-- Logs begin at Sun 2022-08-07 00:10:40 UTC, end at Sun 2022-08-07 02:51:36 UTC. -- Aug 07 00:51:24.524895 n-d-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Aug 07 00:51:24.533798 n-d-master-1 devstack@keystone.service[80478]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 07 00:51:24.535810 n-d-master-1 devstack@keystone.service[80478]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 7 00:51:24 2022] *** Aug 07 00:51:24.535810 n-d-master-1 devstack@keystone.service[80478]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 07 00:51:24.535810 n-d-master-1 devstack@keystone.service[80478]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 07 00:51:24.535810 n-d-master-1 devstack@keystone.service[80478]: nodename: n-d-master-1 Aug 07 00:51:24.535810 n-d-master-1 devstack@keystone.service[80478]: machine: x86_64 Aug 07 00:51:24.535810 n-d-master-1 devstack@keystone.service[80478]: clock source: unix Aug 07 00:51:24.535810 n-d-master-1 devstack@keystone.service[80478]: pcre jit disabled Aug 07 00:51:24.536346 n-d-master-1 devstack@keystone.service[80478]: detected number of CPU cores: 4 Aug 07 00:51:24.536346 n-d-master-1 devstack@keystone.service[80478]: current working directory: / Aug 07 00:51:24.536346 n-d-master-1 devstack@keystone.service[80478]: detected binary path: /usr/bin/uwsgi-core Aug 07 00:51:24.536346 n-d-master-1 devstack@keystone.service[80478]: your processes number limit is 47680 Aug 07 00:51:24.536346 n-d-master-1 devstack@keystone.service[80478]: your memory page size is 4096 bytes Aug 07 00:51:24.536346 n-d-master-1 devstack@keystone.service[80478]: detected max file descriptor number: 2048 Aug 07 00:51:24.536346 n-d-master-1 devstack@keystone.service[80478]: lock engine: pthread robust mutexes Aug 07 00:51:24.541190 n-d-master-1 devstack@keystone.service[80478]: thunder lock: enabled Aug 07 00:51:24.541190 n-d-master-1 devstack@keystone.service[80478]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 07 00:51:24.541190 n-d-master-1 devstack@keystone.service[80478]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 07 00:51:24.576017 n-d-master-1 devstack@keystone.service[80478]: Python main interpreter initialized at 0x55a4af5949c0 Aug 07 00:51:24.576017 n-d-master-1 devstack@keystone.service[80478]: python threads support enabled Aug 07 00:51:24.576017 n-d-master-1 devstack@keystone.service[80478]: your server socket listen backlog is limited to 100 connections Aug 07 00:51:24.576017 n-d-master-1 devstack@keystone.service[80478]: your mercy for graceful operations on workers is 90 seconds Aug 07 00:51:24.576429 n-d-master-1 devstack@keystone.service[80478]: mapped 403077 bytes (393 KB) for 2 cores Aug 07 00:51:24.576429 n-d-master-1 devstack@keystone.service[80478]: *** Operational MODE: preforking *** Aug 07 00:51:24.576715 n-d-master-1 devstack@keystone.service[80478]: *** uWSGI is running in multiple interpreter mode *** Aug 07 00:51:24.576715 n-d-master-1 devstack@keystone.service[80478]: spawned uWSGI master process (pid: 80478) Aug 07 00:51:24.576928 n-d-master-1 systemd[1]: Started Devstack devstack@keystone.service. Aug 07 00:51:24.578332 n-d-master-1 devstack@keystone.service[80478]: spawned uWSGI worker 1 (pid: 80492, cores: 1) Aug 07 00:51:24.578332 n-d-master-1 devstack@keystone.service[80478]: spawned uWSGI worker 2 (pid: 80493, cores: 1) Aug 07 00:51:24.578332 n-d-master-1 devstack@keystone.service[80478]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 07 00:51:30.119613 n-d-master-1 devstack@keystone.service[80493]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 00:51:30.119613 n-d-master-1 devstack@keystone.service[80493]: from cryptography.utils import int_from_bytes Aug 07 00:51:30.120441 n-d-master-1 devstack@keystone.service[80493]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 00:51:30.120441 n-d-master-1 devstack@keystone.service[80493]: from cryptography.utils import int_from_bytes Aug 07 00:51:30.121874 n-d-master-1 devstack@keystone.service[80492]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 00:51:30.121874 n-d-master-1 devstack@keystone.service[80492]: from cryptography.utils import int_from_bytes Aug 07 00:51:30.122325 n-d-master-1 devstack@keystone.service[80492]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 07 00:51:30.122325 n-d-master-1 devstack@keystone.service[80492]: from cryptography.utils import int_from_bytes Aug 07 00:51:30.169465 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 00:51:30.169651 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 00:51:30.169833 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] command line args: [] {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 00:51:30.170101 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 00:51:30.170281 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ================================================================================ {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 00:51:30.170594 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] admin_token = **** {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.170863 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 07 00:51:30.170949 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] config_dir = [] {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.171088 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 07 00:51:30.171168 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.171284 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] command line args: [] {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 07 00:51:30.171363 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] config_source = [] {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.171518 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] debug = True {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.171601 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 07 00:51:30.171723 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ================================================================================ {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 07 00:51:30.171805 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.172010 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] admin_token = **** {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.172177 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.172263 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] config_dir = [] {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.172392 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.172477 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.172587 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] config_source = [] {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.172717 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.172806 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] debug = True {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.172969 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.173075 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.173783 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.173864 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] list_limit = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.173959 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.174066 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] log_config_append = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.174262 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.174380 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.174482 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.174593 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] log_dir = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.174717 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] list_limit = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.174837 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] log_file = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.174956 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] log_config_append = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.175068 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.175179 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.175179 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] log_dir = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.175446 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.175559 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] log_file = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.175677 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.175794 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.175794 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.176051 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.176051 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.176316 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.176470 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.176591 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.176591 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.176824 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.176947 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.177068 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.177181 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.177293 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.177417 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.177531 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.177641 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.177641 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.177854 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.177978 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.178098 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.178218 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.178330 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.178446 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.178557 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.178666 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.178789 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.178902 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.179201 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.179374 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.179520 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] publish_errors = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.179634 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] publish_errors = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.179746 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.179857 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.180003 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.180124 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.180237 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.180348 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.180458 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.180588 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.180710 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.180829 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] standard_threads = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.180941 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.181057 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.181176 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.181357 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] standard_threads = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.181473 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.181473 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] use_journal = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.181684 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.181796 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] use_json = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.181907 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.182016 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] use_stderr = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.182016 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] use_syslog = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.182232 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.182232 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] use_journal = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.182490 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.182615 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] use_json = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.182737 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.182857 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] use_stderr = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.182969 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.183080 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] use_syslog = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.183203 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.183325 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 07 00:51:30.183438 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.183555 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.183673 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.183673 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.183907 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.184033 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.184147 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.184259 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.184376 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.184488 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.184599 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.184717 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.184830 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.184941 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.185058 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.185228 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.185344 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.185463 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.185576 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.185688 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.185895 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.186013 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.186158 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.186283 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.186407 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.186590 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.186707 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.186884 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.187006 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.187194 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.187367 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.187488 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.187630 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.187747 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.187900 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.188102 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.188220 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.188378 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.188501 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.188620 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.188834 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.188973 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.189094 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.189206 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.189318 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.189519 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.189636 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.189760 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.189872 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.189985 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.190215 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.190331 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.190449 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.190572 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.190692 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.190810 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.190923 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.191036 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.191147 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.191267 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.191380 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.191497 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.191615 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.191734 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.191855 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.192014 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.192128 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.192238 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.192359 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.192472 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.192594 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.192707 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.192818 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.192930 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.193041 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.193153 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.193343 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.193459 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.193578 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.193691 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.193802 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.193919 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.194040 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.194153 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.194271 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.194383 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.194500 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.194613 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.194732 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.194845 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.194957 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.195058 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.195168 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.195280 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.195403 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.195516 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.195628 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.195745 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.195857 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.195983 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.196107 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.196220 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.196333 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.196445 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.196556 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.196701 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.196833 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.196947 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.197059 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.197179 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.197179 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.197391 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.197514 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.197628 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.197740 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.197851 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.197963 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.198074 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.198199 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.198322 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.198437 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.198557 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.198671 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.198783 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.198895 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.199015 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.199135 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.199247 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.199359 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.199472 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.199592 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.199713 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.199836 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.199990 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.200106 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.200227 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.200341 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.200454 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.200575 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.200690 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.200802 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.200914 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.201027 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.201139 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.201263 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.201376 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.201489 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.201609 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.201722 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.201843 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.201958 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.202077 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.202191 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.202303 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.202400 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.202502 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.202604 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.202699 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.202792 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.202886 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.202979 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.203084 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.203179 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.203286 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.203382 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.203477 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.203590 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.203712 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.203817 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.203942 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.204049 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.204163 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.204275 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.204467 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.204585 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.204689 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.204689 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.204898 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.205010 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.205123 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.205246 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.205371 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.205485 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.205589 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.205704 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.205816 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.205929 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.206050 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.206050 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.206264 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.206366 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.206489 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.206610 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.206722 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] auth.external = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.206838 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.206951 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.207064 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.207180 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.207294 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.207420 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.207535 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.207648 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] auth.password = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.207760 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.207863 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] auth.token = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.208036 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.208152 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.208265 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.208377 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.208496 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.208610 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.208753 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.208876 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.208992 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.209113 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.209229 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.209342 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.209456 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.209568 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.209690 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] auth.external = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.209813 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] credential.caching = True {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.209938 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.210054 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.210173 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.210289 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.210411 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.210526 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.210639 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] auth.password = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.210751 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.210864 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] auth.token = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.210978 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.211100 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.211215 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.211328 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.211441 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.211554 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.211667 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.211788 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.211917 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.212034 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.212148 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.212261 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.212375 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.212501 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.212622 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.212737 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] credential.caching = True {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.212850 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.212970 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.213086 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.213211 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.213327 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.213440 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.213553 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] federation.caching = True {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.213666 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.213779 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.213904 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.213904 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.214121 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.214240 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.214367 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.214482 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.214604 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.214718 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.214832 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.214947 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.215060 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.215174 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.215296 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.215667 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.215786 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.215914 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.216030 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.216144 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.216271 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.216387 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.216506 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.216627 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] federation.caching = True {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.216742 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] identity.caching = True {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.216855 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.216977 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.217092 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.217206 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.217320 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.217433 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.217547 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.217667 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.217782 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.217896 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.218017 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.218131 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.218244 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.218434 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.218550 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.218664 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.218777 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.218890 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.219003 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.219125 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.219245 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.219361 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.219474 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] identity.caching = True {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.219588 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.219713 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.219828 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.220504 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.220695 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.220811 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.220925 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.221052 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.221169 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.221284 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.221397 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.221513 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.221513 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.221735 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.221851 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.221965 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.222078 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.222192 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.222305 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.222427 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.222544 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.222658 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.222771 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.222885 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.222999 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.223125 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.223244 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.223358 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.223358 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.223578 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.223692 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.223814 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.223943 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.224059 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.224173 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.224286 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.224399 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.224525 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.224642 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.224756 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.224869 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.224983 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.225095 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.225218 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.225332 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.225446 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.225560 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.225674 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.225787 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.225908 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.226024 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.226138 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.226251 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.226365 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.226478 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.226599 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.226715 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.226829 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.226942 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.227055 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.227168 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.227289 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.227404 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.227518 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.227631 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.227746 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.227859 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.228016 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.228133 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.228246 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.228360 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.228473 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.228586 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.228711 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.228828 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.228942 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.229055 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.229169 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.229282 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.user = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.229403 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.229518 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.229632 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.229632 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.229853 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.229853 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.230076 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.230076 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.230290 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.230403 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.230516 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.230630 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.230752 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.230867 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.230981 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.231095 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.231247 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.231379 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.231496 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.231663 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.231781 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.231914 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.user = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.232032 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.232159 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.232275 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.232389 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.232503 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.232616 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.232729 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.232851 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.232967 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.233081 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.233197 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.233312 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.233425 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.233547 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.233662 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.233776 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.233890 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.234003 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.234117 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.234239 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.234354 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.234467 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.234580 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.234694 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.234807 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.234929 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.235044 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.235159 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.235272 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.235386 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.235499 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.236231 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.236356 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.236471 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.236585 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.236709 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.236825 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.236948 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.237063 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.237178 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.237293 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.237406 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.237519 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.237642 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.237757 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.237870 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.237983 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.238097 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.238211 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.238333 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.238448 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.238562 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.238675 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] resource.caching = True {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.238789 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.238902 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.239024 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.239138 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.239253 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.239366 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.239480 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.239593 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.239716 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.239831 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.239960 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.240075 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.240188 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.240301 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.240431 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.240548 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.240662 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.240775 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.240888 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.241001 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] role.caching = True {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.241124 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] resource.caching = True {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.241239 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] role.driver = sql {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.241354 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.241467 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.241587 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.241702 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.241890 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.242007 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.242122 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.242235 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.242348 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.242462 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.242584 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.242699 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.242813 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.242926 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.243039 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.243153 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.243281 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.243396 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.243511 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] role.caching = True {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.243623 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.243737 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] role.driver = sql {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.243850 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.243998 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.244115 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.244229 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.244342 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.244456 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.244580 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.244696 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.244696 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.244910 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.245023 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.245136 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.245257 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.245372 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.245486 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.245600 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.245713 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.245826 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.245948 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.246069 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.246184 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.246297 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.246411 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.246524 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.246647 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.246647 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.246862 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.246862 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.247075 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.247188 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.247310 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.247424 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.247538 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.247653 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.247766 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.247879 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.247879 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.248208 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.248321 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.248435 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.248554 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.248669 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.248792 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.248907 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.249021 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.249134 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.249247 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] token.caching = True {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.249360 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.249482 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.249596 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.249710 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.249824 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.249938 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.250059 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.250174 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.250287 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.250400 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.250513 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.250626 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.250747 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.250863 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.250977 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.251090 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.251226 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.251347 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.251471 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.251586 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.251700 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] token.caching = True {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.251813 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.251941 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.252056 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.252182 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.252299 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.252413 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.252526 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.252639 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.252752 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.252873 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.252989 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.253102 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.253218 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.253332 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.253332 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.253556 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] database.connection = **** {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.253680 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.253807 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.253923 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.254037 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.254151 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.254264 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.254378 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.254500 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.254615 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.254728 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.254841 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.254955 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.255068 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.255190 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.255305 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.255419 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.255419 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.255632 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.255745 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.255866 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] database.connection = **** {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.256022 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.256147 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.256263 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.256377 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.256491 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.256605 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.256727 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.256842 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.256956 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.257070 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.257184 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.257298 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.257419 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.257534 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.257648 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.257762 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.257875 n-d-master-1 devstack@keystone.service[80492]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 00:51:30.257990 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.257990 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.257990 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.257990 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.257990 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.258512 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.258512 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.258512 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.258833 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.258971 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 07 00:51:30.259142 n-d-master-1 devstack@keystone.service[80493]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 07 00:51:30.288497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.288726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.288952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.292508 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.292783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.293014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.299084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.304202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.328314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.328538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.332060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.332294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.382065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.384433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.432758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.432997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.433936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.434174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.497287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.497449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.497594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.497678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.497772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.497851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.497925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.498061 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.498146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.498281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.498377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.498544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.521905 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.522135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.522296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.522401 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.522533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.522617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.522763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.522846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.522972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.523055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.523181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.523261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.523399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.523616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.534732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.535109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.547355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.547584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.547723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.547824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.547981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.548145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.548248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.548361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.548455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.548578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.548659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.548779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80493) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.548857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.549056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80492) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 07 00:51:30.565570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.565779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 07 00:51:30.566123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.566322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 07 00:51:30.566402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.566586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 07 00:51:30.566667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.566862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.566944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.567109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.567191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 07 00:51:30.567365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.567448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.567629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.567900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.568178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.578747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.579028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.579821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.580114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.580205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.580393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.580666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.580952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.587086 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.587877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.590163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.590449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.590735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.590962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.591078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.591251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.591352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.591542 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.591630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.591814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.591911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.592115 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.592203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.592385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.592482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.592658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.592747 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.592926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.593009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.593198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.593483 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.593749 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.616376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.617871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.617965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.618158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.619621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.619760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.622803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.623084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.623367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.624443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.624732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.625021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.630539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.630828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.632171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.632462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.634935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.635230 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.635525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.635821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.636134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.636435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.636580 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.636720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.636881 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.637007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.637168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.637453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.637734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.638016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.638292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.638564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.654080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.654377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.658513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.658627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.658816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.661771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.662072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.664346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.666487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.667591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.668272 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.670567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.672344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.673798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.674098 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.674385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.674681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.674962 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.675254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.675630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.678861 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.679162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.679449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.679737 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.680062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.680363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.691733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.692046 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.692318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.692584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.697037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.697335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.697606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.697876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.699534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.701126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.701407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.704251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.705087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.705397 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.705691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.705976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.706644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.708242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.708522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.711312 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.711604 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.711921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.712225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.712505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.717365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.717654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.717938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.718226 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.718514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.718795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.719078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.724251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.724535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.724820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.725105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.725392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.725675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.725965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.735791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.738770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.741721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.742613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.743292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.744825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.745119 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.745412 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.745604 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.748643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.750174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.752254 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.752395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.752555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.752878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.754015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.756962 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.757257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.757541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.757815 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.759304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.760965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.763907 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.764207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.764496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.764778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.765873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.766166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.766446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.773226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.773520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.773804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.773887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80493) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.774160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.774440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.774716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.774989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.775264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.775546 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.775822 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.776234 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.776510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.776792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.777055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.777333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.777598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80493) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.780723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80492) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 07 00:51:30.781014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.781301 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.781584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.781862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.782154 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.782979 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.783256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.783643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.783957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.784248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.784519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.784798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.785064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80492) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 07 00:51:30.811772 n-d-master-1 devstack@keystone.service[80493]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a4af5949c0 pid: 80493 (default app) Aug 07 00:51:30.815109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb2c31-d682-4499-83a2-61333fdc064c None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:30.815395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb2c31-d682-4499-83a2-61333fdc064c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:30.815668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb2c31-d682-4499-83a2-61333fdc064c None None] PATH_INFO: `/v3` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:30.819587 n-d-master-1 devstack@keystone.service[80492]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a4af5949c0 pid: 80492 (default app) Aug 07 00:51:30.819967 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 791 bytes} [Sun Aug 7 00:51:30 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:38.421833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d4ac5-b3bd-48aa-a8d1-386455f52350 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:38.422398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d4ac5-b3bd-48aa-a8d1-386455f52350 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:38.422398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d4ac5-b3bd-48aa-a8d1-386455f52350 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:38.427419 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:51:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:51:38.432808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5deaee1-2d46-4741-9c9f-5e2346a34927 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:38.433296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5deaee1-2d46-4741-9c9f-5e2346a34927 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:38.433386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5deaee1-2d46-4741-9c9f-5e2346a34927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:38.503278 n-d-master-1 devstack@keystone.service[80493]: INFO dbcounter [None req-e5deaee1-2d46-4741-9c9f-5e2346a34927 None None] Registered counter for database keystone Aug 07 00:51:38.523089 n-d-master-1 devstack@keystone.service[80493]: DEBUG oslo_db.sqlalchemy.engines [None req-e5deaee1-2d46-4741-9c9f-5e2346a34927 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80493) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 00:51:38.529324 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writer thread running {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 00:51:38.706795 n-d-master-1 devstack@keystone.service[80493]: DEBUG passlib.handlers.bcrypt [None req-e5deaee1-2d46-4741-9c9f-5e2346a34927 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80493) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 07 00:51:38.707133 n-d-master-1 devstack@keystone.service[80493]: DEBUG passlib.handlers.bcrypt [None req-e5deaee1-2d46-4741-9c9f-5e2346a34927 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80493) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 07 00:51:38.769142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e5deaee1-2d46-4741-9c9f-5e2346a34927 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:38.770767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e5deaee1-2d46-4741-9c9f-5e2346a34927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:38.909679 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2/3] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 478 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 07 00:51:39.027188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d4ac5-b3bd-48aa-a8d1-386455f52350 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:39.110137 n-d-master-1 devstack@keystone.service[80492]: INFO dbcounter [None req-088d4ac5-b3bd-48aa-a8d1-386455f52350 None None] Registered counter for database keystone Aug 07 00:51:39.131863 n-d-master-1 devstack@keystone.service[80492]: DEBUG oslo_db.sqlalchemy.engines [None req-088d4ac5-b3bd-48aa-a8d1-386455f52350 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80492) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 07 00:51:39.138424 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writer thread running {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 07 00:51:39.257974 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d4ac5-b3bd-48aa-a8d1-386455f52350 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:39.262159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a047b7-49cb-4209-b8da-df39da872dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:39.262779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a047b7-49cb-4209-b8da-df39da872dee admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:39.263056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a047b7-49cb-4209-b8da-df39da872dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:39.263335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a047b7-49cb-4209-b8da-df39da872dee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:39.271898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a047b7-49cb-4209-b8da-df39da872dee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:39.322889 n-d-master-1 devstack@keystone.service[80492]: WARNING keystone.common.rbac_enforcer.enforcer [None req-46a047b7-49cb-4209-b8da-df39da872dee admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 07 00:51:39.323227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a047b7-49cb-4209-b8da-df39da872dee admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:39.333790 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1324 bytes} [Sun Aug 7 00:51:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 00:51:39.339684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5deaee1-2d46-4741-9c9f-5e2346a34927 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:39.354402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5deaee1-2d46-4741-9c9f-5e2346a34927 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:39.358774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f7df9-af69-40c8-b2a7-eac0ae8457ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:39.359876 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f7df9-af69-40c8-b2a7-eac0ae8457ba admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:39.360185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f7df9-af69-40c8-b2a7-eac0ae8457ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:39.360455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f7df9-af69-40c8-b2a7-eac0ae8457ba admin admin] PATH_INFO: `/v3/projects/62e0ba2ccef34e34b7ab3788b1ce6bb8` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:39.361907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f7df9-af69-40c8-b2a7-eac0ae8457ba admin admin] RBAC: Authorizing `identity:get_project(project_id=62e0ba2ccef34e34b7ab3788b1ce6bb8)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:39.412856 n-d-master-1 devstack@keystone.service[80493]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7f4f7df9-af69-40c8-b2a7-eac0ae8457ba admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 07 00:51:39.413195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f7df9-af69-40c8-b2a7-eac0ae8457ba admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:39.417908 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3/5] 10.222.0.39 () {56 vars in 1207 bytes} [Sun Aug 7 00:51:39 2022] GET /identity/v3/projects/62e0ba2ccef34e34b7ab3788b1ce6bb8 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:41.402189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f42d9-b986-40f3-9826-3a3981790394 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:41.402756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f42d9-b986-40f3-9826-3a3981790394 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:41.402756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f42d9-b986-40f3-9826-3a3981790394 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:41.406967 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3/6] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:51:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:51:41.413467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf1f14-0457-4549-8742-de719140de4d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:41.414024 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf1f14-0457-4549-8742-de719140de4d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:41.414024 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf1f14-0457-4549-8742-de719140de4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:41.436636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-19cf1f14-0457-4549-8742-de719140de4d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:41.438163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-19cf1f14-0457-4549-8742-de719140de4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:41.446109 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4/7] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 07 00:51:41.467852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f42d9-b986-40f3-9826-3a3981790394 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:41.480423 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f42d9-b986-40f3-9826-3a3981790394 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:41.484652 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7e256-4bd3-4e09-8770-0ad0a1ca2c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:41.485255 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7e256-4bd3-4e09-8770-0ad0a1ca2c0d admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:41.485538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7e256-4bd3-4e09-8770-0ad0a1ca2c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:41.485856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7e256-4bd3-4e09-8770-0ad0a1ca2c0d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:41.494062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7e256-4bd3-4e09-8770-0ad0a1ca2c0d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:41.495909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7e256-4bd3-4e09-8770-0ad0a1ca2c0d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:41.505403 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4/8] 10.222.0.39 () {58 vars in 1324 bytes} [Sun Aug 7 00:51:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 00:51:41.511212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf1f14-0457-4549-8742-de719140de4d None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:41.521806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf1f14-0457-4549-8742-de719140de4d None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:41.526282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88af226-a74f-4007-b740-6ddf0998ddc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:41.526905 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88af226-a74f-4007-b740-6ddf0998ddc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:41.527187 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88af226-a74f-4007-b740-6ddf0998ddc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:41.527463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88af226-a74f-4007-b740-6ddf0998ddc4 admin admin] PATH_INFO: `/v3/users/e6bf2139d86940dda0c8934f84df710d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:41.528836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88af226-a74f-4007-b740-6ddf0998ddc4 admin admin] RBAC: Authorizing `identity:get_user(user_id=e6bf2139d86940dda0c8934f84df710d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:41.530656 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88af226-a74f-4007-b740-6ddf0998ddc4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:41.532224 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 5/9] 10.222.0.39 () {56 vars in 1198 bytes} [Sun Aug 7 00:51:41 2022] GET /identity/v3/users/e6bf2139d86940dda0c8934f84df710d => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:43.581328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fbb67-39d2-4ac5-b665-7f3a70fd9265 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:43.581872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fbb67-39d2-4ac5-b665-7f3a70fd9265 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:43.581872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fbb67-39d2-4ac5-b665-7f3a70fd9265 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:43.583321 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:43.588795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df679ba8-ac1b-4746-830e-c91cb62fd900 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:43.589252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df679ba8-ac1b-4746-830e-c91cb62fd900 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:43.589466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df679ba8-ac1b-4746-830e-c91cb62fd900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:43.607669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-df679ba8-ac1b-4746-830e-c91cb62fd900 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:43.608873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-df679ba8-ac1b-4746-830e-c91cb62fd900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:43.616111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f5ef1-dd05-4bbc-9629-081c241ffea9 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:43.616393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f5ef1-dd05-4bbc-9629-081c241ffea9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:43.616666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f5ef1-dd05-4bbc-9629-081c241ffea9 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:43.618148 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 6/11] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:51:43.622958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77909b30-0b04-45c0-ad69-1376ad04710b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:43.623246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77909b30-0b04-45c0-ad69-1376ad04710b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:43.623520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77909b30-0b04-45c0-ad69-1376ad04710b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:43.667548 n-d-master-1 devstack@keystone.service[80492]: DEBUG passlib.handlers.bcrypt [None req-77909b30-0b04-45c0-ad69-1376ad04710b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80492) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 07 00:51:43.668005 n-d-master-1 devstack@keystone.service[80492]: DEBUG passlib.handlers.bcrypt [None req-77909b30-0b04-45c0-ad69-1376ad04710b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80492) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 07 00:51:43.689695 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 6/12] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:51:43.712134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df679ba8-ac1b-4746-830e-c91cb62fd900 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:43.713984 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-77909b30-0b04-45c0-ad69-1376ad04710b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:43.715599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-77909b30-0b04-45c0-ad69-1376ad04710b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:43.737434 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:43.818463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df679ba8-ac1b-4746-830e-c91cb62fd900 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:43.818698 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 7/13] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:51:43.840920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77909b30-0b04-45c0-ad69-1376ad04710b None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:43.866502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d4f37-3a8b-4569-9b3b-2e47842af5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:43.867144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d4f37-3a8b-4569-9b3b-2e47842af5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:43.867590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d4f37-3a8b-4569-9b3b-2e47842af5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:43.867858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d4f37-3a8b-4569-9b3b-2e47842af5a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:43.880056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d4f37-3a8b-4569-9b3b-2e47842af5a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:51:43.889112 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-815d4f37-3a8b-4569-9b3b-2e47842af5a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:51:43.889112 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:43.889112 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:43.889112 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:43.889112 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:43.889112 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:43.889112 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:43.889112 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:43.889112 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:43.889112 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:43.889112 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:43.889112 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:43.889112 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:51:43.889112 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:51:43.889112 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:51:43.889112 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:51:43.890081 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:51:43.890081 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:51:43.890081 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:51:43.890081 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:51:43.890081 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:43.890081 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:43.890081 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:43.890081 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:43.890081 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:43.890081 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:43.890081 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:43.890081 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:43.890081 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:43.890081 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:43.890081 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:43.890081 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:43.890885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:43.890885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:43.890885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:43.890885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:43.890885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:51:43.890885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:51:43.890885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:51:43.890885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:51:43.890885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:51:43.890885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:51:43.890885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:51:43.890885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:51:43.890885 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 7/14] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:51:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:51:43.896872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d4f37-3a8b-4569-9b3b-2e47842af5a9 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:43.945695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77909b30-0b04-45c0-ad69-1376ad04710b None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:43.948273 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:43.981754 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:43.985503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758e4a3-efb4-4ca0-a7d0-551e40ba343b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:43.986905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758e4a3-efb4-4ca0-a7d0-551e40ba343b None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:43.987177 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758e4a3-efb4-4ca0-a7d0-551e40ba343b None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:43.987445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758e4a3-efb4-4ca0-a7d0-551e40ba343b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:44.002848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d4f37-3a8b-4569-9b3b-2e47842af5a9 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:44.037409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769e17a-91d2-4d50-ac4b-c08f8ebd25b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:44.038020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769e17a-91d2-4d50-ac4b-c08f8ebd25b4 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:44.038301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769e17a-91d2-4d50-ac4b-c08f8ebd25b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:44.038576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769e17a-91d2-4d50-ac4b-c08f8ebd25b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:44.039259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f769e17a-91d2-4d50-ac4b-c08f8ebd25b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:44.039592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f769e17a-91d2-4d50-ac4b-c08f8ebd25b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:44.041034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f769e17a-91d2-4d50-ac4b-c08f8ebd25b4 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:44.053302 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 8/15] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:51:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:51:44.055513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758e4a3-efb4-4ca0-a7d0-551e40ba343b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:44.057074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758e4a3-efb4-4ca0-a7d0-551e40ba343b None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:44.058819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769e17a-91d2-4d50-ac4b-c08f8ebd25b4 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:44.179390 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 8/16] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:51:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 00:51:44.185239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758e4a3-efb4-4ca0-a7d0-551e40ba343b None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:44.188526 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:44.277744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769e17a-91d2-4d50-ac4b-c08f8ebd25b4 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:44.296917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758e4a3-efb4-4ca0-a7d0-551e40ba343b None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:44.312416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef0209-17c2-4982-8716-96f9718cb25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:44.313048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef0209-17c2-4982-8716-96f9718cb25c None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:44.313329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef0209-17c2-4982-8716-96f9718cb25c None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:44.313600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef0209-17c2-4982-8716-96f9718cb25c None admin] PATH_INFO: `/v3/users/e6bf2139d86940dda0c8934f84df710d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:44.314763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef0209-17c2-4982-8716-96f9718cb25c None admin] RBAC: Authorizing `identity:get_user(user_id=e6bf2139d86940dda0c8934f84df710d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:44.316252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef0209-17c2-4982-8716-96f9718cb25c None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:44.318014 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 9/17] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:51:44 2022] GET /identity/v3/users/e6bf2139d86940dda0c8934f84df710d => generated 247 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:51:44.323182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef0209-17c2-4982-8716-96f9718cb25c None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:44.330084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac6f7d-be8c-4c58-b89c-4a6a8025daff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:44.330929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac6f7d-be8c-4c58-b89c-4a6a8025daff None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:44.331212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac6f7d-be8c-4c58-b89c-4a6a8025daff None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:44.331487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac6f7d-be8c-4c58-b89c-4a6a8025daff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:44.337970 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:44.350188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac6f7d-be8c-4c58-b89c-4a6a8025daff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:44.351643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac6f7d-be8c-4c58-b89c-4a6a8025daff None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:44.370057 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-32ac6f7d-be8c-4c58-b89c-4a6a8025daff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:51:44.370057 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:44.370057 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:44.370057 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:44.370057 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:44.370057 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:44.370057 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:44.370057 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:44.370057 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:44.370057 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:44.370057 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:44.370057 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:44.370057 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:51:44.370057 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:51:44.370057 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:51:44.370057 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:51:44.370923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:44.370923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:44.370923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:44.370923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:44.370923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:44.370923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:44.370923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:44.370923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:44.370923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:44.370923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:44.370923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:44.370923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:44.370923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:44.370923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:44.370923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:44.370923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:44.370923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:51:44.371716 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:51:44.371716 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:51:44.371716 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:51:44.371716 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 9/18] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:51:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:51:44.377102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac6f7d-be8c-4c58-b89c-4a6a8025daff None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:44.426120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef0209-17c2-4982-8716-96f9718cb25c None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:44.434119 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:44.459987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4852a-1b6b-4fb9-9b09-0ea5bc585f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:44.460990 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4852a-1b6b-4fb9-9b09-0ea5bc585f7e None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:44.461274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4852a-1b6b-4fb9-9b09-0ea5bc585f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:44.461543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4852a-1b6b-4fb9-9b09-0ea5bc585f7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:44.462742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4852a-1b6b-4fb9-9b09-0ea5bc585f7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:44.464186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4852a-1b6b-4fb9-9b09-0ea5bc585f7e None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:44.465762 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 10/19] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:51:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:51:44.472062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4852a-1b6b-4fb9-9b09-0ea5bc585f7e None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:44.479574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac6f7d-be8c-4c58-b89c-4a6a8025daff None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:44.514315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91678c-2786-4827-8eb8-8daefa49aec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:44.514943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91678c-2786-4827-8eb8-8daefa49aec2 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:44.515222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91678c-2786-4827-8eb8-8daefa49aec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:44.515497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91678c-2786-4827-8eb8-8daefa49aec2 None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:44.516210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91678c-2786-4827-8eb8-8daefa49aec2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:44.516518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91678c-2786-4827-8eb8-8daefa49aec2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:44.518461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91678c-2786-4827-8eb8-8daefa49aec2 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:44.538016 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 10/20] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:51:44.559322 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:44.581326 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4852a-1b6b-4fb9-9b09-0ea5bc585f7e None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:44.618413 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f2d41-4b82-4efa-a6f9-22ea4ce58355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:44.619110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f2d41-4b82-4efa-a6f9-22ea4ce58355 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:44.619302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f2d41-4b82-4efa-a6f9-22ea4ce58355 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:44.619573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f2d41-4b82-4efa-a6f9-22ea4ce58355 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:44.620364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f2d41-4b82-4efa-a6f9-22ea4ce58355 None admin] RBAC: Adding query filter params (role.id=695b07606e564668bac7afff4ab6052a, scope.domain.id=default, user.id=e6bf2139d86940dda0c8934f84df710d) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:44.620675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f2d41-4b82-4efa-a6f9-22ea4ce58355 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:44.622169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f2d41-4b82-4efa-a6f9-22ea4ce58355 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:44.629687 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 11/21] 10.222.0.39 () {56 vars in 1322 bytes} [Sun Aug 7 00:51:44 2022] GET /identity/v3/role_assignments?user.id=e6bf2139d86940dda0c8934f84df710d&scope.domain.id=default&role.id=695b07606e564668bac7afff4ab6052a => generated 233 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:51:46.943421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cba2b7-52c6-435e-af7b-baf96e3348a3 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:46.943964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cba2b7-52c6-435e-af7b-baf96e3348a3 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:46.943964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cba2b7-52c6-435e-af7b-baf96e3348a3 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:46.945502 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 11/22] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:46.951226 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec4dce-0dd0-49b2-a3fd-d6742fe3f56b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:46.952138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec4dce-0dd0-49b2-a3fd-d6742fe3f56b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:46.952607 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec4dce-0dd0-49b2-a3fd-d6742fe3f56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:46.990108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d2ec4dce-0dd0-49b2-a3fd-d6742fe3f56b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:46.991310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d2ec4dce-0dd0-49b2-a3fd-d6742fe3f56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:47.078354 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 12/23] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 07 00:51:47.085884 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2380570-b9f4-453a-8a28-9a028c8509e0 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:47.086436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2380570-b9f4-453a-8a28-9a028c8509e0 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:47.086918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2380570-b9f4-453a-8a28-9a028c8509e0 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:47.088469 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 12/24] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:51:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:47.092418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0b930-8c90-4e2c-bfe2-feaa31c3695b None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:47.092772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0b930-8c90-4e2c-bfe2-feaa31c3695b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:47.093053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0b930-8c90-4e2c-bfe2-feaa31c3695b None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:47.094370 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 13/25] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:47.103417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9360e2-e426-4da1-af8c-f152d12f9550 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:47.103603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7cb4e-7af0-4bf3-ad00-1a06954f6650 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:47.103811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7cb4e-7af0-4bf3-ad00-1a06954f6650 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:47.104126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7cb4e-7af0-4bf3-ad00-1a06954f6650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:47.104492 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9360e2-e426-4da1-af8c-f152d12f9550 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:47.104951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9360e2-e426-4da1-af8c-f152d12f9550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:47.129237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-87d7cb4e-7af0-4bf3-ad00-1a06954f6650 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:47.130419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-87d7cb4e-7af0-4bf3-ad00-1a06954f6650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:47.143467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9b9360e2-e426-4da1-af8c-f152d12f9550 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:47.145046 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9b9360e2-e426-4da1-af8c-f152d12f9550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:47.203176 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 14/26] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:51:47.204497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7cb4e-7af0-4bf3-ad00-1a06954f6650 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:47.207736 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:47.278527 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 13/27] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:51:47.279709 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9360e2-e426-4da1-af8c-f152d12f9550 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:47.316061 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7cb4e-7af0-4bf3-ad00-1a06954f6650 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:47.355073 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32142d54-9af1-4ea8-a020-bb3a69c43c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:47.356118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32142d54-9af1-4ea8-a020-bb3a69c43c27 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:47.356693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32142d54-9af1-4ea8-a020-bb3a69c43c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:47.357170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32142d54-9af1-4ea8-a020-bb3a69c43c27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:47.360325 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:47.371163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32142d54-9af1-4ea8-a020-bb3a69c43c27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:51:47.377352 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-32142d54-9af1-4ea8-a020-bb3a69c43c27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:51:47.377352 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:47.377352 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:47.377352 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:47.377352 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:47.377352 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:47.377352 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:47.377352 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:47.377352 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:47.377352 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:47.377352 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:47.377352 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:47.377352 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:51:47.377352 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:51:47.377352 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:51:47.377352 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:51:47.378190 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:51:47.378190 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:51:47.378190 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:51:47.378190 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:51:47.378190 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:47.378190 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:47.378190 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:47.378190 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:47.378190 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:47.378190 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:47.378190 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:47.378190 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:47.378190 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:47.378190 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:47.378190 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:47.378190 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:47.378942 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:47.378942 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:47.378942 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:47.378942 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:47.378942 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:51:47.378942 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:51:47.378942 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:51:47.378942 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:51:47.378942 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:51:47.378942 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:51:47.378942 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:51:47.378942 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:51:47.382144 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 15/28] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:51:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:47.383173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32142d54-9af1-4ea8-a020-bb3a69c43c27 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:47.460055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9360e2-e426-4da1-af8c-f152d12f9550 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:47.460237 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:47.504455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad259dd-2552-477b-833e-9f672badcbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:47.505482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad259dd-2552-477b-833e-9f672badcbf2 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:47.506049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad259dd-2552-477b-833e-9f672badcbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:47.506509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad259dd-2552-477b-833e-9f672badcbf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:47.509957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32142d54-9af1-4ea8-a020-bb3a69c43c27 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:47.520264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad259dd-2552-477b-833e-9f672badcbf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:47.522485 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad259dd-2552-477b-833e-9f672badcbf2 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:47.550460 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-fad259dd-2552-477b-833e-9f672badcbf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:51:47.550460 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:47.550460 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:47.550460 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:47.550460 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:47.550460 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:47.550460 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:47.550460 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:47.550460 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:47.550460 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:47.550460 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:47.550460 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:47.550460 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:51:47.550460 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:51:47.550460 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:51:47.550460 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:51:47.551367 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:47.551367 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:47.551367 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:47.551367 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:47.551367 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:47.551367 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:47.551367 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:47.551367 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:47.551367 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:47.551367 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:47.551367 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:47.551367 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:47.551367 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:47.551367 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:47.551367 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:47.551367 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:47.551367 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:51:47.552223 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:51:47.552223 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:51:47.552223 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:51:47.552378 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd717abd-c622-413e-8293-c16fa2b08aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:47.552378 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd717abd-c622-413e-8293-c16fa2b08aa8 None admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:47.552378 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd717abd-c622-413e-8293-c16fa2b08aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:47.552378 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd717abd-c622-413e-8293-c16fa2b08aa8 None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:47.552727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd717abd-c622-413e-8293-c16fa2b08aa8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:47.554308 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 14/29] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:51:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:47.554571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd717abd-c622-413e-8293-c16fa2b08aa8 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:47.555588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad259dd-2552-477b-833e-9f672badcbf2 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:47.707054 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 16/30] 10.222.0.39 () {60 vars in 1131 bytes} [Sun Aug 7 00:51:47 2022] POST /identity/v3/roles => generated 219 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:51:47.708669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2fcc3-9194-49a1-afe5-d70c99a363bc None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:47.709183 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2fcc3-9194-49a1-afe5-d70c99a363bc None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:47.709780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2fcc3-9194-49a1-afe5-d70c99a363bc None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:47.711845 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 17/31] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:51:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:47.712894 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2fcc3-9194-49a1-afe5-d70c99a363bc None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:47.819403 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:47.827012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad259dd-2552-477b-833e-9f672badcbf2 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:47.905887 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58bb74-bf21-43ac-9e04-19c480fe0fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:47.909090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58bb74-bf21-43ac-9e04-19c480fe0fae None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:47.909090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58bb74-bf21-43ac-9e04-19c480fe0fae None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:47.909090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58bb74-bf21-43ac-9e04-19c480fe0fae None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:47.909501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc58bb74-bf21-43ac-9e04-19c480fe0fae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:47.909792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc58bb74-bf21-43ac-9e04-19c480fe0fae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:47.911131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc58bb74-bf21-43ac-9e04-19c480fe0fae None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:47.931741 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 15/32] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:51:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:47.933386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddcc3e-0d76-4e92-b19a-ed8aeb8f42a9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:47.933881 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddcc3e-0d76-4e92-b19a-ed8aeb8f42a9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:47.934384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddcc3e-0d76-4e92-b19a-ed8aeb8f42a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:47.954555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-4dddcc3e-0d76-4e92-b19a-ed8aeb8f42a9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:47.956531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4dddcc3e-0d76-4e92-b19a-ed8aeb8f42a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:47.969171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2fcc3-9194-49a1-afe5-d70c99a363bc None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:48.016467 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:48.037300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3c8ec-88a6-4287-aa4e-2694c6045039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:48.038819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3c8ec-88a6-4287-aa4e-2694c6045039 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:48.038819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3c8ec-88a6-4287-aa4e-2694c6045039 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:48.039213 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3c8ec-88a6-4287-aa4e-2694c6045039 None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:48.040392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3c8ec-88a6-4287-aa4e-2694c6045039 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:48.040912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3c8ec-88a6-4287-aa4e-2694c6045039 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:48.043872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3c8ec-88a6-4287-aa4e-2694c6045039 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:48.060006 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 16/33] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:51:48.061312 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dddcc3e-0d76-4e92-b19a-ed8aeb8f42a9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:48.083049 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 18/34] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:48.093586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3c8ec-88a6-4287-aa4e-2694c6045039 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:48.194970 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:48.208331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dddcc3e-0d76-4e92-b19a-ed8aeb8f42a9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:48.252143 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c383e1-3a03-425e-952f-f50416090cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:48.253144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c383e1-3a03-425e-952f-f50416090cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:48.253520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c383e1-3a03-425e-952f-f50416090cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:48.253895 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c383e1-3a03-425e-952f-f50416090cf7 None admin] PATH_INFO: `/v3/users/e6bf2139d86940dda0c8934f84df710d` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:48.255813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c383e1-3a03-425e-952f-f50416090cf7 None admin] RBAC: Authorizing `identity:get_user(user_id=e6bf2139d86940dda0c8934f84df710d)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:48.257872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c383e1-3a03-425e-952f-f50416090cf7 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:48.266539 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 17/35] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:51:48 2022] GET /identity/v3/users/e6bf2139d86940dda0c8934f84df710d => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:48.266539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c383e1-3a03-425e-952f-f50416090cf7 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:48.269565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3c8ec-88a6-4287-aa4e-2694c6045039 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:48.332134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b493bb-e9c5-4da5-aa24-536526d2aee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:48.334171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b493bb-e9c5-4da5-aa24-536526d2aee6 None admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:48.334791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b493bb-e9c5-4da5-aa24-536526d2aee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:48.335447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b493bb-e9c5-4da5-aa24-536526d2aee6 None admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:48.336799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b493bb-e9c5-4da5-aa24-536526d2aee6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:48.339700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b493bb-e9c5-4da5-aa24-536526d2aee6 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:48.387985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c383e1-3a03-425e-952f-f50416090cf7 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:48.396273 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 19/36] 10.222.0.39 () {60 vars in 1141 bytes} [Sun Aug 7 00:51:48 2022] POST /identity/v3/projects => generated 301 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 00:51:48.398754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b493bb-e9c5-4da5-aa24-536526d2aee6 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:48.435621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024b9b2-c469-42ab-969e-34da50e1b34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:48.436904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024b9b2-c469-42ab-969e-34da50e1b34b None admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:48.437194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024b9b2-c469-42ab-969e-34da50e1b34b None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:48.437475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024b9b2-c469-42ab-969e-34da50e1b34b None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:48.440278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7024b9b2-c469-42ab-969e-34da50e1b34b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:48.444184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7024b9b2-c469-42ab-969e-34da50e1b34b None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:48.493493 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:48.611473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b493bb-e9c5-4da5-aa24-536526d2aee6 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:48.620572 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 18/37] 10.222.0.39 () {60 vars in 1131 bytes} [Sun Aug 7 00:51:48 2022] POST /identity/v3/roles => generated 225 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:51:48.622118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ceb16-41aa-4ad3-bd8a-ed16c4cc5a67 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:48.624276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ceb16-41aa-4ad3-bd8a-ed16c4cc5a67 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:48.624565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ceb16-41aa-4ad3-bd8a-ed16c4cc5a67 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:48.625999 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 19/38] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:51:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:48.635614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec764305-fb93-4f3d-a834-c74734caaf70 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:48.636023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec764305-fb93-4f3d-a834-c74734caaf70 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:48.636261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec764305-fb93-4f3d-a834-c74734caaf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:48.661117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ec764305-fb93-4f3d-a834-c74734caaf70 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:48.663918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ec764305-fb93-4f3d-a834-c74734caaf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:48.684745 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:48.707488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b470bab-eb16-4fee-ae0f-78e5bfd352e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:48.709718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b470bab-eb16-4fee-ae0f-78e5bfd352e6 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:48.711136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b470bab-eb16-4fee-ae0f-78e5bfd352e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:48.712307 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b470bab-eb16-4fee-ae0f-78e5bfd352e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:48.714710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b470bab-eb16-4fee-ae0f-78e5bfd352e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:48.718292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b470bab-eb16-4fee-ae0f-78e5bfd352e6 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:48.724527 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 20/39] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:51:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:48.736395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b470bab-eb16-4fee-ae0f-78e5bfd352e6 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:48.775954 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 20/40] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:51:48.799106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec764305-fb93-4f3d-a834-c74734caaf70 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:48.896392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b470bab-eb16-4fee-ae0f-78e5bfd352e6 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:48.899498 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:48.922338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec764305-fb93-4f3d-a834-c74734caaf70 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:48.932540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fa132-f8ce-4c06-ae57-4e643abe3dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:48.933208 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fa132-f8ce-4c06-ae57-4e643abe3dd7 None admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:48.933487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fa132-f8ce-4c06-ae57-4e643abe3dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:48.933768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fa132-f8ce-4c06-ae57-4e643abe3dd7 None admin] PATH_INFO: `/v3/domains/default/users/e6bf2139d86940dda0c8934f84df710d/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:48.935678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fa132-f8ce-4c06-ae57-4e643abe3dd7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e6bf2139d86940dda0c8934f84df710d, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:48.937167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fa132-f8ce-4c06-ae57-4e643abe3dd7 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:48.951358 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 21/41] 10.222.0.39 () {58 vars in 1361 bytes} [Sun Aug 7 00:51:48 2022] PUT /identity/v3/domains/default/users/e6bf2139d86940dda0c8934f84df710d/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 00:51:48.952654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b54d9-f3a8-46c6-a41b-0055458a356a None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:48.952935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b54d9-f3a8-46c6-a41b-0055458a356a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:48.953212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b54d9-f3a8-46c6-a41b-0055458a356a None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:48.955222 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 22/42] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:48.960855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba3cc9-5a37-4aaa-aaf5-4bf68337166f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:48.961034 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cadda8-91f3-49c9-88b3-5fc104eece6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:48.961465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba3cc9-5a37-4aaa-aaf5-4bf68337166f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:48.961465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba3cc9-5a37-4aaa-aaf5-4bf68337166f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:48.966941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cadda8-91f3-49c9-88b3-5fc104eece6d None admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:48.967271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cadda8-91f3-49c9-88b3-5fc104eece6d None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:48.967518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cadda8-91f3-49c9-88b3-5fc104eece6d None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:48.968309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cadda8-91f3-49c9-88b3-5fc104eece6d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:48.969980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cadda8-91f3-49c9-88b3-5fc104eece6d None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:48.982434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0dba3cc9-5a37-4aaa-aaf5-4bf68337166f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:48.984084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0dba3cc9-5a37-4aaa-aaf5-4bf68337166f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:48.995926 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 21/43] 10.222.0.39 () {60 vars in 1131 bytes} [Sun Aug 7 00:51:48 2022] POST /identity/v3/roles => generated 223 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 00:51:49.076883 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 23/44] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:51:49.101396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cadda8-91f3-49c9-88b3-5fc104eece6d None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:49.114259 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:49.217188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cadda8-91f3-49c9-88b3-5fc104eece6d None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:49.250543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f959a5-7f84-425c-a564-768e6a7f5e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:49.251219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f959a5-7f84-425c-a564-768e6a7f5e65 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:49.252048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f959a5-7f84-425c-a564-768e6a7f5e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:49.252319 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f959a5-7f84-425c-a564-768e6a7f5e65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:49.253464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f959a5-7f84-425c-a564-768e6a7f5e65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:49.254905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f959a5-7f84-425c-a564-768e6a7f5e65 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:49.256488 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 22/45] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:51:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:49.262305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba3cc9-5a37-4aaa-aaf5-4bf68337166f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:49.353365 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:49.361106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba3cc9-5a37-4aaa-aaf5-4bf68337166f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:49.395427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498d3b4-aea9-427d-acf3-35a93474e505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:49.396066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498d3b4-aea9-427d-acf3-35a93474e505 None admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:49.396352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498d3b4-aea9-427d-acf3-35a93474e505 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:49.396879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498d3b4-aea9-427d-acf3-35a93474e505 None admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:49.397535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498d3b4-aea9-427d-acf3-35a93474e505 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:49.398981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498d3b4-aea9-427d-acf3-35a93474e505 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:49.434612 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 24/46] 10.222.0.39 () {60 vars in 1141 bytes} [Sun Aug 7 00:51:49 2022] POST /identity/v3/projects => generated 312 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:51:50.986443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d5a39-7e69-4ab4-bf45-f945288bcff4 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:50.986855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d5a39-7e69-4ab4-bf45-f945288bcff4 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:50.986985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d5a39-7e69-4ab4-bf45-f945288bcff4 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:50.988378 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 23/47] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:50.993660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405a79d-73a9-43ca-a4ec-2fb043c9eb0d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:50.994110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405a79d-73a9-43ca-a4ec-2fb043c9eb0d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:50.994198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405a79d-73a9-43ca-a4ec-2fb043c9eb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:51.012591 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e405a79d-73a9-43ca-a4ec-2fb043c9eb0d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:51.013778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e405a79d-73a9-43ca-a4ec-2fb043c9eb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:51.083978 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 25/48] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:51:51.106121 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d5a39-7e69-4ab4-bf45-f945288bcff4 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:51.184603 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:51.208507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d5a39-7e69-4ab4-bf45-f945288bcff4 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:51.242731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851edc00-e13a-421d-a849-3b8decb271c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:51.243285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851edc00-e13a-421d-a849-3b8decb271c6 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:51.243565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851edc00-e13a-421d-a849-3b8decb271c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:51.243839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851edc00-e13a-421d-a849-3b8decb271c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:51.255441 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851edc00-e13a-421d-a849-3b8decb271c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:51:51.261365 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-851edc00-e13a-421d-a849-3b8decb271c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:51:51.261365 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:51.261365 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:51.261365 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:51.261365 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:51.261365 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:51.261365 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:51.261365 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:51.261365 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:51.261365 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:51.261365 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:51.261365 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:51.261365 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:51:51.261365 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:51:51.261365 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:51:51.261365 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:51:51.262330 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:51:51.262330 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:51:51.262330 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:51:51.262330 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:51:51.262330 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:51.262330 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:51.262330 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:51.262330 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:51.262330 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:51.262330 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:51.262330 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:51.262330 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:51.262330 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:51.262330 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:51.262330 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:51.262330 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:51.263165 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:51.263165 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:51.263165 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:51.263165 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:51.263165 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:51:51.263165 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:51:51.263165 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:51:51.263165 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:51:51.263165 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:51:51.263165 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:51:51.263165 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:51:51.263165 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:51:51.263165 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 24/49] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:51:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:51.269083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405a79d-73a9-43ca-a4ec-2fb043c9eb0d None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:51.344078 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:51.367768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405a79d-73a9-43ca-a4ec-2fb043c9eb0d None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:51.401128 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9c926-ac7b-4b38-89b4-795e4f7683b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:51.401732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9c926-ac7b-4b38-89b4-795e4f7683b8 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:51.402008 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9c926-ac7b-4b38-89b4-795e4f7683b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:51.402276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9c926-ac7b-4b38-89b4-795e4f7683b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:51.402942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf9c926-ac7b-4b38-89b4-795e4f7683b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:51.403238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf9c926-ac7b-4b38-89b4-795e4f7683b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:51.404636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf9c926-ac7b-4b38-89b4-795e4f7683b8 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:51.413457 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 26/50] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:51:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:51.420083 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851edc00-e13a-421d-a849-3b8decb271c6 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:51.436574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a7ae4-025d-42c3-be12-42c88c9a43a8 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:51.436852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a7ae4-025d-42c3-be12-42c88c9a43a8 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:51.437123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a7ae4-025d-42c3-be12-42c88c9a43a8 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:51.438451 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 27/51] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:51:51.443735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7cada-2153-41ce-a452-c9202434af54 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:51.444067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7cada-2153-41ce-a452-c9202434af54 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:51.444341 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7cada-2153-41ce-a452-c9202434af54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:51.462035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9da7cada-2153-41ce-a452-c9202434af54 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:51.463215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9da7cada-2153-41ce-a452-c9202434af54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:51.527365 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851edc00-e13a-421d-a849-3b8decb271c6 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:51.532256 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 28/52] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:51:51.554889 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7cada-2153-41ce-a452-c9202434af54 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:51.561969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b834e7-8265-4d22-9eb0-26a775194699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:51.562603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b834e7-8265-4d22-9eb0-26a775194699 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:51.562889 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b834e7-8265-4d22-9eb0-26a775194699 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:51.563159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b834e7-8265-4d22-9eb0-26a775194699 None admin] PATH_INFO: `/v3/users/e6bf2139d86940dda0c8934f84df710d` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:51.564348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b834e7-8265-4d22-9eb0-26a775194699 None admin] RBAC: Authorizing `identity:get_user(user_id=e6bf2139d86940dda0c8934f84df710d)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:51.565798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b834e7-8265-4d22-9eb0-26a775194699 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:51.567373 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 25/53] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:51:51 2022] GET /identity/v3/users/e6bf2139d86940dda0c8934f84df710d => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:51.572853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b834e7-8265-4d22-9eb0-26a775194699 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:51.576388 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:51.621317 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:51.657047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7cada-2153-41ce-a452-c9202434af54 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:51.672888 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b834e7-8265-4d22-9eb0-26a775194699 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:51.692400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c4e17-66b9-4158-b55c-e9ec3442c2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:51.693410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c4e17-66b9-4158-b55c-e9ec3442c2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:51.693410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c4e17-66b9-4158-b55c-e9ec3442c2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:51.693743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c4e17-66b9-4158-b55c-e9ec3442c2b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:51.694976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c4e17-66b9-4158-b55c-e9ec3442c2b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:51.696604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c4e17-66b9-4158-b55c-e9ec3442c2b8 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:51.698347 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 29/54] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:51:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:51:51.704837 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c4e17-66b9-4158-b55c-e9ec3442c2b8 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:51.708152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429bd55-99c8-4606-9951-cf3943bb253a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:51.709607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429bd55-99c8-4606-9951-cf3943bb253a None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:51.709879 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429bd55-99c8-4606-9951-cf3943bb253a None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:51.710158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429bd55-99c8-4606-9951-cf3943bb253a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:51.711292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429bd55-99c8-4606-9951-cf3943bb253a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:51.712793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429bd55-99c8-4606-9951-cf3943bb253a None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:51.714799 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 26/55] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:51:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:51:51.721286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429bd55-99c8-4606-9951-cf3943bb253a None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:51.789817 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:51.805982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c4e17-66b9-4158-b55c-e9ec3442c2b8 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:51.824311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429bd55-99c8-4606-9951-cf3943bb253a None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:51.842025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5742ce-dc4f-4ff7-a002-916e56797d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:51.842877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5742ce-dc4f-4ff7-a002-916e56797d16 None admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:51.843155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5742ce-dc4f-4ff7-a002-916e56797d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:51.843422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5742ce-dc4f-4ff7-a002-916e56797d16 None admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:51.844108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5742ce-dc4f-4ff7-a002-916e56797d16 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:51.846048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5742ce-dc4f-4ff7-a002-916e56797d16 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:51.851384 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:51.862717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149b25e-524d-4da8-82b7-1dd805cd8ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:51.863326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149b25e-524d-4da8-82b7-1dd805cd8ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:51.863631 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149b25e-524d-4da8-82b7-1dd805cd8ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:51.863897 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149b25e-524d-4da8-82b7-1dd805cd8ec0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:51.864665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149b25e-524d-4da8-82b7-1dd805cd8ec0 None admin] RBAC: Adding query filter params (role.id=695b07606e564668bac7afff4ab6052a, scope.domain.id=default, user.id=e6bf2139d86940dda0c8934f84df710d) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:51.864999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149b25e-524d-4da8-82b7-1dd805cd8ec0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:51.866517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149b25e-524d-4da8-82b7-1dd805cd8ec0 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:51.873733 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 30/56] 10.222.0.39 () {60 vars in 1140 bytes} [Sun Aug 7 00:51:51 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 00:51:51.875915 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 27/57] 10.222.0.39 () {56 vars in 1322 bytes} [Sun Aug 7 00:51:51 2022] GET /identity/v3/role_assignments?user.id=e6bf2139d86940dda0c8934f84df710d&scope.domain.id=default&role.id=695b07606e564668bac7afff4ab6052a => generated 530 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:53.914477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584431aa-4c08-4af8-a5a0-ae7bb7fc9d18 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:53.914998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584431aa-4c08-4af8-a5a0-ae7bb7fc9d18 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:53.914998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584431aa-4c08-4af8-a5a0-ae7bb7fc9d18 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:53.916401 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 31/58] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:53.921578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f15b8-5700-4e52-a57a-91fbf1615a66 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:53.921982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f15b8-5700-4e52-a57a-91fbf1615a66 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:53.922132 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f15b8-5700-4e52-a57a-91fbf1615a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:53.940318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-db0f15b8-5700-4e52-a57a-91fbf1615a66 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:53.941503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-db0f15b8-5700-4e52-a57a-91fbf1615a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:54.006891 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 28/59] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:51:54.031517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584431aa-4c08-4af8-a5a0-ae7bb7fc9d18 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:54.131153 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584431aa-4c08-4af8-a5a0-ae7bb7fc9d18 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:54.164347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8145afbe-e6b9-4566-81ee-556264043343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:54.165016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145afbe-e6b9-4566-81ee-556264043343 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:54.165250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145afbe-e6b9-4566-81ee-556264043343 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:54.165524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8145afbe-e6b9-4566-81ee-556264043343 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:54.166642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8145afbe-e6b9-4566-81ee-556264043343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:54.168121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8145afbe-e6b9-4566-81ee-556264043343 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:54.169731 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 32/60] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:51:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:54.175449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f15b8-5700-4e52-a57a-91fbf1615a66 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:54.239105 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:54.274749 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f15b8-5700-4e52-a57a-91fbf1615a66 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:54.307830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81334486-16c8-44a2-a583-a502dcba6b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:54.308471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81334486-16c8-44a2-a583-a502dcba6b87 None admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:54.308756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81334486-16c8-44a2-a583-a502dcba6b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:54.309030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81334486-16c8-44a2-a583-a502dcba6b87 None admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:54.309670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81334486-16c8-44a2-a583-a502dcba6b87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:54.311120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81334486-16c8-44a2-a583-a502dcba6b87 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:54.337967 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 29/61] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Aug 7 00:51:54 2022] POST /identity/v3/users => generated 275 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:51:57.622206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893802a9-ae3a-4ece-80fb-c67adf5562ee None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:57.623223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893802a9-ae3a-4ece-80fb-c67adf5562ee None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:57.623703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893802a9-ae3a-4ece-80fb-c67adf5562ee None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:57.625370 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 33/62] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:51:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:57.631516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957184fb-8f1b-42de-84b2-a8df94503023 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:57.632005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957184fb-8f1b-42de-84b2-a8df94503023 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:57.632076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957184fb-8f1b-42de-84b2-a8df94503023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:57.661905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-957184fb-8f1b-42de-84b2-a8df94503023 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:57.663110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-957184fb-8f1b-42de-84b2-a8df94503023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:57.738192 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffc0c4-1962-4090-b411-94940c2094e3 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:57.738505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffc0c4-1962-4090-b411-94940c2094e3 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:57.738751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffc0c4-1962-4090-b411-94940c2094e3 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:57.740292 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 34/63] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:51:57.745411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4161f-b5af-492f-91c6-0771828bcc5d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:57.745698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4161f-b5af-492f-91c6-0771828bcc5d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:57.745980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4161f-b5af-492f-91c6-0771828bcc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:57.765251 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 30/64] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:51:57.780928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-39c4161f-b5af-492f-91c6-0771828bcc5d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:57.782150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-39c4161f-b5af-492f-91c6-0771828bcc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:57.788694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957184fb-8f1b-42de-84b2-a8df94503023 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:57.874362 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:57.876972 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:57.912647 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 35/65] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:51:57.921551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7237c-5dbc-43bb-b0a0-056a8f5d6346 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:57.922055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7237c-5dbc-43bb-b0a0-056a8f5d6346 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:57.922469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7237c-5dbc-43bb-b0a0-056a8f5d6346 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:57.924071 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 36/66] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:51:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:57.933279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842b0e0-cc35-433d-90be-314671df7bf7 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:57.933768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842b0e0-cc35-433d-90be-314671df7bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:57.934205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842b0e0-cc35-433d-90be-314671df7bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:57.946305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957184fb-8f1b-42de-84b2-a8df94503023 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:57.965089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7842b0e0-cc35-433d-90be-314671df7bf7 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:57.966508 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7842b0e0-cc35-433d-90be-314671df7bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:57.997916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce0d50-bff8-47c1-8bc4-5947d934237e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:57.998563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce0d50-bff8-47c1-8bc4-5947d934237e None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:57.998837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce0d50-bff8-47c1-8bc4-5947d934237e None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:57.999105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce0d50-bff8-47c1-8bc4-5947d934237e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:58.010567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce0d50-bff8-47c1-8bc4-5947d934237e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:51:58.015824 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-47ce0d50-bff8-47c1-8bc4-5947d934237e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:51:58.015824 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:58.015824 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:58.015824 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:58.015824 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:58.015824 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:58.015824 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:58.015824 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:58.015824 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:58.015824 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:58.015824 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:58.015824 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:58.015824 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:51:58.015824 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:51:58.015824 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:51:58.015824 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:51:58.016780 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:51:58.016780 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:51:58.016780 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:51:58.016780 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:51:58.016780 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:58.016780 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:58.016780 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:58.016780 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:58.016780 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:58.016780 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:58.016780 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:58.016780 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:58.016780 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:58.016780 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:58.016780 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:58.016780 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:58.017615 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:58.017615 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:58.017615 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:58.017615 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:58.017615 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:51:58.017615 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:51:58.017615 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:51:58.017615 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:51:58.017615 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:51:58.017615 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:51:58.017615 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:51:58.017615 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:51:58.017615 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 31/67] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:51:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:51:58.021112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce0d50-bff8-47c1-8bc4-5947d934237e None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:58.049429 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 37/68] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:51:58.051124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e3876-e589-4e9d-8000-561f87e2142b None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:58.051415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e3876-e589-4e9d-8000-561f87e2142b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:58.051732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e3876-e589-4e9d-8000-561f87e2142b None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:58.053130 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 38/69] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:58.053750 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e3876-e589-4e9d-8000-561f87e2142b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:58.128105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce0d50-bff8-47c1-8bc4-5947d934237e None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:58.140826 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:58.158769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e3876-e589-4e9d-8000-561f87e2142b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:58.162964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc25af-727d-4d75-93e0-61984e272561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:58.163698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc25af-727d-4d75-93e0-61984e272561 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:58.164106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc25af-727d-4d75-93e0-61984e272561 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:58.164383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc25af-727d-4d75-93e0-61984e272561 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:58.175991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc25af-727d-4d75-93e0-61984e272561 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:51:58.176614 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:58.180952 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-74cc25af-727d-4d75-93e0-61984e272561 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:51:58.180952 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:58.180952 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:58.180952 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:58.180952 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:58.180952 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:58.180952 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:58.180952 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:58.180952 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:58.180952 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:58.180952 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:58.180952 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:58.180952 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:51:58.180952 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:51:58.180952 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:51:58.180952 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:51:58.181784 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:51:58.181784 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:51:58.181784 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:51:58.181784 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:51:58.181784 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:58.181784 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:58.181784 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:58.181784 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:58.181784 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:58.181784 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:58.181784 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:58.181784 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:58.181784 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:58.181784 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:58.181784 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:58.181784 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:58.182552 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:58.182552 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:58.182552 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:58.182552 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:58.182552 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:51:58.182552 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:51:58.182552 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:51:58.182552 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:51:58.182552 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:51:58.182552 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:51:58.182552 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:51:58.182552 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:51:58.182552 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 32/70] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:51:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:58.183431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0f2b9-d51f-4715-a89b-1c5606ee522a None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:58.183699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0f2b9-d51f-4715-a89b-1c5606ee522a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:58.183850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0f2b9-d51f-4715-a89b-1c5606ee522a None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:58.185132 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 33/71] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:51:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:51:58.186155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d474f15-9e98-423e-beca-07b0e2e29ece None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:58.186440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d474f15-9e98-423e-beca-07b0e2e29ece None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:58.186708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d474f15-9e98-423e-beca-07b0e2e29ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:58.199221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c44204-e9cd-4192-80b8-3c0f2663a330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:58.199840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c44204-e9cd-4192-80b8-3c0f2663a330 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:58.200196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c44204-e9cd-4192-80b8-3c0f2663a330 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:58.200463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c44204-e9cd-4192-80b8-3c0f2663a330 None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:58.201176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c44204-e9cd-4192-80b8-3c0f2663a330 None admin] RBAC: Adding query filter params (name=member) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:58.201475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c44204-e9cd-4192-80b8-3c0f2663a330 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:58.202875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c44204-e9cd-4192-80b8-3c0f2663a330 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:58.208052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2d474f15-9e98-423e-beca-07b0e2e29ece None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:58.209287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2d474f15-9e98-423e-beca-07b0e2e29ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:58.212398 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 39/72] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Aug 7 00:51:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:58.213046 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c44204-e9cd-4192-80b8-3c0f2663a330 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:58.280928 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 34/73] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:51:58.284245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d474f15-9e98-423e-beca-07b0e2e29ece None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:58.320863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c44204-e9cd-4192-80b8-3c0f2663a330 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:58.356801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3883f-522c-4e1a-9eea-c72edd894ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:58.357412 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3883f-522c-4e1a-9eea-c72edd894ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:58.357690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3883f-522c-4e1a-9eea-c72edd894ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:58.357961 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3883f-522c-4e1a-9eea-c72edd894ca6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:58.369563 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3883f-522c-4e1a-9eea-c72edd894ca6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:51:58.374885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-aec3883f-522c-4e1a-9eea-c72edd894ca6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:51:58.374885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:58.374885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:58.374885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:58.374885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:58.374885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:58.374885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:58.374885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:58.374885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:58.374885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:58.374885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:58.374885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:58.374885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:51:58.374885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:51:58.374885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:51:58.374885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:51:58.375743 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:51:58.375743 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:51:58.375743 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:51:58.375743 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:51:58.375743 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:58.375743 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:58.375743 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:58.375743 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:58.375743 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:58.375743 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:58.375743 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:58.375743 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:58.375743 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:58.375743 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:58.375743 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:58.375743 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:58.377043 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:58.377043 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:58.377043 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:58.377043 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:58.377043 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:51:58.377043 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:51:58.377043 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:51:58.377043 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:51:58.377043 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:51:58.377043 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:51:58.377043 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:51:58.377043 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:51:58.377043 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 40/74] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Aug 7 00:51:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:58.377902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef740d9-8fc0-4a4b-9be4-40014c2a92f1 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:58.378204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef740d9-8fc0-4a4b-9be4-40014c2a92f1 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:58.378476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef740d9-8fc0-4a4b-9be4-40014c2a92f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:58.390449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d474f15-9e98-423e-beca-07b0e2e29ece None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:58.392200 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:58.396659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-aef740d9-8fc0-4a4b-9be4-40014c2a92f1 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:51:58.398136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-aef740d9-8fc0-4a4b-9be4-40014c2a92f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:51:58.425535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969582ea-6d23-4a51-ba75-3c7c3ec14598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:58.426158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969582ea-6d23-4a51-ba75-3c7c3ec14598 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:58.426444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969582ea-6d23-4a51-ba75-3c7c3ec14598 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:58.426717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969582ea-6d23-4a51-ba75-3c7c3ec14598 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:58.427390 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969582ea-6d23-4a51-ba75-3c7c3ec14598 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:58.427700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969582ea-6d23-4a51-ba75-3c7c3ec14598 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:58.428113 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:58.429166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969582ea-6d23-4a51-ba75-3c7c3ec14598 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:58.437687 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 35/75] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:51:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:58.439006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969582ea-6d23-4a51-ba75-3c7c3ec14598 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:58.470687 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 41/76] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:51:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:51:58.471543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef740d9-8fc0-4a4b-9be4-40014c2a92f1 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:58.543113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969582ea-6d23-4a51-ba75-3c7c3ec14598 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:58.577405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf80ad-e6cb-45d1-9d05-9977ffa3da04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:58.578156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf80ad-e6cb-45d1-9d05-9977ffa3da04 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:58.578438 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf80ad-e6cb-45d1-9d05-9977ffa3da04 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:58.578729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf80ad-e6cb-45d1-9d05-9977ffa3da04 None admin] PATH_INFO: `/v3/users/54ec182a52e14c09bda7b43dbb5c8427` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:58.580035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef740d9-8fc0-4a4b-9be4-40014c2a92f1 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:58.596207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf80ad-e6cb-45d1-9d05-9977ffa3da04 None admin] RBAC: Authorizing `identity:get_user(user_id=54ec182a52e14c09bda7b43dbb5c8427)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:58.597673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf80ad-e6cb-45d1-9d05-9977ffa3da04 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:58.599685 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 36/77] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:51:58 2022] GET /identity/v3/users/54ec182a52e14c09bda7b43dbb5c8427 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:58.600504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf80ad-e6cb-45d1-9d05-9977ffa3da04 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:58.621875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b360c-a57a-4994-88a8-5fa084978061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:58.622517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b360c-a57a-4994-88a8-5fa084978061 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:58.623074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b360c-a57a-4994-88a8-5fa084978061 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:58.623074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b360c-a57a-4994-88a8-5fa084978061 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:58.624199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b360c-a57a-4994-88a8-5fa084978061 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:58.625492 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:58.625678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b360c-a57a-4994-88a8-5fa084978061 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:58.627797 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 42/78] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:51:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:58.628796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b360c-a57a-4994-88a8-5fa084978061 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:58.666041 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:58.707158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf80ad-e6cb-45d1-9d05-9977ffa3da04 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:58.734199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b360c-a57a-4994-88a8-5fa084978061 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:58.747014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad23384-bf1d-483a-8983-c99bc4561082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:58.747679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad23384-bf1d-483a-8983-c99bc4561082 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:58.747991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad23384-bf1d-483a-8983-c99bc4561082 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:58.748267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad23384-bf1d-483a-8983-c99bc4561082 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:58.748949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad23384-bf1d-483a-8983-c99bc4561082 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:58.749251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad23384-bf1d-483a-8983-c99bc4561082 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:58.750632 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad23384-bf1d-483a-8983-c99bc4561082 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:58.758731 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 37/79] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:51:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:58.759534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad23384-bf1d-483a-8983-c99bc4561082 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:58.774037 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f3bc8-4df2-4257-933a-934f6685235d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:58.774673 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f3bc8-4df2-4257-933a-934f6685235d None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:58.774950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f3bc8-4df2-4257-933a-934f6685235d None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:58.775219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f3bc8-4df2-4257-933a-934f6685235d None admin] PATH_INFO: `/v3/users/e6bf2139d86940dda0c8934f84df710d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:58.776417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f3bc8-4df2-4257-933a-934f6685235d None admin] RBAC: Authorizing `identity:get_user(user_id=e6bf2139d86940dda0c8934f84df710d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:58.777879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f3bc8-4df2-4257-933a-934f6685235d None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:58.779487 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 43/80] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:51:58 2022] GET /identity/v3/users/e6bf2139d86940dda0c8934f84df710d => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:58.780290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f3bc8-4df2-4257-933a-934f6685235d None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:58.851309 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:58.868605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad23384-bf1d-483a-8983-c99bc4561082 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:58.881442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f3bc8-4df2-4257-933a-934f6685235d None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:58.883920 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:58.904504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648675ae-e2f7-42ce-ba77-b3c9c027aed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:58.905139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648675ae-e2f7-42ce-ba77-b3c9c027aed3 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:58.905414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648675ae-e2f7-42ce-ba77-b3c9c027aed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:58.905683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648675ae-e2f7-42ce-ba77-b3c9c027aed3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:58.915556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648675ae-e2f7-42ce-ba77-b3c9c027aed3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:51:58.917156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd24818-a776-4185-b081-17ff31c9a899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:58.917764 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd24818-a776-4185-b081-17ff31c9a899 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:58.918045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd24818-a776-4185-b081-17ff31c9a899 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:58.918317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd24818-a776-4185-b081-17ff31c9a899 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:58.920671 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-648675ae-e2f7-42ce-ba77-b3c9c027aed3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:51:58.920671 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:51:58.920671 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:51:58.920671 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:51:58.920671 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:51:58.920671 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:51:58.920671 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:51:58.920671 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:51:58.920671 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:51:58.920671 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:51:58.920671 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:51:58.920671 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:51:58.920671 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:51:58.920671 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:51:58.920671 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:51:58.920671 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:51:58.921630 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:51:58.921630 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:51:58.921630 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:51:58.921630 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:51:58.921630 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:51:58.921630 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:51:58.921630 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:51:58.921630 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:51:58.921630 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:51:58.921630 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:51:58.921630 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:51:58.921630 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:51:58.921630 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:51:58.921630 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:51:58.921630 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:51:58.921630 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:51:58.922565 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:51:58.922565 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:51:58.922565 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:51:58.922565 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:51:58.922565 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:51:58.922565 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:51:58.922565 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:51:58.922565 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:51:58.922565 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:51:58.922565 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:51:58.922565 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:51:58.922565 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:51:58.922565 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 38/81] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:51:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:51:58.922565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648675ae-e2f7-42ce-ba77-b3c9c027aed3 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:58.995059 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd24818-a776-4185-b081-17ff31c9a899 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:58.996621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd24818-a776-4185-b081-17ff31c9a899 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:59.028246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648675ae-e2f7-42ce-ba77-b3c9c027aed3 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:59.061387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707531d-1287-41e2-aa59-486f6b0b0224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:59.061991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707531d-1287-41e2-aa59-486f6b0b0224 None admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:59.062268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707531d-1287-41e2-aa59-486f6b0b0224 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:59.062538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707531d-1287-41e2-aa59-486f6b0b0224 None admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:59.063176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707531d-1287-41e2-aa59-486f6b0b0224 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:59.064749 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707531d-1287-41e2-aa59-486f6b0b0224 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:59.082590 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:59.087836 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 39/82] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Aug 7 00:51:58 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:51:59.088593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707531d-1287-41e2-aa59-486f6b0b0224 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:59.107278 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 44/83] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:51:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:51:59.108704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd24818-a776-4185-b081-17ff31c9a899 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:59.112565 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:59.221929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707531d-1287-41e2-aa59-486f6b0b0224 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:59.226323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd24818-a776-4185-b081-17ff31c9a899 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:59.264664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f64fc-d0f4-443b-aa25-f288cb918827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:59.264984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857310c8-96fa-4e9a-b9bb-339e1c490105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:59.265576 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f64fc-d0f4-443b-aa25-f288cb918827 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:59.265679 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857310c8-96fa-4e9a-b9bb-339e1c490105 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:59.265868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f64fc-d0f4-443b-aa25-f288cb918827 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:59.265960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857310c8-96fa-4e9a-b9bb-339e1c490105 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:59.266134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f64fc-d0f4-443b-aa25-f288cb918827 None admin] PATH_INFO: `/v3/users/54ec182a52e14c09bda7b43dbb5c8427` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:59.266228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857310c8-96fa-4e9a-b9bb-339e1c490105 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:59.267462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f64fc-d0f4-443b-aa25-f288cb918827 None admin] RBAC: Authorizing `identity:get_user(user_id=54ec182a52e14c09bda7b43dbb5c8427)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:59.269021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f64fc-d0f4-443b-aa25-f288cb918827 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:59.270704 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 40/84] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:51:59 2022] GET /identity/v3/users/54ec182a52e14c09bda7b43dbb5c8427 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:59.271516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f64fc-d0f4-443b-aa25-f288cb918827 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:59.351145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857310c8-96fa-4e9a-b9bb-339e1c490105 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:59.353631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857310c8-96fa-4e9a-b9bb-339e1c490105 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:59.354366 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:59.359561 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:59.402939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f64fc-d0f4-443b-aa25-f288cb918827 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:59.444206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c98bd9-f9dc-4da6-90f0-b081b894c860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:59.444993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c98bd9-f9dc-4da6-90f0-b081b894c860 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:59.445422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c98bd9-f9dc-4da6-90f0-b081b894c860 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:59.445851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c98bd9-f9dc-4da6-90f0-b081b894c860 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:59.446538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c98bd9-f9dc-4da6-90f0-b081b894c860 None admin] RBAC: Adding query filter params (name=member) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:51:59.446865 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c98bd9-f9dc-4da6-90f0-b081b894c860 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:59.448307 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c98bd9-f9dc-4da6-90f0-b081b894c860 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:59.459561 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 41/85] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Aug 7 00:51:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:59.461464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c98bd9-f9dc-4da6-90f0-b081b894c860 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:59.489351 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 45/86] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:51:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:51:59.490201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857310c8-96fa-4e9a-b9bb-339e1c490105 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:59.601377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c98bd9-f9dc-4da6-90f0-b081b894c860 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:59.610312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857310c8-96fa-4e9a-b9bb-339e1c490105 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:59.612853 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:59.632811 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:59.640117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059c427-fdd6-49d0-a2d0-91c0d6a5805e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:59.641017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059c427-fdd6-49d0-a2d0-91c0d6a5805e None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:59.641465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059c427-fdd6-49d0-a2d0-91c0d6a5805e None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:59.642425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6059c427-fdd6-49d0-a2d0-91c0d6a5805e None admin] PATH_INFO: `/v3/projects/d48c2e640c56445a9109354f89807e83` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:59.643786 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6059c427-fdd6-49d0-a2d0-91c0d6a5805e None admin] RBAC: Authorizing `identity:get_project(project_id=d48c2e640c56445a9109354f89807e83)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:59.645450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6059c427-fdd6-49d0-a2d0-91c0d6a5805e None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:59.647982 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 42/87] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:51:59 2022] GET /identity/v3/projects/d48c2e640c56445a9109354f89807e83 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:59.649338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059c427-fdd6-49d0-a2d0-91c0d6a5805e None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:59.650212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae74fe-62ed-4b3f-8c21-5b023aead8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:59.651116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae74fe-62ed-4b3f-8c21-5b023aead8fd None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:59.651464 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae74fe-62ed-4b3f-8c21-5b023aead8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:59.651809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae74fe-62ed-4b3f-8c21-5b023aead8fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:59.722855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae74fe-62ed-4b3f-8c21-5b023aead8fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:59.724857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae74fe-62ed-4b3f-8c21-5b023aead8fd None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:59.754787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6059c427-fdd6-49d0-a2d0-91c0d6a5805e None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:59.790594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b6059-0e3e-4655-a276-7d5e376a28b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:59.791515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b6059-0e3e-4655-a276-7d5e376a28b3 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:59.792005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b6059-0e3e-4655-a276-7d5e376a28b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:59.792471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b6059-0e3e-4655-a276-7d5e376a28b3 None admin] PATH_INFO: `/v3/users/54ec182a52e14c09bda7b43dbb5c8427` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:59.793777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b6059-0e3e-4655-a276-7d5e376a28b3 None admin] RBAC: Authorizing `identity:get_user(user_id=54ec182a52e14c09bda7b43dbb5c8427)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:59.795383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b6059-0e3e-4655-a276-7d5e376a28b3 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:59.797549 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 43/88] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:51:59 2022] GET /identity/v3/users/54ec182a52e14c09bda7b43dbb5c8427 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:59.799242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b6059-0e3e-4655-a276-7d5e376a28b3 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:59.831438 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 46/89] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:51:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:51:59.837252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae74fe-62ed-4b3f-8c21-5b023aead8fd None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:51:59.842310 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:59.875770 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:51:59.913810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b6059-0e3e-4655-a276-7d5e376a28b3 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:59.950638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791ab4c-866f-4fe0-bb45-cdc2420eccfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:51:59.951651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791ab4c-866f-4fe0-bb45-cdc2420eccfe None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:51:59.952133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791ab4c-866f-4fe0-bb45-cdc2420eccfe None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:51:59.952581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791ab4c-866f-4fe0-bb45-cdc2420eccfe None admin] PATH_INFO: `/v3/projects/d48c2e640c56445a9109354f89807e83` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:51:59.953919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791ab4c-866f-4fe0-bb45-cdc2420eccfe None admin] RBAC: Authorizing `identity:get_project(project_id=d48c2e640c56445a9109354f89807e83)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:51:59.955628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791ab4c-866f-4fe0-bb45-cdc2420eccfe None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:51:59.957000 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae74fe-62ed-4b3f-8c21-5b023aead8fd None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:51:59.957910 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 44/90] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:51:59 2022] GET /identity/v3/projects/d48c2e640c56445a9109354f89807e83 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:51:59.959010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791ab4c-866f-4fe0-bb45-cdc2420eccfe None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:00.013055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d7a85-f5b6-47c1-8e33-a4a1594521cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:00.014303 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d7a85-f5b6-47c1-8e33-a4a1594521cf None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:00.014731 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d7a85-f5b6-47c1-8e33-a4a1594521cf None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:00.015139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d7a85-f5b6-47c1-8e33-a4a1594521cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:00.016404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d7a85-f5b6-47c1-8e33-a4a1594521cf None admin] RBAC: Adding query filter params (role.id=979b0708a1934c50b706215aa79dbb7a, scope.project.id=d48c2e640c56445a9109354f89807e83, user.id=54ec182a52e14c09bda7b43dbb5c8427) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:00.017485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d7a85-f5b6-47c1-8e33-a4a1594521cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:00.019722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d7a85-f5b6-47c1-8e33-a4a1594521cf None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:00.027507 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 47/91] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:51:59 2022] GET /identity/v3/role_assignments?user.id=54ec182a52e14c09bda7b43dbb5c8427&scope.project.id=d48c2e640c56445a9109354f89807e83&role.id=979b0708a1934c50b706215aa79dbb7a => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:00.028704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d7a85-f5b6-47c1-8e33-a4a1594521cf None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:00.125346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791ab4c-866f-4fe0-bb45-cdc2420eccfe None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:00.165361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016af61-36f0-4caf-ac99-8026392340ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:00.166396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016af61-36f0-4caf-ac99-8026392340ab None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:00.166815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016af61-36f0-4caf-ac99-8026392340ab None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:00.167226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016af61-36f0-4caf-ac99-8026392340ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:00.172497 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:00.206056 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:00.283862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d7a85-f5b6-47c1-8e33-a4a1594521cf None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:00.297819 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016af61-36f0-4caf-ac99-8026392340ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:00.299296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016af61-36f0-4caf-ac99-8026392340ab None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:00.358196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6171d17-ef53-45b4-bd38-ec1bd2354c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:00.358909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6171d17-ef53-45b4-bd38-ec1bd2354c61 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:00.359231 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6171d17-ef53-45b4-bd38-ec1bd2354c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:00.359574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6171d17-ef53-45b4-bd38-ec1bd2354c61 None admin] PATH_INFO: `/v3/projects/d48c2e640c56445a9109354f89807e83` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:00.362507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6171d17-ef53-45b4-bd38-ec1bd2354c61 None admin] RBAC: Authorizing `identity:get_project(project_id=d48c2e640c56445a9109354f89807e83)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:00.364359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6171d17-ef53-45b4-bd38-ec1bd2354c61 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:00.366451 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 48/92] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:00 2022] GET /identity/v3/projects/d48c2e640c56445a9109354f89807e83 => generated 298 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:00.372253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6171d17-ef53-45b4-bd38-ec1bd2354c61 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:00.486272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6171d17-ef53-45b4-bd38-ec1bd2354c61 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:00.529381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aebf33-fc69-4d6b-a772-98087bd7494d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:00.531939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aebf33-fc69-4d6b-a772-98087bd7494d None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:00.531939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aebf33-fc69-4d6b-a772-98087bd7494d None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:00.531939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aebf33-fc69-4d6b-a772-98087bd7494d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:00.531939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aebf33-fc69-4d6b-a772-98087bd7494d None admin] RBAC: Adding query filter params (role.id=695b07606e564668bac7afff4ab6052a, scope.project.id=d48c2e640c56445a9109354f89807e83, user.id=e6bf2139d86940dda0c8934f84df710d) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:00.531939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aebf33-fc69-4d6b-a772-98087bd7494d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:00.533364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aebf33-fc69-4d6b-a772-98087bd7494d None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:00.536885 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:00.539664 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 49/93] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:52:00 2022] GET /identity/v3/role_assignments?user.id=e6bf2139d86940dda0c8934f84df710d&scope.project.id=d48c2e640c56445a9109354f89807e83&role.id=695b07606e564668bac7afff4ab6052a => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:00.542420 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 45/94] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:51:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:52:00.547445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aebf33-fc69-4d6b-a772-98087bd7494d None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:00.549885 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016af61-36f0-4caf-ac99-8026392340ab None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:00.644292 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:00.666868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aebf33-fc69-4d6b-a772-98087bd7494d None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:00.706397 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e40f7b-43dc-4d73-aa9e-aa5c48e97497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:00.707323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e40f7b-43dc-4d73-aa9e-aa5c48e97497 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:00.707610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e40f7b-43dc-4d73-aa9e-aa5c48e97497 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:00.707909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e40f7b-43dc-4d73-aa9e-aa5c48e97497 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:00.708717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e40f7b-43dc-4d73-aa9e-aa5c48e97497 None admin] RBAC: Adding query filter params (role.id=04a874934a0944a2851b5e485a0f0a1b, scope.project.id=d48c2e640c56445a9109354f89807e83, user.id=54ec182a52e14c09bda7b43dbb5c8427) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:00.709028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e40f7b-43dc-4d73-aa9e-aa5c48e97497 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:00.710671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e40f7b-43dc-4d73-aa9e-aa5c48e97497 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:00.717342 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 50/95] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:52:00 2022] GET /identity/v3/role_assignments?user.id=54ec182a52e14c09bda7b43dbb5c8427&scope.project.id=d48c2e640c56445a9109354f89807e83&role.id=04a874934a0944a2851b5e485a0f0a1b => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:00.849985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016af61-36f0-4caf-ac99-8026392340ab None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:00.902795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11b848-0662-476a-b7c5-eac4eb2ebf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:00.903698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11b848-0662-476a-b7c5-eac4eb2ebf45 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:00.904155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11b848-0662-476a-b7c5-eac4eb2ebf45 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:00.904572 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11b848-0662-476a-b7c5-eac4eb2ebf45 None admin] PATH_INFO: `/v3/projects/26407313c821425aaeebf07af0eefbc3` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:00.905858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11b848-0662-476a-b7c5-eac4eb2ebf45 None admin] RBAC: Authorizing `identity:get_project(project_id=26407313c821425aaeebf07af0eefbc3)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:00.908113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11b848-0662-476a-b7c5-eac4eb2ebf45 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:00.910234 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 46/96] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:00 2022] GET /identity/v3/projects/26407313c821425aaeebf07af0eefbc3 => generated 312 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:00.916405 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e40f7b-43dc-4d73-aa9e-aa5c48e97497 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:01.078712 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:01.103314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e40f7b-43dc-4d73-aa9e-aa5c48e97497 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:01.143346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3d2edc-8e65-4a11-8ac8-bfa2829931bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:01.143992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d2edc-8e65-4a11-8ac8-bfa2829931bd None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:01.144776 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d2edc-8e65-4a11-8ac8-bfa2829931bd None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:01.145066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3d2edc-8e65-4a11-8ac8-bfa2829931bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:01.145809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d2edc-8e65-4a11-8ac8-bfa2829931bd None admin] RBAC: Adding query filter params (role.id=979b0708a1934c50b706215aa79dbb7a, scope.project.id=26407313c821425aaeebf07af0eefbc3, user.id=54ec182a52e14c09bda7b43dbb5c8427) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:01.146122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d2edc-8e65-4a11-8ac8-bfa2829931bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:01.148838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3d2edc-8e65-4a11-8ac8-bfa2829931bd None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:01.158120 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 51/97] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:52:00 2022] GET /identity/v3/role_assignments?user.id=54ec182a52e14c09bda7b43dbb5c8427&scope.project.id=26407313c821425aaeebf07af0eefbc3&role.id=979b0708a1934c50b706215aa79dbb7a => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:01.670342 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265127a-7042-4ce7-b30f-b98d921329d0 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:01.670973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265127a-7042-4ce7-b30f-b98d921329d0 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:01.671458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265127a-7042-4ce7-b30f-b98d921329d0 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:01.673633 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 47/98] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:01.679241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c8f45-71b9-4d91-a534-606a55a07c6d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:01.679705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c8f45-71b9-4d91-a534-606a55a07c6d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:01.679778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c8f45-71b9-4d91-a534-606a55a07c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:01.703226 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0c3c8f45-71b9-4d91-a534-606a55a07c6d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:01.705059 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0c3c8f45-71b9-4d91-a534-606a55a07c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:01.798353 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 52/99] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:01.835208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265127a-7042-4ce7-b30f-b98d921329d0 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:01.960673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265127a-7042-4ce7-b30f-b98d921329d0 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:01.962159 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:02.007878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeef77c-aa97-4371-aa81-70f8787f3438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:02.008533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeef77c-aa97-4371-aa81-70f8787f3438 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:02.008809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeef77c-aa97-4371-aa81-70f8787f3438 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:02.009075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeef77c-aa97-4371-aa81-70f8787f3438 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:02.019999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeef77c-aa97-4371-aa81-70f8787f3438 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:02.024941 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-8eeef77c-aa97-4371-aa81-70f8787f3438 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:52:02.024941 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:02.024941 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:02.024941 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:02.024941 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:02.024941 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:02.024941 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:02.024941 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:02.024941 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:02.024941 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:02.024941 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:02.024941 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:02.024941 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:02.024941 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:02.024941 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:02.024941 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:02.025799 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:02.025799 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:02.025799 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:02.025799 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:02.025799 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:02.025799 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:02.025799 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:02.025799 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:02.025799 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:02.025799 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:02.025799 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:02.025799 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:02.025799 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:02.025799 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:02.025799 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:02.025799 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:02.026540 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:02.026540 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:02.026540 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:02.026540 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:02.026540 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:02.026540 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:02.026540 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:02.026540 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:02.026540 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:02.026540 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:02.026540 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:52:02.026540 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:02.026540 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 48/100] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:02.034285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c8f45-71b9-4d91-a534-606a55a07c6d None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:02.104945 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:02.161504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c8f45-71b9-4d91-a534-606a55a07c6d None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:02.204458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e1e05-6e42-4edd-968e-e7de3854a027 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:02.205132 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e1e05-6e42-4edd-968e-e7de3854a027 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:02.205610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e1e05-6e42-4edd-968e-e7de3854a027 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:02.206287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e850a5-cc1f-493b-b253-c3ddaf29f79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:02.206906 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e850a5-cc1f-493b-b253-c3ddaf29f79b None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:02.207183 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e850a5-cc1f-493b-b253-c3ddaf29f79b None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:02.207454 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e850a5-cc1f-493b-b253-c3ddaf29f79b None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:02.208157 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e850a5-cc1f-493b-b253-c3ddaf29f79b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:02.215989 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 49/101] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:52:02.216147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e850a5-cc1f-493b-b253-c3ddaf29f79b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:02.216147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e850a5-cc1f-493b-b253-c3ddaf29f79b None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:02.221236 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 53/102] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Aug 7 00:52:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:02.222995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137d54f-2c37-433c-9b05-a2b0038d0726 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:02.223525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137d54f-2c37-433c-9b05-a2b0038d0726 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:02.224022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137d54f-2c37-433c-9b05-a2b0038d0726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:02.231615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e850a5-cc1f-493b-b253-c3ddaf29f79b None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:02.269685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c137d54f-2c37-433c-9b05-a2b0038d0726 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:02.270895 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c137d54f-2c37-433c-9b05-a2b0038d0726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:02.415319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e850a5-cc1f-493b-b253-c3ddaf29f79b None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:02.426816 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 50/103] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:02.457380 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137d54f-2c37-433c-9b05-a2b0038d0726 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:02.472444 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:02.476653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e398256-3840-4901-a7f0-f599175332a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:02.477661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e398256-3840-4901-a7f0-f599175332a4 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:02.477940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e398256-3840-4901-a7f0-f599175332a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:02.478210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e398256-3840-4901-a7f0-f599175332a4 None admin] PATH_INFO: `/v3/users/dc3bca5944234d4f93a4562ea9643a2f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:02.505014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e398256-3840-4901-a7f0-f599175332a4 None admin] RBAC: Authorizing `identity:get_user(user_id=dc3bca5944234d4f93a4562ea9643a2f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:02.506493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e398256-3840-4901-a7f0-f599175332a4 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:02.516302 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 54/104] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:52:02 2022] GET /identity/v3/users/dc3bca5944234d4f93a4562ea9643a2f => generated 289 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:02.534203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e398256-3840-4901-a7f0-f599175332a4 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:02.652258 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:02.663916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137d54f-2c37-433c-9b05-a2b0038d0726 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:02.665708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e398256-3840-4901-a7f0-f599175332a4 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:02.706468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2089f-8fe8-4846-b347-019a469db9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:02.707132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2089f-8fe8-4846-b347-019a469db9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:02.707369 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2089f-8fe8-4846-b347-019a469db9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:02.707642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2089f-8fe8-4846-b347-019a469db9d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:02.745227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3da14d-8227-462e-898c-4b2ff4922654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:02.745889 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3da14d-8227-462e-898c-4b2ff4922654 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:02.746182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3da14d-8227-462e-898c-4b2ff4922654 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:02.746462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3da14d-8227-462e-898c-4b2ff4922654 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:02.748884 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3da14d-8227-462e-898c-4b2ff4922654 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:02.750467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3da14d-8227-462e-898c-4b2ff4922654 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:02.752149 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 51/105] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:52:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:02.758702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3da14d-8227-462e-898c-4b2ff4922654 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:02.762320 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:02.789043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2089f-8fe8-4846-b347-019a469db9d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:02.790594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2089f-8fe8-4846-b347-019a469db9d0 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:02.912002 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 55/106] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:52:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:52:02.913356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcc4e5-43f0-4248-afdc-70603c4a6d48 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:02.913651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcc4e5-43f0-4248-afdc-70603c4a6d48 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:02.913926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcc4e5-43f0-4248-afdc-70603c4a6d48 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:02.915350 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 56/107] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:02.917021 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcc4e5-43f0-4248-afdc-70603c4a6d48 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:02.945870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3da14d-8227-462e-898c-4b2ff4922654 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:03.015605 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:03.043198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcc4e5-43f0-4248-afdc-70603c4a6d48 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:03.066768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb9f47-08cb-4199-8876-54aa7a662d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:03.067469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb9f47-08cb-4199-8876-54aa7a662d19 None admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:03.067696 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb9f47-08cb-4199-8876-54aa7a662d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:03.068018 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb9f47-08cb-4199-8876-54aa7a662d19 None admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:03.068689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb9f47-08cb-4199-8876-54aa7a662d19 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:03.070176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb9f47-08cb-4199-8876-54aa7a662d19 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:03.084002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea1a03-60db-4f89-a184-657209462cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:03.084642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea1a03-60db-4f89-a184-657209462cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:03.085202 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea1a03-60db-4f89-a184-657209462cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:03.085477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea1a03-60db-4f89-a184-657209462cc1 None admin] PATH_INFO: `/v3/projects/d48c2e640c56445a9109354f89807e83` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:03.087451 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea1a03-60db-4f89-a184-657209462cc1 None admin] RBAC: Authorizing `identity:get_project(project_id=d48c2e640c56445a9109354f89807e83)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:03.088919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea1a03-60db-4f89-a184-657209462cc1 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:03.096014 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 57/108] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:02 2022] GET /identity/v3/projects/d48c2e640c56445a9109354f89807e83 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:03.105342 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912013b7-5fb7-4749-b515-1703a74d2258 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:03.105915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912013b7-5fb7-4749-b515-1703a74d2258 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:03.106389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912013b7-5fb7-4749-b515-1703a74d2258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:03.148088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-912013b7-5fb7-4749-b515-1703a74d2258 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:03.149997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-912013b7-5fb7-4749-b515-1703a74d2258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:03.152112 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 52/109] 10.222.0.39 () {60 vars in 1141 bytes} [Sun Aug 7 00:52:02 2022] POST /identity/v3/projects => generated 302 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 00:52:03.153150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb9f47-08cb-4199-8876-54aa7a662d19 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:03.184532 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:03.291466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb9f47-08cb-4199-8876-54aa7a662d19 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:03.305519 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 58/110] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:03.337700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed9f97-af1c-4ba2-9ec4-d891627d96e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:03.338715 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed9f97-af1c-4ba2-9ec4-d891627d96e7 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:03.339217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed9f97-af1c-4ba2-9ec4-d891627d96e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:03.339747 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed9f97-af1c-4ba2-9ec4-d891627d96e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:03.340985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed9f97-af1c-4ba2-9ec4-d891627d96e7 None admin] RBAC: Adding query filter params (role.id=53830cd13bce471ba955d5469f3330f4, scope.project.id=d48c2e640c56445a9109354f89807e83, user.id=dc3bca5944234d4f93a4562ea9643a2f) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:03.341531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed9f97-af1c-4ba2-9ec4-d891627d96e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:03.343318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed9f97-af1c-4ba2-9ec4-d891627d96e7 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:03.350723 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 53/111] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:52:03 2022] GET /identity/v3/role_assignments?user.id=dc3bca5944234d4f93a4562ea9643a2f&scope.project.id=d48c2e640c56445a9109354f89807e83&role.id=53830cd13bce471ba955d5469f3330f4 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:03.355788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912013b7-5fb7-4749-b515-1703a74d2258 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:03.490405 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:03.526787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912013b7-5fb7-4749-b515-1703a74d2258 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:03.583898 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb2cda-87dc-4952-b2af-a2a0584cfd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:03.584568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb2cda-87dc-4952-b2af-a2a0584cfd16 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:03.584856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb2cda-87dc-4952-b2af-a2a0584cfd16 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:03.585142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb2cda-87dc-4952-b2af-a2a0584cfd16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:03.599563 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb2cda-87dc-4952-b2af-a2a0584cfd16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:03.606791 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-7ddb2cda-87dc-4952-b2af-a2a0584cfd16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:52:03.606791 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:03.606791 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:03.606791 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:03.606791 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:03.606791 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:03.606791 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:03.606791 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:03.606791 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:03.606791 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:03.606791 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:03.606791 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:03.606791 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:03.606791 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:03.606791 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:03.606791 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:03.607705 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:03.607705 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:03.607705 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:03.607705 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:03.607705 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:03.607705 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:03.607705 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:03.607705 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:03.607705 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:03.607705 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:03.607705 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:03.607705 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:03.607705 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:03.607705 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:03.607705 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:03.607705 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:03.608489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:03.608489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:03.608489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:03.608489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:03.608489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:03.608489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:03.608489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:03.608489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:03.608489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:03.608489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:03.608489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:52:03.608489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:52:03.608489 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 59/112] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:03.615157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed9f97-af1c-4ba2-9ec4-d891627d96e7 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:03.742941 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:03.753457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280dd6d-72ef-49d8-80db-e510eedfa735 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:03.753966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280dd6d-72ef-49d8-80db-e510eedfa735 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:03.754038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280dd6d-72ef-49d8-80db-e510eedfa735 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:03.755555 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 60/113] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:03.765337 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cdfc5-ff9f-45ac-9722-14b9628ab89b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:03.765623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cdfc5-ff9f-45ac-9722-14b9628ab89b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:03.765895 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cdfc5-ff9f-45ac-9722-14b9628ab89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:03.767730 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed9f97-af1c-4ba2-9ec4-d891627d96e7 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:03.808131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ed6cdfc5-ff9f-45ac-9722-14b9628ab89b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:03.808350 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51deb0-40e4-4fbd-af5e-5a96d19a1209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:03.808880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51deb0-40e4-4fbd-af5e-5a96d19a1209 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:03.809165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51deb0-40e4-4fbd-af5e-5a96d19a1209 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:03.809358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ed6cdfc5-ff9f-45ac-9722-14b9628ab89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:03.809457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51deb0-40e4-4fbd-af5e-5a96d19a1209 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:03.810122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51deb0-40e4-4fbd-af5e-5a96d19a1209 None admin] RBAC: Adding query filter params (name=member) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:03.810433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51deb0-40e4-4fbd-af5e-5a96d19a1209 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:03.812052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51deb0-40e4-4fbd-af5e-5a96d19a1209 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:03.821657 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 54/114] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Aug 7 00:52:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:52:03.832326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51deb0-40e4-4fbd-af5e-5a96d19a1209 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:04.011415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51deb0-40e4-4fbd-af5e-5a96d19a1209 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:04.025885 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 61/115] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:04.056836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cdfc5-ff9f-45ac-9722-14b9628ab89b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:04.070382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c4e7d-3537-4097-af0b-539c5b775a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:04.071051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c4e7d-3537-4097-af0b-539c5b775a6a None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:04.071311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c4e7d-3537-4097-af0b-539c5b775a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:04.071584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c4e7d-3537-4097-af0b-539c5b775a6a None admin] PATH_INFO: `/v3/users/54ec182a52e14c09bda7b43dbb5c8427` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:04.075946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c4e7d-3537-4097-af0b-539c5b775a6a None admin] RBAC: Authorizing `identity:get_user(user_id=54ec182a52e14c09bda7b43dbb5c8427)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:04.077854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c4e7d-3537-4097-af0b-539c5b775a6a None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:04.079816 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 55/116] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:52:03 2022] GET /identity/v3/users/54ec182a52e14c09bda7b43dbb5c8427 => generated 275 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:52:04.088089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c4e7d-3537-4097-af0b-539c5b775a6a None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:04.104265 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:04.197798 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:04.248850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cdfc5-ff9f-45ac-9722-14b9628ab89b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:04.253034 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c4e7d-3537-4097-af0b-539c5b775a6a None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:04.308754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8fa3a3-efd7-4714-9ab4-1c1e39ef4eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:04.309411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fa3a3-efd7-4714-9ab4-1c1e39ef4eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:04.309700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fa3a3-efd7-4714-9ab4-1c1e39ef4eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:04.309978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fa3a3-efd7-4714-9ab4-1c1e39ef4eb1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:04.326736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653f638-d98b-4f73-975b-8ee947881b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:04.327383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653f638-d98b-4f73-975b-8ee947881b08 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:04.327673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653f638-d98b-4f73-975b-8ee947881b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:04.327974 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653f638-d98b-4f73-975b-8ee947881b08 None admin] PATH_INFO: `/v3/projects/d48c2e640c56445a9109354f89807e83` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:04.333478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653f638-d98b-4f73-975b-8ee947881b08 None admin] RBAC: Authorizing `identity:get_project(project_id=d48c2e640c56445a9109354f89807e83)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:04.335022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653f638-d98b-4f73-975b-8ee947881b08 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:04.336492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8fa3a3-efd7-4714-9ab4-1c1e39ef4eb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:04.339758 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 56/117] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:04 2022] GET /identity/v3/projects/d48c2e640c56445a9109354f89807e83 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:52:04.344493 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-9b8fa3a3-efd7-4714-9ab4-1c1e39ef4eb1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:52:04.344493 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:04.344493 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:04.344493 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:04.344493 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:04.344493 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:04.344493 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:04.344493 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:04.344493 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:04.344493 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:04.344493 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:04.344493 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:04.344493 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:04.344493 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:04.344493 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:04.344493 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:04.345921 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:04.345921 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:04.345921 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:04.345921 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:04.345921 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:04.345921 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:04.345921 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:04.345921 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:04.345921 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:04.345921 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:04.345921 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:04.345921 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:04.345921 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:04.345921 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:04.345921 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:04.345921 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:04.346755 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:04.346755 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:04.346755 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:04.346755 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:04.346755 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:04.346755 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:04.346755 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:04.346755 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:04.346755 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:04.346755 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:04.346755 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:52:04.346755 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:52:04.347339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bf25b-c9ad-4088-9ef8-137c95642783 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:04.347339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bf25b-c9ad-4088-9ef8-137c95642783 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:04.347339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bf25b-c9ad-4088-9ef8-137c95642783 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:04.347516 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 62/118] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:52:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:04.347579 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 57/119] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:04.355041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8fa3a3-efd7-4714-9ab4-1c1e39ef4eb1 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:04.355341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bf25b-c9ad-4088-9ef8-137c95642783 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:04.516330 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:04.569674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8fa3a3-efd7-4714-9ab4-1c1e39ef4eb1 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:04.573314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bf25b-c9ad-4088-9ef8-137c95642783 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:04.609640 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:04.620085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b0f1f-85ac-4d77-b197-56c752aacedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:04.620757 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b0f1f-85ac-4d77-b197-56c752aacedf None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:04.621043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b0f1f-85ac-4d77-b197-56c752aacedf None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:04.621320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b0f1f-85ac-4d77-b197-56c752aacedf None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:04.622234 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b0f1f-85ac-4d77-b197-56c752aacedf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:04.622638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b0f1f-85ac-4d77-b197-56c752aacedf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:04.624385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b0f1f-85ac-4d77-b197-56c752aacedf None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:04.625262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57cc2d5-a416-48fa-9aef-e327028ba12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:04.626119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57cc2d5-a416-48fa-9aef-e327028ba12c None admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:04.626543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57cc2d5-a416-48fa-9aef-e327028ba12c None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:04.626957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57cc2d5-a416-48fa-9aef-e327028ba12c None admin] PATH_INFO: `/v3/projects/d48c2e640c56445a9109354f89807e83/users/54ec182a52e14c09bda7b43dbb5c8427/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:04.629122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57cc2d5-a416-48fa-9aef-e327028ba12c None admin] RBAC: Authorizing `identity:create_grant(project_id=d48c2e640c56445a9109354f89807e83, user_id=54ec182a52e14c09bda7b43dbb5c8427, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:04.630725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57cc2d5-a416-48fa-9aef-e327028ba12c None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:04.634499 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 63/120] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:04.635870 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cf73d-fa6e-414a-bc7f-3dd5b679c7a8 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:04.636178 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cf73d-fa6e-414a-bc7f-3dd5b679c7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:04.636449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cf73d-fa6e-414a-bc7f-3dd5b679c7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:04.648218 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 58/121] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Aug 7 00:52:04 2022] PUT /identity/v3/projects/d48c2e640c56445a9109354f89807e83/users/54ec182a52e14c09bda7b43dbb5c8427/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 00:52:04.649797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486c648-3db7-4a66-825f-c03b205d5f6d None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:04.650358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486c648-3db7-4a66-825f-c03b205d5f6d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:04.650853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486c648-3db7-4a66-825f-c03b205d5f6d None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:04.652708 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 59/122] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:04.658996 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486c648-3db7-4a66-825f-c03b205d5f6d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:04.674022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-651cf73d-fa6e-414a-bc7f-3dd5b679c7a8 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:04.675362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-651cf73d-fa6e-414a-bc7f-3dd5b679c7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:04.780619 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486c648-3db7-4a66-825f-c03b205d5f6d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:04.822587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875c337-585f-41a4-9af6-c5960e5d9b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:04.823677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875c337-585f-41a4-9af6-c5960e5d9b3d None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:04.824217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875c337-585f-41a4-9af6-c5960e5d9b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:04.824759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875c337-585f-41a4-9af6-c5960e5d9b3d None admin] PATH_INFO: `/v3/users/e6bf2139d86940dda0c8934f84df710d` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:04.826303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875c337-585f-41a4-9af6-c5960e5d9b3d None admin] RBAC: Authorizing `identity:get_user(user_id=e6bf2139d86940dda0c8934f84df710d)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:04.828117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875c337-585f-41a4-9af6-c5960e5d9b3d None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:04.830254 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 60/123] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:52:04 2022] GET /identity/v3/users/e6bf2139d86940dda0c8934f84df710d => generated 247 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:04.831703 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d57ee9-b9bf-4a11-9dfa-20f2e93ebe7a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:04.832224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d57ee9-b9bf-4a11-9dfa-20f2e93ebe7a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:04.832706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d57ee9-b9bf-4a11-9dfa-20f2e93ebe7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:04.840111 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:04.846290 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 64/124] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:04.847254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cf73d-fa6e-414a-bc7f-3dd5b679c7a8 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:04.855536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-25d57ee9-b9bf-4a11-9dfa-20f2e93ebe7a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:04.859172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-25d57ee9-b9bf-4a11-9dfa-20f2e93ebe7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:04.940573 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 61/125] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:04.941769 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d57ee9-b9bf-4a11-9dfa-20f2e93ebe7a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:05.031735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cf73d-fa6e-414a-bc7f-3dd5b679c7a8 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:05.064500 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:05.074817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cbd8e-206c-4050-ac25-cdaf1ef88e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:05.075462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cbd8e-206c-4050-ac25-cdaf1ef88e4c None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:05.075737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cbd8e-206c-4050-ac25-cdaf1ef88e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:05.076051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cbd8e-206c-4050-ac25-cdaf1ef88e4c None admin] PATH_INFO: `/v3/projects/d48c2e640c56445a9109354f89807e83` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:05.077205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004cbd8e-206c-4050-ac25-cdaf1ef88e4c None admin] RBAC: Authorizing `identity:get_project(project_id=d48c2e640c56445a9109354f89807e83)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:05.078770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004cbd8e-206c-4050-ac25-cdaf1ef88e4c None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:05.080492 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 65/126] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:04 2022] GET /identity/v3/projects/d48c2e640c56445a9109354f89807e83 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:05.081408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cbd8e-206c-4050-ac25-cdaf1ef88e4c None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:05.087868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d57ee9-b9bf-4a11-9dfa-20f2e93ebe7a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:05.120341 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:05.136081 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd51be4-d10b-4577-b8bd-bf46f1db2de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:05.136857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd51be4-d10b-4577-b8bd-bf46f1db2de3 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:05.137143 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd51be4-d10b-4577-b8bd-bf46f1db2de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:05.137421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd51be4-d10b-4577-b8bd-bf46f1db2de3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:05.153966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd51be4-d10b-4577-b8bd-bf46f1db2de3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:05.174000 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-edd51be4-d10b-4577-b8bd-bf46f1db2de3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:52:05.174000 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:05.174000 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:05.174000 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:05.174000 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:05.174000 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:05.174000 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:05.174000 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:05.174000 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:05.174000 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:05.174000 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:05.174000 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:05.174000 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:05.174000 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:05.174000 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:05.174000 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:05.174933 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:05.174933 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:05.174933 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:05.174933 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:05.174933 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:05.174933 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:05.174933 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:05.174933 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:05.174933 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:05.174933 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:05.174933 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:05.174933 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:05.174933 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:05.174933 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:05.174933 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:05.174933 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:05.175684 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:05.175684 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:05.175684 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:05.175684 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:05.175684 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:05.175684 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:05.175684 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:05.175684 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:05.175684 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:05.175684 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:05.175684 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:52:05.175684 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:05.175684 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 62/127] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Aug 7 00:52:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:05.176373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd51be4-d10b-4577-b8bd-bf46f1db2de3 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:05.191952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cbd8e-206c-4050-ac25-cdaf1ef88e4c None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:05.237863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6301cb1-67d6-42b0-a393-a72a2210a169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:05.238516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6301cb1-67d6-42b0-a393-a72a2210a169 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:05.238797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6301cb1-67d6-42b0-a393-a72a2210a169 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:05.239071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6301cb1-67d6-42b0-a393-a72a2210a169 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:05.268417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6301cb1-67d6-42b0-a393-a72a2210a169 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:05.276438 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-f6301cb1-67d6-42b0-a393-a72a2210a169 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:52:05.276438 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:05.276438 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:05.276438 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:05.276438 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:05.276438 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:05.276438 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:05.276438 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:05.276438 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:05.276438 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:05.276438 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:05.276438 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:05.276438 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:05.276438 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:05.276438 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:05.276438 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:05.277338 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:05.277338 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:05.277338 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:05.277338 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:05.277338 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:05.277338 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:05.277338 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:05.277338 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:05.277338 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:05.277338 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:05.277338 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:05.277338 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:05.277338 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:05.277338 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:05.277338 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:05.277338 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:05.278100 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:05.278100 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:05.278100 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:05.278100 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:05.278100 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:05.278100 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:05.278100 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:05.278100 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:05.278100 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:05.278100 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:05.278100 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:52:05.278100 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:52:05.279405 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 66/128] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:05.280879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6301cb1-67d6-42b0-a393-a72a2210a169 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:05.383341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd51be4-d10b-4577-b8bd-bf46f1db2de3 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:05.398726 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:05.435493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d6667-3213-454a-8f4c-fbfaff802d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:05.436578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d6667-3213-454a-8f4c-fbfaff802d3a None admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:05.437057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d6667-3213-454a-8f4c-fbfaff802d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:05.437621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d6667-3213-454a-8f4c-fbfaff802d3a None admin] PATH_INFO: `/v3/projects/d48c2e640c56445a9109354f89807e83/users/e6bf2139d86940dda0c8934f84df710d/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:05.445477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d6667-3213-454a-8f4c-fbfaff802d3a None admin] RBAC: Authorizing `identity:create_grant(project_id=d48c2e640c56445a9109354f89807e83, user_id=e6bf2139d86940dda0c8934f84df710d, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:05.447375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d6667-3213-454a-8f4c-fbfaff802d3a None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:05.470294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6301cb1-67d6-42b0-a393-a72a2210a169 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:05.472912 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 63/129] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Aug 7 00:52:05 2022] PUT /identity/v3/projects/d48c2e640c56445a9109354f89807e83/users/e6bf2139d86940dda0c8934f84df710d/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:52:05.473988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d6667-3213-454a-8f4c-fbfaff802d3a None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:05.513091 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f691e-529f-4b4a-81f3-fe5062c1bd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:05.513710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f691e-529f-4b4a-81f3-fe5062c1bd4a None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:05.513993 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f691e-529f-4b4a-81f3-fe5062c1bd4a None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:05.514267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f691e-529f-4b4a-81f3-fe5062c1bd4a None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:05.514958 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f691e-529f-4b4a-81f3-fe5062c1bd4a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:05.515310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f691e-529f-4b4a-81f3-fe5062c1bd4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:05.517251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f691e-529f-4b4a-81f3-fe5062c1bd4a None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:05.527614 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 67/130] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:52:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:05.532929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f691e-529f-4b4a-81f3-fe5062c1bd4a None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:05.604043 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:05.671290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f691e-529f-4b4a-81f3-fe5062c1bd4a None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:05.677542 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d6667-3213-454a-8f4c-fbfaff802d3a None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:05.688277 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:05.746841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2f8f3-90e1-4177-93c9-e4a043c75b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:05.747506 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2f8f3-90e1-4177-93c9-e4a043c75b36 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:05.747789 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2f8f3-90e1-4177-93c9-e4a043c75b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:05.748090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2f8f3-90e1-4177-93c9-e4a043c75b36 None admin] PATH_INFO: `/v3/users/54ec182a52e14c09bda7b43dbb5c8427` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:05.749394 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2f8f3-90e1-4177-93c9-e4a043c75b36 None admin] RBAC: Authorizing `identity:get_user(user_id=54ec182a52e14c09bda7b43dbb5c8427)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:05.751180 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2f8f3-90e1-4177-93c9-e4a043c75b36 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:05.753028 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 68/131] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:52:05 2022] GET /identity/v3/users/54ec182a52e14c09bda7b43dbb5c8427 => generated 275 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:52:05.753358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d4f1d-4c90-4f44-a49c-9d8c9533fee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:05.754371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d4f1d-4c90-4f44-a49c-9d8c9533fee8 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:05.754986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d4f1d-4c90-4f44-a49c-9d8c9533fee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:05.755462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d4f1d-4c90-4f44-a49c-9d8c9533fee8 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:05.756514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d4f1d-4c90-4f44-a49c-9d8c9533fee8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:05.757124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d4f1d-4c90-4f44-a49c-9d8c9533fee8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:05.758453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2f8f3-90e1-4177-93c9-e4a043c75b36 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:05.759255 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d4f1d-4c90-4f44-a49c-9d8c9533fee8 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:05.769966 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 64/132] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Aug 7 00:52:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:05.778507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d4f1d-4c90-4f44-a49c-9d8c9533fee8 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:05.914747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2f8f3-90e1-4177-93c9-e4a043c75b36 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:05.972094 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d4f1d-4c90-4f44-a49c-9d8c9533fee8 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:05.994841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd4f45-4fa5-41c7-9556-098878910933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:05.996003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd4f45-4fa5-41c7-9556-098878910933 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:05.996469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd4f45-4fa5-41c7-9556-098878910933 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:05.997197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd4f45-4fa5-41c7-9556-098878910933 None admin] PATH_INFO: `/v3/projects/d48c2e640c56445a9109354f89807e83` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:06.004188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd4f45-4fa5-41c7-9556-098878910933 None admin] RBAC: Authorizing `identity:get_project(project_id=d48c2e640c56445a9109354f89807e83)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:06.004188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd4f45-4fa5-41c7-9556-098878910933 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:06.004188 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 69/133] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:05 2022] GET /identity/v3/projects/d48c2e640c56445a9109354f89807e83 => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:06.006742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8a165-82e2-4246-87b5-6fc53dd04eb4 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:06.007041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8a165-82e2-4246-87b5-6fc53dd04eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:06.007316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8a165-82e2-4246-87b5-6fc53dd04eb4 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:06.007638 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:06.011041 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 70/134] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:06.011654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8a165-82e2-4246-87b5-6fc53dd04eb4 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:06.048627 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935d955-f04e-4bc2-be34-02e1a2b95f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:06.049573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935d955-f04e-4bc2-be34-02e1a2b95f70 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:06.050053 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935d955-f04e-4bc2-be34-02e1a2b95f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:06.050514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935d955-f04e-4bc2-be34-02e1a2b95f70 None admin] PATH_INFO: `/v3/users/54ec182a52e14c09bda7b43dbb5c8427` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:06.052716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935d955-f04e-4bc2-be34-02e1a2b95f70 None admin] RBAC: Authorizing `identity:get_user(user_id=54ec182a52e14c09bda7b43dbb5c8427)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:06.054398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935d955-f04e-4bc2-be34-02e1a2b95f70 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:06.056303 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 65/135] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:52:05 2022] GET /identity/v3/users/54ec182a52e14c09bda7b43dbb5c8427 => generated 275 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:52:06.057881 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aedab4-39b8-4ebb-bc2b-80bcb7e15827 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:06.059783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aedab4-39b8-4ebb-bc2b-80bcb7e15827 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:06.061123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aedab4-39b8-4ebb-bc2b-80bcb7e15827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:06.100725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-22aedab4-39b8-4ebb-bc2b-80bcb7e15827 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:06.108303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-22aedab4-39b8-4ebb-bc2b-80bcb7e15827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:06.124254 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:06.202649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8a165-82e2-4246-87b5-6fc53dd04eb4 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:06.203670 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 66/136] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:06.204917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aedab4-39b8-4ebb-bc2b-80bcb7e15827 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:06.245729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c0bfb-4c0d-4542-b63f-00c1e16134c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:06.246637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c0bfb-4c0d-4542-b63f-00c1e16134c8 None admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:06.247058 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c0bfb-4c0d-4542-b63f-00c1e16134c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:06.247593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c0bfb-4c0d-4542-b63f-00c1e16134c8 None admin] PATH_INFO: `/v3/projects/d48c2e640c56445a9109354f89807e83/users/54ec182a52e14c09bda7b43dbb5c8427/roles/04a874934a0944a2851b5e485a0f0a1b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:06.250162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c0bfb-4c0d-4542-b63f-00c1e16134c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=d48c2e640c56445a9109354f89807e83, user_id=54ec182a52e14c09bda7b43dbb5c8427, role_id=04a874934a0944a2851b5e485a0f0a1b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:06.251917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c0bfb-4c0d-4542-b63f-00c1e16134c8 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:06.267841 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 71/137] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Aug 7 00:52:06 2022] PUT /identity/v3/projects/d48c2e640c56445a9109354f89807e83/users/54ec182a52e14c09bda7b43dbb5c8427/roles/04a874934a0944a2851b5e485a0f0a1b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:52:06.269650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a43a47-5e6a-450e-af13-b686099cf27c None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:06.270102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a43a47-5e6a-450e-af13-b686099cf27c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:06.270525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a43a47-5e6a-450e-af13-b686099cf27c None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:06.272677 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 72/138] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:06.273812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a43a47-5e6a-450e-af13-b686099cf27c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:06.316510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aedab4-39b8-4ebb-bc2b-80bcb7e15827 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:06.332829 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:06.395193 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b652c9-4b8e-4ba8-9ac5-3086b1048831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:06.395873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b652c9-4b8e-4ba8-9ac5-3086b1048831 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:06.396182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b652c9-4b8e-4ba8-9ac5-3086b1048831 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:06.396470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b652c9-4b8e-4ba8-9ac5-3086b1048831 None admin] PATH_INFO: `/v3/projects/26407313c821425aaeebf07af0eefbc3` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:06.397978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b652c9-4b8e-4ba8-9ac5-3086b1048831 None admin] RBAC: Authorizing `identity:get_project(project_id=26407313c821425aaeebf07af0eefbc3)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:06.399603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b652c9-4b8e-4ba8-9ac5-3086b1048831 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:06.401520 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 67/139] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:06 2022] GET /identity/v3/projects/26407313c821425aaeebf07af0eefbc3 => generated 312 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:06.402721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40100876-f76e-43b5-9a48-b9fdeb9d7d38 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:06.403013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40100876-f76e-43b5-9a48-b9fdeb9d7d38 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:06.403289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40100876-f76e-43b5-9a48-b9fdeb9d7d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:06.441444 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a43a47-5e6a-450e-af13-b686099cf27c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:06.454744 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:06.458196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-40100876-f76e-43b5-9a48-b9fdeb9d7d38 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:06.459548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-40100876-f76e-43b5-9a48-b9fdeb9d7d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:06.496553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01740acc-1192-492d-b9a4-906a7642a54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:06.497615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01740acc-1192-492d-b9a4-906a7642a54e None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:06.498215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01740acc-1192-492d-b9a4-906a7642a54e None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:06.498632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01740acc-1192-492d-b9a4-906a7642a54e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:06.515846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01740acc-1192-492d-b9a4-906a7642a54e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:06.521362 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-01740acc-1192-492d-b9a4-906a7642a54e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:52:06.521362 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:06.521362 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:06.521362 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:06.521362 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:06.521362 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:06.521362 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:06.521362 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:06.521362 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:06.521362 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:06.521362 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:06.521362 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:06.521362 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:06.521362 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:06.521362 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:06.521362 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:06.522538 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:06.522538 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:06.522538 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:06.522538 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:06.522538 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:06.522538 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:06.522538 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:06.522538 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:06.522538 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:06.522538 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:06.522538 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:06.522538 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:06.522538 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:06.522538 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:06.522538 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:06.522538 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:06.523329 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:06.523329 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:06.523329 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:06.523329 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:06.523329 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:06.523329 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:06.523329 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:06.523329 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:06.523329 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:06.523329 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:06.523329 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:52:06.523329 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:52:06.523329 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 73/140] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:06.524050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01740acc-1192-492d-b9a4-906a7642a54e None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:06.560695 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 68/141] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:06.561998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40100876-f76e-43b5-9a48-b9fdeb9d7d38 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:06.640119 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01740acc-1192-492d-b9a4-906a7642a54e None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:06.676473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c643b3a-3e5a-4914-8d81-8b7b579ae044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:06.677254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c643b3a-3e5a-4914-8d81-8b7b579ae044 None admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:06.677560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c643b3a-3e5a-4914-8d81-8b7b579ae044 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:06.677903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c643b3a-3e5a-4914-8d81-8b7b579ae044 None admin] PATH_INFO: `/v3/projects/26407313c821425aaeebf07af0eefbc3/users/54ec182a52e14c09bda7b43dbb5c8427/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:06.680204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c643b3a-3e5a-4914-8d81-8b7b579ae044 None admin] RBAC: Authorizing `identity:create_grant(project_id=26407313c821425aaeebf07af0eefbc3, user_id=54ec182a52e14c09bda7b43dbb5c8427, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:06.681729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c643b3a-3e5a-4914-8d81-8b7b579ae044 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:06.689100 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40100876-f76e-43b5-9a48-b9fdeb9d7d38 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:06.710846 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:06.711169 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 74/142] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Aug 7 00:52:06 2022] PUT /identity/v3/projects/26407313c821425aaeebf07af0eefbc3/users/54ec182a52e14c09bda7b43dbb5c8427/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:52:06.712854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c643b3a-3e5a-4914-8d81-8b7b579ae044 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:06.744107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6d611-5b2f-4b1a-bdfb-06b2e0d172cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:06.745244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6d611-5b2f-4b1a-bdfb-06b2e0d172cb None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:06.745723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6d611-5b2f-4b1a-bdfb-06b2e0d172cb None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:06.746336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6d611-5b2f-4b1a-bdfb-06b2e0d172cb None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:06.747322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a6d611-5b2f-4b1a-bdfb-06b2e0d172cb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:06.747830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a6d611-5b2f-4b1a-bdfb-06b2e0d172cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:06.749693 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a6d611-5b2f-4b1a-bdfb-06b2e0d172cb None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:06.761423 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 69/143] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Aug 7 00:52:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:06.772633 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:06.779162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6d611-5b2f-4b1a-bdfb-06b2e0d172cb None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:06.860638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c643b3a-3e5a-4914-8d81-8b7b579ae044 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:06.900537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40f3e9-57f9-4d58-96dc-99ee7152d0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:06.904110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40f3e9-57f9-4d58-96dc-99ee7152d0be None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:06.904110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40f3e9-57f9-4d58-96dc-99ee7152d0be None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:06.904110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c40f3e9-57f9-4d58-96dc-99ee7152d0be None admin] PATH_INFO: `/v3/domains/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:06.906153 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c40f3e9-57f9-4d58-96dc-99ee7152d0be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:06.908598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c40f3e9-57f9-4d58-96dc-99ee7152d0be None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:06.910659 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 75/144] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:52:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:06.918692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40f3e9-57f9-4d58-96dc-99ee7152d0be None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:06.992552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6d611-5b2f-4b1a-bdfb-06b2e0d172cb None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:07.058979 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37737413-d5ec-4f3c-832c-b2e4e0d0f582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:07.059554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37737413-d5ec-4f3c-832c-b2e4e0d0f582 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:07.059838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37737413-d5ec-4f3c-832c-b2e4e0d0f582 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:07.060166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37737413-d5ec-4f3c-832c-b2e4e0d0f582 None admin] PATH_INFO: `/v3/users/dc3bca5944234d4f93a4562ea9643a2f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:07.061452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37737413-d5ec-4f3c-832c-b2e4e0d0f582 None admin] RBAC: Authorizing `identity:get_user(user_id=dc3bca5944234d4f93a4562ea9643a2f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:07.062914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37737413-d5ec-4f3c-832c-b2e4e0d0f582 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:07.070784 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 70/145] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:52:06 2022] GET /identity/v3/users/dc3bca5944234d4f93a4562ea9643a2f => generated 289 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:07.075680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37737413-d5ec-4f3c-832c-b2e4e0d0f582 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:07.113177 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:07.132143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c40f3e9-57f9-4d58-96dc-99ee7152d0be None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:07.167302 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:07.199371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9095e-dc14-4462-a4a9-49675da444fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:07.200132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9095e-dc14-4462-a4a9-49675da444fd None admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:07.200506 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9095e-dc14-4462-a4a9-49675da444fd None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:07.200847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9095e-dc14-4462-a4a9-49675da444fd None admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:07.201584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9095e-dc14-4462-a4a9-49675da444fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:07.203122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9095e-dc14-4462-a4a9-49675da444fd None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:07.246888 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37737413-d5ec-4f3c-832c-b2e4e0d0f582 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:07.249641 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 76/146] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Aug 7 00:52:06 2022] POST /identity/v3/users => generated 283 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:52:07.292662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa9e79-d5d5-452b-b61a-406c57ea4fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:07.293706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa9e79-d5d5-452b-b61a-406c57ea4fdf None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:07.294169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa9e79-d5d5-452b-b61a-406c57ea4fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:07.294704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa9e79-d5d5-452b-b61a-406c57ea4fdf None admin] PATH_INFO: `/v3/projects/d48c2e640c56445a9109354f89807e83` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:07.296300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa9e79-d5d5-452b-b61a-406c57ea4fdf None admin] RBAC: Authorizing `identity:get_project(project_id=d48c2e640c56445a9109354f89807e83)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:07.298083 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa9e79-d5d5-452b-b61a-406c57ea4fdf None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:07.300160 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 71/147] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:07 2022] GET /identity/v3/projects/d48c2e640c56445a9109354f89807e83 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:07.306309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9095e-dc14-4462-a4a9-49675da444fd None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:07.431341 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9095e-dc14-4462-a4a9-49675da444fd None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:07.472949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5060a-1936-4b61-8999-2a4b4c0ddf22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:07.473643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5060a-1936-4b61-8999-2a4b4c0ddf22 None admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:07.473922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5060a-1936-4b61-8999-2a4b4c0ddf22 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:07.474190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5060a-1936-4b61-8999-2a4b4c0ddf22 None admin] PATH_INFO: `/v3/projects/d48c2e640c56445a9109354f89807e83/users/dc3bca5944234d4f93a4562ea9643a2f/roles/53830cd13bce471ba955d5469f3330f4` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:07.476303 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5060a-1936-4b61-8999-2a4b4c0ddf22 None admin] RBAC: Authorizing `identity:create_grant(project_id=d48c2e640c56445a9109354f89807e83, user_id=dc3bca5944234d4f93a4562ea9643a2f, role_id=53830cd13bce471ba955d5469f3330f4)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:07.477790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5060a-1936-4b61-8999-2a4b4c0ddf22 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:07.498811 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 77/148] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Aug 7 00:52:07 2022] PUT /identity/v3/projects/d48c2e640c56445a9109354f89807e83/users/dc3bca5944234d4f93a4562ea9643a2f/roles/53830cd13bce471ba955d5469f3330f4 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:52:07.937711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d8f2a-56e6-41fe-9c06-6b18e1c1af27 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:07.938500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d8f2a-56e6-41fe-9c06-6b18e1c1af27 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:07.939532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d8f2a-56e6-41fe-9c06-6b18e1c1af27 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:07.941237 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 72/149] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:07.947199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c23466-7a0d-4c1c-9aa1-70d5eb968ea8 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:07.947703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c23466-7a0d-4c1c-9aa1-70d5eb968ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:07.947783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c23466-7a0d-4c1c-9aa1-70d5eb968ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:07.987341 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-36c23466-7a0d-4c1c-9aa1-70d5eb968ea8 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:07.988582 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-36c23466-7a0d-4c1c-9aa1-70d5eb968ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:07.990785 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:08.097441 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 78/150] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:08.145499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d8f2a-56e6-41fe-9c06-6b18e1c1af27 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:08.281213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d8f2a-56e6-41fe-9c06-6b18e1c1af27 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:08.292072 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:08.329786 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4653f78-e252-4e0f-9797-0137c0a6f2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:08.330795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4653f78-e252-4e0f-9797-0137c0a6f2d9 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:08.331290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4653f78-e252-4e0f-9797-0137c0a6f2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:08.331761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4653f78-e252-4e0f-9797-0137c0a6f2d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:08.345499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4653f78-e252-4e0f-9797-0137c0a6f2d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:08.351435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-e4653f78-e252-4e0f-9797-0137c0a6f2d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:52:08.351435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:08.351435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:08.351435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:08.351435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:08.351435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:08.351435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:08.351435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:08.351435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:08.351435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:08.351435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:08.351435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:08.351435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:08.351435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:08.351435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:08.351435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:08.352352 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:08.352352 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:08.352352 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:08.352352 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:08.352352 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:08.352352 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:08.352352 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:08.352352 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:08.352352 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:08.352352 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:08.352352 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:08.352352 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:08.352352 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:08.352352 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:08.352352 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:08.352352 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:08.353108 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:08.353108 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:08.353108 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:08.353108 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:08.353108 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:08.353108 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:08.353108 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:08.353108 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:08.353108 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:08.353108 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:08.353108 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:52:08.353108 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:08.355464 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 73/151] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:08.362766 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c23466-7a0d-4c1c-9aa1-70d5eb968ea8 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:08.509107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c23466-7a0d-4c1c-9aa1-70d5eb968ea8 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:08.570397 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4467d90-d55e-4e0c-a2a0-050054ca5cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:08.571290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4467d90-d55e-4e0c-a2a0-050054ca5cda None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:08.571726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4467d90-d55e-4e0c-a2a0-050054ca5cda None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:08.572234 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4467d90-d55e-4e0c-a2a0-050054ca5cda None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:08.573323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4467d90-d55e-4e0c-a2a0-050054ca5cda None admin] RBAC: Adding query filter params (name=member) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:08.573847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4467d90-d55e-4e0c-a2a0-050054ca5cda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:08.576113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4467d90-d55e-4e0c-a2a0-050054ca5cda None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:08.582130 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:08.590216 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 79/152] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Aug 7 00:52:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:08.595409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4653f78-e252-4e0f-9797-0137c0a6f2d9 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:08.627975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b8c90-ecee-459d-9e32-349763a926e7 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:08.628296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b8c90-ecee-459d-9e32-349763a926e7 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:08.628484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b8c90-ecee-459d-9e32-349763a926e7 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:08.630091 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 80/153] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:08.646294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618081d6-eb23-43a8-8c2e-70ea3b869100 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:08.646294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618081d6-eb23-43a8-8c2e-70ea3b869100 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:08.646294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618081d6-eb23-43a8-8c2e-70ea3b869100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:08.681145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-618081d6-eb23-43a8-8c2e-70ea3b869100 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:08.682370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-618081d6-eb23-43a8-8c2e-70ea3b869100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:08.735723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4653f78-e252-4e0f-9797-0137c0a6f2d9 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:08.784749 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41d2c1-195e-435c-9dc6-05b854f9ba73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:08.785775 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41d2c1-195e-435c-9dc6-05b854f9ba73 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:08.786251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41d2c1-195e-435c-9dc6-05b854f9ba73 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:08.786725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41d2c1-195e-435c-9dc6-05b854f9ba73 None admin] PATH_INFO: `/v3/users/54ec182a52e14c09bda7b43dbb5c8427` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:08.788143 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41d2c1-195e-435c-9dc6-05b854f9ba73 None admin] RBAC: Authorizing `identity:get_user(user_id=54ec182a52e14c09bda7b43dbb5c8427)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:08.789904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41d2c1-195e-435c-9dc6-05b854f9ba73 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:08.790500 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 81/154] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:52:08.792114 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 74/155] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:52:08 2022] GET /identity/v3/users/54ec182a52e14c09bda7b43dbb5c8427 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:08.797764 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618081d6-eb23-43a8-8c2e-70ea3b869100 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:08.892524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41d2c1-195e-435c-9dc6-05b854f9ba73 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:08.928502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618081d6-eb23-43a8-8c2e-70ea3b869100 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:08.976629 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:08.982655 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:08.991295 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f9e58-b289-43d0-b0c3-3063c75fb314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:08.991938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f9e58-b289-43d0-b0c3-3063c75fb314 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:08.992217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f9e58-b289-43d0-b0c3-3063c75fb314 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:08.992509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f9e58-b289-43d0-b0c3-3063c75fb314 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:09.067179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41d2c1-195e-435c-9dc6-05b854f9ba73 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:09.091618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f9e58-b289-43d0-b0c3-3063c75fb314 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:09.093347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f9e58-b289-43d0-b0c3-3063c75fb314 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:09.109135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856a5c2-6b06-4067-8b2d-f3ae8cea6ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:09.110306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856a5c2-6b06-4067-8b2d-f3ae8cea6ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:09.110792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856a5c2-6b06-4067-8b2d-f3ae8cea6ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:09.111408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856a5c2-6b06-4067-8b2d-f3ae8cea6ec7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:09.124287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856a5c2-6b06-4067-8b2d-f3ae8cea6ec7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:09.135989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-f856a5c2-6b06-4067-8b2d-f3ae8cea6ec7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:52:09.135989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:09.135989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:09.135989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:09.135989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:09.135989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:09.135989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:09.135989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:09.135989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:09.135989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:09.135989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:09.135989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:09.135989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:09.135989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:09.135989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:09.135989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:09.137158 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:09.137158 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:09.137158 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:09.137158 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:09.137158 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:09.137158 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:09.137158 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:09.137158 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:09.137158 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:09.137158 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:09.137158 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:09.137158 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:09.137158 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:09.137158 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:09.137158 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:09.137158 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:09.138018 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:09.138018 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:09.138018 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:09.138018 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:09.138018 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:09.138018 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:09.138018 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:09.138018 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:09.138018 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:09.138018 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:09.138018 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:52:09.138018 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:09.140709 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 75/156] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:52:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:09.153742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856a5c2-6b06-4067-8b2d-f3ae8cea6ec7 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:09.243112 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 82/157] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:52:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:52:09.248388 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f9e58-b289-43d0-b0c3-3063c75fb314 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:09.294875 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:09.360859 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:09.375907 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856a5c2-6b06-4067-8b2d-f3ae8cea6ec7 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:09.403694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f9e58-b289-43d0-b0c3-3063c75fb314 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:09.452875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c18072-3ac5-448e-8a0f-190dbbe3f57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:09.460149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c18072-3ac5-448e-8a0f-190dbbe3f57a None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:09.461121 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c18072-3ac5-448e-8a0f-190dbbe3f57a None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:09.461909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c18072-3ac5-448e-8a0f-190dbbe3f57a None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:09.463446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c18072-3ac5-448e-8a0f-190dbbe3f57a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:09.464384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c18072-3ac5-448e-8a0f-190dbbe3f57a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:09.467314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c18072-3ac5-448e-8a0f-190dbbe3f57a None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:09.504347 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 76/158] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:52:09.513497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c18072-3ac5-448e-8a0f-190dbbe3f57a None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:09.522972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b6543-865a-4478-9f09-5a8f10ee026d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:09.524706 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b6543-865a-4478-9f09-5a8f10ee026d None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:09.525936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b6543-865a-4478-9f09-5a8f10ee026d None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:09.532366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b6543-865a-4478-9f09-5a8f10ee026d None admin] PATH_INFO: `/v3/projects/d48c2e640c56445a9109354f89807e83` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:09.541746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b6543-865a-4478-9f09-5a8f10ee026d None admin] RBAC: Authorizing `identity:get_project(project_id=d48c2e640c56445a9109354f89807e83)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:09.544998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b6543-865a-4478-9f09-5a8f10ee026d None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:09.553659 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 83/159] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:09 2022] GET /identity/v3/projects/d48c2e640c56445a9109354f89807e83 => generated 298 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:09.560544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b6543-865a-4478-9f09-5a8f10ee026d None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:09.773734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c18072-3ac5-448e-8a0f-190dbbe3f57a None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:09.808167 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:09.822151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b6543-865a-4478-9f09-5a8f10ee026d None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:09.848635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defcb748-ef34-40e4-89d9-34dcdf8bf755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:09.849632 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcb748-ef34-40e4-89d9-34dcdf8bf755 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:09.849911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcb748-ef34-40e4-89d9-34dcdf8bf755 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:09.850191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcb748-ef34-40e4-89d9-34dcdf8bf755 None admin] PATH_INFO: `/v3/users/e6bf2139d86940dda0c8934f84df710d` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:09.851635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defcb748-ef34-40e4-89d9-34dcdf8bf755 None admin] RBAC: Authorizing `identity:get_user(user_id=e6bf2139d86940dda0c8934f84df710d)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:09.853329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defcb748-ef34-40e4-89d9-34dcdf8bf755 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:09.854954 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 77/160] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:52:09 2022] GET /identity/v3/users/e6bf2139d86940dda0c8934f84df710d => generated 247 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:09.856764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbce92-a456-4e71-a9f4-7f4c866b267c None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:09.857047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbce92-a456-4e71-a9f4-7f4c866b267c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:09.857483 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbce92-a456-4e71-a9f4-7f4c866b267c None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:09.861458 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 78/161] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:09.864058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbce92-a456-4e71-a9f4-7f4c866b267c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:09.921381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbdad49-99e4-497e-bccc-3b15c1ab7f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:09.922009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdad49-99e4-497e-bccc-3b15c1ab7f19 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:09.922293 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdad49-99e4-497e-bccc-3b15c1ab7f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:09.922565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdad49-99e4-497e-bccc-3b15c1ab7f19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:09.923463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbdad49-99e4-497e-bccc-3b15c1ab7f19 None admin] RBAC: Adding query filter params (role.id=979b0708a1934c50b706215aa79dbb7a, scope.project.id=d48c2e640c56445a9109354f89807e83, user.id=54ec182a52e14c09bda7b43dbb5c8427) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:09.923780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbdad49-99e4-497e-bccc-3b15c1ab7f19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:09.924511 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:09.925347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbdad49-99e4-497e-bccc-3b15c1ab7f19 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:09.942214 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 84/162] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:52:09 2022] GET /identity/v3/role_assignments?user.id=54ec182a52e14c09bda7b43dbb5c8427&scope.project.id=d48c2e640c56445a9109354f89807e83&role.id=979b0708a1934c50b706215aa79dbb7a => generated 608 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:52:09.943486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c67ac-dbff-494e-9340-4b41aacc87cd None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:09.943774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c67ac-dbff-494e-9340-4b41aacc87cd None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:09.948662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c67ac-dbff-494e-9340-4b41aacc87cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:10.009013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ca6c67ac-dbff-494e-9340-4b41aacc87cd None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:10.010235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ca6c67ac-dbff-494e-9340-4b41aacc87cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:10.061695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbce92-a456-4e71-a9f4-7f4c866b267c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:10.115667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c07ea-324a-4f8d-8197-fcb54688537e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:10.116331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c07ea-324a-4f8d-8197-fcb54688537e None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:10.116607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c07ea-324a-4f8d-8197-fcb54688537e None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:10.116878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c07ea-324a-4f8d-8197-fcb54688537e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:10.212413 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 85/163] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:10.229630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c07ea-324a-4f8d-8197-fcb54688537e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:10.232162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c07ea-324a-4f8d-8197-fcb54688537e None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:10.260784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c67ac-dbff-494e-9340-4b41aacc87cd None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:10.298542 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:10.468387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c67ac-dbff-494e-9340-4b41aacc87cd None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:10.472406 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:10.473920 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 79/164] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:52:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 00:52:10.475129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1db8c-581f-4ddf-9c92-511def821fb9 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:10.475527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1db8c-581f-4ddf-9c92-511def821fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:10.475914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1db8c-581f-4ddf-9c92-511def821fb9 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:10.477609 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 80/165] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:10.485613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99e0f5-3fbd-4e5c-8f6d-03df83a1815a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:10.486038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99e0f5-3fbd-4e5c-8f6d-03df83a1815a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:10.486426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99e0f5-3fbd-4e5c-8f6d-03df83a1815a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:10.527789 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0c99e0f5-3fbd-4e5c-8f6d-03df83a1815a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:10.529357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0c99e0f5-3fbd-4e5c-8f6d-03df83a1815a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:10.532643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74824719-2e1e-4bd2-89f3-c837e61aa22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:10.533506 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74824719-2e1e-4bd2-89f3-c837e61aa22f None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:10.533787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74824719-2e1e-4bd2-89f3-c837e61aa22f None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:10.534060 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74824719-2e1e-4bd2-89f3-c837e61aa22f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:10.549565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74824719-2e1e-4bd2-89f3-c837e61aa22f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:10.554490 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-74824719-2e1e-4bd2-89f3-c837e61aa22f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:52:10.554490 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:10.554490 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:10.554490 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:10.554490 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:10.554490 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:10.554490 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:10.554490 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:10.554490 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:10.554490 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:10.554490 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:10.554490 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:10.554490 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:10.554490 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:10.554490 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:10.554490 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:10.555922 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:10.555922 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:10.555922 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:10.555922 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:10.555922 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:10.555922 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:10.555922 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:10.555922 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:10.555922 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:10.555922 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:10.555922 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:10.555922 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:10.555922 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:10.555922 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:10.555922 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:10.555922 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:10.557573 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:10.557573 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:10.557573 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:10.557573 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:10.557573 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:10.557573 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:10.557573 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:10.557573 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:10.557573 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:10.557573 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:10.557573 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:52:10.557573 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:52:10.557573 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 86/166] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Aug 7 00:52:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:52:10.564791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74824719-2e1e-4bd2-89f3-c837e61aa22f None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:10.649692 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 81/167] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:52:10.650587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99e0f5-3fbd-4e5c-8f6d-03df83a1815a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:10.720812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74824719-2e1e-4bd2-89f3-c837e61aa22f None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:10.753896 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:10.781707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0f8a3-bb97-46ae-aa1e-05631d6fb24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:10.782548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0f8a3-bb97-46ae-aa1e-05631d6fb24c None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:10.783005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0f8a3-bb97-46ae-aa1e-05631d6fb24c None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:10.783453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0f8a3-bb97-46ae-aa1e-05631d6fb24c None admin] PATH_INFO: `/v3/projects/d48c2e640c56445a9109354f89807e83` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:10.784926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0f8a3-bb97-46ae-aa1e-05631d6fb24c None admin] RBAC: Authorizing `identity:get_project(project_id=d48c2e640c56445a9109354f89807e83)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:10.786490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0f8a3-bb97-46ae-aa1e-05631d6fb24c None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:10.796822 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 87/168] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:10 2022] GET /identity/v3/projects/d48c2e640c56445a9109354f89807e83 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:10.800114 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0f8a3-bb97-46ae-aa1e-05631d6fb24c None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:10.845951 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:10.874475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99e0f5-3fbd-4e5c-8f6d-03df83a1815a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:11.006657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0f8a3-bb97-46ae-aa1e-05631d6fb24c None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:11.017190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2d17b-0446-472a-9447-169189a60fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:11.017833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2d17b-0446-472a-9447-169189a60fda None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:11.018116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2d17b-0446-472a-9447-169189a60fda None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:11.018389 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2d17b-0446-472a-9447-169189a60fda None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:11.019090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2d17b-0446-472a-9447-169189a60fda None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:11.019389 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2d17b-0446-472a-9447-169189a60fda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:11.020841 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2d17b-0446-472a-9447-169189a60fda None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:11.041841 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 82/169] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:52:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:11.042794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2d17b-0446-472a-9447-169189a60fda None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:11.086789 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b2e30-9166-469d-882e-5b16315f0b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:11.087548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b2e30-9166-469d-882e-5b16315f0b19 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:11.087970 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b2e30-9166-469d-882e-5b16315f0b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:11.088560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b2e30-9166-469d-882e-5b16315f0b19 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:11.113408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b2e30-9166-469d-882e-5b16315f0b19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:11.118533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-213b2e30-9166-469d-882e-5b16315f0b19 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:52:11.118533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:11.118533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:11.118533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:11.118533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:11.118533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:11.118533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:11.118533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:11.118533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:11.118533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:11.118533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:11.118533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:11.118533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:11.118533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:11.118533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:11.118533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:11.120131 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:11.120131 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:11.120131 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:11.120131 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:11.120131 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:11.120131 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:11.120131 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:11.120131 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:11.120131 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:11.120131 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:11.120131 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:11.120131 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:11.120131 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:11.120131 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:11.120131 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:11.120131 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:11.121585 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:11.121585 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:11.121585 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:11.121585 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:11.121585 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:11.121585 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:11.121585 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:11.121585 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:11.121585 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:11.121585 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:11.121585 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:52:11.121585 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:52:11.121585 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 88/170] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:11.121585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b2e30-9166-469d-882e-5b16315f0b19 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:11.304412 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:11.307544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2d17b-0446-472a-9447-169189a60fda None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:11.352614 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:11.366749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b2e30-9166-469d-882e-5b16315f0b19 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:11.390653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef320f-6eb0-4c20-a873-136bdd0c14f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:11.391829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef320f-6eb0-4c20-a873-136bdd0c14f3 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:11.392323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef320f-6eb0-4c20-a873-136bdd0c14f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:11.392773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef320f-6eb0-4c20-a873-136bdd0c14f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:11.393948 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef320f-6eb0-4c20-a873-136bdd0c14f3 None admin] RBAC: Adding query filter params (role.id=695b07606e564668bac7afff4ab6052a, scope.project.id=d48c2e640c56445a9109354f89807e83, user.id=e6bf2139d86940dda0c8934f84df710d) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:11.394257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef320f-6eb0-4c20-a873-136bdd0c14f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:11.395730 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef320f-6eb0-4c20-a873-136bdd0c14f3 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:11.404860 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 83/171] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:52:11 2022] GET /identity/v3/role_assignments?user.id=e6bf2139d86940dda0c8934f84df710d&scope.project.id=d48c2e640c56445a9109354f89807e83&role.id=695b07606e564668bac7afff4ab6052a => generated 608 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:11.405933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef320f-6eb0-4c20-a873-136bdd0c14f3 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:11.472714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2415f-2132-49fc-98a8-a7a623905f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:11.473392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2415f-2132-49fc-98a8-a7a623905f37 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:11.473666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2415f-2132-49fc-98a8-a7a623905f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:11.473939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2415f-2132-49fc-98a8-a7a623905f37 None admin] PATH_INFO: `/v3/users/54ec182a52e14c09bda7b43dbb5c8427` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:11.475215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2415f-2132-49fc-98a8-a7a623905f37 None admin] RBAC: Authorizing `identity:get_user(user_id=54ec182a52e14c09bda7b43dbb5c8427)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:11.476774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2415f-2132-49fc-98a8-a7a623905f37 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:11.479818 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 89/172] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:52:11 2022] GET /identity/v3/users/54ec182a52e14c09bda7b43dbb5c8427 => generated 275 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:11.485049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2415f-2132-49fc-98a8-a7a623905f37 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:11.715623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2415f-2132-49fc-98a8-a7a623905f37 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:11.746193 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef320f-6eb0-4c20-a873-136bdd0c14f3 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:11.785963 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e2c34-1638-4839-953a-734eefebff90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:11.789913 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e2c34-1638-4839-953a-734eefebff90 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:11.790494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e2c34-1638-4839-953a-734eefebff90 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:11.790961 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e2c34-1638-4839-953a-734eefebff90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:11.820013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86469e-70c1-4597-9230-16c600813399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:11.822169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86469e-70c1-4597-9230-16c600813399 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:11.823152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86469e-70c1-4597-9230-16c600813399 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:11.823642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86469e-70c1-4597-9230-16c600813399 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:11.824986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86469e-70c1-4597-9230-16c600813399 None admin] RBAC: Adding query filter params (name=member) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:11.826016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86469e-70c1-4597-9230-16c600813399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:11.828529 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86469e-70c1-4597-9230-16c600813399 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:11.833028 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:11.851171 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 84/173] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Aug 7 00:52:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:11.853055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77fcd9-54c3-45b0-b3fa-0bec5b49c8be None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:11.853345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77fcd9-54c3-45b0-b3fa-0bec5b49c8be None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:11.853773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77fcd9-54c3-45b0-b3fa-0bec5b49c8be None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:11.856878 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 85/174] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:11.863082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b836643-4bec-4c9e-adf0-f4394a97abf1 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:11.863461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b836643-4bec-4c9e-adf0-f4394a97abf1 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:11.863958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b836643-4bec-4c9e-adf0-f4394a97abf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:11.897980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2b836643-4bec-4c9e-adf0-f4394a97abf1 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:11.899199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2b836643-4bec-4c9e-adf0-f4394a97abf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:11.920785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e2c34-1638-4839-953a-734eefebff90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:11.922548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e2c34-1638-4839-953a-734eefebff90 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:11.963143 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:12.023421 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 86/175] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:12.024426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b836643-4bec-4c9e-adf0-f4394a97abf1 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:12.135424 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 90/176] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:52:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:52:12.136350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e2c34-1638-4839-953a-734eefebff90 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:12.171623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b836643-4bec-4c9e-adf0-f4394a97abf1 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:12.212457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527615ac-b4c2-42cf-8bea-1755165ef8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:12.213112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527615ac-b4c2-42cf-8bea-1755165ef8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:12.213984 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527615ac-b4c2-42cf-8bea-1755165ef8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:12.214266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527615ac-b4c2-42cf-8bea-1755165ef8b4 None admin] PATH_INFO: `/v3/users/54ec182a52e14c09bda7b43dbb5c8427` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:12.215840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527615ac-b4c2-42cf-8bea-1755165ef8b4 None admin] RBAC: Authorizing `identity:get_user(user_id=54ec182a52e14c09bda7b43dbb5c8427)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:12.216607 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:12.219255 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527615ac-b4c2-42cf-8bea-1755165ef8b4 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:12.222908 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 87/177] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:52:12 2022] GET /identity/v3/users/54ec182a52e14c09bda7b43dbb5c8427 => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:12.224096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527615ac-b4c2-42cf-8bea-1755165ef8b4 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:12.300706 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:12.311171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e2c34-1638-4839-953a-734eefebff90 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:12.356366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6d091-3b36-4864-936c-8fddc5a3fcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:12.357135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6d091-3b36-4864-936c-8fddc5a3fcae None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:12.357494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6d091-3b36-4864-936c-8fddc5a3fcae None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:12.357812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6d091-3b36-4864-936c-8fddc5a3fcae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:12.363830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527615ac-b4c2-42cf-8bea-1755165ef8b4 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:12.371933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e6d091-3b36-4864-936c-8fddc5a3fcae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:12.376929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-c8e6d091-3b36-4864-936c-8fddc5a3fcae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:52:12.376929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:12.376929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:12.376929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:12.376929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:12.376929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:12.376929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:12.376929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:12.376929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:12.376929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:12.376929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:12.376929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:12.376929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:12.376929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:12.376929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:12.376929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:12.378035 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:12.378035 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:12.378035 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:12.378035 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:12.378035 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:12.378035 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:12.378035 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:12.378035 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:12.378035 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:12.378035 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:12.378035 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:12.378035 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:12.378035 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:12.378035 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:12.378035 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:12.378035 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:12.379020 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:12.379020 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:12.379020 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:12.379020 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:12.379020 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:12.379020 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:12.379020 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:12.379020 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:12.379020 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:12.379020 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:12.379020 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:52:12.379020 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:52:12.379020 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 91/178] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:12.379851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6d091-3b36-4864-936c-8fddc5a3fcae None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:12.419785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb3471-5f4a-469b-bc96-243c2be00f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:12.420755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb3471-5f4a-469b-bc96-243c2be00f2c None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:12.421464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb3471-5f4a-469b-bc96-243c2be00f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:12.423359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb3471-5f4a-469b-bc96-243c2be00f2c None admin] PATH_INFO: `/v3/projects/d48c2e640c56445a9109354f89807e83` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:12.424882 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb3471-5f4a-469b-bc96-243c2be00f2c None admin] RBAC: Authorizing `identity:get_project(project_id=d48c2e640c56445a9109354f89807e83)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:12.426613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb3471-5f4a-469b-bc96-243c2be00f2c None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:12.433729 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 88/179] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:12 2022] GET /identity/v3/projects/d48c2e640c56445a9109354f89807e83 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:12.433729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5092994-e3d5-4c14-bd77-63dfa2897c7d None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:12.434162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5092994-e3d5-4c14-bd77-63dfa2897c7d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:12.434828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5092994-e3d5-4c14-bd77-63dfa2897c7d None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:12.438045 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 89/180] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:12 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:12.439491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5092994-e3d5-4c14-bd77-63dfa2897c7d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:12.509827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6d091-3b36-4864-936c-8fddc5a3fcae None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:12.522665 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:12.558719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c7b07-fc4c-41a9-bc7e-cbd510c948b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:12.559530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c7b07-fc4c-41a9-bc7e-cbd510c948b5 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:12.559820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c7b07-fc4c-41a9-bc7e-cbd510c948b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:12.560147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c7b07-fc4c-41a9-bc7e-cbd510c948b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:12.565142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5092994-e3d5-4c14-bd77-63dfa2897c7d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:12.577837 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:12.613041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada0920-e2d3-47a4-b974-1707fbca0af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:12.614015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada0920-e2d3-47a4-b974-1707fbca0af5 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:12.614487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada0920-e2d3-47a4-b974-1707fbca0af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:12.614935 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada0920-e2d3-47a4-b974-1707fbca0af5 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:12.615809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada0920-e2d3-47a4-b974-1707fbca0af5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:12.616294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada0920-e2d3-47a4-b974-1707fbca0af5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:12.617861 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada0920-e2d3-47a4-b974-1707fbca0af5 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:12.635947 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 90/181] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Aug 7 00:52:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:12.635947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada0920-e2d3-47a4-b974-1707fbca0af5 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:12.664691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c7b07-fc4c-41a9-bc7e-cbd510c948b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:12.667228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c7b07-fc4c-41a9-bc7e-cbd510c948b5 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:12.762202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada0920-e2d3-47a4-b974-1707fbca0af5 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:12.798798 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 92/182] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:52:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:52:12.798798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d0be8-4a41-44af-aae5-e767601b3cf8 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:12.798798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d0be8-4a41-44af-aae5-e767601b3cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:12.798798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d0be8-4a41-44af-aae5-e767601b3cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:12.805626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4129dc-77ba-4181-9b5a-9706c637f118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:12.806244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4129dc-77ba-4181-9b5a-9706c637f118 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:12.806522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4129dc-77ba-4181-9b5a-9706c637f118 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:12.806840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4129dc-77ba-4181-9b5a-9706c637f118 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:12.807647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4129dc-77ba-4181-9b5a-9706c637f118 None admin] RBAC: Adding query filter params (role.id=04a874934a0944a2851b5e485a0f0a1b, scope.project.id=d48c2e640c56445a9109354f89807e83, user.id=54ec182a52e14c09bda7b43dbb5c8427) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:12.808006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4129dc-77ba-4181-9b5a-9706c637f118 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:12.809544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4129dc-77ba-4181-9b5a-9706c637f118 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:12.815932 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 91/183] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:52:12 2022] GET /identity/v3/role_assignments?user.id=54ec182a52e14c09bda7b43dbb5c8427&scope.project.id=d48c2e640c56445a9109354f89807e83&role.id=04a874934a0944a2851b5e485a0f0a1b => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:12.817323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493461d-9ea9-42d9-9791-4fff42b49850 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:12.817592 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493461d-9ea9-42d9-9791-4fff42b49850 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:12.817863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493461d-9ea9-42d9-9791-4fff42b49850 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:12.819347 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 92/184] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:12.820025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493461d-9ea9-42d9-9791-4fff42b49850 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:12.820303 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d85d0be8-4a41-44af-aae5-e767601b3cf8 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:12.821931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d85d0be8-4a41-44af-aae5-e767601b3cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:12.825042 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:12.879204 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:12.927648 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 93/185] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:12.937657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e1ea0-ceb1-484e-8e27-d09cd436c071 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:12.937899 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e1ea0-ceb1-484e-8e27-d09cd436c071 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:12.938188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e1ea0-ceb1-484e-8e27-d09cd436c071 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:12.941303 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 94/186] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:12 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:12.941501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e1ea0-ceb1-484e-8e27-d09cd436c071 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:12.987233 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493461d-9ea9-42d9-9791-4fff42b49850 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:13.031281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2cbdab-2123-47ae-ad3b-e066ec8d3523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:13.032743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cbdab-2123-47ae-ad3b-e066ec8d3523 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:13.033137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cbdab-2123-47ae-ad3b-e066ec8d3523 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:13.033482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2cbdab-2123-47ae-ad3b-e066ec8d3523 None admin] PATH_INFO: `/v3/users/dc3bca5944234d4f93a4562ea9643a2f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:13.035131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2cbdab-2123-47ae-ad3b-e066ec8d3523 None admin] RBAC: Authorizing `identity:get_user(user_id=dc3bca5944234d4f93a4562ea9643a2f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:13.036783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2cbdab-2123-47ae-ad3b-e066ec8d3523 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:13.038793 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 93/187] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:52:12 2022] GET /identity/v3/users/dc3bca5944234d4f93a4562ea9643a2f => generated 289 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:13.039978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3c88c-ce47-4bc4-b1f3-4b4dbcf20c12 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:13.040402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3c88c-ce47-4bc4-b1f3-4b4dbcf20c12 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:13.040569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3c88c-ce47-4bc4-b1f3-4b4dbcf20c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:13.061138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-66a3c88c-ce47-4bc4-b1f3-4b4dbcf20c12 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:13.062320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-66a3c88c-ce47-4bc4-b1f3-4b4dbcf20c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:13.099434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e1ea0-ceb1-484e-8e27-d09cd436c071 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:13.137268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c9504-848e-48e2-b6fb-40bef34a6d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:13.138021 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c9504-848e-48e2-b6fb-40bef34a6d31 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:13.138379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c9504-848e-48e2-b6fb-40bef34a6d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:13.138701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c9504-848e-48e2-b6fb-40bef34a6d31 None admin] PATH_INFO: `/v3/projects/26407313c821425aaeebf07af0eefbc3` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:13.140186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c9504-848e-48e2-b6fb-40bef34a6d31 None admin] RBAC: Authorizing `identity:get_project(project_id=26407313c821425aaeebf07af0eefbc3)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:13.142040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c9504-848e-48e2-b6fb-40bef34a6d31 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:13.142315 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 94/188] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:13.143719 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8de8c7-e5e9-4e97-aaa2-3745d7d73e16 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:13.144041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8de8c7-e5e9-4e97-aaa2-3745d7d73e16 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:13.144312 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8de8c7-e5e9-4e97-aaa2-3745d7d73e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:13.150009 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 95/189] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:12 2022] GET /identity/v3/projects/26407313c821425aaeebf07af0eefbc3 => generated 312 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:13.150009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c9504-848e-48e2-b6fb-40bef34a6d31 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:13.161189 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:13.166016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-7e8de8c7-e5e9-4e97-aaa2-3745d7d73e16 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:13.167204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7e8de8c7-e5e9-4e97-aaa2-3745d7d73e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:13.195560 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:13.244361 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 95/190] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:13.245838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8de8c7-e5e9-4e97-aaa2-3745d7d73e16 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:13.278370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c9504-848e-48e2-b6fb-40bef34a6d31 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:13.312989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96b223-cc60-4e01-b7a5-82d6f80e874d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:13.313602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96b223-cc60-4e01-b7a5-82d6f80e874d None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:13.313879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96b223-cc60-4e01-b7a5-82d6f80e874d None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:13.314146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96b223-cc60-4e01-b7a5-82d6f80e874d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:13.325460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b96b223-cc60-4e01-b7a5-82d6f80e874d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:13.334111 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-8b96b223-cc60-4e01-b7a5-82d6f80e874d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:52:13.334111 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:13.334111 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:13.334111 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:13.334111 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:13.334111 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:13.334111 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:13.334111 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:13.334111 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:13.334111 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:13.334111 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:13.334111 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:13.334111 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:13.334111 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:13.334111 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:13.334111 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:13.340175 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:13.340175 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:13.340175 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:13.340175 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:13.340175 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:13.340175 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:13.340175 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:13.340175 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:13.340175 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:13.340175 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:13.340175 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:13.340175 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:13.340175 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:13.340175 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:13.340175 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:13.340175 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:13.340966 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:13.340966 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:13.340966 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:13.340966 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:13.340966 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:13.340966 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:13.340966 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:13.340966 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:13.340966 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:13.340966 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:13.340966 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:52:13.340966 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:52:13.340966 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 96/191] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Aug 7 00:52:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:13.340966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96b223-cc60-4e01-b7a5-82d6f80e874d None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:13.374547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8de8c7-e5e9-4e97-aaa2-3745d7d73e16 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:13.409206 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:13.412666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9dbde8-0392-402a-919e-af2e97cc613d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:13.413259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9dbde8-0392-402a-919e-af2e97cc613d None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:13.413532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9dbde8-0392-402a-919e-af2e97cc613d None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:13.413801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9dbde8-0392-402a-919e-af2e97cc613d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:13.445534 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:13.448540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96b223-cc60-4e01-b7a5-82d6f80e874d None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:13.485028 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9dbde8-0392-402a-919e-af2e97cc613d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:13.487076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9dbde8-0392-402a-919e-af2e97cc613d None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:13.495152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b13b49-4bc6-4cfb-9c61-2f737f27479f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:13.495959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b13b49-4bc6-4cfb-9c61-2f737f27479f None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:13.496355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b13b49-4bc6-4cfb-9c61-2f737f27479f None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:13.496691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b13b49-4bc6-4cfb-9c61-2f737f27479f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:13.497674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b13b49-4bc6-4cfb-9c61-2f737f27479f None admin] RBAC: Adding query filter params (role.id=979b0708a1934c50b706215aa79dbb7a, scope.project.id=26407313c821425aaeebf07af0eefbc3, user.id=54ec182a52e14c09bda7b43dbb5c8427) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:13.498067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b13b49-4bc6-4cfb-9c61-2f737f27479f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:13.499964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b13b49-4bc6-4cfb-9c61-2f737f27479f None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:13.508723 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 97/192] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:52:13 2022] GET /identity/v3/role_assignments?user.id=54ec182a52e14c09bda7b43dbb5c8427&scope.project.id=26407313c821425aaeebf07af0eefbc3&role.id=979b0708a1934c50b706215aa79dbb7a => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:13.509728 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b13b49-4bc6-4cfb-9c61-2f737f27479f None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:13.616034 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 96/193] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:52:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:52:13.616815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9dbde8-0392-402a-919e-af2e97cc613d None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:13.663435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b13b49-4bc6-4cfb-9c61-2f737f27479f None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:13.702242 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:13.706042 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:13.714709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1b142-6bf5-4b78-8ff6-98f241882523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:13.715557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1b142-6bf5-4b78-8ff6-98f241882523 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:13.715966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1b142-6bf5-4b78-8ff6-98f241882523 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:13.716315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1b142-6bf5-4b78-8ff6-98f241882523 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:13.733723 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc1b142-6bf5-4b78-8ff6-98f241882523 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:13.739782 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-ffc1b142-6bf5-4b78-8ff6-98f241882523 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:52:13.739782 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:13.739782 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:13.739782 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:13.739782 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:13.739782 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:13.739782 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:13.739782 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:13.739782 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:13.739782 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:13.739782 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:13.739782 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:13.739782 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:13.739782 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:13.739782 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:13.739782 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:13.740749 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:13.740749 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:13.740749 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:13.740749 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:13.740749 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:13.740749 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:13.740749 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:13.740749 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:13.740749 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:13.740749 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:13.740749 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:13.740749 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:13.740749 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:13.740749 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:13.740749 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:13.740749 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:13.741556 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:13.741556 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:13.741556 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:13.741556 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:13.741556 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:13.741556 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:13.741556 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:13.741556 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:13.741556 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:13.741556 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:13.741556 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:52:13.741556 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:52:13.741556 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 98/194] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:52:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:13.742209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1b142-6bf5-4b78-8ff6-98f241882523 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:13.758059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9dbde8-0392-402a-919e-af2e97cc613d None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:13.807220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c752e-dd6d-450e-9435-0e3cde9b5f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:13.807873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c752e-dd6d-450e-9435-0e3cde9b5f64 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:13.808151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c752e-dd6d-450e-9435-0e3cde9b5f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:13.808420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c752e-dd6d-450e-9435-0e3cde9b5f64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:13.809551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c752e-dd6d-450e-9435-0e3cde9b5f64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:13.811044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c752e-dd6d-450e-9435-0e3cde9b5f64 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:13.817839 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 97/195] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:52:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:13.817839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c752e-dd6d-450e-9435-0e3cde9b5f64 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:13.862347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1b142-6bf5-4b78-8ff6-98f241882523 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:13.899300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724b37f-0503-4a00-835f-5f5278d20d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:13.899859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724b37f-0503-4a00-835f-5f5278d20d45 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:13.900167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724b37f-0503-4a00-835f-5f5278d20d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:13.900438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724b37f-0503-4a00-835f-5f5278d20d45 None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:13.901137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724b37f-0503-4a00-835f-5f5278d20d45 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:13.901438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724b37f-0503-4a00-835f-5f5278d20d45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:13.902835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724b37f-0503-4a00-835f-5f5278d20d45 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:13.911049 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 99/196] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:52:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:13.911870 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724b37f-0503-4a00-835f-5f5278d20d45 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:13.917400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c752e-dd6d-450e-9435-0e3cde9b5f64 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:13.951532 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:13.956966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc471ca7-1f58-409b-95fe-78e904c686ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:13.957596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc471ca7-1f58-409b-95fe-78e904c686ca None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:13.957868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc471ca7-1f58-409b-95fe-78e904c686ca None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:13.958393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc471ca7-1f58-409b-95fe-78e904c686ca None admin] PATH_INFO: `/v3/projects/d48c2e640c56445a9109354f89807e83` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:13.959250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc471ca7-1f58-409b-95fe-78e904c686ca None admin] RBAC: Authorizing `identity:get_project(project_id=d48c2e640c56445a9109354f89807e83)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:13.960787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc471ca7-1f58-409b-95fe-78e904c686ca None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:13.962548 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 98/197] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:13 2022] GET /identity/v3/projects/d48c2e640c56445a9109354f89807e83 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:13.963107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc471ca7-1f58-409b-95fe-78e904c686ca None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:13.969466 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:14.032214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724b37f-0503-4a00-835f-5f5278d20d45 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:14.068761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18d74e-77f6-4d88-8ed8-27b51c63aad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:14.069364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18d74e-77f6-4d88-8ed8-27b51c63aad3 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:14.069642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18d74e-77f6-4d88-8ed8-27b51c63aad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:14.069910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18d74e-77f6-4d88-8ed8-27b51c63aad3 None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:14.070584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18d74e-77f6-4d88-8ed8-27b51c63aad3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:14.070886 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18d74e-77f6-4d88-8ed8-27b51c63aad3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:14.072301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18d74e-77f6-4d88-8ed8-27b51c63aad3 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:14.073272 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc471ca7-1f58-409b-95fe-78e904c686ca None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:14.080816 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 100/198] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:14.081619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18d74e-77f6-4d88-8ed8-27b51c63aad3 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:14.111014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da7846-ecb6-442f-bdc4-ab0f76792237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:14.111643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da7846-ecb6-442f-bdc4-ab0f76792237 None admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:14.112450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da7846-ecb6-442f-bdc4-ab0f76792237 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:14.112731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da7846-ecb6-442f-bdc4-ab0f76792237 None admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:14.113387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da7846-ecb6-442f-bdc4-ab0f76792237 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:14.115119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da7846-ecb6-442f-bdc4-ab0f76792237 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:14.135568 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 99/199] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Aug 7 00:52:13 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:52:14.136453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da7846-ecb6-442f-bdc4-ab0f76792237 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:14.211992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18d74e-77f6-4d88-8ed8-27b51c63aad3 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:14.221054 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:14.234289 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:14.262121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792fa8c-2cd0-4fed-868c-0bee1a721aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:14.263330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792fa8c-2cd0-4fed-868c-0bee1a721aad None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:14.263799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792fa8c-2cd0-4fed-868c-0bee1a721aad None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:14.264123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792fa8c-2cd0-4fed-868c-0bee1a721aad None admin] PATH_INFO: `/v3/users/dc9be94b47244e02876687f29482a820` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:14.286992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792fa8c-2cd0-4fed-868c-0bee1a721aad None admin] RBAC: Authorizing `identity:get_user(user_id=dc9be94b47244e02876687f29482a820)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:14.288527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792fa8c-2cd0-4fed-868c-0bee1a721aad None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:14.288786 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da7846-ecb6-442f-bdc4-ab0f76792237 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:14.290542 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 101/200] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:52:14 2022] GET /identity/v3/users/dc9be94b47244e02876687f29482a820 => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:14.291126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792fa8c-2cd0-4fed-868c-0bee1a721aad None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:14.348580 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc2dd6-4165-4a85-8f84-932fbfc9d2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:14.349234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc2dd6-4165-4a85-8f84-932fbfc9d2ec None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:14.349516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc2dd6-4165-4a85-8f84-932fbfc9d2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:14.349791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc2dd6-4165-4a85-8f84-932fbfc9d2ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:14.350598 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc2dd6-4165-4a85-8f84-932fbfc9d2ec None admin] RBAC: Adding query filter params (role.id=53830cd13bce471ba955d5469f3330f4, scope.project.id=d48c2e640c56445a9109354f89807e83, user.id=dc3bca5944234d4f93a4562ea9643a2f) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:14.350886 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc2dd6-4165-4a85-8f84-932fbfc9d2ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:14.352519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc2dd6-4165-4a85-8f84-932fbfc9d2ec None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:14.359017 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 100/201] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:52:14 2022] GET /identity/v3/role_assignments?user.id=dc3bca5944234d4f93a4562ea9643a2f&scope.project.id=d48c2e640c56445a9109354f89807e83&role.id=53830cd13bce471ba955d5469f3330f4 => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:14.361408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc2dd6-4165-4a85-8f84-932fbfc9d2ec None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:14.455032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792fa8c-2cd0-4fed-868c-0bee1a721aad None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:14.500509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73399ab4-69ca-4e96-a7c5-501de7d3eead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:14.501346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73399ab4-69ca-4e96-a7c5-501de7d3eead None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:14.501582 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73399ab4-69ca-4e96-a7c5-501de7d3eead None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:14.501809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73399ab4-69ca-4e96-a7c5-501de7d3eead None admin] PATH_INFO: `/v3/users/dc9be94b47244e02876687f29482a820` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:14.503182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73399ab4-69ca-4e96-a7c5-501de7d3eead None admin] RBAC: Authorizing `identity:get_user(user_id=dc9be94b47244e02876687f29482a820)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:14.504825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73399ab4-69ca-4e96-a7c5-501de7d3eead None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:14.507980 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 102/202] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:52:14 2022] GET /identity/v3/users/dc9be94b47244e02876687f29482a820 => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:14.514248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73399ab4-69ca-4e96-a7c5-501de7d3eead None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:14.553950 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc2dd6-4165-4a85-8f84-932fbfc9d2ec None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:14.581830 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:14.582069 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:14.601705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789b04c-19cb-4fad-b660-25a2a7007de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:14.602570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789b04c-19cb-4fad-b660-25a2a7007de7 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:14.602997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789b04c-19cb-4fad-b660-25a2a7007de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:14.603516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789b04c-19cb-4fad-b660-25a2a7007de7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:14.694884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73399ab4-69ca-4e96-a7c5-501de7d3eead None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:14.696382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789b04c-19cb-4fad-b660-25a2a7007de7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:14.698342 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789b04c-19cb-4fad-b660-25a2a7007de7 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:14.743553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40aaf5-84c8-4866-999a-4605c105a208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:14.744214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40aaf5-84c8-4866-999a-4605c105a208 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:14.744498 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40aaf5-84c8-4866-999a-4605c105a208 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:14.744775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40aaf5-84c8-4866-999a-4605c105a208 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:14.828431 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 101/203] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:52:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:52:14.834222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789b04c-19cb-4fad-b660-25a2a7007de7 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:14.841202 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a40aaf5-84c8-4866-999a-4605c105a208 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:14.842725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a40aaf5-84c8-4866-999a-4605c105a208 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:14.880303 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:14.922857 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:15.006029 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789b04c-19cb-4fad-b660-25a2a7007de7 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:15.038298 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 103/204] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:52:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 00:52:15.039675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40aaf5-84c8-4866-999a-4605c105a208 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:15.062898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd90e6-1582-471f-9715-d5579f6c883b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:15.065001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd90e6-1582-471f-9715-d5579f6c883b None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:15.065397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd90e6-1582-471f-9715-d5579f6c883b None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:15.065677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd90e6-1582-471f-9715-d5579f6c883b None admin] PATH_INFO: `/v3/projects/2388c261a2d64686b83675d2cd97701c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:15.067708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd90e6-1582-471f-9715-d5579f6c883b None admin] RBAC: Authorizing `identity:get_project(project_id=2388c261a2d64686b83675d2cd97701c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:15.069210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd90e6-1582-471f-9715-d5579f6c883b None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:15.071148 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 102/205] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:14 2022] GET /identity/v3/projects/2388c261a2d64686b83675d2cd97701c => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:15.083993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd90e6-1582-471f-9715-d5579f6c883b None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:15.188960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40aaf5-84c8-4866-999a-4605c105a208 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:15.199715 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:15.221030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd90e6-1582-471f-9715-d5579f6c883b None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:15.246442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddaf3d-d508-4e59-bcaf-f19595c85c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:15.247481 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddaf3d-d508-4e59-bcaf-f19595c85c57 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:15.247758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddaf3d-d508-4e59-bcaf-f19595c85c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:15.248057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddaf3d-d508-4e59-bcaf-f19595c85c57 None admin] PATH_INFO: `/v3/projects/2388c261a2d64686b83675d2cd97701c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:15.249482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ddaf3d-d508-4e59-bcaf-f19595c85c57 None admin] RBAC: Authorizing `identity:get_project(project_id=2388c261a2d64686b83675d2cd97701c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:15.251840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ddaf3d-d508-4e59-bcaf-f19595c85c57 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:15.254565 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 104/206] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:15 2022] GET /identity/v3/projects/2388c261a2d64686b83675d2cd97701c => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:15.260034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddaf3d-d508-4e59-bcaf-f19595c85c57 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:15.274235 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f397b8-720c-46d0-b85e-701702da7367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:15.274481 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:15.275073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f397b8-720c-46d0-b85e-701702da7367 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:15.275353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f397b8-720c-46d0-b85e-701702da7367 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:15.275696 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f397b8-720c-46d0-b85e-701702da7367 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:15.276522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f397b8-720c-46d0-b85e-701702da7367 None admin] RBAC: Adding query filter params (role.id=04a874934a0944a2851b5e485a0f0a1b, scope.project.id=2388c261a2d64686b83675d2cd97701c, user.id=dc9be94b47244e02876687f29482a820) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:15.277150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f397b8-720c-46d0-b85e-701702da7367 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:15.279480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f397b8-720c-46d0-b85e-701702da7367 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:15.292338 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 103/207] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:52:15 2022] GET /identity/v3/role_assignments?user.id=dc9be94b47244e02876687f29482a820&scope.project.id=2388c261a2d64686b83675d2cd97701c&role.id=04a874934a0944a2851b5e485a0f0a1b => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:15.415061 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddaf3d-d508-4e59-bcaf-f19595c85c57 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:15.468362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dfeb2a-b8b2-4664-81e8-5dfcac883598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:15.469242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfeb2a-b8b2-4664-81e8-5dfcac883598 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:15.469722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfeb2a-b8b2-4664-81e8-5dfcac883598 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:15.470126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfeb2a-b8b2-4664-81e8-5dfcac883598 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:15.471279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dfeb2a-b8b2-4664-81e8-5dfcac883598 None admin] RBAC: Adding query filter params (role.id=695b07606e564668bac7afff4ab6052a, scope.project.id=2388c261a2d64686b83675d2cd97701c, user.id=dc9be94b47244e02876687f29482a820) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:15.471745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dfeb2a-b8b2-4664-81e8-5dfcac883598 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:15.474090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dfeb2a-b8b2-4664-81e8-5dfcac883598 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:15.483817 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 105/208] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:52:15 2022] GET /identity/v3/role_assignments?user.id=dc9be94b47244e02876687f29482a820&scope.project.id=2388c261a2d64686b83675d2cd97701c&role.id=695b07606e564668bac7afff4ab6052a => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:52:16.679057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76f844-1c04-4381-b0c4-c0541d7e6a36 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:16.679654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76f844-1c04-4381-b0c4-c0541d7e6a36 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:16.679820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76f844-1c04-4381-b0c4-c0541d7e6a36 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:16.681274 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 104/209] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:16.686645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba9af0-e72d-4e4b-88fd-61a038e0025b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:16.687131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba9af0-e72d-4e4b-88fd-61a038e0025b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:16.687309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba9af0-e72d-4e4b-88fd-61a038e0025b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:16.712944 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-edba9af0-e72d-4e4b-88fd-61a038e0025b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:16.714796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-edba9af0-e72d-4e4b-88fd-61a038e0025b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:16.795134 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 106/210] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:16.817898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76f844-1c04-4381-b0c4-c0541d7e6a36 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:16.933345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76f844-1c04-4381-b0c4-c0541d7e6a36 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:16.947005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef80b8-6423-430b-9f0e-ac958ab1a735 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:16.947371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef80b8-6423-430b-9f0e-ac958ab1a735 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:16.947757 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef80b8-6423-430b-9f0e-ac958ab1a735 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:16.949792 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 107/211] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:52:16.955628 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b57195-8c18-4064-bfad-c1b2009e3121 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:16.956014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b57195-8c18-4064-bfad-c1b2009e3121 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:16.956372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b57195-8c18-4064-bfad-c1b2009e3121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:16.967140 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:16.987146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe60bb5-1f62-4830-af60-6c0ae0d0e72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:16.987920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-f0b57195-8c18-4064-bfad-c1b2009e3121 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:16.988307 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe60bb5-1f62-4830-af60-6c0ae0d0e72c None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:16.988780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe60bb5-1f62-4830-af60-6c0ae0d0e72c None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:16.989247 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe60bb5-1f62-4830-af60-6c0ae0d0e72c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:16.989434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f0b57195-8c18-4064-bfad-c1b2009e3121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:17.001412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe60bb5-1f62-4830-af60-6c0ae0d0e72c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:17.007180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-dfe60bb5-1f62-4830-af60-6c0ae0d0e72c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:52:17.007180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:17.007180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:17.007180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:17.007180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:17.007180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:17.007180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:17.007180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:17.007180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:17.007180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:17.007180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:17.007180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:17.007180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:17.007180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:17.007180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:17.007180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:17.008335 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:17.008335 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:17.008335 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:17.008335 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:17.008335 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:17.008335 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:17.008335 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:17.008335 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:17.008335 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:17.008335 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:17.008335 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:17.008335 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:17.008335 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:17.008335 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:17.008335 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:17.008335 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:17.009150 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:17.009150 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:17.009150 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:17.009150 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:17.009150 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:17.009150 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:17.009150 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:17.009150 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:17.009150 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:17.009150 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:17.009150 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:52:17.009150 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:17.011669 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 105/212] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:17.019593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe60bb5-1f62-4830-af60-6c0ae0d0e72c None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:17.038728 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:17.103738 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 108/213] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:52:17.128024 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b57195-8c18-4064-bfad-c1b2009e3121 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:17.167552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe60bb5-1f62-4830-af60-6c0ae0d0e72c None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:17.217802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bb5d2-98cd-43be-b8e5-6b79e351e275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:17.219012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bb5d2-98cd-43be-b8e5-6b79e351e275 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:17.220273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bb5d2-98cd-43be-b8e5-6b79e351e275 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:17.220823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bb5d2-98cd-43be-b8e5-6b79e351e275 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:17.221968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bb5d2-98cd-43be-b8e5-6b79e351e275 None admin] RBAC: Adding query filter params (name=member) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:17.222645 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bb5d2-98cd-43be-b8e5-6b79e351e275 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:17.224814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bb5d2-98cd-43be-b8e5-6b79e351e275 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:17.237863 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 106/214] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Aug 7 00:52:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:17.243774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bb5d2-98cd-43be-b8e5-6b79e351e275 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:17.250329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b57195-8c18-4064-bfad-c1b2009e3121 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:17.284001 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:17.290962 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ece0d-c30e-47e7-ae47-ee3ad883b640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:17.291633 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ece0d-c30e-47e7-ae47-ee3ad883b640 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:17.291926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ece0d-c30e-47e7-ae47-ee3ad883b640 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:17.292199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ece0d-c30e-47e7-ae47-ee3ad883b640 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:17.293407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ece0d-c30e-47e7-ae47-ee3ad883b640 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:17.294992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ece0d-c30e-47e7-ae47-ee3ad883b640 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:17.296729 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 109/215] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:52:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:52:17.302970 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ece0d-c30e-47e7-ae47-ee3ad883b640 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:17.369790 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:17.403794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bb5d2-98cd-43be-b8e5-6b79e351e275 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:17.418645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ece0d-c30e-47e7-ae47-ee3ad883b640 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:17.453345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efb892-305b-4194-9c43-482bfffc994d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:17.454022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efb892-305b-4194-9c43-482bfffc994d None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:17.454319 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efb892-305b-4194-9c43-482bfffc994d None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:17.454605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efb892-305b-4194-9c43-482bfffc994d None admin] PATH_INFO: `/v3/users/2a406330036d40b68d56f5a46cc31402` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:17.473409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efb892-305b-4194-9c43-482bfffc994d None admin] RBAC: Authorizing `identity:get_user(user_id=2a406330036d40b68d56f5a46cc31402)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:17.474949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efb892-305b-4194-9c43-482bfffc994d None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:17.481546 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 107/216] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:52:17 2022] GET /identity/v3/users/2a406330036d40b68d56f5a46cc31402 => generated 297 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:17.481546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96881a-9027-4af5-9bbe-99750dccbf30 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:17.481546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96881a-9027-4af5-9bbe-99750dccbf30 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:17.481546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96881a-9027-4af5-9bbe-99750dccbf30 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:17.481546 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 108/217] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:17.482598 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96881a-9027-4af5-9bbe-99750dccbf30 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:17.483740 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff34d71-bd5b-4b4a-bade-3bd30111d548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:17.484523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff34d71-bd5b-4b4a-bade-3bd30111d548 None admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:17.484801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff34d71-bd5b-4b4a-bade-3bd30111d548 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:17.485169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff34d71-bd5b-4b4a-bade-3bd30111d548 None admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:17.486345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff34d71-bd5b-4b4a-bade-3bd30111d548 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:17.488370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff34d71-bd5b-4b4a-bade-3bd30111d548 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:17.520098 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 110/218] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Aug 7 00:52:17 2022] POST /identity/v3/users => generated 297 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 00:52:17.521584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57c71c-57ac-44c7-adc7-794f11263368 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:17.521952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57c71c-57ac-44c7-adc7-794f11263368 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:17.522482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57c71c-57ac-44c7-adc7-794f11263368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:17.543174 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0d57c71c-57ac-44c7-adc7-794f11263368 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:17.544467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0d57c71c-57ac-44c7-adc7-794f11263368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:17.613442 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:17.636567 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 111/219] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:17.664539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57c71c-57ac-44c7-adc7-794f11263368 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:17.675114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96881a-9027-4af5-9bbe-99750dccbf30 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:17.713614 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:17.720481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ae850-a29d-4a61-933d-294de899f45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:17.721730 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ae850-a29d-4a61-933d-294de899f45f None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:17.722243 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ae850-a29d-4a61-933d-294de899f45f None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:17.722738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ae850-a29d-4a61-933d-294de899f45f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:17.804422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57c71c-57ac-44c7-adc7-794f11263368 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:17.811432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ae850-a29d-4a61-933d-294de899f45f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:17.811432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ae850-a29d-4a61-933d-294de899f45f None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:17.862709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdec1d8-ff52-4f43-97b4-4128837ec4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:17.863364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdec1d8-ff52-4f43-97b4-4128837ec4d9 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:17.863636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdec1d8-ff52-4f43-97b4-4128837ec4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:17.863927 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdec1d8-ff52-4f43-97b4-4128837ec4d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:17.877227 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdec1d8-ff52-4f43-97b4-4128837ec4d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:17.882603 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-ccdec1d8-ff52-4f43-97b4-4128837ec4d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:52:17.882603 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:17.882603 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:17.882603 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:17.882603 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:17.882603 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:17.882603 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:17.882603 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:17.882603 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:17.882603 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:17.882603 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:17.882603 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:17.882603 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:17.882603 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:17.882603 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:17.882603 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:17.883570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:17.883570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:17.883570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:17.883570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:17.883570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:17.883570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:17.883570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:17.883570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:17.883570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:17.883570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:17.883570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:17.883570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:17.883570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:17.883570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:17.883570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:17.883570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:17.884677 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:17.884677 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:17.884677 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:17.884677 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:17.884677 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:17.884677 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:17.884677 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:17.884677 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:17.884677 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:17.884677 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:17.884677 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:52:17.884677 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:52:17.887227 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 112/220] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Aug 7 00:52:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:52:17.888649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf15d6b-0553-4a40-8e9e-cd028a6f7443 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:17.888954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf15d6b-0553-4a40-8e9e-cd028a6f7443 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:17.889238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf15d6b-0553-4a40-8e9e-cd028a6f7443 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:17.890590 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 113/221] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:17.897025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6125f-f24b-4890-91ff-96ceb8a3f1fa None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:17.897599 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6125f-f24b-4890-91ff-96ceb8a3f1fa None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:17.897893 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6125f-f24b-4890-91ff-96ceb8a3f1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:17.921132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-edd6125f-f24b-4890-91ff-96ceb8a3f1fa None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:17.922350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-edd6125f-f24b-4890-91ff-96ceb8a3f1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:17.951912 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 109/222] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:52:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:52:17.953223 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ae850-a29d-4a61-933d-294de899f45f None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:17.986261 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:18.009661 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:18.060622 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 114/223] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:52:18.066950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6125f-f24b-4890-91ff-96ceb8a3f1fa None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:18.071283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ae850-a29d-4a61-933d-294de899f45f None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:18.151872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157aa3e-8141-4715-bcf7-26b305f0b549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:18.152935 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157aa3e-8141-4715-bcf7-26b305f0b549 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:18.153679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157aa3e-8141-4715-bcf7-26b305f0b549 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:18.154225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157aa3e-8141-4715-bcf7-26b305f0b549 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:18.155630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157aa3e-8141-4715-bcf7-26b305f0b549 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:18.156165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157aa3e-8141-4715-bcf7-26b305f0b549 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:18.158507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157aa3e-8141-4715-bcf7-26b305f0b549 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:18.169649 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 110/224] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:52:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:18.170845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157aa3e-8141-4715-bcf7-26b305f0b549 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:18.230184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6125f-f24b-4890-91ff-96ceb8a3f1fa None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:18.290716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdbf95-caf3-451a-92c0-2f5a287ffc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:18.293117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdbf95-caf3-451a-92c0-2f5a287ffc09 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:18.294166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdbf95-caf3-451a-92c0-2f5a287ffc09 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:18.294869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdbf95-caf3-451a-92c0-2f5a287ffc09 None admin] PATH_INFO: `/v3/projects/2388c261a2d64686b83675d2cd97701c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:18.298004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fdbf95-caf3-451a-92c0-2f5a287ffc09 None admin] RBAC: Authorizing `identity:get_project(project_id=2388c261a2d64686b83675d2cd97701c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:18.300972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fdbf95-caf3-451a-92c0-2f5a287ffc09 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:18.302908 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 115/225] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:18 2022] GET /identity/v3/projects/2388c261a2d64686b83675d2cd97701c => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:18.305101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdbf95-caf3-451a-92c0-2f5a287ffc09 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:18.310032 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:18.319857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157aa3e-8141-4715-bcf7-26b305f0b549 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:18.368264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c597c0-75fa-485a-ac8c-445cf03c2ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:18.368907 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c597c0-75fa-485a-ac8c-445cf03c2ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:18.369180 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c597c0-75fa-485a-ac8c-445cf03c2ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:18.369450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c597c0-75fa-485a-ac8c-445cf03c2ac2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:18.376836 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:18.385942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c597c0-75fa-485a-ac8c-445cf03c2ac2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:18.392051 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-e1c597c0-75fa-485a-ac8c-445cf03c2ac2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:52:18.392051 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:18.392051 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:18.392051 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:18.392051 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:18.392051 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:18.392051 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:18.392051 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:18.392051 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:18.392051 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:18.392051 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:18.392051 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:18.392051 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:18.392051 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:18.392051 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:18.392051 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:18.393579 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:18.393579 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:18.393579 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:18.393579 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:18.393579 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:18.393579 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:18.393579 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:18.393579 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:18.393579 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:18.393579 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:18.393579 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:18.393579 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:18.393579 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:18.393579 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:18.393579 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:18.393579 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:18.394618 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:18.394618 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:18.394618 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:18.394618 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:18.394618 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:18.394618 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:18.394618 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:18.394618 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:18.394618 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:18.394618 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:18.394618 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:52:18.394618 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:18.403454 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 111/226] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:52:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:18.404653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c597c0-75fa-485a-ac8c-445cf03c2ac2 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:18.486806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdbf95-caf3-451a-92c0-2f5a287ffc09 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:18.516655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c597c0-75fa-485a-ac8c-445cf03c2ac2 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:18.549065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c75d8d-817d-4b60-8537-8627064b123d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:18.550043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c75d8d-817d-4b60-8537-8627064b123d None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:18.550732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c75d8d-817d-4b60-8537-8627064b123d None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:18.551252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c75d8d-817d-4b60-8537-8627064b123d None admin] PATH_INFO: `/v3/users/dc9be94b47244e02876687f29482a820` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:18.553414 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c75d8d-817d-4b60-8537-8627064b123d None admin] RBAC: Authorizing `identity:get_user(user_id=dc9be94b47244e02876687f29482a820)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:18.555999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c75d8d-817d-4b60-8537-8627064b123d None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:18.557048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abdbf1-511a-4e63-924d-118713a800a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:18.557847 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abdbf1-511a-4e63-924d-118713a800a8 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:18.558290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abdbf1-511a-4e63-924d-118713a800a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:18.558725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abdbf1-511a-4e63-924d-118713a800a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:18.559468 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 116/227] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:52:18 2022] GET /identity/v3/users/dc9be94b47244e02876687f29482a820 => generated 283 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:18.559829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7abdbf1-511a-4e63-924d-118713a800a8 None admin] RBAC: Adding query filter params (role.id=979b0708a1934c50b706215aa79dbb7a, scope.project.id=2388c261a2d64686b83675d2cd97701c, user.id=2a406330036d40b68d56f5a46cc31402) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:18.560365 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7abdbf1-511a-4e63-924d-118713a800a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:18.561084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c75d8d-817d-4b60-8537-8627064b123d None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:18.562209 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7abdbf1-511a-4e63-924d-118713a800a8 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:18.569361 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 112/228] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:52:18 2022] GET /identity/v3/role_assignments?user.id=2a406330036d40b68d56f5a46cc31402&scope.project.id=2388c261a2d64686b83675d2cd97701c&role.id=979b0708a1934c50b706215aa79dbb7a => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:18.570579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abdbf1-511a-4e63-924d-118713a800a8 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:18.590934 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:18.718557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abdbf1-511a-4e63-924d-118713a800a8 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:18.757286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c75d8d-817d-4b60-8537-8627064b123d None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:18.759382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4deb0-6f22-4661-b851-69f0e8944bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:18.760312 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4deb0-6f22-4661-b851-69f0e8944bbc None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:18.760782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4deb0-6f22-4661-b851-69f0e8944bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:18.761237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4deb0-6f22-4661-b851-69f0e8944bbc None admin] PATH_INFO: `/v3/projects/2388c261a2d64686b83675d2cd97701c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:18.762571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4deb0-6f22-4661-b851-69f0e8944bbc None admin] RBAC: Authorizing `identity:get_project(project_id=2388c261a2d64686b83675d2cd97701c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:18.771915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4deb0-6f22-4661-b851-69f0e8944bbc None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:18.777219 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 113/229] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:18 2022] GET /identity/v3/projects/2388c261a2d64686b83675d2cd97701c => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:18.783346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4deb0-6f22-4661-b851-69f0e8944bbc None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:18.783791 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:18.822580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1218bab-b4f5-4929-a55c-9e6d37436ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:18.823504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1218bab-b4f5-4929-a55c-9e6d37436ead None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:18.823971 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1218bab-b4f5-4929-a55c-9e6d37436ead None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:18.824640 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1218bab-b4f5-4929-a55c-9e6d37436ead None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:18.825861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1218bab-b4f5-4929-a55c-9e6d37436ead None admin] RBAC: Adding query filter params (name=admin) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:18.826350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1218bab-b4f5-4929-a55c-9e6d37436ead None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:18.829492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1218bab-b4f5-4929-a55c-9e6d37436ead None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:18.845855 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 117/230] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:18.852628 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1218bab-b4f5-4929-a55c-9e6d37436ead None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:18.907371 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:18.944425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4deb0-6f22-4661-b851-69f0e8944bbc None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:18.995163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1218bab-b4f5-4929-a55c-9e6d37436ead None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:19.027595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c0dbb-0f68-41d0-bba7-45697d3c8f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:19.028431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c0dbb-0f68-41d0-bba7-45697d3c8f2b None admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:19.028876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c0dbb-0f68-41d0-bba7-45697d3c8f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:19.029289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c0dbb-0f68-41d0-bba7-45697d3c8f2b None admin] PATH_INFO: `/v3/projects/2388c261a2d64686b83675d2cd97701c/users/dc9be94b47244e02876687f29482a820/roles/04a874934a0944a2851b5e485a0f0a1b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:19.031811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c0dbb-0f68-41d0-bba7-45697d3c8f2b None admin] RBAC: Authorizing `identity:create_grant(project_id=2388c261a2d64686b83675d2cd97701c, user_id=dc9be94b47244e02876687f29482a820, role_id=04a874934a0944a2851b5e485a0f0a1b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:19.039915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c0dbb-0f68-41d0-bba7-45697d3c8f2b None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:19.048483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d6d99-5077-4d01-b85f-4bf8662e8525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:19.049368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d6d99-5077-4d01-b85f-4bf8662e8525 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:19.049796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d6d99-5077-4d01-b85f-4bf8662e8525 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:19.050403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d6d99-5077-4d01-b85f-4bf8662e8525 None admin] PATH_INFO: `/v3/users/dc9be94b47244e02876687f29482a820` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:19.054579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d6d99-5077-4d01-b85f-4bf8662e8525 None admin] RBAC: Authorizing `identity:get_user(user_id=dc9be94b47244e02876687f29482a820)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:19.060477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d6d99-5077-4d01-b85f-4bf8662e8525 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:19.065656 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 114/231] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Aug 7 00:52:18 2022] PUT /identity/v3/projects/2388c261a2d64686b83675d2cd97701c/users/dc9be94b47244e02876687f29482a820/roles/04a874934a0944a2851b5e485a0f0a1b => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 00:52:19.067389 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 118/232] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:52:18 2022] GET /identity/v3/users/dc9be94b47244e02876687f29482a820 => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:19.073829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c0dbb-0f68-41d0-bba7-45697d3c8f2b None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:19.247488 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c0dbb-0f68-41d0-bba7-45697d3c8f2b None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:19.294254 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce56702-054e-4ac0-9eeb-9927e670eb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:19.295253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce56702-054e-4ac0-9eeb-9927e670eb31 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:19.295722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce56702-054e-4ac0-9eeb-9927e670eb31 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:19.296237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce56702-054e-4ac0-9eeb-9927e670eb31 None admin] PATH_INFO: `/v3/projects/2388c261a2d64686b83675d2cd97701c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:19.297603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce56702-054e-4ac0-9eeb-9927e670eb31 None admin] RBAC: Authorizing `identity:get_project(project_id=2388c261a2d64686b83675d2cd97701c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:19.299233 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce56702-054e-4ac0-9eeb-9927e670eb31 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:19.301118 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 115/233] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:19 2022] GET /identity/v3/projects/2388c261a2d64686b83675d2cd97701c => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:19.307596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d6d99-5077-4d01-b85f-4bf8662e8525 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:19.365226 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:19.463031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d6d99-5077-4d01-b85f-4bf8662e8525 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:19.526864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487f9b7-e0fb-483c-8ca6-f50d16a2588e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:19.527535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487f9b7-e0fb-483c-8ca6-f50d16a2588e None admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:19.527826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487f9b7-e0fb-483c-8ca6-f50d16a2588e None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:19.528183 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487f9b7-e0fb-483c-8ca6-f50d16a2588e None admin] PATH_INFO: `/v3/projects/2388c261a2d64686b83675d2cd97701c/users/dc9be94b47244e02876687f29482a820/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:19.533430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487f9b7-e0fb-483c-8ca6-f50d16a2588e None admin] RBAC: Authorizing `identity:create_grant(project_id=2388c261a2d64686b83675d2cd97701c, user_id=dc9be94b47244e02876687f29482a820, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:19.534930 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487f9b7-e0fb-483c-8ca6-f50d16a2588e None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:19.557264 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 119/234] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Aug 7 00:52:19 2022] PUT /identity/v3/projects/2388c261a2d64686b83675d2cd97701c/users/dc9be94b47244e02876687f29482a820/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:52:20.106170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22444e71-e255-4157-87b4-66cba5fd0bd6 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:20.106735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22444e71-e255-4157-87b4-66cba5fd0bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:20.106735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22444e71-e255-4157-87b4-66cba5fd0bd6 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:20.108437 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 116/235] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:20.119852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056f097-6afe-401f-a830-ca1d1cc96317 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:20.120795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056f097-6afe-401f-a830-ca1d1cc96317 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:20.121302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056f097-6afe-401f-a830-ca1d1cc96317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:20.142268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7056f097-6afe-401f-a830-ca1d1cc96317 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:20.143787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7056f097-6afe-401f-a830-ca1d1cc96317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:20.185045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920599be-5837-4725-9ad6-8b31dbef8cb8 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:20.185332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920599be-5837-4725-9ad6-8b31dbef8cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:20.185637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920599be-5837-4725-9ad6-8b31dbef8cb8 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:20.187165 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 117/236] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:20.206715 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e77815-8b72-44aa-b56a-3b1605ca60fb None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:20.207005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e77815-8b72-44aa-b56a-3b1605ca60fb None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:20.207286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e77815-8b72-44aa-b56a-3b1605ca60fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:20.238169 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 120/237] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:20.256492 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-68e77815-8b72-44aa-b56a-3b1605ca60fb None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:20.257769 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-68e77815-8b72-44aa-b56a-3b1605ca60fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:20.280349 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:20.292323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056f097-6afe-401f-a830-ca1d1cc96317 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:20.329137 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:20.414086 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056f097-6afe-401f-a830-ca1d1cc96317 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:20.442426 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 118/238] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:20.474946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e77815-8b72-44aa-b56a-3b1605ca60fb None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:20.492920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719ce87-7364-4e22-8b23-8a6d973379f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:20.493488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719ce87-7364-4e22-8b23-8a6d973379f0 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:20.493760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719ce87-7364-4e22-8b23-8a6d973379f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:20.494024 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719ce87-7364-4e22-8b23-8a6d973379f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:20.495287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719ce87-7364-4e22-8b23-8a6d973379f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:20.497966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719ce87-7364-4e22-8b23-8a6d973379f0 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:20.499733 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 121/239] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:52:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:52:20.508191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719ce87-7364-4e22-8b23-8a6d973379f0 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:20.659068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e77815-8b72-44aa-b56a-3b1605ca60fb None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:20.695356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719ce87-7364-4e22-8b23-8a6d973379f0 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:20.697656 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:20.718181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48feee24-6fce-4c48-8d9d-f40b89bbdbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:20.718813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48feee24-6fce-4c48-8d9d-f40b89bbdbe7 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:20.719085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48feee24-6fce-4c48-8d9d-f40b89bbdbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:20.719380 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48feee24-6fce-4c48-8d9d-f40b89bbdbe7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:20.741668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48feee24-6fce-4c48-8d9d-f40b89bbdbe7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:20.747492 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-48feee24-6fce-4c48-8d9d-f40b89bbdbe7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:52:20.747492 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:20.747492 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:20.747492 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:20.747492 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:20.747492 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:20.747492 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:20.747492 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:20.747492 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:20.747492 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:20.747492 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:20.747492 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:20.747492 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:20.747492 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:20.747492 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:20.747492 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:20.748425 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:20.748425 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:20.748425 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:20.748425 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:20.748425 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:20.748425 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:20.748425 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:20.748425 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:20.748425 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:20.748425 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:20.748425 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:20.748425 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:20.748425 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:20.748425 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:20.748425 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:20.748425 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:20.749217 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:20.749217 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:20.749217 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:20.749217 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:20.749217 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:20.749217 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:20.749217 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:20.749217 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:20.749217 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:20.749217 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:20.749217 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:52:20.749217 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:20.749217 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 119/240] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:52:20.758525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48feee24-6fce-4c48-8d9d-f40b89bbdbe7 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:20.767841 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:20.770424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d117a9-56ca-428e-b4a9-91a06c89e19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:20.771054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d117a9-56ca-428e-b4a9-91a06c89e19a None admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:20.771328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d117a9-56ca-428e-b4a9-91a06c89e19a None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:20.771593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d117a9-56ca-428e-b4a9-91a06c89e19a None admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:20.772547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d117a9-56ca-428e-b4a9-91a06c89e19a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:20.774023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d117a9-56ca-428e-b4a9-91a06c89e19a None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:20.814066 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 122/241] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Aug 7 00:52:20 2022] POST /identity/v3/users => generated 293 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:52:20.931458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48feee24-6fce-4c48-8d9d-f40b89bbdbe7 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:20.978973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670018b2-b600-4a44-9ddd-a74301d0fb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:20.978973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670018b2-b600-4a44-9ddd-a74301d0fb30 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:20.978973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670018b2-b600-4a44-9ddd-a74301d0fb30 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:20.978973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670018b2-b600-4a44-9ddd-a74301d0fb30 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:20.979373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670018b2-b600-4a44-9ddd-a74301d0fb30 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:20.979373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670018b2-b600-4a44-9ddd-a74301d0fb30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:20.980723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670018b2-b600-4a44-9ddd-a74301d0fb30 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:20.997870 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 120/242] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Aug 7 00:52:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:21.003581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d117a9-56ca-428e-b4a9-91a06c89e19a None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:21.127639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d117a9-56ca-428e-b4a9-91a06c89e19a None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:21.169912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77206458-5065-4ebe-b1ed-7dc7940f4485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:21.170919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77206458-5065-4ebe-b1ed-7dc7940f4485 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:21.171372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77206458-5065-4ebe-b1ed-7dc7940f4485 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:21.171875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77206458-5065-4ebe-b1ed-7dc7940f4485 None admin] PATH_INFO: `/v3/users/392797e05a94434f9a78d705e7241df5` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:21.189252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77206458-5065-4ebe-b1ed-7dc7940f4485 None admin] RBAC: Authorizing `identity:get_user(user_id=392797e05a94434f9a78d705e7241df5)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:21.190771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77206458-5065-4ebe-b1ed-7dc7940f4485 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:21.192576 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 123/243] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:52:21 2022] GET /identity/v3/users/392797e05a94434f9a78d705e7241df5 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:21.199480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670018b2-b600-4a44-9ddd-a74301d0fb30 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:21.308772 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:21.352728 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670018b2-b600-4a44-9ddd-a74301d0fb30 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:21.396297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a87573-4ca8-4f93-bf91-847390860123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:21.396928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a87573-4ca8-4f93-bf91-847390860123 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:21.397208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a87573-4ca8-4f93-bf91-847390860123 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:21.397736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a87573-4ca8-4f93-bf91-847390860123 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:21.462974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd2147-3356-4b86-b8c5-7bdb2585c0c7 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:21.463298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd2147-3356-4b86-b8c5-7bdb2585c0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:21.463535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd2147-3356-4b86-b8c5-7bdb2585c0c7 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:21.465247 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 124/244] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:52:21.472367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f02a4e-6207-47d7-bbb7-56b4f52b1609 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:21.472712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f02a4e-6207-47d7-bbb7-56b4f52b1609 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:21.473075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f02a4e-6207-47d7-bbb7-56b4f52b1609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:21.501790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a87573-4ca8-4f93-bf91-847390860123 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:21.503782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a87573-4ca8-4f93-bf91-847390860123 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:21.511306 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-77f02a4e-6207-47d7-bbb7-56b4f52b1609 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:21.512868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-77f02a4e-6207-47d7-bbb7-56b4f52b1609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:21.530883 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:21.609003 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:21.630258 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 125/245] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:52:21.633662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999391c8-1fa7-421e-9c80-0e0e18ae651e None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:21.633960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999391c8-1fa7-421e-9c80-0e0e18ae651e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:21.634230 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999391c8-1fa7-421e-9c80-0e0e18ae651e None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:21.635716 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 126/246] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:21.641797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7e879-d2c0-4e71-af19-37fbb8772438 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:21.642323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7e879-d2c0-4e71-af19-37fbb8772438 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:21.642743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7e879-d2c0-4e71-af19-37fbb8772438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:21.666466 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 121/247] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:52:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:52:21.666466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a87573-4ca8-4f93-bf91-847390860123 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:21.677653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-61c7e879-d2c0-4e71-af19-37fbb8772438 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:21.679100 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-61c7e879-d2c0-4e71-af19-37fbb8772438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:21.834175 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 127/248] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:52:21.835058 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7e879-d2c0-4e71-af19-37fbb8772438 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:21.863465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a87573-4ca8-4f93-bf91-847390860123 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:21.915071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261cff83-fdda-4007-990a-0a0dffb62b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:21.915731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cff83-fdda-4007-990a-0a0dffb62b4a None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:21.916043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cff83-fdda-4007-990a-0a0dffb62b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:21.916320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cff83-fdda-4007-990a-0a0dffb62b4a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:21.939377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261cff83-fdda-4007-990a-0a0dffb62b4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:21.944686 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-261cff83-fdda-4007-990a-0a0dffb62b4a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:52:21.944686 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:21.944686 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:21.944686 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:21.944686 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:21.944686 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:21.944686 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:21.944686 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:21.944686 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:21.944686 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:21.944686 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:21.944686 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:21.944686 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:21.944686 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:21.944686 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:21.944686 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:21.945691 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:21.945691 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:21.945691 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:21.945691 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:21.945691 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:21.945691 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:21.945691 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:21.945691 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:21.945691 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:21.945691 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:21.945691 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:21.945691 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:21.945691 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:21.945691 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:21.945691 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:21.945691 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:21.946484 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:21.946484 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:21.946484 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:21.946484 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:21.946484 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:21.946484 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:21.946484 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:21.946484 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:21.946484 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:21.946484 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:21.946484 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:52:21.946484 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:21.946484 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 122/249] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:21.947148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261cff83-fdda-4007-990a-0a0dffb62b4a None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:21.966967 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:21.993784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7e879-d2c0-4e71-af19-37fbb8772438 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:22.026146 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:22.033622 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d352a05-8485-46f0-8455-ce9132520b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:22.034280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d352a05-8485-46f0-8455-ce9132520b73 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:22.034562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d352a05-8485-46f0-8455-ce9132520b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:22.034897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d352a05-8485-46f0-8455-ce9132520b73 None admin] PATH_INFO: `/v3/projects/2388c261a2d64686b83675d2cd97701c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:22.036157 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d352a05-8485-46f0-8455-ce9132520b73 None admin] RBAC: Authorizing `identity:get_project(project_id=2388c261a2d64686b83675d2cd97701c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:22.037651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d352a05-8485-46f0-8455-ce9132520b73 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:22.039398 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 128/250] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:21 2022] GET /identity/v3/projects/2388c261a2d64686b83675d2cd97701c => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:22.040345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d352a05-8485-46f0-8455-ce9132520b73 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:22.155609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d352a05-8485-46f0-8455-ce9132520b73 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:22.196555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261cff83-fdda-4007-990a-0a0dffb62b4a None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:22.206274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225088c6-465b-496e-86ff-7a4aa8c09520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:22.207542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225088c6-465b-496e-86ff-7a4aa8c09520 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:22.207826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225088c6-465b-496e-86ff-7a4aa8c09520 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:22.208121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225088c6-465b-496e-86ff-7a4aa8c09520 None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:22.208811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225088c6-465b-496e-86ff-7a4aa8c09520 None admin] RBAC: Adding query filter params (name=member) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:22.209594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225088c6-465b-496e-86ff-7a4aa8c09520 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:22.211414 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225088c6-465b-496e-86ff-7a4aa8c09520 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:22.237180 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 129/251] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Aug 7 00:52:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:22.238655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225088c6-465b-496e-86ff-7a4aa8c09520 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:22.248274 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:22.272903 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b302d09-972d-4e1a-855c-674df7901d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:22.273614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b302d09-972d-4e1a-855c-674df7901d17 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:22.273861 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b302d09-972d-4e1a-855c-674df7901d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:22.274130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b302d09-972d-4e1a-855c-674df7901d17 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:22.300602 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b302d09-972d-4e1a-855c-674df7901d17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:22.309182 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-9b302d09-972d-4e1a-855c-674df7901d17 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:52:22.309182 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:22.309182 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:22.309182 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:22.309182 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:22.309182 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:22.309182 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:22.309182 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:22.309182 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:22.309182 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:22.309182 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:22.309182 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:22.309182 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:22.309182 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:22.309182 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:22.309182 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:22.311338 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:22.311338 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:22.311338 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:22.311338 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:22.311338 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:22.311338 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:22.311338 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:22.311338 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:22.311338 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:22.311338 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:22.311338 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:22.311338 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:22.311338 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:22.311338 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:22.311338 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:22.311338 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:22.313323 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:22.313323 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:22.313323 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:22.313323 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:22.313323 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:22.313323 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:22.313323 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:22.313323 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:22.313323 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:22.313323 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:22.313323 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:52:22.313323 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:22.313323 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 123/252] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Aug 7 00:52:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:22.319722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b302d09-972d-4e1a-855c-674df7901d17 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:22.396233 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225088c6-465b-496e-86ff-7a4aa8c09520 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:22.439698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6641e-9ac6-4d25-bcd7-c46d584d54a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:22.440649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6641e-9ac6-4d25-bcd7-c46d584d54a1 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:22.440932 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6641e-9ac6-4d25-bcd7-c46d584d54a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:22.441204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6641e-9ac6-4d25-bcd7-c46d584d54a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:22.442315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6641e-9ac6-4d25-bcd7-c46d584d54a1 None admin] RBAC: Adding query filter params (role.id=53830cd13bce471ba955d5469f3330f4, scope.project.id=2388c261a2d64686b83675d2cd97701c, user.id=392797e05a94434f9a78d705e7241df5) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:22.442912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6641e-9ac6-4d25-bcd7-c46d584d54a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:22.444595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6641e-9ac6-4d25-bcd7-c46d584d54a1 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:22.452189 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 130/253] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:52:22 2022] GET /identity/v3/role_assignments?user.id=392797e05a94434f9a78d705e7241df5&scope.project.id=2388c261a2d64686b83675d2cd97701c&role.id=53830cd13bce471ba955d5469f3330f4 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:22.453206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6641e-9ac6-4d25-bcd7-c46d584d54a1 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:22.453730 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:22.472670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b302d09-972d-4e1a-855c-674df7901d17 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:22.569114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae668d8-d94f-4634-b254-47c5dc1325fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:22.569775 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae668d8-d94f-4634-b254-47c5dc1325fd None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:22.570052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae668d8-d94f-4634-b254-47c5dc1325fd None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:22.570321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae668d8-d94f-4634-b254-47c5dc1325fd None admin] PATH_INFO: `/v3/users/2a406330036d40b68d56f5a46cc31402` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:22.571706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae668d8-d94f-4634-b254-47c5dc1325fd None admin] RBAC: Authorizing `identity:get_user(user_id=2a406330036d40b68d56f5a46cc31402)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:22.573222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae668d8-d94f-4634-b254-47c5dc1325fd None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:22.575079 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 124/254] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:52:22 2022] GET /identity/v3/users/2a406330036d40b68d56f5a46cc31402 => generated 297 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:22.585522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda0de4-6555-4748-8a0f-b738bcf58356 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:22.585867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda0de4-6555-4748-8a0f-b738bcf58356 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:22.586069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda0de4-6555-4748-8a0f-b738bcf58356 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:22.587465 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 125/255] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:22 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:22.592840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda0de4-6555-4748-8a0f-b738bcf58356 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:22.624551 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:22.666825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6641e-9ac6-4d25-bcd7-c46d584d54a1 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:22.713400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f789d-dfb8-4c0b-a3fb-301fe17f3740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:22.713400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f789d-dfb8-4c0b-a3fb-301fe17f3740 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:22.713400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f789d-dfb8-4c0b-a3fb-301fe17f3740 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:22.713400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f789d-dfb8-4c0b-a3fb-301fe17f3740 None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:22.714085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f789d-dfb8-4c0b-a3fb-301fe17f3740 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:22.714433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f789d-dfb8-4c0b-a3fb-301fe17f3740 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:22.715968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f789d-dfb8-4c0b-a3fb-301fe17f3740 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:22.726665 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 131/256] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:52:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:22.728547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b5874-b065-4c2e-bb1e-eee812f4f2d4 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:22.728914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b5874-b065-4c2e-bb1e-eee812f4f2d4 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:22.729258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b5874-b065-4c2e-bb1e-eee812f4f2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:22.753144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1b9b5874-b065-4c2e-bb1e-eee812f4f2d4 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:22.754518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1b9b5874-b065-4c2e-bb1e-eee812f4f2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:22.792642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda0de4-6555-4748-8a0f-b738bcf58356 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:22.865922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d80c3-79d1-4698-b050-fd4395e56ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:22.866725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d80c3-79d1-4698-b050-fd4395e56ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:22.867006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d80c3-79d1-4698-b050-fd4395e56ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:22.867276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d80c3-79d1-4698-b050-fd4395e56ea7 None admin] PATH_INFO: `/v3/projects/2388c261a2d64686b83675d2cd97701c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:22.868436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d80c3-79d1-4698-b050-fd4395e56ea7 None admin] RBAC: Authorizing `identity:get_project(project_id=2388c261a2d64686b83675d2cd97701c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:22.869915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606d80c3-79d1-4698-b050-fd4395e56ea7 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:22.871606 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 126/257] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:22 2022] GET /identity/v3/projects/2388c261a2d64686b83675d2cd97701c => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:22.877357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d80c3-79d1-4698-b050-fd4395e56ea7 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:22.900056 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 132/258] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:22.900992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b5874-b065-4c2e-bb1e-eee812f4f2d4 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:22.911727 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:23.040478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606d80c3-79d1-4698-b050-fd4395e56ea7 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:23.081192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfcf0f-d2c6-4b1c-904c-108d397cf5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:23.082240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfcf0f-d2c6-4b1c-904c-108d397cf5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:23.082797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfcf0f-d2c6-4b1c-904c-108d397cf5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:23.083208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfcf0f-d2c6-4b1c-904c-108d397cf5e0 None admin] PATH_INFO: `/v3/users/dc9be94b47244e02876687f29482a820` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:23.084682 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfcf0f-d2c6-4b1c-904c-108d397cf5e0 None admin] RBAC: Authorizing `identity:get_user(user_id=dc9be94b47244e02876687f29482a820)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:23.087633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfcf0f-d2c6-4b1c-904c-108d397cf5e0 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:23.090151 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 127/259] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:52:22 2022] GET /identity/v3/users/dc9be94b47244e02876687f29482a820 => generated 283 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:23.091140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfcf0f-d2c6-4b1c-904c-108d397cf5e0 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:23.096231 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:23.170805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b5874-b065-4c2e-bb1e-eee812f4f2d4 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:23.196616 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:23.208267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfcf0f-d2c6-4b1c-904c-108d397cf5e0 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:23.247536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a1102-f42a-41ae-8625-fd91324e3c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:23.248544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a1102-f42a-41ae-8625-fd91324e3c26 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:23.249414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a1102-f42a-41ae-8625-fd91324e3c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:23.249894 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a1102-f42a-41ae-8625-fd91324e3c26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:23.262754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a1102-f42a-41ae-8625-fd91324e3c26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:23.268334 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-8f7a1102-f42a-41ae-8625-fd91324e3c26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:52:23.268334 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:23.268334 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:23.268334 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:23.268334 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:23.268334 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:23.268334 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:23.268334 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:23.268334 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:23.268334 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:23.268334 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:23.268334 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:23.268334 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:23.268334 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:23.268334 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:23.268334 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:23.269218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:23.269218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:23.269218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:23.269218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:23.269218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:23.269218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:23.269218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:23.269218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:23.269218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:23.269218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:23.269218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:23.269218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:23.269218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:23.269218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:23.269218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:23.269218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:23.270020 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:23.270020 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:23.270020 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:23.270020 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:23.270020 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:23.270020 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:23.270020 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:23.270020 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:23.270020 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:23.270020 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:23.270020 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:52:23.270020 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:23.270720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d2393-1877-4a84-9272-5e9f1d3e0330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:23.270720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d2393-1877-4a84-9272-5e9f1d3e0330 None admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:23.270720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d2393-1877-4a84-9272-5e9f1d3e0330 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:23.270720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d2393-1877-4a84-9272-5e9f1d3e0330 None admin] PATH_INFO: `/v3/projects/2388c261a2d64686b83675d2cd97701c/users/2a406330036d40b68d56f5a46cc31402/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:23.273084 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 128/260] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:52:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:23.274711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a1102-f42a-41ae-8625-fd91324e3c26 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:23.278701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d2393-1877-4a84-9272-5e9f1d3e0330 None admin] RBAC: Authorizing `identity:create_grant(project_id=2388c261a2d64686b83675d2cd97701c, user_id=2a406330036d40b68d56f5a46cc31402, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:23.280314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d2393-1877-4a84-9272-5e9f1d3e0330 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:23.307932 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 133/261] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Aug 7 00:52:22 2022] PUT /identity/v3/projects/2388c261a2d64686b83675d2cd97701c/users/2a406330036d40b68d56f5a46cc31402/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:52:23.307932 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d2393-1877-4a84-9272-5e9f1d3e0330 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:23.422670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a1102-f42a-41ae-8625-fd91324e3c26 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:23.465791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed7e1a-579a-4a98-b206-b12bd3cbc10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:23.466853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed7e1a-579a-4a98-b206-b12bd3cbc10a None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:23.467334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed7e1a-579a-4a98-b206-b12bd3cbc10a None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:23.467805 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed7e1a-579a-4a98-b206-b12bd3cbc10a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:23.500390 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:23.529994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d2393-1877-4a84-9272-5e9f1d3e0330 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:23.551612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed7e1a-579a-4a98-b206-b12bd3cbc10a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:23.553550 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:23.554763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed7e1a-579a-4a98-b206-b12bd3cbc10a None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:23.592651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596a292-5417-4861-ab1d-80eac6009a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:23.593299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596a292-5417-4861-ab1d-80eac6009a9e None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:23.593579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596a292-5417-4861-ab1d-80eac6009a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:23.593914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596a292-5417-4861-ab1d-80eac6009a9e None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:23.594719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596a292-5417-4861-ab1d-80eac6009a9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:23.595026 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596a292-5417-4861-ab1d-80eac6009a9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:23.596613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596a292-5417-4861-ab1d-80eac6009a9e None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:23.638005 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 134/262] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:23.645290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596a292-5417-4861-ab1d-80eac6009a9e None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:23.682393 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 129/263] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:52:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:52:23.689375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed7e1a-579a-4a98-b206-b12bd3cbc10a None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:23.752356 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:23.808288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed7e1a-579a-4a98-b206-b12bd3cbc10a None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:23.850896 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55e322-d85f-4b61-956a-654a255def03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:23.851919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55e322-d85f-4b61-956a-654a255def03 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:23.852496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55e322-d85f-4b61-956a-654a255def03 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:23.852969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55e322-d85f-4b61-956a-654a255def03 None admin] PATH_INFO: `/v3/projects/2388c261a2d64686b83675d2cd97701c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:23.854558 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55e322-d85f-4b61-956a-654a255def03 None admin] RBAC: Authorizing `identity:get_project(project_id=2388c261a2d64686b83675d2cd97701c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:23.856803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55e322-d85f-4b61-956a-654a255def03 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:23.858800 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 130/264] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:23 2022] GET /identity/v3/projects/2388c261a2d64686b83675d2cd97701c => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:52:23.867669 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55e322-d85f-4b61-956a-654a255def03 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:23.986337 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596a292-5417-4861-ab1d-80eac6009a9e None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:24.036221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55e322-d85f-4b61-956a-654a255def03 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:24.103914 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:24.115540 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a708ee4-8b98-48b4-b5f9-12c0a02f9de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:24.125373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a708ee4-8b98-48b4-b5f9-12c0a02f9de8 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:24.126724 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a708ee4-8b98-48b4-b5f9-12c0a02f9de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:24.127381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a708ee4-8b98-48b4-b5f9-12c0a02f9de8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:24.128734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a708ee4-8b98-48b4-b5f9-12c0a02f9de8 None admin] RBAC: Adding query filter params (role.id=04a874934a0944a2851b5e485a0f0a1b, scope.project.id=2388c261a2d64686b83675d2cd97701c, user.id=dc9be94b47244e02876687f29482a820) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:24.129362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a708ee4-8b98-48b4-b5f9-12c0a02f9de8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:24.131874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a708ee4-8b98-48b4-b5f9-12c0a02f9de8 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:24.140948 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 131/265] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:52:23 2022] GET /identity/v3/role_assignments?user.id=dc9be94b47244e02876687f29482a820&scope.project.id=2388c261a2d64686b83675d2cd97701c&role.id=04a874934a0944a2851b5e485a0f0a1b => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:24.144152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb233957-578c-4420-bf19-6a3280147aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:24.144152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb233957-578c-4420-bf19-6a3280147aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:24.144152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb233957-578c-4420-bf19-6a3280147aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:24.144152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb233957-578c-4420-bf19-6a3280147aa0 None admin] PATH_INFO: `/v3/users/dc9be94b47244e02876687f29482a820` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:24.145163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb233957-578c-4420-bf19-6a3280147aa0 None admin] RBAC: Authorizing `identity:get_user(user_id=dc9be94b47244e02876687f29482a820)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:24.146940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb233957-578c-4420-bf19-6a3280147aa0 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:24.153666 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 135/266] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:52:23 2022] GET /identity/v3/users/dc9be94b47244e02876687f29482a820 => generated 283 bytes in 509 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:52:24.160628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a708ee4-8b98-48b4-b5f9-12c0a02f9de8 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:24.254261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910130e-784e-4045-a915-a15e90cb764f None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:24.254908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910130e-784e-4045-a915-a15e90cb764f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:24.254908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910130e-784e-4045-a915-a15e90cb764f None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:24.261569 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 136/267] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:24.268287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb4f08-9387-48b1-b850-85fcf185925a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:24.268604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb4f08-9387-48b1-b850-85fcf185925a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:24.268895 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb4f08-9387-48b1-b850-85fcf185925a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:24.308256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a708ee4-8b98-48b4-b5f9-12c0a02f9de8 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:24.313004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-dffb4f08-9387-48b1-b850-85fcf185925a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:24.314141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-dffb4f08-9387-48b1-b850-85fcf185925a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:24.353836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b8d78-99de-492b-89fd-b52dc0b283ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:24.354833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b8d78-99de-492b-89fd-b52dc0b283ca None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:24.355415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b8d78-99de-492b-89fd-b52dc0b283ca None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:24.355917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b8d78-99de-492b-89fd-b52dc0b283ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:24.428363 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:24.438700 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:24.452233 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b8d78-99de-492b-89fd-b52dc0b283ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:24.455014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b8d78-99de-492b-89fd-b52dc0b283ca None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:24.495724 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 137/268] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:52:24.497201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe539fa-4139-4a3a-b0cd-4a8107942d81 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:24.497550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe539fa-4139-4a3a-b0cd-4a8107942d81 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:24.497849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe539fa-4139-4a3a-b0cd-4a8107942d81 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:24.499349 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 138/269] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:24.506191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d055e-9877-415b-9a2b-71c420f6b1a6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:24.506499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d055e-9877-415b-9a2b-71c420f6b1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:24.506740 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d055e-9877-415b-9a2b-71c420f6b1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:24.557384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-af0d055e-9877-415b-9a2b-71c420f6b1a6 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:24.558740 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-af0d055e-9877-415b-9a2b-71c420f6b1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:24.592369 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 132/270] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:52:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:52:24.594375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b8d78-99de-492b-89fd-b52dc0b283ca None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:24.665629 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 139/271] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:24.667068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d055e-9877-415b-9a2b-71c420f6b1a6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:24.742236 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:24.770344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b8d78-99de-492b-89fd-b52dc0b283ca None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:24.829891 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d055e-9877-415b-9a2b-71c420f6b1a6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:24.833942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784efb08-7a9a-4536-a99b-f3f7ba2fd67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:24.834961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784efb08-7a9a-4536-a99b-f3f7ba2fd67d None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:24.835441 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784efb08-7a9a-4536-a99b-f3f7ba2fd67d None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:24.835940 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784efb08-7a9a-4536-a99b-f3f7ba2fd67d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:24.838213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784efb08-7a9a-4536-a99b-f3f7ba2fd67d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:24.841873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784efb08-7a9a-4536-a99b-f3f7ba2fd67d None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:24.843252 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:24.845892 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 133/272] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:52:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:24.846811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784efb08-7a9a-4536-a99b-f3f7ba2fd67d None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:24.887952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295a15f-743f-48f8-9ed6-33763abd220f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:24.888599 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295a15f-743f-48f8-9ed6-33763abd220f None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:24.888874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295a15f-743f-48f8-9ed6-33763abd220f None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:24.889150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295a15f-743f-48f8-9ed6-33763abd220f None admin] PATH_INFO: `/v3/projects/2388c261a2d64686b83675d2cd97701c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:24.891587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295a15f-743f-48f8-9ed6-33763abd220f None admin] RBAC: Authorizing `identity:get_project(project_id=2388c261a2d64686b83675d2cd97701c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:24.893150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c295a15f-743f-48f8-9ed6-33763abd220f None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:24.894891 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 140/273] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:24 2022] GET /identity/v3/projects/2388c261a2d64686b83675d2cd97701c => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:24.895696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295a15f-743f-48f8-9ed6-33763abd220f None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:24.994703 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784efb08-7a9a-4536-a99b-f3f7ba2fd67d None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:25.036833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c295a15f-743f-48f8-9ed6-33763abd220f None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:25.053450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a2b2f-887f-4219-ac74-b896d9db9101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:25.054412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a2b2f-887f-4219-ac74-b896d9db9101 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:25.054893 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a2b2f-887f-4219-ac74-b896d9db9101 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:25.055321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a2b2f-887f-4219-ac74-b896d9db9101 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:25.069872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a2b2f-887f-4219-ac74-b896d9db9101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:25.075556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-5d1a2b2f-887f-4219-ac74-b896d9db9101 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:52:25.075556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:25.075556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:25.075556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:25.075556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:25.075556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:25.075556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:25.075556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:25.075556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:25.075556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:25.075556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:25.075556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:25.075556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:25.075556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:25.075556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:25.075556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:25.076556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:25.076556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:25.076556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:25.076556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:25.076556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:25.076556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:25.076556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:25.076556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:25.076556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:25.076556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:25.076556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:25.076556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:25.076556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:25.076556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:25.076556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:25.076556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:25.077364 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:25.077364 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:25.077364 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:25.077364 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:25.077364 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:25.077364 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:25.077364 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:25.077364 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:25.077364 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:25.077364 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:25.077364 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:52:25.077364 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:25.080459 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 134/274] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:25.081458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a2b2f-887f-4219-ac74-b896d9db9101 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:25.088759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be145ce-20f8-428a-8410-939d4bc6965e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:25.089389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be145ce-20f8-428a-8410-939d4bc6965e None admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:25.089663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be145ce-20f8-428a-8410-939d4bc6965e None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:25.089929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be145ce-20f8-428a-8410-939d4bc6965e None admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:25.090627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be145ce-20f8-428a-8410-939d4bc6965e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:25.092180 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be145ce-20f8-428a-8410-939d4bc6965e None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:25.104920 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:25.136667 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 141/275] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Aug 7 00:52:24 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:52:25.138383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be145ce-20f8-428a-8410-939d4bc6965e None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:25.190024 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:25.290758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be145ce-20f8-428a-8410-939d4bc6965e None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:25.333932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a2b2f-887f-4219-ac74-b896d9db9101 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:25.339911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e886a5-6e37-4d8d-8d20-b814b9c0fc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:25.339911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e886a5-6e37-4d8d-8d20-b814b9c0fc91 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:25.339911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e886a5-6e37-4d8d-8d20-b814b9c0fc91 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:25.339911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e886a5-6e37-4d8d-8d20-b814b9c0fc91 None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:25.340365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e886a5-6e37-4d8d-8d20-b814b9c0fc91 None admin] RBAC: Adding query filter params (name=member) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:25.340365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e886a5-6e37-4d8d-8d20-b814b9c0fc91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:25.340365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e886a5-6e37-4d8d-8d20-b814b9c0fc91 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:25.351205 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 142/276] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Aug 7 00:52:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:25.357575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e886a5-6e37-4d8d-8d20-b814b9c0fc91 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:25.396699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd406e4d-0b68-4ea9-a676-c317d9972eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:25.398227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd406e4d-0b68-4ea9-a676-c317d9972eba None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:25.398761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd406e4d-0b68-4ea9-a676-c317d9972eba None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:25.399745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd406e4d-0b68-4ea9-a676-c317d9972eba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:25.400995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd406e4d-0b68-4ea9-a676-c317d9972eba None admin] RBAC: Adding query filter params (role.id=695b07606e564668bac7afff4ab6052a, scope.project.id=2388c261a2d64686b83675d2cd97701c, user.id=dc9be94b47244e02876687f29482a820) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:25.401545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd406e4d-0b68-4ea9-a676-c317d9972eba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:25.404012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd406e4d-0b68-4ea9-a676-c317d9972eba None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:25.415878 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 135/277] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:52:25 2022] GET /identity/v3/role_assignments?user.id=dc9be94b47244e02876687f29482a820&scope.project.id=2388c261a2d64686b83675d2cd97701c&role.id=695b07606e564668bac7afff4ab6052a => generated 608 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:25.488666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8564d5-50c0-448d-8324-9cc8675923df None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:25.489302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8564d5-50c0-448d-8324-9cc8675923df None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:25.489575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8564d5-50c0-448d-8324-9cc8675923df None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:25.491441 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 136/278] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:52:25.499048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75660e41-e62b-4cf4-ad5a-0d4b162f9c79 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:25.499363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75660e41-e62b-4cf4-ad5a-0d4b162f9c79 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:25.499585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75660e41-e62b-4cf4-ad5a-0d4b162f9c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:25.537607 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:25.541456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-75660e41-e62b-4cf4-ad5a-0d4b162f9c79 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:25.542691 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-75660e41-e62b-4cf4-ad5a-0d4b162f9c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:25.544688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e886a5-6e37-4d8d-8d20-b814b9c0fc91 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:25.607637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b8fbf-703a-4fd6-9734-85b33be7b0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:25.608235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b8fbf-703a-4fd6-9734-85b33be7b0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:25.608512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b8fbf-703a-4fd6-9734-85b33be7b0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:25.608783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b8fbf-703a-4fd6-9734-85b33be7b0d4 None admin] PATH_INFO: `/v3/users/3da25119665742fcb4988ffb55a027cb` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:25.628529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b8fbf-703a-4fd6-9734-85b33be7b0d4 None admin] RBAC: Authorizing `identity:get_user(user_id=3da25119665742fcb4988ffb55a027cb)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:25.630026 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b8fbf-703a-4fd6-9734-85b33be7b0d4 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:25.631921 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 143/279] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:52:25 2022] GET /identity/v3/users/3da25119665742fcb4988ffb55a027cb => generated 293 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:25.639862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b8fbf-703a-4fd6-9734-85b33be7b0d4 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:25.660544 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 137/280] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:25.690745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75660e41-e62b-4cf4-ad5a-0d4b162f9c79 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:25.695398 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:25.808859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b8fbf-703a-4fd6-9734-85b33be7b0d4 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:25.853150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75660e41-e62b-4cf4-ad5a-0d4b162f9c79 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:25.862061 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b162825-db74-4734-a4bc-9946cd332cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:25.862904 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b162825-db74-4734-a4bc-9946cd332cdd None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:25.863473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b162825-db74-4734-a4bc-9946cd332cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:25.864518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b162825-db74-4734-a4bc-9946cd332cdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:25.865422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b162825-db74-4734-a4bc-9946cd332cdd None admin] RBAC: Adding query filter params (role.id=979b0708a1934c50b706215aa79dbb7a, user.id=3da25119665742fcb4988ffb55a027cb, scope.system=all) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:25.865831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b162825-db74-4734-a4bc-9946cd332cdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:25.867531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b162825-db74-4734-a4bc-9946cd332cdd None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:25.875572 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 144/281] 10.222.0.39 () {56 vars in 1308 bytes} [Sun Aug 7 00:52:25 2022] GET /identity/v3/role_assignments?user.id=3da25119665742fcb4988ffb55a027cb&scope.system=all&role.id=979b0708a1934c50b706215aa79dbb7a => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:25.907215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e120f-6735-424a-a1b1-10f9f75622ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:25.908206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e120f-6735-424a-a1b1-10f9f75622ff None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:25.908659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e120f-6735-424a-a1b1-10f9f75622ff None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:25.909116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e120f-6735-424a-a1b1-10f9f75622ff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:25.923768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e120f-6735-424a-a1b1-10f9f75622ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:25.929370 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-1e4e120f-6735-424a-a1b1-10f9f75622ff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:52:25.929370 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:25.929370 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:25.929370 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:25.929370 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:25.929370 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:25.929370 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:25.929370 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:25.929370 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:25.929370 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:25.929370 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:25.929370 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:25.929370 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:25.929370 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:25.929370 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:25.929370 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:25.930582 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:25.930582 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:25.930582 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:25.930582 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:25.930582 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:25.930582 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:25.930582 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:25.930582 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:25.930582 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:25.930582 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:25.930582 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:25.930582 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:25.930582 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:25.930582 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:25.930582 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:25.930582 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:25.931641 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:25.931641 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:25.931641 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:25.931641 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:25.931641 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:25.931641 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:25.931641 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:25.931641 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:25.931641 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:25.931641 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:25.931641 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:52:25.931641 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:25.934138 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 138/282] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:52:25.940648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b162825-db74-4734-a4bc-9946cd332cdd None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:25.964877 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:26.065678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b162825-db74-4734-a4bc-9946cd332cdd None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:26.106707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2835c53-5a8c-458f-a308-178409e0d551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:26.107391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2835c53-5a8c-458f-a308-178409e0d551 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:26.107707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2835c53-5a8c-458f-a308-178409e0d551 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:26.108034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2835c53-5a8c-458f-a308-178409e0d551 None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:26.108807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2835c53-5a8c-458f-a308-178409e0d551 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:26.109147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2835c53-5a8c-458f-a308-178409e0d551 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:26.110774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2835c53-5a8c-458f-a308-178409e0d551 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:26.120753 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 145/283] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Aug 7 00:52:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:26.126884 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e120f-6735-424a-a1b1-10f9f75622ff None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:26.200720 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:26.244620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e120f-6735-424a-a1b1-10f9f75622ff None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:26.284941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc381db-559d-4623-a60e-05a77e3ab437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:26.285613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc381db-559d-4623-a60e-05a77e3ab437 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:26.285924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc381db-559d-4623-a60e-05a77e3ab437 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:26.286222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc381db-559d-4623-a60e-05a77e3ab437 None admin] PATH_INFO: `/v3/users/392797e05a94434f9a78d705e7241df5` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:26.287527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc381db-559d-4623-a60e-05a77e3ab437 None admin] RBAC: Authorizing `identity:get_user(user_id=392797e05a94434f9a78d705e7241df5)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:26.289134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc381db-559d-4623-a60e-05a77e3ab437 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:26.290886 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 139/284] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:52:26 2022] GET /identity/v3/users/392797e05a94434f9a78d705e7241df5 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:26.296932 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2835c53-5a8c-458f-a308-178409e0d551 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:26.392401 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:26.414386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2835c53-5a8c-458f-a308-178409e0d551 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:26.453465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880a232-710a-4ec0-abd3-f15ad61c2798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:26.454693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880a232-710a-4ec0-abd3-f15ad61c2798 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:26.455003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880a232-710a-4ec0-abd3-f15ad61c2798 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:26.455296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880a232-710a-4ec0-abd3-f15ad61c2798 None admin] PATH_INFO: `/v3/projects/2388c261a2d64686b83675d2cd97701c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:26.456608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880a232-710a-4ec0-abd3-f15ad61c2798 None admin] RBAC: Authorizing `identity:get_project(project_id=2388c261a2d64686b83675d2cd97701c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:26.458219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880a232-710a-4ec0-abd3-f15ad61c2798 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:26.460190 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 146/285] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:26 2022] GET /identity/v3/projects/2388c261a2d64686b83675d2cd97701c => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:26.474869 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975a3fa-f54b-4fc3-929b-ba1f0b0c8e90 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:26.475497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975a3fa-f54b-4fc3-929b-ba1f0b0c8e90 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:26.475497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975a3fa-f54b-4fc3-929b-ba1f0b0c8e90 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:26.477047 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 140/286] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:26.481202 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880a232-710a-4ec0-abd3-f15ad61c2798 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:26.482541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391d8bb-e4d1-40be-acae-2aee4fd1b805 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:26.482820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391d8bb-e4d1-40be-acae-2aee4fd1b805 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:26.483091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391d8bb-e4d1-40be-acae-2aee4fd1b805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:26.514218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6391d8bb-e4d1-40be-acae-2aee4fd1b805 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:26.525392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6391d8bb-e4d1-40be-acae-2aee4fd1b805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:26.618747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880a232-710a-4ec0-abd3-f15ad61c2798 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:26.641632 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 141/287] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:52:26.677825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ed79c-269b-4571-a3f4-118de6d6f425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:26.678458 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ed79c-269b-4571-a3f4-118de6d6f425 None admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:26.678791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ed79c-269b-4571-a3f4-118de6d6f425 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:26.679237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ed79c-269b-4571-a3f4-118de6d6f425 None admin] PATH_INFO: `/v3/projects/2388c261a2d64686b83675d2cd97701c/users/392797e05a94434f9a78d705e7241df5/roles/53830cd13bce471ba955d5469f3330f4` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:26.683573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ed79c-269b-4571-a3f4-118de6d6f425 None admin] RBAC: Authorizing `identity:create_grant(project_id=2388c261a2d64686b83675d2cd97701c, user_id=392797e05a94434f9a78d705e7241df5, role_id=53830cd13bce471ba955d5469f3330f4)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:26.685115 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8ed79c-269b-4571-a3f4-118de6d6f425 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:26.702133 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 147/288] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Aug 7 00:52:26 2022] PUT /identity/v3/projects/2388c261a2d64686b83675d2cd97701c/users/392797e05a94434f9a78d705e7241df5/roles/53830cd13bce471ba955d5469f3330f4 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:52:26.708722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391d8bb-e4d1-40be-acae-2aee4fd1b805 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:26.785129 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:26.841513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391d8bb-e4d1-40be-acae-2aee4fd1b805 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:26.881384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccc3bf-5773-4d9c-b79d-5f7e6b8db837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:26.882040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccc3bf-5773-4d9c-b79d-5f7e6b8db837 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:26.882314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccc3bf-5773-4d9c-b79d-5f7e6b8db837 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:26.882580 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccc3bf-5773-4d9c-b79d-5f7e6b8db837 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:26.896078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccc3bf-5773-4d9c-b79d-5f7e6b8db837 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:26.902111 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-fcccc3bf-5773-4d9c-b79d-5f7e6b8db837 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:52:26.902111 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:26.902111 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:26.902111 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:26.902111 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:26.902111 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:26.902111 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:26.902111 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:26.902111 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:26.902111 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:26.902111 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:26.902111 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:26.902111 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:26.902111 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:26.902111 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:26.902111 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:26.904258 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:26.904258 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:26.904258 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:26.904258 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:26.904258 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:26.904258 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:26.904258 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:26.904258 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:26.904258 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:26.904258 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:26.904258 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:26.904258 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:26.904258 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:26.904258 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:26.904258 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:26.904258 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:26.906180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:26.906180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:26.906180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:26.906180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:26.906180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:26.906180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:26.906180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:26.906180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:26.906180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:26.906180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:26.906180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:52:26.906180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:26.906180 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 142/289] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:26.910870 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ed79c-269b-4571-a3f4-118de6d6f425 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:26.924449 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:27.055180 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ed79c-269b-4571-a3f4-118de6d6f425 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:27.099079 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df604e6-bcf9-4757-9025-828c13f17deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:27.099782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df604e6-bcf9-4757-9025-828c13f17deb None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:27.100480 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df604e6-bcf9-4757-9025-828c13f17deb None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:27.100814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df604e6-bcf9-4757-9025-828c13f17deb None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:27.101736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df604e6-bcf9-4757-9025-828c13f17deb None admin] RBAC: Adding query filter params (name=member) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:27.102042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df604e6-bcf9-4757-9025-828c13f17deb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:27.103683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df604e6-bcf9-4757-9025-828c13f17deb None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:27.116106 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 148/290] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Aug 7 00:52:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:27.123253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccc3bf-5773-4d9c-b79d-5f7e6b8db837 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:27.268936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccc3bf-5773-4d9c-b79d-5f7e6b8db837 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:27.318461 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:27.342911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4f5a0-3c42-4056-b022-78e8f46d306d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:27.343590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4f5a0-3c42-4056-b022-78e8f46d306d None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:27.343912 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4f5a0-3c42-4056-b022-78e8f46d306d None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:27.344253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4f5a0-3c42-4056-b022-78e8f46d306d None admin] PATH_INFO: `/v3/users/2a406330036d40b68d56f5a46cc31402` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:27.348606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4f5a0-3c42-4056-b022-78e8f46d306d None admin] RBAC: Authorizing `identity:get_user(user_id=2a406330036d40b68d56f5a46cc31402)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:27.350229 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a4f5a0-3c42-4056-b022-78e8f46d306d None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:27.352422 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 143/291] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:52:27 2022] GET /identity/v3/users/2a406330036d40b68d56f5a46cc31402 => generated 297 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:27.358023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df604e6-bcf9-4757-9025-828c13f17deb None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:27.524908 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:27.593759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df604e6-bcf9-4757-9025-828c13f17deb None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:27.666590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69359c8f-fd44-4019-963d-48887035ed40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:27.668210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69359c8f-fd44-4019-963d-48887035ed40 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:27.669003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69359c8f-fd44-4019-963d-48887035ed40 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:27.669683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69359c8f-fd44-4019-963d-48887035ed40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:27.808800 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69359c8f-fd44-4019-963d-48887035ed40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:27.810347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69359c8f-fd44-4019-963d-48887035ed40 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:27.942564 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:27.988162 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 149/292] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:52:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:52:27.997151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4f5a0-3c42-4056-b022-78e8f46d306d None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:28.162313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4f5a0-3c42-4056-b022-78e8f46d306d None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:28.215720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197eaa6c-96b8-432e-beb3-b1760150d3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:28.216774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197eaa6c-96b8-432e-beb3-b1760150d3ec None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:28.217314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197eaa6c-96b8-432e-beb3-b1760150d3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:28.217873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197eaa6c-96b8-432e-beb3-b1760150d3ec None admin] PATH_INFO: `/v3/projects/2388c261a2d64686b83675d2cd97701c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:28.219491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197eaa6c-96b8-432e-beb3-b1760150d3ec None admin] RBAC: Authorizing `identity:get_project(project_id=2388c261a2d64686b83675d2cd97701c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:28.221555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197eaa6c-96b8-432e-beb3-b1760150d3ec None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:28.224797 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 144/293] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:27 2022] GET /identity/v3/projects/2388c261a2d64686b83675d2cd97701c => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:28.232729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69359c8f-fd44-4019-963d-48887035ed40 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:28.278655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a4d2d-5a10-4630-8372-af0ea7601063 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:28.279385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a4d2d-5a10-4630-8372-af0ea7601063 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:28.280074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a4d2d-5a10-4630-8372-af0ea7601063 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:28.283484 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 145/294] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:28.290090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4d811-793d-469d-87a4-eb2649a1f47a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:28.290773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4d811-793d-469d-87a4-eb2649a1f47a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:28.291384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4d811-793d-469d-87a4-eb2649a1f47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:28.314636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c6e4d811-793d-469d-87a4-eb2649a1f47a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:28.316385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c6e4d811-793d-469d-87a4-eb2649a1f47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:28.476387 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:28.494051 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 146/295] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:52:28.507003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69359c8f-fd44-4019-963d-48887035ed40 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:28.562814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273610b3-cb32-4e71-9686-27598061389e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:28.564555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273610b3-cb32-4e71-9686-27598061389e None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:28.565151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273610b3-cb32-4e71-9686-27598061389e None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:28.565703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273610b3-cb32-4e71-9686-27598061389e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:28.566812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273610b3-cb32-4e71-9686-27598061389e None admin] RBAC: Adding query filter params (role.id=979b0708a1934c50b706215aa79dbb7a, scope.project.id=2388c261a2d64686b83675d2cd97701c, user.id=2a406330036d40b68d56f5a46cc31402) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:28.567482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273610b3-cb32-4e71-9686-27598061389e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:28.569648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273610b3-cb32-4e71-9686-27598061389e None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:28.577968 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 150/296] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:52:28 2022] GET /identity/v3/role_assignments?user.id=2a406330036d40b68d56f5a46cc31402&scope.project.id=2388c261a2d64686b83675d2cd97701c&role.id=979b0708a1934c50b706215aa79dbb7a => generated 608 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:52:28.606790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d18cf-2fdd-4fb4-b132-beabac805f3b None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:28.607516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d18cf-2fdd-4fb4-b132-beabac805f3b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:28.608146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d18cf-2fdd-4fb4-b132-beabac805f3b None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:28.610767 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 147/297] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:28.614328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273610b3-cb32-4e71-9686-27598061389e None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:28.623304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c4497-7a05-4743-9409-0f7ff785a6af None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:28.624195 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c4497-7a05-4743-9409-0f7ff785a6af None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:28.624831 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c4497-7a05-4743-9409-0f7ff785a6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:28.666602 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d79c4497-7a05-4743-9409-0f7ff785a6af None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:28.668471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d79c4497-7a05-4743-9409-0f7ff785a6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:28.721733 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:28.799535 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 148/298] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:52:28.852945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273610b3-cb32-4e71-9686-27598061389e None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:28.870345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6eda1-b1bb-4f17-b04a-192ca49f27c2 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:28.870948 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6eda1-b1bb-4f17-b04a-192ca49f27c2 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:28.871413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6eda1-b1bb-4f17-b04a-192ca49f27c2 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:28.873243 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 149/299] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:28.879183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce562d-df94-4830-b286-25743a7a9083 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:28.879828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce562d-df94-4830-b286-25743a7a9083 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:28.880345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce562d-df94-4830-b286-25743a7a9083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:28.892052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5274e62-2fc4-4d34-8b42-0ca29b5b3a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:28.892698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5274e62-2fc4-4d34-8b42-0ca29b5b3a5e None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:28.893062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5274e62-2fc4-4d34-8b42-0ca29b5b3a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:28.893375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5274e62-2fc4-4d34-8b42-0ca29b5b3a5e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:28.903445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f8ce562d-df94-4830-b286-25743a7a9083 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:28.905024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f8ce562d-df94-4830-b286-25743a7a9083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:28.905984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5274e62-2fc4-4d34-8b42-0ca29b5b3a5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:28.911580 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-c5274e62-2fc4-4d34-8b42-0ca29b5b3a5e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:52:28.911580 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:28.911580 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:28.911580 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:28.911580 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:28.911580 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:28.911580 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:28.911580 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:28.911580 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:28.911580 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:28.911580 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:28.911580 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:28.911580 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:28.911580 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:28.911580 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:28.911580 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:28.912531 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:28.912531 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:28.912531 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:28.912531 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:28.912531 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:28.912531 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:28.912531 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:28.912531 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:28.912531 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:28.912531 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:28.912531 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:28.912531 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:28.912531 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:28.912531 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:28.912531 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:28.912531 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:28.913324 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:28.913324 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:28.913324 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:28.913324 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:28.913324 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:28.913324 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:28.913324 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:28.913324 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:28.913324 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:28.913324 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:28.913324 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:52:28.913324 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:52:28.913324 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 151/300] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:28.913960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5274e62-2fc4-4d34-8b42-0ca29b5b3a5e None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:28.999935 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 150/301] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:29.000535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce562d-df94-4830-b286-25743a7a9083 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:29.020448 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:29.028778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5274e62-2fc4-4d34-8b42-0ca29b5b3a5e None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:29.067238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8f239-77fc-4d4c-ba1b-dd368b311568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:29.068149 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8f239-77fc-4d4c-ba1b-dd368b311568 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:29.068631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8f239-77fc-4d4c-ba1b-dd368b311568 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:29.069081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8f239-77fc-4d4c-ba1b-dd368b311568 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:29.070466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8f239-77fc-4d4c-ba1b-dd368b311568 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:29.072237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8f239-77fc-4d4c-ba1b-dd368b311568 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:29.072381 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:29.074302 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 152/302] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:52:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:29.075140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8f239-77fc-4d4c-ba1b-dd368b311568 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:29.145654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce562d-df94-4830-b286-25743a7a9083 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:29.193496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d44df-f55e-4975-afe2-30a4056c2867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:29.194113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d44df-f55e-4975-afe2-30a4056c2867 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:29.194389 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d44df-f55e-4975-afe2-30a4056c2867 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:29.194654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d44df-f55e-4975-afe2-30a4056c2867 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:29.195354 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d44df-f55e-4975-afe2-30a4056c2867 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:29.195652 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d44df-f55e-4975-afe2-30a4056c2867 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:29.197136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d44df-f55e-4975-afe2-30a4056c2867 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:29.206642 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 151/303] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Aug 7 00:52:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:29.207471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d44df-f55e-4975-afe2-30a4056c2867 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:29.208586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8f239-77fc-4d4c-ba1b-dd368b311568 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:29.256113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e7136-1623-402c-aa3c-f6e06cec680c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:29.256789 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e7136-1623-402c-aa3c-f6e06cec680c None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:29.257069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e7136-1623-402c-aa3c-f6e06cec680c None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:29.257344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e7136-1623-402c-aa3c-f6e06cec680c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:29.269765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e7136-1623-402c-aa3c-f6e06cec680c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:29.276622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-5b0e7136-1623-402c-aa3c-f6e06cec680c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:52:29.276622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:29.276622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:29.276622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:29.276622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:29.276622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:29.276622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:29.276622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:29.276622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:29.276622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:29.276622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:29.276622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:29.276622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:29.276622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:29.276622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:29.276622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:29.277622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:29.277622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:29.277622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:29.277622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:29.277622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:29.277622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:29.277622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:29.277622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:29.277622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:29.277622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:29.277622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:29.277622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:29.277622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:29.277622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:29.277622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:29.277622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:29.284342 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:29.284342 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:29.284342 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:29.284342 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:29.284342 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:29.284342 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:29.284342 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:29.284342 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:29.284342 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:29.284342 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:29.284342 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:52:29.284342 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:52:29.284342 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 153/304] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:29.284342 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e7136-1623-402c-aa3c-f6e06cec680c None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:29.308920 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:29.347736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d44df-f55e-4975-afe2-30a4056c2867 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:29.363808 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:29.393580 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb0934-d4c8-499a-908b-464e05f297c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:29.394543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb0934-d4c8-499a-908b-464e05f297c1 None admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:29.394850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb0934-d4c8-499a-908b-464e05f297c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:29.395202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb0934-d4c8-499a-908b-464e05f297c1 None admin] PATH_INFO: `/v3/groups` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:29.396057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb0934-d4c8-499a-908b-464e05f297c1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:29.397975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccb0934-d4c8-499a-908b-464e05f297c1 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:29.400949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e7136-1623-402c-aa3c-f6e06cec680c None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:29.417909 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 152/305] 10.222.0.39 () {60 vars in 1134 bytes} [Sun Aug 7 00:52:29 2022] POST /identity/v3/groups => generated 229 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:52:29.419090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb0934-d4c8-499a-908b-464e05f297c1 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:29.462223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d9982-56fa-4b37-9d11-4172798f2ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:29.462889 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d9982-56fa-4b37-9d11-4172798f2ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:29.463190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d9982-56fa-4b37-9d11-4172798f2ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:29.463482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d9982-56fa-4b37-9d11-4172798f2ae4 None admin] PATH_INFO: `/v3/users/62091aa547784b6099147fbad74b2720` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:29.485381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d9982-56fa-4b37-9d11-4172798f2ae4 None admin] RBAC: Authorizing `identity:get_user(user_id=62091aa547784b6099147fbad74b2720)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:29.487483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95d9982-56fa-4b37-9d11-4172798f2ae4 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:29.489781 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 154/306] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:52:29 2022] GET /identity/v3/users/62091aa547784b6099147fbad74b2720 => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:29.496289 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d9982-56fa-4b37-9d11-4172798f2ae4 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:29.589459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb0934-d4c8-499a-908b-464e05f297c1 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:29.615503 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:29.639231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc2368-5e25-4ac4-bdcc-a5aef6a20105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:29.639972 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc2368-5e25-4ac4-bdcc-a5aef6a20105 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:29.640268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc2368-5e25-4ac4-bdcc-a5aef6a20105 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:29.640552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc2368-5e25-4ac4-bdcc-a5aef6a20105 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:29.641897 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc2368-5e25-4ac4-bdcc-a5aef6a20105 None admin] RBAC: Adding query filter params (name=member) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:29.642233 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc2368-5e25-4ac4-bdcc-a5aef6a20105 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:29.643710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc2368-5e25-4ac4-bdcc-a5aef6a20105 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:29.650824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d9982-56fa-4b37-9d11-4172798f2ae4 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:29.653759 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 153/307] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Aug 7 00:52:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:29.654856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160897b-bb3c-4b28-ba27-c831119d7f2c None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:29.655135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160897b-bb3c-4b28-ba27-c831119d7f2c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:29.655406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160897b-bb3c-4b28-ba27-c831119d7f2c None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:29.661057 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 154/308] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:29.662548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160897b-bb3c-4b28-ba27-c831119d7f2c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:29.691580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae10fcf-8214-4310-8047-317239e71814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:29.692332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae10fcf-8214-4310-8047-317239e71814 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:29.692679 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae10fcf-8214-4310-8047-317239e71814 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:29.693017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae10fcf-8214-4310-8047-317239e71814 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:29.693934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae10fcf-8214-4310-8047-317239e71814 None admin] RBAC: Adding query filter params (role.id=53830cd13bce471ba955d5469f3330f4, user.id=62091aa547784b6099147fbad74b2720, scope.system=all) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:29.694388 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae10fcf-8214-4310-8047-317239e71814 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:29.695901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae10fcf-8214-4310-8047-317239e71814 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:29.697203 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:29.707980 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 155/309] 10.222.0.39 () {56 vars in 1308 bytes} [Sun Aug 7 00:52:29 2022] GET /identity/v3/role_assignments?user.id=62091aa547784b6099147fbad74b2720&scope.system=all&role.id=53830cd13bce471ba955d5469f3330f4 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:29.709722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e88278-5bd0-45ea-b386-fbcbe0815717 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:29.710002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e88278-5bd0-45ea-b386-fbcbe0815717 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:29.710269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e88278-5bd0-45ea-b386-fbcbe0815717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:29.729511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-19e88278-5bd0-45ea-b386-fbcbe0815717 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:29.730761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-19e88278-5bd0-45ea-b386-fbcbe0815717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:29.784994 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160897b-bb3c-4b28-ba27-c831119d7f2c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:29.809453 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 156/310] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:29.826024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae0876-ff8d-41e1-b33f-f7d9f70fc67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:29.826925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae0876-ff8d-41e1-b33f-f7d9f70fc67f None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:29.827352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae0876-ff8d-41e1-b33f-f7d9f70fc67f None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:29.827826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae0876-ff8d-41e1-b33f-f7d9f70fc67f None admin] PATH_INFO: `/v3/users/3da25119665742fcb4988ffb55a027cb` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:29.829799 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae0876-ff8d-41e1-b33f-f7d9f70fc67f None admin] RBAC: Authorizing `identity:get_user(user_id=3da25119665742fcb4988ffb55a027cb)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:29.831690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae0876-ff8d-41e1-b33f-f7d9f70fc67f None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:29.833933 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 155/311] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:52:29 2022] GET /identity/v3/users/3da25119665742fcb4988ffb55a027cb => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:52:29.835941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e88278-5bd0-45ea-b386-fbcbe0815717 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:29.839794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae0876-ff8d-41e1-b33f-f7d9f70fc67f None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:29.939411 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:29.961348 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:29.966973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae0876-ff8d-41e1-b33f-f7d9f70fc67f None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:29.977295 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e88278-5bd0-45ea-b386-fbcbe0815717 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:30.004959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7a85a-cbed-4c53-aea9-7c28c5c51f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:30.005769 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7a85a-cbed-4c53-aea9-7c28c5c51f19 None admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:30.006145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7a85a-cbed-4c53-aea9-7c28c5c51f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:30.006505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7a85a-cbed-4c53-aea9-7c28c5c51f19 None admin] PATH_INFO: `/v3/system/users/3da25119665742fcb4988ffb55a027cb/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:30.008151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc7a85a-cbed-4c53-aea9-7c28c5c51f19 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3da25119665742fcb4988ffb55a027cb, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:30.009628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc7a85a-cbed-4c53-aea9-7c28c5c51f19 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:30.020833 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 156/312] 10.222.0.39 () {58 vars in 1334 bytes} [Sun Aug 7 00:52:29 2022] PUT /identity/v3/system/users/3da25119665742fcb4988ffb55a027cb/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 00:52:30.024193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dd74e-237a-4148-b793-debdc65eed82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:30.025071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dd74e-237a-4148-b793-debdc65eed82 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:30.025507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dd74e-237a-4148-b793-debdc65eed82 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:30.025897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dd74e-237a-4148-b793-debdc65eed82 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:30.047771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83dd74e-237a-4148-b793-debdc65eed82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:30.053259 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-f83dd74e-237a-4148-b793-debdc65eed82 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:52:30.053259 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:30.053259 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:30.053259 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:30.053259 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:30.053259 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:30.053259 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:30.053259 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:30.053259 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:30.053259 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:30.053259 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:30.053259 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:30.053259 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:30.053259 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:30.053259 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:30.053259 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:30.054221 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:30.054221 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:30.054221 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:30.054221 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:30.054221 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:30.054221 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:30.054221 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:30.054221 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:30.054221 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:30.054221 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:30.054221 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:30.054221 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:30.054221 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:30.054221 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:30.054221 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:30.054221 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:30.055380 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:30.055380 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:30.055380 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:30.055380 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:30.055380 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:30.055380 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:30.055380 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:30.055380 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:30.055380 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:30.055380 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:30.055380 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:52:30.055380 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:52:30.055380 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 157/313] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:52:30.064937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7a85a-cbed-4c53-aea9-7c28c5c51f19 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:30.187246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7a85a-cbed-4c53-aea9-7c28c5c51f19 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:30.223418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d43685-a895-4525-b3d9-5fad5e367a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:30.223985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d43685-a895-4525-b3d9-5fad5e367a44 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:30.224265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d43685-a895-4525-b3d9-5fad5e367a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:30.224536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d43685-a895-4525-b3d9-5fad5e367a44 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:30.225248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d43685-a895-4525-b3d9-5fad5e367a44 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:30.225553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d43685-a895-4525-b3d9-5fad5e367a44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:30.226947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d43685-a895-4525-b3d9-5fad5e367a44 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:30.244423 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 157/314] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Aug 7 00:52:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:30.248232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dd74e-237a-4148-b793-debdc65eed82 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:30.354952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dd74e-237a-4148-b793-debdc65eed82 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:30.390421 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad3966-3084-470a-9f91-6682f745774b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:30.391576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad3966-3084-470a-9f91-6682f745774b None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:30.391854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad3966-3084-470a-9f91-6682f745774b None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:30.392143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad3966-3084-470a-9f91-6682f745774b None admin] PATH_INFO: `/v3/users/392797e05a94434f9a78d705e7241df5` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:30.393294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad3966-3084-470a-9f91-6682f745774b None admin] RBAC: Authorizing `identity:get_user(user_id=392797e05a94434f9a78d705e7241df5)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:30.394745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad3966-3084-470a-9f91-6682f745774b None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:30.396671 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 158/315] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:52:30 2022] GET /identity/v3/users/392797e05a94434f9a78d705e7241df5 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:30.402487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d43685-a895-4525-b3d9-5fad5e367a44 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:30.432103 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:30.508596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d43685-a895-4525-b3d9-5fad5e367a44 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:30.545677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e32d2-7eeb-46ed-b770-bead2bf8b376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:30.546822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e32d2-7eeb-46ed-b770-bead2bf8b376 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:30.547853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e32d2-7eeb-46ed-b770-bead2bf8b376 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:30.548342 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e32d2-7eeb-46ed-b770-bead2bf8b376 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:30.623999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e32d2-7eeb-46ed-b770-bead2bf8b376 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:30.626533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e32d2-7eeb-46ed-b770-bead2bf8b376 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:30.672340 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:30.744284 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 158/316] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:52:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:52:30.745868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad3966-3084-470a-9f91-6682f745774b None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:30.748717 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:30.847612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad3966-3084-470a-9f91-6682f745774b None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:30.882881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda7a0bf-a36a-4790-b1f0-f62079af8b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:30.883509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7a0bf-a36a-4790-b1f0-f62079af8b8d None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:30.883783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7a0bf-a36a-4790-b1f0-f62079af8b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:30.884089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda7a0bf-a36a-4790-b1f0-f62079af8b8d None admin] PATH_INFO: `/v3/projects/2388c261a2d64686b83675d2cd97701c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:30.885297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7a0bf-a36a-4790-b1f0-f62079af8b8d None admin] RBAC: Authorizing `identity:get_project(project_id=2388c261a2d64686b83675d2cd97701c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:30.886733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda7a0bf-a36a-4790-b1f0-f62079af8b8d None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:30.888534 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 159/317] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:30 2022] GET /identity/v3/projects/2388c261a2d64686b83675d2cd97701c => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:30.894607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e32d2-7eeb-46ed-b770-bead2bf8b376 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:31.022781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e32d2-7eeb-46ed-b770-bead2bf8b376 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:31.051259 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:31.061445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa9f43-dd29-43c4-a955-553dd0f9e7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:31.062097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa9f43-dd29-43c4-a955-553dd0f9e7eb None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:31.062398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa9f43-dd29-43c4-a955-553dd0f9e7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:31.062707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa9f43-dd29-43c4-a955-553dd0f9e7eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:31.063547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa9f43-dd29-43c4-a955-553dd0f9e7eb None admin] RBAC: Adding query filter params (role.id=53830cd13bce471ba955d5469f3330f4, scope.project.id=2388c261a2d64686b83675d2cd97701c, user.id=392797e05a94434f9a78d705e7241df5) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:31.063857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa9f43-dd29-43c4-a955-553dd0f9e7eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:31.065383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa9f43-dd29-43c4-a955-553dd0f9e7eb None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:31.072366 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 159/318] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:52:30 2022] GET /identity/v3/role_assignments?user.id=392797e05a94434f9a78d705e7241df5&scope.project.id=2388c261a2d64686b83675d2cd97701c&role.id=53830cd13bce471ba955d5469f3330f4 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:31.597125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f4dea-94c1-4eeb-96ee-f37740bcf780 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:31.597507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f4dea-94c1-4eeb-96ee-f37740bcf780 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:31.597682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f4dea-94c1-4eeb-96ee-f37740bcf780 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:31.599166 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 160/319] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:31.604286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67974e8f-6fa2-4cfe-b243-8e233c252a70 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:31.604569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67974e8f-6fa2-4cfe-b243-8e233c252a70 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:31.604839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67974e8f-6fa2-4cfe-b243-8e233c252a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:31.626090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-67974e8f-6fa2-4cfe-b243-8e233c252a70 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:31.627328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-67974e8f-6fa2-4cfe-b243-8e233c252a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:31.697544 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 160/320] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:31.719529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f4dea-94c1-4eeb-96ee-f37740bcf780 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:31.792062 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:31.825074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f4dea-94c1-4eeb-96ee-f37740bcf780 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:31.859250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac59b02-8bd1-4726-befd-a4915998a087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:31.860340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac59b02-8bd1-4726-befd-a4915998a087 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:31.860615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac59b02-8bd1-4726-befd-a4915998a087 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:31.860881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac59b02-8bd1-4726-befd-a4915998a087 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:31.862035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac59b02-8bd1-4726-befd-a4915998a087 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:31.863477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac59b02-8bd1-4726-befd-a4915998a087 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:31.865052 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 161/321] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:52:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:31.871123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67974e8f-6fa2-4cfe-b243-8e233c252a70 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:31.957566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b0242-ca74-4002-974c-100824408692 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:31.958254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b0242-ca74-4002-974c-100824408692 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:31.958763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b0242-ca74-4002-974c-100824408692 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:31.961522 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 162/322] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:31.968823 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e578753-e46c-491e-9a13-70398c4cd17b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:31.968823 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e578753-e46c-491e-9a13-70398c4cd17b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:31.968823 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e578753-e46c-491e-9a13-70398c4cd17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:31.987119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67974e8f-6fa2-4cfe-b243-8e233c252a70 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:31.990239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0e578753-e46c-491e-9a13-70398c4cd17b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:31.991441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0e578753-e46c-491e-9a13-70398c4cd17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:32.012989 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:32.030689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96c354-72c9-480d-a28c-3f56d4d056bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:32.031351 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96c354-72c9-480d-a28c-3f56d4d056bd None admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:32.032277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96c354-72c9-480d-a28c-3f56d4d056bd None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:32.032502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e96c354-72c9-480d-a28c-3f56d4d056bd None admin] PATH_INFO: `/v3/groups` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:32.033135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96c354-72c9-480d-a28c-3f56d4d056bd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:32.034609 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e96c354-72c9-480d-a28c-3f56d4d056bd None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:32.052249 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 161/323] 10.222.0.39 () {60 vars in 1134 bytes} [Sun Aug 7 00:52:31 2022] POST /identity/v3/groups => generated 226 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:52:32.083932 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 163/324] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:52:32.105978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96c354-72c9-480d-a28c-3f56d4d056bd None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:32.134864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cd4b2-3244-4e81-83dc-74e1c094be54 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:32.135149 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cd4b2-3244-4e81-83dc-74e1c094be54 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:32.135330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cd4b2-3244-4e81-83dc-74e1c094be54 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:32.136890 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 164/325] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:32.142953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fb066-c9c1-4a99-984c-65042c9a86a8 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:32.143236 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fb066-c9c1-4a99-984c-65042c9a86a8 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:32.143532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fb066-c9c1-4a99-984c-65042c9a86a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:32.166231 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-713fb066-c9c1-4a99-984c-65042c9a86a8 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:32.167540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-713fb066-c9c1-4a99-984c-65042c9a86a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:32.220518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e96c354-72c9-480d-a28c-3f56d4d056bd None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:32.240269 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:32.247834 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 165/326] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:52:32.260304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303be1f3-8b8f-4c50-8f41-1b433db932da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:32.261674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303be1f3-8b8f-4c50-8f41-1b433db932da None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:32.261674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303be1f3-8b8f-4c50-8f41-1b433db932da None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:32.261674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303be1f3-8b8f-4c50-8f41-1b433db932da None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:32.272802 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fb066-c9c1-4a99-984c-65042c9a86a8 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:32.280484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303be1f3-8b8f-4c50-8f41-1b433db932da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:32.297398 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-303be1f3-8b8f-4c50-8f41-1b433db932da None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:52:32.297398 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:32.297398 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:32.297398 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:32.297398 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:32.297398 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:32.297398 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:32.297398 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:32.297398 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:32.297398 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:32.297398 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:32.297398 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:32.297398 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:32.297398 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:32.297398 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:32.297398 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:32.298689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:32.298689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:32.298689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:32.298689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:32.298689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:32.298689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:32.298689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:32.298689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:32.298689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:32.298689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:32.298689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:32.298689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:32.298689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:32.298689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:32.298689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:32.298689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:32.299793 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:32.299793 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:32.299793 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:32.299793 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:32.299793 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:32.299793 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:32.299793 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:32.299793 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:32.299793 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:32.299793 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:32.299793 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:52:32.299793 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:32.299793 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 162/327] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:32.307043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303be1f3-8b8f-4c50-8f41-1b433db932da None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:32.357374 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:32.420140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fb066-c9c1-4a99-984c-65042c9a86a8 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:32.429869 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303be1f3-8b8f-4c50-8f41-1b433db932da None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:32.462921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38068b29-802b-4a39-a45b-30f91c4d88ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:32.464333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38068b29-802b-4a39-a45b-30f91c4d88ef None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:32.464619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38068b29-802b-4a39-a45b-30f91c4d88ef None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:32.464895 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38068b29-802b-4a39-a45b-30f91c4d88ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:32.479446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59960400-ad3c-41e5-b8d3-2ec994ed1fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:32.480683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59960400-ad3c-41e5-b8d3-2ec994ed1fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:32.481162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59960400-ad3c-41e5-b8d3-2ec994ed1fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:32.481568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59960400-ad3c-41e5-b8d3-2ec994ed1fd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:32.482388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59960400-ad3c-41e5-b8d3-2ec994ed1fd3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:32.483096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59960400-ad3c-41e5-b8d3-2ec994ed1fd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:32.483669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38068b29-802b-4a39-a45b-30f91c4d88ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:32.485406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59960400-ad3c-41e5-b8d3-2ec994ed1fd3 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:32.490825 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-38068b29-802b-4a39-a45b-30f91c4d88ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:52:32.490825 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:32.490825 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:32.490825 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:32.490825 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:32.490825 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:32.490825 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:32.490825 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:32.490825 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:32.490825 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:32.490825 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:32.490825 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:32.490825 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:32.490825 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:32.490825 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:32.490825 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:32.492011 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:32.492011 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:32.492011 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:32.492011 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:32.492011 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:32.492011 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:32.492011 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:32.492011 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:32.492011 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:32.492011 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:32.492011 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:32.492011 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:32.492011 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:32.492011 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:32.492011 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:32.492011 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:32.492956 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:32.492956 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:32.492956 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:32.492956 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:32.492956 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:32.492956 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:32.492956 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:32.492956 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:32.492956 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:32.492956 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:32.492956 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:52:32.492956 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:52:32.494667 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 166/328] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:32.499064 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 163/329] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Aug 7 00:52:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:52:32.501852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38068b29-802b-4a39-a45b-30f91c4d88ef None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:32.505064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59960400-ad3c-41e5-b8d3-2ec994ed1fd3 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:32.599619 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:32.680157 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38068b29-802b-4a39-a45b-30f91c4d88ef None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:32.702556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59960400-ad3c-41e5-b8d3-2ec994ed1fd3 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:32.711731 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:32.758335 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3001654-dbb3-405a-935a-58c44a9b1769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:32.759374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3001654-dbb3-405a-935a-58c44a9b1769 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:32.759751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3001654-dbb3-405a-935a-58c44a9b1769 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:32.759898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba515f76-8dde-424e-9d9d-ae97fa7b20c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:32.760155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3001654-dbb3-405a-935a-58c44a9b1769 None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:32.760753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba515f76-8dde-424e-9d9d-ae97fa7b20c8 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:32.761094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3001654-dbb3-405a-935a-58c44a9b1769 None admin] RBAC: Adding query filter params (name=member) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:32.761197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba515f76-8dde-424e-9d9d-ae97fa7b20c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:32.761421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba515f76-8dde-424e-9d9d-ae97fa7b20c8 None admin] PATH_INFO: `/v3/users/62091aa547784b6099147fbad74b2720` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:32.761553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3001654-dbb3-405a-935a-58c44a9b1769 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:32.762666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba515f76-8dde-424e-9d9d-ae97fa7b20c8 None admin] RBAC: Authorizing `identity:get_user(user_id=62091aa547784b6099147fbad74b2720)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:32.763754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3001654-dbb3-405a-935a-58c44a9b1769 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:32.764420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba515f76-8dde-424e-9d9d-ae97fa7b20c8 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:32.767298 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 164/330] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:52:32 2022] GET /identity/v3/users/62091aa547784b6099147fbad74b2720 => generated 293 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:32.774916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba515f76-8dde-424e-9d9d-ae97fa7b20c8 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:32.779127 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 167/331] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Aug 7 00:52:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:52:32.786613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3001654-dbb3-405a-935a-58c44a9b1769 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:32.939597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3001654-dbb3-405a-935a-58c44a9b1769 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:32.940386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba515f76-8dde-424e-9d9d-ae97fa7b20c8 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:32.983825 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:32.992589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cb508-ba92-4d3f-a5bb-61aadf2f3cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:32.994309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cb508-ba92-4d3f-a5bb-61aadf2f3cfa None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:32.996027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cb508-ba92-4d3f-a5bb-61aadf2f3cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:32.997262 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040cb508-ba92-4d3f-a5bb-61aadf2f3cfa None admin] PATH_INFO: `/v3/users/3da25119665742fcb4988ffb55a027cb` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:32.998654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1548f2c-0283-41b6-a29d-b6ed8e369429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:32.999223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040cb508-ba92-4d3f-a5bb-61aadf2f3cfa None admin] RBAC: Authorizing `identity:get_user(user_id=3da25119665742fcb4988ffb55a027cb)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:32.999525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1548f2c-0283-41b6-a29d-b6ed8e369429 None admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:32.999924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1548f2c-0283-41b6-a29d-b6ed8e369429 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:33.000900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1548f2c-0283-41b6-a29d-b6ed8e369429 None admin] PATH_INFO: `/v3/system/users/62091aa547784b6099147fbad74b2720/roles/53830cd13bce471ba955d5469f3330f4` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:33.002087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040cb508-ba92-4d3f-a5bb-61aadf2f3cfa None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:33.002646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1548f2c-0283-41b6-a29d-b6ed8e369429 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=62091aa547784b6099147fbad74b2720, role_id=53830cd13bce471ba955d5469f3330f4)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:33.004178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1548f2c-0283-41b6-a29d-b6ed8e369429 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:33.004796 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 168/332] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:52:32 2022] GET /identity/v3/users/3da25119665742fcb4988ffb55a027cb => generated 293 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:52:33.011772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cb508-ba92-4d3f-a5bb-61aadf2f3cfa None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:33.014037 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 165/333] 10.222.0.39 () {58 vars in 1334 bytes} [Sun Aug 7 00:52:32 2022] PUT /identity/v3/system/users/62091aa547784b6099147fbad74b2720/roles/53830cd13bce471ba955d5469f3330f4 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:52:33.145693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040cb508-ba92-4d3f-a5bb-61aadf2f3cfa None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:33.186692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483dfc7b-ffff-497f-90c9-0ff4e57c98cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:33.187985 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483dfc7b-ffff-497f-90c9-0ff4e57c98cc None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:33.188593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483dfc7b-ffff-497f-90c9-0ff4e57c98cc None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:33.189089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483dfc7b-ffff-497f-90c9-0ff4e57c98cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:33.190213 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483dfc7b-ffff-497f-90c9-0ff4e57c98cc None admin] RBAC: Adding query filter params (role.id=979b0708a1934c50b706215aa79dbb7a, user.id=3da25119665742fcb4988ffb55a027cb, scope.system=all) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:33.190718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483dfc7b-ffff-497f-90c9-0ff4e57c98cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:33.192517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483dfc7b-ffff-497f-90c9-0ff4e57c98cc None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:33.206819 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 169/334] 10.222.0.39 () {56 vars in 1308 bytes} [Sun Aug 7 00:52:33 2022] GET /identity/v3/role_assignments?user.id=3da25119665742fcb4988ffb55a027cb&scope.system=all&role.id=979b0708a1934c50b706215aa79dbb7a => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:34.613379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e5c25-af73-41d2-b7ed-45a6a0f4cd15 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:34.614409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e5c25-af73-41d2-b7ed-45a6a0f4cd15 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:34.616646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e5c25-af73-41d2-b7ed-45a6a0f4cd15 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:34.620762 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 166/335] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:34.630639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf6424-0da3-4d77-bfd2-30dc5c35daa9 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:34.631634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf6424-0da3-4d77-bfd2-30dc5c35daa9 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:34.632156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf6424-0da3-4d77-bfd2-30dc5c35daa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:34.657897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-aadf6424-0da3-4d77-bfd2-30dc5c35daa9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:34.659439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-aadf6424-0da3-4d77-bfd2-30dc5c35daa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:34.706419 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:34.739570 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 170/336] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:52:34.784028 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e5c25-af73-41d2-b7ed-45a6a0f4cd15 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:34.825508 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:34.905454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e5c25-af73-41d2-b7ed-45a6a0f4cd15 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:34.946493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d85c0c-c777-47d1-aa5f-fe1ee4c38e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:34.947119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d85c0c-c777-47d1-aa5f-fe1ee4c38e67 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:34.947386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d85c0c-c777-47d1-aa5f-fe1ee4c38e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:34.947647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d85c0c-c777-47d1-aa5f-fe1ee4c38e67 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:34.961553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d85c0c-c777-47d1-aa5f-fe1ee4c38e67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:34.966279 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-59d85c0c-c777-47d1-aa5f-fe1ee4c38e67 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:52:34.966279 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:34.966279 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:34.966279 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:34.966279 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:34.966279 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:34.966279 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:34.966279 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:34.966279 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:34.966279 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:34.966279 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:34.966279 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:34.966279 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:34.966279 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:34.966279 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:34.966279 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:34.967147 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:34.967147 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:34.967147 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:34.967147 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:34.967147 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:34.967147 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:34.967147 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:34.967147 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:34.967147 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:34.967147 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:34.967147 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:34.967147 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:34.967147 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:34.967147 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:34.967147 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:34.967147 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:34.968374 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:34.968374 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:34.968374 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:34.968374 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:34.968374 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:34.968374 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:34.968374 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:34.968374 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:34.968374 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:34.968374 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:34.968374 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:52:34.968374 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:34.968374 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 167/337] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:52:34.974262 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf6424-0da3-4d77-bfd2-30dc5c35daa9 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:35.093872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf6424-0da3-4d77-bfd2-30dc5c35daa9 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:35.136615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d0839-1a31-40bd-acba-9d2729f430db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:35.137277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d0839-1a31-40bd-acba-9d2729f430db None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:35.137559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d0839-1a31-40bd-acba-9d2729f430db None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:35.137825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d0839-1a31-40bd-acba-9d2729f430db None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:35.138505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d0839-1a31-40bd-acba-9d2729f430db None admin] RBAC: Adding query filter params (name=member) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:35.138801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d0839-1a31-40bd-acba-9d2729f430db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:35.140205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d0839-1a31-40bd-acba-9d2729f430db None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:35.155853 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 171/338] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Aug 7 00:52:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:35.161086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d85c0c-c777-47d1-aa5f-fe1ee4c38e67 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:35.301874 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:35.309926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d85c0c-c777-47d1-aa5f-fe1ee4c38e67 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:35.352700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd98c60-e958-4096-83bc-202ef2c3842e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:35.353663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd98c60-e958-4096-83bc-202ef2c3842e None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:35.354143 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd98c60-e958-4096-83bc-202ef2c3842e None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:35.354646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd98c60-e958-4096-83bc-202ef2c3842e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:35.436373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd98c60-e958-4096-83bc-202ef2c3842e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:35.438196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd98c60-e958-4096-83bc-202ef2c3842e None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:35.567915 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:35.576063 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 168/339] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:52:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:52:35.581814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d0839-1a31-40bd-acba-9d2729f430db None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:35.628337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b76f92-286a-4541-8490-b8251f34f91b None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:35.629293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b76f92-286a-4541-8490-b8251f34f91b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:35.629768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b76f92-286a-4541-8490-b8251f34f91b None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:35.631326 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 169/340] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:35.636774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a26e1-6b28-4982-899d-1f5694cdb631 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:35.637366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a26e1-6b28-4982-899d-1f5694cdb631 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:35.637839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a26e1-6b28-4982-899d-1f5694cdb631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:35.644288 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:35.672932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-155a26e1-6b28-4982-899d-1f5694cdb631 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:35.675010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-155a26e1-6b28-4982-899d-1f5694cdb631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:35.778891 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 170/341] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:52:35.789799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d0839-1a31-40bd-acba-9d2729f430db None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:35.833704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fc7a3-3e01-471e-97d0-7cd0b298d010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:35.834697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fc7a3-3e01-471e-97d0-7cd0b298d010 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:35.834976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fc7a3-3e01-471e-97d0-7cd0b298d010 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:35.835246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fc7a3-3e01-471e-97d0-7cd0b298d010 None admin] PATH_INFO: `/v3/projects/d48c2e640c56445a9109354f89807e83` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:35.835939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a26e1-6b28-4982-899d-1f5694cdb631 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:35.836949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0fc7a3-3e01-471e-97d0-7cd0b298d010 None admin] RBAC: Authorizing `identity:get_project(project_id=d48c2e640c56445a9109354f89807e83)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:35.838552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0fc7a3-3e01-471e-97d0-7cd0b298d010 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:35.841891 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 172/342] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:35 2022] GET /identity/v3/projects/d48c2e640c56445a9109354f89807e83 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:35.851911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fc7a3-3e01-471e-97d0-7cd0b298d010 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:35.975915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a26e1-6b28-4982-899d-1f5694cdb631 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:36.004146 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:36.027563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f145af-02db-4662-99c7-2c039f28cf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:36.028307 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f145af-02db-4662-99c7-2c039f28cf73 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:36.028591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f145af-02db-4662-99c7-2c039f28cf73 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:36.029417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f145af-02db-4662-99c7-2c039f28cf73 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:36.050590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f145af-02db-4662-99c7-2c039f28cf73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:36.056211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-01f145af-02db-4662-99c7-2c039f28cf73 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:52:36.056211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:36.056211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:36.056211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:36.056211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:36.056211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:36.056211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:36.056211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:36.056211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:36.056211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:36.056211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:36.056211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:36.056211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:36.056211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:36.056211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:36.056211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:36.057132 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:36.057132 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:36.057132 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:36.057132 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:36.057132 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:36.057132 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:36.057132 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:36.057132 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:36.057132 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:36.057132 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:36.057132 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:36.057132 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:36.057132 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:36.057132 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:36.057132 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:36.057132 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:36.057920 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:36.057920 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:36.057920 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:36.057920 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:36.057920 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:36.057920 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:36.057920 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:36.057920 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:36.057920 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:36.057920 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:36.057920 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:52:36.057920 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:36.057920 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 171/343] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Aug 7 00:52:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:52:36.064364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f145af-02db-4662-99c7-2c039f28cf73 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:36.080600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fc7a3-3e01-471e-97d0-7cd0b298d010 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:36.095435 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:36.142999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded6e6f-faac-4d78-8454-f02c36da6f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:36.143722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded6e6f-faac-4d78-8454-f02c36da6f64 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:36.144054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded6e6f-faac-4d78-8454-f02c36da6f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:36.144332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded6e6f-faac-4d78-8454-f02c36da6f64 None admin] PATH_INFO: `/v3/groups/434d5356b04040299131b9b736f21b87` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:36.151988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded6e6f-faac-4d78-8454-f02c36da6f64 None admin] RBAC: Authorizing `identity:get_group(group_id=434d5356b04040299131b9b736f21b87)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:36.153472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded6e6f-faac-4d78-8454-f02c36da6f64 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:36.155647 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 173/344] 10.222.0.39 () {56 vars in 1180 bytes} [Sun Aug 7 00:52:35 2022] GET /identity/v3/groups/434d5356b04040299131b9b736f21b87 => generated 226 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:36.158042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2b38d-cc7c-4644-b79a-daafb547f259 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:36.158330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2b38d-cc7c-4644-b79a-daafb547f259 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:36.158602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2b38d-cc7c-4644-b79a-daafb547f259 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:36.160009 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 174/345] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:36.162498 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2b38d-cc7c-4644-b79a-daafb547f259 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:36.270181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f145af-02db-4662-99c7-2c039f28cf73 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:36.303620 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2b38d-cc7c-4644-b79a-daafb547f259 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:36.346701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34e408-6685-4ff2-8f0b-939ac5259072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:36.347313 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34e408-6685-4ff2-8f0b-939ac5259072 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:36.347592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34e408-6685-4ff2-8f0b-939ac5259072 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:36.347865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34e408-6685-4ff2-8f0b-939ac5259072 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:36.348803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34e408-6685-4ff2-8f0b-939ac5259072 None admin] RBAC: Adding query filter params (group.id=434d5356b04040299131b9b736f21b87, role.id=979b0708a1934c50b706215aa79dbb7a, scope.project.id=d48c2e640c56445a9109354f89807e83) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:36.349118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34e408-6685-4ff2-8f0b-939ac5259072 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:36.351442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34e408-6685-4ff2-8f0b-939ac5259072 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:36.358104 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 175/346] 10.222.0.39 () {56 vars in 1376 bytes} [Sun Aug 7 00:52:36 2022] GET /identity/v3/role_assignments?group.id=434d5356b04040299131b9b736f21b87&scope.project.id=d48c2e640c56445a9109354f89807e83&role.id=979b0708a1934c50b706215aa79dbb7a => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:36.360193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf99993-4146-41bd-bae7-155c5fe20d04 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:36.360477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf99993-4146-41bd-bae7-155c5fe20d04 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:36.360756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf99993-4146-41bd-bae7-155c5fe20d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:36.364704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ade96a-8605-4419-ae38-9a24602a4b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:36.365348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ade96a-8605-4419-ae38-9a24602a4b96 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:36.365627 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ade96a-8605-4419-ae38-9a24602a4b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:36.365895 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ade96a-8605-4419-ae38-9a24602a4b96 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:36.366701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ade96a-8605-4419-ae38-9a24602a4b96 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:36.366887 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ade96a-8605-4419-ae38-9a24602a4b96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:36.368346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ade96a-8605-4419-ae38-9a24602a4b96 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:36.382466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-daf99993-4146-41bd-bae7-155c5fe20d04 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:36.383682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-daf99993-4146-41bd-bae7-155c5fe20d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:36.387050 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 172/347] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:52:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:36.392574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ade96a-8605-4419-ae38-9a24602a4b96 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:36.418034 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:36.468825 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 176/348] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:36.498305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf99993-4146-41bd-bae7-155c5fe20d04 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:36.504625 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:36.633281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ade96a-8605-4419-ae38-9a24602a4b96 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:36.642023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf99993-4146-41bd-bae7-155c5fe20d04 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:36.675658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7944c-30c8-44bd-bcf8-a808ac1d0425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:36.676304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7944c-30c8-44bd-bcf8-a808ac1d0425 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:36.676631 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7944c-30c8-44bd-bcf8-a808ac1d0425 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:36.676861 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7944c-30c8-44bd-bcf8-a808ac1d0425 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:36.705122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed2c1f-1fa4-47e5-b07b-0191b87d4bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:36.706170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed2c1f-1fa4-47e5-b07b-0191b87d4bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:36.706652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed2c1f-1fa4-47e5-b07b-0191b87d4bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:36.707129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed2c1f-1fa4-47e5-b07b-0191b87d4bd1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:36.726288 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed2c1f-1fa4-47e5-b07b-0191b87d4bd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:36.736417 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-05ed2c1f-1fa4-47e5-b07b-0191b87d4bd1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:52:36.736417 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:36.736417 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:36.736417 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:36.736417 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:36.736417 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:36.736417 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:36.736417 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:36.736417 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:36.736417 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:36.736417 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:36.736417 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:36.736417 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:36.736417 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:36.736417 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:36.736417 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:36.738554 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:36.738554 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:36.738554 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:36.738554 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:36.738554 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:36.738554 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:36.738554 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:36.738554 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:36.738554 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:36.738554 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:36.738554 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:36.738554 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:36.738554 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:36.738554 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:36.738554 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:36.738554 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:36.740526 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:36.740526 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:36.740526 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:36.740526 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:36.740526 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:36.740526 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:36.740526 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:36.740526 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:36.740526 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:36.740526 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:36.740526 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:52:36.740526 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:52:36.740526 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 177/349] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:36.742155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d7547-86b8-428d-93a1-a0a8b46294bd None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:36.742155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d7547-86b8-428d-93a1-a0a8b46294bd None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:36.742155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d7547-86b8-428d-93a1-a0a8b46294bd None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:36.746126 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 178/350] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:36.748234 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193c60b-a48e-460e-8050-7aaa186cf869 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:36.748771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193c60b-a48e-460e-8050-7aaa186cf869 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:36.749198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193c60b-a48e-460e-8050-7aaa186cf869 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:36.752395 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 179/351] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:36.754327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103e067-57c9-45f6-9352-c64752d92cc8 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:36.754808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103e067-57c9-45f6-9352-c64752d92cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:36.755277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103e067-57c9-45f6-9352-c64752d92cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:36.766815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7944c-30c8-44bd-bcf8-a808ac1d0425 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:36.768595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7944c-30c8-44bd-bcf8-a808ac1d0425 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:36.791536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6103e067-57c9-45f6-9352-c64752d92cc8 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:36.793588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6103e067-57c9-45f6-9352-c64752d92cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:36.822528 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:36.833454 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:36.910285 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 180/352] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:36.911049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103e067-57c9-45f6-9352-c64752d92cc8 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:36.917215 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 173/353] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:52:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 00:52:36.919713 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9859f98-0f49-4933-abb4-931b8f49687e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:36.920498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9859f98-0f49-4933-abb4-931b8f49687e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:36.921243 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9859f98-0f49-4933-abb4-931b8f49687e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:36.954081 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d9859f98-0f49-4933-abb4-931b8f49687e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:36.956589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d9859f98-0f49-4933-abb4-931b8f49687e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:37.020840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6103e067-57c9-45f6-9352-c64752d92cc8 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:37.058975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1145b-fe73-40ac-b9d5-b38213ab7439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:37.059684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1145b-fe73-40ac-b9d5-b38213ab7439 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:37.059993 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1145b-fe73-40ac-b9d5-b38213ab7439 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:37.060270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1145b-fe73-40ac-b9d5-b38213ab7439 None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:37.060945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1145b-fe73-40ac-b9d5-b38213ab7439 None admin] RBAC: Adding query filter params (name=member) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:37.061247 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1145b-fe73-40ac-b9d5-b38213ab7439 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:37.063278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1145b-fe73-40ac-b9d5-b38213ab7439 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:37.072504 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 181/354] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Aug 7 00:52:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:37.073144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1145b-fe73-40ac-b9d5-b38213ab7439 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:37.081676 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 174/355] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:37.083197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9859f98-0f49-4933-abb4-931b8f49687e None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:37.101543 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:37.198397 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:37.223135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1145b-fe73-40ac-b9d5-b38213ab7439 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:37.226303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9859f98-0f49-4933-abb4-931b8f49687e None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:37.268287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c02330-b651-4270-a555-89143f7cf862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:37.269042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c02330-b651-4270-a555-89143f7cf862 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:37.269350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c02330-b651-4270-a555-89143f7cf862 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:37.269690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c02330-b651-4270-a555-89143f7cf862 None admin] PATH_INFO: `/v3/projects/d48c2e640c56445a9109354f89807e83` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:37.270878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c02330-b651-4270-a555-89143f7cf862 None admin] RBAC: Authorizing `identity:get_project(project_id=d48c2e640c56445a9109354f89807e83)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:37.272104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b8fb7-b3d5-41c5-af5a-3400d0ab0534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:37.272742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c02330-b651-4270-a555-89143f7cf862 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:37.273507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b8fb7-b3d5-41c5-af5a-3400d0ab0534 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:37.273971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b8fb7-b3d5-41c5-af5a-3400d0ab0534 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:37.274394 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 182/356] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:37 2022] GET /identity/v3/projects/d48c2e640c56445a9109354f89807e83 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:37.274665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b8fb7-b3d5-41c5-af5a-3400d0ab0534 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:37.275173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c02330-b651-4270-a555-89143f7cf862 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:37.291006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b8fb7-b3d5-41c5-af5a-3400d0ab0534 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:37.296685 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-782b8fb7-b3d5-41c5-af5a-3400d0ab0534 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:52:37.296685 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:37.296685 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:37.296685 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:37.296685 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:37.296685 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:37.296685 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:37.296685 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:37.296685 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:37.296685 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:37.296685 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:37.296685 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:37.296685 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:37.296685 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:37.296685 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:37.296685 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:37.298226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:37.298226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:37.298226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:37.298226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:37.298226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:37.298226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:37.298226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:37.298226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:37.298226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:37.298226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:37.298226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:37.298226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:37.298226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:37.298226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:37.298226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:37.298226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:37.299093 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:37.299093 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:37.299093 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:37.299093 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:37.299093 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:37.299093 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:37.299093 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:37.299093 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:37.299093 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:37.299093 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:37.299093 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 07 00:52:37.299093 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:37.301729 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 175/357] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:37.302954 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b8fb7-b3d5-41c5-af5a-3400d0ab0534 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:37.388512 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:37.410101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c02330-b651-4270-a555-89143f7cf862 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:37.428062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b8fb7-b3d5-41c5-af5a-3400d0ab0534 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:37.456835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0f847-90f3-41b0-9f08-ac29ffeb5bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:37.457379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0f847-90f3-41b0-9f08-ac29ffeb5bfe None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:37.457661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0f847-90f3-41b0-9f08-ac29ffeb5bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:37.457933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0f847-90f3-41b0-9f08-ac29ffeb5bfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:37.468799 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d13881-7887-4a78-a957-a5940dba032b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:37.469945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d13881-7887-4a78-a957-a5940dba032b None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:37.470497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d13881-7887-4a78-a957-a5940dba032b None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:37.470989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d13881-7887-4a78-a957-a5940dba032b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:37.474392 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:37.484748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d13881-7887-4a78-a957-a5940dba032b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:37.490826 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-61d13881-7887-4a78-a957-a5940dba032b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:52:37.490826 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:37.490826 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:37.490826 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:37.490826 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:37.490826 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:37.490826 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:37.490826 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:37.490826 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:37.490826 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:37.490826 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:37.490826 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:37.490826 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:37.490826 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:37.490826 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:37.490826 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:37.491809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:37.491809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:37.491809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:37.491809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:37.491809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:37.491809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:37.491809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:37.491809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:37.491809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:37.491809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:37.491809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:37.491809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:37.491809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:37.491809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:37.491809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:37.491809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:37.492906 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:37.492906 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:37.492906 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:37.492906 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:37.492906 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:37.492906 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:37.492906 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:37.492906 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:37.492906 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:37.492906 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:37.492906 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:52:37.492906 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:37.495363 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 176/358] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Aug 7 00:52:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:37.496776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d13881-7887-4a78-a957-a5940dba032b None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:37.540317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0f847-90f3-41b0-9f08-ac29ffeb5bfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:37.541798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0f847-90f3-41b0-9f08-ac29ffeb5bfe None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:37.616770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d13881-7887-4a78-a957-a5940dba032b None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:37.666269 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:37.666573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd4809-5876-4a02-ad83-1e2565768362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:37.667246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd4809-5876-4a02-ad83-1e2565768362 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:37.667524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd4809-5876-4a02-ad83-1e2565768362 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:37.667797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd4809-5876-4a02-ad83-1e2565768362 None admin] PATH_INFO: `/v3/groups/434d5356b04040299131b9b736f21b87` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:37.669043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd4809-5876-4a02-ad83-1e2565768362 None admin] RBAC: Authorizing `identity:get_group(group_id=434d5356b04040299131b9b736f21b87)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:37.671303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd4809-5876-4a02-ad83-1e2565768362 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:37.673321 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 177/359] 10.222.0.39 () {56 vars in 1180 bytes} [Sun Aug 7 00:52:37 2022] GET /identity/v3/groups/434d5356b04040299131b9b736f21b87 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:37.674128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd4809-5876-4a02-ad83-1e2565768362 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:37.699288 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 183/360] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:52:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:52:37.700840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0f847-90f3-41b0-9f08-ac29ffeb5bfe None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:37.772720 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:37.836885 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd4809-5876-4a02-ad83-1e2565768362 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:37.843091 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0f847-90f3-41b0-9f08-ac29ffeb5bfe None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:37.882570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae68bd29-ee11-44b9-9878-b53464591172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:37.883941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68bd29-ee11-44b9-9878-b53464591172 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:37.884104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68bd29-ee11-44b9-9878-b53464591172 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:37.884447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae68bd29-ee11-44b9-9878-b53464591172 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:37.885672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae68bd29-ee11-44b9-9878-b53464591172 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:37.886212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae68bd29-ee11-44b9-9878-b53464591172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:37.889424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae68bd29-ee11-44b9-9878-b53464591172 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:37.892786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd33a58-c2e6-4cd8-9d57-adc276095122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:37.893417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd33a58-c2e6-4cd8-9d57-adc276095122 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:37.893698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd33a58-c2e6-4cd8-9d57-adc276095122 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:37.893971 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd33a58-c2e6-4cd8-9d57-adc276095122 None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:37.894960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd33a58-c2e6-4cd8-9d57-adc276095122 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:37.894960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd33a58-c2e6-4cd8-9d57-adc276095122 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:37.896378 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd33a58-c2e6-4cd8-9d57-adc276095122 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:37.907819 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 184/361] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:52:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:37.909220 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 178/362] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Aug 7 00:52:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:37.910277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690ad35-1216-4507-af0e-418c8498b84f None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:37.910530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690ad35-1216-4507-af0e-418c8498b84f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:37.910813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690ad35-1216-4507-af0e-418c8498b84f None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:37.911313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae68bd29-ee11-44b9-9878-b53464591172 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:37.913763 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 185/363] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:37.915401 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690ad35-1216-4507-af0e-418c8498b84f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:37.979771 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:38.055596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae68bd29-ee11-44b9-9878-b53464591172 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:38.057139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690ad35-1216-4507-af0e-418c8498b84f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:38.087436 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:38.096889 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febd0d5-7c0d-434a-9420-e85261d481f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:38.097500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febd0d5-7c0d-434a-9420-e85261d481f4 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:38.097783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febd0d5-7c0d-434a-9420-e85261d481f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:38.098057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2febd0d5-7c0d-434a-9420-e85261d481f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:38.098859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2febd0d5-7c0d-434a-9420-e85261d481f4 None admin] RBAC: Adding query filter params (group.id=434d5356b04040299131b9b736f21b87, role.id=04a874934a0944a2851b5e485a0f0a1b, scope.project.id=d48c2e640c56445a9109354f89807e83) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:38.099101 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2febd0d5-7c0d-434a-9420-e85261d481f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:38.101643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2febd0d5-7c0d-434a-9420-e85261d481f4 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:38.104197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c2a12-fdef-491b-82b5-dc6f1b20320d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:38.105466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c2a12-fdef-491b-82b5-dc6f1b20320d None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:38.106155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c2a12-fdef-491b-82b5-dc6f1b20320d None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:38.106590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c2a12-fdef-491b-82b5-dc6f1b20320d None admin] PATH_INFO: `/v3/projects/2388c261a2d64686b83675d2cd97701c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:38.107809 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 179/364] 10.222.0.39 () {56 vars in 1376 bytes} [Sun Aug 7 00:52:37 2022] GET /identity/v3/role_assignments?group.id=434d5356b04040299131b9b736f21b87&scope.project.id=d48c2e640c56445a9109354f89807e83&role.id=04a874934a0944a2851b5e485a0f0a1b => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:38.108125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c2a12-fdef-491b-82b5-dc6f1b20320d None admin] RBAC: Authorizing `identity:get_project(project_id=2388c261a2d64686b83675d2cd97701c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:38.108671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febd0d5-7c0d-434a-9420-e85261d481f4 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:38.110053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c2a12-fdef-491b-82b5-dc6f1b20320d None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:38.118090 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 186/365] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:37 2022] GET /identity/v3/projects/2388c261a2d64686b83675d2cd97701c => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:38.120068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c2a12-fdef-491b-82b5-dc6f1b20320d None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:38.249852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c2a12-fdef-491b-82b5-dc6f1b20320d None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:38.262555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2febd0d5-7c0d-434a-9420-e85261d481f4 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:38.271369 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:38.298302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44564e-f558-4f70-b535-ba2049e77367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:38.299234 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44564e-f558-4f70-b535-ba2049e77367 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:38.299656 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44564e-f558-4f70-b535-ba2049e77367 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:38.300109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44564e-f558-4f70-b535-ba2049e77367 None admin] PATH_INFO: `/v3/users/62091aa547784b6099147fbad74b2720` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:38.301566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44564e-f558-4f70-b535-ba2049e77367 None admin] RBAC: Authorizing `identity:get_user(user_id=62091aa547784b6099147fbad74b2720)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:38.303284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44564e-f558-4f70-b535-ba2049e77367 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:38.305757 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 187/366] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:52:38 2022] GET /identity/v3/users/62091aa547784b6099147fbad74b2720 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:38.307189 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae549b-e71e-4a4d-a04f-3efbdc74f848 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:38.307611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae549b-e71e-4a4d-a04f-3efbdc74f848 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:38.308063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae549b-e71e-4a4d-a04f-3efbdc74f848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:38.327491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb95d74-9aa1-4e15-a68d-5954b89dcdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:38.328166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb95d74-9aa1-4e15-a68d-5954b89dcdef None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:38.329162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb95d74-9aa1-4e15-a68d-5954b89dcdef None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:38.329439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb95d74-9aa1-4e15-a68d-5954b89dcdef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:38.331771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-62ae549b-e71e-4a4d-a04f-3efbdc74f848 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:38.333228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-62ae549b-e71e-4a4d-a04f-3efbdc74f848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:38.398098 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:38.409199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb95d74-9aa1-4e15-a68d-5954b89dcdef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:38.410886 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb95d74-9aa1-4e15-a68d-5954b89dcdef None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:38.443231 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 188/367] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:38.444490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae549b-e71e-4a4d-a04f-3efbdc74f848 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:38.520795 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 180/368] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:52:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:52:38.522083 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb95d74-9aa1-4e15-a68d-5954b89dcdef None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:38.575111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae549b-e71e-4a4d-a04f-3efbdc74f848 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:38.592431 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:38.620695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff41bf4-b967-4bc7-8cc7-275f831bd05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:38.621540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff41bf4-b967-4bc7-8cc7-275f831bd05a None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:38.621910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff41bf4-b967-4bc7-8cc7-275f831bd05a None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:38.622275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff41bf4-b967-4bc7-8cc7-275f831bd05a None admin] PATH_INFO: `/v3/groups/434d5356b04040299131b9b736f21b87` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:38.623534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff41bf4-b967-4bc7-8cc7-275f831bd05a None admin] RBAC: Authorizing `identity:get_group(group_id=434d5356b04040299131b9b736f21b87)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:38.625980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff41bf4-b967-4bc7-8cc7-275f831bd05a None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:38.627723 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 189/369] 10.222.0.39 () {56 vars in 1180 bytes} [Sun Aug 7 00:52:38 2022] GET /identity/v3/groups/434d5356b04040299131b9b736f21b87 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:38.630043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff41bf4-b967-4bc7-8cc7-275f831bd05a None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:38.636518 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:38.648963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb95d74-9aa1-4e15-a68d-5954b89dcdef None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:38.685959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4adade-3f4f-4611-892c-95e5ba4b3894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:38.687267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4adade-3f4f-4611-892c-95e5ba4b3894 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:38.688373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4adade-3f4f-4611-892c-95e5ba4b3894 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:38.688790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4adade-3f4f-4611-892c-95e5ba4b3894 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:38.689709 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4adade-3f4f-4611-892c-95e5ba4b3894 None admin] RBAC: Adding query filter params (role.id=53830cd13bce471ba955d5469f3330f4, user.id=62091aa547784b6099147fbad74b2720, scope.system=all) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:38.690172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4adade-3f4f-4611-892c-95e5ba4b3894 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:38.691826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4adade-3f4f-4611-892c-95e5ba4b3894 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:38.705407 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 181/370] 10.222.0.39 () {56 vars in 1308 bytes} [Sun Aug 7 00:52:38 2022] GET /identity/v3/role_assignments?user.id=62091aa547784b6099147fbad74b2720&scope.system=all&role.id=53830cd13bce471ba955d5469f3330f4 => generated 510 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:38.706553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4adade-3f4f-4611-892c-95e5ba4b3894 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:38.762045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff41bf4-b967-4bc7-8cc7-275f831bd05a None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:38.818892 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb6437b-f1c9-4060-8b56-7140266aa86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:38.819526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6437b-f1c9-4060-8b56-7140266aa86b None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:38.819805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6437b-f1c9-4060-8b56-7140266aa86b None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:38.820133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6437b-f1c9-4060-8b56-7140266aa86b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:38.835589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb6437b-f1c9-4060-8b56-7140266aa86b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:38.842421 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-ecb6437b-f1c9-4060-8b56-7140266aa86b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:52:38.842421 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:38.842421 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:38.842421 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:38.842421 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:38.842421 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:38.842421 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:38.842421 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:38.842421 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:38.842421 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:38.842421 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:38.842421 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:38.842421 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:38.842421 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:38.842421 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:38.842421 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:38.844416 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:38.844416 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:38.844416 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:38.844416 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:38.844416 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:38.844416 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:38.844416 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:38.844416 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:38.844416 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:38.844416 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:38.844416 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:38.844416 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:38.844416 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:38.844416 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:38.844416 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:38.844416 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:38.845611 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:38.845611 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:38.845611 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:38.845611 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:38.845611 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:38.845611 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:38.845611 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:38.845611 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:38.845611 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:38.845611 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:38.845611 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:52:38.845611 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:52:38.845611 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 190/371] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:52:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:38.847245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4adade-3f4f-4611-892c-95e5ba4b3894 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:38.847332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb6437b-f1c9-4060-8b56-7140266aa86b None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:38.903868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13796908-2e47-4917-923a-98b24d7ae23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:38.904554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13796908-2e47-4917-923a-98b24d7ae23c None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:38.904835 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13796908-2e47-4917-923a-98b24d7ae23c None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:38.905177 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13796908-2e47-4917-923a-98b24d7ae23c None admin] PATH_INFO: `/v3/projects/2388c261a2d64686b83675d2cd97701c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:38.906921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13796908-2e47-4917-923a-98b24d7ae23c None admin] RBAC: Authorizing `identity:get_project(project_id=2388c261a2d64686b83675d2cd97701c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:38.908468 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13796908-2e47-4917-923a-98b24d7ae23c None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:38.910530 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 182/372] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:38 2022] GET /identity/v3/projects/2388c261a2d64686b83675d2cd97701c => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:38.911859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55237332-6278-45a9-ae24-9b370d5b26e7 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:38.911991 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:38.912188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55237332-6278-45a9-ae24-9b370d5b26e7 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:38.912466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55237332-6278-45a9-ae24-9b370d5b26e7 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:38.913898 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 183/373] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:38.914615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55237332-6278-45a9-ae24-9b370d5b26e7 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:38.942819 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:39.003754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb6437b-f1c9-4060-8b56-7140266aa86b None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:39.051354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d86ee-0d25-462f-a871-7f7d7cadcb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:39.052031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d86ee-0d25-462f-a871-7f7d7cadcb29 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:39.052312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d86ee-0d25-462f-a871-7f7d7cadcb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:39.052867 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d86ee-0d25-462f-a871-7f7d7cadcb29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:39.053332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d86ee-0d25-462f-a871-7f7d7cadcb29 None admin] RBAC: Adding query filter params (group.id=434d5356b04040299131b9b736f21b87, role.id=979b0708a1934c50b706215aa79dbb7a, scope.project.id=2388c261a2d64686b83675d2cd97701c) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:39.053643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d86ee-0d25-462f-a871-7f7d7cadcb29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:39.055124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d86ee-0d25-462f-a871-7f7d7cadcb29 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:39.062427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55237332-6278-45a9-ae24-9b370d5b26e7 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:39.064854 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 191/374] 10.222.0.39 () {56 vars in 1376 bytes} [Sun Aug 7 00:52:38 2022] GET /identity/v3/role_assignments?group.id=434d5356b04040299131b9b736f21b87&scope.project.id=2388c261a2d64686b83675d2cd97701c&role.id=979b0708a1934c50b706215aa79dbb7a => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:39.064854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d86ee-0d25-462f-a871-7f7d7cadcb29 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:39.106978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c2369-3ca3-4dbc-8407-75f400a65f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:39.107544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c2369-3ca3-4dbc-8407-75f400a65f7d None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:39.107817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c2369-3ca3-4dbc-8407-75f400a65f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:39.108177 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c2369-3ca3-4dbc-8407-75f400a65f7d None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:39.108987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c2369-3ca3-4dbc-8407-75f400a65f7d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:39.109258 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c2369-3ca3-4dbc-8407-75f400a65f7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:39.111514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c2369-3ca3-4dbc-8407-75f400a65f7d None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:39.122929 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 184/375] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:39.127409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b01020-bb83-441c-ba73-ea011276a654 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:39.127863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b01020-bb83-441c-ba73-ea011276a654 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:39.128166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b01020-bb83-441c-ba73-ea011276a654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:39.150532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b7b01020-bb83-441c-ba73-ea011276a654 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:39.151755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b7b01020-bb83-441c-ba73-ea011276a654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:39.210691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d86ee-0d25-462f-a871-7f7d7cadcb29 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:39.214019 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:39.265086 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4ac03-3fdb-4a2d-b923-48b000b51730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:39.267163 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 185/376] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:39.268346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b01020-bb83-441c-ba73-ea011276a654 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:39.272686 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4ac03-3fdb-4a2d-b923-48b000b51730 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:39.272989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4ac03-3fdb-4a2d-b923-48b000b51730 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:39.273252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4ac03-3fdb-4a2d-b923-48b000b51730 None admin] PATH_INFO: `/v3/groups/434d5356b04040299131b9b736f21b87` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:39.274582 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4ac03-3fdb-4a2d-b923-48b000b51730 None admin] RBAC: Authorizing `identity:get_group(group_id=434d5356b04040299131b9b736f21b87)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:39.276127 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4ac03-3fdb-4a2d-b923-48b000b51730 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:39.281478 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:39.284370 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 192/377] 10.222.0.39 () {56 vars in 1180 bytes} [Sun Aug 7 00:52:39 2022] GET /identity/v3/groups/434d5356b04040299131b9b736f21b87 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:39.291997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4ac03-3fdb-4a2d-b923-48b000b51730 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:39.412057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b01020-bb83-441c-ba73-ea011276a654 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:39.426531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4ac03-3fdb-4a2d-b923-48b000b51730 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:39.468093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793b932-6079-4ba6-8591-9d045ccfd85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:39.469322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793b932-6079-4ba6-8591-9d045ccfd85b None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:39.469772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793b932-6079-4ba6-8591-9d045ccfd85b None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:39.470680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793b932-6079-4ba6-8591-9d045ccfd85b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:39.477911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254874d-a06e-4ead-b679-21c37655f8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:39.478856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254874d-a06e-4ead-b679-21c37655f8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:39.479304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254874d-a06e-4ead-b679-21c37655f8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:39.479759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254874d-a06e-4ead-b679-21c37655f8a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:39.480869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254874d-a06e-4ead-b679-21c37655f8a6 None admin] RBAC: Adding query filter params (group.id=434d5356b04040299131b9b736f21b87, role.id=04a874934a0944a2851b5e485a0f0a1b, scope.project.id=2388c261a2d64686b83675d2cd97701c) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:39.481267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254874d-a06e-4ead-b679-21c37655f8a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:39.482831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254874d-a06e-4ead-b679-21c37655f8a6 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:39.490185 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 193/378] 10.222.0.39 () {56 vars in 1376 bytes} [Sun Aug 7 00:52:39 2022] GET /identity/v3/role_assignments?group.id=434d5356b04040299131b9b736f21b87&scope.project.id=2388c261a2d64686b83675d2cd97701c&role.id=04a874934a0944a2851b5e485a0f0a1b => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:39.491135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254874d-a06e-4ead-b679-21c37655f8a6 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:39.574197 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:39.589601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793b932-6079-4ba6-8591-9d045ccfd85b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:39.593505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793b932-6079-4ba6-8591-9d045ccfd85b None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:39.614547 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:39.744597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254874d-a06e-4ead-b679-21c37655f8a6 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:39.795048 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 186/379] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:52:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:52:39.804900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793b932-6079-4ba6-8591-9d045ccfd85b None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:39.817915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbed55-f3d3-4fed-8bb1-6d8ca645adf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:39.818560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbed55-f3d3-4fed-8bb1-6d8ca645adf7 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:39.818836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbed55-f3d3-4fed-8bb1-6d8ca645adf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:39.819107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbed55-f3d3-4fed-8bb1-6d8ca645adf7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:39.848887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dbed55-f3d3-4fed-8bb1-6d8ca645adf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:39.854210 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-55dbed55-f3d3-4fed-8bb1-6d8ca645adf7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:52:39.854210 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:39.854210 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:39.854210 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:39.854210 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:39.854210 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:39.854210 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:39.854210 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:39.854210 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:39.854210 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:39.854210 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:39.854210 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:39.854210 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:39.854210 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:39.854210 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:39.854210 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:39.855672 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:39.855672 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:39.855672 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:39.855672 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:39.855672 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:39.855672 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:39.855672 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:39.855672 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:39.855672 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:39.855672 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:39.855672 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:39.855672 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:39.855672 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:39.855672 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:39.855672 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:39.855672 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:39.856538 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:39.856538 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:39.856538 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:39.856538 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:39.856538 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:39.856538 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:39.856538 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:39.856538 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:39.856538 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:39.856538 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:39.856538 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:52:39.856538 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:52:39.859820 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 194/380] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:39.860957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbed55-f3d3-4fed-8bb1-6d8ca645adf7 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:39.989791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793b932-6079-4ba6-8591-9d045ccfd85b None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:40.009636 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:40.053948 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf967d-fb63-4b18-a5dd-df8e36eaf7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:40.055585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf967d-fb63-4b18-a5dd-df8e36eaf7cf None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:40.056084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf967d-fb63-4b18-a5dd-df8e36eaf7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:40.056566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf967d-fb63-4b18-a5dd-df8e36eaf7cf None admin] PATH_INFO: `/v3/projects/62e0ba2ccef34e34b7ab3788b1ce6bb8` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:40.057939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf967d-fb63-4b18-a5dd-df8e36eaf7cf None admin] RBAC: Authorizing `identity:get_project(project_id=62e0ba2ccef34e34b7ab3788b1ce6bb8)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:40.059643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf967d-fb63-4b18-a5dd-df8e36eaf7cf None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:40.061871 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 187/381] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:39 2022] GET /identity/v3/projects/62e0ba2ccef34e34b7ab3788b1ce6bb8 => generated 344 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:40.068147 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf967d-fb63-4b18-a5dd-df8e36eaf7cf None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:40.125486 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:40.145195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbed55-f3d3-4fed-8bb1-6d8ca645adf7 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:40.226551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e2b77-34c4-4b14-8372-1a9dc52eac8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:40.228844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e2b77-34c4-4b14-8372-1a9dc52eac8f None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:40.229597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e2b77-34c4-4b14-8372-1a9dc52eac8f None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:40.231534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e2b77-34c4-4b14-8372-1a9dc52eac8f None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:40.233007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e2b77-34c4-4b14-8372-1a9dc52eac8f None admin] RBAC: Adding query filter params (name=member) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:40.234811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e2b77-34c4-4b14-8372-1a9dc52eac8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:40.238520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e2b77-34c4-4b14-8372-1a9dc52eac8f None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:40.247583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf967d-fb63-4b18-a5dd-df8e36eaf7cf None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:40.268033 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 195/382] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Aug 7 00:52:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:40.271567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e2b77-34c4-4b14-8372-1a9dc52eac8f None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:40.325086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c1718-a8de-4ba7-953c-1091ba8bda8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:40.326489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c1718-a8de-4ba7-953c-1091ba8bda8c None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:40.327227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c1718-a8de-4ba7-953c-1091ba8bda8c None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:40.329716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c1718-a8de-4ba7-953c-1091ba8bda8c None admin] PATH_INFO: `/v3/groups/a7eb77ab122d4598bdd7824d9c3de2c1` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:40.342304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c1718-a8de-4ba7-953c-1091ba8bda8c None admin] RBAC: Authorizing `identity:get_group(group_id=a7eb77ab122d4598bdd7824d9c3de2c1)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:40.345189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c1718-a8de-4ba7-953c-1091ba8bda8c None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:40.350301 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 188/383] 10.222.0.39 () {56 vars in 1180 bytes} [Sun Aug 7 00:52:40 2022] GET /identity/v3/groups/a7eb77ab122d4598bdd7824d9c3de2c1 => generated 229 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:40.358543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c1718-a8de-4ba7-953c-1091ba8bda8c None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:40.421963 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:40.469779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e2b77-34c4-4b14-8372-1a9dc52eac8f None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:40.495701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c1718-a8de-4ba7-953c-1091ba8bda8c None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:40.533787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5976e-cee1-496d-af60-308391dceef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:40.534347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5976e-cee1-496d-af60-308391dceef3 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:40.534623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5976e-cee1-496d-af60-308391dceef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:40.534889 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5976e-cee1-496d-af60-308391dceef3 None admin] PATH_INFO: `/v3/groups/434d5356b04040299131b9b736f21b87` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:40.536023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5976e-cee1-496d-af60-308391dceef3 None admin] RBAC: Authorizing `identity:get_group(group_id=434d5356b04040299131b9b736f21b87)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:40.537079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80589153-c1f9-4024-a57d-26932b4da90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:40.537558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5976e-cee1-496d-af60-308391dceef3 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:40.538051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80589153-c1f9-4024-a57d-26932b4da90a None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:40.538476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80589153-c1f9-4024-a57d-26932b4da90a None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:40.538901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80589153-c1f9-4024-a57d-26932b4da90a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:40.539175 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 196/384] 10.222.0.39 () {56 vars in 1180 bytes} [Sun Aug 7 00:52:40 2022] GET /identity/v3/groups/434d5356b04040299131b9b736f21b87 => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:40.539988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80589153-c1f9-4024-a57d-26932b4da90a None admin] RBAC: Adding query filter params (group.id=a7eb77ab122d4598bdd7824d9c3de2c1, role.id=695b07606e564668bac7afff4ab6052a, scope.project.id=62e0ba2ccef34e34b7ab3788b1ce6bb8) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:40.540462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80589153-c1f9-4024-a57d-26932b4da90a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:40.542051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80589153-c1f9-4024-a57d-26932b4da90a None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:40.544884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5976e-cee1-496d-af60-308391dceef3 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:40.550636 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 189/385] 10.222.0.39 () {56 vars in 1376 bytes} [Sun Aug 7 00:52:40 2022] GET /identity/v3/role_assignments?group.id=a7eb77ab122d4598bdd7824d9c3de2c1&scope.project.id=62e0ba2ccef34e34b7ab3788b1ce6bb8&role.id=695b07606e564668bac7afff4ab6052a => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:40.582893 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:40.671127 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5976e-cee1-496d-af60-308391dceef3 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:40.707360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7744a-dfe3-4f1d-824b-4cf577f42646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:40.708053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7744a-dfe3-4f1d-824b-4cf577f42646 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:40.708331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7744a-dfe3-4f1d-824b-4cf577f42646 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:40.708749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7744a-dfe3-4f1d-824b-4cf577f42646 None admin] PATH_INFO: `/v3/projects/d48c2e640c56445a9109354f89807e83` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:40.709989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d7744a-dfe3-4f1d-824b-4cf577f42646 None admin] RBAC: Authorizing `identity:get_project(project_id=d48c2e640c56445a9109354f89807e83)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:40.711447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d7744a-dfe3-4f1d-824b-4cf577f42646 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:40.713442 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 197/386] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:40 2022] GET /identity/v3/projects/d48c2e640c56445a9109354f89807e83 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:52:40.719920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80589153-c1f9-4024-a57d-26932b4da90a None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:40.841318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80589153-c1f9-4024-a57d-26932b4da90a None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:40.845887 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:40.882907 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988327ca-1b2c-4dcf-b0dc-1dea828238ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:40.883873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988327ca-1b2c-4dcf-b0dc-1dea828238ed None admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:40.884354 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988327ca-1b2c-4dcf-b0dc-1dea828238ed None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:40.884795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988327ca-1b2c-4dcf-b0dc-1dea828238ed None admin] PATH_INFO: `/v3/projects/d48c2e640c56445a9109354f89807e83/groups/434d5356b04040299131b9b736f21b87/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:40.886973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988327ca-1b2c-4dcf-b0dc-1dea828238ed None admin] RBAC: Authorizing `identity:create_grant(project_id=d48c2e640c56445a9109354f89807e83, group_id=434d5356b04040299131b9b736f21b87, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:40.888699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988327ca-1b2c-4dcf-b0dc-1dea828238ed None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:40.894355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23553931-071e-40d9-a139-016fa0ea8698 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:40.894845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23553931-071e-40d9-a139-016fa0ea8698 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:40.894943 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23553931-071e-40d9-a139-016fa0ea8698 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:40.896757 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 198/387] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:52:40.908219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d07bb-68e0-48d0-86b9-282440854e81 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:40.908835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d07bb-68e0-48d0-86b9-282440854e81 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:40.909194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d07bb-68e0-48d0-86b9-282440854e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:40.912284 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 190/388] 10.222.0.39 () {58 vars in 1442 bytes} [Sun Aug 7 00:52:40 2022] PUT /identity/v3/projects/d48c2e640c56445a9109354f89807e83/groups/434d5356b04040299131b9b736f21b87/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:52:40.936118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-905d07bb-68e0-48d0-86b9-282440854e81 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:40.938325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-905d07bb-68e0-48d0-86b9-282440854e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:41.038108 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 199/389] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:41.076249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988327ca-1b2c-4dcf-b0dc-1dea828238ed None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:41.207513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988327ca-1b2c-4dcf-b0dc-1dea828238ed None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:41.256822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113f6b7-ce67-4b7c-892f-403d260e6c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:41.257845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113f6b7-ce67-4b7c-892f-403d260e6c3e None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:41.258303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113f6b7-ce67-4b7c-892f-403d260e6c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:41.258789 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113f6b7-ce67-4b7c-892f-403d260e6c3e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:41.274587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b113f6b7-ce67-4b7c-892f-403d260e6c3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:41.279848 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-b113f6b7-ce67-4b7c-892f-403d260e6c3e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:52:41.279848 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:41.279848 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:41.279848 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:41.279848 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:41.279848 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:41.279848 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:41.279848 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:41.279848 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:41.279848 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:41.279848 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:41.279848 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:41.279848 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:41.279848 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:41.279848 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:41.279848 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:41.280827 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:41.280827 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:41.280827 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:41.280827 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:41.280827 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:41.280827 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:41.280827 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:41.280827 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:41.280827 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:41.280827 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:41.280827 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:41.280827 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:41.280827 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:41.280827 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:41.280827 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:41.280827 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:41.281708 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:41.281708 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:41.281708 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:41.281708 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:41.281708 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:41.281708 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:41.281708 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:41.281708 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:41.281708 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:41.281708 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:41.281708 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:52:41.281708 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:41.283930 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 191/390] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Aug 7 00:52:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:41.290519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d07bb-68e0-48d0-86b9-282440854e81 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:41.320339 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:41.412807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d07bb-68e0-48d0-86b9-282440854e81 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:41.452190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46801069-aed4-4750-ae2c-41f9db2d7360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:41.452824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46801069-aed4-4750-ae2c-41f9db2d7360 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:41.453178 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46801069-aed4-4750-ae2c-41f9db2d7360 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:41.454010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46801069-aed4-4750-ae2c-41f9db2d7360 None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:41.454706 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46801069-aed4-4750-ae2c-41f9db2d7360 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:41.455007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46801069-aed4-4750-ae2c-41f9db2d7360 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:41.456458 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46801069-aed4-4750-ae2c-41f9db2d7360 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:41.469080 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 200/391] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:52:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:41.477135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113f6b7-ce67-4b7c-892f-403d260e6c3e None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:41.512664 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:41.629917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113f6b7-ce67-4b7c-892f-403d260e6c3e None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:41.669636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0d608-201b-46cb-a680-13d2114504f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:41.670285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0d608-201b-46cb-a680-13d2114504f5 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:41.670563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0d608-201b-46cb-a680-13d2114504f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:41.670836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0d608-201b-46cb-a680-13d2114504f5 None admin] PATH_INFO: `/v3/groups/434d5356b04040299131b9b736f21b87` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:41.672584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e0d608-201b-46cb-a680-13d2114504f5 None admin] RBAC: Authorizing `identity:get_group(group_id=434d5356b04040299131b9b736f21b87)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:41.674115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e0d608-201b-46cb-a680-13d2114504f5 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:41.676163 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 192/392] 10.222.0.39 () {56 vars in 1180 bytes} [Sun Aug 7 00:52:41 2022] GET /identity/v3/groups/434d5356b04040299131b9b736f21b87 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:41.681373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46801069-aed4-4750-ae2c-41f9db2d7360 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:41.805434 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:41.820394 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46801069-aed4-4750-ae2c-41f9db2d7360 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:41.850056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941100f-5fb8-4aab-8044-4ec4103ce340 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:41.850717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941100f-5fb8-4aab-8044-4ec4103ce340 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:41.850874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941100f-5fb8-4aab-8044-4ec4103ce340 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:41.852290 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 193/393] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:52:41.861650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd9de2-a971-4702-a5ab-2b7e2d9f0942 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:41.862065 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd9de2-a971-4702-a5ab-2b7e2d9f0942 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:41.862470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd9de2-a971-4702-a5ab-2b7e2d9f0942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:41.873017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35f976-f57d-44cf-9bcd-e62c3bb9c8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:41.873684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35f976-f57d-44cf-9bcd-e62c3bb9c8fd None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:41.873963 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35f976-f57d-44cf-9bcd-e62c3bb9c8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:41.874236 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35f976-f57d-44cf-9bcd-e62c3bb9c8fd None admin] PATH_INFO: `/v3/projects/d48c2e640c56445a9109354f89807e83` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:41.876793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35f976-f57d-44cf-9bcd-e62c3bb9c8fd None admin] RBAC: Authorizing `identity:get_project(project_id=d48c2e640c56445a9109354f89807e83)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:41.878738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35f976-f57d-44cf-9bcd-e62c3bb9c8fd None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:41.881069 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 201/394] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:41 2022] GET /identity/v3/projects/d48c2e640c56445a9109354f89807e83 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:52:41.886531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35f976-f57d-44cf-9bcd-e62c3bb9c8fd None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:41.896611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f8fd9de2-a971-4702-a5ab-2b7e2d9f0942 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:41.898160 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f8fd9de2-a971-4702-a5ab-2b7e2d9f0942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:42.018877 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 194/395] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:42.090492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35f976-f57d-44cf-9bcd-e62c3bb9c8fd None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:42.108823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd9de2-a971-4702-a5ab-2b7e2d9f0942 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:42.152288 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:42.166354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4837ae-a9c7-4594-a0be-54282652c346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:42.167043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4837ae-a9c7-4594-a0be-54282652c346 None admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:42.167572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4837ae-a9c7-4594-a0be-54282652c346 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:42.167845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4837ae-a9c7-4594-a0be-54282652c346 None admin] PATH_INFO: `/v3/projects/d48c2e640c56445a9109354f89807e83/groups/434d5356b04040299131b9b736f21b87/roles/04a874934a0944a2851b5e485a0f0a1b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:42.172550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4837ae-a9c7-4594-a0be-54282652c346 None admin] RBAC: Authorizing `identity:create_grant(project_id=d48c2e640c56445a9109354f89807e83, group_id=434d5356b04040299131b9b736f21b87, role_id=04a874934a0944a2851b5e485a0f0a1b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:42.174040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4837ae-a9c7-4594-a0be-54282652c346 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:42.208729 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 202/396] 10.222.0.39 () {58 vars in 1442 bytes} [Sun Aug 7 00:52:41 2022] PUT /identity/v3/projects/d48c2e640c56445a9109354f89807e83/groups/434d5356b04040299131b9b736f21b87/roles/04a874934a0944a2851b5e485a0f0a1b => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 00:52:42.276418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760edd5-5f2a-4368-bc3c-a69f6386622a None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:42.277085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760edd5-5f2a-4368-bc3c-a69f6386622a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:42.277580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760edd5-5f2a-4368-bc3c-a69f6386622a None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:42.279402 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 203/397] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:52:42.285996 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4cb9c-8382-4090-978b-4ee82f3ac5c4 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:42.286334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4cb9c-8382-4090-978b-4ee82f3ac5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:42.286642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4cb9c-8382-4090-978b-4ee82f3ac5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:42.291147 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fd9de2-a971-4702-a5ab-2b7e2d9f0942 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:42.329634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1fa4cb9c-8382-4090-978b-4ee82f3ac5c4 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:42.330857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1fa4cb9c-8382-4090-978b-4ee82f3ac5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:42.343262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50234cf6-448a-4992-9329-251bfc5e7a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:42.344447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50234cf6-448a-4992-9329-251bfc5e7a62 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:42.344733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50234cf6-448a-4992-9329-251bfc5e7a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:42.345742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50234cf6-448a-4992-9329-251bfc5e7a62 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:42.350317 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:42.368279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50234cf6-448a-4992-9329-251bfc5e7a62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:42.379733 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-50234cf6-448a-4992-9329-251bfc5e7a62 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:52:42.379733 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:42.379733 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:42.379733 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:42.379733 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:42.379733 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:42.379733 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:42.379733 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:42.379733 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:42.379733 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:42.379733 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:42.379733 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:42.379733 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:42.379733 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:42.379733 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:42.379733 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:42.381495 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:42.381495 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:42.381495 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:42.381495 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:42.381495 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:42.381495 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:42.381495 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:42.381495 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:42.381495 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:42.381495 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:42.381495 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:42.381495 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:42.381495 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:42.381495 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:42.381495 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:42.381495 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:42.382971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:42.382971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:42.382971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:42.382971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:42.382971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:42.382971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:42.382971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:42.382971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:42.382971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:42.382971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:42.382971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:52:42.382971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:42.384569 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 195/398] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:42.403699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50234cf6-448a-4992-9329-251bfc5e7a62 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:42.470119 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 204/399] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:52:42.498297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4cb9c-8382-4090-978b-4ee82f3ac5c4 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:42.540366 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:42.563088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50234cf6-448a-4992-9329-251bfc5e7a62 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:42.605272 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36191aba-5871-4533-bbeb-01a4dafb6035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:42.606063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36191aba-5871-4533-bbeb-01a4dafb6035 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:42.606441 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36191aba-5871-4533-bbeb-01a4dafb6035 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:42.606810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36191aba-5871-4533-bbeb-01a4dafb6035 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:42.607703 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36191aba-5871-4533-bbeb-01a4dafb6035 None admin] RBAC: Adding query filter params (name=member) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:42.608145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36191aba-5871-4533-bbeb-01a4dafb6035 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:42.610246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36191aba-5871-4533-bbeb-01a4dafb6035 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:42.621039 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 196/400] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Aug 7 00:52:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:52:42.633540 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36191aba-5871-4533-bbeb-01a4dafb6035 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:42.681220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4cb9c-8382-4090-978b-4ee82f3ac5c4 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:42.718831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4783dca-b750-4940-b776-acf72cfed1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:42.719467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4783dca-b750-4940-b776-acf72cfed1ae None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:42.719747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4783dca-b750-4940-b776-acf72cfed1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:42.720068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4783dca-b750-4940-b776-acf72cfed1ae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:42.730942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4783dca-b750-4940-b776-acf72cfed1ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:42.736276 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-b4783dca-b750-4940-b776-acf72cfed1ae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:52:42.736276 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:42.736276 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:42.736276 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:42.736276 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:42.736276 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:42.736276 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:42.736276 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:42.736276 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:42.736276 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:42.736276 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:42.736276 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:42.736276 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:42.736276 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:42.736276 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:42.736276 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:42.737202 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:42.737202 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:42.737202 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:42.737202 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:42.737202 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:42.737202 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:42.737202 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:42.737202 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:42.737202 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:42.737202 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:42.737202 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:42.737202 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:42.737202 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:42.737202 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:42.737202 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:42.737202 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:42.738003 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:42.738003 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:42.738003 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:42.738003 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:42.738003 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:42.738003 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:42.738003 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:42.738003 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:42.738003 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:42.738003 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:42.738003 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:52:42.738003 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:52:42.738003 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 205/401] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Aug 7 00:52:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:52:42.745129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4783dca-b750-4940-b776-acf72cfed1ae None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:42.761865 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:42.851428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36191aba-5871-4533-bbeb-01a4dafb6035 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:42.918011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcc850-b631-456c-9b60-949fdb0b39e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:42.919041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcc850-b631-456c-9b60-949fdb0b39e1 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:42.919523 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcc850-b631-456c-9b60-949fdb0b39e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:42.920082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcc850-b631-456c-9b60-949fdb0b39e1 None admin] PATH_INFO: `/v3/groups/434d5356b04040299131b9b736f21b87` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:42.924277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dcc850-b631-456c-9b60-949fdb0b39e1 None admin] RBAC: Authorizing `identity:get_group(group_id=434d5356b04040299131b9b736f21b87)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:42.925993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dcc850-b631-456c-9b60-949fdb0b39e1 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:42.929518 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 197/402] 10.222.0.39 () {56 vars in 1180 bytes} [Sun Aug 7 00:52:42 2022] GET /identity/v3/groups/434d5356b04040299131b9b736f21b87 => generated 226 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:52:42.935656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcc850-b631-456c-9b60-949fdb0b39e1 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:42.967601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4783dca-b750-4940-b776-acf72cfed1ae None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:42.969698 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:43.015586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f09191-5293-4373-894a-2120f3aa2ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:43.017174 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f09191-5293-4373-894a-2120f3aa2ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:43.017706 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f09191-5293-4373-894a-2120f3aa2ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:43.018215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f09191-5293-4373-894a-2120f3aa2ad9 None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:43.019098 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f09191-5293-4373-894a-2120f3aa2ad9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:43.019607 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f09191-5293-4373-894a-2120f3aa2ad9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:43.026889 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f09191-5293-4373-894a-2120f3aa2ad9 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:43.040699 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 206/403] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:52:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:43.046398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f09191-5293-4373-894a-2120f3aa2ad9 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:43.124152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcc850-b631-456c-9b60-949fdb0b39e1 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:43.173184 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:43.198509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac7565-32ac-4fc6-9731-696678f6b706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:43.199168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac7565-32ac-4fc6-9731-696678f6b706 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:43.199466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac7565-32ac-4fc6-9731-696678f6b706 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:43.199697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac7565-32ac-4fc6-9731-696678f6b706 None admin] PATH_INFO: `/v3/projects/2388c261a2d64686b83675d2cd97701c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:43.201091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac7565-32ac-4fc6-9731-696678f6b706 None admin] RBAC: Authorizing `identity:get_project(project_id=2388c261a2d64686b83675d2cd97701c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:43.202563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac7565-32ac-4fc6-9731-696678f6b706 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:43.205379 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 198/404] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:42 2022] GET /identity/v3/projects/2388c261a2d64686b83675d2cd97701c => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:43.211061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac7565-32ac-4fc6-9731-696678f6b706 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:43.246705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f09191-5293-4373-894a-2120f3aa2ad9 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:43.315069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623ed7f-c926-487f-a296-460950c832f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:43.316261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623ed7f-c926-487f-a296-460950c832f0 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:43.316750 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623ed7f-c926-487f-a296-460950c832f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:43.317359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623ed7f-c926-487f-a296-460950c832f0 None admin] PATH_INFO: `/v3/groups/434d5356b04040299131b9b736f21b87` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:43.324794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7623ed7f-c926-487f-a296-460950c832f0 None admin] RBAC: Authorizing `identity:get_group(group_id=434d5356b04040299131b9b736f21b87)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:43.326742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7623ed7f-c926-487f-a296-460950c832f0 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:43.329792 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 207/405] 10.222.0.39 () {56 vars in 1180 bytes} [Sun Aug 7 00:52:43 2022] GET /identity/v3/groups/434d5356b04040299131b9b736f21b87 => generated 226 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:43.336127 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623ed7f-c926-487f-a296-460950c832f0 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:43.337847 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:43.370391 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac7565-32ac-4fc6-9731-696678f6b706 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:43.445797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c564ded-45f3-4fd8-920c-b5cd82187ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:43.446817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c564ded-45f3-4fd8-920c-b5cd82187ad1 None admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:43.447297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c564ded-45f3-4fd8-920c-b5cd82187ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:43.447802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c564ded-45f3-4fd8-920c-b5cd82187ad1 None admin] PATH_INFO: `/v3/projects/2388c261a2d64686b83675d2cd97701c/groups/434d5356b04040299131b9b736f21b87/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:43.450189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c564ded-45f3-4fd8-920c-b5cd82187ad1 None admin] RBAC: Authorizing `identity:create_grant(project_id=2388c261a2d64686b83675d2cd97701c, group_id=434d5356b04040299131b9b736f21b87, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:43.452029 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c564ded-45f3-4fd8-920c-b5cd82187ad1 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:43.471318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623ed7f-c926-487f-a296-460950c832f0 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:43.484277 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 199/406] 10.222.0.39 () {58 vars in 1442 bytes} [Sun Aug 7 00:52:43 2022] PUT /identity/v3/projects/2388c261a2d64686b83675d2cd97701c/groups/434d5356b04040299131b9b736f21b87/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:52:43.512839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e2d00-2e49-49f0-8d6a-3d2f107fdda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:43.513814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e2d00-2e49-49f0-8d6a-3d2f107fdda8 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:43.514298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e2d00-2e49-49f0-8d6a-3d2f107fdda8 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:43.514714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e2d00-2e49-49f0-8d6a-3d2f107fdda8 None admin] PATH_INFO: `/v3/projects/2388c261a2d64686b83675d2cd97701c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:43.516282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e2d00-2e49-49f0-8d6a-3d2f107fdda8 None admin] RBAC: Authorizing `identity:get_project(project_id=2388c261a2d64686b83675d2cd97701c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:43.518019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e2d00-2e49-49f0-8d6a-3d2f107fdda8 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:43.520406 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 208/407] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:43 2022] GET /identity/v3/projects/2388c261a2d64686b83675d2cd97701c => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:43.526644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c564ded-45f3-4fd8-920c-b5cd82187ad1 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:43.668456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c564ded-45f3-4fd8-920c-b5cd82187ad1 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:43.704351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7819003-745d-4847-9927-b72cba77dee5 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:43.704950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7819003-745d-4847-9927-b72cba77dee5 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:43.705421 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7819003-745d-4847-9927-b72cba77dee5 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:43.707038 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 209/408] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:52:43.713855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9b380-a601-4813-9870-1092f8962fad None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:43.714214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9b380-a601-4813-9870-1092f8962fad None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:43.714494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9b380-a601-4813-9870-1092f8962fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:43.714767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba36d71-8365-43fd-8c4c-a7229889b8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:43.715459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba36d71-8365-43fd-8c4c-a7229889b8f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:43.715737 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba36d71-8365-43fd-8c4c-a7229889b8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:43.716061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba36d71-8365-43fd-8c4c-a7229889b8f8 None admin] PATH_INFO: `/v3/projects/2388c261a2d64686b83675d2cd97701c/groups/434d5356b04040299131b9b736f21b87/roles/04a874934a0944a2851b5e485a0f0a1b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:43.718244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba36d71-8365-43fd-8c4c-a7229889b8f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=2388c261a2d64686b83675d2cd97701c, group_id=434d5356b04040299131b9b736f21b87, role_id=04a874934a0944a2851b5e485a0f0a1b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:43.719750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba36d71-8365-43fd-8c4c-a7229889b8f8 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:43.730790 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:43.731255 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:43.738719 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 200/409] 10.222.0.39 () {58 vars in 1442 bytes} [Sun Aug 7 00:52:43 2022] PUT /identity/v3/projects/2388c261a2d64686b83675d2cd97701c/groups/434d5356b04040299131b9b736f21b87/roles/04a874934a0944a2851b5e485a0f0a1b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:52:43.752556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ffb9b380-a601-4813-9870-1092f8962fad None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:43.753739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ffb9b380-a601-4813-9870-1092f8962fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:43.862173 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 210/410] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:52:43.903162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba36d71-8365-43fd-8c4c-a7229889b8f8 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:43.950857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296b1ef-3626-4ad2-9e9b-a023e158dd34 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:43.951491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296b1ef-3626-4ad2-9e9b-a023e158dd34 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:43.951987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296b1ef-3626-4ad2-9e9b-a023e158dd34 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:43.954517 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 211/411] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:52:43.960793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79764b-af20-48c1-bfd9-0613cac66f1f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:43.964595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79764b-af20-48c1-bfd9-0613cac66f1f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:43.965179 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79764b-af20-48c1-bfd9-0613cac66f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:43.995994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2b79764b-af20-48c1-bfd9-0613cac66f1f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:43.997194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2b79764b-af20-48c1-bfd9-0613cac66f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:44.087755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba36d71-8365-43fd-8c4c-a7229889b8f8 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:44.130607 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 212/412] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:52:44.131336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b054dd-b609-4531-9fee-83fe6b9f0ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:44.132321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b054dd-b609-4531-9fee-83fe6b9f0ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:44.132801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b054dd-b609-4531-9fee-83fe6b9f0ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:44.133267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b054dd-b609-4531-9fee-83fe6b9f0ad6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:44.145724 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b054dd-b609-4531-9fee-83fe6b9f0ad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:44.152969 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-c1b054dd-b609-4531-9fee-83fe6b9f0ad6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:52:44.152969 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:44.152969 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:44.152969 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:44.152969 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:44.152969 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:44.152969 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:44.152969 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:44.152969 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:44.152969 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:44.152969 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:44.152969 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:44.152969 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:44.152969 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:44.152969 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:44.152969 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:44.154048 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:44.154048 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:44.154048 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:44.154048 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:44.154048 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:44.154048 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:44.154048 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:44.154048 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:44.154048 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:44.154048 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:44.154048 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:44.154048 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:44.154048 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:44.154048 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:44.154048 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:44.154048 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:44.154986 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:44.154986 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:44.154986 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:44.154986 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:44.154986 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:44.154986 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:44.154986 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:44.154986 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:44.154986 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:44.154986 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:44.154986 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:52:44.154986 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:44.158716 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 201/413] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:52:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:44.164724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79764b-af20-48c1-bfd9-0613cac66f1f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:44.166191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b054dd-b609-4531-9fee-83fe6b9f0ad6 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:44.238513 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:44.288251 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:44.299551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b054dd-b609-4531-9fee-83fe6b9f0ad6 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:44.369347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79764b-af20-48c1-bfd9-0613cac66f1f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:44.382318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4c4b8-b5ba-43ac-93f3-342bd3abcfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:44.382947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4c4b8-b5ba-43ac-93f3-342bd3abcfa6 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:44.383225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4c4b8-b5ba-43ac-93f3-342bd3abcfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:44.383493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4c4b8-b5ba-43ac-93f3-342bd3abcfa6 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:44.384202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4c4b8-b5ba-43ac-93f3-342bd3abcfa6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:44.384501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4c4b8-b5ba-43ac-93f3-342bd3abcfa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:44.385893 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4c4b8-b5ba-43ac-93f3-342bd3abcfa6 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:44.396614 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 202/414] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:44.404825 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4c4b8-b5ba-43ac-93f3-342bd3abcfa6 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:44.449579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90566570-c836-45d9-b606-14ca812841c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:44.450233 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90566570-c836-45d9-b606-14ca812841c6 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:44.450512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90566570-c836-45d9-b606-14ca812841c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:44.450778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90566570-c836-45d9-b606-14ca812841c6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:44.474368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90566570-c836-45d9-b606-14ca812841c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:44.480099 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-90566570-c836-45d9-b606-14ca812841c6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:52:44.480099 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:44.480099 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:44.480099 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:44.480099 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:44.480099 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:44.480099 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:44.480099 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:44.480099 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:44.480099 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:44.480099 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:44.480099 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:44.480099 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:44.480099 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:44.480099 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:44.480099 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:44.481067 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:44.481067 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:44.481067 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:44.481067 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:44.481067 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:44.481067 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:44.481067 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:44.481067 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:44.481067 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:44.481067 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:44.481067 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:44.481067 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:44.481067 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:44.481067 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:44.481067 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:44.481067 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:44.482072 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:44.482072 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:44.482072 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:44.482072 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:44.482072 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:44.482072 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:44.482072 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:44.482072 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:44.482072 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:44.482072 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:44.482072 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:52:44.482072 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:52:44.482072 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 213/415] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:44.496139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90566570-c836-45d9-b606-14ca812841c6 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:44.624472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90566570-c836-45d9-b606-14ca812841c6 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:44.646081 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4c4b8-b5ba-43ac-93f3-342bd3abcfa6 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:44.651947 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:44.676307 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fad72a-8f63-45f2-a58a-3ffb1b901de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:44.677977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fad72a-8f63-45f2-a58a-3ffb1b901de5 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:44.678299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fad72a-8f63-45f2-a58a-3ffb1b901de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:44.678569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fad72a-8f63-45f2-a58a-3ffb1b901de5 None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:44.679264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fad72a-8f63-45f2-a58a-3ffb1b901de5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:44.679570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fad72a-8f63-45f2-a58a-3ffb1b901de5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:44.680993 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fad72a-8f63-45f2-a58a-3ffb1b901de5 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:44.699403 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:44.708766 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 214/416] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Aug 7 00:52:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:44.712336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fad72a-8f63-45f2-a58a-3ffb1b901de5 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:44.725905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4f85d-b0db-4d15-8c0a-a45eb997d2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:44.726650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4f85d-b0db-4d15-8c0a-a45eb997d2c4 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:44.726987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4f85d-b0db-4d15-8c0a-a45eb997d2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:44.727318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4f85d-b0db-4d15-8c0a-a45eb997d2c4 None admin] PATH_INFO: `/v3/groups/a7eb77ab122d4598bdd7824d9c3de2c1` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:44.732649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4f85d-b0db-4d15-8c0a-a45eb997d2c4 None admin] RBAC: Authorizing `identity:get_group(group_id=a7eb77ab122d4598bdd7824d9c3de2c1)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:44.734914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4f85d-b0db-4d15-8c0a-a45eb997d2c4 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:44.737057 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 203/417] 10.222.0.39 () {56 vars in 1180 bytes} [Sun Aug 7 00:52:44 2022] GET /identity/v3/groups/a7eb77ab122d4598bdd7824d9c3de2c1 => generated 229 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:44.743291 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4f85d-b0db-4d15-8c0a-a45eb997d2c4 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:44.893264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fad72a-8f63-45f2-a58a-3ffb1b901de5 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:44.946972 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4f85d-b0db-4d15-8c0a-a45eb997d2c4 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:44.977012 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29e335-0807-4f34-8622-17d3c8f79567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:44.977635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29e335-0807-4f34-8622-17d3c8f79567 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:44.977916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29e335-0807-4f34-8622-17d3c8f79567 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:44.978190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29e335-0807-4f34-8622-17d3c8f79567 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:45.017844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18720b98-483e-4620-ac16-8cbade1e16c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:45.018877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18720b98-483e-4620-ac16-8cbade1e16c8 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:45.019349 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18720b98-483e-4620-ac16-8cbade1e16c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:45.019814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18720b98-483e-4620-ac16-8cbade1e16c8 None admin] PATH_INFO: `/v3/projects/62e0ba2ccef34e34b7ab3788b1ce6bb8` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:45.021177 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18720b98-483e-4620-ac16-8cbade1e16c8 None admin] RBAC: Authorizing `identity:get_project(project_id=62e0ba2ccef34e34b7ab3788b1ce6bb8)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:45.023313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18720b98-483e-4620-ac16-8cbade1e16c8 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:45.025340 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 204/418] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:44 2022] GET /identity/v3/projects/62e0ba2ccef34e34b7ab3788b1ce6bb8 => generated 344 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:52:45.031723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bf813-a6a2-42a8-86f5-5d12ece39b9c None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:45.032802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bf813-a6a2-42a8-86f5-5d12ece39b9c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:45.033591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bf813-a6a2-42a8-86f5-5d12ece39b9c None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:45.036481 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 205/419] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:45 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:45.037765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bf813-a6a2-42a8-86f5-5d12ece39b9c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:45.057234 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:45.076895 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c29e335-0807-4f34-8622-17d3c8f79567 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:45.078759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c29e335-0807-4f34-8622-17d3c8f79567 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:45.110113 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:45.165594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bf813-a6a2-42a8-86f5-5d12ece39b9c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:45.198688 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 215/420] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:52:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:52:45.200385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a47da5-7fef-4dc7-a9fd-1c1183e63d16 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:45.200734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a47da5-7fef-4dc7-a9fd-1c1183e63d16 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:45.201062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a47da5-7fef-4dc7-a9fd-1c1183e63d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:45.205382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b13d0-3e44-4de8-b290-ca62de729d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:45.206330 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b13d0-3e44-4de8-b290-ca62de729d40 None admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:45.206848 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b13d0-3e44-4de8-b290-ca62de729d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:45.207534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b13d0-3e44-4de8-b290-ca62de729d40 None admin] PATH_INFO: `/v3/projects/62e0ba2ccef34e34b7ab3788b1ce6bb8/groups/a7eb77ab122d4598bdd7824d9c3de2c1/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:45.210852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b13d0-3e44-4de8-b290-ca62de729d40 None admin] RBAC: Authorizing `identity:create_grant(project_id=62e0ba2ccef34e34b7ab3788b1ce6bb8, group_id=a7eb77ab122d4598bdd7824d9c3de2c1, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:45.212572 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b13d0-3e44-4de8-b290-ca62de729d40 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:45.220932 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c1a47da5-7fef-4dc7-a9fd-1c1183e63d16 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:45.222114 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c1a47da5-7fef-4dc7-a9fd-1c1183e63d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:45.229117 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 206/421] 10.222.0.39 () {58 vars in 1442 bytes} [Sun Aug 7 00:52:45 2022] PUT /identity/v3/projects/62e0ba2ccef34e34b7ab3788b1ce6bb8/groups/a7eb77ab122d4598bdd7824d9c3de2c1/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 00:52:45.238299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b13d0-3e44-4de8-b290-ca62de729d40 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:45.305943 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 216/422] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:45.331463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a47da5-7fef-4dc7-a9fd-1c1183e63d16 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:45.368150 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:45.436612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b13d0-3e44-4de8-b290-ca62de729d40 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:45.472834 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:45.504932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a48af1-b327-4c78-8d25-bfc1cc3f4f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:45.505576 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a48af1-b327-4c78-8d25-bfc1cc3f4f68 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:45.505849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a48af1-b327-4c78-8d25-bfc1cc3f4f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:45.506127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a48af1-b327-4c78-8d25-bfc1cc3f4f68 None admin] PATH_INFO: `/v3/projects/d48c2e640c56445a9109354f89807e83` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:45.507268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a48af1-b327-4c78-8d25-bfc1cc3f4f68 None admin] RBAC: Authorizing `identity:get_project(project_id=d48c2e640c56445a9109354f89807e83)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:45.509356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a48af1-b327-4c78-8d25-bfc1cc3f4f68 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:45.511807 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 207/423] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:45 2022] GET /identity/v3/projects/d48c2e640c56445a9109354f89807e83 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:45.519391 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a48af1-b327-4c78-8d25-bfc1cc3f4f68 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:45.570546 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a47da5-7fef-4dc7-a9fd-1c1183e63d16 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:45.646755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ea393-dc4d-44b8-93a4-f49caedee5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:45.649570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ea393-dc4d-44b8-93a4-f49caedee5b7 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:45.650555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ea393-dc4d-44b8-93a4-f49caedee5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:45.651268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ea393-dc4d-44b8-93a4-f49caedee5b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:45.669622 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7ea393-dc4d-44b8-93a4-f49caedee5b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:45.676241 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-af7ea393-dc4d-44b8-93a4-f49caedee5b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:52:45.676241 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:45.676241 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:45.676241 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:45.676241 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:45.676241 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:45.676241 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:45.676241 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:45.676241 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:45.676241 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:45.676241 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:45.676241 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:45.676241 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:45.676241 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:45.676241 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:45.676241 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:45.677435 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:45.677435 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:45.677435 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:45.677435 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:45.677435 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:45.677435 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:45.677435 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:45.677435 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:45.677435 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:45.677435 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:45.677435 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:45.677435 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:45.677435 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:45.677435 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:45.677435 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:45.677435 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:45.678556 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:45.678556 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:45.678556 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:45.678556 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:45.678556 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:45.678556 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:45.678556 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:45.678556 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:45.678556 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:45.678556 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:45.678556 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:52:45.678556 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:52:45.681914 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 217/424] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Aug 7 00:52:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:52:45.689530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ea393-dc4d-44b8-93a4-f49caedee5b7 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:45.739160 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a48af1-b327-4c78-8d25-bfc1cc3f4f68 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:45.809957 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:45.828740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc73da-e763-43fd-bed9-12120f3d9257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:45.829386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc73da-e763-43fd-bed9-12120f3d9257 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:45.829661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc73da-e763-43fd-bed9-12120f3d9257 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:45.829930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc73da-e763-43fd-bed9-12120f3d9257 None admin] PATH_INFO: `/v3/groups/434d5356b04040299131b9b736f21b87` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:45.832607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc73da-e763-43fd-bed9-12120f3d9257 None admin] RBAC: Authorizing `identity:get_group(group_id=434d5356b04040299131b9b736f21b87)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:45.834088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc73da-e763-43fd-bed9-12120f3d9257 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:45.836906 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 208/425] 10.222.0.39 () {56 vars in 1180 bytes} [Sun Aug 7 00:52:45 2022] GET /identity/v3/groups/434d5356b04040299131b9b736f21b87 => generated 226 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:45.842983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127909e-cdbd-4c94-a69b-b22141aa5287 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:45.844186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ea393-dc4d-44b8-93a4-f49caedee5b7 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:45.844685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127909e-cdbd-4c94-a69b-b22141aa5287 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:45.845433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127909e-cdbd-4c94-a69b-b22141aa5287 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:45.852793 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 209/426] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:45.854505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127909e-cdbd-4c94-a69b-b22141aa5287 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:45.899193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5cc71-4de9-4c7b-84b3-3194c84948d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:45.902099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5cc71-4de9-4c7b-84b3-3194c84948d6 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:45.902411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5cc71-4de9-4c7b-84b3-3194c84948d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:45.902688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5cc71-4de9-4c7b-84b3-3194c84948d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:45.903399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5cc71-4de9-4c7b-84b3-3194c84948d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:45.903703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5cc71-4de9-4c7b-84b3-3194c84948d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:45.905552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5cc71-4de9-4c7b-84b3-3194c84948d6 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:45.918358 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 218/427] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:52:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:45.919930 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9916b-1a79-4106-93f9-fd5060e593ff None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:45.920222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9916b-1a79-4106-93f9-fd5060e593ff None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:45.920510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9916b-1a79-4106-93f9-fd5060e593ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:45.946021 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-15c9916b-1a79-4106-93f9-fd5060e593ff None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:45.947357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-15c9916b-1a79-4106-93f9-fd5060e593ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:45.957772 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:46.037717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127909e-cdbd-4c94-a69b-b22141aa5287 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:46.064292 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 219/428] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:46.064292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9916b-1a79-4106-93f9-fd5060e593ff None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:46.092575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cbdfd-795e-41b2-a860-5358883ba854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:46.093247 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cbdfd-795e-41b2-a860-5358883ba854 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:46.093528 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cbdfd-795e-41b2-a860-5358883ba854 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:46.093840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389cbdfd-795e-41b2-a860-5358883ba854 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:46.094578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389cbdfd-795e-41b2-a860-5358883ba854 None admin] RBAC: Adding query filter params (group.id=434d5356b04040299131b9b736f21b87, role.id=979b0708a1934c50b706215aa79dbb7a, scope.project.id=d48c2e640c56445a9109354f89807e83) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:46.094943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389cbdfd-795e-41b2-a860-5358883ba854 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:46.096511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389cbdfd-795e-41b2-a860-5358883ba854 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:46.103343 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 210/429] 10.222.0.39 () {56 vars in 1376 bytes} [Sun Aug 7 00:52:45 2022] GET /identity/v3/role_assignments?group.id=434d5356b04040299131b9b736f21b87&scope.project.id=d48c2e640c56445a9109354f89807e83&role.id=979b0708a1934c50b706215aa79dbb7a => generated 611 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:46.108406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cbdfd-795e-41b2-a860-5358883ba854 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:46.165892 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:46.211103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9916b-1a79-4106-93f9-fd5060e593ff None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:46.255978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86237559-9f82-42d5-b0ef-6b79a5f2057f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:46.256954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86237559-9f82-42d5-b0ef-6b79a5f2057f None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:46.257437 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86237559-9f82-42d5-b0ef-6b79a5f2057f None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:46.257922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86237559-9f82-42d5-b0ef-6b79a5f2057f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:46.284428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389cbdfd-795e-41b2-a860-5358883ba854 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:46.328888 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:46.358224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d93056-6aba-4909-b9aa-117c995b7a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:46.359031 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d93056-6aba-4909-b9aa-117c995b7a16 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:46.359413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d93056-6aba-4909-b9aa-117c995b7a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:46.359723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d93056-6aba-4909-b9aa-117c995b7a16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:46.363811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86237559-9f82-42d5-b0ef-6b79a5f2057f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:46.366542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86237559-9f82-42d5-b0ef-6b79a5f2057f None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:46.374333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d93056-6aba-4909-b9aa-117c995b7a16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:46.382053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-82d93056-6aba-4909-b9aa-117c995b7a16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:52:46.382053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:46.382053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:46.382053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:46.382053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:46.382053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:46.382053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:46.382053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:46.382053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:46.382053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:46.382053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:46.382053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:46.382053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:46.382053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:46.382053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:46.382053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:46.383156 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:46.383156 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:46.383156 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:46.383156 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:46.383156 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:46.383156 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:46.383156 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:46.383156 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:46.383156 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:46.383156 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:46.383156 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:46.383156 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:46.383156 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:46.383156 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:46.383156 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:46.383156 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:46.384142 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:46.384142 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:46.384142 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:46.384142 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:46.384142 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:46.384142 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:46.384142 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:46.384142 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:46.384142 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:46.384142 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:46.384142 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 07 00:52:46.384142 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:46.384142 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 211/430] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:46.384809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b18e7f-c454-4618-8b2a-c73c6d62ea22 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:46.384809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b18e7f-c454-4618-8b2a-c73c6d62ea22 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:46.384925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b18e7f-c454-4618-8b2a-c73c6d62ea22 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:46.391313 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 212/431] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:46.391313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b18e7f-c454-4618-8b2a-c73c6d62ea22 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:46.486072 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:46.539923 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 220/432] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:52:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:52:46.539923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47161bc-2705-4f6c-895c-b6fb6a18f9c1 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:46.539923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47161bc-2705-4f6c-895c-b6fb6a18f9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:46.539923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47161bc-2705-4f6c-895c-b6fb6a18f9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:46.555828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b18e7f-c454-4618-8b2a-c73c6d62ea22 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:46.563560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c47161bc-2705-4f6c-895c-b6fb6a18f9c1 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:46.565832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c47161bc-2705-4f6c-895c-b6fb6a18f9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:46.604246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee1c7f-57e2-4b98-801e-4840ae1c7c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:46.605370 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee1c7f-57e2-4b98-801e-4840ae1c7c65 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:46.605925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee1c7f-57e2-4b98-801e-4840ae1c7c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:46.606382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee1c7f-57e2-4b98-801e-4840ae1c7c65 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:46.607426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee1c7f-57e2-4b98-801e-4840ae1c7c65 None admin] RBAC: Adding query filter params (name=member) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:46.608338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee1c7f-57e2-4b98-801e-4840ae1c7c65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:46.610944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee1c7f-57e2-4b98-801e-4840ae1c7c65 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:46.622434 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 213/433] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Aug 7 00:52:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:46.623366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee1c7f-57e2-4b98-801e-4840ae1c7c65 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:46.681176 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 221/434] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:46.682107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47161bc-2705-4f6c-895c-b6fb6a18f9c1 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:46.705877 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:46.793071 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:46.801559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47161bc-2705-4f6c-895c-b6fb6a18f9c1 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:46.802660 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee1c7f-57e2-4b98-801e-4840ae1c7c65 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:46.841839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f3c4d-676d-49d3-8835-75a184a5a662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:46.842446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f3c4d-676d-49d3-8835-75a184a5a662 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:46.842724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f3c4d-676d-49d3-8835-75a184a5a662 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:46.842914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d753e14-6087-4208-90fc-0b4207795a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:46.843028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f3c4d-676d-49d3-8835-75a184a5a662 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:46.843807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d753e14-6087-4208-90fc-0b4207795a1d None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:46.844019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d753e14-6087-4208-90fc-0b4207795a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:46.844356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d753e14-6087-4208-90fc-0b4207795a1d None admin] PATH_INFO: `/v3/projects/d48c2e640c56445a9109354f89807e83` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:46.845495 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d753e14-6087-4208-90fc-0b4207795a1d None admin] RBAC: Authorizing `identity:get_project(project_id=d48c2e640c56445a9109354f89807e83)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:46.847583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d753e14-6087-4208-90fc-0b4207795a1d None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:46.849419 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 214/435] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:46 2022] GET /identity/v3/projects/d48c2e640c56445a9109354f89807e83 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:46.853412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d753e14-6087-4208-90fc-0b4207795a1d None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:46.919903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f3c4d-676d-49d3-8835-75a184a5a662 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:46.921485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f3c4d-676d-49d3-8835-75a184a5a662 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:46.974257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d753e14-6087-4208-90fc-0b4207795a1d None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:46.986587 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:47.014460 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e214a-2f38-45b5-bcf0-8ec0f68ac1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:47.015461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e214a-2f38-45b5-bcf0-8ec0f68ac1f8 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:47.015741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e214a-2f38-45b5-bcf0-8ec0f68ac1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:47.016107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e214a-2f38-45b5-bcf0-8ec0f68ac1f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:47.027616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e214a-2f38-45b5-bcf0-8ec0f68ac1f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:47.032643 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-5b8e214a-2f38-45b5-bcf0-8ec0f68ac1f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:52:47.032643 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:47.032643 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:47.032643 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:47.032643 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:47.032643 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:47.032643 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:47.032643 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:47.032643 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:47.032643 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:47.032643 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:47.032643 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:47.032643 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:47.032643 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:47.032643 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:47.032643 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:47.033608 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:47.033608 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:47.033608 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:47.033608 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:47.033608 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:47.033608 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:47.033608 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:47.033608 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:47.033608 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:47.033608 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:47.033608 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:47.033608 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:47.033608 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:47.033608 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:47.033608 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:47.033608 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:47.034536 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:47.034536 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:47.034536 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:47.034536 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:47.034536 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:47.034536 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:47.034536 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:47.034536 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:47.034536 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:47.034536 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:47.034536 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:52:47.034536 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:47.034536 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 215/436] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Aug 7 00:52:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:47.035233 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e214a-2f38-45b5-bcf0-8ec0f68ac1f8 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:47.036097 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:47.052764 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 222/437] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:52:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:52:47.052764 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f3c4d-676d-49d3-8835-75a184a5a662 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:47.156541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e214a-2f38-45b5-bcf0-8ec0f68ac1f8 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:47.165950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f3c4d-676d-49d3-8835-75a184a5a662 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:47.198738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322d20a-744c-45d7-8f86-7fcf6ed95032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:47.200009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322d20a-744c-45d7-8f86-7fcf6ed95032 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:47.200468 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322d20a-744c-45d7-8f86-7fcf6ed95032 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:47.200915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322d20a-744c-45d7-8f86-7fcf6ed95032 None admin] PATH_INFO: `/v3/groups/434d5356b04040299131b9b736f21b87` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:47.202249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6322d20a-744c-45d7-8f86-7fcf6ed95032 None admin] RBAC: Authorizing `identity:get_group(group_id=434d5356b04040299131b9b736f21b87)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:47.204056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6322d20a-744c-45d7-8f86-7fcf6ed95032 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:47.206491 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 216/438] 10.222.0.39 () {56 vars in 1180 bytes} [Sun Aug 7 00:52:47 2022] GET /identity/v3/groups/434d5356b04040299131b9b736f21b87 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:47.207583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322d20a-744c-45d7-8f86-7fcf6ed95032 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:47.227327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9476e-e5da-4a9b-8e1e-065e81d95aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:47.228361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9476e-e5da-4a9b-8e1e-065e81d95aec None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:47.228827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9476e-e5da-4a9b-8e1e-065e81d95aec None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:47.229305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9476e-e5da-4a9b-8e1e-065e81d95aec None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:47.230463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9476e-e5da-4a9b-8e1e-065e81d95aec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:47.230992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9476e-e5da-4a9b-8e1e-065e81d95aec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:47.233584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9476e-e5da-4a9b-8e1e-065e81d95aec None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:47.247960 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 223/439] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:52:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:47.249403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9476e-e5da-4a9b-8e1e-065e81d95aec None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:47.255334 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:47.326307 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:47.334366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322d20a-744c-45d7-8f86-7fcf6ed95032 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:47.373610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9476e-e5da-4a9b-8e1e-065e81d95aec None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:47.377311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed7738-6ca2-4f71-8c25-c68bb32b3a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:47.377311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed7738-6ca2-4f71-8c25-c68bb32b3a3a None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:47.377671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed7738-6ca2-4f71-8c25-c68bb32b3a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:47.377798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed7738-6ca2-4f71-8c25-c68bb32b3a3a None admin] PATH_INFO: `/v3/projects/2388c261a2d64686b83675d2cd97701c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:47.378908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed7738-6ca2-4f71-8c25-c68bb32b3a3a None admin] RBAC: Authorizing `identity:get_project(project_id=2388c261a2d64686b83675d2cd97701c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:47.380440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed7738-6ca2-4f71-8c25-c68bb32b3a3a None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:47.386721 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 217/440] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:47 2022] GET /identity/v3/projects/2388c261a2d64686b83675d2cd97701c => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:47.386721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed7738-6ca2-4f71-8c25-c68bb32b3a3a None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:47.418191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a00f69-60a7-4ca6-a0dc-db65f2943af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:47.418799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a00f69-60a7-4ca6-a0dc-db65f2943af6 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:47.419074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a00f69-60a7-4ca6-a0dc-db65f2943af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:47.419389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a00f69-60a7-4ca6-a0dc-db65f2943af6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:47.420156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a00f69-60a7-4ca6-a0dc-db65f2943af6 None admin] RBAC: Adding query filter params (group.id=434d5356b04040299131b9b736f21b87, role.id=04a874934a0944a2851b5e485a0f0a1b, scope.project.id=d48c2e640c56445a9109354f89807e83) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:47.420464 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a00f69-60a7-4ca6-a0dc-db65f2943af6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:47.422086 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a00f69-60a7-4ca6-a0dc-db65f2943af6 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:47.429192 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 224/441] 10.222.0.39 () {56 vars in 1376 bytes} [Sun Aug 7 00:52:47 2022] GET /identity/v3/role_assignments?group.id=434d5356b04040299131b9b736f21b87&scope.project.id=d48c2e640c56445a9109354f89807e83&role.id=04a874934a0944a2851b5e485a0f0a1b => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:47.429955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a00f69-60a7-4ca6-a0dc-db65f2943af6 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:47.558333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a00f69-60a7-4ca6-a0dc-db65f2943af6 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:47.571175 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed7738-6ca2-4f71-8c25-c68bb32b3a3a None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:47.576435 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:47.587127 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:47.616957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f46ba8-11a7-4111-b4c4-c29e3ed1ca59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:47.617684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f46ba8-11a7-4111-b4c4-c29e3ed1ca59 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:47.617978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f46ba8-11a7-4111-b4c4-c29e3ed1ca59 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:47.618252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f46ba8-11a7-4111-b4c4-c29e3ed1ca59 None admin] PATH_INFO: `/v3/groups/434d5356b04040299131b9b736f21b87` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:47.620112 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f46ba8-11a7-4111-b4c4-c29e3ed1ca59 None admin] RBAC: Authorizing `identity:get_group(group_id=434d5356b04040299131b9b736f21b87)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:47.621617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f46ba8-11a7-4111-b4c4-c29e3ed1ca59 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:47.626264 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 225/442] 10.222.0.39 () {56 vars in 1180 bytes} [Sun Aug 7 00:52:47 2022] GET /identity/v3/groups/434d5356b04040299131b9b736f21b87 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:47.627255 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e08e64-e4a4-48cd-8d8c-51e186023162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:47.627962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e08e64-e4a4-48cd-8d8c-51e186023162 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:47.628193 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e08e64-e4a4-48cd-8d8c-51e186023162 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:47.628520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e08e64-e4a4-48cd-8d8c-51e186023162 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:47.633556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f46ba8-11a7-4111-b4c4-c29e3ed1ca59 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:47.723336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e08e64-e4a4-48cd-8d8c-51e186023162 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:47.724807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e08e64-e4a4-48cd-8d8c-51e186023162 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:47.817866 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f46ba8-11a7-4111-b4c4-c29e3ed1ca59 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:47.884219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390243a7-b8da-4ecc-9522-974e9d3a5bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:47.884759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390243a7-b8da-4ecc-9522-974e9d3a5bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:47.885092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390243a7-b8da-4ecc-9522-974e9d3a5bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:47.885375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390243a7-b8da-4ecc-9522-974e9d3a5bb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:47.886124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390243a7-b8da-4ecc-9522-974e9d3a5bb2 None admin] RBAC: Adding query filter params (group.id=434d5356b04040299131b9b736f21b87, role.id=979b0708a1934c50b706215aa79dbb7a, scope.project.id=2388c261a2d64686b83675d2cd97701c) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:47.886435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390243a7-b8da-4ecc-9522-974e9d3a5bb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:47.889210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390243a7-b8da-4ecc-9522-974e9d3a5bb2 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:47.902801 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 226/443] 10.222.0.39 () {56 vars in 1376 bytes} [Sun Aug 7 00:52:47 2022] GET /identity/v3/role_assignments?group.id=434d5356b04040299131b9b736f21b87&scope.project.id=2388c261a2d64686b83675d2cd97701c&role.id=979b0708a1934c50b706215aa79dbb7a => generated 611 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:47.911222 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 218/444] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:52:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:52:47.919616 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390243a7-b8da-4ecc-9522-974e9d3a5bb2 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:48.030403 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:48.113577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390243a7-b8da-4ecc-9522-974e9d3a5bb2 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:48.120397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c34e8a-5f63-4950-8597-8ecd3d44486b None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:48.121142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c34e8a-5f63-4950-8597-8ecd3d44486b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:48.121142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c34e8a-5f63-4950-8597-8ecd3d44486b None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:48.123474 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 219/445] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:52:48.132093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dcaa7-0c90-40b6-9a20-e03b2f869feb None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:48.132646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dcaa7-0c90-40b6-9a20-e03b2f869feb None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:48.133166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dcaa7-0c90-40b6-9a20-e03b2f869feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:48.146227 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:48.166012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d52dcaa7-0c90-40b6-9a20-e03b2f869feb None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:48.169118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d52dcaa7-0c90-40b6-9a20-e03b2f869feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:48.171168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824006f7-a4bf-42e5-b4f9-c9200307b700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:48.172980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824006f7-a4bf-42e5-b4f9-c9200307b700 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:48.173491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824006f7-a4bf-42e5-b4f9-c9200307b700 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:48.173983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824006f7-a4bf-42e5-b4f9-c9200307b700 None admin] PATH_INFO: `/v3/projects/2388c261a2d64686b83675d2cd97701c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:48.175864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824006f7-a4bf-42e5-b4f9-c9200307b700 None admin] RBAC: Authorizing `identity:get_project(project_id=2388c261a2d64686b83675d2cd97701c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:48.178062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824006f7-a4bf-42e5-b4f9-c9200307b700 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:48.179827 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 227/446] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:47 2022] GET /identity/v3/projects/2388c261a2d64686b83675d2cd97701c => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:48.186625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824006f7-a4bf-42e5-b4f9-c9200307b700 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:48.271067 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 220/447] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:48.294163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52dcaa7-0c90-40b6-9a20-e03b2f869feb None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:48.331204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824006f7-a4bf-42e5-b4f9-c9200307b700 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:48.363295 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:48.384683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24852cd-efac-4131-a3b9-841eba72aca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:48.385418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24852cd-efac-4131-a3b9-841eba72aca1 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:48.385598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24852cd-efac-4131-a3b9-841eba72aca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:48.385871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24852cd-efac-4131-a3b9-841eba72aca1 None admin] PATH_INFO: `/v3/groups/434d5356b04040299131b9b736f21b87` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:48.387524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24852cd-efac-4131-a3b9-841eba72aca1 None admin] RBAC: Authorizing `identity:get_group(group_id=434d5356b04040299131b9b736f21b87)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:48.389146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24852cd-efac-4131-a3b9-841eba72aca1 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:48.391112 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 228/448] 10.222.0.39 () {56 vars in 1180 bytes} [Sun Aug 7 00:52:48 2022] GET /identity/v3/groups/434d5356b04040299131b9b736f21b87 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:52:48.397180 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24852cd-efac-4131-a3b9-841eba72aca1 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:48.412639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52dcaa7-0c90-40b6-9a20-e03b2f869feb None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:48.448207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247dbdc-7226-43a1-9686-770afc45471f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:48.448830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247dbdc-7226-43a1-9686-770afc45471f None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:48.449112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247dbdc-7226-43a1-9686-770afc45471f None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:48.449383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247dbdc-7226-43a1-9686-770afc45471f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:48.451289 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:48.460805 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247dbdc-7226-43a1-9686-770afc45471f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:48.465533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-3247dbdc-7226-43a1-9686-770afc45471f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:52:48.465533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:48.465533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:48.465533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:48.465533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:48.465533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:48.465533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:48.465533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:48.465533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:48.465533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:48.465533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:48.465533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:48.465533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:48.465533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:48.465533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:48.465533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:48.466621 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:48.466621 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:48.466621 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:48.466621 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:48.466621 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:48.466621 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:48.466621 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:48.466621 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:48.466621 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:48.466621 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:48.466621 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:48.466621 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:48.466621 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:48.466621 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:48.466621 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:48.466621 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:48.467405 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:48.467405 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:48.467405 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:48.467405 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:48.467405 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:48.467405 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:48.467405 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:48.467405 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:48.467405 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:48.467405 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:48.467405 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:52:48.467405 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:48.467405 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 221/449] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:52:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:52:48.473191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247dbdc-7226-43a1-9686-770afc45471f None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:48.506023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24852cd-efac-4131-a3b9-841eba72aca1 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:48.541837 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c051bc-e3b0-4e06-82ff-d507b45ec300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:48.542430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c051bc-e3b0-4e06-82ff-d507b45ec300 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:48.542710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c051bc-e3b0-4e06-82ff-d507b45ec300 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:48.542981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c051bc-e3b0-4e06-82ff-d507b45ec300 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:48.543725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c051bc-e3b0-4e06-82ff-d507b45ec300 None admin] RBAC: Adding query filter params (group.id=434d5356b04040299131b9b736f21b87, role.id=04a874934a0944a2851b5e485a0f0a1b, scope.project.id=2388c261a2d64686b83675d2cd97701c) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:48.544073 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c051bc-e3b0-4e06-82ff-d507b45ec300 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:48.545542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c051bc-e3b0-4e06-82ff-d507b45ec300 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:48.552148 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 229/450] 10.222.0.39 () {56 vars in 1376 bytes} [Sun Aug 7 00:52:48 2022] GET /identity/v3/role_assignments?group.id=434d5356b04040299131b9b736f21b87&scope.project.id=2388c261a2d64686b83675d2cd97701c&role.id=04a874934a0944a2851b5e485a0f0a1b => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:52:48.585908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247dbdc-7226-43a1-9686-770afc45471f None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:48.638814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec851c7-3a6d-4737-99b7-2d0e7dc6a853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:48.639428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec851c7-3a6d-4737-99b7-2d0e7dc6a853 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:48.639699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec851c7-3a6d-4737-99b7-2d0e7dc6a853 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:48.639999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec851c7-3a6d-4737-99b7-2d0e7dc6a853 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:48.640730 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec851c7-3a6d-4737-99b7-2d0e7dc6a853 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:48.641025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec851c7-3a6d-4737-99b7-2d0e7dc6a853 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:48.642429 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec851c7-3a6d-4737-99b7-2d0e7dc6a853 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:48.652014 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 222/451] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:52:48.658391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c051bc-e3b0-4e06-82ff-d507b45ec300 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:48.717775 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:48.766570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c051bc-e3b0-4e06-82ff-d507b45ec300 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:48.802510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad153ed7-e9ce-40d1-aec3-56120aa75ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:48.803110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad153ed7-e9ce-40d1-aec3-56120aa75ffc None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:48.803384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad153ed7-e9ce-40d1-aec3-56120aa75ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:48.803651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad153ed7-e9ce-40d1-aec3-56120aa75ffc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:48.872477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad153ed7-e9ce-40d1-aec3-56120aa75ffc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:48.873932 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad153ed7-e9ce-40d1-aec3-56120aa75ffc None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:48.931471 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:48.979709 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 230/452] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:52:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:52:48.985936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec851c7-3a6d-4737-99b7-2d0e7dc6a853 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:49.043658 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:49.091097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec851c7-3a6d-4737-99b7-2d0e7dc6a853 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:49.126987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb15f7f-4247-427e-8357-5502b6554deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:49.127706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb15f7f-4247-427e-8357-5502b6554deb None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:49.127877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb15f7f-4247-427e-8357-5502b6554deb None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:49.128173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb15f7f-4247-427e-8357-5502b6554deb None admin] PATH_INFO: `/v3/projects/62e0ba2ccef34e34b7ab3788b1ce6bb8` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:49.129677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb15f7f-4247-427e-8357-5502b6554deb None admin] RBAC: Authorizing `identity:get_project(project_id=62e0ba2ccef34e34b7ab3788b1ce6bb8)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:49.131122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb15f7f-4247-427e-8357-5502b6554deb None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:49.133131 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 223/453] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:52:48 2022] GET /identity/v3/projects/62e0ba2ccef34e34b7ab3788b1ce6bb8 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:49.138614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad153ed7-e9ce-40d1-aec3-56120aa75ffc None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:49.238880 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad153ed7-e9ce-40d1-aec3-56120aa75ffc None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:49.273770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d4696-ef94-48b4-bd88-2774042da954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:49.274396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d4696-ef94-48b4-bd88-2774042da954 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:49.274669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d4696-ef94-48b4-bd88-2774042da954 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:49.274936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d4696-ef94-48b4-bd88-2774042da954 None admin] PATH_INFO: `/v3/groups/a7eb77ab122d4598bdd7824d9c3de2c1` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:49.276069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d4696-ef94-48b4-bd88-2774042da954 None admin] RBAC: Authorizing `identity:get_group(group_id=a7eb77ab122d4598bdd7824d9c3de2c1)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:49.277516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d4696-ef94-48b4-bd88-2774042da954 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:49.279071 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 231/454] 10.222.0.39 () {56 vars in 1180 bytes} [Sun Aug 7 00:52:49 2022] GET /identity/v3/groups/a7eb77ab122d4598bdd7824d9c3de2c1 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:49.285790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb15f7f-4247-427e-8357-5502b6554deb None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:49.385114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb15f7f-4247-427e-8357-5502b6554deb None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:49.408254 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:49.418880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d936df-281f-4a28-b49e-ed87c35c5af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:49.419481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d936df-281f-4a28-b49e-ed87c35c5af3 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:49.419755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d936df-281f-4a28-b49e-ed87c35c5af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:49.420053 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d936df-281f-4a28-b49e-ed87c35c5af3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:49.420785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d936df-281f-4a28-b49e-ed87c35c5af3 None admin] RBAC: Adding query filter params (group.id=a7eb77ab122d4598bdd7824d9c3de2c1, role.id=695b07606e564668bac7afff4ab6052a, scope.project.id=62e0ba2ccef34e34b7ab3788b1ce6bb8) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:49.421084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d936df-281f-4a28-b49e-ed87c35c5af3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:49.422546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d936df-281f-4a28-b49e-ed87c35c5af3 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:49.428668 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 224/455] 10.222.0.39 () {56 vars in 1376 bytes} [Sun Aug 7 00:52:49 2022] GET /identity/v3/role_assignments?group.id=a7eb77ab122d4598bdd7824d9c3de2c1&scope.project.id=62e0ba2ccef34e34b7ab3788b1ce6bb8&role.id=695b07606e564668bac7afff4ab6052a => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:52.208975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40174455-26af-4f2c-9023-1379f44a6f7f None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:52.209811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40174455-26af-4f2c-9023-1379f44a6f7f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:52.210259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40174455-26af-4f2c-9023-1379f44a6f7f None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:52.212035 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 232/456] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:52.217776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a4eb9-7ee9-47d8-9aee-9bb4ecc6de8a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:52.219193 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a4eb9-7ee9-47d8-9aee-9bb4ecc6de8a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:52.219608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a4eb9-7ee9-47d8-9aee-9bb4ecc6de8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:52.241829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-405a4eb9-7ee9-47d8-9aee-9bb4ecc6de8a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:52.243248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-405a4eb9-7ee9-47d8-9aee-9bb4ecc6de8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:52.337351 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 225/457] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:52:52.372341 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40174455-26af-4f2c-9023-1379f44a6f7f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:52.422073 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:52.533766 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40174455-26af-4f2c-9023-1379f44a6f7f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:52.534273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81756cb8-5a31-4eaa-ac1f-deb3df77b377 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:52.534996 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81756cb8-5a31-4eaa-ac1f-deb3df77b377 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:52.535499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81756cb8-5a31-4eaa-ac1f-deb3df77b377 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:52.538674 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 226/458] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:52:52.549759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937c294-4e4c-4fc0-bcd6-a2c3ebd7317a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:52.550384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937c294-4e4c-4fc0-bcd6-a2c3ebd7317a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:52.550924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937c294-4e4c-4fc0-bcd6-a2c3ebd7317a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:52.570788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bf45a-f0c8-45f8-a53f-fa60b1c4a4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:52.571667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bf45a-f0c8-45f8-a53f-fa60b1c4a4ad None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:52.572135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bf45a-f0c8-45f8-a53f-fa60b1c4a4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:52.572562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bf45a-f0c8-45f8-a53f-fa60b1c4a4ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:52.584172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2bf45a-f0c8-45f8-a53f-fa60b1c4a4ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:52.585882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2bf45a-f0c8-45f8-a53f-fa60b1c4a4ad None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:52.587017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1937c294-4e4c-4fc0-bcd6-a2c3ebd7317a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:52.588343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1937c294-4e4c-4fc0-bcd6-a2c3ebd7317a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:52.604004 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-6b2bf45a-f0c8-45f8-a53f-fa60b1c4a4ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:52:52.604004 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:52.604004 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:52.604004 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:52.604004 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:52.604004 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:52.604004 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:52.604004 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:52.604004 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:52.604004 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:52.604004 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:52.604004 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:52.604004 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:52:52.604004 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:52:52.604004 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:52:52.604004 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:52:52.604970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:52.604970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:52.604970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:52.604970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:52.604970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:52.604970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:52.604970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:52.604970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:52.604970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:52.604970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:52.604970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:52.604970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:52.604970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:52.604970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:52.604970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:52.604970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:52.604970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:52:52.605824 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:52:52.605824 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:52:52.605824 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:52:52.607697 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 233/459] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:52:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:52:52.620955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bf45a-f0c8-45f8-a53f-fa60b1c4a4ad None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:52.710756 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:52.738744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bf45a-f0c8-45f8-a53f-fa60b1c4a4ad None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:52.751665 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 227/460] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:52:52.779348 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2374d-0111-4efa-8b0d-cfcd87066a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:52.780368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2374d-0111-4efa-8b0d-cfcd87066a92 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:52.780891 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2374d-0111-4efa-8b0d-cfcd87066a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:52.781356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2374d-0111-4efa-8b0d-cfcd87066a92 None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:52.782236 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2374d-0111-4efa-8b0d-cfcd87066a92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:52.782731 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2374d-0111-4efa-8b0d-cfcd87066a92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:52.784430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2374d-0111-4efa-8b0d-cfcd87066a92 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:52.794200 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937c294-4e4c-4fc0-bcd6-a2c3ebd7317a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:52.799763 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 234/461] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:52.804905 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2374d-0111-4efa-8b0d-cfcd87066a92 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:52.916771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2374d-0111-4efa-8b0d-cfcd87066a92 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:52.956024 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63249a69-29f6-4745-ae6c-92921a6740d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:52.956870 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63249a69-29f6-4745-ae6c-92921a6740d3 None admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:52.957240 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63249a69-29f6-4745-ae6c-92921a6740d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:52.957603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63249a69-29f6-4745-ae6c-92921a6740d3 None admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:52.958518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63249a69-29f6-4745-ae6c-92921a6740d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:52.960543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63249a69-29f6-4745-ae6c-92921a6740d3 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:52.971289 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:52.972295 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:52.994254 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 235/462] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Aug 7 00:52:52 2022] POST /identity/v3/users => generated 246 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 00:52:52.997262 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08287a47-75ce-4a3c-b21a-24ecb4764851 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:52.997552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08287a47-75ce-4a3c-b21a-24ecb4764851 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:52.998029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08287a47-75ce-4a3c-b21a-24ecb4764851 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:53.000131 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 236/463] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:53.006385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66566b-f2d2-4ece-978d-896d08076bde None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:53.006889 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66566b-f2d2-4ece-978d-896d08076bde None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:53.007715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66566b-f2d2-4ece-978d-896d08076bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:53.030191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-8b66566b-f2d2-4ece-978d-896d08076bde None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:53.032446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8b66566b-f2d2-4ece-978d-896d08076bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:53.035644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937c294-4e4c-4fc0-bcd6-a2c3ebd7317a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:53.078653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352936b-752e-404a-a754-54913fb72577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:53.079587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352936b-752e-404a-a754-54913fb72577 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:53.080041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352936b-752e-404a-a754-54913fb72577 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:53.080469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352936b-752e-404a-a754-54913fb72577 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:53.096609 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352936b-752e-404a-a754-54913fb72577 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:53.098462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352936b-752e-404a-a754-54913fb72577 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:53.116712 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 237/464] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:52:53.118147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a09d6-6a67-4f8f-9db0-9b03195d4114 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:53.118550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a09d6-6a67-4f8f-9db0-9b03195d4114 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:53.118968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a09d6-6a67-4f8f-9db0-9b03195d4114 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:53.119934 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-7352936b-752e-404a-a754-54913fb72577 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:52:53.119934 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:53.119934 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:53.119934 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:53.119934 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:53.119934 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:53.119934 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:53.119934 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:53.119934 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:53.119934 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:53.119934 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:53.119934 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:53.119934 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:52:53.119934 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:52:53.119934 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:52:53.119934 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:52:53.121058 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:53.121058 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:53.121058 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:53.121058 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:53.121058 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:53.121058 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:53.121058 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:53.121058 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:53.121058 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:53.121058 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:53.121058 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:53.121058 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:53.121058 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:53.121058 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:53.121058 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:53.121058 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:53.121058 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:52:53.122080 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:52:53.122080 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:52:53.122080 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:53.122776 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 238/465] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:53.123923 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 228/466] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:52:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:53.129408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec1410-a11d-4a00-a6b4-4001f2c588cf None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:53.129753 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec1410-a11d-4a00-a6b4-4001f2c588cf None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:53.130097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec1410-a11d-4a00-a6b4-4001f2c588cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:53.135208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352936b-752e-404a-a754-54913fb72577 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:53.156533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-76ec1410-a11d-4a00-a6b4-4001f2c588cf None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:53.157988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-76ec1410-a11d-4a00-a6b4-4001f2c588cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:53.257030 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 239/467] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:53.260863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec1410-a11d-4a00-a6b4-4001f2c588cf None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:53.290890 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:53.294062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352936b-752e-404a-a754-54913fb72577 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:53.329955 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:53.346834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89a16e-d986-48bd-89fa-383e3b10f8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:53.347310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89a16e-d986-48bd-89fa-383e3b10f8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:53.347589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89a16e-d986-48bd-89fa-383e3b10f8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:53.347872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89a16e-d986-48bd-89fa-383e3b10f8b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:53.348579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89a16e-d986-48bd-89fa-383e3b10f8b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:53.348885 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89a16e-d986-48bd-89fa-383e3b10f8b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:53.350281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89a16e-d986-48bd-89fa-383e3b10f8b6 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:53.365289 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 229/468] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:53.366614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89a16e-d986-48bd-89fa-383e3b10f8b6 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:53.413477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec1410-a11d-4a00-a6b4-4001f2c588cf None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:53.453029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640ac02-4494-4b58-b5ae-40dc622fe0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:53.454175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640ac02-4494-4b58-b5ae-40dc622fe0ec None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:53.454675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640ac02-4494-4b58-b5ae-40dc622fe0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:53.455163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640ac02-4494-4b58-b5ae-40dc622fe0ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:53.467719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640ac02-4494-4b58-b5ae-40dc622fe0ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:53.470151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640ac02-4494-4b58-b5ae-40dc622fe0ec None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:53.488073 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-7640ac02-4494-4b58-b5ae-40dc622fe0ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:52:53.488073 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:53.488073 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:53.488073 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:53.488073 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:53.488073 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:53.488073 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:53.488073 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:53.488073 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:53.488073 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:53.488073 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:53.488073 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:53.488073 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:52:53.488073 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:52:53.488073 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:52:53.488073 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:52:53.489114 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:53.489114 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:53.489114 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:53.489114 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:53.489114 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:53.489114 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:53.489114 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:53.489114 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:53.489114 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:53.489114 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:53.489114 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:53.489114 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:53.489114 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:53.489114 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:53.489114 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:53.489114 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:53.489114 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:52:53.490001 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:52:53.490001 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:52:53.490001 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:52:53.496615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89a16e-d986-48bd-89fa-383e3b10f8b6 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:53.497223 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 240/469] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:52:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:53.498362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640ac02-4494-4b58-b5ae-40dc622fe0ec None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:53.543049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb375f6-874f-4908-a838-87b2988f033a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:53.543633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb375f6-874f-4908-a838-87b2988f033a None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:53.543946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb375f6-874f-4908-a838-87b2988f033a None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:53.544222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb375f6-874f-4908-a838-87b2988f033a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:53.558712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb375f6-874f-4908-a838-87b2988f033a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:53.560574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb375f6-874f-4908-a838-87b2988f033a None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:53.581970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-7fb375f6-874f-4908-a838-87b2988f033a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:52:53.581970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:53.581970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:53.581970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:53.581970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:53.581970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:53.581970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:53.581970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:53.581970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:53.581970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:53.581970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:53.581970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:53.581970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:52:53.581970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:52:53.581970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:52:53.581970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:52:53.582958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:53.582958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:53.582958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:53.582958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:53.582958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:53.582958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:53.582958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:53.582958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:53.582958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:53.582958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:53.582958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:53.582958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:53.582958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:53.582958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:53.582958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:53.582958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:53.582958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:52:53.589075 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:52:53.589075 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:52:53.589075 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:53.589075 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 230/470] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:52:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:53.589075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb375f6-874f-4908-a838-87b2988f033a None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:53.613735 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:53.629275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640ac02-4494-4b58-b5ae-40dc622fe0ec None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:53.631718 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:53.687024 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ebe04-5f79-4e61-b760-f85694e51837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:53.687816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ebe04-5f79-4e61-b760-f85694e51837 None admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:53.688160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ebe04-5f79-4e61-b760-f85694e51837 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:53.688432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ebe04-5f79-4e61-b760-f85694e51837 None admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:53.689096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ebe04-5f79-4e61-b760-f85694e51837 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:53.690575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ebe04-5f79-4e61-b760-f85694e51837 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:53.718162 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 241/471] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Aug 7 00:52:53 2022] POST /identity/v3/users => generated 248 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:52:53.719743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ebe04-5f79-4e61-b760-f85694e51837 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:53.735527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb375f6-874f-4908-a838-87b2988f033a None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:53.791536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652db8e-d767-47c6-9589-b267419f9151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:53.792445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652db8e-d767-47c6-9589-b267419f9151 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:53.792725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652db8e-d767-47c6-9589-b267419f9151 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:53.793118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652db8e-d767-47c6-9589-b267419f9151 None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:53.794215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652db8e-d767-47c6-9589-b267419f9151 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:53.794525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652db8e-d767-47c6-9589-b267419f9151 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:53.796306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652db8e-d767-47c6-9589-b267419f9151 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:53.820229 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 231/472] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:53.823599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ea4dd-854b-43c5-bcae-960337d5d291 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:53.823904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ea4dd-854b-43c5-bcae-960337d5d291 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:53.824586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ea4dd-854b-43c5-bcae-960337d5d291 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:53.825933 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 232/473] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:53.829124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ea4dd-854b-43c5-bcae-960337d5d291 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:53.858467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ebe04-5f79-4e61-b760-f85694e51837 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:53.899670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7fa99-6538-4f83-8ff9-9ef17dd1dbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:53.901167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7fa99-6538-4f83-8ff9-9ef17dd1dbea None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:53.901167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7fa99-6538-4f83-8ff9-9ef17dd1dbea None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:53.901452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7fa99-6538-4f83-8ff9-9ef17dd1dbea None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:53.902094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7fa99-6538-4f83-8ff9-9ef17dd1dbea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:53.902400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7fa99-6538-4f83-8ff9-9ef17dd1dbea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:53.903839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7fa99-6538-4f83-8ff9-9ef17dd1dbea None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:53.923063 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 242/474] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:53.923063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152223e-0f85-4447-af8e-dc4631f5513b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:53.923063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152223e-0f85-4447-af8e-dc4631f5513b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:53.923063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152223e-0f85-4447-af8e-dc4631f5513b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:53.943449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d152223e-0f85-4447-af8e-dc4631f5513b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:53.944722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d152223e-0f85-4447-af8e-dc4631f5513b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:53.945654 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:53.963636 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:53.995417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ea4dd-854b-43c5-bcae-960337d5d291 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:54.045519 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 243/475] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:54.045519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152223e-0f85-4447-af8e-dc4631f5513b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:54.055148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f2e52-4910-4497-9d46-29733fc83f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:54.056165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f2e52-4910-4497-9d46-29733fc83f7d None admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:54.056626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f2e52-4910-4497-9d46-29733fc83f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:54.057464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f2e52-4910-4497-9d46-29733fc83f7d None admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:54.058629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f2e52-4910-4497-9d46-29733fc83f7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:54.060638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f2e52-4910-4497-9d46-29733fc83f7d None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:54.089629 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 233/476] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Aug 7 00:52:53 2022] POST /identity/v3/users => generated 248 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:52:54.090717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f2e52-4910-4497-9d46-29733fc83f7d None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:54.187589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152223e-0f85-4447-af8e-dc4631f5513b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:54.259170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999de6a-f273-4b58-a281-656f7508c52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:54.261479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999de6a-f273-4b58-a281-656f7508c52d None admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:54.262134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999de6a-f273-4b58-a281-656f7508c52d None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:54.263953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999de6a-f273-4b58-a281-656f7508c52d None admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:54.264853 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4999de6a-f273-4b58-a281-656f7508c52d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:54.267445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4999de6a-f273-4b58-a281-656f7508c52d None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:54.277479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f2e52-4910-4497-9d46-29733fc83f7d None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:54.313283 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 244/477] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Aug 7 00:52:54 2022] POST /identity/v3/users => generated 249 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:52:54.320570 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:54.332664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac39fcd-97f3-4ab3-bd4e-a7929109f285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:54.333401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac39fcd-97f3-4ab3-bd4e-a7929109f285 None admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:54.333716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac39fcd-97f3-4ab3-bd4e-a7929109f285 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:54.333987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac39fcd-97f3-4ab3-bd4e-a7929109f285 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:54.334676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac39fcd-97f3-4ab3-bd4e-a7929109f285 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:54.336924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac39fcd-97f3-4ab3-bd4e-a7929109f285 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:54.346361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.sql.core [None req-7ac39fcd-97f3-4ab3-bd4e-a7929109f285 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 07 00:52:54.346361 n-d-master-1 devstack@keystone.service[80492]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 07 00:52:54.346361 n-d-master-1 devstack@keystone.service[80492]: [parameters: {'id': '8ad71a49799948439ee46db7f13fddde', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 07 00:52:54.346361 n-d-master-1 devstack@keystone.service[80492]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80492) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 07 00:52:54.366021 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-7ac39fcd-97f3-4ab3-bd4e-a7929109f285 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 07 00:52:54.366021 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:54.366021 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 00:52:54.366021 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 00:52:54.366021 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 00:52:54.366021 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 00:52:54.366021 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 00:52:54.366021 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 00:52:54.366021 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 00:52:54.366021 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application conn.query(q) Aug 07 00:52:54.366021 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 00:52:54.366021 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 00:52:54.366021 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 00:52:54.366021 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application result.read() Aug 07 00:52:54.366021 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 00:52:54.366982 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 00:52:54.366982 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 00:52:54.366982 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 00:52:54.366982 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 00:52:54.366982 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 00:52:54.366982 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 00:52:54.366982 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 00:52:54.366982 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 07 00:52:54.366982 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:54.366982 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 07 00:52:54.366982 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:54.366982 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:54.366982 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 07 00:52:54.366982 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 07 00:52:54.366982 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 07 00:52:54.366982 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return ref.to_dict() Aug 07 00:52:54.366982 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 00:52:54.366982 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application next(self.gen) Aug 07 00:52:54.367949 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 07 00:52:54.367949 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application yield resource Aug 07 00:52:54.367949 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 00:52:54.367949 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application next(self.gen) Aug 07 00:52:54.367949 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 07 00:52:54.367949 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.session.rollback() Aug 07 00:52:54.367949 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 00:52:54.367949 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.force_reraise() Aug 07 00:52:54.367949 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 00:52:54.367949 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise self.value Aug 07 00:52:54.367949 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 07 00:52:54.367949 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 07 00:52:54.367949 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 07 00:52:54.367949 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application session.commit() Aug 07 00:52:54.367949 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 07 00:52:54.367949 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 07 00:52:54.367949 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 07 00:52:54.368964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._prepare_impl() Aug 07 00:52:54.368964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 07 00:52:54.368964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.session.flush() Aug 07 00:52:54.368964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 07 00:52:54.368964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._flush(objects) Aug 07 00:52:54.368964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 07 00:52:54.368964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 07 00:52:54.368964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 07 00:52:54.368964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application compat.raise_( Aug 07 00:52:54.368964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 00:52:54.368964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception Aug 07 00:52:54.368964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 07 00:52:54.368964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application flush_context.execute() Aug 07 00:52:54.368964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 07 00:52:54.368964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rec.execute(self) Aug 07 00:52:54.368964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 07 00:52:54.368964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 07 00:52:54.369926 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 07 00:52:54.369926 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 07 00:52:54.369926 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 07 00:52:54.369926 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 07 00:52:54.369926 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 07 00:52:54.369926 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 07 00:52:54.369926 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 07 00:52:54.369926 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 07 00:52:54.369926 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 07 00:52:54.369926 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 07 00:52:54.369926 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 07 00:52:54.369926 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 07 00:52:54.369926 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 07 00:52:54.369926 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 07 00:52:54.369926 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 00:52:54.369926 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception Aug 07 00:52:54.370755 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 00:52:54.370755 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 00:52:54.370755 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 00:52:54.370755 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 00:52:54.370755 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 00:52:54.370755 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 00:52:54.370755 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 00:52:54.370755 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application conn.query(q) Aug 07 00:52:54.370755 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 00:52:54.370755 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 00:52:54.370755 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 00:52:54.370755 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application result.read() Aug 07 00:52:54.370755 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 00:52:54.370755 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 00:52:54.370755 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 00:52:54.370755 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 00:52:54.371657 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 00:52:54.371657 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 00:52:54.371657 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 00:52:54.371657 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 00:52:54.371657 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 07 00:52:54.371657 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 07 00:52:54.371657 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [parameters: {'id': '8ad71a49799948439ee46db7f13fddde', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 07 00:52:54.371657 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 07 00:52:54.371657 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:54.371657 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:52:54.371657 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:54.371657 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:54.371657 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:54.371657 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:54.371657 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:54.371657 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:54.374285 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:54.374285 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:54.374285 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:54.374285 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:54.374285 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:54.374285 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:54.374285 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 07 00:52:54.374285 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 07 00:52:54.374285 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:54.374285 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:54.374285 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 07 00:52:54.374285 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 07 00:52:54.374285 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 07 00:52:54.374285 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 07 00:52:54.374285 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 07 00:52:54.374285 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:54.376966 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 234/478] 10.222.0.39 () {60 vars in 1131 bytes} [Sun Aug 7 00:52:54 2022] POST /identity/v3/roles => generated 144 bytes in 277 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:54.378791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999de6a-f273-4b58-a281-656f7508c52d None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:54.383789 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:54.554182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999de6a-f273-4b58-a281-656f7508c52d None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:54.594900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79259ea2-df83-452e-9830-d377f5f6dee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:54.595545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79259ea2-df83-452e-9830-d377f5f6dee5 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:54.595811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79259ea2-df83-452e-9830-d377f5f6dee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:54.596169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79259ea2-df83-452e-9830-d377f5f6dee5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:54.607237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79259ea2-df83-452e-9830-d377f5f6dee5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:54.612736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-79259ea2-df83-452e-9830-d377f5f6dee5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:52:54.612736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:54.612736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:54.612736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:54.612736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:54.612736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:54.612736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:54.612736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:54.612736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:54.612736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:54.612736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:54.612736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:54.612736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:54.612736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:54.612736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:54.612736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:54.613672 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:54.613672 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:54.613672 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:54.613672 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:54.613672 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:54.613672 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:54.613672 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:54.613672 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:54.613672 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:54.613672 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:54.613672 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:54.613672 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:54.613672 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:54.613672 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:54.613672 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:54.613672 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:54.614692 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:54.614692 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:54.614692 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:54.614692 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:54.614692 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:54.614692 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:54.614692 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:54.614692 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:54.614692 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:54.614692 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:54.614692 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 07 00:52:54.614692 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:52:54.614692 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 245/479] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Aug 7 00:52:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:54.619515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac39fcd-97f3-4ab3-bd4e-a7929109f285 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:54.735112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac39fcd-97f3-4ab3-bd4e-a7929109f285 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:54.773222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a0dd4-d9e8-4e53-8d27-33cd8bb740c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:54.774239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a0dd4-d9e8-4e53-8d27-33cd8bb740c9 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:54.774720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a0dd4-d9e8-4e53-8d27-33cd8bb740c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:54.775191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a0dd4-d9e8-4e53-8d27-33cd8bb740c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:54.776108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a0dd4-d9e8-4e53-8d27-33cd8bb740c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:54.776661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a0dd4-d9e8-4e53-8d27-33cd8bb740c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:54.778254 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a0dd4-d9e8-4e53-8d27-33cd8bb740c9 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:54.789517 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 235/480] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:52:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:55.427540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189fc97-4665-40ad-aa8c-2b158ac6feea None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:55.428603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189fc97-4665-40ad-aa8c-2b158ac6feea None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:55.429099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189fc97-4665-40ad-aa8c-2b158ac6feea None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:55.430914 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 246/481] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:55.436741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e87b0-29f3-400a-8513-7f7763aaba98 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:55.438261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e87b0-29f3-400a-8513-7f7763aaba98 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:55.438770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e87b0-29f3-400a-8513-7f7763aaba98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:55.462639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-eb4e87b0-29f3-400a-8513-7f7763aaba98 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:55.464184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-eb4e87b0-29f3-400a-8513-7f7763aaba98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:55.541281 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:55.565568 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 236/482] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:52:55.600298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189fc97-4665-40ad-aa8c-2b158ac6feea None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:55.701934 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:55.757565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189fc97-4665-40ad-aa8c-2b158ac6feea None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:55.804229 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b446c-97fe-41a6-a7f8-a14ddf05b3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:55.804866 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b446c-97fe-41a6-a7f8-a14ddf05b3b7 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:55.805139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b446c-97fe-41a6-a7f8-a14ddf05b3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:55.805411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b446c-97fe-41a6-a7f8-a14ddf05b3b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:55.820733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b446c-97fe-41a6-a7f8-a14ddf05b3b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:55.825801 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-712b446c-97fe-41a6-a7f8-a14ddf05b3b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:52:55.825801 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:55.825801 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:55.825801 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:55.825801 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:55.825801 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:55.825801 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:55.825801 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:55.825801 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:55.825801 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:55.825801 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:55.825801 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:55.825801 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:55.825801 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:55.825801 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:55.825801 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:55.826730 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:55.826730 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:55.826730 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:55.826730 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:55.826730 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:55.826730 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:55.826730 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:55.826730 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:55.826730 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:55.826730 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:55.826730 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:55.826730 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:55.826730 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:55.826730 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:55.826730 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:55.826730 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:55.828168 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:55.828168 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:55.828168 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:55.828168 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:55.828168 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:55.828168 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:55.828168 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:55.828168 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:55.828168 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:55.828168 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:55.828168 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:52:55.828168 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:52:55.830949 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 247/483] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Aug 7 00:52:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:55.841040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e87b0-29f3-400a-8513-7f7763aaba98 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:56.005199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e87b0-29f3-400a-8513-7f7763aaba98 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:56.059917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daaa515-8167-4d23-9266-bfa6937914ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:56.060568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaa515-8167-4d23-9266-bfa6937914ea None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:56.060851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaa515-8167-4d23-9266-bfa6937914ea None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:56.061217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daaa515-8167-4d23-9266-bfa6937914ea None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:56.061897 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daaa515-8167-4d23-9266-bfa6937914ea None admin] RBAC: Adding query filter params (name=service) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:56.062279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daaa515-8167-4d23-9266-bfa6937914ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:56.063661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daaa515-8167-4d23-9266-bfa6937914ea None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:56.077193 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 237/484] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Aug 7 00:52:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:56.083020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b446c-97fe-41a6-a7f8-a14ddf05b3b7 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:56.227031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b446c-97fe-41a6-a7f8-a14ddf05b3b7 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:56.257410 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:56.269166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688ef55-4463-4196-828c-9c8cbcd3589d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:56.270501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688ef55-4463-4196-828c-9c8cbcd3589d None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:56.270788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688ef55-4463-4196-828c-9c8cbcd3589d None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:56.271071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e688ef55-4463-4196-828c-9c8cbcd3589d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:56.283636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688ef55-4463-4196-828c-9c8cbcd3589d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:56.285158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e688ef55-4463-4196-828c-9c8cbcd3589d None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:56.299936 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-e688ef55-4463-4196-828c-9c8cbcd3589d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:52:56.299936 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:56.299936 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:56.299936 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:56.299936 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:56.299936 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:56.299936 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:56.299936 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:56.299936 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:56.299936 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:56.299936 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:56.299936 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:56.299936 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:52:56.299936 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:52:56.299936 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:52:56.299936 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:52:56.300868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:56.300868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:56.300868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:56.300868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:56.300868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:56.300868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:56.300868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:56.300868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:56.300868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:56.300868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:56.300868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:56.300868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:56.300868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:56.300868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:56.300868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:56.300868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:56.300868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:52:56.301704 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:52:56.301704 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:52:56.301704 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:52:56.301704 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 248/485] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:52:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:56.306579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daaa515-8167-4d23-9266-bfa6937914ea None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:56.389151 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:56.474676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daaa515-8167-4d23-9266-bfa6937914ea None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:56.520959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c72bd-f97e-4cb3-9c76-fcd9d7da54f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:56.521506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c72bd-f97e-4cb3-9c76-fcd9d7da54f3 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:56.521785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c72bd-f97e-4cb3-9c76-fcd9d7da54f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:56.522059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c72bd-f97e-4cb3-9c76-fcd9d7da54f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:56.522990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c72bd-f97e-4cb3-9c76-fcd9d7da54f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:56.523294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c72bd-f97e-4cb3-9c76-fcd9d7da54f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:56.524751 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c72bd-f97e-4cb3-9c76-fcd9d7da54f3 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:56.549209 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 238/486] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:56.555567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688ef55-4463-4196-828c-9c8cbcd3589d None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:56.636149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf88073-692a-4d8e-8264-553da654a13d None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:56.636476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf88073-692a-4d8e-8264-553da654a13d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:56.636737 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf88073-692a-4d8e-8264-553da654a13d None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:56.644163 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 239/487] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:56.646826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494e19a-6864-4c9a-ad3d-964bbcb746dc None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:56.647289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494e19a-6864-4c9a-ad3d-964bbcb746dc None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:56.647940 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494e19a-6864-4c9a-ad3d-964bbcb746dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:56.676206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-8494e19a-6864-4c9a-ad3d-964bbcb746dc None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:56.677439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8494e19a-6864-4c9a-ad3d-964bbcb746dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:56.719372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e688ef55-4463-4196-828c-9c8cbcd3589d None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:56.775021 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d889b79-4018-45ab-bc6b-8f4a33018eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:56.775739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d889b79-4018-45ab-bc6b-8f4a33018eaf None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:56.776138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d889b79-4018-45ab-bc6b-8f4a33018eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:56.776495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d889b79-4018-45ab-bc6b-8f4a33018eaf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:56.801221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d889b79-4018-45ab-bc6b-8f4a33018eaf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:56.802743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d889b79-4018-45ab-bc6b-8f4a33018eaf None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:56.824055 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 240/488] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:52:56.824591 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-9d889b79-4018-45ab-bc6b-8f4a33018eaf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:52:56.824591 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:56.824591 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:56.824591 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:56.824591 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:56.824591 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:56.824591 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:56.824591 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:56.824591 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:56.824591 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:56.824591 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:56.824591 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:56.824591 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:52:56.824591 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:52:56.824591 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:52:56.824591 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:52:56.825475 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:56.825475 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:56.825475 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:52:56.825475 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:52:56.825475 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:52:56.825475 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:52:56.825475 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:56.825475 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:56.825475 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:56.825475 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:56.825475 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:56.825475 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:56.825475 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:56.825475 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:56.825475 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:56.825475 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:56.825475 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:56.825475 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:56.826351 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:56.826351 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:56.826351 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:52:56.826351 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:52:56.826351 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:52:56.826351 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:52:56.826351 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:52:56.826351 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:52:56.826351 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:52:56.826351 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:52:56.832362 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 249/489] 10.222.0.39 () {56 vars in 1093 bytes} [Sun Aug 7 00:52:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:52:56.837847 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494e19a-6864-4c9a-ad3d-964bbcb746dc None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:56.891192 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d889b79-4018-45ab-bc6b-8f4a33018eaf None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:56.893312 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:56.968676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494e19a-6864-4c9a-ad3d-964bbcb746dc None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:57.001230 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:57.010752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf02c2-312c-45dd-98c4-0435c3ac67e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:57.011377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf02c2-312c-45dd-98c4-0435c3ac67e3 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:57.011656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf02c2-312c-45dd-98c4-0435c3ac67e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:57.011960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf02c2-312c-45dd-98c4-0435c3ac67e3 None admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:57.012723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf02c2-312c-45dd-98c4-0435c3ac67e3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:57.013032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf02c2-312c-45dd-98c4-0435c3ac67e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:57.014735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf02c2-312c-45dd-98c4-0435c3ac67e3 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:57.056655 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 241/490] 10.222.0.39 () {56 vars in 1133 bytes} [Sun Aug 7 00:52:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:57.064191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf02c2-312c-45dd-98c4-0435c3ac67e3 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:57.122587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d889b79-4018-45ab-bc6b-8f4a33018eaf None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:57.170946 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b4421-356b-43f1-8dca-bbb6111ff553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:57.172481 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b4421-356b-43f1-8dca-bbb6111ff553 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:57.172761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b4421-356b-43f1-8dca-bbb6111ff553 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:57.173312 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:57.173952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b4421-356b-43f1-8dca-bbb6111ff553 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:57.180842 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf02c2-312c-45dd-98c4-0435c3ac67e3 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:57.187500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b4421-356b-43f1-8dca-bbb6111ff553 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:57.194231 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-6d9b4421-356b-43f1-8dca-bbb6111ff553 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:52:57.194231 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:57.194231 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:57.194231 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:57.194231 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:57.194231 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:57.194231 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:57.194231 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:57.194231 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:57.194231 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:57.194231 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:57.194231 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:57.194231 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:57.194231 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:57.194231 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:57.194231 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:57.195267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:57.195267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:57.195267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:57.195267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:57.195267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:57.195267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:57.195267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:57.195267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:57.195267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:57.195267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:57.195267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:57.195267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:57.195267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:57.195267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:57.195267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:57.195267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:57.196611 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:57.196611 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:57.196611 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:57.196611 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:57.196611 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:57.196611 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:57.196611 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:57.196611 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:57.196611 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:57.196611 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:57.196611 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:52:57.196611 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:52:57.196611 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 250/491] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Aug 7 00:52:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:52:57.197601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65758c9-91f7-4c37-b8d1-136fcc3c86f0 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:57.197775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65758c9-91f7-4c37-b8d1-136fcc3c86f0 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:57.198004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65758c9-91f7-4c37-b8d1-136fcc3c86f0 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:57.203482 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 251/492] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:57.206053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd007a80-848b-46f2-a607-82df14b1a113 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:57.206365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd007a80-848b-46f2-a607-82df14b1a113 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:57.206672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd007a80-848b-46f2-a607-82df14b1a113 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:57.212930 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 252/493] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:57.212930 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd007a80-848b-46f2-a607-82df14b1a113 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:57.227555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bcf59-0a20-4a8c-86c0-9bdc66766d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:57.228218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bcf59-0a20-4a8c-86c0-9bdc66766d14 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:57.228499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bcf59-0a20-4a8c-86c0-9bdc66766d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:57.228773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bcf59-0a20-4a8c-86c0-9bdc66766d14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:57.307250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5bcf59-0a20-4a8c-86c0-9bdc66766d14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:57.309113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5bcf59-0a20-4a8c-86c0-9bdc66766d14 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:57.325202 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:57.334443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd007a80-848b-46f2-a607-82df14b1a113 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:57.373925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d615640-4ac2-4d7c-bdef-dfb6be0a5246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:57.375101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d615640-4ac2-4d7c-bdef-dfb6be0a5246 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:57.375393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d615640-4ac2-4d7c-bdef-dfb6be0a5246 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:57.375665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d615640-4ac2-4d7c-bdef-dfb6be0a5246 None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:57.376393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d615640-4ac2-4d7c-bdef-dfb6be0a5246 None admin] RBAC: Adding query filter params (name=service) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:57.376702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d615640-4ac2-4d7c-bdef-dfb6be0a5246 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:57.378145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d615640-4ac2-4d7c-bdef-dfb6be0a5246 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:57.388076 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 253/494] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Aug 7 00:52:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:57.389445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8b81a-aaae-4422-9fe2-f8129e1a814c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:57.389752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8b81a-aaae-4422-9fe2-f8129e1a814c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:57.390026 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc8b81a-aaae-4422-9fe2-f8129e1a814c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:57.408584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-5cc8b81a-aaae-4422-9fe2-f8129e1a814c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:57.409875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5cc8b81a-aaae-4422-9fe2-f8129e1a814c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:57.428551 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:57.439396 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 242/495] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:52:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 07 00:52:57.441086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e95bd7-9151-4664-9bbe-3df2998329f2 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:57.441613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e95bd7-9151-4664-9bbe-3df2998329f2 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:57.442075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e95bd7-9151-4664-9bbe-3df2998329f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:57.461434 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a8e95bd7-9151-4664-9bbe-3df2998329f2 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:57.462641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a8e95bd7-9151-4664-9bbe-3df2998329f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:57.491467 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 254/496] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:57.492382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8b81a-aaae-4422-9fe2-f8129e1a814c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:57.545735 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 243/497] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:57.547396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e95bd7-9151-4664-9bbe-3df2998329f2 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:57.605741 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:57.620232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc8b81a-aaae-4422-9fe2-f8129e1a814c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:57.668252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc44ab7-4ba0-4de3-915e-7c009dee21f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:57.669269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc44ab7-4ba0-4de3-915e-7c009dee21f7 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:57.669691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc44ab7-4ba0-4de3-915e-7c009dee21f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:57.670107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc44ab7-4ba0-4de3-915e-7c009dee21f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:57.680166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e95bd7-9151-4664-9bbe-3df2998329f2 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:57.683684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc44ab7-4ba0-4de3-915e-7c009dee21f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:57.685466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc44ab7-4ba0-4de3-915e-7c009dee21f7 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:57.707151 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-3dc44ab7-4ba0-4de3-915e-7c009dee21f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:52:57.707151 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:57.707151 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:57.707151 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:57.707151 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:57.707151 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:57.707151 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:57.707151 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:57.707151 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:57.707151 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:57.707151 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:57.707151 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:57.707151 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:52:57.707151 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:52:57.707151 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:52:57.707151 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:52:57.708434 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:57.708434 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:57.708434 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:57.708434 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:57.708434 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:57.708434 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:57.708434 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:57.708434 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:57.708434 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:57.708434 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:57.708434 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:57.708434 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:57.708434 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:57.708434 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:57.708434 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:57.708434 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:57.708434 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:52:57.714152 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:52:57.714152 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:52:57.714152 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:52:57.714152 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 255/498] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:52:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:57.714152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc44ab7-4ba0-4de3-915e-7c009dee21f7 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:57.715022 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:57.726662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2dd58-067d-4704-9a2d-cf100c7edec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:57.730874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2dd58-067d-4704-9a2d-cf100c7edec6 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:57.730874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2dd58-067d-4704-9a2d-cf100c7edec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:57.730874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2dd58-067d-4704-9a2d-cf100c7edec6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:57.739612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2dd58-067d-4704-9a2d-cf100c7edec6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:57.741151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2dd58-067d-4704-9a2d-cf100c7edec6 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:57.756313 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-d0f2dd58-067d-4704-9a2d-cf100c7edec6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:52:57.756313 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:57.756313 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:57.756313 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:57.756313 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:57.756313 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:57.756313 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:57.756313 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:57.756313 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:57.756313 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:57.756313 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:57.756313 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:57.756313 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:52:57.756313 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:52:57.756313 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:52:57.756313 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:52:57.757342 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:57.757342 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:57.757342 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:57.757342 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:57.757342 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:57.757342 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:57.757342 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:57.757342 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:57.757342 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:57.757342 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:57.757342 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:57.757342 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:57.757342 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:57.757342 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:57.757342 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:57.757342 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:57.757342 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:52:57.758154 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:52:57.758154 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:52:57.758154 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:57.762203 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 244/499] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:52:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:57.762969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2dd58-067d-4704-9a2d-cf100c7edec6 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:57.824287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc44ab7-4ba0-4de3-915e-7c009dee21f7 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:57.857798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c2f48-01e3-4cff-9ab3-f2fc69102483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:57.858489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c2f48-01e3-4cff-9ab3-f2fc69102483 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:57.858755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c2f48-01e3-4cff-9ab3-f2fc69102483 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:57.859030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c2f48-01e3-4cff-9ab3-f2fc69102483 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:57.861722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2dd58-067d-4704-9a2d-cf100c7edec6 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:57.866488 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:57.870518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c2f48-01e3-4cff-9ab3-f2fc69102483 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:57.876587 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-181c2f48-01e3-4cff-9ab3-f2fc69102483 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:52:57.876587 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:57.876587 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:57.876587 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:57.876587 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:57.876587 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:57.876587 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:57.876587 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:57.876587 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:57.876587 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:57.876587 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:57.876587 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:57.876587 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:57.876587 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:57.876587 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:57.876587 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:57.877463 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:57.877463 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:57.877463 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:57.877463 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:57.877463 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:57.877463 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:57.877463 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:57.877463 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:57.877463 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:57.877463 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:57.877463 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:57.877463 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:57.877463 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:57.877463 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:57.877463 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:57.877463 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:57.878251 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:57.878251 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:57.878251 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:57.878251 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:57.878251 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:57.878251 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:57.878251 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:57.878251 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:57.878251 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:57.878251 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:57.878251 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:52:57.878251 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:52:57.878251 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 256/500] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Aug 7 00:52:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:57.878885 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c2f48-01e3-4cff-9ab3-f2fc69102483 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:57.900515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ba26a-6cb7-426a-86b2-01bbca1eb53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:57.901140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ba26a-6cb7-426a-86b2-01bbca1eb53e None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:57.901417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ba26a-6cb7-426a-86b2-01bbca1eb53e None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:57.901689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ba26a-6cb7-426a-86b2-01bbca1eb53e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:57.912222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ba26a-6cb7-426a-86b2-01bbca1eb53e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:52:57.917422 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-390ba26a-6cb7-426a-86b2-01bbca1eb53e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:52:57.917422 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:57.917422 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:57.917422 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:57.917422 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:57.917422 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:57.917422 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:57.917422 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:57.917422 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:57.917422 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:57.917422 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:57.917422 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:57.917422 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:52:57.917422 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:52:57.917422 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:52:57.917422 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:52:57.918299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:52:57.918299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:52:57.918299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:52:57.918299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:52:57.918299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:57.918299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:57.918299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:57.918299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:57.918299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:57.918299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:57.918299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:57.918299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:57.918299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:57.918299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:57.918299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:57.918299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:57.919096 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:57.919096 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:57.919096 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:57.919096 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:57.919096 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:52:57.919096 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:52:57.919096 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:52:57.919096 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:52:57.919096 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:52:57.919096 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:52:57.919096 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:52:57.919096 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:57.919096 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 245/501] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Aug 7 00:52:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:57.920200 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cd15c-89b8-4e3b-a21b-14db41bbc350 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:57.920302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cd15c-89b8-4e3b-a21b-14db41bbc350 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:57.920530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cd15c-89b8-4e3b-a21b-14db41bbc350 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:57.922389 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 246/502] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:52:57.923074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cd15c-89b8-4e3b-a21b-14db41bbc350 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:57.960604 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:57.982195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c2f48-01e3-4cff-9ab3-f2fc69102483 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:58.016715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba2eae-6b72-4c57-83aa-bcf6b7c41792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:58.017315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba2eae-6b72-4c57-83aa-bcf6b7c41792 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:58.017586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba2eae-6b72-4c57-83aa-bcf6b7c41792 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:58.017852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba2eae-6b72-4c57-83aa-bcf6b7c41792 None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:58.018501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba2eae-6b72-4c57-83aa-bcf6b7c41792 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:58.018797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba2eae-6b72-4c57-83aa-bcf6b7c41792 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:58.020207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba2eae-6b72-4c57-83aa-bcf6b7c41792 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:58.030609 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cd15c-89b8-4e3b-a21b-14db41bbc350 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:58.032557 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 257/503] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:58.033420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba2eae-6b72-4c57-83aa-bcf6b7c41792 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:58.064343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02879759-5f48-4e31-9b93-519183cfef66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:58.064943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02879759-5f48-4e31-9b93-519183cfef66 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:58.065216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02879759-5f48-4e31-9b93-519183cfef66 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:58.065481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02879759-5f48-4e31-9b93-519183cfef66 None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:58.066116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02879759-5f48-4e31-9b93-519183cfef66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:58.066417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02879759-5f48-4e31-9b93-519183cfef66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:58.067778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02879759-5f48-4e31-9b93-519183cfef66 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:58.080760 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 247/504] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:58.081556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02879759-5f48-4e31-9b93-519183cfef66 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:58.091402 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:58.130890 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba2eae-6b72-4c57-83aa-bcf6b7c41792 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:58.166536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829996d8-78c0-47c9-9756-89847618ab45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:58.167142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829996d8-78c0-47c9-9756-89847618ab45 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:58.167415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829996d8-78c0-47c9-9756-89847618ab45 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:58.167677 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829996d8-78c0-47c9-9756-89847618ab45 None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:58.168382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829996d8-78c0-47c9-9756-89847618ab45 None admin] RBAC: Adding query filter params (name=service) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:58.168674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829996d8-78c0-47c9-9756-89847618ab45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:58.170057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829996d8-78c0-47c9-9756-89847618ab45 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:58.177726 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:58.183142 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 258/505] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Aug 7 00:52:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:58.183142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dd1a6-9a4b-4872-92d1-6650020eb150 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:58.183142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dd1a6-9a4b-4872-92d1-6650020eb150 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:58.183142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dd1a6-9a4b-4872-92d1-6650020eb150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:58.190477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02879759-5f48-4e31-9b93-519183cfef66 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:58.198406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-047dd1a6-9a4b-4872-92d1-6650020eb150 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:52:58.199612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-047dd1a6-9a4b-4872-92d1-6650020eb150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:52:58.227644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e43682-1cc6-457d-8f62-9699de8a98bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:58.228264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e43682-1cc6-457d-8f62-9699de8a98bf None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:58.228538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e43682-1cc6-457d-8f62-9699de8a98bf None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:58.228800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e43682-1cc6-457d-8f62-9699de8a98bf None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:58.229458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e43682-1cc6-457d-8f62-9699de8a98bf None admin] RBAC: Adding query filter params (name=service) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:58.229749 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e43682-1cc6-457d-8f62-9699de8a98bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:58.231100 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e43682-1cc6-457d-8f62-9699de8a98bf None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:58.238899 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 248/506] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Aug 7 00:52:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:58.239689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e43682-1cc6-457d-8f62-9699de8a98bf None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:58.272010 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 259/507] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:52:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:52:58.273343 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047dd1a6-9a4b-4872-92d1-6650020eb150 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:58.329756 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:58.362324 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e43682-1cc6-457d-8f62-9699de8a98bf None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:58.387138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047dd1a6-9a4b-4872-92d1-6650020eb150 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:58.398767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9b858-895a-44dd-8028-3178a37e7cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:58.399399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9b858-895a-44dd-8028-3178a37e7cab None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:58.399679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9b858-895a-44dd-8028-3178a37e7cab None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:58.399985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9b858-895a-44dd-8028-3178a37e7cab None admin] PATH_INFO: `/v3/users/glance` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:58.408517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9b858-895a-44dd-8028-3178a37e7cab None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:58.412546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9b858-895a-44dd-8028-3178a37e7cab None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:58.425618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e865ac-6fde-4a90-8e2a-28d2ad3a4a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:58.426248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e865ac-6fde-4a90-8e2a-28d2ad3a4a14 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:58.426528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e865ac-6fde-4a90-8e2a-28d2ad3a4a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:58.426803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e865ac-6fde-4a90-8e2a-28d2ad3a4a14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:58.426930 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-39a9b858-895a-44dd-8028-3178a37e7cab None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 07 00:52:58.426930 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:58.426930 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:58.426930 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:58.426930 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:58.426930 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:58.426930 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:58.426930 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:58.426930 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:58.426930 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:58.426930 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:58.426930 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:58.426930 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:52:58.426930 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:52:58.426930 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:52:58.426930 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:52:58.428409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:58.428409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:58.428409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:52:58.428409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:52:58.428409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:52:58.428409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:52:58.428409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:58.428409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:58.428409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:58.428409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:58.428409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:58.428409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:58.428409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:58.428409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:58.428409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:58.428409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:58.428409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:58.428409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:58.430153 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:58.430153 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:58.430153 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:52:58.430153 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:52:58.430153 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:52:58.430153 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:52:58.430153 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:52:58.430153 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:52:58.430153 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 07 00:52:58.430153 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:58.430153 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 249/508] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:58.430153 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9b858-895a-44dd-8028-3178a37e7cab None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:58.437758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e865ac-6fde-4a90-8e2a-28d2ad3a4a14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:58.439386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e865ac-6fde-4a90-8e2a-28d2ad3a4a14 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:58.453224 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-05e865ac-6fde-4a90-8e2a-28d2ad3a4a14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:52:58.453224 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:58.453224 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:58.453224 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:58.453224 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:58.453224 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:58.453224 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:58.453224 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:58.453224 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:58.453224 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:58.453224 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:58.453224 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:58.453224 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:52:58.453224 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:52:58.453224 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:52:58.455125 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:52:58.455125 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:58.455125 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:58.455125 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:58.455125 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:58.455125 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:58.455125 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:58.455125 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:58.455125 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:58.455125 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:58.455125 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:58.455125 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:58.455125 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:58.455125 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:58.455125 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:58.455125 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:58.455125 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:58.457359 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:52:58.457359 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:52:58.457359 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:52:58.457359 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:52:58.457359 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:52:58.457359 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:52:58.457359 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:52:58.457359 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:52:58.458301 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:58.459317 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 260/509] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:52:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:58.460076 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e865ac-6fde-4a90-8e2a-28d2ad3a4a14 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:58.556356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9b858-895a-44dd-8028-3178a37e7cab None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:58.564726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e865ac-6fde-4a90-8e2a-28d2ad3a4a14 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:58.581444 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:58.593508 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70110119-83ae-43ff-aa57-cde01209aada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:58.594008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70110119-83ae-43ff-aa57-cde01209aada None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:58.594284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70110119-83ae-43ff-aa57-cde01209aada None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:58.594557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70110119-83ae-43ff-aa57-cde01209aada None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:58.605205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034aa470-e919-41e0-80a7-acafdeb58591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:58.605681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70110119-83ae-43ff-aa57-cde01209aada None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:58.605851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034aa470-e919-41e0-80a7-acafdeb58591 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:58.606314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034aa470-e919-41e0-80a7-acafdeb58591 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:58.606314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034aa470-e919-41e0-80a7-acafdeb58591 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:58.607167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70110119-83ae-43ff-aa57-cde01209aada None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:58.617581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034aa470-e919-41e0-80a7-acafdeb58591 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:58.619061 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034aa470-e919-41e0-80a7-acafdeb58591 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:58.622883 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-70110119-83ae-43ff-aa57-cde01209aada None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:52:58.622883 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:58.622883 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:58.622883 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:58.622883 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:58.622883 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:58.622883 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:58.622883 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:58.622883 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:58.622883 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:58.622883 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:58.622883 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:58.622883 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:52:58.622883 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:52:58.622883 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:52:58.622883 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:52:58.623778 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:58.623778 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:58.623778 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:58.623778 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:58.623778 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:58.623778 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:58.623778 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:58.623778 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:58.623778 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:58.623778 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:58.623778 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:58.623778 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:58.623778 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:58.623778 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:58.623778 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:58.623778 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:58.623778 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:52:58.627360 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:52:58.627360 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:52:58.627360 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:58.627360 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 250/510] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:52:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:58.627360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70110119-83ae-43ff-aa57-cde01209aada None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:58.637426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-034aa470-e919-41e0-80a7-acafdeb58591 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:52:58.637426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:58.637426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:58.637426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:58.637426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:58.637426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:58.637426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:58.637426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:58.637426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:58.637426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:58.637426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:58.637426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:58.637426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:52:58.637426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:52:58.637426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:52:58.637426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:52:58.638627 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:58.638627 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:58.638627 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:58.638627 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:58.638627 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:58.638627 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:58.638627 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:58.638627 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:58.638627 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:58.638627 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:58.638627 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:58.638627 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:58.638627 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:58.638627 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:58.638627 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:58.638627 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:58.638627 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:52:58.639484 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:52:58.639484 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:52:58.639484 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:52:58.639484 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 261/511] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:52:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:58.639702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034aa470-e919-41e0-80a7-acafdeb58591 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:58.705561 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:58.737561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70110119-83ae-43ff-aa57-cde01209aada None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:58.742029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034aa470-e919-41e0-80a7-acafdeb58591 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:58.770833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55139720-f244-4d10-8d40-c3d5f4259e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:58.771461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55139720-f244-4d10-8d40-c3d5f4259e57 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:58.771737 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55139720-f244-4d10-8d40-c3d5f4259e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:58.772043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55139720-f244-4d10-8d40-c3d5f4259e57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:58.776008 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5dc52-096c-414b-8799-5d3c0f149b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:58.776615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5dc52-096c-414b-8799-5d3c0f149b4d None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:58.776905 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5dc52-096c-414b-8799-5d3c0f149b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:58.777179 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5dc52-096c-414b-8799-5d3c0f149b4d None admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:58.777916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5dc52-096c-414b-8799-5d3c0f149b4d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:58.778221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5dc52-096c-414b-8799-5d3c0f149b4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:58.779681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5dc52-096c-414b-8799-5d3c0f149b4d None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:58.785794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55139720-f244-4d10-8d40-c3d5f4259e57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:58.787295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55139720-f244-4d10-8d40-c3d5f4259e57 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:58.802551 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-55139720-f244-4d10-8d40-c3d5f4259e57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:52:58.802551 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:58.802551 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:58.802551 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:58.802551 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:58.802551 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:58.802551 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:58.802551 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:58.802551 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:58.802551 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:58.802551 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:58.802551 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:58.802551 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:52:58.802551 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:52:58.802551 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:52:58.802551 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:52:58.803533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:58.803533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:58.803533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:58.803533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:58.803533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:58.803533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:58.803533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:58.803533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:58.803533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:58.803533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:58.803533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:58.803533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:58.803533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:58.803533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:58.803533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:58.803533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:58.803533 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:52:58.804419 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:52:58.804419 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:52:58.804419 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:58.804419 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 251/512] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:52:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:58.804641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55139720-f244-4d10-8d40-c3d5f4259e57 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:58.819949 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 262/513] 10.222.0.39 () {56 vars in 1137 bytes} [Sun Aug 7 00:52:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:58.820828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5dc52-096c-414b-8799-5d3c0f149b4d None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:58.853630 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:58.918704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55139720-f244-4d10-8d40-c3d5f4259e57 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:58.936858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5dc52-096c-414b-8799-5d3c0f149b4d None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:58.942138 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:58.955425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a439f4d-259c-4ee8-9a16-9eec5080460e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:58.956090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a439f4d-259c-4ee8-9a16-9eec5080460e None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:58.956358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a439f4d-259c-4ee8-9a16-9eec5080460e None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:58.956631 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a439f4d-259c-4ee8-9a16-9eec5080460e None admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:58.957340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a439f4d-259c-4ee8-9a16-9eec5080460e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:58.957646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a439f4d-259c-4ee8-9a16-9eec5080460e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:58.959108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a439f4d-259c-4ee8-9a16-9eec5080460e None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:58.973099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847d592-4a08-4036-be67-187de3ed2672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:58.973710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847d592-4a08-4036-be67-187de3ed2672 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:58.973997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847d592-4a08-4036-be67-187de3ed2672 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:58.974264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847d592-4a08-4036-be67-187de3ed2672 None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:58.974945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847d592-4a08-4036-be67-187de3ed2672 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:58.975262 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847d592-4a08-4036-be67-187de3ed2672 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:58.976696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847d592-4a08-4036-be67-187de3ed2672 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:58.981790 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 252/514] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:52:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:58.982140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a439f4d-259c-4ee8-9a16-9eec5080460e None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:58.988867 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 263/515] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:58.989754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847d592-4a08-4036-be67-187de3ed2672 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:59.086480 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:59.094085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a439f4d-259c-4ee8-9a16-9eec5080460e None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:59.106101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847d592-4a08-4036-be67-187de3ed2672 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:59.131773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b4170-5d21-4970-bec3-a71e927becf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:59.132465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b4170-5d21-4970-bec3-a71e927becf8 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:59.132741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b4170-5d21-4970-bec3-a71e927becf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:59.133012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b4170-5d21-4970-bec3-a71e927becf8 None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:59.133672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b4170-5d21-4970-bec3-a71e927becf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:59.133989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b4170-5d21-4970-bec3-a71e927becf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:59.135396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b4170-5d21-4970-bec3-a71e927becf8 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:59.149390 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 253/516] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:59.150247 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b4170-5d21-4970-bec3-a71e927becf8 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:59.151658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1996e7-f6bf-4254-bb68-f6f746b1e78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:59.152316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1996e7-f6bf-4254-bb68-f6f746b1e78c None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:59.152617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1996e7-f6bf-4254-bb68-f6f746b1e78c None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:59.152888 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1996e7-f6bf-4254-bb68-f6f746b1e78c None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:59.153540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1996e7-f6bf-4254-bb68-f6f746b1e78c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:59.153986 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1996e7-f6bf-4254-bb68-f6f746b1e78c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:59.155387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1996e7-f6bf-4254-bb68-f6f746b1e78c None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:59.173059 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 264/517] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:59.173826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1996e7-f6bf-4254-bb68-f6f746b1e78c None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:59.201876 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:59.263257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b4170-5d21-4970-bec3-a71e927becf8 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:59.294328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1996e7-f6bf-4254-bb68-f6f746b1e78c None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:59.298203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1870288-0843-4597-8ddc-60c9dcdef878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:59.298820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1870288-0843-4597-8ddc-60c9dcdef878 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:59.299090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1870288-0843-4597-8ddc-60c9dcdef878 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:59.299358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1870288-0843-4597-8ddc-60c9dcdef878 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:59.336690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8568f8-e233-4412-b034-4e9d2ada22d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:59.337317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8568f8-e233-4412-b034-4e9d2ada22d9 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:59.337596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8568f8-e233-4412-b034-4e9d2ada22d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:59.337873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8568f8-e233-4412-b034-4e9d2ada22d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:59.338741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8568f8-e233-4412-b034-4e9d2ada22d9 None admin] RBAC: Adding query filter params (role.id=af03b67d56b44430ab9d48dcba18ace2, scope.project.id=1cd2efda8567437e983e3a7867ecd69b, user.id=6c70d5a72d424db68de7c7b8257fe02c) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:59.339087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8568f8-e233-4412-b034-4e9d2ada22d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:59.340652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8568f8-e233-4412-b034-4e9d2ada22d9 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:59.347143 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 265/518] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:52:59 2022] GET /identity/v3/role_assignments?user.id=6c70d5a72d424db68de7c7b8257fe02c&scope.project.id=1cd2efda8567437e983e3a7867ecd69b&role.id=af03b67d56b44430ab9d48dcba18ace2 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:52:59.348103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8568f8-e233-4412-b034-4e9d2ada22d9 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:59.357999 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:59.404844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1870288-0843-4597-8ddc-60c9dcdef878 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:59.406466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1870288-0843-4597-8ddc-60c9dcdef878 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:59.453060 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:59.467522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8568f8-e233-4412-b034-4e9d2ada22d9 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:59.509383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3804d2-cfcf-4792-936e-bf66b2522157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:59.510166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3804d2-cfcf-4792-936e-bf66b2522157 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:59.510518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3804d2-cfcf-4792-936e-bf66b2522157 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:59.510869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3804d2-cfcf-4792-936e-bf66b2522157 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:59.520681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3804d2-cfcf-4792-936e-bf66b2522157 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:59.521854 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 254/519] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:52:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:52:59.522203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3804d2-cfcf-4792-936e-bf66b2522157 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:59.527573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1870288-0843-4597-8ddc-60c9dcdef878 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:59.538192 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-cb3804d2-cfcf-4792-936e-bf66b2522157 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 00:52:59.538192 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:59.538192 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:59.538192 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:59.538192 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:59.538192 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:59.538192 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:59.538192 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:59.538192 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:59.538192 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:59.538192 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:59.538192 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:59.538192 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:52:59.538192 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:52:59.538192 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:52:59.538192 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:52:59.539172 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:59.539172 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:59.539172 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:52:59.539172 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:52:59.539172 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:52:59.539172 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:52:59.539172 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:59.539172 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:59.539172 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:59.539172 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:59.539172 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:59.539172 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:59.539172 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:59.539172 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:59.539172 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:59.539172 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:59.539172 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:59.539172 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:59.540106 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:59.540106 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:59.540106 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:52:59.540106 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:52:59.540106 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:52:59.540106 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:52:59.540106 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:52:59.540106 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:52:59.540106 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 00:52:59.540106 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:52:59.540106 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 266/520] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Aug 7 00:52:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:59.541212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3804d2-cfcf-4792-936e-bf66b2522157 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:59.624285 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:59.666004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1870288-0843-4597-8ddc-60c9dcdef878 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:59.673837 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3804d2-cfcf-4792-936e-bf66b2522157 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:59.714764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f9869-9930-4da7-8974-f7d9e104fe31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:59.715832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f9869-9930-4da7-8974-f7d9e104fe31 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:59.716339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f9869-9930-4da7-8974-f7d9e104fe31 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:59.716737 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f9869-9930-4da7-8974-f7d9e104fe31 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:59.723235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a1f46-ade5-47eb-aaec-29f29920c116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:59.724283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a1f46-ade5-47eb-aaec-29f29920c116 None admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:59.724761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a1f46-ade5-47eb-aaec-29f29920c116 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:59.725231 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a1f46-ade5-47eb-aaec-29f29920c116 None admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:59.726315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f9869-9930-4da7-8974-f7d9e104fe31 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:59.726494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a1f46-ade5-47eb-aaec-29f29920c116 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:59.728020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f9869-9930-4da7-8974-f7d9e104fe31 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:59.729023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a1f46-ade5-47eb-aaec-29f29920c116 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:52:59.741976 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-f51f9869-9930-4da7-8974-f7d9e104fe31 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 00:52:59.741976 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:52:59.741976 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:52:59.741976 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:52:59.741976 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:52:59.741976 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:52:59.741976 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:52:59.741976 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:52:59.741976 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:52:59.741976 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:52:59.741976 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:52:59.741976 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:52:59.741976 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:52:59.741976 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:52:59.741976 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:52:59.741976 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:52:59.742935 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:52:59.742935 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:52:59.742935 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:52:59.742935 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:52:59.742935 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:52:59.742935 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:52:59.742935 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:52:59.742935 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:52:59.742935 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:52:59.742935 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:52:59.742935 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:52:59.742935 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:52:59.742935 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:52:59.742935 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:52:59.742935 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:52:59.742935 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:52:59.742935 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:52:59.742935 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:52:59.743850 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:52:59.743850 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:52:59.743850 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:52:59.743850 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:52:59.743850 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:52:59.743850 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:52:59.743850 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:52:59.743850 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:52:59.743850 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 00:52:59.743850 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:52:59.743850 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 255/521] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:52:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:52:59.744433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f9869-9930-4da7-8974-f7d9e104fe31 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:59.747433 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:59.771374 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 267/522] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Aug 7 00:52:59 2022] POST /identity/v3/users => generated 247 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:52:59.785023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a1f46-ade5-47eb-aaec-29f29920c116 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:52:59.932527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a1f46-ade5-47eb-aaec-29f29920c116 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:59.945418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f9869-9930-4da7-8974-f7d9e104fe31 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:52:59.958782 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:52:59.982068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495db22-caf3-437e-b912-c2bd259ac2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:52:59.982592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495db22-caf3-437e-b912-c2bd259ac2cb None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:52:59.982911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495db22-caf3-437e-b912-c2bd259ac2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:52:59.983150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495db22-caf3-437e-b912-c2bd259ac2cb None admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:52:59.984481 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a495db22-caf3-437e-b912-c2bd259ac2cb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:52:59.984784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a495db22-caf3-437e-b912-c2bd259ac2cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:52:59.986256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a495db22-caf3-437e-b912-c2bd259ac2cb None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:00.013088 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 268/523] 10.222.0.39 () {56 vars in 1139 bytes} [Sun Aug 7 00:52:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:00.014031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495db22-caf3-437e-b912-c2bd259ac2cb None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:00.018752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a45ef-dc0d-4f81-8c87-a7d34937ed23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:00.019570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a45ef-dc0d-4f81-8c87-a7d34937ed23 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:00.020075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a45ef-dc0d-4f81-8c87-a7d34937ed23 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:00.020482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a45ef-dc0d-4f81-8c87-a7d34937ed23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:00.040890 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a45ef-dc0d-4f81-8c87-a7d34937ed23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:00.042789 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a45ef-dc0d-4f81-8c87-a7d34937ed23 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:00.058321 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-f63a45ef-dc0d-4f81-8c87-a7d34937ed23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:00.058321 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:00.058321 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:00.058321 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:00.058321 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:00.058321 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:00.058321 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:00.058321 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:00.058321 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:00.058321 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:00.058321 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:00.058321 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:00.058321 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:00.058321 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:00.058321 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:00.058321 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:00.059287 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:00.059287 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:00.059287 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:00.059287 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:00.059287 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:00.059287 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:00.059287 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:00.059287 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:00.059287 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:00.059287 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:00.059287 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:00.059287 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:00.059287 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:00.059287 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:00.059287 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:00.059287 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:00.059287 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:00.060216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:00.060216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:00.060216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:00.060216 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 256/524] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:52:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:00.061075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a45ef-dc0d-4f81-8c87-a7d34937ed23 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:00.147776 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:00.173746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495db22-caf3-437e-b912-c2bd259ac2cb None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:00.209933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a45ef-dc0d-4f81-8c87-a7d34937ed23 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:00.224245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969b294-85f2-4bd0-a4c1-8719dd4511ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:00.225087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969b294-85f2-4bd0-a4c1-8719dd4511ef None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:00.225361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969b294-85f2-4bd0-a4c1-8719dd4511ef None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:00.225701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969b294-85f2-4bd0-a4c1-8719dd4511ef None admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:00.226372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969b294-85f2-4bd0-a4c1-8719dd4511ef None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:00.226671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969b294-85f2-4bd0-a4c1-8719dd4511ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:00.228567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969b294-85f2-4bd0-a4c1-8719dd4511ef None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:00.254400 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 269/525] 10.222.0.39 () {56 vars in 1137 bytes} [Sun Aug 7 00:53:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:00.255437 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969b294-85f2-4bd0-a4c1-8719dd4511ef None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:00.258745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00c4c2-e86b-4f31-8037-bcd6520571e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:00.259781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00c4c2-e86b-4f31-8037-bcd6520571e7 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:00.260360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00c4c2-e86b-4f31-8037-bcd6520571e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:00.260878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00c4c2-e86b-4f31-8037-bcd6520571e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:00.299504 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:00.351484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00c4c2-e86b-4f31-8037-bcd6520571e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:00.353561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00c4c2-e86b-4f31-8037-bcd6520571e7 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:00.367209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969b294-85f2-4bd0-a4c1-8719dd4511ef None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:00.404138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8b606-743c-4d53-a311-efd047ce0b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:00.404864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8b606-743c-4d53-a311-efd047ce0b4f None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:00.405775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8b606-743c-4d53-a311-efd047ce0b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:00.405893 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8b606-743c-4d53-a311-efd047ce0b4f None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:00.406687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8b606-743c-4d53-a311-efd047ce0b4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:00.407015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8b606-743c-4d53-a311-efd047ce0b4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:00.409193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8b606-743c-4d53-a311-efd047ce0b4f None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:00.425194 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 270/526] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:00.426553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8b606-743c-4d53-a311-efd047ce0b4f None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:00.433429 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:00.500477 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 257/527] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:53:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:53:00.502039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00c4c2-e86b-4f31-8037-bcd6520571e7 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:00.544977 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:00.549472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8b606-743c-4d53-a311-efd047ce0b4f None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:00.605238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c78a8c-8feb-4ce3-a9df-8ff66570b458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:00.606729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c78a8c-8feb-4ce3-a9df-8ff66570b458 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:00.607431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c78a8c-8feb-4ce3-a9df-8ff66570b458 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:00.607947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c78a8c-8feb-4ce3-a9df-8ff66570b458 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:00.648800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00c4c2-e86b-4f31-8037-bcd6520571e7 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:00.693237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c78a8c-8feb-4ce3-a9df-8ff66570b458 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:00.695401 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c78a8c-8feb-4ce3-a9df-8ff66570b458 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:00.696788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e595ea-4041-4ac6-8719-7b21d7d39179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:00.697424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e595ea-4041-4ac6-8719-7b21d7d39179 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:00.697702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e595ea-4041-4ac6-8719-7b21d7d39179 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:00.697971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e595ea-4041-4ac6-8719-7b21d7d39179 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:00.708177 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e595ea-4041-4ac6-8719-7b21d7d39179 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:00.710095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e595ea-4041-4ac6-8719-7b21d7d39179 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:00.730433 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-09e595ea-4041-4ac6-8719-7b21d7d39179 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:00.730433 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:00.730433 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:00.730433 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:00.730433 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:00.730433 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:00.730433 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:00.730433 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:00.730433 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:00.730433 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:00.730433 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:00.730433 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:00.730433 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:53:00.730433 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:53:00.730433 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:53:00.731792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:53:00.731792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:00.731792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:00.731792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:00.731792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:00.731792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:00.731792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:00.731792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:00.731792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:00.731792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:00.731792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:00.731792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:00.731792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:00.731792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:00.731792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:00.731792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:00.731792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:00.732939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:53:00.732939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:53:00.732939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:53:00.732939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:53:00.732939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:53:00.732939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:53:00.732939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:00.732939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:00.732939 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 258/528] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:00.733404 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e595ea-4041-4ac6-8719-7b21d7d39179 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:00.759473 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:00.836365 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:00.844118 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 271/529] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:53:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:53:00.845466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c78a8c-8feb-4ce3-a9df-8ff66570b458 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:00.891110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e595ea-4041-4ac6-8719-7b21d7d39179 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:00.942947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5854be95-4f7d-4069-bd60-bba69841cfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:00.944206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854be95-4f7d-4069-bd60-bba69841cfb7 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:00.944748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854be95-4f7d-4069-bd60-bba69841cfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:00.945315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854be95-4f7d-4069-bd60-bba69841cfb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:00.959222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5854be95-4f7d-4069-bd60-bba69841cfb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:00.961362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5854be95-4f7d-4069-bd60-bba69841cfb7 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:00.991740 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-5854be95-4f7d-4069-bd60-bba69841cfb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:00.991740 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:00.991740 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:00.991740 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:00.991740 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:00.991740 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:00.991740 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:00.991740 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:00.991740 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:00.991740 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:00.991740 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:00.991740 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:00.991740 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:00.991740 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:00.991740 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:00.991740 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:00.993494 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:00.993494 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:00.993494 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:00.993494 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:00.993494 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:00.993494 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:00.993494 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:00.993494 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:00.993494 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:00.993494 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:00.993494 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:00.993494 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:00.993494 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:00.993494 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:00.993494 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:00.993494 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:00.993494 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:00.994713 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:00.994713 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:00.994713 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:00.997893 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 259/530] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:00.999052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5854be95-4f7d-4069-bd60-bba69841cfb7 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:01.004716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c78a8c-8feb-4ce3-a9df-8ff66570b458 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:01.047124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3455ce-0e39-42f3-86c1-151246d1ddbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:01.048287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3455ce-0e39-42f3-86c1-151246d1ddbe None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:01.048814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3455ce-0e39-42f3-86c1-151246d1ddbe None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:01.049306 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3455ce-0e39-42f3-86c1-151246d1ddbe None admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:01.050410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3455ce-0e39-42f3-86c1-151246d1ddbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:01.050945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3455ce-0e39-42f3-86c1-151246d1ddbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:01.052695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3455ce-0e39-42f3-86c1-151246d1ddbe None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:01.076109 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 272/531] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:53:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:01.077933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3455ce-0e39-42f3-86c1-151246d1ddbe None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:01.086861 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:01.128066 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5854be95-4f7d-4069-bd60-bba69841cfb7 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:01.157751 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:01.166415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831e045-84a4-4a51-886a-6517acd98d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:01.167056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831e045-84a4-4a51-886a-6517acd98d73 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:01.167334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831e045-84a4-4a51-886a-6517acd98d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:01.167610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831e045-84a4-4a51-886a-6517acd98d73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:01.180064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831e045-84a4-4a51-886a-6517acd98d73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:01.181552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831e045-84a4-4a51-886a-6517acd98d73 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:01.197627 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-3831e045-84a4-4a51-886a-6517acd98d73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:01.197627 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:01.197627 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:01.197627 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:01.197627 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:01.197627 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:01.197627 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:01.197627 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:01.197627 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:01.197627 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:01.197627 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:01.197627 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:01.197627 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:01.197627 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:01.197627 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:01.197627 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:01.198629 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:01.198629 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:01.198629 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:01.198629 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:01.198629 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:01.198629 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:01.198629 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:01.198629 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:01.198629 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:01.198629 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:01.198629 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:01.198629 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:01.198629 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:01.198629 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:01.198629 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:01.198629 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:01.198629 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:01.199490 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:01.199490 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:01.199490 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:01.199490 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 260/532] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:01.200231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831e045-84a4-4a51-886a-6517acd98d73 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:01.214246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3455ce-0e39-42f3-86c1-151246d1ddbe None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:01.256338 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d1ad8-7c7b-4ef0-8aab-e518f8d033e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:01.257398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d1ad8-7c7b-4ef0-8aab-e518f8d033e8 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:01.257901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d1ad8-7c7b-4ef0-8aab-e518f8d033e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:01.258384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d1ad8-7c7b-4ef0-8aab-e518f8d033e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:01.259312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d1ad8-7c7b-4ef0-8aab-e518f8d033e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:01.259839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d1ad8-7c7b-4ef0-8aab-e518f8d033e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:01.261648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d1ad8-7c7b-4ef0-8aab-e518f8d033e8 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:01.282643 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 273/533] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:01.284055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d1ad8-7c7b-4ef0-8aab-e518f8d033e8 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:01.321936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831e045-84a4-4a51-886a-6517acd98d73 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:01.341215 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:01.360501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92343310-454e-4a7f-91bc-6b0c247fcb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:01.361090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92343310-454e-4a7f-91bc-6b0c247fcb7c None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:01.361368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92343310-454e-4a7f-91bc-6b0c247fcb7c None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:01.361643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92343310-454e-4a7f-91bc-6b0c247fcb7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:01.362407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92343310-454e-4a7f-91bc-6b0c247fcb7c None admin] RBAC: Adding query filter params (role.id=af03b67d56b44430ab9d48dcba18ace2, scope.project.id=1cd2efda8567437e983e3a7867ecd69b, user.id=bcb60ac015204436b81971694393380c) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:01.362718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92343310-454e-4a7f-91bc-6b0c247fcb7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:01.364197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92343310-454e-4a7f-91bc-6b0c247fcb7c None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:01.370352 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 261/534] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:53:01 2022] GET /identity/v3/role_assignments?user.id=bcb60ac015204436b81971694393380c&scope.project.id=1cd2efda8567437e983e3a7867ecd69b&role.id=af03b67d56b44430ab9d48dcba18ace2 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:01.371259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92343310-454e-4a7f-91bc-6b0c247fcb7c None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:01.456235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d1ad8-7c7b-4ef0-8aab-e518f8d033e8 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:01.481090 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:01.522029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a316d-de01-474e-8507-507bc459bc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:01.522642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a316d-de01-474e-8507-507bc459bc53 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:01.523133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a316d-de01-474e-8507-507bc459bc53 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:01.523606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a316d-de01-474e-8507-507bc459bc53 None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:01.524535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a316d-de01-474e-8507-507bc459bc53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:01.525083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a316d-de01-474e-8507-507bc459bc53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:01.528917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a316d-de01-474e-8507-507bc459bc53 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:01.539548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92343310-454e-4a7f-91bc-6b0c247fcb7c None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:01.554176 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 274/535] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:01.565780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a316d-de01-474e-8507-507bc459bc53 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:01.648825 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3f285-0b6c-4573-b480-3b0e6edb1994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:01.649927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3f285-0b6c-4573-b480-3b0e6edb1994 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:01.650449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3f285-0b6c-4573-b480-3b0e6edb1994 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:01.651003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3f285-0b6c-4573-b480-3b0e6edb1994 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:01.662591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3f285-0b6c-4573-b480-3b0e6edb1994 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:01.664465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3f285-0b6c-4573-b480-3b0e6edb1994 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:01.693962 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-b3d3f285-0b6c-4573-b480-3b0e6edb1994 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:01.693962 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:01.693962 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:01.693962 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:01.693962 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:01.693962 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:01.693962 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:01.693962 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:01.693962 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:01.693962 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:01.693962 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:01.693962 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:01.693962 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:53:01.693962 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:53:01.693962 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:53:01.694891 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:53:01.694891 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:01.694891 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:01.694891 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:01.694891 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:01.694891 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:01.694891 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:01.694891 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:01.694891 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:01.694891 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:01.694891 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:01.694891 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:01.694891 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:01.694891 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:01.694891 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:01.694891 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:01.694891 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:01.695800 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:53:01.695800 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:53:01.695800 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:53:01.695800 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:53:01.695800 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:53:01.695800 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:53:01.695800 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:01.695800 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:01.700554 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 262/536] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:01.713671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4712a2-a716-4b50-a4d7-7a75b6f4a708 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:01.714362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4712a2-a716-4b50-a4d7-7a75b6f4a708 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:01.714861 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4712a2-a716-4b50-a4d7-7a75b6f4a708 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:01.717015 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 263/537] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:01.718684 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4712a2-a716-4b50-a4d7-7a75b6f4a708 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:01.820896 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a316d-de01-474e-8507-507bc459bc53 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:01.823840 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:01.908710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4712a2-a716-4b50-a4d7-7a75b6f4a708 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:01.930075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e006c3b-4817-40da-bea9-0b385f3bfc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:01.931669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e006c3b-4817-40da-bea9-0b385f3bfc5f None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:01.932810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e006c3b-4817-40da-bea9-0b385f3bfc5f None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:01.933498 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e006c3b-4817-40da-bea9-0b385f3bfc5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:01.965798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e006c3b-4817-40da-bea9-0b385f3bfc5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:01.966975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a8c36-016c-4537-87b2-e65c17a8392f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:01.969368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e006c3b-4817-40da-bea9-0b385f3bfc5f None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:01.970240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a8c36-016c-4537-87b2-e65c17a8392f None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:01.970697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a8c36-016c-4537-87b2-e65c17a8392f None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:01.971145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a8c36-016c-4537-87b2-e65c17a8392f None admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:01.972104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a8c36-016c-4537-87b2-e65c17a8392f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:01.972590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a8c36-016c-4537-87b2-e65c17a8392f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:01.974732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a8c36-016c-4537-87b2-e65c17a8392f None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:02.002873 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-3e006c3b-4817-40da-bea9-0b385f3bfc5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:02.002873 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:02.002873 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:02.002873 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:02.002873 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:02.002873 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:02.002873 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:02.002873 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:02.002873 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:02.002873 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:02.002873 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:02.002873 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:02.002873 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:53:02.002873 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:53:02.002873 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:53:02.003806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:53:02.003806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:02.003806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:02.003806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:02.003806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:02.003806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:02.003806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:02.003806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:02.003806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:02.003806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:02.003806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:02.003806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:02.003806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:02.003806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:02.003806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:02.003806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:02.003806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:02.004708 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:53:02.004708 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:53:02.004708 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:53:02.004708 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:53:02.004708 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:53:02.004708 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:53:02.004708 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:02.004708 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:02.016228 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 275/538] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 445 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:02.018044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31d6f9-4438-421b-ae0e-8deea7e74ab4 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:02.018622 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 264/539] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:53:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:02.019809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a8c36-016c-4537-87b2-e65c17a8392f None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:02.020351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31d6f9-4438-421b-ae0e-8deea7e74ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:02.021235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31d6f9-4438-421b-ae0e-8deea7e74ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:02.064832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-af31d6f9-4438-421b-ae0e-8deea7e74ab4 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:02.067303 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-af31d6f9-4438-421b-ae0e-8deea7e74ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:02.125348 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:02.180203 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 276/540] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:53:02.181831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31d6f9-4438-421b-ae0e-8deea7e74ab4 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:02.200680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a8c36-016c-4537-87b2-e65c17a8392f None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:02.204237 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:02.271918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261890ff-4601-4485-8297-b0c2d5f20075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:02.272801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261890ff-4601-4485-8297-b0c2d5f20075 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:02.273132 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261890ff-4601-4485-8297-b0c2d5f20075 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:02.273399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261890ff-4601-4485-8297-b0c2d5f20075 None admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:02.274138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261890ff-4601-4485-8297-b0c2d5f20075 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:02.274433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261890ff-4601-4485-8297-b0c2d5f20075 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:02.275881 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261890ff-4601-4485-8297-b0c2d5f20075 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:02.296010 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 265/541] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:53:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:02.296010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261890ff-4601-4485-8297-b0c2d5f20075 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:02.361338 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31d6f9-4438-421b-ae0e-8deea7e74ab4 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:02.434497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423235f-1d6a-4b9b-9b6f-2adef00a801a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:02.435400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423235f-1d6a-4b9b-9b6f-2adef00a801a None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:02.435990 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423235f-1d6a-4b9b-9b6f-2adef00a801a None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:02.437613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423235f-1d6a-4b9b-9b6f-2adef00a801a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:02.438789 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423235f-1d6a-4b9b-9b6f-2adef00a801a None admin] RBAC: Adding query filter params (role.id=af03b67d56b44430ab9d48dcba18ace2, scope.project.id=1cd2efda8567437e983e3a7867ecd69b, user.id=b219e01934fa477fbaa053cca586f01b) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:02.439135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423235f-1d6a-4b9b-9b6f-2adef00a801a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:02.441165 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423235f-1d6a-4b9b-9b6f-2adef00a801a None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:02.448937 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 277/542] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:53:02 2022] GET /identity/v3/role_assignments?user.id=b219e01934fa477fbaa053cca586f01b&scope.project.id=1cd2efda8567437e983e3a7867ecd69b&role.id=af03b67d56b44430ab9d48dcba18ace2 => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:02.449881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423235f-1d6a-4b9b-9b6f-2adef00a801a None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:02.484403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261890ff-4601-4485-8297-b0c2d5f20075 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:02.519934 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:02.540812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc01f6a-45bb-40e7-b4a7-68f900e06203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:02.542676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc01f6a-45bb-40e7-b4a7-68f900e06203 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:02.543270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc01f6a-45bb-40e7-b4a7-68f900e06203 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:02.543750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc01f6a-45bb-40e7-b4a7-68f900e06203 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:02.561069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc01f6a-45bb-40e7-b4a7-68f900e06203 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:53:02.567481 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-3cc01f6a-45bb-40e7-b4a7-68f900e06203 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:02.567481 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:02.567481 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:02.567481 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:02.567481 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:02.567481 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:02.567481 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:02.567481 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:02.567481 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:02.567481 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:02.567481 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:02.567481 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:02.567481 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:53:02.567481 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:53:02.567481 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:53:02.567481 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:53:02.568668 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:53:02.568668 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:53:02.568668 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:53:02.568668 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:53:02.568668 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:02.568668 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:02.568668 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:02.568668 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:02.568668 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:02.568668 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:02.568668 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:02.568668 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:02.568668 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:02.568668 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:02.568668 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:02.568668 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:02.569508 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:02.569508 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:02.569508 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:02.569508 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:02.569508 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:53:02.569508 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:53:02.569508 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:53:02.569508 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:53:02.569508 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:53:02.569508 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:53:02.569508 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:02.569508 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:02.572162 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 266/543] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Aug 7 00:53:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:02.573785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf56654-164e-4755-8ab9-d480a499e7c8 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:02.574430 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf56654-164e-4755-8ab9-d480a499e7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:02.574912 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf56654-164e-4755-8ab9-d480a499e7c8 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:02.581066 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 267/544] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:02.583413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714b16d-1c67-414f-ad1a-252aa0c6b0c5 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:02.584068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714b16d-1c67-414f-ad1a-252aa0c6b0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:02.584609 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714b16d-1c67-414f-ad1a-252aa0c6b0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:02.605964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c714b16d-1c67-414f-ad1a-252aa0c6b0c5 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:02.607590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c714b16d-1c67-414f-ad1a-252aa0c6b0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:02.641502 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:02.689516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423235f-1d6a-4b9b-9b6f-2adef00a801a None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:02.733133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e24ab-f1d0-4d0c-b0e1-41ae7110b23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:02.733770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e24ab-f1d0-4d0c-b0e1-41ae7110b23a None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:02.734064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e24ab-f1d0-4d0c-b0e1-41ae7110b23a None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:02.734340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e24ab-f1d0-4d0c-b0e1-41ae7110b23a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:02.735639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e24ab-f1d0-4d0c-b0e1-41ae7110b23a None admin] RBAC: Adding query filter params (role.id=af03b67d56b44430ab9d48dcba18ace2, scope.project.id=1cd2efda8567437e983e3a7867ecd69b, user.id=9a8be18e03a54bd8821ed5c048bbc793) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:02.735639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e24ab-f1d0-4d0c-b0e1-41ae7110b23a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:02.737015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e24ab-f1d0-4d0c-b0e1-41ae7110b23a None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:02.743852 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 278/545] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:53:02 2022] GET /identity/v3/role_assignments?user.id=9a8be18e03a54bd8821ed5c048bbc793&scope.project.id=1cd2efda8567437e983e3a7867ecd69b&role.id=af03b67d56b44430ab9d48dcba18ace2 => generated 259 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:02.744891 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e24ab-f1d0-4d0c-b0e1-41ae7110b23a None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:02.759518 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 268/546] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:53:02.798686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714b16d-1c67-414f-ad1a-252aa0c6b0c5 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:02.899753 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e24ab-f1d0-4d0c-b0e1-41ae7110b23a None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:02.904304 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:02.984703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736d323-9228-45c9-9ed3-c3425871eeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:02.985437 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736d323-9228-45c9-9ed3-c3425871eeb0 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:02.985797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736d323-9228-45c9-9ed3-c3425871eeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:02.986152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736d323-9228-45c9-9ed3-c3425871eeb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:02.986987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736d323-9228-45c9-9ed3-c3425871eeb0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:02.987373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736d323-9228-45c9-9ed3-c3425871eeb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:02.989054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736d323-9228-45c9-9ed3-c3425871eeb0 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:03.015190 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 279/547] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Aug 7 00:53:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:03.025010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736d323-9228-45c9-9ed3-c3425871eeb0 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:03.046284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714b16d-1c67-414f-ad1a-252aa0c6b0c5 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:03.105723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90cdac-da1a-401a-9a51-3654bb165ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:03.111317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90cdac-da1a-401a-9a51-3654bb165ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:03.111949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90cdac-da1a-401a-9a51-3654bb165ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:03.112427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90cdac-da1a-401a-9a51-3654bb165ed2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:03.131468 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90cdac-da1a-401a-9a51-3654bb165ed2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:53:03.137572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-6d90cdac-da1a-401a-9a51-3654bb165ed2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:03.137572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:03.137572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:03.137572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:03.137572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:03.137572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:03.137572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:03.137572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:03.137572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:03.137572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:03.137572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:03.137572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:03.137572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:53:03.137572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:53:03.137572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:53:03.137572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:53:03.138524 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:53:03.138524 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:53:03.138524 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:53:03.138524 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:53:03.138524 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:03.138524 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:03.138524 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:03.138524 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:03.138524 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:03.138524 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:03.138524 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:03.138524 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:03.138524 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:03.138524 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:03.138524 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:03.138524 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:03.139301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:03.139301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:03.139301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:03.139301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:03.139301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:53:03.139301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:53:03.139301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:53:03.139301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:53:03.139301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:53:03.139301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:53:03.139301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:03.139301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:03.151010 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 269/548] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Aug 7 00:53:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:03.156744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90cdac-da1a-401a-9a51-3654bb165ed2 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:03.190084 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:03.220646 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736d323-9228-45c9-9ed3-c3425871eeb0 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:03.288960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb0d36-d542-4ceb-b285-c2895b99632d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:03.290044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb0d36-d542-4ceb-b285-c2895b99632d None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:03.290517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb0d36-d542-4ceb-b285-c2895b99632d None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:03.290977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb0d36-d542-4ceb-b285-c2895b99632d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:03.310859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb0d36-d542-4ceb-b285-c2895b99632d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:03.314504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb0d36-d542-4ceb-b285-c2895b99632d None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:03.341719 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-7ddb0d36-d542-4ceb-b285-c2895b99632d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:03.341719 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:03.341719 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:03.341719 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:03.341719 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:03.341719 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:03.341719 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:03.341719 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:03.341719 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:03.341719 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:03.341719 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:03.341719 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:03.341719 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:03.341719 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:03.341719 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:03.341719 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:03.343244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:03.343244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:03.343244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:03.343244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:03.343244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:03.343244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:03.343244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:03.343244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:03.343244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:03.343244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:03.343244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:03.343244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:03.343244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:03.343244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:03.343244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:03.343244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:03.343244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:03.344332 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:03.344332 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:03.344332 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:03.351283 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 280/549] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:03.358007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb0d36-d542-4ceb-b285-c2895b99632d None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:03.382040 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:03.393932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90cdac-da1a-401a-9a51-3654bb165ed2 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:03.466092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cc453-27c4-4899-abd3-6df931908267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:03.468019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cc453-27c4-4899-abd3-6df931908267 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:03.471439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cc453-27c4-4899-abd3-6df931908267 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:03.471972 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cc453-27c4-4899-abd3-6df931908267 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:03.472906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530cc453-27c4-4899-abd3-6df931908267 None admin] RBAC: Adding query filter params (name=service) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:03.473412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530cc453-27c4-4899-abd3-6df931908267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:03.475069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530cc453-27c4-4899-abd3-6df931908267 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:03.490738 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 270/550] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Aug 7 00:53:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:03.498010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cc453-27c4-4899-abd3-6df931908267 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:03.579039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb0d36-d542-4ceb-b285-c2895b99632d None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:03.649235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99490fd7-c870-4944-85d9-060ef761d9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:03.650315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99490fd7-c870-4944-85d9-060ef761d9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:03.650809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99490fd7-c870-4944-85d9-060ef761d9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:03.651302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99490fd7-c870-4944-85d9-060ef761d9a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:03.652576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99490fd7-c870-4944-85d9-060ef761d9a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:03.653112 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99490fd7-c870-4944-85d9-060ef761d9a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:03.656400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99490fd7-c870-4944-85d9-060ef761d9a2 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:03.679943 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:03.691666 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 281/551] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:03.697303 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99490fd7-c870-4944-85d9-060ef761d9a2 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:03.739501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cc453-27c4-4899-abd3-6df931908267 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:03.801805 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:03.826263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205330e0-ad90-4582-890c-0ea97b7880c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:03.827192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205330e0-ad90-4582-890c-0ea97b7880c0 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:03.827688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205330e0-ad90-4582-890c-0ea97b7880c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:03.828136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205330e0-ad90-4582-890c-0ea97b7880c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:03.866946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205330e0-ad90-4582-890c-0ea97b7880c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:03.869751 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205330e0-ad90-4582-890c-0ea97b7880c0 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:03.878915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99490fd7-c870-4944-85d9-060ef761d9a2 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:03.893099 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-205330e0-ad90-4582-890c-0ea97b7880c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:03.893099 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:03.893099 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:03.893099 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:03.893099 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:03.893099 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:03.893099 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:03.893099 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:03.893099 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:03.893099 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:03.893099 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:03.893099 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:03.893099 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:03.893099 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:03.893099 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:03.893099 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:03.894176 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:03.894176 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:03.894176 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:03.894176 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:03.894176 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:03.894176 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:03.894176 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:03.894176 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:03.894176 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:03.894176 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:03.894176 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:03.894176 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:03.894176 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:03.894176 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:03.894176 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:03.894176 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:03.894176 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:03.895120 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:03.895120 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:03.895120 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:03.900016 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 271/552] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:03.902338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e199a0c-a2bd-4531-b581-7ea53481eccb None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:03.902830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e199a0c-a2bd-4531-b581-7ea53481eccb None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:03.903244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e199a0c-a2bd-4531-b581-7ea53481eccb None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:03.906319 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 272/553] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:03.907596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e199a0c-a2bd-4531-b581-7ea53481eccb None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:03.938966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d614d4-751f-46ab-a688-a3dfb1247b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:03.939767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d614d4-751f-46ab-a688-a3dfb1247b1e None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:03.940082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d614d4-751f-46ab-a688-a3dfb1247b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:03.940354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d614d4-751f-46ab-a688-a3dfb1247b1e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:03.949130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d614d4-751f-46ab-a688-a3dfb1247b1e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:03.950785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d614d4-751f-46ab-a688-a3dfb1247b1e None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:03.966431 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-b9d614d4-751f-46ab-a688-a3dfb1247b1e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:53:03.966431 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:03.966431 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:03.966431 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:03.966431 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:03.966431 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:03.966431 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:03.966431 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:03.966431 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:03.966431 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:03.966431 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:03.966431 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:03.966431 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:53:03.966431 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:53:03.966431 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:53:03.966431 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:53:03.969707 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:03.969707 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:03.969707 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:53:03.969707 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:03.969707 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:53:03.969707 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:03.969707 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:03.969707 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:03.969707 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:03.969707 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:03.969707 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:03.969707 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:03.969707 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:03.969707 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:03.969707 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:03.969707 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:03.969707 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:03.969707 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:03.971746 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:03.971746 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:03.971746 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:53:03.971746 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:53:03.971746 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:53:03.971746 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:53:03.971746 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:53:03.971746 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:53:03.971746 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:53:03.971746 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:03.971746 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 282/554] 10.222.0.39 () {56 vars in 1093 bytes} [Sun Aug 7 00:53:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:53:03.971746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028720c-35e0-422f-9b49-e8656743ea76 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:03.971746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028720c-35e0-422f-9b49-e8656743ea76 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:03.973443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028720c-35e0-422f-9b49-e8656743ea76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:03.998901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7028720c-35e0-422f-9b49-e8656743ea76 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:04.000688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7028720c-35e0-422f-9b49-e8656743ea76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:04.089162 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 283/555] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:53:04.096263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028720c-35e0-422f-9b49-e8656743ea76 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:04.109492 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e199a0c-a2bd-4531-b581-7ea53481eccb None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:04.153530 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:04.171928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7b5d8-8732-4c88-ac1d-18bcc659e256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:04.172959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7b5d8-8732-4c88-ac1d-18bcc659e256 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:04.173692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7b5d8-8732-4c88-ac1d-18bcc659e256 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:04.174201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7b5d8-8732-4c88-ac1d-18bcc659e256 None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:04.175588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7b5d8-8732-4c88-ac1d-18bcc659e256 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:04.176458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7b5d8-8732-4c88-ac1d-18bcc659e256 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:04.178068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7b5d8-8732-4c88-ac1d-18bcc659e256 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:04.199717 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 273/556] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:04.201546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7b5d8-8732-4c88-ac1d-18bcc659e256 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:04.231157 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:04.292209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028720c-35e0-422f-9b49-e8656743ea76 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:04.352363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5907aa-361f-4d73-bf7c-2139924b987f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:04.353345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5907aa-361f-4d73-bf7c-2139924b987f None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:04.353792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5907aa-361f-4d73-bf7c-2139924b987f None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:04.354311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5907aa-361f-4d73-bf7c-2139924b987f None admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:04.355623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5907aa-361f-4d73-bf7c-2139924b987f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:04.356154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5907aa-361f-4d73-bf7c-2139924b987f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:04.358770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5907aa-361f-4d73-bf7c-2139924b987f None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:04.373985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7b5d8-8732-4c88-ac1d-18bcc659e256 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:04.392680 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 284/557] 10.222.0.39 () {56 vars in 1133 bytes} [Sun Aug 7 00:53:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:04.394315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5907aa-361f-4d73-bf7c-2139924b987f None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:04.420540 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393413a4-0c37-48b6-b62d-4e4902775abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:04.421948 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393413a4-0c37-48b6-b62d-4e4902775abf None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:04.422435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393413a4-0c37-48b6-b62d-4e4902775abf None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:04.422952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393413a4-0c37-48b6-b62d-4e4902775abf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:04.439144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393413a4-0c37-48b6-b62d-4e4902775abf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:53:04.445118 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-393413a4-0c37-48b6-b62d-4e4902775abf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:04.445118 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:04.445118 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:04.445118 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:04.445118 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:04.445118 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:04.445118 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:04.445118 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:04.445118 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:04.445118 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:04.445118 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:04.445118 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:04.445118 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:53:04.445118 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:53:04.445118 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:53:04.445118 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:53:04.446595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:53:04.446595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:53:04.446595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:53:04.446595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:53:04.446595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:04.446595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:04.446595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:04.446595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:04.446595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:04.446595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:04.446595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:04.446595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:04.446595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:04.446595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:04.446595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:04.446595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:04.447424 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:04.447424 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:04.447424 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:04.447424 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:04.447424 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:53:04.447424 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:53:04.447424 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:53:04.447424 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:53:04.447424 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:53:04.447424 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:53:04.447424 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:04.447424 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:04.455128 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 274/558] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Aug 7 00:53:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:04.455128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393413a4-0c37-48b6-b62d-4e4902775abf None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:04.556029 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:04.578557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5907aa-361f-4d73-bf7c-2139924b987f None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:04.609190 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:04.646647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393413a4-0c37-48b6-b62d-4e4902775abf None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:04.649696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e179cf9-37e0-40d0-8075-f96a4204b50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:04.652412 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e179cf9-37e0-40d0-8075-f96a4204b50b None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:04.652911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e179cf9-37e0-40d0-8075-f96a4204b50b None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:04.653404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e179cf9-37e0-40d0-8075-f96a4204b50b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:04.667306 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e179cf9-37e0-40d0-8075-f96a4204b50b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:04.669301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e179cf9-37e0-40d0-8075-f96a4204b50b None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:04.684030 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-6e179cf9-37e0-40d0-8075-f96a4204b50b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:53:04.684030 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:04.684030 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:04.684030 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:04.684030 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:04.684030 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:04.684030 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:04.684030 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:04.684030 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:04.684030 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:04.684030 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:04.684030 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:04.684030 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:53:04.684030 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:53:04.684030 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:53:04.684030 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:53:04.685010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:04.685010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:04.685010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:53:04.685010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:04.685010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:53:04.685010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:04.685010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:04.685010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:04.685010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:04.685010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:04.685010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:04.685010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:04.685010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:04.685010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:04.685010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:04.685010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:04.685010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:04.685010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:04.686041 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:04.686041 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:04.686041 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:53:04.686041 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:53:04.686041 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:53:04.686041 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:53:04.686041 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:53:04.686041 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:53:04.686041 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:53:04.686041 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:04.692213 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 285/559] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:53:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:04.693603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e179cf9-37e0-40d0-8075-f96a4204b50b None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:04.715626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae2880-66ec-4e89-b4bc-0be45256694d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:04.717224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae2880-66ec-4e89-b4bc-0be45256694d None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:04.718866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae2880-66ec-4e89-b4bc-0be45256694d None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:04.719382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae2880-66ec-4e89-b4bc-0be45256694d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:04.737803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae2880-66ec-4e89-b4bc-0be45256694d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:04.741037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae2880-66ec-4e89-b4bc-0be45256694d None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:04.759705 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-74ae2880-66ec-4e89-b4bc-0be45256694d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:04.759705 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:04.759705 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:04.759705 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:04.759705 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:04.759705 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:04.759705 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:04.759705 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:04.759705 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:04.759705 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:04.759705 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:04.759705 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:04.759705 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:04.759705 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:04.759705 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:04.759705 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:04.760911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:04.760911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:04.760911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:04.760911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:04.760911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:04.760911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:04.760911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:04.760911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:04.760911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:04.760911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:04.760911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:04.760911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:04.760911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:04.760911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:04.760911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:04.760911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:04.760911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:04.762018 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:04.762018 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:04.762018 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:04.763768 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 275/560] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:04.765432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae2880-66ec-4e89-b4bc-0be45256694d None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:04.879104 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:04.884195 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae2880-66ec-4e89-b4bc-0be45256694d None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:04.887612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e179cf9-37e0-40d0-8075-f96a4204b50b None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:04.930889 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61c016-d1e4-4988-a714-c170171b5a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:04.931912 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61c016-d1e4-4988-a714-c170171b5a9d None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:04.932300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515c4f1-9c6c-499d-9ef7-ab4e5e26e33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:04.932442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61c016-d1e4-4988-a714-c170171b5a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:04.932856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61c016-d1e4-4988-a714-c170171b5a9d None admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:04.932954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515c4f1-9c6c-499d-9ef7-ab4e5e26e33a None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:04.933172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515c4f1-9c6c-499d-9ef7-ab4e5e26e33a None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:04.933445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515c4f1-9c6c-499d-9ef7-ab4e5e26e33a None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:04.934173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515c4f1-9c6c-499d-9ef7-ab4e5e26e33a None admin] RBAC: Adding query filter params (name=service) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:04.934270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc61c016-d1e4-4988-a714-c170171b5a9d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:04.934432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515c4f1-9c6c-499d-9ef7-ab4e5e26e33a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:04.934723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc61c016-d1e4-4988-a714-c170171b5a9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:04.935813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c515c4f1-9c6c-499d-9ef7-ab4e5e26e33a None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:04.937371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc61c016-d1e4-4988-a714-c170171b5a9d None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:04.949609 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 286/561] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Aug 7 00:53:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:04.949609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bf270-8881-4157-a01f-43088c81ee06 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:04.949609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bf270-8881-4157-a01f-43088c81ee06 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:04.949609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bf270-8881-4157-a01f-43088c81ee06 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:04.953676 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 287/562] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:04.954538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bf270-8881-4157-a01f-43088c81ee06 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:04.968832 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 276/563] 10.222.0.39 () {56 vars in 1135 bytes} [Sun Aug 7 00:53:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:04.970055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61c016-d1e4-4988-a714-c170171b5a9d None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:05.020778 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:05.094899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61c016-d1e4-4988-a714-c170171b5a9d None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:05.114807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bf270-8881-4157-a01f-43088c81ee06 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:05.135925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca7d48-cf25-443e-adbb-6992ebaa6cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:05.136565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca7d48-cf25-443e-adbb-6992ebaa6cbe None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:05.136866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca7d48-cf25-443e-adbb-6992ebaa6cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:05.137117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca7d48-cf25-443e-adbb-6992ebaa6cbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:05.149185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca7d48-cf25-443e-adbb-6992ebaa6cbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:05.150816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca7d48-cf25-443e-adbb-6992ebaa6cbe None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:05.166626 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-bbca7d48-cf25-443e-adbb-6992ebaa6cbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:05.166626 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:05.166626 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:05.166626 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:05.166626 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:05.166626 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:05.166626 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:05.166626 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:05.166626 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:05.166626 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:05.166626 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:05.166626 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:05.166626 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:05.166626 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:05.166626 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:05.166626 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:05.167728 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:05.167728 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:05.167728 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:05.167728 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:05.167728 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:05.167728 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:05.167728 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:05.167728 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:05.167728 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:05.167728 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:05.167728 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:05.167728 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:05.167728 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:05.167728 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:05.167728 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:05.167728 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:05.167728 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:05.169084 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:05.169084 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:05.169084 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:05.169084 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 277/564] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:05.169084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf596f-73b3-4fea-872b-0369d081ca7d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:05.169389 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf596f-73b3-4fea-872b-0369d081ca7d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:05.169726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf596f-73b3-4fea-872b-0369d081ca7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:05.176048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967219ee-9f0d-4f55-a270-a52e19ae2170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:05.176947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967219ee-9f0d-4f55-a270-a52e19ae2170 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:05.177273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967219ee-9f0d-4f55-a270-a52e19ae2170 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:05.177536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967219ee-9f0d-4f55-a270-a52e19ae2170 None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:05.178207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967219ee-9f0d-4f55-a270-a52e19ae2170 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:05.178503 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967219ee-9f0d-4f55-a270-a52e19ae2170 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:05.179959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967219ee-9f0d-4f55-a270-a52e19ae2170 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:05.193265 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 288/565] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:05.194036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967219ee-9f0d-4f55-a270-a52e19ae2170 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:05.199216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ddaf596f-73b3-4fea-872b-0369d081ca7d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:05.201068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ddaf596f-73b3-4fea-872b-0369d081ca7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:05.204861 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:05.303939 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 278/566] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:53:05.303939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf596f-73b3-4fea-872b-0369d081ca7d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:05.326880 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:05.332029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967219ee-9f0d-4f55-a270-a52e19ae2170 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:05.382877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff37f38-ee9a-446a-a6e7-fcf2b1270d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:05.383683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff37f38-ee9a-446a-a6e7-fcf2b1270d62 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:05.384140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff37f38-ee9a-446a-a6e7-fcf2b1270d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:05.384556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff37f38-ee9a-446a-a6e7-fcf2b1270d62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:05.439957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf596f-73b3-4fea-872b-0369d081ca7d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:05.471426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff37f38-ee9a-446a-a6e7-fcf2b1270d62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:05.472934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff37f38-ee9a-446a-a6e7-fcf2b1270d62 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:05.486687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd727fd-ea0a-42a6-8a4a-9c9ffa752a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:05.487295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd727fd-ea0a-42a6-8a4a-9c9ffa752a08 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:05.487567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd727fd-ea0a-42a6-8a4a-9c9ffa752a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:05.487832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd727fd-ea0a-42a6-8a4a-9c9ffa752a08 None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:05.488510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd727fd-ea0a-42a6-8a4a-9c9ffa752a08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:05.488822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd727fd-ea0a-42a6-8a4a-9c9ffa752a08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:05.490692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd727fd-ea0a-42a6-8a4a-9c9ffa752a08 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:05.497957 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:05.504809 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 279/567] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:05.505659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd727fd-ea0a-42a6-8a4a-9c9ffa752a08 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:05.614329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd727fd-ea0a-42a6-8a4a-9c9ffa752a08 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:05.627672 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:05.634305 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 289/568] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:53:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:53:05.636562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0071f-35c3-41d8-9731-6398ec27f6b9 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:05.637273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0071f-35c3-41d8-9731-6398ec27f6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:05.638040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0071f-35c3-41d8-9731-6398ec27f6b9 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:05.646669 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 290/569] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:05 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:05.647802 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0071f-35c3-41d8-9731-6398ec27f6b9 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:05.651292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514aace-214f-4f36-9305-68cc3f2da0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:05.651948 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514aace-214f-4f36-9305-68cc3f2da0ab None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:05.652221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514aace-214f-4f36-9305-68cc3f2da0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:05.652485 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514aace-214f-4f36-9305-68cc3f2da0ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:05.661264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514aace-214f-4f36-9305-68cc3f2da0ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:05.662699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514aace-214f-4f36-9305-68cc3f2da0ab None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:05.674758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-4514aace-214f-4f36-9305-68cc3f2da0ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:05.674758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:05.674758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:05.674758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:05.674758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:05.674758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:05.674758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:05.674758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:05.674758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:05.674758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:05.674758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:05.674758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:05.674758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:53:05.674758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:53:05.674758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:53:05.675694 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:53:05.675694 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:05.675694 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:05.675694 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:05.675694 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:05.675694 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:05.675694 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:05.675694 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:05.675694 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:05.675694 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:05.675694 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:05.675694 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:05.675694 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:05.675694 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:05.675694 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:05.675694 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:05.675694 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:05.676647 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:53:05.676647 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:53:05.676647 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:53:05.676647 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:53:05.676647 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:53:05.676647 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:53:05.676647 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:05.676647 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:05.676647 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 280/570] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:05.676647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514aace-214f-4f36-9305-68cc3f2da0ab None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:05.744156 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:05.774633 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0071f-35c3-41d8-9731-6398ec27f6b9 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:05.791969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514aace-214f-4f36-9305-68cc3f2da0ab None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:05.809757 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d8004-f4b8-40d5-906c-e90f6c6d9700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:05.810377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d8004-f4b8-40d5-906c-e90f6c6d9700 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:05.810651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d8004-f4b8-40d5-906c-e90f6c6d9700 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:05.810919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d8004-f4b8-40d5-906c-e90f6c6d9700 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:05.823283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d8004-f4b8-40d5-906c-e90f6c6d9700 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:53:05.827607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a28ce-7f69-4fe4-8b83-ca9a3c2c0066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:05.828267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a28ce-7f69-4fe4-8b83-ca9a3c2c0066 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:05.828541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a28ce-7f69-4fe4-8b83-ca9a3c2c0066 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:05.828703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-8c9d8004-f4b8-40d5-906c-e90f6c6d9700 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:05.828703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:05.828703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:05.828703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:05.828703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:05.828703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:05.828703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:05.828703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:05.828703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:05.828703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:05.828703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:05.828703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:05.828703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:53:05.828703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:53:05.828703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:53:05.828703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:53:05.830213 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:53:05.830213 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:53:05.830213 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:53:05.830213 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:53:05.830213 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:05.830213 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:05.830213 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:05.830213 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:05.830213 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:05.830213 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:05.830213 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:05.830213 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:05.830213 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:05.830213 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:05.830213 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:05.830213 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:05.831823 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:05.831823 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:05.831823 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:05.831823 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:05.831823 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:53:05.831823 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:53:05.831823 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:53:05.831823 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:53:05.831823 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:53:05.831823 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:53:05.831823 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:05.831823 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:05.834735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a28ce-7f69-4fe4-8b83-ca9a3c2c0066 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:05.834968 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 291/571] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Aug 7 00:53:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:05.834968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d8004-f4b8-40d5-906c-e90f6c6d9700 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:05.845080 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a28ce-7f69-4fe4-8b83-ca9a3c2c0066 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:05.846879 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a28ce-7f69-4fe4-8b83-ca9a3c2c0066 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:05.863370 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-d03a28ce-7f69-4fe4-8b83-ca9a3c2c0066 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 07 00:53:05.863370 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:05.863370 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:05.863370 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:05.863370 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:05.863370 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:05.863370 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:05.863370 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:05.863370 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:05.863370 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:05.863370 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:05.863370 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:05.863370 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:53:05.863370 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:53:05.863370 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:53:05.863370 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:53:05.865689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:05.865689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:05.865689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:53:05.865689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:05.865689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:53:05.865689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:05.865689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:05.865689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:05.865689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:05.865689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:05.865689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:05.865689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:05.865689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:05.865689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:05.865689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:05.865689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:05.865689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:05.865689 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:05.867561 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:05.867561 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:05.867561 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:53:05.867561 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:53:05.867561 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:53:05.867561 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:53:05.867561 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:53:05.867561 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:53:05.867561 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 07 00:53:05.867561 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:05.867561 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 281/572] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:53:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:05.876586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13660ae-acd7-4ab4-a449-25dd8ef68973 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:05.876864 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13660ae-acd7-4ab4-a449-25dd8ef68973 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:05.877133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13660ae-acd7-4ab4-a449-25dd8ef68973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:05.906120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f13660ae-acd7-4ab4-a449-25dd8ef68973 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:05.908048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f13660ae-acd7-4ab4-a449-25dd8ef68973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:05.914734 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:05.967028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d8004-f4b8-40d5-906c-e90f6c6d9700 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:05.995279 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 282/573] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:53:05.996095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13660ae-acd7-4ab4-a449-25dd8ef68973 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:06.015413 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb7588-02e2-49fb-a440-4ad9ccc338f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:06.016097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb7588-02e2-49fb-a440-4ad9ccc338f7 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:06.016376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb7588-02e2-49fb-a440-4ad9ccc338f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:06.016648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb7588-02e2-49fb-a440-4ad9ccc338f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:06.028396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb7588-02e2-49fb-a440-4ad9ccc338f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:06.030098 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb7588-02e2-49fb-a440-4ad9ccc338f7 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:06.046991 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-3efb7588-02e2-49fb-a440-4ad9ccc338f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:06.046991 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:06.046991 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:06.046991 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:06.046991 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:06.046991 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:06.046991 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:06.046991 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:06.046991 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:06.046991 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:06.046991 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:06.046991 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:06.046991 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:06.046991 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:06.046991 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:06.046991 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:06.048092 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:06.048092 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:06.048092 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:06.048092 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:06.048092 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:06.048092 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:06.048092 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:06.048092 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:06.048092 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:06.048092 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:06.048092 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:06.048092 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:06.048092 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:06.048092 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:06.048092 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:06.048092 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:06.048092 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:06.049504 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:06.049504 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:06.049504 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:06.049504 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 292/574] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:06.049504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb7588-02e2-49fb-a440-4ad9ccc338f7 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:06.057756 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:06.122648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13660ae-acd7-4ab4-a449-25dd8ef68973 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:06.158942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a6ce4-0701-42e2-81aa-dcd40010a9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:06.159539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a6ce4-0701-42e2-81aa-dcd40010a9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:06.159813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a6ce4-0701-42e2-81aa-dcd40010a9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:06.160107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a6ce4-0701-42e2-81aa-dcd40010a9f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:06.160814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a6ce4-0701-42e2-81aa-dcd40010a9f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:06.161119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a6ce4-0701-42e2-81aa-dcd40010a9f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:06.162553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a6ce4-0701-42e2-81aa-dcd40010a9f8 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:06.168022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb7588-02e2-49fb-a440-4ad9ccc338f7 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:06.175767 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 283/575] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:53:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:06.176829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a6ce4-0701-42e2-81aa-dcd40010a9f8 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:06.190460 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:06.222365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01f705-27fd-4a36-bf5a-b7984f336e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:06.223327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01f705-27fd-4a36-bf5a-b7984f336e0f None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:06.223794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01f705-27fd-4a36-bf5a-b7984f336e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:06.224276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01f705-27fd-4a36-bf5a-b7984f336e0f None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:06.225416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01f705-27fd-4a36-bf5a-b7984f336e0f None admin] RBAC: Adding query filter params (name=service) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:06.225951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01f705-27fd-4a36-bf5a-b7984f336e0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:06.228379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01f705-27fd-4a36-bf5a-b7984f336e0f None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:06.240265 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 293/576] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Aug 7 00:53:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:06.241495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01f705-27fd-4a36-bf5a-b7984f336e0f None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:06.333941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a6ce4-0701-42e2-81aa-dcd40010a9f8 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:06.343323 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:06.363101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01f705-27fd-4a36-bf5a-b7984f336e0f None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:06.376591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4d39d-d85a-4324-8eeb-81e6e14e099c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:06.377536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4d39d-d85a-4324-8eeb-81e6e14e099c None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:06.377986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4d39d-d85a-4324-8eeb-81e6e14e099c None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:06.378429 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4d39d-d85a-4324-8eeb-81e6e14e099c None admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:06.379552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4d39d-d85a-4324-8eeb-81e6e14e099c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:06.380085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4d39d-d85a-4324-8eeb-81e6e14e099c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:06.382534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4d39d-d85a-4324-8eeb-81e6e14e099c None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:06.411082 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 284/577] 10.222.0.39 () {56 vars in 1137 bytes} [Sun Aug 7 00:53:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:06.412044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4d39d-d85a-4324-8eeb-81e6e14e099c None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:06.423509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5d52f-4759-4304-a73c-67a28123046e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:06.424232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5d52f-4759-4304-a73c-67a28123046e None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:06.424507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5d52f-4759-4304-a73c-67a28123046e None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:06.424782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5d52f-4759-4304-a73c-67a28123046e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:06.436013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa5d52f-4759-4304-a73c-67a28123046e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:53:06.441945 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-baa5d52f-4759-4304-a73c-67a28123046e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:06.441945 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:06.441945 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:06.441945 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:06.441945 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:06.441945 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:06.441945 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:06.441945 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:06.441945 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:06.441945 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:06.441945 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:06.441945 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:06.441945 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:53:06.441945 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:53:06.441945 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:53:06.441945 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:53:06.442944 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:53:06.442944 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:53:06.442944 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:53:06.442944 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:53:06.442944 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:06.442944 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:06.442944 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:06.442944 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:06.442944 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:06.442944 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:06.442944 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:06.442944 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:06.442944 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:06.442944 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:06.442944 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:06.442944 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:06.443851 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:06.443851 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:06.443851 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:06.443851 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:06.443851 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:53:06.443851 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:53:06.443851 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:53:06.443851 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:53:06.443851 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:53:06.443851 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:53:06.443851 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:06.443851 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:06.443851 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 294/578] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Aug 7 00:53:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:06.443851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5d52f-4759-4304-a73c-67a28123046e None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:06.484162 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:06.533667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4d39d-d85a-4324-8eeb-81e6e14e099c None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:06.557630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5d52f-4759-4304-a73c-67a28123046e None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:06.569794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec597601-bf30-4507-b02a-9cc43c2ef07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:06.570398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec597601-bf30-4507-b02a-9cc43c2ef07e None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:06.570683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec597601-bf30-4507-b02a-9cc43c2ef07e None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:06.570949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec597601-bf30-4507-b02a-9cc43c2ef07e None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:06.571603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec597601-bf30-4507-b02a-9cc43c2ef07e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:06.571918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec597601-bf30-4507-b02a-9cc43c2ef07e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:06.573292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec597601-bf30-4507-b02a-9cc43c2ef07e None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:06.593543 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 285/579] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:06.594357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec597601-bf30-4507-b02a-9cc43c2ef07e None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:06.596198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d484e74-40de-423b-889b-0843623a847a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:06.597033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d484e74-40de-423b-889b-0843623a847a None admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:06.597470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d484e74-40de-423b-889b-0843623a847a None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:06.597745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d484e74-40de-423b-889b-0843623a847a None admin] PATH_INFO: `/v3/projects/1cd2efda8567437e983e3a7867ecd69b/users/6c70d5a72d424db68de7c7b8257fe02c/roles/af03b67d56b44430ab9d48dcba18ace2` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:06.613960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d484e74-40de-423b-889b-0843623a847a None admin] RBAC: Authorizing `identity:create_grant(project_id=1cd2efda8567437e983e3a7867ecd69b, user_id=6c70d5a72d424db68de7c7b8257fe02c, role_id=af03b67d56b44430ab9d48dcba18ace2)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:06.615434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d484e74-40de-423b-889b-0843623a847a None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:06.625370 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:06.630208 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 295/580] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Aug 7 00:53:06 2022] PUT /identity/v3/projects/1cd2efda8567437e983e3a7867ecd69b/users/6c70d5a72d424db68de7c7b8257fe02c/roles/af03b67d56b44430ab9d48dcba18ace2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:53:06.631060 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d484e74-40de-423b-889b-0843623a847a None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:06.740210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec597601-bf30-4507-b02a-9cc43c2ef07e None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:06.746064 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:06.769271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d484e74-40de-423b-889b-0843623a847a None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:06.783049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf438c5-ce60-40c7-96a2-5da76f133c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:06.783995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf438c5-ce60-40c7-96a2-5da76f133c35 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:06.784456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf438c5-ce60-40c7-96a2-5da76f133c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:06.784876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf438c5-ce60-40c7-96a2-5da76f133c35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:06.797735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf438c5-ce60-40c7-96a2-5da76f133c35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:06.799477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf438c5-ce60-40c7-96a2-5da76f133c35 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:06.814463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc0b8c-7875-47a4-88cb-ccd1fe648eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:06.815103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc0b8c-7875-47a4-88cb-ccd1fe648eda None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:06.815383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc0b8c-7875-47a4-88cb-ccd1fe648eda None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:06.815662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc0b8c-7875-47a4-88cb-ccd1fe648eda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:06.817396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-cbf438c5-ce60-40c7-96a2-5da76f133c35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:06.817396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:06.817396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:06.817396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:06.817396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:06.817396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:06.817396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:06.817396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:06.817396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:06.817396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:06.817396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:06.817396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:06.817396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:06.817396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:06.817396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:06.817396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:06.818424 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:06.818424 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:06.818424 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:06.818424 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:06.818424 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:06.818424 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:06.818424 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:06.818424 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:06.818424 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:06.818424 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:06.818424 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:06.818424 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:06.818424 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:06.818424 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:06.818424 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:06.818424 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:06.818424 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:06.819915 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:06.819915 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:06.819915 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:06.819915 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 286/581] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:06.819915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf438c5-ce60-40c7-96a2-5da76f133c35 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:06.837865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc0b8c-7875-47a4-88cb-ccd1fe648eda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:06.839374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc0b8c-7875-47a4-88cb-ccd1fe648eda None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:06.858686 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-64fc0b8c-7875-47a4-88cb-ccd1fe648eda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:06.858686 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:06.858686 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:06.858686 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:06.858686 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:06.858686 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:06.858686 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:06.858686 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:06.858686 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:06.858686 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:06.858686 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:06.858686 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:06.858686 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:06.858686 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:06.858686 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:06.858686 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:06.859681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:06.859681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:06.859681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:06.859681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:06.859681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:06.859681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:06.859681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:06.859681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:06.859681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:06.859681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:06.859681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:06.859681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:06.859681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:06.859681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:06.859681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:06.859681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:06.859681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:06.860619 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:06.860619 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:06.860619 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:06.860619 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 296/582] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:06.860619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc0b8c-7875-47a4-88cb-ccd1fe648eda None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:06.940594 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:06.979463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf438c5-ce60-40c7-96a2-5da76f133c35 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:07.026250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc0b8c-7875-47a4-88cb-ccd1fe648eda None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:07.030796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0d18a-2eb6-4381-a624-8903b45b9286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:07.031776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0d18a-2eb6-4381-a624-8903b45b9286 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:07.032240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0d18a-2eb6-4381-a624-8903b45b9286 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:07.032669 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0d18a-2eb6-4381-a624-8903b45b9286 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:07.033508 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0d18a-2eb6-4381-a624-8903b45b9286 None admin] RBAC: Adding query filter params (name=service) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:07.033982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0d18a-2eb6-4381-a624-8903b45b9286 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:07.035622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0d18a-2eb6-4381-a624-8903b45b9286 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:07.046841 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 287/583] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Aug 7 00:53:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:07.047797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0d18a-2eb6-4381-a624-8903b45b9286 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:07.075822 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf6b00-7dd5-4d3a-9138-63702e7f8a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:07.076660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf6b00-7dd5-4d3a-9138-63702e7f8a6c None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:07.076846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf6b00-7dd5-4d3a-9138-63702e7f8a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:07.077149 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf6b00-7dd5-4d3a-9138-63702e7f8a6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:07.080982 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:07.086893 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf6b00-7dd5-4d3a-9138-63702e7f8a6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:07.088963 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf6b00-7dd5-4d3a-9138-63702e7f8a6c None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:07.102566 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-cfbf6b00-7dd5-4d3a-9138-63702e7f8a6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:07.102566 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:07.102566 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:07.102566 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:07.102566 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:07.102566 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:07.102566 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:07.102566 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:07.102566 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:07.102566 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:07.102566 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:07.102566 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:07.102566 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:53:07.102566 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:53:07.102566 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:53:07.103570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:53:07.103570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:07.103570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:07.103570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:07.103570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:07.103570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:07.103570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:07.103570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:07.103570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:07.103570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:07.103570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:07.103570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:07.103570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:07.103570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:07.103570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:07.103570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:07.103570 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:07.105078 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:53:07.105078 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:53:07.105078 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:53:07.105078 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:53:07.105078 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:53:07.105078 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:53:07.105078 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:07.105078 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:07.105078 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 297/584] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:07.105078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf6b00-7dd5-4d3a-9138-63702e7f8a6c None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:07.184812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0d18a-2eb6-4381-a624-8903b45b9286 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:07.225078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7adc27-e85e-4df2-9cbc-60af35dbca3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:07.225692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7adc27-e85e-4df2-9cbc-60af35dbca3c None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:07.225969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7adc27-e85e-4df2-9cbc-60af35dbca3c None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:07.226239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7adc27-e85e-4df2-9cbc-60af35dbca3c None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:07.226954 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7adc27-e85e-4df2-9cbc-60af35dbca3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:07.227319 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7adc27-e85e-4df2-9cbc-60af35dbca3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:07.228738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7adc27-e85e-4df2-9cbc-60af35dbca3c None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:07.238765 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:07.246978 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 288/585] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:07.248050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7adc27-e85e-4df2-9cbc-60af35dbca3c None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:07.266212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf6b00-7dd5-4d3a-9138-63702e7f8a6c None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:07.320183 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09869398-dc7b-494f-b871-a644b08c005b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:07.320809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09869398-dc7b-494f-b871-a644b08c005b None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:07.321088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09869398-dc7b-494f-b871-a644b08c005b None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:07.321357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09869398-dc7b-494f-b871-a644b08c005b None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:07.322057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09869398-dc7b-494f-b871-a644b08c005b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:07.322353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09869398-dc7b-494f-b871-a644b08c005b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:07.323793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09869398-dc7b-494f-b871-a644b08c005b None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:07.342284 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 298/586] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:07.343836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09869398-dc7b-494f-b871-a644b08c005b None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:07.370239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7adc27-e85e-4df2-9cbc-60af35dbca3c None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:07.415735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0d740-d335-4cc6-bb88-62da533fd47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:07.416513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0d740-d335-4cc6-bb88-62da533fd47d None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:07.416784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0d740-d335-4cc6-bb88-62da533fd47d None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:07.417135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0d740-d335-4cc6-bb88-62da533fd47d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:07.428915 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:07.442203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0d740-d335-4cc6-bb88-62da533fd47d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:07.446161 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0d740-d335-4cc6-bb88-62da533fd47d None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:07.465968 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-6bd0d740-d335-4cc6-bb88-62da533fd47d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:07.465968 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:07.465968 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:07.465968 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:07.465968 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:07.465968 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:07.465968 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:07.465968 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:07.465968 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:07.465968 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:07.465968 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:07.465968 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:07.465968 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:07.465968 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:07.465968 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:07.465968 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:07.476053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:07.476053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:07.476053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:07.476053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:07.476053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:07.476053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:07.476053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:07.476053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:07.476053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:07.476053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:07.476053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:07.476053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:07.476053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:07.476053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:07.476053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:07.476053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:07.476053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:07.478071 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:07.478071 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:07.478071 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:07.478071 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 289/587] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:07.478071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0d740-d335-4cc6-bb88-62da533fd47d None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:07.495471 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09869398-dc7b-494f-b871-a644b08c005b None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:07.540659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303be2e8-c6be-43cf-bc25-a107d072915b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:07.541261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303be2e8-c6be-43cf-bc25-a107d072915b None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:07.541543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303be2e8-c6be-43cf-bc25-a107d072915b None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:07.541807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303be2e8-c6be-43cf-bc25-a107d072915b None admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:07.542482 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:07.542632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303be2e8-c6be-43cf-bc25-a107d072915b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:07.542795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303be2e8-c6be-43cf-bc25-a107d072915b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:07.544279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303be2e8-c6be-43cf-bc25-a107d072915b None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:07.560298 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 299/588] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:53:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:07.561389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303be2e8-c6be-43cf-bc25-a107d072915b None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:07.600779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0d740-d335-4cc6-bb88-62da533fd47d None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:07.640898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc672c-4ddf-4305-b0c8-32efce09f879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:07.641760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc672c-4ddf-4305-b0c8-32efce09f879 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:07.642042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc672c-4ddf-4305-b0c8-32efce09f879 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:07.642364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc672c-4ddf-4305-b0c8-32efce09f879 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:07.651423 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc672c-4ddf-4305-b0c8-32efce09f879 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:07.653086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc672c-4ddf-4305-b0c8-32efce09f879 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:07.667009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-61cc672c-4ddf-4305-b0c8-32efce09f879 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 00:53:07.667009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:07.667009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:07.667009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:07.667009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:07.667009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:07.667009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:07.667009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:07.667009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:07.667009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:07.667009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:07.667009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:07.667009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:53:07.667009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:53:07.667009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:53:07.667009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:53:07.668777 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:07.668777 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:07.668777 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:53:07.668777 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:07.668777 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:53:07.668777 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:07.668777 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:07.668777 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:07.668777 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:07.668777 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:07.668777 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:07.668777 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:07.668777 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:07.668777 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:07.668777 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:07.668777 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:07.668777 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:07.668777 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:07.670737 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:07.670737 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:07.670737 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:53:07.670737 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:53:07.670737 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:53:07.670737 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:53:07.670737 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:53:07.670737 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:53:07.670737 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 00:53:07.670737 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:07.670737 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 290/589] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Aug 7 00:53:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:07.670737 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc672c-4ddf-4305-b0c8-32efce09f879 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:07.689162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303be2e8-c6be-43cf-bc25-a107d072915b None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:07.709313 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:07.732764 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa6e4e-6fee-41fd-a890-9357910b94d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:07.733637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa6e4e-6fee-41fd-a890-9357910b94d9 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:07.734009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa6e4e-6fee-41fd-a890-9357910b94d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:07.734346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa6e4e-6fee-41fd-a890-9357910b94d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:07.742479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa6e4e-6fee-41fd-a890-9357910b94d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:07.743987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa6e4e-6fee-41fd-a890-9357910b94d9 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:07.756294 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-3afa6e4e-6fee-41fd-a890-9357910b94d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:07.756294 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:07.756294 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:07.756294 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:07.756294 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:07.756294 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:07.756294 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:07.756294 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:07.756294 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:07.756294 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:07.756294 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:07.756294 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:07.756294 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:53:07.756294 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:53:07.756294 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:53:07.757251 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:53:07.757251 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:07.757251 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:07.757251 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:07.757251 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:07.757251 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:07.757251 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:07.757251 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:07.757251 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:07.757251 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:07.757251 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:07.757251 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:07.757251 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:07.757251 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:07.757251 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:07.757251 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:07.757251 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:07.758183 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:53:07.758183 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:53:07.758183 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:53:07.758183 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:53:07.758183 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:53:07.758183 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:53:07.758183 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:07.758183 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:07.758183 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 300/590] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:07.758676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa6e4e-6fee-41fd-a890-9357910b94d9 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:07.815606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc672c-4ddf-4305-b0c8-32efce09f879 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:07.839944 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:07.877968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a8b41-861c-4efd-b339-7340083bced4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:07.879017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a8b41-861c-4efd-b339-7340083bced4 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:07.879509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a8b41-861c-4efd-b339-7340083bced4 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:07.880015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a8b41-861c-4efd-b339-7340083bced4 None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:07.881202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a8b41-861c-4efd-b339-7340083bced4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:07.881709 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a8b41-861c-4efd-b339-7340083bced4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:07.884317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a8b41-861c-4efd-b339-7340083bced4 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:07.887785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa6e4e-6fee-41fd-a890-9357910b94d9 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:07.908532 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 291/591] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:07.913228 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a8b41-861c-4efd-b339-7340083bced4 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:07.958068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c3057-e890-4d11-bf5e-8e6d2cc39431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:07.959073 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c3057-e890-4d11-bf5e-8e6d2cc39431 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:07.959601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c3057-e890-4d11-bf5e-8e6d2cc39431 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:07.961408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c3057-e890-4d11-bf5e-8e6d2cc39431 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:07.961408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c3057-e890-4d11-bf5e-8e6d2cc39431 None admin] RBAC: Adding query filter params (role.id=af03b67d56b44430ab9d48dcba18ace2, scope.project.id=1cd2efda8567437e983e3a7867ecd69b, user.id=fb5a86da594046ed97745371176decf7) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:07.961852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c3057-e890-4d11-bf5e-8e6d2cc39431 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:07.965026 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c3057-e890-4d11-bf5e-8e6d2cc39431 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:07.974835 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 301/592] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:53:07 2022] GET /identity/v3/role_assignments?user.id=fb5a86da594046ed97745371176decf7&scope.project.id=1cd2efda8567437e983e3a7867ecd69b&role.id=af03b67d56b44430ab9d48dcba18ace2 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:07.975854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c3057-e890-4d11-bf5e-8e6d2cc39431 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:08.038431 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:08.094853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a8b41-861c-4efd-b339-7340083bced4 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:08.118136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c3057-e890-4d11-bf5e-8e6d2cc39431 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:08.143521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee00fc-b130-4c8c-bb68-9eba050605ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:08.144853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee00fc-b130-4c8c-bb68-9eba050605ec None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:08.145317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee00fc-b130-4c8c-bb68-9eba050605ec None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:08.146016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee00fc-b130-4c8c-bb68-9eba050605ec None admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:08.147691 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee00fc-b130-4c8c-bb68-9eba050605ec None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:08.148566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee00fc-b130-4c8c-bb68-9eba050605ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:08.150568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee00fc-b130-4c8c-bb68-9eba050605ec None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:08.164879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ef535-809d-4b47-9654-c4b820a520bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:08.165788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ef535-809d-4b47-9654-c4b820a520bf None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:08.166272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ef535-809d-4b47-9654-c4b820a520bf None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:08.166687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ef535-809d-4b47-9654-c4b820a520bf None admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:08.167570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ef535-809d-4b47-9654-c4b820a520bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:08.168102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ef535-809d-4b47-9654-c4b820a520bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:08.169743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ef535-809d-4b47-9654-c4b820a520bf None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:08.175456 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 292/593] 10.222.0.39 () {56 vars in 1139 bytes} [Sun Aug 7 00:53:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:08.176529 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee00fc-b130-4c8c-bb68-9eba050605ec None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:08.193151 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 302/594] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:53:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:08.193151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ef535-809d-4b47-9654-c4b820a520bf None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:08.234356 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:08.328253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee00fc-b130-4c8c-bb68-9eba050605ec None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:08.367582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a00b4-2a2b-482c-9bcc-355b2bd4a7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:08.368527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a00b4-2a2b-482c-9bcc-355b2bd4a7ba None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:08.368967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a00b4-2a2b-482c-9bcc-355b2bd4a7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:08.369388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a00b4-2a2b-482c-9bcc-355b2bd4a7ba None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:08.372732 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:08.378971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a00b4-2a2b-482c-9bcc-355b2bd4a7ba None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:08.380772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a00b4-2a2b-482c-9bcc-355b2bd4a7ba None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:08.382102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ef535-809d-4b47-9654-c4b820a520bf None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:08.394725 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-893a00b4-2a2b-482c-9bcc-355b2bd4a7ba None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 00:53:08.394725 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:08.394725 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:08.394725 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:08.394725 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:08.394725 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:08.394725 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:08.394725 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:08.394725 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:08.394725 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:08.394725 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:08.394725 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:08.394725 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:53:08.394725 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:53:08.394725 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:53:08.394725 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:53:08.396563 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:08.396563 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:08.396563 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:53:08.396563 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:08.396563 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:53:08.396563 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:08.396563 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:08.396563 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:08.396563 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:08.396563 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:08.396563 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:08.396563 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:08.396563 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:08.396563 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:08.396563 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:08.396563 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:08.396563 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:08.396563 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:08.398594 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:08.398594 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:08.398594 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:53:08.398594 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:53:08.398594 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:53:08.398594 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:53:08.398594 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:53:08.398594 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:53:08.398594 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 00:53:08.398594 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:08.400374 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 293/595] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:53:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:08.401109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a00b4-2a2b-482c-9bcc-355b2bd4a7ba None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:08.458926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68768db-e2ac-4308-8f61-ce2e3aae4d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:08.461170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68768db-e2ac-4308-8f61-ce2e3aae4d97 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:08.461932 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68768db-e2ac-4308-8f61-ce2e3aae4d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:08.463197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68768db-e2ac-4308-8f61-ce2e3aae4d97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:08.491077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68768db-e2ac-4308-8f61-ce2e3aae4d97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:08.496814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68768db-e2ac-4308-8f61-ce2e3aae4d97 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:08.526030 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:08.538814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a00b4-2a2b-482c-9bcc-355b2bd4a7ba None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:08.544468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-d68768db-e2ac-4308-8f61-ce2e3aae4d97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:08.544468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:08.544468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:08.544468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:08.544468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:08.544468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:08.544468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:08.544468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:08.544468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:08.544468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:08.544468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:08.544468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:08.544468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:08.544468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:08.544468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:08.544468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:08.546754 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:08.546754 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:08.546754 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:08.546754 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:08.546754 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:08.546754 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:08.546754 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:08.546754 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:08.546754 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:08.546754 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:08.546754 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:08.546754 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:08.546754 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:08.546754 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:08.546754 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:08.546754 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:08.546754 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:08.548521 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:08.548521 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:08.548521 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:08.550170 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 303/596] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:08.550813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68768db-e2ac-4308-8f61-ce2e3aae4d97 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:08.582366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72f8dd-168f-4ea2-b5ea-44d2743272b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:08.583031 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72f8dd-168f-4ea2-b5ea-44d2743272b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:08.583370 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72f8dd-168f-4ea2-b5ea-44d2743272b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:08.583726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72f8dd-168f-4ea2-b5ea-44d2743272b7 None admin] PATH_INFO: `/v3/projects/1cd2efda8567437e983e3a7867ecd69b/users/bcb60ac015204436b81971694393380c/roles/af03b67d56b44430ab9d48dcba18ace2` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:08.607936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72f8dd-168f-4ea2-b5ea-44d2743272b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=1cd2efda8567437e983e3a7867ecd69b, user_id=bcb60ac015204436b81971694393380c, role_id=af03b67d56b44430ab9d48dcba18ace2)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:08.609943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72f8dd-168f-4ea2-b5ea-44d2743272b7 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:08.626827 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 294/597] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Aug 7 00:53:08 2022] PUT /identity/v3/projects/1cd2efda8567437e983e3a7867ecd69b/users/bcb60ac015204436b81971694393380c/roles/af03b67d56b44430ab9d48dcba18ace2 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:53:08.628751 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72f8dd-168f-4ea2-b5ea-44d2743272b7 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:08.842930 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68768db-e2ac-4308-8f61-ce2e3aae4d97 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:08.867716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72f8dd-168f-4ea2-b5ea-44d2743272b7 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:08.912031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23657047-d4c7-483e-9334-425aef0eed91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:08.913452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23657047-d4c7-483e-9334-425aef0eed91 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:08.914319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23657047-d4c7-483e-9334-425aef0eed91 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:08.915060 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23657047-d4c7-483e-9334-425aef0eed91 None admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:08.916877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23657047-d4c7-483e-9334-425aef0eed91 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:08.917739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23657047-d4c7-483e-9334-425aef0eed91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:08.920636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23657047-d4c7-483e-9334-425aef0eed91 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:08.933470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a45317-e8f0-4b50-884f-d4f31cc1e4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:08.934096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a45317-e8f0-4b50-884f-d4f31cc1e4eb None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:08.934478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a45317-e8f0-4b50-884f-d4f31cc1e4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:08.934753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a45317-e8f0-4b50-884f-d4f31cc1e4eb None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:08.935402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a45317-e8f0-4b50-884f-d4f31cc1e4eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:08.935759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a45317-e8f0-4b50-884f-d4f31cc1e4eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:08.937920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a45317-e8f0-4b50-884f-d4f31cc1e4eb None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:08.959579 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 304/598] 10.222.0.39 () {56 vars in 1137 bytes} [Sun Aug 7 00:53:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:08.960441 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:08.961104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ae538-29d5-4d19-960d-52c36d89523f None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:08.961386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ae538-29d5-4d19-960d-52c36d89523f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:08.961667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ae538-29d5-4d19-960d-52c36d89523f None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:08.967091 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 305/599] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:08.968592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ae538-29d5-4d19-960d-52c36d89523f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:08.990989 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 295/600] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:08.993334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb0668-51e0-4fb0-b74a-edaa27c77985 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:08.993945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb0668-51e0-4fb0-b74a-edaa27c77985 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:08.994548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb0668-51e0-4fb0-b74a-edaa27c77985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:08.995125 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:09.020133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6fcb0668-51e0-4fb0-b74a-edaa27c77985 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:09.021722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6fcb0668-51e0-4fb0-b74a-edaa27c77985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:09.124945 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 296/601] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:53:09.124945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb0668-51e0-4fb0-b74a-edaa27c77985 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:09.179680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ae538-29d5-4d19-960d-52c36d89523f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:09.266035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34fd5e-6e53-4b38-8734-e5b1fba64318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:09.267854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34fd5e-6e53-4b38-8734-e5b1fba64318 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:09.268402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34fd5e-6e53-4b38-8734-e5b1fba64318 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:09.268878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34fd5e-6e53-4b38-8734-e5b1fba64318 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:09.287933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb0668-51e0-4fb0-b74a-edaa27c77985 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:09.292645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34fd5e-6e53-4b38-8734-e5b1fba64318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:09.294437 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34fd5e-6e53-4b38-8734-e5b1fba64318 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:09.313228 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-7f34fd5e-6e53-4b38-8734-e5b1fba64318 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:09.313228 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:09.313228 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:09.313228 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:09.313228 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:09.313228 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:09.313228 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:09.313228 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:09.313228 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:09.313228 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:09.313228 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:09.313228 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:09.313228 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:09.313228 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:09.313228 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:09.313228 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:09.314267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:09.314267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:09.314267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:09.314267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:09.314267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:09.314267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:09.314267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:09.314267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:09.314267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:09.314267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:09.314267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:09.314267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:09.314267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:09.314267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:09.314267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:09.314267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:09.314267 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:09.315208 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:09.315208 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:09.315208 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:09.316841 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 306/602] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:09.318312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34fd5e-6e53-4b38-8734-e5b1fba64318 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:09.357360 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:09.368829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d7063-45c0-45f3-b62a-2cfd95ae3c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:09.370181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d7063-45c0-45f3-b62a-2cfd95ae3c0d None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:09.370516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d7063-45c0-45f3-b62a-2cfd95ae3c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:09.370998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d7063-45c0-45f3-b62a-2cfd95ae3c0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:09.384808 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d7063-45c0-45f3-b62a-2cfd95ae3c0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:09.387627 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d7063-45c0-45f3-b62a-2cfd95ae3c0d None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:09.402707 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:09.416959 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-0e4d7063-45c0-45f3-b62a-2cfd95ae3c0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:09.416959 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:09.416959 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:09.416959 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:09.416959 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:09.416959 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:09.416959 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:09.416959 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:09.416959 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:09.416959 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:09.416959 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:09.416959 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:09.416959 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:53:09.416959 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:53:09.416959 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:53:09.417971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:53:09.417971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:09.417971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:09.417971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:09.417971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:09.417971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:09.417971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:09.417971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:09.417971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:09.417971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:09.417971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:09.417971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:09.417971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:09.417971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:09.417971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:09.417971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:09.417971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:09.418905 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:53:09.418905 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:53:09.418905 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:53:09.418905 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:53:09.418905 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:53:09.418905 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:53:09.418905 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:09.418905 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:09.419455 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 297/603] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:09.421599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d7063-45c0-45f3-b62a-2cfd95ae3c0d None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:09.454614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34fd5e-6e53-4b38-8734-e5b1fba64318 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:09.494045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa847d-8864-42da-ae13-507d43378a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:09.495411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa847d-8864-42da-ae13-507d43378a07 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:09.496098 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa847d-8864-42da-ae13-507d43378a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:09.496739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa847d-8864-42da-ae13-507d43378a07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:09.512871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa847d-8864-42da-ae13-507d43378a07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:53:09.519406 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-ccfa847d-8864-42da-ae13-507d43378a07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:09.519406 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:09.519406 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:09.519406 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:09.519406 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:09.519406 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:09.519406 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:09.519406 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:09.519406 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:09.519406 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:09.519406 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:09.519406 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:09.519406 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:53:09.519406 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:53:09.519406 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:53:09.519406 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:53:09.520770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:53:09.520770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:53:09.520770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:53:09.520770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:53:09.520770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:09.520770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:09.520770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:09.520770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:09.520770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:09.520770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:09.520770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:09.520770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:09.520770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:09.520770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:09.520770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:09.520770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:09.521936 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:09.521936 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:09.521936 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:09.521936 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:09.521936 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:53:09.521936 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:53:09.521936 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:53:09.521936 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:53:09.521936 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:53:09.521936 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:53:09.521936 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:09.521936 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:09.524821 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 307/604] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Aug 7 00:53:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:09.525979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa847d-8864-42da-ae13-507d43378a07 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:09.632346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d7063-45c0-45f3-b62a-2cfd95ae3c0d None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:09.637956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa847d-8864-42da-ae13-507d43378a07 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:09.666666 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:09.684730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69468ac-0b27-4650-b473-ed807b543d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:09.685781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69468ac-0b27-4650-b473-ed807b543d99 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:09.686259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69468ac-0b27-4650-b473-ed807b543d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:09.687243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69468ac-0b27-4650-b473-ed807b543d99 None admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:09.688227 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69468ac-0b27-4650-b473-ed807b543d99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:09.688737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69468ac-0b27-4650-b473-ed807b543d99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:09.690551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69468ac-0b27-4650-b473-ed807b543d99 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:09.704685 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 308/605] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:53:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:09.704872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4db88-9f06-4f6d-910c-ee76581b474a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:09.705827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4db88-9f06-4f6d-910c-ee76581b474a None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:09.706220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69468ac-0b27-4650-b473-ed807b543d99 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:09.706327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4db88-9f06-4f6d-910c-ee76581b474a None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:09.706788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4db88-9f06-4f6d-910c-ee76581b474a None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:09.708255 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4db88-9f06-4f6d-910c-ee76581b474a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:09.708788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4db88-9f06-4f6d-910c-ee76581b474a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:09.712112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4db88-9f06-4f6d-910c-ee76581b474a None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:09.737106 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 298/606] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:09.738819 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4db88-9f06-4f6d-910c-ee76581b474a None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:09.819262 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69468ac-0b27-4650-b473-ed807b543d99 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:09.840603 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:09.860457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d574460-9ec5-4199-b586-302df60176d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:09.861430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d574460-9ec5-4199-b586-302df60176d3 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:09.861949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d574460-9ec5-4199-b586-302df60176d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:09.862399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d574460-9ec5-4199-b586-302df60176d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:09.863269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d574460-9ec5-4199-b586-302df60176d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:09.863771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d574460-9ec5-4199-b586-302df60176d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:09.865377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d574460-9ec5-4199-b586-302df60176d3 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:09.876013 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 309/607] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Aug 7 00:53:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:09.877421 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d574460-9ec5-4199-b586-302df60176d3 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:09.934431 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:09.953991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4db88-9f06-4f6d-910c-ee76581b474a None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:10.001315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d574460-9ec5-4199-b586-302df60176d3 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:10.042156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc433e-c71a-4dbf-a66a-5b28afe75a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:10.043552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc433e-c71a-4dbf-a66a-5b28afe75a68 None admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:10.044090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc433e-c71a-4dbf-a66a-5b28afe75a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:10.044407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26661b-1bda-46e1-96b5-b0562ba1d4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:10.044593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc433e-c71a-4dbf-a66a-5b28afe75a68 None admin] PATH_INFO: `/v3/projects/1cd2efda8567437e983e3a7867ecd69b/users/b219e01934fa477fbaa053cca586f01b/roles/af03b67d56b44430ab9d48dcba18ace2` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:10.045412 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26661b-1bda-46e1-96b5-b0562ba1d4df None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:10.046575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26661b-1bda-46e1-96b5-b0562ba1d4df None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:10.047112 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26661b-1bda-46e1-96b5-b0562ba1d4df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:10.055371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26661b-1bda-46e1-96b5-b0562ba1d4df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:10.057338 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26661b-1bda-46e1-96b5-b0562ba1d4df None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:10.070829 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-ba26661b-1bda-46e1-96b5-b0562ba1d4df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:10.070829 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:10.070829 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:10.070829 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:10.070829 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:10.070829 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:10.070829 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:10.070829 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:10.070829 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:10.070829 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:10.070829 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:10.070829 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:10.070829 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:53:10.070829 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:53:10.070829 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:53:10.071932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:53:10.071932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:10.071932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:10.071932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:10.071932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:10.071932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:10.071932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:10.071932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:10.071932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:10.071932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:10.071932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:10.071932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:10.071932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:10.071932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:10.071932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:10.071932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:10.071932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:10.072856 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:53:10.072856 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:53:10.072856 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:53:10.072856 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:53:10.072856 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:53:10.072856 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:53:10.072856 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:10.072856 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:10.075383 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 310/608] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:10.075632 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc433e-c71a-4dbf-a66a-5b28afe75a68 None admin] RBAC: Authorizing `identity:create_grant(project_id=1cd2efda8567437e983e3a7867ecd69b, user_id=b219e01934fa477fbaa053cca586f01b, role_id=af03b67d56b44430ab9d48dcba18ace2)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:10.077774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26661b-1bda-46e1-96b5-b0562ba1d4df None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:10.079167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc433e-c71a-4dbf-a66a-5b28afe75a68 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:10.105369 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 299/609] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Aug 7 00:53:09 2022] PUT /identity/v3/projects/1cd2efda8567437e983e3a7867ecd69b/users/b219e01934fa477fbaa053cca586f01b/roles/af03b67d56b44430ab9d48dcba18ace2 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:53:10.107252 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc433e-c71a-4dbf-a66a-5b28afe75a68 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:10.206895 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26661b-1bda-46e1-96b5-b0562ba1d4df None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:10.210760 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:10.250113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727c46f-c501-4f3f-b8fa-a921fc89555a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:10.250999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727c46f-c501-4f3f-b8fa-a921fc89555a None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:10.251373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727c46f-c501-4f3f-b8fa-a921fc89555a None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:10.251742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727c46f-c501-4f3f-b8fa-a921fc89555a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:10.266160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727c46f-c501-4f3f-b8fa-a921fc89555a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:10.267443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727c46f-c501-4f3f-b8fa-a921fc89555a None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:10.284330 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-a727c46f-c501-4f3f-b8fa-a921fc89555a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:10.284330 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:10.284330 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:10.284330 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:10.284330 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:10.284330 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:10.284330 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:10.284330 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:10.284330 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:10.284330 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:10.284330 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:10.284330 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:10.284330 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:10.284330 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:10.284330 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:10.284330 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:10.286489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:10.286489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:10.286489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:10.286489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:10.286489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:10.286489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:10.286489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:10.286489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:10.286489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:10.286489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:10.286489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:10.286489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:10.286489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:10.286489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:10.286489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:10.286489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:10.286489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:10.288599 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:10.288599 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:10.288599 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:10.288599 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 311/610] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:10.297790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727c46f-c501-4f3f-b8fa-a921fc89555a None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:10.338953 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:10.346186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc433e-c71a-4dbf-a66a-5b28afe75a68 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:10.425540 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5163d-caa4-4746-8bcc-1a3f340556b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:10.427140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5163d-caa4-4746-8bcc-1a3f340556b8 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:10.427874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5163d-caa4-4746-8bcc-1a3f340556b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:10.428634 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5163d-caa4-4746-8bcc-1a3f340556b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:10.430334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5163d-caa4-4746-8bcc-1a3f340556b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:10.431134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5163d-caa4-4746-8bcc-1a3f340556b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:10.439417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5163d-caa4-4746-8bcc-1a3f340556b8 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:10.473570 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 300/611] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:53:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:10.481952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727c46f-c501-4f3f-b8fa-a921fc89555a None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:10.485161 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5163d-caa4-4746-8bcc-1a3f340556b8 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:10.536268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81caf458-e7d4-411e-8e7d-111e98a6f970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:10.537157 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81caf458-e7d4-411e-8e7d-111e98a6f970 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:10.537543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81caf458-e7d4-411e-8e7d-111e98a6f970 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:10.537906 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81caf458-e7d4-411e-8e7d-111e98a6f970 None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:10.538727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81caf458-e7d4-411e-8e7d-111e98a6f970 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:10.539145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81caf458-e7d4-411e-8e7d-111e98a6f970 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:10.541494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81caf458-e7d4-411e-8e7d-111e98a6f970 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:10.567878 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 312/612] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:10.569800 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4a712-acd1-4f6a-89bb-2a3309f51dd1 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:10.570094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4a712-acd1-4f6a-89bb-2a3309f51dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:10.570383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4a712-acd1-4f6a-89bb-2a3309f51dd1 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:10.573660 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 313/613] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:10.574569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4a712-acd1-4f6a-89bb-2a3309f51dd1 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:10.599827 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:10.629188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5163d-caa4-4746-8bcc-1a3f340556b8 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:10.690009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad364b9-ffb7-4bfd-b239-2aaaac1b0727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:10.691066 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad364b9-ffb7-4bfd-b239-2aaaac1b0727 None admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:10.691375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad364b9-ffb7-4bfd-b239-2aaaac1b0727 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:10.691701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad364b9-ffb7-4bfd-b239-2aaaac1b0727 None admin] PATH_INFO: `/v3/projects/1cd2efda8567437e983e3a7867ecd69b/users/9a8be18e03a54bd8821ed5c048bbc793/roles/af03b67d56b44430ab9d48dcba18ace2` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:10.714765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4a712-acd1-4f6a-89bb-2a3309f51dd1 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:10.715127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad364b9-ffb7-4bfd-b239-2aaaac1b0727 None admin] RBAC: Authorizing `identity:create_grant(project_id=1cd2efda8567437e983e3a7867ecd69b, user_id=9a8be18e03a54bd8821ed5c048bbc793, role_id=af03b67d56b44430ab9d48dcba18ace2)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:10.717186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad364b9-ffb7-4bfd-b239-2aaaac1b0727 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:10.740989 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 301/614] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Aug 7 00:53:10 2022] PUT /identity/v3/projects/1cd2efda8567437e983e3a7867ecd69b/users/9a8be18e03a54bd8821ed5c048bbc793/roles/af03b67d56b44430ab9d48dcba18ace2 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:53:10.742587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dd1c8-a6e0-47ef-905a-dd9c5998c1c2 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:10.742893 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dd1c8-a6e0-47ef-905a-dd9c5998c1c2 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:10.743213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dd1c8-a6e0-47ef-905a-dd9c5998c1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:10.770220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5a6dd1c8-a6e0-47ef-905a-dd9c5998c1c2 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:10.772037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5a6dd1c8-a6e0-47ef-905a-dd9c5998c1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:10.776841 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:10.783946 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453844d2-103a-41f7-9062-8a0642f80d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:10.784802 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453844d2-103a-41f7-9062-8a0642f80d72 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:10.785082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453844d2-103a-41f7-9062-8a0642f80d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:10.785868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453844d2-103a-41f7-9062-8a0642f80d72 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:10.805261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453844d2-103a-41f7-9062-8a0642f80d72 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:10.806867 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453844d2-103a-41f7-9062-8a0642f80d72 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:10.840106 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-453844d2-103a-41f7-9062-8a0642f80d72 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:53:10.840106 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:10.840106 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:10.840106 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:10.840106 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:10.840106 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:10.840106 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:10.840106 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:10.840106 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:10.840106 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:10.840106 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:10.840106 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:10.840106 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:53:10.840106 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:53:10.840106 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:53:10.840106 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:53:10.843771 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:10.843771 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:10.843771 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:53:10.843771 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:10.843771 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:53:10.843771 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:10.843771 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:10.843771 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:10.843771 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:10.843771 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:10.843771 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:10.843771 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:10.843771 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:10.843771 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:10.843771 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:10.843771 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:10.843771 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:10.843771 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:10.847423 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:10.847423 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:10.847423 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:53:10.847423 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:53:10.847423 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:53:10.847423 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:53:10.847423 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:53:10.847423 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:53:10.847423 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:53:10.847423 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:10.847423 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 314/615] 10.222.0.39 () {56 vars in 1093 bytes} [Sun Aug 7 00:53:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:10.860324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453844d2-103a-41f7-9062-8a0642f80d72 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:10.895864 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 302/616] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:53:10.917714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dd1c8-a6e0-47ef-905a-dd9c5998c1c2 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:11.060359 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:11.069996 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dd1c8-a6e0-47ef-905a-dd9c5998c1c2 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:11.097928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453844d2-103a-41f7-9062-8a0642f80d72 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:11.118032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e29424-5714-4e97-b455-c5796ccb1391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:11.118796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e29424-5714-4e97-b455-c5796ccb1391 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:11.119131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e29424-5714-4e97-b455-c5796ccb1391 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:11.119445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e29424-5714-4e97-b455-c5796ccb1391 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:11.134047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e29424-5714-4e97-b455-c5796ccb1391 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:53:11.139957 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-83e29424-5714-4e97-b455-c5796ccb1391 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:11.139957 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:11.139957 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:11.139957 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:11.139957 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:11.139957 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:11.139957 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:11.139957 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:11.139957 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:11.139957 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:11.139957 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:11.139957 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:11.139957 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:53:11.139957 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:53:11.139957 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:53:11.139957 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:53:11.141747 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:53:11.141747 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:53:11.141747 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:53:11.141747 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:53:11.141747 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:11.141747 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:11.141747 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:11.141747 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:11.141747 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:11.141747 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:11.141747 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:11.141747 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:11.141747 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:11.141747 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:11.141747 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:11.141747 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:11.143393 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:11.143393 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:11.143393 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:11.143393 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:11.143393 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:53:11.143393 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:53:11.143393 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:53:11.143393 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:53:11.143393 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:53:11.143393 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:53:11.143393 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:11.143393 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:11.143393 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 303/617] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Aug 7 00:53:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:53:11.143393 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:11.152371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f887e5-03be-479e-a80a-090fe405c44d None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:11.152371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f887e5-03be-479e-a80a-090fe405c44d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:11.152371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f887e5-03be-479e-a80a-090fe405c44d None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:11.152371 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 304/618] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:11.152371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f887e5-03be-479e-a80a-090fe405c44d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:11.156687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60adcc-4d27-456a-b91a-623b566f0635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:11.157883 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60adcc-4d27-456a-b91a-623b566f0635 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:11.158558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60adcc-4d27-456a-b91a-623b566f0635 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:11.159146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60adcc-4d27-456a-b91a-623b566f0635 None admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:11.160736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60adcc-4d27-456a-b91a-623b566f0635 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:11.161392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60adcc-4d27-456a-b91a-623b566f0635 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:11.164381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60adcc-4d27-456a-b91a-623b566f0635 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:11.192081 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 315/619] 10.222.0.39 () {56 vars in 1133 bytes} [Sun Aug 7 00:53:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:11.193666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aae4a0-990c-4832-af1f-80e54535b101 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:11.194027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aae4a0-990c-4832-af1f-80e54535b101 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:11.194369 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aae4a0-990c-4832-af1f-80e54535b101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:11.217073 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-75aae4a0-990c-4832-af1f-80e54535b101 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:11.218930 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-75aae4a0-990c-4832-af1f-80e54535b101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:11.301200 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 316/620] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:53:11.302243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aae4a0-990c-4832-af1f-80e54535b101 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:11.344696 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f887e5-03be-479e-a80a-090fe405c44d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:11.392110 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:11.404843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72483e4d-74fe-4595-8aee-831abcc2e670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:11.406288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72483e4d-74fe-4595-8aee-831abcc2e670 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:11.406567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72483e4d-74fe-4595-8aee-831abcc2e670 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:11.406836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72483e4d-74fe-4595-8aee-831abcc2e670 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:11.407529 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72483e4d-74fe-4595-8aee-831abcc2e670 None admin] RBAC: Adding query filter params (name=service) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:11.407828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72483e4d-74fe-4595-8aee-831abcc2e670 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:11.409251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72483e4d-74fe-4595-8aee-831abcc2e670 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:11.427466 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 305/621] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Aug 7 00:53:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:11.427466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72483e4d-74fe-4595-8aee-831abcc2e670 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:11.461240 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aae4a0-990c-4832-af1f-80e54535b101 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:11.510703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c4b50-8546-4710-aff9-ebd61d1eadcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:11.511332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c4b50-8546-4710-aff9-ebd61d1eadcf None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:11.511612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c4b50-8546-4710-aff9-ebd61d1eadcf None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:11.511906 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c4b50-8546-4710-aff9-ebd61d1eadcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:11.534811 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:11.592983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72483e4d-74fe-4595-8aee-831abcc2e670 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:11.620401 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c4b50-8546-4710-aff9-ebd61d1eadcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:11.621899 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c4b50-8546-4710-aff9-ebd61d1eadcf None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:11.637216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5396bc-cf73-4152-ab69-f03287bb0f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:11.638354 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5396bc-cf73-4152-ab69-f03287bb0f16 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:11.638832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5396bc-cf73-4152-ab69-f03287bb0f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:11.639926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5396bc-cf73-4152-ab69-f03287bb0f16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:11.653439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5396bc-cf73-4152-ab69-f03287bb0f16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:53:11.659942 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-0a5396bc-cf73-4152-ab69-f03287bb0f16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:11.659942 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:11.659942 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:11.659942 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:11.659942 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:11.659942 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:11.659942 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:11.659942 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:11.659942 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:11.659942 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:11.659942 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:11.659942 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:11.659942 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:53:11.659942 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:53:11.659942 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:53:11.659942 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:53:11.660959 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:53:11.660959 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:53:11.660959 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:53:11.660959 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:53:11.660959 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:11.660959 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:11.660959 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:11.660959 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:11.660959 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:11.660959 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:11.660959 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:11.660959 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:11.660959 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:11.660959 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:11.660959 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:11.660959 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:11.661848 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:11.661848 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:11.661848 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:11.661848 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:11.661848 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:53:11.661848 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:53:11.661848 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:53:11.661848 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:53:11.661848 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:53:11.661848 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:53:11.661848 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:11.661848 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:11.664792 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 306/622] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Aug 7 00:53:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:11.666526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5396bc-cf73-4152-ab69-f03287bb0f16 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:11.696374 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:11.796321 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 317/623] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:53:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:53:11.798778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c4b50-8546-4710-aff9-ebd61d1eadcf None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:11.800198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5396bc-cf73-4152-ab69-f03287bb0f16 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:11.824656 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:11.838603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0358cb-6aff-4030-91c7-443a18d8d160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:11.839589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0358cb-6aff-4030-91c7-443a18d8d160 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:11.840085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0358cb-6aff-4030-91c7-443a18d8d160 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:11.840575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0358cb-6aff-4030-91c7-443a18d8d160 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:11.852191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0358cb-6aff-4030-91c7-443a18d8d160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:11.854041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0358cb-6aff-4030-91c7-443a18d8d160 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:11.869260 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-dc0358cb-6aff-4030-91c7-443a18d8d160 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:11.869260 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:11.869260 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:11.869260 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:11.869260 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:11.869260 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:11.869260 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:11.869260 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:11.869260 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:11.869260 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:11.869260 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:11.869260 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:11.869260 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:11.869260 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:11.869260 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:11.869260 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:11.870291 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:11.870291 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:11.870291 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:11.870291 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:11.870291 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:11.870291 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:11.870291 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:11.870291 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:11.870291 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:11.870291 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:11.870291 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:11.870291 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:11.870291 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:11.870291 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:11.870291 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:11.870291 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:11.870291 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:11.871228 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:11.871228 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:11.871228 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:11.873061 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 307/624] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:11.874700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0358cb-6aff-4030-91c7-443a18d8d160 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:12.014350 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0358cb-6aff-4030-91c7-443a18d8d160 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:12.054574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79d556-ac55-4975-9c1f-366753f64a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:12.055632 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79d556-ac55-4975-9c1f-366753f64a17 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:12.056150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79d556-ac55-4975-9c1f-366753f64a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:12.056657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79d556-ac55-4975-9c1f-366753f64a17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:12.073911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79d556-ac55-4975-9c1f-366753f64a17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:12.076903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c4b50-8546-4710-aff9-ebd61d1eadcf None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:12.077632 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79d556-ac55-4975-9c1f-366753f64a17 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:12.103782 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-3d79d556-ac55-4975-9c1f-366753f64a17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:12.103782 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:12.103782 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:12.103782 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:12.103782 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:12.103782 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:12.103782 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:12.103782 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:12.103782 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:12.103782 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:12.103782 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:12.103782 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:12.103782 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:12.103782 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:12.103782 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:12.103782 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:12.105586 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:12.105586 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:12.105586 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:12.105586 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:12.105586 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:12.105586 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:12.105586 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:12.105586 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:12.105586 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:12.105586 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:12.105586 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:12.105586 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:12.105586 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:12.105586 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:12.105586 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:12.105586 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:12.105586 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:12.107251 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:12.107251 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:12.107251 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:12.110884 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 308/625] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:12.112781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79d556-ac55-4975-9c1f-366753f64a17 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:12.153924 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:12.166074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ff3b2-4f78-4147-8422-a038a01aced9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:12.166701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ff3b2-4f78-4147-8422-a038a01aced9 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:12.167031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ff3b2-4f78-4147-8422-a038a01aced9 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:12.167305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ff3b2-4f78-4147-8422-a038a01aced9 None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:12.168027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ff3b2-4f78-4147-8422-a038a01aced9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:12.168332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ff3b2-4f78-4147-8422-a038a01aced9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:12.169881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839ff3b2-4f78-4147-8422-a038a01aced9 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:12.180203 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 318/626] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Aug 7 00:53:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:12.181103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ff3b2-4f78-4147-8422-a038a01aced9 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:12.225070 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:12.236386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79d556-ac55-4975-9c1f-366753f64a17 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:12.273118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86958214-3227-4ab3-bd06-9ea7eb847675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:12.274097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86958214-3227-4ab3-bd06-9ea7eb847675 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:12.274593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86958214-3227-4ab3-bd06-9ea7eb847675 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:12.275056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86958214-3227-4ab3-bd06-9ea7eb847675 None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:12.275917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86958214-3227-4ab3-bd06-9ea7eb847675 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:12.276413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86958214-3227-4ab3-bd06-9ea7eb847675 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:12.277970 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86958214-3227-4ab3-bd06-9ea7eb847675 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:12.290621 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 309/627] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:12.291794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86958214-3227-4ab3-bd06-9ea7eb847675 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:12.323287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839ff3b2-4f78-4147-8422-a038a01aced9 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:12.363543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a30c99-33d0-469d-a885-db7e49548e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:12.364194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a30c99-33d0-469d-a885-db7e49548e6c None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:12.364554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a30c99-33d0-469d-a885-db7e49548e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:12.364787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a30c99-33d0-469d-a885-db7e49548e6c None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:12.365443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a30c99-33d0-469d-a885-db7e49548e6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:12.365747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a30c99-33d0-469d-a885-db7e49548e6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:12.367377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a30c99-33d0-469d-a885-db7e49548e6c None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:12.385526 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 319/628] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:12.386196 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:12.388019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a30c99-33d0-469d-a885-db7e49548e6c None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:12.400879 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86958214-3227-4ab3-bd06-9ea7eb847675 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:12.444137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefcae1-e86a-42ce-835d-df6ea34f6bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:12.444800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefcae1-e86a-42ce-835d-df6ea34f6bbb None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:12.445168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefcae1-e86a-42ce-835d-df6ea34f6bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:12.445341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddefcae1-e86a-42ce-835d-df6ea34f6bbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:12.457374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefcae1-e86a-42ce-835d-df6ea34f6bbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:12.458868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddefcae1-e86a-42ce-835d-df6ea34f6bbb None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:12.474797 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-ddefcae1-e86a-42ce-835d-df6ea34f6bbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:12.474797 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:12.474797 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:12.474797 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:12.474797 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:12.474797 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:12.474797 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:12.474797 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:12.474797 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:12.474797 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:12.474797 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:12.474797 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:12.474797 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:12.474797 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:12.474797 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:12.474797 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:12.476138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:12.476138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:12.476138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:12.476138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:12.476138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:12.476138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:12.476138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:12.476138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:12.476138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:12.476138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:12.476138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:12.476138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:12.476138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:12.476138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:12.476138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:12.476138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:12.476138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:12.477442 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:12.477442 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:12.477442 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:12.477442 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 310/629] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:12.477442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefcae1-e86a-42ce-835d-df6ea34f6bbb None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:12.500136 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:12.522566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a30c99-33d0-469d-a885-db7e49548e6c None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:12.561657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f42d0-dcc0-4f08-8632-1d65f03222e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:12.562621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f42d0-dcc0-4f08-8632-1d65f03222e2 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:12.563048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f42d0-dcc0-4f08-8632-1d65f03222e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:12.563466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f42d0-dcc0-4f08-8632-1d65f03222e2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:12.572035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f42d0-dcc0-4f08-8632-1d65f03222e2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:12.573862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f42d0-dcc0-4f08-8632-1d65f03222e2 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:12.587695 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-a26f42d0-dcc0-4f08-8632-1d65f03222e2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:53:12.587695 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:12.587695 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:12.587695 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:12.587695 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:12.587695 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:12.587695 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:12.587695 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:12.587695 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:12.587695 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:12.587695 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:12.587695 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:12.587695 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:53:12.587695 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:53:12.587695 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:53:12.587695 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:53:12.588727 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:12.588727 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:12.588727 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:53:12.588727 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:12.588727 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:53:12.588727 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:12.588727 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:12.588727 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:12.588727 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:12.588727 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:12.588727 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:12.588727 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:12.588727 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:12.588727 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:12.588727 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:12.588727 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:12.588727 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:12.588727 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:12.589675 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:12.589675 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:12.589675 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:53:12.589675 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:53:12.589675 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:53:12.589675 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:53:12.589675 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:53:12.589675 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:53:12.589675 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:53:12.589675 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:12.597209 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 320/630] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:53:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:12.598507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f42d0-dcc0-4f08-8632-1d65f03222e2 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:12.600697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddefcae1-e86a-42ce-835d-df6ea34f6bbb None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:12.636613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833cec3a-4358-4e35-8ef9-68d0dbbf2cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:12.637251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cec3a-4358-4e35-8ef9-68d0dbbf2cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:12.637525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cec3a-4358-4e35-8ef9-68d0dbbf2cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:12.637790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cec3a-4358-4e35-8ef9-68d0dbbf2cc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:12.645104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833cec3a-4358-4e35-8ef9-68d0dbbf2cc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:12.646481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833cec3a-4358-4e35-8ef9-68d0dbbf2cc4 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:12.648602 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:12.659750 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-833cec3a-4358-4e35-8ef9-68d0dbbf2cc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:12.659750 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:12.659750 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:12.659750 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:12.659750 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:12.659750 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:12.659750 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:12.659750 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:12.659750 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:12.659750 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:12.659750 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:12.659750 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:12.659750 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:53:12.659750 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:53:12.659750 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:53:12.660791 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:53:12.660791 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:12.660791 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:12.660791 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:12.660791 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:12.660791 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:12.660791 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:12.660791 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:12.660791 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:12.660791 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:12.660791 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:12.660791 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:12.660791 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:12.660791 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:12.660791 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:12.660791 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:12.660791 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:12.662013 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:53:12.662013 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:53:12.662013 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:53:12.662013 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:53:12.662013 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:53:12.662013 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:53:12.662013 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:12.662013 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:12.665985 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 311/631] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:12.667302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833cec3a-4358-4e35-8ef9-68d0dbbf2cc4 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:12.723741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f42d0-dcc0-4f08-8632-1d65f03222e2 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:12.763220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092261e-6014-4750-b074-206232730b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:12.764243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092261e-6014-4750-b074-206232730b71 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:12.764804 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092261e-6014-4750-b074-206232730b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:12.765284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092261e-6014-4750-b074-206232730b71 None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:12.766311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092261e-6014-4750-b074-206232730b71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:12.766820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092261e-6014-4750-b074-206232730b71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:12.768567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092261e-6014-4750-b074-206232730b71 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:12.785388 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 321/632] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:12.786802 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092261e-6014-4750-b074-206232730b71 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:12.788641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833cec3a-4358-4e35-8ef9-68d0dbbf2cc4 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:12.798672 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:12.848676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f20b8-f0d7-4f30-805c-498a26e50bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:12.849543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f20b8-f0d7-4f30-805c-498a26e50bbf None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:12.849952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f20b8-f0d7-4f30-805c-498a26e50bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:12.850362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f20b8-f0d7-4f30-805c-498a26e50bbf None admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:12.851502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f20b8-f0d7-4f30-805c-498a26e50bbf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:12.852060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f20b8-f0d7-4f30-805c-498a26e50bbf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:12.854369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f20b8-f0d7-4f30-805c-498a26e50bbf None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:12.890491 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 312/633] 10.222.0.39 () {56 vars in 1135 bytes} [Sun Aug 7 00:53:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:12.890491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f20b8-f0d7-4f30-805c-498a26e50bbf None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:12.930484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092261e-6014-4750-b074-206232730b71 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:12.988011 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:13.005569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522ccd4-d53b-4f1c-8f98-65a63e48ab18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:13.006962 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522ccd4-d53b-4f1c-8f98-65a63e48ab18 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:13.007558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522ccd4-d53b-4f1c-8f98-65a63e48ab18 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:13.009408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522ccd4-d53b-4f1c-8f98-65a63e48ab18 None admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:13.010862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522ccd4-d53b-4f1c-8f98-65a63e48ab18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:13.011481 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522ccd4-d53b-4f1c-8f98-65a63e48ab18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:13.014086 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9522ccd4-d53b-4f1c-8f98-65a63e48ab18 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:13.045476 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 322/634] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:53:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:13.047872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522ccd4-d53b-4f1c-8f98-65a63e48ab18 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:13.055390 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f20b8-f0d7-4f30-805c-498a26e50bbf None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:13.118785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da497f0-a7ac-43bb-967a-269eaf5dda09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:13.119758 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da497f0-a7ac-43bb-967a-269eaf5dda09 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:13.120256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da497f0-a7ac-43bb-967a-269eaf5dda09 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:13.120706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da497f0-a7ac-43bb-967a-269eaf5dda09 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:13.132943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da497f0-a7ac-43bb-967a-269eaf5dda09 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:13.135401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da497f0-a7ac-43bb-967a-269eaf5dda09 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:13.155854 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-9da497f0-a7ac-43bb-967a-269eaf5dda09 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 07 00:53:13.155854 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:13.155854 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:13.155854 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:13.155854 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:13.155854 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:13.155854 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:13.155854 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:13.155854 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:13.155854 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:13.155854 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:13.155854 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:13.155854 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:53:13.155854 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:53:13.155854 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:53:13.155854 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:53:13.158047 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:13.158047 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:13.158047 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:53:13.158047 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:13.158047 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:53:13.158047 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:13.158047 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:13.158047 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:13.158047 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:13.158047 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:13.158047 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:13.158047 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:13.158047 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:13.158047 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:13.158047 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:13.158047 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:13.158047 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:13.158047 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:13.160224 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:13.160224 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:13.160224 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:53:13.160224 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:53:13.160224 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:53:13.160224 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:53:13.160224 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:53:13.160224 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:53:13.160224 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 07 00:53:13.160224 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:13.164795 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 313/635] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:53:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:13.166221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da497f0-a7ac-43bb-967a-269eaf5dda09 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:13.176558 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:13.222866 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522ccd4-d53b-4f1c-8f98-65a63e48ab18 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:13.265868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829747c-d754-4f04-93f6-b6b2d5711587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:13.267252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829747c-d754-4f04-93f6-b6b2d5711587 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:13.267533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829747c-d754-4f04-93f6-b6b2d5711587 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:13.267851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829747c-d754-4f04-93f6-b6b2d5711587 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:13.280545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829747c-d754-4f04-93f6-b6b2d5711587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:13.281738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829747c-d754-4f04-93f6-b6b2d5711587 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:13.294602 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da497f0-a7ac-43bb-967a-269eaf5dda09 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:13.301388 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-5829747c-d754-4f04-93f6-b6b2d5711587 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:13.301388 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:13.301388 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:13.301388 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:13.301388 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:13.301388 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:13.301388 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:13.301388 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:13.301388 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:13.301388 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:13.301388 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:13.301388 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:13.301388 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:13.301388 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:13.301388 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:13.301388 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:13.302812 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:13.302812 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:13.302812 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:13.302812 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:13.302812 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:13.302812 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:13.302812 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:13.302812 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:13.302812 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:13.302812 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:13.302812 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:13.302812 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:13.302812 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:13.302812 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:13.302812 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:13.302812 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:13.302812 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:13.304282 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:13.304282 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:13.304282 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:13.307489 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 323/636] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:13.308929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed106c2-cd12-4f29-b54b-969add9d7ae9 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:13.309663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed106c2-cd12-4f29-b54b-969add9d7ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:13.309663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed106c2-cd12-4f29-b54b-969add9d7ae9 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:13.311050 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 324/637] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:13.311705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed106c2-cd12-4f29-b54b-969add9d7ae9 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:13.324313 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:13.349237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a1726-4aca-48a5-85df-7d18b4d9b582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:13.349960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a1726-4aca-48a5-85df-7d18b4d9b582 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:13.350320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a1726-4aca-48a5-85df-7d18b4d9b582 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:13.350657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a1726-4aca-48a5-85df-7d18b4d9b582 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:13.351415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a1726-4aca-48a5-85df-7d18b4d9b582 None admin] RBAC: Adding query filter params (role.id=af03b67d56b44430ab9d48dcba18ace2, scope.project.id=1cd2efda8567437e983e3a7867ecd69b, user.id=6c70d5a72d424db68de7c7b8257fe02c) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:13.351738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a1726-4aca-48a5-85df-7d18b4d9b582 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:13.353304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a1726-4aca-48a5-85df-7d18b4d9b582 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:13.361501 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 314/638] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:53:13 2022] GET /identity/v3/role_assignments?user.id=6c70d5a72d424db68de7c7b8257fe02c&scope.project.id=1cd2efda8567437e983e3a7867ecd69b&role.id=af03b67d56b44430ab9d48dcba18ace2 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:13.373067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a1726-4aca-48a5-85df-7d18b4d9b582 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:13.484158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed106c2-cd12-4f29-b54b-969add9d7ae9 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:13.508217 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:13.520762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a1726-4aca-48a5-85df-7d18b4d9b582 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:13.534253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb295c0-95c3-46ec-92ff-10190219b15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:13.535055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb295c0-95c3-46ec-92ff-10190219b15b None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:13.535400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb295c0-95c3-46ec-92ff-10190219b15b None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:13.535777 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb295c0-95c3-46ec-92ff-10190219b15b None admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:13.536832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb295c0-95c3-46ec-92ff-10190219b15b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:13.537222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb295c0-95c3-46ec-92ff-10190219b15b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:13.539225 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb295c0-95c3-46ec-92ff-10190219b15b None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:13.568973 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 325/639] 10.222.0.39 () {56 vars in 1137 bytes} [Sun Aug 7 00:53:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:13.569306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16059640-0e3a-49cf-bb8c-27ac0029d755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:13.569943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16059640-0e3a-49cf-bb8c-27ac0029d755 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:13.570207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16059640-0e3a-49cf-bb8c-27ac0029d755 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:13.570477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16059640-0e3a-49cf-bb8c-27ac0029d755 None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:13.571174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16059640-0e3a-49cf-bb8c-27ac0029d755 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:13.571334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4e9ed-3e12-4017-8ba2-792eac754e4e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:13.571614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16059640-0e3a-49cf-bb8c-27ac0029d755 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:13.571783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4e9ed-3e12-4017-8ba2-792eac754e4e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:13.572063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4e9ed-3e12-4017-8ba2-792eac754e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:13.573484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16059640-0e3a-49cf-bb8c-27ac0029d755 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:13.593956 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 315/640] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:13.596694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58efaa-9c4a-42e3-aee5-ec33601d8266 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:13.597517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58efaa-9c4a-42e3-aee5-ec33601d8266 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:13.597678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-16c4e9ed-3e12-4017-8ba2-792eac754e4e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:13.598318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58efaa-9c4a-42e3-aee5-ec33601d8266 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:13.598820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-16c4e9ed-3e12-4017-8ba2-792eac754e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:13.601832 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 316/641] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:13.605043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58efaa-9c4a-42e3-aee5-ec33601d8266 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:13.683931 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:13.706258 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 326/642] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:53:13.707802 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4e9ed-3e12-4017-8ba2-792eac754e4e None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:13.798358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58efaa-9c4a-42e3-aee5-ec33601d8266 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:13.862082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0e0a9-2076-4314-9230-9a850830ac49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:13.863056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0e0a9-2076-4314-9230-9a850830ac49 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:13.863491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0e0a9-2076-4314-9230-9a850830ac49 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:13.863946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0e0a9-2076-4314-9230-9a850830ac49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:13.918534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4e9ed-3e12-4017-8ba2-792eac754e4e None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:13.934928 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:13.977828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0e0a9-2076-4314-9230-9a850830ac49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:13.980746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc0e0a9-2076-4314-9230-9a850830ac49 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:13.994601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff25ca5-36d8-4e61-87fc-cae132b0542a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:13.995418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff25ca5-36d8-4e61-87fc-cae132b0542a None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:13.995840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff25ca5-36d8-4e61-87fc-cae132b0542a None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:13.996272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff25ca5-36d8-4e61-87fc-cae132b0542a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:14.005515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff25ca5-36d8-4e61-87fc-cae132b0542a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:14.007485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff25ca5-36d8-4e61-87fc-cae132b0542a None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:14.022821 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-3ff25ca5-36d8-4e61-87fc-cae132b0542a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:14.022821 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:14.022821 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:14.022821 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:14.022821 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:14.022821 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:14.022821 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:14.022821 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:14.022821 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:14.022821 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:14.022821 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:14.022821 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:14.022821 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:53:14.022821 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:53:14.022821 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:53:14.024961 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:53:14.024961 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:14.024961 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:14.024961 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:14.024961 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:14.024961 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:14.024961 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:14.024961 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:14.024961 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:14.024961 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:14.024961 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:14.024961 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:14.024961 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:14.024961 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:14.024961 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:14.024961 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:14.024961 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:14.026708 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:53:14.026708 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:53:14.026708 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:53:14.026708 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:53:14.026708 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:53:14.026708 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:53:14.026708 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:14.026708 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:14.031464 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 327/643] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:14.033189 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6494ee6-62a1-4819-b591-df92e04a961a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:14.033603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6494ee6-62a1-4819-b591-df92e04a961a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:14.034072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6494ee6-62a1-4819-b591-df92e04a961a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:14.062890 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-f6494ee6-62a1-4819-b591-df92e04a961a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:14.064439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f6494ee6-62a1-4819-b591-df92e04a961a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:14.068534 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:14.169370 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 317/644] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:53:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:53:14.171422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0e0a9-2076-4314-9230-9a850830ac49 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:14.188384 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 328/645] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:53:14.189656 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6494ee6-62a1-4819-b591-df92e04a961a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:14.347206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc0e0a9-2076-4314-9230-9a850830ac49 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:14.363846 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:14.376349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6494ee6-62a1-4819-b591-df92e04a961a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:14.405873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff7afd-c4b8-4d88-96f9-d7c4fd65c85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:14.406809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff7afd-c4b8-4d88-96f9-d7c4fd65c85d None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:14.407246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff7afd-c4b8-4d88-96f9-d7c4fd65c85d None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:14.407759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff7afd-c4b8-4d88-96f9-d7c4fd65c85d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:14.421495 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:14.429748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ff7afd-c4b8-4d88-96f9-d7c4fd65c85d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:53:14.438028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63dcf2-ce6c-4f5d-9b34-3e910bf824e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:14.439173 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-10ff7afd-c4b8-4d88-96f9-d7c4fd65c85d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:14.439173 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:14.439173 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:14.439173 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:14.439173 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:14.439173 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:14.439173 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:14.439173 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:14.439173 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:14.439173 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:14.439173 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:14.439173 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:14.439173 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:53:14.439173 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:53:14.439173 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:53:14.439173 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:53:14.440970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:53:14.440970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:53:14.440970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:53:14.440970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:53:14.440970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:14.440970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:14.440970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:14.440970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:14.440970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:14.440970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:14.440970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:14.440970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:14.440970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:14.440970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:14.440970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:14.440970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:14.449270 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:14.449270 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:14.449270 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:14.449270 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:14.449270 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:53:14.449270 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:53:14.449270 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:53:14.449270 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:53:14.449270 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:53:14.449270 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:53:14.449270 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:14.449270 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:14.450537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63dcf2-ce6c-4f5d-9b34-3e910bf824e6 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:14.450537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63dcf2-ce6c-4f5d-9b34-3e910bf824e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:14.450537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63dcf2-ce6c-4f5d-9b34-3e910bf824e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:14.450903 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 318/646] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Aug 7 00:53:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:14.451029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63dcf2-ce6c-4f5d-9b34-3e910bf824e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:14.451166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff7afd-c4b8-4d88-96f9-d7c4fd65c85d None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:14.451271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63dcf2-ce6c-4f5d-9b34-3e910bf824e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:14.451271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c63dcf2-ce6c-4f5d-9b34-3e910bf824e6 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:14.471480 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 329/647] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:53:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:14.472828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63dcf2-ce6c-4f5d-9b34-3e910bf824e6 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:14.643295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff7afd-c4b8-4d88-96f9-d7c4fd65c85d None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:14.662879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c63dcf2-ce6c-4f5d-9b34-3e910bf824e6 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:14.713208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd25cc-7962-400b-bc46-3ad41ae30b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:14.714206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd25cc-7962-400b-bc46-3ad41ae30b89 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:14.714639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd25cc-7962-400b-bc46-3ad41ae30b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:14.715098 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd25cc-7962-400b-bc46-3ad41ae30b89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:14.735237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e5901-3b46-41c3-b240-60e068a104ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:14.736155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e5901-3b46-41c3-b240-60e068a104ed None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:14.736595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e5901-3b46-41c3-b240-60e068a104ed None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:14.737039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e5901-3b46-41c3-b240-60e068a104ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:14.737195 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd25cc-7962-400b-bc46-3ad41ae30b89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:14.739591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd25cc-7962-400b-bc46-3ad41ae30b89 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:14.757885 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e5901-3b46-41c3-b240-60e068a104ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:53:14.767691 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-b84e5901-3b46-41c3-b240-60e068a104ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:14.767691 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:14.767691 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:14.767691 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:14.767691 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:14.767691 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:14.767691 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:14.767691 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:14.767691 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:14.767691 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:14.767691 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:14.767691 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:14.767691 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:53:14.767691 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:53:14.767691 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:53:14.767691 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:53:14.769469 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:53:14.769469 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:53:14.769469 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:53:14.769469 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:53:14.769469 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:14.769469 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:14.769469 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:14.769469 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:14.769469 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:14.769469 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:14.769469 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:14.769469 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:14.769469 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:14.769469 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:14.769469 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:14.769469 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:14.779740 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:14.779740 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:14.779740 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:14.779740 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:14.779740 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:53:14.779740 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:53:14.779740 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:53:14.779740 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:53:14.779740 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:53:14.779740 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:53:14.779740 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:14.779740 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:14.781135 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-87bd25cc-7962-400b-bc46-3ad41ae30b89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:14.781135 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:14.781135 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:14.781135 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:14.781135 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:14.781135 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:14.781135 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:14.781135 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:14.781135 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:14.781135 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:14.781135 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:14.781135 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:14.781135 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:14.781135 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:14.781135 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:14.781135 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:14.782776 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:14.782776 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:14.782776 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:14.782776 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:14.782776 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:14.782776 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:14.782776 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:14.782776 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:14.782776 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:14.782776 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:14.782776 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:14.782776 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:14.782776 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:14.782776 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:14.782776 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:14.782776 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:14.782776 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:14.784809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:14.784809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:14.784809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:14.785154 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 330/648] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Aug 7 00:53:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:14.785154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e5901-3b46-41c3-b240-60e068a104ed None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:14.785413 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 319/649] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:14.785413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd25cc-7962-400b-bc46-3ad41ae30b89 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:14.820235 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:14.867867 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:14.947579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd25cc-7962-400b-bc46-3ad41ae30b89 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:14.973030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e5901-3b46-41c3-b240-60e068a104ed None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:15.008913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c652918-e088-4469-acf8-a4f46bb7e8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:15.009878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c652918-e088-4469-acf8-a4f46bb7e8be None admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:15.010334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c652918-e088-4469-acf8-a4f46bb7e8be None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:15.010828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c652918-e088-4469-acf8-a4f46bb7e8be None admin] PATH_INFO: `/v3/projects/1cd2efda8567437e983e3a7867ecd69b/users/fb5a86da594046ed97745371176decf7/roles/af03b67d56b44430ab9d48dcba18ace2` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:15.032493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c652918-e088-4469-acf8-a4f46bb7e8be None admin] RBAC: Authorizing `identity:create_grant(project_id=1cd2efda8567437e983e3a7867ecd69b, user_id=fb5a86da594046ed97745371176decf7, role_id=af03b67d56b44430ab9d48dcba18ace2)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:15.034309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c652918-e088-4469-acf8-a4f46bb7e8be None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:15.056090 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 320/650] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Aug 7 00:53:14 2022] PUT /identity/v3/projects/1cd2efda8567437e983e3a7867ecd69b/users/fb5a86da594046ed97745371176decf7/roles/af03b67d56b44430ab9d48dcba18ace2 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:53:15.058237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c652918-e088-4469-acf8-a4f46bb7e8be None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:15.065400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b424ae1-e308-49e2-a416-061123a03d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:15.066934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b424ae1-e308-49e2-a416-061123a03d96 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:15.067721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b424ae1-e308-49e2-a416-061123a03d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:15.068714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b424ae1-e308-49e2-a416-061123a03d96 None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:15.070569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b424ae1-e308-49e2-a416-061123a03d96 None admin] RBAC: Adding query filter params (name=service) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:15.071263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b424ae1-e308-49e2-a416-061123a03d96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:15.074363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b424ae1-e308-49e2-a416-061123a03d96 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:15.100350 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 331/651] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Aug 7 00:53:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:15.101915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b424ae1-e308-49e2-a416-061123a03d96 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:15.279095 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:15.308337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c652918-e088-4469-acf8-a4f46bb7e8be None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:15.314046 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:15.335304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b424ae1-e308-49e2-a416-061123a03d96 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:15.380607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc035a5-8a75-4a3e-86ff-186b2b460458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:15.381604 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc035a5-8a75-4a3e-86ff-186b2b460458 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:15.382052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc035a5-8a75-4a3e-86ff-186b2b460458 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:15.382653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc035a5-8a75-4a3e-86ff-186b2b460458 None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:15.383544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc035a5-8a75-4a3e-86ff-186b2b460458 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:15.384081 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc035a5-8a75-4a3e-86ff-186b2b460458 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:15.386497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc035a5-8a75-4a3e-86ff-186b2b460458 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:15.406437 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba105e99-1717-4a24-bcf6-86899a837ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:15.408476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba105e99-1717-4a24-bcf6-86899a837ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:15.409222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba105e99-1717-4a24-bcf6-86899a837ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:15.409409 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 321/652] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:15.410138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba105e99-1717-4a24-bcf6-86899a837ae4 None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:15.415276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc035a5-8a75-4a3e-86ff-186b2b460458 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:15.417593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba105e99-1717-4a24-bcf6-86899a837ae4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:15.418402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba105e99-1717-4a24-bcf6-86899a837ae4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:15.422031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba105e99-1717-4a24-bcf6-86899a837ae4 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:15.442964 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 332/653] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Aug 7 00:53:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:15.445151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba105e99-1717-4a24-bcf6-86899a837ae4 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:15.599179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc035a5-8a75-4a3e-86ff-186b2b460458 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:15.645465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedf38e-1c4d-4284-a6ec-cdc426b05d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:15.646478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedf38e-1c4d-4284-a6ec-cdc426b05d9a None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:15.646478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedf38e-1c4d-4284-a6ec-cdc426b05d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:15.646723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedf38e-1c4d-4284-a6ec-cdc426b05d9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:15.660327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdedf38e-1c4d-4284-a6ec-cdc426b05d9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:15.661871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdedf38e-1c4d-4284-a6ec-cdc426b05d9a None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:15.662943 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba105e99-1717-4a24-bcf6-86899a837ae4 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:15.678512 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-bdedf38e-1c4d-4284-a6ec-cdc426b05d9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:15.678512 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:15.678512 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:15.678512 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:15.678512 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:15.678512 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:15.678512 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:15.678512 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:15.678512 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:15.678512 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:15.678512 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:15.678512 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:15.678512 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:15.678512 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:15.678512 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:15.678512 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:15.680371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:15.680371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:15.680371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:15.680371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:15.680371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:15.680371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:15.680371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:15.680371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:15.680371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:15.680371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:15.680371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:15.680371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:15.680371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:15.680371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:15.680371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:15.680371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:15.680371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:15.682257 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:15.682257 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:15.682257 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:15.684503 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 322/654] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:15.685503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedf38e-1c4d-4284-a6ec-cdc426b05d9a None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:15.704071 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:15.740213 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7937d7-abf9-4b00-9f96-ab5e63f44905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:15.741885 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7937d7-abf9-4b00-9f96-ab5e63f44905 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:15.742684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7937d7-abf9-4b00-9f96-ab5e63f44905 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:15.743444 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7937d7-abf9-4b00-9f96-ab5e63f44905 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:15.757326 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7937d7-abf9-4b00-9f96-ab5e63f44905 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:15.760689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7937d7-abf9-4b00-9f96-ab5e63f44905 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:15.766069 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:15.785674 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-9b7937d7-abf9-4b00-9f96-ab5e63f44905 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:15.785674 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:15.785674 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:15.785674 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:15.785674 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:15.785674 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:15.785674 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:15.785674 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:15.785674 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:15.785674 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:15.785674 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:15.785674 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:15.785674 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:53:15.785674 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:53:15.785674 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:53:15.787380 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:53:15.787380 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:15.787380 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:15.787380 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:15.787380 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:15.787380 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:15.787380 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:15.787380 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:15.787380 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:15.787380 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:15.787380 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:15.787380 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:15.787380 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:15.787380 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:15.787380 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:15.787380 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:15.787380 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:15.789180 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:53:15.789180 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:53:15.789180 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:53:15.789180 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:53:15.789180 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:53:15.789180 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:53:15.789180 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:15.789180 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:15.800227 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 333/655] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:15.802085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7937d7-abf9-4b00-9f96-ab5e63f44905 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:15.875528 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedf38e-1c4d-4284-a6ec-cdc426b05d9a None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:15.942504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d81de-07c9-4d37-95cb-152fcf39f1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:15.943515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d81de-07c9-4d37-95cb-152fcf39f1ef None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:15.943983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d81de-07c9-4d37-95cb-152fcf39f1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:15.945117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d81de-07c9-4d37-95cb-152fcf39f1ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:15.972777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d81de-07c9-4d37-95cb-152fcf39f1ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:15.975927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d81de-07c9-4d37-95cb-152fcf39f1ef None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:15.997108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7937d7-abf9-4b00-9f96-ab5e63f44905 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:16.006661 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-e89d81de-07c9-4d37-95cb-152fcf39f1ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:16.006661 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:16.006661 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:16.006661 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:16.006661 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:16.006661 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:16.006661 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:16.006661 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:16.006661 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:16.006661 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:16.006661 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:16.006661 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:16.006661 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:16.006661 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:16.006661 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:16.006661 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:16.008792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:16.008792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:16.008792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:16.008792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:16.008792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:16.008792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:16.008792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:16.008792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:16.008792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:16.008792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:16.008792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:16.008792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:16.008792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:16.008792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:16.008792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:16.008792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:16.008792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:16.010759 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:16.010759 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:16.010759 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:16.012335 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 323/656] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:16.013784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d81de-07c9-4d37-95cb-152fcf39f1ef None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:16.068755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182fcd3-957a-4bcc-92bc-3a2d2097b865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:16.070114 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182fcd3-957a-4bcc-92bc-3a2d2097b865 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:16.070752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182fcd3-957a-4bcc-92bc-3a2d2097b865 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:16.071382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182fcd3-957a-4bcc-92bc-3a2d2097b865 None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:16.072782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182fcd3-957a-4bcc-92bc-3a2d2097b865 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:16.073697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182fcd3-957a-4bcc-92bc-3a2d2097b865 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:16.076367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182fcd3-957a-4bcc-92bc-3a2d2097b865 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:16.099548 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 334/657] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:16.101384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182fcd3-957a-4bcc-92bc-3a2d2097b865 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:16.145534 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:16.214366 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:16.215054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d81de-07c9-4d37-95cb-152fcf39f1ef None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:16.279359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221452d9-70b3-4d93-8abb-4acc0454e633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:16.281578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221452d9-70b3-4d93-8abb-4acc0454e633 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:16.282056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221452d9-70b3-4d93-8abb-4acc0454e633 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:16.282526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221452d9-70b3-4d93-8abb-4acc0454e633 None admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:16.283824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221452d9-70b3-4d93-8abb-4acc0454e633 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:16.284391 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221452d9-70b3-4d93-8abb-4acc0454e633 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:16.287123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221452d9-70b3-4d93-8abb-4acc0454e633 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:16.291665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182fcd3-957a-4bcc-92bc-3a2d2097b865 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:16.310052 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 324/658] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:53:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:16.312863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba8400-558b-4436-8dd3-28c42468d6aa None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:16.313689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba8400-558b-4436-8dd3-28c42468d6aa None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:16.314399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba8400-558b-4436-8dd3-28c42468d6aa None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:16.317179 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 325/659] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:16.318774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba8400-558b-4436-8dd3-28c42468d6aa None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:16.365321 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2e738-971d-4e68-b977-6d10ff82a530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:16.366360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2e738-971d-4e68-b977-6d10ff82a530 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:16.366878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2e738-971d-4e68-b977-6d10ff82a530 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:16.367325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2e738-971d-4e68-b977-6d10ff82a530 None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:16.368560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2e738-971d-4e68-b977-6d10ff82a530 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:16.369184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2e738-971d-4e68-b977-6d10ff82a530 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:16.372002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2e738-971d-4e68-b977-6d10ff82a530 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:16.402104 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 335/660] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:16.403671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2e738-971d-4e68-b977-6d10ff82a530 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:16.492251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba8400-558b-4436-8dd3-28c42468d6aa None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:16.526706 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:16.540227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d7d5c-8742-4356-9fe3-b60588f6e2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:16.540868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d7d5c-8742-4356-9fe3-b60588f6e2d2 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:16.541144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d7d5c-8742-4356-9fe3-b60588f6e2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:16.541418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d7d5c-8742-4356-9fe3-b60588f6e2d2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:16.550439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d7d5c-8742-4356-9fe3-b60588f6e2d2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:16.551923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d7d5c-8742-4356-9fe3-b60588f6e2d2 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:16.566480 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-5c3d7d5c-8742-4356-9fe3-b60588f6e2d2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 00:53:16.566480 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:16.566480 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:16.566480 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:16.566480 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:16.566480 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:16.566480 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:16.566480 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:16.566480 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:16.566480 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:16.566480 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:16.566480 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:16.566480 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:53:16.566480 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:53:16.566480 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:53:16.566480 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:53:16.568328 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:16.568328 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:16.568328 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:53:16.568328 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:16.568328 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:53:16.568328 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:16.568328 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:16.568328 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:16.568328 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:16.568328 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:16.568328 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:16.568328 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:16.568328 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:16.568328 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:16.568328 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:16.568328 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:16.568328 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:16.568328 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:16.570120 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:16.570120 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:16.570120 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:53:16.570120 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:53:16.570120 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:53:16.570120 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:53:16.570120 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:53:16.570120 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:53:16.570120 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 07 00:53:16.570120 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:16.570120 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 326/661] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Aug 7 00:53:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:16.570120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd0d8b-eae9-4009-8130-89acf90fe858 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:16.570120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd0d8b-eae9-4009-8130-89acf90fe858 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:16.571369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd0d8b-eae9-4009-8130-89acf90fe858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:16.599476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2e738-971d-4e68-b977-6d10ff82a530 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:16.600638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5dfd0d8b-eae9-4009-8130-89acf90fe858 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:16.601878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5dfd0d8b-eae9-4009-8130-89acf90fe858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:16.639916 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:16.659586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fceed78-d049-40ee-afaa-f632885d7f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:16.660141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fceed78-d049-40ee-afaa-f632885d7f80 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:16.660480 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fceed78-d049-40ee-afaa-f632885d7f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:16.660756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fceed78-d049-40ee-afaa-f632885d7f80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:16.661521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fceed78-d049-40ee-afaa-f632885d7f80 None admin] RBAC: Adding query filter params (role.id=af03b67d56b44430ab9d48dcba18ace2, scope.project.id=1cd2efda8567437e983e3a7867ecd69b, user.id=bcb60ac015204436b81971694393380c) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:16.661830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fceed78-d049-40ee-afaa-f632885d7f80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:16.664137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fceed78-d049-40ee-afaa-f632885d7f80 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:16.671008 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 336/662] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:53:16 2022] GET /identity/v3/role_assignments?user.id=bcb60ac015204436b81971694393380c&scope.project.id=1cd2efda8567437e983e3a7867ecd69b&role.id=af03b67d56b44430ab9d48dcba18ace2 => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:16.682006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fceed78-d049-40ee-afaa-f632885d7f80 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:16.721634 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 327/663] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:53:16.723134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd0d8b-eae9-4009-8130-89acf90fe858 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:16.908383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fceed78-d049-40ee-afaa-f632885d7f80 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:16.916653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd0d8b-eae9-4009-8130-89acf90fe858 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:16.945765 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:16.975569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9918bf-4b58-4fc7-861f-e794f10fc628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:16.977752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9918bf-4b58-4fc7-861f-e794f10fc628 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:16.978519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9918bf-4b58-4fc7-861f-e794f10fc628 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:16.979190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9918bf-4b58-4fc7-861f-e794f10fc628 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:16.993538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0c280-4495-4f2a-8303-ab9f7636ba54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:16.994757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0c280-4495-4f2a-8303-ab9f7636ba54 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:16.995350 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0c280-4495-4f2a-8303-ab9f7636ba54 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:16.996257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0c280-4495-4f2a-8303-ab9f7636ba54 None admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:16.997714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0c280-4495-4f2a-8303-ab9f7636ba54 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:16.997961 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9918bf-4b58-4fc7-861f-e794f10fc628 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:16.998276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0c280-4495-4f2a-8303-ab9f7636ba54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:17.000877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9918bf-4b58-4fc7-861f-e794f10fc628 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:17.001089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0c280-4495-4f2a-8303-ab9f7636ba54 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:17.020190 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-4a9918bf-4b58-4fc7-861f-e794f10fc628 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 00:53:17.020190 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:17.020190 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:17.020190 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:17.020190 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:17.020190 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:17.020190 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:17.020190 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:17.020190 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:17.020190 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:17.020190 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:17.020190 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:17.020190 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:53:17.020190 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:53:17.020190 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:53:17.020190 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:53:17.021316 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:17.021316 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:17.021316 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:53:17.021316 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:17.021316 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:53:17.021316 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:17.021316 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:17.021316 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:17.021316 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:17.021316 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:17.021316 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:17.021316 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:17.021316 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:17.021316 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:17.021316 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:17.021316 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:17.021316 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:17.021316 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:17.022986 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:17.022986 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:17.022986 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:53:17.022986 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:53:17.022986 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:53:17.022986 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:53:17.022986 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:53:17.022986 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:53:17.022986 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 00:53:17.022986 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:17.026034 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 337/664] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:53:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:17.031743 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 328/665] 10.222.0.39 () {56 vars in 1139 bytes} [Sun Aug 7 00:53:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:17.032215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9918bf-4b58-4fc7-861f-e794f10fc628 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:17.041702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0c280-4495-4f2a-8303-ab9f7636ba54 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:17.153846 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:17.221527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9918bf-4b58-4fc7-861f-e794f10fc628 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:17.225972 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0c280-4495-4f2a-8303-ab9f7636ba54 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:17.286487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c7b03-cdda-48c7-ad6b-47c1c14e14f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:17.287102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf6a76-e643-4ad5-a66f-f666972b53e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:17.287496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c7b03-cdda-48c7-ad6b-47c1c14e14f7 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:17.287984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c7b03-cdda-48c7-ad6b-47c1c14e14f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:17.288433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c7b03-cdda-48c7-ad6b-47c1c14e14f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:17.289239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf6a76-e643-4ad5-a66f-f666972b53e4 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:17.289951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf6a76-e643-4ad5-a66f-f666972b53e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:17.290666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf6a76-e643-4ad5-a66f-f666972b53e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:17.309292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c7b03-cdda-48c7-ad6b-47c1c14e14f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:53:17.320412 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-601c7b03-cdda-48c7-ad6b-47c1c14e14f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:53:17.320412 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:17.320412 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:17.320412 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:17.320412 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:17.320412 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:17.320412 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:17.320412 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:17.320412 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:17.320412 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:17.320412 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:17.320412 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:17.320412 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:53:17.320412 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:53:17.320412 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:53:17.320412 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:53:17.322275 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:53:17.322275 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:53:17.322275 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:53:17.322275 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:53:17.322275 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:17.322275 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:17.322275 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:17.322275 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:17.322275 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:17.322275 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:17.322275 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:17.322275 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:17.322275 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:17.322275 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:17.322275 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:17.322275 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:17.323931 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:17.323931 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:17.323931 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:17.323931 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:17.323931 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:53:17.323931 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:53:17.323931 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:53:17.323931 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:53:17.323931 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:53:17.323931 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:53:17.323931 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:53:17.323931 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:17.323931 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 338/666] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:53:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:17.323931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c7b03-cdda-48c7-ad6b-47c1c14e14f7 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:17.378647 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:17.425243 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf6a76-e643-4ad5-a66f-f666972b53e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:17.428386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf6a76-e643-4ad5-a66f-f666972b53e4 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:17.525060 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c7b03-cdda-48c7-ad6b-47c1c14e14f7 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:17.529619 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:17.593062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414968d0-7984-4641-91f6-f01024561cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:17.594462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414968d0-7984-4641-91f6-f01024561cbe None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:17.595189 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414968d0-7984-4641-91f6-f01024561cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:17.595965 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414968d0-7984-4641-91f6-f01024561cbe None admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:17.597722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414968d0-7984-4641-91f6-f01024561cbe None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:17.598375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414968d0-7984-4641-91f6-f01024561cbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:17.601121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414968d0-7984-4641-91f6-f01024561cbe None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:17.614670 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 329/667] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:53:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:53:17.616289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf6a76-e643-4ad5-a66f-f666972b53e4 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:17.644176 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 339/668] 10.222.0.39 () {56 vars in 1137 bytes} [Sun Aug 7 00:53:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:17.645740 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414968d0-7984-4641-91f6-f01024561cbe None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:17.757166 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:17.812515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf6a76-e643-4ad5-a66f-f666972b53e4 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:17.850669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414968d0-7984-4641-91f6-f01024561cbe None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:17.886652 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f479dcd-1ac4-4495-bdd3-15199089c14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:17.887605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f479dcd-1ac4-4495-bdd3-15199089c14b None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:17.888160 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f479dcd-1ac4-4495-bdd3-15199089c14b None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:17.888678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f479dcd-1ac4-4495-bdd3-15199089c14b None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:17.889978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f479dcd-1ac4-4495-bdd3-15199089c14b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:17.890575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f479dcd-1ac4-4495-bdd3-15199089c14b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:17.893125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f479dcd-1ac4-4495-bdd3-15199089c14b None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:17.911630 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 330/669] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:53:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:17.913184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f479dcd-1ac4-4495-bdd3-15199089c14b None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:17.925984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f1238-554e-4645-8739-2c5ba3b15475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:17.927419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f1238-554e-4645-8739-2c5ba3b15475 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:17.928243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f1238-554e-4645-8739-2c5ba3b15475 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:17.929787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f1238-554e-4645-8739-2c5ba3b15475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:17.954546 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f1238-554e-4645-8739-2c5ba3b15475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:17.957839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f1238-554e-4645-8739-2c5ba3b15475 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:17.992994 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-aa2f1238-554e-4645-8739-2c5ba3b15475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:17.992994 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:17.992994 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:17.992994 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:17.992994 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:17.992994 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:17.992994 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:17.992994 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:17.992994 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:17.992994 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:17.992994 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:17.992994 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:17.992994 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:17.992994 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:17.992994 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:17.992994 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:17.994166 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:17.994166 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:17.994166 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:17.994166 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:17.994166 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:17.994166 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:17.994166 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:17.994166 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:17.994166 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:17.994166 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:17.994166 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:17.994166 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:17.994166 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:17.994166 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:17.994166 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:17.994166 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:17.994166 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:17.995056 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:17.995056 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:17.995056 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:18.002803 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 340/670] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:18.002803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f1238-554e-4645-8739-2c5ba3b15475 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:18.026531 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:18.110976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f479dcd-1ac4-4495-bdd3-15199089c14b None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:18.164203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f1238-554e-4645-8739-2c5ba3b15475 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:18.167542 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226777ee-5b7a-4117-9461-07a4df4b9bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:18.168348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226777ee-5b7a-4117-9461-07a4df4b9bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:18.168763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226777ee-5b7a-4117-9461-07a4df4b9bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:18.169203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226777ee-5b7a-4117-9461-07a4df4b9bf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:18.177495 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:18.227900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe2f17-49cd-4752-958e-b6e057be917b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:18.228750 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe2f17-49cd-4752-958e-b6e057be917b None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:18.229154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe2f17-49cd-4752-958e-b6e057be917b None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:18.229547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe2f17-49cd-4752-958e-b6e057be917b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:18.243447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe2f17-49cd-4752-958e-b6e057be917b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:18.245332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe2f17-49cd-4752-958e-b6e057be917b None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:18.264840 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-d6fe2f17-49cd-4752-958e-b6e057be917b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:18.264840 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:18.264840 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:18.264840 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:18.264840 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:18.264840 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:18.264840 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:18.264840 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:18.264840 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:18.264840 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:18.264840 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:18.264840 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:18.264840 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:18.264840 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:18.264840 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:18.264840 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:18.265901 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:18.265901 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:18.265901 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:18.265901 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:18.265901 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:18.265901 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:18.265901 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:18.265901 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:18.265901 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:18.265901 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:18.265901 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:18.265901 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:18.265901 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:18.265901 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:18.265901 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:18.265901 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:18.265901 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:18.266837 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:18.266837 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:18.266837 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:18.267022 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 341/671] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:18.268559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe2f17-49cd-4752-958e-b6e057be917b None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:18.289056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226777ee-5b7a-4117-9461-07a4df4b9bf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:18.291037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226777ee-5b7a-4117-9461-07a4df4b9bf2 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:18.381057 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:18.433810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe2f17-49cd-4752-958e-b6e057be917b None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:18.436390 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 331/672] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:53:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:53:18.438429 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1686d4-4d96-4668-81ab-4a460f46374d None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:18.439849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1686d4-4d96-4668-81ab-4a460f46374d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:18.440281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1686d4-4d96-4668-81ab-4a460f46374d None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:18.441997 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 332/673] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:18.443567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1686d4-4d96-4668-81ab-4a460f46374d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:18.491942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57dc4a-b694-4b00-a3d1-32c8d1276c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:18.493076 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57dc4a-b694-4b00-a3d1-32c8d1276c5e None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:18.493627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57dc4a-b694-4b00-a3d1-32c8d1276c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:18.494203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57dc4a-b694-4b00-a3d1-32c8d1276c5e None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:18.495525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57dc4a-b694-4b00-a3d1-32c8d1276c5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:18.496186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57dc4a-b694-4b00-a3d1-32c8d1276c5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:18.499117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57dc4a-b694-4b00-a3d1-32c8d1276c5e None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:18.504495 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:18.525881 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 342/674] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:18.525881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57dc4a-b694-4b00-a3d1-32c8d1276c5e None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:18.641052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1686d4-4d96-4668-81ab-4a460f46374d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:18.673362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57dc4a-b694-4b00-a3d1-32c8d1276c5e None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:18.705838 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:18.709496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4dd1b1-b19a-43c7-94c2-a112626796cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:18.710699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dd1b1-b19a-43c7-94c2-a112626796cc None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:18.710977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dd1b1-b19a-43c7-94c2-a112626796cc None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:18.711464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dd1b1-b19a-43c7-94c2-a112626796cc None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:18.711937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4dd1b1-b19a-43c7-94c2-a112626796cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:18.712247 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4dd1b1-b19a-43c7-94c2-a112626796cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:18.713690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4dd1b1-b19a-43c7-94c2-a112626796cc None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:18.718666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888f97d-6d59-46c8-a78b-43f341c5fcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:18.719314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888f97d-6d59-46c8-a78b-43f341c5fcd4 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:18.719618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888f97d-6d59-46c8-a78b-43f341c5fcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:18.719852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888f97d-6d59-46c8-a78b-43f341c5fcd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:18.732574 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 333/675] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:18.732574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8b4c9-5a0f-4d37-9cb5-cd7b346788d5 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:18.732574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8b4c9-5a0f-4d37-9cb5-cd7b346788d5 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:18.732574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8b4c9-5a0f-4d37-9cb5-cd7b346788d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:18.738270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888f97d-6d59-46c8-a78b-43f341c5fcd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:18.739777 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888f97d-6d59-46c8-a78b-43f341c5fcd4 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:18.750734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-21c8b4c9-5a0f-4d37-9cb5-cd7b346788d5 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:18.752393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-21c8b4c9-5a0f-4d37-9cb5-cd7b346788d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:18.760594 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-b888f97d-6d59-46c8-a78b-43f341c5fcd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:18.760594 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:18.760594 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:18.760594 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:18.760594 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:18.760594 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:18.760594 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:18.760594 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:18.760594 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:18.760594 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:18.760594 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:18.760594 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:18.760594 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:18.760594 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:18.760594 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:18.760594 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:18.761805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:18.761805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:18.761805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:18.761805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:18.761805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:18.761805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:18.761805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:18.761805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:18.761805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:18.761805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:18.761805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:18.761805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:18.761805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:18.761805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:18.761805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:18.761805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:18.761805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:18.762913 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:18.762913 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:18.762913 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:18.762913 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 343/676] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:18.762913 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888f97d-6d59-46c8-a78b-43f341c5fcd4 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:18.866009 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 334/677] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:53:18.866881 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8b4c9-5a0f-4d37-9cb5-cd7b346788d5 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:18.909570 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:18.927531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888f97d-6d59-46c8-a78b-43f341c5fcd4 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:18.983667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7853ad-63b0-4eea-b530-424b04022d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:18.984449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7853ad-63b0-4eea-b530-424b04022d79 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:18.984796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7853ad-63b0-4eea-b530-424b04022d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:18.985136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7853ad-63b0-4eea-b530-424b04022d79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:18.992820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7853ad-63b0-4eea-b530-424b04022d79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:18.994684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7853ad-63b0-4eea-b530-424b04022d79 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:19.001192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8b4c9-5a0f-4d37-9cb5-cd7b346788d5 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:19.007414 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-3a7853ad-63b0-4eea-b530-424b04022d79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:19.007414 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:19.007414 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:19.007414 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:19.007414 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:19.007414 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:19.007414 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:19.007414 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:19.007414 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:19.007414 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:19.007414 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:19.007414 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:19.007414 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:53:19.007414 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:53:19.007414 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:53:19.008514 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:53:19.008514 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:19.008514 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:19.008514 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:19.008514 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:19.008514 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:19.008514 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:19.008514 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:19.008514 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:19.008514 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:19.008514 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:19.008514 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:19.008514 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:19.008514 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:19.008514 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:19.008514 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:19.008514 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:19.015043 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:53:19.015043 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:53:19.015043 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:53:19.015043 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:53:19.015043 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:53:19.015043 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:53:19.015043 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:19.015043 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:19.015043 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 344/678] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:19.015043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7853ad-63b0-4eea-b530-424b04022d79 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:19.047038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0bf26-0c56-4463-a229-a1d7b4b4ba0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:19.047696 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0bf26-0c56-4463-a229-a1d7b4b4ba0d None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:19.048013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0bf26-0c56-4463-a229-a1d7b4b4ba0d None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:19.048284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0bf26-0c56-4463-a229-a1d7b4b4ba0d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:19.056124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0bf26-0c56-4463-a229-a1d7b4b4ba0d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:19.057598 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0bf26-0c56-4463-a229-a1d7b4b4ba0d None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:19.064583 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:19.071232 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-62a0bf26-0c56-4463-a229-a1d7b4b4ba0d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:53:19.071232 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:19.071232 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:19.071232 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:19.071232 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:19.071232 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:19.071232 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:19.071232 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:19.071232 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:19.071232 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:19.071232 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:19.071232 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:19.071232 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:53:19.071232 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:53:19.071232 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:53:19.071232 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:53:19.073137 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:19.073137 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:19.073137 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:53:19.073137 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:19.073137 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:53:19.073137 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:19.073137 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:19.073137 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:19.073137 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:19.073137 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:19.073137 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:19.073137 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:19.073137 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:19.073137 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:19.073137 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:19.073137 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:19.073137 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:19.073137 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:19.074995 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:19.074995 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:19.074995 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:53:19.074995 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:53:19.074995 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:53:19.074995 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:53:19.074995 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:53:19.074995 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:53:19.074995 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:53:19.074995 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:19.074995 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 335/679] 10.222.0.39 () {56 vars in 1093 bytes} [Sun Aug 7 00:53:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:19.074995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0bf26-0c56-4463-a229-a1d7b4b4ba0d None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:19.171809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7853ad-63b0-4eea-b530-424b04022d79 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:19.244843 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:19.249244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819a8c4-7649-424c-bb90-79566f152a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:19.250722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819a8c4-7649-424c-bb90-79566f152a9f None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:19.251546 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819a8c4-7649-424c-bb90-79566f152a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:19.252129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819a8c4-7649-424c-bb90-79566f152a9f None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:19.253416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819a8c4-7649-424c-bb90-79566f152a9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:19.253979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819a8c4-7649-424c-bb90-79566f152a9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:19.256653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819a8c4-7649-424c-bb90-79566f152a9f None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:19.277538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0bf26-0c56-4463-a229-a1d7b4b4ba0d None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:19.282339 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 345/680] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:19.283970 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819a8c4-7649-424c-bb90-79566f152a9f None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:19.361138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1ee4d-4b54-472a-b2f0-aeb685280605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:19.362221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1ee4d-4b54-472a-b2f0-aeb685280605 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:19.362694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1ee4d-4b54-472a-b2f0-aeb685280605 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:19.363166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1ee4d-4b54-472a-b2f0-aeb685280605 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:19.384041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1ee4d-4b54-472a-b2f0-aeb685280605 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:53:19.394532 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-f0e1ee4d-4b54-472a-b2f0-aeb685280605 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:19.394532 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:19.394532 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:19.394532 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:19.394532 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:19.394532 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:19.394532 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:19.394532 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:19.394532 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:19.394532 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:19.394532 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:19.394532 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:19.394532 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:53:19.394532 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:53:19.394532 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:53:19.394532 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:53:19.396440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:53:19.396440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:53:19.396440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:53:19.396440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:53:19.396440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:19.396440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:19.396440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:19.396440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:19.396440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:19.396440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:19.396440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:19.396440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:19.396440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:19.396440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:19.396440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:19.396440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:19.398377 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:19.398377 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:19.398377 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:19.398377 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:19.398377 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:53:19.398377 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:53:19.398377 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:53:19.398377 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:53:19.398377 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:53:19.398377 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:53:19.398377 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:19.398377 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:19.405675 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 336/681] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Aug 7 00:53:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:19.407228 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1ee4d-4b54-472a-b2f0-aeb685280605 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:19.490738 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:19.500318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819a8c4-7649-424c-bb90-79566f152a9f None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:19.585779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1251e951-a207-42fe-b0ed-1cfd8f576124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:19.586834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251e951-a207-42fe-b0ed-1cfd8f576124 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:19.587310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251e951-a207-42fe-b0ed-1cfd8f576124 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:19.587811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251e951-a207-42fe-b0ed-1cfd8f576124 None admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:19.589200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1251e951-a207-42fe-b0ed-1cfd8f576124 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:19.589749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1251e951-a207-42fe-b0ed-1cfd8f576124 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:19.593023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1251e951-a207-42fe-b0ed-1cfd8f576124 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:19.607173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1ee4d-4b54-472a-b2f0-aeb685280605 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:19.616903 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 346/682] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:53:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:19.618579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1251e951-a207-42fe-b0ed-1cfd8f576124 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:19.675758 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9387c-b3aa-4763-8f15-5a4e945076a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:19.676693 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9387c-b3aa-4763-8f15-5a4e945076a1 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:19.677091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9387c-b3aa-4763-8f15-5a4e945076a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:19.677504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9387c-b3aa-4763-8f15-5a4e945076a1 None admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:19.678702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b9387c-b3aa-4763-8f15-5a4e945076a1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:19.679190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b9387c-b3aa-4763-8f15-5a4e945076a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:19.681493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b9387c-b3aa-4763-8f15-5a4e945076a1 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:19.719914 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 337/683] 10.222.0.39 () {56 vars in 1133 bytes} [Sun Aug 7 00:53:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:19.721331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9387c-b3aa-4763-8f15-5a4e945076a1 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:19.733795 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:19.818423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1251e951-a207-42fe-b0ed-1cfd8f576124 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:19.880574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea9757-95b3-4a2b-83a3-8d139a16f949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:19.881215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea9757-95b3-4a2b-83a3-8d139a16f949 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:19.881503 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea9757-95b3-4a2b-83a3-8d139a16f949 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:19.881773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea9757-95b3-4a2b-83a3-8d139a16f949 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:19.889956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea9757-95b3-4a2b-83a3-8d139a16f949 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:19.891469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea9757-95b3-4a2b-83a3-8d139a16f949 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:19.904387 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-09ea9757-95b3-4a2b-83a3-8d139a16f949 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:19.904387 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:19.904387 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:19.904387 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:19.904387 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:19.904387 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:19.904387 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:19.904387 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:19.904387 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:19.904387 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:19.904387 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:19.904387 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:19.904387 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:53:19.904387 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:53:19.904387 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:53:19.906520 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:53:19.906520 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:19.906520 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:19.906520 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:19.906520 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:19.906520 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:19.906520 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:19.906520 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:19.906520 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:19.906520 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:19.906520 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:19.906520 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:19.906520 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:19.906520 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:19.906520 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:19.906520 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:19.906520 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:19.908405 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:53:19.908405 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:53:19.908405 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:53:19.908405 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:53:19.908405 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:53:19.908405 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:53:19.908405 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:19.908405 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:19.908405 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 347/684] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:19.908405 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea9757-95b3-4a2b-83a3-8d139a16f949 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:19.918505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9387c-b3aa-4763-8f15-5a4e945076a1 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:19.944340 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:19.986342 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05fbb2-1854-474d-a790-61c09e52b67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:19.986906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05fbb2-1854-474d-a790-61c09e52b67f None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:19.987762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05fbb2-1854-474d-a790-61c09e52b67f None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:19.988298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05fbb2-1854-474d-a790-61c09e52b67f None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:19.989569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05fbb2-1854-474d-a790-61c09e52b67f None admin] RBAC: Adding query filter params (name=service) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:19.990675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05fbb2-1854-474d-a790-61c09e52b67f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:19.992505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05fbb2-1854-474d-a790-61c09e52b67f None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:20.003175 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 338/685] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Aug 7 00:53:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:20.004862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05fbb2-1854-474d-a790-61c09e52b67f None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:20.082205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea9757-95b3-4a2b-83a3-8d139a16f949 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:20.127210 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:20.145600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2a0c7-9521-415f-aeb5-cfd0ed5dd30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:20.146768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2a0c7-9521-415f-aeb5-cfd0ed5dd30e None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:20.147161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2a0c7-9521-415f-aeb5-cfd0ed5dd30e None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:20.147920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2a0c7-9521-415f-aeb5-cfd0ed5dd30e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:20.149385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2a0c7-9521-415f-aeb5-cfd0ed5dd30e None admin] RBAC: Adding query filter params (role.id=af03b67d56b44430ab9d48dcba18ace2, scope.project.id=1cd2efda8567437e983e3a7867ecd69b, user.id=b219e01934fa477fbaa053cca586f01b) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:20.149951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2a0c7-9521-415f-aeb5-cfd0ed5dd30e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:20.152825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2a0c7-9521-415f-aeb5-cfd0ed5dd30e None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:20.164986 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 348/686] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:53:19 2022] GET /identity/v3/role_assignments?user.id=b219e01934fa477fbaa053cca586f01b&scope.project.id=1cd2efda8567437e983e3a7867ecd69b&role.id=af03b67d56b44430ab9d48dcba18ace2 => generated 608 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:20.167052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20915feb-bce7-4360-a726-31903e78e268 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:20.167575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20915feb-bce7-4360-a726-31903e78e268 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:20.168090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20915feb-bce7-4360-a726-31903e78e268 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:20.170851 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 349/687] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:20.172194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20915feb-bce7-4360-a726-31903e78e268 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:20.186441 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05fbb2-1854-474d-a790-61c09e52b67f None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:20.264547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81928d70-1fd7-4a02-a5e6-10fb4ef6cc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:20.265498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81928d70-1fd7-4a02-a5e6-10fb4ef6cc29 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:20.265918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81928d70-1fd7-4a02-a5e6-10fb4ef6cc29 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:20.266331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81928d70-1fd7-4a02-a5e6-10fb4ef6cc29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:20.367204 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:20.413810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20915feb-bce7-4360-a726-31903e78e268 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:20.478550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cf684-dfc9-4be2-a19a-6ae8b3aa887e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:20.480059 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cf684-dfc9-4be2-a19a-6ae8b3aa887e None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:20.480980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cf684-dfc9-4be2-a19a-6ae8b3aa887e None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:20.481713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cf684-dfc9-4be2-a19a-6ae8b3aa887e None admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:20.483925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969cf684-dfc9-4be2-a19a-6ae8b3aa887e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:20.484863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969cf684-dfc9-4be2-a19a-6ae8b3aa887e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:20.487873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969cf684-dfc9-4be2-a19a-6ae8b3aa887e None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:20.515005 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 350/688] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:53:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:20.517790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cf684-dfc9-4be2-a19a-6ae8b3aa887e None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:20.597017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81928d70-1fd7-4a02-a5e6-10fb4ef6cc29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:20.599477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81928d70-1fd7-4a02-a5e6-10fb4ef6cc29 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:20.681369 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:20.710283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cf684-dfc9-4be2-a19a-6ae8b3aa887e None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:20.750187 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 339/689] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:53:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 744 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:53:20.751220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d943c1-7033-4006-b80c-da07170b9ba5 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:20.751594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d943c1-7033-4006-b80c-da07170b9ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:20.752030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d943c1-7033-4006-b80c-da07170b9ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:20.770217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f79a15-7bd6-427c-8a98-3653500f4081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:20.771639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f79a15-7bd6-427c-8a98-3653500f4081 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:20.772146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f79a15-7bd6-427c-8a98-3653500f4081 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:20.772891 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f79a15-7bd6-427c-8a98-3653500f4081 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:20.774725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d2d943c1-7033-4006-b80c-da07170b9ba5 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:20.776377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d2d943c1-7033-4006-b80c-da07170b9ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:20.792602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f79a15-7bd6-427c-8a98-3653500f4081 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:20.796003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f79a15-7bd6-427c-8a98-3653500f4081 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:20.799366 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:20.825303 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-58f79a15-7bd6-427c-8a98-3653500f4081 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:20.825303 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:20.825303 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:20.825303 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:20.825303 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:20.825303 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:20.825303 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:20.825303 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:20.825303 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:20.825303 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:20.825303 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:20.825303 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:20.825303 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:20.825303 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:20.825303 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:20.825303 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:20.828702 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:20.828702 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:20.828702 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:20.828702 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:20.828702 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:20.828702 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:20.828702 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:20.828702 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:20.828702 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:20.828702 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:20.828702 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:20.828702 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:20.828702 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:20.828702 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:20.828702 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:20.828702 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:20.828702 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:20.829650 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:20.829650 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:20.829650 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:20.835605 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 351/690] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:20.837259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f79a15-7bd6-427c-8a98-3653500f4081 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:20.875734 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 340/691] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:53:20.876657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d943c1-7033-4006-b80c-da07170b9ba5 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:21.028354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f79a15-7bd6-427c-8a98-3653500f4081 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:21.079971 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:21.093658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d943c1-7033-4006-b80c-da07170b9ba5 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:21.099648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b77f3-713a-41cb-af00-53d8a66d340d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:21.100737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b77f3-713a-41cb-af00-53d8a66d340d None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:21.101240 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b77f3-713a-41cb-af00-53d8a66d340d None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:21.101797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b77f3-713a-41cb-af00-53d8a66d340d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:21.103319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b77f3-713a-41cb-af00-53d8a66d340d None admin] RBAC: Adding query filter params (role.id=af03b67d56b44430ab9d48dcba18ace2, scope.project.id=1cd2efda8567437e983e3a7867ecd69b, user.id=9a8be18e03a54bd8821ed5c048bbc793) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:21.103973 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b77f3-713a-41cb-af00-53d8a66d340d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:21.106602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b77f3-713a-41cb-af00-53d8a66d340d None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:21.119512 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 352/692] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:53:20 2022] GET /identity/v3/role_assignments?user.id=9a8be18e03a54bd8821ed5c048bbc793&scope.project.id=1cd2efda8567437e983e3a7867ecd69b&role.id=af03b67d56b44430ab9d48dcba18ace2 => generated 608 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:21.121559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b77f3-713a-41cb-af00-53d8a66d340d None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:21.176144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f93c0c-db91-40a6-b770-a2bcc3dab8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:21.177342 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f93c0c-db91-40a6-b770-a2bcc3dab8d2 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:21.177908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f93c0c-db91-40a6-b770-a2bcc3dab8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:21.178499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f93c0c-db91-40a6-b770-a2bcc3dab8d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:21.199499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f93c0c-db91-40a6-b770-a2bcc3dab8d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:21.202772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f93c0c-db91-40a6-b770-a2bcc3dab8d2 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:21.233878 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-32f93c0c-db91-40a6-b770-a2bcc3dab8d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:21.233878 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:21.233878 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:21.233878 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:21.233878 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:21.233878 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:21.233878 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:21.233878 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:21.233878 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:21.233878 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:21.233878 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:21.233878 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:21.233878 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:21.233878 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:21.233878 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:21.233878 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:21.235907 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:21.235907 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:21.235907 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:21.235907 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:21.235907 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:21.235907 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:21.235907 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:21.235907 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:21.235907 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:21.235907 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:21.235907 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:21.235907 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:21.235907 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:21.235907 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:21.235907 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:21.235907 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:21.235907 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:21.237605 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:21.237605 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:21.237605 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:21.240955 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 341/693] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:21.242819 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f93c0c-db91-40a6-b770-a2bcc3dab8d2 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:21.258448 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:21.370768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b77f3-713a-41cb-af00-53d8a66d340d None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:21.444335 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708696fe-88fc-493c-8710-7d6e17801958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:21.445455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708696fe-88fc-493c-8710-7d6e17801958 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:21.446066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708696fe-88fc-493c-8710-7d6e17801958 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:21.446668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708696fe-88fc-493c-8710-7d6e17801958 None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:21.450807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708696fe-88fc-493c-8710-7d6e17801958 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:21.450807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708696fe-88fc-493c-8710-7d6e17801958 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:21.451562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708696fe-88fc-493c-8710-7d6e17801958 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:21.470090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f93c0c-db91-40a6-b770-a2bcc3dab8d2 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:21.482066 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 353/694] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:21.484406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708696fe-88fc-493c-8710-7d6e17801958 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:21.537535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7a724-b896-4d4a-8e50-280eebda3231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:21.538906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7a724-b896-4d4a-8e50-280eebda3231 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:21.539646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7a724-b896-4d4a-8e50-280eebda3231 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:21.540656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7a724-b896-4d4a-8e50-280eebda3231 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:21.560881 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b7a724-b896-4d4a-8e50-280eebda3231 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:21.564043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b7a724-b896-4d4a-8e50-280eebda3231 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:21.592264 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:21.600532 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-52b7a724-b896-4d4a-8e50-280eebda3231 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:21.600532 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:21.600532 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:21.600532 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:21.600532 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:21.600532 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:21.600532 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:21.600532 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:21.600532 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:21.600532 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:21.600532 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:21.600532 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:21.600532 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:21.600532 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:21.600532 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:21.600532 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:21.602560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:21.602560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:21.602560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:21.602560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:21.602560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:21.602560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:21.602560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:21.602560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:21.602560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:21.602560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:21.602560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:21.602560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:21.602560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:21.602560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:21.602560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:21.602560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:21.602560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:21.604420 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:21.604420 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:21.604420 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:21.608484 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 342/695] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:21.610065 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7a724-b896-4d4a-8e50-280eebda3231 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:21.702668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708696fe-88fc-493c-8710-7d6e17801958 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:21.754543 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:21.783674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45350f9a-81e8-4d1f-a201-2bf70a5b967c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:21.784719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45350f9a-81e8-4d1f-a201-2bf70a5b967c None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:21.785162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45350f9a-81e8-4d1f-a201-2bf70a5b967c None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:21.785621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45350f9a-81e8-4d1f-a201-2bf70a5b967c None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:21.786804 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45350f9a-81e8-4d1f-a201-2bf70a5b967c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:21.787319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45350f9a-81e8-4d1f-a201-2bf70a5b967c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:21.787840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7a724-b896-4d4a-8e50-280eebda3231 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:21.789715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45350f9a-81e8-4d1f-a201-2bf70a5b967c None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:21.817387 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 354/696] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:21.819198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45350f9a-81e8-4d1f-a201-2bf70a5b967c None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:21.849598 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e192c2-0690-4147-9b65-95b3bfb9b63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:21.851136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e192c2-0690-4147-9b65-95b3bfb9b63e None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:21.851594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e192c2-0690-4147-9b65-95b3bfb9b63e None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:21.852111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e192c2-0690-4147-9b65-95b3bfb9b63e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:21.869086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e192c2-0690-4147-9b65-95b3bfb9b63e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:21.871994 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e192c2-0690-4147-9b65-95b3bfb9b63e None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:21.896736 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-12e192c2-0690-4147-9b65-95b3bfb9b63e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:53:21.896736 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:21.896736 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:21.896736 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:21.896736 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:21.896736 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:21.896736 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:21.896736 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:21.896736 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:21.896736 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:21.896736 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:21.896736 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:21.896736 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:53:21.896736 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:53:21.896736 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:53:21.896736 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:53:21.898905 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:21.898905 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:21.898905 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:53:21.898905 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:21.898905 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:53:21.898905 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:21.898905 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:21.898905 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:21.898905 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:21.898905 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:21.898905 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:21.898905 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:21.898905 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:21.898905 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:21.898905 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:21.898905 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:21.898905 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:21.898905 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:21.901846 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:21.901846 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:21.901846 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:53:21.901846 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:53:21.901846 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:53:21.901846 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:53:21.901846 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:53:21.901846 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:53:21.901846 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:53:21.901846 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:21.907918 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 343/697] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:53:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:21.907918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e192c2-0690-4147-9b65-95b3bfb9b63e None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:22.023965 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45350f9a-81e8-4d1f-a201-2bf70a5b967c None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:22.050401 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:22.093587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063e665-2fa2-4c42-aafd-f730fdcb2875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:22.094854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063e665-2fa2-4c42-aafd-f730fdcb2875 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:22.095422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063e665-2fa2-4c42-aafd-f730fdcb2875 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:22.096071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0063e665-2fa2-4c42-aafd-f730fdcb2875 None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:22.106485 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e192c2-0690-4147-9b65-95b3bfb9b63e None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:22.112517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0063e665-2fa2-4c42-aafd-f730fdcb2875 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:22.113182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0063e665-2fa2-4c42-aafd-f730fdcb2875 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:22.116327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0063e665-2fa2-4c42-aafd-f730fdcb2875 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:22.145383 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 355/698] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:22.145383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063e665-2fa2-4c42-aafd-f730fdcb2875 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:22.172089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19d2f9-23aa-4d53-9be7-014f79ea1e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:22.173358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19d2f9-23aa-4d53-9be7-014f79ea1e0c None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:22.173927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19d2f9-23aa-4d53-9be7-014f79ea1e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:22.174484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19d2f9-23aa-4d53-9be7-014f79ea1e0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:22.187236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19d2f9-23aa-4d53-9be7-014f79ea1e0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:22.189999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19d2f9-23aa-4d53-9be7-014f79ea1e0c None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:22.211639 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-4d19d2f9-23aa-4d53-9be7-014f79ea1e0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:22.211639 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:22.211639 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:22.211639 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:22.211639 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:22.211639 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:22.211639 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:22.211639 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:22.211639 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:22.211639 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:22.211639 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:22.211639 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:22.211639 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:53:22.211639 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:53:22.211639 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:53:22.213700 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:53:22.213700 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:22.213700 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:22.213700 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:22.213700 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:22.213700 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:22.213700 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:22.213700 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:22.213700 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:22.213700 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:22.213700 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:22.213700 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:22.213700 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:22.213700 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:22.213700 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:22.213700 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:22.213700 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:22.227381 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:53:22.227381 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:53:22.227381 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:53:22.227381 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:53:22.227381 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:53:22.227381 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:53:22.227381 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:22.227381 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:22.227381 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 344/699] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:22.227381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19d2f9-23aa-4d53-9be7-014f79ea1e0c None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:22.259564 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:22.378889 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0063e665-2fa2-4c42-aafd-f730fdcb2875 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:22.452006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75023549-b690-4b52-8ccd-be58b25071d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:22.452628 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75023549-b690-4b52-8ccd-be58b25071d9 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:22.452908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75023549-b690-4b52-8ccd-be58b25071d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:22.453185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75023549-b690-4b52-8ccd-be58b25071d9 None admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:22.453484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19d2f9-23aa-4d53-9be7-014f79ea1e0c None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:22.453935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75023549-b690-4b52-8ccd-be58b25071d9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:22.454241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75023549-b690-4b52-8ccd-be58b25071d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:22.455862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75023549-b690-4b52-8ccd-be58b25071d9 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:22.481020 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 356/700] 10.222.0.39 () {56 vars in 1135 bytes} [Sun Aug 7 00:53:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:22.481020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75023549-b690-4b52-8ccd-be58b25071d9 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:22.486565 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:22.505500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc836a0b-d36a-4c99-b732-e47ee8f8b0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:22.506240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc836a0b-d36a-4c99-b732-e47ee8f8b0d0 None admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:22.506591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc836a0b-d36a-4c99-b732-e47ee8f8b0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:22.506928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc836a0b-d36a-4c99-b732-e47ee8f8b0d0 None admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:22.508274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc836a0b-d36a-4c99-b732-e47ee8f8b0d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:22.509796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc836a0b-d36a-4c99-b732-e47ee8f8b0d0 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:22.552160 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 345/701] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Aug 7 00:53:22 2022] POST /identity/v3/users => generated 254 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:53:22.554569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc836a0b-d36a-4c99-b732-e47ee8f8b0d0 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:22.625746 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:22.634965 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75023549-b690-4b52-8ccd-be58b25071d9 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:22.679508 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b29cb66-2da1-4fa2-8080-97f89693f731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:22.680545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29cb66-2da1-4fa2-8080-97f89693f731 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:22.681123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29cb66-2da1-4fa2-8080-97f89693f731 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:22.681576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29cb66-2da1-4fa2-8080-97f89693f731 None admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:22.682645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b29cb66-2da1-4fa2-8080-97f89693f731 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:22.683129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b29cb66-2da1-4fa2-8080-97f89693f731 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:22.684794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b29cb66-2da1-4fa2-8080-97f89693f731 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:22.700930 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 357/702] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:53:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:22.708041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b29cb66-2da1-4fa2-8080-97f89693f731 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:22.778836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc836a0b-d36a-4c99-b732-e47ee8f8b0d0 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:22.843860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b29cb66-2da1-4fa2-8080-97f89693f731 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:22.862426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440c690-c7dc-4ab4-81cc-b95d12c0e931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:22.863442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440c690-c7dc-4ab4-81cc-b95d12c0e931 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:22.863964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440c690-c7dc-4ab4-81cc-b95d12c0e931 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:22.864507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440c690-c7dc-4ab4-81cc-b95d12c0e931 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:22.885803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bf196-50d7-4b91-995a-25effc5e9d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:22.886832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bf196-50d7-4b91-995a-25effc5e9d8f None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:22.887393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bf196-50d7-4b91-995a-25effc5e9d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:22.887950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bf196-50d7-4b91-995a-25effc5e9d8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:22.889556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0bf196-50d7-4b91-995a-25effc5e9d8f None admin] RBAC: Adding query filter params (role.id=695b07606e564668bac7afff4ab6052a, scope.project.id=1cd2efda8567437e983e3a7867ecd69b, user.id=6c70d5a72d424db68de7c7b8257fe02c) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:22.890119 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0bf196-50d7-4b91-995a-25effc5e9d8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:22.892019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0bf196-50d7-4b91-995a-25effc5e9d8f None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:22.900250 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 358/703] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:53:22 2022] GET /identity/v3/role_assignments?user.id=6c70d5a72d424db68de7c7b8257fe02c&scope.project.id=1cd2efda8567437e983e3a7867ecd69b&role.id=695b07606e564668bac7afff4ab6052a => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:22.979175 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:23.028677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440c690-c7dc-4ab4-81cc-b95d12c0e931 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:23.032157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440c690-c7dc-4ab4-81cc-b95d12c0e931 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:23.185557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daa24e-1b7b-48c5-adab-2d364f3e9650 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:23.186132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daa24e-1b7b-48c5-adab-2d364f3e9650 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:23.186132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daa24e-1b7b-48c5-adab-2d364f3e9650 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:23.187710 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 359/704] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:23.195249 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d3be7-b29d-49e9-b8ae-fbcecafcc67f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:23.195559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d3be7-b29d-49e9-b8ae-fbcecafcc67f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:23.195787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d3be7-b29d-49e9-b8ae-fbcecafcc67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:23.241195 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 346/705] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:53:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 688 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:53:23.243954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7e2d3be7-b29d-49e9-b8ae-fbcecafcc67f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:23.245188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7e2d3be7-b29d-49e9-b8ae-fbcecafcc67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:23.250492 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440c690-c7dc-4ab4-81cc-b95d12c0e931 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:23.289299 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:23.414257 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:23.449516 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 360/706] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:53:23.463419 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440c690-c7dc-4ab4-81cc-b95d12c0e931 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:23.489041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d3be7-b29d-49e9-b8ae-fbcecafcc67f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:23.545001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02a698-a112-4bba-a5d0-0ccc6b8e0120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:23.546582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02a698-a112-4bba-a5d0-0ccc6b8e0120 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:23.547053 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02a698-a112-4bba-a5d0-0ccc6b8e0120 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:23.547524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02a698-a112-4bba-a5d0-0ccc6b8e0120 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:23.570396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02a698-a112-4bba-a5d0-0ccc6b8e0120 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:23.573122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02a698-a112-4bba-a5d0-0ccc6b8e0120 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:23.625247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-3e02a698-a112-4bba-a5d0-0ccc6b8e0120 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:23.625247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:23.625247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:23.625247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:23.625247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:23.625247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:23.625247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:23.625247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:23.625247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:23.625247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:23.625247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:23.625247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:23.625247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:23.625247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:23.625247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:23.625247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:23.626265 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:23.626265 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:23.626265 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:23.626265 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:23.626265 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:23.626265 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:23.626265 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:23.626265 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:23.626265 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:23.626265 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:23.626265 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:23.626265 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:23.626265 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:23.626265 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:23.626265 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:23.626265 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:23.626265 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:23.627155 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:23.627155 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:23.627155 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:23.627761 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 347/707] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:53:23.633661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02a698-a112-4bba-a5d0-0ccc6b8e0120 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:23.707575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d3be7-b29d-49e9-b8ae-fbcecafcc67f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:23.761901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ebc0b-e66d-4a7f-82ae-0f4bd7d36b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:23.762571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ebc0b-e66d-4a7f-82ae-0f4bd7d36b86 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:23.762851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ebc0b-e66d-4a7f-82ae-0f4bd7d36b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:23.763124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ebc0b-e66d-4a7f-82ae-0f4bd7d36b86 None admin] PATH_INFO: `/v3/services/network` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:23.763793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ebc0b-e66d-4a7f-82ae-0f4bd7d36b86 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:23.765819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ebc0b-e66d-4a7f-82ae-0f4bd7d36b86 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:23.782597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02a698-a112-4bba-a5d0-0ccc6b8e0120 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:23.783386 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-481ebc0b-e66d-4a7f-82ae-0f4bd7d36b86 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 00:53:23.783386 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:23.783386 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:53:23.783386 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:53:23.783386 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:53:23.783386 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:53:23.783386 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:53:23.783386 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:23.783386 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 00:53:23.783386 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:23.783386 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:53:23.783386 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:23.783386 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:23.783386 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:23.783386 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:23.783386 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:23.783386 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:23.784426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:23.784426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:23.784426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:23.784426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:23.784426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:23.784426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:23.784426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:53:23.784426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:53:23.784426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:53:23.784426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:53:23.784426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:23.784426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:23.784426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:23.784426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:23.784426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:23.784426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:23.785311 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:23.785311 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:23.785311 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:23.785311 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:23.785311 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:23.785311 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:23.785311 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:23.785311 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:23.785311 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:23.785311 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:23.785311 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:53:23.785311 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:23.785311 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 00:53:23.785311 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:23.789996 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 361/708] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:23 2022] GET /identity/v3/services/network => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:53:23.797156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ebc0b-e66d-4a7f-82ae-0f4bd7d36b86 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:23.835874 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:23.850219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd131ea6-674a-48c1-ac69-d641ac0c2c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:23.851285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd131ea6-674a-48c1-ac69-d641ac0c2c4f None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:23.851484 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:23.852131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd131ea6-674a-48c1-ac69-d641ac0c2c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:23.852338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd131ea6-674a-48c1-ac69-d641ac0c2c4f None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:23.853566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd131ea6-674a-48c1-ac69-d641ac0c2c4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:23.854148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd131ea6-674a-48c1-ac69-d641ac0c2c4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:23.856881 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd131ea6-674a-48c1-ac69-d641ac0c2c4f None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:23.882048 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 348/709] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:53:23.891367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd131ea6-674a-48c1-ac69-d641ac0c2c4f None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:24.052526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd131ea6-674a-48c1-ac69-d641ac0c2c4f None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:24.093006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de9275-c7e7-48f8-b4f1-700a1450d596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:24.094455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de9275-c7e7-48f8-b4f1-700a1450d596 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:24.094976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de9275-c7e7-48f8-b4f1-700a1450d596 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:24.095496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de9275-c7e7-48f8-b4f1-700a1450d596 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:24.104051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de9275-c7e7-48f8-b4f1-700a1450d596 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:24.105591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de9275-c7e7-48f8-b4f1-700a1450d596 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:24.119409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-22de9275-c7e7-48f8-b4f1-700a1450d596 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:24.119409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:24.119409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:24.119409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:24.119409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:24.119409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:24.119409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:24.119409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:24.119409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:24.119409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:24.119409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:24.119409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:24.119409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:53:24.119409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:53:24.119409 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:53:24.120440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:53:24.120440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:24.120440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:24.120440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:24.120440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:24.120440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:24.120440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:24.120440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:24.120440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:24.120440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:24.120440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:24.120440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:24.120440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:24.120440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:24.120440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:24.120440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:24.120440 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:24.121384 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:53:24.121384 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:53:24.121384 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:53:24.121384 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:53:24.121384 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:53:24.121384 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:53:24.121384 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:24.121384 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:24.121384 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 349/710] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:24.128303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de9275-c7e7-48f8-b4f1-700a1450d596 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:24.165347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ebc0b-e66d-4a7f-82ae-0f4bd7d36b86 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:24.207361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf00582-1f56-469f-a2e5-d799956c6996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:24.208021 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf00582-1f56-469f-a2e5-d799956c6996 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:24.208265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf00582-1f56-469f-a2e5-d799956c6996 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:24.208707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf00582-1f56-469f-a2e5-d799956c6996 None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:24.209507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf00582-1f56-469f-a2e5-d799956c6996 None admin] RBAC: Adding query filter params (name=network) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:24.210124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf00582-1f56-469f-a2e5-d799956c6996 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:24.211647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf00582-1f56-469f-a2e5-d799956c6996 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:24.217181 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 362/711] 10.222.0.39 () {56 vars in 1112 bytes} [Sun Aug 7 00:53:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:53:24.223602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf00582-1f56-469f-a2e5-d799956c6996 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:24.252515 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:24.356567 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:24.371453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf00582-1f56-469f-a2e5-d799956c6996 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:24.413969 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db36f7a-5c13-401e-8886-0f2757fc5bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:24.415068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db36f7a-5c13-401e-8886-0f2757fc5bdb None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:24.415528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db36f7a-5c13-401e-8886-0f2757fc5bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:24.416054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db36f7a-5c13-401e-8886-0f2757fc5bdb None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:24.416933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db36f7a-5c13-401e-8886-0f2757fc5bdb None admin] RBAC: Adding query filter params (type=network) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:24.417880 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db36f7a-5c13-401e-8886-0f2757fc5bdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:24.419612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db36f7a-5c13-401e-8886-0f2757fc5bdb None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:24.427086 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 363/712] 10.222.0.39 () {56 vars in 1112 bytes} [Sun Aug 7 00:53:24 2022] GET /identity/v3/services?type=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:24.437787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de9275-c7e7-48f8-b4f1-700a1450d596 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:24.498716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc6eb5-304c-40d5-9963-c8c29b005dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:24.500366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc6eb5-304c-40d5-9963-c8c29b005dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:24.501149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc6eb5-304c-40d5-9963-c8c29b005dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:24.501880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc6eb5-304c-40d5-9963-c8c29b005dd3 None admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:24.503546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc6eb5-304c-40d5-9963-c8c29b005dd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:24.504444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc6eb5-304c-40d5-9963-c8c29b005dd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:24.507477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc6eb5-304c-40d5-9963-c8c29b005dd3 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:24.535323 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 350/713] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:53:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:53:24.545611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db36f7a-5c13-401e-8886-0f2757fc5bdb None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:24.676251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db36f7a-5c13-401e-8886-0f2757fc5bdb None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:24.714982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da6031-7b12-4ea1-8cb5-246c26279d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:24.715979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da6031-7b12-4ea1-8cb5-246c26279d2e None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:24.716440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da6031-7b12-4ea1-8cb5-246c26279d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:24.716905 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da6031-7b12-4ea1-8cb5-246c26279d2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:24.718426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da6031-7b12-4ea1-8cb5-246c26279d2e None admin] RBAC: Adding query filter params (role.id=af03b67d56b44430ab9d48dcba18ace2, scope.project.id=1cd2efda8567437e983e3a7867ecd69b, user.id=fb5a86da594046ed97745371176decf7) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:24.718923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da6031-7b12-4ea1-8cb5-246c26279d2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:24.720820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da6031-7b12-4ea1-8cb5-246c26279d2e None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:24.728273 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 364/714] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:53:24 2022] GET /identity/v3/role_assignments?user.id=fb5a86da594046ed97745371176decf7&scope.project.id=1cd2efda8567437e983e3a7867ecd69b&role.id=af03b67d56b44430ab9d48dcba18ace2 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:24.926460 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccc140-d35b-43ad-a2e5-0b53525c15c3 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:24.926913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccc140-d35b-43ad-a2e5-0b53525c15c3 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:24.927285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fccc140-d35b-43ad-a2e5-0b53525c15c3 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:24.929857 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 351/715] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:53:24.935301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7dfa8-def5-49c3-a685-62c5bedcb1f6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:24.936680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7dfa8-def5-49c3-a685-62c5bedcb1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:24.936680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7dfa8-def5-49c3-a685-62c5bedcb1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:24.953488 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:24.959688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-eef7dfa8-def5-49c3-a685-62c5bedcb1f6 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:24.967507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-eef7dfa8-def5-49c3-a685-62c5bedcb1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:25.051980 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 365/716] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:53:25.089914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccc140-d35b-43ad-a2e5-0b53525c15c3 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:25.264439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fccc140-d35b-43ad-a2e5-0b53525c15c3 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:25.275610 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:25.312875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa5174-83ce-4bef-9699-5f366fb552d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:25.313943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa5174-83ce-4bef-9699-5f366fb552d6 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:25.314503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa5174-83ce-4bef-9699-5f366fb552d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:25.314983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa5174-83ce-4bef-9699-5f366fb552d6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:25.316085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa5174-83ce-4bef-9699-5f366fb552d6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:25.318823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa5174-83ce-4bef-9699-5f366fb552d6 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:25.340319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-c1fa5174-83ce-4bef-9699-5f366fb552d6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 00:53:25.340319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:25.340319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:53:25.340319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:53:25.340319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:53:25.340319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:53:25.340319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:53:25.340319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:25.340319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 00:53:25.340319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:25.340319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:53:25.340319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:25.340319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:25.340319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:25.340319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:25.340319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:25.340319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:25.343224 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:25.343224 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:25.343224 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:25.343224 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:25.343224 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:25.343224 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:25.343224 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:53:25.343224 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:53:25.343224 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:53:25.343224 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:53:25.343224 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:25.343224 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:25.343224 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:25.343224 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:25.343224 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:25.343224 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:25.345221 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:25.345221 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:25.345221 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:25.345221 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:25.345221 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:25.345221 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:25.345221 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:25.345221 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:25.345221 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:25.345221 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:25.345221 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:53:25.345221 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:25.345221 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 00:53:25.345221 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:25.345221 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 352/717] 10.222.0.39 () {56 vars in 1129 bytes} [Sun Aug 7 00:53:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:25.353070 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7dfa8-def5-49c3-a685-62c5bedcb1f6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:25.586174 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7dfa8-def5-49c3-a685-62c5bedcb1f6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:25.624254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25293a7c-b713-48bb-94e3-bf00abcf48d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:25.625167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25293a7c-b713-48bb-94e3-bf00abcf48d1 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:25.625605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25293a7c-b713-48bb-94e3-bf00abcf48d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:25.626031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25293a7c-b713-48bb-94e3-bf00abcf48d1 None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:25.626830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25293a7c-b713-48bb-94e3-bf00abcf48d1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:25.627276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25293a7c-b713-48bb-94e3-bf00abcf48d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:25.628838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25293a7c-b713-48bb-94e3-bf00abcf48d1 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:25.631228 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:25.634831 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 366/718] 10.222.0.39 () {56 vars in 1124 bytes} [Sun Aug 7 00:53:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:25.640868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa5174-83ce-4bef-9699-5f366fb552d6 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:25.805331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa5174-83ce-4bef-9699-5f366fb552d6 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:25.878681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e26bf0-b717-4f43-a453-ef2703b3e3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:25.879654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e26bf0-b717-4f43-a453-ef2703b3e3b0 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:25.880172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e26bf0-b717-4f43-a453-ef2703b3e3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:25.880662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e26bf0-b717-4f43-a453-ef2703b3e3b0 None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:25.881811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e26bf0-b717-4f43-a453-ef2703b3e3b0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:25.882357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e26bf0-b717-4f43-a453-ef2703b3e3b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:25.884829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e26bf0-b717-4f43-a453-ef2703b3e3b0 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:25.900794 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 353/719] 10.222.0.39 () {56 vars in 1124 bytes} [Sun Aug 7 00:53:25 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:53:25.996889 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdc083-dd41-4a26-85c0-bd8e76357ddf None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:25.997473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdc083-dd41-4a26-85c0-bd8e76357ddf None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:25.997910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdc083-dd41-4a26-85c0-bd8e76357ddf None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:26.000512 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 367/720] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:26.007660 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679d027-d80a-4d99-9068-ae1ec2c76567 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:26.008179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679d027-d80a-4d99-9068-ae1ec2c76567 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:26.008672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679d027-d80a-4d99-9068-ae1ec2c76567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:26.049127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-7679d027-d80a-4d99-9068-ae1ec2c76567 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:26.051356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7679d027-d80a-4d99-9068-ae1ec2c76567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:26.133702 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:26.203901 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 354/721] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:53:26.230730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdc083-dd41-4a26-85c0-bd8e76357ddf None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:26.237509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25e67e-de9c-4085-bb85-477cfb175656 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:26.238005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25e67e-de9c-4085-bb85-477cfb175656 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:26.238490 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25e67e-de9c-4085-bb85-477cfb175656 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:26.241429 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 355/722] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:26.255626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d6c56-1743-42c0-97c9-1d301aff2d2d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:26.256159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d6c56-1743-42c0-97c9-1d301aff2d2d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:26.256641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d6c56-1743-42c0-97c9-1d301aff2d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:26.296162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-228d6c56-1743-42c0-97c9-1d301aff2d2d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:26.299417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-228d6c56-1743-42c0-97c9-1d301aff2d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:26.433734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdc083-dd41-4a26-85c0-bd8e76357ddf None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:26.437828 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 356/723] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 00:53:26.480183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d6c56-1743-42c0-97c9-1d301aff2d2d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:26.505852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac70d3-d1da-43fa-aee9-b724fcd36734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:26.506548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac70d3-d1da-43fa-aee9-b724fcd36734 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:26.506821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac70d3-d1da-43fa-aee9-b724fcd36734 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:26.507166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac70d3-d1da-43fa-aee9-b724fcd36734 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:26.533433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac70d3-d1da-43fa-aee9-b724fcd36734 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:53:26.540104 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-b5ac70d3-d1da-43fa-aee9-b724fcd36734 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:26.540104 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:26.540104 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:26.540104 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:26.540104 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:26.540104 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:26.540104 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:26.540104 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:26.540104 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:26.540104 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:26.540104 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:26.540104 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:26.540104 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:53:26.540104 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:53:26.540104 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:53:26.540104 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:53:26.541973 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:53:26.541973 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:53:26.541973 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:53:26.541973 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:53:26.541973 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:26.541973 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:26.541973 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:26.541973 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:26.541973 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:26.541973 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:26.541973 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:26.541973 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:26.541973 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:26.541973 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:26.541973 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:26.541973 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:26.544408 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:26.544408 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:26.544408 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:26.544408 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:26.544408 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:53:26.544408 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:53:26.544408 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:53:26.544408 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:53:26.544408 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:53:26.544408 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:53:26.544408 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:26.544408 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:26.544408 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 368/724] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Aug 7 00:53:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:26.549123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac70d3-d1da-43fa-aee9-b724fcd36734 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:26.660206 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:26.678899 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:26.692201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d6c56-1743-42c0-97c9-1d301aff2d2d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:26.747758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac70d3-d1da-43fa-aee9-b724fcd36734 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:26.764089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376207a-12dc-44a3-bf26-e6453da630ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:26.764732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376207a-12dc-44a3-bf26-e6453da630ce None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:26.765019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376207a-12dc-44a3-bf26-e6453da630ce None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:26.765249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376207a-12dc-44a3-bf26-e6453da630ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:26.786423 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376207a-12dc-44a3-bf26-e6453da630ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:53:26.795943 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-a376207a-12dc-44a3-bf26-e6453da630ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:53:26.795943 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:26.795943 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:26.795943 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:26.795943 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:26.795943 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:26.795943 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:26.795943 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:26.795943 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:26.795943 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:26.795943 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:26.795943 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:26.795943 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:53:26.795943 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:53:26.795943 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:53:26.795943 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:53:26.798257 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:53:26.798257 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:53:26.798257 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:53:26.798257 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:53:26.798257 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:26.798257 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:26.798257 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:26.798257 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:26.798257 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:26.798257 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:26.798257 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:26.798257 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:26.798257 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:26.798257 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:26.798257 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:26.798257 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:26.800129 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:26.800129 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:26.800129 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:26.800129 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:26.800129 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:53:26.800129 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:53:26.800129 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:53:26.800129 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:53:26.800129 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:53:26.800129 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:53:26.800129 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:53:26.800129 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:26.800129 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 357/725] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:53:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:26.804319 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376207a-12dc-44a3-bf26-e6453da630ce None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:26.825931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e6b93-6a2c-458a-97b8-2b333e7456ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:26.826961 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e6b93-6a2c-458a-97b8-2b333e7456ce None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:26.827473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e6b93-6a2c-458a-97b8-2b333e7456ce None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:26.827927 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e6b93-6a2c-458a-97b8-2b333e7456ce None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:26.829121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e6b93-6a2c-458a-97b8-2b333e7456ce None admin] RBAC: Adding query filter params (name=service) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:26.829638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e6b93-6a2c-458a-97b8-2b333e7456ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:26.832179 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e6b93-6a2c-458a-97b8-2b333e7456ce None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:26.854048 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 369/726] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Aug 7 00:53:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:26.860878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e6b93-6a2c-458a-97b8-2b333e7456ce None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:27.018240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376207a-12dc-44a3-bf26-e6453da630ce None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:27.054828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e6b93-6a2c-458a-97b8-2b333e7456ce None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:27.097389 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:27.120953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f0fcd-0dd3-4195-8a38-2deb5526aae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:27.124245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f0fcd-0dd3-4195-8a38-2deb5526aae2 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:27.125273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f0fcd-0dd3-4195-8a38-2deb5526aae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:27.127019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f0fcd-0dd3-4195-8a38-2deb5526aae2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:27.137482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43ddca-3e40-4657-a7de-23c6177a5fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:27.140820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43ddca-3e40-4657-a7de-23c6177a5fbe None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:27.148634 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43ddca-3e40-4657-a7de-23c6177a5fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:27.149498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43ddca-3e40-4657-a7de-23c6177a5fbe None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:27.150998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb43ddca-3e40-4657-a7de-23c6177a5fbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:27.151811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb43ddca-3e40-4657-a7de-23c6177a5fbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:27.154939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb43ddca-3e40-4657-a7de-23c6177a5fbe None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:27.171223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f0fcd-0dd3-4195-8a38-2deb5526aae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:27.177100 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f0fcd-0dd3-4195-8a38-2deb5526aae2 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:27.189331 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 358/727] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:53:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:27.195170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43ddca-3e40-4657-a7de-23c6177a5fbe None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:27.229150 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-300f0fcd-0dd3-4195-8a38-2deb5526aae2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:27.229150 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:27.229150 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:27.229150 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:27.229150 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:27.229150 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:27.229150 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:27.229150 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:27.229150 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:27.229150 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:27.229150 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:27.229150 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:27.229150 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:27.229150 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:27.229150 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:27.229150 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:27.230985 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:27.230985 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:27.230985 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:27.230985 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:27.230985 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:27.230985 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:27.230985 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:27.230985 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:27.230985 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:27.230985 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:27.230985 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:27.230985 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:27.230985 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:27.230985 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:27.230985 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:27.230985 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:27.230985 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:27.233473 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:27.233473 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:27.233473 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:27.237330 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 370/728] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:53:27.245651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f0fcd-0dd3-4195-8a38-2deb5526aae2 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:27.251172 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:27.480144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43ddca-3e40-4657-a7de-23c6177a5fbe None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:27.517038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea205f4a-a9fd-4ea6-bd30-e2e194ab089b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:27.517614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea205f4a-a9fd-4ea6-bd30-e2e194ab089b None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:27.517891 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea205f4a-a9fd-4ea6-bd30-e2e194ab089b None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:27.518163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea205f4a-a9fd-4ea6-bd30-e2e194ab089b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:27.531028 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea205f4a-a9fd-4ea6-bd30-e2e194ab089b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:27.532552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea205f4a-a9fd-4ea6-bd30-e2e194ab089b None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:27.548682 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-ea205f4a-a9fd-4ea6-bd30-e2e194ab089b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:27.548682 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:27.548682 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:27.548682 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:27.548682 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:27.548682 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:27.548682 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:27.548682 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:27.548682 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:27.548682 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:27.548682 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:27.548682 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:27.548682 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:27.548682 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:27.548682 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:27.548682 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:27.550564 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:27.550564 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:27.550564 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:27.550564 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:27.550564 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:27.550564 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:27.550564 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:27.550564 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:27.550564 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:27.550564 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:27.550564 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:27.550564 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:27.550564 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:27.550564 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:27.550564 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:27.550564 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:27.550564 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:27.552427 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:27.552427 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:27.552427 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:27.552427 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 359/729] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:27.552895 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f0fcd-0dd3-4195-8a38-2deb5526aae2 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:27.561585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea205f4a-a9fd-4ea6-bd30-e2e194ab089b None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:27.622280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c00568-1d89-4a04-a72d-702ab7477acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:27.622891 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c00568-1d89-4a04-a72d-702ab7477acf None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:27.623723 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c00568-1d89-4a04-a72d-702ab7477acf None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:27.624021 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c00568-1d89-4a04-a72d-702ab7477acf None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:27.624683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c00568-1d89-4a04-a72d-702ab7477acf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:27.624982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c00568-1d89-4a04-a72d-702ab7477acf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:27.626361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c00568-1d89-4a04-a72d-702ab7477acf None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:27.663097 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 371/730] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:27.669393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c00568-1d89-4a04-a72d-702ab7477acf None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:27.748809 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:27.776367 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:27.838041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea205f4a-a9fd-4ea6-bd30-e2e194ab089b None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:27.894011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a266f9-effd-4c1d-b367-79923f0c344a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:27.894625 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a266f9-effd-4c1d-b367-79923f0c344a None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:27.894895 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a266f9-effd-4c1d-b367-79923f0c344a None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:27.895157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a266f9-effd-4c1d-b367-79923f0c344a None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:27.895820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a266f9-effd-4c1d-b367-79923f0c344a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:27.896144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a266f9-effd-4c1d-b367-79923f0c344a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:27.901095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a266f9-effd-4c1d-b367-79923f0c344a None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:27.927794 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 360/731] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:27.936431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a266f9-effd-4c1d-b367-79923f0c344a None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:27.937214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c00568-1d89-4a04-a72d-702ab7477acf None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:28.018003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a43bb8-e946-4ad3-a65a-46f1f78f93ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:28.019141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a43bb8-e946-4ad3-a65a-46f1f78f93ae None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:28.019417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a43bb8-e946-4ad3-a65a-46f1f78f93ae None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:28.020014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a43bb8-e946-4ad3-a65a-46f1f78f93ae None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:28.030355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a43bb8-e946-4ad3-a65a-46f1f78f93ae None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:28.032806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a43bb8-e946-4ad3-a65a-46f1f78f93ae None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:28.050751 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-09a43bb8-e946-4ad3-a65a-46f1f78f93ae None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:53:28.050751 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:28.050751 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:28.050751 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:28.050751 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:28.050751 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:28.050751 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:28.050751 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:28.050751 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:28.050751 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:28.050751 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:28.050751 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:28.050751 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:53:28.050751 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:53:28.050751 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:53:28.050751 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:53:28.051756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:28.051756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:28.051756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:53:28.051756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:28.051756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:53:28.051756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:28.051756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:28.051756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:28.051756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:28.051756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:28.051756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:28.051756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:28.051756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:28.051756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:28.051756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:28.051756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:28.051756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:28.051756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:28.052733 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:28.052733 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:28.052733 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:53:28.052733 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:53:28.052733 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:53:28.052733 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:53:28.052733 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:53:28.052733 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:53:28.052733 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:53:28.052733 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:28.053272 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 372/732] 10.222.0.39 () {56 vars in 1117 bytes} [Sun Aug 7 00:53:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:53:28.054561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411ff7a-1222-42a0-ac44-a5eb8118e9a6 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:28.054845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411ff7a-1222-42a0-ac44-a5eb8118e9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:28.055107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411ff7a-1222-42a0-ac44-a5eb8118e9a6 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:28.056742 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 373/733] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:28.059641 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411ff7a-1222-42a0-ac44-a5eb8118e9a6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:28.094798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a266f9-effd-4c1d-b367-79923f0c344a None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:28.127821 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:28.135120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde752f6-5ba9-449b-bf68-94de8e79f20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:28.136618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde752f6-5ba9-449b-bf68-94de8e79f20b None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:28.136920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde752f6-5ba9-449b-bf68-94de8e79f20b None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:28.137188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde752f6-5ba9-449b-bf68-94de8e79f20b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:28.146280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde752f6-5ba9-449b-bf68-94de8e79f20b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:28.148031 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde752f6-5ba9-449b-bf68-94de8e79f20b None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:28.165068 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-fde752f6-5ba9-449b-bf68-94de8e79f20b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:53:28.165068 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:28.165068 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:28.165068 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:28.165068 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:28.165068 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:28.165068 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:28.165068 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:28.165068 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:28.165068 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:28.165068 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:28.165068 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:28.165068 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:53:28.165068 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:53:28.165068 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:53:28.165068 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:53:28.167618 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:28.167618 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:28.167618 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:53:28.167618 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:28.167618 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:53:28.167618 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:28.167618 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:28.167618 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:28.167618 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:28.167618 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:28.167618 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:28.167618 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:28.167618 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:28.167618 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:28.167618 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:28.167618 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:28.167618 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:28.167618 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:28.168753 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:28.168753 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:28.168753 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:53:28.168753 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:53:28.168753 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:53:28.168753 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:53:28.168753 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:53:28.168753 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:53:28.168753 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:53:28.168753 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:28.168753 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 361/734] 10.222.0.39 () {56 vars in 1093 bytes} [Sun Aug 7 00:53:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:53:28.168753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd26da-9228-486d-80f3-ad80fa418fea None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:28.168753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd26da-9228-486d-80f3-ad80fa418fea None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:28.169495 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd26da-9228-486d-80f3-ad80fa418fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:28.188537 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:28.188908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-01fd26da-9228-486d-80f3-ad80fa418fea None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:28.190064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-01fd26da-9228-486d-80f3-ad80fa418fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:28.198696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411ff7a-1222-42a0-ac44-a5eb8118e9a6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:28.263468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c0afc-2973-4d2a-935a-bf2afca7dc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:28.264985 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c0afc-2973-4d2a-935a-bf2afca7dc4b None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:28.265212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c0afc-2973-4d2a-935a-bf2afca7dc4b None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:28.265524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c0afc-2973-4d2a-935a-bf2afca7dc4b None admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:28.266367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c0afc-2973-4d2a-935a-bf2afca7dc4b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:28.266712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c0afc-2973-4d2a-935a-bf2afca7dc4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:28.268346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c0afc-2973-4d2a-935a-bf2afca7dc4b None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:28.278354 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 362/735] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:53:28.280074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6242ae1-9d00-4ad4-8677-f4c11eb074a1 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:28.280424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6242ae1-9d00-4ad4-8677-f4c11eb074a1 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:28.280618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6242ae1-9d00-4ad4-8677-f4c11eb074a1 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:28.286004 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 363/736] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:28.286004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6242ae1-9d00-4ad4-8677-f4c11eb074a1 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:28.308492 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 374/737] 10.222.0.39 () {56 vars in 1149 bytes} [Sun Aug 7 00:53:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:53:28.311192 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2612ff-fc04-4d93-a150-633497ab5cb7 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:28.311724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2612ff-fc04-4d93-a150-633497ab5cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:28.312559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2612ff-fc04-4d93-a150-633497ab5cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:28.332414 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1b2612ff-fc04-4d93-a150-633497ab5cb7 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:28.333608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1b2612ff-fc04-4d93-a150-633497ab5cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:28.408224 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 375/738] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:53:28.408884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2612ff-fc04-4d93-a150-633497ab5cb7 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:28.422513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6242ae1-9d00-4ad4-8677-f4c11eb074a1 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:28.448683 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:28.467814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1157096-56eb-4db5-89be-1ca727fb4488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:28.468808 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1157096-56eb-4db5-89be-1ca727fb4488 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:28.469176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1157096-56eb-4db5-89be-1ca727fb4488 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:28.469556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1157096-56eb-4db5-89be-1ca727fb4488 None admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:28.470384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1157096-56eb-4db5-89be-1ca727fb4488 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:28.470766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1157096-56eb-4db5-89be-1ca727fb4488 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:28.472520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1157096-56eb-4db5-89be-1ca727fb4488 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:28.492918 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 364/739] 10.222.0.39 () {56 vars in 1133 bytes} [Sun Aug 7 00:53:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:28.493720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1157096-56eb-4db5-89be-1ca727fb4488 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:28.536469 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:28.567674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2612ff-fc04-4d93-a150-633497ab5cb7 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:28.611994 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1157096-56eb-4db5-89be-1ca727fb4488 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:28.612587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c7d63-40c3-47c9-a667-887f4221e5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:28.613207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c7d63-40c3-47c9-a667-887f4221e5d1 None admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:28.613775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c7d63-40c3-47c9-a667-887f4221e5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:28.614053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c7d63-40c3-47c9-a667-887f4221e5d1 None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:28.615713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c7d63-40c3-47c9-a667-887f4221e5d1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:28.617166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c7d63-40c3-47c9-a667-887f4221e5d1 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:28.651928 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 376/740] 10.222.0.39 () {60 vars in 1141 bytes} [Sun Aug 7 00:53:28 2022] POST /identity/v3/services => generated 240 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:53:28.651928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c7d63-40c3-47c9-a667-887f4221e5d1 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:28.667156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461a086-3e6f-4a14-91ab-a1c68b2851c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:28.667982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461a086-3e6f-4a14-91ab-a1c68b2851c7 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:28.668354 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461a086-3e6f-4a14-91ab-a1c68b2851c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:28.668667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461a086-3e6f-4a14-91ab-a1c68b2851c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:28.727528 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:28.761921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461a086-3e6f-4a14-91ab-a1c68b2851c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:28.763463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461a086-3e6f-4a14-91ab-a1c68b2851c7 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:28.823255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c7d63-40c3-47c9-a667-887f4221e5d1 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:28.874700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ef7df-d606-4051-ab78-f44364236432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:28.875407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ef7df-d606-4051-ab78-f44364236432 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:28.876136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ef7df-d606-4051-ab78-f44364236432 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:28.876136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ef7df-d606-4051-ab78-f44364236432 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:28.889295 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ef7df-d606-4051-ab78-f44364236432 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:53:28.895558 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-e02ef7df-d606-4051-ab78-f44364236432 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:53:28.895558 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:28.895558 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:28.895558 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:28.895558 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:28.895558 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:28.895558 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:28.895558 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:28.895558 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:28.895558 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:28.895558 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:28.895558 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:28.895558 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:53:28.895558 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:53:28.895558 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:53:28.895558 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:53:28.896598 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:53:28.896598 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:53:28.896598 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:53:28.896598 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:53:28.896598 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:28.896598 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:28.896598 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:28.896598 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:28.896598 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:28.896598 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:28.896598 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:28.896598 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:28.896598 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:28.896598 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:28.896598 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:28.896598 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:28.897753 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:28.897753 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:28.897753 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:28.897753 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:28.897753 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:53:28.897753 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:53:28.897753 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:53:28.897753 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:53:28.897753 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:53:28.897753 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:53:28.897753 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:53:28.897753 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:28.897753 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 377/741] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:53:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:28.898507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ef7df-d606-4051-ab78-f44364236432 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:28.903478 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:28.908184 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 365/742] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:53:28 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 00:53:28.909419 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b014a-c17d-4332-9c76-b53358f68e17 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:28.909692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b014a-c17d-4332-9c76-b53358f68e17 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:28.909959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b014a-c17d-4332-9c76-b53358f68e17 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:28.911597 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 366/743] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:28.912418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b014a-c17d-4332-9c76-b53358f68e17 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:29.014387 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:29.028106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ef7df-d606-4051-ab78-f44364236432 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:29.048576 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b014a-c17d-4332-9c76-b53358f68e17 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:29.084635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944f396-35fe-4f97-9996-492c0bee311b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:29.085196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944f396-35fe-4f97-9996-492c0bee311b None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:29.085594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944f396-35fe-4f97-9996-492c0bee311b None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:29.085848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c944f396-35fe-4f97-9996-492c0bee311b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:29.089107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbbb26-e261-40a4-af63-cf3291c99699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:29.089696 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbbb26-e261-40a4-af63-cf3291c99699 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:29.089987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbbb26-e261-40a4-af63-cf3291c99699 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:29.090268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbbb26-e261-40a4-af63-cf3291c99699 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:29.090942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbbb26-e261-40a4-af63-cf3291c99699 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:29.091235 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbbb26-e261-40a4-af63-cf3291c99699 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:29.093189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbbb26-e261-40a4-af63-cf3291c99699 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:29.100686 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944f396-35fe-4f97-9996-492c0bee311b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:29.102236 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c944f396-35fe-4f97-9996-492c0bee311b None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:29.108206 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 367/744] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:53:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:29.108206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9faeca-0465-4bdf-a333-a634af0b45d1 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:29.108206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9faeca-0465-4bdf-a333-a634af0b45d1 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:29.108206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9faeca-0465-4bdf-a333-a634af0b45d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:29.126087 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-c944f396-35fe-4f97-9996-492c0bee311b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:29.126087 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:29.126087 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:29.126087 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:29.126087 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:29.126087 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:29.126087 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:29.126087 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:29.126087 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:29.126087 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:29.126087 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:29.126087 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:29.126087 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:29.126087 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:29.126087 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:29.126087 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:29.127916 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:29.127916 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:29.127916 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:29.127916 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:29.127916 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:29.127916 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:29.127916 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:29.127916 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:29.127916 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:29.127916 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:29.127916 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:29.127916 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:29.127916 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:29.127916 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:29.127916 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:29.127916 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:29.127916 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:29.129533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:29.129533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:29.129533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:29.129859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ef9faeca-0465-4bdf-a333-a634af0b45d1 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:29.130011 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 378/745] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:29.130011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944f396-35fe-4f97-9996-492c0bee311b None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:29.132668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ef9faeca-0465-4bdf-a333-a634af0b45d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:29.220321 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:29.224595 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 368/746] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:29 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 00:53:29.225795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9faeca-0465-4bdf-a333-a634af0b45d1 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:29.289089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c944f396-35fe-4f97-9996-492c0bee311b None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:29.328599 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6bad0-3ee5-4e6b-85bc-4b3216b8cf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:29.329232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6bad0-3ee5-4e6b-85bc-4b3216b8cf1b None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:29.329507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6bad0-3ee5-4e6b-85bc-4b3216b8cf1b None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:29.329780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6bad0-3ee5-4e6b-85bc-4b3216b8cf1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:29.331108 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:29.342812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f6bad0-3ee5-4e6b-85bc-4b3216b8cf1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:29.344202 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f6bad0-3ee5-4e6b-85bc-4b3216b8cf1b None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:29.359678 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-96f6bad0-3ee5-4e6b-85bc-4b3216b8cf1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:29.359678 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:29.359678 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:29.359678 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:29.359678 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:29.359678 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:29.359678 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:29.359678 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:29.359678 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:29.359678 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:29.359678 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:29.359678 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:29.359678 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:29.359678 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:29.359678 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:29.359678 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:29.360910 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:29.360910 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:29.360910 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:29.360910 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:29.360910 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:29.360910 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:29.360910 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:29.360910 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:29.360910 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:29.360910 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:29.360910 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:29.360910 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:29.360910 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:29.360910 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:29.360910 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:29.360910 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:29.360910 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:29.362605 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:29.362605 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:29.362605 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:29.362605 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 379/747] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:29.362605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6bad0-3ee5-4e6b-85bc-4b3216b8cf1b None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:29.395755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9faeca-0465-4bdf-a333-a634af0b45d1 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:29.441423 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156cc8ad-3808-442e-9d17-3d9c16696c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:29.442648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cc8ad-3808-442e-9d17-3d9c16696c04 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:29.443566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cc8ad-3808-442e-9d17-3d9c16696c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:29.444069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cc8ad-3808-442e-9d17-3d9c16696c04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:29.468562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156cc8ad-3808-442e-9d17-3d9c16696c04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:29.472395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156cc8ad-3808-442e-9d17-3d9c16696c04 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:29.496324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6bad0-3ee5-4e6b-85bc-4b3216b8cf1b None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:29.499948 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-156cc8ad-3808-442e-9d17-3d9c16696c04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:29.499948 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:29.499948 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:29.499948 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:29.499948 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:29.499948 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:29.499948 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:29.499948 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:29.499948 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:29.499948 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:29.499948 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:29.499948 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:29.499948 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:29.499948 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:29.499948 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:29.499948 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:29.502215 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:29.502215 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:29.502215 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:29.502215 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:29.502215 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:29.502215 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:29.502215 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:29.502215 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:29.502215 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:29.502215 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:29.502215 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:29.502215 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:29.502215 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:29.502215 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:29.502215 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:29.502215 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:29.502215 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:29.504045 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:29.504045 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:29.504045 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:29.504045 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 369/748] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:29.504045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156cc8ad-3808-442e-9d17-3d9c16696c04 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:29.511700 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:29.552018 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338cdd0-f8a2-4f81-a2c7-b8ae8babfe90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:29.552627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338cdd0-f8a2-4f81-a2c7-b8ae8babfe90 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:29.552948 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338cdd0-f8a2-4f81-a2c7-b8ae8babfe90 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:29.553250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338cdd0-f8a2-4f81-a2c7-b8ae8babfe90 None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:29.553908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8338cdd0-f8a2-4f81-a2c7-b8ae8babfe90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:29.554232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8338cdd0-f8a2-4f81-a2c7-b8ae8babfe90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:29.556198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8338cdd0-f8a2-4f81-a2c7-b8ae8babfe90 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:29.576091 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 380/749] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:29.577642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338cdd0-f8a2-4f81-a2c7-b8ae8babfe90 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:29.655381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156cc8ad-3808-442e-9d17-3d9c16696c04 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:29.683021 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:29.710178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d7816-9733-4054-9921-63dfe5f443d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:29.710920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d7816-9733-4054-9921-63dfe5f443d6 None admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:29.711374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d7816-9733-4054-9921-63dfe5f443d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:29.711799 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d7816-9733-4054-9921-63dfe5f443d6 None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:29.712876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d7816-9733-4054-9921-63dfe5f443d6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:29.715147 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d7816-9733-4054-9921-63dfe5f443d6 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:29.739752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338cdd0-f8a2-4f81-a2c7-b8ae8babfe90 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:29.752447 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 370/750] 10.222.0.39 () {60 vars in 1141 bytes} [Sun Aug 7 00:53:29 2022] POST /identity/v3/services => generated 251 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:53:29.752447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d7816-9733-4054-9921-63dfe5f443d6 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:29.831459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2accb-6dc2-4b8c-ab4c-4fd23a55320c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:29.832809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2accb-6dc2-4b8c-ab4c-4fd23a55320c None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:29.833286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2accb-6dc2-4b8c-ab4c-4fd23a55320c None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:29.833757 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2accb-6dc2-4b8c-ab4c-4fd23a55320c None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:29.834996 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2accb-6dc2-4b8c-ab4c-4fd23a55320c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:29.835513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2accb-6dc2-4b8c-ab4c-4fd23a55320c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:29.838310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c2accb-6dc2-4b8c-ab4c-4fd23a55320c None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:29.862847 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 381/751] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:29.864484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2accb-6dc2-4b8c-ab4c-4fd23a55320c None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:29.911261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d7816-9733-4054-9921-63dfe5f443d6 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:29.912267 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:29.957356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20378094-cb93-49f1-a282-dc6cdb84bd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:29.958237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20378094-cb93-49f1-a282-dc6cdb84bd61 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:29.958661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20378094-cb93-49f1-a282-dc6cdb84bd61 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:29.959102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20378094-cb93-49f1-a282-dc6cdb84bd61 None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:29.959959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20378094-cb93-49f1-a282-dc6cdb84bd61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:29.960406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20378094-cb93-49f1-a282-dc6cdb84bd61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:29.961952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20378094-cb93-49f1-a282-dc6cdb84bd61 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:29.981008 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 371/752] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:29.983926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20378094-cb93-49f1-a282-dc6cdb84bd61 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:30.050501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2accb-6dc2-4b8c-ab4c-4fd23a55320c None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:30.078824 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:30.099558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dffaf-02d8-40a5-bf18-f734b83d6cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:30.100665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dffaf-02d8-40a5-bf18-f734b83d6cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:30.101163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dffaf-02d8-40a5-bf18-f734b83d6cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:30.101657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dffaf-02d8-40a5-bf18-f734b83d6cc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:30.112353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6dffaf-02d8-40a5-bf18-f734b83d6cc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:30.115116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6dffaf-02d8-40a5-bf18-f734b83d6cc1 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:30.136647 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-fc6dffaf-02d8-40a5-bf18-f734b83d6cc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:30.136647 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:30.136647 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:30.136647 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:30.136647 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:30.136647 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:30.136647 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:30.136647 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:30.136647 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:30.136647 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:30.136647 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:30.136647 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:30.136647 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:53:30.136647 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:53:30.136647 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:53:30.137606 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:53:30.137606 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:30.137606 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:30.137606 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:30.137606 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:30.137606 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:30.137606 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:30.137606 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:30.137606 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:30.137606 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:30.137606 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:30.137606 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:30.137606 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:30.137606 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:30.137606 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:30.137606 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:30.137606 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:30.138569 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:53:30.138569 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:53:30.138569 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:53:30.138569 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:53:30.138569 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:53:30.138569 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:53:30.138569 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:30.138569 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:30.142249 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 382/753] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:30.143321 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dffaf-02d8-40a5-bf18-f734b83d6cc1 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:30.177636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20378094-cb93-49f1-a282-dc6cdb84bd61 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:30.245443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29afcde-75ab-45d5-9f56-0a9f3a876693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:30.246621 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:30.248065 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29afcde-75ab-45d5-9f56-0a9f3a876693 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:30.249368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29afcde-75ab-45d5-9f56-0a9f3a876693 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:30.250059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29afcde-75ab-45d5-9f56-0a9f3a876693 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:30.265203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29afcde-75ab-45d5-9f56-0a9f3a876693 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:30.268295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29afcde-75ab-45d5-9f56-0a9f3a876693 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:30.269336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dffaf-02d8-40a5-bf18-f734b83d6cc1 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:30.292928 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-b29afcde-75ab-45d5-9f56-0a9f3a876693 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:30.292928 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:30.292928 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:30.292928 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:30.292928 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:30.292928 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:30.292928 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:30.292928 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:30.292928 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:30.292928 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:30.292928 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:30.292928 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:30.292928 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:53:30.292928 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:53:30.292928 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:53:30.293979 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:53:30.293979 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:30.293979 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:30.293979 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:30.293979 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:30.293979 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:30.293979 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:30.293979 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:30.293979 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:30.293979 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:30.293979 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:30.293979 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:30.293979 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:30.293979 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:30.293979 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:30.293979 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:30.293979 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:30.295580 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:53:30.295580 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:53:30.295580 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:53:30.295580 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:53:30.295580 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:53:30.295580 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:53:30.295580 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:30.295580 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:30.298641 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 372/754] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:30.300492 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29afcde-75ab-45d5-9f56-0a9f3a876693 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:30.314991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31ceaf-eb1f-4705-aede-badb489a1054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:30.315936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31ceaf-eb1f-4705-aede-badb489a1054 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:30.316364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31ceaf-eb1f-4705-aede-badb489a1054 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:30.316801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31ceaf-eb1f-4705-aede-badb489a1054 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:30.326650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31ceaf-eb1f-4705-aede-badb489a1054 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:30.328367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31ceaf-eb1f-4705-aede-badb489a1054 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:30.343013 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-dc31ceaf-eb1f-4705-aede-badb489a1054 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:53:30.343013 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:30.343013 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:30.343013 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:30.343013 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:30.343013 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:30.343013 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:30.343013 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:30.343013 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:30.343013 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:30.343013 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:30.343013 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:30.343013 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:53:30.343013 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:53:30.343013 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:53:30.343013 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:53:30.344313 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:30.344313 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:30.344313 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:53:30.344313 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:30.344313 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:53:30.344313 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:30.344313 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:30.344313 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:30.344313 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:30.344313 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:30.344313 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:30.344313 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:30.344313 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:30.344313 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:30.344313 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:30.344313 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:30.344313 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:30.344313 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:30.345430 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:30.345430 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:30.345430 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:53:30.345430 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:53:30.345430 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:53:30.345430 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:53:30.345430 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:53:30.345430 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:53:30.345430 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:53:30.345430 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:30.352649 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 383/755] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:53:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:30.352998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31ceaf-eb1f-4705-aede-badb489a1054 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:30.441229 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:30.445898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29afcde-75ab-45d5-9f56-0a9f3a876693 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:30.486514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad5885-2463-4167-a66e-339d110776ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:30.487418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad5885-2463-4167-a66e-339d110776ec None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:30.487840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad5885-2463-4167-a66e-339d110776ec None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:30.488253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad5885-2463-4167-a66e-339d110776ec None admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:30.489170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad5885-2463-4167-a66e-339d110776ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:30.489570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad5885-2463-4167-a66e-339d110776ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:30.491799 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad5885-2463-4167-a66e-339d110776ec None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:30.500339 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31ceaf-eb1f-4705-aede-badb489a1054 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:30.513204 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 373/756] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:53:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:30.514398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad5885-2463-4167-a66e-339d110776ec None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:30.564720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4786d-94a0-4c02-8592-457718348252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:30.565972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4786d-94a0-4c02-8592-457718348252 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:30.566600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4786d-94a0-4c02-8592-457718348252 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:30.567184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4786d-94a0-4c02-8592-457718348252 None admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:30.569052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4786d-94a0-4c02-8592-457718348252 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:30.569423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4786d-94a0-4c02-8592-457718348252 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:30.572445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4786d-94a0-4c02-8592-457718348252 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:30.597607 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 384/757] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:53:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:30.599340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4786d-94a0-4c02-8592-457718348252 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:30.604573 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:30.648878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad5885-2463-4167-a66e-339d110776ec None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:30.715657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c255a9d-e45a-4f6d-b034-192340480131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:30.716967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c255a9d-e45a-4f6d-b034-192340480131 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:30.717584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c255a9d-e45a-4f6d-b034-192340480131 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:30.718300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c255a9d-e45a-4f6d-b034-192340480131 None admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:30.720026 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c255a9d-e45a-4f6d-b034-192340480131 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:30.720724 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c255a9d-e45a-4f6d-b034-192340480131 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:30.723864 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c255a9d-e45a-4f6d-b034-192340480131 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:30.755983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4786d-94a0-4c02-8592-457718348252 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:30.766785 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 374/758] 10.222.0.39 () {56 vars in 1135 bytes} [Sun Aug 7 00:53:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:30.766785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c255a9d-e45a-4f6d-b034-192340480131 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:30.800631 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:30.809201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7873003-409d-48ef-b9ea-8f08036f5caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:30.810296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7873003-409d-48ef-b9ea-8f08036f5caf None admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:30.811553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7873003-409d-48ef-b9ea-8f08036f5caf None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:30.812010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7873003-409d-48ef-b9ea-8f08036f5caf None admin] PATH_INFO: `/v3/projects/1cd2efda8567437e983e3a7867ecd69b/users/6c70d5a72d424db68de7c7b8257fe02c/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:30.814771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7873003-409d-48ef-b9ea-8f08036f5caf None admin] RBAC: Authorizing `identity:create_grant(project_id=1cd2efda8567437e983e3a7867ecd69b, user_id=6c70d5a72d424db68de7c7b8257fe02c, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:30.817398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7873003-409d-48ef-b9ea-8f08036f5caf None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:30.837905 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 385/759] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Aug 7 00:53:30 2022] PUT /identity/v3/projects/1cd2efda8567437e983e3a7867ecd69b/users/6c70d5a72d424db68de7c7b8257fe02c/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:53:30.839670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7873003-409d-48ef-b9ea-8f08036f5caf None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:31.035439 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:31.050150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c255a9d-e45a-4f6d-b034-192340480131 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:31.104845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7873003-409d-48ef-b9ea-8f08036f5caf None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:31.106248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc43e4-3dfd-4491-83b0-6f3413a63d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:31.107261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc43e4-3dfd-4491-83b0-6f3413a63d9f None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:31.108668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc43e4-3dfd-4491-83b0-6f3413a63d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:31.109002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc43e4-3dfd-4491-83b0-6f3413a63d9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:31.109741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc43e4-3dfd-4491-83b0-6f3413a63d9f None admin] RBAC: Adding query filter params (role.id=af03b67d56b44430ab9d48dcba18ace2, scope.project.id=1cd2efda8567437e983e3a7867ecd69b, user.id=af48a86c031e400982666d661c9f4229) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:31.110050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc43e4-3dfd-4491-83b0-6f3413a63d9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:31.111604 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc43e4-3dfd-4491-83b0-6f3413a63d9f None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:31.128937 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 375/760] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:53:30 2022] GET /identity/v3/role_assignments?user.id=af48a86c031e400982666d661c9f4229&scope.project.id=1cd2efda8567437e983e3a7867ecd69b&role.id=af03b67d56b44430ab9d48dcba18ace2 => generated 259 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:31.134006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc53d62-b8d8-4e39-935c-445c3693c1e5 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:31.136512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc53d62-b8d8-4e39-935c-445c3693c1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:31.136876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc53d62-b8d8-4e39-935c-445c3693c1e5 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:31.144815 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 376/761] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:31 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:31.152440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf46824-d50d-43bf-a647-b93684507a00 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:31.152887 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf46824-d50d-43bf-a647-b93684507a00 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:31.153330 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf46824-d50d-43bf-a647-b93684507a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:31.171354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f393da-780d-4306-821a-5c936314a002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:31.172007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f393da-780d-4306-821a-5c936314a002 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:31.172384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f393da-780d-4306-821a-5c936314a002 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:31.172828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f393da-780d-4306-821a-5c936314a002 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:31.199218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ccf46824-d50d-43bf-a647-b93684507a00 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:31.204575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ccf46824-d50d-43bf-a647-b93684507a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:31.294684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f393da-780d-4306-821a-5c936314a002 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:31.297791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f393da-780d-4306-821a-5c936314a002 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:31.345987 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 377/762] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:53:31.373909 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:31.389833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf46824-d50d-43bf-a647-b93684507a00 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:31.413326 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:31.427069 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 386/763] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:53:30 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:53:31.432368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f393da-780d-4306-821a-5c936314a002 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:31.544201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f393da-780d-4306-821a-5c936314a002 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:31.586418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecdb9c-7a9b-4ad3-b65c-489112b1c58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:31.587424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecdb9c-7a9b-4ad3-b65c-489112b1c58f None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:31.588640 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecdb9c-7a9b-4ad3-b65c-489112b1c58f None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:31.589123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecdb9c-7a9b-4ad3-b65c-489112b1c58f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:31.612048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aecdb9c-7a9b-4ad3-b65c-489112b1c58f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:31.618824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aecdb9c-7a9b-4ad3-b65c-489112b1c58f None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:31.638075 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-4aecdb9c-7a9b-4ad3-b65c-489112b1c58f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:31.638075 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:31.638075 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:31.638075 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:31.638075 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:31.638075 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:31.638075 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:31.638075 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:31.638075 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:31.638075 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:31.638075 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:31.638075 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:31.638075 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:31.638075 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:31.638075 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:31.638075 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:31.639162 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:31.639162 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:31.639162 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:31.639162 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:31.639162 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:31.639162 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:31.639162 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:31.639162 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:31.639162 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:31.639162 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:31.639162 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:31.639162 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:31.639162 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:31.639162 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:31.639162 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:31.639162 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:31.639162 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:31.640073 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:31.640073 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:31.640073 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:31.642215 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 387/764] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:31.657553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecdb9c-7a9b-4ad3-b65c-489112b1c58f None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:31.668482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf46824-d50d-43bf-a647-b93684507a00 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:31.696471 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:31.741684 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a70c13-e315-4a72-a714-7add11a6bac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:31.742333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a70c13-e315-4a72-a714-7add11a6bac8 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:31.746897 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a70c13-e315-4a72-a714-7add11a6bac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:31.747178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a70c13-e315-4a72-a714-7add11a6bac8 None admin] PATH_INFO: `/v3/services/network` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:31.748616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a70c13-e315-4a72-a714-7add11a6bac8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:31.750185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a70c13-e315-4a72-a714-7add11a6bac8 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:31.767810 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-60a70c13-e315-4a72-a714-7add11a6bac8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 00:53:31.767810 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:31.767810 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:53:31.767810 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:53:31.767810 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:53:31.767810 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:53:31.767810 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:53:31.767810 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:31.767810 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 00:53:31.767810 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:31.767810 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:53:31.767810 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:31.767810 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:31.767810 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:31.767810 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:31.767810 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:31.767810 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:31.768872 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:31.768872 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:31.768872 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:31.768872 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:31.768872 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:31.768872 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:31.768872 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:53:31.768872 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:53:31.768872 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:53:31.768872 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:53:31.768872 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:31.768872 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:31.768872 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:31.768872 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:31.768872 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:31.768872 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:31.769701 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:31.769701 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:31.769701 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:31.769701 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:31.769701 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:31.769701 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:31.769701 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:31.769701 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:31.769701 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:31.769701 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:31.769701 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:53:31.769701 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:31.769701 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 00:53:31.769701 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:31.769701 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 378/765] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:31 2022] GET /identity/v3/services/network => generated 88 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:31.778005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a70c13-e315-4a72-a714-7add11a6bac8 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:31.918669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecdb9c-7a9b-4ad3-b65c-489112b1c58f None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:32.012526 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:32.069262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a70c13-e315-4a72-a714-7add11a6bac8 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:32.081467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14588e18-63c1-462f-96ce-22a12de67bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:32.082102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14588e18-63c1-462f-96ce-22a12de67bfe None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:32.082382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14588e18-63c1-462f-96ce-22a12de67bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:32.082654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14588e18-63c1-462f-96ce-22a12de67bfe None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:32.083339 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14588e18-63c1-462f-96ce-22a12de67bfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:32.083648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14588e18-63c1-462f-96ce-22a12de67bfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:32.085149 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14588e18-63c1-462f-96ce-22a12de67bfe None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:32.122238 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 388/766] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 465 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:53:32.128441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14588e18-63c1-462f-96ce-22a12de67bfe None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:32.139423 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85ec1e-0330-49a8-a666-3b987cdc597b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:32.140462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85ec1e-0330-49a8-a666-3b987cdc597b None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:32.140930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85ec1e-0330-49a8-a666-3b987cdc597b None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:32.141390 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85ec1e-0330-49a8-a666-3b987cdc597b None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:32.142502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db85ec1e-0330-49a8-a666-3b987cdc597b None admin] RBAC: Adding query filter params (name=network) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:32.143027 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db85ec1e-0330-49a8-a666-3b987cdc597b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:32.146358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db85ec1e-0330-49a8-a666-3b987cdc597b None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:32.155875 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 379/767] 10.222.0.39 () {56 vars in 1112 bytes} [Sun Aug 7 00:53:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:53:32.164759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85ec1e-0330-49a8-a666-3b987cdc597b None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:32.309743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85ec1e-0330-49a8-a666-3b987cdc597b None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:32.353138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f82e55-a7e7-417a-8aa9-8ee467099a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:32.355320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f82e55-a7e7-417a-8aa9-8ee467099a18 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:32.355823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f82e55-a7e7-417a-8aa9-8ee467099a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:32.356388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f82e55-a7e7-417a-8aa9-8ee467099a18 None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:32.357654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f82e55-a7e7-417a-8aa9-8ee467099a18 None admin] RBAC: Adding query filter params (type=network) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:32.358208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f82e55-a7e7-417a-8aa9-8ee467099a18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:32.360877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f82e55-a7e7-417a-8aa9-8ee467099a18 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:32.371365 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 380/768] 10.222.0.39 () {56 vars in 1112 bytes} [Sun Aug 7 00:53:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:32.384523 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f82e55-a7e7-417a-8aa9-8ee467099a18 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:32.392270 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:32.403207 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:32.479536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14588e18-63c1-462f-96ce-22a12de67bfe None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:32.578720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84299a88-3cd2-40d6-b78b-619b99919016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:32.579981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84299a88-3cd2-40d6-b78b-619b99919016 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:32.580502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84299a88-3cd2-40d6-b78b-619b99919016 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:32.581014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84299a88-3cd2-40d6-b78b-619b99919016 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:32.598109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84299a88-3cd2-40d6-b78b-619b99919016 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:32.600678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84299a88-3cd2-40d6-b78b-619b99919016 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:32.605002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f82e55-a7e7-417a-8aa9-8ee467099a18 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:32.642930 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-84299a88-3cd2-40d6-b78b-619b99919016 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:32.642930 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:32.642930 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:32.642930 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:32.642930 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:32.642930 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:32.642930 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:32.642930 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:32.642930 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:32.642930 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:32.642930 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:32.642930 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:32.642930 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:53:32.642930 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:53:32.642930 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:53:32.644452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:53:32.644452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:32.644452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:32.644452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:32.644452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:32.644452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:32.644452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:32.644452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:32.644452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:32.644452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:32.644452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:32.644452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:32.644452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:32.644452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:32.644452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:32.644452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:32.644452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:32.645363 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:53:32.645363 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:53:32.645363 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:53:32.645363 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:53:32.645363 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:53:32.645363 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:53:32.645363 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:32.645363 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:32.646466 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 389/769] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 518 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:53:32.649457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4db6c-081a-4cc8-a435-1c392647aeb7 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:32.649888 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4db6c-081a-4cc8-a435-1c392647aeb7 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:32.650302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4db6c-081a-4cc8-a435-1c392647aeb7 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:32.653119 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 390/770] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:32.655270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4db6c-081a-4cc8-a435-1c392647aeb7 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:32.663849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e204e-9d46-4d1c-8f50-78c1fa957266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:32.664518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e204e-9d46-4d1c-8f50-78c1fa957266 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:32.664797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e204e-9d46-4d1c-8f50-78c1fa957266 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:32.665103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e204e-9d46-4d1c-8f50-78c1fa957266 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:32.665859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e204e-9d46-4d1c-8f50-78c1fa957266 None admin] RBAC: Adding query filter params (interface=public, service_id=6b40c40ab36d4a19a1f127b2233374aa, region_id=RegionOne) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:32.666190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e204e-9d46-4d1c-8f50-78c1fa957266 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:32.667631 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e204e-9d46-4d1c-8f50-78c1fa957266 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:32.679378 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 381/771] 10.222.0.39 () {56 vars in 1251 bytes} [Sun Aug 7 00:53:32 2022] GET /identity/v3/endpoints?service_id=6b40c40ab36d4a19a1f127b2233374aa&interface=public®ion_id=RegionOne => generated 194 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:53:32.680784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb6b76-94ce-4340-852d-0a2e612f67f2 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:32.681071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb6b76-94ce-4340-852d-0a2e612f67f2 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:32.681376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb6b76-94ce-4340-852d-0a2e612f67f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:32.701971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a8bb6b76-94ce-4340-852d-0a2e612f67f2 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:32.703202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a8bb6b76-94ce-4340-852d-0a2e612f67f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:32.817569 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:32.829880 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4db6c-081a-4cc8-a435-1c392647aeb7 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:32.844350 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 382/772] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:53:32.846844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb6b76-94ce-4340-852d-0a2e612f67f2 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:32.878732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed59da-848f-4bba-ae78-16f3c2705908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:32.879394 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed59da-848f-4bba-ae78-16f3c2705908 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:32.879697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed59da-848f-4bba-ae78-16f3c2705908 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:32.879991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed59da-848f-4bba-ae78-16f3c2705908 None admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:32.880684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed59da-848f-4bba-ae78-16f3c2705908 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:32.880983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed59da-848f-4bba-ae78-16f3c2705908 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:32.882509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed59da-848f-4bba-ae78-16f3c2705908 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:32.886516 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:32.916016 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 391/773] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:53:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:32.918385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed59da-848f-4bba-ae78-16f3c2705908 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:33.053367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed59da-848f-4bba-ae78-16f3c2705908 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:33.100068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb6b76-94ce-4340-852d-0a2e612f67f2 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:33.101298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4faf7d-6902-47f0-85e8-e461f79a14c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:33.102144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4faf7d-6902-47f0-85e8-e461f79a14c0 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:33.102528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4faf7d-6902-47f0-85e8-e461f79a14c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:33.102919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4faf7d-6902-47f0-85e8-e461f79a14c0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:33.103627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4faf7d-6902-47f0-85e8-e461f79a14c0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:33.105474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4faf7d-6902-47f0-85e8-e461f79a14c0 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:33.120781 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-6f4faf7d-6902-47f0-85e8-e461f79a14c0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 00:53:33.120781 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:33.120781 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:53:33.120781 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:53:33.120781 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:53:33.120781 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:53:33.120781 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:53:33.120781 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:33.120781 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 00:53:33.120781 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:33.120781 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:53:33.120781 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:33.120781 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:33.120781 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:33.120781 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:33.120781 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:33.120781 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:33.123404 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:33.123404 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:33.123404 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:33.123404 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:33.123404 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:33.123404 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:33.123404 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:53:33.123404 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:53:33.123404 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:53:33.123404 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:53:33.123404 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:33.123404 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:33.123404 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:33.123404 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:33.123404 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:33.123404 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:33.134211 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:33.134211 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:33.134211 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:33.134211 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:33.134211 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:33.134211 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:33.134211 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:33.134211 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:33.134211 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:33.134211 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:33.134211 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:53:33.134211 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:33.134211 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 00:53:33.134211 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:33.134211 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 392/774] 10.222.0.39 () {56 vars in 1129 bytes} [Sun Aug 7 00:53:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:33.137442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4faf7d-6902-47f0-85e8-e461f79a14c0 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:33.182492 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a27294-fbe0-445b-9bb2-bbfffc6a9451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:33.184195 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a27294-fbe0-445b-9bb2-bbfffc6a9451 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:33.185160 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a27294-fbe0-445b-9bb2-bbfffc6a9451 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:33.186521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a27294-fbe0-445b-9bb2-bbfffc6a9451 None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:33.188116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a27294-fbe0-445b-9bb2-bbfffc6a9451 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:33.191738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a27294-fbe0-445b-9bb2-bbfffc6a9451 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:33.204893 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 383/775] 10.222.0.39 () {56 vars in 1087 bytes} [Sun Aug 7 00:53:32 2022] GET /identity/v3/services => generated 772 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:33.205815 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:33.208672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a27294-fbe0-445b-9bb2-bbfffc6a9451 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:33.308434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4faf7d-6902-47f0-85e8-e461f79a14c0 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:33.336617 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:33.395318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0e774-3257-4656-8179-a897f2bbd8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:33.398484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0e774-3257-4656-8179-a897f2bbd8ae None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:33.399003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0e774-3257-4656-8179-a897f2bbd8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:33.399450 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0e774-3257-4656-8179-a897f2bbd8ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:33.400433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0e774-3257-4656-8179-a897f2bbd8ae None admin] RBAC: Adding query filter params (role.id=695b07606e564668bac7afff4ab6052a, scope.project.id=1cd2efda8567437e983e3a7867ecd69b, user.id=fb5a86da594046ed97745371176decf7) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:33.402294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0e774-3257-4656-8179-a897f2bbd8ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:33.406463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0e774-3257-4656-8179-a897f2bbd8ae None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:33.418213 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 393/776] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:53:33 2022] GET /identity/v3/role_assignments?user.id=fb5a86da594046ed97745371176decf7&scope.project.id=1cd2efda8567437e983e3a7867ecd69b&role.id=695b07606e564668bac7afff4ab6052a => generated 259 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:33.432051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a27294-fbe0-445b-9bb2-bbfffc6a9451 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:33.475655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d5bb1-41d3-4986-930e-e913b9aae35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:33.476638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d5bb1-41d3-4986-930e-e913b9aae35b None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:33.477076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d5bb1-41d3-4986-930e-e913b9aae35b None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:33.477523 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d5bb1-41d3-4986-930e-e913b9aae35b None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:33.478375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d5bb1-41d3-4986-930e-e913b9aae35b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:33.478838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d5bb1-41d3-4986-930e-e913b9aae35b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:33.480474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d5bb1-41d3-4986-930e-e913b9aae35b None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:33.486789 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 384/777] 10.222.0.39 () {56 vars in 1124 bytes} [Sun Aug 7 00:53:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:33.492878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0e774-3257-4656-8179-a897f2bbd8ae None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:33.549312 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa36a1-d1f0-43d9-a7d4-4de3cf7210b7 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:33.549657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa36a1-d1f0-43d9-a7d4-4de3cf7210b7 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:33.549954 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa36a1-d1f0-43d9-a7d4-4de3cf7210b7 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:33.551563 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 385/778] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:53:33.558021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66125e-b450-4f57-9088-b4fc476a1f1e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:33.558731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66125e-b450-4f57-9088-b4fc476a1f1e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:33.559212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66125e-b450-4f57-9088-b4fc476a1f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:33.583581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0c66125e-b450-4f57-9088-b4fc476a1f1e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:33.585936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0c66125e-b450-4f57-9088-b4fc476a1f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:33.667021 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0e774-3257-4656-8179-a897f2bbd8ae None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:33.688311 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 386/779] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:53:33.720525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66125e-b450-4f57-9088-b4fc476a1f1e None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:33.722506 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:33.745510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a60d9a-e20b-4a4e-9c72-08a4931e8573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:33.746456 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a60d9a-e20b-4a4e-9c72-08a4931e8573 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:33.746907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a60d9a-e20b-4a4e-9c72-08a4931e8573 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:33.747374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a60d9a-e20b-4a4e-9c72-08a4931e8573 None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:33.748580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a60d9a-e20b-4a4e-9c72-08a4931e8573 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:33.749067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a60d9a-e20b-4a4e-9c72-08a4931e8573 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:33.751532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a60d9a-e20b-4a4e-9c72-08a4931e8573 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:33.760895 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 394/780] 10.222.0.39 () {56 vars in 1124 bytes} [Sun Aug 7 00:53:33 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:33.771682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a60d9a-e20b-4a4e-9c72-08a4931e8573 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:33.864337 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:33.943552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66125e-b450-4f57-9088-b4fc476a1f1e None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:33.991415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a60d9a-e20b-4a4e-9c72-08a4931e8573 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:34.018011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20192c3b-5c38-46af-b360-f481d7f8ad89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:34.019072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20192c3b-5c38-46af-b360-f481d7f8ad89 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:34.019426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20192c3b-5c38-46af-b360-f481d7f8ad89 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:34.019768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20192c3b-5c38-46af-b360-f481d7f8ad89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:34.034963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20192c3b-5c38-46af-b360-f481d7f8ad89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:53:34.041576 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-20192c3b-5c38-46af-b360-f481d7f8ad89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:53:34.041576 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:34.041576 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:34.041576 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:34.041576 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:34.041576 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:34.041576 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:34.041576 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:34.041576 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:34.041576 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:34.041576 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:34.041576 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:34.041576 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:53:34.041576 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:53:34.041576 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:53:34.041576 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:53:34.043343 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:53:34.043343 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:53:34.043343 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:53:34.043343 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:53:34.043343 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:34.043343 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:34.043343 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:34.043343 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:34.043343 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:34.043343 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:34.043343 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:34.043343 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:34.043343 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:34.043343 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:34.043343 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:34.043343 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:34.045444 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:34.045444 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:34.045444 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:34.045444 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:34.045444 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:53:34.045444 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:53:34.045444 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:53:34.045444 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:53:34.045444 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:53:34.045444 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:53:34.045444 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:53:34.045444 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:34.048766 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 387/781] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:53:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:34.050991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088d674-d425-4761-8d3c-eeec840f07f8 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:34.051347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088d674-d425-4761-8d3c-eeec840f07f8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:34.052780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088d674-d425-4761-8d3c-eeec840f07f8 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:34.054990 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 388/782] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:34.056572 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088d674-d425-4761-8d3c-eeec840f07f8 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:34.069179 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0071a6-faed-41d3-a529-c9d99dfcfcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:34.069179 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0071a6-faed-41d3-a529-c9d99dfcfcf5 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:34.069179 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0071a6-faed-41d3-a529-c9d99dfcfcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:34.069179 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0071a6-faed-41d3-a529-c9d99dfcfcf5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:34.069789 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0071a6-faed-41d3-a529-c9d99dfcfcf5 None admin] RBAC: Adding query filter params (interface=public, service_id=4aa286188e4d43efab20e45592256442, region_id=RegionOne) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:34.069924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0071a6-faed-41d3-a529-c9d99dfcfcf5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:34.073164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0071a6-faed-41d3-a529-c9d99dfcfcf5 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:34.080821 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 395/783] 10.222.0.39 () {56 vars in 1251 bytes} [Sun Aug 7 00:53:33 2022] GET /identity/v3/endpoints?service_id=4aa286188e4d43efab20e45592256442&interface=public®ion_id=RegionOne => generated 194 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:34.082256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe17e51-0afb-4c74-af8d-3aefe3c04d72 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:34.082759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe17e51-0afb-4c74-af8d-3aefe3c04d72 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:34.083101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe17e51-0afb-4c74-af8d-3aefe3c04d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:34.108322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3fe17e51-0afb-4c74-af8d-3aefe3c04d72 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:34.110767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3fe17e51-0afb-4c74-af8d-3aefe3c04d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:34.177319 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:34.208801 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 396/784] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:53:34.209456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088d674-d425-4761-8d3c-eeec840f07f8 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:34.210089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe17e51-0afb-4c74-af8d-3aefe3c04d72 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:34.228160 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:34.267200 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66643f15-1286-46e8-8b60-60f8ea097084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:34.268097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66643f15-1286-46e8-8b60-60f8ea097084 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:34.268473 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66643f15-1286-46e8-8b60-60f8ea097084 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:34.268840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66643f15-1286-46e8-8b60-60f8ea097084 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:34.269630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66643f15-1286-46e8-8b60-60f8ea097084 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:34.270061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66643f15-1286-46e8-8b60-60f8ea097084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:34.271629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66643f15-1286-46e8-8b60-60f8ea097084 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:34.282700 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 389/785] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:53:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:34.287359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66643f15-1286-46e8-8b60-60f8ea097084 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:34.387272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe17e51-0afb-4c74-af8d-3aefe3c04d72 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:34.424241 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66643f15-1286-46e8-8b60-60f8ea097084 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:34.452185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de8338-5fac-4ab3-a44d-fb1c7293b987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:34.452998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de8338-5fac-4ab3-a44d-fb1c7293b987 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:34.453377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de8338-5fac-4ab3-a44d-fb1c7293b987 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:34.453746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de8338-5fac-4ab3-a44d-fb1c7293b987 None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:34.454504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de8338-5fac-4ab3-a44d-fb1c7293b987 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:34.456300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de8338-5fac-4ab3-a44d-fb1c7293b987 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:34.468160 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 397/786] 10.222.0.39 () {56 vars in 1087 bytes} [Sun Aug 7 00:53:34 2022] GET /identity/v3/services => generated 772 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:34.468160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de8338-5fac-4ab3-a44d-fb1c7293b987 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:34.519968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4d3f4-4f4b-4269-8f32-15293fb18d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:34.521028 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4d3f4-4f4b-4269-8f32-15293fb18d16 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:34.521510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4d3f4-4f4b-4269-8f32-15293fb18d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:34.522029 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4d3f4-4f4b-4269-8f32-15293fb18d16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:34.549256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4d3f4-4f4b-4269-8f32-15293fb18d16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:53:34.559438 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-e6e4d3f4-4f4b-4269-8f32-15293fb18d16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:34.559438 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:34.559438 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:34.559438 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:34.559438 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:34.559438 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:34.559438 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:34.559438 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:34.559438 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:34.559438 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:34.559438 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:34.559438 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:34.559438 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:53:34.559438 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:53:34.559438 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:53:34.559438 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:53:34.561164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:53:34.561164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:53:34.561164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:53:34.561164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:53:34.561164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:34.561164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:34.561164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:34.561164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:34.561164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:34.561164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:34.561164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:34.561164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:34.561164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:34.561164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:34.561164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:34.561164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:34.562133 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:34.562133 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:34.562133 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:34.562133 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:34.562133 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:53:34.562133 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:53:34.562133 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:53:34.562133 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:53:34.562133 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:53:34.562133 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:53:34.562133 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:34.562133 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:34.566349 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 390/787] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Aug 7 00:53:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:34.573307 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4d3f4-4f4b-4269-8f32-15293fb18d16 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:34.586299 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:34.654869 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:34.765644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de8338-5fac-4ab3-a44d-fb1c7293b987 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:34.806328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4d3f4-4f4b-4269-8f32-15293fb18d16 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:34.848945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404afe9-8e19-4a71-961b-055c89c21f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:34.850429 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404afe9-8e19-4a71-961b-055c89c21f7a None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:34.855406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404afe9-8e19-4a71-961b-055c89c21f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:34.855406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404afe9-8e19-4a71-961b-055c89c21f7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:34.870864 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46600015-3beb-4a79-91a8-abbac00f4ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:34.871865 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46600015-3beb-4a79-91a8-abbac00f4ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:34.872378 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46600015-3beb-4a79-91a8-abbac00f4ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:34.873520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46600015-3beb-4a79-91a8-abbac00f4ca6 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:34.874466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46600015-3beb-4a79-91a8-abbac00f4ca6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:34.874976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46600015-3beb-4a79-91a8-abbac00f4ca6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:34.876626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46600015-3beb-4a79-91a8-abbac00f4ca6 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:34.877045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404afe9-8e19-4a71-961b-055c89c21f7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:34.880706 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404afe9-8e19-4a71-961b-055c89c21f7a None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:34.895580 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 391/788] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Aug 7 00:53:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:53:34.903201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46600015-3beb-4a79-91a8-abbac00f4ca6 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:34.909468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-5404afe9-8e19-4a71-961b-055c89c21f7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:34.909468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:34.909468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:34.909468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:34.909468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:34.909468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:34.909468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:34.909468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:34.909468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:34.909468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:34.909468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:34.909468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:34.909468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:34.909468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:34.909468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:34.909468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:34.910502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:34.910502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:34.910502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:34.910502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:34.910502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:34.910502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:34.910502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:34.910502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:34.910502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:34.910502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:34.910502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:34.910502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:34.910502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:34.910502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:34.910502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:34.910502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:34.910502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:34.911475 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:34.911475 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:34.911475 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:34.912718 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 398/789] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 449 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:34.921034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404afe9-8e19-4a71-961b-055c89c21f7a None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:35.044558 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:35.057082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46600015-3beb-4a79-91a8-abbac00f4ca6 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:35.080627 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:35.098317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404afe9-8e19-4a71-961b-055c89c21f7a None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:35.146040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff7e4c5-a6ab-4b37-9a75-53f8a630ae9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:35.147037 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7e4c5-a6ab-4b37-9a75-53f8a630ae9a None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:35.147825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7e4c5-a6ab-4b37-9a75-53f8a630ae9a None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:35.148400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7e4c5-a6ab-4b37-9a75-53f8a630ae9a None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:35.149266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff7e4c5-a6ab-4b37-9a75-53f8a630ae9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:35.149882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff7e4c5-a6ab-4b37-9a75-53f8a630ae9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:35.151476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff7e4c5-a6ab-4b37-9a75-53f8a630ae9a None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:35.166646 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 399/790] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:35.168316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ef3cb-3649-422b-9562-2f1356313dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:35.169009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ef3cb-3649-422b-9562-2f1356313dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:35.169321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ef3cb-3649-422b-9562-2f1356313dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:35.169671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ef3cb-3649-422b-9562-2f1356313dd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:35.173192 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff7e4c5-a6ab-4b37-9a75-53f8a630ae9a None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:35.200879 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ef3cb-3649-422b-9562-2f1356313dd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:35.207313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ef3cb-3649-422b-9562-2f1356313dd7 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:35.254421 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-ed2ef3cb-3649-422b-9562-2f1356313dd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:35.254421 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:35.254421 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:35.254421 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:35.254421 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:35.254421 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:35.254421 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:35.254421 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:35.254421 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:35.254421 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:35.254421 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:35.254421 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:35.254421 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:35.254421 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:35.254421 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:35.254421 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:35.255432 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:35.255432 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:35.255432 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:35.255432 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:35.255432 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:35.255432 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:35.255432 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:35.255432 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:35.255432 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:35.255432 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:35.255432 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:35.255432 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:35.255432 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:35.255432 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:35.255432 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:35.255432 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:35.255432 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:35.256373 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:35.256373 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:35.256373 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:35.259048 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 392/791] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:53:35.267946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ef3cb-3649-422b-9562-2f1356313dd7 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:35.345656 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff7e4c5-a6ab-4b37-9a75-53f8a630ae9a None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:35.384434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0523e-978d-4939-a2ca-46a5a0b4ce7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:35.385495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0523e-978d-4939-a2ca-46a5a0b4ce7d None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:35.385996 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0523e-978d-4939-a2ca-46a5a0b4ce7d None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:35.386477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0523e-978d-4939-a2ca-46a5a0b4ce7d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:35.396345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0523e-978d-4939-a2ca-46a5a0b4ce7d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:35.398624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0523e-978d-4939-a2ca-46a5a0b4ce7d None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:35.412452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-cdb0523e-978d-4939-a2ca-46a5a0b4ce7d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:53:35.412452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:35.412452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:35.412452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:35.412452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:35.412452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:35.412452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:35.412452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:35.412452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:35.412452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:35.412452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:35.412452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:35.412452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:53:35.412452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:53:35.412452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:53:35.412452 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:53:35.413492 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:35.413492 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:35.413492 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:53:35.413492 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:35.413492 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:53:35.413492 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:35.413492 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:35.413492 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:35.413492 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:35.413492 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:35.413492 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:35.413492 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:35.413492 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:35.413492 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:35.413492 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:35.413492 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:35.413492 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:35.413492 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:35.414438 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:35.414438 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:35.414438 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:53:35.414438 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:53:35.414438 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:53:35.414438 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:53:35.414438 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:53:35.414438 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:53:35.414438 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:53:35.414438 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:35.417179 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 400/792] 10.222.0.39 () {56 vars in 1093 bytes} [Sun Aug 7 00:53:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:35.429678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0523e-978d-4939-a2ca-46a5a0b4ce7d None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:35.495451 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:35.524650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ef3cb-3649-422b-9562-2f1356313dd7 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:35.573796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2b77a-4be9-4f8f-a09e-911751ffa92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:35.574930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2b77a-4be9-4f8f-a09e-911751ffa92d None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:35.575481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2b77a-4be9-4f8f-a09e-911751ffa92d None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:35.576099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2b77a-4be9-4f8f-a09e-911751ffa92d None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:35.577167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2b77a-4be9-4f8f-a09e-911751ffa92d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:35.577814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2b77a-4be9-4f8f-a09e-911751ffa92d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:35.579738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2b77a-4be9-4f8f-a09e-911751ffa92d None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:35.594898 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 393/793] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:53:35.605353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2b77a-4be9-4f8f-a09e-911751ffa92d None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:35.636265 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:35.639405 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0523e-978d-4939-a2ca-46a5a0b4ce7d None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:35.682841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e801f-1e79-40f0-beb5-a691de1a67cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:35.683509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e801f-1e79-40f0-beb5-a691de1a67cb None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:35.683793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e801f-1e79-40f0-beb5-a691de1a67cb None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:35.684325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e801f-1e79-40f0-beb5-a691de1a67cb None admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:35.686542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e801f-1e79-40f0-beb5-a691de1a67cb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:35.686884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e801f-1e79-40f0-beb5-a691de1a67cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:35.688450 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e801f-1e79-40f0-beb5-a691de1a67cb None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:35.744481 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 401/794] 10.222.0.39 () {56 vars in 1133 bytes} [Sun Aug 7 00:53:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:53:35.750196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e801f-1e79-40f0-beb5-a691de1a67cb None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:35.888184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2b77a-4be9-4f8f-a09e-911751ffa92d None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:35.946000 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:35.968876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd91a4b-ba5c-4048-bea3-0c1e3c8223bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:35.969552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd91a4b-ba5c-4048-bea3-0c1e3c8223bc None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:35.969860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd91a4b-ba5c-4048-bea3-0c1e3c8223bc None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:35.970183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd91a4b-ba5c-4048-bea3-0c1e3c8223bc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:35.979071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd91a4b-ba5c-4048-bea3-0c1e3c8223bc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:35.988920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd91a4b-ba5c-4048-bea3-0c1e3c8223bc None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:36.014189 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e801f-1e79-40f0-beb5-a691de1a67cb None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:36.020895 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-6dd91a4b-ba5c-4048-bea3-0c1e3c8223bc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:53:36.020895 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:36.020895 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:36.020895 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:36.020895 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:36.020895 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:36.020895 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:36.020895 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:36.020895 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:36.020895 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:36.020895 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:36.020895 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:36.020895 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:53:36.020895 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:53:36.020895 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:53:36.020895 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:53:36.021867 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:36.021867 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:36.021867 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:53:36.021867 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:36.021867 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:53:36.021867 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:36.021867 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:36.021867 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:36.021867 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:36.021867 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:36.021867 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:36.021867 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:36.021867 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:36.021867 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:36.021867 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:36.021867 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:36.021867 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:36.021867 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:36.023073 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:36.023073 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:36.023073 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:53:36.023073 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:53:36.023073 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:53:36.023073 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:53:36.023073 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:53:36.023073 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:53:36.023073 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:53:36.023073 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:36.023073 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 394/795] 10.222.0.39 () {56 vars in 1117 bytes} [Sun Aug 7 00:53:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:36.030442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd91a4b-ba5c-4048-bea3-0c1e3c8223bc None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:36.081756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1c7c8-46f8-4862-91db-ceda84239500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:36.082800 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1c7c8-46f8-4862-91db-ceda84239500 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:36.083298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1c7c8-46f8-4862-91db-ceda84239500 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:36.083801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1c7c8-46f8-4862-91db-ceda84239500 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:36.137137 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:36.173979 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd91a4b-ba5c-4048-bea3-0c1e3c8223bc None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:36.212932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0157c45-241a-403d-b328-513cafcbf727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:36.213929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0157c45-241a-403d-b328-513cafcbf727 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:36.214442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0157c45-241a-403d-b328-513cafcbf727 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:36.214908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0157c45-241a-403d-b328-513cafcbf727 None admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:36.215226 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1c7c8-46f8-4862-91db-ceda84239500 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:36.216123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0157c45-241a-403d-b328-513cafcbf727 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:36.216658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0157c45-241a-403d-b328-513cafcbf727 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:36.218094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1c7c8-46f8-4862-91db-ceda84239500 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:36.218506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0157c45-241a-403d-b328-513cafcbf727 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:36.244500 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 395/796] 10.222.0.39 () {56 vars in 1149 bytes} [Sun Aug 7 00:53:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:53:36.246336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db474ac4-3cb9-4385-8570-335ee4f18f11 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:36.246871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db474ac4-3cb9-4385-8570-335ee4f18f11 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:36.247341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db474ac4-3cb9-4385-8570-335ee4f18f11 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:36.249247 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 396/797] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:36.254138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db474ac4-3cb9-4385-8570-335ee4f18f11 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:36.363959 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:36.370384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db474ac4-3cb9-4385-8570-335ee4f18f11 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:36.400573 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:36.410857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b7830-5b4b-4371-8fc8-4297f9c7c251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:36.411825 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b7830-5b4b-4371-8fc8-4297f9c7c251 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:36.412339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b7830-5b4b-4371-8fc8-4297f9c7c251 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:36.412801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b7830-5b4b-4371-8fc8-4297f9c7c251 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:36.414379 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 402/798] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:53:35 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 00:53:36.416610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fa240-ce21-4099-bfda-082d54526604 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:36.417123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fa240-ce21-4099-bfda-082d54526604 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:36.417694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fa240-ce21-4099-bfda-082d54526604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:36.425464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b7830-5b4b-4371-8fc8-4297f9c7c251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:36.427239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b7830-5b4b-4371-8fc8-4297f9c7c251 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:36.444099 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-081b7830-5b4b-4371-8fc8-4297f9c7c251 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:36.444099 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:36.444099 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:36.444099 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:36.444099 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:36.444099 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:36.444099 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:36.444099 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:36.444099 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:36.444099 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:36.444099 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:36.444099 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:36.444099 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:36.444099 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:36.444099 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:36.444099 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:36.445117 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:36.445117 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:36.445117 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:36.445117 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:36.445117 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:36.445117 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:36.445117 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:36.445117 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:36.445117 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:36.445117 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:36.445117 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:36.445117 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:36.445117 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:36.445117 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:36.445117 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:36.445117 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:36.445117 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:36.446106 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:36.446106 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:36.446106 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:36.453061 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-111fa240-ce21-4099-bfda-082d54526604 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:36.453061 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-111fa240-ce21-4099-bfda-082d54526604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:36.453469 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 397/799] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:36.454618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b7830-5b4b-4371-8fc8-4297f9c7c251 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:36.570962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b7830-5b4b-4371-8fc8-4297f9c7c251 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:36.584881 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 403/800] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:53:36.585847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111fa240-ce21-4099-bfda-082d54526604 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:36.611400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a8ae7-87ef-4247-bee1-becaa4fe3dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:36.612467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a8ae7-87ef-4247-bee1-becaa4fe3dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:36.612964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a8ae7-87ef-4247-bee1-becaa4fe3dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:36.613427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a8ae7-87ef-4247-bee1-becaa4fe3dd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:36.625461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a8ae7-87ef-4247-bee1-becaa4fe3dd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:36.627256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a8ae7-87ef-4247-bee1-becaa4fe3dd3 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:36.642269 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-810a8ae7-87ef-4247-bee1-becaa4fe3dd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:36.642269 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:36.642269 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:36.642269 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:36.642269 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:36.642269 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:36.642269 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:36.642269 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:36.642269 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:36.642269 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:36.642269 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:36.642269 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:36.642269 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:36.642269 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:36.642269 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:36.642269 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:36.643310 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:36.643310 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:36.643310 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:36.643310 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:36.643310 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:36.643310 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:36.643310 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:36.643310 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:36.643310 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:36.643310 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:36.643310 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:36.643310 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:36.643310 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:36.643310 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:36.643310 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:36.643310 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:36.643310 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:36.649870 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:36.649870 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:36.649870 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:36.649870 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 398/801] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:36.649870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62d23e-14f3-417d-9659-3e68e89dfbef None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:36.649870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62d23e-14f3-417d-9659-3e68e89dfbef None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:36.649870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62d23e-14f3-417d-9659-3e68e89dfbef None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:36.649870 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 399/802] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:36.649870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62d23e-14f3-417d-9659-3e68e89dfbef None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:36.695273 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:36.742368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111fa240-ce21-4099-bfda-082d54526604 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:36.746456 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:36.793334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a993e9-02ab-4e33-aaa1-cbab605f4883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:36.793968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a993e9-02ab-4e33-aaa1-cbab605f4883 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:36.794248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a993e9-02ab-4e33-aaa1-cbab605f4883 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:36.795139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a993e9-02ab-4e33-aaa1-cbab605f4883 None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:36.795816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a993e9-02ab-4e33-aaa1-cbab605f4883 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:36.796210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a993e9-02ab-4e33-aaa1-cbab605f4883 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:36.797596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a993e9-02ab-4e33-aaa1-cbab605f4883 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:36.808763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62d23e-14f3-417d-9659-3e68e89dfbef None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:36.815852 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 404/803] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:36.815852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a993e9-02ab-4e33-aaa1-cbab605f4883 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:36.857707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767332e-63d6-42d5-b229-72bc2de5a4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:36.858520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767332e-63d6-42d5-b229-72bc2de5a4dd None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:36.858923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767332e-63d6-42d5-b229-72bc2de5a4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:36.859315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767332e-63d6-42d5-b229-72bc2de5a4dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:36.873479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767332e-63d6-42d5-b229-72bc2de5a4dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:53:36.879180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-a767332e-63d6-42d5-b229-72bc2de5a4dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:53:36.879180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:36.879180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:36.879180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:36.879180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:36.879180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:36.879180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:36.879180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:36.879180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:36.879180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:36.879180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:36.879180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:36.879180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:53:36.879180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:53:36.879180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:53:36.879180 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:53:36.880976 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:53:36.880976 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:53:36.880976 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:53:36.880976 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:53:36.880976 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:36.880976 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:36.880976 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:36.880976 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:36.880976 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:36.880976 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:36.880976 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:36.880976 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:36.880976 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:36.880976 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:36.880976 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:36.880976 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:36.882621 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:36.882621 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:36.882621 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:36.882621 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:36.882621 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:53:36.882621 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:53:36.882621 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:53:36.882621 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:53:36.882621 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:53:36.882621 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:53:36.882621 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:53:36.882621 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:36.882621 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 400/804] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:53:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:36.884037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980579e-c61e-470f-8aa2-9d84c76e64ef None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:36.884037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980579e-c61e-470f-8aa2-9d84c76e64ef None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:36.884037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980579e-c61e-470f-8aa2-9d84c76e64ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:36.907019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9980579e-c61e-470f-8aa2-9d84c76e64ef None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:36.908663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9980579e-c61e-470f-8aa2-9d84c76e64ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:36.944022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a993e9-02ab-4e33-aaa1-cbab605f4883 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:36.995847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab9c9d-e642-4252-aed6-79d79477adcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:36.996903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab9c9d-e642-4252-aed6-79d79477adcb None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:36.996903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab9c9d-e642-4252-aed6-79d79477adcb None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:36.997265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab9c9d-e642-4252-aed6-79d79477adcb None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:36.997950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab9c9d-e642-4252-aed6-79d79477adcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:36.998309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab9c9d-e642-4252-aed6-79d79477adcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:37.000509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab9c9d-e642-4252-aed6-79d79477adcb None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:37.003999 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 401/805] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:53:37.005113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980579e-c61e-470f-8aa2-9d84c76e64ef None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:37.023332 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 405/806] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:37.025327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab9c9d-e642-4252-aed6-79d79477adcb None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:37.047153 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:37.075637 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:37.150378 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980579e-c61e-470f-8aa2-9d84c76e64ef None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:37.214714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab9c9d-e642-4252-aed6-79d79477adcb None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:37.221184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c5a71-9f39-4ec7-bc43-2d47b90bdd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:37.222267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c5a71-9f39-4ec7-bc43-2d47b90bdd99 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:37.222760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c5a71-9f39-4ec7-bc43-2d47b90bdd99 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:37.223236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c5a71-9f39-4ec7-bc43-2d47b90bdd99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:37.235934 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c5a71-9f39-4ec7-bc43-2d47b90bdd99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:37.238596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c5a71-9f39-4ec7-bc43-2d47b90bdd99 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:37.256349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a57ef4-18c4-43aa-bfd0-73ffa9401852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:37.256964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a57ef4-18c4-43aa-bfd0-73ffa9401852 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:37.257255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a57ef4-18c4-43aa-bfd0-73ffa9401852 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:37.257517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a57ef4-18c4-43aa-bfd0-73ffa9401852 None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:37.258195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a57ef4-18c4-43aa-bfd0-73ffa9401852 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:37.258497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a57ef4-18c4-43aa-bfd0-73ffa9401852 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:37.259865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a57ef4-18c4-43aa-bfd0-73ffa9401852 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:37.260152 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-7c8c5a71-9f39-4ec7-bc43-2d47b90bdd99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:37.260152 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:37.260152 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:37.260152 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:37.260152 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:37.260152 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:37.260152 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:37.260152 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:37.260152 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:37.260152 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:37.260152 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:37.260152 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:37.260152 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:53:37.260152 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:53:37.260152 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:53:37.261045 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:53:37.261045 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:37.261045 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:37.261045 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:37.261045 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:37.261045 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:37.261045 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:37.261045 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:37.261045 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:37.261045 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:37.261045 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:37.261045 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:37.261045 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:37.261045 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:37.261045 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:37.261045 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:37.261045 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:37.261992 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:53:37.261992 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:53:37.261992 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:53:37.261992 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:53:37.261992 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:53:37.261992 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:53:37.261992 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:37.261992 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:37.262439 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 402/807] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:37.264116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c5a71-9f39-4ec7-bc43-2d47b90bdd99 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:37.275713 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 406/808] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:53:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:37.280432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a57ef4-18c4-43aa-bfd0-73ffa9401852 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:37.369077 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:37.386532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a57ef4-18c4-43aa-bfd0-73ffa9401852 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:37.391988 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:37.412601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c5a71-9f39-4ec7-bc43-2d47b90bdd99 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:37.423371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac548ca2-e08b-48df-b711-436eb2fa864e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:37.424042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac548ca2-e08b-48df-b711-436eb2fa864e None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:37.424328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac548ca2-e08b-48df-b711-436eb2fa864e None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:37.424597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac548ca2-e08b-48df-b711-436eb2fa864e None admin] PATH_INFO: `/v3/services/network` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:37.425190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac548ca2-e08b-48df-b711-436eb2fa864e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:37.426574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac548ca2-e08b-48df-b711-436eb2fa864e None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:37.436264 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-ac548ca2-e08b-48df-b711-436eb2fa864e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 00:53:37.436264 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:37.436264 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:53:37.436264 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:53:37.436264 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:53:37.436264 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:53:37.436264 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:53:37.436264 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:37.436264 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 00:53:37.436264 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:37.436264 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:53:37.436264 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:37.436264 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:37.436264 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:37.436264 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:37.436264 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:37.436264 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:37.437832 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:37.437832 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:37.437832 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:37.437832 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:37.437832 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:37.437832 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:37.437832 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:53:37.437832 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:53:37.437832 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:53:37.437832 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:53:37.437832 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:37.437832 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:37.437832 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:37.437832 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:37.437832 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:37.437832 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:37.439416 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:37.439416 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:37.439416 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:37.439416 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:37.439416 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:37.439416 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:37.439416 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:37.439416 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:37.439416 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:37.439416 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:37.439416 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:53:37.439416 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:37.439416 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 07 00:53:37.439416 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:37.439416 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 407/809] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:37 2022] GET /identity/v3/services/network => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:37.440989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac548ca2-e08b-48df-b711-436eb2fa864e None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:37.455292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb81e71-8fe2-4cfa-a0cd-aec22fd8e2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:37.456069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb81e71-8fe2-4cfa-a0cd-aec22fd8e2bf None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:37.456351 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb81e71-8fe2-4cfa-a0cd-aec22fd8e2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:37.456613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb81e71-8fe2-4cfa-a0cd-aec22fd8e2bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:37.464435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb81e71-8fe2-4cfa-a0cd-aec22fd8e2bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:37.465899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb81e71-8fe2-4cfa-a0cd-aec22fd8e2bf None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:37.482591 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-2eb81e71-8fe2-4cfa-a0cd-aec22fd8e2bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:37.482591 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:37.482591 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:37.482591 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:37.482591 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:37.482591 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:37.482591 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:37.482591 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:37.482591 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:37.482591 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:37.482591 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:37.482591 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:37.482591 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:53:37.482591 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:53:37.482591 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:53:37.483619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:53:37.483619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:37.483619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:37.483619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:37.483619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:37.483619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:37.483619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:37.483619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:37.483619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:37.483619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:37.483619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:37.483619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:37.483619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:37.483619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:37.483619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:37.483619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:37.483619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:37.484560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:53:37.484560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:53:37.484560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:53:37.484560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:53:37.484560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:53:37.484560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:53:37.484560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:37.484560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:37.484560 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 403/810] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:37.485913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb81e71-8fe2-4cfa-a0cd-aec22fd8e2bf None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:37.570587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac548ca2-e08b-48df-b711-436eb2fa864e None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:37.606671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb81e71-8fe2-4cfa-a0cd-aec22fd8e2bf None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:37.609780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9070b-4956-4f03-9f0d-d079745b745f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:37.610443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9070b-4956-4f03-9f0d-d079745b745f None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:37.610720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9070b-4956-4f03-9f0d-d079745b745f None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:37.610993 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9070b-4956-4f03-9f0d-d079745b745f None admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:37.611710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9070b-4956-4f03-9f0d-d079745b745f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:37.612063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9070b-4956-4f03-9f0d-d079745b745f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:37.613536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9070b-4956-4f03-9f0d-d079745b745f None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:37.627596 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 408/811] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:53:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:37.629011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30ff78-99d9-476a-8fef-d9c734b7f8c9 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:37.629299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30ff78-99d9-476a-8fef-d9c734b7f8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:37.629570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30ff78-99d9-476a-8fef-d9c734b7f8c9 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:37.630844 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 409/812] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:37.631566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30ff78-99d9-476a-8fef-d9c734b7f8c9 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:37.645865 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:37.652685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ba089-ab22-4bc8-958b-139b200a6a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:37.653331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ba089-ab22-4bc8-958b-139b200a6a2c None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:37.653606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ba089-ab22-4bc8-958b-139b200a6a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:37.654517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ba089-ab22-4bc8-958b-139b200a6a2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:37.666716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ba089-ab22-4bc8-958b-139b200a6a2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:37.668224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ba089-ab22-4bc8-958b-139b200a6a2c None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:37.670946 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:37.687162 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-1b7ba089-ab22-4bc8-958b-139b200a6a2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:37.687162 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:37.687162 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:37.687162 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:37.687162 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:37.687162 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:37.687162 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:37.687162 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:37.687162 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:37.687162 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:37.687162 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:37.687162 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:37.687162 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:37.687162 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:37.687162 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:37.687162 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:37.689070 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:37.689070 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:37.689070 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:37.689070 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:37.689070 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:37.689070 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:37.689070 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:37.689070 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:37.689070 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:37.689070 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:37.689070 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:37.689070 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:37.689070 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:37.689070 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:37.689070 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:37.689070 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:37.689070 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:37.690775 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:37.690775 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:37.690775 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:37.690775 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 404/813] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:37.690775 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ba089-ab22-4bc8-958b-139b200a6a2c None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:37.754887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30ff78-99d9-476a-8fef-d9c734b7f8c9 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:37.802929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25193780-b104-4f8a-8130-904522365bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:37.803544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25193780-b104-4f8a-8130-904522365bff None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:37.803816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25193780-b104-4f8a-8130-904522365bff None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:37.804118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25193780-b104-4f8a-8130-904522365bff None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:37.804763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25193780-b104-4f8a-8130-904522365bff None admin] RBAC: Adding query filter params (name=network) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:37.805071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25193780-b104-4f8a-8130-904522365bff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:37.806451 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25193780-b104-4f8a-8130-904522365bff None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:37.809220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ba089-ab22-4bc8-958b-139b200a6a2c None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:37.811320 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 410/814] 10.222.0.39 () {56 vars in 1112 bytes} [Sun Aug 7 00:53:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:37.812152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25193780-b104-4f8a-8130-904522365bff None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:37.854732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91437af-6419-46a2-8ce2-b48db98abae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:37.855126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91437af-6419-46a2-8ce2-b48db98abae9 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:37.855387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91437af-6419-46a2-8ce2-b48db98abae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:37.855665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91437af-6419-46a2-8ce2-b48db98abae9 None admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:37.856415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91437af-6419-46a2-8ce2-b48db98abae9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:37.856716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91437af-6419-46a2-8ce2-b48db98abae9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:37.858219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91437af-6419-46a2-8ce2-b48db98abae9 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:37.871233 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 405/815] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:53:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:37.872557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec9f80-9098-4823-9d95-bc0ad08b0663 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:37.872847 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec9f80-9098-4823-9d95-bc0ad08b0663 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:37.873118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec9f80-9098-4823-9d95-bc0ad08b0663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:37.892980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-cfec9f80-9098-4823-9d95-bc0ad08b0663 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:37.894201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-cfec9f80-9098-4823-9d95-bc0ad08b0663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:37.911669 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:37.939785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25193780-b104-4f8a-8130-904522365bff None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:37.949079 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:37.972285 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 406/816] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:53:37.974076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec9f80-9098-4823-9d95-bc0ad08b0663 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:37.986044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23765090-7862-4197-8539-93876122e208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:37.987044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23765090-7862-4197-8539-93876122e208 None admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:37.987477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23765090-7862-4197-8539-93876122e208 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:37.987939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23765090-7862-4197-8539-93876122e208 None admin] PATH_INFO: `/v3/projects/1cd2efda8567437e983e3a7867ecd69b/users/af48a86c031e400982666d661c9f4229/roles/af03b67d56b44430ab9d48dcba18ace2` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:38.007817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23765090-7862-4197-8539-93876122e208 None admin] RBAC: Authorizing `identity:create_grant(project_id=1cd2efda8567437e983e3a7867ecd69b, user_id=af48a86c031e400982666d661c9f4229, role_id=af03b67d56b44430ab9d48dcba18ace2)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:38.010245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23765090-7862-4197-8539-93876122e208 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:38.025518 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 411/817] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Aug 7 00:53:37 2022] PUT /identity/v3/projects/1cd2efda8567437e983e3a7867ecd69b/users/af48a86c031e400982666d661c9f4229/roles/af03b67d56b44430ab9d48dcba18ace2 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:53:38.026623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23765090-7862-4197-8539-93876122e208 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:38.118293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec9f80-9098-4823-9d95-bc0ad08b0663 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:38.164008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac6cd5-d95f-4332-b1ea-853d6987bc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:38.164648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac6cd5-d95f-4332-b1ea-853d6987bc13 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:38.164927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac6cd5-d95f-4332-b1ea-853d6987bc13 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:38.165199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac6cd5-d95f-4332-b1ea-853d6987bc13 None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:38.165920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac6cd5-d95f-4332-b1ea-853d6987bc13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:38.166219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac6cd5-d95f-4332-b1ea-853d6987bc13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:38.167662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac6cd5-d95f-4332-b1ea-853d6987bc13 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:38.188401 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23765090-7862-4197-8539-93876122e208 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:38.192904 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 407/818] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:38.193819 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac6cd5-d95f-4332-b1ea-853d6987bc13 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:38.235241 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:38.253609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6825089-3ec2-4f3b-b9d5-7e582a84b8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:38.254491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6825089-3ec2-4f3b-b9d5-7e582a84b8d3 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:38.254905 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6825089-3ec2-4f3b-b9d5-7e582a84b8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:38.255319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6825089-3ec2-4f3b-b9d5-7e582a84b8d3 None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:38.256267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6825089-3ec2-4f3b-b9d5-7e582a84b8d3 None admin] RBAC: Adding query filter params (type=network) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:38.256758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6825089-3ec2-4f3b-b9d5-7e582a84b8d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:38.258639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6825089-3ec2-4f3b-b9d5-7e582a84b8d3 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:38.266882 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 412/819] 10.222.0.39 () {56 vars in 1112 bytes} [Sun Aug 7 00:53:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:38.267576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6825089-3ec2-4f3b-b9d5-7e582a84b8d3 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:38.285540 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:38.355491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac6cd5-d95f-4332-b1ea-853d6987bc13 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:38.398406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b13e89-88ce-48be-8f15-548003f61d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:38.398941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b13e89-88ce-48be-8f15-548003f61d4b None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:38.399216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b13e89-88ce-48be-8f15-548003f61d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:38.399483 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b13e89-88ce-48be-8f15-548003f61d4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:38.400261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b13e89-88ce-48be-8f15-548003f61d4b None admin] RBAC: Adding query filter params (role.id=695b07606e564668bac7afff4ab6052a, scope.project.id=1cd2efda8567437e983e3a7867ecd69b, user.id=6c70d5a72d424db68de7c7b8257fe02c) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:38.400567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b13e89-88ce-48be-8f15-548003f61d4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:38.402012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b13e89-88ce-48be-8f15-548003f61d4b None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:38.419941 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 408/820] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:53:38 2022] GET /identity/v3/role_assignments?user.id=6c70d5a72d424db68de7c7b8257fe02c&scope.project.id=1cd2efda8567437e983e3a7867ecd69b&role.id=695b07606e564668bac7afff4ab6052a => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:38.419941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b13e89-88ce-48be-8f15-548003f61d4b None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:38.437088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6825089-3ec2-4f3b-b9d5-7e582a84b8d3 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:38.510216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a51ab3-9390-48aa-914e-66d81bb37774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:38.512119 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a51ab3-9390-48aa-914e-66d81bb37774 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:38.512487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a51ab3-9390-48aa-914e-66d81bb37774 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:38.512836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a51ab3-9390-48aa-914e-66d81bb37774 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:38.513860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a51ab3-9390-48aa-914e-66d81bb37774 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:38.515708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a51ab3-9390-48aa-914e-66d81bb37774 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:38.537177 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-a0a51ab3-9390-48aa-914e-66d81bb37774 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 00:53:38.537177 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:38.537177 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:53:38.537177 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:53:38.537177 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:53:38.537177 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:53:38.537177 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:53:38.537177 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:38.537177 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 00:53:38.537177 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:38.537177 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:53:38.537177 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:38.537177 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:38.537177 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:38.537177 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:38.537177 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:38.537177 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:38.538489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:38.538489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:38.538489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:38.538489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:38.538489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:38.538489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:38.538489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:53:38.538489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:53:38.538489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:53:38.538489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:53:38.538489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:38.538489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:38.538489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:38.538489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:38.538489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:38.538489 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:38.539640 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:38.539640 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:38.539640 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:38.539640 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:38.539640 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:38.539640 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:38.539640 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:38.539640 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:38.539640 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:38.539640 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:38.539640 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:53:38.539640 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:38.539640 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 07 00:53:38.539640 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:38.546680 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 413/821] 10.222.0.39 () {56 vars in 1129 bytes} [Sun Aug 7 00:53:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:38.546680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a51ab3-9390-48aa-914e-66d81bb37774 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:38.606233 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b13e89-88ce-48be-8f15-548003f61d4b None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:38.618912 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:38.661519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc2414-5ccc-4d50-bcd4-b0be237c5c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:38.662504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc2414-5ccc-4d50-bcd4-b0be237c5c3b None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:38.663004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc2414-5ccc-4d50-bcd4-b0be237c5c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:38.663483 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc2414-5ccc-4d50-bcd4-b0be237c5c3b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:38.663960 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:38.675740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cc2414-5ccc-4d50-bcd4-b0be237c5c3b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:38.677520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cc2414-5ccc-4d50-bcd4-b0be237c5c3b None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:38.691770 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-94cc2414-5ccc-4d50-bcd4-b0be237c5c3b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:53:38.691770 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:38.691770 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:38.691770 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:38.691770 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:38.691770 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:38.691770 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:38.691770 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:38.691770 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:38.691770 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:38.691770 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:38.691770 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:38.691770 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:53:38.691770 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:53:38.691770 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:53:38.691770 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:53:38.693049 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:38.693049 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:38.693049 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:53:38.693049 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:38.693049 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:53:38.693049 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:38.693049 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:38.693049 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:38.693049 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:38.693049 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:38.693049 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:38.693049 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:38.693049 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:38.693049 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:38.693049 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:38.693049 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:38.693049 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:38.693049 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:38.694146 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:38.694146 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:38.694146 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:53:38.694146 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:53:38.694146 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:53:38.694146 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:53:38.694146 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:53:38.694146 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:53:38.694146 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:53:38.694146 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:38.698088 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 409/822] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:53:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:38.703914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc2414-5ccc-4d50-bcd4-b0be237c5c3b None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:38.759820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a51ab3-9390-48aa-914e-66d81bb37774 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:38.809461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad322e-ddbe-4b2e-b22a-ee761784f872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:38.810429 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad322e-ddbe-4b2e-b22a-ee761784f872 None admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:38.810708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad322e-ddbe-4b2e-b22a-ee761784f872 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:38.811008 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad322e-ddbe-4b2e-b22a-ee761784f872 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:38.812186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad322e-ddbe-4b2e-b22a-ee761784f872 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:38.813907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad322e-ddbe-4b2e-b22a-ee761784f872 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:38.844148 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 414/823] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 00:53:38 2022] POST /identity/v3/endpoints => generated 337 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:53:38.845148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad322e-ddbe-4b2e-b22a-ee761784f872 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:38.897618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc2414-5ccc-4d50-bcd4-b0be237c5c3b None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:39.010246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae5ff2-3247-45c8-9ada-2a3e7e13f27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:39.010951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae5ff2-3247-45c8-9ada-2a3e7e13f27a None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:39.011182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae5ff2-3247-45c8-9ada-2a3e7e13f27a None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:39.011387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ae5ff2-3247-45c8-9ada-2a3e7e13f27a None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:39.012068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae5ff2-3247-45c8-9ada-2a3e7e13f27a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:39.012374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae5ff2-3247-45c8-9ada-2a3e7e13f27a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:39.014057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ae5ff2-3247-45c8-9ada-2a3e7e13f27a None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:39.030656 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 410/824] 10.222.0.39 () {56 vars in 1124 bytes} [Sun Aug 7 00:53:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:39.036766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae5ff2-3247-45c8-9ada-2a3e7e13f27a None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:39.062511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad322e-ddbe-4b2e-b22a-ee761784f872 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:39.084282 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:39.104494 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:39.132215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb1e18-6885-48b9-9c07-4187ead83914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:39.133233 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb1e18-6885-48b9-9c07-4187ead83914 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:39.133821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb1e18-6885-48b9-9c07-4187ead83914 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:39.134103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb1e18-6885-48b9-9c07-4187ead83914 None admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:39.134882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb1e18-6885-48b9-9c07-4187ead83914 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:39.135193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb1e18-6885-48b9-9c07-4187ead83914 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:39.137523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb1e18-6885-48b9-9c07-4187ead83914 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:39.165999 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 415/825] 10.222.0.39 () {56 vars in 1135 bytes} [Sun Aug 7 00:53:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:39.171639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb1e18-6885-48b9-9c07-4187ead83914 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:39.221687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ae5ff2-3247-45c8-9ada-2a3e7e13f27a None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:39.266981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5ff88-acef-44b3-baf7-e81efb21d528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:39.268134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5ff88-acef-44b3-baf7-e81efb21d528 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:39.268670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5ff88-acef-44b3-baf7-e81efb21d528 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:39.269310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5ff88-acef-44b3-baf7-e81efb21d528 None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:39.270361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5ff88-acef-44b3-baf7-e81efb21d528 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:39.270882 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5ff88-acef-44b3-baf7-e81efb21d528 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:39.273109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5ff88-acef-44b3-baf7-e81efb21d528 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:39.280131 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 411/826] 10.222.0.39 () {56 vars in 1124 bytes} [Sun Aug 7 00:53:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:53:39.287560 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5ff88-acef-44b3-baf7-e81efb21d528 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:39.315475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb1e18-6885-48b9-9c07-4187ead83914 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:39.362672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fda85-fa24-43a5-b713-2ec308c88092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:39.363327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fda85-fa24-43a5-b713-2ec308c88092 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:39.363602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fda85-fa24-43a5-b713-2ec308c88092 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:39.363871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fda85-fa24-43a5-b713-2ec308c88092 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:39.378341 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fda85-fa24-43a5-b713-2ec308c88092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:39.379847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fda85-fa24-43a5-b713-2ec308c88092 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:39.400311 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-a61fda85-fa24-43a5-b713-2ec308c88092 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:39.400311 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:39.400311 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:39.400311 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:39.400311 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:39.400311 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:39.400311 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:39.400311 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:39.400311 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:39.400311 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:39.400311 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:39.400311 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:39.400311 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:39.400311 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:39.400311 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:39.400311 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:39.401354 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:39.401354 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:39.401354 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:39.401354 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:39.401354 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:39.401354 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:39.401354 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:39.401354 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:39.401354 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:39.401354 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:39.401354 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:39.401354 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:39.401354 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:39.401354 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:39.401354 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:39.401354 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:39.401354 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:39.402849 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:39.402849 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:39.402849 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:39.402849 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 416/827] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:53:39.407648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fda85-fa24-43a5-b713-2ec308c88092 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:39.417586 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:39.429977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5ff88-acef-44b3-baf7-e81efb21d528 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:39.438403 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:39.473134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fe36e-022d-4550-8046-d77e9764ee01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:39.474156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fe36e-022d-4550-8046-d77e9764ee01 None admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:39.474643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fe36e-022d-4550-8046-d77e9764ee01 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:39.475268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fe36e-022d-4550-8046-d77e9764ee01 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:39.476240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fe36e-022d-4550-8046-d77e9764ee01 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:39.478071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fe36e-022d-4550-8046-d77e9764ee01 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:39.508931 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 412/828] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 00:53:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:53:39.558028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fda85-fa24-43a5-b713-2ec308c88092 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:39.606140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822a45b-462c-4838-9853-3e7b19fbcc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:39.607665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822a45b-462c-4838-9853-3e7b19fbcc01 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:39.608130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822a45b-462c-4838-9853-3e7b19fbcc01 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:39.608407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822a45b-462c-4838-9853-3e7b19fbcc01 None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:39.609167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822a45b-462c-4838-9853-3e7b19fbcc01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:39.609524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822a45b-462c-4838-9853-3e7b19fbcc01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:39.611041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822a45b-462c-4838-9853-3e7b19fbcc01 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:39.626695 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 417/829] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:53:39.632426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fe36e-022d-4550-8046-d77e9764ee01 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:39.762759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fe36e-022d-4550-8046-d77e9764ee01 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:39.799247 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97d5dd-e247-43c1-83ac-d77d2c24bf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:39.799898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97d5dd-e247-43c1-83ac-d77d2c24bf92 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:39.800251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97d5dd-e247-43c1-83ac-d77d2c24bf92 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:39.800524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97d5dd-e247-43c1-83ac-d77d2c24bf92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:39.807698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97d5dd-e247-43c1-83ac-d77d2c24bf92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:39.809235 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97d5dd-e247-43c1-83ac-d77d2c24bf92 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:39.821416 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-fb97d5dd-e247-43c1-83ac-d77d2c24bf92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:39.821416 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:39.821416 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:39.821416 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:39.821416 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:39.821416 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:39.821416 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:39.821416 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:39.821416 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:39.821416 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:39.821416 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:39.821416 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:39.821416 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:53:39.821416 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:53:39.821416 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:53:39.822444 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:53:39.822444 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:39.822444 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:39.822444 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:39.822444 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:39.822444 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:39.822444 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:39.822444 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:39.822444 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:39.822444 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:39.822444 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:39.822444 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:39.822444 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:39.822444 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:39.822444 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:39.822444 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:39.822444 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:39.823381 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:53:39.823381 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:53:39.823381 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:53:39.823381 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:53:39.823381 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:53:39.823381 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:53:39.823381 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:39.823381 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:39.823381 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 413/830] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:39.830161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822a45b-462c-4838-9853-3e7b19fbcc01 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:39.949767 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:39.995272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822a45b-462c-4838-9853-3e7b19fbcc01 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:40.046693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161786f1-9e83-4c6f-8f26-d3c99bb2b240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:40.047583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161786f1-9e83-4c6f-8f26-d3c99bb2b240 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:40.048022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161786f1-9e83-4c6f-8f26-d3c99bb2b240 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:40.048427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161786f1-9e83-4c6f-8f26-d3c99bb2b240 None admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:40.049599 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161786f1-9e83-4c6f-8f26-d3c99bb2b240 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:40.050051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161786f1-9e83-4c6f-8f26-d3c99bb2b240 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:40.051798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161786f1-9e83-4c6f-8f26-d3c99bb2b240 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:40.070700 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 418/831] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:53:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:40.076984 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97d5dd-e247-43c1-83ac-d77d2c24bf92 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:40.089096 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:40.184871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97d5dd-e247-43c1-83ac-d77d2c24bf92 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:40.220823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e2f31-9695-4915-b857-daad0eb4fd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:40.221489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e2f31-9695-4915-b857-daad0eb4fd9e None admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:40.221762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e2f31-9695-4915-b857-daad0eb4fd9e None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:40.222030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e2f31-9695-4915-b857-daad0eb4fd9e None admin] PATH_INFO: `/v3/projects/1cd2efda8567437e983e3a7867ecd69b/users/fb5a86da594046ed97745371176decf7/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:40.224256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e2f31-9695-4915-b857-daad0eb4fd9e None admin] RBAC: Authorizing `identity:create_grant(project_id=1cd2efda8567437e983e3a7867ecd69b, user_id=fb5a86da594046ed97745371176decf7, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:40.225695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e2f31-9695-4915-b857-daad0eb4fd9e None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:40.242290 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 414/832] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Aug 7 00:53:40 2022] PUT /identity/v3/projects/1cd2efda8567437e983e3a7867ecd69b/users/fb5a86da594046ed97745371176decf7/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:53:40.581227 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072334b6-59ee-41ba-9317-38a443ca0065 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:40.581926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072334b6-59ee-41ba-9317-38a443ca0065 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:40.582441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072334b6-59ee-41ba-9317-38a443ca0065 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:40.584349 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 419/833] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:40.590230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f398981-6527-47d1-9de5-e7ac8c6079c0 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:40.590813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f398981-6527-47d1-9de5-e7ac8c6079c0 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:40.591341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f398981-6527-47d1-9de5-e7ac8c6079c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:40.610323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6f398981-6527-47d1-9de5-e7ac8c6079c0 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:40.611898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6f398981-6527-47d1-9de5-e7ac8c6079c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:40.679339 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:40.690762 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 415/834] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:53:40.711170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072334b6-59ee-41ba-9317-38a443ca0065 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:40.833876 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072334b6-59ee-41ba-9317-38a443ca0065 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:40.872971 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fb37a-5e94-490d-91d7-d65eea0d9d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:40.873711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fb37a-5e94-490d-91d7-d65eea0d9d42 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:40.874042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fb37a-5e94-490d-91d7-d65eea0d9d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:40.874311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fb37a-5e94-490d-91d7-d65eea0d9d42 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:40.876758 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:40.889370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8fb37a-5e94-490d-91d7-d65eea0d9d42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:53:40.896176 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-eb8fb37a-5e94-490d-91d7-d65eea0d9d42 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:40.896176 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:40.896176 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:40.896176 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:40.896176 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:40.896176 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:40.896176 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:40.896176 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:40.896176 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:40.896176 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:40.896176 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:40.896176 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:40.896176 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:53:40.896176 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:53:40.896176 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:53:40.896176 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:53:40.897412 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:53:40.897412 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:53:40.897412 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:53:40.897412 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:53:40.897412 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:40.897412 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:40.897412 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:40.897412 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:40.897412 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:40.897412 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:40.897412 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:40.897412 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:40.897412 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:40.897412 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:40.897412 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:40.897412 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:40.898298 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:40.898298 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:40.898298 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:40.898298 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:40.898298 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:53:40.898298 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:53:40.898298 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:53:40.898298 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:53:40.898298 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:53:40.898298 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:53:40.898298 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:53:40.898298 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:40.898298 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 420/835] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Aug 7 00:53:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:40.904478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f398981-6527-47d1-9de5-e7ac8c6079c0 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:40.909333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d13ac-6cbe-46ba-8279-589f7b0a922d None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:40.909885 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d13ac-6cbe-46ba-8279-589f7b0a922d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:40.910367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d13ac-6cbe-46ba-8279-589f7b0a922d None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:40.912377 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 421/836] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:53:40.917933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb662982-3d64-4c5f-b28c-884dc1205051 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:40.918486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb662982-3d64-4c5f-b28c-884dc1205051 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:40.919003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb662982-3d64-4c5f-b28c-884dc1205051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:40.939875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-bb662982-3d64-4c5f-b28c-884dc1205051 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:40.941607 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bb662982-3d64-4c5f-b28c-884dc1205051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:41.031596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f398981-6527-47d1-9de5-e7ac8c6079c0 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:41.032398 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 422/837] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:53:41.051651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb662982-3d64-4c5f-b28c-884dc1205051 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:41.071327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d59b51-62bd-4363-891a-e39a42cd0d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:41.071980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d59b51-62bd-4363-891a-e39a42cd0d37 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:41.072271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d59b51-62bd-4363-891a-e39a42cd0d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:41.072522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d59b51-62bd-4363-891a-e39a42cd0d37 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:41.073531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d59b51-62bd-4363-891a-e39a42cd0d37 None admin] RBAC: Adding query filter params (name=service) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:41.073832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d59b51-62bd-4363-891a-e39a42cd0d37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:41.075215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d59b51-62bd-4363-891a-e39a42cd0d37 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:41.087376 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 416/838] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Aug 7 00:53:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:53:41.093253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d59b51-62bd-4363-891a-e39a42cd0d37 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:41.164614 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:41.188860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb662982-3d64-4c5f-b28c-884dc1205051 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:41.219702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d59b51-62bd-4363-891a-e39a42cd0d37 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:41.225831 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:41.242425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699148e-1a53-485f-97c8-f528934b290f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:41.243613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699148e-1a53-485f-97c8-f528934b290f None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:41.244090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699148e-1a53-485f-97c8-f528934b290f None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:41.244940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699148e-1a53-485f-97c8-f528934b290f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:41.245700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9699148e-1a53-485f-97c8-f528934b290f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:41.247244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9699148e-1a53-485f-97c8-f528934b290f None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:41.259229 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-9699148e-1a53-485f-97c8-f528934b290f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 00:53:41.259229 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:41.259229 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:53:41.259229 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:53:41.259229 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:53:41.259229 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:53:41.259229 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:53:41.259229 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:41.259229 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 00:53:41.259229 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:41.259229 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:53:41.259229 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:41.259229 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:41.259229 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:41.259229 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:41.259229 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:41.260349 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:41.260349 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:41.260349 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:41.260349 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:41.260349 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:41.260349 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:41.260349 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:41.260349 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:53:41.260349 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:53:41.260349 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:53:41.260349 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:53:41.260349 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:41.260349 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:41.260349 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:41.260349 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:41.260349 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:41.260349 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:41.261243 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:41.261243 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:41.261243 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:41.261243 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:41.261243 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:41.261243 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:41.261243 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:41.261243 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:41.261243 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:41.261243 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:41.261243 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:53:41.261243 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:41.261243 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 00:53:41.261243 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:41.267867 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 423/839] 10.222.0.39 () {56 vars in 1132 bytes} [Sun Aug 7 00:53:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:41.269670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699148e-1a53-485f-97c8-f528934b290f None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:41.280668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3e407-e798-4cd5-b173-3f52cc53da4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:41.281501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3e407-e798-4cd5-b173-3f52cc53da4e None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:41.281686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3e407-e798-4cd5-b173-3f52cc53da4e None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:41.282224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3e407-e798-4cd5-b173-3f52cc53da4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:41.295521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3e407-e798-4cd5-b173-3f52cc53da4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:41.297188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3e407-e798-4cd5-b173-3f52cc53da4e None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:41.314233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-05c3e407-e798-4cd5-b173-3f52cc53da4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:41.314233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:41.314233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:41.314233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:41.314233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:41.314233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:41.314233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:41.314233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:41.314233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:41.314233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:41.314233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:41.314233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:41.314233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:41.314233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:41.314233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:41.314233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:41.315247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:41.315247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:41.315247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:41.315247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:41.315247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:41.315247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:41.315247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:41.315247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:41.315247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:41.315247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:41.315247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:41.315247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:41.315247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:41.315247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:41.315247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:41.315247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:41.315247 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:41.316190 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:41.316190 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:41.316190 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:41.320223 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 417/840] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:41.321674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3e407-e798-4cd5-b173-3f52cc53da4e None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:41.401970 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699148e-1a53-485f-97c8-f528934b290f None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:41.434675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3e407-e798-4cd5-b173-3f52cc53da4e None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:41.446927 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20a99a-3329-4825-863d-a25c94f16b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:41.447987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20a99a-3329-4825-863d-a25c94f16b75 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:41.448493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20a99a-3329-4825-863d-a25c94f16b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:41.448969 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20a99a-3329-4825-863d-a25c94f16b75 None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:41.449846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20a99a-3329-4825-863d-a25c94f16b75 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:41.450394 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:41.450996 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20a99a-3329-4825-863d-a25c94f16b75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:41.453687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20a99a-3329-4825-863d-a25c94f16b75 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:41.465411 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 424/841] 10.222.0.39 () {56 vars in 1126 bytes} [Sun Aug 7 00:53:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:41.467374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20a99a-3329-4825-863d-a25c94f16b75 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:41.474962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4103ba5-b833-4acc-8980-8e5f47761a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:41.475579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4103ba5-b833-4acc-8980-8e5f47761a74 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:41.475858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4103ba5-b833-4acc-8980-8e5f47761a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:41.476155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4103ba5-b833-4acc-8980-8e5f47761a74 None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:41.476873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4103ba5-b833-4acc-8980-8e5f47761a74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:41.477232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4103ba5-b833-4acc-8980-8e5f47761a74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:41.478719 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4103ba5-b833-4acc-8980-8e5f47761a74 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:41.496958 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 418/842] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:41.498556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4103ba5-b833-4acc-8980-8e5f47761a74 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:41.533608 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:41.594803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20a99a-3329-4825-863d-a25c94f16b75 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:41.612590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4103ba5-b833-4acc-8980-8e5f47761a74 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:41.633965 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc9e1f-684f-4f5b-8174-689020201a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:41.635068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc9e1f-684f-4f5b-8174-689020201a19 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:41.635535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc9e1f-684f-4f5b-8174-689020201a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:41.636023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc9e1f-684f-4f5b-8174-689020201a19 None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:41.636886 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc9e1f-684f-4f5b-8174-689020201a19 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:41.637401 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc9e1f-684f-4f5b-8174-689020201a19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:41.639734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc9e1f-684f-4f5b-8174-689020201a19 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:41.650777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c6508-1a06-4c79-a071-a2cd55483445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:41.651431 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 425/843] 10.222.0.39 () {56 vars in 1126 bytes} [Sun Aug 7 00:53:41 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:41.651622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c6508-1a06-4c79-a071-a2cd55483445 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:41.652096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c6508-1a06-4c79-a071-a2cd55483445 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:41.652381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c6508-1a06-4c79-a071-a2cd55483445 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:41.661502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c6508-1a06-4c79-a071-a2cd55483445 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:41.663260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c6508-1a06-4c79-a071-a2cd55483445 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:41.678186 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-ec9c6508-1a06-4c79-a071-a2cd55483445 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:53:41.678186 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:41.678186 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:41.678186 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:41.678186 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:41.678186 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:41.678186 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:41.678186 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:41.678186 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:41.678186 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:41.678186 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:41.678186 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:41.678186 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:53:41.678186 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:53:41.678186 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:53:41.678186 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:53:41.679216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:41.679216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:41.679216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:53:41.679216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:41.679216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:53:41.679216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:41.679216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:41.679216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:41.679216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:41.679216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:41.679216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:41.679216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:41.679216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:41.679216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:41.679216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:41.679216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:41.679216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:41.679216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:41.680214 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:41.680214 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:41.680214 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:53:41.680214 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:53:41.680214 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:53:41.680214 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:53:41.680214 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:53:41.680214 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:53:41.680214 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:53:41.680214 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:41.680960 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 419/844] 10.222.0.39 () {56 vars in 1117 bytes} [Sun Aug 7 00:53:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:53:41.686027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2b2a2-8600-469f-afeb-ff715e516526 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:41.686372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2b2a2-8600-469f-afeb-ff715e516526 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:41.686502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c6508-1a06-4c79-a071-a2cd55483445 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:41.686666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2b2a2-8600-469f-afeb-ff715e516526 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:41.688365 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 426/845] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:41.693905 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1e9da-9bcb-4aaf-8c05-cc4b72c0fb45 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:41.694188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1e9da-9bcb-4aaf-8c05-cc4b72c0fb45 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:41.694472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1e9da-9bcb-4aaf-8c05-cc4b72c0fb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:41.716211 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-fcb1e9da-9bcb-4aaf-8c05-cc4b72c0fb45 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:41.717467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-fcb1e9da-9bcb-4aaf-8c05-cc4b72c0fb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:41.726793 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:41.807852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c6508-1a06-4c79-a071-a2cd55483445 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:41.812047 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 427/846] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:53:41.832939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1e9da-9bcb-4aaf-8c05-cc4b72c0fb45 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:41.860597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdb830-c55b-48d7-859d-dea2c888ccc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:41.861210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdb830-c55b-48d7-859d-dea2c888ccc7 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:41.861489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdb830-c55b-48d7-859d-dea2c888ccc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:41.861779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdb830-c55b-48d7-859d-dea2c888ccc7 None admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:41.862551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdb830-c55b-48d7-859d-dea2c888ccc7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:41.862858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdb830-c55b-48d7-859d-dea2c888ccc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:41.864921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdb830-c55b-48d7-859d-dea2c888ccc7 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:41.888004 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 420/847] 10.222.0.39 () {56 vars in 1149 bytes} [Sun Aug 7 00:53:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:53:41.891803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdb830-c55b-48d7-859d-dea2c888ccc7 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:41.893704 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:41.971921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1e9da-9bcb-4aaf-8c05-cc4b72c0fb45 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:42.015865 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:42.022765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a6580-cf11-4227-9e26-d261a8e8e8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:42.024297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a6580-cf11-4227-9e26-d261a8e8e8ec None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:42.024856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a6580-cf11-4227-9e26-d261a8e8e8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:42.025336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a6580-cf11-4227-9e26-d261a8e8e8ec None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:42.026252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a6580-cf11-4227-9e26-d261a8e8e8ec None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:42.028322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a6580-cf11-4227-9e26-d261a8e8e8ec None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:42.035942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdb830-c55b-48d7-859d-dea2c888ccc7 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:42.040983 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-b08a6580-cf11-4227-9e26-d261a8e8e8ec None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 00:53:42.040983 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:42.040983 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:53:42.040983 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:53:42.040983 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:53:42.040983 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:53:42.040983 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:53:42.040983 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:42.040983 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 00:53:42.040983 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:42.040983 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:53:42.040983 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:42.040983 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:42.040983 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:42.040983 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:42.040983 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:42.040983 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:42.042040 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:42.042040 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:42.042040 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:42.042040 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:42.042040 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:42.042040 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:42.042040 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:53:42.042040 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:53:42.042040 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:53:42.042040 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:53:42.042040 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:42.042040 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:42.042040 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:42.042040 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:42.042040 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:42.042040 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:42.042941 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:42.042941 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:42.042941 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:42.042941 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:42.042941 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:42.042941 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:42.042941 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:42.042941 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:42.042941 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:42.042941 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:42.042941 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:53:42.042941 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:42.042941 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 00:53:42.042941 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:42.051435 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 428/848] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Aug 7 00:53:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:42.052846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a6580-cf11-4227-9e26-d261a8e8e8ec None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:42.077376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791740c-0d5a-46ba-bb48-8929f82eabb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:42.077990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791740c-0d5a-46ba-bb48-8929f82eabb2 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:42.078264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791740c-0d5a-46ba-bb48-8929f82eabb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:42.078530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791740c-0d5a-46ba-bb48-8929f82eabb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:42.175898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791740c-0d5a-46ba-bb48-8929f82eabb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:42.177477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791740c-0d5a-46ba-bb48-8929f82eabb2 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:42.194284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a6580-cf11-4227-9e26-d261a8e8e8ec None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:42.212569 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:42.255474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f771a-5fec-4cf7-9e78-67e1a1b3000a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:42.256379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f771a-5fec-4cf7-9e78-67e1a1b3000a None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:42.257017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f771a-5fec-4cf7-9e78-67e1a1b3000a None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:42.257863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f771a-5fec-4cf7-9e78-67e1a1b3000a None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:42.258784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f771a-5fec-4cf7-9e78-67e1a1b3000a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:42.259359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f771a-5fec-4cf7-9e78-67e1a1b3000a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:42.260921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f771a-5fec-4cf7-9e78-67e1a1b3000a None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:42.267747 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 429/849] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Aug 7 00:53:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:42.273611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f771a-5fec-4cf7-9e78-67e1a1b3000a None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:42.300232 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:42.314131 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 421/850] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:53:41 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:53:42.320369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791740c-0d5a-46ba-bb48-8929f82eabb2 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:42.399381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f771a-5fec-4cf7-9e78-67e1a1b3000a None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:42.440255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0b871-8b18-4333-a7ea-46123b6f797f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:42.441134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0b871-8b18-4333-a7ea-46123b6f797f None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:42.441409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0b871-8b18-4333-a7ea-46123b6f797f None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:42.441676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0b871-8b18-4333-a7ea-46123b6f797f None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:42.442428 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0b871-8b18-4333-a7ea-46123b6f797f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:42.442861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0b871-8b18-4333-a7ea-46123b6f797f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:42.444679 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0b871-8b18-4333-a7ea-46123b6f797f None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:42.455530 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 430/851] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Aug 7 00:53:42 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:53:42.482879 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791740c-0d5a-46ba-bb48-8929f82eabb2 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:42.485450 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189ccbe-b8fd-4c93-b97b-05d06678aa1d None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:42.485778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189ccbe-b8fd-4c93-b97b-05d06678aa1d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:42.486007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189ccbe-b8fd-4c93-b97b-05d06678aa1d None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:42.487709 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 431/852] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:42.493774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70975740-4214-4fa2-8457-1c8bb6ff33d3 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:42.494209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70975740-4214-4fa2-8457-1c8bb6ff33d3 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:42.494582 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70975740-4214-4fa2-8457-1c8bb6ff33d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:42.516325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-70975740-4214-4fa2-8457-1c8bb6ff33d3 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:42.517611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-70975740-4214-4fa2-8457-1c8bb6ff33d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:42.553518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3935c1-d0d1-4515-85aa-2381a02e4fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:42.554987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3935c1-d0d1-4515-85aa-2381a02e4fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:42.555723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3935c1-d0d1-4515-85aa-2381a02e4fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:42.556766 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:42.557112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3935c1-d0d1-4515-85aa-2381a02e4fb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:42.579036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3935c1-d0d1-4515-85aa-2381a02e4fb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:42.582242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3935c1-d0d1-4515-85aa-2381a02e4fb1 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:42.610939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-be3935c1-d0d1-4515-85aa-2381a02e4fb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:42.610939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:42.610939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:42.610939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:42.610939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:42.610939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:42.610939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:42.610939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:42.610939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:42.610939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:42.610939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:42.610939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:42.610939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:42.610939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:42.610939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:42.610939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:42.613293 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:42.613293 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:42.613293 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:42.613293 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:42.613293 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:42.613293 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:42.613293 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:42.613293 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:42.613293 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:42.613293 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:42.613293 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:42.613293 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:42.613293 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:42.613293 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:42.613293 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:42.613293 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:42.613293 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:42.614983 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:42.614983 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:42.614983 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:42.617078 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 432/853] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:53:42.624063 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 422/854] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:53:42.627157 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70975740-4214-4fa2-8457-1c8bb6ff33d3 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:42.655012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3935c1-d0d1-4515-85aa-2381a02e4fb1 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:42.767045 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:42.767294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70975740-4214-4fa2-8457-1c8bb6ff33d3 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:42.837075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2fdbb-cd87-437d-a858-fcc74ebe35ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:42.837707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2fdbb-cd87-437d-a858-fcc74ebe35ef None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:42.838100 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2fdbb-cd87-437d-a858-fcc74ebe35ef None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:42.838373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2fdbb-cd87-437d-a858-fcc74ebe35ef None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:42.839107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2fdbb-cd87-437d-a858-fcc74ebe35ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:42.839445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2fdbb-cd87-437d-a858-fcc74ebe35ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:42.840966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2fdbb-cd87-437d-a858-fcc74ebe35ef None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:42.857340 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 433/855] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:42.865902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2fdbb-cd87-437d-a858-fcc74ebe35ef None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:42.881562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3935c1-d0d1-4515-85aa-2381a02e4fb1 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:42.920971 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:42.931952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24755be0-fb20-4328-8142-c68b1c82b698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:42.931952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24755be0-fb20-4328-8142-c68b1c82b698 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:42.931952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24755be0-fb20-4328-8142-c68b1c82b698 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:42.932325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24755be0-fb20-4328-8142-c68b1c82b698 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:42.949329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24755be0-fb20-4328-8142-c68b1c82b698 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:53:42.956211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-24755be0-fb20-4328-8142-c68b1c82b698 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:53:42.956211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:42.956211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:42.956211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:42.956211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:42.956211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:42.956211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:42.956211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:42.956211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:42.956211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:42.956211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:42.956211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:42.956211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:53:42.956211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:53:42.956211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:53:42.956211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:53:42.957218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:53:42.957218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:53:42.957218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:53:42.957218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:53:42.957218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:42.957218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:42.957218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:42.957218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:42.957218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:42.957218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:42.957218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:42.957218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:42.957218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:42.957218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:42.957218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:42.957218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:42.958089 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:42.958089 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:42.958089 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:42.958089 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:42.958089 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:53:42.958089 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:53:42.958089 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:53:42.958089 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:53:42.958089 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:53:42.958089 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:53:42.958089 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:53:42.958089 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:42.971944 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 423/856] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:53:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:53:42.971944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24755be0-fb20-4328-8142-c68b1c82b698 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:43.049548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2fdbb-cd87-437d-a858-fcc74ebe35ef None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:43.101298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08cd77-8c5b-4a3e-8950-004a8ca8303a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:43.101959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08cd77-8c5b-4a3e-8950-004a8ca8303a None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:43.102482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08cd77-8c5b-4a3e-8950-004a8ca8303a None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:43.102923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08cd77-8c5b-4a3e-8950-004a8ca8303a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:43.112578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08cd77-8c5b-4a3e-8950-004a8ca8303a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:43.114118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08cd77-8c5b-4a3e-8950-004a8ca8303a None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:43.131643 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-be08cd77-8c5b-4a3e-8950-004a8ca8303a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:43.131643 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:43.131643 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:43.131643 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:43.131643 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:43.131643 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:43.131643 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:43.131643 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:43.131643 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:43.131643 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:43.131643 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:43.131643 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:43.131643 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:53:43.131643 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:53:43.131643 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:53:43.132622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:53:43.132622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:43.132622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:43.132622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:43.132622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:43.132622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:43.132622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:43.132622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:43.132622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:43.132622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:43.132622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:43.132622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:43.132622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:43.132622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:43.132622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:43.132622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:43.132622 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:43.133510 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:53:43.133510 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:53:43.133510 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:53:43.133510 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:53:43.133510 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:53:43.133510 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:53:43.133510 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:43.133510 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:43.134461 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 434/857] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:53:43.141424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08cd77-8c5b-4a3e-8950-004a8ca8303a None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:43.157217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24755be0-fb20-4328-8142-c68b1c82b698 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:43.159485 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:43.233933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9117178-6960-4bcc-9d00-a404dfaabee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:43.234926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9117178-6960-4bcc-9d00-a404dfaabee4 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:43.235420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9117178-6960-4bcc-9d00-a404dfaabee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:43.235921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9117178-6960-4bcc-9d00-a404dfaabee4 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:43.237209 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9117178-6960-4bcc-9d00-a404dfaabee4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:43.237741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9117178-6960-4bcc-9d00-a404dfaabee4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:43.240570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9117178-6960-4bcc-9d00-a404dfaabee4 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:43.253164 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 424/858] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:53:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:43.264643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9117178-6960-4bcc-9d00-a404dfaabee4 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:43.268411 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:43.297651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08cd77-8c5b-4a3e-8950-004a8ca8303a None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:43.385949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358435b-7c9d-4884-a989-728dd860382f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:43.387029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358435b-7c9d-4884-a989-728dd860382f None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:43.389212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358435b-7c9d-4884-a989-728dd860382f None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:43.389743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358435b-7c9d-4884-a989-728dd860382f None admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:43.392582 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358435b-7c9d-4884-a989-728dd860382f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:43.393137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358435b-7c9d-4884-a989-728dd860382f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:43.398312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358435b-7c9d-4884-a989-728dd860382f None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:43.424822 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 435/859] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:53:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:43.425188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9117178-6960-4bcc-9d00-a404dfaabee4 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:43.432456 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358435b-7c9d-4884-a989-728dd860382f None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:43.471834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66553a7c-e507-4597-961b-f7579df5e5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:43.472519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66553a7c-e507-4597-961b-f7579df5e5df None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:43.472797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66553a7c-e507-4597-961b-f7579df5e5df None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:43.473192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66553a7c-e507-4597-961b-f7579df5e5df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:43.491762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66553a7c-e507-4597-961b-f7579df5e5df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:43.493848 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66553a7c-e507-4597-961b-f7579df5e5df None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:43.511051 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-66553a7c-e507-4597-961b-f7579df5e5df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:43.511051 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:43.511051 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:43.511051 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:43.511051 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:43.511051 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:43.511051 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:43.511051 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:43.511051 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:43.511051 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:43.511051 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:43.511051 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:43.511051 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:43.511051 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:43.511051 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:43.511051 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:43.512212 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:43.512212 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:43.512212 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:43.512212 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:43.512212 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:43.512212 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:43.512212 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:43.512212 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:43.512212 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:43.512212 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:43.512212 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:43.512212 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:43.512212 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:43.512212 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:43.512212 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:43.512212 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:43.512212 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:43.513166 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:43.513166 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:43.513166 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:43.515553 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 425/860] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:43.524267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66553a7c-e507-4597-961b-f7579df5e5df None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:43.553057 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:43.596811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358435b-7c9d-4884-a989-728dd860382f None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:43.650670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657a9f7-c9ad-4b91-af3d-7fb6dc3bd92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:43.651737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657a9f7-c9ad-4b91-af3d-7fb6dc3bd92f None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:43.652312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657a9f7-c9ad-4b91-af3d-7fb6dc3bd92f None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:43.652881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657a9f7-c9ad-4b91-af3d-7fb6dc3bd92f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:43.654528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657a9f7-c9ad-4b91-af3d-7fb6dc3bd92f None admin] RBAC: Adding query filter params (role.id=af03b67d56b44430ab9d48dcba18ace2, scope.project.id=1cd2efda8567437e983e3a7867ecd69b, user.id=af48a86c031e400982666d661c9f4229) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:43.655047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657a9f7-c9ad-4b91-af3d-7fb6dc3bd92f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:43.656909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657a9f7-c9ad-4b91-af3d-7fb6dc3bd92f None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:43.671199 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 436/861] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:53:43 2022] GET /identity/v3/role_assignments?user.id=af48a86c031e400982666d661c9f4229&scope.project.id=1cd2efda8567437e983e3a7867ecd69b&role.id=af03b67d56b44430ab9d48dcba18ace2 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:43.685414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66553a7c-e507-4597-961b-f7579df5e5df None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:43.724926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665fde4-a79e-414f-965a-963800237413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:43.725554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665fde4-a79e-414f-965a-963800237413 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:43.725833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665fde4-a79e-414f-965a-963800237413 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:43.726107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665fde4-a79e-414f-965a-963800237413 None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:43.726753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665fde4-a79e-414f-965a-963800237413 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:43.727058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665fde4-a79e-414f-965a-963800237413 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:43.728509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665fde4-a79e-414f-965a-963800237413 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:43.743767 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 426/862] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:43.750133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657a9f7-c9ad-4b91-af3d-7fb6dc3bd92f None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:43.770152 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:43.898814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657a9f7-c9ad-4b91-af3d-7fb6dc3bd92f None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:43.944555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772f494-3a9f-469f-91cf-c906494f7d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:43.945130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772f494-3a9f-469f-91cf-c906494f7d16 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:43.945411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772f494-3a9f-469f-91cf-c906494f7d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:43.945683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772f494-3a9f-469f-91cf-c906494f7d16 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:43.955273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772f494-3a9f-469f-91cf-c906494f7d16 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:43.956807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772f494-3a9f-469f-91cf-c906494f7d16 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:43.972808 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-2772f494-3a9f-469f-91cf-c906494f7d16 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:53:43.972808 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:43.972808 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:43.972808 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:43.972808 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:43.972808 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:43.972808 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:43.972808 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:43.972808 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:43.972808 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:43.972808 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:43.972808 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:43.972808 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:53:43.972808 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:53:43.972808 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:53:43.972808 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:53:43.974824 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:43.974824 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:43.974824 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:53:43.974824 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:43.974824 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:53:43.974824 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:43.974824 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:43.974824 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:43.974824 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:43.974824 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:43.974824 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:43.974824 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:43.974824 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:43.974824 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:43.974824 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:43.974824 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:43.974824 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:43.974824 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:43.976838 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:43.976838 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:43.976838 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:53:43.976838 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:53:43.976838 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:53:43.976838 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:53:43.976838 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:53:43.976838 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:53:43.976838 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 07 00:53:43.976838 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:43.976838 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 437/863] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:53:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:43.985658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665fde4-a79e-414f-965a-963800237413 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:44.072140 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:44.079787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeaa95f-bd7c-4f10-a6b7-1668f4e2ac7f None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:44.080094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeaa95f-bd7c-4f10-a6b7-1668f4e2ac7f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:44.080378 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeaa95f-bd7c-4f10-a6b7-1668f4e2ac7f None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:44.083359 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 438/864] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:44.090750 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2db1b-330d-41b1-8a3c-99bbface8353 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:44.092014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2db1b-330d-41b1-8a3c-99bbface8353 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:44.094153 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2db1b-330d-41b1-8a3c-99bbface8353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:44.121627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d8f2db1b-330d-41b1-8a3c-99bbface8353 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:44.123652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d8f2db1b-330d-41b1-8a3c-99bbface8353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:44.126864 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665fde4-a79e-414f-965a-963800237413 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:44.214945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c77a00-de70-47bb-ab11-76867bcc7fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:44.216399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c77a00-de70-47bb-ab11-76867bcc7fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:44.217132 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c77a00-de70-47bb-ab11-76867bcc7fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:44.217927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c77a00-de70-47bb-ab11-76867bcc7fb7 None admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:44.219711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c77a00-de70-47bb-ab11-76867bcc7fb7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:44.220481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c77a00-de70-47bb-ab11-76867bcc7fb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:44.222882 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c77a00-de70-47bb-ab11-76867bcc7fb7 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:44.224588 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 439/865] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:53:44.260177 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 427/866] 10.222.0.39 () {56 vars in 1135 bytes} [Sun Aug 7 00:53:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:44.266654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2db1b-330d-41b1-8a3c-99bbface8353 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:44.269178 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:44.270476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c77a00-de70-47bb-ab11-76867bcc7fb7 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:44.396088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c77a00-de70-47bb-ab11-76867bcc7fb7 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:44.413256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2db1b-330d-41b1-8a3c-99bbface8353 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:44.452799 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9f779-37c1-46c6-b02c-f9299c13370f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:44.453933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9f779-37c1-46c6-b02c-f9299c13370f None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:44.454388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9f779-37c1-46c6-b02c-f9299c13370f None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:44.455269 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9f779-37c1-46c6-b02c-f9299c13370f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:44.458575 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:44.470263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c99f03-35e6-455e-83fc-b4524c2b083b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:44.471214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c99f03-35e6-455e-83fc-b4524c2b083b None admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:44.472049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c99f03-35e6-455e-83fc-b4524c2b083b None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:44.472462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c99f03-35e6-455e-83fc-b4524c2b083b None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:44.473812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c99f03-35e6-455e-83fc-b4524c2b083b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:44.476930 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c99f03-35e6-455e-83fc-b4524c2b083b None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:44.515914 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 440/867] 10.222.0.39 () {60 vars in 1141 bytes} [Sun Aug 7 00:53:44 2022] POST /identity/v3/services => generated 269 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 00:53:44.552381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9f779-37c1-46c6-b02c-f9299c13370f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:44.553895 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9f779-37c1-46c6-b02c-f9299c13370f None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:44.683617 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 428/868] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:53:44 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 00:53:44.689709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c99f03-35e6-455e-83fc-b4524c2b083b None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:44.766885 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:44.788188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8030a-deb7-40c7-8dcb-902b955bc1f9 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:44.788653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8030a-deb7-40c7-8dcb-902b955bc1f9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:44.789106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8030a-deb7-40c7-8dcb-902b955bc1f9 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:44.793390 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 429/869] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:53:44.802698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615194bd-237f-4cde-9aa5-b16c13013df3 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:44.803158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615194bd-237f-4cde-9aa5-b16c13013df3 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:44.803628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615194bd-237f-4cde-9aa5-b16c13013df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:44.835232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-615194bd-237f-4cde-9aa5-b16c13013df3 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:44.837246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-615194bd-237f-4cde-9aa5-b16c13013df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:44.855873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c99f03-35e6-455e-83fc-b4524c2b083b None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:44.873456 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:44.940418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13003402-79e5-40f5-9e76-4799fe587d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:44.941748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13003402-79e5-40f5-9e76-4799fe587d8b None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:44.942381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13003402-79e5-40f5-9e76-4799fe587d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:44.943027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13003402-79e5-40f5-9e76-4799fe587d8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:44.943842 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 430/870] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:44 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:53:44.968171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615194bd-237f-4cde-9aa5-b16c13013df3 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:44.975321 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13003402-79e5-40f5-9e76-4799fe587d8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:44.981408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13003402-79e5-40f5-9e76-4799fe587d8b None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:45.002505 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-13003402-79e5-40f5-9e76-4799fe587d8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:45.002505 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:45.002505 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:45.002505 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:45.002505 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:45.002505 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:45.002505 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:45.002505 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:45.002505 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:45.002505 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:45.002505 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:45.002505 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:45.002505 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:45.002505 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:45.002505 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:45.002505 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:45.003609 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:45.003609 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:45.003609 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:45.003609 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:45.003609 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:45.003609 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:45.003609 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:45.003609 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:45.003609 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:45.003609 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:45.003609 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:45.003609 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:45.003609 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:45.003609 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:45.003609 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:45.003609 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:45.003609 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:45.005056 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:45.005056 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:45.005056 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:45.005056 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 441/871] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:45.011931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13003402-79e5-40f5-9e76-4799fe587d8b None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:45.097088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615194bd-237f-4cde-9aa5-b16c13013df3 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:45.120523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13003402-79e5-40f5-9e76-4799fe587d8b None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:45.131778 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:45.137894 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdaa04-98b3-4586-94ea-9b3f3492eb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:45.138734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdaa04-98b3-4586-94ea-9b3f3492eb5e None admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:45.139226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdaa04-98b3-4586-94ea-9b3f3492eb5e None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:45.139740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdaa04-98b3-4586-94ea-9b3f3492eb5e None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:45.140616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdaa04-98b3-4586-94ea-9b3f3492eb5e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:45.142199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdaa04-98b3-4586-94ea-9b3f3492eb5e None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:45.162863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae68cd-55d3-4a7d-b32f-1f2f22d33fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:45.163848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae68cd-55d3-4a7d-b32f-1f2f22d33fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:45.164358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae68cd-55d3-4a7d-b32f-1f2f22d33fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:45.164785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae68cd-55d3-4a7d-b32f-1f2f22d33fd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:45.165697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae68cd-55d3-4a7d-b32f-1f2f22d33fd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:45.166327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae68cd-55d3-4a7d-b32f-1f2f22d33fd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:45.168365 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 431/872] 10.222.0.39 () {60 vars in 1141 bytes} [Sun Aug 7 00:53:44 2022] POST /identity/v3/services => generated 251 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:53:45.175712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae68cd-55d3-4a7d-b32f-1f2f22d33fd0 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:45.205013 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 442/873] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:53:45.212651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdaa04-98b3-4586-94ea-9b3f3492eb5e None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:45.246719 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:45.368556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdaa04-98b3-4586-94ea-9b3f3492eb5e None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:45.418284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea3aab-f4f0-4da5-8e32-627f16f71eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:45.419983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea3aab-f4f0-4da5-8e32-627f16f71eea None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:45.420490 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea3aab-f4f0-4da5-8e32-627f16f71eea None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:45.420957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea3aab-f4f0-4da5-8e32-627f16f71eea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:45.431628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea3aab-f4f0-4da5-8e32-627f16f71eea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:45.433345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea3aab-f4f0-4da5-8e32-627f16f71eea None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:45.446150 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-80ea3aab-f4f0-4da5-8e32-627f16f71eea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:45.446150 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:45.446150 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:45.446150 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:45.446150 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:45.446150 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:45.446150 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:45.446150 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:45.446150 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:45.446150 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:45.446150 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:45.446150 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:45.446150 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:53:45.446150 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:53:45.446150 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:53:45.447766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:53:45.447766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:45.447766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:45.447766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:45.447766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:45.447766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:45.447766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:45.447766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:45.447766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:45.447766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:45.447766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:45.447766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:45.447766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:45.447766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:45.447766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:45.447766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:45.447766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:45.449593 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:53:45.449593 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:53:45.449593 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:53:45.449593 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:53:45.449593 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:53:45.449593 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:53:45.449593 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:45.449593 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:45.449593 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 432/874] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:45.457811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae68cd-55d3-4a7d-b32f-1f2f22d33fd0 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:45.660083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae68cd-55d3-4a7d-b32f-1f2f22d33fd0 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:45.724824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf78ba0-58c8-4ea0-8021-252bc94ddda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:45.725816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf78ba0-58c8-4ea0-8021-252bc94ddda3 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:45.726248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf78ba0-58c8-4ea0-8021-252bc94ddda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:45.726692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf78ba0-58c8-4ea0-8021-252bc94ddda3 None admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:45.727859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf78ba0-58c8-4ea0-8021-252bc94ddda3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:45.728384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf78ba0-58c8-4ea0-8021-252bc94ddda3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:45.731125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf78ba0-58c8-4ea0-8021-252bc94ddda3 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:45.755746 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 443/875] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:53:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:45.761921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea3aab-f4f0-4da5-8e32-627f16f71eea None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:45.898934 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:45.926103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea3aab-f4f0-4da5-8e32-627f16f71eea None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:45.964249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47061d7-7cbc-4c08-9a2f-39218e4ce279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:45.965222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47061d7-7cbc-4c08-9a2f-39218e4ce279 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:45.965726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47061d7-7cbc-4c08-9a2f-39218e4ce279 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:45.966767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47061d7-7cbc-4c08-9a2f-39218e4ce279 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:45.967799 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47061d7-7cbc-4c08-9a2f-39218e4ce279 None admin] RBAC: Adding query filter params (role.id=695b07606e564668bac7afff4ab6052a, scope.project.id=1cd2efda8567437e983e3a7867ecd69b, user.id=fb5a86da594046ed97745371176decf7) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:45.968371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47061d7-7cbc-4c08-9a2f-39218e4ce279 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:45.970049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47061d7-7cbc-4c08-9a2f-39218e4ce279 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:45.977474 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 433/876] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:53:45 2022] GET /identity/v3/role_assignments?user.id=fb5a86da594046ed97745371176decf7&scope.project.id=1cd2efda8567437e983e3a7867ecd69b&role.id=695b07606e564668bac7afff4ab6052a => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:46.605064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d2e78-2bc8-4f4e-a2bc-18782f93eb6a None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:46.606133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d2e78-2bc8-4f4e-a2bc-18782f93eb6a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:46.606665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703d2e78-2bc8-4f4e-a2bc-18782f93eb6a None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:46.608524 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 444/877] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:46.617528 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872b9df-1ec6-4266-addf-a7c1f86b7d9a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:46.618017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872b9df-1ec6-4266-addf-a7c1f86b7d9a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:46.618502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872b9df-1ec6-4266-addf-a7c1f86b7d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:46.646878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c872b9df-1ec6-4266-addf-a7c1f86b7d9a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:46.648785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c872b9df-1ec6-4266-addf-a7c1f86b7d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:46.728196 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 434/878] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:46 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:53:46.772488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d2e78-2bc8-4f4e-a2bc-18782f93eb6a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:46.819488 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14915d-8ef2-4417-b618-26cd7710d29e None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:46.819826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14915d-8ef2-4417-b618-26cd7710d29e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:46.820084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14915d-8ef2-4417-b618-26cd7710d29e None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:46.821638 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 435/879] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:46.827216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb14ece-9df1-43c3-a071-875d55767c8e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:46.827503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb14ece-9df1-43c3-a071-875d55767c8e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:46.827783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb14ece-9df1-43c3-a071-875d55767c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:46.832290 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:46.847448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ffb14ece-9df1-43c3-a071-875d55767c8e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:46.848687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ffb14ece-9df1-43c3-a071-875d55767c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:46.921120 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 436/880] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:46 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:53:46.944198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb14ece-9df1-43c3-a071-875d55767c8e None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:46.956920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703d2e78-2bc8-4f4e-a2bc-18782f93eb6a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:46.960452 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:47.008768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730bcad-52fe-4f72-8877-fd35718a1a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:47.010495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730bcad-52fe-4f72-8877-fd35718a1a5c None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:47.011292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730bcad-52fe-4f72-8877-fd35718a1a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:47.012159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730bcad-52fe-4f72-8877-fd35718a1a5c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:47.036166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730bcad-52fe-4f72-8877-fd35718a1a5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:53:47.047957 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-3730bcad-52fe-4f72-8877-fd35718a1a5c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 00:53:47.047957 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:47.047957 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:47.047957 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:47.047957 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:47.047957 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:47.047957 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:47.047957 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:47.047957 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:47.047957 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:47.047957 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:47.047957 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:47.047957 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:53:47.047957 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:53:47.047957 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:53:47.047957 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:53:47.049795 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:53:47.049795 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:53:47.049795 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:53:47.049795 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:53:47.049795 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:47.049795 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:47.049795 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:47.049795 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:47.049795 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:47.049795 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:47.049795 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:47.049795 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:47.049795 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:47.049795 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:47.049795 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:47.049795 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:47.051525 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:47.051525 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:47.051525 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:47.051525 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:47.051525 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:53:47.051525 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:53:47.051525 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:53:47.051525 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:53:47.051525 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:53:47.051525 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:53:47.051525 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 00:53:47.051525 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:47.064292 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 445/881] 10.222.0.39 () {56 vars in 1120 bytes} [Sun Aug 7 00:53:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:47.066471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb14ece-9df1-43c3-a071-875d55767c8e None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:47.067927 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730bcad-52fe-4f72-8877-fd35718a1a5c None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:47.105735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf94543-24fc-47c6-aec4-aebd408d1c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:47.106653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf94543-24fc-47c6-aec4-aebd408d1c2b None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:47.107043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf94543-24fc-47c6-aec4-aebd408d1c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:47.107580 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf94543-24fc-47c6-aec4-aebd408d1c2b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:47.108230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf94543-24fc-47c6-aec4-aebd408d1c2b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:47.109971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf94543-24fc-47c6-aec4-aebd408d1c2b None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:47.119911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-4bf94543-24fc-47c6-aec4-aebd408d1c2b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 00:53:47.119911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:47.119911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:53:47.119911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:53:47.119911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:53:47.119911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:53:47.119911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:53:47.119911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:47.119911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 00:53:47.119911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:47.119911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:53:47.119911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:47.119911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:47.119911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:47.119911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:47.119911 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:47.122580 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:47.122580 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:47.122580 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:47.122580 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:47.122580 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:47.122580 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:47.122580 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:47.122580 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:53:47.122580 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:53:47.122580 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:53:47.122580 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:53:47.122580 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:47.122580 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:47.122580 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:47.122580 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:47.122580 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:47.122580 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:47.125081 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:47.125081 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:47.125081 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:47.125081 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:47.125081 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:47.125081 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:47.125081 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:47.125081 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:47.125081 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:47.125081 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:47.125081 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:53:47.125081 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:47.125081 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 00:53:47.125081 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:47.125081 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 437/882] 10.222.0.39 () {56 vars in 1132 bytes} [Sun Aug 7 00:53:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:53:47.129193 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf94543-24fc-47c6-aec4-aebd408d1c2b None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:47.224569 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:47.261743 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:47.281382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730bcad-52fe-4f72-8877-fd35718a1a5c None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:47.299838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf94543-24fc-47c6-aec4-aebd408d1c2b None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:47.346575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a3d81-a5bb-475c-9074-cc6913d4246c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:47.347722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a3d81-a5bb-475c-9074-cc6913d4246c None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:47.348358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a3d81-a5bb-475c-9074-cc6913d4246c None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:47.348803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a3d81-a5bb-475c-9074-cc6913d4246c None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:47.350256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a3d81-a5bb-475c-9074-cc6913d4246c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:47.350771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a3d81-a5bb-475c-9074-cc6913d4246c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:47.354189 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a3d81-a5bb-475c-9074-cc6913d4246c None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:47.364947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f6e96-abef-49ab-bd93-7f0cc73f8aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:47.366043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f6e96-abef-49ab-bd93-7f0cc73f8aea None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:47.366513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f6e96-abef-49ab-bd93-7f0cc73f8aea None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:47.366950 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759f6e96-abef-49ab-bd93-7f0cc73f8aea None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:47.368096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f6e96-abef-49ab-bd93-7f0cc73f8aea None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:47.368613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f6e96-abef-49ab-bd93-7f0cc73f8aea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:47.370996 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759f6e96-abef-49ab-bd93-7f0cc73f8aea None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:47.371781 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 446/883] 10.222.0.39 () {56 vars in 1115 bytes} [Sun Aug 7 00:53:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:53:47.381329 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 438/884] 10.222.0.39 () {56 vars in 1126 bytes} [Sun Aug 7 00:53:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:53:47.385058 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a3d81-a5bb-475c-9074-cc6913d4246c None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:47.387012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f6e96-abef-49ab-bd93-7f0cc73f8aea None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:47.499163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a3d81-a5bb-475c-9074-cc6913d4246c None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:47.505157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759f6e96-abef-49ab-bd93-7f0cc73f8aea None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:47.540140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb392b7e-b0f7-4598-82f2-2df7b66350bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:47.540685 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:47.542125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb392b7e-b0f7-4598-82f2-2df7b66350bc None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:47.542382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb392b7e-b0f7-4598-82f2-2df7b66350bc None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:47.542667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb392b7e-b0f7-4598-82f2-2df7b66350bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:47.547237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994947e-b1aa-4341-8fcc-462a9d1c0843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:47.547991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994947e-b1aa-4341-8fcc-462a9d1c0843 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:47.548431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994947e-b1aa-4341-8fcc-462a9d1c0843 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:47.548682 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994947e-b1aa-4341-8fcc-462a9d1c0843 None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:47.549373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994947e-b1aa-4341-8fcc-462a9d1c0843 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:47.549770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994947e-b1aa-4341-8fcc-462a9d1c0843 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:47.551208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994947e-b1aa-4341-8fcc-462a9d1c0843 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:47.556548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb392b7e-b0f7-4598-82f2-2df7b66350bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:47.558051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb392b7e-b0f7-4598-82f2-2df7b66350bc None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:47.562064 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 439/885] 10.222.0.39 () {56 vars in 1126 bytes} [Sun Aug 7 00:53:47 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:47.563280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994947e-b1aa-4341-8fcc-462a9d1c0843 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:47.580253 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-eb392b7e-b0f7-4598-82f2-2df7b66350bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:47.580253 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:47.580253 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:47.580253 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:47.580253 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:47.580253 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:47.580253 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:47.580253 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:47.580253 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:47.580253 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:47.580253 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:47.580253 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:47.580253 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:47.580253 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:47.580253 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:47.580253 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:47.583250 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:47.583250 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:47.583250 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:47.583250 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:47.583250 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:47.583250 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:47.583250 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:47.583250 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:47.583250 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:47.583250 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:47.583250 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:47.583250 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:47.583250 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:47.583250 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:47.583250 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:47.583250 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:47.583250 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:47.585762 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:47.585762 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:47.585762 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:47.585762 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 447/886] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:47.597323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb392b7e-b0f7-4598-82f2-2df7b66350bc None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:47.604436 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:47.690248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994947e-b1aa-4341-8fcc-462a9d1c0843 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:47.740347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8e775-f067-40c2-a33b-c8b395fc0b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:47.741649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8e775-f067-40c2-a33b-c8b395fc0b11 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:47.741993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8e775-f067-40c2-a33b-c8b395fc0b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:47.742918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8e775-f067-40c2-a33b-c8b395fc0b11 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:47.744001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8e775-f067-40c2-a33b-c8b395fc0b11 None admin] RBAC: Adding query filter params (interface=public, service_id=d40f434c8480403c825a4b4141143309, region_id=RegionOne) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:47.744521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8e775-f067-40c2-a33b-c8b395fc0b11 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:47.746946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8e775-f067-40c2-a33b-c8b395fc0b11 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:47.761072 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 440/887] 10.222.0.39 () {56 vars in 1251 bytes} [Sun Aug 7 00:53:47 2022] GET /identity/v3/endpoints?service_id=d40f434c8480403c825a4b4141143309&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:53:47.764166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0136b-e54b-42f9-938a-5e470b82042c None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:47.764660 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0136b-e54b-42f9-938a-5e470b82042c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:47.765143 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0136b-e54b-42f9-938a-5e470b82042c None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:47.767674 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 441/888] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:47.769138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0136b-e54b-42f9-938a-5e470b82042c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:47.795357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb392b7e-b0f7-4598-82f2-2df7b66350bc None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:47.833244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386412ff-0574-4e12-a074-21e787a37692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:47.833919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386412ff-0574-4e12-a074-21e787a37692 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:47.834264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386412ff-0574-4e12-a074-21e787a37692 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:47.834493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386412ff-0574-4e12-a074-21e787a37692 None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:47.835229 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386412ff-0574-4e12-a074-21e787a37692 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:47.836389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386412ff-0574-4e12-a074-21e787a37692 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:47.836957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386412ff-0574-4e12-a074-21e787a37692 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:47.854903 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 448/889] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:47.856333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a174d-d01b-4add-958c-9ca733107071 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:47.856653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a174d-d01b-4add-958c-9ca733107071 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:47.857288 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a174d-d01b-4add-958c-9ca733107071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:47.876107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ca0a174d-d01b-4add-958c-9ca733107071 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:47.877270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ca0a174d-d01b-4add-958c-9ca733107071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:47.880980 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:47.936916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0136b-e54b-42f9-938a-5e470b82042c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:47.973392 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:47.986130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09a61c-2574-4d39-9552-1649a2b917bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:47.987087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09a61c-2574-4d39-9552-1649a2b917bb None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:47.987550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09a61c-2574-4d39-9552-1649a2b917bb None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:47.988055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09a61c-2574-4d39-9552-1649a2b917bb None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:47.989096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09a61c-2574-4d39-9552-1649a2b917bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:47.991498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09a61c-2574-4d39-9552-1649a2b917bb None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:47.998777 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 449/890] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:47 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:53:47.998777 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a174d-d01b-4add-958c-9ca733107071 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:48.002621 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 442/891] 10.222.0.39 () {56 vars in 1087 bytes} [Sun Aug 7 00:53:47 2022] GET /identity/v3/services => generated 1268 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 00:53:48.020141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09a61c-2574-4d39-9552-1649a2b917bb None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:48.180474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a174d-d01b-4add-958c-9ca733107071 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:48.199927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09a61c-2574-4d39-9552-1649a2b917bb None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:48.246580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ee41d-3e50-4478-ad2b-4286524b5ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:48.247324 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:48.247643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ee41d-3e50-4478-ad2b-4286524b5ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:48.248154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ee41d-3e50-4478-ad2b-4286524b5ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:48.248609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9ee41d-3e50-4478-ad2b-4286524b5ee6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:48.263563 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ee41d-3e50-4478-ad2b-4286524b5ee6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:48.266190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9ee41d-3e50-4478-ad2b-4286524b5ee6 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:48.267733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de96f3-af6a-4135-bfcd-7411249c4b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:48.268750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de96f3-af6a-4135-bfcd-7411249c4b09 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:48.269113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de96f3-af6a-4135-bfcd-7411249c4b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:48.269539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de96f3-af6a-4135-bfcd-7411249c4b09 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:48.271023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de96f3-af6a-4135-bfcd-7411249c4b09 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:48.273176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de96f3-af6a-4135-bfcd-7411249c4b09 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:48.285693 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-5c9ee41d-3e50-4478-ad2b-4286524b5ee6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:53:48.285693 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:48.285693 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:48.285693 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:48.285693 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:48.285693 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:48.285693 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:48.285693 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:48.285693 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:48.285693 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:48.285693 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:48.285693 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:48.285693 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:53:48.285693 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:53:48.285693 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:53:48.285693 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:53:48.286703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:48.286703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:48.286703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:53:48.286703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:48.286703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:53:48.286703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:48.286703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:48.286703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:48.286703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:48.286703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:48.286703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:48.286703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:48.286703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:48.286703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:48.286703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:48.286703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:48.286703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:48.286703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:48.289317 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:48.289317 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:48.289317 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:53:48.289317 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:53:48.289317 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:53:48.289317 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:53:48.289317 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:53:48.289317 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:53:48.289317 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:53:48.289317 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:48.289317 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 450/892] 10.222.0.39 () {56 vars in 1117 bytes} [Sun Aug 7 00:53:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:48.290008 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-75de96f3-af6a-4135-bfcd-7411249c4b09 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 00:53:48.290008 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:48.290008 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:53:48.290008 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:53:48.290008 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:53:48.290008 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:53:48.290008 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:53:48.290008 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:48.290008 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 00:53:48.290008 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:48.290008 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:53:48.290008 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:48.290008 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:48.290008 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:48.290008 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:48.290008 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:48.290008 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:48.290901 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:48.290901 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:48.290901 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:48.290901 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:48.290901 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:48.290901 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:48.290901 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:53:48.290901 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:53:48.290901 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:53:48.290901 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:53:48.290901 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:48.290901 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:48.290901 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:48.290901 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:48.290901 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:48.290901 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:48.291732 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:48.291732 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:48.291732 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:48.291732 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:48.291732 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:48.291732 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:48.291732 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:48.291732 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:48.291732 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:48.291732 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:48.291732 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:53:48.291732 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:48.291732 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 00:53:48.291732 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:48.291732 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 443/893] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Aug 7 00:53:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:48.296776 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ee41d-3e50-4478-ad2b-4286524b5ee6 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:48.300421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de96f3-af6a-4135-bfcd-7411249c4b09 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:48.361622 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:48.433012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de96f3-af6a-4135-bfcd-7411249c4b09 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:48.438533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9ee41d-3e50-4478-ad2b-4286524b5ee6 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:48.471086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062efc4c-0f2b-4d6f-9922-c6d4e9885123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:48.471701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062efc4c-0f2b-4d6f-9922-c6d4e9885123 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:48.472023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062efc4c-0f2b-4d6f-9922-c6d4e9885123 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:48.472292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062efc4c-0f2b-4d6f-9922-c6d4e9885123 None admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:48.473034 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062efc4c-0f2b-4d6f-9922-c6d4e9885123 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:48.473333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062efc4c-0f2b-4d6f-9922-c6d4e9885123 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:48.475341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062efc4c-0f2b-4d6f-9922-c6d4e9885123 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:48.496000 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f864de-4f0c-4d81-b8e8-3284a27b3f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:48.496615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f864de-4f0c-4d81-b8e8-3284a27b3f83 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:48.496896 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f864de-4f0c-4d81-b8e8-3284a27b3f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:48.497235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f864de-4f0c-4d81-b8e8-3284a27b3f83 None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:48.497896 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f864de-4f0c-4d81-b8e8-3284a27b3f83 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:48.498198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f864de-4f0c-4d81-b8e8-3284a27b3f83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:48.499672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f864de-4f0c-4d81-b8e8-3284a27b3f83 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:48.504669 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 444/894] 10.222.0.39 () {56 vars in 1149 bytes} [Sun Aug 7 00:53:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:48.509453 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 451/895] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Aug 7 00:53:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:48.509453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f864de-4f0c-4d81-b8e8-3284a27b3f83 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:48.509715 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb899a27-71b9-4d3f-9e0a-ad27de2e42a8 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:48.509715 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb899a27-71b9-4d3f-9e0a-ad27de2e42a8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:48.509715 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb899a27-71b9-4d3f-9e0a-ad27de2e42a8 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:48.516070 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 445/896] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:48 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:48.517425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb899a27-71b9-4d3f-9e0a-ad27de2e42a8 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:48.579195 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:48.658692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f864de-4f0c-4d81-b8e8-3284a27b3f83 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:48.670545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb899a27-71b9-4d3f-9e0a-ad27de2e42a8 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:48.678945 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:48.709536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01d2db-911a-436d-ae43-e3943e08b4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:48.710539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01d2db-911a-436d-ae43-e3943e08b4c2 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:48.711021 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01d2db-911a-436d-ae43-e3943e08b4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:48.711498 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01d2db-911a-436d-ae43-e3943e08b4c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:48.715267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9330c-aa3f-4225-a9d0-79987eacd7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:48.717008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9330c-aa3f-4225-a9d0-79987eacd7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:48.717484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9330c-aa3f-4225-a9d0-79987eacd7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:48.717931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9330c-aa3f-4225-a9d0-79987eacd7c0 None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:48.718580 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9330c-aa3f-4225-a9d0-79987eacd7c0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:48.718878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9330c-aa3f-4225-a9d0-79987eacd7c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:48.720301 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9330c-aa3f-4225-a9d0-79987eacd7c0 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:48.728959 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 446/897] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Aug 7 00:53:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:48.730091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8fca1-17d4-4407-b553-86dd1a975116 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:48.730375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8fca1-17d4-4407-b553-86dd1a975116 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:48.730649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8fca1-17d4-4407-b553-86dd1a975116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:48.750524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-93e8fca1-17d4-4407-b553-86dd1a975116 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:48.751715 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-93e8fca1-17d4-4407-b553-86dd1a975116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:48.820421 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01d2db-911a-436d-ae43-e3943e08b4c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:48.823204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01d2db-911a-436d-ae43-e3943e08b4c2 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:48.861280 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 447/898] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:53:48.863289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8fca1-17d4-4407-b553-86dd1a975116 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:48.946918 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:49.013830 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 452/899] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:53:48 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:53:49.013830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01d2db-911a-436d-ae43-e3943e08b4c2 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:49.035567 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:49.050707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8fca1-17d4-4407-b553-86dd1a975116 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:49.092725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9884d0d-235d-4b82-8143-76da42e396f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:49.093677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9884d0d-235d-4b82-8143-76da42e396f3 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:49.094138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9884d0d-235d-4b82-8143-76da42e396f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:49.094585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9884d0d-235d-4b82-8143-76da42e396f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:49.095564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9884d0d-235d-4b82-8143-76da42e396f3 None admin] RBAC: Adding query filter params (interface=public, service_id=3c702913a99b4b40bece3319ae027648, region_id=RegionOne) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:49.096112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9884d0d-235d-4b82-8143-76da42e396f3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:49.097706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9884d0d-235d-4b82-8143-76da42e396f3 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:49.103408 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 448/900] 10.222.0.39 () {56 vars in 1251 bytes} [Sun Aug 7 00:53:48 2022] GET /identity/v3/endpoints?service_id=3c702913a99b4b40bece3319ae027648&interface=public®ion_id=RegionOne => generated 194 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:49.104280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9884d0d-235d-4b82-8143-76da42e396f3 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:49.165337 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01d2db-911a-436d-ae43-e3943e08b4c2 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:49.208049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b349a6-c5a7-4110-8bc5-54561a9a6c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:49.209560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b349a6-c5a7-4110-8bc5-54561a9a6c70 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:49.210322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b349a6-c5a7-4110-8bc5-54561a9a6c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:49.210818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b349a6-c5a7-4110-8bc5-54561a9a6c70 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:49.212054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b349a6-c5a7-4110-8bc5-54561a9a6c70 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:49.214635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b349a6-c5a7-4110-8bc5-54561a9a6c70 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:49.232687 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-51b349a6-c5a7-4110-8bc5-54561a9a6c70 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:53:49.232687 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:49.232687 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:53:49.232687 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:53:49.232687 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:53:49.232687 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:53:49.232687 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:53:49.232687 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:49.232687 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:53:49.232687 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:49.232687 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:53:49.232687 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:49.232687 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:49.232687 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:49.232687 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:49.232687 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:49.232687 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:49.233773 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:49.233773 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:49.233773 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:49.233773 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:49.233773 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:49.233773 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:49.233773 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:53:49.233773 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:53:49.233773 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:53:49.233773 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:53:49.233773 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:49.233773 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:49.233773 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:49.233773 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:49.233773 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:49.233773 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:49.234591 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:49.234591 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:49.234591 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:49.234591 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:49.234591 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:49.234591 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:49.234591 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:49.234591 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:49.234591 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:49.234591 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:49.234591 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:53:49.234591 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:49.234591 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:53:49.234591 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:49.235331 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 453/901] 10.222.0.39 () {56 vars in 1126 bytes} [Sun Aug 7 00:53:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:49.236515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b349a6-c5a7-4110-8bc5-54561a9a6c70 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:49.254145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9884d0d-235d-4b82-8143-76da42e396f3 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:49.257483 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:49.306262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08eab53-1fa4-43fd-929a-78a0408b684f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:49.307310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08eab53-1fa4-43fd-929a-78a0408b684f None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:49.307811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08eab53-1fa4-43fd-929a-78a0408b684f None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:49.308346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08eab53-1fa4-43fd-929a-78a0408b684f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:49.322782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08eab53-1fa4-43fd-929a-78a0408b684f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:49.326222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08eab53-1fa4-43fd-929a-78a0408b684f None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:49.365971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-d08eab53-1fa4-43fd-929a-78a0408b684f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:49.365971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:49.365971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:49.365971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:49.365971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:49.365971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:49.365971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:49.365971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:49.365971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:49.365971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:49.365971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:49.365971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:49.365971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:49.365971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:49.365971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:49.365971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:49.367788 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:49.367788 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:49.367788 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:49.367788 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:49.367788 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:49.367788 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:49.367788 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:49.367788 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:49.367788 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:49.367788 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:49.367788 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:49.367788 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:49.367788 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:49.367788 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:49.367788 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:49.367788 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:49.367788 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:49.370112 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:49.370112 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:49.370112 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:49.370112 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 449/902] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:49.370112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08eab53-1fa4-43fd-929a-78a0408b684f None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:49.375503 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:49.401225 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b349a6-c5a7-4110-8bc5-54561a9a6c70 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:49.461545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264efe0b-7df8-4eba-a3aa-a24ed184f329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:49.461894 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264efe0b-7df8-4eba-a3aa-a24ed184f329 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:49.462333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264efe0b-7df8-4eba-a3aa-a24ed184f329 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:49.462772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264efe0b-7df8-4eba-a3aa-a24ed184f329 None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:49.464118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264efe0b-7df8-4eba-a3aa-a24ed184f329 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:49.467653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264efe0b-7df8-4eba-a3aa-a24ed184f329 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:49.479500 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 454/903] 10.222.0.39 () {56 vars in 1087 bytes} [Sun Aug 7 00:53:49 2022] GET /identity/v3/services => generated 1268 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 00:53:49.480980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264efe0b-7df8-4eba-a3aa-a24ed184f329 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:49.537486 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08eab53-1fa4-43fd-929a-78a0408b684f None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:49.582534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5efc2-e88a-402e-bb18-caa703b581b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:49.583484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5efc2-e88a-402e-bb18-caa703b581b6 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:49.583978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5efc2-e88a-402e-bb18-caa703b581b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:49.584433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5efc2-e88a-402e-bb18-caa703b581b6 None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:49.585377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5efc2-e88a-402e-bb18-caa703b581b6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:49.585903 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5efc2-e88a-402e-bb18-caa703b581b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:49.587553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5efc2-e88a-402e-bb18-caa703b581b6 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:49.599009 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 450/904] 10.222.0.39 () {56 vars in 1122 bytes} [Sun Aug 7 00:53:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:49.600413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5efc2-e88a-402e-bb18-caa703b581b6 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:49.630938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264efe0b-7df8-4eba-a3aa-a24ed184f329 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:49.633654 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:49.670256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83e37d-10cc-4b5c-af7d-33c0f5a09416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:49.670910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83e37d-10cc-4b5c-af7d-33c0f5a09416 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:49.671186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83e37d-10cc-4b5c-af7d-33c0f5a09416 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:49.671455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83e37d-10cc-4b5c-af7d-33c0f5a09416 None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:49.672316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83e37d-10cc-4b5c-af7d-33c0f5a09416 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:49.672916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83e37d-10cc-4b5c-af7d-33c0f5a09416 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:49.674331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83e37d-10cc-4b5c-af7d-33c0f5a09416 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:49.692699 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 455/905] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:49.694383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83e37d-10cc-4b5c-af7d-33c0f5a09416 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:49.706595 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:49.737011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5efc2-e88a-402e-bb18-caa703b581b6 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:49.787677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12717701-b648-4c85-aa62-089518c2892b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:49.788961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12717701-b648-4c85-aa62-089518c2892b None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:49.789244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12717701-b648-4c85-aa62-089518c2892b None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:49.789585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12717701-b648-4c85-aa62-089518c2892b None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:49.790245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12717701-b648-4c85-aa62-089518c2892b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:49.790843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12717701-b648-4c85-aa62-089518c2892b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:49.792541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12717701-b648-4c85-aa62-089518c2892b None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:49.801547 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 451/906] 10.222.0.39 () {56 vars in 1122 bytes} [Sun Aug 7 00:53:49 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:49.833777 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83e37d-10cc-4b5c-af7d-33c0f5a09416 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:49.876942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7fd4f-85d9-4a42-b58b-ced4f976229b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:49.877589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7fd4f-85d9-4a42-b58b-ced4f976229b None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:49.877870 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7fd4f-85d9-4a42-b58b-ced4f976229b None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:49.878143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7fd4f-85d9-4a42-b58b-ced4f976229b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:49.886214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7fd4f-85d9-4a42-b58b-ced4f976229b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:49.888285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7fd4f-85d9-4a42-b58b-ced4f976229b None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:49.901572 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-1fd7fd4f-85d9-4a42-b58b-ced4f976229b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:49.901572 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:49.901572 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:49.901572 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:49.901572 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:49.901572 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:49.901572 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:49.901572 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:49.901572 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:49.901572 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:49.901572 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:49.901572 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:49.901572 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:53:49.901572 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:53:49.901572 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:53:49.902552 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:53:49.902552 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:49.902552 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:49.902552 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:49.902552 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:49.902552 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:49.902552 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:49.902552 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:49.902552 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:49.902552 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:49.902552 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:49.902552 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:49.902552 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:49.902552 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:49.902552 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:49.902552 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:49.902552 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:49.903572 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:53:49.903572 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:53:49.903572 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:53:49.903572 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:53:49.903572 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:53:49.903572 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:53:49.903572 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:49.903572 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:49.903572 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 456/907] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:49.917214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12717701-b648-4c85-aa62-089518c2892b None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:50.028459 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:50.042501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12717701-b648-4c85-aa62-089518c2892b None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:50.085836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0072998-4ebc-4287-80af-02b35b71add7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:50.086567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0072998-4ebc-4287-80af-02b35b71add7 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:50.086893 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0072998-4ebc-4287-80af-02b35b71add7 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:50.087218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0072998-4ebc-4287-80af-02b35b71add7 None admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:50.088114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0072998-4ebc-4287-80af-02b35b71add7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:50.088475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0072998-4ebc-4287-80af-02b35b71add7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:50.090312 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0072998-4ebc-4287-80af-02b35b71add7 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:50.111434 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 452/908] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:53:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:50.118558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7fd4f-85d9-4a42-b58b-ced4f976229b None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:50.230022 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:50.296086 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7fd4f-85d9-4a42-b58b-ced4f976229b None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:50.312169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291c0a4-96a4-4707-9c5e-055584525ccf None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:50.312666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291c0a4-96a4-4707-9c5e-055584525ccf None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:50.313148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291c0a4-96a4-4707-9c5e-055584525ccf None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:50.322063 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 453/909] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:50.325761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e4a7b-8d2e-4053-8634-de3a7708b5d0 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:50.326238 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e4a7b-8d2e-4053-8634-de3a7708b5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:50.326713 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e4a7b-8d2e-4053-8634-de3a7708b5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:50.348693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e70be1-0307-4bbf-afe7-3e1ef5dad0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:50.349607 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e70be1-0307-4bbf-afe7-3e1ef5dad0aa None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:50.349892 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e70be1-0307-4bbf-afe7-3e1ef5dad0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:50.350165 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e70be1-0307-4bbf-afe7-3e1ef5dad0aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:50.350951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e70be1-0307-4bbf-afe7-3e1ef5dad0aa None admin] RBAC: Adding query filter params (role.id=e5cdf0e52e1d42efb54f7af9a731d3a5, scope.project.id=1cd2efda8567437e983e3a7867ecd69b, user.id=af48a86c031e400982666d661c9f4229) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:50.353560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e70be1-0307-4bbf-afe7-3e1ef5dad0aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:50.353560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e70be1-0307-4bbf-afe7-3e1ef5dad0aa None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:50.360261 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 457/910] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:53:50 2022] GET /identity/v3/role_assignments?user.id=af48a86c031e400982666d661c9f4229&scope.project.id=1cd2efda8567437e983e3a7867ecd69b&role.id=e5cdf0e52e1d42efb54f7af9a731d3a5 => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:50.360869 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d41e4a7b-8d2e-4053-8634-de3a7708b5d0 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:50.363117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d41e4a7b-8d2e-4053-8634-de3a7708b5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:50.460569 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 454/911] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:50 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:53:50.484350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e70be1-0307-4bbf-afe7-3e1ef5dad0aa None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:50.607104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e70be1-0307-4bbf-afe7-3e1ef5dad0aa None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:50.637999 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:50.644617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483f08f-53d0-4c12-aa34-61eb1098db1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:50.645262 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483f08f-53d0-4c12-aa34-61eb1098db1e None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:50.645576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483f08f-53d0-4c12-aa34-61eb1098db1e None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:50.645853 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483f08f-53d0-4c12-aa34-61eb1098db1e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:50.646457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483f08f-53d0-4c12-aa34-61eb1098db1e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:50.648113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483f08f-53d0-4c12-aa34-61eb1098db1e None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:50.657748 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-4483f08f-53d0-4c12-aa34-61eb1098db1e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 00:53:50.657748 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:50.657748 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:53:50.657748 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:53:50.657748 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:53:50.657748 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:53:50.657748 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:53:50.657748 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:50.657748 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 00:53:50.657748 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:50.657748 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:53:50.657748 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:50.657748 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:50.657748 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:50.657748 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:50.657748 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:50.658756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:50.658756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:50.658756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:50.658756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:50.658756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:50.658756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:50.658756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:50.658756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:53:50.658756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:53:50.658756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:53:50.658756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:53:50.658756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:50.658756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:50.658756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:50.658756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:50.658756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:50.658756 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:50.659852 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:50.659852 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:50.659852 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:50.659852 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:50.659852 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:50.659852 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:50.659852 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:50.659852 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:50.659852 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:50.659852 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:50.659852 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:53:50.659852 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:50.659852 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 07 00:53:50.659852 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:50.659852 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 458/912] 10.222.0.39 () {56 vars in 1132 bytes} [Sun Aug 7 00:53:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:50.667380 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e4a7b-8d2e-4053-8634-de3a7708b5d0 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:50.748779 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:50.784143 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e4a7b-8d2e-4053-8634-de3a7708b5d0 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:50.822877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2b722-c82c-4a8f-bbbc-f98ae720fca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:50.823539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2b722-c82c-4a8f-bbbc-f98ae720fca0 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:50.823814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2b722-c82c-4a8f-bbbc-f98ae720fca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:50.824116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2b722-c82c-4a8f-bbbc-f98ae720fca0 None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:50.824767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2b722-c82c-4a8f-bbbc-f98ae720fca0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:50.825656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2b722-c82c-4a8f-bbbc-f98ae720fca0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:50.827111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2b722-c82c-4a8f-bbbc-f98ae720fca0 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:50.833245 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 455/913] 10.222.0.39 () {56 vars in 1126 bytes} [Sun Aug 7 00:53:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:50.841146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483f08f-53d0-4c12-aa34-61eb1098db1e None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:50.961204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483f08f-53d0-4c12-aa34-61eb1098db1e None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:51.006103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975deee-b4a9-4ac6-a51c-f43c525a14d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:51.006744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975deee-b4a9-4ac6-a51c-f43c525a14d9 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:51.007028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975deee-b4a9-4ac6-a51c-f43c525a14d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:51.007332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975deee-b4a9-4ac6-a51c-f43c525a14d9 None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:51.008050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975deee-b4a9-4ac6-a51c-f43c525a14d9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:51.008360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975deee-b4a9-4ac6-a51c-f43c525a14d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:51.009783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975deee-b4a9-4ac6-a51c-f43c525a14d9 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:51.015937 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 459/914] 10.222.0.39 () {56 vars in 1126 bytes} [Sun Aug 7 00:53:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:51.022406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2b722-c82c-4a8f-bbbc-f98ae720fca0 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:51.167022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2b722-c82c-4a8f-bbbc-f98ae720fca0 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:51.204142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d01cb-53a0-4c07-a567-5b7914edc25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:51.204763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d01cb-53a0-4c07-a567-5b7914edc25c None admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:51.205036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d01cb-53a0-4c07-a567-5b7914edc25c None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:51.205305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d01cb-53a0-4c07-a567-5b7914edc25c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:51.206014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d01cb-53a0-4c07-a567-5b7914edc25c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:51.207380 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d01cb-53a0-4c07-a567-5b7914edc25c None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:51.217573 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:51.233063 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 456/915] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 00:53:51 2022] POST /identity/v3/endpoints => generated 347 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:53:51.970064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f9bee-48f8-45af-81a9-6f52f49ff4c1 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:51.970609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f9bee-48f8-45af-81a9-6f52f49ff4c1 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:51.970922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f9bee-48f8-45af-81a9-6f52f49ff4c1 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:51.973298 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 460/916] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:51.980441 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cf9ac-1696-4748-a045-1f0c7b070e0a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:51.980957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cf9ac-1696-4748-a045-1f0c7b070e0a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:51.980957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cf9ac-1696-4748-a045-1f0c7b070e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:52.001364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0f1cf9ac-1696-4748-a045-1f0c7b070e0a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:52.002571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0f1cf9ac-1696-4748-a045-1f0c7b070e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:52.113756 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 457/917] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:51 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:53:52.139662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f9bee-48f8-45af-81a9-6f52f49ff4c1 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:52.153794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45903d32-aa52-4b47-bc2f-999a2794aa9d None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:52.154805 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45903d32-aa52-4b47-bc2f-999a2794aa9d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:52.155595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45903d32-aa52-4b47-bc2f-999a2794aa9d None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:52.158227 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 458/918] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:52.164381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e6c54-3b4c-4a0f-9bae-6b527bf95e75 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:52.164991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e6c54-3b4c-4a0f-9bae-6b527bf95e75 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:52.165491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e6c54-3b4c-4a0f-9bae-6b527bf95e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:52.186366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c11e6c54-3b4c-4a0f-9bae-6b527bf95e75 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:52.188106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c11e6c54-3b4c-4a0f-9bae-6b527bf95e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:52.253640 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:52.312292 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 459/919] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:52 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:53:52.319375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f9bee-48f8-45af-81a9-6f52f49ff4c1 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:52.340101 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e6c54-3b4c-4a0f-9bae-6b527bf95e75 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:52.393746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a73ef-41ce-4bd6-b479-037186566ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:52.395338 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a73ef-41ce-4bd6-b479-037186566ece None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:52.396015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a73ef-41ce-4bd6-b479-037186566ece None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:52.396671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a73ef-41ce-4bd6-b479-037186566ece None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:52.398102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a73ef-41ce-4bd6-b479-037186566ece None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:52.399921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a73ef-41ce-4bd6-b479-037186566ece None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:52.411718 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-719a73ef-41ce-4bd6-b479-037186566ece None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 00:53:52.411718 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:52.411718 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:53:52.411718 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:53:52.411718 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:53:52.411718 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:53:52.411718 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:53:52.411718 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:52.411718 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 00:53:52.411718 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:52.411718 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:53:52.411718 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:52.411718 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:52.411718 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:52.411718 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:52.411718 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:52.411718 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:52.413488 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:52.413488 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:52.413488 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:52.413488 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:52.413488 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:52.413488 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:52.413488 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:53:52.413488 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:53:52.413488 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:53:52.413488 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:53:52.413488 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:52.413488 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:52.413488 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:52.413488 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:52.413488 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:52.413488 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:52.415000 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:52.415000 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:52.415000 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:52.415000 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:52.415000 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:52.415000 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:52.415000 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:52.415000 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:52.415000 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:52.415000 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:52.415000 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:53:52.415000 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:52.415000 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 07 00:53:52.415000 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:52.418726 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:52.419869 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 461/920] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Aug 7 00:53:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:52.431485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a73ef-41ce-4bd6-b479-037186566ece None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:52.484335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e6c54-3b4c-4a0f-9bae-6b527bf95e75 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:52.538354 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f4499-d5c3-43e6-8ef8-042b14a71b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:52.539397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f4499-d5c3-43e6-8ef8-042b14a71b6d None admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:52.540154 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f4499-d5c3-43e6-8ef8-042b14a71b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:52.540798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f4499-d5c3-43e6-8ef8-042b14a71b6d None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:52.541754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f4499-d5c3-43e6-8ef8-042b14a71b6d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:52.544859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f4499-d5c3-43e6-8ef8-042b14a71b6d None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:52.576030 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 460/921] 10.222.0.39 () {60 vars in 1141 bytes} [Sun Aug 7 00:53:52 2022] POST /identity/v3/services => generated 241 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 00:53:52.597788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a73ef-41ce-4bd6-b479-037186566ece None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:52.636118 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:52.637469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1e032-dbc9-4e30-b73e-cd9645a9d40d None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:52.637848 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1e032-dbc9-4e30-b73e-cd9645a9d40d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:52.638152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1e032-dbc9-4e30-b73e-cd9645a9d40d None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:52.640076 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 461/922] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:52.647841 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929955a5-b75e-476b-ab25-527add58d872 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:52.648333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929955a5-b75e-476b-ab25-527add58d872 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:52.648821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929955a5-b75e-476b-ab25-527add58d872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:52.655812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b145300-0c45-487e-b0dc-d92fbc692873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:52.656496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b145300-0c45-487e-b0dc-d92fbc692873 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:52.656758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b145300-0c45-487e-b0dc-d92fbc692873 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:52.657028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b145300-0c45-487e-b0dc-d92fbc692873 None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:52.657738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b145300-0c45-487e-b0dc-d92fbc692873 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:52.658038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b145300-0c45-487e-b0dc-d92fbc692873 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:52.660404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b145300-0c45-487e-b0dc-d92fbc692873 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:52.670841 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 462/923] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Aug 7 00:53:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:52.676852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b145300-0c45-487e-b0dc-d92fbc692873 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:52.684011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-929955a5-b75e-476b-ab25-527add58d872 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:52.686149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-929955a5-b75e-476b-ab25-527add58d872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:52.821179 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 462/924] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:53:52.851548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929955a5-b75e-476b-ab25-527add58d872 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:52.858785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b145300-0c45-487e-b0dc-d92fbc692873 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:52.912443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15591a17-08fe-45f6-abf5-951adb61c61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:52.913405 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15591a17-08fe-45f6-abf5-951adb61c61b None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:52.913860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15591a17-08fe-45f6-abf5-951adb61c61b None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:52.914309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15591a17-08fe-45f6-abf5-951adb61c61b None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:52.915284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15591a17-08fe-45f6-abf5-951adb61c61b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:52.916632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15591a17-08fe-45f6-abf5-951adb61c61b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:52.919594 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:52.919930 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15591a17-08fe-45f6-abf5-951adb61c61b None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:52.930976 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 463/925] 10.222.0.39 () {56 vars in 1114 bytes} [Sun Aug 7 00:53:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:52.937253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15591a17-08fe-45f6-abf5-951adb61c61b None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:53.006660 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:53.026759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929955a5-b75e-476b-ab25-527add58d872 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:53.069357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2d110-db19-4fcc-ba37-7d4b029171a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:53.070525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2d110-db19-4fcc-ba37-7d4b029171a0 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:53.071122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2d110-db19-4fcc-ba37-7d4b029171a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:53.071701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2d110-db19-4fcc-ba37-7d4b029171a0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:53.074446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15591a17-08fe-45f6-abf5-951adb61c61b None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:53.085000 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c2d110-db19-4fcc-ba37-7d4b029171a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:53:53.090091 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-b6c2d110-db19-4fcc-ba37-7d4b029171a0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 00:53:53.090091 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:53.090091 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:53.090091 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:53.090091 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:53.090091 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:53.090091 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:53.090091 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:53.090091 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:53.090091 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:53.090091 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:53.090091 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:53.090091 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:53:53.090091 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:53:53.090091 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:53:53.090091 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:53:53.091871 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:53:53.091871 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:53:53.091871 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:53:53.091871 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:53:53.091871 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:53.091871 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:53.091871 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:53.091871 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:53.091871 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:53.091871 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:53.091871 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:53.091871 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:53.091871 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:53.091871 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:53.091871 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:53.091871 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:53.092960 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:53.092960 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:53.092960 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:53.092960 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:53.092960 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:53:53.092960 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:53:53.092960 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:53:53.092960 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:53:53.092960 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:53:53.092960 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:53:53.092960 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 00:53:53.092960 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:53.095150 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 463/926] 10.222.0.39 () {56 vars in 1120 bytes} [Sun Aug 7 00:53:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:53:53.101001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2d110-db19-4fcc-ba37-7d4b029171a0 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:53.118666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56253f4-3ac8-4c7b-96ae-0813d1a07ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:53.119569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56253f4-3ac8-4c7b-96ae-0813d1a07ab2 None admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:53.120030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56253f4-3ac8-4c7b-96ae-0813d1a07ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:53.120353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56253f4-3ac8-4c7b-96ae-0813d1a07ab2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:53.121040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56253f4-3ac8-4c7b-96ae-0813d1a07ab2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:53.123084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56253f4-3ac8-4c7b-96ae-0813d1a07ab2 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:53.158234 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 464/927] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 00:53:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:53:53.240371 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:53.243610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2d110-db19-4fcc-ba37-7d4b029171a0 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:53.292886 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6e94e-bf42-417e-b51a-5a7035d36793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:53.293515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6e94e-bf42-417e-b51a-5a7035d36793 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:53.293860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6e94e-bf42-417e-b51a-5a7035d36793 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:53.294129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd6e94e-bf42-417e-b51a-5a7035d36793 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:53.294828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6e94e-bf42-417e-b51a-5a7035d36793 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:53.295192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6e94e-bf42-417e-b51a-5a7035d36793 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:53.296646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd6e94e-bf42-417e-b51a-5a7035d36793 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:53.309076 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 464/928] 10.222.0.39 () {56 vars in 1115 bytes} [Sun Aug 7 00:53:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:53.315282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56253f4-3ac8-4c7b-96ae-0813d1a07ab2 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:53.436318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56253f4-3ac8-4c7b-96ae-0813d1a07ab2 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:53.438186 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:53.478125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ae335-1636-4a9b-806b-bd923cda104f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:53.478768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ae335-1636-4a9b-806b-bd923cda104f None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:53.479041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ae335-1636-4a9b-806b-bd923cda104f None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:53.479336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ae335-1636-4a9b-806b-bd923cda104f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:53.492029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ae335-1636-4a9b-806b-bd923cda104f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:53.493557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ae335-1636-4a9b-806b-bd923cda104f None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:53.508988 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-aa4ae335-1636-4a9b-806b-bd923cda104f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:53.508988 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:53.508988 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:53.508988 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:53.508988 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:53.508988 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:53.508988 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:53.508988 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:53.508988 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:53.508988 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:53.508988 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:53.508988 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:53.508988 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:53.508988 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:53.508988 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:53.508988 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:53.509997 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:53.509997 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:53.509997 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:53.509997 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:53.509997 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:53.509997 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:53.509997 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:53.509997 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:53.509997 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:53.509997 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:53.509997 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:53.509997 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:53.509997 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:53.509997 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:53.509997 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:53.509997 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:53.509997 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:53.510886 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:53.510886 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:53.510886 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:53.510886 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 465/929] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:53.516951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6e94e-bf42-417e-b51a-5a7035d36793 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:53.627768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd6e94e-bf42-417e-b51a-5a7035d36793 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:53.671665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a5afd-5fe1-4266-92a3-ab50b0be0941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:53.672324 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a5afd-5fe1-4266-92a3-ab50b0be0941 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:53.672611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a5afd-5fe1-4266-92a3-ab50b0be0941 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:53.672852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a5afd-5fe1-4266-92a3-ab50b0be0941 None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:53.673520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a5afd-5fe1-4266-92a3-ab50b0be0941 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:53.673821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a5afd-5fe1-4266-92a3-ab50b0be0941 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:53.675226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a5afd-5fe1-4266-92a3-ab50b0be0941 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:53.689780 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 465/930] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:53.695234 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ae335-1636-4a9b-806b-bd923cda104f None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:53.842953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ae335-1636-4a9b-806b-bd923cda104f None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:53.897836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2e03a-dfa7-480d-954c-735d6cb6a99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:53.899087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2e03a-dfa7-480d-954c-735d6cb6a99a None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:53.899859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2e03a-dfa7-480d-954c-735d6cb6a99a None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:53.900572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2e03a-dfa7-480d-954c-735d6cb6a99a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:53.904156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0e14c-8055-4622-9244-03cd46acadd0 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:53.904445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0e14c-8055-4622-9244-03cd46acadd0 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:53.904946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0e14c-8055-4622-9244-03cd46acadd0 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:53.910486 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 466/931] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:53:53.912358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd347d3-acb2-4fbb-a59b-076a11158e62 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:53.912638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd347d3-acb2-4fbb-a59b-076a11158e62 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:53.912908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd347d3-acb2-4fbb-a59b-076a11158e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:53.915692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b2e03a-dfa7-480d-954c-735d6cb6a99a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:53.918744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b2e03a-dfa7-480d-954c-735d6cb6a99a None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:53.933102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-afd347d3-acb2-4fbb-a59b-076a11158e62 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:53.934973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-afd347d3-acb2-4fbb-a59b-076a11158e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:53.941876 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-57b2e03a-dfa7-480d-954c-735d6cb6a99a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:53:53.941876 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:53.941876 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:53.941876 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:53.941876 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:53.941876 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:53.941876 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:53.941876 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:53.941876 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:53.941876 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:53.941876 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:53.941876 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:53.941876 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:53:53.941876 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:53:53.941876 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:53:53.941876 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:53:53.943536 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:53.943536 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:53.943536 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:53:53.943536 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:53.943536 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:53:53.943536 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:53.943536 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:53.943536 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:53.943536 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:53.943536 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:53.943536 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:53.943536 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:53.943536 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:53.943536 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:53.943536 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:53.943536 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:53.943536 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:53.943536 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:53.945298 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:53.945298 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:53.945298 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:53:53.945298 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:53:53.945298 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:53:53.945298 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:53:53.945298 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:53:53.945298 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:53:53.945298 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:53:53.945298 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:53.949274 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 466/932] 10.222.0.39 () {56 vars in 1117 bytes} [Sun Aug 7 00:53:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:53:53.955766 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2e03a-dfa7-480d-954c-735d6cb6a99a None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:53.957258 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:53.980377 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:54.114298 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 467/933] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:53:54.141329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd347d3-acb2-4fbb-a59b-076a11158e62 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:54.186039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2e03a-dfa7-480d-954c-735d6cb6a99a None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:54.246124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3084a-42a6-430e-b5bb-8ec35023bf11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:54.246695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3084a-42a6-430e-b5bb-8ec35023bf11 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:54.247511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3084a-42a6-430e-b5bb-8ec35023bf11 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:54.247813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3084a-42a6-430e-b5bb-8ec35023bf11 None admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:54.249460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3084a-42a6-430e-b5bb-8ec35023bf11 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:54.249765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3084a-42a6-430e-b5bb-8ec35023bf11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:54.251255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3084a-42a6-430e-b5bb-8ec35023bf11 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:54.282964 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 467/934] 10.222.0.39 () {56 vars in 1149 bytes} [Sun Aug 7 00:53:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:53:54.285041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3084a-42a6-430e-b5bb-8ec35023bf11 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:54.286728 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd347d3-acb2-4fbb-a59b-076a11158e62 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:54.328873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d81bf-36c1-4e3f-9db7-2dfe5136b25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:54.329948 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d81bf-36c1-4e3f-9db7-2dfe5136b25c None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:54.330572 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d81bf-36c1-4e3f-9db7-2dfe5136b25c None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:54.331091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d81bf-36c1-4e3f-9db7-2dfe5136b25c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:54.332060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d81bf-36c1-4e3f-9db7-2dfe5136b25c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:54.333780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d81bf-36c1-4e3f-9db7-2dfe5136b25c None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:54.344486 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-143d81bf-36c1-4e3f-9db7-2dfe5136b25c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 00:53:54.344486 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:54.344486 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:53:54.344486 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:53:54.344486 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:53:54.344486 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:53:54.344486 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:53:54.344486 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:54.344486 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 00:53:54.344486 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:54.344486 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:53:54.344486 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:54.344486 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:54.344486 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:54.344486 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:54.344486 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:54.344486 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:54.345572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:54.345572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:54.345572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:54.345572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:54.345572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:54.345572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:54.345572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:53:54.345572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:53:54.345572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:53:54.345572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:53:54.345572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:54.345572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:54.345572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:54.345572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:54.345572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:54.345572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:54.346427 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:54.346427 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:54.346427 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:54.346427 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:54.346427 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:54.346427 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:54.346427 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:54.346427 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:54.346427 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:54.346427 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:54.346427 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:53:54.346427 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:54.346427 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 00:53:54.346427 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:54.354850 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 468/935] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:54.357398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d81bf-36c1-4e3f-9db7-2dfe5136b25c None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:54.377687 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:54.418283 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:54.469586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3084a-42a6-430e-b5bb-8ec35023bf11 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:54.522311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1e11e-0752-4762-8b2b-461102ed3e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:54.523674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1e11e-0752-4762-8b2b-461102ed3e5a None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:54.524250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1e11e-0752-4762-8b2b-461102ed3e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:54.524875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1e11e-0752-4762-8b2b-461102ed3e5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:54.542107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1e11e-0752-4762-8b2b-461102ed3e5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:54.544851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e1e11e-0752-4762-8b2b-461102ed3e5a None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:54.562744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d81bf-36c1-4e3f-9db7-2dfe5136b25c None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:54.564222 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-a9e1e11e-0752-4762-8b2b-461102ed3e5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:54.564222 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:54.564222 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:54.564222 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:54.564222 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:54.564222 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:54.564222 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:54.564222 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:54.564222 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:54.564222 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:54.564222 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:54.564222 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:54.564222 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:54.564222 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:54.564222 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:54.564222 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:54.565195 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:54.565195 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:54.565195 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:54.565195 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:54.565195 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:54.565195 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:54.565195 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:54.565195 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:54.565195 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:54.565195 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:54.565195 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:54.565195 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:54.565195 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:54.565195 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:54.565195 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:54.565195 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:54.565195 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:54.566601 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:54.566601 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:54.566601 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:54.575873 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 468/936] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:53:54.579172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1e11e-0752-4762-8b2b-461102ed3e5a None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:54.622448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef3366-f56c-413b-94a4-37b5c123a9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:54.623584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef3366-f56c-413b-94a4-37b5c123a9d2 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:54.624051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef3366-f56c-413b-94a4-37b5c123a9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:54.624464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef3366-f56c-413b-94a4-37b5c123a9d2 None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:54.625665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef3366-f56c-413b-94a4-37b5c123a9d2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:54.626129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef3366-f56c-413b-94a4-37b5c123a9d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:54.628905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef3366-f56c-413b-94a4-37b5c123a9d2 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:54.643922 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 469/937] 10.222.0.39 () {56 vars in 1112 bytes} [Sun Aug 7 00:53:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:54.649683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef3366-f56c-413b-94a4-37b5c123a9d2 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:54.771696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1e11e-0752-4762-8b2b-461102ed3e5a None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:54.780424 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:54.808131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef3366-f56c-413b-94a4-37b5c123a9d2 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:54.818711 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:54.838590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654165d-9ddd-4116-80f3-8019f8bff974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:54.840076 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654165d-9ddd-4116-80f3-8019f8bff974 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:54.841542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654165d-9ddd-4116-80f3-8019f8bff974 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:54.842392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654165d-9ddd-4116-80f3-8019f8bff974 None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:54.844200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654165d-9ddd-4116-80f3-8019f8bff974 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:54.845217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654165d-9ddd-4116-80f3-8019f8bff974 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:54.848478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654165d-9ddd-4116-80f3-8019f8bff974 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:54.854215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec01ad-4f63-4073-b5b7-90a97fdc4b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:54.854842 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec01ad-4f63-4073-b5b7-90a97fdc4b76 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:54.855169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec01ad-4f63-4073-b5b7-90a97fdc4b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:54.855445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec01ad-4f63-4073-b5b7-90a97fdc4b76 None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:54.856146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec01ad-4f63-4073-b5b7-90a97fdc4b76 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:54.856973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec01ad-4f63-4073-b5b7-90a97fdc4b76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:54.858419 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec01ad-4f63-4073-b5b7-90a97fdc4b76 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:54.868249 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 470/938] 10.222.0.39 () {56 vars in 1112 bytes} [Sun Aug 7 00:53:54 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:54.879401 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 469/939] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:54.887301 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec01ad-4f63-4073-b5b7-90a97fdc4b76 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:55.073771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec01ad-4f63-4073-b5b7-90a97fdc4b76 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:55.081948 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02336c3b-ecd1-445d-aaf4-f10ca847cd98 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:55.082230 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02336c3b-ecd1-445d-aaf4-f10ca847cd98 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:55.082552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02336c3b-ecd1-445d-aaf4-f10ca847cd98 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:55.084289 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 470/940] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:55.089789 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8faff-abde-44bc-9402-a28d7b899bcf None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:55.090151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8faff-abde-44bc-9402-a28d7b899bcf None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:55.091475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8faff-abde-44bc-9402-a28d7b899bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:55.115640 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-40b8faff-abde-44bc-9402-a28d7b899bcf None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:55.117239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-40b8faff-abde-44bc-9402-a28d7b899bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:55.129792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cb8ac-d977-4782-add0-e84e627928be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:55.130683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cb8ac-d977-4782-add0-e84e627928be None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:55.131091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cb8ac-d977-4782-add0-e84e627928be None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:55.131843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cb8ac-d977-4782-add0-e84e627928be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:55.143464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cb8ac-d977-4782-add0-e84e627928be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:55.145968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9cb8ac-d977-4782-add0-e84e627928be None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:55.150915 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:55.169237 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-8d9cb8ac-d977-4782-add0-e84e627928be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:55.169237 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:55.169237 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:55.169237 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:55.169237 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:55.169237 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:55.169237 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:55.169237 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:55.169237 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:55.169237 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:55.169237 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:55.169237 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:55.169237 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:53:55.169237 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:53:55.169237 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:53:55.170379 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:53:55.170379 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:55.170379 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:55.170379 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:55.170379 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:55.170379 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:55.170379 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:55.170379 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:55.170379 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:55.170379 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:55.170379 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:55.170379 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:55.170379 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:55.170379 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:55.170379 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:55.170379 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:55.170379 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:55.171357 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:53:55.171357 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:53:55.171357 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:53:55.171357 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:53:55.171357 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:53:55.171357 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:53:55.171357 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:55.171357 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:55.176073 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 471/941] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:55.180545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cb8ac-d977-4782-add0-e84e627928be None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:55.224558 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 471/942] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:53:55.254928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8faff-abde-44bc-9402-a28d7b899bcf None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:55.349711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cb8ac-d977-4782-add0-e84e627928be None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:55.408587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09be89-b006-4ea3-a23f-c9ecfbf7fbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:55.409651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09be89-b006-4ea3-a23f-c9ecfbf7fbbd None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:55.410154 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09be89-b006-4ea3-a23f-c9ecfbf7fbbd None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:55.410544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09be89-b006-4ea3-a23f-c9ecfbf7fbbd None admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:55.411727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09be89-b006-4ea3-a23f-c9ecfbf7fbbd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:55.412292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09be89-b006-4ea3-a23f-c9ecfbf7fbbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:55.414813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09be89-b006-4ea3-a23f-c9ecfbf7fbbd None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:55.417091 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8faff-abde-44bc-9402-a28d7b899bcf None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:55.432612 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 472/943] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:53:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:53:55.439379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09be89-b006-4ea3-a23f-c9ecfbf7fbbd None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:55.444621 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:55.470917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29bbd8-f377-4a58-be50-9f00da61dbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:55.471987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29bbd8-f377-4a58-be50-9f00da61dbed None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:55.472523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29bbd8-f377-4a58-be50-9f00da61dbed None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:55.473027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29bbd8-f377-4a58-be50-9f00da61dbed None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:55.474045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29bbd8-f377-4a58-be50-9f00da61dbed None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:55.475646 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29bbd8-f377-4a58-be50-9f00da61dbed None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:55.487224 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-1b29bbd8-f377-4a58-be50-9f00da61dbed None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:53:55.487224 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:55.487224 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:53:55.487224 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:53:55.487224 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:53:55.487224 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:53:55.487224 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:53:55.487224 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:55.487224 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:53:55.487224 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:55.487224 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:53:55.487224 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:55.487224 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:55.487224 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:55.487224 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:55.487224 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:55.487224 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:55.488405 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:55.488405 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:55.488405 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:55.488405 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:55.488405 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:55.488405 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:55.488405 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:53:55.488405 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:53:55.488405 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:53:55.488405 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:53:55.488405 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:55.488405 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:55.488405 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:55.488405 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:55.488405 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:55.488405 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:55.489332 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:55.489332 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:55.489332 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:55.489332 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:55.489332 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:55.489332 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:55.489332 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:55.489332 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:55.489332 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:55.489332 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:55.489332 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:53:55.489332 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:55.489332 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:53:55.489332 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:55.492203 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 472/944] 10.222.0.39 () {56 vars in 1126 bytes} [Sun Aug 7 00:53:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:53:55.503988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29bbd8-f377-4a58-be50-9f00da61dbed None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:55.541710 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:55.605705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09be89-b006-4ea3-a23f-c9ecfbf7fbbd None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:55.662651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f7e8d-ba98-41b5-b40f-a71763b75769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:55.663916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f7e8d-ba98-41b5-b40f-a71763b75769 None admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:55.664417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f7e8d-ba98-41b5-b40f-a71763b75769 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:55.665012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f7e8d-ba98-41b5-b40f-a71763b75769 None admin] PATH_INFO: `/v3/projects/1cd2efda8567437e983e3a7867ecd69b/users/af48a86c031e400982666d661c9f4229/roles/e5cdf0e52e1d42efb54f7af9a731d3a5` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:55.669938 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f7e8d-ba98-41b5-b40f-a71763b75769 None admin] RBAC: Authorizing `identity:create_grant(project_id=1cd2efda8567437e983e3a7867ecd69b, user_id=af48a86c031e400982666d661c9f4229, role_id=e5cdf0e52e1d42efb54f7af9a731d3a5)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:55.671424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f7e8d-ba98-41b5-b40f-a71763b75769 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:55.702179 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 473/945] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Aug 7 00:53:55 2022] PUT /identity/v3/projects/1cd2efda8567437e983e3a7867ecd69b/users/af48a86c031e400982666d661c9f4229/roles/e5cdf0e52e1d42efb54f7af9a731d3a5 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 00:53:55.702179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b39be0-b224-44a2-8a8f-920bf28e2ea4 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:55.702179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b39be0-b224-44a2-8a8f-920bf28e2ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:55.702179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b39be0-b224-44a2-8a8f-920bf28e2ea4 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:55.702865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29bbd8-f377-4a58-be50-9f00da61dbed None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:55.703019 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 474/946] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:55.705663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822ad41-5eb2-4e71-9308-7acce1d81c20 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:55.706553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822ad41-5eb2-4e71-9308-7acce1d81c20 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:55.707226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822ad41-5eb2-4e71-9308-7acce1d81c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:55.730086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a822ad41-5eb2-4e71-9308-7acce1d81c20 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:55.732448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a822ad41-5eb2-4e71-9308-7acce1d81c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:55.755308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708a3e5-e458-464e-a6ff-ad18e486ff4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:55.755954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708a3e5-e458-464e-a6ff-ad18e486ff4d None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:55.756316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708a3e5-e458-464e-a6ff-ad18e486ff4d None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:55.756625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708a3e5-e458-464e-a6ff-ad18e486ff4d None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:55.757275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708a3e5-e458-464e-a6ff-ad18e486ff4d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:55.757578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708a3e5-e458-464e-a6ff-ad18e486ff4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:55.759227 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708a3e5-e458-464e-a6ff-ad18e486ff4d None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:55.772794 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 473/947] 10.222.0.39 () {56 vars in 1122 bytes} [Sun Aug 7 00:53:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:55.774408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708a3e5-e458-464e-a6ff-ad18e486ff4d None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:55.872779 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 475/948] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:53:55.876490 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:55.898971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822ad41-5eb2-4e71-9308-7acce1d81c20 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:55.944121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708a3e5-e458-464e-a6ff-ad18e486ff4d None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:55.958693 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:56.021419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5725ea-9470-4658-96f8-cf2ed050fbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:56.022745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5725ea-9470-4658-96f8-cf2ed050fbed None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:56.023282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5725ea-9470-4658-96f8-cf2ed050fbed None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:56.023863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5725ea-9470-4658-96f8-cf2ed050fbed None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:56.025073 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5725ea-9470-4658-96f8-cf2ed050fbed None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:56.025672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5725ea-9470-4658-96f8-cf2ed050fbed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:56.029647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5725ea-9470-4658-96f8-cf2ed050fbed None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:56.042218 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 474/949] 10.222.0.39 () {56 vars in 1122 bytes} [Sun Aug 7 00:53:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:56.049548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5725ea-9470-4658-96f8-cf2ed050fbed None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:56.056669 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822ad41-5eb2-4e71-9308-7acce1d81c20 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:56.123353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b77a2-f191-426d-825e-ee6ee384d9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:56.123912 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b77a2-f191-426d-825e-ee6ee384d9a7 None admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:56.124217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b77a2-f191-426d-825e-ee6ee384d9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:56.124486 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b77a2-f191-426d-825e-ee6ee384d9a7 None admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:56.125813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b77a2-f191-426d-825e-ee6ee384d9a7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:56.127278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2b77a2-f191-426d-825e-ee6ee384d9a7 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:56.130947 n-d-master-1 devstack@keystone.service[80492]: WARNING keystone.server.flask.common [None req-9f2b77a2-f191-426d-825e-ee6ee384d9a7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 07 00:53:56.157635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.sql.core [None req-9f2b77a2-f191-426d-825e-ee6ee384d9a7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 07 00:53:56.157635 n-d-master-1 devstack@keystone.service[80492]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 07 00:53:56.157635 n-d-master-1 devstack@keystone.service[80492]: [parameters: {'id': '5497e8f591254c2d9b26b97795527108', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 07 00:53:56.157635 n-d-master-1 devstack@keystone.service[80492]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80492) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 07 00:53:56.167490 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-9f2b77a2-f191-426d-825e-ee6ee384d9a7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5497e8f591254c2d9b26b97795527108.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5497e8f591254c2d9b26b97795527108. Aug 07 00:53:56.167490 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:56.167490 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 00:53:56.167490 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 00:53:56.167490 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 00:53:56.167490 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 00:53:56.167490 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 00:53:56.167490 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 00:53:56.167490 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 00:53:56.167490 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application conn.query(q) Aug 07 00:53:56.167490 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 00:53:56.167490 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 00:53:56.167490 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 00:53:56.168459 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application result.read() Aug 07 00:53:56.168459 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 00:53:56.168459 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 00:53:56.168459 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 00:53:56.168459 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 00:53:56.168459 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 00:53:56.168459 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 00:53:56.168459 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 00:53:56.168459 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 00:53:56.168459 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 07 00:53:56.168459 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:56.168459 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 07 00:53:56.168459 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:56.168459 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:56.168459 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 07 00:53:56.168459 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 07 00:53:56.168459 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 07 00:53:56.168459 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 07 00:53:56.169472 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 00:53:56.169472 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application next(self.gen) Aug 07 00:53:56.169472 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 07 00:53:56.169472 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application yield resource Aug 07 00:53:56.169472 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 00:53:56.169472 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application next(self.gen) Aug 07 00:53:56.169472 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 07 00:53:56.169472 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.session.rollback() Aug 07 00:53:56.169472 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 00:53:56.169472 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.force_reraise() Aug 07 00:53:56.169472 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 00:53:56.169472 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise self.value Aug 07 00:53:56.169472 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 07 00:53:56.169472 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 07 00:53:56.169472 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 07 00:53:56.169472 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application session.commit() Aug 07 00:53:56.169472 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 07 00:53:56.170390 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 07 00:53:56.170390 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 07 00:53:56.170390 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._prepare_impl() Aug 07 00:53:56.170390 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 07 00:53:56.170390 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.session.flush() Aug 07 00:53:56.170390 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 07 00:53:56.170390 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._flush(objects) Aug 07 00:53:56.170390 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 07 00:53:56.170390 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 07 00:53:56.170390 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 07 00:53:56.170390 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application compat.raise_( Aug 07 00:53:56.170390 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 00:53:56.170390 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception Aug 07 00:53:56.170390 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 07 00:53:56.170390 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application flush_context.execute() Aug 07 00:53:56.170390 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 07 00:53:56.170390 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rec.execute(self) Aug 07 00:53:56.171354 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 07 00:53:56.171354 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 07 00:53:56.171354 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 07 00:53:56.171354 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 07 00:53:56.171354 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 07 00:53:56.171354 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 07 00:53:56.171354 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 07 00:53:56.171354 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 07 00:53:56.171354 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 07 00:53:56.171354 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 07 00:53:56.171354 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 07 00:53:56.171354 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 07 00:53:56.171354 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 07 00:53:56.171354 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 07 00:53:56.171354 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 07 00:53:56.178986 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 07 00:53:56.178986 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 00:53:56.178986 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception Aug 07 00:53:56.178986 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 00:53:56.178986 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 00:53:56.178986 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 00:53:56.178986 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 00:53:56.178986 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 00:53:56.178986 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 00:53:56.178986 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 00:53:56.178986 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application conn.query(q) Aug 07 00:53:56.178986 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 00:53:56.178986 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 00:53:56.178986 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 00:53:56.178986 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application result.read() Aug 07 00:53:56.178986 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 00:53:56.178986 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 00:53:56.181635 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 00:53:56.181635 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 00:53:56.181635 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 00:53:56.181635 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 00:53:56.181635 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 00:53:56.181635 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 00:53:56.181635 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 07 00:53:56.181635 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 07 00:53:56.181635 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [parameters: {'id': '5497e8f591254c2d9b26b97795527108', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 07 00:53:56.181635 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 07 00:53:56.181635 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:56.181635 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:53:56.181635 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:56.181635 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:56.181635 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 07 00:53:56.183611 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 07 00:53:56.183611 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 07 00:53:56.183611 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 07 00:53:56.183611 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 07 00:53:56.183611 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:56.183611 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:53:56.183611 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:56.183611 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:56.183611 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:56.183611 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:56.183611 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:56.183611 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:56.183611 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:56.183611 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:56.183611 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:56.183611 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:56.183611 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:56.187125 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:56.187125 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 07 00:53:56.187125 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 07 00:53:56.187125 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:56.187125 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:56.187125 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 07 00:53:56.187125 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 07 00:53:56.187125 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5497e8f591254c2d9b26b97795527108. Aug 07 00:53:56.187125 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:56.187125 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 476/950] 10.222.0.39 () {60 vars in 1140 bytes} [Sun Aug 7 00:53:55 2022] POST /identity/v3/projects => generated 262 bytes in 271 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:53:56.187125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b77a2-f191-426d-825e-ee6ee384d9a7 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:56.242802 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5725ea-9470-4658-96f8-cf2ed050fbed None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:56.259367 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:56.321092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db4f27-bbb8-43e4-a91d-22f1853d82d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:56.322537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db4f27-bbb8-43e4-a91d-22f1853d82d6 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:56.323575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db4f27-bbb8-43e4-a91d-22f1853d82d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:56.324358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db4f27-bbb8-43e4-a91d-22f1853d82d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:56.327703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db4f27-bbb8-43e4-a91d-22f1853d82d6 None admin] RBAC: Adding query filter params (interface=public, service_id=47db6d7051ce470e82e218631b446c00, region_id=RegionOne) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:56.328238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db4f27-bbb8-43e4-a91d-22f1853d82d6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:56.329892 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db4f27-bbb8-43e4-a91d-22f1853d82d6 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:56.338108 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 475/951] 10.222.0.39 () {56 vars in 1251 bytes} [Sun Aug 7 00:53:56 2022] GET /identity/v3/endpoints?service_id=47db6d7051ce470e82e218631b446c00&interface=public®ion_id=RegionOne => generated 194 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:56.347928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db4f27-bbb8-43e4-a91d-22f1853d82d6 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:56.351988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2b77a2-f191-426d-825e-ee6ee384d9a7 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:56.361675 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:56.406854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4d204-d5b5-4a03-a917-52e7f5f5dca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:56.407557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4d204-d5b5-4a03-a917-52e7f5f5dca6 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:56.407788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4d204-d5b5-4a03-a917-52e7f5f5dca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:56.408109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4d204-d5b5-4a03-a917-52e7f5f5dca6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:56.415849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4d204-d5b5-4a03-a917-52e7f5f5dca6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:56.418313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4d204-d5b5-4a03-a917-52e7f5f5dca6 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:56.432930 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-7ed4d204-d5b5-4a03-a917-52e7f5f5dca6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:56.432930 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:56.432930 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:56.432930 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:56.432930 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:56.432930 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:56.432930 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:56.432930 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:56.432930 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:56.432930 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:56.432930 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:56.432930 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:56.432930 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:53:56.432930 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:53:56.432930 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:53:56.434717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:53:56.434717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:56.434717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:56.434717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:56.434717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:56.434717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:56.434717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:56.434717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:56.434717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:56.434717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:56.434717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:56.434717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:56.434717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:56.434717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:56.434717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:56.434717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:56.434717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:56.442662 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:53:56.442662 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:53:56.442662 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:53:56.442662 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:53:56.442662 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:53:56.442662 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:53:56.442662 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:53:56.442662 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:56.442662 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 477/952] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:53:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:53:56.443717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4d204-d5b5-4a03-a917-52e7f5f5dca6 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:56.495286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db4f27-bbb8-43e4-a91d-22f1853d82d6 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:56.541682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b0997-6075-4e67-99ac-417d599c30d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:56.542887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b0997-6075-4e67-99ac-417d599c30d8 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:56.544106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b0997-6075-4e67-99ac-417d599c30d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:56.544529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b0997-6075-4e67-99ac-417d599c30d8 None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:56.545476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b0997-6075-4e67-99ac-417d599c30d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:56.547315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b0997-6075-4e67-99ac-417d599c30d8 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:56.560435 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 476/953] 10.222.0.39 () {56 vars in 1087 bytes} [Sun Aug 7 00:53:56 2022] GET /identity/v3/services => generated 1497 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 00:53:56.573074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4d204-d5b5-4a03-a917-52e7f5f5dca6 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:56.621373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610b9b2-9767-4132-8431-72742c5eb98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:56.622569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610b9b2-9767-4132-8431-72742c5eb98f None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:56.622911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610b9b2-9767-4132-8431-72742c5eb98f None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:56.623184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610b9b2-9767-4132-8431-72742c5eb98f None admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:56.623943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610b9b2-9767-4132-8431-72742c5eb98f None admin] RBAC: Adding query filter params (name=service) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:56.624254 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610b9b2-9767-4132-8431-72742c5eb98f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:56.625818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610b9b2-9767-4132-8431-72742c5eb98f None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:56.650409 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 478/954] 10.222.0.39 () {56 vars in 1112 bytes} [Sun Aug 7 00:53:56 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:53:57.455464 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528917f1-4d70-44d2-a683-6bed057989d4 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:57.456046 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528917f1-4d70-44d2-a683-6bed057989d4 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:57.456046 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528917f1-4d70-44d2-a683-6bed057989d4 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:57.457778 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 477/955] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:57.463590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44261461-5659-49d6-8ef6-77843ffcec77 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:57.464109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44261461-5659-49d6-8ef6-77843ffcec77 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:57.464189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44261461-5659-49d6-8ef6-77843ffcec77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:57.483701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-44261461-5659-49d6-8ef6-77843ffcec77 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:57.485245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-44261461-5659-49d6-8ef6-77843ffcec77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:57.506179 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:57.564270 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 479/956] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:53:57.580932 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528917f1-4d70-44d2-a683-6bed057989d4 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:57.621367 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:57.696950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528917f1-4d70-44d2-a683-6bed057989d4 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:57.732541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fdf0dd-8574-45f8-ad08-8be4e582e293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:57.733154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdf0dd-8574-45f8-ad08-8be4e582e293 None admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:57.733435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdf0dd-8574-45f8-ad08-8be4e582e293 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:57.733707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdf0dd-8574-45f8-ad08-8be4e582e293 None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:57.734361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fdf0dd-8574-45f8-ad08-8be4e582e293 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:57.735737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fdf0dd-8574-45f8-ad08-8be4e582e293 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:57.755987 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 478/957] 10.222.0.39 () {60 vars in 1141 bytes} [Sun Aug 7 00:53:57 2022] POST /identity/v3/services => generated 242 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:53:57.949942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffa612-8ce2-449e-9877-f9050b15a041 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:57.950414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffa612-8ce2-449e-9877-f9050b15a041 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:57.950791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffa612-8ce2-449e-9877-f9050b15a041 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:57.952607 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 480/958] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:57.958869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae113c1-9516-4619-888a-c33ebfe96bae None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:57.959298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae113c1-9516-4619-888a-c33ebfe96bae None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:57.959674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae113c1-9516-4619-888a-c33ebfe96bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:57.979741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2ae113c1-9516-4619-888a-c33ebfe96bae None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:57.981784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2ae113c1-9516-4619-888a-c33ebfe96bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:58.062251 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 479/959] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:57 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:53:58.086755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffa612-8ce2-449e-9877-f9050b15a041 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:58.197874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffa612-8ce2-449e-9877-f9050b15a041 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:58.234554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8165d5a-e448-435b-b640-6f3af84194b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:58.235152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8165d5a-e448-435b-b640-6f3af84194b9 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:58.235426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8165d5a-e448-435b-b640-6f3af84194b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:58.235690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8165d5a-e448-435b-b640-6f3af84194b9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:58.246865 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8165d5a-e448-435b-b640-6f3af84194b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:53:58.251863 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-e8165d5a-e448-435b-b640-6f3af84194b9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 00:53:58.251863 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:58.251863 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:58.251863 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:58.251863 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:58.251863 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:58.251863 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:58.251863 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:58.251863 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:58.251863 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:58.251863 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:58.251863 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:58.251863 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:53:58.251863 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:53:58.251863 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:53:58.251863 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:53:58.252881 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:53:58.252881 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:53:58.252881 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:53:58.252881 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:53:58.252881 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:58.252881 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:58.252881 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:58.252881 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:58.252881 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:58.252881 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:58.252881 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:58.252881 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:58.252881 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:58.252881 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:58.252881 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:58.252881 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:58.253999 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:58.253999 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:58.253999 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:58.253999 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:58.253999 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:53:58.253999 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:53:58.253999 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:53:58.253999 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:53:58.253999 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:53:58.253999 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:53:58.253999 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 00:53:58.253999 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:58.253999 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 481/960] 10.222.0.39 () {56 vars in 1120 bytes} [Sun Aug 7 00:53:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:58.261182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae113c1-9516-4619-888a-c33ebfe96bae None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:58.297470 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:58.369160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae113c1-9516-4619-888a-c33ebfe96bae None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:58.406385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245635b-44c7-4d4a-b9a4-f7ae56e596d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:58.406995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245635b-44c7-4d4a-b9a4-f7ae56e596d3 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:58.407275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245635b-44c7-4d4a-b9a4-f7ae56e596d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:58.407542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245635b-44c7-4d4a-b9a4-f7ae56e596d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:58.408243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a245635b-44c7-4d4a-b9a4-f7ae56e596d3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:58.408539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a245635b-44c7-4d4a-b9a4-f7ae56e596d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:58.409904 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a245635b-44c7-4d4a-b9a4-f7ae56e596d3 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:58.419031 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 480/961] 10.222.0.39 () {56 vars in 1115 bytes} [Sun Aug 7 00:53:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:53:58.424983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8165d5a-e448-435b-b640-6f3af84194b9 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:58.445186 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:58.537073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8165d5a-e448-435b-b640-6f3af84194b9 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:58.573808 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d8199-270f-4a44-bb81-bce6b13ad778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:58.574446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d8199-270f-4a44-bb81-bce6b13ad778 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:58.574858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d8199-270f-4a44-bb81-bce6b13ad778 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:58.575052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d8199-270f-4a44-bb81-bce6b13ad778 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:58.586086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d8199-270f-4a44-bb81-bce6b13ad778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:58.587618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d8199-270f-4a44-bb81-bce6b13ad778 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:58.603656 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-e51d8199-270f-4a44-bb81-bce6b13ad778 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:58.603656 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:58.603656 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:58.603656 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:58.603656 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:58.603656 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:58.603656 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:58.603656 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:58.603656 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:58.603656 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:58.603656 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:58.603656 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:58.603656 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:58.603656 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:58.603656 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:58.603656 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:58.604719 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:58.604719 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:58.604719 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:58.604719 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:58.604719 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:58.604719 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:58.604719 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:58.604719 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:58.604719 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:58.604719 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:58.604719 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:58.604719 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:58.604719 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:58.604719 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:58.604719 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:58.604719 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:58.604719 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:58.606118 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:58.606118 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:58.606118 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:58.606118 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 482/962] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:58.613094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245635b-44c7-4d4a-b9a4-f7ae56e596d3 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:58.715696 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:58.736980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245635b-44c7-4d4a-b9a4-f7ae56e596d3 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:58.758428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4789c8e-28d9-49d3-9fac-dc4f615b0a07 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:58.758788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4789c8e-28d9-49d3-9fac-dc4f615b0a07 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:58.758979 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4789c8e-28d9-49d3-9fac-dc4f615b0a07 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:58.760655 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 483/963] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:58.767083 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57899f5-98d2-4155-bf5a-ed93bd4a58c1 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:58.767465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57899f5-98d2-4155-bf5a-ed93bd4a58c1 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:58.767786 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57899f5-98d2-4155-bf5a-ed93bd4a58c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:58.779562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b08598-0e98-4f7a-a235-48b34946a856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:58.780560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b08598-0e98-4f7a-a235-48b34946a856 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:58.781046 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b08598-0e98-4f7a-a235-48b34946a856 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:58.781519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b08598-0e98-4f7a-a235-48b34946a856 None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:58.782413 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b08598-0e98-4f7a-a235-48b34946a856 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:58.783453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b08598-0e98-4f7a-a235-48b34946a856 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:58.785374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b08598-0e98-4f7a-a235-48b34946a856 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:58.789155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b57899f5-98d2-4155-bf5a-ed93bd4a58c1 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:58.790328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b57899f5-98d2-4155-bf5a-ed93bd4a58c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:58.801931 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 481/964] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:58.807357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b08598-0e98-4f7a-a235-48b34946a856 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:58.878648 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:58.895935 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 484/965] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:58 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:53:58.912663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57899f5-98d2-4155-bf5a-ed93bd4a58c1 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:58.930716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b08598-0e98-4f7a-a235-48b34946a856 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:58.976173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40e44e-1392-45fa-890b-e4959e13f5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:58.977177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40e44e-1392-45fa-890b-e4959e13f5b4 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:58.977538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40e44e-1392-45fa-890b-e4959e13f5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:58.977882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40e44e-1392-45fa-890b-e4959e13f5b4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:58.986249 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40e44e-1392-45fa-890b-e4959e13f5b4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:58.987743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40e44e-1392-45fa-890b-e4959e13f5b4 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:59.000681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-6a40e44e-1392-45fa-890b-e4959e13f5b4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:53:59.000681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:59.000681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:59.000681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:59.000681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:59.000681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:59.000681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:59.000681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:59.000681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:59.000681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:59.000681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:59.000681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:59.000681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:53:59.000681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:53:59.000681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:53:59.000681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:53:59.001752 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:59.001752 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:59.001752 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:53:59.001752 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:59.001752 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:53:59.001752 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:59.001752 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:59.001752 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:59.001752 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:59.001752 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:59.001752 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:59.001752 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:59.001752 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:59.001752 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:59.001752 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:59.001752 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:59.001752 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:59.001752 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:59.002754 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:59.002754 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:59.002754 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:53:59.002754 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:53:59.002754 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:53:59.002754 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:53:59.002754 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:53:59.002754 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:53:59.002754 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 07 00:53:59.002754 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:59.002754 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 482/966] 10.222.0.39 () {56 vars in 1117 bytes} [Sun Aug 7 00:53:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:53:59.003385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce77ad-bde3-49e2-97ec-dc62f31f11c6 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:59.004222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce77ad-bde3-49e2-97ec-dc62f31f11c6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:59.004556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce77ad-bde3-49e2-97ec-dc62f31f11c6 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:59.006131 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 483/967] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:53:59.009893 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce77ad-bde3-49e2-97ec-dc62f31f11c6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:59.014435 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:59.034523 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57899f5-98d2-4155-bf5a-ed93bd4a58c1 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:59.076046 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac587bf-5bfe-4797-ae34-b607683e7791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:59.076699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac587bf-5bfe-4797-ae34-b607683e7791 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:59.076973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac587bf-5bfe-4797-ae34-b607683e7791 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:59.077239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac587bf-5bfe-4797-ae34-b607683e7791 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:59.077861 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac587bf-5bfe-4797-ae34-b607683e7791 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:59.079369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac587bf-5bfe-4797-ae34-b607683e7791 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:59.089669 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-6ac587bf-5bfe-4797-ae34-b607683e7791 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:53:59.089669 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:59.089669 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:53:59.089669 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:53:59.089669 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:53:59.089669 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:53:59.089669 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:53:59.089669 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:59.089669 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:53:59.089669 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:59.089669 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:53:59.089669 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:59.089669 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:59.089669 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:59.089669 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:59.089669 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:59.089669 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:59.091248 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:59.091248 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:59.091248 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:59.091248 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:59.091248 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:59.091248 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:59.091248 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:53:59.091248 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:53:59.091248 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:53:59.091248 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:53:59.091248 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:59.091248 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:59.091248 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:59.091248 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:59.091248 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:59.091248 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:59.092185 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:59.092185 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:59.092185 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:59.092185 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:59.092185 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:59.092185 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:59.092185 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:59.092185 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:59.092185 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:59.092185 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:59.092185 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:53:59.092185 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:53:59.092185 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:53:59.092185 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:59.092185 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 485/968] 10.222.0.39 () {56 vars in 1126 bytes} [Sun Aug 7 00:53:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:53:59.093020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b885a4-71b7-48d5-b8e6-a5836e3bf06f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:59.093020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b885a4-71b7-48d5-b8e6-a5836e3bf06f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:59.093020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b885a4-71b7-48d5-b8e6-a5836e3bf06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:59.111102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-97b885a4-71b7-48d5-b8e6-a5836e3bf06f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:53:59.112359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-97b885a4-71b7-48d5-b8e6-a5836e3bf06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:53:59.138551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce77ad-bde3-49e2-97ec-dc62f31f11c6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:59.175631 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:59.178765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a3560-a88c-4a1d-8b83-896ff1eae4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:59.179533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a3560-a88c-4a1d-8b83-896ff1eae4a3 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:59.179817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a3560-a88c-4a1d-8b83-896ff1eae4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:59.180129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a3560-a88c-4a1d-8b83-896ff1eae4a3 None admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:59.180891 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a3560-a88c-4a1d-8b83-896ff1eae4a3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:59.181195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a3560-a88c-4a1d-8b83-896ff1eae4a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:59.182645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341a3560-a88c-4a1d-8b83-896ff1eae4a3 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:59.189324 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 486/969] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:53:59 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:53:59.193151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b885a4-71b7-48d5-b8e6-a5836e3bf06f None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:59.211123 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 484/970] 10.222.0.39 () {56 vars in 1149 bytes} [Sun Aug 7 00:53:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:59.212119 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a3560-a88c-4a1d-8b83-896ff1eae4a3 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:59.277522 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:59.322391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a3560-a88c-4a1d-8b83-896ff1eae4a3 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:59.360719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674c42e-b143-4fa6-b477-a928763f6b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:59.361301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674c42e-b143-4fa6-b477-a928763f6b99 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:59.361594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674c42e-b143-4fa6-b477-a928763f6b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:59.361823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b885a4-71b7-48d5-b8e6-a5836e3bf06f None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:59.361936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674c42e-b143-4fa6-b477-a928763f6b99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:59.401025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366efa2-7607-4544-a60b-2354b69e14a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:59.401644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366efa2-7607-4544-a60b-2354b69e14a3 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:59.401919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366efa2-7607-4544-a60b-2354b69e14a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:59.402184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366efa2-7607-4544-a60b-2354b69e14a3 None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:59.402823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366efa2-7607-4544-a60b-2354b69e14a3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:59.403213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366efa2-7607-4544-a60b-2354b69e14a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:59.404531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366efa2-7607-4544-a60b-2354b69e14a3 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:59.409803 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 487/971] 10.222.0.39 () {56 vars in 1122 bytes} [Sun Aug 7 00:53:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:59.410630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366efa2-7607-4544-a60b-2354b69e14a3 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:59.453554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674c42e-b143-4fa6-b477-a928763f6b99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:59.455186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674c42e-b143-4fa6-b477-a928763f6b99 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:59.485235 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:59.525861 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:59.537983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366efa2-7607-4544-a60b-2354b69e14a3 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:59.576685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc421f55-1b0c-464f-9c8a-7da6a05b8221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:59.577296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc421f55-1b0c-464f-9c8a-7da6a05b8221 None admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:59.577560 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc421f55-1b0c-464f-9c8a-7da6a05b8221 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:59.577821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc421f55-1b0c-464f-9c8a-7da6a05b8221 None admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:59.578465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc421f55-1b0c-464f-9c8a-7da6a05b8221 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:59.579910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc421f55-1b0c-464f-9c8a-7da6a05b8221 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:59.597682 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 485/972] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:53:59 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:53:59.597682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674c42e-b143-4fa6-b477-a928763f6b99 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:59.602044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.sql.core [None req-cc421f55-1b0c-464f-9c8a-7da6a05b8221 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 07 00:53:59.602044 n-d-master-1 devstack@keystone.service[80492]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 07 00:53:59.602044 n-d-master-1 devstack@keystone.service[80492]: [parameters: {'user_id': '07bc544ead8c4a9fbc566eec35ca3def', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 07 00:53:59.602044 n-d-master-1 devstack@keystone.service[80492]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80492) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 07 00:53:59.609195 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-cc421f55-1b0c-464f-9c8a-7da6a05b8221 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 07 00:53:59.609195 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:59.609195 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 00:53:59.609195 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 00:53:59.609195 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 00:53:59.609195 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 00:53:59.609195 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 00:53:59.609195 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 00:53:59.609195 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 00:53:59.609195 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application conn.query(q) Aug 07 00:53:59.609195 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 00:53:59.609195 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 00:53:59.609195 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 00:53:59.609195 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application result.read() Aug 07 00:53:59.609195 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 00:53:59.616599 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 00:53:59.616599 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 00:53:59.616599 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 00:53:59.616599 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 00:53:59.616599 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 00:53:59.616599 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 00:53:59.616599 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 00:53:59.616599 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 07 00:53:59.616599 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:59.616599 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 07 00:53:59.616599 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:59.616599 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:59.616599 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 07 00:53:59.616599 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 07 00:53:59.616599 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 07 00:53:59.616599 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 07 00:53:59.616599 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 00:53:59.616599 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application next(self.gen) Aug 07 00:53:59.617717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 07 00:53:59.617717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application yield resource Aug 07 00:53:59.617717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 00:53:59.617717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application next(self.gen) Aug 07 00:53:59.617717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 07 00:53:59.617717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.session.rollback() Aug 07 00:53:59.617717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 00:53:59.617717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.force_reraise() Aug 07 00:53:59.617717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 00:53:59.617717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise self.value Aug 07 00:53:59.617717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 07 00:53:59.617717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 07 00:53:59.617717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 07 00:53:59.617717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application session.commit() Aug 07 00:53:59.617717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 07 00:53:59.617717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 07 00:53:59.617717 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 07 00:53:59.618625 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._prepare_impl() Aug 07 00:53:59.618625 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 07 00:53:59.618625 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.session.flush() Aug 07 00:53:59.618625 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 07 00:53:59.618625 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._flush(objects) Aug 07 00:53:59.618625 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 07 00:53:59.618625 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 07 00:53:59.618625 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 07 00:53:59.618625 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application compat.raise_( Aug 07 00:53:59.618625 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 00:53:59.618625 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception Aug 07 00:53:59.618625 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 07 00:53:59.618625 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application flush_context.execute() Aug 07 00:53:59.618625 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 07 00:53:59.618625 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rec.execute(self) Aug 07 00:53:59.618625 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 07 00:53:59.618625 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 07 00:53:59.619557 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 07 00:53:59.619557 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 07 00:53:59.619557 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 07 00:53:59.619557 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 07 00:53:59.619557 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 07 00:53:59.619557 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 07 00:53:59.619557 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 07 00:53:59.619557 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 07 00:53:59.619557 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 07 00:53:59.619557 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 07 00:53:59.619557 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 07 00:53:59.619557 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 07 00:53:59.619557 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 07 00:53:59.619557 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 07 00:53:59.619557 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 00:53:59.619557 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception Aug 07 00:53:59.620460 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 00:53:59.620460 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 00:53:59.620460 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 00:53:59.620460 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 00:53:59.620460 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 00:53:59.620460 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 00:53:59.620460 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 00:53:59.620460 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application conn.query(q) Aug 07 00:53:59.620460 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 00:53:59.620460 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 00:53:59.620460 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 00:53:59.620460 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application result.read() Aug 07 00:53:59.620460 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 00:53:59.620460 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 00:53:59.620460 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 00:53:59.620460 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 00:53:59.621327 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 00:53:59.621327 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 00:53:59.621327 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 00:53:59.621327 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 00:53:59.621327 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 07 00:53:59.621327 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 07 00:53:59.621327 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [parameters: {'user_id': '07bc544ead8c4a9fbc566eec35ca3def', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 07 00:53:59.621327 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 07 00:53:59.621327 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:59.621327 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:53:59.621327 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:59.621327 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:59.621327 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:59.621327 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:59.621327 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:59.622167 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:59.622167 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:59.622167 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:59.622167 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:59.622167 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:59.622167 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:59.622167 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:59.622167 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 07 00:53:59.622167 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 07 00:53:59.622167 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:59.622167 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:59.622167 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:53:59.622167 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:59.622167 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:53:59.622167 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:59.622167 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 07 00:53:59.622167 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 07 00:53:59.623123 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 07 00:53:59.623123 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 07 00:53:59.623123 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 07 00:53:59.623123 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 07 00:53:59.623123 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 07 00:53:59.623123 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:59.623123 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 488/973] 10.222.0.39 () {60 vars in 1131 bytes} [Sun Aug 7 00:53:59 2022] POST /identity/v3/users => generated 160 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:59.623123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc421f55-1b0c-464f-9c8a-7da6a05b8221 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:59.729003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674c42e-b143-4fa6-b477-a928763f6b99 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:59.732877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc421f55-1b0c-464f-9c8a-7da6a05b8221 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:59.753774 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:59.767571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ccd90c-04cf-4dd7-ba58-d8d1348835e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:59.768204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccd90c-04cf-4dd7-ba58-d8d1348835e7 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:59.768647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccd90c-04cf-4dd7-ba58-d8d1348835e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:59.768811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccd90c-04cf-4dd7-ba58-d8d1348835e7 None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:59.769476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ccd90c-04cf-4dd7-ba58-d8d1348835e7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:53:59.769771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ccd90c-04cf-4dd7-ba58-d8d1348835e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:59.771134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ccd90c-04cf-4dd7-ba58-d8d1348835e7 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:59.775645 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b215d0-d25e-4401-99a1-98cba76edcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:59.776284 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 486/974] 10.222.0.39 () {56 vars in 1122 bytes} [Sun Aug 7 00:53:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:53:59.776708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b215d0-d25e-4401-99a1-98cba76edcaf None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:59.777063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ccd90c-04cf-4dd7-ba58-d8d1348835e7 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:59.777540 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b215d0-d25e-4401-99a1-98cba76edcaf None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:59.778007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b215d0-d25e-4401-99a1-98cba76edcaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:59.792010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b215d0-d25e-4401-99a1-98cba76edcaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:59.794910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b215d0-d25e-4401-99a1-98cba76edcaf None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:59.804668 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:53:59.819347 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-73b215d0-d25e-4401-99a1-98cba76edcaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:59.819347 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:59.819347 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:59.819347 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:59.819347 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:59.819347 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:59.819347 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:59.819347 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:59.819347 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:59.819347 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:59.819347 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:59.819347 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:59.819347 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:53:59.819347 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:53:59.819347 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:53:59.819347 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:53:59.820548 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:59.820548 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:59.820548 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:59.820548 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:59.820548 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:59.820548 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:59.820548 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:59.820548 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:59.820548 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:59.820548 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:59.820548 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:59.820548 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:59.820548 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:59.820548 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:59.820548 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:59.820548 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:59.820548 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:53:59.821469 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:53:59.821469 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:53:59.821469 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:53:59.825357 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 489/975] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:53:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:59.826559 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b215d0-d25e-4401-99a1-98cba76edcaf None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:59.891827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ccd90c-04cf-4dd7-ba58-d8d1348835e7 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:59.931427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92efa1-51bc-4573-8a79-049d3e6702c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:59.932093 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92efa1-51bc-4573-8a79-049d3e6702c5 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:59.932367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92efa1-51bc-4573-8a79-049d3e6702c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:59.932633 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92efa1-51bc-4573-8a79-049d3e6702c5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:59.940635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92efa1-51bc-4573-8a79-049d3e6702c5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:59.942126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92efa1-51bc-4573-8a79-049d3e6702c5 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:53:59.948772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b215d0-d25e-4401-99a1-98cba76edcaf None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:53:59.957840 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-2f92efa1-51bc-4573-8a79-049d3e6702c5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 00:53:59.957840 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:53:59.957840 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:53:59.957840 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:53:59.957840 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:53:59.957840 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:53:59.957840 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:53:59.957840 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:53:59.957840 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:53:59.957840 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:53:59.957840 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:53:59.957840 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:53:59.957840 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:53:59.957840 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:53:59.957840 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:53:59.957840 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:53:59.958906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:53:59.958906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:53:59.958906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:53:59.958906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:59.958906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:53:59.958906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:53:59.958906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:53:59.958906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:53:59.958906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:53:59.958906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:53:59.958906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:53:59.958906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:53:59.958906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:53:59.958906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:53:59.958906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:53:59.958906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:53:59.958906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:53:59.958906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:53:59.959867 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:53:59.959867 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:53:59.959867 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:53:59.959867 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:53:59.959867 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:53:59.959867 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:53:59.959867 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:53:59.959867 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:53:59.959867 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 07 00:53:59.959867 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:53:59.966033 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 487/976] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:53:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:53:59.966033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92efa1-51bc-4573-8a79-049d3e6702c5 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:53:59.992570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a9ac9-7e05-43e2-a13e-954d8222c591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:53:59.993211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a9ac9-7e05-43e2-a13e-954d8222c591 None admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:53:59.993490 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a9ac9-7e05-43e2-a13e-954d8222c591 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:53:59.993767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a9ac9-7e05-43e2-a13e-954d8222c591 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:53:59.994432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a9ac9-7e05-43e2-a13e-954d8222c591 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:53:59.995803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a9ac9-7e05-43e2-a13e-954d8222c591 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:00.021009 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 490/977] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 00:53:59 2022] POST /identity/v3/endpoints => generated 349 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:54:00.022116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a9ac9-7e05-43e2-a13e-954d8222c591 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:00.056383 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:00.075439 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:00.098058 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92efa1-51bc-4573-8a79-049d3e6702c5 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:00.150533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0484785-dfc5-4d7d-943a-35bb8cb374e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:00.151062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0484785-dfc5-4d7d-943a-35bb8cb374e0 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:00.151335 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0484785-dfc5-4d7d-943a-35bb8cb374e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:00.151608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0484785-dfc5-4d7d-943a-35bb8cb374e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:00.152325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0484785-dfc5-4d7d-943a-35bb8cb374e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:00.153160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0484785-dfc5-4d7d-943a-35bb8cb374e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:00.153980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a9ac9-7e05-43e2-a13e-954d8222c591 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:00.154566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0484785-dfc5-4d7d-943a-35bb8cb374e0 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:00.168995 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 488/978] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:00.170413 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3a47b-9fc5-4b80-a237-19944367751f None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:00.170703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3a47b-9fc5-4b80-a237-19944367751f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:00.170975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3a47b-9fc5-4b80-a237-19944367751f None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:00.176159 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 489/979] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:54:00.177355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3a47b-9fc5-4b80-a237-19944367751f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:00.203195 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31df10-efc5-407a-bacf-9841411a5112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:00.204336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31df10-efc5-407a-bacf-9841411a5112 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:00.204336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31df10-efc5-407a-bacf-9841411a5112 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:00.204534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31df10-efc5-407a-bacf-9841411a5112 None admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:00.205637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31df10-efc5-407a-bacf-9841411a5112 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:00.205637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31df10-efc5-407a-bacf-9841411a5112 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:00.206906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31df10-efc5-407a-bacf-9841411a5112 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:00.257721 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 491/980] 10.222.0.39 () {56 vars in 1101 bytes} [Sun Aug 7 00:54:00 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:00.257721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787c514-9d69-499a-9606-d8cb18e5bfdf None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:00.257721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787c514-9d69-499a-9606-d8cb18e5bfdf None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:00.257721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787c514-9d69-499a-9606-d8cb18e5bfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:00.279445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-7787c514-9d69-499a-9606-d8cb18e5bfdf None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:54:00.281202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7787c514-9d69-499a-9606-d8cb18e5bfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:54:00.348702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3a47b-9fc5-4b80-a237-19944367751f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:00.384053 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 492/981] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:54:00 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:54:00.407811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fed82-66cc-41fc-ac9b-fec365a0ce98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:00.409786 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787c514-9d69-499a-9606-d8cb18e5bfdf None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:00.410292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fed82-66cc-41fc-ac9b-fec365a0ce98 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:00.410591 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fed82-66cc-41fc-ac9b-fec365a0ce98 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:00.410869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fed82-66cc-41fc-ac9b-fec365a0ce98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:00.422277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43fed82-66cc-41fc-ac9b-fec365a0ce98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:00.424330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43fed82-66cc-41fc-ac9b-fec365a0ce98 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:00.426653 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:00.433278 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:00.441036 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-e43fed82-66cc-41fc-ac9b-fec365a0ce98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:54:00.441036 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:00.441036 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:54:00.441036 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:54:00.441036 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:54:00.441036 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:54:00.441036 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:54:00.441036 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:54:00.441036 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:54:00.441036 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:54:00.441036 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:54:00.441036 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:54:00.441036 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:54:00.441036 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:54:00.441036 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:54:00.441980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:54:00.441980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:54:00.441980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:54:00.441980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:54:00.441980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:54:00.441980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:54:00.441980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:54:00.441980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:54:00.441980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:54:00.441980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:54:00.441980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:54:00.441980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:54:00.441980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:54:00.441980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:54:00.441980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:54:00.441980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:54:00.441980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:54:00.442866 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:54:00.442866 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:54:00.442866 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:54:00.442866 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:54:00.442866 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:54:00.442866 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:54:00.442866 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:54:00.442866 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:54:00.442866 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 490/982] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:54:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:54:00.448463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fed82-66cc-41fc-ac9b-fec365a0ce98 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:00.538910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787c514-9d69-499a-9606-d8cb18e5bfdf None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:00.585487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a7a6e-6eaa-4a19-aada-57e31e0d30cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:00.586134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a7a6e-6eaa-4a19-aada-57e31e0d30cd None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:00.586408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a7a6e-6eaa-4a19-aada-57e31e0d30cd None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:00.586674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a7a6e-6eaa-4a19-aada-57e31e0d30cd None admin] PATH_INFO: `/v3/services/compute` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:00.587259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a7a6e-6eaa-4a19-aada-57e31e0d30cd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:00.589285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a7a6e-6eaa-4a19-aada-57e31e0d30cd None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:00.600245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fed82-66cc-41fc-ac9b-fec365a0ce98 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:00.601307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-5f0a7a6e-6eaa-4a19-aada-57e31e0d30cd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 00:54:00.601307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:00.601307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:54:00.601307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:54:00.601307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:54:00.601307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:54:00.601307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:54:00.601307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:54:00.601307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 00:54:00.601307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:54:00.601307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:54:00.601307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:54:00.601307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:00.601307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:54:00.601307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:54:00.601307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:54:00.601307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:54:00.602280 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:54:00.602280 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:54:00.602280 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:54:00.602280 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:54:00.602280 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:54:00.602280 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:54:00.602280 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:54:00.602280 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:54:00.602280 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:54:00.602280 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:54:00.602280 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:54:00.602280 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:54:00.602280 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:54:00.602280 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:54:00.602280 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:54:00.602280 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:54:00.603184 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:54:00.603184 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:54:00.603184 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:54:00.603184 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:54:00.603184 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:54:00.603184 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:54:00.603184 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:54:00.603184 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:54:00.603184 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:54:00.603184 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:54:00.603184 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:54:00.603184 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:54:00.603184 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 00:54:00.603184 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:54:00.603184 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 493/983] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:54:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:54:00.609445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a7a6e-6eaa-4a19-aada-57e31e0d30cd None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:00.651136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67478a10-da38-48aa-aa03-85d8de3cf297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:00.652116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67478a10-da38-48aa-aa03-85d8de3cf297 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:00.653130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67478a10-da38-48aa-aa03-85d8de3cf297 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:00.653603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67478a10-da38-48aa-aa03-85d8de3cf297 None admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:00.654493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67478a10-da38-48aa-aa03-85d8de3cf297 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:00.654998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67478a10-da38-48aa-aa03-85d8de3cf297 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:00.657169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67478a10-da38-48aa-aa03-85d8de3cf297 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:00.678258 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 491/984] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:54:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:54:00.679150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67478a10-da38-48aa-aa03-85d8de3cf297 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:00.696834 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:00.723993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a7a6e-6eaa-4a19-aada-57e31e0d30cd None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:00.752589 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:00.773451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325148d-af0b-4d18-a5c5-8ac05859604a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:00.774191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325148d-af0b-4d18-a5c5-8ac05859604a None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:00.774470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325148d-af0b-4d18-a5c5-8ac05859604a None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:00.774742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325148d-af0b-4d18-a5c5-8ac05859604a None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:00.775392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7325148d-af0b-4d18-a5c5-8ac05859604a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:00.775699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7325148d-af0b-4d18-a5c5-8ac05859604a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:00.777136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7325148d-af0b-4d18-a5c5-8ac05859604a None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:00.787421 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 494/985] 10.222.0.39 () {56 vars in 1112 bytes} [Sun Aug 7 00:54:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:54:00.788617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325148d-af0b-4d18-a5c5-8ac05859604a None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:00.807676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67478a10-da38-48aa-aa03-85d8de3cf297 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:00.846105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae0b3e-2995-4636-a0a6-161f0debc9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:00.846714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae0b3e-2995-4636-a0a6-161f0debc9d6 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:00.846992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae0b3e-2995-4636-a0a6-161f0debc9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:00.847262 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae0b3e-2995-4636-a0a6-161f0debc9d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:00.848017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae0b3e-2995-4636-a0a6-161f0debc9d6 None admin] RBAC: Adding query filter params (role.id=e5cdf0e52e1d42efb54f7af9a731d3a5, scope.project.id=1cd2efda8567437e983e3a7867ecd69b, user.id=af48a86c031e400982666d661c9f4229) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:00.848329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae0b3e-2995-4636-a0a6-161f0debc9d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:00.849759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae0b3e-2995-4636-a0a6-161f0debc9d6 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:00.856100 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 492/986] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:54:00 2022] GET /identity/v3/role_assignments?user.id=af48a86c031e400982666d661c9f4229&scope.project.id=1cd2efda8567437e983e3a7867ecd69b&role.id=e5cdf0e52e1d42efb54f7af9a731d3a5 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:00.905317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325148d-af0b-4d18-a5c5-8ac05859604a None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:00.944209 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3452b-be52-4d01-bc00-446a9633e29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:00.944746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3452b-be52-4d01-bc00-446a9633e29f None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:00.945018 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3452b-be52-4d01-bc00-446a9633e29f None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:00.945286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3452b-be52-4d01-bc00-446a9633e29f None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:00.945951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3452b-be52-4d01-bc00-446a9633e29f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:00.946252 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3452b-be52-4d01-bc00-446a9633e29f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:00.947650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3452b-be52-4d01-bc00-446a9633e29f None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:00.959223 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 495/987] 10.222.0.39 () {56 vars in 1112 bytes} [Sun Aug 7 00:54:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:54:00.960160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae0b3e-2995-4636-a0a6-161f0debc9d6 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:01.077616 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae0b3e-2995-4636-a0a6-161f0debc9d6 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:01.102034 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:01.113521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1ba19-29ed-4ee7-a500-bae64a2dc0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:01.114125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1ba19-29ed-4ee7-a500-bae64a2dc0af None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:01.114402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1ba19-29ed-4ee7-a500-bae64a2dc0af None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:01.114678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1ba19-29ed-4ee7-a500-bae64a2dc0af None admin] PATH_INFO: `/v3/endpoints` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:01.115396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1ba19-29ed-4ee7-a500-bae64a2dc0af None admin] RBAC: Adding query filter params (interface=public, service_id=69f6afbfd51441a2a444bc73bd829e4d, region_id=RegionOne) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:01.115700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1ba19-29ed-4ee7-a500-bae64a2dc0af None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:01.117103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1ba19-29ed-4ee7-a500-bae64a2dc0af None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:01.122881 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 493/988] 10.222.0.39 () {56 vars in 1251 bytes} [Sun Aug 7 00:54:00 2022] GET /identity/v3/endpoints?service_id=69f6afbfd51441a2a444bc73bd829e4d&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:54:01.128665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3452b-be52-4d01-bc00-446a9633e29f None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:01.131547 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:01.239130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3452b-be52-4d01-bc00-446a9633e29f None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:01.278427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3513ed-0db0-495b-8669-56e2e87b892f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:01.279058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3513ed-0db0-495b-8669-56e2e87b892f None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:01.279335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3513ed-0db0-495b-8669-56e2e87b892f None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:01.279606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3513ed-0db0-495b-8669-56e2e87b892f None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:01.280268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3513ed-0db0-495b-8669-56e2e87b892f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:01.281683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3513ed-0db0-495b-8669-56e2e87b892f None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:01.289004 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 496/989] 10.222.0.39 () {56 vars in 1087 bytes} [Sun Aug 7 00:54:01 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 00:54:02.117720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364a274-b257-4af0-bd40-f3b8d433be4f None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:02.118244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364a274-b257-4af0-bd40-f3b8d433be4f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:02.118244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364a274-b257-4af0-bd40-f3b8d433be4f None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:02.120078 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 494/990] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:54:02.125939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b8a7a-506f-44ea-b680-9c1743c86623 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:02.126443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b8a7a-506f-44ea-b680-9c1743c86623 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:02.126523 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b8a7a-506f-44ea-b680-9c1743c86623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:02.145440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6f1b8a7a-506f-44ea-b680-9c1743c86623 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:54:02.146879 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6f1b8a7a-506f-44ea-b680-9c1743c86623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:54:02.219910 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:02.236613 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 497/991] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:54:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:54:02.251551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364a274-b257-4af0-bd40-f3b8d433be4f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:02.369999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364a274-b257-4af0-bd40-f3b8d433be4f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:02.409934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28d012-6f3c-43d2-b356-dd81ec69e0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:02.411082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28d012-6f3c-43d2-b356-dd81ec69e0a2 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:02.411593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28d012-6f3c-43d2-b356-dd81ec69e0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:02.412116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28d012-6f3c-43d2-b356-dd81ec69e0a2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:02.412978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28d012-6f3c-43d2-b356-dd81ec69e0a2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:02.414708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28d012-6f3c-43d2-b356-dd81ec69e0a2 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:02.426344 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-ac28d012-6f3c-43d2-b356-dd81ec69e0a2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:54:02.426344 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:02.426344 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:54:02.426344 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:54:02.426344 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:54:02.426344 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:54:02.426344 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:54:02.426344 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:54:02.426344 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:54:02.426344 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:54:02.426344 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:54:02.426344 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:54:02.426344 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:02.426344 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:54:02.426344 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:54:02.426344 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:54:02.426344 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:54:02.427433 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:54:02.427433 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:54:02.427433 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:54:02.427433 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:54:02.427433 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:54:02.427433 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:54:02.427433 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:54:02.427433 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:54:02.427433 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:54:02.427433 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:54:02.427433 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:54:02.427433 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:54:02.427433 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:54:02.427433 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:54:02.427433 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:54:02.427433 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:54:02.428358 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:54:02.428358 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:54:02.428358 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:54:02.428358 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:54:02.428358 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:54:02.428358 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:54:02.428358 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:54:02.428358 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:54:02.428358 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:54:02.428358 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:54:02.428358 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:54:02.428358 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:54:02.428358 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:54:02.428358 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:54:02.431532 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 495/992] 10.222.0.39 () {56 vars in 1126 bytes} [Sun Aug 7 00:54:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:54:02.437754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b8a7a-506f-44ea-b680-9c1743c86623 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:02.550263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b8a7a-506f-44ea-b680-9c1743c86623 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:02.585407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bed481-4572-4b93-8e6b-d167ccd97e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:02.586019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bed481-4572-4b93-8e6b-d167ccd97e66 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:02.586291 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bed481-4572-4b93-8e6b-d167ccd97e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:02.586555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bed481-4572-4b93-8e6b-d167ccd97e66 None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:02.587190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bed481-4572-4b93-8e6b-d167ccd97e66 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:02.587486 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bed481-4572-4b93-8e6b-d167ccd97e66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:02.588880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bed481-4572-4b93-8e6b-d167ccd97e66 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:02.599742 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 498/993] 10.222.0.39 () {56 vars in 1122 bytes} [Sun Aug 7 00:54:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:02.600879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28d012-6f3c-43d2-b356-dd81ec69e0a2 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:02.657833 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:02.707835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28d012-6f3c-43d2-b356-dd81ec69e0a2 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:02.743813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a51f56-d8fc-4376-a867-44a891204e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:02.744455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a51f56-d8fc-4376-a867-44a891204e4f None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:02.744730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a51f56-d8fc-4376-a867-44a891204e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:02.744998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a51f56-d8fc-4376-a867-44a891204e4f None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:02.745635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a51f56-d8fc-4376-a867-44a891204e4f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:02.745931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a51f56-d8fc-4376-a867-44a891204e4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:02.747380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a51f56-d8fc-4376-a867-44a891204e4f None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:02.757642 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 496/994] 10.222.0.39 () {56 vars in 1122 bytes} [Sun Aug 7 00:54:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:02.758823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bed481-4572-4b93-8e6b-d167ccd97e66 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:02.820039 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:02.862380 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bed481-4572-4b93-8e6b-d167ccd97e66 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:02.897332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4408e6b-f2e3-4146-86a1-c89dd65da34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:02.897939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4408e6b-f2e3-4146-86a1-c89dd65da34b None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:02.898212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4408e6b-f2e3-4146-86a1-c89dd65da34b None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:02.898510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4408e6b-f2e3-4146-86a1-c89dd65da34b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:02.899186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4408e6b-f2e3-4146-86a1-c89dd65da34b None admin] RBAC: Adding query filter params (interface=admin, service_id=47db6d7051ce470e82e218631b446c00, region_id=RegionOne) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:02.899487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4408e6b-f2e3-4146-86a1-c89dd65da34b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:02.900921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4408e6b-f2e3-4146-86a1-c89dd65da34b None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:02.911536 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 499/995] 10.222.0.39 () {56 vars in 1249 bytes} [Sun Aug 7 00:54:02 2022] GET /identity/v3/endpoints?service_id=47db6d7051ce470e82e218631b446c00&interface=admin®ion_id=RegionOne => generated 193 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:02.912751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a51f56-d8fc-4376-a867-44a891204e4f None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:02.970204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5e074-e032-4dec-badb-5d3aadd48bbf None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:02.970489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5e074-e032-4dec-badb-5d3aadd48bbf None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:02.970759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5e074-e032-4dec-badb-5d3aadd48bbf None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:02.972166 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 500/996] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:54:02.977421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f39b28-2205-4512-a747-898251c51794 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:02.977712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f39b28-2205-4512-a747-898251c51794 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:02.977979 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f39b28-2205-4512-a747-898251c51794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:02.998923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d8f39b28-2205-4512-a747-898251c51794 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:54:03.000265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d8f39b28-2205-4512-a747-898251c51794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:54:03.037186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a51f56-d8fc-4376-a867-44a891204e4f None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:03.057820 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:03.081341 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2781a9e-9af1-4ac5-aa62-9c735eccc8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:03.081982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2781a9e-9af1-4ac5-aa62-9c735eccc8c3 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:03.082261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2781a9e-9af1-4ac5-aa62-9c735eccc8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:03.082528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2781a9e-9af1-4ac5-aa62-9c735eccc8c3 None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:03.083143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2781a9e-9af1-4ac5-aa62-9c735eccc8c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:03.084610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2781a9e-9af1-4ac5-aa62-9c735eccc8c3 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:03.085769 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 501/997] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:54:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:54:03.100105 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 497/998] 10.222.0.39 () {56 vars in 1087 bytes} [Sun Aug 7 00:54:02 2022] GET /identity/v3/services => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 00:54:03.100764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f39b28-2205-4512-a747-898251c51794 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:03.167088 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:03.220782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f39b28-2205-4512-a747-898251c51794 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:03.264633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52747a91-71cb-4cf4-a893-42898718ecaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:03.265275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52747a91-71cb-4cf4-a893-42898718ecaa None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:03.265570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52747a91-71cb-4cf4-a893-42898718ecaa None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:03.265880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52747a91-71cb-4cf4-a893-42898718ecaa None admin] PATH_INFO: `/v3/services/image` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:03.266449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52747a91-71cb-4cf4-a893-42898718ecaa None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:03.267837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52747a91-71cb-4cf4-a893-42898718ecaa None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:03.279067 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-52747a91-71cb-4cf4-a893-42898718ecaa None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 00:54:03.279067 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:03.279067 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:54:03.279067 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:54:03.279067 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:54:03.279067 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:54:03.279067 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:54:03.279067 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:54:03.279067 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 00:54:03.279067 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:54:03.279067 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:54:03.279067 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:54:03.279067 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:03.279067 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:54:03.279067 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:54:03.279067 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:54:03.279067 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:54:03.280301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:54:03.280301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:54:03.280301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:54:03.280301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:54:03.280301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:54:03.280301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:54:03.280301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:54:03.280301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:54:03.280301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:54:03.280301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:54:03.280301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:54:03.280301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:54:03.280301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:54:03.280301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:54:03.280301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:54:03.280301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:54:03.281145 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:54:03.281145 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:54:03.281145 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:54:03.281145 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:54:03.281145 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:54:03.281145 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:54:03.281145 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:54:03.281145 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:54:03.281145 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:54:03.281145 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:54:03.281145 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:54:03.281145 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:54:03.281145 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 00:54:03.281145 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:54:03.281145 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 502/999] 10.222.0.39 () {56 vars in 1105 bytes} [Sun Aug 7 00:54:03 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:54:03.288101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2781a9e-9af1-4ac5-aa62-9c735eccc8c3 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:03.368385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f183e56-2197-4b69-a33f-cb533d9b0fc6 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:03.368571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f183e56-2197-4b69-a33f-cb533d9b0fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:03.368850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f183e56-2197-4b69-a33f-cb533d9b0fc6 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:03.370203 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 503/1000] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:54:03.375689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaab2bb-ca25-40d6-97b9-45b5ef781b9e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:03.376010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaab2bb-ca25-40d6-97b9-45b5ef781b9e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:03.376288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaab2bb-ca25-40d6-97b9-45b5ef781b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:03.395168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3eaab2bb-ca25-40d6-97b9-45b5ef781b9e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:54:03.396409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3eaab2bb-ca25-40d6-97b9-45b5ef781b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:54:03.404827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2781a9e-9af1-4ac5-aa62-9c735eccc8c3 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:03.443250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb73b86-b2ed-4604-b279-84999e2da015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:03.443860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb73b86-b2ed-4604-b279-84999e2da015 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:03.444242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb73b86-b2ed-4604-b279-84999e2da015 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:03.444510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb73b86-b2ed-4604-b279-84999e2da015 None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:03.445157 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb73b86-b2ed-4604-b279-84999e2da015 None admin] RBAC: Adding query filter params (name=image) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:03.445461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb73b86-b2ed-4604-b279-84999e2da015 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:03.446837 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb73b86-b2ed-4604-b279-84999e2da015 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:03.452941 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 498/1001] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:54:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:03.458680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb73b86-b2ed-4604-b279-84999e2da015 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:03.477143 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 504/1002] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:54:03 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:54:03.500117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaab2bb-ca25-40d6-97b9-45b5ef781b9e None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:03.510749 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:03.554261 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:03.571867 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb73b86-b2ed-4604-b279-84999e2da015 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:03.611065 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaab2bb-ca25-40d6-97b9-45b5ef781b9e None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:03.611713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd829bab-0025-48ab-83c9-57d66b74b287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:03.612515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd829bab-0025-48ab-83c9-57d66b74b287 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:03.612790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd829bab-0025-48ab-83c9-57d66b74b287 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:03.613056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd829bab-0025-48ab-83c9-57d66b74b287 None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:03.613696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd829bab-0025-48ab-83c9-57d66b74b287 None admin] RBAC: Adding query filter params (type=image) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:03.613993 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd829bab-0025-48ab-83c9-57d66b74b287 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:03.615350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd829bab-0025-48ab-83c9-57d66b74b287 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:03.620356 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 499/1003] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:54:03 2022] GET /identity/v3/services?type=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:54:03.651014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6f1b8-b275-46fd-a5df-56c8168708fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:03.651673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6f1b8-b275-46fd-a5df-56c8168708fc None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:03.651986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6f1b8-b275-46fd-a5df-56c8168708fc None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:03.652263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6f1b8-b275-46fd-a5df-56c8168708fc None admin] PATH_INFO: `/v3/services/compute` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:03.653402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6f1b8-b275-46fd-a5df-56c8168708fc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:03.654818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6f1b8-b275-46fd-a5df-56c8168708fc None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:03.664730 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-5bd6f1b8-b275-46fd-a5df-56c8168708fc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 00:54:03.664730 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:03.664730 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:54:03.664730 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:54:03.664730 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:54:03.664730 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:54:03.664730 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:54:03.664730 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:54:03.664730 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 00:54:03.664730 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:54:03.664730 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:54:03.664730 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:54:03.664730 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:03.664730 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:54:03.664730 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:54:03.664730 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:54:03.664730 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:54:03.665898 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:54:03.665898 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:54:03.665898 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:54:03.665898 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:54:03.665898 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:54:03.665898 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:54:03.665898 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:54:03.665898 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:54:03.665898 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:54:03.665898 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:54:03.665898 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:54:03.665898 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:54:03.665898 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:54:03.665898 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:54:03.665898 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:54:03.665898 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:54:03.672604 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:54:03.672604 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:54:03.672604 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:54:03.672604 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:54:03.672604 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:54:03.672604 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:54:03.672604 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:54:03.672604 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:54:03.672604 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:54:03.672604 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:54:03.672604 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:54:03.672604 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:54:03.672604 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 07 00:54:03.672604 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:54:03.672604 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 505/1004] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:54:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:54:03.675312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd829bab-0025-48ab-83c9-57d66b74b287 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:03.806049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd829bab-0025-48ab-83c9-57d66b74b287 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:03.817558 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:03.846559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3ec9f-8af7-4dba-903c-cb206d70be19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:03.847217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3ec9f-8af7-4dba-903c-cb206d70be19 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:03.847533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3ec9f-8af7-4dba-903c-cb206d70be19 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:03.847826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3ec9f-8af7-4dba-903c-cb206d70be19 None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:03.848584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3ec9f-8af7-4dba-903c-cb206d70be19 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:03.848925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3ec9f-8af7-4dba-903c-cb206d70be19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:03.850424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3ec9f-8af7-4dba-903c-cb206d70be19 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:03.860015 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 500/1005] 10.222.0.39 () {56 vars in 1112 bytes} [Sun Aug 7 00:54:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:03.862501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6f1b8-b275-46fd-a5df-56c8168708fc None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:03.989429 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6f1b8-b275-46fd-a5df-56c8168708fc None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:04.003768 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:04.028626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b258a8-f412-4b4c-bf0f-4d8f4f0c8106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:04.029253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b258a8-f412-4b4c-bf0f-4d8f4f0c8106 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:04.029536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b258a8-f412-4b4c-bf0f-4d8f4f0c8106 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:04.029999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b258a8-f412-4b4c-bf0f-4d8f4f0c8106 None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:04.031201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b258a8-f412-4b4c-bf0f-4d8f4f0c8106 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:04.032391 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b258a8-f412-4b4c-bf0f-4d8f4f0c8106 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:04.033366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b258a8-f412-4b4c-bf0f-4d8f4f0c8106 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:04.040564 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 506/1006] 10.222.0.39 () {56 vars in 1112 bytes} [Sun Aug 7 00:54:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:04.046551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3ec9f-8af7-4dba-903c-cb206d70be19 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:04.159799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3ec9f-8af7-4dba-903c-cb206d70be19 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:04.194891 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88f18a-44f0-4701-858c-740da8666577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:04.195496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88f18a-44f0-4701-858c-740da8666577 None admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:04.195770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88f18a-44f0-4701-858c-740da8666577 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:04.196065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88f18a-44f0-4701-858c-740da8666577 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:04.196744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c88f18a-44f0-4701-858c-740da8666577 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:04.198103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c88f18a-44f0-4701-858c-740da8666577 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:04.226845 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 501/1007] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 00:54:04 2022] POST /identity/v3/endpoints => generated 334 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:54:05.345920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e0679-3c55-4102-a49e-d6808838c082 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:05.346517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e0679-3c55-4102-a49e-d6808838c082 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:05.346517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e0679-3c55-4102-a49e-d6808838c082 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:05.351930 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 507/1008] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:54:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:54:05.354406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5ddeb-d3f3-4328-8fa4-f1689290f256 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:05.354948 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5ddeb-d3f3-4328-8fa4-f1689290f256 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:05.355112 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5ddeb-d3f3-4328-8fa4-f1689290f256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:05.379995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1cf5ddeb-d3f3-4328-8fa4-f1689290f256 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:54:05.381521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1cf5ddeb-d3f3-4328-8fa4-f1689290f256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:54:05.417930 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:05.512172 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 502/1009] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:54:05 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:54:05.541405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e0679-3c55-4102-a49e-d6808838c082 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:05.683936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e0679-3c55-4102-a49e-d6808838c082 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:05.726108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d9e11-7b7f-47e4-8be6-f848352a0536 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:05.726392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d9e11-7b7f-47e4-8be6-f848352a0536 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:05.726663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d9e11-7b7f-47e4-8be6-f848352a0536 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:05.728182 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 503/1010] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:54:05.729226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00212f-cd3d-4755-813a-f28ad5db4db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:05.730059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00212f-cd3d-4755-813a-f28ad5db4db7 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:05.730482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00212f-cd3d-4755-813a-f28ad5db4db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:05.730807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00212f-cd3d-4755-813a-f28ad5db4db7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:05.731509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a00212f-cd3d-4755-813a-f28ad5db4db7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:05.733438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74494e24-8d53-4198-90fe-c27dbd1d5423 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:05.733644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a00212f-cd3d-4755-813a-f28ad5db4db7 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:05.733743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74494e24-8d53-4198-90fe-c27dbd1d5423 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:05.733975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74494e24-8d53-4198-90fe-c27dbd1d5423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:05.744840 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-8a00212f-cd3d-4755-813a-f28ad5db4db7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:54:05.744840 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:05.744840 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:54:05.744840 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:54:05.744840 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:54:05.744840 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:54:05.744840 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:54:05.744840 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:54:05.744840 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:54:05.744840 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:54:05.744840 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:54:05.744840 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:54:05.744840 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:05.744840 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:54:05.744840 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:54:05.744840 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:54:05.744840 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:54:05.752931 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:54:05.752931 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:54:05.752931 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:54:05.752931 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:54:05.752931 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:54:05.752931 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:54:05.752931 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:54:05.752931 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:54:05.752931 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:54:05.752931 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:54:05.752931 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:54:05.752931 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:54:05.752931 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:54:05.752931 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:54:05.752931 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:54:05.752931 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:54:05.754009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:54:05.754009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:54:05.754009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:54:05.754009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:54:05.754009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:54:05.754009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:54:05.754009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:54:05.754009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:54:05.754009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:54:05.754009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:54:05.754009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:54:05.754009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:54:05.754009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 07 00:54:05.754009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:54:05.754009 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 508/1011] 10.222.0.39 () {56 vars in 1126 bytes} [Sun Aug 7 00:54:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:54:05.756128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00212f-cd3d-4755-813a-f28ad5db4db7 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:05.760762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-74494e24-8d53-4198-90fe-c27dbd1d5423 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:54:05.762584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-74494e24-8d53-4198-90fe-c27dbd1d5423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:54:05.820542 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:05.846372 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 504/1012] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:54:05 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:54:05.871907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74494e24-8d53-4198-90fe-c27dbd1d5423 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:05.918843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00212f-cd3d-4755-813a-f28ad5db4db7 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:05.974291 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcb5bc-8f64-4dac-9d45-6eb2bee35ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:05.974953 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcb5bc-8f64-4dac-9d45-6eb2bee35ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:05.975266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcb5bc-8f64-4dac-9d45-6eb2bee35ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:05.975541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcb5bc-8f64-4dac-9d45-6eb2bee35ec5 None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:05.976444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcb5bc-8f64-4dac-9d45-6eb2bee35ec5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:05.979761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcb5bc-8f64-4dac-9d45-6eb2bee35ec5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:05.979761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcb5bc-8f64-4dac-9d45-6eb2bee35ec5 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:05.990920 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 509/1013] 10.222.0.39 () {56 vars in 1122 bytes} [Sun Aug 7 00:54:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:54:05.992335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcb5bc-8f64-4dac-9d45-6eb2bee35ec5 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:05.996467 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:06.023368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74494e24-8d53-4198-90fe-c27dbd1d5423 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:06.077075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d159b-e45a-483d-80d9-a48706b71fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:06.077931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d159b-e45a-483d-80d9-a48706b71fd1 None admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:06.078649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d159b-e45a-483d-80d9-a48706b71fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:06.079061 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d159b-e45a-483d-80d9-a48706b71fd1 None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:06.079911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d159b-e45a-483d-80d9-a48706b71fd1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:06.083287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d159b-e45a-483d-80d9-a48706b71fd1 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:06.102141 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 505/1014] 10.222.0.39 () {60 vars in 1141 bytes} [Sun Aug 7 00:54:05 2022] POST /identity/v3/services => generated 242 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 00:54:06.139371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcb5bc-8f64-4dac-9d45-6eb2bee35ec5 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:06.144106 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:06.197644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1d005-7289-44fa-8465-bb65acae78f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:06.198269 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1d005-7289-44fa-8465-bb65acae78f4 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:06.198540 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1d005-7289-44fa-8465-bb65acae78f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:06.198819 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1d005-7289-44fa-8465-bb65acae78f4 None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:06.200149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e1d005-7289-44fa-8465-bb65acae78f4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:06.200503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e1d005-7289-44fa-8465-bb65acae78f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:06.201914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e1d005-7289-44fa-8465-bb65acae78f4 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:06.213990 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 510/1015] 10.222.0.39 () {56 vars in 1122 bytes} [Sun Aug 7 00:54:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:54:06.215397 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d159b-e45a-483d-80d9-a48706b71fd1 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:06.365452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d159b-e45a-483d-80d9-a48706b71fd1 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:06.411611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037287d2-68d0-416e-b9f9-514d00066485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:06.412410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037287d2-68d0-416e-b9f9-514d00066485 None admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:06.412694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037287d2-68d0-416e-b9f9-514d00066485 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:06.412981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037287d2-68d0-416e-b9f9-514d00066485 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:06.413878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037287d2-68d0-416e-b9f9-514d00066485 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:06.415587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037287d2-68d0-416e-b9f9-514d00066485 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:06.437399 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 506/1016] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 00:54:06 2022] POST /identity/v3/endpoints => generated 325 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:54:06.606113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7efbb5-f3af-469b-9d93-6a5f3497b7b1 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:06.606657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7efbb5-f3af-469b-9d93-6a5f3497b7b1 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:06.606657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7efbb5-f3af-469b-9d93-6a5f3497b7b1 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:06.608416 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 511/1017] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:54:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:54:06.614615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e3ac1-a408-493e-a25b-64e7727980c6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:06.614910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e3ac1-a408-493e-a25b-64e7727980c6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:06.615171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e3ac1-a408-493e-a25b-64e7727980c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:06.624632 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:06.639749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9d7e3ac1-a408-493e-a25b-64e7727980c6 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:54:06.641256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9d7e3ac1-a408-493e-a25b-64e7727980c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:54:06.748346 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 507/1018] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:54:06 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:54:06.774012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7efbb5-f3af-469b-9d93-6a5f3497b7b1 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:06.903936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7efbb5-f3af-469b-9d93-6a5f3497b7b1 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:06.942219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94b39d-3c1c-427a-9ad1-3b12bee05077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:06.942851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94b39d-3c1c-427a-9ad1-3b12bee05077 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:06.943123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94b39d-3c1c-427a-9ad1-3b12bee05077 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:06.943390 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94b39d-3c1c-427a-9ad1-3b12bee05077 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:06.954082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94b39d-3c1c-427a-9ad1-3b12bee05077 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:54:06.958868 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-fd94b39d-3c1c-427a-9ad1-3b12bee05077 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 00:54:06.958868 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:06.958868 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:54:06.958868 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:54:06.958868 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:54:06.958868 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:54:06.958868 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:54:06.958868 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:54:06.958868 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:54:06.958868 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:54:06.958868 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:54:06.958868 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:54:06.958868 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:54:06.958868 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:54:06.958868 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:54:06.958868 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:54:06.960211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:54:06.960211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:54:06.960211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:54:06.960211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:54:06.960211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:54:06.960211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:54:06.960211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:54:06.960211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:54:06.960211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:54:06.960211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:54:06.960211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:54:06.960211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:54:06.960211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:54:06.960211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:54:06.960211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:54:06.960211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:54:06.961413 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:54:06.961413 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:54:06.961413 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:54:06.961413 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:54:06.961413 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:54:06.961413 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:54:06.961413 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:54:06.961413 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:54:06.961413 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:54:06.961413 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:54:06.961413 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 00:54:06.961413 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:54:06.967928 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 512/1019] 10.222.0.39 () {56 vars in 1120 bytes} [Sun Aug 7 00:54:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:54:06.968175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e3ac1-a408-493e-a25b-64e7727980c6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:07.097966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e3ac1-a408-493e-a25b-64e7727980c6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:07.142553 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:07.150496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32815a20-00a3-485c-a048-a252bf88ccaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:07.151166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32815a20-00a3-485c-a048-a252bf88ccaa None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:07.151392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32815a20-00a3-485c-a048-a252bf88ccaa None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:07.151657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32815a20-00a3-485c-a048-a252bf88ccaa None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:07.152466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32815a20-00a3-485c-a048-a252bf88ccaa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:07.152767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32815a20-00a3-485c-a048-a252bf88ccaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:07.154210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32815a20-00a3-485c-a048-a252bf88ccaa None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:07.166395 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 508/1020] 10.222.0.39 () {56 vars in 1115 bytes} [Sun Aug 7 00:54:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:54:07.172757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94b39d-3c1c-427a-9ad1-3b12bee05077 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:07.209144 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:07.310991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94b39d-3c1c-427a-9ad1-3b12bee05077 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:07.364888 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496224ab-8fd9-4f05-be18-7d285e785b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:07.365531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496224ab-8fd9-4f05-be18-7d285e785b8f None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:07.365807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496224ab-8fd9-4f05-be18-7d285e785b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:07.366077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496224ab-8fd9-4f05-be18-7d285e785b8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:07.381746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496224ab-8fd9-4f05-be18-7d285e785b8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:07.385040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496224ab-8fd9-4f05-be18-7d285e785b8f None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:07.403965 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-496224ab-8fd9-4f05-be18-7d285e785b8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:54:07.403965 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:07.403965 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:54:07.403965 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:54:07.403965 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:54:07.403965 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:54:07.403965 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:54:07.403965 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:54:07.403965 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:54:07.403965 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:54:07.403965 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:54:07.403965 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:54:07.403965 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:54:07.403965 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:54:07.403965 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:54:07.403965 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:54:07.405332 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:54:07.405332 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:54:07.405332 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:54:07.405332 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:54:07.405332 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:54:07.405332 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:54:07.405332 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:54:07.405332 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:54:07.405332 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:54:07.405332 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:54:07.405332 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:54:07.405332 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:54:07.405332 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:54:07.405332 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:54:07.405332 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:54:07.405332 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:54:07.405332 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:54:07.407163 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:54:07.407163 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:54:07.407163 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:54:07.407756 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 513/1021] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:54:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:54:07.410947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32815a20-00a3-485c-a048-a252bf88ccaa None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:07.552371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32815a20-00a3-485c-a048-a252bf88ccaa None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:07.603758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f1edb-464a-4be0-b7c3-75e922045211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:07.605155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f1edb-464a-4be0-b7c3-75e922045211 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:07.605959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f1edb-464a-4be0-b7c3-75e922045211 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:07.606654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f1edb-464a-4be0-b7c3-75e922045211 None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:07.608028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f1edb-464a-4be0-b7c3-75e922045211 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:07.608777 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f1edb-464a-4be0-b7c3-75e922045211 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:07.611512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f1edb-464a-4be0-b7c3-75e922045211 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:07.639917 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 509/1022] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:07.641969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496224ab-8fd9-4f05-be18-7d285e785b8f None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:07.727008 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:07.752496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496224ab-8fd9-4f05-be18-7d285e785b8f None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:07.793864 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2403a-c340-4af8-b09d-a313596530e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:07.794501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2403a-c340-4af8-b09d-a313596530e9 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:07.794770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2403a-c340-4af8-b09d-a313596530e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:07.795034 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2403a-c340-4af8-b09d-a313596530e9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:07.803027 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2403a-c340-4af8-b09d-a313596530e9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:07.804513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2403a-c340-4af8-b09d-a313596530e9 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:07.816064 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-d5c2403a-c340-4af8-b09d-a313596530e9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:54:07.816064 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:07.816064 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:54:07.816064 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:54:07.816064 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:54:07.816064 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:54:07.816064 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:54:07.816064 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:54:07.816064 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:54:07.816064 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:54:07.816064 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:54:07.816064 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:54:07.816064 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:54:07.816064 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:54:07.816064 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:54:07.816064 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:54:07.817229 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:54:07.817229 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:54:07.817229 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:54:07.817229 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:54:07.817229 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:54:07.817229 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:54:07.817229 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:54:07.817229 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:54:07.817229 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:54:07.817229 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:54:07.817229 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:54:07.817229 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:54:07.817229 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:54:07.817229 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:54:07.817229 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:54:07.817229 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:54:07.817229 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:54:07.817229 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:54:07.818243 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:54:07.818243 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:54:07.818243 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:54:07.818243 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:54:07.818243 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:54:07.818243 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:54:07.818243 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:54:07.818243 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:54:07.818243 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:54:07.818243 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:54:07.818243 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 514/1023] 10.222.0.39 () {56 vars in 1093 bytes} [Sun Aug 7 00:54:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:54:07.825610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f1edb-464a-4be0-b7c3-75e922045211 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:07.880688 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:07.932523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f1edb-464a-4be0-b7c3-75e922045211 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:07.972699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33399f-81cc-46f9-8c9e-c0dddbfe773a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:07.973316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33399f-81cc-46f9-8c9e-c0dddbfe773a None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:07.973590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33399f-81cc-46f9-8c9e-c0dddbfe773a None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:07.973853 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33399f-81cc-46f9-8c9e-c0dddbfe773a None admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:07.974584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e33399f-81cc-46f9-8c9e-c0dddbfe773a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:07.974880 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e33399f-81cc-46f9-8c9e-c0dddbfe773a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:07.979269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e33399f-81cc-46f9-8c9e-c0dddbfe773a None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:08.002976 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 510/1024] 10.222.0.39 () {56 vars in 1133 bytes} [Sun Aug 7 00:54:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:08.004248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2403a-c340-4af8-b09d-a313596530e9 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:08.109238 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2403a-c340-4af8-b09d-a313596530e9 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:08.144606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f8867-52dc-4ec8-84d8-c44202929cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:08.145210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f8867-52dc-4ec8-84d8-c44202929cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:08.145554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f8867-52dc-4ec8-84d8-c44202929cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:08.145824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f8867-52dc-4ec8-84d8-c44202929cb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:08.149653 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:08.231433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f8867-52dc-4ec8-84d8-c44202929cb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:08.232789 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f8867-52dc-4ec8-84d8-c44202929cb4 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:08.265548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d8df9-f39b-488b-9903-4d5045ef17ea None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:08.265835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d8df9-f39b-488b-9903-4d5045ef17ea None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:08.266136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d8df9-f39b-488b-9903-4d5045ef17ea None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:08.267622 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 511/1025] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:54:08.274074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6aaa8-736a-4328-8fc3-96f56ba2100e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:08.274074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6aaa8-736a-4328-8fc3-96f56ba2100e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:08.274074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6aaa8-736a-4328-8fc3-96f56ba2100e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:08.296587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-cdb6aaa8-736a-4328-8fc3-96f56ba2100e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:54:08.298520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cdb6aaa8-736a-4328-8fc3-96f56ba2100e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:54:08.356113 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 515/1026] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:54:08 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:54:08.357410 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f8867-52dc-4ec8-84d8-c44202929cb4 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:08.394322 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:08.394519 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 512/1027] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:54:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:54:08.417530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6aaa8-736a-4328-8fc3-96f56ba2100e None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:08.461952 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:08.475872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f8867-52dc-4ec8-84d8-c44202929cb4 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:08.512986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc11b6-d36b-4e2c-affe-a8c4dc2a2289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:08.513533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc11b6-d36b-4e2c-affe-a8c4dc2a2289 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:08.513808 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc11b6-d36b-4e2c-affe-a8c4dc2a2289 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:08.514137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc11b6-d36b-4e2c-affe-a8c4dc2a2289 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:08.524384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6aaa8-736a-4328-8fc3-96f56ba2100e None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:08.525601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc11b6-d36b-4e2c-affe-a8c4dc2a2289 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:08.527407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc11b6-d36b-4e2c-affe-a8c4dc2a2289 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:08.543661 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-e0dc11b6-d36b-4e2c-affe-a8c4dc2a2289 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:54:08.543661 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:08.543661 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:54:08.543661 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:54:08.543661 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:54:08.543661 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:54:08.543661 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:54:08.543661 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:54:08.543661 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:54:08.543661 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:54:08.543661 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:54:08.543661 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:54:08.543661 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:54:08.543661 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:54:08.543661 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:54:08.543661 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:54:08.544805 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:54:08.544805 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:54:08.544805 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:54:08.544805 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:54:08.544805 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:54:08.544805 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:54:08.544805 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:54:08.544805 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:54:08.544805 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:54:08.544805 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:54:08.544805 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:54:08.544805 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:54:08.544805 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:54:08.544805 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:54:08.544805 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:54:08.544805 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:54:08.544805 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:54:08.545792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:54:08.545792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:54:08.545792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:54:08.545792 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 516/1028] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:54:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:54:08.550605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc11b6-d36b-4e2c-affe-a8c4dc2a2289 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:08.565704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59531439-7fd0-4785-8ee1-35cfac690e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:08.566899 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59531439-7fd0-4785-8ee1-35cfac690e9b None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:08.567360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59531439-7fd0-4785-8ee1-35cfac690e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:08.567779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59531439-7fd0-4785-8ee1-35cfac690e9b None admin] PATH_INFO: `/v3/services/image` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:08.568547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59531439-7fd0-4785-8ee1-35cfac690e9b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:08.570300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59531439-7fd0-4785-8ee1-35cfac690e9b None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:08.581189 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-59531439-7fd0-4785-8ee1-35cfac690e9b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 00:54:08.581189 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:08.581189 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:54:08.581189 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:54:08.581189 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:54:08.581189 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:54:08.581189 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:54:08.581189 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:54:08.581189 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 00:54:08.581189 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:54:08.581189 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:54:08.581189 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:54:08.581189 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:08.581189 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:54:08.581189 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:54:08.581189 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:54:08.581189 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:54:08.587333 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:54:08.587333 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:54:08.587333 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:54:08.587333 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:54:08.587333 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:54:08.587333 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:54:08.587333 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:54:08.587333 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:54:08.587333 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:54:08.587333 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:54:08.587333 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:54:08.587333 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:54:08.587333 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:54:08.587333 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:54:08.587333 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:54:08.587333 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:54:08.588313 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:54:08.588313 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:54:08.588313 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:54:08.588313 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:54:08.588313 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:54:08.588313 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:54:08.588313 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:54:08.588313 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:54:08.588313 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:54:08.588313 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:54:08.588313 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:54:08.588313 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:54:08.588313 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 00:54:08.588313 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:54:08.588313 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 513/1029] 10.222.0.39 () {56 vars in 1105 bytes} [Sun Aug 7 00:54:08 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:54:08.589142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59531439-7fd0-4785-8ee1-35cfac690e9b None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:08.648203 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:08.660339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc11b6-d36b-4e2c-affe-a8c4dc2a2289 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:08.695945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa472381-7764-401b-a7c8-19c4fbc8e9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:08.696568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa472381-7764-401b-a7c8-19c4fbc8e9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:08.696846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa472381-7764-401b-a7c8-19c4fbc8e9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:08.697115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa472381-7764-401b-a7c8-19c4fbc8e9c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:08.697267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59531439-7fd0-4785-8ee1-35cfac690e9b None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:08.697770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa472381-7764-401b-a7c8-19c4fbc8e9c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:08.698073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa472381-7764-401b-a7c8-19c4fbc8e9c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:08.700119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa472381-7764-401b-a7c8-19c4fbc8e9c3 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:08.701495 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:08.713090 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 517/1030] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:54:08.714422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb1e6a-cbfa-448b-ad9c-46a87878acc5 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:08.714768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb1e6a-cbfa-448b-ad9c-46a87878acc5 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:08.715043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb1e6a-cbfa-448b-ad9c-46a87878acc5 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:08.716575 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 518/1031] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:54:08.718453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb1e6a-cbfa-448b-ad9c-46a87878acc5 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:08.738194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d7917-8bd2-42ef-b5b7-331c20fbaa7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:08.738838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d7917-8bd2-42ef-b5b7-331c20fbaa7f None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:08.739113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d7917-8bd2-42ef-b5b7-331c20fbaa7f None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:08.739381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d7917-8bd2-42ef-b5b7-331c20fbaa7f None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:08.740057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d7917-8bd2-42ef-b5b7-331c20fbaa7f None admin] RBAC: Adding query filter params (name=image) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:08.740357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d7917-8bd2-42ef-b5b7-331c20fbaa7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:08.741759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d7917-8bd2-42ef-b5b7-331c20fbaa7f None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:08.747578 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 514/1032] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:54:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:54:08.748887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e2e00-88d1-4603-9b73-2817a32bddba None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:08.749172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e2e00-88d1-4603-9b73-2817a32bddba None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:08.749438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e2e00-88d1-4603-9b73-2817a32bddba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:08.767563 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c17e2e00-88d1-4603-9b73-2817a32bddba None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:54:08.768703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c17e2e00-88d1-4603-9b73-2817a32bddba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:54:08.829115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb1e6a-cbfa-448b-ad9c-46a87878acc5 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:08.839042 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 515/1033] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:54:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:54:08.840487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e2e00-88d1-4603-9b73-2817a32bddba None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:08.868260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4166a0-0bdc-4565-838f-a39774d77d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:08.868903 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4166a0-0bdc-4565-838f-a39774d77d1e None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:08.869176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4166a0-0bdc-4565-838f-a39774d77d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:08.869447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4166a0-0bdc-4565-838f-a39774d77d1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:08.876926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4166a0-0bdc-4565-838f-a39774d77d1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:08.878384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4166a0-0bdc-4565-838f-a39774d77d1e None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:08.889894 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-be4166a0-0bdc-4565-838f-a39774d77d1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:54:08.889894 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:08.889894 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:54:08.889894 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:54:08.889894 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:54:08.889894 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:54:08.889894 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:54:08.889894 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:54:08.889894 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:54:08.889894 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:54:08.889894 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:54:08.889894 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:54:08.889894 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:54:08.889894 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:54:08.889894 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:54:08.890882 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:54:08.890882 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:54:08.890882 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:54:08.890882 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:54:08.890882 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:54:08.890882 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:54:08.890882 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:54:08.890882 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:54:08.890882 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:54:08.890882 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:54:08.890882 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:54:08.890882 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:54:08.890882 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:54:08.890882 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:54:08.890882 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:54:08.890882 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:54:08.890882 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:54:08.891912 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:54:08.891912 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:54:08.891912 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:54:08.891912 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:54:08.891912 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:54:08.891912 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:54:08.891912 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:54:08.891912 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:54:08.895931 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 519/1034] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:54:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:54:08.897019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4166a0-0bdc-4565-838f-a39774d77d1e None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:08.908083 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:08.941631 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:08.945616 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e2e00-88d1-4603-9b73-2817a32bddba None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:08.981858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c4d83-7320-44d9-be09-5c8bc97920a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:08.982743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c4d83-7320-44d9-be09-5c8bc97920a7 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:08.982743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c4d83-7320-44d9-be09-5c8bc97920a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:08.983353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6c4d83-7320-44d9-be09-5c8bc97920a7 None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:08.983631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c4d83-7320-44d9-be09-5c8bc97920a7 None admin] RBAC: Adding query filter params (type=image) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:08.983964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c4d83-7320-44d9-be09-5c8bc97920a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:08.985355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6c4d83-7320-44d9-be09-5c8bc97920a7 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:08.990578 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 516/1035] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:54:08 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:08.991398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c4d83-7320-44d9-be09-5c8bc97920a7 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:09.007411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4166a0-0bdc-4565-838f-a39774d77d1e None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:09.047427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ff5cc-f9d5-4711-87c0-d1af65863d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:09.048016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ff5cc-f9d5-4711-87c0-d1af65863d87 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:09.048293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ff5cc-f9d5-4711-87c0-d1af65863d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:09.048566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ff5cc-f9d5-4711-87c0-d1af65863d87 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:09.049884 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ff5cc-f9d5-4711-87c0-d1af65863d87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:09.051535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ff5cc-f9d5-4711-87c0-d1af65863d87 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:09.053325 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 520/1036] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:54:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:09.054155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ff5cc-f9d5-4711-87c0-d1af65863d87 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:09.130132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6c4d83-7320-44d9-be09-5c8bc97920a7 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:09.145162 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:09.166964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8857056-f637-48d1-b1fa-17fbba80a841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:09.167579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8857056-f637-48d1-b1fa-17fbba80a841 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:09.168683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8857056-f637-48d1-b1fa-17fbba80a841 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:09.169028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8857056-f637-48d1-b1fa-17fbba80a841 None admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:09.169391 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ff5cc-f9d5-4711-87c0-d1af65863d87 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:09.169739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8857056-f637-48d1-b1fa-17fbba80a841 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:09.170046 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8857056-f637-48d1-b1fa-17fbba80a841 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:09.171484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8857056-f637-48d1-b1fa-17fbba80a841 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:09.183992 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 517/1037] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:54:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:09.184827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8857056-f637-48d1-b1fa-17fbba80a841 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:09.203671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f30c5-8aed-4d44-a3e7-08b88c8bb056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:09.204316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f30c5-8aed-4d44-a3e7-08b88c8bb056 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:09.204585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f30c5-8aed-4d44-a3e7-08b88c8bb056 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:09.204858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f30c5-8aed-4d44-a3e7-08b88c8bb056 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:09.205567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f30c5-8aed-4d44-a3e7-08b88c8bb056 None admin] RBAC: Adding query filter params (interface=public, service_id=ebcaa86d3d8f4308851d858ea13f0d05, region_id=RegionOne) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:09.205868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f30c5-8aed-4d44-a3e7-08b88c8bb056 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:09.207244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f30c5-8aed-4d44-a3e7-08b88c8bb056 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:09.212517 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 521/1038] 10.222.0.39 () {56 vars in 1251 bytes} [Sun Aug 7 00:54:09 2022] GET /identity/v3/endpoints?service_id=ebcaa86d3d8f4308851d858ea13f0d05&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:09.213298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f30c5-8aed-4d44-a3e7-08b88c8bb056 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:09.214357 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:09.295346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8857056-f637-48d1-b1fa-17fbba80a841 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:09.323653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f30c5-8aed-4d44-a3e7-08b88c8bb056 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:09.330281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3eb41-4438-4e33-8534-dab3d3e8a936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:09.330897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3eb41-4438-4e33-8534-dab3d3e8a936 None admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:09.331189 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3eb41-4438-4e33-8534-dab3d3e8a936 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:09.331457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3eb41-4438-4e33-8534-dab3d3e8a936 None admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:09.332190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3eb41-4438-4e33-8534-dab3d3e8a936 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:09.333645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3eb41-4438-4e33-8534-dab3d3e8a936 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:09.363475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ef900-1293-4e97-9c66-c3e3a9e8a9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:09.364118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ef900-1293-4e97-9c66-c3e3a9e8a9e2 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:09.364393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ef900-1293-4e97-9c66-c3e3a9e8a9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:09.364660 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ef900-1293-4e97-9c66-c3e3a9e8a9e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:09.365493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ef900-1293-4e97-9c66-c3e3a9e8a9e2 None admin] RBAC: Adding query filter params (role.id=e5cdf0e52e1d42efb54f7af9a731d3a5, scope.project.id=1cd2efda8567437e983e3a7867ecd69b, user.id=6c70d5a72d424db68de7c7b8257fe02c) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:09.365493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ef900-1293-4e97-9c66-c3e3a9e8a9e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:09.366012 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 518/1039] 10.222.0.39 () {60 vars in 1141 bytes} [Sun Aug 7 00:54:09 2022] POST /identity/v3/projects => generated 311 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:54:09.366835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3eb41-4438-4e33-8534-dab3d3e8a936 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:09.367192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ef900-1293-4e97-9c66-c3e3a9e8a9e2 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:09.375074 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 522/1040] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:54:09 2022] GET /identity/v3/role_assignments?user.id=6c70d5a72d424db68de7c7b8257fe02c&scope.project.id=1cd2efda8567437e983e3a7867ecd69b&role.id=e5cdf0e52e1d42efb54f7af9a731d3a5 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:09.465720 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:09.501893 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3eb41-4438-4e33-8534-dab3d3e8a936 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:09.544453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ba77e-fc96-4041-96ec-9a5a5bf32153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:09.544813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ba77e-fc96-4041-96ec-9a5a5bf32153 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:09.545090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ba77e-fc96-4041-96ec-9a5a5bf32153 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:09.545357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ba77e-fc96-4041-96ec-9a5a5bf32153 None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:09.545983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ba77e-fc96-4041-96ec-9a5a5bf32153 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:09.547371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ba77e-fc96-4041-96ec-9a5a5bf32153 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:09.554745 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 519/1041] 10.222.0.39 () {56 vars in 1087 bytes} [Sun Aug 7 00:54:09 2022] GET /identity/v3/services => generated 1957 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 00:54:11.452046 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243afaa3-cd23-4112-b889-f88c6db7cc32 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:11.452579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243afaa3-cd23-4112-b889-f88c6db7cc32 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:11.452579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243afaa3-cd23-4112-b889-f88c6db7cc32 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:11.453927 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 523/1042] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:54:11.459728 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38335ddc-3bd2-4407-914d-e95c9e5c78cc None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:11.460258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38335ddc-3bd2-4407-914d-e95c9e5c78cc None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:11.460343 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38335ddc-3bd2-4407-914d-e95c9e5c78cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:11.478808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-38335ddc-3bd2-4407-914d-e95c9e5c78cc None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:54:11.480009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-38335ddc-3bd2-4407-914d-e95c9e5c78cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:54:11.547715 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493b1c1-162d-4c51-869e-26f547f1c4cc None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:11.548055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493b1c1-162d-4c51-869e-26f547f1c4cc None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:11.548494 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493b1c1-162d-4c51-869e-26f547f1c4cc None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:11.550072 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 524/1043] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:54:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:54:11.554322 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 520/1044] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:54:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:54:11.555406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65612ad7-9c74-4aa4-b9d8-56c34d3db623 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:11.555703 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65612ad7-9c74-4aa4-b9d8-56c34d3db623 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:11.556014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65612ad7-9c74-4aa4-b9d8-56c34d3db623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:11.569332 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:11.578321 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38335ddc-3bd2-4407-914d-e95c9e5c78cc None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:11.581219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-65612ad7-9c74-4aa4-b9d8-56c34d3db623 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:54:11.582447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-65612ad7-9c74-4aa4-b9d8-56c34d3db623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:54:11.651749 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 525/1045] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:54:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:54:11.652691 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:11.657300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b936b-9a48-49ea-92ec-e44c48a9a224 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:11.657586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b936b-9a48-49ea-92ec-e44c48a9a224 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:11.657860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307b936b-9a48-49ea-92ec-e44c48a9a224 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:11.659191 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 526/1046] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:54:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:54:11.664649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5ab83-65dd-4476-a132-d5525f0743e2 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:11.664931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5ab83-65dd-4476-a132-d5525f0743e2 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:11.665199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5ab83-65dd-4476-a132-d5525f0743e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:11.683973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f6d5ab83-65dd-4476-a132-d5525f0743e2 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:54:11.685156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f6d5ab83-65dd-4476-a132-d5525f0743e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:54:11.692903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38335ddc-3bd2-4407-914d-e95c9e5c78cc None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:11.728555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ebd08-e496-40b9-88a1-7d82b2625f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:11.729104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ebd08-e496-40b9-88a1-7d82b2625f3e None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:11.729384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ebd08-e496-40b9-88a1-7d82b2625f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:11.729655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ebd08-e496-40b9-88a1-7d82b2625f3e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:11.740331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ebd08-e496-40b9-88a1-7d82b2625f3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:54:11.745042 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-8c0ebd08-e496-40b9-88a1-7d82b2625f3e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 00:54:11.745042 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:11.745042 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:54:11.745042 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:54:11.745042 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:54:11.745042 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:54:11.745042 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:54:11.745042 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:54:11.745042 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:54:11.745042 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:54:11.745042 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:54:11.745042 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:54:11.745042 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:54:11.745042 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:54:11.745042 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:54:11.745042 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:54:11.746261 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:54:11.746261 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:54:11.746261 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:54:11.746261 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:54:11.746261 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:54:11.746261 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:54:11.746261 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:54:11.746261 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:54:11.746261 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:54:11.746261 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:54:11.746261 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:54:11.746261 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:54:11.746261 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:54:11.746261 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:54:11.746261 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:54:11.746261 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:54:11.747291 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:54:11.747291 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:54:11.747291 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:54:11.747291 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:54:11.747291 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:54:11.747291 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:54:11.747291 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:54:11.747291 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:54:11.747291 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:54:11.747291 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:54:11.747291 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 00:54:11.747291 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:54:11.747291 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 521/1047] 10.222.0.39 () {56 vars in 1120 bytes} [Sun Aug 7 00:54:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:54:11.747291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ebd08-e496-40b9-88a1-7d82b2625f3e None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:11.754203 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 527/1048] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:54:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:54:11.755057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5ab83-65dd-4476-a132-d5525f0743e2 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:11.824856 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:11.851397 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ebd08-e496-40b9-88a1-7d82b2625f3e None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:11.863675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5ab83-65dd-4476-a132-d5525f0743e2 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:11.882416 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:11.892538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc0d89-3e4e-4f39-8c84-3d97651fd782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:11.893173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc0d89-3e4e-4f39-8c84-3d97651fd782 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:11.893449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc0d89-3e4e-4f39-8c84-3d97651fd782 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:11.893718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc0d89-3e4e-4f39-8c84-3d97651fd782 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:11.894898 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc0d89-3e4e-4f39-8c84-3d97651fd782 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:11.896388 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc0d89-3e4e-4f39-8c84-3d97651fd782 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:11.898236 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 522/1049] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:54:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:11.899006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc0d89-3e4e-4f39-8c84-3d97651fd782 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:11.907626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36118afc-6e43-479e-b948-d7fee24b71dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:11.908268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36118afc-6e43-479e-b948-d7fee24b71dc None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:11.908553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36118afc-6e43-479e-b948-d7fee24b71dc None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:11.908830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36118afc-6e43-479e-b948-d7fee24b71dc None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:11.909499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36118afc-6e43-479e-b948-d7fee24b71dc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:11.909797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36118afc-6e43-479e-b948-d7fee24b71dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:11.911163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36118afc-6e43-479e-b948-d7fee24b71dc None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:11.920783 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 528/1050] 10.222.0.39 () {56 vars in 1115 bytes} [Sun Aug 7 00:54:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:11.921690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36118afc-6e43-479e-b948-d7fee24b71dc None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:12.029437 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc0d89-3e4e-4f39-8c84-3d97651fd782 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:12.032544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36118afc-6e43-479e-b948-d7fee24b71dc None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:12.067188 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:12.077657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03439884-b016-420e-8d82-09a2c4dd6cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:12.078283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03439884-b016-420e-8d82-09a2c4dd6cb0 None admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:12.078417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43927ac6-df69-4fc5-8864-1aea121ac535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:12.078590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03439884-b016-420e-8d82-09a2c4dd6cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:12.078822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03439884-b016-420e-8d82-09a2c4dd6cb0 None admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:12.079230 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43927ac6-df69-4fc5-8864-1aea121ac535 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:12.079472 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03439884-b016-420e-8d82-09a2c4dd6cb0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:12.079733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43927ac6-df69-4fc5-8864-1aea121ac535 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:12.080105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43927ac6-df69-4fc5-8864-1aea121ac535 None admin] PATH_INFO: `/v3/services/image` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:12.080976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03439884-b016-420e-8d82-09a2c4dd6cb0 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:12.081098 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43927ac6-df69-4fc5-8864-1aea121ac535 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:12.082851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43927ac6-df69-4fc5-8864-1aea121ac535 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:12.096260 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-43927ac6-df69-4fc5-8864-1aea121ac535 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 00:54:12.096260 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:12.096260 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:54:12.096260 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:54:12.096260 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:54:12.096260 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:54:12.096260 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:54:12.096260 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:54:12.096260 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 00:54:12.096260 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:54:12.096260 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:54:12.096260 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:54:12.096260 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:12.096260 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:54:12.096260 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:54:12.096260 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:54:12.096260 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:54:12.097919 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:54:12.097919 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:54:12.097919 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:54:12.097919 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:54:12.097919 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:54:12.097919 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:54:12.097919 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:54:12.097919 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:54:12.097919 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:54:12.097919 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:54:12.097919 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:54:12.097919 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:54:12.097919 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:54:12.097919 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:54:12.097919 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:54:12.097919 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:54:12.099536 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:54:12.099536 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:54:12.099536 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:54:12.099536 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:54:12.099536 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:54:12.099536 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:54:12.099536 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:54:12.099536 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:54:12.099536 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:54:12.099536 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:54:12.099536 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:54:12.099536 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:54:12.099536 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 07 00:54:12.099536 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:54:12.099536 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 523/1051] 10.222.0.39 () {56 vars in 1105 bytes} [Sun Aug 7 00:54:11 2022] GET /identity/v3/services/image => generated 86 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:54:12.101124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43927ac6-df69-4fc5-8864-1aea121ac535 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:12.114051 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 529/1052] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Aug 7 00:54:11 2022] POST /identity/v3/users => generated 285 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:54:12.114997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03439884-b016-420e-8d82-09a2c4dd6cb0 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:12.194422 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:12.272657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43927ac6-df69-4fc5-8864-1aea121ac535 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:12.287661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03439884-b016-420e-8d82-09a2c4dd6cb0 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:12.333730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0f084-cb4d-4f89-9ef1-69bea744d85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:12.334649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0f084-cb4d-4f89-9ef1-69bea744d85b None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:12.335038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0f084-cb4d-4f89-9ef1-69bea744d85b None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:12.336519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0f084-cb4d-4f89-9ef1-69bea744d85b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:12.345183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a67f7-d16d-4256-bd90-e8088235b733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:12.346434 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a67f7-d16d-4256-bd90-e8088235b733 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:12.346434 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a67f7-d16d-4256-bd90-e8088235b733 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:12.346729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a67f7-d16d-4256-bd90-e8088235b733 None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:12.347785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a67f7-d16d-4256-bd90-e8088235b733 None admin] RBAC: Adding query filter params (name=image) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:12.348338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a67f7-d16d-4256-bd90-e8088235b733 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:12.350264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a67f7-d16d-4256-bd90-e8088235b733 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:12.353744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0f084-cb4d-4f89-9ef1-69bea744d85b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:12.356406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0f084-cb4d-4f89-9ef1-69bea744d85b None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:12.364434 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 530/1053] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:54:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:12.366226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a67f7-d16d-4256-bd90-e8088235b733 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:12.373498 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-26c0f084-cb4d-4f89-9ef1-69bea744d85b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:54:12.373498 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:12.373498 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:54:12.373498 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:54:12.373498 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:54:12.373498 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:54:12.373498 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:54:12.373498 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:54:12.373498 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:54:12.373498 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:54:12.373498 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:54:12.373498 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:54:12.373498 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:54:12.373498 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:54:12.373498 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:54:12.373498 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:54:12.375403 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:54:12.375403 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:54:12.375403 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:54:12.375403 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:54:12.375403 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:54:12.375403 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:54:12.375403 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:54:12.375403 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:54:12.375403 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:54:12.375403 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:54:12.375403 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:54:12.375403 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:54:12.375403 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:54:12.375403 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:54:12.375403 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:54:12.375403 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:54:12.375403 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:54:12.377256 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:54:12.377256 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:54:12.377256 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:54:12.377256 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 524/1054] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:54:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:54:12.381197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0f084-cb4d-4f89-9ef1-69bea744d85b None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:12.431308 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:12.493688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a67f7-d16d-4256-bd90-e8088235b733 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:12.505073 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0f084-cb4d-4f89-9ef1-69bea744d85b None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:12.520257 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:12.532878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1fa17-d8e7-4e02-a2a3-8216e96ed3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:12.533502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1fa17-d8e7-4e02-a2a3-8216e96ed3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:12.533787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1fa17-d8e7-4e02-a2a3-8216e96ed3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:12.534061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c1fa17-d8e7-4e02-a2a3-8216e96ed3e4 None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:12.534700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c1fa17-d8e7-4e02-a2a3-8216e96ed3e4 None admin] RBAC: Adding query filter params (type=image) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:12.535000 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c1fa17-d8e7-4e02-a2a3-8216e96ed3e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:12.536429 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c1fa17-d8e7-4e02-a2a3-8216e96ed3e4 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:12.541939 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 531/1055] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:54:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:54:12.548095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1fa17-d8e7-4e02-a2a3-8216e96ed3e4 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:12.557642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ee2be-5818-4dc5-9b39-ea51444decbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:12.559248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ee2be-5818-4dc5-9b39-ea51444decbb None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:12.559685 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ee2be-5818-4dc5-9b39-ea51444decbb None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:12.560163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ee2be-5818-4dc5-9b39-ea51444decbb None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:12.561242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ee2be-5818-4dc5-9b39-ea51444decbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:12.561701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ee2be-5818-4dc5-9b39-ea51444decbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:12.564095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ee2be-5818-4dc5-9b39-ea51444decbb None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:12.583089 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 525/1056] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:12.588672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ee2be-5818-4dc5-9b39-ea51444decbb None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:12.663443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c1fa17-d8e7-4e02-a2a3-8216e96ed3e4 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:12.674828 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:12.699687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba270d6d-cb30-4913-a403-104641b5f18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:12.700414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba270d6d-cb30-4913-a403-104641b5f18d None admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:12.700691 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba270d6d-cb30-4913-a403-104641b5f18d None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:12.700961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba270d6d-cb30-4913-a403-104641b5f18d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:12.701633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba270d6d-cb30-4913-a403-104641b5f18d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:12.703014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba270d6d-cb30-4913-a403-104641b5f18d None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:12.705038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ee2be-5818-4dc5-9b39-ea51444decbb None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:12.739911 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 532/1057] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 00:54:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:54:12.764577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812e4d3-f2b2-43ea-98b1-89f9c60c232a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:12.765225 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812e4d3-f2b2-43ea-98b1-89f9c60c232a None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:12.765502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812e4d3-f2b2-43ea-98b1-89f9c60c232a None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:12.765770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812e4d3-f2b2-43ea-98b1-89f9c60c232a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:12.774900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812e4d3-f2b2-43ea-98b1-89f9c60c232a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:12.776415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812e4d3-f2b2-43ea-98b1-89f9c60c232a None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:12.790047 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-5812e4d3-f2b2-43ea-98b1-89f9c60c232a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:54:12.790047 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:12.790047 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:54:12.790047 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:54:12.790047 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:54:12.790047 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:54:12.790047 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:54:12.790047 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:54:12.790047 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:54:12.790047 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:54:12.790047 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:54:12.790047 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:54:12.790047 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:54:12.790047 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:54:12.790047 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:54:12.790047 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:54:12.791230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:54:12.791230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:54:12.791230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:54:12.791230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:54:12.791230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:54:12.791230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:54:12.791230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:54:12.791230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:54:12.791230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:54:12.791230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:54:12.791230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:54:12.791230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:54:12.791230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:54:12.791230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:54:12.791230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:54:12.791230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:54:12.791230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:54:12.791230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:54:12.792319 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:54:12.792319 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:54:12.792319 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:54:12.792319 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:54:12.792319 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:54:12.792319 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:54:12.792319 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:54:12.792319 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:54:12.792319 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:54:12.792319 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:54:12.792319 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 526/1058] 10.222.0.39 () {56 vars in 1093 bytes} [Sun Aug 7 00:54:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:54:12.797659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba270d6d-cb30-4913-a403-104641b5f18d None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:12.918733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba270d6d-cb30-4913-a403-104641b5f18d None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:12.957686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54cbb9a-ccb7-4048-ad4b-237a02602dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:12.958339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cbb9a-ccb7-4048-ad4b-237a02602dfa None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:12.958619 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cbb9a-ccb7-4048-ad4b-237a02602dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:12.958888 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cbb9a-ccb7-4048-ad4b-237a02602dfa None admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:12.959637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54cbb9a-ccb7-4048-ad4b-237a02602dfa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:12.959968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54cbb9a-ccb7-4048-ad4b-237a02602dfa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:12.961416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54cbb9a-ccb7-4048-ad4b-237a02602dfa None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:12.988277 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 533/1059] 10.222.0.39 () {56 vars in 1133 bytes} [Sun Aug 7 00:54:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:12.989551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812e4d3-f2b2-43ea-98b1-89f9c60c232a None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:13.021385 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:13.101624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812e4d3-f2b2-43ea-98b1-89f9c60c232a None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:13.137182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d229943-b652-44a8-a627-9634b1e8a0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:13.137810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d229943-b652-44a8-a627-9634b1e8a0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:13.138088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d229943-b652-44a8-a627-9634b1e8a0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:13.138357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d229943-b652-44a8-a627-9634b1e8a0e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:13.149648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d229943-b652-44a8-a627-9634b1e8a0e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:13.151092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d229943-b652-44a8-a627-9634b1e8a0e3 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:13.165522 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-5d229943-b652-44a8-a627-9634b1e8a0e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:54:13.165522 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:13.165522 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:54:13.165522 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:54:13.165522 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:54:13.165522 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:54:13.165522 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:54:13.165522 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:54:13.165522 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:54:13.165522 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:54:13.165522 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:54:13.165522 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:54:13.165522 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:54:13.165522 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:54:13.165522 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:54:13.165522 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:54:13.166528 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:54:13.166528 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:54:13.166528 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:54:13.166528 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:54:13.166528 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:54:13.166528 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:54:13.166528 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:54:13.166528 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:54:13.166528 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:54:13.166528 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:54:13.166528 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:54:13.166528 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:54:13.166528 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:54:13.166528 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:54:13.166528 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:54:13.166528 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:54:13.166528 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:54:13.167988 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:54:13.167988 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:54:13.167988 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:54:13.167988 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 527/1060] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:54:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:54:13.174261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54cbb9a-ccb7-4048-ad4b-237a02602dfa None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:13.200927 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:13.288192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54cbb9a-ccb7-4048-ad4b-237a02602dfa None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:13.325421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063dd194-b674-405f-b739-9e50aff1fa25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:13.326026 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063dd194-b674-405f-b739-9e50aff1fa25 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:13.326425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063dd194-b674-405f-b739-9e50aff1fa25 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:13.326733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063dd194-b674-405f-b739-9e50aff1fa25 None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:13.327398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063dd194-b674-405f-b739-9e50aff1fa25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:13.327773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063dd194-b674-405f-b739-9e50aff1fa25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:13.329282 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063dd194-b674-405f-b739-9e50aff1fa25 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:13.353975 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 534/1061] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:13.356432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d229943-b652-44a8-a627-9634b1e8a0e3 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:13.498716 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:13.520873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d229943-b652-44a8-a627-9634b1e8a0e3 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:13.559529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26976a00-9323-4c5d-a19e-a31e64aaa845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:13.560188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26976a00-9323-4c5d-a19e-a31e64aaa845 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:13.560466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26976a00-9323-4c5d-a19e-a31e64aaa845 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:13.560737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26976a00-9323-4c5d-a19e-a31e64aaa845 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:13.567757 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26976a00-9323-4c5d-a19e-a31e64aaa845 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:13.569254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26976a00-9323-4c5d-a19e-a31e64aaa845 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:13.580681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-26976a00-9323-4c5d-a19e-a31e64aaa845 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:54:13.580681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:13.580681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:54:13.580681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:54:13.580681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:54:13.580681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:54:13.580681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:54:13.580681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:54:13.580681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:54:13.580681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:54:13.580681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:54:13.580681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:54:13.580681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:54:13.580681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:54:13.580681 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:54:13.581673 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:54:13.581673 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:54:13.581673 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:54:13.581673 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:54:13.581673 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:54:13.581673 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:54:13.581673 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:54:13.581673 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:54:13.581673 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:54:13.581673 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:54:13.581673 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:54:13.581673 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:54:13.581673 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:54:13.581673 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:54:13.581673 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:54:13.581673 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:54:13.581673 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:54:13.582601 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:54:13.582601 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:54:13.582601 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:54:13.582601 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:54:13.582601 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:54:13.582601 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:54:13.582601 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:54:13.582601 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:54:13.584244 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 528/1062] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:54:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:54:13.587761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063dd194-b674-405f-b739-9e50aff1fa25 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:13.682178 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:13.699590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063dd194-b674-405f-b739-9e50aff1fa25 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:13.735179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a528dc3-153b-4660-bc95-713bce2926fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:13.735781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a528dc3-153b-4660-bc95-713bce2926fb None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:13.736088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a528dc3-153b-4660-bc95-713bce2926fb None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:13.736358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a528dc3-153b-4660-bc95-713bce2926fb None admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:13.737056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a528dc3-153b-4660-bc95-713bce2926fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:13.737357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a528dc3-153b-4660-bc95-713bce2926fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:13.738790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a528dc3-153b-4660-bc95-713bce2926fb None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:13.754743 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 535/1063] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:54:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:13.757930 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26976a00-9323-4c5d-a19e-a31e64aaa845 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:13.868392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26976a00-9323-4c5d-a19e-a31e64aaa845 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:13.908688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701b458-9f8b-4265-a976-2745c324b719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:13.909361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701b458-9f8b-4265-a976-2745c324b719 None admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:13.909694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701b458-9f8b-4265-a976-2745c324b719 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:13.910113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701b458-9f8b-4265-a976-2745c324b719 None admin] PATH_INFO: `/v3/projects/1cd2efda8567437e983e3a7867ecd69b/users/6c70d5a72d424db68de7c7b8257fe02c/roles/e5cdf0e52e1d42efb54f7af9a731d3a5` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:13.912564 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701b458-9f8b-4265-a976-2745c324b719 None admin] RBAC: Authorizing `identity:create_grant(project_id=1cd2efda8567437e983e3a7867ecd69b, user_id=6c70d5a72d424db68de7c7b8257fe02c, role_id=e5cdf0e52e1d42efb54f7af9a731d3a5)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:13.914012 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701b458-9f8b-4265-a976-2745c324b719 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:13.924926 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:13.935000 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 529/1064] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Aug 7 00:54:13 2022] PUT /identity/v3/projects/1cd2efda8567437e983e3a7867ecd69b/users/6c70d5a72d424db68de7c7b8257fe02c/roles/e5cdf0e52e1d42efb54f7af9a731d3a5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:54:14.358180 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615965e-e84b-477a-9289-bb049dfddd60 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:14.358455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615965e-e84b-477a-9289-bb049dfddd60 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:14.358717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615965e-e84b-477a-9289-bb049dfddd60 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:14.360143 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 536/1065] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:54:14.365483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f63d3-0e0c-494b-a18c-bc560c375c5e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:14.365768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f63d3-0e0c-494b-a18c-bc560c375c5e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:14.366043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f63d3-0e0c-494b-a18c-bc560c375c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:14.384863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d34f63d3-0e0c-494b-a18c-bc560c375c5e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:54:14.386063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d34f63d3-0e0c-494b-a18c-bc560c375c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:54:14.456420 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 530/1066] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:54:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:54:14.479725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615965e-e84b-477a-9289-bb049dfddd60 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:14.587295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615965e-e84b-477a-9289-bb049dfddd60 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:14.623186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d135c7-30de-44c8-b165-60f0694f1511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:14.623825 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d135c7-30de-44c8-b165-60f0694f1511 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:14.624102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d135c7-30de-44c8-b165-60f0694f1511 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:14.624272 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d135c7-30de-44c8-b165-60f0694f1511 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:14.634919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d135c7-30de-44c8-b165-60f0694f1511 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:54:14.640195 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-43d135c7-30de-44c8-b165-60f0694f1511 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:54:14.640195 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:14.640195 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:54:14.640195 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:54:14.640195 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:54:14.640195 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:54:14.640195 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:54:14.640195 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:54:14.640195 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:54:14.640195 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:54:14.640195 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:54:14.640195 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:54:14.640195 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:54:14.640195 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:54:14.640195 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:54:14.640195 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:54:14.641218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:54:14.641218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:54:14.641218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:54:14.641218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:54:14.641218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:54:14.641218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:54:14.641218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:54:14.641218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:54:14.641218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:54:14.641218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:54:14.641218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:54:14.641218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:54:14.641218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:54:14.641218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:54:14.641218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:54:14.641218 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:54:14.642069 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:54:14.642069 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:54:14.642069 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:54:14.642069 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:54:14.642069 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:54:14.642069 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:54:14.642069 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:54:14.642069 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:54:14.642069 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:54:14.642069 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:54:14.642069 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:54:14.642069 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:54:14.642069 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 537/1067] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:54:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:54:14.649093 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f63d3-0e0c-494b-a18c-bc560c375c5e None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:14.752383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f63d3-0e0c-494b-a18c-bc560c375c5e None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:14.801997 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:14.813277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c4c91-d746-4e19-86cc-833e02650ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:14.814308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c4c91-d746-4e19-86cc-833e02650ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:14.814773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c4c91-d746-4e19-86cc-833e02650ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:14.815225 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c4c91-d746-4e19-86cc-833e02650ab8 None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:14.816491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c4c91-d746-4e19-86cc-833e02650ab8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:14.817022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c4c91-d746-4e19-86cc-833e02650ab8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:14.819028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c4c91-d746-4e19-86cc-833e02650ab8 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:14.826218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1221525-fb0c-47ee-86de-7c2b9a608fcd None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:14.826503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1221525-fb0c-47ee-86de-7c2b9a608fcd None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:14.826785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1221525-fb0c-47ee-86de-7c2b9a608fcd None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:14.828435 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 538/1068] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:54:14.830025 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 531/1069] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:54:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:54:14.834101 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5c263-6600-47e3-ae21-e963ce5bb0aa None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:14.834457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5c263-6600-47e3-ae21-e963ce5bb0aa None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:14.834740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af5c263-6600-47e3-ae21-e963ce5bb0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:14.835567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c4c91-d746-4e19-86cc-833e02650ab8 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:14.842693 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:14.854622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0af5c263-6600-47e3-ae21-e963ce5bb0aa None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:54:14.855981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0af5c263-6600-47e3-ae21-e963ce5bb0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:54:14.936313 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 539/1070] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:54:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:54:14.947510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c4c91-d746-4e19-86cc-833e02650ab8 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:14.952414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5c263-6600-47e3-ae21-e963ce5bb0aa None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:14.984283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fb809-81c1-4138-9c10-607debb1e1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:14.984922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fb809-81c1-4138-9c10-607debb1e1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:14.985201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fb809-81c1-4138-9c10-607debb1e1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:14.985527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fb809-81c1-4138-9c10-607debb1e1c3 None admin] PATH_INFO: `/v3/users/de2f63ac369a42fa8174533073d1236a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:15.000239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0fb809-81c1-4138-9c10-607debb1e1c3 None admin] RBAC: Authorizing `identity:get_user(user_id=de2f63ac369a42fa8174533073d1236a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:15.001722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0fb809-81c1-4138-9c10-607debb1e1c3 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:15.003406 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 532/1071] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:54:14 2022] GET /identity/v3/users/de2f63ac369a42fa8174533073d1236a => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:15.009016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fb809-81c1-4138-9c10-607debb1e1c3 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:15.073054 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:15.075755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af5c263-6600-47e3-ae21-e963ce5bb0aa None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:15.114974 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f9a083-6d1e-4212-abbf-7017bc87443c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:15.115588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9a083-6d1e-4212-abbf-7017bc87443c None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:15.115862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9a083-6d1e-4212-abbf-7017bc87443c None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:15.116158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9a083-6d1e-4212-abbf-7017bc87443c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:15.119047 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:15.128822 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fb809-81c1-4138-9c10-607debb1e1c3 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:15.167206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72705d9-6920-4932-b0fc-9a2cc6d6c74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:15.167878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72705d9-6920-4932-b0fc-9a2cc6d6c74b None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:15.168191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72705d9-6920-4932-b0fc-9a2cc6d6c74b None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:15.168466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72705d9-6920-4932-b0fc-9a2cc6d6c74b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:15.196500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f9a083-6d1e-4212-abbf-7017bc87443c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:15.198314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f9a083-6d1e-4212-abbf-7017bc87443c None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:15.241778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72705d9-6920-4932-b0fc-9a2cc6d6c74b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:15.243615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72705d9-6920-4932-b0fc-9a2cc6d6c74b None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:15.301889 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:15.307457 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 540/1072] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:54:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 00:54:15.314360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f9a083-6d1e-4212-abbf-7017bc87443c None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:15.347774 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:15.362293 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 533/1073] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:54:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 00:54:15.367698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72705d9-6920-4932-b0fc-9a2cc6d6c74b None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:15.427211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f9a083-6d1e-4212-abbf-7017bc87443c None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:15.466285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9a9a2-b512-4ef4-9ec9-3dafe5e5ad5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:15.466946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9a9a2-b512-4ef4-9ec9-3dafe5e5ad5a None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:15.467219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9a9a2-b512-4ef4-9ec9-3dafe5e5ad5a None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:15.467486 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9a9a2-b512-4ef4-9ec9-3dafe5e5ad5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:15.474592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72705d9-6920-4932-b0fc-9a2cc6d6c74b None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:15.478605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9a9a2-b512-4ef4-9ec9-3dafe5e5ad5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:15.480847 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9a9a2-b512-4ef4-9ec9-3dafe5e5ad5a None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:15.497809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-e8a9a9a2-b512-4ef4-9ec9-3dafe5e5ad5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:54:15.497809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:15.497809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:54:15.497809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:54:15.497809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:54:15.497809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:54:15.497809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:54:15.497809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:54:15.497809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:54:15.497809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:54:15.497809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:54:15.497809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:54:15.497809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:54:15.497809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:54:15.497809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:54:15.497809 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:54:15.498820 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:54:15.498820 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:54:15.498820 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:54:15.498820 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:54:15.498820 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:54:15.498820 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:54:15.498820 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:54:15.498820 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:54:15.498820 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:54:15.498820 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:54:15.498820 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:54:15.498820 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:54:15.498820 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:54:15.498820 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:54:15.498820 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:54:15.498820 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:54:15.498820 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:54:15.499961 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:54:15.499961 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:54:15.499961 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:54:15.506222 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 541/1074] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:54:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:54:15.507541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9a9a2-b512-4ef4-9ec9-3dafe5e5ad5a None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:15.510714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75056622-6a0b-46d3-a0ee-7a07ed19dca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:15.511417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75056622-6a0b-46d3-a0ee-7a07ed19dca9 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:15.511684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75056622-6a0b-46d3-a0ee-7a07ed19dca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:15.512004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75056622-6a0b-46d3-a0ee-7a07ed19dca9 None admin] PATH_INFO: `/v3/projects/82c4b601702d4e97822ec14d9b3ff8f5` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:15.513156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75056622-6a0b-46d3-a0ee-7a07ed19dca9 None admin] RBAC: Authorizing `identity:get_project(project_id=82c4b601702d4e97822ec14d9b3ff8f5)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:15.514581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75056622-6a0b-46d3-a0ee-7a07ed19dca9 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:15.516255 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 534/1075] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:54:15 2022] GET /identity/v3/projects/82c4b601702d4e97822ec14d9b3ff8f5 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:54:15.522500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75056622-6a0b-46d3-a0ee-7a07ed19dca9 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:15.543074 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:15.603847 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:15.621066 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9a9a2-b512-4ef4-9ec9-3dafe5e5ad5a None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:15.637474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75056622-6a0b-46d3-a0ee-7a07ed19dca9 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:15.659432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23ed5e-9c9a-4661-b289-a7ca93f093f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:15.660200 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23ed5e-9c9a-4661-b289-a7ca93f093f9 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:15.660419 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23ed5e-9c9a-4661-b289-a7ca93f093f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:15.660688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23ed5e-9c9a-4661-b289-a7ca93f093f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:15.661332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23ed5e-9c9a-4661-b289-a7ca93f093f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:15.661630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23ed5e-9c9a-4661-b289-a7ca93f093f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:15.663244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23ed5e-9c9a-4661-b289-a7ca93f093f9 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:15.675402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810126c-31c8-4a86-b3bf-fba8bc981808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:15.676145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810126c-31c8-4a86-b3bf-fba8bc981808 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:15.676325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810126c-31c8-4a86-b3bf-fba8bc981808 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:15.676597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810126c-31c8-4a86-b3bf-fba8bc981808 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:15.677071 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 542/1076] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:54:15.680412 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810126c-31c8-4a86-b3bf-fba8bc981808 None admin] RBAC: Adding query filter params (role.id=695b07606e564668bac7afff4ab6052a, scope.project.id=82c4b601702d4e97822ec14d9b3ff8f5, user.id=de2f63ac369a42fa8174533073d1236a) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:15.680736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810126c-31c8-4a86-b3bf-fba8bc981808 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:15.682212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810126c-31c8-4a86-b3bf-fba8bc981808 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:15.692985 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 535/1077] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:54:15 2022] GET /identity/v3/role_assignments?user.id=de2f63ac369a42fa8174533073d1236a&scope.project.id=82c4b601702d4e97822ec14d9b3ff8f5&role.id=695b07606e564668bac7afff4ab6052a => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:54:16.001946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d393e5a-fc30-46a9-9b6e-d56c3d440c2d None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:16.002234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d393e5a-fc30-46a9-9b6e-d56c3d440c2d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:16.002510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d393e5a-fc30-46a9-9b6e-d56c3d440c2d None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:16.003869 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 543/1078] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:54:16.009045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785d502-c62a-4907-a921-24f5e96a50dd None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:16.009331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785d502-c62a-4907-a921-24f5e96a50dd None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:16.009604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785d502-c62a-4907-a921-24f5e96a50dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:16.028940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2785d502-c62a-4907-a921-24f5e96a50dd None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:54:16.030120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2785d502-c62a-4907-a921-24f5e96a50dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:54:16.097265 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 536/1079] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:54:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:54:16.120901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d393e5a-fc30-46a9-9b6e-d56c3d440c2d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:16.228506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d393e5a-fc30-46a9-9b6e-d56c3d440c2d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:16.264526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68594cb0-7ed2-462e-9315-671312e52c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:16.265063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68594cb0-7ed2-462e-9315-671312e52c67 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:16.265337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68594cb0-7ed2-462e-9315-671312e52c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:16.265603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68594cb0-7ed2-462e-9315-671312e52c67 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:16.279951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68594cb0-7ed2-462e-9315-671312e52c67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:54:16.284733 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-68594cb0-7ed2-462e-9315-671312e52c67 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 00:54:16.284733 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:16.284733 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:54:16.284733 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:54:16.284733 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:54:16.284733 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:54:16.284733 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:54:16.284733 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:54:16.284733 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:54:16.284733 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:54:16.284733 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:54:16.284733 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:54:16.284733 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:54:16.284733 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:54:16.284733 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:54:16.284733 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:54:16.285692 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:54:16.285692 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:54:16.285692 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:54:16.285692 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:54:16.285692 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:54:16.285692 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:54:16.285692 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:54:16.285692 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:54:16.285692 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:54:16.285692 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:54:16.285692 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:54:16.285692 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:54:16.285692 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:54:16.285692 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:54:16.285692 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:54:16.285692 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:54:16.286982 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:54:16.286982 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:54:16.286982 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:54:16.286982 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:54:16.286982 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:54:16.286982 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:54:16.286982 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:54:16.286982 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:54:16.286982 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:54:16.286982 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:54:16.286982 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 07 00:54:16.286982 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:54:16.286982 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 544/1080] 10.222.0.39 () {56 vars in 1120 bytes} [Sun Aug 7 00:54:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:54:16.291937 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785d502-c62a-4907-a921-24f5e96a50dd None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:16.306660 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:16.391938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785d502-c62a-4907-a921-24f5e96a50dd None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:16.427511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d635974-1864-47e8-a99e-66a65b2ef2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:16.428148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d635974-1864-47e8-a99e-66a65b2ef2ca None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:16.428427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d635974-1864-47e8-a99e-66a65b2ef2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:16.428697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d635974-1864-47e8-a99e-66a65b2ef2ca None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:16.429375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d635974-1864-47e8-a99e-66a65b2ef2ca None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:16.429677 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d635974-1864-47e8-a99e-66a65b2ef2ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:16.431044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d635974-1864-47e8-a99e-66a65b2ef2ca None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:16.440286 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 537/1081] 10.222.0.39 () {56 vars in 1115 bytes} [Sun Aug 7 00:54:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:16.446023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68594cb0-7ed2-462e-9315-671312e52c67 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:16.456978 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:16.553971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68594cb0-7ed2-462e-9315-671312e52c67 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:16.587218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e8d44-9195-4769-8926-519ee4fd85a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:16.587832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e8d44-9195-4769-8926-519ee4fd85a2 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:16.588127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e8d44-9195-4769-8926-519ee4fd85a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:16.588394 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e8d44-9195-4769-8926-519ee4fd85a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:16.598602 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e8d44-9195-4769-8926-519ee4fd85a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:16.600056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e8d44-9195-4769-8926-519ee4fd85a2 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:16.613614 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-f33e8d44-9195-4769-8926-519ee4fd85a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:54:16.613614 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:16.613614 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:54:16.613614 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:54:16.613614 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:54:16.613614 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:54:16.613614 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:54:16.613614 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:54:16.613614 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:54:16.613614 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:54:16.613614 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:54:16.613614 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:54:16.613614 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:54:16.613614 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:54:16.613614 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:54:16.613614 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:54:16.614766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:54:16.614766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:54:16.614766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:54:16.614766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:54:16.614766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:54:16.614766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:54:16.614766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:54:16.614766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:54:16.614766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:54:16.614766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:54:16.614766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:54:16.614766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:54:16.614766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:54:16.614766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:54:16.614766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:54:16.614766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:54:16.614766 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:54:16.615680 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:54:16.615680 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:54:16.615680 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:54:16.615680 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 545/1082] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:54:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:54:16.621288 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d635974-1864-47e8-a99e-66a65b2ef2ca None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:16.697009 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:16.723235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d635974-1864-47e8-a99e-66a65b2ef2ca None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:16.761700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3dc48b-ee0e-44b9-8920-7336aab8f1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:16.762242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3dc48b-ee0e-44b9-8920-7336aab8f1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:16.762520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3dc48b-ee0e-44b9-8920-7336aab8f1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:16.762790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3dc48b-ee0e-44b9-8920-7336aab8f1b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:16.763460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3dc48b-ee0e-44b9-8920-7336aab8f1b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:16.763760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3dc48b-ee0e-44b9-8920-7336aab8f1b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:16.765205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3dc48b-ee0e-44b9-8920-7336aab8f1b1 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:16.779058 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 538/1083] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:16.785081 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e8d44-9195-4769-8926-519ee4fd85a2 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:16.851714 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:16.900141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e8d44-9195-4769-8926-519ee4fd85a2 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:16.937590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794a254-762e-4e8d-951b-f86cc9df2cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:16.938252 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794a254-762e-4e8d-951b-f86cc9df2cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:16.938519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794a254-762e-4e8d-951b-f86cc9df2cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:16.938792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794a254-762e-4e8d-951b-f86cc9df2cb5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:16.947228 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794a254-762e-4e8d-951b-f86cc9df2cb5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:16.948768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794a254-762e-4e8d-951b-f86cc9df2cb5 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:16.960807 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-a794a254-762e-4e8d-951b-f86cc9df2cb5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:54:16.960807 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:16.960807 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:54:16.960807 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:54:16.960807 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:54:16.960807 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:54:16.960807 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:54:16.960807 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:54:16.960807 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:54:16.960807 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:54:16.960807 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:54:16.960807 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:54:16.960807 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:54:16.960807 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:54:16.960807 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:54:16.960807 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:54:16.961921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:54:16.961921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:54:16.961921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:54:16.961921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:54:16.961921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:54:16.961921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:54:16.961921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:54:16.961921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:54:16.961921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:54:16.961921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:54:16.961921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:54:16.961921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:54:16.961921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:54:16.961921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:54:16.961921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:54:16.961921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:54:16.961921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:54:16.961921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:54:16.962874 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:54:16.962874 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:54:16.962874 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:54:16.962874 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:54:16.962874 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:54:16.962874 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:54:16.962874 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:54:16.962874 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:54:16.962874 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 07 00:54:16.962874 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:54:16.962874 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 546/1084] 10.222.0.39 () {56 vars in 1093 bytes} [Sun Aug 7 00:54:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:54:16.968847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3dc48b-ee0e-44b9-8920-7336aab8f1b1 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:17.079092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3dc48b-ee0e-44b9-8920-7336aab8f1b1 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:17.119560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8086c1-5433-4cc1-8c5b-13000f5b9cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:17.120121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8086c1-5433-4cc1-8c5b-13000f5b9cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:17.120484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8086c1-5433-4cc1-8c5b-13000f5b9cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:17.120753 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8086c1-5433-4cc1-8c5b-13000f5b9cc0 None admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:17.121488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8086c1-5433-4cc1-8c5b-13000f5b9cc0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:17.121790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8086c1-5433-4cc1-8c5b-13000f5b9cc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:17.123221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8086c1-5433-4cc1-8c5b-13000f5b9cc0 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:17.124985 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:17.143094 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 539/1085] 10.222.0.39 () {56 vars in 1133 bytes} [Sun Aug 7 00:54:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:17.149340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794a254-762e-4e8d-951b-f86cc9df2cb5 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:17.254256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794a254-762e-4e8d-951b-f86cc9df2cb5 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:17.274252 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:17.296501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e325d-a289-454f-9c20-ee3ebf0ca6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:17.297204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e325d-a289-454f-9c20-ee3ebf0ca6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:17.297666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e325d-a289-454f-9c20-ee3ebf0ca6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:17.298132 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e325d-a289-454f-9c20-ee3ebf0ca6e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:17.373477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e325d-a289-454f-9c20-ee3ebf0ca6e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:17.374853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e325d-a289-454f-9c20-ee3ebf0ca6e7 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:17.497376 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 547/1086] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:54:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 00:54:17.504585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8086c1-5433-4cc1-8c5b-13000f5b9cc0 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:17.627701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8086c1-5433-4cc1-8c5b-13000f5b9cc0 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:17.669678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99682558-e3d0-43df-82bd-357e216558ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:17.670642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99682558-e3d0-43df-82bd-357e216558ee None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:17.671069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99682558-e3d0-43df-82bd-357e216558ee None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:17.671528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99682558-e3d0-43df-82bd-357e216558ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:17.688439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99682558-e3d0-43df-82bd-357e216558ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:17.690050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99682558-e3d0-43df-82bd-357e216558ee None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:17.706077 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-99682558-e3d0-43df-82bd-357e216558ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:54:17.706077 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:17.706077 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:54:17.706077 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:54:17.706077 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:54:17.706077 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:54:17.706077 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:54:17.706077 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:54:17.706077 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:54:17.706077 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:54:17.706077 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:54:17.706077 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:54:17.706077 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:54:17.706077 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:54:17.706077 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:54:17.706077 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:54:17.707828 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:54:17.707828 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:54:17.707828 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:54:17.707828 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:54:17.707828 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:54:17.707828 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:54:17.707828 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:54:17.707828 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:54:17.707828 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:54:17.707828 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:54:17.707828 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:54:17.707828 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:54:17.707828 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:54:17.707828 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:54:17.707828 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:54:17.707828 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:54:17.707828 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:54:17.709324 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:54:17.709324 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:54:17.709324 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:54:17.712088 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 540/1087] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:54:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:54:17.712982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e325d-a289-454f-9c20-ee3ebf0ca6e7 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:17.733138 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:17.793325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42db22-5c1d-40a4-b65d-0410e2b8a2e7 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:17.793598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42db22-5c1d-40a4-b65d-0410e2b8a2e7 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:17.793865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42db22-5c1d-40a4-b65d-0410e2b8a2e7 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:17.795224 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 541/1088] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:54:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:54:17.800535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f26ea-79bc-4568-aaae-8f05c0d51853 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:17.800814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f26ea-79bc-4568-aaae-8f05c0d51853 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:17.801084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f26ea-79bc-4568-aaae-8f05c0d51853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:17.819039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e325d-a289-454f-9c20-ee3ebf0ca6e7 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:17.825699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7d4f26ea-79bc-4568-aaae-8f05c0d51853 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:54:17.826915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7d4f26ea-79bc-4568-aaae-8f05c0d51853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:54:17.858047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ffa9f-aa94-4bf4-8848-42e2aaa44dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:17.858662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ffa9f-aa94-4bf4-8848-42e2aaa44dae None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:17.858933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ffa9f-aa94-4bf4-8848-42e2aaa44dae None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:17.859217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ffa9f-aa94-4bf4-8848-42e2aaa44dae None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:17.859870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ffa9f-aa94-4bf4-8848-42e2aaa44dae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:17.860210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ffa9f-aa94-4bf4-8848-42e2aaa44dae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:17.861590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ffa9f-aa94-4bf4-8848-42e2aaa44dae None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:17.870418 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:17.874464 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 548/1089] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:17.880895 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ffa9f-aa94-4bf4-8848-42e2aaa44dae None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:17.898625 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 542/1090] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:54:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:54:17.922797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f26ea-79bc-4568-aaae-8f05c0d51853 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:17.990055 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:18.021648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ffa9f-aa94-4bf4-8848-42e2aaa44dae None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:18.034484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f26ea-79bc-4568-aaae-8f05c0d51853 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:18.056067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56990041-2cc7-4141-91a2-ce9c8c7a2249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:18.056691 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56990041-2cc7-4141-91a2-ce9c8c7a2249 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:18.056966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56990041-2cc7-4141-91a2-ce9c8c7a2249 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:18.057235 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56990041-2cc7-4141-91a2-ce9c8c7a2249 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:18.063797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56990041-2cc7-4141-91a2-ce9c8c7a2249 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:18.065259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56990041-2cc7-4141-91a2-ce9c8c7a2249 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:18.076317 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-56990041-2cc7-4141-91a2-ce9c8c7a2249 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:54:18.076317 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:18.076317 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:54:18.076317 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:54:18.076317 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:54:18.076317 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:54:18.076317 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:54:18.076317 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:54:18.076317 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:54:18.076317 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:54:18.076317 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:54:18.076317 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:54:18.076317 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:54:18.076317 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:54:18.076317 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:54:18.077396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:54:18.077396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:54:18.077396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:54:18.077396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:54:18.077396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:54:18.077396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:54:18.077396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:54:18.077396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:54:18.077396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:54:18.077396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:54:18.077396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:54:18.077396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:54:18.077396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:54:18.077396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:54:18.077396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:54:18.077396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:54:18.077396 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:54:18.078324 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:54:18.078324 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:54:18.078324 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:54:18.078324 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:54:18.078324 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:54:18.078324 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:54:18.078324 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:54:18.078324 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:54:18.078324 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 549/1091] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:54:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:54:18.082305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321f12c-0653-4a16-911f-f1288fc77dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:18.082936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321f12c-0653-4a16-911f-f1288fc77dad None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:18.083267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321f12c-0653-4a16-911f-f1288fc77dad None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:18.083542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321f12c-0653-4a16-911f-f1288fc77dad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:18.086196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56990041-2cc7-4141-91a2-ce9c8c7a2249 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:18.094919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4321f12c-0653-4a16-911f-f1288fc77dad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:54:18.099780 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-4321f12c-0653-4a16-911f-f1288fc77dad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:54:18.099780 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:18.099780 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:54:18.099780 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:54:18.099780 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:54:18.099780 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:54:18.099780 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:54:18.099780 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:54:18.099780 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:54:18.099780 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:54:18.099780 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:54:18.099780 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:54:18.099780 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:54:18.099780 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:54:18.099780 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:54:18.099780 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:54:18.100733 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:54:18.100733 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:54:18.100733 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:54:18.100733 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:54:18.100733 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:54:18.100733 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:54:18.100733 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:54:18.100733 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:54:18.100733 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:54:18.100733 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:54:18.100733 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:54:18.100733 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:54:18.100733 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:54:18.100733 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:54:18.100733 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:54:18.100733 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:54:18.101583 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:54:18.101583 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:54:18.101583 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:54:18.101583 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:54:18.101583 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:54:18.101583 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:54:18.101583 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:54:18.101583 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:54:18.101583 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:54:18.101583 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:54:18.101583 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:54:18.101583 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:54:18.101583 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 543/1092] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:54:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:54:18.107487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321f12c-0653-4a16-911f-f1288fc77dad None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:18.141181 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:18.187556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56990041-2cc7-4141-91a2-ce9c8c7a2249 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:18.208136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321f12c-0653-4a16-911f-f1288fc77dad None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:18.221843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50f319-fdbd-4911-a0a8-3c1fb2de5256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:18.222458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50f319-fdbd-4911-a0a8-3c1fb2de5256 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:18.222733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50f319-fdbd-4911-a0a8-3c1fb2de5256 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:18.223001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50f319-fdbd-4911-a0a8-3c1fb2de5256 None admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:18.223695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50f319-fdbd-4911-a0a8-3c1fb2de5256 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:18.224029 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50f319-fdbd-4911-a0a8-3c1fb2de5256 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:18.225471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50f319-fdbd-4911-a0a8-3c1fb2de5256 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:18.235659 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:18.242080 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 550/1093] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:54:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:54:18.244985 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03e207-c0d7-4bf0-913a-aae7901c02a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:18.245630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03e207-c0d7-4bf0-913a-aae7901c02a5 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:18.245902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03e207-c0d7-4bf0-913a-aae7901c02a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:18.246166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03e207-c0d7-4bf0-913a-aae7901c02a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:18.246833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03e207-c0d7-4bf0-913a-aae7901c02a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:18.247156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03e207-c0d7-4bf0-913a-aae7901c02a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:18.248547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03e207-c0d7-4bf0-913a-aae7901c02a5 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:18.248719 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50f319-fdbd-4911-a0a8-3c1fb2de5256 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:18.257738 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 544/1094] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:54:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:54:18.264008 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03e207-c0d7-4bf0-913a-aae7901c02a5 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:18.367602 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50f319-fdbd-4911-a0a8-3c1fb2de5256 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:18.371728 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:18.378422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03e207-c0d7-4bf0-913a-aae7901c02a5 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:18.408125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6fae20-f7ac-464f-b719-6f6abe3e4432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:18.408709 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fae20-f7ac-464f-b719-6f6abe3e4432 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:18.409051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fae20-f7ac-464f-b719-6f6abe3e4432 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:18.409386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fae20-f7ac-464f-b719-6f6abe3e4432 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:18.410317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6fae20-f7ac-464f-b719-6f6abe3e4432 None admin] RBAC: Adding query filter params (role.id=e5cdf0e52e1d42efb54f7af9a731d3a5, scope.project.id=1cd2efda8567437e983e3a7867ecd69b, user.id=6c70d5a72d424db68de7c7b8257fe02c) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:18.410830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6fae20-f7ac-464f-b719-6f6abe3e4432 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:18.412442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6fae20-f7ac-464f-b719-6f6abe3e4432 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:18.420319 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 551/1095] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:54:18 2022] GET /identity/v3/role_assignments?user.id=6c70d5a72d424db68de7c7b8257fe02c&scope.project.id=1cd2efda8567437e983e3a7867ecd69b&role.id=e5cdf0e52e1d42efb54f7af9a731d3a5 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:18.430724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec198d-9527-4894-8f89-40e0916b96d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:18.431463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec198d-9527-4894-8f89-40e0916b96d1 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:18.431798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec198d-9527-4894-8f89-40e0916b96d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:18.432166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec198d-9527-4894-8f89-40e0916b96d1 None admin] PATH_INFO: `/v3/users/de2f63ac369a42fa8174533073d1236a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:18.433538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec198d-9527-4894-8f89-40e0916b96d1 None admin] RBAC: Authorizing `identity:get_user(user_id=de2f63ac369a42fa8174533073d1236a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:18.435108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec198d-9527-4894-8f89-40e0916b96d1 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:18.436881 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 545/1096] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:54:18 2022] GET /identity/v3/users/de2f63ac369a42fa8174533073d1236a => generated 285 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:18.443102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6fae20-f7ac-464f-b719-6f6abe3e4432 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:18.510536 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:18.555197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6fae20-f7ac-464f-b719-6f6abe3e4432 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:18.593268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ea594-6232-4fb8-97bd-8a0a7069e94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:18.594321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ea594-6232-4fb8-97bd-8a0a7069e94b None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:18.594593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ea594-6232-4fb8-97bd-8a0a7069e94b None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:18.594868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ea594-6232-4fb8-97bd-8a0a7069e94b None admin] PATH_INFO: `/v3/projects/82c4b601702d4e97822ec14d9b3ff8f5` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:18.596033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ea594-6232-4fb8-97bd-8a0a7069e94b None admin] RBAC: Authorizing `identity:get_project(project_id=82c4b601702d4e97822ec14d9b3ff8f5)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:18.597455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0ea594-6232-4fb8-97bd-8a0a7069e94b None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:18.599084 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 552/1097] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:54:18 2022] GET /identity/v3/projects/82c4b601702d4e97822ec14d9b3ff8f5 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:18.605349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec198d-9527-4894-8f89-40e0916b96d1 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:18.724819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec198d-9527-4894-8f89-40e0916b96d1 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:18.775663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc49a7-3580-41aa-ad0b-b1ce707bf819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:18.776604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc49a7-3580-41aa-ad0b-b1ce707bf819 None admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:18.776947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc49a7-3580-41aa-ad0b-b1ce707bf819 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:18.777271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc49a7-3580-41aa-ad0b-b1ce707bf819 None admin] PATH_INFO: `/v3/projects/82c4b601702d4e97822ec14d9b3ff8f5/users/de2f63ac369a42fa8174533073d1236a/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:18.779991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc49a7-3580-41aa-ad0b-b1ce707bf819 None admin] RBAC: Authorizing `identity:create_grant(project_id=82c4b601702d4e97822ec14d9b3ff8f5, user_id=de2f63ac369a42fa8174533073d1236a, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:18.781919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc49a7-3580-41aa-ad0b-b1ce707bf819 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:18.799331 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 546/1098] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Aug 7 00:54:18 2022] PUT /identity/v3/projects/82c4b601702d4e97822ec14d9b3ff8f5/users/de2f63ac369a42fa8174533073d1236a/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:54:20.867511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df4c1c-67f1-45d3-98a0-ca04eb50dfff None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:20.868104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df4c1c-67f1-45d3-98a0-ca04eb50dfff None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:20.868104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df4c1c-67f1-45d3-98a0-ca04eb50dfff None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:20.869537 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 553/1099] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:54:20.875475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312d16a-233b-4f49-ae9d-b30e4aed5371 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:20.875924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312d16a-233b-4f49-ae9d-b30e4aed5371 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:20.876036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312d16a-233b-4f49-ae9d-b30e4aed5371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:20.894653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6312d16a-233b-4f49-ae9d-b30e4aed5371 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:54:20.895860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6312d16a-233b-4f49-ae9d-b30e4aed5371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:54:20.913441 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:20.965368 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 547/1100] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:54:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:54:20.988307 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df4c1c-67f1-45d3-98a0-ca04eb50dfff None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:21.093852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df4c1c-67f1-45d3-98a0-ca04eb50dfff None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:21.121922 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:21.128459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb04f9-b0f2-4e23-b138-be9b7374791b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:21.129083 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb04f9-b0f2-4e23-b138-be9b7374791b None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:21.129352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb04f9-b0f2-4e23-b138-be9b7374791b None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:21.129616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb04f9-b0f2-4e23-b138-be9b7374791b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:21.140819 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb04f9-b0f2-4e23-b138-be9b7374791b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:54:21.145435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-69eb04f9-b0f2-4e23-b138-be9b7374791b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:54:21.145435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:21.145435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:54:21.145435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:54:21.145435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:54:21.145435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:54:21.145435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:54:21.145435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:54:21.145435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:54:21.145435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:54:21.145435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:54:21.145435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:54:21.145435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:54:21.145435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:54:21.145435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:54:21.145435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:54:21.146859 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:54:21.146859 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:54:21.146859 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:54:21.146859 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:54:21.146859 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:54:21.146859 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:54:21.146859 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:54:21.146859 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:54:21.146859 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:54:21.146859 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:54:21.146859 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:54:21.146859 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:54:21.146859 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:54:21.146859 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:54:21.146859 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:54:21.146859 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:54:21.147922 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:54:21.147922 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:54:21.147922 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:54:21.147922 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:54:21.147922 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:54:21.147922 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:54:21.147922 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:54:21.147922 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:54:21.147922 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:54:21.147922 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:54:21.147922 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:54:21.147922 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:54:21.147922 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 554/1101] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:54:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:54:21.153271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312d16a-233b-4f49-ae9d-b30e4aed5371 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:21.251618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312d16a-233b-4f49-ae9d-b30e4aed5371 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:21.287117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c297cb-b1f6-4d03-a576-a77c1bb4e3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:21.287717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c297cb-b1f6-4d03-a576-a77c1bb4e3ef None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:21.288025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c297cb-b1f6-4d03-a576-a77c1bb4e3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:21.288297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c297cb-b1f6-4d03-a576-a77c1bb4e3ef None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:21.288972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c297cb-b1f6-4d03-a576-a77c1bb4e3ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:21.289273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c297cb-b1f6-4d03-a576-a77c1bb4e3ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:21.290635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c297cb-b1f6-4d03-a576-a77c1bb4e3ef None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:21.299226 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 548/1102] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:54:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:21.305148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb04f9-b0f2-4e23-b138-be9b7374791b None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:21.402727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb04f9-b0f2-4e23-b138-be9b7374791b None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:21.436233 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094bed80-67b7-45da-a10c-54f986a71649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:21.436867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bed80-67b7-45da-a10c-54f986a71649 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:21.437141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bed80-67b7-45da-a10c-54f986a71649 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:21.437408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bed80-67b7-45da-a10c-54f986a71649 None admin] PATH_INFO: `/v3/users/de2f63ac369a42fa8174533073d1236a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:21.438533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094bed80-67b7-45da-a10c-54f986a71649 None admin] RBAC: Authorizing `identity:get_user(user_id=de2f63ac369a42fa8174533073d1236a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:21.439984 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094bed80-67b7-45da-a10c-54f986a71649 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:21.441578 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 555/1103] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:54:21 2022] GET /identity/v3/users/de2f63ac369a42fa8174533073d1236a => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:21.447499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c297cb-b1f6-4d03-a576-a77c1bb4e3ef None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:21.467511 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:21.557305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c297cb-b1f6-4d03-a576-a77c1bb4e3ef None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:21.611086 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de404c4a-6857-4426-8659-7fa757f5f4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:21.611695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de404c4a-6857-4426-8659-7fa757f5f4af None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:21.612006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de404c4a-6857-4426-8659-7fa757f5f4af None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:21.612279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de404c4a-6857-4426-8659-7fa757f5f4af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:21.691618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de404c4a-6857-4426-8659-7fa757f5f4af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:21.693028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de404c4a-6857-4426-8659-7fa757f5f4af None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:21.713775 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:21.811100 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 549/1104] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:54:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:54:21.817308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094bed80-67b7-45da-a10c-54f986a71649 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:21.878312 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:21.920174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094bed80-67b7-45da-a10c-54f986a71649 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:21.953610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe13bdc6-6543-4c56-beae-d2c5d3e2421f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:21.954158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13bdc6-6543-4c56-beae-d2c5d3e2421f None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:21.954437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13bdc6-6543-4c56-beae-d2c5d3e2421f None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:21.954708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13bdc6-6543-4c56-beae-d2c5d3e2421f None admin] PATH_INFO: `/v3/projects/82c4b601702d4e97822ec14d9b3ff8f5` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:21.955817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13bdc6-6543-4c56-beae-d2c5d3e2421f None admin] RBAC: Authorizing `identity:get_project(project_id=82c4b601702d4e97822ec14d9b3ff8f5)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:21.957267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe13bdc6-6543-4c56-beae-d2c5d3e2421f None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:21.958889 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 556/1105] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:54:21 2022] GET /identity/v3/projects/82c4b601702d4e97822ec14d9b3ff8f5 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:21.966832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de404c4a-6857-4426-8659-7fa757f5f4af None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:22.064788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de404c4a-6857-4426-8659-7fa757f5f4af None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:22.081306 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:22.099062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8644ae8-7551-49ba-8159-129866c62f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:22.099671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8644ae8-7551-49ba-8159-129866c62f4c None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:22.099986 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8644ae8-7551-49ba-8159-129866c62f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:22.100261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8644ae8-7551-49ba-8159-129866c62f4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:22.100989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8644ae8-7551-49ba-8159-129866c62f4c None admin] RBAC: Adding query filter params (role.id=695b07606e564668bac7afff4ab6052a, scope.project.id=82c4b601702d4e97822ec14d9b3ff8f5, user.id=de2f63ac369a42fa8174533073d1236a) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:22.101294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8644ae8-7551-49ba-8159-129866c62f4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:22.102720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8644ae8-7551-49ba-8159-129866c62f4c None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:22.109151 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 550/1106] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:54:21 2022] GET /identity/v3/role_assignments?user.id=de2f63ac369a42fa8174533073d1236a&scope.project.id=82c4b601702d4e97822ec14d9b3ff8f5&role.id=695b07606e564668bac7afff4ab6052a => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:24.204190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced5bd7-1325-4d2f-bc54-6c25cbd7584b None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:24.204742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced5bd7-1325-4d2f-bc54-6c25cbd7584b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:24.204873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced5bd7-1325-4d2f-bc54-6c25cbd7584b None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:24.206927 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 557/1107] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:54:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:54:24.213433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c99c4-a5ef-49e4-8833-b1ba74e3e50c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:24.213961 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c99c4-a5ef-49e4-8833-b1ba74e3e50c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:24.213961 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c99c4-a5ef-49e4-8833-b1ba74e3e50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:24.236218 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-456c99c4-a5ef-49e4-8833-b1ba74e3e50c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:54:24.237336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-456c99c4-a5ef-49e4-8833-b1ba74e3e50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:54:24.325968 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 551/1108] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:54:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:54:24.350438 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced5bd7-1325-4d2f-bc54-6c25cbd7584b None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:24.457359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced5bd7-1325-4d2f-bc54-6c25cbd7584b None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:24.487633 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:24.498637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7714d96-0314-4d7b-9203-9705c8c6367a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:24.499348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7714d96-0314-4d7b-9203-9705c8c6367a None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:24.499663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7714d96-0314-4d7b-9203-9705c8c6367a None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:24.500007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7714d96-0314-4d7b-9203-9705c8c6367a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:24.501186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7714d96-0314-4d7b-9203-9705c8c6367a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:24.502649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7714d96-0314-4d7b-9203-9705c8c6367a None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:24.504320 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 558/1109] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:54:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:24.513246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c99c4-a5ef-49e4-8833-b1ba74e3e50c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:24.650087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c99c4-a5ef-49e4-8833-b1ba74e3e50c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:24.663961 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:24.692260 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba425d6-aedf-4dd3-964e-104e4aa890ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:24.692866 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba425d6-aedf-4dd3-964e-104e4aa890ff None admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:24.693146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba425d6-aedf-4dd3-964e-104e4aa890ff None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:24.693415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba425d6-aedf-4dd3-964e-104e4aa890ff None admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:24.694069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba425d6-aedf-4dd3-964e-104e4aa890ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:24.695494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba425d6-aedf-4dd3-964e-104e4aa890ff None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:24.718933 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 552/1110] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Aug 7 00:54:24 2022] POST /identity/v3/users => generated 286 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:54:26.823467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80fa83-f2f9-4d25-846a-ec1cdf850049 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:26.824032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80fa83-f2f9-4d25-846a-ec1cdf850049 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:26.824032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80fa83-f2f9-4d25-846a-ec1cdf850049 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:26.825385 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 559/1111] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:54:26.830702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0538403-c815-4f79-a83d-0ba87371d517 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:26.831172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0538403-c815-4f79-a83d-0ba87371d517 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:26.831280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0538403-c815-4f79-a83d-0ba87371d517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:26.850568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c0538403-c815-4f79-a83d-0ba87371d517 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:54:26.851762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c0538403-c815-4f79-a83d-0ba87371d517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:54:26.919810 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 553/1112] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:54:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:54:26.942569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80fa83-f2f9-4d25-846a-ec1cdf850049 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:27.043843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80fa83-f2f9-4d25-846a-ec1cdf850049 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:27.076209 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0d5e3-2b08-4ae3-b0a6-616be6e116a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:27.076747 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0d5e3-2b08-4ae3-b0a6-616be6e116a2 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:27.077016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0d5e3-2b08-4ae3-b0a6-616be6e116a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:27.077279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0d5e3-2b08-4ae3-b0a6-616be6e116a2 None admin] PATH_INFO: `/v3/roles/04a874934a0944a2851b5e485a0f0a1b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:27.078636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0d5e3-2b08-4ae3-b0a6-616be6e116a2 None admin] RBAC: Authorizing `identity:get_role(role_id=04a874934a0944a2851b5e485a0f0a1b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:27.080014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0d5e3-2b08-4ae3-b0a6-616be6e116a2 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:27.081323 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 560/1113] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:54:26 2022] GET /identity/v3/roles/04a874934a0944a2851b5e485a0f0a1b => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:27.087238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0538403-c815-4f79-a83d-0ba87371d517 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:27.178010 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:27.184830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0538403-c815-4f79-a83d-0ba87371d517 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:27.218533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b454dff-f0f3-4460-a35d-2b7b7ae4023f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:27.219160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b454dff-f0f3-4460-a35d-2b7b7ae4023f None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:27.219484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b454dff-f0f3-4460-a35d-2b7b7ae4023f None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:27.219712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b454dff-f0f3-4460-a35d-2b7b7ae4023f None admin] PATH_INFO: `/v3/users/88c820d36d3c4842ae68f0831675ef20` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:27.232904 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b454dff-f0f3-4460-a35d-2b7b7ae4023f None admin] RBAC: Authorizing `identity:get_user(user_id=88c820d36d3c4842ae68f0831675ef20)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:27.234367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b454dff-f0f3-4460-a35d-2b7b7ae4023f None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:27.236027 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 554/1114] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:54:27 2022] GET /identity/v3/users/88c820d36d3c4842ae68f0831675ef20 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:27.241844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0d5e3-2b08-4ae3-b0a6-616be6e116a2 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:27.302708 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:27.341582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0d5e3-2b08-4ae3-b0a6-616be6e116a2 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:27.375463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878843f0-374c-4ac8-b365-714d60a78d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:27.376097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878843f0-374c-4ac8-b365-714d60a78d28 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:27.376373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878843f0-374c-4ac8-b365-714d60a78d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:27.376638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878843f0-374c-4ac8-b365-714d60a78d28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:27.442748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878843f0-374c-4ac8-b365-714d60a78d28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:27.444232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878843f0-374c-4ac8-b365-714d60a78d28 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:27.502897 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:27.546469 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 561/1115] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:54:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:54:27.552796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b454dff-f0f3-4460-a35d-2b7b7ae4023f None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:27.657758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b454dff-f0f3-4460-a35d-2b7b7ae4023f None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:27.695246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffdf6c-9617-4905-94cd-8d5fc248a16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:27.696054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffdf6c-9617-4905-94cd-8d5fc248a16f None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:27.696334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffdf6c-9617-4905-94cd-8d5fc248a16f None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:27.696606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffdf6c-9617-4905-94cd-8d5fc248a16f None admin] PATH_INFO: `/v3/projects/82c4b601702d4e97822ec14d9b3ff8f5` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:27.697838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ffdf6c-9617-4905-94cd-8d5fc248a16f None admin] RBAC: Authorizing `identity:get_project(project_id=82c4b601702d4e97822ec14d9b3ff8f5)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:27.699948 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ffdf6c-9617-4905-94cd-8d5fc248a16f None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:27.701720 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 555/1116] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:54:27 2022] GET /identity/v3/projects/82c4b601702d4e97822ec14d9b3ff8f5 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:27.708185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878843f0-374c-4ac8-b365-714d60a78d28 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:27.813155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878843f0-374c-4ac8-b365-714d60a78d28 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:27.847267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f476000-8ff3-4ee5-8c8e-541a5380d7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:27.847994 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f476000-8ff3-4ee5-8c8e-541a5380d7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:27.848128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f476000-8ff3-4ee5-8c8e-541a5380d7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:27.848392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f476000-8ff3-4ee5-8c8e-541a5380d7f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:27.849105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f476000-8ff3-4ee5-8c8e-541a5380d7f4 None admin] RBAC: Adding query filter params (role.id=04a874934a0944a2851b5e485a0f0a1b, scope.project.id=82c4b601702d4e97822ec14d9b3ff8f5, user.id=88c820d36d3c4842ae68f0831675ef20) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:27.849401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f476000-8ff3-4ee5-8c8e-541a5380d7f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:27.850804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f476000-8ff3-4ee5-8c8e-541a5380d7f4 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:27.856063 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 562/1117] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:54:27 2022] GET /identity/v3/role_assignments?user.id=88c820d36d3c4842ae68f0831675ef20&scope.project.id=82c4b601702d4e97822ec14d9b3ff8f5&role.id=04a874934a0944a2851b5e485a0f0a1b => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:29.855969 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d3d58-1909-4360-81ce-6dc0c2bc0054 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:29.856597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d3d58-1909-4360-81ce-6dc0c2bc0054 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:29.856597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d3d58-1909-4360-81ce-6dc0c2bc0054 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:29.857950 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 556/1118] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:54:29.863861 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1bc66-fc61-4313-899d-9ee584536673 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:29.864415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1bc66-fc61-4313-899d-9ee584536673 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:29.864415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1bc66-fc61-4313-899d-9ee584536673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:29.883510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-63a1bc66-fc61-4313-899d-9ee584536673 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:54:29.884820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-63a1bc66-fc61-4313-899d-9ee584536673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:54:29.906526 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:29.952982 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 563/1119] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:54:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:54:29.974438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d3d58-1909-4360-81ce-6dc0c2bc0054 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:29.999446 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:30.077735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d3d58-1909-4360-81ce-6dc0c2bc0054 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:30.110698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad98664-4f0f-492d-9b7e-fa5ac7bbbd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:30.111238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad98664-4f0f-492d-9b7e-fa5ac7bbbd76 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:30.111515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad98664-4f0f-492d-9b7e-fa5ac7bbbd76 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:30.111783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad98664-4f0f-492d-9b7e-fa5ac7bbbd76 None admin] PATH_INFO: `/v3/roles/04a874934a0944a2851b5e485a0f0a1b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:30.113187 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad98664-4f0f-492d-9b7e-fa5ac7bbbd76 None admin] RBAC: Authorizing `identity:get_role(role_id=04a874934a0944a2851b5e485a0f0a1b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:30.114554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad98664-4f0f-492d-9b7e-fa5ac7bbbd76 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:30.115869 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 557/1120] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:54:29 2022] GET /identity/v3/roles/04a874934a0944a2851b5e485a0f0a1b => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:30.122357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1bc66-fc61-4313-899d-9ee584536673 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:30.217651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1bc66-fc61-4313-899d-9ee584536673 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:30.252542 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef04d1-2111-4b4b-93d4-b62a50ed232f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:30.253170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef04d1-2111-4b4b-93d4-b62a50ed232f None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:30.253443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef04d1-2111-4b4b-93d4-b62a50ed232f None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:30.253711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef04d1-2111-4b4b-93d4-b62a50ed232f None admin] PATH_INFO: `/v3/users/88c820d36d3c4842ae68f0831675ef20` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:30.254830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef04d1-2111-4b4b-93d4-b62a50ed232f None admin] RBAC: Authorizing `identity:get_user(user_id=88c820d36d3c4842ae68f0831675ef20)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:30.256286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef04d1-2111-4b4b-93d4-b62a50ed232f None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:30.257869 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 564/1121] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:54:30 2022] GET /identity/v3/users/88c820d36d3c4842ae68f0831675ef20 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:30.263788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad98664-4f0f-492d-9b7e-fa5ac7bbbd76 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:30.360679 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:30.370980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad98664-4f0f-492d-9b7e-fa5ac7bbbd76 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:30.406734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44e7a2-001f-447d-bee2-b9d698503de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:30.407351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44e7a2-001f-447d-bee2-b9d698503de7 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:30.407624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44e7a2-001f-447d-bee2-b9d698503de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:30.407912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44e7a2-001f-447d-bee2-b9d698503de7 None admin] PATH_INFO: `/v3/projects/82c4b601702d4e97822ec14d9b3ff8f5` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:30.409033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44e7a2-001f-447d-bee2-b9d698503de7 None admin] RBAC: Authorizing `identity:get_project(project_id=82c4b601702d4e97822ec14d9b3ff8f5)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:30.410454 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44e7a2-001f-447d-bee2-b9d698503de7 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:30.412096 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 558/1122] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:54:30 2022] GET /identity/v3/projects/82c4b601702d4e97822ec14d9b3ff8f5 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:30.419051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef04d1-2111-4b4b-93d4-b62a50ed232f None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:30.444562 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:30.521833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef04d1-2111-4b4b-93d4-b62a50ed232f None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:30.558158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4078fc7-9a5f-4034-91fc-378d5dc3e7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:30.558807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4078fc7-9a5f-4034-91fc-378d5dc3e7b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:30.559080 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4078fc7-9a5f-4034-91fc-378d5dc3e7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:30.559350 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4078fc7-9a5f-4034-91fc-378d5dc3e7b7 None admin] PATH_INFO: `/v3/projects/82c4b601702d4e97822ec14d9b3ff8f5/users/88c820d36d3c4842ae68f0831675ef20/roles/04a874934a0944a2851b5e485a0f0a1b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:30.561533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4078fc7-9a5f-4034-91fc-378d5dc3e7b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=82c4b601702d4e97822ec14d9b3ff8f5, user_id=88c820d36d3c4842ae68f0831675ef20, role_id=04a874934a0944a2851b5e485a0f0a1b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:30.562960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4078fc7-9a5f-4034-91fc-378d5dc3e7b7 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:30.576855 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 565/1123] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Aug 7 00:54:30 2022] PUT /identity/v3/projects/82c4b601702d4e97822ec14d9b3ff8f5/users/88c820d36d3c4842ae68f0831675ef20/roles/04a874934a0944a2851b5e485a0f0a1b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:54:32.605058 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3597037-26d2-4524-8bbd-6dab5ad32c11 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:32.605602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3597037-26d2-4524-8bbd-6dab5ad32c11 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:32.605602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3597037-26d2-4524-8bbd-6dab5ad32c11 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:32.606936 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 559/1124] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:54:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:54:32.612185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30467c9-02f8-474a-9c05-902f14040dd6 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:32.612647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30467c9-02f8-474a-9c05-902f14040dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:32.612744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30467c9-02f8-474a-9c05-902f14040dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:32.631733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c30467c9-02f8-474a-9c05-902f14040dd6 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:54:32.632941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c30467c9-02f8-474a-9c05-902f14040dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:54:32.699357 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 566/1125] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:54:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:54:32.722029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3597037-26d2-4524-8bbd-6dab5ad32c11 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:32.824083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3597037-26d2-4524-8bbd-6dab5ad32c11 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:32.859612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11ccd5-4792-43ae-8da4-62186131e6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:32.860202 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11ccd5-4792-43ae-8da4-62186131e6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:32.860481 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11ccd5-4792-43ae-8da4-62186131e6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:32.860754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11ccd5-4792-43ae-8da4-62186131e6c7 None admin] PATH_INFO: `/v3/roles/04a874934a0944a2851b5e485a0f0a1b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:32.862223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11ccd5-4792-43ae-8da4-62186131e6c7 None admin] RBAC: Authorizing `identity:get_role(role_id=04a874934a0944a2851b5e485a0f0a1b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:32.863609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11ccd5-4792-43ae-8da4-62186131e6c7 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:32.865035 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 560/1126] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:54:32 2022] GET /identity/v3/roles/04a874934a0944a2851b5e485a0f0a1b => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:32.871233 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30467c9-02f8-474a-9c05-902f14040dd6 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:32.886492 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:32.969757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30467c9-02f8-474a-9c05-902f14040dd6 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:33.003734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad09c72-308f-41f2-aab8-e2b52d885179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:33.004387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad09c72-308f-41f2-aab8-e2b52d885179 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:33.004656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad09c72-308f-41f2-aab8-e2b52d885179 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:33.004919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad09c72-308f-41f2-aab8-e2b52d885179 None admin] PATH_INFO: `/v3/users/88c820d36d3c4842ae68f0831675ef20` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:33.006036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad09c72-308f-41f2-aab8-e2b52d885179 None admin] RBAC: Authorizing `identity:get_user(user_id=88c820d36d3c4842ae68f0831675ef20)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:33.007449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad09c72-308f-41f2-aab8-e2b52d885179 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:33.009065 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 567/1127] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:54:32 2022] GET /identity/v3/users/88c820d36d3c4842ae68f0831675ef20 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:33.014905 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11ccd5-4792-43ae-8da4-62186131e6c7 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:33.043982 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:33.117580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11ccd5-4792-43ae-8da4-62186131e6c7 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:33.151200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa884c65-2ede-4ffa-9a8d-e09b8631b1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:33.151798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa884c65-2ede-4ffa-9a8d-e09b8631b1bb None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:33.152105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa884c65-2ede-4ffa-9a8d-e09b8631b1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:33.152382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa884c65-2ede-4ffa-9a8d-e09b8631b1bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:33.218587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa884c65-2ede-4ffa-9a8d-e09b8631b1bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:33.220067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa884c65-2ede-4ffa-9a8d-e09b8631b1bb None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:33.245692 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:33.317507 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 561/1128] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:54:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:54:33.324113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad09c72-308f-41f2-aab8-e2b52d885179 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:33.404676 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:33.422980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad09c72-308f-41f2-aab8-e2b52d885179 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:33.457219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf244a9e-0912-45ad-a806-677a09c82483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:33.457849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf244a9e-0912-45ad-a806-677a09c82483 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:33.458125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf244a9e-0912-45ad-a806-677a09c82483 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:33.458400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf244a9e-0912-45ad-a806-677a09c82483 None admin] PATH_INFO: `/v3/projects/82c4b601702d4e97822ec14d9b3ff8f5` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:33.459534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf244a9e-0912-45ad-a806-677a09c82483 None admin] RBAC: Authorizing `identity:get_project(project_id=82c4b601702d4e97822ec14d9b3ff8f5)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:33.461015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf244a9e-0912-45ad-a806-677a09c82483 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:33.462661 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 568/1129] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:54:33 2022] GET /identity/v3/projects/82c4b601702d4e97822ec14d9b3ff8f5 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:54:33.469755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa884c65-2ede-4ffa-9a8d-e09b8631b1bb None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:33.573182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa884c65-2ede-4ffa-9a8d-e09b8631b1bb None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:33.598648 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:33.607756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d27a4-aee3-4c94-97d8-0e778e14ad19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:33.608447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d27a4-aee3-4c94-97d8-0e778e14ad19 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:33.608644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d27a4-aee3-4c94-97d8-0e778e14ad19 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:33.608909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d27a4-aee3-4c94-97d8-0e778e14ad19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:33.609632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d27a4-aee3-4c94-97d8-0e778e14ad19 None admin] RBAC: Adding query filter params (role.id=04a874934a0944a2851b5e485a0f0a1b, scope.project.id=82c4b601702d4e97822ec14d9b3ff8f5, user.id=88c820d36d3c4842ae68f0831675ef20) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:33.609938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d27a4-aee3-4c94-97d8-0e778e14ad19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:33.611350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d27a4-aee3-4c94-97d8-0e778e14ad19 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:33.617020 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 562/1130] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:54:33 2022] GET /identity/v3/role_assignments?user.id=88c820d36d3c4842ae68f0831675ef20&scope.project.id=82c4b601702d4e97822ec14d9b3ff8f5&role.id=04a874934a0944a2851b5e485a0f0a1b => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:35.688541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e3399-89d7-429d-8326-99b9d4f34b79 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:35.689080 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e3399-89d7-429d-8326-99b9d4f34b79 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:35.689080 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e3399-89d7-429d-8326-99b9d4f34b79 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:35.690431 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 569/1131] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:54:35.695672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1c3ec-ec8f-42b8-9ada-8d76d3e1b865 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:35.696157 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1c3ec-ec8f-42b8-9ada-8d76d3e1b865 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:35.696261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1c3ec-ec8f-42b8-9ada-8d76d3e1b865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:35.713869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-83c1c3ec-ec8f-42b8-9ada-8d76d3e1b865 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:54:35.715043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-83c1c3ec-ec8f-42b8-9ada-8d76d3e1b865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:54:35.784897 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 563/1132] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:54:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:54:35.808862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e3399-89d7-429d-8326-99b9d4f34b79 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:35.915766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e3399-89d7-429d-8326-99b9d4f34b79 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:35.951944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae994d-33c7-47db-8476-b8dc90d50b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:35.952484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae994d-33c7-47db-8476-b8dc90d50b13 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:35.952757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae994d-33c7-47db-8476-b8dc90d50b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:35.953030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae994d-33c7-47db-8476-b8dc90d50b13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:35.954124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ae994d-33c7-47db-8476-b8dc90d50b13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:35.955548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ae994d-33c7-47db-8476-b8dc90d50b13 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:35.957148 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 570/1133] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:54:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:35.963690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1c3ec-ec8f-42b8-9ada-8d76d3e1b865 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:36.062499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1c3ec-ec8f-42b8-9ada-8d76d3e1b865 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:36.082858 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:36.104529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f243aba-b36b-40a3-978e-d87fc947d835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:36.105136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f243aba-b36b-40a3-978e-d87fc947d835 None admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:36.105412 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f243aba-b36b-40a3-978e-d87fc947d835 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:36.105679 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f243aba-b36b-40a3-978e-d87fc947d835 None admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:36.106322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f243aba-b36b-40a3-978e-d87fc947d835 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:36.107760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f243aba-b36b-40a3-978e-d87fc947d835 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:36.138962 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 564/1134] 10.222.0.39 () {60 vars in 1141 bytes} [Sun Aug 7 00:54:35 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:54:38.196393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf3970-c105-4c98-8100-dc057fd69996 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:38.196959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf3970-c105-4c98-8100-dc057fd69996 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:38.196959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf3970-c105-4c98-8100-dc057fd69996 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:38.198875 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 571/1135] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:54:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:54:38.204844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb983c-3bea-4892-a479-c08dde91df12 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:38.205390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb983c-3bea-4892-a479-c08dde91df12 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:38.205390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb983c-3bea-4892-a479-c08dde91df12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:38.226762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6eeb983c-3bea-4892-a479-c08dde91df12 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:54:38.228441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6eeb983c-3bea-4892-a479-c08dde91df12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:54:38.316291 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 565/1136] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:54:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:54:38.341148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf3970-c105-4c98-8100-dc057fd69996 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:38.361063 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:38.450500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf3970-c105-4c98-8100-dc057fd69996 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:38.486495 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600b876-138a-4b8e-974d-6fdaf364e81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:38.487122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600b876-138a-4b8e-974d-6fdaf364e81a None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:38.487399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600b876-138a-4b8e-974d-6fdaf364e81a None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:38.487670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600b876-138a-4b8e-974d-6fdaf364e81a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:38.488853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600b876-138a-4b8e-974d-6fdaf364e81a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:38.490303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600b876-138a-4b8e-974d-6fdaf364e81a None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:38.491936 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 572/1137] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:54:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:38.498941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb983c-3bea-4892-a479-c08dde91df12 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:38.623257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb983c-3bea-4892-a479-c08dde91df12 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:38.625626 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:38.668444 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50301d6b-b9ec-4dbc-9a30-5fc7c42ecd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:38.669050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50301d6b-b9ec-4dbc-9a30-5fc7c42ecd04 None admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:38.669327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50301d6b-b9ec-4dbc-9a30-5fc7c42ecd04 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:38.669592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50301d6b-b9ec-4dbc-9a30-5fc7c42ecd04 None admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:38.670241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50301d6b-b9ec-4dbc-9a30-5fc7c42ecd04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:38.671692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50301d6b-b9ec-4dbc-9a30-5fc7c42ecd04 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:38.695907 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 566/1138] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Aug 7 00:54:38 2022] POST /identity/v3/users => generated 286 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:54:40.908686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95200275-57b4-411a-afcf-30f44922ae56 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:40.909446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95200275-57b4-411a-afcf-30f44922ae56 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:40.909446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95200275-57b4-411a-afcf-30f44922ae56 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:40.910782 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 573/1139] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:54:40.916726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf6a3b-a563-4c14-892f-b077a1bfeca6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:40.917491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf6a3b-a563-4c14-892f-b077a1bfeca6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:40.917491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf6a3b-a563-4c14-892f-b077a1bfeca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:40.939232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-bcbf6a3b-a563-4c14-892f-b077a1bfeca6 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:54:40.940488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bcbf6a3b-a563-4c14-892f-b077a1bfeca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:54:41.022925 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 567/1140] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:54:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:54:41.048020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95200275-57b4-411a-afcf-30f44922ae56 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:41.192877 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:41.212240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95200275-57b4-411a-afcf-30f44922ae56 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:41.265890 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725089c-7d71-4cb2-8625-4134723ed3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:41.266682 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725089c-7d71-4cb2-8625-4134723ed3fe None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:41.267136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725089c-7d71-4cb2-8625-4134723ed3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:41.268166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725089c-7d71-4cb2-8625-4134723ed3fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:41.280086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725089c-7d71-4cb2-8625-4134723ed3fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:54:41.285000 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-5725089c-7d71-4cb2-8625-4134723ed3fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:54:41.285000 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:41.285000 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:54:41.285000 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:54:41.285000 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:54:41.285000 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:54:41.285000 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:54:41.285000 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:54:41.285000 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:54:41.285000 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:54:41.285000 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:54:41.285000 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:54:41.285000 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:54:41.285000 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:54:41.285000 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:54:41.285000 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:54:41.286849 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:54:41.286849 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:54:41.286849 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:54:41.286849 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:54:41.286849 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:54:41.286849 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:54:41.286849 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:54:41.286849 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:54:41.286849 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:54:41.286849 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:54:41.286849 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:54:41.286849 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:54:41.286849 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:54:41.286849 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:54:41.286849 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:54:41.286849 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:54:41.288511 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:54:41.288511 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:54:41.288511 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:54:41.288511 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:54:41.288511 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:54:41.288511 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:54:41.288511 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:54:41.288511 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:54:41.288511 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:54:41.288511 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:54:41.288511 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:54:41.288511 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:54:41.288511 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 574/1141] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:54:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:54:41.295522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf6a3b-a563-4c14-892f-b077a1bfeca6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:41.418153 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:41.438320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf6a3b-a563-4c14-892f-b077a1bfeca6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:41.481037 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c8daf-3af3-46f5-89bc-3c8dbeef60a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:41.481581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c8daf-3af3-46f5-89bc-3c8dbeef60a3 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:41.481877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c8daf-3af3-46f5-89bc-3c8dbeef60a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:41.482322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c8daf-3af3-46f5-89bc-3c8dbeef60a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:41.483090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c8daf-3af3-46f5-89bc-3c8dbeef60a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:41.483413 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c8daf-3af3-46f5-89bc-3c8dbeef60a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:41.484848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c8daf-3af3-46f5-89bc-3c8dbeef60a3 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:41.497238 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 568/1142] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:54:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:41.503964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725089c-7d71-4cb2-8625-4134723ed3fe None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:41.636458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725089c-7d71-4cb2-8625-4134723ed3fe None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:41.684300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc9ad2-6cb7-4a54-895a-9002d19279e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:41.685068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc9ad2-6cb7-4a54-895a-9002d19279e8 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:41.685439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc9ad2-6cb7-4a54-895a-9002d19279e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:41.685811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc9ad2-6cb7-4a54-895a-9002d19279e8 None admin] PATH_INFO: `/v3/users/bd4a5511295540a1aad110ed3c0cea97` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:41.702591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc9ad2-6cb7-4a54-895a-9002d19279e8 None admin] RBAC: Authorizing `identity:get_user(user_id=bd4a5511295540a1aad110ed3c0cea97)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:41.704250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc9ad2-6cb7-4a54-895a-9002d19279e8 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:41.706344 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 575/1143] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:54:41 2022] GET /identity/v3/users/bd4a5511295540a1aad110ed3c0cea97 => generated 286 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:54:41.713737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c8daf-3af3-46f5-89bc-3c8dbeef60a3 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:41.874900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c8daf-3af3-46f5-89bc-3c8dbeef60a3 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:41.928906 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e52076-9ec8-413a-aa9c-246b2682cd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:41.929895 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e52076-9ec8-413a-aa9c-246b2682cd31 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:41.930151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e52076-9ec8-413a-aa9c-246b2682cd31 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:41.930490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e52076-9ec8-413a-aa9c-246b2682cd31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:41.956319 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:42.039804 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e52076-9ec8-413a-aa9c-246b2682cd31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:42.042592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e52076-9ec8-413a-aa9c-246b2682cd31 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:42.188666 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 569/1144] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:54:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:54:42.198058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc9ad2-6cb7-4a54-895a-9002d19279e8 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:42.202289 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:42.340743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc9ad2-6cb7-4a54-895a-9002d19279e8 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:42.384654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8435134-7219-4e40-9e75-ac2f3bdfbcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:42.385652 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8435134-7219-4e40-9e75-ac2f3bdfbcf9 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:42.386104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8435134-7219-4e40-9e75-ac2f3bdfbcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:42.386546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8435134-7219-4e40-9e75-ac2f3bdfbcf9 None admin] PATH_INFO: `/v3/projects/e1db6291de12424eba4b84cde320014d` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:42.387968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8435134-7219-4e40-9e75-ac2f3bdfbcf9 None admin] RBAC: Authorizing `identity:get_project(project_id=e1db6291de12424eba4b84cde320014d)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:42.389488 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8435134-7219-4e40-9e75-ac2f3bdfbcf9 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:42.391254 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 576/1145] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:54:42 2022] GET /identity/v3/projects/e1db6291de12424eba4b84cde320014d => generated 311 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:42.398119 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e52076-9ec8-413a-aa9c-246b2682cd31 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:42.480654 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:42.552501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e52076-9ec8-413a-aa9c-246b2682cd31 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:42.592721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4efd5-26cd-440b-a097-42a060a59585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:42.593376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4efd5-26cd-440b-a097-42a060a59585 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:42.593694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4efd5-26cd-440b-a097-42a060a59585 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:42.594004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4efd5-26cd-440b-a097-42a060a59585 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:42.594787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4efd5-26cd-440b-a097-42a060a59585 None admin] RBAC: Adding query filter params (role.id=695b07606e564668bac7afff4ab6052a, scope.project.id=e1db6291de12424eba4b84cde320014d, user.id=bd4a5511295540a1aad110ed3c0cea97) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:42.595125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4efd5-26cd-440b-a097-42a060a59585 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:42.596711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4efd5-26cd-440b-a097-42a060a59585 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:42.604949 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 570/1146] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:54:42 2022] GET /identity/v3/role_assignments?user.id=bd4a5511295540a1aad110ed3c0cea97&scope.project.id=e1db6291de12424eba4b84cde320014d&role.id=695b07606e564668bac7afff4ab6052a => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:44.839438 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37065fcb-89fe-4d26-bb21-a37135de0769 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:44.840212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37065fcb-89fe-4d26-bb21-a37135de0769 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:44.840212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37065fcb-89fe-4d26-bb21-a37135de0769 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:44.841444 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 577/1147] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:54:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:54:44.847121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84917089-1496-4aba-8c0d-cbe35c90bc0b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:44.847662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84917089-1496-4aba-8c0d-cbe35c90bc0b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:44.847756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84917089-1496-4aba-8c0d-cbe35c90bc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:44.866184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-84917089-1496-4aba-8c0d-cbe35c90bc0b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:54:44.867368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-84917089-1496-4aba-8c0d-cbe35c90bc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:54:44.939370 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 571/1148] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:54:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:54:44.962489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37065fcb-89fe-4d26-bb21-a37135de0769 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:45.034829 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:45.070470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37065fcb-89fe-4d26-bb21-a37135de0769 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:45.104796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8001e-dc7e-4ca3-9f4e-b57a5c3eea00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:45.105340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8001e-dc7e-4ca3-9f4e-b57a5c3eea00 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:45.105617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8001e-dc7e-4ca3-9f4e-b57a5c3eea00 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:45.105886 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8001e-dc7e-4ca3-9f4e-b57a5c3eea00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:45.116257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8001e-dc7e-4ca3-9f4e-b57a5c3eea00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:54:45.121503 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-bca8001e-dc7e-4ca3-9f4e-b57a5c3eea00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:54:45.121503 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:45.121503 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:54:45.121503 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:54:45.121503 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:54:45.121503 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:54:45.121503 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:54:45.121503 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:54:45.121503 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:54:45.121503 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:54:45.121503 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:54:45.121503 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:54:45.121503 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:54:45.121503 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:54:45.121503 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:54:45.121503 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:54:45.122659 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:54:45.122659 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:54:45.122659 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:54:45.122659 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:54:45.122659 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:54:45.122659 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:54:45.122659 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:54:45.122659 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:54:45.122659 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:54:45.122659 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:54:45.122659 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:54:45.122659 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:54:45.122659 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:54:45.122659 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:54:45.122659 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:54:45.122659 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:54:45.123578 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:54:45.123578 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:54:45.123578 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:54:45.123578 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:54:45.123578 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:54:45.123578 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:54:45.123578 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:54:45.123578 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:54:45.123578 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:54:45.123578 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:54:45.123578 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:54:45.123578 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:54:45.123578 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 578/1149] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:54:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:54:45.128895 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84917089-1496-4aba-8c0d-cbe35c90bc0b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:45.176093 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:45.245377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84917089-1496-4aba-8c0d-cbe35c90bc0b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:45.281830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbc9f4-7479-4fdd-aceb-d86c581421ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:45.282436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbc9f4-7479-4fdd-aceb-d86c581421ef None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:45.282712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbc9f4-7479-4fdd-aceb-d86c581421ef None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:45.282980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbc9f4-7479-4fdd-aceb-d86c581421ef None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:45.283655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbc9f4-7479-4fdd-aceb-d86c581421ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:45.283982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbc9f4-7479-4fdd-aceb-d86c581421ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:45.285354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbc9f4-7479-4fdd-aceb-d86c581421ef None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:45.294961 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 572/1150] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:54:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:45.301513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8001e-dc7e-4ca3-9f4e-b57a5c3eea00 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:45.402221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8001e-dc7e-4ca3-9f4e-b57a5c3eea00 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:45.430962 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:45.437288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37975b-9924-4e78-9212-d80566a68b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:45.437905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37975b-9924-4e78-9212-d80566a68b7a None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:45.438176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37975b-9924-4e78-9212-d80566a68b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:45.438441 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37975b-9924-4e78-9212-d80566a68b7a None admin] PATH_INFO: `/v3/users/bd4a5511295540a1aad110ed3c0cea97` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:45.439562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37975b-9924-4e78-9212-d80566a68b7a None admin] RBAC: Authorizing `identity:get_user(user_id=bd4a5511295540a1aad110ed3c0cea97)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:45.441021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37975b-9924-4e78-9212-d80566a68b7a None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:45.442596 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 579/1151] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:54:45 2022] GET /identity/v3/users/bd4a5511295540a1aad110ed3c0cea97 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:45.448637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbc9f4-7479-4fdd-aceb-d86c581421ef None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:45.550385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbc9f4-7479-4fdd-aceb-d86c581421ef None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:45.558430 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:45.585902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27b5a4-c07b-403c-9230-00388c37678e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:45.586526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27b5a4-c07b-403c-9230-00388c37678e None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:45.586801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27b5a4-c07b-403c-9230-00388c37678e None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:45.587069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27b5a4-c07b-403c-9230-00388c37678e None admin] PATH_INFO: `/v3/projects/e1db6291de12424eba4b84cde320014d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:45.588865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27b5a4-c07b-403c-9230-00388c37678e None admin] RBAC: Authorizing `identity:get_project(project_id=e1db6291de12424eba4b84cde320014d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:45.590302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27b5a4-c07b-403c-9230-00388c37678e None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:45.591959 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 573/1152] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:54:45 2022] GET /identity/v3/projects/e1db6291de12424eba4b84cde320014d => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:45.597919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37975b-9924-4e78-9212-d80566a68b7a None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:45.697546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37975b-9924-4e78-9212-d80566a68b7a None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:45.733800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59386e18-4436-444e-adb4-5c0c398edbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:45.734461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59386e18-4436-444e-adb4-5c0c398edbab None admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:45.734736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59386e18-4436-444e-adb4-5c0c398edbab None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:45.735003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59386e18-4436-444e-adb4-5c0c398edbab None admin] PATH_INFO: `/v3/projects/e1db6291de12424eba4b84cde320014d/users/bd4a5511295540a1aad110ed3c0cea97/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:45.736971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59386e18-4436-444e-adb4-5c0c398edbab None admin] RBAC: Authorizing `identity:create_grant(project_id=e1db6291de12424eba4b84cde320014d, user_id=bd4a5511295540a1aad110ed3c0cea97, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:45.738412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59386e18-4436-444e-adb4-5c0c398edbab None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:45.753045 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 580/1153] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Aug 7 00:54:45 2022] PUT /identity/v3/projects/e1db6291de12424eba4b84cde320014d/users/bd4a5511295540a1aad110ed3c0cea97/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:54:47.776153 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595554d-b0da-4163-b0ff-9b3f11866b67 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:47.776717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595554d-b0da-4163-b0ff-9b3f11866b67 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:47.776717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595554d-b0da-4163-b0ff-9b3f11866b67 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:47.778018 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 574/1154] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:54:47.783321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c668d3-dd04-4e06-93bc-453598485f06 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:47.783785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c668d3-dd04-4e06-93bc-453598485f06 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:47.783915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c668d3-dd04-4e06-93bc-453598485f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:47.802540 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d3c668d3-dd04-4e06-93bc-453598485f06 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:54:47.803715 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d3c668d3-dd04-4e06-93bc-453598485f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:54:47.859023 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:47.871148 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 581/1155] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:54:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:54:47.893882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595554d-b0da-4163-b0ff-9b3f11866b67 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:48.000932 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595554d-b0da-4163-b0ff-9b3f11866b67 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:48.037257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c23c3a-b6df-4e67-a95b-d7b258e931ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:48.037785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c23c3a-b6df-4e67-a95b-d7b258e931ac None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:48.038061 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c23c3a-b6df-4e67-a95b-d7b258e931ac None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:48.038329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c23c3a-b6df-4e67-a95b-d7b258e931ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:48.049165 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c23c3a-b6df-4e67-a95b-d7b258e931ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:54:48.053793 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-d2c23c3a-b6df-4e67-a95b-d7b258e931ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:54:48.053793 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:48.053793 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:54:48.053793 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:54:48.053793 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:54:48.053793 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:54:48.053793 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:54:48.053793 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:54:48.053793 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:54:48.053793 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:54:48.053793 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:54:48.053793 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:54:48.053793 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:54:48.053793 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:54:48.053793 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:54:48.053793 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:54:48.054906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:54:48.054906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:54:48.054906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:54:48.054906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:54:48.054906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:54:48.054906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:54:48.054906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:54:48.054906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:54:48.054906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:54:48.054906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:54:48.054906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:54:48.054906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:54:48.054906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:54:48.054906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:54:48.054906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:54:48.054906 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:54:48.056011 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:54:48.056011 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:54:48.056011 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:54:48.056011 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:54:48.056011 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:54:48.056011 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:54:48.056011 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:54:48.056011 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:54:48.056011 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:54:48.056011 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:54:48.056011 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:54:48.056011 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:54:48.056011 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 575/1156] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:54:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:54:48.061069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c668d3-dd04-4e06-93bc-453598485f06 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:48.157350 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c668d3-dd04-4e06-93bc-453598485f06 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:48.190137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2780af9-dfe8-42ee-a031-5ccba45dfa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:48.190735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2780af9-dfe8-42ee-a031-5ccba45dfa06 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:48.191010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2780af9-dfe8-42ee-a031-5ccba45dfa06 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:48.191284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2780af9-dfe8-42ee-a031-5ccba45dfa06 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:48.191970 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2780af9-dfe8-42ee-a031-5ccba45dfa06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:48.192272 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2780af9-dfe8-42ee-a031-5ccba45dfa06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:48.193630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2780af9-dfe8-42ee-a031-5ccba45dfa06 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:48.201557 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 582/1157] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:54:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:48.207524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c23c3a-b6df-4e67-a95b-d7b258e931ac None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:48.243162 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:48.312155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c23c3a-b6df-4e67-a95b-d7b258e931ac None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:48.345410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ddc123-64a5-4f08-aa61-a75f24d25622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:48.346030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddc123-64a5-4f08-aa61-a75f24d25622 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:48.346300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddc123-64a5-4f08-aa61-a75f24d25622 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:48.346561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddc123-64a5-4f08-aa61-a75f24d25622 None admin] PATH_INFO: `/v3/users/bd4a5511295540a1aad110ed3c0cea97` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:48.347683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ddc123-64a5-4f08-aa61-a75f24d25622 None admin] RBAC: Authorizing `identity:get_user(user_id=bd4a5511295540a1aad110ed3c0cea97)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:48.349130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ddc123-64a5-4f08-aa61-a75f24d25622 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:48.350698 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 576/1158] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:54:48 2022] GET /identity/v3/users/bd4a5511295540a1aad110ed3c0cea97 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:48.356785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2780af9-dfe8-42ee-a031-5ccba45dfa06 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:48.408092 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:48.465695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2780af9-dfe8-42ee-a031-5ccba45dfa06 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:48.498628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f9e06-be6d-487e-9d00-92d5742bd9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:48.499230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f9e06-be6d-487e-9d00-92d5742bd9aa None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:48.499504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f9e06-be6d-487e-9d00-92d5742bd9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:48.499770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f9e06-be6d-487e-9d00-92d5742bd9aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:48.566075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f9e06-be6d-487e-9d00-92d5742bd9aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:48.567444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f9e06-be6d-487e-9d00-92d5742bd9aa None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:48.616656 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:48.664479 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 583/1159] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:54:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:54:48.670434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ddc123-64a5-4f08-aa61-a75f24d25622 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:48.771062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ddc123-64a5-4f08-aa61-a75f24d25622 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:48.772625 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:48.804915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb2ce8-ea26-4cd0-8d19-dbe883c24008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:48.805587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb2ce8-ea26-4cd0-8d19-dbe883c24008 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:48.805790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb2ce8-ea26-4cd0-8d19-dbe883c24008 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:48.806586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb2ce8-ea26-4cd0-8d19-dbe883c24008 None admin] PATH_INFO: `/v3/projects/e1db6291de12424eba4b84cde320014d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:48.807687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb2ce8-ea26-4cd0-8d19-dbe883c24008 None admin] RBAC: Authorizing `identity:get_project(project_id=e1db6291de12424eba4b84cde320014d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:48.809174 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb2ce8-ea26-4cd0-8d19-dbe883c24008 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:48.810777 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 577/1160] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:54:48 2022] GET /identity/v3/projects/e1db6291de12424eba4b84cde320014d => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:48.817171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f9e06-be6d-487e-9d00-92d5742bd9aa None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:48.914757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f9e06-be6d-487e-9d00-92d5742bd9aa None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:48.948877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6303f5-7717-45c2-8e42-45465c669847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:48.949478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6303f5-7717-45c2-8e42-45465c669847 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:48.949759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6303f5-7717-45c2-8e42-45465c669847 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:48.950032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6303f5-7717-45c2-8e42-45465c669847 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:48.950759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6303f5-7717-45c2-8e42-45465c669847 None admin] RBAC: Adding query filter params (role.id=695b07606e564668bac7afff4ab6052a, scope.project.id=e1db6291de12424eba4b84cde320014d, user.id=bd4a5511295540a1aad110ed3c0cea97) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:48.951064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6303f5-7717-45c2-8e42-45465c669847 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:48.952514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6303f5-7717-45c2-8e42-45465c669847 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:48.958366 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 584/1161] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:54:48 2022] GET /identity/v3/role_assignments?user.id=bd4a5511295540a1aad110ed3c0cea97&scope.project.id=e1db6291de12424eba4b84cde320014d&role.id=695b07606e564668bac7afff4ab6052a => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:51.019814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c6aa4-d1f2-4779-a508-f3af94025d9f None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:51.020974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c6aa4-d1f2-4779-a508-f3af94025d9f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:51.020974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c6aa4-d1f2-4779-a508-f3af94025d9f None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:51.022006 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 578/1162] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:54:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:54:51.029554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292cc4f-9676-4a36-b6f5-2ad98e446974 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:51.030091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292cc4f-9676-4a36-b6f5-2ad98e446974 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:51.030504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292cc4f-9676-4a36-b6f5-2ad98e446974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:51.060366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-8292cc4f-9676-4a36-b6f5-2ad98e446974 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:54:51.062347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8292cc4f-9676-4a36-b6f5-2ad98e446974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:54:51.082407 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:51.162228 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 585/1163] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:54:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:54:51.185980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c6aa4-d1f2-4779-a508-f3af94025d9f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:51.305243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c6aa4-d1f2-4779-a508-f3af94025d9f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:51.362545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c24ed-8b7f-4359-9ac3-753aa325aa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:51.363587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c24ed-8b7f-4359-9ac3-753aa325aa6a None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:51.364123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c24ed-8b7f-4359-9ac3-753aa325aa6a None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:51.364618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c24ed-8b7f-4359-9ac3-753aa325aa6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:51.435581 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:51.489096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c24ed-8b7f-4359-9ac3-753aa325aa6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:51.491872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c24ed-8b7f-4359-9ac3-753aa325aa6a None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:51.659179 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 579/1164] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:54:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 00:54:51.665586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292cc4f-9676-4a36-b6f5-2ad98e446974 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:51.809899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292cc4f-9676-4a36-b6f5-2ad98e446974 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:51.866014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b1b80-42af-4c31-a777-c9b6e04760a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:51.867002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b1b80-42af-4c31-a777-c9b6e04760a9 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:51.867453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b1b80-42af-4c31-a777-c9b6e04760a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:51.867943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b1b80-42af-4c31-a777-c9b6e04760a9 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:51.879837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b1b80-42af-4c31-a777-c9b6e04760a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:51.882386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b1b80-42af-4c31-a777-c9b6e04760a9 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:51.903289 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-353b1b80-42af-4c31-a777-c9b6e04760a9 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 07 00:54:51.903289 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:51.903289 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 07 00:54:51.903289 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 07 00:54:51.903289 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:54:51.903289 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:54:51.903289 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:54:51.903289 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:54:51.903289 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 07 00:54:51.903289 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:54:51.903289 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:54:51.903289 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:54:51.903289 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:54:51.903289 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:54:51.903289 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:54:51.903289 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:54:51.903289 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:54:51.905290 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:54:51.905290 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:54:51.905290 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:54:51.905290 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:54:51.905290 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:54:51.905290 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:54:51.905290 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:54:51.905290 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:54:51.905290 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:54:51.905290 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:54:51.905290 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:54:51.905290 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:54:51.905290 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:54:51.905290 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:54:51.905290 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:54:51.905290 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:54:51.907186 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:54:51.907186 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:54:51.907186 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:54:51.907186 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:54:51.907186 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:54:51.907186 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:54:51.907186 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:54:51.907186 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:54:51.907186 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:54:51.907186 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:54:51.907186 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 07 00:54:51.907186 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:54:51.907186 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 07 00:54:51.907186 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:54:51.907186 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 586/1165] 10.222.0.39 () {56 vars in 1117 bytes} [Sun Aug 7 00:54:51 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:54:51.913775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c24ed-8b7f-4359-9ac3-753aa325aa6a None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:52.020263 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:52.076080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c24ed-8b7f-4359-9ac3-753aa325aa6a None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:52.135595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f12026-035c-45e8-a533-293c266681c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:52.136675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f12026-035c-45e8-a533-293c266681c0 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:52.137172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f12026-035c-45e8-a533-293c266681c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:52.137661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f12026-035c-45e8-a533-293c266681c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:52.138854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f12026-035c-45e8-a533-293c266681c0 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:54:52.139398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f12026-035c-45e8-a533-293c266681c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:52.141924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f12026-035c-45e8-a533-293c266681c0 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:52.156129 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 580/1166] 10.222.0.39 () {56 vars in 1115 bytes} [Sun Aug 7 00:54:51 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:54:54.262607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80aa7ad-5314-4aaf-b4e9-9adba8ffb402 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:54.263141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80aa7ad-5314-4aaf-b4e9-9adba8ffb402 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:54.263141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80aa7ad-5314-4aaf-b4e9-9adba8ffb402 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:54.264472 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 587/1167] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:54:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:54:54.270795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25d7e9-b5b4-414d-87fe-9fc5911fdcd5 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:54.271318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25d7e9-b5b4-414d-87fe-9fc5911fdcd5 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:54.271318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25d7e9-b5b4-414d-87fe-9fc5911fdcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:54.297158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-5b25d7e9-b5b4-414d-87fe-9fc5911fdcd5 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:54:54.298358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5b25d7e9-b5b4-414d-87fe-9fc5911fdcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:54:54.395926 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 581/1168] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:54:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:54:54.418664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80aa7ad-5314-4aaf-b4e9-9adba8ffb402 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:54.428914 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:54.545809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80aa7ad-5314-4aaf-b4e9-9adba8ffb402 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:54.610263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a0196-71ae-42ee-a795-266f4711b792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:54.611325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a0196-71ae-42ee-a795-266f4711b792 None admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:54.611834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a0196-71ae-42ee-a795-266f4711b792 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:54.612366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a0196-71ae-42ee-a795-266f4711b792 None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:54.613689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a0196-71ae-42ee-a795-266f4711b792 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:54.616327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a0196-71ae-42ee-a795-266f4711b792 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:54.638301 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 588/1169] 10.222.0.39 () {60 vars in 1138 bytes} [Sun Aug 7 00:54:54 2022] POST /identity/v3/domains => generated 267 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:54:56.813000 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cb972-8e83-4a2b-a557-887f9a90f7e7 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:56.813547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cb972-8e83-4a2b-a557-887f9a90f7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:56.813960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cb972-8e83-4a2b-a557-887f9a90f7e7 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:56.816491 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 582/1170] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:54:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:54:56.825033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708308ff-f3e5-4c7d-aac4-0db5549cb7f4 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:56.825834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708308ff-f3e5-4c7d-aac4-0db5549cb7f4 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:56.826015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708308ff-f3e5-4c7d-aac4-0db5549cb7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:56.846183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-708308ff-f3e5-4c7d-aac4-0db5549cb7f4 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:54:56.847380 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-708308ff-f3e5-4c7d-aac4-0db5549cb7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:54:56.935303 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:56.950067 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 589/1171] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:54:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:54:56.975695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cb972-8e83-4a2b-a557-887f9a90f7e7 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:57.048801 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:54:57.094663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cb972-8e83-4a2b-a557-887f9a90f7e7 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:57.134644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ed1ff-3843-4604-9c03-0721d52390dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:57.135395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ed1ff-3843-4604-9c03-0721d52390dc None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:57.135759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ed1ff-3843-4604-9c03-0721d52390dc None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:57.136171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ed1ff-3843-4604-9c03-0721d52390dc None admin] PATH_INFO: `/v3/domains/96d4bdc5998142379c08c1dad8bbd283` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:57.149634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ed1ff-3843-4604-9c03-0721d52390dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=96d4bdc5998142379c08c1dad8bbd283)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:57.151599 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ed1ff-3843-4604-9c03-0721d52390dc None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:57.153982 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 583/1172] 10.222.0.39 () {56 vars in 1183 bytes} [Sun Aug 7 00:54:56 2022] GET /identity/v3/domains/96d4bdc5998142379c08c1dad8bbd283 => generated 267 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:54:57.163777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708308ff-f3e5-4c7d-aac4-0db5549cb7f4 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:54:57.294011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708308ff-f3e5-4c7d-aac4-0db5549cb7f4 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:54:57.334793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8101c8-a387-431e-a8dd-c38b98719547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:54:57.335471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8101c8-a387-431e-a8dd-c38b98719547 None admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:57.335827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8101c8-a387-431e-a8dd-c38b98719547 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:57.336176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8101c8-a387-431e-a8dd-c38b98719547 None admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:57.337433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8101c8-a387-431e-a8dd-c38b98719547 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:54:57.338928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8101c8-a387-431e-a8dd-c38b98719547 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:54:57.371351 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 590/1173] 10.222.0.39 () {60 vars in 1141 bytes} [Sun Aug 7 00:54:57 2022] POST /identity/v3/projects => generated 361 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 00:54:59.914055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c83ae-4e1a-4dad-a3fc-776939bbfb2c None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:59.914775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c83ae-4e1a-4dad-a3fc-776939bbfb2c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:59.915104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c83ae-4e1a-4dad-a3fc-776939bbfb2c None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:59.917584 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 584/1174] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:54:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:54:59.926353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd140b3-16e4-4308-9d59-21fd6d976e31 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:54:59.926927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd140b3-16e4-4308-9d59-21fd6d976e31 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:54:59.927251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd140b3-16e4-4308-9d59-21fd6d976e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:54:59.949468 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2dd140b3-16e4-4308-9d59-21fd6d976e31 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:54:59.950804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2dd140b3-16e4-4308-9d59-21fd6d976e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:00.016477 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:00.047412 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 591/1175] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:54:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:55:00.079757 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c83ae-4e1a-4dad-a3fc-776939bbfb2c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:55:00.205121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11c83ae-4e1a-4dad-a3fc-776939bbfb2c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:55:00.234040 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:00.246336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d90a5-04ac-41dd-a427-cbf36138a848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:55:00.246977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d90a5-04ac-41dd-a427-cbf36138a848 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:00.247254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d90a5-04ac-41dd-a427-cbf36138a848 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:00.247525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d90a5-04ac-41dd-a427-cbf36138a848 None admin] PATH_INFO: `/v3/domains/96d4bdc5998142379c08c1dad8bbd283` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:00.248742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d90a5-04ac-41dd-a427-cbf36138a848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=96d4bdc5998142379c08c1dad8bbd283)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:55:00.250214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d90a5-04ac-41dd-a427-cbf36138a848 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:55:00.251846 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 585/1176] 10.222.0.39 () {56 vars in 1183 bytes} [Sun Aug 7 00:55:00 2022] GET /identity/v3/domains/96d4bdc5998142379c08c1dad8bbd283 => generated 267 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:55:00.261450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd140b3-16e4-4308-9d59-21fd6d976e31 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:55:00.397407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd140b3-16e4-4308-9d59-21fd6d976e31 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:55:00.437186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777c2ad-e462-45f5-a758-c55d0e143f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:55:00.437792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777c2ad-e462-45f5-a758-c55d0e143f6b None admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:00.438070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777c2ad-e462-45f5-a758-c55d0e143f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:00.438337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777c2ad-e462-45f5-a758-c55d0e143f6b None admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:00.439001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777c2ad-e462-45f5-a758-c55d0e143f6b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:55:00.440527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777c2ad-e462-45f5-a758-c55d0e143f6b None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:55:00.469167 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 592/1177] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Aug 7 00:55:00 2022] POST /identity/v3/users => generated 311 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 00:55:03.394319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea2918-099c-4037-b9c5-296676109b65 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:03.394909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea2918-099c-4037-b9c5-296676109b65 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:03.394909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea2918-099c-4037-b9c5-296676109b65 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:03.396667 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 586/1178] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:55:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:55:03.402967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b9950-d7f5-4857-b2f1-7b435ae43fa1 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:03.403539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b9950-d7f5-4857-b2f1-7b435ae43fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:03.403539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b9950-d7f5-4857-b2f1-7b435ae43fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:03.422273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-529b9950-d7f5-4857-b2f1-7b435ae43fa1 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:55:03.423501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-529b9950-d7f5-4857-b2f1-7b435ae43fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:03.455080 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:03.501883 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 593/1179] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:55:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:55:03.535541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea2918-099c-4037-b9c5-296676109b65 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:55:03.711078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea2918-099c-4037-b9c5-296676109b65 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:55:03.752706 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bd8f3-3c29-4e73-8c09-e25a2bfb4af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:55:03.753391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bd8f3-3c29-4e73-8c09-e25a2bfb4af1 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:03.753709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bd8f3-3c29-4e73-8c09-e25a2bfb4af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:03.754029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9bd8f3-3c29-4e73-8c09-e25a2bfb4af1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:03.768191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9bd8f3-3c29-4e73-8c09-e25a2bfb4af1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:55:03.773637 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-0f9bd8f3-3c29-4e73-8c09-e25a2bfb4af1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:55:03.773637 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:55:03.773637 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:55:03.773637 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:55:03.773637 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:55:03.773637 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:55:03.773637 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:55:03.773637 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:55:03.773637 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:55:03.773637 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:55:03.773637 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:55:03.773637 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:55:03.773637 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:55:03.773637 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:55:03.773637 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:55:03.773637 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:55:03.775713 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:55:03.775713 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:55:03.775713 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:55:03.775713 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:55:03.775713 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:55:03.775713 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:55:03.775713 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:55:03.775713 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:55:03.775713 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:55:03.775713 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:55:03.775713 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:55:03.775713 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:55:03.775713 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:55:03.775713 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:55:03.775713 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:55:03.775713 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:55:03.777047 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:55:03.777047 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:55:03.777047 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:55:03.777047 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:55:03.777047 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:55:03.777047 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:55:03.777047 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:55:03.777047 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:55:03.777047 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:55:03.777047 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:55:03.777047 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:55:03.777047 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:55:03.777047 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 587/1180] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:55:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:55:03.785263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b9950-d7f5-4857-b2f1-7b435ae43fa1 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:55:03.925153 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b9950-d7f5-4857-b2f1-7b435ae43fa1 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:55:03.987852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d202e-2bcc-492b-8105-e9214c132759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:55:03.988852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d202e-2bcc-492b-8105-e9214c132759 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:03.989317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d202e-2bcc-492b-8105-e9214c132759 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:03.989754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d202e-2bcc-492b-8105-e9214c132759 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:03.990599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d202e-2bcc-492b-8105-e9214c132759 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:55:03.991042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d202e-2bcc-492b-8105-e9214c132759 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:55:03.993204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507d202e-2bcc-492b-8105-e9214c132759 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:55:04.007740 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 594/1181] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:55:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:55:04.015052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bd8f3-3c29-4e73-8c09-e25a2bfb4af1 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:55:04.083837 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:04.179848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9bd8f3-3c29-4e73-8c09-e25a2bfb4af1 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:55:04.220905 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857013e-fb00-4d35-ba4e-66f972d3baf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:55:04.221601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857013e-fb00-4d35-ba4e-66f972d3baf5 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:04.221929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857013e-fb00-4d35-ba4e-66f972d3baf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:04.222236 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857013e-fb00-4d35-ba4e-66f972d3baf5 None admin] PATH_INFO: `/v3/users/564b2d480b2d4e889098f632fa82d9db` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:04.237910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857013e-fb00-4d35-ba4e-66f972d3baf5 None admin] RBAC: Authorizing `identity:get_user(user_id=564b2d480b2d4e889098f632fa82d9db)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:55:04.239315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857013e-fb00-4d35-ba4e-66f972d3baf5 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:55:04.241167 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 588/1182] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:55:04 2022] GET /identity/v3/users/564b2d480b2d4e889098f632fa82d9db => generated 311 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:55:04.251843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d202e-2bcc-492b-8105-e9214c132759 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:55:04.288739 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:04.378780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507d202e-2bcc-492b-8105-e9214c132759 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:55:04.418504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd1812-e18a-495e-b121-261a15a93bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:55:04.419560 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd1812-e18a-495e-b121-261a15a93bba None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:04.419560 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd1812-e18a-495e-b121-261a15a93bba None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:04.419852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd1812-e18a-495e-b121-261a15a93bba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:04.523006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd1812-e18a-495e-b121-261a15a93bba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:55:04.524746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd1812-e18a-495e-b121-261a15a93bba None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:55:04.574574 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:04.665554 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 595/1183] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:55:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:55:04.672530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857013e-fb00-4d35-ba4e-66f972d3baf5 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:55:04.850376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857013e-fb00-4d35-ba4e-66f972d3baf5 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:55:04.872501 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:04.915503 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dcc517-eb34-4532-9978-53035c68e68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:55:04.922229 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcc517-eb34-4532-9978-53035c68e68a None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:04.922752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcc517-eb34-4532-9978-53035c68e68a None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:04.923239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcc517-eb34-4532-9978-53035c68e68a None admin] PATH_INFO: `/v3/projects/fc0403c3048d4edda1f269cbae51e34a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:04.927322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dcc517-eb34-4532-9978-53035c68e68a None admin] RBAC: Authorizing `identity:get_project(project_id=fc0403c3048d4edda1f269cbae51e34a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:55:04.930627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dcc517-eb34-4532-9978-53035c68e68a None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:55:04.934692 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 589/1184] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:55:04 2022] GET /identity/v3/projects/fc0403c3048d4edda1f269cbae51e34a => generated 361 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:55:04.945113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd1812-e18a-495e-b121-261a15a93bba None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:55:05.122680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd1812-e18a-495e-b121-261a15a93bba None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:55:05.169322 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:05.183669 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372eae4d-345d-44b4-a3da-9182a4b2acb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:55:05.184726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372eae4d-345d-44b4-a3da-9182a4b2acb0 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:05.185201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372eae4d-345d-44b4-a3da-9182a4b2acb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:05.185672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372eae4d-345d-44b4-a3da-9182a4b2acb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:05.187008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372eae4d-345d-44b4-a3da-9182a4b2acb0 None admin] RBAC: Adding query filter params (role.id=695b07606e564668bac7afff4ab6052a, scope.project.id=fc0403c3048d4edda1f269cbae51e34a, user.id=564b2d480b2d4e889098f632fa82d9db) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:55:05.187543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372eae4d-345d-44b4-a3da-9182a4b2acb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:55:05.190243 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372eae4d-345d-44b4-a3da-9182a4b2acb0 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:55:05.201058 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 596/1185] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:55:04 2022] GET /identity/v3/role_assignments?user.id=564b2d480b2d4e889098f632fa82d9db&scope.project.id=fc0403c3048d4edda1f269cbae51e34a&role.id=695b07606e564668bac7afff4ab6052a => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:55:07.532406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464e006-1e18-4c8a-8475-3838ac89a450 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:07.532995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464e006-1e18-4c8a-8475-3838ac89a450 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:07.533343 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464e006-1e18-4c8a-8475-3838ac89a450 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:07.535759 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 590/1186] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:55:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:55:07.544449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47185cae-b60d-416e-ab6a-98d74e6dea4c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:07.545375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47185cae-b60d-416e-ab6a-98d74e6dea4c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:07.545375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47185cae-b60d-416e-ab6a-98d74e6dea4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:07.565639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-47185cae-b60d-416e-ab6a-98d74e6dea4c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:55:07.566981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-47185cae-b60d-416e-ab6a-98d74e6dea4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:07.645484 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 597/1187] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:55:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:55:07.669337 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464e006-1e18-4c8a-8475-3838ac89a450 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:55:07.801526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464e006-1e18-4c8a-8475-3838ac89a450 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:55:07.846330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e34bd-710d-4afb-9d25-651debf13733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:55:07.846991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e34bd-710d-4afb-9d25-651debf13733 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:07.847292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e34bd-710d-4afb-9d25-651debf13733 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:07.847563 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e34bd-710d-4afb-9d25-651debf13733 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:07.860417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e34bd-710d-4afb-9d25-651debf13733 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:55:07.865446 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-ea6e34bd-710d-4afb-9d25-651debf13733 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:55:07.865446 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:55:07.865446 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:55:07.865446 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:55:07.865446 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:55:07.865446 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:55:07.865446 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:55:07.865446 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:55:07.865446 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:55:07.865446 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:55:07.865446 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:55:07.865446 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:55:07.865446 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:55:07.865446 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:55:07.865446 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:55:07.865446 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:55:07.867809 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:55:07.867809 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:55:07.867809 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:55:07.867809 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:55:07.867809 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:55:07.867809 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:55:07.867809 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:55:07.867809 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:55:07.867809 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:55:07.867809 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:55:07.867809 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:55:07.867809 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:55:07.867809 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:55:07.867809 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:55:07.867809 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:55:07.867809 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:55:07.869050 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:55:07.869050 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:55:07.869050 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:55:07.869050 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:55:07.869050 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:55:07.869050 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:55:07.869050 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:55:07.869050 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:55:07.869050 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:55:07.869050 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:55:07.869050 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:55:07.869050 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:55:07.869050 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 591/1188] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:55:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:55:07.877082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47185cae-b60d-416e-ab6a-98d74e6dea4c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:55:08.056230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47185cae-b60d-416e-ab6a-98d74e6dea4c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:55:08.082069 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:08.098114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ba35d-e351-4c67-999b-b23d12c3b8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:55:08.099021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ba35d-e351-4c67-999b-b23d12c3b8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:08.099300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ba35d-e351-4c67-999b-b23d12c3b8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:08.099570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ba35d-e351-4c67-999b-b23d12c3b8a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:08.100288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ba35d-e351-4c67-999b-b23d12c3b8a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:55:08.100586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ba35d-e351-4c67-999b-b23d12c3b8a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:55:08.102060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ba35d-e351-4c67-999b-b23d12c3b8a4 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:55:08.111419 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 598/1189] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:55:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:55:08.118493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e34bd-710d-4afb-9d25-651debf13733 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:55:08.164858 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:08.229082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e34bd-710d-4afb-9d25-651debf13733 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:55:08.266473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9bf08-f176-4ab8-8b15-efc4a495c6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:55:08.267117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9bf08-f176-4ab8-8b15-efc4a495c6bd None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:08.267391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9bf08-f176-4ab8-8b15-efc4a495c6bd None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:08.267662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9bf08-f176-4ab8-8b15-efc4a495c6bd None admin] PATH_INFO: `/v3/users/564b2d480b2d4e889098f632fa82d9db` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:08.268927 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9bf08-f176-4ab8-8b15-efc4a495c6bd None admin] RBAC: Authorizing `identity:get_user(user_id=564b2d480b2d4e889098f632fa82d9db)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:55:08.270648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9bf08-f176-4ab8-8b15-efc4a495c6bd None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:55:08.272304 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 592/1190] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:55:08 2022] GET /identity/v3/users/564b2d480b2d4e889098f632fa82d9db => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:55:08.279073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ba35d-e351-4c67-999b-b23d12c3b8a4 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:55:08.389638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ba35d-e351-4c67-999b-b23d12c3b8a4 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:55:08.433033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f118e1-03ee-470e-a8ac-519be77b2627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:55:08.434090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f118e1-03ee-470e-a8ac-519be77b2627 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:08.434570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f118e1-03ee-470e-a8ac-519be77b2627 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:08.435058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f118e1-03ee-470e-a8ac-519be77b2627 None admin] PATH_INFO: `/v3/projects/fc0403c3048d4edda1f269cbae51e34a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:08.437061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f118e1-03ee-470e-a8ac-519be77b2627 None admin] RBAC: Authorizing `identity:get_project(project_id=fc0403c3048d4edda1f269cbae51e34a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:55:08.439129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f118e1-03ee-470e-a8ac-519be77b2627 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:55:08.441101 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 599/1191] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:55:08 2022] GET /identity/v3/projects/fc0403c3048d4edda1f269cbae51e34a => generated 361 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:55:08.450867 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9bf08-f176-4ab8-8b15-efc4a495c6bd None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:55:08.565367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9bf08-f176-4ab8-8b15-efc4a495c6bd None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:55:08.574977 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:08.610215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b463f-a1a2-4ecb-9c6f-0db702796da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:55:08.610893 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b463f-a1a2-4ecb-9c6f-0db702796da7 None admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:08.611167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b463f-a1a2-4ecb-9c6f-0db702796da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:08.611437 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b463f-a1a2-4ecb-9c6f-0db702796da7 None admin] PATH_INFO: `/v3/projects/fc0403c3048d4edda1f269cbae51e34a/users/564b2d480b2d4e889098f632fa82d9db/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:08.613592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b463f-a1a2-4ecb-9c6f-0db702796da7 None admin] RBAC: Authorizing `identity:create_grant(project_id=fc0403c3048d4edda1f269cbae51e34a, user_id=564b2d480b2d4e889098f632fa82d9db, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:55:08.615064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b463f-a1a2-4ecb-9c6f-0db702796da7 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:55:08.633313 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 593/1192] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Aug 7 00:55:08 2022] PUT /identity/v3/projects/fc0403c3048d4edda1f269cbae51e34a/users/564b2d480b2d4e889098f632fa82d9db/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 00:55:10.791738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb8f2d-2eb4-4b8a-ae3a-19402bd935aa None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:10.792430 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb8f2d-2eb4-4b8a-ae3a-19402bd935aa None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:10.792629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb8f2d-2eb4-4b8a-ae3a-19402bd935aa None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:10.795057 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 600/1193] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:55:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:55:10.805078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43be696-9278-4f98-bb84-88ce1927cd38 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:10.805653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43be696-9278-4f98-bb84-88ce1927cd38 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:10.806046 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43be696-9278-4f98-bb84-88ce1927cd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:10.837266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-f43be696-9278-4f98-bb84-88ce1927cd38 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:55:10.839468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f43be696-9278-4f98-bb84-88ce1927cd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:55:10.972889 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 594/1194] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:55:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:55:11.017460 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb8f2d-2eb4-4b8a-ae3a-19402bd935aa None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:55:11.087818 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:11.143975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb8f2d-2eb4-4b8a-ae3a-19402bd935aa None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:55:11.183345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a67f30-f32a-4a92-9e1c-a8a7b5bf9b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:55:11.184043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a67f30-f32a-4a92-9e1c-a8a7b5bf9b32 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:11.184319 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a67f30-f32a-4a92-9e1c-a8a7b5bf9b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:11.184583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a67f30-f32a-4a92-9e1c-a8a7b5bf9b32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:11.196703 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a67f30-f32a-4a92-9e1c-a8a7b5bf9b32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:55:11.201556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-52a67f30-f32a-4a92-9e1c-a8a7b5bf9b32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:55:11.201556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:55:11.201556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:55:11.201556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:55:11.201556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:55:11.201556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:55:11.201556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:55:11.201556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:55:11.201556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:55:11.201556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:55:11.201556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:55:11.201556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:55:11.201556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:55:11.201556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:55:11.201556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:55:11.201556 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:55:11.203393 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:55:11.203393 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:55:11.203393 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:55:11.203393 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:55:11.203393 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:55:11.203393 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:55:11.203393 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:55:11.203393 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:55:11.203393 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:55:11.203393 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:55:11.203393 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:55:11.203393 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:55:11.203393 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:55:11.203393 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:55:11.203393 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:55:11.203393 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:55:11.205115 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:55:11.205115 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:55:11.205115 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:55:11.205115 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:55:11.205115 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:55:11.205115 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:55:11.205115 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:55:11.205115 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:55:11.205115 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:55:11.205115 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:55:11.205115 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:55:11.205115 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:55:11.205115 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 601/1195] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:55:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:55:11.210447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43be696-9278-4f98-bb84-88ce1927cd38 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:55:11.312679 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:11.321283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43be696-9278-4f98-bb84-88ce1927cd38 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:55:11.366182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e6bb8-df3a-4cff-ac6d-ed3dece4aa64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:55:11.366820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e6bb8-df3a-4cff-ac6d-ed3dece4aa64 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:11.367255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e6bb8-df3a-4cff-ac6d-ed3dece4aa64 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:11.367713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e6bb8-df3a-4cff-ac6d-ed3dece4aa64 None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:11.368795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e6bb8-df3a-4cff-ac6d-ed3dece4aa64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:55:11.369166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e6bb8-df3a-4cff-ac6d-ed3dece4aa64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:55:11.370701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e6bb8-df3a-4cff-ac6d-ed3dece4aa64 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:55:11.379727 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 595/1196] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:55:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:55:11.386444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a67f30-f32a-4a92-9e1c-a8a7b5bf9b32 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:55:11.496817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a67f30-f32a-4a92-9e1c-a8a7b5bf9b32 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:55:11.510553 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:11.542098 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0c6c9-b028-4add-8bdf-5d350ddfb3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:55:11.543194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0c6c9-b028-4add-8bdf-5d350ddfb3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:11.543721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0c6c9-b028-4add-8bdf-5d350ddfb3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:11.544248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0c6c9-b028-4add-8bdf-5d350ddfb3f6 None admin] PATH_INFO: `/v3/users/564b2d480b2d4e889098f632fa82d9db` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:11.546234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0c6c9-b028-4add-8bdf-5d350ddfb3f6 None admin] RBAC: Authorizing `identity:get_user(user_id=564b2d480b2d4e889098f632fa82d9db)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:55:11.549021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0c6c9-b028-4add-8bdf-5d350ddfb3f6 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:55:11.552046 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 602/1197] 10.222.0.39 () {56 vars in 1177 bytes} [Sun Aug 7 00:55:11 2022] GET /identity/v3/users/564b2d480b2d4e889098f632fa82d9db => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:55:11.562451 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e6bb8-df3a-4cff-ac6d-ed3dece4aa64 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:55:11.686901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e6bb8-df3a-4cff-ac6d-ed3dece4aa64 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:55:11.729488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06b620-da4a-4daf-82db-16a6f3692626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:55:11.730160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06b620-da4a-4daf-82db-16a6f3692626 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:11.730498 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06b620-da4a-4daf-82db-16a6f3692626 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:11.730818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06b620-da4a-4daf-82db-16a6f3692626 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:11.766410 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:11.816480 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06b620-da4a-4daf-82db-16a6f3692626 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:55:11.818048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06b620-da4a-4daf-82db-16a6f3692626 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:55:11.932932 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 596/1198] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:55:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:55:11.940244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0c6c9-b028-4add-8bdf-5d350ddfb3f6 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:55:12.116777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0c6c9-b028-4add-8bdf-5d350ddfb3f6 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:55:12.161080 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a0c83-8f74-4dcd-a777-a9a83a5d1e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:55:12.161793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a0c83-8f74-4dcd-a777-a9a83a5d1e18 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:12.162115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a0c83-8f74-4dcd-a777-a9a83a5d1e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:12.162428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a0c83-8f74-4dcd-a777-a9a83a5d1e18 None admin] PATH_INFO: `/v3/projects/fc0403c3048d4edda1f269cbae51e34a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:12.163645 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a0c83-8f74-4dcd-a777-a9a83a5d1e18 None admin] RBAC: Authorizing `identity:get_project(project_id=fc0403c3048d4edda1f269cbae51e34a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:55:12.165676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a0c83-8f74-4dcd-a777-a9a83a5d1e18 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:55:12.167395 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 603/1199] 10.222.0.39 () {56 vars in 1186 bytes} [Sun Aug 7 00:55:11 2022] GET /identity/v3/projects/fc0403c3048d4edda1f269cbae51e34a => generated 361 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:55:12.174152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06b620-da4a-4daf-82db-16a6f3692626 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:55:12.243582 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:12.290525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06b620-da4a-4daf-82db-16a6f3692626 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:55:12.327027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b1e41-4340-422a-80c0-4c94bba44f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:55:12.327772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b1e41-4340-422a-80c0-4c94bba44f74 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:55:12.328186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b1e41-4340-422a-80c0-4c94bba44f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:55:12.328575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b1e41-4340-422a-80c0-4c94bba44f74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:55:12.329449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b1e41-4340-422a-80c0-4c94bba44f74 None admin] RBAC: Adding query filter params (role.id=695b07606e564668bac7afff4ab6052a, scope.project.id=fc0403c3048d4edda1f269cbae51e34a, user.id=564b2d480b2d4e889098f632fa82d9db) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:55:12.329880 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b1e41-4340-422a-80c0-4c94bba44f74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:55:12.331485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b1e41-4340-422a-80c0-4c94bba44f74 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:55:12.338676 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 597/1200] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:55:12 2022] GET /identity/v3/role_assignments?user.id=564b2d480b2d4e889098f632fa82d9db&scope.project.id=fc0403c3048d4edda1f269cbae51e34a&role.id=695b07606e564668bac7afff4ab6052a => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:55:22.156355 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=77 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:55:22.335940 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=39 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:17.347295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec22e0-10b5-40bc-9aa5-79d435dd3045 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:17.347295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec22e0-10b5-40bc-9aa5-79d435dd3045 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:17.347295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec22e0-10b5-40bc-9aa5-79d435dd3045 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:17.348616 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 604/1201] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:56:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:56:17.355457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ca26f-5610-4723-868c-d0ca637defad None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:17.356586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ca26f-5610-4723-868c-d0ca637defad None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:17.356926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ca26f-5610-4723-868c-d0ca637defad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:17.380889 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-be1ca26f-5610-4723-868c-d0ca637defad None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:56:17.382296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-be1ca26f-5610-4723-868c-d0ca637defad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:17.506589 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 598/1202] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:56:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:56:17.552104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec22e0-10b5-40bc-9aa5-79d435dd3045 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:17.767326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec22e0-10b5-40bc-9aa5-79d435dd3045 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:17.837820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad354c-21de-4e89-ab4b-808e22009846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:17.838484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad354c-21de-4e89-ab4b-808e22009846 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:17.838824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad354c-21de-4e89-ab4b-808e22009846 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:17.839084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad354c-21de-4e89-ab4b-808e22009846 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:17.857595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad354c-21de-4e89-ab4b-808e22009846 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:17.859203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad354c-21de-4e89-ab4b-808e22009846 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:17.882435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-4dad354c-21de-4e89-ab4b-808e22009846 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:56:17.882435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:17.882435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:56:17.882435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:56:17.882435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:56:17.882435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:56:17.882435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:56:17.882435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:56:17.882435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:56:17.882435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:56:17.882435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:56:17.882435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:56:17.882435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:56:17.882435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:56:17.882435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:56:17.882435 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:56:17.884508 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:56:17.884508 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:56:17.884508 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:56:17.884508 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:56:17.884508 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:56:17.884508 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:56:17.884508 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:56:17.884508 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:56:17.884508 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:56:17.884508 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:56:17.884508 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:56:17.884508 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:56:17.884508 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:56:17.884508 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:56:17.884508 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:56:17.884508 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:56:17.884508 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:56:17.885595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:56:17.885595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:56:17.885595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:56:17.885595 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 605/1203] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:56:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:56:17.890997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ca26f-5610-4723-868c-d0ca637defad None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:18.089612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ca26f-5610-4723-868c-d0ca637defad None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:18.162755 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:18.177120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63311bc-0912-4889-b16c-166a7a52843c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:18.178217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63311bc-0912-4889-b16c-166a7a52843c None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:18.178700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63311bc-0912-4889-b16c-166a7a52843c None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:18.181907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63311bc-0912-4889-b16c-166a7a52843c None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:18.181907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63311bc-0912-4889-b16c-166a7a52843c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:18.181907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63311bc-0912-4889-b16c-166a7a52843c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:18.183648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63311bc-0912-4889-b16c-166a7a52843c None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:18.209881 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 599/1204] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:56:18.220171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad354c-21de-4e89-ab4b-808e22009846 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:18.330326 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:18.434364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad354c-21de-4e89-ab4b-808e22009846 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:18.518705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25bbbf-57df-41f3-a793-4d1941f831c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:18.519896 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25bbbf-57df-41f3-a793-4d1941f831c7 None admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:18.521055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25bbbf-57df-41f3-a793-4d1941f831c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:18.521460 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25bbbf-57df-41f3-a793-4d1941f831c7 None admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:18.523417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25bbbf-57df-41f3-a793-4d1941f831c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:18.525747 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25bbbf-57df-41f3-a793-4d1941f831c7 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:18.573333 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 606/1205] 10.222.0.39 () {60 vars in 1132 bytes} [Sun Aug 7 00:56:18 2022] POST /identity/v3/users => generated 251 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:56:21.574367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef96e6-d32f-4d64-813c-c871d200438d None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:21.574367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef96e6-d32f-4d64-813c-c871d200438d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:21.574367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef96e6-d32f-4d64-813c-c871d200438d None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:21.576107 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 600/1206] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:56:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:56:21.580696 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9468834-c325-4ca9-bead-fca656c43820 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:21.581374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9468834-c325-4ca9-bead-fca656c43820 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:21.581374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9468834-c325-4ca9-bead-fca656c43820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:21.619280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b9468834-c325-4ca9-bead-fca656c43820 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:56:21.622000 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b9468834-c325-4ca9-bead-fca656c43820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:21.771737 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 607/1207] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:56:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:56:21.800950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef96e6-d32f-4d64-813c-c871d200438d None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:21.972205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef96e6-d32f-4d64-813c-c871d200438d None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:22.022441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6266094-ae93-4192-a5e3-c052b64ecacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:22.023112 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6266094-ae93-4192-a5e3-c052b64ecacd None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:22.023358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6266094-ae93-4192-a5e3-c052b64ecacd None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:22.023654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6266094-ae93-4192-a5e3-c052b64ecacd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:22.048306 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6266094-ae93-4192-a5e3-c052b64ecacd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:56:22.057806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-e6266094-ae93-4192-a5e3-c052b64ecacd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:56:22.057806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:22.057806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:56:22.057806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:56:22.057806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:56:22.057806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:56:22.057806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:56:22.057806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:56:22.057806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:56:22.057806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:56:22.057806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:56:22.057806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:56:22.057806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:56:22.057806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:56:22.057806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:56:22.057806 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:56:22.058858 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:56:22.058858 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:56:22.058858 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:56:22.058858 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:56:22.058858 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:56:22.058858 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:56:22.058858 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:56:22.058858 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:56:22.058858 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:56:22.058858 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:56:22.058858 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:56:22.058858 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:56:22.058858 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:56:22.058858 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:56:22.058858 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:56:22.058858 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:56:22.059741 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:56:22.059741 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:56:22.059741 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:56:22.059741 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:56:22.059741 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:56:22.059741 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:56:22.059741 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:56:22.059741 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:56:22.059741 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:56:22.059741 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:56:22.059741 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:56:22.059741 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:56:22.059741 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 601/1208] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Aug 7 00:56:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:56:22.065186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9468834-c325-4ca9-bead-fca656c43820 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:22.124206 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:22.240139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9468834-c325-4ca9-bead-fca656c43820 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:22.344481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b571b1-f794-44d1-a5a6-f8135682e19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:22.345411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b571b1-f794-44d1-a5a6-f8135682e19a None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:22.345899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b571b1-f794-44d1-a5a6-f8135682e19a None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:22.346976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b571b1-f794-44d1-a5a6-f8135682e19a None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:22.348007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b571b1-f794-44d1-a5a6-f8135682e19a None admin] RBAC: Adding query filter params (name=service) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:22.348550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b571b1-f794-44d1-a5a6-f8135682e19a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:22.350247 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b571b1-f794-44d1-a5a6-f8135682e19a None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:22.368984 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 608/1209] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Aug 7 00:56:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:56:22.372417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6266094-ae93-4192-a5e3-c052b64ecacd None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:22.438515 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:22.506277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6266094-ae93-4192-a5e3-c052b64ecacd None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:22.546848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a831a67-b48f-440a-ae55-57c59e090969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:22.547570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a831a67-b48f-440a-ae55-57c59e090969 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:22.547835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a831a67-b48f-440a-ae55-57c59e090969 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:22.548186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a831a67-b48f-440a-ae55-57c59e090969 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:22.561973 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a831a67-b48f-440a-ae55-57c59e090969 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:22.562625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a831a67-b48f-440a-ae55-57c59e090969 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:22.579421 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-3a831a67-b48f-440a-ae55-57c59e090969 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:56:22.579421 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:22.579421 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:56:22.579421 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:56:22.579421 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:56:22.579421 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:56:22.579421 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:56:22.579421 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:56:22.579421 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:56:22.579421 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:56:22.579421 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:56:22.579421 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:56:22.579421 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:56:22.579421 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:56:22.579421 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:56:22.579421 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:56:22.581742 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:56:22.581742 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:56:22.581742 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:56:22.581742 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:56:22.581742 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:56:22.581742 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:56:22.581742 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:56:22.581742 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:56:22.581742 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:56:22.581742 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:56:22.581742 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:56:22.581742 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:56:22.581742 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:56:22.581742 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:56:22.581742 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:56:22.581742 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:56:22.581742 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:56:22.582669 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:56:22.582669 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:56:22.582669 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:56:22.582669 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 602/1210] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:56:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:56:22.587217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b571b1-f794-44d1-a5a6-f8135682e19a None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:22.786195 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:22.790774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b571b1-f794-44d1-a5a6-f8135682e19a None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:22.885978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39571114-3348-4a7b-b44e-ead1872a9de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:22.886716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39571114-3348-4a7b-b44e-ead1872a9de3 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:22.887041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39571114-3348-4a7b-b44e-ead1872a9de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:22.887374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39571114-3348-4a7b-b44e-ead1872a9de3 None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:22.888170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39571114-3348-4a7b-b44e-ead1872a9de3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:22.889153 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39571114-3348-4a7b-b44e-ead1872a9de3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:22.891364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39571114-3348-4a7b-b44e-ead1872a9de3 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:22.922272 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 609/1211] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:56:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:56:22.931219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a831a67-b48f-440a-ae55-57c59e090969 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:23.178566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a831a67-b48f-440a-ae55-57c59e090969 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:23.182102 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:23.247646 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd344d3-2eb5-474d-948c-97c853c5d3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:23.248611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd344d3-2eb5-474d-948c-97c853c5d3be None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:23.249161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd344d3-2eb5-474d-948c-97c853c5d3be None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:23.249634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd344d3-2eb5-474d-948c-97c853c5d3be None admin] PATH_INFO: `/v3/users/placement` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:23.272728 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd344d3-2eb5-474d-948c-97c853c5d3be None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:23.276886 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd344d3-2eb5-474d-948c-97c853c5d3be None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:23.305319 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-bcd344d3-2eb5-474d-948c-97c853c5d3be None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 00:56:23.305319 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:23.305319 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:56:23.305319 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:56:23.305319 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:56:23.305319 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:56:23.305319 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:56:23.305319 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:56:23.305319 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:56:23.305319 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:56:23.305319 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:56:23.305319 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:56:23.305319 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:56:23.305319 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:56:23.305319 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:56:23.305319 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:56:23.307535 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:56:23.307535 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:56:23.307535 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:56:23.307535 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:56:23.307535 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:56:23.307535 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:56:23.307535 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:56:23.307535 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:56:23.307535 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:56:23.307535 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:56:23.307535 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:56:23.307535 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:56:23.307535 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:56:23.307535 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:56:23.307535 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:56:23.307535 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:56:23.307535 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:56:23.307535 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:56:23.309702 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:56:23.309702 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:56:23.309702 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:56:23.309702 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:56:23.309702 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:56:23.309702 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:56:23.309702 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:56:23.309702 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:56:23.309702 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 00:56:23.309702 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:56:23.311649 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 603/1212] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:56:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:56:23.320314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39571114-3348-4a7b-b44e-ead1872a9de3 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:23.558807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39571114-3348-4a7b-b44e-ead1872a9de3 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:23.625376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d199bb4-9186-40be-be8e-a674a0a73743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:23.627046 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d199bb4-9186-40be-be8e-a674a0a73743 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:23.627621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d199bb4-9186-40be-be8e-a674a0a73743 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:23.628261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d199bb4-9186-40be-be8e-a674a0a73743 None admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:23.629278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d199bb4-9186-40be-be8e-a674a0a73743 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:23.629780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d199bb4-9186-40be-be8e-a674a0a73743 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:23.631505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d199bb4-9186-40be-be8e-a674a0a73743 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:23.661903 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 610/1213] 10.222.0.39 () {56 vars in 1143 bytes} [Sun Aug 7 00:56:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:56:23.669408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd344d3-2eb5-474d-948c-97c853c5d3be None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:23.828075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd344d3-2eb5-474d-948c-97c853c5d3be None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:23.880416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c943fd-9a16-427b-864c-5843715163c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:23.881364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c943fd-9a16-427b-864c-5843715163c0 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:23.881759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c943fd-9a16-427b-864c-5843715163c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:23.882156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c943fd-9a16-427b-864c-5843715163c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:23.941024 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:24.032097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c943fd-9a16-427b-864c-5843715163c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:24.035424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c943fd-9a16-427b-864c-5843715163c0 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:24.225878 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 604/1214] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:56:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 00:56:24.234115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d199bb4-9186-40be-be8e-a674a0a73743 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:24.264367 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:24.402773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d199bb4-9186-40be-be8e-a674a0a73743 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:24.466491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c00bde-8edf-4631-aafa-3f1bb272c2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:24.467517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c00bde-8edf-4631-aafa-3f1bb272c2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:24.469353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c00bde-8edf-4631-aafa-3f1bb272c2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:24.469353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c00bde-8edf-4631-aafa-3f1bb272c2f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:24.498243 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c00bde-8edf-4631-aafa-3f1bb272c2f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:24.501173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c00bde-8edf-4631-aafa-3f1bb272c2f2 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:24.532347 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-03c00bde-8edf-4631-aafa-3f1bb272c2f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:56:24.532347 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:24.532347 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:56:24.532347 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:56:24.532347 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:56:24.532347 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:56:24.532347 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:56:24.532347 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:56:24.532347 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:56:24.532347 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:56:24.532347 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:56:24.532347 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:56:24.532347 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:56:24.532347 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:56:24.532347 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:56:24.532347 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:56:24.534828 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:56:24.534828 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:56:24.534828 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:56:24.534828 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:56:24.534828 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:56:24.534828 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:56:24.534828 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:56:24.534828 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:56:24.534828 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:56:24.534828 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:56:24.534828 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:56:24.534828 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:56:24.534828 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:56:24.534828 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:56:24.534828 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:56:24.534828 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:56:24.534828 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:56:24.541503 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:56:24.541503 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:56:24.541503 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:56:24.541503 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 611/1215] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:56:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:56:24.543581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c943fd-9a16-427b-864c-5843715163c0 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:24.655496 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:24.724881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c943fd-9a16-427b-864c-5843715163c0 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:24.795596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad8ebb-6844-4046-b151-bdec243d6776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:24.796390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad8ebb-6844-4046-b151-bdec243d6776 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:24.796737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad8ebb-6844-4046-b151-bdec243d6776 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:24.797146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad8ebb-6844-4046-b151-bdec243d6776 None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:24.797900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad8ebb-6844-4046-b151-bdec243d6776 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:24.798434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad8ebb-6844-4046-b151-bdec243d6776 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:24.800726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad8ebb-6844-4046-b151-bdec243d6776 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:24.819321 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 605/1216] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:56:24.825798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c00bde-8edf-4631-aafa-3f1bb272c2f2 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:24.958791 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:25.022353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c00bde-8edf-4631-aafa-3f1bb272c2f2 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:25.085697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4203aa-21ce-4224-9131-31f9937aeaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:25.087150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4203aa-21ce-4224-9131-31f9937aeaf1 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:25.087757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4203aa-21ce-4224-9131-31f9937aeaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:25.088082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4203aa-21ce-4224-9131-31f9937aeaf1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:25.104057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4203aa-21ce-4224-9131-31f9937aeaf1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:25.107563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4203aa-21ce-4224-9131-31f9937aeaf1 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:25.126590 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-bb4203aa-21ce-4224-9131-31f9937aeaf1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:56:25.126590 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:25.126590 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:56:25.126590 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:56:25.126590 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:56:25.126590 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:56:25.126590 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:56:25.126590 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:56:25.126590 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:56:25.126590 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:56:25.126590 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:56:25.126590 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:56:25.126590 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:56:25.126590 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:56:25.126590 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:56:25.129758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:56:25.129758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:56:25.129758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:56:25.129758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:56:25.129758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:56:25.129758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:56:25.129758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:56:25.129758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:56:25.129758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:56:25.129758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:56:25.129758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:56:25.129758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:56:25.129758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:56:25.129758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:56:25.129758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:56:25.129758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:56:25.129758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:56:25.131915 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:56:25.131915 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:56:25.131915 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:56:25.131915 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:56:25.131915 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:56:25.131915 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:56:25.131915 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:56:25.131915 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:56:25.131915 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 612/1217] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:56:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:56:25.140419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad8ebb-6844-4046-b151-bdec243d6776 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:25.313883 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad8ebb-6844-4046-b151-bdec243d6776 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:25.362290 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:25.383043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f465a84-1d9f-4428-9332-70190d8a77f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:25.383751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f465a84-1d9f-4428-9332-70190d8a77f7 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:25.384108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f465a84-1d9f-4428-9332-70190d8a77f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:25.384387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f465a84-1d9f-4428-9332-70190d8a77f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:25.385117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f465a84-1d9f-4428-9332-70190d8a77f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:25.385425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f465a84-1d9f-4428-9332-70190d8a77f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:25.387023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f465a84-1d9f-4428-9332-70190d8a77f7 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:25.401773 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 606/1218] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:56:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:56:25.408620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4203aa-21ce-4224-9131-31f9937aeaf1 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:25.594526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4203aa-21ce-4224-9131-31f9937aeaf1 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:25.651131 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:25.661835 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3f598-517d-44b7-883f-06fb3f45ece8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:25.662827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3f598-517d-44b7-883f-06fb3f45ece8 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:25.663284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3f598-517d-44b7-883f-06fb3f45ece8 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:25.663746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3f598-517d-44b7-883f-06fb3f45ece8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:25.665039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3f598-517d-44b7-883f-06fb3f45ece8 None admin] RBAC: Adding query filter params (role.id=af03b67d56b44430ab9d48dcba18ace2, scope.project.id=1cd2efda8567437e983e3a7867ecd69b, user.id=e3a1871b12e54ecdb9d656799385d05b) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:25.665654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3f598-517d-44b7-883f-06fb3f45ece8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:25.670036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3f598-517d-44b7-883f-06fb3f45ece8 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:25.679566 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 613/1219] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:56:25 2022] GET /identity/v3/role_assignments?user.id=e3a1871b12e54ecdb9d656799385d05b&scope.project.id=1cd2efda8567437e983e3a7867ecd69b&role.id=af03b67d56b44430ab9d48dcba18ace2 => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:56:28.564734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafba853-a9d0-4150-8042-6b682b92dca0 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:28.565619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafba853-a9d0-4150-8042-6b682b92dca0 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:28.565619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafba853-a9d0-4150-8042-6b682b92dca0 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:28.567336 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 607/1220] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:56:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:56:28.579872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b0db5-a589-4d0b-b047-58c9ca60dd85 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:28.581310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b0db5-a589-4d0b-b047-58c9ca60dd85 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:28.581741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b0db5-a589-4d0b-b047-58c9ca60dd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:28.617507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c45b0db5-a589-4d0b-b047-58c9ca60dd85 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:56:28.619614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c45b0db5-a589-4d0b-b047-58c9ca60dd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:28.763064 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 614/1221] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:56:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:56:28.797062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafba853-a9d0-4150-8042-6b682b92dca0 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:28.992505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafba853-a9d0-4150-8042-6b682b92dca0 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:29.032495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e496bf-cdef-4165-9d20-28a8d154e0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:29.033148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e496bf-cdef-4165-9d20-28a8d154e0fe None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:29.033461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e496bf-cdef-4165-9d20-28a8d154e0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:29.033733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e496bf-cdef-4165-9d20-28a8d154e0fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:29.046543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e496bf-cdef-4165-9d20-28a8d154e0fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:56:29.051614 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-89e496bf-cdef-4165-9d20-28a8d154e0fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:56:29.051614 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:29.051614 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:56:29.051614 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:56:29.051614 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:56:29.051614 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:56:29.051614 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:56:29.051614 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:56:29.051614 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:56:29.051614 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:56:29.051614 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:56:29.051614 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:56:29.051614 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:56:29.051614 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:56:29.051614 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:56:29.051614 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:56:29.053406 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:56:29.053406 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:56:29.053406 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:56:29.053406 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:56:29.053406 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:56:29.053406 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:56:29.053406 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:56:29.053406 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:56:29.053406 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:56:29.053406 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:56:29.053406 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:56:29.053406 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:56:29.053406 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:56:29.053406 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:56:29.053406 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:56:29.053406 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:56:29.054281 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:56:29.054281 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:56:29.054281 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:56:29.054281 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:56:29.054281 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:56:29.054281 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:56:29.054281 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:56:29.054281 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:56:29.054281 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:56:29.054281 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:56:29.054281 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:56:29.054281 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:56:29.054281 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 608/1222] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Aug 7 00:56:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:56:29.063688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b0db5-a589-4d0b-b047-58c9ca60dd85 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:29.282571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b0db5-a589-4d0b-b047-58c9ca60dd85 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:29.329647 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:29.349337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d3f4b-0193-46e6-9c36-baae9b42eccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:29.350339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d3f4b-0193-46e6-9c36-baae9b42eccd None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:29.350636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d3f4b-0193-46e6-9c36-baae9b42eccd None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:29.351021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d3f4b-0193-46e6-9c36-baae9b42eccd None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:29.352104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d3f4b-0193-46e6-9c36-baae9b42eccd None admin] RBAC: Adding query filter params (name=service) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:29.352561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d3f4b-0193-46e6-9c36-baae9b42eccd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:29.355002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d3f4b-0193-46e6-9c36-baae9b42eccd None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:29.383945 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 615/1223] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Aug 7 00:56:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:56:29.392684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e496bf-cdef-4165-9d20-28a8d154e0fe None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:29.497255 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:29.607961 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e496bf-cdef-4165-9d20-28a8d154e0fe None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:29.676444 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6807045-333b-4049-998d-0811a84d1a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:29.677564 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6807045-333b-4049-998d-0811a84d1a26 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:29.678002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6807045-333b-4049-998d-0811a84d1a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:29.678500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6807045-333b-4049-998d-0811a84d1a26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:29.698593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6807045-333b-4049-998d-0811a84d1a26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:29.700913 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6807045-333b-4049-998d-0811a84d1a26 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:29.730010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-a6807045-333b-4049-998d-0811a84d1a26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:56:29.730010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:29.730010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:56:29.730010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:56:29.730010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:56:29.730010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:56:29.730010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:56:29.730010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:56:29.730010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:56:29.730010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:56:29.730010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:56:29.730010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:56:29.730010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:56:29.730010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:56:29.730010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:56:29.730010 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:56:29.731805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:56:29.731805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:56:29.731805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:56:29.731805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:56:29.731805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:56:29.731805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:56:29.731805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:56:29.731805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:56:29.731805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:56:29.731805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:56:29.731805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:56:29.731805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:56:29.731805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:56:29.731805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:56:29.731805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:56:29.731805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:56:29.731805 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:56:29.733091 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:56:29.733091 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:56:29.733091 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:56:29.733091 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 609/1224] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:56:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:56:29.742145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d3f4b-0193-46e6-9c36-baae9b42eccd None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:29.939937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d3f4b-0193-46e6-9c36-baae9b42eccd None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:30.005420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39e628-67e7-4a73-9e2f-8912206b7dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:30.006422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39e628-67e7-4a73-9e2f-8912206b7dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:30.006922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39e628-67e7-4a73-9e2f-8912206b7dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:30.007391 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39e628-67e7-4a73-9e2f-8912206b7dd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:30.008594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39e628-67e7-4a73-9e2f-8912206b7dd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:30.009135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39e628-67e7-4a73-9e2f-8912206b7dd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:30.011671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39e628-67e7-4a73-9e2f-8912206b7dd4 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:30.035690 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 616/1225] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:56:30.042980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6807045-333b-4049-998d-0811a84d1a26 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:30.230334 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:30.241586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6807045-333b-4049-998d-0811a84d1a26 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:30.290528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d121ba2-63aa-43ee-9035-6e3dacbc5df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:30.291372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d121ba2-63aa-43ee-9035-6e3dacbc5df2 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:30.291727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d121ba2-63aa-43ee-9035-6e3dacbc5df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:30.292143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d121ba2-63aa-43ee-9035-6e3dacbc5df2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:30.301992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d121ba2-63aa-43ee-9035-6e3dacbc5df2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:30.303709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d121ba2-63aa-43ee-9035-6e3dacbc5df2 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:30.318330 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-2d121ba2-63aa-43ee-9035-6e3dacbc5df2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 00:56:30.318330 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:30.318330 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:56:30.318330 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:56:30.318330 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:56:30.318330 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:56:30.318330 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:56:30.318330 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:56:30.318330 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:56:30.318330 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:56:30.318330 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:56:30.318330 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:56:30.318330 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:56:30.318330 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:56:30.318330 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:56:30.318330 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:56:30.325879 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:56:30.325879 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:56:30.325879 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:56:30.325879 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:56:30.325879 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:56:30.325879 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:56:30.325879 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:56:30.325879 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:56:30.325879 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:56:30.325879 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:56:30.325879 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:56:30.325879 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:56:30.325879 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:56:30.325879 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:56:30.325879 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:56:30.325879 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:56:30.325879 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:56:30.325879 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:56:30.327727 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:56:30.327727 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:56:30.327727 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:56:30.327727 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:56:30.327727 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:56:30.327727 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:56:30.327727 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:56:30.327727 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:56:30.327727 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 00:56:30.327727 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:56:30.327727 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 610/1226] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:56:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:56:30.328948 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39e628-67e7-4a73-9e2f-8912206b7dd4 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:30.410450 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:30.489046 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39e628-67e7-4a73-9e2f-8912206b7dd4 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:30.547922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c157794-5009-4a67-b6f4-c306d8420e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:30.550041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c157794-5009-4a67-b6f4-c306d8420e97 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:30.550833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c157794-5009-4a67-b6f4-c306d8420e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:30.551537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c157794-5009-4a67-b6f4-c306d8420e97 None admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:30.553941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c157794-5009-4a67-b6f4-c306d8420e97 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:30.554807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c157794-5009-4a67-b6f4-c306d8420e97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:30.558854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c157794-5009-4a67-b6f4-c306d8420e97 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:30.593204 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 617/1227] 10.222.0.39 () {56 vars in 1143 bytes} [Sun Aug 7 00:56:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:56:30.602648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d121ba2-63aa-43ee-9035-6e3dacbc5df2 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:30.787733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d121ba2-63aa-43ee-9035-6e3dacbc5df2 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:30.852655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abbad9-51f3-4955-9757-a9bf4972c836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:30.853947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abbad9-51f3-4955-9757-a9bf4972c836 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:30.854434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abbad9-51f3-4955-9757-a9bf4972c836 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:30.854845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abbad9-51f3-4955-9757-a9bf4972c836 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:30.876091 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6abbad9-51f3-4955-9757-a9bf4972c836 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:30.879376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6abbad9-51f3-4955-9757-a9bf4972c836 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:30.905935 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-a6abbad9-51f3-4955-9757-a9bf4972c836 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:56:30.905935 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:30.905935 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:56:30.905935 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:56:30.905935 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:56:30.905935 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:56:30.905935 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:56:30.905935 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:56:30.905935 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:56:30.905935 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:56:30.905935 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:56:30.905935 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:56:30.905935 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:56:30.905935 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:56:30.905935 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:56:30.905935 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:56:30.913426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:56:30.913426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:56:30.913426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:56:30.913426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:56:30.913426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:56:30.913426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:56:30.913426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:56:30.913426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:56:30.913426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:56:30.913426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:56:30.913426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:56:30.913426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:56:30.913426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:56:30.913426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:56:30.913426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:56:30.913426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:56:30.913426 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:56:30.915337 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:56:30.915337 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:56:30.915337 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:56:30.915337 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 611/1228] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:56:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:56:30.915802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c157794-5009-4a67-b6f4-c306d8420e97 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:31.087778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c157794-5009-4a67-b6f4-c306d8420e97 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:31.090741 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:31.133273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78f631-7c87-47b3-b320-617a387cfa89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:31.133892 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78f631-7c87-47b3-b320-617a387cfa89 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:31.134167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78f631-7c87-47b3-b320-617a387cfa89 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:31.134460 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78f631-7c87-47b3-b320-617a387cfa89 None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:31.135118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78f631-7c87-47b3-b320-617a387cfa89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:31.135418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78f631-7c87-47b3-b320-617a387cfa89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:31.136921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78f631-7c87-47b3-b320-617a387cfa89 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:31.151637 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 618/1229] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:56:31.159135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abbad9-51f3-4955-9757-a9bf4972c836 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:31.178245 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:31.380547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abbad9-51f3-4955-9757-a9bf4972c836 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:31.455851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75cf7f-ba51-4e38-8dfb-16201c6b8fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:31.456889 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75cf7f-ba51-4e38-8dfb-16201c6b8fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:31.457311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75cf7f-ba51-4e38-8dfb-16201c6b8fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:31.457744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75cf7f-ba51-4e38-8dfb-16201c6b8fe3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:31.471109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75cf7f-ba51-4e38-8dfb-16201c6b8fe3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:31.473873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75cf7f-ba51-4e38-8dfb-16201c6b8fe3 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:31.492714 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-7f75cf7f-ba51-4e38-8dfb-16201c6b8fe3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:56:31.492714 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:31.492714 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:56:31.492714 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:56:31.492714 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:56:31.492714 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:56:31.492714 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:56:31.492714 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:56:31.492714 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:56:31.492714 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:56:31.492714 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:56:31.492714 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:56:31.492714 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:56:31.492714 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:56:31.492714 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:56:31.495238 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:56:31.495238 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:56:31.495238 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:56:31.495238 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:56:31.495238 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:56:31.495238 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:56:31.495238 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:56:31.495238 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:56:31.495238 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:56:31.495238 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:56:31.495238 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:56:31.495238 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:56:31.495238 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:56:31.495238 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:56:31.495238 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:56:31.495238 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:56:31.495238 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:56:31.497213 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:56:31.497213 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:56:31.497213 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:56:31.497213 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:56:31.497213 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:56:31.497213 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:56:31.497213 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:56:31.497213 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:56:31.497213 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 612/1230] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:56:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:56:31.504834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78f631-7c87-47b3-b320-617a387cfa89 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:31.674675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78f631-7c87-47b3-b320-617a387cfa89 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:31.737902 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915d8d6-037e-4a74-a625-1933f4bc116d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:31.739153 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915d8d6-037e-4a74-a625-1933f4bc116d None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:31.739709 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915d8d6-037e-4a74-a625-1933f4bc116d None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:31.740312 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915d8d6-037e-4a74-a625-1933f4bc116d None admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:31.741784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915d8d6-037e-4a74-a625-1933f4bc116d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:31.742405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915d8d6-037e-4a74-a625-1933f4bc116d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:31.745589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915d8d6-037e-4a74-a625-1933f4bc116d None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:31.773639 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 619/1231] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:56:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:56:31.783937 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75cf7f-ba51-4e38-8dfb-16201c6b8fe3 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:31.884433 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:31.933936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75cf7f-ba51-4e38-8dfb-16201c6b8fe3 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:31.981902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12832004-41f7-47f5-b3c1-d384f2b1b6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:31.982729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12832004-41f7-47f5-b3c1-d384f2b1b6ce None admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:31.983123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12832004-41f7-47f5-b3c1-d384f2b1b6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:31.983498 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12832004-41f7-47f5-b3c1-d384f2b1b6ce None admin] PATH_INFO: `/v3/projects/1cd2efda8567437e983e3a7867ecd69b/users/e3a1871b12e54ecdb9d656799385d05b/roles/af03b67d56b44430ab9d48dcba18ace2` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:32.007533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12832004-41f7-47f5-b3c1-d384f2b1b6ce None admin] RBAC: Authorizing `identity:create_grant(project_id=1cd2efda8567437e983e3a7867ecd69b, user_id=e3a1871b12e54ecdb9d656799385d05b, role_id=af03b67d56b44430ab9d48dcba18ace2)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:32.009255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12832004-41f7-47f5-b3c1-d384f2b1b6ce None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:32.025947 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 613/1232] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Aug 7 00:56:31 2022] PUT /identity/v3/projects/1cd2efda8567437e983e3a7867ecd69b/users/e3a1871b12e54ecdb9d656799385d05b/roles/af03b67d56b44430ab9d48dcba18ace2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:56:34.685866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2ac19-1478-472c-843f-9e938e8584eb None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:34.686594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2ac19-1478-472c-843f-9e938e8584eb None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:34.686594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2ac19-1478-472c-843f-9e938e8584eb None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:34.688078 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 620/1233] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:56:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:56:34.695338 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a1b47-1e9e-4e99-b596-519bc4325d57 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:34.696185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a1b47-1e9e-4e99-b596-519bc4325d57 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:34.696185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a1b47-1e9e-4e99-b596-519bc4325d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:34.717111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-334a1b47-1e9e-4e99-b596-519bc4325d57 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:56:34.718334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-334a1b47-1e9e-4e99-b596-519bc4325d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:34.822205 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 614/1234] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:56:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:56:34.868166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2ac19-1478-472c-843f-9e938e8584eb None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:34.910294 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:35.048017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2ac19-1478-472c-843f-9e938e8584eb None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:35.108193 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7192c-1501-4aea-8156-57bd96d63980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:35.108976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7192c-1501-4aea-8156-57bd96d63980 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:35.109386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7192c-1501-4aea-8156-57bd96d63980 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:35.109821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7192c-1501-4aea-8156-57bd96d63980 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:35.125546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7192c-1501-4aea-8156-57bd96d63980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:56:35.133566 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-a5b7192c-1501-4aea-8156-57bd96d63980 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:56:35.133566 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:35.133566 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:56:35.133566 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:56:35.133566 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:56:35.133566 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:56:35.133566 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:56:35.133566 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:56:35.133566 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:56:35.133566 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:56:35.133566 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:56:35.133566 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:56:35.133566 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:56:35.133566 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:56:35.133566 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:56:35.133566 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:56:35.135815 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:56:35.135815 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:56:35.135815 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:56:35.135815 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:56:35.135815 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:56:35.135815 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:56:35.135815 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:56:35.135815 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:56:35.135815 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:56:35.135815 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:56:35.135815 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:56:35.135815 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:56:35.135815 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:56:35.135815 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:56:35.135815 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:56:35.135815 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:56:35.137744 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:56:35.137744 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:56:35.137744 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:56:35.137744 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:56:35.137744 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:56:35.137744 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:56:35.137744 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:56:35.137744 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:56:35.137744 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:56:35.137744 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:56:35.137744 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 07 00:56:35.137744 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:56:35.137744 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 621/1235] 10.222.0.39 () {56 vars in 1102 bytes} [Sun Aug 7 00:56:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:56:35.145882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a1b47-1e9e-4e99-b596-519bc4325d57 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:35.203610 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:35.309358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a1b47-1e9e-4e99-b596-519bc4325d57 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:35.363846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770fd6d-f9dc-410a-b3e7-d4995534897d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:35.364495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770fd6d-f9dc-410a-b3e7-d4995534897d None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:35.364948 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770fd6d-f9dc-410a-b3e7-d4995534897d None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:35.365384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770fd6d-f9dc-410a-b3e7-d4995534897d None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:35.366559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770fd6d-f9dc-410a-b3e7-d4995534897d None admin] RBAC: Adding query filter params (name=service) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:35.366869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770fd6d-f9dc-410a-b3e7-d4995534897d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:35.369046 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770fd6d-f9dc-410a-b3e7-d4995534897d None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:35.387967 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 615/1236] 10.222.0.39 () {56 vars in 1103 bytes} [Sun Aug 7 00:56:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:56:35.396127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7192c-1501-4aea-8156-57bd96d63980 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:35.548396 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:35.582015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7192c-1501-4aea-8156-57bd96d63980 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:35.634845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cdd61-f0de-46b9-9abd-107abc356475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:35.636339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cdd61-f0de-46b9-9abd-107abc356475 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:35.636952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cdd61-f0de-46b9-9abd-107abc356475 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:35.637515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cdd61-f0de-46b9-9abd-107abc356475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:35.663712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cdd61-f0de-46b9-9abd-107abc356475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:35.667042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cdd61-f0de-46b9-9abd-107abc356475 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:35.698340 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-bf8cdd61-f0de-46b9-9abd-107abc356475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:56:35.698340 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:35.698340 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:56:35.698340 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:56:35.698340 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:56:35.698340 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:56:35.698340 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:56:35.698340 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:56:35.698340 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:56:35.698340 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:56:35.698340 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:56:35.698340 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:56:35.698340 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:56:35.698340 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:56:35.698340 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:56:35.698340 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:56:35.700572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:56:35.700572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:56:35.700572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:56:35.700572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:56:35.700572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:56:35.700572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:56:35.700572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:56:35.700572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:56:35.700572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:56:35.700572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:56:35.700572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:56:35.700572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:56:35.700572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:56:35.700572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:56:35.700572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:56:35.700572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:56:35.700572 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:56:35.702765 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:56:35.702765 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:56:35.702765 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:56:35.702765 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 622/1237] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:56:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:56:35.710918 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770fd6d-f9dc-410a-b3e7-d4995534897d None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:35.898741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770fd6d-f9dc-410a-b3e7-d4995534897d None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:35.914766 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:35.945344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7549d3-bf69-495e-958b-5970433868db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:35.945980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7549d3-bf69-495e-958b-5970433868db None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:35.946241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7549d3-bf69-495e-958b-5970433868db None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:35.946498 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7549d3-bf69-495e-958b-5970433868db None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:35.947160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7549d3-bf69-495e-958b-5970433868db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:35.947462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7549d3-bf69-495e-958b-5970433868db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:35.948900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7549d3-bf69-495e-958b-5970433868db None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:35.971035 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 616/1238] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:56:35.978702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cdd61-f0de-46b9-9abd-107abc356475 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:36.137470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cdd61-f0de-46b9-9abd-107abc356475 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:36.183807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18f1fb-9669-4053-b6ce-6bf5b4ac6d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:36.192587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18f1fb-9669-4053-b6ce-6bf5b4ac6d61 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:36.193103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18f1fb-9669-4053-b6ce-6bf5b4ac6d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:36.193502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18f1fb-9669-4053-b6ce-6bf5b4ac6d61 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:36.197499 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:36.207736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18f1fb-9669-4053-b6ce-6bf5b4ac6d61 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:36.210117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18f1fb-9669-4053-b6ce-6bf5b4ac6d61 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:36.225029 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-fa18f1fb-9669-4053-b6ce-6bf5b4ac6d61 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 00:56:36.225029 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:36.225029 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:56:36.225029 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:56:36.225029 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:56:36.225029 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:56:36.225029 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:56:36.225029 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:56:36.225029 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:56:36.225029 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:56:36.225029 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:56:36.225029 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:56:36.225029 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:56:36.225029 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:56:36.225029 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:56:36.225029 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:56:36.226971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:56:36.226971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:56:36.226971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:56:36.226971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:56:36.226971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:56:36.226971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:56:36.226971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:56:36.226971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:56:36.226971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:56:36.226971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:56:36.226971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:56:36.226971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:56:36.226971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:56:36.226971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:56:36.226971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:56:36.226971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:56:36.226971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:56:36.226971 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:56:36.228992 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:56:36.228992 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:56:36.228992 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:56:36.228992 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:56:36.228992 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:56:36.228992 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:56:36.228992 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:56:36.228992 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:56:36.228992 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 00:56:36.228992 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:56:36.228992 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 623/1239] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:56:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:56:36.232396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7549d3-bf69-495e-958b-5970433868db None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:36.370892 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7549d3-bf69-495e-958b-5970433868db None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:36.431941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d46fe5-4796-417d-8ecb-98e4646476e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:36.432570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d46fe5-4796-417d-8ecb-98e4646476e4 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:36.432865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d46fe5-4796-417d-8ecb-98e4646476e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:36.433131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d46fe5-4796-417d-8ecb-98e4646476e4 None admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:36.433993 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d46fe5-4796-417d-8ecb-98e4646476e4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:36.434234 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d46fe5-4796-417d-8ecb-98e4646476e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:36.435673 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d46fe5-4796-417d-8ecb-98e4646476e4 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:36.457678 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 617/1240] 10.222.0.39 () {56 vars in 1143 bytes} [Sun Aug 7 00:56:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:56:36.464403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18f1fb-9669-4053-b6ce-6bf5b4ac6d61 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:36.652021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18f1fb-9669-4053-b6ce-6bf5b4ac6d61 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:36.716855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5a971-2fe4-429b-8373-87440975b786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:36.717986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5a971-2fe4-429b-8373-87440975b786 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:36.718192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5a971-2fe4-429b-8373-87440975b786 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:36.718656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5a971-2fe4-429b-8373-87440975b786 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:36.837852 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:36.852416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5a971-2fe4-429b-8373-87440975b786 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:36.856216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5a971-2fe4-429b-8373-87440975b786 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:37.028500 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 624/1241] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:56:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 07 00:56:37.035717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d46fe5-4796-417d-8ecb-98e4646476e4 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:37.072036 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:37.174530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d46fe5-4796-417d-8ecb-98e4646476e4 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:37.221211 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d234f-1d68-4dff-9118-3b84a1aa7514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:37.222169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d234f-1d68-4dff-9118-3b84a1aa7514 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:37.222578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d234f-1d68-4dff-9118-3b84a1aa7514 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:37.222972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d234f-1d68-4dff-9118-3b84a1aa7514 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:37.237617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d234f-1d68-4dff-9118-3b84a1aa7514 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:37.239789 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d234f-1d68-4dff-9118-3b84a1aa7514 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:37.266715 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-487d234f-1d68-4dff-9118-3b84a1aa7514 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:56:37.266715 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:37.266715 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:56:37.266715 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:56:37.266715 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:56:37.266715 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:56:37.266715 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:56:37.266715 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:56:37.266715 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:56:37.266715 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:56:37.266715 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:56:37.266715 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:56:37.266715 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:56:37.266715 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:56:37.266715 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:56:37.266715 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:56:37.268244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:56:37.268244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:56:37.268244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:56:37.268244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:56:37.268244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:56:37.268244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:56:37.268244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:56:37.268244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:56:37.268244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:56:37.268244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:56:37.268244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:56:37.268244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:56:37.268244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:56:37.268244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:56:37.268244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:56:37.268244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:56:37.268244 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:56:37.269295 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:56:37.269295 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:56:37.269295 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:56:37.269295 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 618/1242] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:56:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:56:37.277781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5a971-2fe4-429b-8373-87440975b786 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:37.424393 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:37.434458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5a971-2fe4-429b-8373-87440975b786 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:37.485966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3716cc2-7258-4a56-b05c-80f858856837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:37.486936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3716cc2-7258-4a56-b05c-80f858856837 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:37.487354 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3716cc2-7258-4a56-b05c-80f858856837 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:37.487960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3716cc2-7258-4a56-b05c-80f858856837 None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:37.488964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3716cc2-7258-4a56-b05c-80f858856837 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:37.489414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3716cc2-7258-4a56-b05c-80f858856837 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:37.491062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3716cc2-7258-4a56-b05c-80f858856837 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:37.505881 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 625/1243] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:56:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:56:37.512307 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d234f-1d68-4dff-9118-3b84a1aa7514 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:37.636982 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:37.675432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d234f-1d68-4dff-9118-3b84a1aa7514 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:37.724330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231920f-4f7b-4c14-85e2-c11c875bf4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:37.725059 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231920f-4f7b-4c14-85e2-c11c875bf4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:37.725392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231920f-4f7b-4c14-85e2-c11c875bf4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:37.725735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231920f-4f7b-4c14-85e2-c11c875bf4c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:37.734078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231920f-4f7b-4c14-85e2-c11c875bf4c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:37.736240 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231920f-4f7b-4c14-85e2-c11c875bf4c8 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:37.751716 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-9231920f-4f7b-4c14-85e2-c11c875bf4c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:56:37.751716 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:37.751716 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:56:37.751716 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:56:37.751716 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:56:37.751716 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:56:37.751716 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:56:37.751716 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:56:37.751716 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:56:37.751716 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:56:37.751716 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:56:37.751716 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:56:37.751716 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:56:37.751716 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:56:37.751716 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:56:37.753859 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:56:37.753859 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:56:37.753859 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:56:37.753859 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:56:37.753859 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:56:37.753859 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:56:37.753859 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:56:37.753859 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:56:37.753859 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:56:37.753859 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:56:37.753859 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:56:37.753859 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:56:37.753859 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:56:37.753859 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:56:37.753859 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:56:37.753859 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:56:37.753859 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:56:37.755461 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:56:37.755461 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:56:37.755461 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:56:37.755461 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:56:37.755461 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:56:37.755461 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:56:37.755461 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:56:37.755461 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:56:37.755461 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 619/1244] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:56:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:56:37.761468 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3716cc2-7258-4a56-b05c-80f858856837 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:37.906750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3716cc2-7258-4a56-b05c-80f858856837 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:37.967733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acb1b9-a4ce-4b09-adfd-9bc866952124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:37.968777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acb1b9-a4ce-4b09-adfd-9bc866952124 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:37.969273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acb1b9-a4ce-4b09-adfd-9bc866952124 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:37.969778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acb1b9-a4ce-4b09-adfd-9bc866952124 None admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:37.971637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39acb1b9-a4ce-4b09-adfd-9bc866952124 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:37.972090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39acb1b9-a4ce-4b09-adfd-9bc866952124 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:37.974253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39acb1b9-a4ce-4b09-adfd-9bc866952124 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:37.995134 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 626/1245] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:56:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:56:38.008664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231920f-4f7b-4c14-85e2-c11c875bf4c8 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:38.187113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231920f-4f7b-4c14-85e2-c11c875bf4c8 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:38.247513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91df5d-d993-4acc-ad31-0d06752a852f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:38.248374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91df5d-d993-4acc-ad31-0d06752a852f None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:38.248820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91df5d-d993-4acc-ad31-0d06752a852f None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:38.249261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91df5d-d993-4acc-ad31-0d06752a852f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:38.250243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91df5d-d993-4acc-ad31-0d06752a852f None admin] RBAC: Adding query filter params (role.id=af03b67d56b44430ab9d48dcba18ace2, scope.project.id=1cd2efda8567437e983e3a7867ecd69b, user.id=e3a1871b12e54ecdb9d656799385d05b) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:38.250670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91df5d-d993-4acc-ad31-0d06752a852f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:38.253021 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac91df5d-d993-4acc-ad31-0d06752a852f None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:38.262256 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 620/1246] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:56:38 2022] GET /identity/v3/role_assignments?user.id=e3a1871b12e54ecdb9d656799385d05b&scope.project.id=1cd2efda8567437e983e3a7867ecd69b&role.id=af03b67d56b44430ab9d48dcba18ace2 => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:56:40.979790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0b6ca-3d0c-450d-b345-c64f00ee2a6f None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:40.980753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0b6ca-3d0c-450d-b345-c64f00ee2a6f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:40.980753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0b6ca-3d0c-450d-b345-c64f00ee2a6f None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:40.982155 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 627/1247] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:56:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:56:40.992551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa012e-18b0-4804-8897-bb28c2aeceaa None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:40.993531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa012e-18b0-4804-8897-bb28c2aeceaa None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:40.993952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa012e-18b0-4804-8897-bb28c2aeceaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:41.004602 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:41.025109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0dfa012e-18b0-4804-8897-bb28c2aeceaa None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:56:41.027148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0dfa012e-18b0-4804-8897-bb28c2aeceaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:41.135743 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 621/1248] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:56:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:56:41.164599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0b6ca-3d0c-450d-b345-c64f00ee2a6f None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:41.205356 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:41.349678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0b6ca-3d0c-450d-b345-c64f00ee2a6f None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:41.399099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52597d66-45ee-4e60-b204-1041d251c6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:41.399763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52597d66-45ee-4e60-b204-1041d251c6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:41.400072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52597d66-45ee-4e60-b204-1041d251c6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:41.400339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52597d66-45ee-4e60-b204-1041d251c6d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:41.424382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52597d66-45ee-4e60-b204-1041d251c6d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:56:41.432334 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-52597d66-45ee-4e60-b204-1041d251c6d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:56:41.432334 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:41.432334 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:56:41.432334 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:56:41.432334 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:56:41.432334 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:56:41.432334 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:56:41.432334 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:56:41.432334 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:56:41.432334 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:56:41.432334 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:56:41.432334 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:56:41.432334 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:56:41.432334 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:56:41.432334 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:56:41.432334 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:56:41.440452 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:56:41.440452 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:56:41.440452 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:56:41.440452 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:56:41.440452 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:56:41.440452 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:56:41.440452 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:56:41.440452 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:56:41.440452 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:56:41.440452 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:56:41.440452 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:56:41.440452 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:56:41.440452 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:56:41.440452 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:56:41.440452 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:56:41.440452 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:56:41.442531 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:56:41.442531 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:56:41.442531 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:56:41.442531 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:56:41.442531 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:56:41.442531 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:56:41.442531 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:56:41.442531 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:56:41.442531 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:56:41.442531 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:56:41.442531 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:56:41.442531 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:56:41.442531 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 628/1249] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:56:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:56:41.444243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa012e-18b0-4804-8897-bb28c2aeceaa None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:41.629025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa012e-18b0-4804-8897-bb28c2aeceaa None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:41.690934 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:41.697988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47df962-ebc9-4ef5-b443-46bafe4fbdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:41.698765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47df962-ebc9-4ef5-b443-46bafe4fbdd5 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:41.699206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47df962-ebc9-4ef5-b443-46bafe4fbdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:41.699854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47df962-ebc9-4ef5-b443-46bafe4fbdd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:41.701112 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47df962-ebc9-4ef5-b443-46bafe4fbdd5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:41.701571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47df962-ebc9-4ef5-b443-46bafe4fbdd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:41.703171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47df962-ebc9-4ef5-b443-46bafe4fbdd5 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:41.714955 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 622/1250] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:56:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:56:41.721947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52597d66-45ee-4e60-b204-1041d251c6d3 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:41.847694 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:41.882970 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52597d66-45ee-4e60-b204-1041d251c6d3 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:41.939767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5bf63-587d-49f6-8243-bb5deb888f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:41.941182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5bf63-587d-49f6-8243-bb5deb888f09 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:41.941832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5bf63-587d-49f6-8243-bb5deb888f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:41.942407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5bf63-587d-49f6-8243-bb5deb888f09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:41.963451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5bf63-587d-49f6-8243-bb5deb888f09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:41.967978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5bf63-587d-49f6-8243-bb5deb888f09 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:41.995053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-00c5bf63-587d-49f6-8243-bb5deb888f09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:56:41.995053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:41.995053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:56:41.995053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:56:41.995053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:56:41.995053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:56:41.995053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:56:41.995053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:56:41.995053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:56:41.995053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:56:41.995053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:56:41.995053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:56:41.995053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:56:41.995053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:56:41.995053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:56:41.995053 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:56:41.997970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:56:41.997970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:56:41.997970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:56:41.997970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:56:41.997970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:56:41.997970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:56:41.997970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:56:41.997970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:56:41.997970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:56:41.997970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:56:41.997970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:56:41.997970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:56:41.997970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:56:41.997970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:56:41.997970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:56:41.997970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:56:41.997970 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:56:42.000074 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:56:42.000074 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:56:42.000074 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:56:42.000074 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 629/1251] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:56:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:56:42.005616 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47df962-ebc9-4ef5-b443-46bafe4fbdd5 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:42.167855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47df962-ebc9-4ef5-b443-46bafe4fbdd5 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:42.218825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2ef00-6e18-4803-85ae-1c1d5f36ea07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:42.219818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2ef00-6e18-4803-85ae-1c1d5f36ea07 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:42.220297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2ef00-6e18-4803-85ae-1c1d5f36ea07 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:42.220687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2ef00-6e18-4803-85ae-1c1d5f36ea07 None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:42.221554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2ef00-6e18-4803-85ae-1c1d5f36ea07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:42.222004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2ef00-6e18-4803-85ae-1c1d5f36ea07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:42.223625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2ef00-6e18-4803-85ae-1c1d5f36ea07 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:42.241460 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 623/1252] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:56:42.253082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5bf63-587d-49f6-8243-bb5deb888f09 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:42.404289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5bf63-587d-49f6-8243-bb5deb888f09 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:42.445105 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:42.455109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ef850-e4d9-48a0-b1a2-3137ad463d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:42.455775 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ef850-e4d9-48a0-b1a2-3137ad463d07 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:42.456100 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ef850-e4d9-48a0-b1a2-3137ad463d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:42.456372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ef850-e4d9-48a0-b1a2-3137ad463d07 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:42.466184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ef850-e4d9-48a0-b1a2-3137ad463d07 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:42.468013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ef850-e4d9-48a0-b1a2-3137ad463d07 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:42.484164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-b33ef850-e4d9-48a0-b1a2-3137ad463d07 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 00:56:42.484164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:42.484164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:56:42.484164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:56:42.484164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:56:42.484164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:56:42.484164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:56:42.484164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:56:42.484164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:56:42.484164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:56:42.484164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:56:42.484164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:56:42.484164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:56:42.484164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:56:42.484164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:56:42.484164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:56:42.486939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:56:42.486939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:56:42.486939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:56:42.486939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:56:42.486939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:56:42.486939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:56:42.486939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:56:42.486939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:56:42.486939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:56:42.486939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:56:42.486939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:56:42.486939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:56:42.486939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:56:42.486939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:56:42.486939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:56:42.486939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:56:42.486939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:56:42.486939 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:56:42.488350 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:56:42.488350 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:56:42.488350 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:56:42.488350 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:56:42.488350 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:56:42.488350 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:56:42.488350 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:56:42.488350 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:56:42.488350 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 00:56:42.488350 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:56:42.488350 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 630/1253] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:56:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:56:42.494400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2ef00-6e18-4803-85ae-1c1d5f36ea07 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:42.578618 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:42.647188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2ef00-6e18-4803-85ae-1c1d5f36ea07 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:42.699852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060d525-1d42-44c3-af32-c841eb8ad59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:42.700619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060d525-1d42-44c3-af32-c841eb8ad59c None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:42.701013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060d525-1d42-44c3-af32-c841eb8ad59c None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:42.701416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060d525-1d42-44c3-af32-c841eb8ad59c None admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:42.702344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060d525-1d42-44c3-af32-c841eb8ad59c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:42.702722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060d525-1d42-44c3-af32-c841eb8ad59c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:42.705954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060d525-1d42-44c3-af32-c841eb8ad59c None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:42.736139 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 624/1254] 10.222.0.39 () {56 vars in 1143 bytes} [Sun Aug 7 00:56:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:56:42.744767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ef850-e4d9-48a0-b1a2-3137ad463d07 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:42.901730 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ef850-e4d9-48a0-b1a2-3137ad463d07 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:42.947581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557409a6-b277-4b2d-ab89-bf3d1c27cbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:42.948390 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557409a6-b277-4b2d-ab89-bf3d1c27cbcf None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:42.948791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557409a6-b277-4b2d-ab89-bf3d1c27cbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:42.949035 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557409a6-b277-4b2d-ab89-bf3d1c27cbcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:43.035733 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:43.059239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557409a6-b277-4b2d-ab89-bf3d1c27cbcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:43.062074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557409a6-b277-4b2d-ab89-bf3d1c27cbcf None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:43.273034 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 631/1255] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:56:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 00:56:43.286795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060d525-1d42-44c3-af32-c841eb8ad59c None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:43.504414 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060d525-1d42-44c3-af32-c841eb8ad59c None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:43.539681 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:43.582515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585585e1-dbda-454f-9756-dd71ea8b295e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:43.583380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585585e1-dbda-454f-9756-dd71ea8b295e None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:43.583748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585585e1-dbda-454f-9756-dd71ea8b295e None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:43.584258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585585e1-dbda-454f-9756-dd71ea8b295e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:43.600567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585585e1-dbda-454f-9756-dd71ea8b295e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:43.602482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585585e1-dbda-454f-9756-dd71ea8b295e None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:43.635381 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-585585e1-dbda-454f-9756-dd71ea8b295e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:56:43.635381 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:43.635381 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:56:43.635381 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:56:43.635381 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:56:43.635381 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:56:43.635381 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:56:43.635381 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:56:43.635381 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:56:43.635381 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:56:43.635381 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:56:43.635381 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:56:43.635381 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:56:43.635381 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:56:43.635381 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:56:43.635381 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:56:43.637502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:56:43.637502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:56:43.637502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:56:43.637502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:56:43.637502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:56:43.637502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:56:43.637502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:56:43.637502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:56:43.637502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:56:43.637502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:56:43.637502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:56:43.637502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:56:43.637502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:56:43.637502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:56:43.637502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:56:43.637502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:56:43.637502 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:56:43.639116 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:56:43.639116 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:56:43.639116 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:56:43.639116 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 625/1256] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:56:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:56:43.647465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557409a6-b277-4b2d-ab89-bf3d1c27cbcf None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:43.777226 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:43.796076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557409a6-b277-4b2d-ab89-bf3d1c27cbcf None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:43.840535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9575932-0eac-4322-9712-c4d47ad8dbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:43.841322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9575932-0eac-4322-9712-c4d47ad8dbe5 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:43.841625 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9575932-0eac-4322-9712-c4d47ad8dbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:43.841978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9575932-0eac-4322-9712-c4d47ad8dbe5 None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:43.842864 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9575932-0eac-4322-9712-c4d47ad8dbe5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:43.843285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9575932-0eac-4322-9712-c4d47ad8dbe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:43.846288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9575932-0eac-4322-9712-c4d47ad8dbe5 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:43.867457 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 632/1257] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:56:43.874546 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585585e1-dbda-454f-9756-dd71ea8b295e None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:44.087353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585585e1-dbda-454f-9756-dd71ea8b295e None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:44.153330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e282c8-90a4-449e-9ea2-e2487319601d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:44.154504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e282c8-90a4-449e-9ea2-e2487319601d None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:44.155140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e282c8-90a4-449e-9ea2-e2487319601d None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:44.155679 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e282c8-90a4-449e-9ea2-e2487319601d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:44.169370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e282c8-90a4-449e-9ea2-e2487319601d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:44.172069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e282c8-90a4-449e-9ea2-e2487319601d None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:44.187669 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-d2e282c8-90a4-449e-9ea2-e2487319601d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:56:44.187669 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:44.187669 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:56:44.187669 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:56:44.187669 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:56:44.187669 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:56:44.187669 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:56:44.187669 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:56:44.187669 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:56:44.187669 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:56:44.187669 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:56:44.187669 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:56:44.187669 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:56:44.187669 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:56:44.187669 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:56:44.197574 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:56:44.197574 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:56:44.197574 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:56:44.197574 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:56:44.197574 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:56:44.197574 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:56:44.197574 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:56:44.197574 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:56:44.197574 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:56:44.197574 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:56:44.197574 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:56:44.197574 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:56:44.197574 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:56:44.197574 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:56:44.197574 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:56:44.197574 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:56:44.197574 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:56:44.199409 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:56:44.199409 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:56:44.199409 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:56:44.199409 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:56:44.199409 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:56:44.199409 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:56:44.199409 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:56:44.199409 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:56:44.199409 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 626/1258] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:56:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:56:44.200445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9575932-0eac-4322-9712-c4d47ad8dbe5 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:44.391236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9575932-0eac-4322-9712-c4d47ad8dbe5 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:44.466085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f39a72-be87-4ee2-92d4-b9434d71b0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:44.467212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f39a72-be87-4ee2-92d4-b9434d71b0ae None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:44.467665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f39a72-be87-4ee2-92d4-b9434d71b0ae None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:44.468169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f39a72-be87-4ee2-92d4-b9434d71b0ae None admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:44.472383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f39a72-be87-4ee2-92d4-b9434d71b0ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:44.472383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f39a72-be87-4ee2-92d4-b9434d71b0ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:44.472812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f39a72-be87-4ee2-92d4-b9434d71b0ae None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:44.500332 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 633/1259] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:56:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:56:44.510814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e282c8-90a4-449e-9ea2-e2487319601d None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:44.551549 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:44.709695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e282c8-90a4-449e-9ea2-e2487319601d None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:44.776069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3d2b8-a5fe-4ca7-a571-dac7fc671eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:44.777581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3d2b8-a5fe-4ca7-a571-dac7fc671eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:44.778385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3d2b8-a5fe-4ca7-a571-dac7fc671eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:44.779007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3d2b8-a5fe-4ca7-a571-dac7fc671eb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:44.781274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3d2b8-a5fe-4ca7-a571-dac7fc671eb9 None admin] RBAC: Adding query filter params (role.id=695b07606e564668bac7afff4ab6052a, scope.project.id=1cd2efda8567437e983e3a7867ecd69b, user.id=e3a1871b12e54ecdb9d656799385d05b) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:44.781887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3d2b8-a5fe-4ca7-a571-dac7fc671eb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:44.793328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3d2b8-a5fe-4ca7-a571-dac7fc671eb9 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:44.806681 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 627/1260] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:56:44 2022] GET /identity/v3/role_assignments?user.id=e3a1871b12e54ecdb9d656799385d05b&scope.project.id=1cd2efda8567437e983e3a7867ecd69b&role.id=695b07606e564668bac7afff4ab6052a => generated 259 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:56:47.517406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753dd0b-5852-4bf0-81c6-688a1952e987 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:47.519254 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753dd0b-5852-4bf0-81c6-688a1952e987 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:47.519254 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753dd0b-5852-4bf0-81c6-688a1952e987 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:47.520553 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 634/1261] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:56:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:56:47.529519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbb0cc-3b07-4958-b367-0aaa40fcd637 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:47.530231 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbb0cc-3b07-4958-b367-0aaa40fcd637 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:47.530499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bbb0cc-3b07-4958-b367-0aaa40fcd637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:47.564941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-75bbb0cc-3b07-4958-b367-0aaa40fcd637 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:56:47.567301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-75bbb0cc-3b07-4958-b367-0aaa40fcd637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:47.704941 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 628/1262] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:56:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:56:47.743875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753dd0b-5852-4bf0-81c6-688a1952e987 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:47.763190 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:47.933827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753dd0b-5852-4bf0-81c6-688a1952e987 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:47.993220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34f485-8cf8-4ae9-8f61-6be256e65e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:47.994263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34f485-8cf8-4ae9-8f61-6be256e65e19 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:47.994542 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34f485-8cf8-4ae9-8f61-6be256e65e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:47.994811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34f485-8cf8-4ae9-8f61-6be256e65e19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:48.007461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34f485-8cf8-4ae9-8f61-6be256e65e19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:56:48.012271 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-fd34f485-8cf8-4ae9-8f61-6be256e65e19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:56:48.012271 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:48.012271 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:56:48.012271 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:56:48.012271 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:56:48.012271 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:56:48.012271 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:56:48.012271 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:56:48.012271 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:56:48.012271 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:56:48.012271 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:56:48.012271 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:56:48.012271 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:56:48.012271 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:56:48.012271 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:56:48.012271 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:56:48.014296 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:56:48.014296 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:56:48.014296 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:56:48.014296 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:56:48.014296 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:56:48.014296 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:56:48.014296 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:56:48.014296 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:56:48.014296 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:56:48.014296 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:56:48.014296 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:56:48.014296 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:56:48.014296 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:56:48.014296 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:56:48.014296 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:56:48.014296 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:56:48.017046 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:56:48.017046 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:56:48.017046 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:56:48.017046 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:56:48.017046 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:56:48.017046 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:56:48.017046 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:56:48.017046 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:56:48.017046 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:56:48.017046 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:56:48.017046 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:56:48.017046 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:56:48.017046 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 635/1263] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:56:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:56:48.022792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bbb0cc-3b07-4958-b367-0aaa40fcd637 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:48.059497 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:48.198060 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bbb0cc-3b07-4958-b367-0aaa40fcd637 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:48.239786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e26d0-07a6-4bc6-80e1-cecd6731c7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:48.240494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e26d0-07a6-4bc6-80e1-cecd6731c7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:48.240816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e26d0-07a6-4bc6-80e1-cecd6731c7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:48.241129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e26d0-07a6-4bc6-80e1-cecd6731c7b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:48.241856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e26d0-07a6-4bc6-80e1-cecd6731c7b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:48.242197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e26d0-07a6-4bc6-80e1-cecd6731c7b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:48.243638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e26d0-07a6-4bc6-80e1-cecd6731c7b5 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:48.256532 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 629/1264] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:56:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:56:48.263303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34f485-8cf8-4ae9-8f61-6be256e65e19 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:48.385646 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:48.445929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34f485-8cf8-4ae9-8f61-6be256e65e19 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:48.507954 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b2e0b-001d-432e-b094-95e029c557e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:48.508875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b2e0b-001d-432e-b094-95e029c557e8 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:48.509352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b2e0b-001d-432e-b094-95e029c557e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:48.509823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b2e0b-001d-432e-b094-95e029c557e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:48.528658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b2e0b-001d-432e-b094-95e029c557e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:48.530810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b2e0b-001d-432e-b094-95e029c557e8 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:48.559128 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-3a2b2e0b-001d-432e-b094-95e029c557e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:56:48.559128 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:48.559128 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:56:48.559128 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:56:48.559128 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:56:48.559128 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:56:48.559128 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:56:48.559128 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:56:48.559128 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:56:48.559128 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:56:48.559128 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:56:48.559128 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:56:48.559128 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:56:48.559128 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:56:48.559128 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:56:48.559128 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:56:48.561744 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:56:48.561744 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:56:48.561744 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:56:48.561744 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:56:48.561744 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:56:48.561744 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:56:48.561744 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:56:48.561744 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:56:48.561744 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:56:48.561744 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:56:48.561744 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:56:48.561744 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:56:48.561744 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:56:48.561744 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:56:48.561744 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:56:48.561744 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:56:48.561744 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:56:48.563605 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:56:48.563605 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:56:48.563605 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:56:48.563605 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 636/1265] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:56:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:56:48.571495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e26d0-07a6-4bc6-80e1-cecd6731c7b5 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:48.703290 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:48.728314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e26d0-07a6-4bc6-80e1-cecd6731c7b5 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:48.769736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c176b5d-28a8-4f4d-b9af-f8756d013473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:48.770253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c176b5d-28a8-4f4d-b9af-f8756d013473 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:48.770526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c176b5d-28a8-4f4d-b9af-f8756d013473 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:48.770791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c176b5d-28a8-4f4d-b9af-f8756d013473 None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:48.771458 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c176b5d-28a8-4f4d-b9af-f8756d013473 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:48.771754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c176b5d-28a8-4f4d-b9af-f8756d013473 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:48.773218 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c176b5d-28a8-4f4d-b9af-f8756d013473 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:48.786948 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 630/1266] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:56:48.793102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b2e0b-001d-432e-b094-95e029c557e8 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:48.913134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b2e0b-001d-432e-b094-95e029c557e8 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:48.933690 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:48.949219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db61379-9c8a-447d-befd-2eb197c3ed47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:48.949909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db61379-9c8a-447d-befd-2eb197c3ed47 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:48.950220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db61379-9c8a-447d-befd-2eb197c3ed47 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:48.950524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db61379-9c8a-447d-befd-2eb197c3ed47 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:48.959274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db61379-9c8a-447d-befd-2eb197c3ed47 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:48.960806 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db61379-9c8a-447d-befd-2eb197c3ed47 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:48.975714 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-4db61379-9c8a-447d-befd-2eb197c3ed47 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 00:56:48.975714 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:48.975714 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:56:48.975714 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:56:48.975714 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:56:48.975714 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:56:48.975714 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:56:48.975714 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:56:48.975714 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:56:48.975714 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:56:48.975714 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:56:48.975714 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:56:48.975714 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:56:48.975714 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:56:48.975714 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:56:48.975714 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:56:48.977299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:56:48.977299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:56:48.977299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:56:48.977299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:56:48.977299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:56:48.977299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:56:48.977299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:56:48.977299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:56:48.977299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:56:48.977299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:56:48.977299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:56:48.977299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:56:48.977299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:56:48.977299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:56:48.977299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:56:48.977299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:56:48.977299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:56:48.977299 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:56:48.978869 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:56:48.978869 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:56:48.978869 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:56:48.978869 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:56:48.978869 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:56:48.978869 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:56:48.978869 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:56:48.978869 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:56:48.978869 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 00:56:48.978869 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:56:48.978869 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 637/1267] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:56:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:56:48.983715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c176b5d-28a8-4f4d-b9af-f8756d013473 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:49.091631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c176b5d-28a8-4f4d-b9af-f8756d013473 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:49.129559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520de6c8-5b2d-44bd-aedc-86c9f688c913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:49.130218 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520de6c8-5b2d-44bd-aedc-86c9f688c913 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:49.130532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520de6c8-5b2d-44bd-aedc-86c9f688c913 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:49.130838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520de6c8-5b2d-44bd-aedc-86c9f688c913 None admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:49.131650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520de6c8-5b2d-44bd-aedc-86c9f688c913 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:49.132051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520de6c8-5b2d-44bd-aedc-86c9f688c913 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:49.133610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520de6c8-5b2d-44bd-aedc-86c9f688c913 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:49.143499 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:49.153000 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 631/1268] 10.222.0.39 () {56 vars in 1143 bytes} [Sun Aug 7 00:56:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:56:49.162898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db61379-9c8a-447d-befd-2eb197c3ed47 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:49.271570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db61379-9c8a-447d-befd-2eb197c3ed47 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:49.305434 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42901a83-d504-41f1-86dd-16881f9c6efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:49.306065 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42901a83-d504-41f1-86dd-16881f9c6efc None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:49.306334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42901a83-d504-41f1-86dd-16881f9c6efc None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:49.306598 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42901a83-d504-41f1-86dd-16881f9c6efc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:49.320099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42901a83-d504-41f1-86dd-16881f9c6efc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:49.322600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42901a83-d504-41f1-86dd-16881f9c6efc None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:49.338958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-42901a83-d504-41f1-86dd-16881f9c6efc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:56:49.338958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:49.338958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:56:49.338958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:56:49.338958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:56:49.338958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:56:49.338958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:56:49.338958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:56:49.338958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:56:49.338958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:56:49.338958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:56:49.338958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:56:49.338958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:56:49.338958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:56:49.338958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:56:49.338958 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:56:49.340989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:56:49.340989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:56:49.340989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:56:49.340989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:56:49.340989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:56:49.340989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:56:49.340989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:56:49.340989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:56:49.340989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:56:49.340989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:56:49.340989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:56:49.340989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:56:49.340989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:56:49.340989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:56:49.340989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:56:49.340989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:56:49.340989 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:56:49.343009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:56:49.343009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:56:49.343009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:56:49.343009 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 638/1269] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:56:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:56:49.346801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520de6c8-5b2d-44bd-aedc-86c9f688c913 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:49.501661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520de6c8-5b2d-44bd-aedc-86c9f688c913 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:49.537820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645682aa-5769-4bfb-a409-228c3d49a0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:49.538417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645682aa-5769-4bfb-a409-228c3d49a0a2 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:49.538692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645682aa-5769-4bfb-a409-228c3d49a0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:49.538958 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645682aa-5769-4bfb-a409-228c3d49a0a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:49.539602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645682aa-5769-4bfb-a409-228c3d49a0a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:49.539928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645682aa-5769-4bfb-a409-228c3d49a0a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:49.541299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645682aa-5769-4bfb-a409-228c3d49a0a2 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:49.556769 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 632/1270] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:56:49.564757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42901a83-d504-41f1-86dd-16881f9c6efc None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:49.606829 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:49.681996 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42901a83-d504-41f1-86dd-16881f9c6efc None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:49.727066 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa852f6-aab1-4b3b-aa2d-8e711140e929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:49.728087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa852f6-aab1-4b3b-aa2d-8e711140e929 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:49.728578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa852f6-aab1-4b3b-aa2d-8e711140e929 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:49.729056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa852f6-aab1-4b3b-aa2d-8e711140e929 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:49.742248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa852f6-aab1-4b3b-aa2d-8e711140e929 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:49.745041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa852f6-aab1-4b3b-aa2d-8e711140e929 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:49.767226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-afa852f6-aab1-4b3b-aa2d-8e711140e929 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:56:49.767226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:49.767226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:56:49.767226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:56:49.767226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:56:49.767226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:56:49.767226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:56:49.767226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:56:49.767226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:56:49.767226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:56:49.767226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:56:49.767226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:56:49.767226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:56:49.767226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:56:49.767226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:56:49.768991 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:56:49.768991 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:56:49.768991 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:56:49.768991 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:56:49.768991 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:56:49.768991 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:56:49.768991 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:56:49.768991 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:56:49.768991 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:56:49.768991 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:56:49.768991 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:56:49.768991 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:56:49.768991 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:56:49.768991 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:56:49.768991 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:56:49.768991 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:56:49.768991 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:56:49.770937 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:56:49.770937 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:56:49.770937 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:56:49.770937 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:56:49.770937 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:56:49.770937 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:56:49.770937 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:56:49.770937 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:56:49.770937 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 639/1271] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:56:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:56:49.777037 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645682aa-5769-4bfb-a409-228c3d49a0a2 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:49.864778 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:49.915005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645682aa-5769-4bfb-a409-228c3d49a0a2 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:49.954972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a5ddf-51aa-47b9-bef0-d1b2ae449697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:49.955613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a5ddf-51aa-47b9-bef0-d1b2ae449697 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:49.955926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a5ddf-51aa-47b9-bef0-d1b2ae449697 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:49.956181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a5ddf-51aa-47b9-bef0-d1b2ae449697 None admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:49.956894 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a5ddf-51aa-47b9-bef0-d1b2ae449697 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:49.957191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a5ddf-51aa-47b9-bef0-d1b2ae449697 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:49.958626 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a5ddf-51aa-47b9-bef0-d1b2ae449697 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:49.981090 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 633/1272] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:56:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:56:49.989631 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa852f6-aab1-4b3b-aa2d-8e711140e929 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:50.125155 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:50.137241 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa852f6-aab1-4b3b-aa2d-8e711140e929 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:50.178925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9323f1-453e-49f3-9566-ea0ae08d4b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:50.179664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9323f1-453e-49f3-9566-ea0ae08d4b0a None admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:50.180037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9323f1-453e-49f3-9566-ea0ae08d4b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:50.180359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9323f1-453e-49f3-9566-ea0ae08d4b0a None admin] PATH_INFO: `/v3/projects/1cd2efda8567437e983e3a7867ecd69b/users/e3a1871b12e54ecdb9d656799385d05b/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:50.182869 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9323f1-453e-49f3-9566-ea0ae08d4b0a None admin] RBAC: Authorizing `identity:create_grant(project_id=1cd2efda8567437e983e3a7867ecd69b, user_id=e3a1871b12e54ecdb9d656799385d05b, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:50.184572 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9323f1-453e-49f3-9566-ea0ae08d4b0a None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:50.201097 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 640/1273] 10.222.0.39 () {58 vars in 1439 bytes} [Sun Aug 7 00:56:49 2022] PUT /identity/v3/projects/1cd2efda8567437e983e3a7867ecd69b/users/e3a1871b12e54ecdb9d656799385d05b/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 00:56:52.469206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56962373-cecb-40ee-b78b-436c428eaf57 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:52.469871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56962373-cecb-40ee-b78b-436c428eaf57 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:52.470198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56962373-cecb-40ee-b78b-436c428eaf57 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:52.472363 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 634/1274] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:56:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:56:52.481500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029ac52-d4b8-4fbf-8d7c-b15733be159d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:52.482117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029ac52-d4b8-4fbf-8d7c-b15733be159d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:52.482450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029ac52-d4b8-4fbf-8d7c-b15733be159d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:52.513217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-8029ac52-d4b8-4fbf-8d7c-b15733be159d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:56:52.515295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8029ac52-d4b8-4fbf-8d7c-b15733be159d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:52.647225 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 641/1275] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:56:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:56:52.682664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56962373-cecb-40ee-b78b-436c428eaf57 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:52.814201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56962373-cecb-40ee-b78b-436c428eaf57 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:52.833938 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:52.853473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ac765-05d9-4b0c-b8e8-9857fb2672da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:52.854133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ac765-05d9-4b0c-b8e8-9857fb2672da None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:52.854411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ac765-05d9-4b0c-b8e8-9857fb2672da None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:52.854680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ac765-05d9-4b0c-b8e8-9857fb2672da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:52.866771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ac765-05d9-4b0c-b8e8-9857fb2672da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 00:56:52.871656 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-8b2ac765-05d9-4b0c-b8e8-9857fb2672da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:56:52.871656 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:52.871656 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:56:52.871656 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:56:52.871656 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:56:52.871656 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:56:52.871656 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:56:52.871656 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:56:52.871656 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:56:52.871656 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:56:52.871656 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:56:52.871656 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:56:52.871656 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 07 00:56:52.871656 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 07 00:56:52.871656 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 07 00:56:52.871656 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 07 00:56:52.873599 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 00:56:52.873599 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 00:56:52.873599 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 00:56:52.873599 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 00:56:52.873599 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:56:52.873599 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:56:52.873599 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:56:52.873599 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:56:52.873599 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:56:52.873599 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:56:52.873599 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:56:52.873599 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:56:52.873599 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:56:52.873599 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:56:52.873599 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:56:52.873599 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:56:52.876703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:56:52.876703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:56:52.876703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:56:52.876703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:56:52.876703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 00:56:52.876703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 00:56:52.876703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 00:56:52.876703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 00:56:52.876703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 00:56:52.876703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 00:56:52.876703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 07 00:56:52.876703 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:56:52.876703 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 635/1276] 10.222.0.39 () {56 vars in 1096 bytes} [Sun Aug 7 00:56:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:56:52.882059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029ac52-d4b8-4fbf-8d7c-b15733be159d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:53.015627 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:53.038101 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029ac52-d4b8-4fbf-8d7c-b15733be159d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:53.080801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a65da-e51d-48a0-a747-c7d6caa96e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:53.081402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a65da-e51d-48a0-a747-c7d6caa96e52 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:53.081733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a65da-e51d-48a0-a747-c7d6caa96e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:53.082008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a65da-e51d-48a0-a747-c7d6caa96e52 None admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:53.082721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a65da-e51d-48a0-a747-c7d6caa96e52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:53.083020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a65da-e51d-48a0-a747-c7d6caa96e52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:53.084458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a65da-e51d-48a0-a747-c7d6caa96e52 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:53.093972 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 642/1277] 10.222.0.39 () {56 vars in 1099 bytes} [Sun Aug 7 00:56:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:56:53.100224 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ac765-05d9-4b0c-b8e8-9857fb2672da None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:53.223128 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ac765-05d9-4b0c-b8e8-9857fb2672da None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:53.282508 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce133583-c953-4e3a-8cfc-c3c4421c12c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:53.283575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce133583-c953-4e3a-8cfc-c3c4421c12c4 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:53.284102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce133583-c953-4e3a-8cfc-c3c4421c12c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:53.284580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce133583-c953-4e3a-8cfc-c3c4421c12c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:53.302675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce133583-c953-4e3a-8cfc-c3c4421c12c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:53.305471 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce133583-c953-4e3a-8cfc-c3c4421c12c4 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:53.331711 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-ce133583-c953-4e3a-8cfc-c3c4421c12c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:56:53.331711 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:53.331711 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:56:53.331711 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:56:53.331711 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:56:53.331711 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:56:53.331711 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:56:53.331711 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:56:53.331711 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:56:53.331711 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:56:53.331711 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:56:53.331711 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:56:53.331711 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:56:53.331711 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:56:53.331711 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:56:53.331711 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:56:53.333347 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:56:53.333347 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:56:53.333347 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:56:53.333347 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:56:53.333347 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:56:53.333347 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:56:53.333347 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:56:53.333347 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:56:53.333347 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:56:53.333347 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:56:53.333347 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:56:53.333347 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:56:53.333347 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:56:53.333347 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:56:53.333347 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:56:53.333347 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:56:53.333347 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:56:53.335164 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:56:53.335164 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:56:53.335164 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:56:53.335164 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 636/1278] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:56:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:56:53.340368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a65da-e51d-48a0-a747-c7d6caa96e52 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:53.473141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a65da-e51d-48a0-a747-c7d6caa96e52 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:53.520635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efda71-1eb4-40eb-bd56-27afa49bc31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:53.521563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efda71-1eb4-40eb-bd56-27afa49bc31f None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:53.521563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efda71-1eb4-40eb-bd56-27afa49bc31f None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:53.521867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efda71-1eb4-40eb-bd56-27afa49bc31f None admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:53.522484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01efda71-1eb4-40eb-bd56-27afa49bc31f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:53.522787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01efda71-1eb4-40eb-bd56-27afa49bc31f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:53.524323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01efda71-1eb4-40eb-bd56-27afa49bc31f None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:53.539473 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 643/1279] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:56:53.545942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce133583-c953-4e3a-8cfc-c3c4421c12c4 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:53.592148 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:53.715419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce133583-c953-4e3a-8cfc-c3c4421c12c4 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:53.763520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f13961-9d43-4aff-b0db-bb1845ab1403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:53.764192 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f13961-9d43-4aff-b0db-bb1845ab1403 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:53.764470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f13961-9d43-4aff-b0db-bb1845ab1403 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:53.764742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f13961-9d43-4aff-b0db-bb1845ab1403 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:53.773826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f13961-9d43-4aff-b0db-bb1845ab1403 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:53.775339 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f13961-9d43-4aff-b0db-bb1845ab1403 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:53.788141 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-a3f13961-9d43-4aff-b0db-bb1845ab1403 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 07 00:56:53.788141 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:53.788141 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:56:53.788141 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:56:53.788141 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:56:53.788141 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:56:53.788141 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:56:53.788141 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:56:53.788141 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:56:53.788141 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:56:53.788141 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:56:53.788141 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:56:53.788141 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 00:56:53.788141 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 00:56:53.788141 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 00:56:53.788141 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 00:56:53.789815 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:56:53.789815 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:56:53.789815 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 00:56:53.789815 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:56:53.789815 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 00:56:53.789815 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 00:56:53.789815 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:56:53.789815 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:56:53.789815 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:56:53.789815 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:56:53.789815 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:56:53.789815 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:56:53.789815 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:56:53.789815 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:56:53.789815 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:56:53.789815 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:56:53.789815 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:56:53.789815 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:56:53.791992 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:56:53.791992 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:56:53.791992 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 00:56:53.791992 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 00:56:53.791992 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 00:56:53.791992 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 00:56:53.791992 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 00:56:53.791992 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 00:56:53.791992 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 07 00:56:53.791992 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:56:53.791992 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 637/1280] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:56:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:56:53.796033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efda71-1eb4-40eb-bd56-27afa49bc31f None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:53.802735 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:53.933709 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efda71-1eb4-40eb-bd56-27afa49bc31f None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:53.975231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c7cd5-6eeb-412c-820e-3865c251a180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:53.976069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c7cd5-6eeb-412c-820e-3865c251a180 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:53.976473 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c7cd5-6eeb-412c-820e-3865c251a180 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:53.976836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c7cd5-6eeb-412c-820e-3865c251a180 None admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:53.977883 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c7cd5-6eeb-412c-820e-3865c251a180 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:53.978354 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c7cd5-6eeb-412c-820e-3865c251a180 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:53.980632 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c7cd5-6eeb-412c-820e-3865c251a180 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:54.003282 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 644/1281] 10.222.0.39 () {56 vars in 1143 bytes} [Sun Aug 7 00:56:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:56:54.012453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f13961-9d43-4aff-b0db-bb1845ab1403 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:54.114325 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:54.126681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f13961-9d43-4aff-b0db-bb1845ab1403 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:54.164715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045521a4-590c-4e6b-bdb1-657446116b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:54.165461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045521a4-590c-4e6b-bdb1-657446116b9b None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:54.165828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045521a4-590c-4e6b-bdb1-657446116b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:54.166185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045521a4-590c-4e6b-bdb1-657446116b9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:54.251368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045521a4-590c-4e6b-bdb1-657446116b9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:54.253004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045521a4-590c-4e6b-bdb1-657446116b9b None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:54.359370 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:54.370978 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 638/1282] 10.222.0.39 () {58 vars in 1282 bytes} [Sun Aug 7 00:56:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 07 00:56:54.377865 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c7cd5-6eeb-412c-820e-3865c251a180 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:54.444290 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:54.485798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c7cd5-6eeb-412c-820e-3865c251a180 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:54.540464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c27d8d-b009-4784-a09b-0973306ffc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:54.541508 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c27d8d-b009-4784-a09b-0973306ffc4b None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:54.542025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c27d8d-b009-4784-a09b-0973306ffc4b None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:54.542542 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c27d8d-b009-4784-a09b-0973306ffc4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:54.564290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c27d8d-b009-4784-a09b-0973306ffc4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:54.567205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c27d8d-b009-4784-a09b-0973306ffc4b None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:54.597904 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-97c27d8d-b009-4784-a09b-0973306ffc4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:56:54.597904 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:54.597904 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:56:54.597904 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:56:54.597904 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:56:54.597904 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:56:54.597904 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:56:54.597904 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:56:54.597904 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:56:54.597904 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:56:54.597904 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:56:54.597904 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:56:54.597904 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 00:56:54.597904 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 00:56:54.597904 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 00:56:54.597904 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 00:56:54.599662 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:56:54.599662 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:56:54.599662 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:56:54.599662 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:56:54.599662 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:56:54.599662 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:56:54.599662 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:56:54.599662 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:56:54.599662 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:56:54.599662 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:56:54.599662 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:56:54.599662 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:56:54.599662 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:56:54.599662 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:56:54.599662 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:56:54.599662 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:56:54.599662 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 07 00:56:54.601212 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 00:56:54.601212 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 07 00:56:54.601212 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:56:54.601212 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 645/1283] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 00:56:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 00:56:54.607329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045521a4-590c-4e6b-bdb1-657446116b9b None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:54.730024 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045521a4-590c-4e6b-bdb1-657446116b9b None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:54.768848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53121f-506e-439b-8c76-8c939c8f400b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:54.769498 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53121f-506e-439b-8c76-8c939c8f400b None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:54.769842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53121f-506e-439b-8c76-8c939c8f400b None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:54.770222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53121f-506e-439b-8c76-8c939c8f400b None admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:54.770953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53121f-506e-439b-8c76-8c939c8f400b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:54.771296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53121f-506e-439b-8c76-8c939c8f400b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:54.772817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53121f-506e-439b-8c76-8c939c8f400b None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:54.785900 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 639/1284] 10.222.0.39 () {56 vars in 1109 bytes} [Sun Aug 7 00:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:56:54.792689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c27d8d-b009-4784-a09b-0973306ffc4b None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:54.930998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c27d8d-b009-4784-a09b-0973306ffc4b None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:54.950146 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:54.975640 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7063c13-3cfb-430d-b128-5f52daaf1178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:54.976519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7063c13-3cfb-430d-b128-5f52daaf1178 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:54.976895 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7063c13-3cfb-430d-b128-5f52daaf1178 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:54.977233 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7063c13-3cfb-430d-b128-5f52daaf1178 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:54.987035 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7063c13-3cfb-430d-b128-5f52daaf1178 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:54.988617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7063c13-3cfb-430d-b128-5f52daaf1178 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:55.002081 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-a7063c13-3cfb-430d-b128-5f52daaf1178 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:56:55.002081 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:55.002081 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:56:55.002081 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:56:55.002081 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:56:55.002081 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:56:55.002081 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:56:55.002081 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:56:55.002081 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:56:55.002081 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:56:55.002081 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:56:55.002081 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:56:55.002081 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 07 00:56:55.002081 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 07 00:56:55.002081 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 07 00:56:55.004044 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 07 00:56:55.004044 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:56:55.004044 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:56:55.004044 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:56:55.004044 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:56:55.004044 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:56:55.004044 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:56:55.004044 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:56:55.004044 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 00:56:55.004044 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:56:55.004044 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:56:55.004044 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:56:55.004044 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:56:55.004044 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:56:55.004044 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:56:55.004044 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:56:55.004044 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:56:55.006082 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 07 00:56:55.006082 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 07 00:56:55.006082 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 00:56:55.006082 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 00:56:55.006082 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 00:56:55.006082 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 00:56:55.006082 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 07 00:56:55.006082 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 00:56:55.006082 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 646/1285] 10.222.0.39 () {56 vars in 1111 bytes} [Sun Aug 7 00:56:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:56:55.010749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53121f-506e-439b-8c76-8c939c8f400b None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:55.070054 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:55.158940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53121f-506e-439b-8c76-8c939c8f400b None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:55.217709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df521c-059a-4b93-9654-9c45a974f45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:55.218755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df521c-059a-4b93-9654-9c45a974f45e None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:55.219254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df521c-059a-4b93-9654-9c45a974f45e None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:55.219735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df521c-059a-4b93-9654-9c45a974f45e None admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:55.221077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df521c-059a-4b93-9654-9c45a974f45e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:55.221629 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df521c-059a-4b93-9654-9c45a974f45e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:55.224401 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df521c-059a-4b93-9654-9c45a974f45e None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:55.247560 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 640/1286] 10.222.0.39 () {56 vars in 1148 bytes} [Sun Aug 7 00:56:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:56:55.255013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7063c13-3cfb-430d-b128-5f52daaf1178 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:55.425658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7063c13-3cfb-430d-b128-5f52daaf1178 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:55.482223 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262fe38-2be9-4a4d-a991-141cb2f0bbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:55.483192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262fe38-2be9-4a4d-a991-141cb2f0bbbe None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:55.483686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262fe38-2be9-4a4d-a991-141cb2f0bbbe None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:55.484198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262fe38-2be9-4a4d-a991-141cb2f0bbbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:55.487491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262fe38-2be9-4a4d-a991-141cb2f0bbbe None admin] RBAC: Adding query filter params (role.id=695b07606e564668bac7afff4ab6052a, scope.project.id=1cd2efda8567437e983e3a7867ecd69b, user.id=e3a1871b12e54ecdb9d656799385d05b) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:55.488092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262fe38-2be9-4a4d-a991-141cb2f0bbbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:55.490661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262fe38-2be9-4a4d-a991-141cb2f0bbbe None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:55.501309 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 647/1287] 10.222.0.39 () {56 vars in 1374 bytes} [Sun Aug 7 00:56:55 2022] GET /identity/v3/role_assignments?user.id=e3a1871b12e54ecdb9d656799385d05b&scope.project.id=1cd2efda8567437e983e3a7867ecd69b&role.id=695b07606e564668bac7afff4ab6052a => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:56:57.800838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bf88e-8f6c-424d-ac02-b4167ea41828 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:57.801429 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bf88e-8f6c-424d-ac02-b4167ea41828 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:57.801429 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bf88e-8f6c-424d-ac02-b4167ea41828 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:57.802776 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 641/1288] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:56:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:56:57.811913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485999f4-fed0-43fc-85f0-7843cfd2b1e3 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:57.812498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485999f4-fed0-43fc-85f0-7843cfd2b1e3 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:57.812917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485999f4-fed0-43fc-85f0-7843cfd2b1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:57.844402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-485999f4-fed0-43fc-85f0-7843cfd2b1e3 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:56:57.846600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-485999f4-fed0-43fc-85f0-7843cfd2b1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:56:57.900622 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:57.953685 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 648/1289] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:56:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:56:57.979216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bf88e-8f6c-424d-ac02-b4167ea41828 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:58.164539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bf88e-8f6c-424d-ac02-b4167ea41828 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:58.186767 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:56:58.218143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370103f-70b2-4b83-ae4b-0a447033f10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:58.219328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370103f-70b2-4b83-ae4b-0a447033f10d None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:58.219607 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370103f-70b2-4b83-ae4b-0a447033f10d None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:58.219916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370103f-70b2-4b83-ae4b-0a447033f10d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:58.220532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b370103f-70b2-4b83-ae4b-0a447033f10d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:58.221929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b370103f-70b2-4b83-ae4b-0a447033f10d None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:58.231770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-b370103f-70b2-4b83-ae4b-0a447033f10d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 00:56:58.231770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:58.231770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:56:58.231770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:56:58.231770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:56:58.231770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:56:58.231770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:56:58.231770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:56:58.231770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 00:56:58.231770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:56:58.231770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:56:58.231770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:56:58.231770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:56:58.231770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:56:58.231770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:56:58.231770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:56:58.231770 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:56:58.233720 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:56:58.233720 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:56:58.233720 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:56:58.233720 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:56:58.233720 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:56:58.233720 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:56:58.233720 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:56:58.233720 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:56:58.233720 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:56:58.233720 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:56:58.233720 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:56:58.233720 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:56:58.233720 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:56:58.233720 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:56:58.233720 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:56:58.233720 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:56:58.236048 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:56:58.236048 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:56:58.236048 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:56:58.236048 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:56:58.236048 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:56:58.236048 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:56:58.236048 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:56:58.236048 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:56:58.236048 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:56:58.236048 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:56:58.236048 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:56:58.236048 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:56:58.236048 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 00:56:58.236048 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:56:58.236048 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 642/1290] 10.222.0.39 () {56 vars in 1117 bytes} [Sun Aug 7 00:56:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:56:58.244149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485999f4-fed0-43fc-85f0-7843cfd2b1e3 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:58.361763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485999f4-fed0-43fc-85f0-7843cfd2b1e3 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:58.399911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b0805-ab72-4973-bb74-226e0bba8665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:58.400756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b0805-ab72-4973-bb74-226e0bba8665 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:58.401172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b0805-ab72-4973-bb74-226e0bba8665 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:58.401450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b0805-ab72-4973-bb74-226e0bba8665 None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:58.402110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b0805-ab72-4973-bb74-226e0bba8665 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:58.402412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b0805-ab72-4973-bb74-226e0bba8665 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:58.403804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b0805-ab72-4973-bb74-226e0bba8665 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:58.409946 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 649/1291] 10.222.0.39 () {56 vars in 1116 bytes} [Sun Aug 7 00:56:58 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 00:56:58.418981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370103f-70b2-4b83-ae4b-0a447033f10d None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:56:58.572714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370103f-70b2-4b83-ae4b-0a447033f10d None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:56:58.625434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3cd58-f8e7-4b12-bb78-25433e916667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:56:58.626422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3cd58-f8e7-4b12-bb78-25433e916667 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:56:58.626690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3cd58-f8e7-4b12-bb78-25433e916667 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:56:58.627037 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3cd58-f8e7-4b12-bb78-25433e916667 None admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:56:58.628013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3cd58-f8e7-4b12-bb78-25433e916667 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:56:58.628363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3cd58-f8e7-4b12-bb78-25433e916667 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:56:58.630090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3cd58-f8e7-4b12-bb78-25433e916667 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:56:58.641809 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 643/1292] 10.222.0.39 () {56 vars in 1116 bytes} [Sun Aug 7 00:56:58 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:57:00.719344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef92b2-4149-4e1a-b24a-4d15923f81d0 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:00.720105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef92b2-4149-4e1a-b24a-4d15923f81d0 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:00.720557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef92b2-4149-4e1a-b24a-4d15923f81d0 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:00.723117 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 650/1293] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:57:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:57:00.733551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0bc54-7577-4bed-8584-c912f5c6bb3e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:00.734975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0bc54-7577-4bed-8584-c912f5c6bb3e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:00.734975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0bc54-7577-4bed-8584-c912f5c6bb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:00.755514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-74c0bc54-7577-4bed-8584-c912f5c6bb3e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:57:00.756839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-74c0bc54-7577-4bed-8584-c912f5c6bb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:00.795307 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:00.844847 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 644/1294] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:57:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:57:00.868654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef92b2-4149-4e1a-b24a-4d15923f81d0 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:00.909885 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:01.001541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef92b2-4149-4e1a-b24a-4d15923f81d0 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:01.043076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d3797-c238-462d-b694-4bb547fe2b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:01.043695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d3797-c238-462d-b694-4bb547fe2b37 None admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:01.043999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d3797-c238-462d-b694-4bb547fe2b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:01.044264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d3797-c238-462d-b694-4bb547fe2b37 None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:01.044929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d3797-c238-462d-b694-4bb547fe2b37 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:01.046321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d3797-c238-462d-b694-4bb547fe2b37 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:01.063396 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 651/1295] 10.222.0.39 () {60 vars in 1141 bytes} [Sun Aug 7 00:57:00 2022] POST /identity/v3/services => generated 246 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 00:57:03.372415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236a0b7-fb83-40ae-816a-bb0093dd075e None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:03.373084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236a0b7-fb83-40ae-816a-bb0093dd075e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:03.373213 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236a0b7-fb83-40ae-816a-bb0093dd075e None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:03.375270 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 645/1296] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:57:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:57:03.382483 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b67d4-b47f-4184-aad6-7da9a8c995af None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:03.383608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b67d4-b47f-4184-aad6-7da9a8c995af None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:03.384138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b67d4-b47f-4184-aad6-7da9a8c995af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:03.414198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d61b67d4-b47f-4184-aad6-7da9a8c995af None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:57:03.416000 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d61b67d4-b47f-4184-aad6-7da9a8c995af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:03.534097 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 652/1297] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:57:03 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 00:57:03.560672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236a0b7-fb83-40ae-816a-bb0093dd075e None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:03.681382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236a0b7-fb83-40ae-816a-bb0093dd075e None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:03.726966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4795ab-058f-4ebb-bfed-8eece04a1d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:03.728071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4795ab-058f-4ebb-bfed-8eece04a1d04 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:03.728424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4795ab-058f-4ebb-bfed-8eece04a1d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:03.728730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4795ab-058f-4ebb-bfed-8eece04a1d04 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:03.729298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4795ab-058f-4ebb-bfed-8eece04a1d04 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:03.730704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4795ab-058f-4ebb-bfed-8eece04a1d04 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:03.741105 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-1d4795ab-058f-4ebb-bfed-8eece04a1d04 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 00:57:03.741105 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:57:03.741105 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:57:03.741105 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:57:03.741105 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:57:03.741105 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:57:03.741105 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:57:03.741105 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:57:03.741105 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 00:57:03.741105 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:57:03.741105 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:57:03.741105 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:57:03.741105 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:57:03.741105 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:57:03.741105 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:57:03.741105 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:57:03.741105 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:57:03.742468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:57:03.742468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:57:03.742468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:57:03.742468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:57:03.742468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:57:03.742468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:57:03.742468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:57:03.742468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:57:03.742468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:57:03.742468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:57:03.742468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:57:03.742468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:57:03.742468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:57:03.742468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:57:03.742468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:57:03.742468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:57:03.743750 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:57:03.743750 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:57:03.743750 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:57:03.743750 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:57:03.743750 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:57:03.743750 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:57:03.743750 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:57:03.743750 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:57:03.743750 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:57:03.743750 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:57:03.743750 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:57:03.743750 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:57:03.743750 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 00:57:03.743750 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:57:03.743750 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 646/1298] 10.222.0.39 () {56 vars in 1117 bytes} [Sun Aug 7 00:57:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:57:03.751962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b67d4-b47f-4184-aad6-7da9a8c995af None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:03.773380 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:03.879208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b67d4-b47f-4184-aad6-7da9a8c995af None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:03.922052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931e509-5caa-4ac5-a345-2b1cc4097d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:03.922674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931e509-5caa-4ac5-a345-2b1cc4097d68 None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:03.922951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931e509-5caa-4ac5-a345-2b1cc4097d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:03.923220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931e509-5caa-4ac5-a345-2b1cc4097d68 None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:03.923877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931e509-5caa-4ac5-a345-2b1cc4097d68 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:57:03.924216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931e509-5caa-4ac5-a345-2b1cc4097d68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:03.925620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931e509-5caa-4ac5-a345-2b1cc4097d68 None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:03.932457 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 653/1299] 10.222.0.39 () {56 vars in 1116 bytes} [Sun Aug 7 00:57:03 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:57:03.941832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4795ab-058f-4ebb-bfed-8eece04a1d04 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:03.982769 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:04.069264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4795ab-058f-4ebb-bfed-8eece04a1d04 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:04.110902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676079d5-8800-458a-989d-d3a3adf177c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:04.111531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676079d5-8800-458a-989d-d3a3adf177c2 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:04.111814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676079d5-8800-458a-989d-d3a3adf177c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:04.112115 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676079d5-8800-458a-989d-d3a3adf177c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:04.112870 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676079d5-8800-458a-989d-d3a3adf177c2 None admin] RBAC: Adding query filter params (interface=public, service_id=32b3842ec20f4aaeb12337048dfe72e5, region_id=RegionOne) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:57:04.113182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676079d5-8800-458a-989d-d3a3adf177c2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:04.114623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676079d5-8800-458a-989d-d3a3adf177c2 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:04.120825 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 647/1300] 10.222.0.39 () {56 vars in 1251 bytes} [Sun Aug 7 00:57:03 2022] GET /identity/v3/endpoints?service_id=32b3842ec20f4aaeb12337048dfe72e5&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:57:04.129714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931e509-5caa-4ac5-a345-2b1cc4097d68 None admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:04.234763 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:04.257711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931e509-5caa-4ac5-a345-2b1cc4097d68 None admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:04.299553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22cc98-4713-4a48-9a22-3fb00b32703f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:04.300217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22cc98-4713-4a48-9a22-3fb00b32703f None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:04.300495 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22cc98-4713-4a48-9a22-3fb00b32703f None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:04.300768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22cc98-4713-4a48-9a22-3fb00b32703f None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:04.301390 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22cc98-4713-4a48-9a22-3fb00b32703f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:04.302808 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22cc98-4713-4a48-9a22-3fb00b32703f None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:04.310600 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 654/1301] 10.222.0.39 () {56 vars in 1087 bytes} [Sun Aug 7 00:57:04 2022] GET /identity/v3/services => generated 2191 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 00:57:06.426824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151a81f-c4ea-4fb1-ae50-e5f2fb69aee2 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:06.427590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151a81f-c4ea-4fb1-ae50-e5f2fb69aee2 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:06.427590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151a81f-c4ea-4fb1-ae50-e5f2fb69aee2 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:06.428767 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 648/1302] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:57:06.437092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41665cd1-c00c-4614-873f-3eb62e540441 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:06.439237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41665cd1-c00c-4614-873f-3eb62e540441 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:06.439237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41665cd1-c00c-4614-873f-3eb62e540441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:06.457316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-41665cd1-c00c-4614-873f-3eb62e540441 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:57:06.458568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-41665cd1-c00c-4614-873f-3eb62e540441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:57:06.539063 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 655/1303] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:57:06 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 07 00:57:06.575760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151a81f-c4ea-4fb1-ae50-e5f2fb69aee2 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:06.716046 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:06.724133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151a81f-c4ea-4fb1-ae50-e5f2fb69aee2 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:06.760788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d252e-175b-4e1e-bb9c-3c0250885743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:06.761427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d252e-175b-4e1e-bb9c-3c0250885743 None admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:06.761704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d252e-175b-4e1e-bb9c-3c0250885743 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:06.761974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d252e-175b-4e1e-bb9c-3c0250885743 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:06.762564 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d252e-175b-4e1e-bb9c-3c0250885743 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:06.764002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d252e-175b-4e1e-bb9c-3c0250885743 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:06.774868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-8a4d252e-175b-4e1e-bb9c-3c0250885743 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 00:57:06.774868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:57:06.774868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 00:57:06.774868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 00:57:06.774868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 00:57:06.774868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 00:57:06.774868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 00:57:06.774868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:57:06.774868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 00:57:06.774868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:57:06.774868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 00:57:06.774868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:57:06.774868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 00:57:06.774868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 00:57:06.774868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 00:57:06.774868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 00:57:06.774868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 00:57:06.776465 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 00:57:06.776465 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 00:57:06.776465 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 00:57:06.776465 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 00:57:06.776465 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 00:57:06.776465 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 00:57:06.776465 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 00:57:06.776465 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 00:57:06.776465 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 00:57:06.776465 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 00:57:06.776465 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 00:57:06.776465 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 00:57:06.776465 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 00:57:06.776465 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 00:57:06.776465 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 00:57:06.776465 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 00:57:06.778235 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 00:57:06.778235 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 00:57:06.778235 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 00:57:06.778235 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 00:57:06.778235 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 00:57:06.778235 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 00:57:06.778235 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 00:57:06.778235 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 00:57:06.778235 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 00:57:06.778235 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 00:57:06.778235 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 00:57:06.778235 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 00:57:06.778235 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 07 00:57:06.778235 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 00:57:06.778235 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 649/1304] 10.222.0.39 () {56 vars in 1117 bytes} [Sun Aug 7 00:57:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 00:57:06.783299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41665cd1-c00c-4614-873f-3eb62e540441 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:06.878709 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:06.910869 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41665cd1-c00c-4614-873f-3eb62e540441 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:06.956165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae385d8-5e93-477b-876d-a623763d8bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:06.957069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae385d8-5e93-477b-876d-a623763d8bda None admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:06.957379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae385d8-5e93-477b-876d-a623763d8bda None admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:06.957655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae385d8-5e93-477b-876d-a623763d8bda None admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:06.958614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae385d8-5e93-477b-876d-a623763d8bda None admin] RBAC: Adding query filter params (name=placement) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 00:57:06.959130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae385d8-5e93-477b-876d-a623763d8bda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:06.961125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae385d8-5e93-477b-876d-a623763d8bda None admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:06.970935 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 656/1305] 10.222.0.39 () {56 vars in 1116 bytes} [Sun Aug 7 00:57:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 00:57:06.976988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d252e-175b-4e1e-bb9c-3c0250885743 None admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:57:07.137857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d252e-175b-4e1e-bb9c-3c0250885743 None admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:57:07.189619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c521c2e-cc36-442d-b43b-b1f36126d0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:57:07.190478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c521c2e-cc36-442d-b43b-b1f36126d0c0 None admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:57:07.190809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c521c2e-cc36-442d-b43b-b1f36126d0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:57:07.191080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c521c2e-cc36-442d-b43b-b1f36126d0c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:57:07.191773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c521c2e-cc36-442d-b43b-b1f36126d0c0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:57:07.193195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c521c2e-cc36-442d-b43b-b1f36126d0c0 None admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:57:07.215425 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 650/1306] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 00:57:06 2022] POST /identity/v3/endpoints => generated 331 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 00:57:16.964794 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=30 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:57:17.210858 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:15.708730 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32649bb-3d6a-43b7-9dca-611696f7486a None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:15.710090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32649bb-3d6a-43b7-9dca-611696f7486a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:15.710904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32649bb-3d6a-43b7-9dca-611696f7486a None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:15.720671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d26469-8920-4d5e-9123-f3210e0b105f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:15.721143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d26469-8920-4d5e-9123-f3210e0b105f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:15.721143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d26469-8920-4d5e-9123-f3210e0b105f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:15.721706 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 657/1307] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:58:15 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:15.852353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e2d26469-8920-4d5e-9123-f3210e0b105f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:15.854348 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e2d26469-8920-4d5e-9123-f3210e0b105f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:15.993973 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 651/1308] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 00:58:16.046188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308add56-4f1e-4b61-a4e5-b785266b0122 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:16.046474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308add56-4f1e-4b61-a4e5-b785266b0122 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:16.047040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308add56-4f1e-4b61-a4e5-b785266b0122 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:16.048644 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 658/1309] 10.222.0.39 () {54 vars in 965 bytes} [Sun Aug 7 00:58:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:16.055449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3510cd1-9372-42b9-b4cc-26255bb8dd79 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:16.055967 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3510cd1-9372-42b9-b4cc-26255bb8dd79 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:16.056776 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3510cd1-9372-42b9-b4cc-26255bb8dd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:16.149277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-f3510cd1-9372-42b9-b4cc-26255bb8dd79 None None] MFA Rules not processed for user `b219e01934fa477fbaa053cca586f01b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:16.150581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f3510cd1-9372-42b9-b4cc-26255bb8dd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:16.173120 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:16.237412 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 652/1310] 10.222.0.39 () {58 vars in 1062 bytes} [Sun Aug 7 00:58:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:58:16.247629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308add56-4f1e-4b61-a4e5-b785266b0122 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:16.249679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-308add56-4f1e-4b61-a4e5-b785266b0122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:16.380386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308add56-4f1e-4b61-a4e5-b785266b0122 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:16.463725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3f549-9457-4f16-91a8-23712609127b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:16.464370 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3f549-9457-4f16-91a8-23712609127b service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:16.464646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3f549-9457-4f16-91a8-23712609127b service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:16.464915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3f549-9457-4f16-91a8-23712609127b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:16.466555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c8a3f549-9457-4f16-91a8-23712609127b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:16.529138 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:16.593569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3f549-9457-4f16-91a8-23712609127b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:16.595018 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3f549-9457-4f16-91a8-23712609127b service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:16.615658 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 659/1311] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 00:58:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:58:18.981513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533526e6-720d-4150-8889-e721bd43f861 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:18.981513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533526e6-720d-4150-8889-e721bd43f861 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:18.981513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533526e6-720d-4150-8889-e721bd43f861 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:18.984551 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 653/1312] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:58:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:18.988137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2553b-7a72-4831-b125-e75fa3fbaf6f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:18.988137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2553b-7a72-4831-b125-e75fa3fbaf6f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:18.988137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2553b-7a72-4831-b125-e75fa3fbaf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:19.079385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-fcc2553b-7a72-4831-b125-e75fa3fbaf6f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:19.080648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fcc2553b-7a72-4831-b125-e75fa3fbaf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:19.213860 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 660/1313] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 00:58:19.291859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b21437-056f-4c61-ab38-86b6363c08ae None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:19.292176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b21437-056f-4c61-ab38-86b6363c08ae None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:19.292449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b21437-056f-4c61-ab38-86b6363c08ae None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:19.293921 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 654/1314] 10.222.0.39 () {54 vars in 965 bytes} [Sun Aug 7 00:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:19.300622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7eb8b-cd0b-4d7a-8f26-4caf51c17b26 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:19.300915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7eb8b-cd0b-4d7a-8f26-4caf51c17b26 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:19.301166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7eb8b-cd0b-4d7a-8f26-4caf51c17b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:19.315059 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:19.417013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-75e7eb8b-cd0b-4d7a-8f26-4caf51c17b26 None None] MFA Rules not processed for user `b219e01934fa477fbaa053cca586f01b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:19.418236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-75e7eb8b-cd0b-4d7a-8f26-4caf51c17b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:19.504447 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 661/1315] 10.222.0.39 () {58 vars in 1062 bytes} [Sun Aug 7 00:58:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:58:19.514714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b21437-056f-4c61-ab38-86b6363c08ae None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:19.516468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-01b21437-056f-4c61-ab38-86b6363c08ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:19.640735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b21437-056f-4c61-ab38-86b6363c08ae None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:19.725553 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:19.728677 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1af1c5-6f72-468d-bd7d-49908808a845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:19.729612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1af1c5-6f72-468d-bd7d-49908808a845 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:19.729945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1af1c5-6f72-468d-bd7d-49908808a845 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:19.730407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1af1c5-6f72-468d-bd7d-49908808a845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:19.732393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3b1af1c5-6f72-468d-bd7d-49908808a845 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:19.861387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1af1c5-6f72-468d-bd7d-49908808a845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:19.862843 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1af1c5-6f72-468d-bd7d-49908808a845 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:19.881960 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 655/1316] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 00:58:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:58:22.455128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019dd7fc-df7c-4832-b02a-d45cd16833aa None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:22.455708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019dd7fc-df7c-4832-b02a-d45cd16833aa None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:22.455708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019dd7fc-df7c-4832-b02a-d45cd16833aa None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:22.457137 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 662/1317] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:22.463130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b237a4-e981-44fa-818f-091d931e9b7d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:22.463680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b237a4-e981-44fa-818f-091d931e9b7d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:22.463680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b237a4-e981-44fa-818f-091d931e9b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:22.536978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-81b237a4-e981-44fa-818f-091d931e9b7d None None] MFA Rules not processed for user `54ec182a52e14c09bda7b43dbb5c8427`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:22.538122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-81b237a4-e981-44fa-818f-091d931e9b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:22.593652 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:22.641076 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 656/1318] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:22 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:58:22.681633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019dd7fc-df7c-4832-b02a-d45cd16833aa None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:22.683155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-019dd7fc-df7c-4832-b02a-d45cd16833aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:22.786533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019dd7fc-df7c-4832-b02a-d45cd16833aa None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:22.789372 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:22.864369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd017c9-2124-4930-8e73-2ceb73e2d985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:22.864975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd017c9-2124-4930-8e73-2ceb73e2d985 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:22.865245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd017c9-2124-4930-8e73-2ceb73e2d985 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:22.865511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd017c9-2124-4930-8e73-2ceb73e2d985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:22.867096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ffd017c9-2124-4930-8e73-2ceb73e2d985 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:22.976275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd017c9-2124-4930-8e73-2ceb73e2d985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:22.978314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd017c9-2124-4930-8e73-2ceb73e2d985 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:22.997082 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 663/1319] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 00:58:22 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:58:25.647117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e4494-665f-4c11-8c5f-134efa852e11 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:25.647669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e4494-665f-4c11-8c5f-134efa852e11 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:25.647669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e4494-665f-4c11-8c5f-134efa852e11 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:25.649055 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 657/1320] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:25.656261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664ff8f-7544-497d-9dc7-d91c09a68220 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:25.656831 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664ff8f-7544-497d-9dc7-d91c09a68220 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:25.656831 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664ff8f-7544-497d-9dc7-d91c09a68220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:25.700691 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:25.729642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f664ff8f-7544-497d-9dc7-d91c09a68220 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:25.730886 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f664ff8f-7544-497d-9dc7-d91c09a68220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:25.836864 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 664/1321] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:58:25.875502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e4494-665f-4c11-8c5f-134efa852e11 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:25.877072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-928e4494-665f-4c11-8c5f-134efa852e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:25.981010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e4494-665f-4c11-8c5f-134efa852e11 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:26.053701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811c26f-d2a9-4258-82ca-4ba1769a0676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:26.054292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811c26f-d2a9-4258-82ca-4ba1769a0676 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:26.054565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811c26f-d2a9-4258-82ca-4ba1769a0676 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:26.054829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811c26f-d2a9-4258-82ca-4ba1769a0676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:26.056985 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2811c26f-d2a9-4258-82ca-4ba1769a0676 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:26.064394 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:26.174372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2811c26f-d2a9-4258-82ca-4ba1769a0676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:26.175794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2811c26f-d2a9-4258-82ca-4ba1769a0676 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:26.194663 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 658/1322] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 00:58:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:58:29.147997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67b902-042b-4231-9c56-4a84efefe305 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:29.148552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67b902-042b-4231-9c56-4a84efefe305 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:29.148552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67b902-042b-4231-9c56-4a84efefe305 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:29.149918 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 665/1323] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:29.155256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a8e91-6843-4316-8511-0522b9afe068 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:29.155721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a8e91-6843-4316-8511-0522b9afe068 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:29.155817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a8e91-6843-4316-8511-0522b9afe068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:29.223631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ec5a8e91-6843-4316-8511-0522b9afe068 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:29.224876 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ec5a8e91-6843-4316-8511-0522b9afe068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:29.294423 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:29.339916 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 659/1324] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:58:29.377756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67b902-042b-4231-9c56-4a84efefe305 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:29.379358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fd67b902-042b-4231-9c56-4a84efefe305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:29.497102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67b902-042b-4231-9c56-4a84efefe305 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:29.510524 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:29.578145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bde919-46d0-4510-a446-e5035263198e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:29.578755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bde919-46d0-4510-a446-e5035263198e service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:29.579034 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bde919-46d0-4510-a446-e5035263198e service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:29.579306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bde919-46d0-4510-a446-e5035263198e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:29.580934 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-32bde919-46d0-4510-a446-e5035263198e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:29.692772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bde919-46d0-4510-a446-e5035263198e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:29.694105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bde919-46d0-4510-a446-e5035263198e service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:29.712938 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 666/1325] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 00:58:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:58:31.792525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58654f64-9944-4c14-a34c-a4ce51dd74b1 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:31.793081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58654f64-9944-4c14-a34c-a4ce51dd74b1 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:31.793081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58654f64-9944-4c14-a34c-a4ce51dd74b1 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:31.794320 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 660/1326] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:31.799612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923d47f-3a4c-4e1a-80a4-903308bfcf71 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:31.800066 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923d47f-3a4c-4e1a-80a4-903308bfcf71 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:31.800304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923d47f-3a4c-4e1a-80a4-903308bfcf71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:31.849489 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:31.868252 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9923d47f-3a4c-4e1a-80a4-903308bfcf71 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:31.869429 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9923d47f-3a4c-4e1a-80a4-903308bfcf71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:31.972086 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 667/1327] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:58:32.009573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58654f64-9944-4c14-a34c-a4ce51dd74b1 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:32.011114 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-58654f64-9944-4c14-a34c-a4ce51dd74b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:32.128383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58654f64-9944-4c14-a34c-a4ce51dd74b1 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:32.212987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976bd2c-e238-4d24-9dc2-b31e865c0bc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:32.213610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976bd2c-e238-4d24-9dc2-b31e865c0bc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:32.213886 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976bd2c-e238-4d24-9dc2-b31e865c0bc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:32.214153 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976bd2c-e238-4d24-9dc2-b31e865c0bc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:32.215977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5976bd2c-e238-4d24-9dc2-b31e865c0bc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:32.237726 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:32.340823 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976bd2c-e238-4d24-9dc2-b31e865c0bc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:32.342267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976bd2c-e238-4d24-9dc2-b31e865c0bc9 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:32.361002 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 661/1328] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 00:58:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:58:34.451839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52eef4-30a2-4744-857e-caf5a06823fa None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:34.452408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52eef4-30a2-4744-857e-caf5a06823fa None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:34.452408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52eef4-30a2-4744-857e-caf5a06823fa None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:34.453782 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 668/1329] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:34.459020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe195ef-ed4f-473b-a244-384925e69048 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:34.459503 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe195ef-ed4f-473b-a244-384925e69048 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:34.459604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe195ef-ed4f-473b-a244-384925e69048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:34.541551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-dfe195ef-ed4f-473b-a244-384925e69048 None None] MFA Rules not processed for user `54ec182a52e14c09bda7b43dbb5c8427`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:34.542782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-dfe195ef-ed4f-473b-a244-384925e69048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:34.611002 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:34.649244 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 662/1330] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:34 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 00:58:34.689088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52eef4-30a2-4744-857e-caf5a06823fa None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:34.690624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ff52eef4-30a2-4744-857e-caf5a06823fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:34.793861 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52eef4-30a2-4744-857e-caf5a06823fa None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:34.813569 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:34.869659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887e2fb-b212-4a27-8a05-872b0b644cf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:34.870259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887e2fb-b212-4a27-8a05-872b0b644cf6 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:34.870531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887e2fb-b212-4a27-8a05-872b0b644cf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:34.870792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887e2fb-b212-4a27-8a05-872b0b644cf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:34.872443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c887e2fb-b212-4a27-8a05-872b0b644cf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:34.988905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887e2fb-b212-4a27-8a05-872b0b644cf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:34.990333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887e2fb-b212-4a27-8a05-872b0b644cf6 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:35.009069 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 669/1331] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 00:58:34 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:58:37.369289 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077d293-6633-4fdd-8dd1-2f9496f49b6d None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:37.369806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077d293-6633-4fdd-8dd1-2f9496f49b6d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:37.369806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077d293-6633-4fdd-8dd1-2f9496f49b6d None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:37.371131 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 663/1332] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:37.376284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe0f4a-5d6e-46c6-9a43-e2d9f329b862 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:37.376698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe0f4a-5d6e-46c6-9a43-e2d9f329b862 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:37.376824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe0f4a-5d6e-46c6-9a43-e2d9f329b862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:37.440730 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:37.443556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-4efe0f4a-5d6e-46c6-9a43-e2d9f329b862 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:37.445838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4efe0f4a-5d6e-46c6-9a43-e2d9f329b862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:37.543909 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 670/1333] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:58:37.579794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077d293-6633-4fdd-8dd1-2f9496f49b6d None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:37.581362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3077d293-6633-4fdd-8dd1-2f9496f49b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:37.685135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077d293-6633-4fdd-8dd1-2f9496f49b6d None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:37.759650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff5c44-01d0-4cca-88c9-c474fe80ce0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:37.760268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff5c44-01d0-4cca-88c9-c474fe80ce0b service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:37.760572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff5c44-01d0-4cca-88c9-c474fe80ce0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:37.760839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff5c44-01d0-4cca-88c9-c474fe80ce0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:37.762662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e9ff5c44-01d0-4cca-88c9-c474fe80ce0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:37.789884 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:37.871639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff5c44-01d0-4cca-88c9-c474fe80ce0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:37.873111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff5c44-01d0-4cca-88c9-c474fe80ce0b service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:37.892028 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 664/1334] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 00:58:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:58:39.982799 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af87cda-fe38-4055-be9d-31da40ec2603 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:39.983257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af87cda-fe38-4055-be9d-31da40ec2603 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:39.983370 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af87cda-fe38-4055-be9d-31da40ec2603 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:39.984700 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 671/1335] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:39.989981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b939d-9ecb-46a9-a4b9-d9636577fe27 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:39.990384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b939d-9ecb-46a9-a4b9-d9636577fe27 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:39.990532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b939d-9ecb-46a9-a4b9-d9636577fe27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:40.056589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e16b939d-9ecb-46a9-a4b9-d9636577fe27 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:40.057798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e16b939d-9ecb-46a9-a4b9-d9636577fe27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:40.134985 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:40.158188 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 665/1336] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:58:40.198300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af87cda-fe38-4055-be9d-31da40ec2603 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:40.199798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6af87cda-fe38-4055-be9d-31da40ec2603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:40.304471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af87cda-fe38-4055-be9d-31da40ec2603 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:40.331875 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:40.379052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a44c3a-9ca9-43a0-98c0-bbb31db3177b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:40.379668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a44c3a-9ca9-43a0-98c0-bbb31db3177b service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:40.379979 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a44c3a-9ca9-43a0-98c0-bbb31db3177b service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:40.380252 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a44c3a-9ca9-43a0-98c0-bbb31db3177b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:40.381857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-34a44c3a-9ca9-43a0-98c0-bbb31db3177b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:40.496600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a44c3a-9ca9-43a0-98c0-bbb31db3177b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:40.498028 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a44c3a-9ca9-43a0-98c0-bbb31db3177b service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:40.516268 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 672/1337] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 00:58:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:58:42.969607 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248c945-d9f1-40b0-b8b6-cf66cace26f3 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:42.970131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248c945-d9f1-40b0-b8b6-cf66cace26f3 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:42.970131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d248c945-d9f1-40b0-b8b6-cf66cace26f3 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:42.971500 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 666/1338] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:42.977400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf06e5-3680-47a0-bddb-2b057d555760 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:42.977865 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf06e5-3680-47a0-bddb-2b057d555760 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:42.977960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf06e5-3680-47a0-bddb-2b057d555760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:43.048198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-8abf06e5-3680-47a0-bddb-2b057d555760 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:43.049414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8abf06e5-3680-47a0-bddb-2b057d555760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:43.058615 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:43.145485 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 673/1339] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:58:43.182160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248c945-d9f1-40b0-b8b6-cf66cace26f3 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:43.183669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d248c945-d9f1-40b0-b8b6-cf66cace26f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:43.288667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d248c945-d9f1-40b0-b8b6-cf66cace26f3 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:43.360959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57013cb4-3ac1-4bb2-b082-dbf4279ebc0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:43.361559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57013cb4-3ac1-4bb2-b082-dbf4279ebc0a service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:43.361839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57013cb4-3ac1-4bb2-b082-dbf4279ebc0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:43.362112 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57013cb4-3ac1-4bb2-b082-dbf4279ebc0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:43.363707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-57013cb4-3ac1-4bb2-b082-dbf4279ebc0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:43.400826 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:43.474122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57013cb4-3ac1-4bb2-b082-dbf4279ebc0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:43.475466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57013cb4-3ac1-4bb2-b082-dbf4279ebc0a service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:43.494312 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 667/1340] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 00:58:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:58:47.735966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f86592-56c4-43b7-a10c-95a595cdb1c9 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:47.736564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f86592-56c4-43b7-a10c-95a595cdb1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:47.736564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f86592-56c4-43b7-a10c-95a595cdb1c9 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:47.737882 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 674/1341] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:47.743456 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee2258-0e59-4f54-ae05-4008e3c17a77 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:47.743976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee2258-0e59-4f54-ae05-4008e3c17a77 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:47.744081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee2258-0e59-4f54-ae05-4008e3c17a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:47.812180 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ccee2258-0e59-4f54-ae05-4008e3c17a77 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:47.813417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ccee2258-0e59-4f54-ae05-4008e3c17a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:47.900833 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:47.912993 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 668/1342] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:58:47.953081 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f86592-56c4-43b7-a10c-95a595cdb1c9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:47.954722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-92f86592-56c4-43b7-a10c-95a595cdb1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:48.065704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f86592-56c4-43b7-a10c-95a595cdb1c9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:48.104506 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:48.142323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad1cc8-f254-4d37-aafb-2724a1035298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:48.142921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad1cc8-f254-4d37-aafb-2724a1035298 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:48.143193 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad1cc8-f254-4d37-aafb-2724a1035298 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:48.143460 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad1cc8-f254-4d37-aafb-2724a1035298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:48.145076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b5ad1cc8-f254-4d37-aafb-2724a1035298 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:48.263660 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad1cc8-f254-4d37-aafb-2724a1035298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:48.265077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad1cc8-f254-4d37-aafb-2724a1035298 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:48.284602 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 675/1343] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 00:58:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:58:50.966205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca4965-03ca-4798-a2e8-a1d3680d9786 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:50.967039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca4965-03ca-4798-a2e8-a1d3680d9786 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:50.967039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ca4965-03ca-4798-a2e8-a1d3680d9786 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:50.968185 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 669/1344] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:50.974415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86aacfb-7816-4ad5-9382-1cf21a1ab9fd None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:50.975042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86aacfb-7816-4ad5-9382-1cf21a1ab9fd None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:50.975042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86aacfb-7816-4ad5-9382-1cf21a1ab9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:51.054329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e86aacfb-7816-4ad5-9382-1cf21a1ab9fd None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:51.055624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e86aacfb-7816-4ad5-9382-1cf21a1ab9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:51.077049 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:51.166352 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 676/1345] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:58:51.204641 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca4965-03ca-4798-a2e8-a1d3680d9786 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:51.206260 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-43ca4965-03ca-4798-a2e8-a1d3680d9786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:51.342135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ca4965-03ca-4798-a2e8-a1d3680d9786 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:51.420973 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ceaa6-0c0f-4817-8fce-95388066872c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:51.421501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ceaa6-0c0f-4817-8fce-95388066872c service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:51.421779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ceaa6-0c0f-4817-8fce-95388066872c service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:51.422051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ceaa6-0c0f-4817-8fce-95388066872c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:51.423670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6f2ceaa6-0c0f-4817-8fce-95388066872c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:51.468864 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:51.541624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ceaa6-0c0f-4817-8fce-95388066872c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:51.543100 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ceaa6-0c0f-4817-8fce-95388066872c service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:51.562422 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 670/1346] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 00:58:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:58:55.850992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4a974-0780-4d0a-b9c5-1866ff0f2087 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:55.851550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4a974-0780-4d0a-b9c5-1866ff0f2087 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:55.851550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4a974-0780-4d0a-b9c5-1866ff0f2087 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:55.852978 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 677/1347] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:58:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:58:55.858730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ec900-193f-477a-b517-7e16c6128d9e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:55.859182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ec900-193f-477a-b517-7e16c6128d9e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:55.859420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ec900-193f-477a-b517-7e16c6128d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:55.931637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-8f5ec900-193f-477a-b517-7e16c6128d9e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:58:55.932903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8f5ec900-193f-477a-b517-7e16c6128d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:56.050149 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 671/1348] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:58:56.051191 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:56.090735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4a974-0780-4d0a-b9c5-1866ff0f2087 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:58:56.092238 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fef4a974-0780-4d0a-b9c5-1866ff0f2087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:56.211533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4a974-0780-4d0a-b9c5-1866ff0f2087 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:58:56.274500 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:58:56.304360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6dfabf-61fd-4a83-8ee4-d8f46ee6d34f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:58:56.304964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dfabf-61fd-4a83-8ee4-d8f46ee6d34f service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:58:56.305240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dfabf-61fd-4a83-8ee4-d8f46ee6d34f service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:58:56.305506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dfabf-61fd-4a83-8ee4-d8f46ee6d34f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:58:56.307158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-aa6dfabf-61fd-4a83-8ee4-d8f46ee6d34f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:58:56.430435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6dfabf-61fd-4a83-8ee4-d8f46ee6d34f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:58:56.431878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6dfabf-61fd-4a83-8ee4-d8f46ee6d34f service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:58:56.451440 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 678/1349] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 00:58:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:59:02.145014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546169fa-a30d-4496-b3e4-a0772b2ef6b7 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:02.145837 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546169fa-a30d-4496-b3e4-a0772b2ef6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:02.145837 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546169fa-a30d-4496-b3e4-a0772b2ef6b7 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:02.149340 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 672/1350] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 00:59:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:02.155189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a6a4e-6055-4a1f-aa7a-c38126d98cfd None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:02.156039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a6a4e-6055-4a1f-aa7a-c38126d98cfd None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:02.156039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a6a4e-6055-4a1f-aa7a-c38126d98cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:02.319934 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-fc8a6a4e-6055-4a1f-aa7a-c38126d98cfd None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:02.321999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fc8a6a4e-6055-4a1f-aa7a-c38126d98cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:02.361733 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:02.557560 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 679/1351] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 00:59:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 00:59:08.642769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe44b43-087b-4411-8526-76ff7d28db32 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:08.643617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe44b43-087b-4411-8526-76ff7d28db32 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:08.643758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe44b43-087b-4411-8526-76ff7d28db32 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:08.647343 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 673/1352] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 00:59:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:08.656298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263156b-70ba-4884-8de6-6c3029d9fd60 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:08.657788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263156b-70ba-4884-8de6-6c3029d9fd60 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:08.658613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263156b-70ba-4884-8de6-6c3029d9fd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:08.842812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e263156b-70ba-4884-8de6-6c3029d9fd60 None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:08.845602 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e263156b-70ba-4884-8de6-6c3029d9fd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:09.008265 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:09.072575 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 680/1353] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 00:59:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:59:11.070122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa49fd-a970-4e0c-ab51-9a717844325d None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:11.070959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa49fd-a970-4e0c-ab51-9a717844325d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:11.070959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa49fd-a970-4e0c-ab51-9a717844325d None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:11.072820 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 674/1354] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 00:59:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:11.079145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9ac8a-c3a4-439f-a341-81cd8def1e44 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:11.080056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9ac8a-c3a4-439f-a341-81cd8def1e44 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:11.080056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9ac8a-c3a4-439f-a341-81cd8def1e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:11.234117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-20e9ac8a-c3a4-439f-a341-81cd8def1e44 None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:11.235928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-20e9ac8a-c3a4-439f-a341-81cd8def1e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:11.414734 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 681/1355] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 00:59:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 00:59:15.360406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6f38b-fe48-4329-aa22-d898f4731d8d None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:15.361537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6f38b-fe48-4329-aa22-d898f4731d8d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:15.362189 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6f38b-fe48-4329-aa22-d898f4731d8d None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:15.365144 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 675/1356] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:59:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:15.374026 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61162a-24ec-4c93-9640-8b86ba961c83 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:15.374026 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61162a-24ec-4c93-9640-8b86ba961c83 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:15.375735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61162a-24ec-4c93-9640-8b86ba961c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:15.470758 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:15.524647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3b61162a-24ec-4c93-9640-8b86ba961c83 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:15.526804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3b61162a-24ec-4c93-9640-8b86ba961c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:15.759590 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 682/1357] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:59:15.855752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edd5ad-961d-4501-8277-3a9093f71e0c None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:15.857143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edd5ad-961d-4501-8277-3a9093f71e0c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:15.858067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edd5ad-961d-4501-8277-3a9093f71e0c None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:15.863128 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 676/1358] 10.222.0.39 () {54 vars in 962 bytes} [Sun Aug 7 00:59:15 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:15.876537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc091383-9838-49ac-bb83-d453bc4fd774 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:15.878966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc091383-9838-49ac-bb83-d453bc4fd774 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:15.880255 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc091383-9838-49ac-bb83-d453bc4fd774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:16.071165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-cc091383-9838-49ac-bb83-d453bc4fd774 None None] MFA Rules not processed for user `6c70d5a72d424db68de7c7b8257fe02c`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:16.073288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-cc091383-9838-49ac-bb83-d453bc4fd774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:16.176991 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:16.327950 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 683/1359] 10.222.0.39 () {58 vars in 1059 bytes} [Sun Aug 7 00:59:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:59:16.342446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7edd5ad-961d-4501-8277-3a9093f71e0c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:16.344482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d7edd5ad-961d-4501-8277-3a9093f71e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:16.683554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7edd5ad-961d-4501-8277-3a9093f71e0c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:16.832167 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:16.912172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323536e-d982-4667-83d2-42e62e31aa5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:16.913286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323536e-d982-4667-83d2-42e62e31aa5b service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:16.913829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323536e-d982-4667-83d2-42e62e31aa5b service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:16.914327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323536e-d982-4667-83d2-42e62e31aa5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:16.918053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6323536e-d982-4667-83d2-42e62e31aa5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:17.087692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323536e-d982-4667-83d2-42e62e31aa5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:17.091299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323536e-d982-4667-83d2-42e62e31aa5b service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:17.132204 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 677/1360] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 00:59:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 790 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:59:20.027257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbd869-5a1a-4ff7-ab1d-286e9254ed37 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:20.029205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbd869-5a1a-4ff7-ab1d-286e9254ed37 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:20.029205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bbd869-5a1a-4ff7-ab1d-286e9254ed37 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:20.030670 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 684/1361] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:59:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:59:20.039999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7d341-0b7c-4c15-9451-857b2c13365c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:20.039999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7d341-0b7c-4c15-9451-857b2c13365c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:20.039999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7d341-0b7c-4c15-9451-857b2c13365c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:20.138578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9ba7d341-0b7c-4c15-9451-857b2c13365c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:20.139801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9ba7d341-0b7c-4c15-9451-857b2c13365c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:20.197211 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:20.311203 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 678/1362] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:59:20.367534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbd869-5a1a-4ff7-ab1d-286e9254ed37 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:20.369573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-83bbd869-5a1a-4ff7-ab1d-286e9254ed37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:20.689726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bbd869-5a1a-4ff7-ab1d-286e9254ed37 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:20.709612 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:20.947119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe448bd-1915-4c8f-b977-89c13bec1680 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:20.948217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe448bd-1915-4c8f-b977-89c13bec1680 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:20.948706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe448bd-1915-4c8f-b977-89c13bec1680 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:20.949190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe448bd-1915-4c8f-b977-89c13bec1680 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:20.952460 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1fe448bd-1915-4c8f-b977-89c13bec1680 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:21.158263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe448bd-1915-4c8f-b977-89c13bec1680 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:21.160855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe448bd-1915-4c8f-b977-89c13bec1680 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:21.193052 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 685/1363] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 00:59:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 826 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:59:24.733787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed8a59-5286-434b-8439-97679a920855 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:24.734758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed8a59-5286-434b-8439-97679a920855 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:24.734758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed8a59-5286-434b-8439-97679a920855 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:24.735711 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 679/1364] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:24.742549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271aad8-93f2-4d4e-8c35-12f4e7eee6fd None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:24.743588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271aad8-93f2-4d4e-8c35-12f4e7eee6fd None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:24.744415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271aad8-93f2-4d4e-8c35-12f4e7eee6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:24.768259 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:24.846179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-4271aad8-93f2-4d4e-8c35-12f4e7eee6fd None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:24.849304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4271aad8-93f2-4d4e-8c35-12f4e7eee6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:25.032304 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 686/1365] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 00:59:25.088368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb22f4-1ecc-42b5-8b3a-ce537e245d0c None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:25.089241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb22f4-1ecc-42b5-8b3a-ce537e245d0c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:25.089747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb22f4-1ecc-42b5-8b3a-ce537e245d0c None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:25.092083 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 680/1366] 10.222.0.39 () {54 vars in 962 bytes} [Sun Aug 7 00:59:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:25.101514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcafbc-97db-4d98-b751-8184a0781050 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:25.102951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcafbc-97db-4d98-b751-8184a0781050 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:25.102951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcafbc-97db-4d98-b751-8184a0781050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:25.245593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-74fcafbc-97db-4d98-b751-8184a0781050 None None] MFA Rules not processed for user `6c70d5a72d424db68de7c7b8257fe02c`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:25.247610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-74fcafbc-97db-4d98-b751-8184a0781050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:25.323263 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:25.488864 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 687/1367] 10.222.0.39 () {58 vars in 1059 bytes} [Sun Aug 7 00:59:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 00:59:25.500167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb22f4-1ecc-42b5-8b3a-ce537e245d0c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:25.503122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-89bb22f4-1ecc-42b5-8b3a-ce537e245d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:25.817964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb22f4-1ecc-42b5-8b3a-ce537e245d0c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:25.858749 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:26.089775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bcc082-2526-4e32-887b-9de7b47e9a9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:26.091424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcc082-2526-4e32-887b-9de7b47e9a9b service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:26.092278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcc082-2526-4e32-887b-9de7b47e9a9b service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:26.093037 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcc082-2526-4e32-887b-9de7b47e9a9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:26.097316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a3bcc082-2526-4e32-887b-9de7b47e9a9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:26.282436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bcc082-2526-4e32-887b-9de7b47e9a9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:26.287216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bcc082-2526-4e32-887b-9de7b47e9a9b service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:26.328375 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 681/1368] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 00:59:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 829 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:59:30.092071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e98c8-7249-4127-81c6-6eebecf5d4e9 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:30.093672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e98c8-7249-4127-81c6-6eebecf5d4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:30.094422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e98c8-7249-4127-81c6-6eebecf5d4e9 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:30.097775 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 688/1369] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:59:30 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:30.105873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8225fb9-12ac-4a65-a032-601ea89b8af8 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:30.106566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8225fb9-12ac-4a65-a032-601ea89b8af8 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:30.106717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8225fb9-12ac-4a65-a032-601ea89b8af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:30.169124 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:30.234671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-f8225fb9-12ac-4a65-a032-601ea89b8af8 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:30.237841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f8225fb9-12ac-4a65-a032-601ea89b8af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:30.413671 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 682/1370] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:59:30.499303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e98c8-7249-4127-81c6-6eebecf5d4e9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:30.502591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a49e98c8-7249-4127-81c6-6eebecf5d4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:30.786063 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:30.797026 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e98c8-7249-4127-81c6-6eebecf5d4e9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:31.040851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c830e21-d3fa-4fef-8afa-2c482f810b4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:31.041386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c830e21-d3fa-4fef-8afa-2c482f810b4c service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:31.041659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c830e21-d3fa-4fef-8afa-2c482f810b4c service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:31.042004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c830e21-d3fa-4fef-8afa-2c482f810b4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:31.045895 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3c830e21-d3fa-4fef-8afa-2c482f810b4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:31.227418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c830e21-d3fa-4fef-8afa-2c482f810b4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:31.232590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c830e21-d3fa-4fef-8afa-2c482f810b4c service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:31.268604 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:31.274876 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 689/1371] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 00:59:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 776 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:59:32.857198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22ac1f-8941-46bd-90d3-f69a3cd41077 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:32.858067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22ac1f-8941-46bd-90d3-f69a3cd41077 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:32.858067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22ac1f-8941-46bd-90d3-f69a3cd41077 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:32.860965 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 683/1372] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:59:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:32.870093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f8ade-bce8-455e-906e-ee82e389e9dd None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:32.871138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f8ade-bce8-455e-906e-ee82e389e9dd None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:32.871416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f8ade-bce8-455e-906e-ee82e389e9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:33.015433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-8c5f8ade-bce8-455e-906e-ee82e389e9dd None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:33.017473 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8c5f8ade-bce8-455e-906e-ee82e389e9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:33.230752 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 690/1373] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 00:59:33.634253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2aa45-5141-4000-b81b-58d01ddef18d None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:33.634529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2aa45-5141-4000-b81b-58d01ddef18d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:33.634799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2aa45-5141-4000-b81b-58d01ddef18d None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:33.636550 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 684/1374] 10.222.0.39 () {54 vars in 964 bytes} [Sun Aug 7 00:59:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:59:33.642769 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a37622-ae01-4db0-83e7-7d6a8cb5273d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:33.643040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a37622-ae01-4db0-83e7-7d6a8cb5273d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:33.643489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a37622-ae01-4db0-83e7-7d6a8cb5273d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:33.768868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-91a37622-ae01-4db0-83e7-7d6a8cb5273d None None] MFA Rules not processed for user `9a8be18e03a54bd8821ed5c048bbc793`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:33.771119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-91a37622-ae01-4db0-83e7-7d6a8cb5273d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:33.823159 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:33.953721 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 691/1375] 10.222.0.39 () {58 vars in 1061 bytes} [Sun Aug 7 00:59:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 00:59:33.970925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2aa45-5141-4000-b81b-58d01ddef18d None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:33.974851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-aac2aa45-5141-4000-b81b-58d01ddef18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:34.202176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2aa45-5141-4000-b81b-58d01ddef18d None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:34.214682 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:34.371795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1db21-9a53-4018-a955-ba7c0f096537 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:34.372672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1db21-9a53-4018-a955-ba7c0f096537 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:34.373016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1db21-9a53-4018-a955-ba7c0f096537 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:34.373414 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1db21-9a53-4018-a955-ba7c0f096537 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:34.375527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d9d1db21-9a53-4018-a955-ba7c0f096537 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:34.560700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1db21-9a53-4018-a955-ba7c0f096537 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:34.562457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1db21-9a53-4018-a955-ba7c0f096537 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:34.599989 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 685/1376] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 00:59:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:59:34.636792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0caee4-f7ab-4496-b336-531f8f37e8d2 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:34.637399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0caee4-f7ab-4496-b336-531f8f37e8d2 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:34.638025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0caee4-f7ab-4496-b336-531f8f37e8d2 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:34.641180 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 692/1377] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:59:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:34.655287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00515f34-6471-4054-8df9-00a4905655d1 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:34.655818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00515f34-6471-4054-8df9-00a4905655d1 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:34.656247 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00515f34-6471-4054-8df9-00a4905655d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:34.739874 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:34.780953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-00515f34-6471-4054-8df9-00a4905655d1 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:34.782594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-00515f34-6471-4054-8df9-00a4905655d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:34.960003 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 686/1378] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 00:59:35.045406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0caee4-f7ab-4496-b336-531f8f37e8d2 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:35.048844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5d0caee4-f7ab-4496-b336-531f8f37e8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:35.375659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0caee4-f7ab-4496-b336-531f8f37e8d2 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:35.446001 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:35.673662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca8b78-08a2-4fae-a40c-ec2e60955ae3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:35.675499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca8b78-08a2-4fae-a40c-ec2e60955ae3 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:35.676958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca8b78-08a2-4fae-a40c-ec2e60955ae3 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:35.677729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca8b78-08a2-4fae-a40c-ec2e60955ae3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:35.682216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0eca8b78-08a2-4fae-a40c-ec2e60955ae3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:36.077912 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca8b78-08a2-4fae-a40c-ec2e60955ae3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:36.080071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca8b78-08a2-4fae-a40c-ec2e60955ae3 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:36.112361 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 693/1379] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 00:59:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 1068 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:59:39.027110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d379d-9f13-45f7-8feb-83e0a1a13ee9 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:39.027683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d379d-9f13-45f7-8feb-83e0a1a13ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:39.028569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d379d-9f13-45f7-8feb-83e0a1a13ee9 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:39.031837 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 687/1380] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:59:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:39.043335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800b79b-7e7b-4dca-ba4d-fa8e70754342 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:39.045021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800b79b-7e7b-4dca-ba4d-fa8e70754342 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:39.045732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800b79b-7e7b-4dca-ba4d-fa8e70754342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:39.149836 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:39.199703 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a800b79b-7e7b-4dca-ba4d-fa8e70754342 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:39.201078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a800b79b-7e7b-4dca-ba4d-fa8e70754342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:39.372473 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 694/1381] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:59:39.435601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d379d-9f13-45f7-8feb-83e0a1a13ee9 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:39.438667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bf5d379d-9f13-45f7-8feb-83e0a1a13ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:39.726918 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:39.789705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d379d-9f13-45f7-8feb-83e0a1a13ee9 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:39.954704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6fb2e2-5c34-48ec-b144-d4e9b0eaa683 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:39.955480 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6fb2e2-5c34-48ec-b144-d4e9b0eaa683 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:39.955862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6fb2e2-5c34-48ec-b144-d4e9b0eaa683 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:39.956400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6fb2e2-5c34-48ec-b144-d4e9b0eaa683 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:39.958203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5d6fb2e2-5c34-48ec-b144-d4e9b0eaa683 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:40.067365 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:40.089258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6fb2e2-5c34-48ec-b144-d4e9b0eaa683 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:40.091676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6fb2e2-5c34-48ec-b144-d4e9b0eaa683 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:40.121107 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 688/1382] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 00:59:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 687 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:59:42.960946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081e088-1ea1-42cd-9666-70b66273047f None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:42.961486 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081e088-1ea1-42cd-9666-70b66273047f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:42.961574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081e088-1ea1-42cd-9666-70b66273047f None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:42.962922 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 695/1383] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:42.968778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff7e7a-62a3-4843-98ec-cbadb9f0293b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:42.969216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff7e7a-62a3-4843-98ec-cbadb9f0293b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:42.969336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff7e7a-62a3-4843-98ec-cbadb9f0293b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:43.049011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-71ff7e7a-62a3-4843-98ec-cbadb9f0293b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:43.050223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-71ff7e7a-62a3-4843-98ec-cbadb9f0293b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:43.187394 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 689/1384] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:59:43.238325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081e088-1ea1-42cd-9666-70b66273047f None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:43.239923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1081e088-1ea1-42cd-9666-70b66273047f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:43.374238 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:43.435382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081e088-1ea1-42cd-9666-70b66273047f None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:43.604822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d15e7b-cc41-44fc-84dc-8605e328ee5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:43.605583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d15e7b-cc41-44fc-84dc-8605e328ee5a service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:43.605854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d15e7b-cc41-44fc-84dc-8605e328ee5a service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:43.606122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d15e7b-cc41-44fc-84dc-8605e328ee5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:43.607751 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-85d15e7b-cc41-44fc-84dc-8605e328ee5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:43.736825 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:43.765735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d15e7b-cc41-44fc-84dc-8605e328ee5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:43.769009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d15e7b-cc41-44fc-84dc-8605e328ee5a service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:43.812578 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 696/1385] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 00:59:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:59:46.421005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15b437-c8a8-4cbb-b84b-c45760c2c6e5 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:46.422179 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15b437-c8a8-4cbb-b84b-c45760c2c6e5 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:46.422179 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15b437-c8a8-4cbb-b84b-c45760c2c6e5 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:46.424605 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 690/1386] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:59:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:59:46.432006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfecef-7565-48c3-9b53-d1d036cf1f32 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:46.433060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfecef-7565-48c3-9b53-d1d036cf1f32 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:46.433060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfecef-7565-48c3-9b53-d1d036cf1f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:46.534123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-4fbfecef-7565-48c3-9b53-d1d036cf1f32 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:46.535449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4fbfecef-7565-48c3-9b53-d1d036cf1f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:46.721852 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 697/1387] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 00:59:46.773111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15b437-c8a8-4cbb-b84b-c45760c2c6e5 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:46.775253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2c15b437-c8a8-4cbb-b84b-c45760c2c6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:46.869159 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:47.046653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15b437-c8a8-4cbb-b84b-c45760c2c6e5 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:47.239617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9061027-c202-4d82-ba62-cde552cbfd82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:47.240380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9061027-c202-4d82-ba62-cde552cbfd82 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:47.240592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9061027-c202-4d82-ba62-cde552cbfd82 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:47.240892 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9061027-c202-4d82-ba62-cde552cbfd82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:47.242599 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d9061027-c202-4d82-ba62-cde552cbfd82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:47.270589 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:47.423133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9061027-c202-4d82-ba62-cde552cbfd82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:47.425094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9061027-c202-4d82-ba62-cde552cbfd82 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:47.447294 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 691/1388] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 00:59:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:59:50.056715 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5f3f5-f988-4e37-a3dd-ffaa4bfe707e None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:50.057830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5f3f5-f988-4e37-a3dd-ffaa4bfe707e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:50.057830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5f3f5-f988-4e37-a3dd-ffaa4bfe707e None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:50.059708 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 698/1389] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:59:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:50.067108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eb61d-562c-4701-87da-ed222b4a36b1 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:50.067666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eb61d-562c-4701-87da-ed222b4a36b1 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:50.068090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12eb61d-562c-4701-87da-ed222b4a36b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:50.168192 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b12eb61d-562c-4701-87da-ed222b4a36b1 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:50.169825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b12eb61d-562c-4701-87da-ed222b4a36b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:50.285997 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:50.306253 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 692/1390] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:59:50.357947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5f3f5-f988-4e37-a3dd-ffaa4bfe707e None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:50.359352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-23c5f3f5-f988-4e37-a3dd-ffaa4bfe707e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:50.426932 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:50.552113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5f3f5-f988-4e37-a3dd-ffaa4bfe707e None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:50.692599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29196ffa-5659-430e-988e-d1f563c83639 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:50.693396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29196ffa-5659-430e-988e-d1f563c83639 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:50.693771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29196ffa-5659-430e-988e-d1f563c83639 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:50.694140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29196ffa-5659-430e-988e-d1f563c83639 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:50.695933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-29196ffa-5659-430e-988e-d1f563c83639 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:50.709134 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:50.834364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29196ffa-5659-430e-988e-d1f563c83639 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:50.838959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29196ffa-5659-430e-988e-d1f563c83639 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:50.865452 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 699/1391] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 00:59:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:59:53.099685 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0da3a-b7cc-44bc-b3f9-3e66d48375f0 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:53.100567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0da3a-b7cc-44bc-b3f9-3e66d48375f0 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:53.100567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0da3a-b7cc-44bc-b3f9-3e66d48375f0 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:53.102157 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 693/1392] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 00:59:53.108647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca89205-4c01-43e5-8bde-13b4511153d1 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:53.109551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca89205-4c01-43e5-8bde-13b4511153d1 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:53.109551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca89205-4c01-43e5-8bde-13b4511153d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:53.194444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3ca89205-4c01-43e5-8bde-13b4511153d1 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:53.195746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3ca89205-4c01-43e5-8bde-13b4511153d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:53.298648 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:53.314629 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 700/1393] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 00:59:53.361999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0da3a-b7cc-44bc-b3f9-3e66d48375f0 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:53.363496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c4e0da3a-b7cc-44bc-b3f9-3e66d48375f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:53.529280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0da3a-b7cc-44bc-b3f9-3e66d48375f0 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:53.603290 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:53.662124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b55fb-b96a-4535-876d-226719656b43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:53.662946 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b55fb-b96a-4535-876d-226719656b43 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:53.663323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b55fb-b96a-4535-876d-226719656b43 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:53.663692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b55fb-b96a-4535-876d-226719656b43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:53.665788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d97b55fb-b96a-4535-876d-226719656b43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:53.714458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b4f8b-5212-4580-9c1e-4b95a0b0e241 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:53.714810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b4f8b-5212-4580-9c1e-4b95a0b0e241 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:53.714999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b4f8b-5212-4580-9c1e-4b95a0b0e241 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:53.716576 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 701/1394] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:53.724919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb869b44-6d5b-403c-862f-c434a04b41ba None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:53.725199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb869b44-6d5b-403c-862f-c434a04b41ba None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:53.725467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb869b44-6d5b-403c-862f-c434a04b41ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:53.778689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b55fb-b96a-4535-876d-226719656b43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:53.787609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b55fb-b96a-4535-876d-226719656b43 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:53.815012 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 694/1395] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 00:59:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:59:53.826003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-eb869b44-6d5b-403c-862f-c434a04b41ba None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:53.828114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-eb869b44-6d5b-403c-862f-c434a04b41ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:53.987100 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 702/1396] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 00:59:54.043227 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03ef2c-0c29-48c9-92ce-a4b74698d70a None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:54.043690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03ef2c-0c29-48c9-92ce-a4b74698d70a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:54.044140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03ef2c-0c29-48c9-92ce-a4b74698d70a None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:54.045658 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 695/1397] 10.222.0.39 () {54 vars in 966 bytes} [Sun Aug 7 00:59:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:54.053447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511b0cd-8d9e-41ba-b455-3eaed22372e6 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:54.053740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511b0cd-8d9e-41ba-b455-3eaed22372e6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:54.053982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511b0cd-8d9e-41ba-b455-3eaed22372e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:54.181224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a511b0cd-8d9e-41ba-b455-3eaed22372e6 None None] MFA Rules not processed for user `bcb60ac015204436b81971694393380c`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:54.182876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a511b0cd-8d9e-41ba-b455-3eaed22372e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:54.193942 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:54.293056 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 703/1398] 10.222.0.39 () {58 vars in 1063 bytes} [Sun Aug 7 00:59:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:59:54.301679 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03ef2c-0c29-48c9-92ce-a4b74698d70a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:54.303171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bb03ef2c-0c29-48c9-92ce-a4b74698d70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:54.401142 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:54.447421 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03ef2c-0c29-48c9-92ce-a4b74698d70a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:54.554428 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ba259-13ed-430d-a83d-c7ed16c0eeaf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:54.555062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ba259-13ed-430d-a83d-c7ed16c0eeaf service glance] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:54.555373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ba259-13ed-430d-a83d-c7ed16c0eeaf service glance] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:54.555677 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ba259-13ed-430d-a83d-c7ed16c0eeaf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:54.557560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7e5ba259-13ed-430d-a83d-c7ed16c0eeaf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:54.716362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ba259-13ed-430d-a83d-c7ed16c0eeaf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:54.718854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ba259-13ed-430d-a83d-c7ed16c0eeaf service glance] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:54.763748 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 696/1399] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 00:59:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 00:59:55.566991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f90256-70ed-4214-9749-e5b59e20bbb1 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:55.567847 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f90256-70ed-4214-9749-e5b59e20bbb1 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:55.568039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f90256-70ed-4214-9749-e5b59e20bbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:55.643057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-91f90256-70ed-4214-9749-e5b59e20bbb1 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:55.644285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-91f90256-70ed-4214-9749-e5b59e20bbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:55.735553 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 704/1400] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 00:59:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 00:59:55.786544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d288a-08d9-45a3-824e-07fe9b930380 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:55.787237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d288a-08d9-45a3-824e-07fe9b930380 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:55.787237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d288a-08d9-45a3-824e-07fe9b930380 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:55.788595 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 697/1401] 10.222.0.39 () {54 vars in 943 bytes} [Sun Aug 7 00:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:55.796152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a7f50-47cc-4da5-9c6b-bb98dca3cb87 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:55.796507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a7f50-47cc-4da5-9c6b-bb98dca3cb87 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:55.796837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a7f50-47cc-4da5-9c6b-bb98dca3cb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:55.833791 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:55.888116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-026a7f50-47cc-4da5-9c6b-bb98dca3cb87 None None] MFA Rules not processed for user `fb5a86da594046ed97745371176decf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:55.889350 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-026a7f50-47cc-4da5-9c6b-bb98dca3cb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:56.000874 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 705/1402] 10.222.0.39 () {58 vars in 1040 bytes} [Sun Aug 7 00:59:55 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:59:56.011236 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d288a-08d9-45a3-824e-07fe9b930380 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:56.013041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-437d288a-08d9-45a3-824e-07fe9b930380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:56.021591 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:56.159380 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e988f-2434-4ccf-8b71-48018e3e507b None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:56.160094 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e988f-2434-4ccf-8b71-48018e3e507b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:56.161526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e988f-2434-4ccf-8b71-48018e3e507b None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:56.164187 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 706/1403] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:59:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:56.169754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf313b-bc8c-4207-a78f-3b87abb036c1 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:56.170173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf313b-bc8c-4207-a78f-3b87abb036c1 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:56.170454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf313b-bc8c-4207-a78f-3b87abb036c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:56.177096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d288a-08d9-45a3-824e-07fe9b930380 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:56.244602 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2ebf313b-bc8c-4207-a78f-3b87abb036c1 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:56.245837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2ebf313b-bc8c-4207-a78f-3b87abb036c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:56.293520 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:56.316436 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:56.328784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4747c-a880-4539-a9d8-21e49691a923 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:56.329395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4747c-a880-4539-a9d8-21e49691a923 service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:56.330089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4747c-a880-4539-a9d8-21e49691a923 service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:56.330089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4747c-a880-4539-a9d8-21e49691a923 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:56.331648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d8d4747c-a880-4539-a9d8-21e49691a923 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:56.365606 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 707/1404] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 00:59:56.413134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf313b-bc8c-4207-a78f-3b87abb036c1 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:56.415008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2ebf313b-bc8c-4207-a78f-3b87abb036c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:56.434508 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4747c-a880-4539-a9d8-21e49691a923 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:56.436195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4747c-a880-4539-a9d8-21e49691a923 service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:56.446090 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 698/1405] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 00:59:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 00:59:56.589476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf313b-bc8c-4207-a78f-3b87abb036c1 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 00:59:56.683144 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:56.767393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8058f-754b-403a-a200-70b7f0cc1df9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 00:59:56.768158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8058f-754b-403a-a200-70b7f0cc1df9 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:56.768573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8058f-754b-403a-a200-70b7f0cc1df9 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:56.768778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8058f-754b-403a-a200-70b7f0cc1df9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:56.770532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-71e8058f-754b-403a-a200-70b7f0cc1df9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:56.878991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e8058f-754b-403a-a200-70b7f0cc1df9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 00:59:56.881263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e8058f-754b-403a-a200-70b7f0cc1df9 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 00:59:56.907946 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 708/1406] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 00:59:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 00:59:59.388012 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de92c32-c678-4f04-a370-30dd58ddc88e None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:59.389565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de92c32-c678-4f04-a370-30dd58ddc88e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:59.389565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de92c32-c678-4f04-a370-30dd58ddc88e None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:59.391937 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 699/1407] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 00:59:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 00:59:59.405676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee72a61-805e-43ae-b8f3-5ec8becd82e6 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 00:59:59.405676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee72a61-805e-43ae-b8f3-5ec8becd82e6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 00:59:59.405676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee72a61-805e-43ae-b8f3-5ec8becd82e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 00:59:59.514958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-fee72a61-805e-43ae-b8f3-5ec8becd82e6 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 00:59:59.517033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fee72a61-805e-43ae-b8f3-5ec8becd82e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:59.534849 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:59.680807 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 709/1408] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 00:59:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 00:59:59.735267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de92c32-c678-4f04-a370-30dd58ddc88e None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 00:59:59.736820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5de92c32-c678-4f04-a370-30dd58ddc88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 00:59:59.935466 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 00:59:59.959691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de92c32-c678-4f04-a370-30dd58ddc88e None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:00.155960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11d282-f7d8-4de4-acc7-5717b337985c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:00.156829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11d282-f7d8-4de4-acc7-5717b337985c service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:00.157199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11d282-f7d8-4de4-acc7-5717b337985c service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:00.157568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11d282-f7d8-4de4-acc7-5717b337985c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:00.163808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8d11d282-f7d8-4de4-acc7-5717b337985c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:00.369855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11d282-f7d8-4de4-acc7-5717b337985c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:00.372499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11d282-f7d8-4de4-acc7-5717b337985c service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:00.380634 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:00.402578 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 700/1409] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 00:59:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:00:09.681029 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=40 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:10.404062 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:22.047760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5934a0-2bee-4b72-ab3e-a5b54cf4e413 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:22.048405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5934a0-2bee-4b72-ab3e-a5b54cf4e413 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:22.048405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5934a0-2bee-4b72-ab3e-a5b54cf4e413 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:22.049742 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 710/1410] 10.222.0.39 () {54 vars in 918 bytes} [Sun Aug 7 01:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:22.054965 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de742c6b-c292-4a0a-a4d1-62a0126a3574 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:22.055403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de742c6b-c292-4a0a-a4d1-62a0126a3574 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:22.055522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de742c6b-c292-4a0a-a4d1-62a0126a3574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:22.143550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-de742c6b-c292-4a0a-a4d1-62a0126a3574 None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:22.145177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-de742c6b-c292-4a0a-a4d1-62a0126a3574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:22.272784 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 701/1411] 10.222.0.39 () {58 vars in 1015 bytes} [Sun Aug 7 01:00:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:00:22.287519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae82c09-2f08-4b49-a58c-98b03c9d9bc6 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:22.287804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae82c09-2f08-4b49-a58c-98b03c9d9bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:22.288110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae82c09-2f08-4b49-a58c-98b03c9d9bc6 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:22.289444 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 711/1412] 10.222.0.39 () {54 vars in 918 bytes} [Sun Aug 7 01:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:22.294320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091f240-aa61-4b07-a803-2b98a6ba9dd0 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:22.294614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091f240-aa61-4b07-a803-2b98a6ba9dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:22.294922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091f240-aa61-4b07-a803-2b98a6ba9dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:22.370601 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:22.373789 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-a091f240-aa61-4b07-a803-2b98a6ba9dd0 None None] MFA Rules not processed for user `6c70d5a72d424db68de7c7b8257fe02c`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:22.375025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a091f240-aa61-4b07-a803-2b98a6ba9dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:22.502218 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 702/1413] 10.222.0.39 () {58 vars in 1015 bytes} [Sun Aug 7 01:00:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:00:25.063304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144dea83-b8b8-4fa5-9046-241353345087 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:25.063967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144dea83-b8b8-4fa5-9046-241353345087 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:25.063967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144dea83-b8b8-4fa5-9046-241353345087 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:25.065213 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 712/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 01:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:25.070982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223bd97-b218-4983-99bf-2f09166c44b1 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:25.071580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223bd97-b218-4983-99bf-2f09166c44b1 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:25.071580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223bd97-b218-4983-99bf-2f09166c44b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:25.151120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b223bd97-b218-4983-99bf-2f09166c44b1 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:25.152236 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b223bd97-b218-4983-99bf-2f09166c44b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:25.213920 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:25.258501 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 703/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 01:00:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:00:25.302836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144dea83-b8b8-4fa5-9046-241353345087 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:25.304564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-144dea83-b8b8-4fa5-9046-241353345087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:25.453824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144dea83-b8b8-4fa5-9046-241353345087 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:25.527564 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:25.573814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8518444-e09e-41da-9ec1-5e3e7bd10d48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:25.574436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8518444-e09e-41da-9ec1-5e3e7bd10d48 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:25.574709 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8518444-e09e-41da-9ec1-5e3e7bd10d48 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:25.574980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8518444-e09e-41da-9ec1-5e3e7bd10d48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:25.576710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e8518444-e09e-41da-9ec1-5e3e7bd10d48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:25.675902 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8518444-e09e-41da-9ec1-5e3e7bd10d48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:25.677543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8518444-e09e-41da-9ec1-5e3e7bd10d48 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:25.698443 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 713/1416] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:00:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:00:26.639686 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324833c7-b559-4cba-9105-0157dc3a85bb None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:26.640483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324833c7-b559-4cba-9105-0157dc3a85bb None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:26.640483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324833c7-b559-4cba-9105-0157dc3a85bb None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:26.641630 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 704/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 01:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:26.647556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c47070-60a6-4a69-a5d5-b5b1fbd703c4 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:26.648076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c47070-60a6-4a69-a5d5-b5b1fbd703c4 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:26.648181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c47070-60a6-4a69-a5d5-b5b1fbd703c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:26.734064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-25c47070-60a6-4a69-a5d5-b5b1fbd703c4 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:26.735264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-25c47070-60a6-4a69-a5d5-b5b1fbd703c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:26.766655 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:26.851397 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 714/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 01:00:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:00:27.030146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324833c7-b559-4cba-9105-0157dc3a85bb None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:27.031668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-324833c7-b559-4cba-9105-0157dc3a85bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:27.209107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324833c7-b559-4cba-9105-0157dc3a85bb None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:27.254336 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:27.330799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e83e3-1c1c-44c5-a2d5-c9041dc21d4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:27.331404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e83e3-1c1c-44c5-a2d5-c9041dc21d4f service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:27.331713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e83e3-1c1c-44c5-a2d5-c9041dc21d4f service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:27.332013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e83e3-1c1c-44c5-a2d5-c9041dc21d4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:27.333613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f68e83e3-1c1c-44c5-a2d5-c9041dc21d4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:27.431548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e83e3-1c1c-44c5-a2d5-c9041dc21d4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:27.433676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e83e3-1c1c-44c5-a2d5-c9041dc21d4f service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:27.459187 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 705/1419] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:00:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:00:28.369514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4f679-eb26-4306-91c9-ece451a8b14f None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:28.370157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4f679-eb26-4306-91c9-ece451a8b14f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:28.370157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4f679-eb26-4306-91c9-ece451a8b14f None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:28.371546 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 715/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 01:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:28.377441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0a0a3-8779-4e79-b2e8-4293eafeac2b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:28.378022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0a0a3-8779-4e79-b2e8-4293eafeac2b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:28.378022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0a0a3-8779-4e79-b2e8-4293eafeac2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:28.438973 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:28.462821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-11c0a0a3-8779-4e79-b2e8-4293eafeac2b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:28.464102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-11c0a0a3-8779-4e79-b2e8-4293eafeac2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:28.563220 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 706/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 01:00:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:00:28.719070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4f679-eb26-4306-91c9-ece451a8b14f None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:28.720604 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-91e4f679-eb26-4306-91c9-ece451a8b14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:28.889351 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4f679-eb26-4306-91c9-ece451a8b14f None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:28.903266 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:29.019323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103c0783-4bd2-4d39-9333-2688933abbdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:29.019983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c0783-4bd2-4d39-9333-2688933abbdd service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:29.020263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c0783-4bd2-4d39-9333-2688933abbdd service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:29.020534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103c0783-4bd2-4d39-9333-2688933abbdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:29.022209 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-103c0783-4bd2-4d39-9333-2688933abbdd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:29.131082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c0783-4bd2-4d39-9333-2688933abbdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:29.133122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103c0783-4bd2-4d39-9333-2688933abbdd service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:29.155561 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 716/1422] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:00:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:00:30.066314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4611a8a-e506-4b43-a616-aee41eae0c2c None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:30.067178 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4611a8a-e506-4b43-a616-aee41eae0c2c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:30.067178 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4611a8a-e506-4b43-a616-aee41eae0c2c None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:30.068340 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 707/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 01:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:00:30.075000 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df598f74-b3f6-4fb4-84e0-f6fd71b5804b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:30.075551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df598f74-b3f6-4fb4-84e0-f6fd71b5804b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:30.075838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df598f74-b3f6-4fb4-84e0-f6fd71b5804b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:30.104185 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:30.174113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-df598f74-b3f6-4fb4-84e0-f6fd71b5804b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:30.175356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-df598f74-b3f6-4fb4-84e0-f6fd71b5804b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:30.294870 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 717/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 01:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:00:30.464039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4611a8a-e506-4b43-a616-aee41eae0c2c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:30.465767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c4611a8a-e506-4b43-a616-aee41eae0c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:30.597966 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:30.639171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4611a8a-e506-4b43-a616-aee41eae0c2c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:30.770144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6a03c-50db-4ab2-ac0c-aa223dab4398 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:30.770144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6a03c-50db-4ab2-ac0c-aa223dab4398 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:30.770144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6a03c-50db-4ab2-ac0c-aa223dab4398 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:30.770144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6a03c-50db-4ab2-ac0c-aa223dab4398 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:30.771043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-52a6a03c-50db-4ab2-ac0c-aa223dab4398 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:30.850837 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:30.869567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6a03c-50db-4ab2-ac0c-aa223dab4398 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:30.872538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6a03c-50db-4ab2-ac0c-aa223dab4398 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:30.890839 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 708/1425] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:00:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:00:31.789574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f252ba-efef-4a66-bf6c-1a505d6b605a None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:31.790174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f252ba-efef-4a66-bf6c-1a505d6b605a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:31.790174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f252ba-efef-4a66-bf6c-1a505d6b605a None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:31.791557 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 718/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 01:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:31.797232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39948f9-87fc-4d27-8839-53394e3b5065 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:31.797729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39948f9-87fc-4d27-8839-53394e3b5065 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:31.797853 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39948f9-87fc-4d27-8839-53394e3b5065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:31.890108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e39948f9-87fc-4d27-8839-53394e3b5065 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:31.891406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e39948f9-87fc-4d27-8839-53394e3b5065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:31.997530 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 709/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 01:00:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:00:32.178128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f252ba-efef-4a66-bf6c-1a505d6b605a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:32.180444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f0f252ba-efef-4a66-bf6c-1a505d6b605a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:32.275280 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:32.339697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f252ba-efef-4a66-bf6c-1a505d6b605a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:32.463650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49025d-e6a3-492f-821a-42bc86f89199 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:32.464332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49025d-e6a3-492f-821a-42bc86f89199 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:32.464709 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49025d-e6a3-492f-821a-42bc86f89199 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:32.465074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49025d-e6a3-492f-821a-42bc86f89199 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:32.466757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-be49025d-e6a3-492f-821a-42bc86f89199 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:32.516319 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:32.559225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49025d-e6a3-492f-821a-42bc86f89199 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:32.560836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49025d-e6a3-492f-821a-42bc86f89199 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:32.580669 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 719/1428] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:00:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:00:33.420590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99e97b-8596-414f-a606-3ef5ec619f92 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:33.421436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99e97b-8596-414f-a606-3ef5ec619f92 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:33.421591 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99e97b-8596-414f-a606-3ef5ec619f92 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:33.423695 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 710/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 01:00:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:00:33.433246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aaee75-8c06-4958-bf2c-26223b1c4e6d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:33.433910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aaee75-8c06-4958-bf2c-26223b1c4e6d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:33.434188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aaee75-8c06-4958-bf2c-26223b1c4e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:33.574122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-34aaee75-8c06-4958-bf2c-26223b1c4e6d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:33.576515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-34aaee75-8c06-4958-bf2c-26223b1c4e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:33.770681 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 720/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 01:00:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:00:33.930271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99e97b-8596-414f-a606-3ef5ec619f92 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:33.931838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8c99e97b-8596-414f-a606-3ef5ec619f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:34.022942 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:34.156440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99e97b-8596-414f-a606-3ef5ec619f92 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:34.352950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3085dcf-1c61-46f4-bf52-6323d4d0b5ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:34.354513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3085dcf-1c61-46f4-bf52-6323d4d0b5ec service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:34.355043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3085dcf-1c61-46f4-bf52-6323d4d0b5ec service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:34.355545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3085dcf-1c61-46f4-bf52-6323d4d0b5ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:34.357429 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e3085dcf-1c61-46f4-bf52-6323d4d0b5ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:34.365523 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:34.468519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3085dcf-1c61-46f4-bf52-6323d4d0b5ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:34.470594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3085dcf-1c61-46f4-bf52-6323d4d0b5ec service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:34.494638 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 711/1431] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:00:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:00:35.372411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1bf16-3c60-41de-bdc5-e3c97239bfe2 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:35.373147 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1bf16-3c60-41de-bdc5-e3c97239bfe2 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:35.373147 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1bf16-3c60-41de-bdc5-e3c97239bfe2 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:35.374301 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 721/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 01:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:35.380308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cac44-18c1-4107-98a4-e016d53ef8d5 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:35.380708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cac44-18c1-4107-98a4-e016d53ef8d5 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:35.381089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cac44-18c1-4107-98a4-e016d53ef8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:35.470601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-8b9cac44-18c1-4107-98a4-e016d53ef8d5 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:35.472345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8b9cac44-18c1-4107-98a4-e016d53ef8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:35.549772 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:35.585865 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 712/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 01:00:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:00:35.860833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1bf16-3c60-41de-bdc5-e3c97239bfe2 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:35.862351 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6ba1bf16-3c60-41de-bdc5-e3c97239bfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:35.880686 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:36.045502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1bf16-3c60-41de-bdc5-e3c97239bfe2 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:36.154926 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:36.182726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec7cbf4-d29a-4c60-a7de-d0ad7bc3dd4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:36.183736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7cbf4-d29a-4c60-a7de-d0ad7bc3dd4b service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:36.184121 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7cbf4-d29a-4c60-a7de-d0ad7bc3dd4b service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:36.184391 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec7cbf4-d29a-4c60-a7de-d0ad7bc3dd4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:36.186093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6ec7cbf4-d29a-4c60-a7de-d0ad7bc3dd4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:36.281878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec7cbf4-d29a-4c60-a7de-d0ad7bc3dd4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:36.283483 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec7cbf4-d29a-4c60-a7de-d0ad7bc3dd4b service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:36.307185 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 722/1434] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:00:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:00:37.167380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fef60-fb3d-4bd6-a22c-515559103dff None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:37.168300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fef60-fb3d-4bd6-a22c-515559103dff None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:37.168300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fef60-fb3d-4bd6-a22c-515559103dff None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:37.169920 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 713/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 01:00:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:37.176400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0229c3-0bb2-48d6-9478-8ff591d3a3c6 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:37.176972 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0229c3-0bb2-48d6-9478-8ff591d3a3c6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:37.176972 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0229c3-0bb2-48d6-9478-8ff591d3a3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:37.262628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ab0229c3-0bb2-48d6-9478-8ff591d3a3c6 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:37.263838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ab0229c3-0bb2-48d6-9478-8ff591d3a3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:37.310899 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:37.365125 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 723/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 01:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:00:37.519726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fef60-fb3d-4bd6-a22c-515559103dff None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:37.521194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f99fef60-fb3d-4bd6-a22c-515559103dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:37.678301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fef60-fb3d-4bd6-a22c-515559103dff None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:37.742221 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:37.808510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eeacea-ec04-4616-9a19-73ba759367c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:37.809034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eeacea-ec04-4616-9a19-73ba759367c7 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:37.809312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eeacea-ec04-4616-9a19-73ba759367c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:37.809587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eeacea-ec04-4616-9a19-73ba759367c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:37.811253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f8eeacea-ec04-4616-9a19-73ba759367c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:37.918858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eeacea-ec04-4616-9a19-73ba759367c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:37.920514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eeacea-ec04-4616-9a19-73ba759367c7 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:37.940009 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 714/1437] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:00:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:00:38.761425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112cbdc-4644-496c-b091-6667dd1c93dd None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:38.762006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112cbdc-4644-496c-b091-6667dd1c93dd None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:38.762006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112cbdc-4644-496c-b091-6667dd1c93dd None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:38.763300 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 724/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 01:00:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:38.768681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d6631-35d4-4c0f-ae3a-ed3c37a3b469 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:38.769188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d6631-35d4-4c0f-ae3a-ed3c37a3b469 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:38.769574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d6631-35d4-4c0f-ae3a-ed3c37a3b469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:38.859028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b28d6631-35d4-4c0f-ae3a-ed3c37a3b469 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:38.860293 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b28d6631-35d4-4c0f-ae3a-ed3c37a3b469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:38.862493 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:38.968805 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 715/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 01:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:00:39.123195 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112cbdc-4644-496c-b091-6667dd1c93dd None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:39.124932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b112cbdc-4644-496c-b091-6667dd1c93dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:39.276384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112cbdc-4644-496c-b091-6667dd1c93dd None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:39.308093 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:39.437915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c349dbd-ca69-4fe8-b3ec-437bb2bdeed9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:39.438519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c349dbd-ca69-4fe8-b3ec-437bb2bdeed9 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:39.438795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c349dbd-ca69-4fe8-b3ec-437bb2bdeed9 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:39.439062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c349dbd-ca69-4fe8-b3ec-437bb2bdeed9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:39.440688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7c349dbd-ca69-4fe8-b3ec-437bb2bdeed9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:39.535212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c349dbd-ca69-4fe8-b3ec-437bb2bdeed9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:39.536800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c349dbd-ca69-4fe8-b3ec-437bb2bdeed9 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:39.555554 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 725/1440] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:00:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:00:41.525684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023848c-5465-4def-a561-1d43ea6d4cf3 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:41.526882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023848c-5465-4def-a561-1d43ea6d4cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:41.526882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023848c-5465-4def-a561-1d43ea6d4cf3 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:41.528127 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 716/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 01:00:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:41.533652 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12bc4f-7b13-400e-be87-204c76171c70 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:41.534127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12bc4f-7b13-400e-be87-204c76171c70 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:41.534245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12bc4f-7b13-400e-be87-204c76171c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:41.575814 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:41.602017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5b12bc4f-7b13-400e-be87-204c76171c70 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:41.603217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5b12bc4f-7b13-400e-be87-204c76171c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:41.704040 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 726/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 01:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:00:41.738990 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023848c-5465-4def-a561-1d43ea6d4cf3 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:41.740618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c023848c-5465-4def-a561-1d43ea6d4cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:41.851588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023848c-5465-4def-a561-1d43ea6d4cf3 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:41.883912 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:41.926005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76605627-1bd7-4289-a18a-3e8d539fa14a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:41.926617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76605627-1bd7-4289-a18a-3e8d539fa14a service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:41.926898 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76605627-1bd7-4289-a18a-3e8d539fa14a service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:41.927170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76605627-1bd7-4289-a18a-3e8d539fa14a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:41.928879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-76605627-1bd7-4289-a18a-3e8d539fa14a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:42.039707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76605627-1bd7-4289-a18a-3e8d539fa14a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:42.041269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76605627-1bd7-4289-a18a-3e8d539fa14a service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:42.059190 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 717/1443] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:00:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:00:44.305490 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19694589-ebe3-4647-a112-15cb6e13165a None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:44.306050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19694589-ebe3-4647-a112-15cb6e13165a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:44.306050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19694589-ebe3-4647-a112-15cb6e13165a None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:44.307288 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 727/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 01:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:44.312942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fc143-03af-4d18-a9e6-d5f91a04a21f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:44.313511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fc143-03af-4d18-a9e6-d5f91a04a21f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:44.313511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fc143-03af-4d18-a9e6-d5f91a04a21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:44.408935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-423fc143-03af-4d18-a9e6-d5f91a04a21f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:44.411215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-423fc143-03af-4d18-a9e6-d5f91a04a21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:44.436106 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:44.590394 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 718/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 01:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:00:44.630492 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19694589-ebe3-4647-a112-15cb6e13165a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:44.632128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-19694589-ebe3-4647-a112-15cb6e13165a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:44.739038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19694589-ebe3-4647-a112-15cb6e13165a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:44.752055 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:44.821274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cb77b-4870-4fa9-a9e6-678136b257df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:44.821889 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cb77b-4870-4fa9-a9e6-678136b257df service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:44.822164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cb77b-4870-4fa9-a9e6-678136b257df service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:44.822433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cb77b-4870-4fa9-a9e6-678136b257df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:44.824191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-493cb77b-4870-4fa9-a9e6-678136b257df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:44.946154 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493cb77b-4870-4fa9-a9e6-678136b257df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:44.947509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493cb77b-4870-4fa9-a9e6-678136b257df service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:44.968069 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 728/1446] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:00:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:00:47.609553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8c29d-d9e6-45f5-bffa-46f3226ed416 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:47.610148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8c29d-d9e6-45f5-bffa-46f3226ed416 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:47.610148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8c29d-d9e6-45f5-bffa-46f3226ed416 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:47.611456 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 719/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 01:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:00:47.617574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b30c9-4f88-4a15-9c83-bdd8679d272e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:47.618193 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b30c9-4f88-4a15-9c83-bdd8679d272e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:47.618193 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b30c9-4f88-4a15-9c83-bdd8679d272e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:47.672417 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:47.692405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-588b30c9-4f88-4a15-9c83-bdd8679d272e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:47.693632 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-588b30c9-4f88-4a15-9c83-bdd8679d272e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:47.799029 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 729/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 01:00:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:00:47.840983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8c29d-d9e6-45f5-bffa-46f3226ed416 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:47.842779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b0b8c29d-d9e6-45f5-bffa-46f3226ed416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:47.968908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8c29d-d9e6-45f5-bffa-46f3226ed416 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:48.016132 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:48.056604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8d8bf-1123-4a88-9909-bf3dcfa6d978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:48.057209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8d8bf-1123-4a88-9909-bf3dcfa6d978 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:48.058211 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8d8bf-1123-4a88-9909-bf3dcfa6d978 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:48.058486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8d8bf-1123-4a88-9909-bf3dcfa6d978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:48.060164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b4e8d8bf-1123-4a88-9909-bf3dcfa6d978 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:48.194445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8d8bf-1123-4a88-9909-bf3dcfa6d978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:48.195928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8d8bf-1123-4a88-9909-bf3dcfa6d978 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:48.218706 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 720/1449] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:00:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:00:51.170141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08d991-e007-4ac7-b649-8273917764e1 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:51.170917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08d991-e007-4ac7-b649-8273917764e1 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:51.171386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08d991-e007-4ac7-b649-8273917764e1 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:51.173970 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 730/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 01:00:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:51.183496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d716524-3914-4dea-860a-b6581ff1b422 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:51.184160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d716524-3914-4dea-860a-b6581ff1b422 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:51.184512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d716524-3914-4dea-860a-b6581ff1b422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:51.297914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-5d716524-3914-4dea-860a-b6581ff1b422 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:51.300007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5d716524-3914-4dea-860a-b6581ff1b422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:51.347913 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:51.489208 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 721/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 01:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:00:51.541969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08d991-e007-4ac7-b649-8273917764e1 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:51.544134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6b08d991-e007-4ac7-b649-8273917764e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:51.660827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08d991-e007-4ac7-b649-8273917764e1 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:51.686620 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:51.771023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75018e43-5ec9-47f6-a1d1-2a3712106478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:51.772110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75018e43-5ec9-47f6-a1d1-2a3712106478 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:51.772597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75018e43-5ec9-47f6-a1d1-2a3712106478 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:51.773036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75018e43-5ec9-47f6-a1d1-2a3712106478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:51.776163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-75018e43-5ec9-47f6-a1d1-2a3712106478 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:51.982836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75018e43-5ec9-47f6-a1d1-2a3712106478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:51.985581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75018e43-5ec9-47f6-a1d1-2a3712106478 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:52.022346 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 731/1452] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:00:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:00:54.657171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635c54c-e9c9-4eec-a0ec-dca9c6818dc3 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:54.657759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635c54c-e9c9-4eec-a0ec-dca9c6818dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:54.657759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635c54c-e9c9-4eec-a0ec-dca9c6818dc3 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:54.659121 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 722/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 01:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:54.664978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f4737-3612-4a79-8f19-9e61b2f23273 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:54.665759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f4737-3612-4a79-8f19-9e61b2f23273 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:54.665759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f4737-3612-4a79-8f19-9e61b2f23273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:54.744528 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:54.747506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e67f4737-3612-4a79-8f19-9e61b2f23273 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:54.749381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e67f4737-3612-4a79-8f19-9e61b2f23273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:54.850616 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 732/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 01:00:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:00:54.890559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635c54c-e9c9-4eec-a0ec-dca9c6818dc3 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:54.892166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2635c54c-e9c9-4eec-a0ec-dca9c6818dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:55.002985 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635c54c-e9c9-4eec-a0ec-dca9c6818dc3 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:55.066506 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:55.096638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd33927f-adc7-4153-a93a-ac54a3498b69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:55.097260 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33927f-adc7-4153-a93a-ac54a3498b69 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:55.097530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33927f-adc7-4153-a93a-ac54a3498b69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:55.097793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd33927f-adc7-4153-a93a-ac54a3498b69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:55.099520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bd33927f-adc7-4153-a93a-ac54a3498b69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:55.219444 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33927f-adc7-4153-a93a-ac54a3498b69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:55.221027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd33927f-adc7-4153-a93a-ac54a3498b69 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:55.242101 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 723/1455] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:00:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:00:57.416281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea5cdd-efe7-4046-8755-a532139ca4a8 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:57.416873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea5cdd-efe7-4046-8755-a532139ca4a8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:57.416873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea5cdd-efe7-4046-8755-a532139ca4a8 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:57.418559 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 733/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 01:00:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:00:57.424415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a5eb9-6892-4516-89d4-fe84e96c7e70 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:57.424954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a5eb9-6892-4516-89d4-fe84e96c7e70 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:57.424954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a5eb9-6892-4516-89d4-fe84e96c7e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:57.492992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-206a5eb9-6892-4516-89d4-fe84e96c7e70 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:00:57.494215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-206a5eb9-6892-4516-89d4-fe84e96c7e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:57.524773 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:57.596196 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 724/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 01:00:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:00:57.644307 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea5cdd-efe7-4046-8755-a532139ca4a8 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:00:57.644307 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9dea5cdd-efe7-4046-8755-a532139ca4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:57.770020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea5cdd-efe7-4046-8755-a532139ca4a8 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:00:57.803404 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:00:57.851478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4c4e2-fff3-4d21-b389-9c17456199f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:00:57.852137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4c4e2-fff3-4d21-b389-9c17456199f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:00:57.852473 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4c4e2-fff3-4d21-b389-9c17456199f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:00:57.852679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4c4e2-fff3-4d21-b389-9c17456199f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:00:57.854280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-38c4c4e2-fff3-4d21-b389-9c17456199f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:00:57.975409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c4c4e2-fff3-4d21-b389-9c17456199f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:00:57.977275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c4c4e2-fff3-4d21-b389-9c17456199f3 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:00:57.999135 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 734/1458] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:00:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:01:00.190809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971778cd-0280-4db0-aaca-e66eeb2c71e8 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:00.191380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971778cd-0280-4db0-aaca-e66eeb2c71e8 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:00.191380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971778cd-0280-4db0-aaca-e66eeb2c71e8 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:00.192717 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 725/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 01:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:01:00.198421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c81f84-9360-4c79-9af4-8874ab08b3b3 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:00.199475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c81f84-9360-4c79-9af4-8874ab08b3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:00.199475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c81f84-9360-4c79-9af4-8874ab08b3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:00.304267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-67c81f84-9360-4c79-9af4-8874ab08b3b3 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:01:00.306251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-67c81f84-9360-4c79-9af4-8874ab08b3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:00.322779 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:01:00.445126 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 735/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 01:01:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:01:00.484685 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971778cd-0280-4db0-aaca-e66eeb2c71e8 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:01:00.486236 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-971778cd-0280-4db0-aaca-e66eeb2c71e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:00.616474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971778cd-0280-4db0-aaca-e66eeb2c71e8 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:01:00.679063 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:01:00.700140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de19b20-1474-48d3-8cf4-9758f64e758c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:01:00.700902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de19b20-1474-48d3-8cf4-9758f64e758c service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:00.701222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de19b20-1474-48d3-8cf4-9758f64e758c service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:00.701538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de19b20-1474-48d3-8cf4-9758f64e758c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:00.703383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8de19b20-1474-48d3-8cf4-9758f64e758c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:00.841163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de19b20-1474-48d3-8cf4-9758f64e758c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:01:00.842615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de19b20-1474-48d3-8cf4-9758f64e758c service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:01:00.864244 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 726/1461] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:01:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:01:03.974757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0522b4-0afd-4dd6-a9f3-4fa6fdd0a472 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:03.975688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0522b4-0afd-4dd6-a9f3-4fa6fdd0a472 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:03.975688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0522b4-0afd-4dd6-a9f3-4fa6fdd0a472 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:03.977420 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 736/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 01:01:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:01:03.986273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ae3a0-870f-4612-aa93-ff4812c40aa7 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:03.986941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ae3a0-870f-4612-aa93-ff4812c40aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:03.986941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ae3a0-870f-4612-aa93-ff4812c40aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:04.070735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-490ae3a0-870f-4612-aa93-ff4812c40aa7 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:01:04.072235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-490ae3a0-870f-4612-aa93-ff4812c40aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:04.119489 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:01:04.235290 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 727/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 01:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:01:04.282712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0522b4-0afd-4dd6-a9f3-4fa6fdd0a472 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:01:04.284401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6d0522b4-0afd-4dd6-a9f3-4fa6fdd0a472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:04.437345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0522b4-0afd-4dd6-a9f3-4fa6fdd0a472 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:01:04.514245 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:01:04.584127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e26446-9cf3-41ac-a4ed-11fc306e0f83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:01:04.585154 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e26446-9cf3-41ac-a4ed-11fc306e0f83 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:04.585661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e26446-9cf3-41ac-a4ed-11fc306e0f83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:04.586129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e26446-9cf3-41ac-a4ed-11fc306e0f83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:04.589846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-79e26446-9cf3-41ac-a4ed-11fc306e0f83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:04.768604 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e26446-9cf3-41ac-a4ed-11fc306e0f83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:01:04.771226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e26446-9cf3-41ac-a4ed-11fc306e0f83 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:01:04.802501 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 737/1464] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:01:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:01:07.625386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08a37f-cd61-4c34-9dbd-83c22c9dcd57 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:07.626261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08a37f-cd61-4c34-9dbd-83c22c9dcd57 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:07.626466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08a37f-cd61-4c34-9dbd-83c22c9dcd57 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:07.628762 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 728/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 01:01:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:01:07.639539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424180a1-6982-49bd-8de7-8012f91eae9f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:07.640609 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424180a1-6982-49bd-8de7-8012f91eae9f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:07.640609 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424180a1-6982-49bd-8de7-8012f91eae9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:07.778475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-424180a1-6982-49bd-8de7-8012f91eae9f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:01:07.780565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-424180a1-6982-49bd-8de7-8012f91eae9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:07.833996 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:01:07.999219 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 738/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 01:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:01:08.068910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08a37f-cd61-4c34-9dbd-83c22c9dcd57 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:01:08.071651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9a08a37f-cd61-4c34-9dbd-83c22c9dcd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:08.293557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08a37f-cd61-4c34-9dbd-83c22c9dcd57 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:01:08.429055 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:01:08.443652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd13ffa-dbfb-4515-b92a-c6f362bcb171 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:01:08.444752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd13ffa-dbfb-4515-b92a-c6f362bcb171 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:08.445248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd13ffa-dbfb-4515-b92a-c6f362bcb171 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:08.445716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd13ffa-dbfb-4515-b92a-c6f362bcb171 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:08.449545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8bd13ffa-dbfb-4515-b92a-c6f362bcb171 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:08.670866 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd13ffa-dbfb-4515-b92a-c6f362bcb171 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:01:08.673727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd13ffa-dbfb-4515-b92a-c6f362bcb171 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:01:08.711233 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 729/1467] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:01:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:01:12.087553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8da196-eef5-4e24-b10d-c506c4c820ef None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:12.088440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8da196-eef5-4e24-b10d-c506c4c820ef None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:12.088611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8da196-eef5-4e24-b10d-c506c4c820ef None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:12.091764 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 739/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 01:01:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:01:12.100935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8daa272-9b15-45e8-b6dc-d0c68d86b0bb None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:12.101765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8daa272-9b15-45e8-b6dc-d0c68d86b0bb None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:12.101911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8daa272-9b15-45e8-b6dc-d0c68d86b0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:12.251828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c8daa272-9b15-45e8-b6dc-d0c68d86b0bb None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:01:12.253882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c8daa272-9b15-45e8-b6dc-d0c68d86b0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:12.352244 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:01:12.439776 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 730/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 01:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:01:12.489801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8da196-eef5-4e24-b10d-c506c4c820ef None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:01:12.491409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ca8da196-eef5-4e24-b10d-c506c4c820ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:12.648296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8da196-eef5-4e24-b10d-c506c4c820ef None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:01:12.740040 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:01:12.776609 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc030f9-70db-45c2-ab3a-2b36e3135d07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:01:12.777374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc030f9-70db-45c2-ab3a-2b36e3135d07 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:12.777690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc030f9-70db-45c2-ab3a-2b36e3135d07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:12.778129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc030f9-70db-45c2-ab3a-2b36e3135d07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:12.780067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-adc030f9-70db-45c2-ab3a-2b36e3135d07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:12.970373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc030f9-70db-45c2-ab3a-2b36e3135d07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:01:12.971926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc030f9-70db-45c2-ab3a-2b36e3135d07 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:01:12.999590 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 740/1470] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:01:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:01:22.436388 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=22 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:01:22.996892 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=66 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:01:40.381867 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddf95c-6216-4453-a5b8-c72d2130ae4a None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:40.382841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddf95c-6216-4453-a5b8-c72d2130ae4a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:40.382841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddf95c-6216-4453-a5b8-c72d2130ae4a None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:40.384189 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 731/1471] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 01:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:01:40.390948 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead28ea-74d7-441e-a4a1-39c2ba7d3e64 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:40.391815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead28ea-74d7-441e-a4a1-39c2ba7d3e64 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:40.391815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead28ea-74d7-441e-a4a1-39c2ba7d3e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:40.486253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5ead28ea-74d7-441e-a4a1-39c2ba7d3e64 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:01:40.487627 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5ead28ea-74d7-441e-a4a1-39c2ba7d3e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:40.615854 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 741/1472] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 01:01:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:01:40.712127 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f97fa-90eb-4a87-89e1-d122ad8ff9a8 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:40.712449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f97fa-90eb-4a87-89e1-d122ad8ff9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:40.712749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f97fa-90eb-4a87-89e1-d122ad8ff9a8 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:40.714151 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 732/1473] 10.222.0.39 () {54 vars in 966 bytes} [Sun Aug 7 01:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:01:40.720836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee43bbf-d84f-453d-a4d2-ced0bff29852 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:40.721169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee43bbf-d84f-453d-a4d2-ced0bff29852 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:40.721491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee43bbf-d84f-453d-a4d2-ced0bff29852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:40.815723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6ee43bbf-d84f-453d-a4d2-ced0bff29852 None None] MFA Rules not processed for user `bcb60ac015204436b81971694393380c`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:01:40.817922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6ee43bbf-d84f-453d-a4d2-ced0bff29852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:40.857522 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:01:40.948576 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 742/1474] 10.222.0.39 () {58 vars in 1063 bytes} [Sun Aug 7 01:01:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:01:40.965229 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f97fa-90eb-4a87-89e1-d122ad8ff9a8 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:01:40.968508 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-da7f97fa-90eb-4a87-89e1-d122ad8ff9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:41.210807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f97fa-90eb-4a87-89e1-d122ad8ff9a8 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:01:41.358535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30511f5d-4157-48de-9355-48217a12f13d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:01:41.359556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30511f5d-4157-48de-9355-48217a12f13d service glance] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:41.360070 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30511f5d-4157-48de-9355-48217a12f13d service glance] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:41.360536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30511f5d-4157-48de-9355-48217a12f13d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:41.363528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-30511f5d-4157-48de-9355-48217a12f13d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:41.471604 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:01:41.585399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30511f5d-4157-48de-9355-48217a12f13d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:01:41.588252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30511f5d-4157-48de-9355-48217a12f13d service glance] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:01:41.627251 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 733/1475] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:01:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:01:44.298982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae01852-da14-4f7c-b12d-f4aabed74b40 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:44.299686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae01852-da14-4f7c-b12d-f4aabed74b40 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:44.299686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae01852-da14-4f7c-b12d-f4aabed74b40 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:44.301022 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 743/1476] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 01:01:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:01:44.309983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176aff66-ad9d-4ab9-8ab1-d403780f3775 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:44.310550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176aff66-ad9d-4ab9-8ab1-d403780f3775 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:44.310715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176aff66-ad9d-4ab9-8ab1-d403780f3775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:44.405442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-176aff66-ad9d-4ab9-8ab1-d403780f3775 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:01:44.406767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-176aff66-ad9d-4ab9-8ab1-d403780f3775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:44.545473 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 734/1477] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 01:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:01:44.570749 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae01852-da14-4f7c-b12d-f4aabed74b40 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:01:44.572350 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6ae01852-da14-4f7c-b12d-f4aabed74b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:44.763218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae01852-da14-4f7c-b12d-f4aabed74b40 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:01:44.845969 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:01:44.934687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec667eae-bf15-4852-9111-8de37dc3e8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:01:44.935667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec667eae-bf15-4852-9111-8de37dc3e8aa admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:44.936159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec667eae-bf15-4852-9111-8de37dc3e8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:44.936596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec667eae-bf15-4852-9111-8de37dc3e8aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:44.937732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec667eae-bf15-4852-9111-8de37dc3e8aa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:01:44.940880 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-ec667eae-bf15-4852-9111-8de37dc3e8aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:01:44.940880 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:01:44.940880 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:01:44.943004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec667eae-bf15-4852-9111-8de37dc3e8aa admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:01:44.979960 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 744/1478] 10.222.0.39 () {56 vars in 1108 bytes} [Sun Aug 7 01:01:44 2022] GET /identity/v3/projects => generated 2553 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:01:47.545890 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d93e1e-0555-4ae4-a83c-1595fbdae418 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:47.546732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d93e1e-0555-4ae4-a83c-1595fbdae418 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:47.546732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d93e1e-0555-4ae4-a83c-1595fbdae418 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:47.548693 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 735/1479] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 01:01:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:01:47.557415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9ac54-58ce-4165-8300-e6770cffb952 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:47.558214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9ac54-58ce-4165-8300-e6770cffb952 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:47.558377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9ac54-58ce-4165-8300-e6770cffb952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:47.675181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5eb9ac54-58ce-4165-8300-e6770cffb952 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:01:47.677318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5eb9ac54-58ce-4165-8300-e6770cffb952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:47.862611 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 745/1480] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 01:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:01:47.921848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d93e1e-0555-4ae4-a83c-1595fbdae418 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:01:47.923779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e5d93e1e-0555-4ae4-a83c-1595fbdae418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:47.937884 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:01:48.176379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d93e1e-0555-4ae4-a83c-1595fbdae418 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:01:48.315080 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:01:48.382354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5338f-1d00-4c3f-b730-c9ceff140c13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:01:48.383395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5338f-1d00-4c3f-b730-c9ceff140c13 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:48.383875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5338f-1d00-4c3f-b730-c9ceff140c13 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:48.384391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5338f-1d00-4c3f-b730-c9ceff140c13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:48.388347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-aec5338f-1d00-4c3f-b730-c9ceff140c13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:48.520878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5338f-1d00-4c3f-b730-c9ceff140c13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:01:48.522534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5338f-1d00-4c3f-b730-c9ceff140c13 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:01:48.547210 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 736/1481] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:01:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:01:51.031429 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfaf028-989b-4cca-932c-a4270dc4a8d6 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:51.032361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfaf028-989b-4cca-932c-a4270dc4a8d6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:51.032361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfaf028-989b-4cca-932c-a4270dc4a8d6 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:51.033933 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 746/1482] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 01:01:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:01:51.042564 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71aa75-d616-45c0-b98b-3544e16d0d87 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:51.043235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71aa75-d616-45c0-b98b-3544e16d0d87 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:51.043474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71aa75-d616-45c0-b98b-3544e16d0d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:51.174346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2b71aa75-d616-45c0-b98b-3544e16d0d87 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:01:51.175948 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2b71aa75-d616-45c0-b98b-3544e16d0d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:51.270617 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:01:51.340079 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 737/1483] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 01:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:01:51.402078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfaf028-989b-4cca-932c-a4270dc4a8d6 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:01:51.404649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5bfaf028-989b-4cca-932c-a4270dc4a8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:51.438697 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:01:51.592003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfaf028-989b-4cca-932c-a4270dc4a8d6 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:01:51.723090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042e65c-b638-4b4a-bafd-168987955c4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:01:51.724146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042e65c-b638-4b4a-bafd-168987955c4b service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:51.724640 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042e65c-b638-4b4a-bafd-168987955c4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:51.725117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042e65c-b638-4b4a-bafd-168987955c4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:51.728268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d042e65c-b638-4b4a-bafd-168987955c4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:51.836085 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:01:51.880490 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042e65c-b638-4b4a-bafd-168987955c4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:01:51.882022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042e65c-b638-4b4a-bafd-168987955c4b service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:01:51.910589 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 747/1484] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:01:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:01:54.180882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d646489-3772-4db9-9fb0-85ccf5b47808 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:54.181476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d646489-3772-4db9-9fb0-85ccf5b47808 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:54.181476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d646489-3772-4db9-9fb0-85ccf5b47808 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:54.182916 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 738/1485] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 01:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:01:54.189880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86770991-3d50-445a-98f4-8c50b97bf6bd None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:54.190559 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86770991-3d50-445a-98f4-8c50b97bf6bd None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:54.190559 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86770991-3d50-445a-98f4-8c50b97bf6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:54.274836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-86770991-3d50-445a-98f4-8c50b97bf6bd None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:01:54.276164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-86770991-3d50-445a-98f4-8c50b97bf6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:54.412773 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 748/1486] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 01:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:01:54.483269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d646489-3772-4db9-9fb0-85ccf5b47808 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:01:54.484977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8d646489-3772-4db9-9fb0-85ccf5b47808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:54.632748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d646489-3772-4db9-9fb0-85ccf5b47808 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:01:54.759709 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:01:54.763776 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f2c1c-ae2b-48d8-b3ef-5d8e121e0f00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:01:54.765099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f2c1c-ae2b-48d8-b3ef-5d8e121e0f00 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:54.765830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f2c1c-ae2b-48d8-b3ef-5d8e121e0f00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:54.766336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f2c1c-ae2b-48d8-b3ef-5d8e121e0f00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:54.769742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-172f2c1c-ae2b-48d8-b3ef-5d8e121e0f00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:54.984614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f2c1c-ae2b-48d8-b3ef-5d8e121e0f00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:01:54.987499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f2c1c-ae2b-48d8-b3ef-5d8e121e0f00 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:01:55.025706 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 739/1487] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:01:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:01:58.142582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53805bf0-a72c-4f45-953e-8473a8cc615a None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:58.143544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53805bf0-a72c-4f45-953e-8473a8cc615a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:58.143544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53805bf0-a72c-4f45-953e-8473a8cc615a None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:58.145968 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 749/1488] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 01:01:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:01:58.155437 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932258e-506f-411d-9c31-7bbe5fd99a5d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:58.156445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932258e-506f-411d-9c31-7bbe5fd99a5d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:58.156445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932258e-506f-411d-9c31-7bbe5fd99a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:58.282358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c932258e-506f-411d-9c31-7bbe5fd99a5d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:01:58.284556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c932258e-506f-411d-9c31-7bbe5fd99a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:58.392037 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:01:58.475925 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 740/1489] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 01:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:01:58.524402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53805bf0-a72c-4f45-953e-8473a8cc615a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:01:58.526279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-53805bf0-a72c-4f45-953e-8473a8cc615a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:58.591691 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:01:58.727369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53805bf0-a72c-4f45-953e-8473a8cc615a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:01:58.838562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c6804-dc82-4050-becb-a5764816d547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:01:58.839276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c6804-dc82-4050-becb-a5764816d547 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:01:58.840174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c6804-dc82-4050-becb-a5764816d547 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:01:58.840499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c6804-dc82-4050-becb-a5764816d547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:01:58.842371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-998c6804-dc82-4050-becb-a5764816d547 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:01:58.975313 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:01:59.026809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c6804-dc82-4050-becb-a5764816d547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:01:59.029717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c6804-dc82-4050-becb-a5764816d547 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:01:59.063163 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 750/1490] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:01:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:02:02.298663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d3ec7-ab51-4911-b0cd-a3807b74f44c None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:02.299553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d3ec7-ab51-4911-b0cd-a3807b74f44c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:02.299553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d3ec7-ab51-4911-b0cd-a3807b74f44c None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:02.301972 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 741/1491] 10.222.0.39 () {54 vars in 927 bytes} [Sun Aug 7 01:02:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:02:02.312005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127390a-d95c-455d-8221-08121ed08513 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:02.312564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127390a-d95c-455d-8221-08121ed08513 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:02.312963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127390a-d95c-455d-8221-08121ed08513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:02.435966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1127390a-d95c-455d-8221-08121ed08513 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:02:02.438061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1127390a-d95c-455d-8221-08121ed08513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:02.580141 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 751/1492] 10.222.0.39 () {58 vars in 1024 bytes} [Sun Aug 7 01:02:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:02:02.635751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d3ec7-ab51-4911-b0cd-a3807b74f44c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:02:02.638923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a18d3ec7-ab51-4911-b0cd-a3807b74f44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:02.795016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d3ec7-ab51-4911-b0cd-a3807b74f44c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:02:02.915827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30d0b0-52b4-467a-90ed-e524562f4a73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:02:02.916376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30d0b0-52b4-467a-90ed-e524562f4a73 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:02:02.916699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30d0b0-52b4-467a-90ed-e524562f4a73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:02:02.916981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30d0b0-52b4-467a-90ed-e524562f4a73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:02:02.919601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cb30d0b0-52b4-467a-90ed-e524562f4a73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:02:03.062528 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:03.188819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30d0b0-52b4-467a-90ed-e524562f4a73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:02:03.191006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30d0b0-52b4-467a-90ed-e524562f4a73 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:02:03.228807 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 742/1493] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:02:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:02:12.576458 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=82 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:02:13.225506 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=50 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:03:55.995247 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111f168-ebcc-42f6-9bcb-153a7e15ba66 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:55.996121 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111f168-ebcc-42f6-9bcb-153a7e15ba66 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:55.996121 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111f168-ebcc-42f6-9bcb-153a7e15ba66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:56.106454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f111f168-ebcc-42f6-9bcb-153a7e15ba66 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:03:56.107809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f111f168-ebcc-42f6-9bcb-153a7e15ba66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:56.238562 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 752/1494] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:03:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:03:56.247222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804212c-f0a7-49e2-8d89-4ac415522587 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:56.247813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804212c-f0a7-49e2-8d89-4ac415522587 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:56.247813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804212c-f0a7-49e2-8d89-4ac415522587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:56.271253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-a804212c-f0a7-49e2-8d89-4ac415522587 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:03:56.272519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a804212c-f0a7-49e2-8d89-4ac415522587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:56.282431 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 743/1495] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:03:56.287872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111f168-ebcc-42f6-9bcb-153a7e15ba66 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:56.299296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111f168-ebcc-42f6-9bcb-153a7e15ba66 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:56.304184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b19e9-968a-4f43-a794-9f5511bcdc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:56.304796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b19e9-968a-4f43-a794-9f5511bcdc7c admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:56.305077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b19e9-968a-4f43-a794-9f5511bcdc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:56.305332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b19e9-968a-4f43-a794-9f5511bcdc7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:56.305984 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b19e9-968a-4f43-a794-9f5511bcdc7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:03:56.306287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b19e9-968a-4f43-a794-9f5511bcdc7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:56.307496 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-bd0b19e9-968a-4f43-a794-9f5511bcdc7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:03:56.307496 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:03:56.307496 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:03:56.308421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0b19e9-968a-4f43-a794-9f5511bcdc7c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:56.321124 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 753/1496] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:03:56.330166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804212c-f0a7-49e2-8d89-4ac415522587 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:56.341003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804212c-f0a7-49e2-8d89-4ac415522587 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:56.346309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676d8c1-325a-4545-b33f-bab2511e8fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:56.346922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676d8c1-325a-4545-b33f-bab2511e8fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:56.347196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676d8c1-325a-4545-b33f-bab2511e8fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:56.347478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6676d8c1-325a-4545-b33f-bab2511e8fb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:56.348151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6676d8c1-325a-4545-b33f-bab2511e8fb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:56.349906 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-6676d8c1-325a-4545-b33f-bab2511e8fb1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:03:56.349906 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:03:56.349906 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:03:56.351119 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6676d8c1-325a-4545-b33f-bab2511e8fb1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:56.395962 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 744/1497] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:03:56 2022] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:03:56.399738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b19e9-968a-4f43-a794-9f5511bcdc7c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:56.412474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b19e9-968a-4f43-a794-9f5511bcdc7c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:56.471156 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:03:56.478406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55e9fb-54d6-4654-a935-2b2723c5cb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:56.479057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55e9fb-54d6-4654-a935-2b2723c5cb84 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:56.479332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55e9fb-54d6-4654-a935-2b2723c5cb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:56.479601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55e9fb-54d6-4654-a935-2b2723c5cb84 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:56.480270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55e9fb-54d6-4654-a935-2b2723c5cb84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:56.481294 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-4b55e9fb-54d6-4654-a935-2b2723c5cb84 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:03:56.481294 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:03:56.481294 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:03:56.482492 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55e9fb-54d6-4654-a935-2b2723c5cb84 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:56.504496 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 754/1498] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:03:56 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:03:56.508833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676d8c1-325a-4545-b33f-bab2511e8fb1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:56.519845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6676d8c1-325a-4545-b33f-bab2511e8fb1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:56.524602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435fa01-4331-4991-8047-2695f4ea96a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:56.525190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435fa01-4331-4991-8047-2695f4ea96a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:56.525462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435fa01-4331-4991-8047-2695f4ea96a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:56.525721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435fa01-4331-4991-8047-2695f4ea96a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:56.527170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e435fa01-4331-4991-8047-2695f4ea96a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:56.528217 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-e435fa01-4331-4991-8047-2695f4ea96a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:03:56.528217 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:03:56.528217 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:03:56.529082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e435fa01-4331-4991-8047-2695f4ea96a8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:56.542380 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 745/1499] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:03:56.547169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55e9fb-54d6-4654-a935-2b2723c5cb84 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:56.557381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55e9fb-54d6-4654-a935-2b2723c5cb84 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:56.561999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d68bbb-0dc4-4270-80c3-d3de3e3c6591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:56.562597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d68bbb-0dc4-4270-80c3-d3de3e3c6591 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:56.562871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d68bbb-0dc4-4270-80c3-d3de3e3c6591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:56.563134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d68bbb-0dc4-4270-80c3-d3de3e3c6591 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:56.563772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d68bbb-0dc4-4270-80c3-d3de3e3c6591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:56.564804 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-79d68bbb-0dc4-4270-80c3-d3de3e3c6591 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:03:56.564804 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:03:56.564804 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:03:56.565680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d68bbb-0dc4-4270-80c3-d3de3e3c6591 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:56.580135 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 755/1500] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:03:56.584927 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435fa01-4331-4991-8047-2695f4ea96a8 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:56.595377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435fa01-4331-4991-8047-2695f4ea96a8 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:56.600053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9ced8-c824-454b-8637-4572ab9dc09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:56.600725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9ced8-c824-454b-8637-4572ab9dc09a admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:56.600987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9ced8-c824-454b-8637-4572ab9dc09a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:56.601261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9ced8-c824-454b-8637-4572ab9dc09a admin admin] PATH_INFO: `/v3/projects/b6663082082345d88383bcbdb2952d0f/users/fd89c72f991042589131e053d2140572/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:56.617288 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9ced8-c824-454b-8637-4572ab9dc09a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6663082082345d88383bcbdb2952d0f, user_id=fd89c72f991042589131e053d2140572, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:56.618369 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-0bc9ced8-c824-454b-8637-4572ab9dc09a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:03:56.618369 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:03:56.618369 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:03:56.620367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9ced8-c824-454b-8637-4572ab9dc09a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:56.636062 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 746/1501] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:03:56 2022] PUT /identity/v3/projects/b6663082082345d88383bcbdb2952d0f/users/fd89c72f991042589131e053d2140572/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:03:56.648543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8418e-fd87-4ac0-a167-18dd518b3bfa None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:56.648828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8418e-fd87-4ac0-a167-18dd518b3bfa None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:56.649106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8418e-fd87-4ac0-a167-18dd518b3bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:56.679152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-86c8418e-fd87-4ac0-a167-18dd518b3bfa None None] MFA Rules not processed for user `fd89c72f991042589131e053d2140572`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:03:56.680416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-86c8418e-fd87-4ac0-a167-18dd518b3bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:56.746844 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 756/1502] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:03:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:03:56.761092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b831d-9ac1-48cc-8a3f-ff7bd2663ba6 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:56.761276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b831d-9ac1-48cc-8a3f-ff7bd2663ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:56.761543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b831d-9ac1-48cc-8a3f-ff7bd2663ba6 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:56.762863 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 747/1503] 10.222.0.39 () {54 vars in 964 bytes} [Sun Aug 7 01:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:03:56.767815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f8c2b-3966-4ac1-9072-3e43b5316fe5 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:56.768125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f8c2b-3966-4ac1-9072-3e43b5316fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:56.768426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f8c2b-3966-4ac1-9072-3e43b5316fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:56.832116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-fb0f8c2b-3966-4ac1-9072-3e43b5316fe5 None None] MFA Rules not processed for user `9a8be18e03a54bd8821ed5c048bbc793`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:03:56.833339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fb0f8c2b-3966-4ac1-9072-3e43b5316fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:56.912261 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 757/1504] 10.222.0.39 () {58 vars in 1061 bytes} [Sun Aug 7 01:03:56 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:03:56.920237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b831d-9ac1-48cc-8a3f-ff7bd2663ba6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:56.931845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b831d-9ac1-48cc-8a3f-ff7bd2663ba6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:56.936120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db45db-4a68-4fda-9a2f-dc5ab32b82d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:56.936721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db45db-4a68-4fda-9a2f-dc5ab32b82d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:56.936996 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db45db-4a68-4fda-9a2f-dc5ab32b82d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:56.937267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db45db-4a68-4fda-9a2f-dc5ab32b82d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:56.946043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db45db-4a68-4fda-9a2f-dc5ab32b82d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:56.947525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db45db-4a68-4fda-9a2f-dc5ab32b82d6 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:56.958767 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 748/1505] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:03:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:03:57.008114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fc1a3-133e-4e71-8b6e-6c89b36f1b06 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:57.008653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fc1a3-133e-4e71-8b6e-6c89b36f1b06 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:57.008653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fc1a3-133e-4e71-8b6e-6c89b36f1b06 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:57.009919 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 758/1506] 10.222.0.39 () {52 vars in 830 bytes} [Sun Aug 7 01:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:03:57.014988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db45db-4a68-4fda-9a2f-dc5ab32b82d6 service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:57.082299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db45db-4a68-4fda-9a2f-dc5ab32b82d6 service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:57.086940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d4c74-6a04-42ca-8653-d5820e1b3730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:57.087574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d4c74-6a04-42ca-8653-d5820e1b3730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:57.087849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d4c74-6a04-42ca-8653-d5820e1b3730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:57.088154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d4c74-6a04-42ca-8653-d5820e1b3730 admin admin] PATH_INFO: `/v3/users/fd89c72f991042589131e053d2140572` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:57.089978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d4c74-6a04-42ca-8653-d5820e1b3730 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd89c72f991042589131e053d2140572)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:57.091001 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-aa3d4c74-6a04-42ca-8653-d5820e1b3730 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:03:57.091001 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:03:57.091001 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:03:57.092247 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d4c74-6a04-42ca-8653-d5820e1b3730 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:57.175251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aa3d4c74-6a04-42ca-8653-d5820e1b3730 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd89c72f991042589131e053d2140572'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:57.193344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aa3d4c74-6a04-42ca-8653-d5820e1b3730 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd89c72f991042589131e053d2140572'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:57.219203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aa3d4c74-6a04-42ca-8653-d5820e1b3730 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd89c72f991042589131e053d2140572'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:57.220081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aa3d4c74-6a04-42ca-8653-d5820e1b3730 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd89c72f991042589131e053d2140572'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:57.224050 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:03:57.231231 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aa3d4c74-6a04-42ca-8653-d5820e1b3730 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd89c72f991042589131e053d2140572'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:57.239087 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 749/1507] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:03:57 2022] DELETE /identity/v3/users/fd89c72f991042589131e053d2140572 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:03:57.244038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf575d-9e81-4f3b-92b3-895609252a55 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:57.244369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf575d-9e81-4f3b-92b3-895609252a55 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:57.244653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf575d-9e81-4f3b-92b3-895609252a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:57.265695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9bcf575d-9e81-4f3b-92b3-895609252a55 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:03:57.266933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9bcf575d-9e81-4f3b-92b3-895609252a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:57.278433 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:03:57.333499 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 759/1508] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:03:57.344363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d4c74-6a04-42ca-8653-d5820e1b3730 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:57.345817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-aa3d4c74-6a04-42ca-8653-d5820e1b3730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:57.430072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d4c74-6a04-42ca-8653-d5820e1b3730 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:57.434417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f8677-72df-418f-914c-62cc4ee06655 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:57.435022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f8677-72df-418f-914c-62cc4ee06655 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:57.435298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f8677-72df-418f-914c-62cc4ee06655 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:57.435570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f8677-72df-418f-914c-62cc4ee06655 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:57.445298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f8677-72df-418f-914c-62cc4ee06655 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:57.446737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f8677-72df-418f-914c-62cc4ee06655 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:57.457131 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 750/1509] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:03:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:03:57.837760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf575d-9e81-4f3b-92b3-895609252a55 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:03:57.839480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9bcf575d-9e81-4f3b-92b3-895609252a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:03:57.854503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf575d-9e81-4f3b-92b3-895609252a55 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:03:57.860839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151bf0f-1223-4117-b2ce-c0563f91ccf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:03:57.861934 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151bf0f-1223-4117-b2ce-c0563f91ccf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:03:57.862422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151bf0f-1223-4117-b2ce-c0563f91ccf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:03:57.862922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151bf0f-1223-4117-b2ce-c0563f91ccf0 admin admin] PATH_INFO: `/v3/projects/b6663082082345d88383bcbdb2952d0f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:03:57.865012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151bf0f-1223-4117-b2ce-c0563f91ccf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6663082082345d88383bcbdb2952d0f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:03:57.867252 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-2151bf0f-1223-4117-b2ce-c0563f91ccf0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:03:57.867252 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:03:57.867252 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:03:57.870288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151bf0f-1223-4117-b2ce-c0563f91ccf0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:03:57.944634 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2151bf0f-1223-4117-b2ce-c0563f91ccf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6663082082345d88383bcbdb2952d0f', 'request_id': 'req-2151bf0f-1223-4117-b2ce-c0563f91ccf0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:57.951153 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2151bf0f-1223-4117-b2ce-c0563f91ccf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6663082082345d88383bcbdb2952d0f', 'request_id': 'req-2151bf0f-1223-4117-b2ce-c0563f91ccf0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:57.965082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2151bf0f-1223-4117-b2ce-c0563f91ccf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6663082082345d88383bcbdb2952d0f', 'request_id': 'req-2151bf0f-1223-4117-b2ce-c0563f91ccf0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:57.983311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2151bf0f-1223-4117-b2ce-c0563f91ccf0 admin admin] The token cache is being invalidate because project b6663082082345d88383bcbdb2952d0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:03:57.983630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2151bf0f-1223-4117-b2ce-c0563f91ccf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:57.984850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2151bf0f-1223-4117-b2ce-c0563f91ccf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:03:57.985912 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 760/1510] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:03:57 2022] DELETE /identity/v3/projects/b6663082082345d88383bcbdb2952d0f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:04:07.452751 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:04:07.981525 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:13.355561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc931c-2210-40e9-8a25-16aac065d03c None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:13.356229 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc931c-2210-40e9-8a25-16aac065d03c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:13.356229 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc931c-2210-40e9-8a25-16aac065d03c None None] PATH_INFO: `/v3` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:13.357631 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 751/1511] 10.222.0.25 () {54 vars in 925 bytes} [Sun Aug 7 01:07:13 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:07:13.364417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb729bd-e49b-48ef-ba43-57a9352387ca None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:13.365264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb729bd-e49b-48ef-ba43-57a9352387ca None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:13.365264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb729bd-e49b-48ef-ba43-57a9352387ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:13.423457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-edb729bd-e49b-48ef-ba43-57a9352387ca None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:13.424791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-edb729bd-e49b-48ef-ba43-57a9352387ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:13.510339 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 761/1512] 10.222.0.25 () {58 vars in 1015 bytes} [Sun Aug 7 01:07:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:07:18.312977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d588f6-339d-4add-808b-ed4d1cde8306 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:18.313550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d588f6-339d-4add-808b-ed4d1cde8306 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:18.313550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d588f6-339d-4add-808b-ed4d1cde8306 None None] PATH_INFO: `/v3` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:18.314862 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 752/1513] 10.222.0.50 () {54 vars in 925 bytes} [Sun Aug 7 01:07:18 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:07:18.342693 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e823e4-af18-495d-82f1-1df9454d93f7 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:18.343300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e823e4-af18-495d-82f1-1df9454d93f7 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:18.343300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e823e4-af18-495d-82f1-1df9454d93f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:18.365165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-26e823e4-af18-495d-82f1-1df9454d93f7 None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:18.366414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-26e823e4-af18-495d-82f1-1df9454d93f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:18.375416 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 762/1514] 10.222.0.50 () {58 vars in 1015 bytes} [Sun Aug 7 01:07:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:07:22.285671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4baf3-1c20-4a5a-958e-46ddd5c5ced2 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:22.286235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4baf3-1c20-4a5a-958e-46ddd5c5ced2 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:22.286235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4baf3-1c20-4a5a-958e-46ddd5c5ced2 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:22.287416 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 753/1515] 10.222.0.39 () {54 vars in 961 bytes} [Sun Aug 7 01:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:07:22.292439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14ea3a-754c-43a5-8007-49afdc0bcd35 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:22.292900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14ea3a-754c-43a5-8007-49afdc0bcd35 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:22.293003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14ea3a-754c-43a5-8007-49afdc0bcd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:22.312957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1c14ea3a-754c-43a5-8007-49afdc0bcd35 None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:22.314234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1c14ea3a-754c-43a5-8007-49afdc0bcd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:22.322781 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 763/1516] 10.222.0.39 () {58 vars in 1058 bytes} [Sun Aug 7 01:07:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:07:22.330430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4baf3-1c20-4a5a-958e-46ddd5c5ced2 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:22.344005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4baf3-1c20-4a5a-958e-46ddd5c5ced2 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:22.349598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c22bb1-38af-48d0-b404-d8c44a5d31c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:22.350197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c22bb1-38af-48d0-b404-d8c44a5d31c0 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:22.350494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c22bb1-38af-48d0-b404-d8c44a5d31c0 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:22.350740 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c22bb1-38af-48d0-b404-d8c44a5d31c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:22.359531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c22bb1-38af-48d0-b404-d8c44a5d31c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:22.361166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c22bb1-38af-48d0-b404-d8c44a5d31c0 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:22.371439 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 754/1517] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:07:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:07:26.778172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3866ab-3128-43e6-992f-43f4d9cccb9f None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:26.778693 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3866ab-3128-43e6-992f-43f4d9cccb9f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:26.778814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3866ab-3128-43e6-992f-43f4d9cccb9f None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:26.780171 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 764/1518] 10.222.0.39 () {54 vars in 961 bytes} [Sun Aug 7 01:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:07:26.785915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7c9af-966f-4376-8e74-9c7326dc2faa None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:26.786482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7c9af-966f-4376-8e74-9c7326dc2faa None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:26.786927 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7c9af-966f-4376-8e74-9c7326dc2faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:26.808388 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-17d7c9af-966f-4376-8e74-9c7326dc2faa None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:26.809606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-17d7c9af-966f-4376-8e74-9c7326dc2faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:26.818330 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 755/1519] 10.222.0.39 () {58 vars in 1058 bytes} [Sun Aug 7 01:07:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:07:26.826040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3866ab-3128-43e6-992f-43f4d9cccb9f None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:26.840134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3866ab-3128-43e6-992f-43f4d9cccb9f None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:26.845512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47d3b6-456b-4f13-ae2d-9b01c3fd81df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:26.846132 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47d3b6-456b-4f13-ae2d-9b01c3fd81df service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:26.846899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47d3b6-456b-4f13-ae2d-9b01c3fd81df service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:26.847176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47d3b6-456b-4f13-ae2d-9b01c3fd81df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:26.856591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47d3b6-456b-4f13-ae2d-9b01c3fd81df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:26.858216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47d3b6-456b-4f13-ae2d-9b01c3fd81df service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:26.872080 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 765/1520] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:07:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:07:36.803159 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=9 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:36.866752 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=56 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:07:44.290087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbda72-a0e6-43ac-9458-388c3ffffcac None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:44.290813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbda72-a0e6-43ac-9458-388c3ffffcac None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:44.290813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbda72-a0e6-43ac-9458-388c3ffffcac None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:44.291911 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 756/1521] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 01:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:07:44.297190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb015a-7620-4ca1-8ea9-cb232177c975 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:44.297667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb015a-7620-4ca1-8ea9-cb232177c975 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:44.297787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb015a-7620-4ca1-8ea9-cb232177c975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:44.320376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-51cb015a-7620-4ca1-8ea9-cb232177c975 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:44.321606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-51cb015a-7620-4ca1-8ea9-cb232177c975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:44.387211 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 766/1522] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 01:07:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:07:44.548139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbda72-a0e6-43ac-9458-388c3ffffcac None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:44.550103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c3fbda72-a0e6-43ac-9458-388c3ffffcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:44.671239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbda72-a0e6-43ac-9458-388c3ffffcac None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:44.677434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd35b74-31a0-44a4-9358-a68eec2842fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:44.678056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd35b74-31a0-44a4-9358-a68eec2842fc service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:44.678334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd35b74-31a0-44a4-9358-a68eec2842fc service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:44.678608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd35b74-31a0-44a4-9358-a68eec2842fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:44.687680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd35b74-31a0-44a4-9358-a68eec2842fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:44.689852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd35b74-31a0-44a4-9358-a68eec2842fc service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:44.700834 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 757/1523] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:07:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:07:45.910997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37830c04-a485-455b-9d15-66b112af89cd None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:45.911640 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37830c04-a485-455b-9d15-66b112af89cd None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:45.912143 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37830c04-a485-455b-9d15-66b112af89cd None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:45.915076 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 767/1524] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 7 01:07:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:07:45.920826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1ba04-007f-4edf-b9ee-c613275f5e90 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:45.921398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1ba04-007f-4edf-b9ee-c613275f5e90 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:45.921398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1ba04-007f-4edf-b9ee-c613275f5e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:45.942849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-08b1ba04-007f-4edf-b9ee-c613275f5e90 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:45.944095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-08b1ba04-007f-4edf-b9ee-c613275f5e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:45.952681 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 758/1525] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 7 01:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:07:46.109842 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37830c04-a485-455b-9d15-66b112af89cd None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:46.134886 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37830c04-a485-455b-9d15-66b112af89cd None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:46.145385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3dc74-18bd-4196-adf3-bc90c1ceab59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:46.146412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3dc74-18bd-4196-adf3-bc90c1ceab59 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:46.146905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3dc74-18bd-4196-adf3-bc90c1ceab59 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:46.147380 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3dc74-18bd-4196-adf3-bc90c1ceab59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:46.166383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3dc74-18bd-4196-adf3-bc90c1ceab59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:46.169530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3dc74-18bd-4196-adf3-bc90c1ceab59 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:46.181173 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 768/1526] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:07:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:07:50.178088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8b507-77c1-464f-9cd7-34720fb2474e None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:50.178754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8b507-77c1-464f-9cd7-34720fb2474e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:50.178754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8b507-77c1-464f-9cd7-34720fb2474e None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:50.180101 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 759/1527] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 01:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:07:50.186406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8135dac-2109-4790-85da-d614f0fd2f95 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:50.187215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8135dac-2109-4790-85da-d614f0fd2f95 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:50.187215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8135dac-2109-4790-85da-d614f0fd2f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:50.208263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a8135dac-2109-4790-85da-d614f0fd2f95 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:50.209522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a8135dac-2109-4790-85da-d614f0fd2f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:50.218477 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 769/1528] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 01:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:07:50.303972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8b507-77c1-464f-9cd7-34720fb2474e None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:50.306483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b7c8b507-77c1-464f-9cd7-34720fb2474e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:50.374355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c8b507-77c1-464f-9cd7-34720fb2474e None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:50.378716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e28ab4-ac44-48aa-bb8b-03947a91a52f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:50.379387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e28ab4-ac44-48aa-bb8b-03947a91a52f service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:50.379664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e28ab4-ac44-48aa-bb8b-03947a91a52f service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:50.379966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e28ab4-ac44-48aa-bb8b-03947a91a52f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:50.390089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e28ab4-ac44-48aa-bb8b-03947a91a52f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:50.391599 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e28ab4-ac44-48aa-bb8b-03947a91a52f service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:50.402477 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 760/1529] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:07:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:07:52.681589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61dcf0-2904-43bc-956d-c6a82b305a13 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:52.682328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61dcf0-2904-43bc-956d-c6a82b305a13 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:52.682328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61dcf0-2904-43bc-956d-c6a82b305a13 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:52.683552 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 770/1530] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 7 01:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:07:52.689462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c73970-007c-44bc-93e4-0dd94304e13f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:52.690038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c73970-007c-44bc-93e4-0dd94304e13f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:52.690038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c73970-007c-44bc-93e4-0dd94304e13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:52.715449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d1c73970-007c-44bc-93e4-0dd94304e13f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:07:52.716708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d1c73970-007c-44bc-93e4-0dd94304e13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:07:52.725667 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 761/1531] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 7 01:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:07:52.762136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61dcf0-2904-43bc-956d-c6a82b305a13 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:07:52.773857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61dcf0-2904-43bc-956d-c6a82b305a13 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:07:52.777680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b123a18-d28d-4dac-b71b-1b0090aa0c59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:07:52.778283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b123a18-d28d-4dac-b71b-1b0090aa0c59 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:07:52.778565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b123a18-d28d-4dac-b71b-1b0090aa0c59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:07:52.778833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b123a18-d28d-4dac-b71b-1b0090aa0c59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:07:52.789700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b123a18-d28d-4dac-b71b-1b0090aa0c59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:07:52.791153 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b123a18-d28d-4dac-b71b-1b0090aa0c59 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:07:52.802063 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 771/1532] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:07:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:08:02.710198 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=78 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:02.797110 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=42 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:08:45.685248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80887277-6a6b-4466-ac95-696ca447e438 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:45.686524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80887277-6a6b-4466-ac95-696ca447e438 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:45.686524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80887277-6a6b-4466-ac95-696ca447e438 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:45.688002 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 762/1533] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 01:08:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:08:45.693133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a6dcc-d1f2-49cf-b018-045262d068c9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:08:45.693820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a6dcc-d1f2-49cf-b018-045262d068c9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:08:45.693820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a6dcc-d1f2-49cf-b018-045262d068c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:08:45.713487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-fe9a6dcc-d1f2-49cf-b018-045262d068c9 None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:08:45.714679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fe9a6dcc-d1f2-49cf-b018-045262d068c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:08:45.724975 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 772/1534] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 01:08:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:08:55.708454 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:19.582130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e7463-934c-49c1-906e-aea82a04a9c1 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:19.583010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e7463-934c-49c1-906e-aea82a04a9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:19.583010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e7463-934c-49c1-906e-aea82a04a9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:19.607089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b54e7463-934c-49c1-906e-aea82a04a9c1 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:19.608538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b54e7463-934c-49c1-906e-aea82a04a9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:19.619482 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 763/1535] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:09:19.641911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81affb4e-8232-44d8-83d6-dc58ad2ece45 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:19.642766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81affb4e-8232-44d8-83d6-dc58ad2ece45 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:19.642766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81affb4e-8232-44d8-83d6-dc58ad2ece45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:19.667997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-81affb4e-8232-44d8-83d6-dc58ad2ece45 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:19.669985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-81affb4e-8232-44d8-83d6-dc58ad2ece45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:19.685551 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 773/1536] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:09:19.690497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e7463-934c-49c1-906e-aea82a04a9c1 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:19.702243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e7463-934c-49c1-906e-aea82a04a9c1 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:19.711463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42ba73-dab7-4fff-aed2-fe6739d8d842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:19.712614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42ba73-dab7-4fff-aed2-fe6739d8d842 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:19.713073 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42ba73-dab7-4fff-aed2-fe6739d8d842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:19.713555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42ba73-dab7-4fff-aed2-fe6739d8d842 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:19.714655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42ba73-dab7-4fff-aed2-fe6739d8d842 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:09:19.715268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42ba73-dab7-4fff-aed2-fe6739d8d842 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:19.717479 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-2f42ba73-dab7-4fff-aed2-fe6739d8d842 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:19.717479 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:09:19.717479 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:09:19.724708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42ba73-dab7-4fff-aed2-fe6739d8d842 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:19.744084 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 764/1537] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:09:19.754945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81affb4e-8232-44d8-83d6-dc58ad2ece45 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:19.771188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81affb4e-8232-44d8-83d6-dc58ad2ece45 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:19.774480 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21745f-408c-48a4-8222-543027f2864a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:19.775375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21745f-408c-48a4-8222-543027f2864a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:19.775959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21745f-408c-48a4-8222-543027f2864a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:19.786951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc5fe6-25e7-4c10-8f0d-7340e9b947e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:19.787637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc5fe6-25e7-4c10-8f0d-7340e9b947e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:19.787940 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc5fe6-25e7-4c10-8f0d-7340e9b947e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:19.788240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc5fe6-25e7-4c10-8f0d-7340e9b947e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:19.788899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc5fe6-25e7-4c10-8f0d-7340e9b947e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:19.789956 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-87fc5fe6-25e7-4c10-8f0d-7340e9b947e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:19.789956 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:09:19.789956 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:09:19.791543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc5fe6-25e7-4c10-8f0d-7340e9b947e3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:19.821048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-df21745f-408c-48a4-8222-543027f2864a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:19.822700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-df21745f-408c-48a4-8222-543027f2864a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:19.839585 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 765/1538] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:19.845299 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 774/1539] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:19 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:19.850169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21745f-408c-48a4-8222-543027f2864a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:19.864216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0427a9-cabf-4442-bd55-c6f3a8fdbb89 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:19.864501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0427a9-cabf-4442-bd55-c6f3a8fdbb89 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:19.867433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0427a9-cabf-4442-bd55-c6f3a8fdbb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:19.870940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21745f-408c-48a4-8222-543027f2864a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:19.913141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-fb0427a9-cabf-4442-bd55-c6f3a8fdbb89 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:19.914400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fb0427a9-cabf-4442-bd55-c6f3a8fdbb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:20.041826 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 775/1540] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:20.052079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0427a9-cabf-4442-bd55-c6f3a8fdbb89 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:20.061120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3f21c-cdde-4ce4-989a-83a514a8b491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:20.062846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3f21c-cdde-4ce4-989a-83a514a8b491 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:20.063401 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3f21c-cdde-4ce4-989a-83a514a8b491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:20.063956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3f21c-cdde-4ce4-989a-83a514a8b491 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:20.064814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd3f21c-cdde-4ce4-989a-83a514a8b491 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:20.066184 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-0fd3f21c-cdde-4ce4-989a-83a514a8b491 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:20.066184 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:09:20.066184 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:09:20.066432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0427a9-cabf-4442-bd55-c6f3a8fdbb89 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:20.067802 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd3f21c-cdde-4ce4-989a-83a514a8b491 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:20.085855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17021e8-8f5e-4a48-8d95-d887704963b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:20.086491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17021e8-8f5e-4a48-8d95-d887704963b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:20.086777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17021e8-8f5e-4a48-8d95-d887704963b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:20.087049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17021e8-8f5e-4a48-8d95-d887704963b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:20.087726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17021e8-8f5e-4a48-8d95-d887704963b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:09:20.088066 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17021e8-8f5e-4a48-8d95-d887704963b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:20.089754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17021e8-8f5e-4a48-8d95-d887704963b7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:20.111169 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 766/1541] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:19 2022] POST /identity/v3/users => generated 292 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:20.113455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299dfae3-3591-42fe-9ea0-97ff51b252ef None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:20.116728 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 776/1542] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:09:20.118768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299dfae3-3591-42fe-9ea0-97ff51b252ef None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:20.120219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299dfae3-3591-42fe-9ea0-97ff51b252ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:20.131530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17021e8-8f5e-4a48-8d95-d887704963b7 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:20.146477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17021e8-8f5e-4a48-8d95-d887704963b7 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:20.175936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e33f6-a0aa-441f-a040-723cfaf072ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:20.175936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e33f6-a0aa-441f-a040-723cfaf072ac admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:20.175936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e33f6-a0aa-441f-a040-723cfaf072ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:20.175936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e33f6-a0aa-441f-a040-723cfaf072ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:20.176617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e33f6-a0aa-441f-a040-723cfaf072ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:20.177002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e33f6-a0aa-441f-a040-723cfaf072ac admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:20.181744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-299dfae3-3591-42fe-9ea0-97ff51b252ef None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:20.183669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-299dfae3-3591-42fe-9ea0-97ff51b252ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:20.197679 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 777/1543] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:09:20.200653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e33f6-a0aa-441f-a040-723cfaf072ac admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:20.205995 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 767/1544] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:20.212342 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f8f14-b585-4288-a75d-bbcf0f3182df None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:20.213158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f8f14-b585-4288-a75d-bbcf0f3182df None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:20.213723 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f8f14-b585-4288-a75d-bbcf0f3182df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:20.217096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e33f6-a0aa-441f-a040-723cfaf072ac admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:20.256899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2661c-d411-4a29-a9a0-a4844535d617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:20.257961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2661c-d411-4a29-a9a0-a4844535d617 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:20.258258 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2661c-d411-4a29-a9a0-a4844535d617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:20.258554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2661c-d411-4a29-a9a0-a4844535d617 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:20.259253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2661c-d411-4a29-a9a0-a4844535d617 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:20.261407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2661c-d411-4a29-a9a0-a4844535d617 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:20.266758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-413f8f14-b585-4288-a75d-bbcf0f3182df None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:20.269081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-413f8f14-b585-4288-a75d-bbcf0f3182df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:20.287686 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 768/1545] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:20.289290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f8f14-b585-4288-a75d-bbcf0f3182df None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:20.311767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f8f14-b585-4288-a75d-bbcf0f3182df None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:20.320404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bbf22-c023-4abd-93c3-3ad1cd50dd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:20.321364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bbf22-c023-4abd-93c3-3ad1cd50dd30 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:20.321862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bbf22-c023-4abd-93c3-3ad1cd50dd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:20.322061 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 778/1546] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:20 2022] POST /identity/v3/projects => generated 403 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:20.322322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bbf22-c023-4abd-93c3-3ad1cd50dd30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:20.323559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0bbf22-c023-4abd-93c3-3ad1cd50dd30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:20.323681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb2736-cabb-4193-8fba-5e3b30323c03 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:20.324051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb2736-cabb-4193-8fba-5e3b30323c03 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:20.324427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb2736-cabb-4193-8fba-5e3b30323c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:20.327250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0bbf22-c023-4abd-93c3-3ad1cd50dd30 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:20.361486 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 769/1547] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:20.362648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135317d-ced6-41a9-b31d-110a1965b8c0 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:20.362937 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135317d-ced6-41a9-b31d-110a1965b8c0 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:20.363215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135317d-ced6-41a9-b31d-110a1965b8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:20.378911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1beb2736-cabb-4193-8fba-5e3b30323c03 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:20.381123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1beb2736-cabb-4193-8fba-5e3b30323c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:20.391650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-4135317d-ced6-41a9-b31d-110a1965b8c0 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:20.393005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4135317d-ced6-41a9-b31d-110a1965b8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:20.491228 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 770/1548] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:20.504000 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73224a-a392-4977-90c7-9b6a6e98d5bc None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:20.504362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73224a-a392-4977-90c7-9b6a6e98d5bc None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:20.504564 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73224a-a392-4977-90c7-9b6a6e98d5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:20.516772 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 779/1549] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:20.518937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb2736-cabb-4193-8fba-5e3b30323c03 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:20.532760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1f73224a-a392-4977-90c7-9b6a6e98d5bc None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:20.534545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1f73224a-a392-4977-90c7-9b6a6e98d5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:20.538167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb2736-cabb-4193-8fba-5e3b30323c03 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:20.544886 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 771/1550] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:20.546107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaabd89-fd72-43b6-9e27-7bdbf267bca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:20.546359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5f644-b46e-410b-9a62-4f095a2e8ed6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:20.546447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5f644-b46e-410b-9a62-4f095a2e8ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:20.546653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5f644-b46e-410b-9a62-4f095a2e8ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:20.547134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaabd89-fd72-43b6-9e27-7bdbf267bca8 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:20.547616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaabd89-fd72-43b6-9e27-7bdbf267bca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:20.548119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaabd89-fd72-43b6-9e27-7bdbf267bca8 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:20.549255 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaabd89-fd72-43b6-9e27-7bdbf267bca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:20.552997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaabd89-fd72-43b6-9e27-7bdbf267bca8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:20.566526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7fa5f644-b46e-410b-9a62-4f095a2e8ed6 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:20.567732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7fa5f644-b46e-410b-9a62-4f095a2e8ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:20.577134 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 772/1551] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:20.578022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5f644-b46e-410b-9a62-4f095a2e8ed6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:20.584401 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 780/1552] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:20 2022] POST /identity/v3/users => generated 302 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:20.584401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792efdd5-775d-4bc3-aa84-c2d3f526bd61 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:20.584401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792efdd5-775d-4bc3-aa84-c2d3f526bd61 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:20.584401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792efdd5-775d-4bc3-aa84-c2d3f526bd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:20.588102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5f644-b46e-410b-9a62-4f095a2e8ed6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:20.593451 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18450df-0de4-418e-a3f7-e0d5fb77a055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:20.594136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18450df-0de4-418e-a3f7-e0d5fb77a055 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:20.594459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18450df-0de4-418e-a3f7-e0d5fb77a055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:20.594679 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18450df-0de4-418e-a3f7-e0d5fb77a055 admin admin] PATH_INFO: `/v3/projects/a0ca0eceda6241cea90089c9a5f6dbcd/users/ffa98b97de414051938bcbce678fcb27/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:20.604652 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-792efdd5-775d-4bc3-aa84-c2d3f526bd61 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:20.605915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-792efdd5-775d-4bc3-aa84-c2d3f526bd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:20.611182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18450df-0de4-418e-a3f7-e0d5fb77a055 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0ca0eceda6241cea90089c9a5f6dbcd, user_id=ffa98b97de414051938bcbce678fcb27, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:20.614253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18450df-0de4-418e-a3f7-e0d5fb77a055 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:20.615241 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 781/1553] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:20.617375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6823ed3-61a7-470f-a216-39aa460b08dd None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:20.617801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6823ed3-61a7-470f-a216-39aa460b08dd None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:20.618139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6823ed3-61a7-470f-a216-39aa460b08dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:20.627135 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:20.630608 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 773/1554] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:20 2022] PUT /identity/v3/projects/a0ca0eceda6241cea90089c9a5f6dbcd/users/ffa98b97de414051938bcbce678fcb27/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:20.632207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53df06c-0e11-48ec-8449-6000757c1607 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:20.632466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53df06c-0e11-48ec-8449-6000757c1607 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:20.632733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53df06c-0e11-48ec-8449-6000757c1607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:20.640782 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:20.643945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c6823ed3-61a7-470f-a216-39aa460b08dd None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:20.646179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c6823ed3-61a7-470f-a216-39aa460b08dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:20.657931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c53df06c-0e11-48ec-8449-6000757c1607 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:20.659151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c53df06c-0e11-48ec-8449-6000757c1607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:20.721765 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 782/1555] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:20.722598 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6823ed3-61a7-470f-a216-39aa460b08dd None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:20.734755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6823ed3-61a7-470f-a216-39aa460b08dd None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:20.739389 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 774/1556] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:20.739637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e9c7e-0b5b-4b66-aee2-c576d9c7838f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:20.740194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53df06c-0e11-48ec-8449-6000757c1607 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:20.740309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e9c7e-0b5b-4b66-aee2-c576d9c7838f admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:20.740533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e9c7e-0b5b-4b66-aee2-c576d9c7838f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:20.740800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e9c7e-0b5b-4b66-aee2-c576d9c7838f admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:20.741457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e9c7e-0b5b-4b66-aee2-c576d9c7838f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:09:20.741780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e9c7e-0b5b-4b66-aee2-c576d9c7838f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:20.743363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03e9c7e-0b5b-4b66-aee2-c576d9c7838f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:20.754447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53df06c-0e11-48ec-8449-6000757c1607 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:20.760042 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 783/1557] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:09:20.760042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e9c7e-0b5b-4b66-aee2-c576d9c7838f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:20.769062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78042b52-a1f2-4f83-ba28-e43f47f6b30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:20.769062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78042b52-a1f2-4f83-ba28-e43f47f6b30d admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:20.769062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78042b52-a1f2-4f83-ba28-e43f47f6b30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:20.769062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78042b52-a1f2-4f83-ba28-e43f47f6b30d admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:20.769462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78042b52-a1f2-4f83-ba28-e43f47f6b30d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:09:20.769462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78042b52-a1f2-4f83-ba28-e43f47f6b30d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:20.769462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78042b52-a1f2-4f83-ba28-e43f47f6b30d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:20.775452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e9c7e-0b5b-4b66-aee2-c576d9c7838f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:20.780617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f8c7f6-51b1-4624-b7a2-feb8c7464741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:20.781262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8c7f6-51b1-4624-b7a2-feb8c7464741 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:20.781533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8c7f6-51b1-4624-b7a2-feb8c7464741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:20.781801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f8c7f6-51b1-4624-b7a2-feb8c7464741 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:20.782449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8c7f6-51b1-4624-b7a2-feb8c7464741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:20.782555 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 775/1558] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:09:20.783799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6042b2-c6b4-4f85-b34a-074f4ba6b976 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:20.784341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f8c7f6-51b1-4624-b7a2-feb8c7464741 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:20.784435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6042b2-c6b4-4f85-b34a-074f4ba6b976 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:20.784435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6042b2-c6b4-4f85-b34a-074f4ba6b976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:20.801326 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 784/1559] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:20.801326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76ed2d-9219-4e91-b024-4f5895537274 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:20.801326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76ed2d-9219-4e91-b024-4f5895537274 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:20.801326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76ed2d-9219-4e91-b024-4f5895537274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:20.810595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-cd6042b2-c6b4-4f85-b34a-074f4ba6b976 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:20.811556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cd6042b2-c6b4-4f85-b34a-074f4ba6b976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:20.820075 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 776/1560] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:20.821273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bdf8b6-35c7-4ace-80a5-97e5fe09c87f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:20.821586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bdf8b6-35c7-4ace-80a5-97e5fe09c87f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:20.821836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bdf8b6-35c7-4ace-80a5-97e5fe09c87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:20.821918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9a76ed2d-9219-4e91-b024-4f5895537274 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:20.823092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9a76ed2d-9219-4e91-b024-4f5895537274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:20.832152 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 785/1561] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:20.833906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76ed2d-9219-4e91-b024-4f5895537274 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:20.843225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76ed2d-9219-4e91-b024-4f5895537274 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:20.848450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457682a6-3fe3-4aec-a028-2952d016ab2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:20.849126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457682a6-3fe3-4aec-a028-2952d016ab2c admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:20.850297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457682a6-3fe3-4aec-a028-2952d016ab2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:20.850297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457682a6-3fe3-4aec-a028-2952d016ab2c admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:20.850297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457682a6-3fe3-4aec-a028-2952d016ab2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:09:20.850639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457682a6-3fe3-4aec-a028-2952d016ab2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:20.852226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457682a6-3fe3-4aec-a028-2952d016ab2c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:20.860106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-11bdf8b6-35c7-4ace-80a5-97e5fe09c87f None None] MFA Rules not processed for user `ffa98b97de414051938bcbce678fcb27`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:20.861673 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-11bdf8b6-35c7-4ace-80a5-97e5fe09c87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:20.865899 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 786/1562] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:09:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:09:20.867163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92895d-e551-46bb-a640-6993981b06f3 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:20.867440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92895d-e551-46bb-a640-6993981b06f3 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:20.867704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92895d-e551-46bb-a640-6993981b06f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:20.892208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2f92895d-e551-46bb-a640-6993981b06f3 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:20.893573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2f92895d-e551-46bb-a640-6993981b06f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:20.903580 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 787/1563] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:20.904491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92895d-e551-46bb-a640-6993981b06f3 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:20.916951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92895d-e551-46bb-a640-6993981b06f3 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:20.923654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87f004-6420-4fbe-80d0-d1209ab5a580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:20.924319 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87f004-6420-4fbe-80d0-d1209ab5a580 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:20.924596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87f004-6420-4fbe-80d0-d1209ab5a580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:20.924875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87f004-6420-4fbe-80d0-d1209ab5a580 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:20.925514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc87f004-6420-4fbe-80d0-d1209ab5a580 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:20.927439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc87f004-6420-4fbe-80d0-d1209ab5a580 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:20.961747 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 788/1564] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:20 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:20.962643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87f004-6420-4fbe-80d0-d1209ab5a580 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:20.964902 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 777/1565] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:20.965643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bdf8b6-35c7-4ace-80a5-97e5fe09c87f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:20.981741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bdf8b6-35c7-4ace-80a5-97e5fe09c87f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:21.046450 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba49269-2889-4812-af65-35e8dca5b8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:21.047303 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba49269-2889-4812-af65-35e8dca5b8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:21.047745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba49269-2889-4812-af65-35e8dca5b8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:21.048070 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba49269-2889-4812-af65-35e8dca5b8d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:21.048812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba49269-2889-4812-af65-35e8dca5b8d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:21.050623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87f004-6420-4fbe-80d0-d1209ab5a580 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:21.050766 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba49269-2889-4812-af65-35e8dca5b8d5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:21.056188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8aac3-c0a6-48e5-b4a0-5ebdbf5798f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:21.056906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8aac3-c0a6-48e5-b4a0-5ebdbf5798f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:21.057210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8aac3-c0a6-48e5-b4a0-5ebdbf5798f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:21.057516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8aac3-c0a6-48e5-b4a0-5ebdbf5798f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:21.058159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae8aac3-c0a6-48e5-b4a0-5ebdbf5798f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:21.060990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae8aac3-c0a6-48e5-b4a0-5ebdbf5798f5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:21.064546 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 778/1566] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:21.065468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba49269-2889-4812-af65-35e8dca5b8d5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:21.075556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba49269-2889-4812-af65-35e8dca5b8d5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:21.081470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82cdef-cb85-4c48-98c8-4381e45564a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:21.082108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82cdef-cb85-4c48-98c8-4381e45564a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:21.082389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82cdef-cb85-4c48-98c8-4381e45564a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:21.082659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82cdef-cb85-4c48-98c8-4381e45564a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:21.083316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82cdef-cb85-4c48-98c8-4381e45564a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:09:21.083643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82cdef-cb85-4c48-98c8-4381e45564a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:21.085571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82cdef-cb85-4c48-98c8-4381e45564a0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:21.088803 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:21.109177 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 779/1567] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:09:21.109391 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 789/1568] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:20 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:21.109489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82cdef-cb85-4c48-98c8-4381e45564a0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:21.109603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8aac3-c0a6-48e5-b4a0-5ebdbf5798f5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:21.116910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82cdef-cb85-4c48-98c8-4381e45564a0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:21.128536 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:21.184039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3a0a0-4ebc-4907-aab8-7d8a0baaad15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:21.184711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3a0a0-4ebc-4907-aab8-7d8a0baaad15 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:21.184991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3a0a0-4ebc-4907-aab8-7d8a0baaad15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:21.185324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3a0a0-4ebc-4907-aab8-7d8a0baaad15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:21.185415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8aac3-c0a6-48e5-b4a0-5ebdbf5798f5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:21.186042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3a0a0-4ebc-4907-aab8-7d8a0baaad15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:09:21.186346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3a0a0-4ebc-4907-aab8-7d8a0baaad15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:21.188021 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3a0a0-4ebc-4907-aab8-7d8a0baaad15 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:21.190229 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89a5b9-cc52-458a-8516-7f4322adbf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:21.190833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89a5b9-cc52-458a-8516-7f4322adbf3a admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:21.191104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89a5b9-cc52-458a-8516-7f4322adbf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:21.191372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89a5b9-cc52-458a-8516-7f4322adbf3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:21.192038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89a5b9-cc52-458a-8516-7f4322adbf3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:21.193996 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89a5b9-cc52-458a-8516-7f4322adbf3a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:21.201351 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 780/1569] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:09:21.202497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3a0a0-4ebc-4907-aab8-7d8a0baaad15 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:21.221734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3a0a0-4ebc-4907-aab8-7d8a0baaad15 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:21.228114 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 790/1570] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:21 2022] POST /identity/v3/projects => generated 397 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:21.230589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d4c0d-4eed-4463-aacc-7400c518ba82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:21.232515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d4c0d-4eed-4463-aacc-7400c518ba82 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:21.232660 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89a5b9-cc52-458a-8516-7f4322adbf3a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:21.233416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d4c0d-4eed-4463-aacc-7400c518ba82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:21.234049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d4c0d-4eed-4463-aacc-7400c518ba82 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:21.235847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d4c0d-4eed-4463-aacc-7400c518ba82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:09:21.236748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d4c0d-4eed-4463-aacc-7400c518ba82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:21.240241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d4c0d-4eed-4463-aacc-7400c518ba82 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:21.260899 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 781/1571] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:09:21.262213 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d4c0d-4eed-4463-aacc-7400c518ba82 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:21.276088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d4c0d-4eed-4463-aacc-7400c518ba82 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:21.310049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89a5b9-cc52-458a-8516-7f4322adbf3a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:21.315593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61371714-454e-47e7-af41-a09c8b5f6969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:21.316363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61371714-454e-47e7-af41-a09c8b5f6969 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:21.316647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61371714-454e-47e7-af41-a09c8b5f6969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:21.316977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61371714-454e-47e7-af41-a09c8b5f6969 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:21.317654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61371714-454e-47e7-af41-a09c8b5f6969 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:21.319691 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61371714-454e-47e7-af41-a09c8b5f6969 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:21.343085 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 791/1572] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:21 2022] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:21.343912 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61371714-454e-47e7-af41-a09c8b5f6969 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:21.345594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac5228-a236-4603-9a91-5fe3d2ad0de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:21.346721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac5228-a236-4603-9a91-5fe3d2ad0de0 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:21.346998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac5228-a236-4603-9a91-5fe3d2ad0de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:21.347269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac5228-a236-4603-9a91-5fe3d2ad0de0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:21.348123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac5228-a236-4603-9a91-5fe3d2ad0de0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:21.350060 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac5228-a236-4603-9a91-5fe3d2ad0de0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:21.353839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61371714-454e-47e7-af41-a09c8b5f6969 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:21.358585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa88149-ebb5-47c9-ab91-20ab11cf43b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:21.359244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa88149-ebb5-47c9-ab91-20ab11cf43b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:21.359519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa88149-ebb5-47c9-ab91-20ab11cf43b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:21.359788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa88149-ebb5-47c9-ab91-20ab11cf43b6 admin admin] PATH_INFO: `/v3/projects/0771943ca95c463998e2c2321dfc3685/users/b734b820694444fcb1a4dffda0547775/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:21.376978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa88149-ebb5-47c9-ab91-20ab11cf43b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0771943ca95c463998e2c2321dfc3685, user_id=b734b820694444fcb1a4dffda0547775, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:21.378046 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-6fa88149-ebb5-47c9-ab91-20ab11cf43b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:21.378046 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:09:21.378046 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:09:21.378903 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 782/1573] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:21 2022] POST /identity/v3/projects => generated 381 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:21.379788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac5228-a236-4603-9a91-5fe3d2ad0de0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:21.380157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa88149-ebb5-47c9-ab91-20ab11cf43b6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:21.395545 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 792/1574] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:21 2022] PUT /identity/v3/projects/0771943ca95c463998e2c2321dfc3685/users/b734b820694444fcb1a4dffda0547775/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:21.396785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa88149-ebb5-47c9-ab91-20ab11cf43b6 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:21.461923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac5228-a236-4603-9a91-5fe3d2ad0de0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:21.467341 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:21.474627 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa88149-ebb5-47c9-ab91-20ab11cf43b6 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:21.480755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5273ff-a0be-41e1-8033-ba0d29e08de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:21.481434 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5273ff-a0be-41e1-8033-ba0d29e08de9 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:21.481897 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5273ff-a0be-41e1-8033-ba0d29e08de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:21.482224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5273ff-a0be-41e1-8033-ba0d29e08de9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:21.482993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5273ff-a0be-41e1-8033-ba0d29e08de9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:21.485534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5273ff-a0be-41e1-8033-ba0d29e08de9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:21.497583 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:21.518245 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 793/1575] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:21 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:21.519257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5273ff-a0be-41e1-8033-ba0d29e08de9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:21.531260 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1181c-8ddc-400c-a0cc-4bd50b79fa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:21.531869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1181c-8ddc-400c-a0cc-4bd50b79fa93 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:21.532173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1181c-8ddc-400c-a0cc-4bd50b79fa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:21.532440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1181c-8ddc-400c-a0cc-4bd50b79fa93 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:21.533067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead1181c-8ddc-400c-a0cc-4bd50b79fa93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:21.535050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead1181c-8ddc-400c-a0cc-4bd50b79fa93 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:21.559061 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 783/1576] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:21 2022] POST /identity/v3/users => generated 294 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:21.560754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1181c-8ddc-400c-a0cc-4bd50b79fa93 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:21.570790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1181c-8ddc-400c-a0cc-4bd50b79fa93 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:21.600572 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5273ff-a0be-41e1-8033-ba0d29e08de9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:21.606905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3da0ff-fd99-427f-b811-f2f4a820a127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:21.607787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3da0ff-fd99-427f-b811-f2f4a820a127 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:21.608078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3da0ff-fd99-427f-b811-f2f4a820a127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:21.608343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3da0ff-fd99-427f-b811-f2f4a820a127 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:21.608988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3da0ff-fd99-427f-b811-f2f4a820a127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:21.611195 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3da0ff-fd99-427f-b811-f2f4a820a127 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:21.643753 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 794/1577] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:21 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:21.645002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3da0ff-fd99-427f-b811-f2f4a820a127 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:21.646610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b499b9-6faa-42bc-a71a-f33c6d7bb43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:21.647268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b499b9-6faa-42bc-a71a-f33c6d7bb43f admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:21.647504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b499b9-6faa-42bc-a71a-f33c6d7bb43f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:21.648186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b499b9-6faa-42bc-a71a-f33c6d7bb43f admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:21.648450 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b499b9-6faa-42bc-a71a-f33c6d7bb43f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:21.650647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b499b9-6faa-42bc-a71a-f33c6d7bb43f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:21.676460 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 784/1578] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:21 2022] POST /identity/v3/users => generated 299 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:21.677380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b499b9-6faa-42bc-a71a-f33c6d7bb43f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:21.689649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b499b9-6faa-42bc-a71a-f33c6d7bb43f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:21.723789 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3da0ff-fd99-427f-b811-f2f4a820a127 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:21.729249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275b3f6-fc68-4353-a505-86af718fb439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:21.729863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275b3f6-fc68-4353-a505-86af718fb439 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:21.730135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275b3f6-fc68-4353-a505-86af718fb439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:21.730403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275b3f6-fc68-4353-a505-86af718fb439 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:21.731559 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275b3f6-fc68-4353-a505-86af718fb439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:21.733530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275b3f6-fc68-4353-a505-86af718fb439 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:21.753991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db0f8a-aed5-44a7-8444-7620351ab932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:21.754692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db0f8a-aed5-44a7-8444-7620351ab932 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:21.755056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db0f8a-aed5-44a7-8444-7620351ab932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:21.755370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db0f8a-aed5-44a7-8444-7620351ab932 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:21.756222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db0f8a-aed5-44a7-8444-7620351ab932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:21.757846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db0f8a-aed5-44a7-8444-7620351ab932 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:21.764834 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 795/1579] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:21 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:21.766124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275b3f6-fc68-4353-a505-86af718fb439 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:21.774653 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 785/1580] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:21.774653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372b0cc-0bb3-4b49-9121-dd3e43870f28 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:21.774653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372b0cc-0bb3-4b49-9121-dd3e43870f28 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:21.774653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372b0cc-0bb3-4b49-9121-dd3e43870f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:21.804419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-8372b0cc-0bb3-4b49-9121-dd3e43870f28 None None] MFA Rules not processed for user `b734b820694444fcb1a4dffda0547775`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:21.805678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8372b0cc-0bb3-4b49-9121-dd3e43870f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:21.825671 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:21.846631 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275b3f6-fc68-4353-a505-86af718fb439 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:21.851752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53f065-45d1-4c0a-9610-bd8fde09aa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:21.852407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53f065-45d1-4c0a-9610-bd8fde09aa71 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:21.852690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53f065-45d1-4c0a-9610-bd8fde09aa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:21.852964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53f065-45d1-4c0a-9610-bd8fde09aa71 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:21.853598 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53f065-45d1-4c0a-9610-bd8fde09aa71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:21.855555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53f065-45d1-4c0a-9610-bd8fde09aa71 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:21.866017 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:21.888899 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 796/1581] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:21 2022] POST /identity/v3/users => generated 297 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:21.890566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53f065-45d1-4c0a-9610-bd8fde09aa71 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:21.901902 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 786/1582] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:21 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:21.902379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53f065-45d1-4c0a-9610-bd8fde09aa71 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:21.902750 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372b0cc-0bb3-4b49-9121-dd3e43870f28 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:21.907748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefda774-a634-44a2-a59e-03ca7627cf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:21.908408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefda774-a634-44a2-a59e-03ca7627cf6b admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:21.908680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefda774-a634-44a2-a59e-03ca7627cf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:21.908952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefda774-a634-44a2-a59e-03ca7627cf6b admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:21.909731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefda774-a634-44a2-a59e-03ca7627cf6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:21.911641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefda774-a634-44a2-a59e-03ca7627cf6b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:21.914298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372b0cc-0bb3-4b49-9121-dd3e43870f28 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:21.920426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571728dc-c33d-41b7-a3ad-9749dac199d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:21.921067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571728dc-c33d-41b7-a3ad-9749dac199d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:21.921363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571728dc-c33d-41b7-a3ad-9749dac199d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:21.921651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571728dc-c33d-41b7-a3ad-9749dac199d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:21.922317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571728dc-c33d-41b7-a3ad-9749dac199d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:21.924079 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571728dc-c33d-41b7-a3ad-9749dac199d4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:21.935419 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 797/1583] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:21 2022] POST /identity/v3/users => generated 291 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:21.936254 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 787/1584] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:21.936539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefda774-a634-44a2-a59e-03ca7627cf6b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:21.937270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571728dc-c33d-41b7-a3ad-9749dac199d4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:21.951672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefda774-a634-44a2-a59e-03ca7627cf6b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:21.952710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571728dc-c33d-41b7-a3ad-9749dac199d4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:21.956770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e08b68-8a34-4080-bbb2-6f5976d66a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:21.957377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4c900-d534-4088-850d-f54b1347bf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:21.957507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e08b68-8a34-4080-bbb2-6f5976d66a9d admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:21.957781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e08b68-8a34-4080-bbb2-6f5976d66a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:21.957969 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4c900-d534-4088-850d-f54b1347bf7b admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:21.958093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e08b68-8a34-4080-bbb2-6f5976d66a9d admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:21.958291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4c900-d534-4088-850d-f54b1347bf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:21.958560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4c900-d534-4088-850d-f54b1347bf7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:21.959096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e08b68-8a34-4080-bbb2-6f5976d66a9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:21.959204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4c900-d534-4088-850d-f54b1347bf7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:21.960807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4c900-d534-4088-850d-f54b1347bf7b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:21.962601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e08b68-8a34-4080-bbb2-6f5976d66a9d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:21.974928 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 788/1585] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:21.974928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4c900-d534-4088-850d-f54b1347bf7b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:21.989451 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4c900-d534-4088-850d-f54b1347bf7b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:21.993495 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 798/1586] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:21 2022] POST /identity/v3/users => generated 291 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:21.994868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e08b68-8a34-4080-bbb2-6f5976d66a9d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:21.995083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed94bab-2c7b-40b4-b93f-14bf5bc05229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:21.995690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed94bab-2c7b-40b4-b93f-14bf5bc05229 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:21.996034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed94bab-2c7b-40b4-b93f-14bf5bc05229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:21.996340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed94bab-2c7b-40b4-b93f-14bf5bc05229 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:21.997030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed94bab-2c7b-40b4-b93f-14bf5bc05229 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:21.999132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed94bab-2c7b-40b4-b93f-14bf5bc05229 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:22.007484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e08b68-8a34-4080-bbb2-6f5976d66a9d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:22.012449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f639b-82d4-406e-b31d-3d571a2a4151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:22.013139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f639b-82d4-406e-b31d-3d571a2a4151 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:22.013394 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f639b-82d4-406e-b31d-3d571a2a4151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:22.013657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f639b-82d4-406e-b31d-3d571a2a4151 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:22.014304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f639b-82d4-406e-b31d-3d571a2a4151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:22.015950 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f639b-82d4-406e-b31d-3d571a2a4151 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:22.023947 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 789/1587] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:21 2022] POST /identity/v3/users => generated 292 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:22.024795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed94bab-2c7b-40b4-b93f-14bf5bc05229 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:22.027145 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 799/1588] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:22.028682 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f639b-82d4-406e-b31d-3d571a2a4151 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:22.038380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed94bab-2c7b-40b4-b93f-14bf5bc05229 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:22.041854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f639b-82d4-406e-b31d-3d571a2a4151 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:22.043118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb6628-30fa-4299-afcb-2e748102e9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:22.044363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb6628-30fa-4299-afcb-2e748102e9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:22.044636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb6628-30fa-4299-afcb-2e748102e9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:22.044900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb6628-30fa-4299-afcb-2e748102e9f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:22.045551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb6628-30fa-4299-afcb-2e748102e9f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:22.047157 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb6628-30fa-4299-afcb-2e748102e9f2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:22.047761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce0a0a-2082-43b1-8d9e-bc48601dfa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:22.048523 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce0a0a-2082-43b1-8d9e-bc48601dfa5a admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:22.048826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce0a0a-2082-43b1-8d9e-bc48601dfa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:22.049124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce0a0a-2082-43b1-8d9e-bc48601dfa5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:22.049902 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce0a0a-2082-43b1-8d9e-bc48601dfa5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:22.051805 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce0a0a-2082-43b1-8d9e-bc48601dfa5a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:22.059472 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 790/1589] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:22.062959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb6628-30fa-4299-afcb-2e748102e9f2 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:22.073410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb6628-30fa-4299-afcb-2e748102e9f2 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:22.078428 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97100006-ce9b-4f1e-9841-980055ca3904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:22.078973 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97100006-ce9b-4f1e-9841-980055ca3904 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:22.079251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97100006-ce9b-4f1e-9841-980055ca3904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:22.079524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97100006-ce9b-4f1e-9841-980055ca3904 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:22.080204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97100006-ce9b-4f1e-9841-980055ca3904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:22.081826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97100006-ce9b-4f1e-9841-980055ca3904 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:22.087009 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 800/1590] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:22 2022] POST /identity/v3/projects => generated 399 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:22.087009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce0a0a-2082-43b1-8d9e-bc48601dfa5a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:22.096727 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 791/1591] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:22.096727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97100006-ce9b-4f1e-9841-980055ca3904 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:22.107453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97100006-ce9b-4f1e-9841-980055ca3904 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:22.179265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce0a0a-2082-43b1-8d9e-bc48601dfa5a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:22.185820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d3841-9b65-4207-afce-839e95c4d7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:22.186433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d3841-9b65-4207-afce-839e95c4d7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:22.186702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d3841-9b65-4207-afce-839e95c4d7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:22.186995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d3841-9b65-4207-afce-839e95c4d7d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:22.187695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d3841-9b65-4207-afce-839e95c4d7d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:22.187913 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d6d3c-225a-45fd-986a-23590765d631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:22.188537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d6d3c-225a-45fd-986a-23590765d631 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:22.188814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d6d3c-225a-45fd-986a-23590765d631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:22.189111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d6d3c-225a-45fd-986a-23590765d631 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:22.189442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d3841-9b65-4207-afce-839e95c4d7d5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:22.189765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d6d3c-225a-45fd-986a-23590765d631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:22.191554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d6d3c-225a-45fd-986a-23590765d631 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:22.202639 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 801/1592] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:22.203699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d3841-9b65-4207-afce-839e95c4d7d5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:22.204164 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 792/1593] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:22.205013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d6d3c-225a-45fd-986a-23590765d631 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:22.217156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d3841-9b65-4207-afce-839e95c4d7d5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:22.219787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d6d3c-225a-45fd-986a-23590765d631 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:22.222348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcd49a-33c9-42b6-9a33-e85668b0a937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:22.222956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcd49a-33c9-42b6-9a33-e85668b0a937 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:22.223231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcd49a-33c9-42b6-9a33-e85668b0a937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:22.223500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcd49a-33c9-42b6-9a33-e85668b0a937 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:22.224209 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcd49a-33c9-42b6-9a33-e85668b0a937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:22.224635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb22be-8cbe-4c1a-afd6-8a801aa924be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:22.225220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb22be-8cbe-4c1a-afd6-8a801aa924be admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:22.225499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb22be-8cbe-4c1a-afd6-8a801aa924be admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:22.225767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb22be-8cbe-4c1a-afd6-8a801aa924be admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:22.226838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcd49a-33c9-42b6-9a33-e85668b0a937 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:22.226952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb22be-8cbe-4c1a-afd6-8a801aa924be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:22.228023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb22be-8cbe-4c1a-afd6-8a801aa924be admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:22.237111 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 802/1594] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:22.237972 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcd49a-33c9-42b6-9a33-e85668b0a937 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:22.240866 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 793/1595] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:22.242068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb22be-8cbe-4c1a-afd6-8a801aa924be admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:22.249820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcd49a-33c9-42b6-9a33-e85668b0a937 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:22.253109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb22be-8cbe-4c1a-afd6-8a801aa924be admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:22.255055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caeaf9e-208a-4b12-bc63-3cf07a8d2d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:22.255657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caeaf9e-208a-4b12-bc63-3cf07a8d2d07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:22.255962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caeaf9e-208a-4b12-bc63-3cf07a8d2d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:22.256237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caeaf9e-208a-4b12-bc63-3cf07a8d2d07 admin admin] PATH_INFO: `/v3/projects/f0aad067435e4b678ea13dbb920f03f4/users/103b3fb732e74594b778ee8991119a6c/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:22.258098 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ae4bc-bce8-44d0-8b78-fd7928fc9bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:22.258754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ae4bc-bce8-44d0-8b78-fd7928fc9bb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:22.259033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ae4bc-bce8-44d0-8b78-fd7928fc9bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:22.259702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ae4bc-bce8-44d0-8b78-fd7928fc9bb4 admin admin] PATH_INFO: `/v3/projects/889a01769c2748caa74da4b3340130eb/users/0b28c757c2104074a33ab785b590dd23/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:22.274797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caeaf9e-208a-4b12-bc63-3cf07a8d2d07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0aad067435e4b678ea13dbb920f03f4, user_id=103b3fb732e74594b778ee8991119a6c, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:22.278022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caeaf9e-208a-4b12-bc63-3cf07a8d2d07 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:22.278280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ae4bc-bce8-44d0-8b78-fd7928fc9bb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=889a01769c2748caa74da4b3340130eb, user_id=0b28c757c2104074a33ab785b590dd23, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:22.281211 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ae4bc-bce8-44d0-8b78-fd7928fc9bb4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:22.295592 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 803/1596] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:22 2022] PUT /identity/v3/projects/f0aad067435e4b678ea13dbb920f03f4/users/103b3fb732e74594b778ee8991119a6c/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:22.296843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caeaf9e-208a-4b12-bc63-3cf07a8d2d07 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:22.297874 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 794/1597] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:22 2022] PUT /identity/v3/projects/889a01769c2748caa74da4b3340130eb/users/0b28c757c2104074a33ab785b590dd23/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:22.298719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ae4bc-bce8-44d0-8b78-fd7928fc9bb4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:22.321001 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:22.357095 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:INSERT=10,keystone:SELECT=90 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:22.377007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caeaf9e-208a-4b12-bc63-3cf07a8d2d07 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:22.382938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ae4bc-bce8-44d0-8b78-fd7928fc9bb4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:22.383104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fa1e6-957d-4d9d-920e-5383c46d84fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:22.383724 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fa1e6-957d-4d9d-920e-5383c46d84fa admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:22.384052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fa1e6-957d-4d9d-920e-5383c46d84fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:22.384356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fa1e6-957d-4d9d-920e-5383c46d84fa admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:22.385033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6fa1e6-957d-4d9d-920e-5383c46d84fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:22.387125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6fa1e6-957d-4d9d-920e-5383c46d84fa admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:22.388784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a90c9d-2d8f-4d77-bb59-a3cd9e70da1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:22.389387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a90c9d-2d8f-4d77-bb59-a3cd9e70da1f admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:22.389668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a90c9d-2d8f-4d77-bb59-a3cd9e70da1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:22.389940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a90c9d-2d8f-4d77-bb59-a3cd9e70da1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:22.390595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a90c9d-2d8f-4d77-bb59-a3cd9e70da1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:22.392231 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a90c9d-2d8f-4d77-bb59-a3cd9e70da1f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:22.404538 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 795/1598] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:22.405646 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a90c9d-2d8f-4d77-bb59-a3cd9e70da1f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:22.415841 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 804/1599] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:22 2022] POST /identity/v3/users => generated 306 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:22.416149 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a90c9d-2d8f-4d77-bb59-a3cd9e70da1f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:22.420313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fa1e6-957d-4d9d-920e-5383c46d84fa admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:22.424359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a87679-3d5c-48c3-9a95-9a31d7b1f97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:22.425152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a87679-3d5c-48c3-9a95-9a31d7b1f97c admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:22.425525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a87679-3d5c-48c3-9a95-9a31d7b1f97c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:22.425732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a87679-3d5c-48c3-9a95-9a31d7b1f97c admin admin] PATH_INFO: `/v3/projects/0afe6dcb22ed4e028d37c9ec3e7c6474/users/897c3130dbe44598af2263a1ef3d5f04/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:22.432477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fa1e6-957d-4d9d-920e-5383c46d84fa admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:22.439191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957d431-2e33-444d-bc08-7c3338b66c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:22.439878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957d431-2e33-444d-bc08-7c3338b66c02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:22.440187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957d431-2e33-444d-bc08-7c3338b66c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:22.440467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3957d431-2e33-444d-bc08-7c3338b66c02 admin admin] PATH_INFO: `/v3/projects/248e2243d5a54a9d94e8452fe43680c8/users/60d4f703c4d6468e853b2a27d64df026/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:22.445011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a87679-3d5c-48c3-9a95-9a31d7b1f97c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0afe6dcb22ed4e028d37c9ec3e7c6474, user_id=897c3130dbe44598af2263a1ef3d5f04, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:22.447755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a87679-3d5c-48c3-9a95-9a31d7b1f97c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:22.459734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3957d431-2e33-444d-bc08-7c3338b66c02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=248e2243d5a54a9d94e8452fe43680c8, user_id=60d4f703c4d6468e853b2a27d64df026, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:22.462616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3957d431-2e33-444d-bc08-7c3338b66c02 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:22.464618 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 796/1600] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:22 2022] PUT /identity/v3/projects/0afe6dcb22ed4e028d37c9ec3e7c6474/users/897c3130dbe44598af2263a1ef3d5f04/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:22.465675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a87679-3d5c-48c3-9a95-9a31d7b1f97c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:22.489809 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 805/1601] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:22 2022] PUT /identity/v3/projects/248e2243d5a54a9d94e8452fe43680c8/users/60d4f703c4d6468e853b2a27d64df026/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:22.490932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957d431-2e33-444d-bc08-7c3338b66c02 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:22.549384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a87679-3d5c-48c3-9a95-9a31d7b1f97c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:22.575909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3957d431-2e33-444d-bc08-7c3338b66c02 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:22.580970 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26963a26-6619-48e4-897a-d48fc32a565a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:22.581590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26963a26-6619-48e4-897a-d48fc32a565a admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:22.581867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26963a26-6619-48e4-897a-d48fc32a565a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:22.582139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26963a26-6619-48e4-897a-d48fc32a565a admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:22.582795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26963a26-6619-48e4-897a-d48fc32a565a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:22.584463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26963a26-6619-48e4-897a-d48fc32a565a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:22.595739 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 806/1602] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:22.596700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26963a26-6619-48e4-897a-d48fc32a565a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:22.607827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26963a26-6619-48e4-897a-d48fc32a565a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:22.612808 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835c9a3-487d-459b-af7e-e9ca484d09f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:22.613254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec62367-71dc-4b19-9d14-0ab3be84404e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:22.613418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835c9a3-487d-459b-af7e-e9ca484d09f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:22.613700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835c9a3-487d-459b-af7e-e9ca484d09f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:22.613898 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec62367-71dc-4b19-9d14-0ab3be84404e admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:22.614114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835c9a3-487d-459b-af7e-e9ca484d09f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:22.614265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec62367-71dc-4b19-9d14-0ab3be84404e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:22.614433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec62367-71dc-4b19-9d14-0ab3be84404e admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:22.614766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2835c9a3-487d-459b-af7e-e9ca484d09f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:22.615107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec62367-71dc-4b19-9d14-0ab3be84404e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:22.616416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2835c9a3-487d-459b-af7e-e9ca484d09f7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:22.616747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec62367-71dc-4b19-9d14-0ab3be84404e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:22.627274 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 797/1603] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:22.628850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895b8b2-a69d-40f6-8671-2467d320a1f4 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:22.629116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895b8b2-a69d-40f6-8671-2467d320a1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:22.629380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895b8b2-a69d-40f6-8671-2467d320a1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:22.633154 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 807/1604] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:22.634590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835c9a3-487d-459b-af7e-e9ca484d09f7 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:22.653006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835c9a3-487d-459b-af7e-e9ca484d09f7 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:22.660668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e64a3-cd06-417f-82a2-cbdd35b19f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:22.661820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e64a3-cd06-417f-82a2-cbdd35b19f08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:22.662317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e64a3-cd06-417f-82a2-cbdd35b19f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:22.662427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-a895b8b2-a69d-40f6-8671-2467d320a1f4 None None] MFA Rules not processed for user `103b3fb732e74594b778ee8991119a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:22.662867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e64a3-cd06-417f-82a2-cbdd35b19f08 admin admin] PATH_INFO: `/v3/projects/c15e7e61e7eb4c9490b7632bde85d2cd/users/37a892781ecd4300b6dd10b9c235e263/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:22.663578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a895b8b2-a69d-40f6-8671-2467d320a1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:22.681185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e64a3-cd06-417f-82a2-cbdd35b19f08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c15e7e61e7eb4c9490b7632bde85d2cd, user_id=37a892781ecd4300b6dd10b9c235e263, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:22.683859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e64a3-cd06-417f-82a2-cbdd35b19f08 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:22.684078 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:22.702810 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 808/1605] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:22 2022] PUT /identity/v3/projects/c15e7e61e7eb4c9490b7632bde85d2cd/users/37a892781ecd4300b6dd10b9c235e263/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:22.703943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e64a3-cd06-417f-82a2-cbdd35b19f08 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:22.759594 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 798/1606] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:22.760871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb5b72-2ee8-4e73-a887-d42b213a187d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:22.761221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb5b72-2ee8-4e73-a887-d42b213a187d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:22.761502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb5b72-2ee8-4e73-a887-d42b213a187d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:22.776682 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e64a3-cd06-417f-82a2-cbdd35b19f08 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:22.782359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602b1ca-23e4-4b22-9fe0-9a5c62ddbd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:22.782961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602b1ca-23e4-4b22-9fe0-9a5c62ddbd42 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:22.783476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602b1ca-23e4-4b22-9fe0-9a5c62ddbd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:22.784510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602b1ca-23e4-4b22-9fe0-9a5c62ddbd42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:22.784510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602b1ca-23e4-4b22-9fe0-9a5c62ddbd42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:22.785942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602b1ca-23e4-4b22-9fe0-9a5c62ddbd42 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:22.792469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d9bb5b72-2ee8-4e73-a887-d42b213a187d None None] MFA Rules not processed for user `897c3130dbe44598af2263a1ef3d5f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:22.794683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d9bb5b72-2ee8-4e73-a887-d42b213a187d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:22.798551 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 809/1607] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:22.801639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a4fda-22e8-48ab-ba18-2ec3db66b840 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:22.802138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a4fda-22e8-48ab-ba18-2ec3db66b840 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:22.802629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a4fda-22e8-48ab-ba18-2ec3db66b840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:22.819368 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:22.836386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-497a4fda-22e8-48ab-ba18-2ec3db66b840 None None] MFA Rules not processed for user `60d4f703c4d6468e853b2a27d64df026`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:22.837716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-497a4fda-22e8-48ab-ba18-2ec3db66b840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:22.875191 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 799/1608] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:22.876416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb5b72-2ee8-4e73-a887-d42b213a187d None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:22.889432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb5b72-2ee8-4e73-a887-d42b213a187d None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:22.894801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca7506-5d63-4d2c-a98b-d4658d520708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:22.895474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca7506-5d63-4d2c-a98b-d4658d520708 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:22.895750 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca7506-5d63-4d2c-a98b-d4658d520708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:22.896066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca7506-5d63-4d2c-a98b-d4658d520708 admin admin] PATH_INFO: `/v3/projects/4100cbdf8697462ab2da94054ab02a82/users/fb017971b41b4cdf86c12b94dad84414/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:22.913333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca7506-5d63-4d2c-a98b-d4658d520708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4100cbdf8697462ab2da94054ab02a82, user_id=fb017971b41b4cdf86c12b94dad84414, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:22.916153 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca7506-5d63-4d2c-a98b-d4658d520708 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:22.924985 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 810/1609] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:22 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:22.925657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a4fda-22e8-48ab-ba18-2ec3db66b840 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:22.937176 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 800/1610] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:22 2022] PUT /identity/v3/projects/4100cbdf8697462ab2da94054ab02a82/users/fb017971b41b4cdf86c12b94dad84414/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:22.938105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca7506-5d63-4d2c-a98b-d4658d520708 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:22.945280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a4fda-22e8-48ab-ba18-2ec3db66b840 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:23.010373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca7506-5d63-4d2c-a98b-d4658d520708 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:23.016312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c91358-adf7-46a1-96d7-3beec87e2080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:23.016985 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c91358-adf7-46a1-96d7-3beec87e2080 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:23.017328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c91358-adf7-46a1-96d7-3beec87e2080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:23.017532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c91358-adf7-46a1-96d7-3beec87e2080 admin admin] PATH_INFO: `/v3/projects/889a01769c2748caa74da4b3340130eb/users/0b28c757c2104074a33ab785b590dd23/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:23.019575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c91358-adf7-46a1-96d7-3beec87e2080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=889a01769c2748caa74da4b3340130eb, user_id=0b28c757c2104074a33ab785b590dd23, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:23.022298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c91358-adf7-46a1-96d7-3beec87e2080 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:23.028781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f4f9c-a25b-40ad-bdb1-8f1da67d5638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:23.029959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f4f9c-a25b-40ad-bdb1-8f1da67d5638 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:23.030460 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f4f9c-a25b-40ad-bdb1-8f1da67d5638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:23.030944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f4f9c-a25b-40ad-bdb1-8f1da67d5638 admin admin] PATH_INFO: `/v3/projects/36e797af7651498dbfb2f2ee96bd2c5d/users/b270312bc8ea4cd7825a0a92788dac69/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:23.034671 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 801/1611] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:22 2022] PUT /identity/v3/projects/889a01769c2748caa74da4b3340130eb/users/0b28c757c2104074a33ab785b590dd23/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:23.036009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be7071-b120-469f-ba50-0e92be289e1e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:23.036293 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be7071-b120-469f-ba50-0e92be289e1e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:23.036580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be7071-b120-469f-ba50-0e92be289e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:23.059245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f4f9c-a25b-40ad-bdb1-8f1da67d5638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36e797af7651498dbfb2f2ee96bd2c5d, user_id=b270312bc8ea4cd7825a0a92788dac69, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:23.065409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f4f9c-a25b-40ad-bdb1-8f1da67d5638 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:23.074032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d4be7071-b120-469f-ba50-0e92be289e1e None None] MFA Rules not processed for user `37a892781ecd4300b6dd10b9c235e263`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:23.075325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d4be7071-b120-469f-ba50-0e92be289e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:23.081055 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:23.085684 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 811/1612] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:22 2022] PUT /identity/v3/projects/36e797af7651498dbfb2f2ee96bd2c5d/users/b270312bc8ea4cd7825a0a92788dac69/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:23.086675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f4f9c-a25b-40ad-bdb1-8f1da67d5638 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:23.154871 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 802/1613] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:23.155709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be7071-b120-469f-ba50-0e92be289e1e None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:23.164441 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f4f9c-a25b-40ad-bdb1-8f1da67d5638 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:23.170885 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f7319-b750-4893-842c-dd5f17c2aa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:23.171509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f7319-b750-4893-842c-dd5f17c2aa1e admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:23.171783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f7319-b750-4893-842c-dd5f17c2aa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:23.172079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f7319-b750-4893-842c-dd5f17c2aa1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:23.172749 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f7319-b750-4893-842c-dd5f17c2aa1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:23.174658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f7319-b750-4893-842c-dd5f17c2aa1e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:23.211338 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 812/1614] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:23 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:23.211338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f7319-b750-4893-842c-dd5f17c2aa1e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:23.216245 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:23.238106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be7071-b120-469f-ba50-0e92be289e1e None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:23.290662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f7319-b750-4893-842c-dd5f17c2aa1e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:23.295996 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8dc1b0-b728-47d9-8b46-4c120b808479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:23.296665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dc1b0-b728-47d9-8b46-4c120b808479 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:23.296945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dc1b0-b728-47d9-8b46-4c120b808479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:23.297215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dc1b0-b728-47d9-8b46-4c120b808479 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:23.297871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8dc1b0-b728-47d9-8b46-4c120b808479 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:23.299849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8dc1b0-b728-47d9-8b46-4c120b808479 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:23.313793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0c7044-a14c-445b-a3dd-4b8398ef8251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:23.314490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c7044-a14c-445b-a3dd-4b8398ef8251 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:23.314764 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c7044-a14c-445b-a3dd-4b8398ef8251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:23.315032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c7044-a14c-445b-a3dd-4b8398ef8251 admin admin] PATH_INFO: `/v3/projects/27d4c8103087466ebf02d5402b6edb35/users/72b47c4daf644a7eab24521c2f41dfdb/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:23.333288 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 813/1615] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:23 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:23.333556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c7044-a14c-445b-a3dd-4b8398ef8251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d4c8103087466ebf02d5402b6edb35, user_id=72b47c4daf644a7eab24521c2f41dfdb, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:23.334314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8dc1b0-b728-47d9-8b46-4c120b808479 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:23.336134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0c7044-a14c-445b-a3dd-4b8398ef8251 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:23.352157 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 803/1616] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:23 2022] PUT /identity/v3/projects/27d4c8103087466ebf02d5402b6edb35/users/72b47c4daf644a7eab24521c2f41dfdb/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:23.353494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adfc78-7bdc-4670-83c7-7be823a50912 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:23.353772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adfc78-7bdc-4670-83c7-7be823a50912 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:23.354045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adfc78-7bdc-4670-83c7-7be823a50912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:23.385144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-96adfc78-7bdc-4670-83c7-7be823a50912 None None] MFA Rules not processed for user `fb017971b41b4cdf86c12b94dad84414`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:23.386610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-96adfc78-7bdc-4670-83c7-7be823a50912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:23.409479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8dc1b0-b728-47d9-8b46-4c120b808479 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:23.415537 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:23.462424 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 804/1617] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:23.464651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7dd1a-1055-47fe-b609-8fc23b9628e3 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:23.465120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7dd1a-1055-47fe-b609-8fc23b9628e3 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:23.466271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7dd1a-1055-47fe-b609-8fc23b9628e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:23.473548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09f32c-87fc-4111-8432-6628fbf5d999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:23.474264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09f32c-87fc-4111-8432-6628fbf5d999 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:23.474548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09f32c-87fc-4111-8432-6628fbf5d999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:23.474818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09f32c-87fc-4111-8432-6628fbf5d999 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:23.475443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09f32c-87fc-4111-8432-6628fbf5d999 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:23.477565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09f32c-87fc-4111-8432-6628fbf5d999 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:23.510575 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 814/1618] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:23 2022] POST /identity/v3/projects => generated 397 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:23.510575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1213236-7af6-4c4e-bfa5-e8a8f28ca74e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:23.510575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1213236-7af6-4c4e-bfa5-e8a8f28ca74e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:23.510575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1213236-7af6-4c4e-bfa5-e8a8f28ca74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:23.514456 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9dd7dd1a-1055-47fe-b609-8fc23b9628e3 None None] MFA Rules not processed for user `0b28c757c2104074a33ab785b590dd23`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:23.516527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9dd7dd1a-1055-47fe-b609-8fc23b9628e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:23.540372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a1213236-7af6-4c4e-bfa5-e8a8f28ca74e None None] MFA Rules not processed for user `b270312bc8ea4cd7825a0a92788dac69`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:23.541695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a1213236-7af6-4c4e-bfa5-e8a8f28ca74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:23.552050 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:23.609642 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 805/1619] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:23.610473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7dd1a-1055-47fe-b609-8fc23b9628e3 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:23.626413 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 815/1620] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:23.627339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1213236-7af6-4c4e-bfa5-e8a8f28ca74e None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:23.693351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7dd1a-1055-47fe-b609-8fc23b9628e3 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:23.698024 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a2954-7506-4967-92b8-02ce26e99fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:23.698622 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a2954-7506-4967-92b8-02ce26e99fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:23.698894 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a2954-7506-4967-92b8-02ce26e99fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:23.699169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a2954-7506-4967-92b8-02ce26e99fe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:23.700727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a2954-7506-4967-92b8-02ce26e99fe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:23.702720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a2954-7506-4967-92b8-02ce26e99fe2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:23.707994 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1213236-7af6-4c4e-bfa5-e8a8f28ca74e None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:23.713523 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c547a-1604-4788-8a1a-954323df59e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:23.714146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c547a-1604-4788-8a1a-954323df59e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:23.714426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c547a-1604-4788-8a1a-954323df59e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:23.714700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c547a-1604-4788-8a1a-954323df59e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:23.715336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c547a-1604-4788-8a1a-954323df59e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:23.717429 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c547a-1604-4788-8a1a-954323df59e4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:23.738431 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 806/1621] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:23 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:23.741495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a2954-7506-4967-92b8-02ce26e99fe2 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:23.742140 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 816/1622] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:23 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:23.745346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c547a-1604-4788-8a1a-954323df59e4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:23.759825 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c547a-1604-4788-8a1a-954323df59e4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:23.811501 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:23.833277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45923e1e-4171-4168-b58b-ed1983b5b57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:23.834009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45923e1e-4171-4168-b58b-ed1983b5b57f admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:23.834348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45923e1e-4171-4168-b58b-ed1983b5b57f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:23.834682 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45923e1e-4171-4168-b58b-ed1983b5b57f admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:23.835774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45923e1e-4171-4168-b58b-ed1983b5b57f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:23.838215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45923e1e-4171-4168-b58b-ed1983b5b57f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:23.841993 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a2954-7506-4967-92b8-02ce26e99fe2 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:23.847593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705dff3-8942-467b-8a10-6008757c80b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:23.848259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705dff3-8942-467b-8a10-6008757c80b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:23.848560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705dff3-8942-467b-8a10-6008757c80b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:23.848857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705dff3-8942-467b-8a10-6008757c80b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:23.849452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705dff3-8942-467b-8a10-6008757c80b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:23.850901 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 817/1623] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:23.851380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705dff3-8942-467b-8a10-6008757c80b5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:23.851737 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45923e1e-4171-4168-b58b-ed1983b5b57f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:23.863381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45923e1e-4171-4168-b58b-ed1983b5b57f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:23.870437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d861a-c0d3-483b-8994-c794f69bd826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:23.871069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d861a-c0d3-483b-8994-c794f69bd826 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:23.871345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d861a-c0d3-483b-8994-c794f69bd826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:23.872364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d861a-c0d3-483b-8994-c794f69bd826 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:23.873029 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d861a-c0d3-483b-8994-c794f69bd826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:23.874942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d861a-c0d3-483b-8994-c794f69bd826 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:23.878312 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 807/1624] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:23 2022] POST /identity/v3/users => generated 300 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:23.880305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705dff3-8942-467b-8a10-6008757c80b5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:23.900343 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705dff3-8942-467b-8a10-6008757c80b5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:23.908568 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 818/1625] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:23 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:23.908568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d861a-c0d3-483b-8994-c794f69bd826 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:23.911376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846bbbaf-1b29-4b12-aede-b338b9574f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:23.912465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846bbbaf-1b29-4b12-aede-b338b9574f21 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:23.912955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846bbbaf-1b29-4b12-aede-b338b9574f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:23.913446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846bbbaf-1b29-4b12-aede-b338b9574f21 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:23.914585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846bbbaf-1b29-4b12-aede-b338b9574f21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:23.919012 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846bbbaf-1b29-4b12-aede-b338b9574f21 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:23.925884 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:23.953738 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 808/1626] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:23 2022] POST /identity/v3/users => generated 305 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:23.956082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41330af6-0f50-44df-9612-3638330edf8f None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:23.956796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41330af6-0f50-44df-9612-3638330edf8f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:23.957360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41330af6-0f50-44df-9612-3638330edf8f None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:23.959836 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 809/1627] 10.222.0.39 () {54 vars in 962 bytes} [Sun Aug 7 01:09:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:09:23.961212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41330af6-0f50-44df-9612-3638330edf8f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:23.977129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d861a-c0d3-483b-8994-c794f69bd826 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:23.982533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6218313-6e7b-404d-a068-e15af934c772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:23.983494 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6218313-6e7b-404d-a068-e15af934c772 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:23.984039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6218313-6e7b-404d-a068-e15af934c772 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:23.984476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6218313-6e7b-404d-a068-e15af934c772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:24.038330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41330af6-0f50-44df-9612-3638330edf8f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:24.044523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464324c6-70df-430b-b986-625a66bb6880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:24.045297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464324c6-70df-430b-b986-625a66bb6880 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:24.045435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464324c6-70df-430b-b986-625a66bb6880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:24.045669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464324c6-70df-430b-b986-625a66bb6880 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:24.046332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464324c6-70df-430b-b986-625a66bb6880 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:24.048370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464324c6-70df-430b-b986-625a66bb6880 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:24.051030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6218313-6e7b-404d-a068-e15af934c772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:24.052669 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6218313-6e7b-404d-a068-e15af934c772 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:24.063364 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 819/1628] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:24.064213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6218313-6e7b-404d-a068-e15af934c772 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:24.072254 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 810/1629] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:23 2022] POST /identity/v3/users => generated 298 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:24.073403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464324c6-70df-430b-b986-625a66bb6880 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:24.079488 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6218313-6e7b-404d-a068-e15af934c772 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:24.084130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfed524-8cac-4e78-82dd-1b8c191f7f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:24.084946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfed524-8cac-4e78-82dd-1b8c191f7f90 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:24.085094 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfed524-8cac-4e78-82dd-1b8c191f7f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:24.085206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464324c6-70df-430b-b986-625a66bb6880 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:24.085627 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfed524-8cac-4e78-82dd-1b8c191f7f90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:24.086095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfed524-8cac-4e78-82dd-1b8c191f7f90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:24.087831 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfed524-8cac-4e78-82dd-1b8c191f7f90 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:24.091719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fba2ea-dc6c-4a56-a2bc-be90674b9aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:24.092574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fba2ea-dc6c-4a56-a2bc-be90674b9aec admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:24.092845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fba2ea-dc6c-4a56-a2bc-be90674b9aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:24.093112 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fba2ea-dc6c-4a56-a2bc-be90674b9aec admin admin] PATH_INFO: `/v3/projects/27d4c8103087466ebf02d5402b6edb35/users/72b47c4daf644a7eab24521c2f41dfdb/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:24.095645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fba2ea-dc6c-4a56-a2bc-be90674b9aec admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d4c8103087466ebf02d5402b6edb35, user_id=72b47c4daf644a7eab24521c2f41dfdb, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:24.102076 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fba2ea-dc6c-4a56-a2bc-be90674b9aec admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:24.102255 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 820/1630] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:24.102255 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfed524-8cac-4e78-82dd-1b8c191f7f90 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:24.112594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfed524-8cac-4e78-82dd-1b8c191f7f90 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:24.117016 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 811/1631] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:24 2022] PUT /identity/v3/projects/27d4c8103087466ebf02d5402b6edb35/users/72b47c4daf644a7eab24521c2f41dfdb/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:24.117783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fba2ea-dc6c-4a56-a2bc-be90674b9aec admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:24.198962 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fba2ea-dc6c-4a56-a2bc-be90674b9aec admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:24.201216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06841c6-5291-4881-8955-0c10fd423989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:24.201826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06841c6-5291-4881-8955-0c10fd423989 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:24.202105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06841c6-5291-4881-8955-0c10fd423989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:24.202380 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06841c6-5291-4881-8955-0c10fd423989 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:24.203118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06841c6-5291-4881-8955-0c10fd423989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:24.205105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06841c6-5291-4881-8955-0c10fd423989 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:24.207118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a721dd-3975-4c8b-bd18-785715c44f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:24.208421 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a721dd-3975-4c8b-bd18-785715c44f87 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:24.208885 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a721dd-3975-4c8b-bd18-785715c44f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:24.209308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a721dd-3975-4c8b-bd18-785715c44f87 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:24.210283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a721dd-3975-4c8b-bd18-785715c44f87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:24.214793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a721dd-3975-4c8b-bd18-785715c44f87 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:24.216751 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 821/1632] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:24.217616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06841c6-5291-4881-8955-0c10fd423989 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:24.228382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06841c6-5291-4881-8955-0c10fd423989 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:24.235008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdf9c1-d871-480b-998a-b3f7c214c7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:24.235714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdf9c1-d871-480b-998a-b3f7c214c7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:24.236059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdf9c1-d871-480b-998a-b3f7c214c7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:24.236397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdf9c1-d871-480b-998a-b3f7c214c7f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:24.237242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bdf9c1-d871-480b-998a-b3f7c214c7f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:24.239371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bdf9c1-d871-480b-998a-b3f7c214c7f0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:24.248291 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 812/1633] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:24 2022] POST /identity/v3/users => generated 297 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:24.249487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769db8d4-990e-42db-ab0f-ae4328ad35d9 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:24.249864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769db8d4-990e-42db-ab0f-ae4328ad35d9 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:24.250210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769db8d4-990e-42db-ab0f-ae4328ad35d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:24.258659 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 822/1634] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:24.259551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdf9c1-d871-480b-998a-b3f7c214c7f0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:24.275901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdf9c1-d871-480b-998a-b3f7c214c7f0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:24.281876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88443a35-f809-434e-a382-09d0f35e2372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:24.282686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88443a35-f809-434e-a382-09d0f35e2372 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:24.282992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88443a35-f809-434e-a382-09d0f35e2372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:24.283313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88443a35-f809-434e-a382-09d0f35e2372 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:24.284157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88443a35-f809-434e-a382-09d0f35e2372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:24.285983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88443a35-f809-434e-a382-09d0f35e2372 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:24.293483 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:24.304818 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 823/1635] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:24.304818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88443a35-f809-434e-a382-09d0f35e2372 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:24.312218 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-769db8d4-990e-42db-ab0f-ae4328ad35d9 None None] MFA Rules not processed for user `6c70d5a72d424db68de7c7b8257fe02c`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:24.313757 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-769db8d4-990e-42db-ab0f-ae4328ad35d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:24.321024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88443a35-f809-434e-a382-09d0f35e2372 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:24.327757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596cfee-fa6e-4e17-850a-19130d148598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:24.328528 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596cfee-fa6e-4e17-850a-19130d148598 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:24.328846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596cfee-fa6e-4e17-850a-19130d148598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:24.329144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596cfee-fa6e-4e17-850a-19130d148598 admin admin] PATH_INFO: `/v3/projects/a0d56d35a6334ac68246c1e9f49054e7/users/236f96764f304ecc825e3f1a2093f924/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:24.350309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4596cfee-fa6e-4e17-850a-19130d148598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0d56d35a6334ac68246c1e9f49054e7, user_id=236f96764f304ecc825e3f1a2093f924, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:24.353531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4596cfee-fa6e-4e17-850a-19130d148598 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:24.370574 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 824/1636] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:24 2022] PUT /identity/v3/projects/a0d56d35a6334ac68246c1e9f49054e7/users/236f96764f304ecc825e3f1a2093f924/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:24.372424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aef426-1cb6-49d0-83df-73b150f792d1 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:24.372711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aef426-1cb6-49d0-83df-73b150f792d1 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:24.372987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aef426-1cb6-49d0-83df-73b150f792d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:24.395509 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:24.411179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-52aef426-1cb6-49d0-83df-73b150f792d1 None None] MFA Rules not processed for user `72b47c4daf644a7eab24521c2f41dfdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:24.413303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-52aef426-1cb6-49d0-83df-73b150f792d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:24.426000 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 813/1637] 10.222.0.39 () {58 vars in 1059 bytes} [Sun Aug 7 01:09:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:24.427469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769db8d4-990e-42db-ab0f-ae4328ad35d9 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:24.438888 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769db8d4-990e-42db-ab0f-ae4328ad35d9 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:24.495723 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 825/1638] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:24 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:24.497310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aef426-1cb6-49d0-83df-73b150f792d1 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:24.503358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b14b4-d80d-4b0b-ab67-72ebbdb67aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:24.504402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b14b4-d80d-4b0b-ab67-72ebbdb67aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:24.504693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b14b4-d80d-4b0b-ab67-72ebbdb67aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:24.505110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b14b4-d80d-4b0b-ab67-72ebbdb67aa0 admin admin] PATH_INFO: `/v3/projects/e29bf6c8c2cb469492d158acd882a854/users/05a8fe7bfdd543998711596f61316191/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:24.526337 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372b14b4-d80d-4b0b-ab67-72ebbdb67aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e29bf6c8c2cb469492d158acd882a854, user_id=05a8fe7bfdd543998711596f61316191, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:24.532329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372b14b4-d80d-4b0b-ab67-72ebbdb67aa0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:24.552050 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 814/1639] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:24 2022] PUT /identity/v3/projects/e29bf6c8c2cb469492d158acd882a854/users/05a8fe7bfdd543998711596f61316191/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:24.553004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b14b4-d80d-4b0b-ab67-72ebbdb67aa0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:24.579825 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aef426-1cb6-49d0-83df-73b150f792d1 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:24.622619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b14b4-d80d-4b0b-ab67-72ebbdb67aa0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:24.627347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441cfb7-fe58-4fab-9545-d7ec4fa71364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:24.628048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441cfb7-fe58-4fab-9545-d7ec4fa71364 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:24.628335 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441cfb7-fe58-4fab-9545-d7ec4fa71364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:24.628601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441cfb7-fe58-4fab-9545-d7ec4fa71364 admin admin] PATH_INFO: `/v3/projects/60b8430a79264d20b633391ab7bc6790/users/c7f69d5acc5547dba7f05bd2ea205e71/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:24.645550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20829c-61a6-4c80-900c-d8144665c5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:24.645775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441cfb7-fe58-4fab-9545-d7ec4fa71364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60b8430a79264d20b633391ab7bc6790, user_id=c7f69d5acc5547dba7f05bd2ea205e71, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:24.646158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20829c-61a6-4c80-900c-d8144665c5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:24.646429 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20829c-61a6-4c80-900c-d8144665c5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:24.646699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20829c-61a6-4c80-900c-d8144665c5c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:24.647342 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20829c-61a6-4c80-900c-d8144665c5c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:24.648468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441cfb7-fe58-4fab-9545-d7ec4fa71364 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:24.648948 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20829c-61a6-4c80-900c-d8144665c5c1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:24.660548 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:24.664388 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 826/1640] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:24.664388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20829c-61a6-4c80-900c-d8144665c5c1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:24.666160 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 815/1641] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:24 2022] PUT /identity/v3/projects/60b8430a79264d20b633391ab7bc6790/users/c7f69d5acc5547dba7f05bd2ea205e71/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:24.667131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441cfb7-fe58-4fab-9545-d7ec4fa71364 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:24.673418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20829c-61a6-4c80-900c-d8144665c5c1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:24.712378 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:24.738390 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3dfa44-a474-4a23-852e-c37719929e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:24.739134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3dfa44-a474-4a23-852e-c37719929e40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:24.739411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3dfa44-a474-4a23-852e-c37719929e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:24.739698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3dfa44-a474-4a23-852e-c37719929e40 admin admin] PATH_INFO: `/v3/projects/5990c8b61fe5439fb2ae91810d353225/users/e8b354f4536d40d3adedc0c10609d467/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:24.739955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441cfb7-fe58-4fab-9545-d7ec4fa71364 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:24.744894 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0b999-8e0c-4cdb-9b20-a5587c52964f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:24.745504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0b999-8e0c-4cdb-9b20-a5587c52964f admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:24.745847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0b999-8e0c-4cdb-9b20-a5587c52964f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:24.746087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0b999-8e0c-4cdb-9b20-a5587c52964f admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:24.746803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0b999-8e0c-4cdb-9b20-a5587c52964f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:24.748463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0b999-8e0c-4cdb-9b20-a5587c52964f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:24.755265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3dfa44-a474-4a23-852e-c37719929e40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5990c8b61fe5439fb2ae91810d353225, user_id=e8b354f4536d40d3adedc0c10609d467, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:24.757898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3dfa44-a474-4a23-852e-c37719929e40 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:24.760235 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 816/1642] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:24.761306 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0b999-8e0c-4cdb-9b20-a5587c52964f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:24.777133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0b999-8e0c-4cdb-9b20-a5587c52964f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:24.780639 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 827/1643] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:24 2022] PUT /identity/v3/projects/5990c8b61fe5439fb2ae91810d353225/users/e8b354f4536d40d3adedc0c10609d467/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:24.781533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3dfa44-a474-4a23-852e-c37719929e40 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:24.852762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7a879-7af8-4a45-950f-0a234a2c3eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:24.853395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7a879-7af8-4a45-950f-0a234a2c3eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:24.853678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7a879-7af8-4a45-950f-0a234a2c3eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:24.853943 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7a879-7af8-4a45-950f-0a234a2c3eb8 admin admin] PATH_INFO: `/v3/users/b270312bc8ea4cd7825a0a92788dac69` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:24.855121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7a879-7af8-4a45-950f-0a234a2c3eb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b270312bc8ea4cd7825a0a92788dac69)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:24.857089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7a879-7af8-4a45-950f-0a234a2c3eb8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:24.861284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3dfa44-a474-4a23-852e-c37719929e40 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:24.871687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2d9a2-7d1a-453a-ba2f-212ce66e0c03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:24.871687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2d9a2-7d1a-453a-ba2f-212ce66e0c03 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:24.871687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2d9a2-7d1a-453a-ba2f-212ce66e0c03 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:24.871687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2d9a2-7d1a-453a-ba2f-212ce66e0c03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:24.920348 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-03e7a879-7af8-4a45-950f-0a234a2c3eb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b270312bc8ea4cd7825a0a92788dac69'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:24.928509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-03e7a879-7af8-4a45-950f-0a234a2c3eb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b270312bc8ea4cd7825a0a92788dac69'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:24.937739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2d9a2-7d1a-453a-ba2f-212ce66e0c03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:24.939586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2d9a2-7d1a-453a-ba2f-212ce66e0c03 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:24.942993 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-03e7a879-7af8-4a45-950f-0a234a2c3eb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b270312bc8ea4cd7825a0a92788dac69'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:24.943906 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-03e7a879-7af8-4a45-950f-0a234a2c3eb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b270312bc8ea4cd7825a0a92788dac69'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:24.950691 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 828/1644] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:24.952593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67698847-b28a-43f5-b928-471b4ff75aae None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:24.952593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67698847-b28a-43f5-b928-471b4ff75aae None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:24.952882 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67698847-b28a-43f5-b928-471b4ff75aae None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:24.953329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-03e7a879-7af8-4a45-950f-0a234a2c3eb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b270312bc8ea4cd7825a0a92788dac69'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:24.954657 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 829/1645] 10.222.0.39 () {54 vars in 962 bytes} [Sun Aug 7 01:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:09:24.959797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67698847-b28a-43f5-b928-471b4ff75aae None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:24.961451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-67698847-b28a-43f5-b928-471b4ff75aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:24.966234 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 817/1646] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:09:24 2022] DELETE /identity/v3/users/b270312bc8ea4cd7825a0a92788dac69 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:24.966234 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7a879-7af8-4a45-950f-0a234a2c3eb8 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:24.971633 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-03e7a879-7af8-4a45-950f-0a234a2c3eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:25.005266 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:25.047615 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:25.053589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67698847-b28a-43f5-b928-471b4ff75aae None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:25.060469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76470a-ade0-48bb-966e-59219c11c001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:25.061158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76470a-ade0-48bb-966e-59219c11c001 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:25.061637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76470a-ade0-48bb-966e-59219c11c001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:25.061932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76470a-ade0-48bb-966e-59219c11c001 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:25.062654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76470a-ade0-48bb-966e-59219c11c001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:25.064359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76470a-ade0-48bb-966e-59219c11c001 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:25.074634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7a879-7af8-4a45-950f-0a234a2c3eb8 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:25.075697 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 830/1647] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:25.079790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76470a-ade0-48bb-966e-59219c11c001 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:25.080957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14d0af-8c28-411a-9270-1cbae22288a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:25.082821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3d76470a-ade0-48bb-966e-59219c11c001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:25.083509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14d0af-8c28-411a-9270-1cbae22288a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:25.084008 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14d0af-8c28-411a-9270-1cbae22288a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:25.084406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14d0af-8c28-411a-9270-1cbae22288a9 admin admin] PATH_INFO: `/v3/projects/8329ceada8244e55b467957d108fc43b/users/fdd64e9af9744fbea3765833eedeb117/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:25.097524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76470a-ade0-48bb-966e-59219c11c001 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:25.103866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac477f8f-593c-4dd0-bf77-8d736ed08e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:25.104696 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac477f8f-593c-4dd0-bf77-8d736ed08e82 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:25.104824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a14d0af-8c28-411a-9270-1cbae22288a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8329ceada8244e55b467957d108fc43b, user_id=fdd64e9af9744fbea3765833eedeb117, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:25.105004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac477f8f-593c-4dd0-bf77-8d736ed08e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:25.105329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac477f8f-593c-4dd0-bf77-8d736ed08e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:25.106533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac477f8f-593c-4dd0-bf77-8d736ed08e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:25.108082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a14d0af-8c28-411a-9270-1cbae22288a9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:25.108227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac477f8f-593c-4dd0-bf77-8d736ed08e82 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:25.124265 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 831/1648] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:25.124265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac477f8f-593c-4dd0-bf77-8d736ed08e82 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:25.124926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ac477f8f-593c-4dd0-bf77-8d736ed08e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:25.127162 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 818/1649] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:24 2022] PUT /identity/v3/projects/8329ceada8244e55b467957d108fc43b/users/fdd64e9af9744fbea3765833eedeb117/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:25.128065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14d0af-8c28-411a-9270-1cbae22288a9 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:25.129879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8a14d0af-8c28-411a-9270-1cbae22288a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:25.138769 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac477f8f-593c-4dd0-bf77-8d736ed08e82 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:25.211552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c2581-9b16-481e-a7c1-f61da1ceae3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:25.212300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c2581-9b16-481e-a7c1-f61da1ceae3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:25.212581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c2581-9b16-481e-a7c1-f61da1ceae3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:25.212858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c2581-9b16-481e-a7c1-f61da1ceae3d admin admin] PATH_INFO: `/v3/projects/a0d56d35a6334ac68246c1e9f49054e7/users/236f96764f304ecc825e3f1a2093f924/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:25.214841 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c2581-9b16-481e-a7c1-f61da1ceae3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0d56d35a6334ac68246c1e9f49054e7, user_id=236f96764f304ecc825e3f1a2093f924, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:25.216433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14d0af-8c28-411a-9270-1cbae22288a9 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:25.218323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438c2581-9b16-481e-a7c1-f61da1ceae3d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:25.221341 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58553d80-0e7c-406a-a6da-f9b63018d21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:25.222132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58553d80-0e7c-406a-a6da-f9b63018d21c admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:25.222420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58553d80-0e7c-406a-a6da-f9b63018d21c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:25.222729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58553d80-0e7c-406a-a6da-f9b63018d21c admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:25.223483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58553d80-0e7c-406a-a6da-f9b63018d21c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:25.225249 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58553d80-0e7c-406a-a6da-f9b63018d21c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:25.230737 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 832/1650] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:25 2022] PUT /identity/v3/projects/a0d56d35a6334ac68246c1e9f49054e7/users/236f96764f304ecc825e3f1a2093f924/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:25.232116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b034dbf-9693-4a16-8060-b38c6b19936e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:25.232401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b034dbf-9693-4a16-8060-b38c6b19936e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:25.232673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b034dbf-9693-4a16-8060-b38c6b19936e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:25.239973 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 819/1651] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:25.239973 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb0191-137a-4871-8146-d958d0d000c0 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:25.239973 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb0191-137a-4871-8146-d958d0d000c0 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:25.239973 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb0191-137a-4871-8146-d958d0d000c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:25.263452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9b034dbf-9693-4a16-8060-b38c6b19936e None None] MFA Rules not processed for user `6c70d5a72d424db68de7c7b8257fe02c`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:25.263817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-afbb0191-137a-4871-8146-d958d0d000c0 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:25.265299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9b034dbf-9693-4a16-8060-b38c6b19936e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:25.265441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-afbb0191-137a-4871-8146-d958d0d000c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:25.328939 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 820/1652] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:25.333335 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb0191-137a-4871-8146-d958d0d000c0 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:25.343666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb0191-137a-4871-8146-d958d0d000c0 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:25.348470 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 833/1653] 10.222.0.39 () {58 vars in 1059 bytes} [Sun Aug 7 01:09:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:25.348669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b579677-2c19-4ed9-b5af-faaa628e998c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:25.349431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b034dbf-9693-4a16-8060-b38c6b19936e None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:25.349541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b579677-2c19-4ed9-b5af-faaa628e998c admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:25.349756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b579677-2c19-4ed9-b5af-faaa628e998c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:25.350019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b579677-2c19-4ed9-b5af-faaa628e998c admin admin] PATH_INFO: `/v3/projects/e29bf6c8c2cb469492d158acd882a854/users/05a8fe7bfdd543998711596f61316191/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:25.351973 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b579677-2c19-4ed9-b5af-faaa628e998c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e29bf6c8c2cb469492d158acd882a854, user_id=05a8fe7bfdd543998711596f61316191, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:25.354647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b579677-2c19-4ed9-b5af-faaa628e998c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:25.360790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b034dbf-9693-4a16-8060-b38c6b19936e None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:25.366362 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 821/1654] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:25 2022] PUT /identity/v3/projects/e29bf6c8c2cb469492d158acd882a854/users/05a8fe7bfdd543998711596f61316191/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:25.367217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b579677-2c19-4ed9-b5af-faaa628e998c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:25.408713 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:25.426563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c6ab9-7f9f-4068-b5b2-417bcf592d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:25.427532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c6ab9-7f9f-4068-b5b2-417bcf592d86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:25.428024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c6ab9-7f9f-4068-b5b2-417bcf592d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:25.428215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c6ab9-7f9f-4068-b5b2-417bcf592d86 admin admin] PATH_INFO: `/v3/projects/60b8430a79264d20b633391ab7bc6790/users/c7f69d5acc5547dba7f05bd2ea205e71/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:25.430331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c6ab9-7f9f-4068-b5b2-417bcf592d86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60b8430a79264d20b633391ab7bc6790, user_id=c7f69d5acc5547dba7f05bd2ea205e71, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:25.435092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c6ab9-7f9f-4068-b5b2-417bcf592d86 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:25.447640 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 834/1655] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:25 2022] PUT /identity/v3/projects/60b8430a79264d20b633391ab7bc6790/users/c7f69d5acc5547dba7f05bd2ea205e71/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:25.448440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c6ab9-7f9f-4068-b5b2-417bcf592d86 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:25.450588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-170c6ab9-7f9f-4068-b5b2-417bcf592d86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:25.455411 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:25.464131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b579677-2c19-4ed9-b5af-faaa628e998c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:25.530637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526177a0-8369-4364-9670-cde033f31d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:25.531151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526177a0-8369-4364-9670-cde033f31d72 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:25.531437 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526177a0-8369-4364-9670-cde033f31d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:25.531703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526177a0-8369-4364-9670-cde033f31d72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:25.532425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526177a0-8369-4364-9670-cde033f31d72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:25.533139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c6ab9-7f9f-4068-b5b2-417bcf592d86 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:25.534042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526177a0-8369-4364-9670-cde033f31d72 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:25.538144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba3849-bae8-415a-b3bd-948596317fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:25.538846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba3849-bae8-415a-b3bd-948596317fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:25.539128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba3849-bae8-415a-b3bd-948596317fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:25.539420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba3849-bae8-415a-b3bd-948596317fe2 admin admin] PATH_INFO: `/v3/users/ffa98b97de414051938bcbce678fcb27` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:25.540782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba3849-bae8-415a-b3bd-948596317fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffa98b97de414051938bcbce678fcb27)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:25.541909 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-ccba3849-bae8-415a-b3bd-948596317fe2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:25.541909 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:09:25.541909 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:09:25.543147 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba3849-bae8-415a-b3bd-948596317fe2 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:25.545182 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 822/1656] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:25.546030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526177a0-8369-4364-9670-cde033f31d72 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:25.556195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526177a0-8369-4364-9670-cde033f31d72 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:25.562330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc928c4e-7055-4da9-8485-754c8b3cecbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:25.563538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc928c4e-7055-4da9-8485-754c8b3cecbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:25.564025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc928c4e-7055-4da9-8485-754c8b3cecbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:25.564531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc928c4e-7055-4da9-8485-754c8b3cecbe admin admin] PATH_INFO: `/v3/projects/5990c8b61fe5439fb2ae91810d353225/users/e8b354f4536d40d3adedc0c10609d467/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:25.566885 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc928c4e-7055-4da9-8485-754c8b3cecbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5990c8b61fe5439fb2ae91810d353225, user_id=e8b354f4536d40d3adedc0c10609d467, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:25.570254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc928c4e-7055-4da9-8485-754c8b3cecbe admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:25.584767 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 823/1657] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:25 2022] PUT /identity/v3/projects/5990c8b61fe5439fb2ae91810d353225/users/e8b354f4536d40d3adedc0c10609d467/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:25.586545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b589f1a-205f-4af8-9abb-ddeb88fd5b42 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:25.586835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b589f1a-205f-4af8-9abb-ddeb88fd5b42 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:25.587110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b589f1a-205f-4af8-9abb-ddeb88fd5b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:25.625080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6b589f1a-205f-4af8-9abb-ddeb88fd5b42 None None] MFA Rules not processed for user `236f96764f304ecc825e3f1a2093f924`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:25.626319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6b589f1a-205f-4af8-9abb-ddeb88fd5b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:25.646553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ccba3849-bae8-415a-b3bd-948596317fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffa98b97de414051938bcbce678fcb27'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:25.660689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ccba3849-bae8-415a-b3bd-948596317fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffa98b97de414051938bcbce678fcb27'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:25.682624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ccba3849-bae8-415a-b3bd-948596317fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffa98b97de414051938bcbce678fcb27'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:25.683404 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ccba3849-bae8-415a-b3bd-948596317fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffa98b97de414051938bcbce678fcb27'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:25.691895 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ccba3849-bae8-415a-b3bd-948596317fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffa98b97de414051938bcbce678fcb27'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:25.699604 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 835/1658] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:09:25 2022] DELETE /identity/v3/users/ffa98b97de414051938bcbce678fcb27 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:25.700717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba3849-bae8-415a-b3bd-948596317fe2 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:25.702299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ccba3849-bae8-415a-b3bd-948596317fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:25.709654 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 824/1659] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:25.710377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b589f1a-205f-4af8-9abb-ddeb88fd5b42 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:25.711680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6b589f1a-205f-4af8-9abb-ddeb88fd5b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:25.762299 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:25.772724 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba3849-bae8-415a-b3bd-948596317fe2 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:25.777608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8dd23-ced9-45b2-bc05-4c491296779e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:25.779026 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8dd23-ced9-45b2-bc05-4c491296779e service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:25.779026 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8dd23-ced9-45b2-bc05-4c491296779e service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:25.779247 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8dd23-ced9-45b2-bc05-4c491296779e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:25.781155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-daa8dd23-ced9-45b2-bc05-4c491296779e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:25.800217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b589f1a-205f-4af8-9abb-ddeb88fd5b42 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:25.819430 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:25.858757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8dd23-ced9-45b2-bc05-4c491296779e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:25.860564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8dd23-ced9-45b2-bc05-4c491296779e service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:25.871359 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 836/1660] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:25.871913 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887af52-dac4-4448-927f-6fcbaaa75123 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:25.872566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887af52-dac4-4448-927f-6fcbaaa75123 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:25.872826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887af52-dac4-4448-927f-6fcbaaa75123 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:25.872972 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018df35c-347d-40ea-9544-97ad45778681 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:25.873102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887af52-dac4-4448-927f-6fcbaaa75123 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:25.873271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018df35c-347d-40ea-9544-97ad45778681 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:25.873409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018df35c-347d-40ea-9544-97ad45778681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:25.875006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d887af52-dac4-4448-927f-6fcbaaa75123 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:25.908248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-018df35c-347d-40ea-9544-97ad45778681 None None] MFA Rules not processed for user `05a8fe7bfdd543998711596f61316191`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:25.909591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-018df35c-347d-40ea-9544-97ad45778681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:26.010930 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887af52-dac4-4448-927f-6fcbaaa75123 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:26.013763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887af52-dac4-4448-927f-6fcbaaa75123 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:26.022290 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 837/1661] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:26.024596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d0b1a-f120-479d-9a94-3994fcf28c04 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:26.024982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d0b1a-f120-479d-9a94-3994fcf28c04 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:26.025740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d0b1a-f120-479d-9a94-3994fcf28c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:26.035351 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 825/1662] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:25 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:26.036543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887af52-dac4-4448-927f-6fcbaaa75123 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:26.038681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d887af52-dac4-4448-927f-6fcbaaa75123 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:26.060039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887af52-dac4-4448-927f-6fcbaaa75123 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:26.065485 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-fc2d0b1a-f120-479d-9a94-3994fcf28c04 None None] MFA Rules not processed for user `c7f69d5acc5547dba7f05bd2ea205e71`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:26.067181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fc2d0b1a-f120-479d-9a94-3994fcf28c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:26.068587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f84ffa-2f01-4347-a968-e383d1ab9463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:26.069627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f84ffa-2f01-4347-a968-e383d1ab9463 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:26.070072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f84ffa-2f01-4347-a968-e383d1ab9463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:26.070503 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f84ffa-2f01-4347-a968-e383d1ab9463 admin admin] PATH_INFO: `/v3/projects/8329ceada8244e55b467957d108fc43b/users/fdd64e9af9744fbea3765833eedeb117/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:26.073687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f84ffa-2f01-4347-a968-e383d1ab9463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8329ceada8244e55b467957d108fc43b, user_id=fdd64e9af9744fbea3765833eedeb117, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:26.079066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f84ffa-2f01-4347-a968-e383d1ab9463 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:26.112130 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 826/1663] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:26 2022] PUT /identity/v3/projects/8329ceada8244e55b467957d108fc43b/users/fdd64e9af9744fbea3765833eedeb117/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:26.116701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ee856-797c-4df0-9a54-4105b9108af4 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:26.117182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ee856-797c-4df0-9a54-4105b9108af4 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:26.117682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ee856-797c-4df0-9a54-4105b9108af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:26.170482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0e5ee856-797c-4df0-9a54-4105b9108af4 None None] MFA Rules not processed for user `e8b354f4536d40d3adedc0c10609d467`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:26.172353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0e5ee856-797c-4df0-9a54-4105b9108af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:26.235688 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 838/1664] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:26 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:26.238126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9c7af-d2da-414d-b7a9-14e53696cb66 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:26.238813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9c7af-d2da-414d-b7a9-14e53696cb66 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:26.239303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9c7af-d2da-414d-b7a9-14e53696cb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:26.252178 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:26.280073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-13b9c7af-d2da-414d-b7a9-14e53696cb66 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:26.282056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-13b9c7af-d2da-414d-b7a9-14e53696cb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:26.308454 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 827/1665] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:26.310051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ee856-797c-4df0-9a54-4105b9108af4 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:26.311933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0e5ee856-797c-4df0-9a54-4105b9108af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:26.365571 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:26.421298 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 839/1666] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:26.424014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54be451-6570-47c9-bccf-56a63b11619e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:26.428185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54be451-6570-47c9-bccf-56a63b11619e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:26.428704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54be451-6570-47c9-bccf-56a63b11619e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:26.435858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ee856-797c-4df0-9a54-4105b9108af4 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:26.444524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f1526-4789-42db-bdae-b999e27c342b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:26.445156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f1526-4789-42db-bdae-b999e27c342b service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:26.445983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f1526-4789-42db-bdae-b999e27c342b service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:26.445983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f1526-4789-42db-bdae-b999e27c342b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:26.473892 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c54be451-6570-47c9-bccf-56a63b11619e None None] MFA Rules not processed for user `fdd64e9af9744fbea3765833eedeb117`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:26.475969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c54be451-6570-47c9-bccf-56a63b11619e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:26.517634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f1526-4789-42db-bdae-b999e27c342b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:26.519567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f1526-4789-42db-bdae-b999e27c342b service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:26.531169 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 828/1667] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:26 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:26.532067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f1526-4789-42db-bdae-b999e27c342b service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:26.543149 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f1526-4789-42db-bdae-b999e27c342b service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:26.550332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f3bd6-8c5a-4059-a22e-dda3d8c84079 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:26.550881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f3bd6-8c5a-4059-a22e-dda3d8c84079 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:26.552257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f3bd6-8c5a-4059-a22e-dda3d8c84079 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:26.552257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f3bd6-8c5a-4059-a22e-dda3d8c84079 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:26.581501 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 840/1668] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:26 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:26.584867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54be451-6570-47c9-bccf-56a63b11619e None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:26.589282 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c54be451-6570-47c9-bccf-56a63b11619e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:26.605923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54be451-6570-47c9-bccf-56a63b11619e None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:26.620339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405db63-09e7-4c50-8f37-915adfcbbfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:26.622366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405db63-09e7-4c50-8f37-915adfcbbfa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:26.622905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405db63-09e7-4c50-8f37-915adfcbbfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:26.623526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405db63-09e7-4c50-8f37-915adfcbbfa1 admin admin] PATH_INFO: `/v3/projects/36e797af7651498dbfb2f2ee96bd2c5d` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:26.625543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405db63-09e7-4c50-8f37-915adfcbbfa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36e797af7651498dbfb2f2ee96bd2c5d)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:26.627806 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405db63-09e7-4c50-8f37-915adfcbbfa1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:26.660648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f3bd6-8c5a-4059-a22e-dda3d8c84079 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:26.662466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f3bd6-8c5a-4059-a22e-dda3d8c84079 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:26.677717 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 829/1669] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:26 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:26.689983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f3bd6-8c5a-4059-a22e-dda3d8c84079 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:26.700188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7405db63-09e7-4c50-8f37-915adfcbbfa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36e797af7651498dbfb2f2ee96bd2c5d', 'request_id': 'req-7405db63-09e7-4c50-8f37-915adfcbbfa1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:26.703642 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:26.713783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7405db63-09e7-4c50-8f37-915adfcbbfa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36e797af7651498dbfb2f2ee96bd2c5d', 'request_id': 'req-7405db63-09e7-4c50-8f37-915adfcbbfa1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:26.733535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7405db63-09e7-4c50-8f37-915adfcbbfa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36e797af7651498dbfb2f2ee96bd2c5d', 'request_id': 'req-7405db63-09e7-4c50-8f37-915adfcbbfa1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:26.752288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7405db63-09e7-4c50-8f37-915adfcbbfa1 admin admin] The token cache is being invalidate because project 36e797af7651498dbfb2f2ee96bd2c5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:09:26.752569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7405db63-09e7-4c50-8f37-915adfcbbfa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:26.754071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7405db63-09e7-4c50-8f37-915adfcbbfa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:26.756962 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 841/1670] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:09:26 2022] DELETE /identity/v3/projects/36e797af7651498dbfb2f2ee96bd2c5d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:26.758833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405db63-09e7-4c50-8f37-915adfcbbfa1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:26.762266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7405db63-09e7-4c50-8f37-915adfcbbfa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:26.780555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f3bd6-8c5a-4059-a22e-dda3d8c84079 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:26.841286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4636a-c843-47ac-90f1-97caa8b8e3c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:26.841903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4636a-c843-47ac-90f1-97caa8b8e3c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:26.842187 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4636a-c843-47ac-90f1-97caa8b8e3c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:26.842475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4636a-c843-47ac-90f1-97caa8b8e3c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:26.844415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-daa4636a-c843-47ac-90f1-97caa8b8e3c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:26.856354 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:26.901720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405db63-09e7-4c50-8f37-915adfcbbfa1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:26.909553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfe97c-ffd6-4823-870f-5cea0671e852 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:26.910333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfe97c-ffd6-4823-870f-5cea0671e852 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:26.910615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfe97c-ffd6-4823-870f-5cea0671e852 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:26.910976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfe97c-ffd6-4823-870f-5cea0671e852 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:26.912906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-35dfe97c-ffd6-4823-870f-5cea0671e852 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:26.953129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4636a-c843-47ac-90f1-97caa8b8e3c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:26.955878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4636a-c843-47ac-90f1-97caa8b8e3c4 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:26.978707 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 830/1671] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:26.980348 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4636a-c843-47ac-90f1-97caa8b8e3c4 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:26.984021 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-daa4636a-c843-47ac-90f1-97caa8b8e3c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:27.005360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dfe97c-ffd6-4823-870f-5cea0671e852 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:27.007184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dfe97c-ffd6-4823-870f-5cea0671e852 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:27.008877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4636a-c843-47ac-90f1-97caa8b8e3c4 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:27.018066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b51c94-7b21-442a-814c-416a47a8c01a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:27.019122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b51c94-7b21-442a-814c-416a47a8c01a service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:27.019547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b51c94-7b21-442a-814c-416a47a8c01a service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:27.020003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b51c94-7b21-442a-814c-416a47a8c01a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:27.020852 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 842/1672] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:26 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:27.022453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52877e65-21fe-483c-bf42-51734904b46c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:27.022797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-59b51c94-7b21-442a-814c-416a47a8c01a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:27.023138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52877e65-21fe-483c-bf42-51734904b46c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:27.023504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52877e65-21fe-483c-bf42-51734904b46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:27.054387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-52877e65-21fe-483c-bf42-51734904b46c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:27.055977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-52877e65-21fe-483c-bf42-51734904b46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:27.073681 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 843/1673] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:27.085983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217a406-8c25-4fcb-b5de-5814dd178970 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:27.087806 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217a406-8c25-4fcb-b5de-5814dd178970 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:27.088266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217a406-8c25-4fcb-b5de-5814dd178970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:27.118877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f217a406-8c25-4fcb-b5de-5814dd178970 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:27.120592 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f217a406-8c25-4fcb-b5de-5814dd178970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:27.129682 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 844/1674] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:27.133187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217a406-8c25-4fcb-b5de-5814dd178970 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:27.137919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b51c94-7b21-442a-814c-416a47a8c01a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:27.140095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b51c94-7b21-442a-814c-416a47a8c01a service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:27.151185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217a406-8c25-4fcb-b5de-5814dd178970 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:27.154134 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 831/1675] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:26 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:27.160352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4869017-731a-45a9-beb7-f58ca15fd499 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:27.161983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b51c94-7b21-442a-814c-416a47a8c01a service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:27.162252 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4869017-731a-45a9-beb7-f58ca15fd499 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:27.162586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4869017-731a-45a9-beb7-f58ca15fd499 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:27.162866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4869017-731a-45a9-beb7-f58ca15fd499 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:27.165494 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b4869017-731a-45a9-beb7-f58ca15fd499 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:27.188831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b51c94-7b21-442a-814c-416a47a8c01a service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:27.200228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b9ef0-d918-4f2a-99fc-fdae57e7bca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:27.202016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b9ef0-d918-4f2a-99fc-fdae57e7bca4 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:27.202734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b9ef0-d918-4f2a-99fc-fdae57e7bca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:27.203292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b9ef0-d918-4f2a-99fc-fdae57e7bca4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:27.204618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b9ef0-d918-4f2a-99fc-fdae57e7bca4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:09:27.205257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b9ef0-d918-4f2a-99fc-fdae57e7bca4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:27.209305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b9ef0-d918-4f2a-99fc-fdae57e7bca4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:27.213467 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:27.240974 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 832/1676] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:09:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:09:27.250866 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b9ef0-d918-4f2a-99fc-fdae57e7bca4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:27.275987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b9ef0-d918-4f2a-99fc-fdae57e7bca4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:27.286569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57482aa9-e36b-4290-8766-25933e986b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:27.287802 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57482aa9-e36b-4290-8766-25933e986b9c admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:27.288561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57482aa9-e36b-4290-8766-25933e986b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:27.289307 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57482aa9-e36b-4290-8766-25933e986b9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:27.291763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57482aa9-e36b-4290-8766-25933e986b9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:27.296245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57482aa9-e36b-4290-8766-25933e986b9c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:27.308530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4869017-731a-45a9-beb7-f58ca15fd499 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:27.310886 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4869017-731a-45a9-beb7-f58ca15fd499 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:27.328123 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 845/1677] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:27 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:27.329140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4869017-731a-45a9-beb7-f58ca15fd499 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:27.336019 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 833/1678] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:27 2022] POST /identity/v3/projects => generated 375 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:27.341210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57482aa9-e36b-4290-8766-25933e986b9c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:27.357275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4869017-731a-45a9-beb7-f58ca15fd499 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:27.495453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57482aa9-e36b-4290-8766-25933e986b9c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:27.516590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233cf66-2e48-409a-8ff9-e00af37a8568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:27.517541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233cf66-2e48-409a-8ff9-e00af37a8568 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:27.518001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233cf66-2e48-409a-8ff9-e00af37a8568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:27.518458 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233cf66-2e48-409a-8ff9-e00af37a8568 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:27.519561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233cf66-2e48-409a-8ff9-e00af37a8568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:27.522085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268a7ce-ce58-4e84-bb97-1ef15704a75d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:27.522765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268a7ce-ce58-4e84-bb97-1ef15704a75d service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:27.523109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268a7ce-ce58-4e84-bb97-1ef15704a75d service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:27.523451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268a7ce-ce58-4e84-bb97-1ef15704a75d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:27.523607 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6233cf66-2e48-409a-8ff9-e00af37a8568 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:27.525744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8268a7ce-ce58-4e84-bb97-1ef15704a75d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:27.533947 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:27.572996 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 834/1679] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:27 2022] POST /identity/v3/users => generated 288 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:09:27.573880 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233cf66-2e48-409a-8ff9-e00af37a8568 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:27.580792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6233cf66-2e48-409a-8ff9-e00af37a8568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:27.600087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233cf66-2e48-409a-8ff9-e00af37a8568 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:27.618371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cff689-d3d7-4644-83d4-af515765f7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:27.618371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cff689-d3d7-4644-83d4-af515765f7bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:27.618371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cff689-d3d7-4644-83d4-af515765f7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:27.618371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cff689-d3d7-4644-83d4-af515765f7bd admin admin] PATH_INFO: `/v3/users/103b3fb732e74594b778ee8991119a6c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:27.619043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cff689-d3d7-4644-83d4-af515765f7bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=103b3fb732e74594b778ee8991119a6c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:27.619043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cff689-d3d7-4644-83d4-af515765f7bd admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:27.623542 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268a7ce-ce58-4e84-bb97-1ef15704a75d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:27.625314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268a7ce-ce58-4e84-bb97-1ef15704a75d service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:27.649358 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 846/1680] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:27 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:27.649688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268a7ce-ce58-4e84-bb97-1ef15704a75d service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:27.657643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8268a7ce-ce58-4e84-bb97-1ef15704a75d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:27.677519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268a7ce-ce58-4e84-bb97-1ef15704a75d service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:27.685914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478916b-6635-4675-a95d-55f4b9a2d79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:27.685914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478916b-6635-4675-a95d-55f4b9a2d79a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:27.686145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478916b-6635-4675-a95d-55f4b9a2d79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:27.686404 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478916b-6635-4675-a95d-55f4b9a2d79a admin admin] PATH_INFO: `/v3/projects/a0ca0eceda6241cea90089c9a5f6dbcd` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:27.687754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478916b-6635-4675-a95d-55f4b9a2d79a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0ca0eceda6241cea90089c9a5f6dbcd)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:27.689813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478916b-6635-4675-a95d-55f4b9a2d79a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:27.714847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e3cff689-d3d7-4644-83d4-af515765f7bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '103b3fb732e74594b778ee8991119a6c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:27.728646 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e3cff689-d3d7-4644-83d4-af515765f7bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '103b3fb732e74594b778ee8991119a6c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:27.749051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e3cff689-d3d7-4644-83d4-af515765f7bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '103b3fb732e74594b778ee8991119a6c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:27.749863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e3cff689-d3d7-4644-83d4-af515765f7bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '103b3fb732e74594b778ee8991119a6c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:27.753053 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d478916b-6635-4675-a95d-55f4b9a2d79a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0ca0eceda6241cea90089c9a5f6dbcd', 'request_id': 'req-d478916b-6635-4675-a95d-55f4b9a2d79a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:27.760651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e3cff689-d3d7-4644-83d4-af515765f7bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '103b3fb732e74594b778ee8991119a6c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:27.764199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d478916b-6635-4675-a95d-55f4b9a2d79a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0ca0eceda6241cea90089c9a5f6dbcd', 'request_id': 'req-d478916b-6635-4675-a95d-55f4b9a2d79a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:27.768881 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 835/1681] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:09:27 2022] DELETE /identity/v3/users/103b3fb732e74594b778ee8991119a6c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:27.770083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cff689-d3d7-4644-83d4-af515765f7bd admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:27.771624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e3cff689-d3d7-4644-83d4-af515765f7bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:27.772396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d478916b-6635-4675-a95d-55f4b9a2d79a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0ca0eceda6241cea90089c9a5f6dbcd', 'request_id': 'req-d478916b-6635-4675-a95d-55f4b9a2d79a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:27.789941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d478916b-6635-4675-a95d-55f4b9a2d79a admin admin] The token cache is being invalidate because project a0ca0eceda6241cea90089c9a5f6dbcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:09:27.790289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d478916b-6635-4675-a95d-55f4b9a2d79a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:27.790984 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d478916b-6635-4675-a95d-55f4b9a2d79a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:27.793013 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 847/1682] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:09:27 2022] DELETE /identity/v3/projects/a0ca0eceda6241cea90089c9a5f6dbcd => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:27.793988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478916b-6635-4675-a95d-55f4b9a2d79a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:27.795482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d478916b-6635-4675-a95d-55f4b9a2d79a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:27.849575 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:27.895302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cff689-d3d7-4644-83d4-af515765f7bd admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:27.902026 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d54eae-77e1-4c24-99a2-5eda3c428c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:27.902822 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d54eae-77e1-4c24-99a2-5eda3c428c66 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:27.903154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d54eae-77e1-4c24-99a2-5eda3c428c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:27.903673 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d54eae-77e1-4c24-99a2-5eda3c428c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:27.904476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d54eae-77e1-4c24-99a2-5eda3c428c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:27.906519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d54eae-77e1-4c24-99a2-5eda3c428c66 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:27.917895 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 836/1683] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:27.920084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129b9b9-bd17-42c2-9f37-09ab3ef90ea1 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:27.920484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129b9b9-bd17-42c2-9f37-09ab3ef90ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:27.920766 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129b9b9-bd17-42c2-9f37-09ab3ef90ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:27.922029 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478916b-6635-4675-a95d-55f4b9a2d79a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:27.940647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9129b9b9-bd17-42c2-9f37-09ab3ef90ea1 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:27.941874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9129b9b9-bd17-42c2-9f37-09ab3ef90ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:27.944627 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:27.958219 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 837/1684] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:27.958219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129b9b9-bd17-42c2-9f37-09ab3ef90ea1 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:27.958987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9129b9b9-bd17-42c2-9f37-09ab3ef90ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:27.981648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129b9b9-bd17-42c2-9f37-09ab3ef90ea1 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:27.989630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71507f1-31e2-4be6-9c8e-373a9a1877d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:27.990705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71507f1-31e2-4be6-9c8e-373a9a1877d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:27.991193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71507f1-31e2-4be6-9c8e-373a9a1877d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:27.991679 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71507f1-31e2-4be6-9c8e-373a9a1877d7 admin admin] PATH_INFO: `/v3/users/0b28c757c2104074a33ab785b590dd23` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:27.993695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71507f1-31e2-4be6-9c8e-373a9a1877d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b28c757c2104074a33ab785b590dd23)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:27.997968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71507f1-31e2-4be6-9c8e-373a9a1877d7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:28.009620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54746d84-4981-4196-8c7f-b0dfe56f2270 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:28.010251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54746d84-4981-4196-8c7f-b0dfe56f2270 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:28.010504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54746d84-4981-4196-8c7f-b0dfe56f2270 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:28.010767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54746d84-4981-4196-8c7f-b0dfe56f2270 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:28.013318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-54746d84-4981-4196-8c7f-b0dfe56f2270 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:28.055626 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b71507f1-31e2-4be6-9c8e-373a9a1877d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b28c757c2104074a33ab785b590dd23'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:28.063681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b71507f1-31e2-4be6-9c8e-373a9a1877d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b28c757c2104074a33ab785b590dd23'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:28.076716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b71507f1-31e2-4be6-9c8e-373a9a1877d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b28c757c2104074a33ab785b590dd23'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:28.077430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b71507f1-31e2-4be6-9c8e-373a9a1877d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b28c757c2104074a33ab785b590dd23'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:28.078955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54746d84-4981-4196-8c7f-b0dfe56f2270 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:28.080601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54746d84-4981-4196-8c7f-b0dfe56f2270 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:28.085854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b71507f1-31e2-4be6-9c8e-373a9a1877d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b28c757c2104074a33ab785b590dd23'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:28.091318 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 848/1685] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:27 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:28.092629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c46f4-8112-4733-b427-b23dd11d5aa8 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:28.092906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c46f4-8112-4733-b427-b23dd11d5aa8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:28.093229 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c46f4-8112-4733-b427-b23dd11d5aa8 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:28.093518 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 838/1686] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:09:27 2022] DELETE /identity/v3/users/0b28c757c2104074a33ab785b590dd23 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:28.094365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71507f1-31e2-4be6-9c8e-373a9a1877d7 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:28.095731 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b71507f1-31e2-4be6-9c8e-373a9a1877d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:28.101836 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 849/1687] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:09:28 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:09:28.102836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c46f4-8112-4733-b427-b23dd11d5aa8 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:28.104592 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dd5c46f4-8112-4733-b427-b23dd11d5aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:28.218740 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71507f1-31e2-4be6-9c8e-373a9a1877d7 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:28.238811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b4265-df6e-4ff2-be32-42356929ac9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:28.239918 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b4265-df6e-4ff2-be32-42356929ac9b admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:28.240421 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b4265-df6e-4ff2-be32-42356929ac9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:28.240940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b4265-df6e-4ff2-be32-42356929ac9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:28.242148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b4265-df6e-4ff2-be32-42356929ac9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:28.244782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c46f4-8112-4733-b427-b23dd11d5aa8 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:28.252738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac306a-4dd5-459a-b144-958b85defdca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:28.254232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac306a-4dd5-459a-b144-958b85defdca service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:28.254812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac306a-4dd5-459a-b144-958b85defdca service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:28.254926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b4265-df6e-4ff2-be32-42356929ac9b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:28.255657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac306a-4dd5-459a-b144-958b85defdca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:28.263749 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5eac306a-4dd5-459a-b144-958b85defdca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:28.276510 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 839/1688] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:28.278947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f83808-db84-4bd4-a53c-23264036fbbf None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:28.279242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f83808-db84-4bd4-a53c-23264036fbbf None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:28.279618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f83808-db84-4bd4-a53c-23264036fbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:28.308442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac306a-4dd5-459a-b144-958b85defdca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:28.310265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac306a-4dd5-459a-b144-958b85defdca service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:28.311515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-37f83808-db84-4bd4-a53c-23264036fbbf None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:28.312882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-37f83808-db84-4bd4-a53c-23264036fbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:28.355540 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 850/1689] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:28.359502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac306a-4dd5-459a-b144-958b85defdca service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:28.368670 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:28.397201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac306a-4dd5-459a-b144-958b85defdca service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:28.408408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340c2a8-e1c7-456b-96f5-b60467878601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:28.409108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340c2a8-e1c7-456b-96f5-b60467878601 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:28.409387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340c2a8-e1c7-456b-96f5-b60467878601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:28.409770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340c2a8-e1c7-456b-96f5-b60467878601 admin admin] PATH_INFO: `/v3/projects/8d0af4ec538f41868c10700c90e816d6/users/2e60f068764c4a259771662a83663cb9/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:28.447962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f340c2a8-e1c7-456b-96f5-b60467878601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d0af4ec538f41868c10700c90e816d6, user_id=2e60f068764c4a259771662a83663cb9, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:28.454156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f340c2a8-e1c7-456b-96f5-b60467878601 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:28.461512 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 840/1690] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:09:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:28.478451 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 851/1691] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:28 2022] PUT /identity/v3/projects/8d0af4ec538f41868c10700c90e816d6/users/2e60f068764c4a259771662a83663cb9/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:28.491614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1a3e7-a361-402a-8707-d2a3cb7ad3b3 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:28.492083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1a3e7-a361-402a-8707-d2a3cb7ad3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:28.492353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1a3e7-a361-402a-8707-d2a3cb7ad3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:28.504513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340c2a8-e1c7-456b-96f5-b60467878601 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:28.508401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f340c2a8-e1c7-456b-96f5-b60467878601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:28.570332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b0d1a3e7-a361-402a-8707-d2a3cb7ad3b3 None None] MFA Rules not processed for user `2e60f068764c4a259771662a83663cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:28.571349 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:28.574887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b0d1a3e7-a361-402a-8707-d2a3cb7ad3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:28.632475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340c2a8-e1c7-456b-96f5-b60467878601 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:28.648863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45037a80-7765-44aa-a245-eca154a732b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:28.649763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45037a80-7765-44aa-a245-eca154a732b5 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:28.650392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45037a80-7765-44aa-a245-eca154a732b5 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:28.650735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45037a80-7765-44aa-a245-eca154a732b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:28.672978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45037a80-7765-44aa-a245-eca154a732b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:28.675870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45037a80-7765-44aa-a245-eca154a732b5 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:28.699854 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 841/1692] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:28.700218 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 852/1693] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:28.709049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1a3e7-a361-402a-8707-d2a3cb7ad3b3 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:28.788602 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45037a80-7765-44aa-a245-eca154a732b5 service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:28.790181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-45037a80-7765-44aa-a245-eca154a732b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:28.850492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1a3e7-a361-402a-8707-d2a3cb7ad3b3 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:28.856610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425ba9d-95a1-45f6-a099-52022b2dd238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:28.857603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425ba9d-95a1-45f6-a099-52022b2dd238 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:28.857749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425ba9d-95a1-45f6-a099-52022b2dd238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:28.858068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425ba9d-95a1-45f6-a099-52022b2dd238 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:28.859095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425ba9d-95a1-45f6-a099-52022b2dd238 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:28.861471 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425ba9d-95a1-45f6-a099-52022b2dd238 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:28.919484 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 842/1694] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:28 2022] POST /identity/v3/projects => generated 377 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:28.919484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425ba9d-95a1-45f6-a099-52022b2dd238 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:28.930648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0425ba9d-95a1-45f6-a099-52022b2dd238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:29.004572 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45037a80-7765-44aa-a245-eca154a732b5 service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:29.036934 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:29.075680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425ba9d-95a1-45f6-a099-52022b2dd238 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:29.078854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446dc33-205c-4623-bade-03f086681c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:29.079584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446dc33-205c-4623-bade-03f086681c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:29.079958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446dc33-205c-4623-bade-03f086681c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:29.080232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446dc33-205c-4623-bade-03f086681c70 admin admin] PATH_INFO: `/v3/projects/889a01769c2748caa74da4b3340130eb` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:29.081481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446dc33-205c-4623-bade-03f086681c70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=889a01769c2748caa74da4b3340130eb)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:29.083410 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446dc33-205c-4623-bade-03f086681c70 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:29.084655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01be966-e76f-4178-a5fc-5504b6e97c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:29.085820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01be966-e76f-4178-a5fc-5504b6e97c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:29.086399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01be966-e76f-4178-a5fc-5504b6e97c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:29.086858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01be966-e76f-4178-a5fc-5504b6e97c6f admin admin] PATH_INFO: `/v3/users/b734b820694444fcb1a4dffda0547775` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:29.089057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01be966-e76f-4178-a5fc-5504b6e97c6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b734b820694444fcb1a4dffda0547775)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:29.092852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01be966-e76f-4178-a5fc-5504b6e97c6f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:29.144196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f446dc33-205c-4623-bade-03f086681c70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '889a01769c2748caa74da4b3340130eb', 'request_id': 'req-f446dc33-205c-4623-bade-03f086681c70'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:29.151722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f446dc33-205c-4623-bade-03f086681c70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '889a01769c2748caa74da4b3340130eb', 'request_id': 'req-f446dc33-205c-4623-bade-03f086681c70'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:29.157481 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c01be966-e76f-4178-a5fc-5504b6e97c6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b734b820694444fcb1a4dffda0547775'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:29.160570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f446dc33-205c-4623-bade-03f086681c70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '889a01769c2748caa74da4b3340130eb', 'request_id': 'req-f446dc33-205c-4623-bade-03f086681c70'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:29.168151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c01be966-e76f-4178-a5fc-5504b6e97c6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b734b820694444fcb1a4dffda0547775'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:29.177959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f446dc33-205c-4623-bade-03f086681c70 admin admin] The token cache is being invalidate because project 889a01769c2748caa74da4b3340130eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:09:29.178342 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f446dc33-205c-4623-bade-03f086681c70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:29.179024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f446dc33-205c-4623-bade-03f086681c70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:29.180554 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 853/1695] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:09:28 2022] DELETE /identity/v3/projects/889a01769c2748caa74da4b3340130eb => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:29.181305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446dc33-205c-4623-bade-03f086681c70 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:29.182635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f446dc33-205c-4623-bade-03f086681c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:29.189639 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:29.197090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c01be966-e76f-4178-a5fc-5504b6e97c6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b734b820694444fcb1a4dffda0547775'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:29.198811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c01be966-e76f-4178-a5fc-5504b6e97c6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b734b820694444fcb1a4dffda0547775'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:29.211137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c01be966-e76f-4178-a5fc-5504b6e97c6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b734b820694444fcb1a4dffda0547775'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:29.222846 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 843/1696] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:09:28 2022] DELETE /identity/v3/users/b734b820694444fcb1a4dffda0547775 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:29.225782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01be966-e76f-4178-a5fc-5504b6e97c6f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:29.228885 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c01be966-e76f-4178-a5fc-5504b6e97c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:29.277102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446dc33-205c-4623-bade-03f086681c70 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:29.319331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01be966-e76f-4178-a5fc-5504b6e97c6f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:29.328597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335774e-6aea-455b-9e1e-6e6de31bec58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:29.329461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335774e-6aea-455b-9e1e-6e6de31bec58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:29.329732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335774e-6aea-455b-9e1e-6e6de31bec58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:29.330005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335774e-6aea-455b-9e1e-6e6de31bec58 admin admin] PATH_INFO: `/v3/projects/f0aad067435e4b678ea13dbb920f03f4` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:29.331214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335774e-6aea-455b-9e1e-6e6de31bec58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0aad067435e4b678ea13dbb920f03f4)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:29.332269 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-c335774e-6aea-455b-9e1e-6e6de31bec58 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:09:29.332269 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:09:29.332269 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:09:29.333492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335774e-6aea-455b-9e1e-6e6de31bec58 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:29.338625 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c970466-e085-4aaa-8491-61c8bb782faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:29.339312 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c970466-e085-4aaa-8491-61c8bb782faf admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:29.339586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c970466-e085-4aaa-8491-61c8bb782faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:29.339871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c970466-e085-4aaa-8491-61c8bb782faf admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:29.340714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c970466-e085-4aaa-8491-61c8bb782faf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:29.342942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c970466-e085-4aaa-8491-61c8bb782faf admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:29.373482 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 854/1697] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:29 2022] POST /identity/v3/users => generated 295 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:29.373482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c970466-e085-4aaa-8491-61c8bb782faf admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:29.373482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7c970466-e085-4aaa-8491-61c8bb782faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:29.385813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c970466-e085-4aaa-8491-61c8bb782faf admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:29.403223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c335774e-6aea-455b-9e1e-6e6de31bec58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0aad067435e4b678ea13dbb920f03f4', 'request_id': 'req-c335774e-6aea-455b-9e1e-6e6de31bec58'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:29.409982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c335774e-6aea-455b-9e1e-6e6de31bec58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0aad067435e4b678ea13dbb920f03f4', 'request_id': 'req-c335774e-6aea-455b-9e1e-6e6de31bec58'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:29.424512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c335774e-6aea-455b-9e1e-6e6de31bec58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0aad067435e4b678ea13dbb920f03f4', 'request_id': 'req-c335774e-6aea-455b-9e1e-6e6de31bec58'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:29.426672 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:29.445983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c335774e-6aea-455b-9e1e-6e6de31bec58 admin admin] The token cache is being invalidate because project f0aad067435e4b678ea13dbb920f03f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:09:29.446514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c335774e-6aea-455b-9e1e-6e6de31bec58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:29.447509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c335774e-6aea-455b-9e1e-6e6de31bec58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:29.449175 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 844/1698] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:09:29 2022] DELETE /identity/v3/projects/f0aad067435e4b678ea13dbb920f03f4 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:29.450469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d6225-6335-4769-b480-6998eb84c40c None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:29.450757 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d6225-6335-4769-b480-6998eb84c40c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:29.451033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d6225-6335-4769-b480-6998eb84c40c None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:29.452862 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 845/1699] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:09:29.457324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa46d27-93b1-436f-a0a0-9a4c363e7be2 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:29.457793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa46d27-93b1-436f-a0a0-9a4c363e7be2 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:29.458350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa46d27-93b1-436f-a0a0-9a4c363e7be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:29.459612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a559e1-12c2-469f-8307-3c9e2bb98e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:29.460476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a559e1-12c2-469f-8307-3c9e2bb98e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:29.460840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a559e1-12c2-469f-8307-3c9e2bb98e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:29.461284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a559e1-12c2-469f-8307-3c9e2bb98e1e admin admin] PATH_INFO: `/v3/users/897c3130dbe44598af2263a1ef3d5f04` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:29.462659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a559e1-12c2-469f-8307-3c9e2bb98e1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=897c3130dbe44598af2263a1ef3d5f04)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:29.465549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a559e1-12c2-469f-8307-3c9e2bb98e1e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:29.480040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-efa46d27-93b1-436f-a0a0-9a4c363e7be2 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:29.481891 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-efa46d27-93b1-436f-a0a0-9a4c363e7be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:29.490192 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 846/1700] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:29.491453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d855623-8d07-4705-b758-559c8033c772 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:29.491733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d855623-8d07-4705-b758-559c8033c772 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:29.492075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d855623-8d07-4705-b758-559c8033c772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:29.512078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7d855623-8d07-4705-b758-559c8033c772 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:29.513298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7d855623-8d07-4705-b758-559c8033c772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:29.523068 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 847/1701] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:29.523068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d855623-8d07-4705-b758-559c8033c772 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:29.528762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7d855623-8d07-4705-b758-559c8033c772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:29.544701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d855623-8d07-4705-b758-559c8033c772 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:29.548963 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:29.549966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b989a1-3133-4d85-87c7-3416b37e37ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:29.550760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b989a1-3133-4d85-87c7-3416b37e37ef admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:29.551210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b989a1-3133-4d85-87c7-3416b37e37ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:29.551570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b989a1-3133-4d85-87c7-3416b37e37ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:29.551721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c0a559e1-12c2-469f-8307-3c9e2bb98e1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '897c3130dbe44598af2263a1ef3d5f04'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:29.552668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b989a1-3133-4d85-87c7-3416b37e37ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:29.554054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b989a1-3133-4d85-87c7-3416b37e37ef admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:29.561714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c0a559e1-12c2-469f-8307-3c9e2bb98e1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '897c3130dbe44598af2263a1ef3d5f04'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:29.565919 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 848/1702] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:29.566599 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b989a1-3133-4d85-87c7-3416b37e37ef admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:29.568516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-14b989a1-3133-4d85-87c7-3416b37e37ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:29.578236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c0a559e1-12c2-469f-8307-3c9e2bb98e1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '897c3130dbe44598af2263a1ef3d5f04'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:29.579117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c0a559e1-12c2-469f-8307-3c9e2bb98e1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '897c3130dbe44598af2263a1ef3d5f04'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:29.582407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b989a1-3133-4d85-87c7-3416b37e37ef admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:29.588335 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01ce3b-455c-4065-9506-0a255c896140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:29.589392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01ce3b-455c-4065-9506-0a255c896140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:29.589589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c0a559e1-12c2-469f-8307-3c9e2bb98e1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '897c3130dbe44598af2263a1ef3d5f04'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:29.589864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01ce3b-455c-4065-9506-0a255c896140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:29.590921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01ce3b-455c-4065-9506-0a255c896140 admin admin] PATH_INFO: `/v3/users/236f96764f304ecc825e3f1a2093f924` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:29.592748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01ce3b-455c-4065-9506-0a255c896140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=236f96764f304ecc825e3f1a2093f924)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:29.595989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01ce3b-455c-4065-9506-0a255c896140 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:29.600805 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 855/1703] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:09:29 2022] DELETE /identity/v3/users/897c3130dbe44598af2263a1ef3d5f04 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:29.603856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdb342-e9c7-4007-8b1e-0e7a54be6f13 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:29.603856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdb342-e9c7-4007-8b1e-0e7a54be6f13 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:29.604079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdb342-e9c7-4007-8b1e-0e7a54be6f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:29.631137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f2cdb342-e9c7-4007-8b1e-0e7a54be6f13 None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:29.632696 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f2cdb342-e9c7-4007-8b1e-0e7a54be6f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:29.658553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-eb01ce3b-455c-4065-9506-0a255c896140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '236f96764f304ecc825e3f1a2093f924'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:29.666272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-eb01ce3b-455c-4065-9506-0a255c896140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '236f96764f304ecc825e3f1a2093f924'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:29.680212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-eb01ce3b-455c-4065-9506-0a255c896140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '236f96764f304ecc825e3f1a2093f924'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:29.681653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-eb01ce3b-455c-4065-9506-0a255c896140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '236f96764f304ecc825e3f1a2093f924'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:29.690662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-eb01ce3b-455c-4065-9506-0a255c896140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '236f96764f304ecc825e3f1a2093f924'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:29.697736 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 849/1704] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:09:29 2022] DELETE /identity/v3/users/236f96764f304ecc825e3f1a2093f924 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:29.701402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d335f-6ac6-4618-8f2b-03b4193263ac None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:29.701402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d335f-6ac6-4618-8f2b-03b4193263ac None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:29.701402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d335f-6ac6-4618-8f2b-03b4193263ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:29.712587 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 856/1705] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:09:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:29.713380 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cdb342-e9c7-4007-8b1e-0e7a54be6f13 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:29.714690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f2cdb342-e9c7-4007-8b1e-0e7a54be6f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:29.728787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-a64d335f-6ac6-4618-8f2b-03b4193263ac None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:29.729930 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a64d335f-6ac6-4618-8f2b-03b4193263ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:29.779927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cdb342-e9c7-4007-8b1e-0e7a54be6f13 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:29.818658 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 850/1706] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:29.820305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d335f-6ac6-4618-8f2b-03b4193263ac None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:29.822285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a64d335f-6ac6-4618-8f2b-03b4193263ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:29.835279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d335f-6ac6-4618-8f2b-03b4193263ac None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:29.841495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63493754-0459-4837-9393-6bbdda96d82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:29.842471 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63493754-0459-4837-9393-6bbdda96d82b admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:29.842930 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63493754-0459-4837-9393-6bbdda96d82b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:29.843219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63493754-0459-4837-9393-6bbdda96d82b admin admin] PATH_INFO: `/v3/projects/aabb9a49690d4678a44ec7ba410bdd77/users/5ff86b78b7574be485bca55324b517e0/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:29.853145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a4e5d-bb99-4356-8a48-4bd7093ee307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:29.853871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a4e5d-bb99-4356-8a48-4bd7093ee307 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:29.854203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a4e5d-bb99-4356-8a48-4bd7093ee307 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:29.854485 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a4e5d-bb99-4356-8a48-4bd7093ee307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:29.859744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f74a4e5d-bb99-4356-8a48-4bd7093ee307 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:29.865103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63493754-0459-4837-9393-6bbdda96d82b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aabb9a49690d4678a44ec7ba410bdd77, user_id=5ff86b78b7574be485bca55324b517e0, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:29.867834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63493754-0459-4837-9393-6bbdda96d82b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:29.879339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a4e5d-bb99-4356-8a48-4bd7093ee307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:29.882666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a4e5d-bb99-4356-8a48-4bd7093ee307 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:29.893103 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 851/1707] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:29 2022] PUT /identity/v3/projects/aabb9a49690d4678a44ec7ba410bdd77/users/5ff86b78b7574be485bca55324b517e0/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:29.895146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f8c46-b5a0-413b-af6d-7ae59a259918 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:29.895752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f8c46-b5a0-413b-af6d-7ae59a259918 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:29.896802 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f8c46-b5a0-413b-af6d-7ae59a259918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:29.906087 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 857/1708] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:29.907603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a4e5d-bb99-4356-8a48-4bd7093ee307 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:29.909753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f74a4e5d-bb99-4356-8a48-4bd7093ee307 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:29.951037 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:29.994862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ff6f8c46-b5a0-413b-af6d-7ae59a259918 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:30.001468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ff6f8c46-b5a0-413b-af6d-7ae59a259918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:30.024601 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:INSERT=3,keystone:DELETE=11,keystone:SELECT=86 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:30.035290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a4e5d-bb99-4356-8a48-4bd7093ee307 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:30.119978 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 852/1709] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:30.119978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f8c46-b5a0-413b-af6d-7ae59a259918 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:30.132433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b3166-20dc-4b2e-a30e-ef1432aca14a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:30.133335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b3166-20dc-4b2e-a30e-ef1432aca14a service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:30.133614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b3166-20dc-4b2e-a30e-ef1432aca14a service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:30.133952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b3166-20dc-4b2e-a30e-ef1432aca14a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:30.136212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f8c46-b5a0-413b-af6d-7ae59a259918 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:30.147011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b3166-20dc-4b2e-a30e-ef1432aca14a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:30.147173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3dd05-e9c5-4685-8335-4a6aa1a75189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:30.147803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3dd05-e9c5-4685-8335-4a6aa1a75189 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:30.148137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3dd05-e9c5-4685-8335-4a6aa1a75189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:30.148384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3dd05-e9c5-4685-8335-4a6aa1a75189 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:30.149055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3dd05-e9c5-4685-8335-4a6aa1a75189 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:09:30.149357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3dd05-e9c5-4685-8335-4a6aa1a75189 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:30.149524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b3166-20dc-4b2e-a30e-ef1432aca14a service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:30.151587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3dd05-e9c5-4685-8335-4a6aa1a75189 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:30.165240 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 858/1710] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:30.166679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b3166-20dc-4b2e-a30e-ef1432aca14a service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:30.179772 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 853/1711] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:09:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:09:30.180966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3dd05-e9c5-4685-8335-4a6aa1a75189 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:30.181722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b3166-20dc-4b2e-a30e-ef1432aca14a service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:30.185682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-acc3dd05-e9c5-4685-8335-4a6aa1a75189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:30.189821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d9ce34-25a2-4408-8a51-97f1dc4ac2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:30.190561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9ce34-25a2-4408-8a51-97f1dc4ac2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:30.191053 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9ce34-25a2-4408-8a51-97f1dc4ac2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:30.192014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9ce34-25a2-4408-8a51-97f1dc4ac2c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:30.193243 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d9ce34-25a2-4408-8a51-97f1dc4ac2c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:30.196005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d9ce34-25a2-4408-8a51-97f1dc4ac2c1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:30.209723 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3dd05-e9c5-4685-8335-4a6aa1a75189 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:30.212272 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 859/1712] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:30.213387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d9ce34-25a2-4408-8a51-97f1dc4ac2c1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:30.216856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e7d9ce34-25a2-4408-8a51-97f1dc4ac2c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:30.218691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada21718-2822-4ad2-8fc2-75edd77a4230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:30.219597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada21718-2822-4ad2-8fc2-75edd77a4230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:30.219812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada21718-2822-4ad2-8fc2-75edd77a4230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:30.220369 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada21718-2822-4ad2-8fc2-75edd77a4230 admin admin] PATH_INFO: `/v3/projects/a0d56d35a6334ac68246c1e9f49054e7` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:30.222591 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada21718-2822-4ad2-8fc2-75edd77a4230 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0d56d35a6334ac68246c1e9f49054e7)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:30.225129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada21718-2822-4ad2-8fc2-75edd77a4230 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:30.303568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ada21718-2822-4ad2-8fc2-75edd77a4230 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0d56d35a6334ac68246c1e9f49054e7', 'request_id': 'req-ada21718-2822-4ad2-8fc2-75edd77a4230'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:30.305398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d9ce34-25a2-4408-8a51-97f1dc4ac2c1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:30.313997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ada21718-2822-4ad2-8fc2-75edd77a4230 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0d56d35a6334ac68246c1e9f49054e7', 'request_id': 'req-ada21718-2822-4ad2-8fc2-75edd77a4230'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:30.329248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ada21718-2822-4ad2-8fc2-75edd77a4230 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0d56d35a6334ac68246c1e9f49054e7', 'request_id': 'req-ada21718-2822-4ad2-8fc2-75edd77a4230'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:30.353186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ada21718-2822-4ad2-8fc2-75edd77a4230 admin admin] The token cache is being invalidate because project a0d56d35a6334ac68246c1e9f49054e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:09:30.353968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ada21718-2822-4ad2-8fc2-75edd77a4230 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:30.356790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ada21718-2822-4ad2-8fc2-75edd77a4230 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:30.364151 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 854/1713] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:09:30 2022] DELETE /identity/v3/projects/a0d56d35a6334ac68246c1e9f49054e7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:30.364151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada21718-2822-4ad2-8fc2-75edd77a4230 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:30.367483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ada21718-2822-4ad2-8fc2-75edd77a4230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:30.401044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d64eae-9916-4d00-88e2-156272bd18f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:30.401828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d64eae-9916-4d00-88e2-156272bd18f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:30.403442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d64eae-9916-4d00-88e2-156272bd18f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:30.403928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d64eae-9916-4d00-88e2-156272bd18f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:30.406733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d7d64eae-9916-4d00-88e2-156272bd18f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:30.425242 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:30.479439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada21718-2822-4ad2-8fc2-75edd77a4230 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:30.485444 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc9c95-853f-44fb-bc56-0118aa9417f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:30.485717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc9c95-853f-44fb-bc56-0118aa9417f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:30.486024 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc9c95-853f-44fb-bc56-0118aa9417f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:30.486312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc9c95-853f-44fb-bc56-0118aa9417f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:30.486962 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc9c95-853f-44fb-bc56-0118aa9417f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:30.489228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc9c95-853f-44fb-bc56-0118aa9417f6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:30.532156 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 855/1714] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:30 2022] POST /identity/v3/projects => generated 389 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:30.532156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc9c95-853f-44fb-bc56-0118aa9417f6 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:30.532156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bdfc9c95-853f-44fb-bc56-0118aa9417f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:30.537005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d64eae-9916-4d00-88e2-156272bd18f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:30.538442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d64eae-9916-4d00-88e2-156272bd18f3 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:30.553120 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 860/1715] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:30.554921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d64eae-9916-4d00-88e2-156272bd18f3 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:30.556588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d7d64eae-9916-4d00-88e2-156272bd18f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:30.563828 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:30.598008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d64eae-9916-4d00-88e2-156272bd18f3 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:30.663645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc9c95-853f-44fb-bc56-0118aa9417f6 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:30.673356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10d642-11e6-4106-bdf7-f01f56ccff04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:30.674391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10d642-11e6-4106-bdf7-f01f56ccff04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:30.674793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10d642-11e6-4106-bdf7-f01f56ccff04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:30.675135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10d642-11e6-4106-bdf7-f01f56ccff04 admin admin] PATH_INFO: `/v3/projects/aabb9a49690d4678a44ec7ba410bdd77/users/5ff86b78b7574be485bca55324b517e0/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:30.677972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10d642-11e6-4106-bdf7-f01f56ccff04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aabb9a49690d4678a44ec7ba410bdd77, user_id=5ff86b78b7574be485bca55324b517e0, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:30.680964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10d642-11e6-4106-bdf7-f01f56ccff04 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:30.715011 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 856/1716] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:30 2022] PUT /identity/v3/projects/aabb9a49690d4678a44ec7ba410bdd77/users/5ff86b78b7574be485bca55324b517e0/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:30.717169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc4dd9-1d27-468d-980e-bfe451adf860 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:30.717527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc4dd9-1d27-468d-980e-bfe451adf860 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:30.717925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc4dd9-1d27-468d-980e-bfe451adf860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:30.734646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a0370-ce19-48f0-8395-591e525eb520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:30.735266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a0370-ce19-48f0-8395-591e525eb520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:30.735541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a0370-ce19-48f0-8395-591e525eb520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:30.735815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a0370-ce19-48f0-8395-591e525eb520 admin admin] PATH_INFO: `/v3/projects/0771943ca95c463998e2c2321dfc3685` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:30.738717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a0370-ce19-48f0-8395-591e525eb520 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0771943ca95c463998e2c2321dfc3685)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:30.745584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a0370-ce19-48f0-8395-591e525eb520 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:30.763554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-77dc4dd9-1d27-468d-980e-bfe451adf860 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:30.764920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-77dc4dd9-1d27-468d-980e-bfe451adf860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:30.807340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4d1a0370-ce19-48f0-8395-591e525eb520 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0771943ca95c463998e2c2321dfc3685', 'request_id': 'req-4d1a0370-ce19-48f0-8395-591e525eb520'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:30.817955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4d1a0370-ce19-48f0-8395-591e525eb520 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0771943ca95c463998e2c2321dfc3685', 'request_id': 'req-4d1a0370-ce19-48f0-8395-591e525eb520'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:30.828426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4d1a0370-ce19-48f0-8395-591e525eb520 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0771943ca95c463998e2c2321dfc3685', 'request_id': 'req-4d1a0370-ce19-48f0-8395-591e525eb520'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:30.845345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4d1a0370-ce19-48f0-8395-591e525eb520 admin admin] The token cache is being invalidate because project 0771943ca95c463998e2c2321dfc3685 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:09:30.846688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4d1a0370-ce19-48f0-8395-591e525eb520 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:30.847414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4d1a0370-ce19-48f0-8395-591e525eb520 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:30.849448 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 861/1717] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:09:30 2022] DELETE /identity/v3/projects/0771943ca95c463998e2c2321dfc3685 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:30.850898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a0370-ce19-48f0-8395-591e525eb520 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:30.853477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4d1a0370-ce19-48f0-8395-591e525eb520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:30.883842 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 857/1718] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:30.883842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc4dd9-1d27-468d-980e-bfe451adf860 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:30.883842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-77dc4dd9-1d27-468d-980e-bfe451adf860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:30.897353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc4dd9-1d27-468d-980e-bfe451adf860 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:30.915284 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:30.998548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a0370-ce19-48f0-8395-591e525eb520 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:31.007525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b5629-888f-43ad-b04b-6128f2ee88e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:31.008380 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b5629-888f-43ad-b04b-6128f2ee88e4 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:31.008648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b5629-888f-43ad-b04b-6128f2ee88e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:31.008924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b5629-888f-43ad-b04b-6128f2ee88e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:31.011191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ec3b5629-888f-43ad-b04b-6128f2ee88e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:31.013613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5014cd-c41e-4c9e-95d7-d4c7c23a97cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:31.015341 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5014cd-c41e-4c9e-95d7-d4c7c23a97cc admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:31.016509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5014cd-c41e-4c9e-95d7-d4c7c23a97cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:31.017261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5014cd-c41e-4c9e-95d7-d4c7c23a97cc admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:31.018658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5014cd-c41e-4c9e-95d7-d4c7c23a97cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:31.021807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5014cd-c41e-4c9e-95d7-d4c7c23a97cc admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:31.053868 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 858/1719] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:30 2022] POST /identity/v3/users => generated 295 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:31.054869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2eaa65-1519-4259-bc10-322aad78fb8a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:31.055156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2eaa65-1519-4259-bc10-322aad78fb8a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:31.055519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2eaa65-1519-4259-bc10-322aad78fb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:31.090625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ac2eaa65-1519-4259-bc10-322aad78fb8a None None] MFA Rules not processed for user `5ff86b78b7574be485bca55324b517e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:31.091942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ac2eaa65-1519-4259-bc10-322aad78fb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:31.109570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b5629-888f-43ad-b04b-6128f2ee88e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:31.111471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b5629-888f-43ad-b04b-6128f2ee88e4 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:31.124556 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:31.124809 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 862/1720] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:30 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:31.125796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b5629-888f-43ad-b04b-6128f2ee88e4 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:31.126991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ec3b5629-888f-43ad-b04b-6128f2ee88e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:31.144538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b5629-888f-43ad-b04b-6128f2ee88e4 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:31.150735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b560090-7454-44da-add5-ab7405743191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:31.156086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b560090-7454-44da-add5-ab7405743191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:31.156443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b560090-7454-44da-add5-ab7405743191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:31.156803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b560090-7454-44da-add5-ab7405743191 admin admin] PATH_INFO: `/v3/users/72b47c4daf644a7eab24521c2f41dfdb` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:31.158481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b560090-7454-44da-add5-ab7405743191 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72b47c4daf644a7eab24521c2f41dfdb)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:31.160891 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b560090-7454-44da-add5-ab7405743191 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:31.199111 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 859/1721] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:31 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:31.200744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124be7b-9f3a-4fce-a952-5dcc9bf220a2 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:31.201112 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124be7b-9f3a-4fce-a952-5dcc9bf220a2 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:31.201470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124be7b-9f3a-4fce-a952-5dcc9bf220a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:31.227550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6124be7b-9f3a-4fce-a952-5dcc9bf220a2 None None] MFA Rules not processed for user `37a892781ecd4300b6dd10b9c235e263`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:31.229082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6124be7b-9f3a-4fce-a952-5dcc9bf220a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:31.260980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0b560090-7454-44da-add5-ab7405743191 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72b47c4daf644a7eab24521c2f41dfdb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:31.272461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0b560090-7454-44da-add5-ab7405743191 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72b47c4daf644a7eab24521c2f41dfdb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:31.293950 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0b560090-7454-44da-add5-ab7405743191 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72b47c4daf644a7eab24521c2f41dfdb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:31.300211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0b560090-7454-44da-add5-ab7405743191 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72b47c4daf644a7eab24521c2f41dfdb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:31.314092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0b560090-7454-44da-add5-ab7405743191 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72b47c4daf644a7eab24521c2f41dfdb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:31.320531 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 860/1722] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:31.322243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b924b-1226-4c21-bc66-dc53e3fc4086 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:31.322692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b924b-1226-4c21-bc66-dc53e3fc4086 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:31.323137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b924b-1226-4c21-bc66-dc53e3fc4086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:31.323357 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 863/1723] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:09:31 2022] DELETE /identity/v3/users/72b47c4daf644a7eab24521c2f41dfdb => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:31.325037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b560090-7454-44da-add5-ab7405743191 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:31.334515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0b560090-7454-44da-add5-ab7405743191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:31.351035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-092b924b-1226-4c21-bc66-dc53e3fc4086 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:31.352808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-092b924b-1226-4c21-bc66-dc53e3fc4086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:31.411831 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:31.459136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b560090-7454-44da-add5-ab7405743191 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:31.475232 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 861/1724] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:31.476464 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b924b-1226-4c21-bc66-dc53e3fc4086 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:31.479432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fc648-50a7-4e70-ae50-de1fe908a727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:31.481387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fc648-50a7-4e70-ae50-de1fe908a727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:31.481755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fc648-50a7-4e70-ae50-de1fe908a727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:31.481972 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fc648-50a7-4e70-ae50-de1fe908a727 admin admin] PATH_INFO: `/v3/projects/0afe6dcb22ed4e028d37c9ec3e7c6474` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:31.483383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-092b924b-1226-4c21-bc66-dc53e3fc4086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:31.484360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618fc648-50a7-4e70-ae50-de1fe908a727 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0afe6dcb22ed4e028d37c9ec3e7c6474)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:31.495442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618fc648-50a7-4e70-ae50-de1fe908a727 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:31.510472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b924b-1226-4c21-bc66-dc53e3fc4086 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:31.521737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f198aa4-042d-4537-84a8-03d9de6d55b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:31.522768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f198aa4-042d-4537-84a8-03d9de6d55b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:31.523301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f198aa4-042d-4537-84a8-03d9de6d55b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:31.523667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f198aa4-042d-4537-84a8-03d9de6d55b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:31.524717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f198aa4-042d-4537-84a8-03d9de6d55b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:31.528809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f198aa4-042d-4537-84a8-03d9de6d55b2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:31.542888 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 862/1725] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:31.544417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b67b0-efc8-4e01-83bb-e4205b7dc0e6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:31.544708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b67b0-efc8-4e01-83bb-e4205b7dc0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:31.544979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b67b0-efc8-4e01-83bb-e4205b7dc0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:31.572198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-266b67b0-efc8-4e01-83bb-e4205b7dc0e6 None None] MFA Rules not processed for user `2e60f068764c4a259771662a83663cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:31.573441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-266b67b0-efc8-4e01-83bb-e4205b7dc0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:31.602213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-618fc648-50a7-4e70-ae50-de1fe908a727 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0afe6dcb22ed4e028d37c9ec3e7c6474', 'request_id': 'req-618fc648-50a7-4e70-ae50-de1fe908a727'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:31.631576 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-618fc648-50a7-4e70-ae50-de1fe908a727 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0afe6dcb22ed4e028d37c9ec3e7c6474', 'request_id': 'req-618fc648-50a7-4e70-ae50-de1fe908a727'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:31.643157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-618fc648-50a7-4e70-ae50-de1fe908a727 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0afe6dcb22ed4e028d37c9ec3e7c6474', 'request_id': 'req-618fc648-50a7-4e70-ae50-de1fe908a727'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:31.667380 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:31.668875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-618fc648-50a7-4e70-ae50-de1fe908a727 admin admin] The token cache is being invalidate because project 0afe6dcb22ed4e028d37c9ec3e7c6474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:09:31.669482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-618fc648-50a7-4e70-ae50-de1fe908a727 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:31.670646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-618fc648-50a7-4e70-ae50-de1fe908a727 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:31.673693 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 864/1726] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:09:31 2022] DELETE /identity/v3/projects/0afe6dcb22ed4e028d37c9ec3e7c6474 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:31.674913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fc648-50a7-4e70-ae50-de1fe908a727 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:31.677058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-618fc648-50a7-4e70-ae50-de1fe908a727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:31.681007 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 863/1727] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:31.682100 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b67b0-efc8-4e01-83bb-e4205b7dc0e6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:31.683860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-266b67b0-efc8-4e01-83bb-e4205b7dc0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:31.768954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b67b0-efc8-4e01-83bb-e4205b7dc0e6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:31.774623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3471ea2-6f2b-44f3-8201-d63f118b4782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:31.776272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3471ea2-6f2b-44f3-8201-d63f118b4782 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:31.776580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3471ea2-6f2b-44f3-8201-d63f118b4782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:31.777124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3471ea2-6f2b-44f3-8201-d63f118b4782 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:31.778453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3471ea2-6f2b-44f3-8201-d63f118b4782 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:09:31.778879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3471ea2-6f2b-44f3-8201-d63f118b4782 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:31.780968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3471ea2-6f2b-44f3-8201-d63f118b4782 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:31.793037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fc648-50a7-4e70-ae50-de1fe908a727 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:31.800243 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 864/1728] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:09:31.802184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3471ea2-6f2b-44f3-8201-d63f118b4782 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:31.805082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b3471ea2-6f2b-44f3-8201-d63f118b4782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:31.809515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96ee38-5aeb-4616-b85e-3a770176bbc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:31.810595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96ee38-5aeb-4616-b85e-3a770176bbc9 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:31.811265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96ee38-5aeb-4616-b85e-3a770176bbc9 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:31.811722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96ee38-5aeb-4616-b85e-3a770176bbc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:31.814881 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9f96ee38-5aeb-4616-b85e-3a770176bbc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:31.821216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3471ea2-6f2b-44f3-8201-d63f118b4782 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:31.827826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a53fce-a8be-4ef2-be12-f1f31751dc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:31.828730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a53fce-a8be-4ef2-be12-f1f31751dc83 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:31.829128 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a53fce-a8be-4ef2-be12-f1f31751dc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:31.829514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a53fce-a8be-4ef2-be12-f1f31751dc83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:31.830494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a53fce-a8be-4ef2-be12-f1f31751dc83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:31.832965 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a53fce-a8be-4ef2-be12-f1f31751dc83 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:31.847784 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 865/1729] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:31.849494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a53fce-a8be-4ef2-be12-f1f31751dc83 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:31.852723 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-91a53fce-a8be-4ef2-be12-f1f31751dc83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:31.870338 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a53fce-a8be-4ef2-be12-f1f31751dc83 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:31.877039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fc2d4-0b41-4509-be10-73552c14d3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:31.877905 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fc2d4-0b41-4509-be10-73552c14d3c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:31.878305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fc2d4-0b41-4509-be10-73552c14d3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:31.878732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fc2d4-0b41-4509-be10-73552c14d3c8 admin admin] PATH_INFO: `/v3/users/05a8fe7bfdd543998711596f61316191` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:31.880525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6fc2d4-0b41-4509-be10-73552c14d3c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05a8fe7bfdd543998711596f61316191)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:31.883207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6fc2d4-0b41-4509-be10-73552c14d3c8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:31.959228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6e6fc2d4-0b41-4509-be10-73552c14d3c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05a8fe7bfdd543998711596f61316191'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:31.972325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6e6fc2d4-0b41-4509-be10-73552c14d3c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05a8fe7bfdd543998711596f61316191'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:31.980385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96ee38-5aeb-4616-b85e-3a770176bbc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:31.983373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96ee38-5aeb-4616-b85e-3a770176bbc9 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:31.995142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6e6fc2d4-0b41-4509-be10-73552c14d3c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05a8fe7bfdd543998711596f61316191'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:31.996751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6e6fc2d4-0b41-4509-be10-73552c14d3c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05a8fe7bfdd543998711596f61316191'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:32.000675 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 865/1730] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:32.001790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96ee38-5aeb-4616-b85e-3a770176bbc9 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:32.003454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9f96ee38-5aeb-4616-b85e-3a770176bbc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:32.013858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6e6fc2d4-0b41-4509-be10-73552c14d3c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05a8fe7bfdd543998711596f61316191'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:32.022539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96ee38-5aeb-4616-b85e-3a770176bbc9 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:32.032678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98faaa6a-eec8-49fe-a064-47e903d2a0aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:32.033448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98faaa6a-eec8-49fe-a064-47e903d2a0aa service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:32.033810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98faaa6a-eec8-49fe-a064-47e903d2a0aa service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:32.033970 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 866/1731] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:09:31 2022] DELETE /identity/v3/users/05a8fe7bfdd543998711596f61316191 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:32.034539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98faaa6a-eec8-49fe-a064-47e903d2a0aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:32.034995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fc2d4-0b41-4509-be10-73552c14d3c8 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:32.036840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-98faaa6a-eec8-49fe-a064-47e903d2a0aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:32.038129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6e6fc2d4-0b41-4509-be10-73552c14d3c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:32.069238 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:32.079238 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98faaa6a-eec8-49fe-a064-47e903d2a0aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:32.085010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98faaa6a-eec8-49fe-a064-47e903d2a0aa service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:32.140953 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 866/1732] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:32.142501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98faaa6a-eec8-49fe-a064-47e903d2a0aa service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:32.151844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-98faaa6a-eec8-49fe-a064-47e903d2a0aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:32.188920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98faaa6a-eec8-49fe-a064-47e903d2a0aa service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:32.213072 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:32.225446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6fc2d4-0b41-4509-be10-73552c14d3c8 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:32.238569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334435d-c62c-4641-8b76-7ef54261b86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:32.239840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334435d-c62c-4641-8b76-7ef54261b86a admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:32.239840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334435d-c62c-4641-8b76-7ef54261b86a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:32.239840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334435d-c62c-4641-8b76-7ef54261b86a admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:32.240387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334435d-c62c-4641-8b76-7ef54261b86a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:32.242553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334435d-c62c-4641-8b76-7ef54261b86a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:32.278314 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 867/1733] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:32 2022] POST /identity/v3/projects => generated 375 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:32.279135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334435d-c62c-4641-8b76-7ef54261b86a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:32.281657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8334435d-c62c-4641-8b76-7ef54261b86a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:32.316474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c48fb-bb11-4d09-aeb2-0302b2d80475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:32.317310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c48fb-bb11-4d09-aeb2-0302b2d80475 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:32.317686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c48fb-bb11-4d09-aeb2-0302b2d80475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:32.318120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c48fb-bb11-4d09-aeb2-0302b2d80475 admin admin] PATH_INFO: `/v3/projects/010ea68aed824d6bac970360d34ab747/users/909b8165f015473c9977ef92aaf0741b/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:32.347295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c48fb-bb11-4d09-aeb2-0302b2d80475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=010ea68aed824d6bac970360d34ab747, user_id=909b8165f015473c9977ef92aaf0741b, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:32.351337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c48fb-bb11-4d09-aeb2-0302b2d80475 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:32.386364 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 867/1734] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:32 2022] PUT /identity/v3/projects/010ea68aed824d6bac970360d34ab747/users/909b8165f015473c9977ef92aaf0741b/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:32.386364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0847b50-1955-474a-9018-0317f02213c1 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:32.386364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0847b50-1955-474a-9018-0317f02213c1 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:32.386364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0847b50-1955-474a-9018-0317f02213c1 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:32.386364 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 868/1735] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:09:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:09:32.387695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83864a-c93e-4539-9748-cbbf3cee91dd None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:32.387999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334435d-c62c-4641-8b76-7ef54261b86a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:32.388152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83864a-c93e-4539-9748-cbbf3cee91dd None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:32.388306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83864a-c93e-4539-9748-cbbf3cee91dd None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:32.390270 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 869/1736] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:09:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:09:32.394232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83864a-c93e-4539-9748-cbbf3cee91dd None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:32.492455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83864a-c93e-4539-9748-cbbf3cee91dd None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:32.495178 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d3142-86b6-47b3-8e83-0056564bf060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:32.495995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d3142-86b6-47b3-8e83-0056564bf060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:32.497266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d3142-86b6-47b3-8e83-0056564bf060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:32.497544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d3142-86b6-47b3-8e83-0056564bf060 admin admin] PATH_INFO: `/v3/projects/27d4c8103087466ebf02d5402b6edb35` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:32.499717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffad14-c886-4d18-928f-98308e3f041e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:32.500651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d3142-86b6-47b3-8e83-0056564bf060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d4c8103087466ebf02d5402b6edb35)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:32.501175 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffad14-c886-4d18-928f-98308e3f041e admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:32.502580 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffad14-c886-4d18-928f-98308e3f041e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:32.502580 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffad14-c886-4d18-928f-98308e3f041e admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:32.502796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffad14-c886-4d18-928f-98308e3f041e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:32.505356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d3142-86b6-47b3-8e83-0056564bf060 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:32.505522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffad14-c886-4d18-928f-98308e3f041e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:32.538654 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 870/1737] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:32 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:32.538654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d5a16-13d7-4340-819b-6887d264410d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:32.538654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d5a16-13d7-4340-819b-6887d264410d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:32.538654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d5a16-13d7-4340-819b-6887d264410d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:32.563824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e25d5a16-13d7-4340-819b-6887d264410d None None] MFA Rules not processed for user `6c70d5a72d424db68de7c7b8257fe02c`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:32.565219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e25d5a16-13d7-4340-819b-6887d264410d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:32.586872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-607d3142-86b6-47b3-8e83-0056564bf060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d4c8103087466ebf02d5402b6edb35', 'request_id': 'req-607d3142-86b6-47b3-8e83-0056564bf060'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:32.594047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-607d3142-86b6-47b3-8e83-0056564bf060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d4c8103087466ebf02d5402b6edb35', 'request_id': 'req-607d3142-86b6-47b3-8e83-0056564bf060'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:32.601026 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-607d3142-86b6-47b3-8e83-0056564bf060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d4c8103087466ebf02d5402b6edb35', 'request_id': 'req-607d3142-86b6-47b3-8e83-0056564bf060'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:32.618250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-607d3142-86b6-47b3-8e83-0056564bf060 admin admin] The token cache is being invalidate because project 27d4c8103087466ebf02d5402b6edb35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:09:32.618718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-607d3142-86b6-47b3-8e83-0056564bf060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:32.619760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-607d3142-86b6-47b3-8e83-0056564bf060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:32.622574 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 868/1738] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:09:32 2022] DELETE /identity/v3/projects/27d4c8103087466ebf02d5402b6edb35 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:32.624489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57cbcbd-b77a-4071-a002-71fec4e207c9 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:32.624986 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57cbcbd-b77a-4071-a002-71fec4e207c9 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:32.625474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57cbcbd-b77a-4071-a002-71fec4e207c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:32.643595 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:32.657344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d57cbcbd-b77a-4071-a002-71fec4e207c9 None None] MFA Rules not processed for user `6c70d5a72d424db68de7c7b8257fe02c`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:32.659185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d57cbcbd-b77a-4071-a002-71fec4e207c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:32.661695 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 871/1739] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:09:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:32.664642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196225a-5909-417f-92ad-69a2b0ae8308 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:32.665033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196225a-5909-417f-92ad-69a2b0ae8308 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:32.665339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196225a-5909-417f-92ad-69a2b0ae8308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:32.672215 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 869/1740] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:09:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:32.673131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57cbcbd-b77a-4071-a002-71fec4e207c9 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:32.676100 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d57cbcbd-b77a-4071-a002-71fec4e207c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:32.694027 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:32.702564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1196225a-5909-417f-92ad-69a2b0ae8308 None None] MFA Rules not processed for user `909b8165f015473c9977ef92aaf0741b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:32.703977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1196225a-5909-417f-92ad-69a2b0ae8308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:32.754321 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57cbcbd-b77a-4071-a002-71fec4e207c9 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:32.759015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601e492-bbed-4acd-81b1-791bdb41740a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:32.759704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601e492-bbed-4acd-81b1-791bdb41740a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:32.760016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601e492-bbed-4acd-81b1-791bdb41740a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:32.760293 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601e492-bbed-4acd-81b1-791bdb41740a admin admin] PATH_INFO: `/v3/projects/e29bf6c8c2cb469492d158acd882a854` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:32.761443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601e492-bbed-4acd-81b1-791bdb41740a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e29bf6c8c2cb469492d158acd882a854)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:32.763490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601e492-bbed-4acd-81b1-791bdb41740a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:32.777172 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 872/1741] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:32.779183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196225a-5909-417f-92ad-69a2b0ae8308 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:32.780743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1196225a-5909-417f-92ad-69a2b0ae8308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:32.798811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1196225a-5909-417f-92ad-69a2b0ae8308 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:32.806679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c55205-11fa-4fec-8cb5-3e7dca5f5fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:32.807714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c55205-11fa-4fec-8cb5-3e7dca5f5fbb admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:32.808242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c55205-11fa-4fec-8cb5-3e7dca5f5fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:32.808903 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c55205-11fa-4fec-8cb5-3e7dca5f5fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:32.810145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c55205-11fa-4fec-8cb5-3e7dca5f5fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:32.813111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c55205-11fa-4fec-8cb5-3e7dca5f5fbb admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:32.819813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5601e492-bbed-4acd-81b1-791bdb41740a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e29bf6c8c2cb469492d158acd882a854', 'request_id': 'req-5601e492-bbed-4acd-81b1-791bdb41740a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:32.826436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5601e492-bbed-4acd-81b1-791bdb41740a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e29bf6c8c2cb469492d158acd882a854', 'request_id': 'req-5601e492-bbed-4acd-81b1-791bdb41740a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:32.832340 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 873/1742] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:32.833538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5601e492-bbed-4acd-81b1-791bdb41740a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e29bf6c8c2cb469492d158acd882a854', 'request_id': 'req-5601e492-bbed-4acd-81b1-791bdb41740a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:32.835273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5ad1c-05eb-4f32-884e-c374162b86e7 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:32.835273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5ad1c-05eb-4f32-884e-c374162b86e7 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:32.835554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5ad1c-05eb-4f32-884e-c374162b86e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:32.848688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5601e492-bbed-4acd-81b1-791bdb41740a admin admin] The token cache is being invalidate because project e29bf6c8c2cb469492d158acd882a854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:09:32.849210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5601e492-bbed-4acd-81b1-791bdb41740a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:32.850016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5601e492-bbed-4acd-81b1-791bdb41740a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:32.856449 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 870/1743] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:09:32 2022] DELETE /identity/v3/projects/e29bf6c8c2cb469492d158acd882a854 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:32.856449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601e492-bbed-4acd-81b1-791bdb41740a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:32.856449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5601e492-bbed-4acd-81b1-791bdb41740a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:32.868869 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-fcc5ad1c-05eb-4f32-884e-c374162b86e7 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:32.870937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fcc5ad1c-05eb-4f32-884e-c374162b86e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:32.954188 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 874/1744] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:32.956026 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5ad1c-05eb-4f32-884e-c374162b86e7 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:32.958295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fcc5ad1c-05eb-4f32-884e-c374162b86e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:32.984971 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601e492-bbed-4acd-81b1-791bdb41740a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:32.989217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c62524-997c-43bc-ae91-12f4328449df service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:32.989865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c62524-997c-43bc-ae91-12f4328449df service glance] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:32.990142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c62524-997c-43bc-ae91-12f4328449df service glance] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:32.990512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c62524-997c-43bc-ae91-12f4328449df service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:32.991163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5ad1c-05eb-4f32-884e-c374162b86e7 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:32.992518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b7c62524-997c-43bc-ae91-12f4328449df service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:32.995062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a7ee0-932b-4fec-aa4e-c3ef265e9325 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:32.995688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a7ee0-932b-4fec-aa4e-c3ef265e9325 service glance] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:32.996043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a7ee0-932b-4fec-aa4e-c3ef265e9325 service glance] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:32.996398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a7ee0-932b-4fec-aa4e-c3ef265e9325 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:32.998517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-245a7ee0-932b-4fec-aa4e-c3ef265e9325 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:33.034228 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:33.080641 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:33.082815 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c62524-997c-43bc-ae91-12f4328449df service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:33.083909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a7ee0-932b-4fec-aa4e-c3ef265e9325 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:33.084671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c62524-997c-43bc-ae91-12f4328449df service glance] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:33.086554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a7ee0-932b-4fec-aa4e-c3ef265e9325 service glance] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:33.096782 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 871/1745] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:33.097704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c62524-997c-43bc-ae91-12f4328449df service glance] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:33.099134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b7c62524-997c-43bc-ae91-12f4328449df service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:33.100428 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 875/1746] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:33.101711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a7ee0-932b-4fec-aa4e-c3ef265e9325 service glance] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:33.103321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-245a7ee0-932b-4fec-aa4e-c3ef265e9325 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:33.117831 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a7ee0-932b-4fec-aa4e-c3ef265e9325 service glance] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:33.120637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c62524-997c-43bc-ae91-12f4328449df service glance] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:33.123767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272cbd96-7dc9-413e-b021-0ad681c3a84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:33.124421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cbd96-7dc9-413e-b021-0ad681c3a84e admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:33.124707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cbd96-7dc9-413e-b021-0ad681c3a84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:33.124981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cbd96-7dc9-413e-b021-0ad681c3a84e admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:33.125632 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272cbd96-7dc9-413e-b021-0ad681c3a84e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:33.127230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272cbd96-7dc9-413e-b021-0ad681c3a84e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:33.129467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f436d73-9488-4702-97b7-90a528e3291f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:33.130491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f436d73-9488-4702-97b7-90a528e3291f admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:33.130951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f436d73-9488-4702-97b7-90a528e3291f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:33.131412 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f436d73-9488-4702-97b7-90a528e3291f admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:33.132747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f436d73-9488-4702-97b7-90a528e3291f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:33.137405 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f436d73-9488-4702-97b7-90a528e3291f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:33.151159 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 876/1747] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:33.151159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98908b1-f2dc-489c-a8ca-976d64ebbc0b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:33.151159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98908b1-f2dc-489c-a8ca-976d64ebbc0b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:33.151159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98908b1-f2dc-489c-a8ca-976d64ebbc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:33.177325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f98908b1-f2dc-489c-a8ca-976d64ebbc0b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:33.178737 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f98908b1-f2dc-489c-a8ca-976d64ebbc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:33.187808 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 877/1748] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:33.191674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454575b-04ba-4a5c-aa8d-73aad46e310f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:33.191674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454575b-04ba-4a5c-aa8d-73aad46e310f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:33.191674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454575b-04ba-4a5c-aa8d-73aad46e310f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:33.192841 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 872/1749] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:33 2022] POST /identity/v3/projects => generated 389 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:33.193963 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f436d73-9488-4702-97b7-90a528e3291f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:33.231181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2454575b-04ba-4a5c-aa8d-73aad46e310f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:33.236956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2454575b-04ba-4a5c-aa8d-73aad46e310f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:33.299434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f436d73-9488-4702-97b7-90a528e3291f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:33.307279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e4396f-d863-4246-a851-66ad3c7f4ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:33.311230 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4396f-d863-4246-a851-66ad3c7f4ec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:33.311644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4396f-d863-4246-a851-66ad3c7f4ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:33.313688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4396f-d863-4246-a851-66ad3c7f4ec7 admin admin] PATH_INFO: `/v3/projects/e69f58f3b72e47a18d2e2ac28b6b4b0c/users/dcb338858f314453b2cc3a1cc701b453/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:33.336639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4396f-d863-4246-a851-66ad3c7f4ec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e69f58f3b72e47a18d2e2ac28b6b4b0c, user_id=dcb338858f314453b2cc3a1cc701b453, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:33.339663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e4396f-d863-4246-a851-66ad3c7f4ec7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:33.350048 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 878/1750] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:33.351089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454575b-04ba-4a5c-aa8d-73aad46e310f None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:33.362648 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 873/1751] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:33 2022] PUT /identity/v3/projects/e69f58f3b72e47a18d2e2ac28b6b4b0c/users/dcb338858f314453b2cc3a1cc701b453/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:33.364635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc717ec-9a21-4eeb-822c-2cbe2040edbf None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:33.364988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454575b-04ba-4a5c-aa8d-73aad46e310f None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:33.365250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc717ec-9a21-4eeb-822c-2cbe2040edbf None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:33.365736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc717ec-9a21-4eeb-822c-2cbe2040edbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:33.392624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-dfc717ec-9a21-4eeb-822c-2cbe2040edbf None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:33.394145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-dfc717ec-9a21-4eeb-822c-2cbe2040edbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:33.455531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1407c-fa0a-4ded-a48f-88c984d3dd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:33.456516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1407c-fa0a-4ded-a48f-88c984d3dd3d admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:33.457113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1407c-fa0a-4ded-a48f-88c984d3dd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:33.457519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1407c-fa0a-4ded-a48f-88c984d3dd3d admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:33.458328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1407c-fa0a-4ded-a48f-88c984d3dd3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:33.461446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1407c-fa0a-4ded-a48f-88c984d3dd3d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:33.472333 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 874/1752] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:33.474147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc717ec-9a21-4eeb-822c-2cbe2040edbf None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:33.490417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc717ec-9a21-4eeb-822c-2cbe2040edbf None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:33.495773 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 879/1753] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:33 2022] POST /identity/v3/users => generated 301 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:33.498194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c08ade-8d06-4bbf-91e9-a3cccd8189e4 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:33.498678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c08ade-8d06-4bbf-91e9-a3cccd8189e4 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:33.499077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c08ade-8d06-4bbf-91e9-a3cccd8189e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:33.500078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec5c84-17ad-4e70-8562-cc954f7b272b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:33.500969 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec5c84-17ad-4e70-8562-cc954f7b272b admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:33.501696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec5c84-17ad-4e70-8562-cc954f7b272b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:33.502217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec5c84-17ad-4e70-8562-cc954f7b272b admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:33.503635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec5c84-17ad-4e70-8562-cc954f7b272b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:09:33.504150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec5c84-17ad-4e70-8562-cc954f7b272b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:33.506376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec5c84-17ad-4e70-8562-cc954f7b272b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:33.527637 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 875/1754] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:09:33.529210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec5c84-17ad-4e70-8562-cc954f7b272b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:33.542308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c5c08ade-8d06-4bbf-91e9-a3cccd8189e4 None None] MFA Rules not processed for user `dcb338858f314453b2cc3a1cc701b453`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:33.544296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c5c08ade-8d06-4bbf-91e9-a3cccd8189e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:33.549788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec5c84-17ad-4e70-8562-cc954f7b272b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:33.556812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b44929-5b36-47b0-a14b-722b2df479a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:33.558876 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b44929-5b36-47b0-a14b-722b2df479a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:33.560204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b44929-5b36-47b0-a14b-722b2df479a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:33.560520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b44929-5b36-47b0-a14b-722b2df479a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:33.562196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b44929-5b36-47b0-a14b-722b2df479a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:09:33.562372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b44929-5b36-47b0-a14b-722b2df479a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:33.564430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b44929-5b36-47b0-a14b-722b2df479a9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:33.578982 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:33.594417 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 876/1755] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:09:33.594417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b44929-5b36-47b0-a14b-722b2df479a9 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:33.606553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b44929-5b36-47b0-a14b-722b2df479a9 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:33.613697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dcdb52-da22-4069-b39f-32ff5d75d090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:33.614691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dcdb52-da22-4069-b39f-32ff5d75d090 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:33.615038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dcdb52-da22-4069-b39f-32ff5d75d090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:33.615374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dcdb52-da22-4069-b39f-32ff5d75d090 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:33.616156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dcdb52-da22-4069-b39f-32ff5d75d090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:33.619472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dcdb52-da22-4069-b39f-32ff5d75d090 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:33.637826 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:33.648694 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 877/1756] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:33.649026 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 880/1757] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:33.649118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dcdb52-da22-4069-b39f-32ff5d75d090 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:33.649221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c08ade-8d06-4bbf-91e9-a3cccd8189e4 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:33.657914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dcdb52-da22-4069-b39f-32ff5d75d090 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:33.664918 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995e73f-8a38-4cb7-a8cb-d3124152fad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:33.665186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c08ade-8d06-4bbf-91e9-a3cccd8189e4 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:33.665701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995e73f-8a38-4cb7-a8cb-d3124152fad9 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:33.666045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995e73f-8a38-4cb7-a8cb-d3124152fad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:33.666485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995e73f-8a38-4cb7-a8cb-d3124152fad9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:33.667113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995e73f-8a38-4cb7-a8cb-d3124152fad9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:33.670145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995e73f-8a38-4cb7-a8cb-d3124152fad9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:33.678084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33148bed-7fe6-4fb3-82d3-67139a9f8ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:33.679366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33148bed-7fe6-4fb3-82d3-67139a9f8ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:33.680384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33148bed-7fe6-4fb3-82d3-67139a9f8ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:33.681026 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33148bed-7fe6-4fb3-82d3-67139a9f8ff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:33.682063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33148bed-7fe6-4fb3-82d3-67139a9f8ff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:33.685375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33148bed-7fe6-4fb3-82d3-67139a9f8ff8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:33.733274 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 878/1758] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:33 2022] POST /identity/v3/projects => generated 375 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:33.738351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995e73f-8a38-4cb7-a8cb-d3124152fad9 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:33.745111 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 881/1759] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:33 2022] POST /identity/v3/projects => generated 393 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:33.746187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33148bed-7fe6-4fb3-82d3-67139a9f8ff8 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:33.890837 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995e73f-8a38-4cb7-a8cb-d3124152fad9 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:33.905753 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b3c39-acea-42f9-91fa-81aa48200028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:33.906438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b3c39-acea-42f9-91fa-81aa48200028 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:33.906715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b3c39-acea-42f9-91fa-81aa48200028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:33.906983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b3c39-acea-42f9-91fa-81aa48200028 admin admin] PATH_INFO: `/v3/projects/f2239ad86993401085b946379209eda3/users/9accbb8655b84894be9a101d7ffdcf33/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:33.907534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33148bed-7fe6-4fb3-82d3-67139a9f8ff8 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:33.923048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1eda6c-7289-4a88-9c29-0fca0ed270e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:33.924048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1eda6c-7289-4a88-9c29-0fca0ed270e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:33.924382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1eda6c-7289-4a88-9c29-0fca0ed270e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:33.924839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1eda6c-7289-4a88-9c29-0fca0ed270e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:33.925754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1eda6c-7289-4a88-9c29-0fca0ed270e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:33.936784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1eda6c-7289-4a88-9c29-0fca0ed270e1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:33.948182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b3c39-acea-42f9-91fa-81aa48200028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2239ad86993401085b946379209eda3, user_id=9accbb8655b84894be9a101d7ffdcf33, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:33.951517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b3c39-acea-42f9-91fa-81aa48200028 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:33.981553 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 879/1760] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:33 2022] PUT /identity/v3/projects/f2239ad86993401085b946379209eda3/users/9accbb8655b84894be9a101d7ffdcf33/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:33.981553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b3c39-acea-42f9-91fa-81aa48200028 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:33.999966 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 882/1761] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:33 2022] POST /identity/v3/projects => generated 377 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:34.001437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1eda6c-7289-4a88-9c29-0fca0ed270e1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:34.098470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b3c39-acea-42f9-91fa-81aa48200028 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:34.103776 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04484f18-8b68-4ba4-936b-61e4b3f15f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:34.104117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1eda6c-7289-4a88-9c29-0fca0ed270e1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:34.104783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04484f18-8b68-4ba4-936b-61e4b3f15f37 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:34.105171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04484f18-8b68-4ba4-936b-61e4b3f15f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:34.105491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04484f18-8b68-4ba4-936b-61e4b3f15f37 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:34.106284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04484f18-8b68-4ba4-936b-61e4b3f15f37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:34.110542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04484f18-8b68-4ba4-936b-61e4b3f15f37 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:34.117642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192b6a0-e51f-4a90-9f6b-23526e5413b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:34.117642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192b6a0-e51f-4a90-9f6b-23526e5413b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:34.117642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192b6a0-e51f-4a90-9f6b-23526e5413b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:34.117642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192b6a0-e51f-4a90-9f6b-23526e5413b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:34.118093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c192b6a0-e51f-4a90-9f6b-23526e5413b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:34.124795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c192b6a0-e51f-4a90-9f6b-23526e5413b3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:34.135158 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 880/1762] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:33 2022] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:34.136434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04484f18-8b68-4ba4-936b-61e4b3f15f37 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:34.138495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-04484f18-8b68-4ba4-936b-61e4b3f15f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:34.164481 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 883/1763] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:33 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:34.166306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192b6a0-e51f-4a90-9f6b-23526e5413b3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:34.170141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c192b6a0-e51f-4a90-9f6b-23526e5413b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:34.218616 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:34.243031 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:34.265672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192b6a0-e51f-4a90-9f6b-23526e5413b3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:34.265914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04484f18-8b68-4ba4-936b-61e4b3f15f37 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:34.270760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24796e14-962e-40b2-bb88-33c055ace10c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:34.271388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24796e14-962e-40b2-bb88-33c055ace10c service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:34.271661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24796e14-962e-40b2-bb88-33c055ace10c service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:34.271960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24796e14-962e-40b2-bb88-33c055ace10c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:34.272681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06a0c4-415f-4374-839e-fcf11ef53608 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:34.273433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06a0c4-415f-4374-839e-fcf11ef53608 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:34.273623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06a0c4-415f-4374-839e-fcf11ef53608 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:34.273884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06a0c4-415f-4374-839e-fcf11ef53608 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:34.274120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-24796e14-962e-40b2-bb88-33c055ace10c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:34.276002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8a06a0c4-415f-4374-839e-fcf11ef53608 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:34.287471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24796e14-962e-40b2-bb88-33c055ace10c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:34.289111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24796e14-962e-40b2-bb88-33c055ace10c service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:34.289250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06a0c4-415f-4374-839e-fcf11ef53608 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:34.290726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06a0c4-415f-4374-839e-fcf11ef53608 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:34.301405 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 884/1764] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:34.302005 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 881/1765] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:34.302115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24796e14-962e-40b2-bb88-33c055ace10c service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:34.302732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06a0c4-415f-4374-839e-fcf11ef53608 service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:34.314165 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06a0c4-415f-4374-839e-fcf11ef53608 service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:34.314340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24796e14-962e-40b2-bb88-33c055ace10c service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:34.319070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3327f76-986b-43ab-9fb6-54ac76b94a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:34.319688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3327f76-986b-43ab-9fb6-54ac76b94a83 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:34.319904 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9584f97-7b20-4912-8baa-0e2178078f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:34.320031 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3327f76-986b-43ab-9fb6-54ac76b94a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:34.320239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3327f76-986b-43ab-9fb6-54ac76b94a83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:34.320670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9584f97-7b20-4912-8baa-0e2178078f38 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:34.320898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3327f76-986b-43ab-9fb6-54ac76b94a83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:34.320997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9584f97-7b20-4912-8baa-0e2178078f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:34.321217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9584f97-7b20-4912-8baa-0e2178078f38 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:34.322027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9584f97-7b20-4912-8baa-0e2178078f38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:34.323001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3327f76-986b-43ab-9fb6-54ac76b94a83 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:34.323969 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9584f97-7b20-4912-8baa-0e2178078f38 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:34.338524 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 885/1766] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:34.339749 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3327f76-986b-43ab-9fb6-54ac76b94a83 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:34.354960 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 882/1767] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:34 2022] POST /identity/v3/users => generated 295 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:34.356988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9584f97-7b20-4912-8baa-0e2178078f38 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:34.358087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3327f76-986b-43ab-9fb6-54ac76b94a83 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:34.366880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b52525-b306-4a5f-bd75-4cb7cb4f30cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:34.367722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b52525-b306-4a5f-bd75-4cb7cb4f30cc admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:34.368228 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b52525-b306-4a5f-bd75-4cb7cb4f30cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:34.368680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b52525-b306-4a5f-bd75-4cb7cb4f30cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:34.369753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b52525-b306-4a5f-bd75-4cb7cb4f30cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:34.371143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9584f97-7b20-4912-8baa-0e2178078f38 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:34.374128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b52525-b306-4a5f-bd75-4cb7cb4f30cc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:34.376984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596c90e-aff6-466f-aafb-6bf31635158f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:34.377945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596c90e-aff6-466f-aafb-6bf31635158f admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:34.378223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596c90e-aff6-466f-aafb-6bf31635158f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:34.378568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596c90e-aff6-466f-aafb-6bf31635158f admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:34.379305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596c90e-aff6-466f-aafb-6bf31635158f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:34.381209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596c90e-aff6-466f-aafb-6bf31635158f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:34.394966 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 883/1768] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:34.395826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596c90e-aff6-466f-aafb-6bf31635158f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:34.407620 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596c90e-aff6-466f-aafb-6bf31635158f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:34.407820 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 886/1769] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:34.409541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b52525-b306-4a5f-bd75-4cb7cb4f30cc admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:34.414902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88706f-776f-4037-8789-547abbdf6efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:34.415589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88706f-776f-4037-8789-547abbdf6efb admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:34.415875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88706f-776f-4037-8789-547abbdf6efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:34.416187 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88706f-776f-4037-8789-547abbdf6efb admin admin] PATH_INFO: `/v3/projects/f2239ad86993401085b946379209eda3/users/9accbb8655b84894be9a101d7ffdcf33/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:34.419179 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa88706f-776f-4037-8789-547abbdf6efb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2239ad86993401085b946379209eda3, user_id=9accbb8655b84894be9a101d7ffdcf33, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:34.422179 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa88706f-776f-4037-8789-547abbdf6efb admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:34.432812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b52525-b306-4a5f-bd75-4cb7cb4f30cc admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:34.444413 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 884/1770] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:34 2022] PUT /identity/v3/projects/f2239ad86993401085b946379209eda3/users/9accbb8655b84894be9a101d7ffdcf33/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:34.446417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88706f-776f-4037-8789-547abbdf6efb admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:34.516225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4fd43-9c2b-40da-95ec-aea5756d21fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:34.516995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4fd43-9c2b-40da-95ec-aea5756d21fb admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:34.518027 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4fd43-9c2b-40da-95ec-aea5756d21fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:34.518027 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4fd43-9c2b-40da-95ec-aea5756d21fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:34.518515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4fd43-9c2b-40da-95ec-aea5756d21fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:34.520780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4fd43-9c2b-40da-95ec-aea5756d21fb admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:34.540277 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 887/1771] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:34.541863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4fd43-9c2b-40da-95ec-aea5756d21fb admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:34.557976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4fd43-9c2b-40da-95ec-aea5756d21fb admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:34.571559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88706f-776f-4037-8789-547abbdf6efb admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:34.576791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f381e59-2ff5-43ee-ace3-53227fd28d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:34.577660 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f381e59-2ff5-43ee-ace3-53227fd28d04 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:34.578005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f381e59-2ff5-43ee-ace3-53227fd28d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:34.578337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f381e59-2ff5-43ee-ace3-53227fd28d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:34.578643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e891c07-052c-4727-9ffd-db7ee3ad7f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:34.579123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f381e59-2ff5-43ee-ace3-53227fd28d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:34.579791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e891c07-052c-4727-9ffd-db7ee3ad7f72 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:34.580353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e891c07-052c-4727-9ffd-db7ee3ad7f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:34.580999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e891c07-052c-4727-9ffd-db7ee3ad7f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:34.581646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f381e59-2ff5-43ee-ace3-53227fd28d04 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:34.583437 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e891c07-052c-4727-9ffd-db7ee3ad7f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:34.585637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e891c07-052c-4727-9ffd-db7ee3ad7f72 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:34.599692 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 888/1772] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:34.599692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabacda-c3d8-4970-8893-89122360b554 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:34.599692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabacda-c3d8-4970-8893-89122360b554 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:34.600586 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 885/1773] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:34.601853 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e891c07-052c-4727-9ffd-db7ee3ad7f72 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:34.602190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabacda-c3d8-4970-8893-89122360b554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:34.614154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e891c07-052c-4727-9ffd-db7ee3ad7f72 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:34.623003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f8082-1866-4e9a-9c78-17727da987f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:34.623857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f8082-1866-4e9a-9c78-17727da987f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:34.624171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f8082-1866-4e9a-9c78-17727da987f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:34.624443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f8082-1866-4e9a-9c78-17727da987f6 admin admin] PATH_INFO: `/v3/projects/19d5955f976a4ecf871bd9882387b4ad/users/e69d89fa64164206b673445855d733cb/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:34.640820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1cabacda-c3d8-4970-8893-89122360b554 None None] MFA Rules not processed for user `9accbb8655b84894be9a101d7ffdcf33`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:34.642450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1cabacda-c3d8-4970-8893-89122360b554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:34.644203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f8082-1866-4e9a-9c78-17727da987f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19d5955f976a4ecf871bd9882387b4ad, user_id=e69d89fa64164206b673445855d733cb, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:34.647992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f8082-1866-4e9a-9c78-17727da987f6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:34.665094 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 886/1774] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:34 2022] PUT /identity/v3/projects/19d5955f976a4ecf871bd9882387b4ad/users/e69d89fa64164206b673445855d733cb/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:34.666885 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f8082-1866-4e9a-9c78-17727da987f6 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:34.764491 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 889/1775] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:34 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:34.765411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabacda-c3d8-4970-8893-89122360b554 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:34.785758 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabacda-c3d8-4970-8893-89122360b554 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:34.797462 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:34.804480 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f8082-1866-4e9a-9c78-17727da987f6 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:34.814598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3012afd-4493-4db1-9006-176fcf62b75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:34.815671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3012afd-4493-4db1-9006-176fcf62b75f admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:34.816161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3012afd-4493-4db1-9006-176fcf62b75f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:34.816533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3012afd-4493-4db1-9006-176fcf62b75f admin admin] PATH_INFO: `/v3/projects/245abc5dd7c44309a6e1b051e37f6be9/users/fad6ad24de0c4f128a694ba2bec03ec9/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:34.818601 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:34.841900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3012afd-4493-4db1-9006-176fcf62b75f admin admin] RBAC: Authorizing `identity:create_grant(project_id=245abc5dd7c44309a6e1b051e37f6be9, user_id=fad6ad24de0c4f128a694ba2bec03ec9, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:34.847432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3012afd-4493-4db1-9006-176fcf62b75f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:34.864421 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 887/1776] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:34 2022] PUT /identity/v3/projects/245abc5dd7c44309a6e1b051e37f6be9/users/fad6ad24de0c4f128a694ba2bec03ec9/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:34.866330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3012afd-4493-4db1-9006-176fcf62b75f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:34.882277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72556a9-3c8b-49a7-92e4-4012a66232e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:34.883289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72556a9-3c8b-49a7-92e4-4012a66232e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:34.883563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72556a9-3c8b-49a7-92e4-4012a66232e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:34.884047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72556a9-3c8b-49a7-92e4-4012a66232e5 admin admin] PATH_INFO: `/v3/projects/39b8c8d84b9c482b9b4daafb9a5c5684/users/9808f053a85743b5ae2a61ab3de44e71/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:34.905922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72556a9-3c8b-49a7-92e4-4012a66232e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b8c8d84b9c482b9b4daafb9a5c5684, user_id=9808f053a85743b5ae2a61ab3de44e71, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:34.908963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72556a9-3c8b-49a7-92e4-4012a66232e5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:34.926578 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 890/1777] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:34 2022] PUT /identity/v3/projects/39b8c8d84b9c482b9b4daafb9a5c5684/users/9808f053a85743b5ae2a61ab3de44e71/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:34.928008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7847f0-46c4-4a56-a611-2fe469cc3442 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:34.928289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7847f0-46c4-4a56-a611-2fe469cc3442 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:34.928558 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7847f0-46c4-4a56-a611-2fe469cc3442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:34.954522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3012afd-4493-4db1-9006-176fcf62b75f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:34.968178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1f7847f0-46c4-4a56-a611-2fe469cc3442 None None] MFA Rules not processed for user `909b8165f015473c9977ef92aaf0741b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:34.969182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1f7847f0-46c4-4a56-a611-2fe469cc3442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:35.083190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cfa712-2f47-490c-a2ed-b1ee81af9c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:35.084518 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 891/1778] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:35.084649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfa712-2f47-490c-a2ed-b1ee81af9c55 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:35.084922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfa712-2f47-490c-a2ed-b1ee81af9c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:35.085283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cfa712-2f47-490c-a2ed-b1ee81af9c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:35.086114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a179551-fa9a-44a7-890e-d507f8b16bdf None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:35.086501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a179551-fa9a-44a7-890e-d507f8b16bdf None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:35.086827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a179551-fa9a-44a7-890e-d507f8b16bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:35.087944 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cfa712-2f47-490c-a2ed-b1ee81af9c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:35.097287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cfa712-2f47-490c-a2ed-b1ee81af9c55 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:35.115433 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 888/1779] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:35.115433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32f5cc-e3fb-42a3-bf99-180cbbfa9fe7 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:35.115433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32f5cc-e3fb-42a3-bf99-180cbbfa9fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:35.115433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32f5cc-e3fb-42a3-bf99-180cbbfa9fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:35.128834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-8a179551-fa9a-44a7-890e-d507f8b16bdf None None] MFA Rules not processed for user `fad6ad24de0c4f128a694ba2bec03ec9`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:35.130358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8a179551-fa9a-44a7-890e-d507f8b16bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:35.149634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9a32f5cc-e3fb-42a3-bf99-180cbbfa9fe7 None None] MFA Rules not processed for user `9808f053a85743b5ae2a61ab3de44e71`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:35.151330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9a32f5cc-e3fb-42a3-bf99-180cbbfa9fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:35.222790 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 892/1780] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:35.224222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a179551-fa9a-44a7-890e-d507f8b16bdf None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:35.229672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8a179551-fa9a-44a7-890e-d507f8b16bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:35.254659 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 889/1781] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:35.255688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32f5cc-e3fb-42a3-bf99-180cbbfa9fe7 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:35.270611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32f5cc-e3fb-42a3-bf99-180cbbfa9fe7 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:35.277046 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d66cb7-faba-4344-81a7-9cebf2848009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:35.278048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d66cb7-faba-4344-81a7-9cebf2848009 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:35.278393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d66cb7-faba-4344-81a7-9cebf2848009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:35.278738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d66cb7-faba-4344-81a7-9cebf2848009 admin admin] PATH_INFO: `/v3/projects/19d5955f976a4ecf871bd9882387b4ad/users/e69d89fa64164206b673445855d733cb/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:35.281354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d66cb7-faba-4344-81a7-9cebf2848009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19d5955f976a4ecf871bd9882387b4ad, user_id=e69d89fa64164206b673445855d733cb, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:35.284881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d66cb7-faba-4344-81a7-9cebf2848009 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:35.295455 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:35.300551 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:35.302349 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 890/1782] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:35 2022] PUT /identity/v3/projects/19d5955f976a4ecf871bd9882387b4ad/users/e69d89fa64164206b673445855d733cb/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:35.303489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d66cb7-faba-4344-81a7-9cebf2848009 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:35.352595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a179551-fa9a-44a7-890e-d507f8b16bdf None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:35.409595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d66cb7-faba-4344-81a7-9cebf2848009 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:35.415152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a614991-3c08-4ee6-86c1-6cceb1557a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:35.415793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a614991-3c08-4ee6-86c1-6cceb1557a45 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:35.416148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a614991-3c08-4ee6-86c1-6cceb1557a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:35.416446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a614991-3c08-4ee6-86c1-6cceb1557a45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:35.417081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a614991-3c08-4ee6-86c1-6cceb1557a45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:35.419142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a614991-3c08-4ee6-86c1-6cceb1557a45 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:35.434776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39014c21-73a9-4f5d-84a0-c000e8feeb6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:35.435598 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39014c21-73a9-4f5d-84a0-c000e8feeb6f service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:35.435751 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39014c21-73a9-4f5d-84a0-c000e8feeb6f service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:35.435993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39014c21-73a9-4f5d-84a0-c000e8feeb6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:35.437843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-39014c21-73a9-4f5d-84a0-c000e8feeb6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:35.462310 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 891/1783] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:35 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:35.462310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a614991-3c08-4ee6-86c1-6cceb1557a45 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:35.534462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39014c21-73a9-4f5d-84a0-c000e8feeb6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:35.536442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39014c21-73a9-4f5d-84a0-c000e8feeb6f service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:35.547822 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 893/1784] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:35 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:35.549100 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae0897-d689-4f25-8875-3c260b1414fc None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:35.549460 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae0897-d689-4f25-8875-3c260b1414fc None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:35.549803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dae0897-d689-4f25-8875-3c260b1414fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:35.583872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-4dae0897-d689-4f25-8875-3c260b1414fc None None] MFA Rules not processed for user `e69d89fa64164206b673445855d733cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:35.584699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a614991-3c08-4ee6-86c1-6cceb1557a45 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:35.585160 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4dae0897-d689-4f25-8875-3c260b1414fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:35.591398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faaf673-ed81-44eb-8176-f6d3a5838997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:35.592060 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faaf673-ed81-44eb-8176-f6d3a5838997 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:35.592338 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faaf673-ed81-44eb-8176-f6d3a5838997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:35.592665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faaf673-ed81-44eb-8176-f6d3a5838997 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:35.594087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faaf673-ed81-44eb-8176-f6d3a5838997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:35.598206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faaf673-ed81-44eb-8176-f6d3a5838997 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:35.659679 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 892/1785] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:35 2022] POST /identity/v3/projects => generated 393 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:35.661386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faaf673-ed81-44eb-8176-f6d3a5838997 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:35.690602 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 894/1786] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:35.690602 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae0897-d689-4f25-8875-3c260b1414fc None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:35.712699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dae0897-d689-4f25-8875-3c260b1414fc None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:35.718267 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:35.785407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faaf673-ed81-44eb-8176-f6d3a5838997 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:35.791059 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c534e-51b0-4a69-b39d-30a5a43713fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:35.792256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c534e-51b0-4a69-b39d-30a5a43713fc admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:35.792888 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c534e-51b0-4a69-b39d-30a5a43713fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:35.793388 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c534e-51b0-4a69-b39d-30a5a43713fc admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:35.794263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c534e-51b0-4a69-b39d-30a5a43713fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:35.796648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c534e-51b0-4a69-b39d-30a5a43713fc admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:35.811721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407610ce-2de9-46c9-81fa-9b02babc5c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:35.812593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407610ce-2de9-46c9-81fa-9b02babc5c7e admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:35.812876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407610ce-2de9-46c9-81fa-9b02babc5c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:35.813384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407610ce-2de9-46c9-81fa-9b02babc5c7e admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:35.814388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407610ce-2de9-46c9-81fa-9b02babc5c7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:35.817144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407610ce-2de9-46c9-81fa-9b02babc5c7e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:35.819254 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:35.828055 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 893/1787] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:35 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:35.829272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c534e-51b0-4a69-b39d-30a5a43713fc admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:35.831298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-137c534e-51b0-4a69-b39d-30a5a43713fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:35.869309 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 895/1788] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:35 2022] POST /identity/v3/users => generated 303 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:35.871647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407610ce-2de9-46c9-81fa-9b02babc5c7e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:35.887391 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407610ce-2de9-46c9-81fa-9b02babc5c7e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:35.895407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95126a9d-79fb-43a2-9bbb-cf551d252272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:35.896902 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95126a9d-79fb-43a2-9bbb-cf551d252272 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:35.897447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95126a9d-79fb-43a2-9bbb-cf551d252272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:35.898519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95126a9d-79fb-43a2-9bbb-cf551d252272 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:35.899736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95126a9d-79fb-43a2-9bbb-cf551d252272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:35.903082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95126a9d-79fb-43a2-9bbb-cf551d252272 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:35.927518 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 896/1789] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:35.929765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95126a9d-79fb-43a2-9bbb-cf551d252272 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:35.947112 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c534e-51b0-4a69-b39d-30a5a43713fc admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:35.954965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95126a9d-79fb-43a2-9bbb-cf551d252272 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:35.956925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7753dbc-8ce3-4cea-89d0-df1f91fc8b17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:35.957675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7753dbc-8ce3-4cea-89d0-df1f91fc8b17 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:35.958012 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7753dbc-8ce3-4cea-89d0-df1f91fc8b17 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:35.958977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7753dbc-8ce3-4cea-89d0-df1f91fc8b17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:35.989192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c827ae5-e40c-4339-a878-d201be03162d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:35.990312 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c827ae5-e40c-4339-a878-d201be03162d admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:35.991239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c827ae5-e40c-4339-a878-d201be03162d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:35.994320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c827ae5-e40c-4339-a878-d201be03162d admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:35.995862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c827ae5-e40c-4339-a878-d201be03162d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:35.999078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c827ae5-e40c-4339-a878-d201be03162d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:36.018932 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 897/1790] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:36.018932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c827ae5-e40c-4339-a878-d201be03162d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:36.030918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c827ae5-e40c-4339-a878-d201be03162d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:36.035477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23e1fa-72ad-4c08-ab09-0fcc6beba0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:36.036317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23e1fa-72ad-4c08-ab09-0fcc6beba0e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:36.036672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23e1fa-72ad-4c08-ab09-0fcc6beba0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:36.037011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23e1fa-72ad-4c08-ab09-0fcc6beba0e7 admin admin] PATH_INFO: `/v3/projects/f6d53cc25ee64824b5c2e006a029ef01/users/973430ad67504ecf8b7c0b8ba2f18850/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:36.064570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23e1fa-72ad-4c08-ab09-0fcc6beba0e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6d53cc25ee64824b5c2e006a029ef01, user_id=973430ad67504ecf8b7c0b8ba2f18850, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:36.067692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23e1fa-72ad-4c08-ab09-0fcc6beba0e7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:36.095700 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 898/1791] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:36 2022] PUT /identity/v3/projects/f6d53cc25ee64824b5c2e006a029ef01/users/973430ad67504ecf8b7c0b8ba2f18850/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:36.100275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23e1fa-72ad-4c08-ab09-0fcc6beba0e7 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:36.129814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7753dbc-8ce3-4cea-89d0-df1f91fc8b17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:36.132992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7753dbc-8ce3-4cea-89d0-df1f91fc8b17 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:36.149545 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 894/1792] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:36.150704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7753dbc-8ce3-4cea-89d0-df1f91fc8b17 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:36.165536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7753dbc-8ce3-4cea-89d0-df1f91fc8b17 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:36.213272 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23e1fa-72ad-4c08-ab09-0fcc6beba0e7 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:36.220621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a71b4-084a-4971-8d91-985c79d84147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:36.221397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a71b4-084a-4971-8d91-985c79d84147 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:36.221872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a71b4-084a-4971-8d91-985c79d84147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:36.222126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a71b4-084a-4971-8d91-985c79d84147 admin admin] PATH_INFO: `/v3/projects/bc6040481e2049cbb8ad165338911832/users/ab19c631b56c4565baf2fdac8cc117c9/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:36.246884 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a71b4-084a-4971-8d91-985c79d84147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc6040481e2049cbb8ad165338911832, user_id=ab19c631b56c4565baf2fdac8cc117c9, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:36.251910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a71b4-084a-4971-8d91-985c79d84147 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:36.273542 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 899/1793] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:36 2022] PUT /identity/v3/projects/bc6040481e2049cbb8ad165338911832/users/ab19c631b56c4565baf2fdac8cc117c9/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:36.281557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a71b4-084a-4971-8d91-985c79d84147 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:36.377585 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:36.379956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85224021-a79f-4d6d-b0d7-e18f90021307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:36.381601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85224021-a79f-4d6d-b0d7-e18f90021307 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:36.382145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85224021-a79f-4d6d-b0d7-e18f90021307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:36.382578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85224021-a79f-4d6d-b0d7-e18f90021307 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:36.383750 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85224021-a79f-4d6d-b0d7-e18f90021307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:36.387832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85224021-a79f-4d6d-b0d7-e18f90021307 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:36.416442 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 895/1794] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:36.421522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85224021-a79f-4d6d-b0d7-e18f90021307 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:36.441212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85224021-a79f-4d6d-b0d7-e18f90021307 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:36.456318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876120be-929f-4ecd-b6bc-0a6ca4d2c405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:36.457759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876120be-929f-4ecd-b6bc-0a6ca4d2c405 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:36.457890 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a71b4-084a-4971-8d91-985c79d84147 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:36.458159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876120be-929f-4ecd-b6bc-0a6ca4d2c405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:36.458798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876120be-929f-4ecd-b6bc-0a6ca4d2c405 admin admin] PATH_INFO: `/v3/projects/f6d53cc25ee64824b5c2e006a029ef01/users/973430ad67504ecf8b7c0b8ba2f18850/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:36.461896 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876120be-929f-4ecd-b6bc-0a6ca4d2c405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6d53cc25ee64824b5c2e006a029ef01, user_id=973430ad67504ecf8b7c0b8ba2f18850, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:36.465864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876120be-929f-4ecd-b6bc-0a6ca4d2c405 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:36.475071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75786c6-78ba-4348-9710-830a0bb8d5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:36.476432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75786c6-78ba-4348-9710-830a0bb8d5da admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:36.477084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75786c6-78ba-4348-9710-830a0bb8d5da admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:36.477512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75786c6-78ba-4348-9710-830a0bb8d5da admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:36.478423 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75786c6-78ba-4348-9710-830a0bb8d5da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:36.481048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75786c6-78ba-4348-9710-830a0bb8d5da admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:36.483459 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 896/1795] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:36 2022] PUT /identity/v3/projects/f6d53cc25ee64824b5c2e006a029ef01/users/973430ad67504ecf8b7c0b8ba2f18850/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:36.494654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03db872-1a9b-46fd-b2d2-175d2fd91fc6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:36.495374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03db872-1a9b-46fd-b2d2-175d2fd91fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:36.495374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03db872-1a9b-46fd-b2d2-175d2fd91fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:36.525413 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 900/1796] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:09:36.528620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75786c6-78ba-4348-9710-830a0bb8d5da admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:36.558108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75786c6-78ba-4348-9710-830a0bb8d5da admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:36.575922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-f03db872-1a9b-46fd-b2d2-175d2fd91fc6 None None] MFA Rules not processed for user `973430ad67504ecf8b7c0b8ba2f18850`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:36.578186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f03db872-1a9b-46fd-b2d2-175d2fd91fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:36.584456 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:36.705504 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 897/1797] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:36.739633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff291038-08c7-49d2-b944-ff50aa8b3270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:36.740787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff291038-08c7-49d2-b944-ff50aa8b3270 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:36.742496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff291038-08c7-49d2-b944-ff50aa8b3270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:36.742867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff291038-08c7-49d2-b944-ff50aa8b3270 admin admin] PATH_INFO: `/v3/projects/bc6040481e2049cbb8ad165338911832/users/ab19c631b56c4565baf2fdac8cc117c9/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:36.746950 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff291038-08c7-49d2-b944-ff50aa8b3270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc6040481e2049cbb8ad165338911832, user_id=ab19c631b56c4565baf2fdac8cc117c9, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:36.750686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff291038-08c7-49d2-b944-ff50aa8b3270 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:36.772465 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 901/1798] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:36 2022] PUT /identity/v3/projects/bc6040481e2049cbb8ad165338911832/users/ab19c631b56c4565baf2fdac8cc117c9/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:36.791769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0435e20-f0dd-43f1-97b0-df663a1048bb None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:36.793223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0435e20-f0dd-43f1-97b0-df663a1048bb None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:36.793223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0435e20-f0dd-43f1-97b0-df663a1048bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:36.796753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff291038-08c7-49d2-b944-ff50aa8b3270 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:36.873843 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d0435e20-f0dd-43f1-97b0-df663a1048bb None None] MFA Rules not processed for user `ab19c631b56c4565baf2fdac8cc117c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:36.875169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d0435e20-f0dd-43f1-97b0-df663a1048bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:36.940092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff291038-08c7-49d2-b944-ff50aa8b3270 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:36.956359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19cda7-0487-4b80-9e89-db287dc8ceb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:36.957323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19cda7-0487-4b80-9e89-db287dc8ceb1 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:36.957802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19cda7-0487-4b80-9e89-db287dc8ceb1 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:36.958228 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19cda7-0487-4b80-9e89-db287dc8ceb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:37.053269 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 898/1799] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:36 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:37.084776 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b02e74-845d-4a17-bcfa-22c407e726b7 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:37.085067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b02e74-845d-4a17-bcfa-22c407e726b7 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:37.085346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b02e74-845d-4a17-bcfa-22c407e726b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:37.148237 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:37.161448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19cda7-0487-4b80-9e89-db287dc8ceb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:37.161448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19cda7-0487-4b80-9e89-db287dc8ceb1 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:37.188109 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 902/1800] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:37.191282 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19cda7-0487-4b80-9e89-db287dc8ceb1 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:37.226612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-82b02e74-845d-4a17-bcfa-22c407e726b7 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:37.232031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-82b02e74-845d-4a17-bcfa-22c407e726b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:37.315065 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19cda7-0487-4b80-9e89-db287dc8ceb1 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:37.332647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbc7964-55be-4a49-9921-5ec980041d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:37.333446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc7964-55be-4a49-9921-5ec980041d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:37.333803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc7964-55be-4a49-9921-5ec980041d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:37.335374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc7964-55be-4a49-9921-5ec980041d48 admin admin] PATH_INFO: `/v3/users/9808f053a85743b5ae2a61ab3de44e71` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:37.339794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc7964-55be-4a49-9921-5ec980041d48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9808f053a85743b5ae2a61ab3de44e71)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:37.342015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbc7964-55be-4a49-9921-5ec980041d48 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:37.411183 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:37.422122 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 899/1801] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:09:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:37.423254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b02e74-845d-4a17-bcfa-22c407e726b7 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:37.470952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-afbc7964-55be-4a49-9921-5ec980041d48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9808f053a85743b5ae2a61ab3de44e71'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:37.481393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-afbc7964-55be-4a49-9921-5ec980041d48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9808f053a85743b5ae2a61ab3de44e71'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:37.481669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b02e74-845d-4a17-bcfa-22c407e726b7 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:37.494573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea668f-2b5c-4bb8-a53f-f9fd322fe217 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:37.495368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea668f-2b5c-4bb8-a53f-f9fd322fe217 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:37.496448 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea668f-2b5c-4bb8-a53f-f9fd322fe217 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:37.496910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea668f-2b5c-4bb8-a53f-f9fd322fe217 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:37.499021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-afbc7964-55be-4a49-9921-5ec980041d48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9808f053a85743b5ae2a61ab3de44e71'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:37.500012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-afbc7964-55be-4a49-9921-5ec980041d48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9808f053a85743b5ae2a61ab3de44e71'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:37.518328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-afbc7964-55be-4a49-9921-5ec980041d48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9808f053a85743b5ae2a61ab3de44e71'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:37.532573 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 903/1802] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:09:37 2022] DELETE /identity/v3/users/9808f053a85743b5ae2a61ab3de44e71 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:37.547726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b775f3-996e-4953-a53d-1d3be869794a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:37.548356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b775f3-996e-4953-a53d-1d3be869794a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:37.549064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b775f3-996e-4953-a53d-1d3be869794a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:37.587050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b4b775f3-996e-4953-a53d-1d3be869794a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:37.590049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b4b775f3-996e-4953-a53d-1d3be869794a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:37.656420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea668f-2b5c-4bb8-a53f-f9fd322fe217 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:37.660707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea668f-2b5c-4bb8-a53f-f9fd322fe217 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:37.718633 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 900/1803] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:37.719873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea668f-2b5c-4bb8-a53f-f9fd322fe217 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:37.724993 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8aea668f-2b5c-4bb8-a53f-f9fd322fe217 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:37.771936 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 904/1804] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:37.785545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b775f3-996e-4953-a53d-1d3be869794a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:37.787570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b4b775f3-996e-4953-a53d-1d3be869794a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:37.826069 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:37.910023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b775f3-996e-4953-a53d-1d3be869794a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:37.914007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b042716-1b21-4965-b6d0-e1b5550f6655 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:37.914799 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b042716-1b21-4965-b6d0-e1b5550f6655 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:37.915135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b042716-1b21-4965-b6d0-e1b5550f6655 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:37.915532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b042716-1b21-4965-b6d0-e1b5550f6655 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:37.931995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea668f-2b5c-4bb8-a53f-f9fd322fe217 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:37.958053 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b042716-1b21-4965-b6d0-e1b5550f6655 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:37.962519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b042716-1b21-4965-b6d0-e1b5550f6655 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:38.008121 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 905/1805] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:09:38.150856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96012a3-282a-4788-9f0a-a7b6b1416e00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:38.151507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96012a3-282a-4788-9f0a-a7b6b1416e00 service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:38.151831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96012a3-282a-4788-9f0a-a7b6b1416e00 service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:38.152203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96012a3-282a-4788-9f0a-a7b6b1416e00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:38.162275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f96012a3-282a-4788-9f0a-a7b6b1416e00 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:38.246203 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:38.322825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96012a3-282a-4788-9f0a-a7b6b1416e00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:38.325348 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96012a3-282a-4788-9f0a-a7b6b1416e00 service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:38.344140 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 901/1806] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:09:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:09:38.527714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b042716-1b21-4965-b6d0-e1b5550f6655 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:38.529712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4b042716-1b21-4965-b6d0-e1b5550f6655 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:38.576486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96012a3-282a-4788-9f0a-a7b6b1416e00 service swift] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:38.578359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f96012a3-282a-4788-9f0a-a7b6b1416e00 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:38.606644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96012a3-282a-4788-9f0a-a7b6b1416e00 service swift] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:38.622544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974550a5-b617-4c97-ae39-26068eb5e6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:38.623923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974550a5-b617-4c97-ae39-26068eb5e6b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:38.624650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974550a5-b617-4c97-ae39-26068eb5e6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:38.625154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974550a5-b617-4c97-ae39-26068eb5e6b8 admin admin] PATH_INFO: `/v3/users/fad6ad24de0c4f128a694ba2bec03ec9` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:38.627685 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974550a5-b617-4c97-ae39-26068eb5e6b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fad6ad24de0c4f128a694ba2bec03ec9)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:38.635522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974550a5-b617-4c97-ae39-26068eb5e6b8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:38.752579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-974550a5-b617-4c97-ae39-26068eb5e6b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fad6ad24de0c4f128a694ba2bec03ec9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:38.774700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-974550a5-b617-4c97-ae39-26068eb5e6b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fad6ad24de0c4f128a694ba2bec03ec9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:38.784531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b042716-1b21-4965-b6d0-e1b5550f6655 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:38.804845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8475c23-4db3-4d1b-8e8e-9c9184465020 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:38.807762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8475c23-4db3-4d1b-8e8e-9c9184465020 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:38.810701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8475c23-4db3-4d1b-8e8e-9c9184465020 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:38.810851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-974550a5-b617-4c97-ae39-26068eb5e6b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fad6ad24de0c4f128a694ba2bec03ec9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:38.811589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8475c23-4db3-4d1b-8e8e-9c9184465020 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:38.814182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-974550a5-b617-4c97-ae39-26068eb5e6b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fad6ad24de0c4f128a694ba2bec03ec9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:38.817986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a8475c23-4db3-4d1b-8e8e-9c9184465020 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:38.835490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-974550a5-b617-4c97-ae39-26068eb5e6b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fad6ad24de0c4f128a694ba2bec03ec9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:38.853655 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 902/1807] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:09:38 2022] DELETE /identity/v3/users/fad6ad24de0c4f128a694ba2bec03ec9 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:38.857466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb100a-0072-46e5-a4f0-c07d6e7f4446 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:38.862288 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb100a-0072-46e5-a4f0-c07d6e7f4446 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:38.863338 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecb100a-0072-46e5-a4f0-c07d6e7f4446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:38.919632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0ecb100a-0072-46e5-a4f0-c07d6e7f4446 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:38.921891 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0ecb100a-0072-46e5-a4f0-c07d6e7f4446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:38.951644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8475c23-4db3-4d1b-8e8e-9c9184465020 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:38.954052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8475c23-4db3-4d1b-8e8e-9c9184465020 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:38.976204 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 906/1808] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:38.977938 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f759a-debe-44f0-b071-be9766acda1d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:38.978231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f759a-debe-44f0-b071-be9766acda1d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:38.978735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f759a-debe-44f0-b071-be9766acda1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:39.005107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9f4f759a-debe-44f0-b071-be9766acda1d None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:39.006384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9f4f759a-debe-44f0-b071-be9766acda1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:39.087872 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:39.101797 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 907/1809] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:09:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:39.125760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f759a-debe-44f0-b071-be9766acda1d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:39.128330 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9f4f759a-debe-44f0-b071-be9766acda1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:39.225901 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 903/1810] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:39.322961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f759a-debe-44f0-b071-be9766acda1d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:39.331643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d79021-9657-4cd0-b291-638d9f56d75e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:39.332336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d79021-9657-4cd0-b291-638d9f56d75e service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:39.332750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d79021-9657-4cd0-b291-638d9f56d75e service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:39.333146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d79021-9657-4cd0-b291-638d9f56d75e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:39.346843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d79021-9657-4cd0-b291-638d9f56d75e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:39.349009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d79021-9657-4cd0-b291-638d9f56d75e service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:39.357974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb100a-0072-46e5-a4f0-c07d6e7f4446 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:39.360258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0ecb100a-0072-46e5-a4f0-c07d6e7f4446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:39.380921 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 908/1811] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:09:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 07 01:09:39.448378 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:39.502181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecb100a-0072-46e5-a4f0-c07d6e7f4446 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:39.509799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb41ab8-97da-4959-9e8e-d74472a2435e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:39.511214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb41ab8-97da-4959-9e8e-d74472a2435e service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:39.511716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb41ab8-97da-4959-9e8e-d74472a2435e service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:39.512013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb41ab8-97da-4959-9e8e-d74472a2435e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:39.532833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb41ab8-97da-4959-9e8e-d74472a2435e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:39.537303 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb41ab8-97da-4959-9e8e-d74472a2435e service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:39.572173 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 904/1812] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:09:40.429156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989fdf3-ef61-4f17-be1d-d2d8762dd12d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:40.429782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989fdf3-ef61-4f17-be1d-d2d8762dd12d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:40.429782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989fdf3-ef61-4f17-be1d-d2d8762dd12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:40.568269 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9989fdf3-ef61-4f17-be1d-d2d8762dd12d None None] MFA Rules not processed for user `b219e01934fa477fbaa053cca586f01b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:40.570522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9989fdf3-ef61-4f17-be1d-d2d8762dd12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:40.593834 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 909/1813] 10.222.0.25 () {58 vars in 1015 bytes} [Sun Aug 7 01:09:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:40.623584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb41ab8-97da-4959-9e8e-d74472a2435e service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:40.625777 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6eb41ab8-97da-4959-9e8e-d74472a2435e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:40.664424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb41ab8-97da-4959-9e8e-d74472a2435e service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:40.688768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5de04-0dd0-49c8-8654-5b2fe980e753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:40.689822 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5de04-0dd0-49c8-8654-5b2fe980e753 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:40.690372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5de04-0dd0-49c8-8654-5b2fe980e753 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:40.690856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5de04-0dd0-49c8-8654-5b2fe980e753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:40.711026 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5de04-0dd0-49c8-8654-5b2fe980e753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:40.712810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5de04-0dd0-49c8-8654-5b2fe980e753 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:40.748188 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 905/1814] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:41.334956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989fdf3-ef61-4f17-be1d-d2d8762dd12d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:41.336477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9989fdf3-ef61-4f17-be1d-d2d8762dd12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:41.380127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989fdf3-ef61-4f17-be1d-d2d8762dd12d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:41.390304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d6945-de03-40be-8057-fb7154e72ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:41.390947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d6945-de03-40be-8057-fb7154e72ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:41.391232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d6945-de03-40be-8057-fb7154e72ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:41.391505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d6945-de03-40be-8057-fb7154e72ea0 admin admin] PATH_INFO: `/v3/projects/39b8c8d84b9c482b9b4daafb9a5c5684` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:41.400450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d6945-de03-40be-8057-fb7154e72ea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39b8c8d84b9c482b9b4daafb9a5c5684)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:41.402700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d6945-de03-40be-8057-fb7154e72ea0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:41.507639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a05d6945-de03-40be-8057-fb7154e72ea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39b8c8d84b9c482b9b4daafb9a5c5684', 'request_id': 'req-a05d6945-de03-40be-8057-fb7154e72ea0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:41.534614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a05d6945-de03-40be-8057-fb7154e72ea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39b8c8d84b9c482b9b4daafb9a5c5684', 'request_id': 'req-a05d6945-de03-40be-8057-fb7154e72ea0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:41.550438 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a05d6945-de03-40be-8057-fb7154e72ea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39b8c8d84b9c482b9b4daafb9a5c5684', 'request_id': 'req-a05d6945-de03-40be-8057-fb7154e72ea0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:41.582052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a05d6945-de03-40be-8057-fb7154e72ea0 admin admin] The token cache is being invalidate because project 39b8c8d84b9c482b9b4daafb9a5c5684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:09:41.582645 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a05d6945-de03-40be-8057-fb7154e72ea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:41.583659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a05d6945-de03-40be-8057-fb7154e72ea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:41.596220 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 910/1815] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:09:41 2022] DELETE /identity/v3/projects/39b8c8d84b9c482b9b4daafb9a5c5684 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:41.601532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5de04-0dd0-49c8-8654-5b2fe980e753 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:41.649530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5de04-0dd0-49c8-8654-5b2fe980e753 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:41.864985 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06947716-8172-4cf1-a502-ab025b08427c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:41.865761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06947716-8172-4cf1-a502-ab025b08427c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:41.866150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06947716-8172-4cf1-a502-ab025b08427c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:41.866520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06947716-8172-4cf1-a502-ab025b08427c admin admin] PATH_INFO: `/v3/users/ab19c631b56c4565baf2fdac8cc117c9` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:41.872136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06947716-8172-4cf1-a502-ab025b08427c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab19c631b56c4565baf2fdac8cc117c9)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:41.887331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06947716-8172-4cf1-a502-ab025b08427c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:42.034675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-06947716-8172-4cf1-a502-ab025b08427c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab19c631b56c4565baf2fdac8cc117c9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:42.060014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-06947716-8172-4cf1-a502-ab025b08427c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab19c631b56c4565baf2fdac8cc117c9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:42.100204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-06947716-8172-4cf1-a502-ab025b08427c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab19c631b56c4565baf2fdac8cc117c9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:42.101385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-06947716-8172-4cf1-a502-ab025b08427c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab19c631b56c4565baf2fdac8cc117c9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:42.133015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-06947716-8172-4cf1-a502-ab025b08427c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab19c631b56c4565baf2fdac8cc117c9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:42.153423 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 906/1816] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:09:41 2022] DELETE /identity/v3/users/ab19c631b56c4565baf2fdac8cc117c9 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:42.185691 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d6945-de03-40be-8057-fb7154e72ea0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:42.188081 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a05d6945-de03-40be-8057-fb7154e72ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:42.218003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d6945-de03-40be-8057-fb7154e72ea0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:42.324135 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:42.365643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7a531-9a8b-470c-a98a-df5e2f20018e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:42.371822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7a531-9a8b-470c-a98a-df5e2f20018e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:42.373001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7a531-9a8b-470c-a98a-df5e2f20018e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:42.374971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7a531-9a8b-470c-a98a-df5e2f20018e admin admin] PATH_INFO: `/v3/users/dcb338858f314453b2cc3a1cc701b453` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:42.383988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec7a531-9a8b-470c-a98a-df5e2f20018e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcb338858f314453b2cc3a1cc701b453)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:42.394496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec7a531-9a8b-470c-a98a-df5e2f20018e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:42.742338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8ec7a531-9a8b-470c-a98a-df5e2f20018e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcb338858f314453b2cc3a1cc701b453'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:42.781391 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8ec7a531-9a8b-470c-a98a-df5e2f20018e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcb338858f314453b2cc3a1cc701b453'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:42.844929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8ec7a531-9a8b-470c-a98a-df5e2f20018e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcb338858f314453b2cc3a1cc701b453'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:42.856230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8ec7a531-9a8b-470c-a98a-df5e2f20018e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcb338858f314453b2cc3a1cc701b453'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:42.879483 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8ec7a531-9a8b-470c-a98a-df5e2f20018e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcb338858f314453b2cc3a1cc701b453'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:42.926075 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 911/1817] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:09:42 2022] DELETE /identity/v3/users/dcb338858f314453b2cc3a1cc701b453 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:42.926918 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a9803-682a-4e5f-9c35-33bb109d99d4 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:42.927713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a9803-682a-4e5f-9c35-33bb109d99d4 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:42.927713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a9803-682a-4e5f-9c35-33bb109d99d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:42.987368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-509a9803-682a-4e5f-9c35-33bb109d99d4 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:42.993867 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-509a9803-682a-4e5f-9c35-33bb109d99d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:43.139131 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:43.154168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7a531-9a8b-470c-a98a-df5e2f20018e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:43.156573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8ec7a531-9a8b-470c-a98a-df5e2f20018e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:43.306468 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 907/1818] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:43.469544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a9803-682a-4e5f-9c35-33bb109d99d4 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:43.470898 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-509a9803-682a-4e5f-9c35-33bb109d99d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:43.481767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7a531-9a8b-470c-a98a-df5e2f20018e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:43.512534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be1a9f-6d5c-4a25-b529-21708f3f5159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:43.514169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be1a9f-6d5c-4a25-b529-21708f3f5159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:43.517164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be1a9f-6d5c-4a25-b529-21708f3f5159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:43.517680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be1a9f-6d5c-4a25-b529-21708f3f5159 admin admin] PATH_INFO: `/v3/projects/245abc5dd7c44309a6e1b051e37f6be9` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:43.522282 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be1a9f-6d5c-4a25-b529-21708f3f5159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=245abc5dd7c44309a6e1b051e37f6be9)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:43.532668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be1a9f-6d5c-4a25-b529-21708f3f5159 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:43.670619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a9803-682a-4e5f-9c35-33bb109d99d4 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:43.706418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-46be1a9f-6d5c-4a25-b529-21708f3f5159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '245abc5dd7c44309a6e1b051e37f6be9', 'request_id': 'req-46be1a9f-6d5c-4a25-b529-21708f3f5159'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:43.728184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-46be1a9f-6d5c-4a25-b529-21708f3f5159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '245abc5dd7c44309a6e1b051e37f6be9', 'request_id': 'req-46be1a9f-6d5c-4a25-b529-21708f3f5159'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:43.767803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-46be1a9f-6d5c-4a25-b529-21708f3f5159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '245abc5dd7c44309a6e1b051e37f6be9', 'request_id': 'req-46be1a9f-6d5c-4a25-b529-21708f3f5159'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:43.800933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-46be1a9f-6d5c-4a25-b529-21708f3f5159 admin admin] The token cache is being invalidate because project 245abc5dd7c44309a6e1b051e37f6be9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:09:43.802136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-46be1a9f-6d5c-4a25-b529-21708f3f5159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:43.803992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-46be1a9f-6d5c-4a25-b529-21708f3f5159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:43.810446 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 912/1819] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:09:43 2022] DELETE /identity/v3/projects/245abc5dd7c44309a6e1b051e37f6be9 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:43.817280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be1a9f-6d5c-4a25-b529-21708f3f5159 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:43.826747 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-46be1a9f-6d5c-4a25-b529-21708f3f5159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:43.854808 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:43.932403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebde06-22f4-4990-b4ad-8e08a6611666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:43.934474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebde06-22f4-4990-b4ad-8e08a6611666 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:43.934748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebde06-22f4-4990-b4ad-8e08a6611666 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:43.935009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caebde06-22f4-4990-b4ad-8e08a6611666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:43.942814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-caebde06-22f4-4990-b4ad-8e08a6611666 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:44.182260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be1a9f-6d5c-4a25-b529-21708f3f5159 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:44.195837 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebde06-22f4-4990-b4ad-8e08a6611666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:44.199618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caebde06-22f4-4990-b4ad-8e08a6611666 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:44.211747 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d9a3c-8103-4d44-b15e-80750086b5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:44.212559 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d9a3c-8103-4d44-b15e-80750086b5c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:44.212961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d9a3c-8103-4d44-b15e-80750086b5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:44.213343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d9a3c-8103-4d44-b15e-80750086b5c9 admin admin] PATH_INFO: `/v3/users/973430ad67504ecf8b7c0b8ba2f18850` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:44.215364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d9a3c-8103-4d44-b15e-80750086b5c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=973430ad67504ecf8b7c0b8ba2f18850)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:44.218811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d9a3c-8103-4d44-b15e-80750086b5c9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:44.249138 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 908/1820] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 780 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:44.362159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2b9d9a3c-8103-4d44-b15e-80750086b5c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '973430ad67504ecf8b7c0b8ba2f18850'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:44.396017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2b9d9a3c-8103-4d44-b15e-80750086b5c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '973430ad67504ecf8b7c0b8ba2f18850'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:44.453710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2b9d9a3c-8103-4d44-b15e-80750086b5c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '973430ad67504ecf8b7c0b8ba2f18850'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:44.455848 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2b9d9a3c-8103-4d44-b15e-80750086b5c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '973430ad67504ecf8b7c0b8ba2f18850'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:44.500766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2b9d9a3c-8103-4d44-b15e-80750086b5c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '973430ad67504ecf8b7c0b8ba2f18850'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:44.523244 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 913/1821] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:09:43 2022] DELETE /identity/v3/users/973430ad67504ecf8b7c0b8ba2f18850 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:45.315677 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebde06-22f4-4990-b4ad-8e08a6611666 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:45.318741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-caebde06-22f4-4990-b4ad-8e08a6611666 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:45.350037 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caebde06-22f4-4990-b4ad-8e08a6611666 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:45.496755 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:45.542569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa73f9f-2921-45bb-bfc0-e949de2bfd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:45.543555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa73f9f-2921-45bb-bfc0-e949de2bfd54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:45.544026 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa73f9f-2921-45bb-bfc0-e949de2bfd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:45.544539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa73f9f-2921-45bb-bfc0-e949de2bfd54 admin admin] PATH_INFO: `/v3/projects/bc6040481e2049cbb8ad165338911832` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:45.553302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa73f9f-2921-45bb-bfc0-e949de2bfd54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc6040481e2049cbb8ad165338911832)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:45.557767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa73f9f-2921-45bb-bfc0-e949de2bfd54 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:45.719694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-efa73f9f-2921-45bb-bfc0-e949de2bfd54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc6040481e2049cbb8ad165338911832', 'request_id': 'req-efa73f9f-2921-45bb-bfc0-e949de2bfd54'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:45.738482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-efa73f9f-2921-45bb-bfc0-e949de2bfd54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc6040481e2049cbb8ad165338911832', 'request_id': 'req-efa73f9f-2921-45bb-bfc0-e949de2bfd54'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:45.754696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-efa73f9f-2921-45bb-bfc0-e949de2bfd54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc6040481e2049cbb8ad165338911832', 'request_id': 'req-efa73f9f-2921-45bb-bfc0-e949de2bfd54'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:45.784548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-efa73f9f-2921-45bb-bfc0-e949de2bfd54 admin admin] The token cache is being invalidate because project bc6040481e2049cbb8ad165338911832 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:09:45.784847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-efa73f9f-2921-45bb-bfc0-e949de2bfd54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:45.791639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-efa73f9f-2921-45bb-bfc0-e949de2bfd54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:45.801316 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 909/1822] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:09:45 2022] DELETE /identity/v3/projects/bc6040481e2049cbb8ad165338911832 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:45.803409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f71669-0f21-4ea3-afea-46bce93889e3 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:45.804365 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f71669-0f21-4ea3-afea-46bce93889e3 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:45.804365 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f71669-0f21-4ea3-afea-46bce93889e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:45.941063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-32f71669-0f21-4ea3-afea-46bce93889e3 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:45.942866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-32f71669-0f21-4ea3-afea-46bce93889e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:46.282608 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 914/1823] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:46.299717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef627e1-c87f-4088-a833-c054e98faf7c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:46.300360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef627e1-c87f-4088-a833-c054e98faf7c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:46.300961 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef627e1-c87f-4088-a833-c054e98faf7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:46.343957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-aef627e1-c87f-4088-a833-c054e98faf7c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:46.346512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-aef627e1-c87f-4088-a833-c054e98faf7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:46.387386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f71669-0f21-4ea3-afea-46bce93889e3 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:46.399350 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 910/1824] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:46.429605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f71669-0f21-4ea3-afea-46bce93889e3 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:46.450616 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42117e4f-7f05-4ca4-9e9b-66445c1af975 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:46.450798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42117e4f-7f05-4ca4-9e9b-66445c1af975 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:46.451234 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42117e4f-7f05-4ca4-9e9b-66445c1af975 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:46.454405 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 911/1825] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 01:09:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:09:46.461776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b84a08-3281-4f85-a9ef-46a4cc56196b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:46.462841 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b84a08-3281-4f85-a9ef-46a4cc56196b admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:46.463315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b84a08-3281-4f85-a9ef-46a4cc56196b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:46.468415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b84a08-3281-4f85-a9ef-46a4cc56196b admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:46.472902 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b84a08-3281-4f85-a9ef-46a4cc56196b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:09:46.473481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b84a08-3281-4f85-a9ef-46a4cc56196b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:46.482006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b84a08-3281-4f85-a9ef-46a4cc56196b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:46.534629 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f689e98-8a2a-4acc-abe1-3e49b5433861 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:46.535053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f689e98-8a2a-4acc-abe1-3e49b5433861 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:46.535471 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f689e98-8a2a-4acc-abe1-3e49b5433861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:46.570868 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 915/1826] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:09:46.578672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b84a08-3281-4f85-a9ef-46a4cc56196b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:46.632063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b84a08-3281-4f85-a9ef-46a4cc56196b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:46.644418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9f689e98-8a2a-4acc-abe1-3e49b5433861 None None] MFA Rules not processed for user `6c70d5a72d424db68de7c7b8257fe02c`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:46.646946 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9f689e98-8a2a-4acc-abe1-3e49b5433861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:46.665936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262c666-13b1-44fb-9bcc-e5377efe2ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:46.670306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262c666-13b1-44fb-9bcc-e5377efe2ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:46.670929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262c666-13b1-44fb-9bcc-e5377efe2ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:46.671213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262c666-13b1-44fb-9bcc-e5377efe2ec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:46.673178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262c666-13b1-44fb-9bcc-e5377efe2ec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:46.687076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262c666-13b1-44fb-9bcc-e5377efe2ec9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:46.720380 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:46.791064 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 916/1827] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:46 2022] POST /identity/v3/projects => generated 391 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:46.798458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262c666-13b1-44fb-9bcc-e5377efe2ec9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:46.992476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262c666-13b1-44fb-9bcc-e5377efe2ec9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:47.011145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d4e59-2dde-458e-a373-f3e7cae4c35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:47.012003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d4e59-2dde-458e-a373-f3e7cae4c35a admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:47.012288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d4e59-2dde-458e-a373-f3e7cae4c35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:47.012740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d4e59-2dde-458e-a373-f3e7cae4c35a admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:47.013541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d4e59-2dde-458e-a373-f3e7cae4c35a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:47.020521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d4e59-2dde-458e-a373-f3e7cae4c35a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:47.066524 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 912/1828] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 01:09:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 535 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:09:47.104520 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 917/1829] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:46 2022] POST /identity/v3/users => generated 296 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:47.110351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f689e98-8a2a-4acc-abe1-3e49b5433861 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:47.157135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f689e98-8a2a-4acc-abe1-3e49b5433861 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:47.191976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af241974-7f1b-4368-ba8a-752e55831690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:47.191976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af241974-7f1b-4368-ba8a-752e55831690 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:47.191976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af241974-7f1b-4368-ba8a-752e55831690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:47.191976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af241974-7f1b-4368-ba8a-752e55831690 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:47.192709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af241974-7f1b-4368-ba8a-752e55831690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:47.203179 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af241974-7f1b-4368-ba8a-752e55831690 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:47.248435 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 913/1830] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:47.250438 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d4e59-2dde-458e-a373-f3e7cae4c35a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:47.283732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d4e59-2dde-458e-a373-f3e7cae4c35a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:47.308469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217f253-1669-4418-bc12-2f5a4e9e9dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:47.309100 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217f253-1669-4418-bc12-2f5a4e9e9dcb admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:47.309482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217f253-1669-4418-bc12-2f5a4e9e9dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:47.309786 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217f253-1669-4418-bc12-2f5a4e9e9dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:47.310608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217f253-1669-4418-bc12-2f5a4e9e9dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:47.312505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217f253-1669-4418-bc12-2f5a4e9e9dcb admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:47.352324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af241974-7f1b-4368-ba8a-752e55831690 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:47.359314 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 918/1831] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:09:47.372986 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af241974-7f1b-4368-ba8a-752e55831690 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:47.398763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217f253-1669-4418-bc12-2f5a4e9e9dcb admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:47.404442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0217f253-1669-4418-bc12-2f5a4e9e9dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:47.418975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235239d1-8bb6-4570-b05d-9a85fd07f5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:47.419319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235239d1-8bb6-4570-b05d-9a85fd07f5ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:47.419624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235239d1-8bb6-4570-b05d-9a85fd07f5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:47.431193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235239d1-8bb6-4570-b05d-9a85fd07f5ab admin admin] PATH_INFO: `/v3/projects/4f263fc12abc4b40ab771109bb7a3d85/users/6298dea4d322433b89afad045cb04c73/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:47.511722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217f253-1669-4418-bc12-2f5a4e9e9dcb admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:47.557664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8aee22-b562-44e1-b2d9-5e64649bbdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:47.562391 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8aee22-b562-44e1-b2d9-5e64649bbdc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:47.564209 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8aee22-b562-44e1-b2d9-5e64649bbdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:47.564725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8aee22-b562-44e1-b2d9-5e64649bbdc6 admin admin] PATH_INFO: `/v3/projects/e69f58f3b72e47a18d2e2ac28b6b4b0c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:47.573668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235239d1-8bb6-4570-b05d-9a85fd07f5ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f263fc12abc4b40ab771109bb7a3d85, user_id=6298dea4d322433b89afad045cb04c73, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:47.574885 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8aee22-b562-44e1-b2d9-5e64649bbdc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e69f58f3b72e47a18d2e2ac28b6b4b0c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:47.590913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8aee22-b562-44e1-b2d9-5e64649bbdc6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:47.592426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235239d1-8bb6-4570-b05d-9a85fd07f5ab admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:47.684042 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 914/1832] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:47 2022] PUT /identity/v3/projects/4f263fc12abc4b40ab771109bb7a3d85/users/6298dea4d322433b89afad045cb04c73/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:47.694323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9655d-91aa-4773-b8b7-2a0663236be0 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:47.694764 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9655d-91aa-4773-b8b7-2a0663236be0 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:47.695217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9655d-91aa-4773-b8b7-2a0663236be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:47.763321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-da8aee22-b562-44e1-b2d9-5e64649bbdc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e69f58f3b72e47a18d2e2ac28b6b4b0c', 'request_id': 'req-da8aee22-b562-44e1-b2d9-5e64649bbdc6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:47.795302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-da8aee22-b562-44e1-b2d9-5e64649bbdc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e69f58f3b72e47a18d2e2ac28b6b4b0c', 'request_id': 'req-da8aee22-b562-44e1-b2d9-5e64649bbdc6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:47.820642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-da8aee22-b562-44e1-b2d9-5e64649bbdc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e69f58f3b72e47a18d2e2ac28b6b4b0c', 'request_id': 'req-da8aee22-b562-44e1-b2d9-5e64649bbdc6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:47.860642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-da8aee22-b562-44e1-b2d9-5e64649bbdc6 admin admin] The token cache is being invalidate because project e69f58f3b72e47a18d2e2ac28b6b4b0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:09:47.861477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-da8aee22-b562-44e1-b2d9-5e64649bbdc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:47.862982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-da8aee22-b562-44e1-b2d9-5e64649bbdc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:47.887375 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 919/1833] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:09:47 2022] DELETE /identity/v3/projects/e69f58f3b72e47a18d2e2ac28b6b4b0c => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:09:47.892820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-fba9655d-91aa-4773-b8b7-2a0663236be0 None None] MFA Rules not processed for user `6298dea4d322433b89afad045cb04c73`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:47.893993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8aee22-b562-44e1-b2d9-5e64649bbdc6 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:47.898288 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-fba9655d-91aa-4773-b8b7-2a0663236be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:47.903259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-da8aee22-b562-44e1-b2d9-5e64649bbdc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:48.008083 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:48.168897 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:48.226196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8aee22-b562-44e1-b2d9-5e64649bbdc6 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:48.238921 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 915/1834] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 546 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:09:48.240606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb72396-4a16-42ee-8718-3e13a59443ed None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:48.240820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb72396-4a16-42ee-8718-3e13a59443ed None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:48.241093 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb72396-4a16-42ee-8718-3e13a59443ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:48.246116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0efc0-4b44-4c4e-9462-ee13adaeb87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:48.249290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0efc0-4b44-4c4e-9462-ee13adaeb87f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:48.249653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0efc0-4b44-4c4e-9462-ee13adaeb87f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:48.249897 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0efc0-4b44-4c4e-9462-ee13adaeb87f admin admin] PATH_INFO: `/v3/users/e69d89fa64164206b673445855d733cb` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:48.251932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0efc0-4b44-4c4e-9462-ee13adaeb87f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e69d89fa64164206b673445855d733cb)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:48.256862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0efc0-4b44-4c4e-9462-ee13adaeb87f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:48.295134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-bbb72396-4a16-42ee-8718-3e13a59443ed None None] MFA Rules not processed for user `b219e01934fa477fbaa053cca586f01b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:48.299132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bbb72396-4a16-42ee-8718-3e13a59443ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:48.403706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-78f0efc0-4b44-4c4e-9462-ee13adaeb87f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e69d89fa64164206b673445855d733cb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:48.426483 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-78f0efc0-4b44-4c4e-9462-ee13adaeb87f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e69d89fa64164206b673445855d733cb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:48.458750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-78f0efc0-4b44-4c4e-9462-ee13adaeb87f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e69d89fa64164206b673445855d733cb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:48.459575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-78f0efc0-4b44-4c4e-9462-ee13adaeb87f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e69d89fa64164206b673445855d733cb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:48.478832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-78f0efc0-4b44-4c4e-9462-ee13adaeb87f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e69d89fa64164206b673445855d733cb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:48.484471 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 916/1835] 10.222.0.50 () {58 vars in 1015 bytes} [Sun Aug 7 01:09:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:48.486094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb72396-4a16-42ee-8718-3e13a59443ed None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:48.488673 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bbb72396-4a16-42ee-8718-3e13a59443ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:48.501140 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 920/1836] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:09:47 2022] DELETE /identity/v3/users/e69d89fa64164206b673445855d733cb => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:48.515973 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb72396-4a16-42ee-8718-3e13a59443ed None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:48.610609 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0efc0-4b44-4c4e-9462-ee13adaeb87f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:48.614571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-78f0efc0-4b44-4c4e-9462-ee13adaeb87f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:48.700450 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a4846-0b68-4fe7-a593-24328d5b6c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:48.705994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a4846-0b68-4fe7-a593-24328d5b6c51 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:48.706387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a4846-0b68-4fe7-a593-24328d5b6c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:48.710021 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a4846-0b68-4fe7-a593-24328d5b6c51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:48.711104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a4846-0b68-4fe7-a593-24328d5b6c51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:48.718565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278a4846-0b68-4fe7-a593-24328d5b6c51 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:48.795497 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 917/1837] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:48 2022] POST /identity/v3/projects => generated 391 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:48.796767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a4846-0b68-4fe7-a593-24328d5b6c51 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:48.809370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-278a4846-0b68-4fe7-a593-24328d5b6c51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:48.824352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0efc0-4b44-4c4e-9462-ee13adaeb87f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:48.912406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ed013-4930-4b89-bbaf-93c583df605f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:48.913271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ed013-4930-4b89-bbaf-93c583df605f service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:48.913598 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ed013-4930-4b89-bbaf-93c583df605f service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:48.913855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ed013-4930-4b89-bbaf-93c583df605f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:48.917618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dd8ed013-4930-4b89-bbaf-93c583df605f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:48.932594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ed013-4930-4b89-bbaf-93c583df605f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:48.934537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ed013-4930-4b89-bbaf-93c583df605f service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:48.941506 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:48.949586 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 921/1838] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:09:48.950965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ed013-4930-4b89-bbaf-93c583df605f service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:48.954082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dd8ed013-4930-4b89-bbaf-93c583df605f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:48.999703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a4846-0b68-4fe7-a593-24328d5b6c51 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:49.012880 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:49.071741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf04b59-5ca5-4d1f-a6f2-ae1f818b3512 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:49.072705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf04b59-5ca5-4d1f-a6f2-ae1f818b3512 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:49.072998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf04b59-5ca5-4d1f-a6f2-ae1f818b3512 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:49.073332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf04b59-5ca5-4d1f-a6f2-ae1f818b3512 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:49.082895 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5bf04b59-5ca5-4d1f-a6f2-ae1f818b3512 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:49.088498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ed013-4930-4b89-bbaf-93c583df605f service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:49.095385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa30d82-4311-4543-81d7-ec527bb0c121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:49.096429 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa30d82-4311-4543-81d7-ec527bb0c121 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:49.096876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa30d82-4311-4543-81d7-ec527bb0c121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:49.097460 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa30d82-4311-4543-81d7-ec527bb0c121 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:49.098467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa30d82-4311-4543-81d7-ec527bb0c121 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:49.101751 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa30d82-4311-4543-81d7-ec527bb0c121 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:49.127215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf04b59-5ca5-4d1f-a6f2-ae1f818b3512 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:49.131128 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf04b59-5ca5-4d1f-a6f2-ae1f818b3512 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:49.140347 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 922/1839] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:48 2022] POST /identity/v3/users => generated 302 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:49.146427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa30d82-4311-4543-81d7-ec527bb0c121 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:49.162080 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa30d82-4311-4543-81d7-ec527bb0c121 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:49.172565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8f598-e6f6-4b54-97e1-b15c530773ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:49.174581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8f598-e6f6-4b54-97e1-b15c530773ab admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:49.175180 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8f598-e6f6-4b54-97e1-b15c530773ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:49.175643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8f598-e6f6-4b54-97e1-b15c530773ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:49.176786 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8f598-e6f6-4b54-97e1-b15c530773ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:49.180656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8f598-e6f6-4b54-97e1-b15c530773ab admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:49.199539 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 923/1840] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:49.206099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8f598-e6f6-4b54-97e1-b15c530773ab admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:49.206378 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 918/1841] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:49.223078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8f598-e6f6-4b54-97e1-b15c530773ab admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:49.231462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f1211-8029-49c5-b788-4528f3233f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:49.233127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f1211-8029-49c5-b788-4528f3233f70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:49.233127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f1211-8029-49c5-b788-4528f3233f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:49.233811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f1211-8029-49c5-b788-4528f3233f70 admin admin] PATH_INFO: `/v3/projects/08a594efa62f415490f0fdb741a2647e/users/4c0b0c4fb5c94dc6bec1534839c9e4a3/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:49.258852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f1211-8029-49c5-b788-4528f3233f70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08a594efa62f415490f0fdb741a2647e, user_id=4c0b0c4fb5c94dc6bec1534839c9e4a3, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:49.263773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f1211-8029-49c5-b788-4528f3233f70 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:49.290440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf04b59-5ca5-4d1f-a6f2-ae1f818b3512 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:49.293788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5bf04b59-5ca5-4d1f-a6f2-ae1f818b3512 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:49.352545 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 924/1842] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:49 2022] PUT /identity/v3/projects/08a594efa62f415490f0fdb741a2647e/users/4c0b0c4fb5c94dc6bec1534839c9e4a3/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:49.358445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f1211-8029-49c5-b788-4528f3233f70 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:49.364420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf04b59-5ca5-4d1f-a6f2-ae1f818b3512 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:49.550947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f1211-8029-49c5-b788-4528f3233f70 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:49.568115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ce2df-9af7-44e0-9bd1-fcc40ed52fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:49.569166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ce2df-9af7-44e0-9bd1-fcc40ed52fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:49.569166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ce2df-9af7-44e0-9bd1-fcc40ed52fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:49.569452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ce2df-9af7-44e0-9bd1-fcc40ed52fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:49.570097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ce2df-9af7-44e0-9bd1-fcc40ed52fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:49.571773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ce2df-9af7-44e0-9bd1-fcc40ed52fa7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:49.618317 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 925/1843] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:49.619770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ce2df-9af7-44e0-9bd1-fcc40ed52fa7 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:49.643464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ce2df-9af7-44e0-9bd1-fcc40ed52fa7 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:49.657216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307a7fd-042f-4e41-b8f9-c5030f088d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:49.658105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307a7fd-042f-4e41-b8f9-c5030f088d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:49.658384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307a7fd-042f-4e41-b8f9-c5030f088d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:49.658655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307a7fd-042f-4e41-b8f9-c5030f088d5e admin admin] PATH_INFO: `/v3/projects/08a594efa62f415490f0fdb741a2647e/users/4c0b0c4fb5c94dc6bec1534839c9e4a3/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:49.665069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5307a7fd-042f-4e41-b8f9-c5030f088d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=08a594efa62f415490f0fdb741a2647e, user_id=4c0b0c4fb5c94dc6bec1534839c9e4a3, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:49.666151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68066b04-5883-4ef1-8ef4-37c10ec49468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:49.672530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68066b04-5883-4ef1-8ef4-37c10ec49468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:49.673684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68066b04-5883-4ef1-8ef4-37c10ec49468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:49.675236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5307a7fd-042f-4e41-b8f9-c5030f088d5e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:49.676565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68066b04-5883-4ef1-8ef4-37c10ec49468 admin admin] PATH_INFO: `/v3/projects/f6d53cc25ee64824b5c2e006a029ef01` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:49.683873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68066b04-5883-4ef1-8ef4-37c10ec49468 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6d53cc25ee64824b5c2e006a029ef01)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:49.695326 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68066b04-5883-4ef1-8ef4-37c10ec49468 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:49.711133 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 926/1844] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:49 2022] PUT /identity/v3/projects/08a594efa62f415490f0fdb741a2647e/users/4c0b0c4fb5c94dc6bec1534839c9e4a3/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:09:49.734310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4863a-5c3a-4a59-871e-b42286af6dd0 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:49.735458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4863a-5c3a-4a59-871e-b42286af6dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:49.736260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4863a-5c3a-4a59-871e-b42286af6dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:49.850064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-93e4863a-5c3a-4a59-871e-b42286af6dd0 None None] MFA Rules not processed for user `4c0b0c4fb5c94dc6bec1534839c9e4a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:49.858177 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-93e4863a-5c3a-4a59-871e-b42286af6dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:49.957070 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-68066b04-5883-4ef1-8ef4-37c10ec49468 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6d53cc25ee64824b5c2e006a029ef01', 'request_id': 'req-68066b04-5883-4ef1-8ef4-37c10ec49468'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:49.986794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-68066b04-5883-4ef1-8ef4-37c10ec49468 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6d53cc25ee64824b5c2e006a029ef01', 'request_id': 'req-68066b04-5883-4ef1-8ef4-37c10ec49468'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:50.005557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-68066b04-5883-4ef1-8ef4-37c10ec49468 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6d53cc25ee64824b5c2e006a029ef01', 'request_id': 'req-68066b04-5883-4ef1-8ef4-37c10ec49468'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:50.031642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-68066b04-5883-4ef1-8ef4-37c10ec49468 admin admin] The token cache is being invalidate because project f6d53cc25ee64824b5c2e006a029ef01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:09:50.032357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-68066b04-5883-4ef1-8ef4-37c10ec49468 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:50.033769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-68066b04-5883-4ef1-8ef4-37c10ec49468 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:50.040528 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 919/1845] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:09:49 2022] DELETE /identity/v3/projects/f6d53cc25ee64824b5c2e006a029ef01 => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:50.045624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3dea5b-cc49-4fa0-84a5-7cc3564b2306 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:50.046793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3dea5b-cc49-4fa0-84a5-7cc3564b2306 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:50.048041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3dea5b-cc49-4fa0-84a5-7cc3564b2306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:50.085130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3d3dea5b-cc49-4fa0-84a5-7cc3564b2306 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:50.086954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3d3dea5b-cc49-4fa0-84a5-7cc3564b2306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:50.171761 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:50.238674 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 920/1846] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:50.246745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f9532-3a5f-4ca9-8cc6-aa06bd36a504 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:50.252237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f9532-3a5f-4ca9-8cc6-aa06bd36a504 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:50.252566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f9532-3a5f-4ca9-8cc6-aa06bd36a504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:50.297645 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 927/1847] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:49 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 558 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:50.304653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1b0f9532-3a5f-4ca9-8cc6-aa06bd36a504 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:50.306503 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1b0f9532-3a5f-4ca9-8cc6-aa06bd36a504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:50.330933 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 921/1848] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:50.335942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4863a-5c3a-4a59-871e-b42286af6dd0 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:50.513328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4863a-5c3a-4a59-871e-b42286af6dd0 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:50.524344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0265b-4324-49a6-8648-dfe1ac9e9d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:50.525279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0265b-4324-49a6-8648-dfe1ac9e9d0e admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:50.525594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0265b-4324-49a6-8648-dfe1ac9e9d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:50.525982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0265b-4324-49a6-8648-dfe1ac9e9d0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:50.526885 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0265b-4324-49a6-8648-dfe1ac9e9d0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:09:50.527286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0265b-4324-49a6-8648-dfe1ac9e9d0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:50.529429 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0265b-4324-49a6-8648-dfe1ac9e9d0e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:50.537900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663ecdc-e455-447d-a228-e8f55ab54428 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:50.538205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663ecdc-e455-447d-a228-e8f55ab54428 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:50.538608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663ecdc-e455-447d-a228-e8f55ab54428 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:50.540336 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 922/1849] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 01:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:09:50.575826 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 928/1850] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:09:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:09:50.581102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663ecdc-e455-447d-a228-e8f55ab54428 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:50.594901 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:50.605328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f4554-c664-4405-815b-623fba0ebab7 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:50.606321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f4554-c664-4405-815b-623fba0ebab7 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:50.607271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f4554-c664-4405-815b-623fba0ebab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:50.623380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663ecdc-e455-447d-a228-e8f55ab54428 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:50.643844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8eca13-9d82-41a9-9e9b-7d117dca63b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:50.645457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8eca13-9d82-41a9-9e9b-7d117dca63b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:50.648018 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8eca13-9d82-41a9-9e9b-7d117dca63b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:50.648980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8eca13-9d82-41a9-9e9b-7d117dca63b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:50.653199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8eca13-9d82-41a9-9e9b-7d117dca63b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:50.657556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8eca13-9d82-41a9-9e9b-7d117dca63b9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:50.670851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-857f4554-c664-4405-815b-623fba0ebab7 None None] MFA Rules not processed for user `6c70d5a72d424db68de7c7b8257fe02c`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:50.674979 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-857f4554-c664-4405-815b-623fba0ebab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:50.770481 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 923/1851] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:50 2022] POST /identity/v3/projects => generated 381 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:50.772694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8eca13-9d82-41a9-9e9b-7d117dca63b9 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:50.780730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0c8eca13-9d82-41a9-9e9b-7d117dca63b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:50.998092 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 929/1852] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 01:09:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:50.999688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f4554-c664-4405-815b-623fba0ebab7 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:51.032315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f4554-c664-4405-815b-623fba0ebab7 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:51.098480 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8eca13-9d82-41a9-9e9b-7d117dca63b9 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:51.118554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcbaf5a-c1c2-4a24-96c5-cfea641e1d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:51.119556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbaf5a-c1c2-4a24-96c5-cfea641e1d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:51.122820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbaf5a-c1c2-4a24-96c5-cfea641e1d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:51.123353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbaf5a-c1c2-4a24-96c5-cfea641e1d6e admin admin] PATH_INFO: `/v3/projects/19d5955f976a4ecf871bd9882387b4ad` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:51.127751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcbaf5a-c1c2-4a24-96c5-cfea641e1d6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=19d5955f976a4ecf871bd9882387b4ad)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:51.139559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcbaf5a-c1c2-4a24-96c5-cfea641e1d6e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:51.303104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd446e9d-8b7b-4684-8840-449ffa0d9736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:51.306021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd446e9d-8b7b-4684-8840-449ffa0d9736 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:51.306952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd446e9d-8b7b-4684-8840-449ffa0d9736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:51.310675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd446e9d-8b7b-4684-8840-449ffa0d9736 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:51.313047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd446e9d-8b7b-4684-8840-449ffa0d9736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:51.319039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd446e9d-8b7b-4684-8840-449ffa0d9736 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:51.369196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-afcbaf5a-c1c2-4a24-96c5-cfea641e1d6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19d5955f976a4ecf871bd9882387b4ad', 'request_id': 'req-afcbaf5a-c1c2-4a24-96c5-cfea641e1d6e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:51.395651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-afcbaf5a-c1c2-4a24-96c5-cfea641e1d6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19d5955f976a4ecf871bd9882387b4ad', 'request_id': 'req-afcbaf5a-c1c2-4a24-96c5-cfea641e1d6e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:51.410463 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 930/1853] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:50 2022] POST /identity/v3/users => generated 291 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:51.418319 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd446e9d-8b7b-4684-8840-449ffa0d9736 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:51.434534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-afcbaf5a-c1c2-4a24-96c5-cfea641e1d6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19d5955f976a4ecf871bd9882387b4ad', 'request_id': 'req-afcbaf5a-c1c2-4a24-96c5-cfea641e1d6e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:51.449598 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:51.477690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd446e9d-8b7b-4684-8840-449ffa0d9736 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:51.508241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-afcbaf5a-c1c2-4a24-96c5-cfea641e1d6e admin admin] The token cache is being invalidate because project 19d5955f976a4ecf871bd9882387b4ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:09:51.514918 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-afcbaf5a-c1c2-4a24-96c5-cfea641e1d6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:51.520478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-afcbaf5a-c1c2-4a24-96c5-cfea641e1d6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:51.537378 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 924/1854] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:09:50 2022] DELETE /identity/v3/projects/19d5955f976a4ecf871bd9882387b4ad => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:51.542372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600af87-8ac4-47e8-90c2-07e318886340 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:51.543172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600af87-8ac4-47e8-90c2-07e318886340 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:51.543946 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600af87-8ac4-47e8-90c2-07e318886340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:51.638291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3600af87-8ac4-47e8-90c2-07e318886340 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:51.644615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3600af87-8ac4-47e8-90c2-07e318886340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:51.803910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302e9d9-975b-4d0e-9746-93990c73be92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:51.805132 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302e9d9-975b-4d0e-9746-93990c73be92 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:51.807214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302e9d9-975b-4d0e-9746-93990c73be92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:51.807829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302e9d9-975b-4d0e-9746-93990c73be92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:51.811972 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302e9d9-975b-4d0e-9746-93990c73be92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:51.815465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302e9d9-975b-4d0e-9746-93990c73be92 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:51.868391 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 931/1855] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:51.874803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302e9d9-975b-4d0e-9746-93990c73be92 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:51.881739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6302e9d9-975b-4d0e-9746-93990c73be92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:51.926338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302e9d9-975b-4d0e-9746-93990c73be92 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:51.935305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58ff0f-c279-4ecb-82a8-6884db83cb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:51.936843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58ff0f-c279-4ecb-82a8-6884db83cb2c admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:51.937243 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58ff0f-c279-4ecb-82a8-6884db83cb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:51.937641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58ff0f-c279-4ecb-82a8-6884db83cb2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:51.938505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58ff0f-c279-4ecb-82a8-6884db83cb2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:51.941232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58ff0f-c279-4ecb-82a8-6884db83cb2c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:52.008596 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 925/1856] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:52.009321 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 932/1857] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:52.014087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600af87-8ac4-47e8-90c2-07e318886340 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:52.014740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58ff0f-c279-4ecb-82a8-6884db83cb2c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:52.021482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dd58ff0f-c279-4ecb-82a8-6884db83cb2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:52.038013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600af87-8ac4-47e8-90c2-07e318886340 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:52.073438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a64d88d-64ea-44ca-bfd2-64be7dd1480e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:52.078642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64d88d-64ea-44ca-bfd2-64be7dd1480e admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:52.081388 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64d88d-64ea-44ca-bfd2-64be7dd1480e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:52.082029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a64d88d-64ea-44ca-bfd2-64be7dd1480e admin admin] PATH_INFO: `/v3/projects/3e6f5c6f095145569a21febacb2f2bbe/users/1f6554c6afcb4148901186f0a17df313/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:52.115126 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:52.137571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a64d88d-64ea-44ca-bfd2-64be7dd1480e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e6f5c6f095145569a21febacb2f2bbe, user_id=1f6554c6afcb4148901186f0a17df313, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:52.144684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a64d88d-64ea-44ca-bfd2-64be7dd1480e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:52.192012 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 926/1858] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:52 2022] PUT /identity/v3/projects/3e6f5c6f095145569a21febacb2f2bbe/users/1f6554c6afcb4148901186f0a17df313/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:52.194178 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a59293-8b58-4252-918f-30fa3604355b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:52.194808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a59293-8b58-4252-918f-30fa3604355b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:52.195277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a59293-8b58-4252-918f-30fa3604355b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:52.240729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-68a59293-8b58-4252-918f-30fa3604355b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:52.244096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-68a59293-8b58-4252-918f-30fa3604355b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:52.312782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58ff0f-c279-4ecb-82a8-6884db83cb2c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:52.489739 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 927/1859] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:52.491486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a59293-8b58-4252-918f-30fa3604355b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:52.500240 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-68a59293-8b58-4252-918f-30fa3604355b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:52.515410 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91388ef6-67a5-4b22-bdfe-00e395ecc926 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:52.518348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91388ef6-67a5-4b22-bdfe-00e395ecc926 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:52.518733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91388ef6-67a5-4b22-bdfe-00e395ecc926 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:52.519221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91388ef6-67a5-4b22-bdfe-00e395ecc926 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:52.524159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-91388ef6-67a5-4b22-bdfe-00e395ecc926 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:52.546735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a59293-8b58-4252-918f-30fa3604355b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:52.558430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca373f-8910-4ae9-815a-c5708b0198f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:52.560153 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca373f-8910-4ae9-815a-c5708b0198f4 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:52.560913 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca373f-8910-4ae9-815a-c5708b0198f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:52.562542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca373f-8910-4ae9-815a-c5708b0198f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:52.569662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b6ca373f-8910-4ae9-815a-c5708b0198f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:52.597662 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:52.611360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca373f-8910-4ae9-815a-c5708b0198f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:52.614698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca373f-8910-4ae9-815a-c5708b0198f4 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:52.640457 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 928/1860] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:52.643485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27012b16-4e88-4be1-9cfb-47fa54adf552 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:52.644265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27012b16-4e88-4be1-9cfb-47fa54adf552 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:52.652621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27012b16-4e88-4be1-9cfb-47fa54adf552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:52.685294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91388ef6-67a5-4b22-bdfe-00e395ecc926 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:52.690222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91388ef6-67a5-4b22-bdfe-00e395ecc926 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:52.744510 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 933/1861] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:52 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 735 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:52.752362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91388ef6-67a5-4b22-bdfe-00e395ecc926 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:52.761866 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-27012b16-4e88-4be1-9cfb-47fa54adf552 None None] MFA Rules not processed for user `1f6554c6afcb4148901186f0a17df313`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:52.766192 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-27012b16-4e88-4be1-9cfb-47fa54adf552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:52.796836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91388ef6-67a5-4b22-bdfe-00e395ecc926 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:52.812941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03257e1-67ed-4e9b-ae11-e64bac1f12a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:52.816286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03257e1-67ed-4e9b-ae11-e64bac1f12a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:52.818430 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03257e1-67ed-4e9b-ae11-e64bac1f12a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:52.818875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03257e1-67ed-4e9b-ae11-e64bac1f12a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:52.825042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03257e1-67ed-4e9b-ae11-e64bac1f12a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:09:52.825042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03257e1-67ed-4e9b-ae11-e64bac1f12a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:52.829455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03257e1-67ed-4e9b-ae11-e64bac1f12a5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:52.902395 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 934/1862] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:09:52.907615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03257e1-67ed-4e9b-ae11-e64bac1f12a5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:52.932921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03257e1-67ed-4e9b-ae11-e64bac1f12a5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:52.957091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427b9ee-3b7b-4163-8a95-a5a1623b2d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:52.958128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427b9ee-3b7b-4163-8a95-a5a1623b2d8d admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:52.958605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427b9ee-3b7b-4163-8a95-a5a1623b2d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:52.959055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427b9ee-3b7b-4163-8a95-a5a1623b2d8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:52.960770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5427b9ee-3b7b-4163-8a95-a5a1623b2d8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:52.966684 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5427b9ee-3b7b-4163-8a95-a5a1623b2d8d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:53.128256 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 935/1863] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:52 2022] POST /identity/v3/projects => generated 379 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:53.130168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427b9ee-3b7b-4163-8a95-a5a1623b2d8d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:53.143147 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 929/1864] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 502 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:53.155668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27012b16-4e88-4be1-9cfb-47fa54adf552 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:53.233944 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27012b16-4e88-4be1-9cfb-47fa54adf552 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:53.402208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427b9ee-3b7b-4163-8a95-a5a1623b2d8d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:53.435490 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb80d8-8204-4204-8bac-f8b4fd81bd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:53.437231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb80d8-8204-4204-8bac-f8b4fd81bd74 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:53.437231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb80d8-8204-4204-8bac-f8b4fd81bd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:53.437636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb80d8-8204-4204-8bac-f8b4fd81bd74 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:53.438717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb80d8-8204-4204-8bac-f8b4fd81bd74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:53.443705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb80d8-8204-4204-8bac-f8b4fd81bd74 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:53.494588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3fa551-dca1-4ecd-9ae0-15a9e0603693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:53.496413 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fa551-dca1-4ecd-9ae0-15a9e0603693 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:53.496842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fa551-dca1-4ecd-9ae0-15a9e0603693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:53.497252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fa551-dca1-4ecd-9ae0-15a9e0603693 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:53.498267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3fa551-dca1-4ecd-9ae0-15a9e0603693 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:53.504960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3fa551-dca1-4ecd-9ae0-15a9e0603693 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:53.542710 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:53.570398 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 936/1865] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:53 2022] POST /identity/v3/users => generated 290 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:53.576614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb80d8-8204-4204-8bac-f8b4fd81bd74 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:53.612160 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 930/1866] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:53 2022] POST /identity/v3/projects => generated 381 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:53.613493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3fa551-dca1-4ecd-9ae0-15a9e0603693 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:53.620797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb80d8-8204-4204-8bac-f8b4fd81bd74 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:53.882370 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a2401-cbea-4cf4-94c5-e1c619f67ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:53.883370 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a2401-cbea-4cf4-94c5-e1c619f67ecb admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:53.883850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a2401-cbea-4cf4-94c5-e1c619f67ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:53.884357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a2401-cbea-4cf4-94c5-e1c619f67ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:53.887079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a2401-cbea-4cf4-94c5-e1c619f67ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:53.905617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a2401-cbea-4cf4-94c5-e1c619f67ecb admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:53.911737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3fa551-dca1-4ecd-9ae0-15a9e0603693 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:53.931436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb764fc-834d-439d-8de2-a6a719d02e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:53.932568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb764fc-834d-439d-8de2-a6a719d02e09 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:53.932759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb764fc-834d-439d-8de2-a6a719d02e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:53.933024 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb764fc-834d-439d-8de2-a6a719d02e09 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:53.933855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb764fc-834d-439d-8de2-a6a719d02e09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:53.938313 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 937/1867] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:53.939867 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb764fc-834d-439d-8de2-a6a719d02e09 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:53.943785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a2401-cbea-4cf4-94c5-e1c619f67ecb admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:53.966954 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a2401-cbea-4cf4-94c5-e1c619f67ecb admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:53.997554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4c535-5afb-4a24-88ac-6b623501747f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:53.998906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4c535-5afb-4a24-88ac-6b623501747f admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:53.999627 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4c535-5afb-4a24-88ac-6b623501747f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:54.000325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4c535-5afb-4a24-88ac-6b623501747f admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:54.001711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4c535-5afb-4a24-88ac-6b623501747f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:54.010066 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4c535-5afb-4a24-88ac-6b623501747f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:54.030109 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:54.055692 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 938/1868] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:54.059630 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 931/1869] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:53 2022] POST /identity/v3/users => generated 297 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:54.062748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4c535-5afb-4a24-88ac-6b623501747f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:54.062985 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb764fc-834d-439d-8de2-a6a719d02e09 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:54.091944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4c535-5afb-4a24-88ac-6b623501747f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:54.101119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2915e-1471-4f62-929f-a51c560517e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:54.102409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2915e-1471-4f62-929f-a51c560517e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:54.102838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2915e-1471-4f62-929f-a51c560517e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:54.103260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2915e-1471-4f62-929f-a51c560517e8 admin admin] PATH_INFO: `/v3/projects/5b93d58fe82b4d6bb4d4865c492dbaad/users/73cdf8b421e747f1824625a174368323/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:54.106993 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb764fc-834d-439d-8de2-a6a719d02e09 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:54.132047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224b02c-711d-4845-add1-1026d0f9cb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:54.135131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224b02c-711d-4845-add1-1026d0f9cb53 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:54.136820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224b02c-711d-4845-add1-1026d0f9cb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:54.137102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224b02c-711d-4845-add1-1026d0f9cb53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:54.138006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224b02c-711d-4845-add1-1026d0f9cb53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:54.138310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2915e-1471-4f62-929f-a51c560517e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b93d58fe82b4d6bb4d4865c492dbaad, user_id=73cdf8b421e747f1824625a174368323, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:54.143432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2915e-1471-4f62-929f-a51c560517e8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:54.144361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224b02c-711d-4845-add1-1026d0f9cb53 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:54.183521 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 939/1870] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:54 2022] PUT /identity/v3/projects/5b93d58fe82b4d6bb4d4865c492dbaad/users/73cdf8b421e747f1824625a174368323/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:54.205763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726059b-8722-47e2-84b3-49f53c8809f0 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:54.205993 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 932/1871] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:54.211076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726059b-8722-47e2-84b3-49f53c8809f0 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:54.211466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726059b-8722-47e2-84b3-49f53c8809f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:54.211672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224b02c-711d-4845-add1-1026d0f9cb53 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:54.255478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224b02c-711d-4845-add1-1026d0f9cb53 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:54.289709 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f726059b-8722-47e2-84b3-49f53c8809f0 None None] MFA Rules not processed for user `73cdf8b421e747f1824625a174368323`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:54.294413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f726059b-8722-47e2-84b3-49f53c8809f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:54.505551 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 940/1872] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:09:54.512140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726059b-8722-47e2-84b3-49f53c8809f0 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:54.534780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480665a3-e5a4-408f-93a9-85ad59931f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:54.536049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480665a3-e5a4-408f-93a9-85ad59931f5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:54.536539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480665a3-e5a4-408f-93a9-85ad59931f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:54.537024 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480665a3-e5a4-408f-93a9-85ad59931f5a admin admin] PATH_INFO: `/v3/projects/08b6f347456346eeb80c9a1fe8f786f7/users/971b9fe909e84d2a8208350fe022c58a/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:54.660139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480665a3-e5a4-408f-93a9-85ad59931f5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=08b6f347456346eeb80c9a1fe8f786f7, user_id=971b9fe909e84d2a8208350fe022c58a, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:54.670095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480665a3-e5a4-408f-93a9-85ad59931f5a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:54.717271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726059b-8722-47e2-84b3-49f53c8809f0 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:54.726023 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 933/1873] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:54 2022] PUT /identity/v3/projects/08b6f347456346eeb80c9a1fe8f786f7/users/971b9fe909e84d2a8208350fe022c58a/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:54.727107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480665a3-e5a4-408f-93a9-85ad59931f5a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:54.737258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-480665a3-e5a4-408f-93a9-85ad59931f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:54.945151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644036b-ac65-4019-8ff0-5fbc0ed52d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:54.946229 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644036b-ac65-4019-8ff0-5fbc0ed52d3a admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:54.946632 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644036b-ac65-4019-8ff0-5fbc0ed52d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:54.947151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644036b-ac65-4019-8ff0-5fbc0ed52d3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:54.948153 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644036b-ac65-4019-8ff0-5fbc0ed52d3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:54.950803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644036b-ac65-4019-8ff0-5fbc0ed52d3a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:54.990125 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:55.006230 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 941/1874] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:54 2022] POST /identity/v3/projects => generated 377 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:55.008617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644036b-ac65-4019-8ff0-5fbc0ed52d3a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:55.069809 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:55.139678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644036b-ac65-4019-8ff0-5fbc0ed52d3a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:55.152074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480665a3-e5a4-408f-93a9-85ad59931f5a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:55.153238 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beda698-a954-4102-b291-d5cb1b60a50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:55.154909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beda698-a954-4102-b291-d5cb1b60a50b admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:55.155423 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beda698-a954-4102-b291-d5cb1b60a50b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:55.155923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beda698-a954-4102-b291-d5cb1b60a50b admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:55.157114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beda698-a954-4102-b291-d5cb1b60a50b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:55.159985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beda698-a954-4102-b291-d5cb1b60a50b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:55.203634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136af48-d360-4b60-a7ae-13a47909b414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:55.203947 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 942/1875] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:55.204170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136af48-d360-4b60-a7ae-13a47909b414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:55.205804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beda698-a954-4102-b291-d5cb1b60a50b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:55.209598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136af48-d360-4b60-a7ae-13a47909b414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:55.211644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136af48-d360-4b60-a7ae-13a47909b414 admin admin] PATH_INFO: `/v3/users/6298dea4d322433b89afad045cb04c73` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:55.217993 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136af48-d360-4b60-a7ae-13a47909b414 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6298dea4d322433b89afad045cb04c73)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:55.241884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136af48-d360-4b60-a7ae-13a47909b414 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:55.280094 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beda698-a954-4102-b291-d5cb1b60a50b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:55.315354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4136af48-d360-4b60-a7ae-13a47909b414 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6298dea4d322433b89afad045cb04c73'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:55.329141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4136af48-d360-4b60-a7ae-13a47909b414 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6298dea4d322433b89afad045cb04c73'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:55.337996 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747325ce-26e2-43ac-8b4d-a538c73b3063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:55.342264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747325ce-26e2-43ac-8b4d-a538c73b3063 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:55.344784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747325ce-26e2-43ac-8b4d-a538c73b3063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:55.346933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747325ce-26e2-43ac-8b4d-a538c73b3063 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:55.349019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747325ce-26e2-43ac-8b4d-a538c73b3063 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:55.356391 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747325ce-26e2-43ac-8b4d-a538c73b3063 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:55.365972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4136af48-d360-4b60-a7ae-13a47909b414 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6298dea4d322433b89afad045cb04c73'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:55.367055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4136af48-d360-4b60-a7ae-13a47909b414 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6298dea4d322433b89afad045cb04c73'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:55.380509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4136af48-d360-4b60-a7ae-13a47909b414 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6298dea4d322433b89afad045cb04c73'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:55.398112 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 934/1876] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:09:54 2022] DELETE /identity/v3/users/6298dea4d322433b89afad045cb04c73 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:55.398112 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136af48-d360-4b60-a7ae-13a47909b414 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:55.400841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4136af48-d360-4b60-a7ae-13a47909b414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:55.417624 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 943/1877] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:55 2022] POST /identity/v3/users => generated 295 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:55.419294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfab5b-d04f-43c3-8c72-48c1ae631b7c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:55.419766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfab5b-d04f-43c3-8c72-48c1ae631b7c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:55.424843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfab5b-d04f-43c3-8c72-48c1ae631b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:55.461276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0acfab5b-d04f-43c3-8c72-48c1ae631b7c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:55.464455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0acfab5b-d04f-43c3-8c72-48c1ae631b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:55.525648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136af48-d360-4b60-a7ae-13a47909b414 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:55.534951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e5d99-d3a0-442a-a87c-1b562bd2ef49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:55.535742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e5d99-d3a0-442a-a87c-1b562bd2ef49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:55.536115 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e5d99-d3a0-442a-a87c-1b562bd2ef49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:55.536488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e5d99-d3a0-442a-a87c-1b562bd2ef49 admin admin] PATH_INFO: `/v3/projects/08b6f347456346eeb80c9a1fe8f786f7/users/971b9fe909e84d2a8208350fe022c58a/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:55.539664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e5d99-d3a0-442a-a87c-1b562bd2ef49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08b6f347456346eeb80c9a1fe8f786f7, user_id=971b9fe909e84d2a8208350fe022c58a, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:55.545000 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e5d99-d3a0-442a-a87c-1b562bd2ef49 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:55.577459 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 935/1878] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:55 2022] PUT /identity/v3/projects/08b6f347456346eeb80c9a1fe8f786f7/users/971b9fe909e84d2a8208350fe022c58a/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:55.578710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e5d99-d3a0-442a-a87c-1b562bd2ef49 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:55.582593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-fd7e5d99-d3a0-442a-a87c-1b562bd2ef49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:55.680383 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 944/1879] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:55.682905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb31b6-434d-403c-ab1c-d0380ebc2bb8 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:55.684559 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb31b6-434d-403c-ab1c-d0380ebc2bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:55.688364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb31b6-434d-403c-ab1c-d0380ebc2bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:55.710156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e5d99-d3a0-442a-a87c-1b562bd2ef49 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:55.716955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146df00-8e76-4994-8ef4-7485be197151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:55.719282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146df00-8e76-4994-8ef4-7485be197151 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:55.719601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146df00-8e76-4994-8ef4-7485be197151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:55.720033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146df00-8e76-4994-8ef4-7485be197151 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:55.721539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146df00-8e76-4994-8ef4-7485be197151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:55.725762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146df00-8e76-4994-8ef4-7485be197151 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:55.734975 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:55.742581 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 936/1880] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:09:55.744233 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146df00-8e76-4994-8ef4-7485be197151 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:55.748258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0146df00-8e76-4994-8ef4-7485be197151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:55.782339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-70fb31b6-434d-403c-ab1c-d0380ebc2bb8 None None] MFA Rules not processed for user `971b9fe909e84d2a8208350fe022c58a`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:55.785344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-70fb31b6-434d-403c-ab1c-d0380ebc2bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:55.897529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146df00-8e76-4994-8ef4-7485be197151 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:55.907180 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57e525-781e-4a2a-baad-09940a49e61c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:55.908980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57e525-781e-4a2a-baad-09940a49e61c service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:55.909340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57e525-781e-4a2a-baad-09940a49e61c service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:55.909810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57e525-781e-4a2a-baad-09940a49e61c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:55.929780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57e525-781e-4a2a-baad-09940a49e61c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:55.932166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57e525-781e-4a2a-baad-09940a49e61c service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:55.962778 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 937/1881] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:55.970055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57e525-781e-4a2a-baad-09940a49e61c service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:55.998797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57e525-781e-4a2a-baad-09940a49e61c service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:56.013350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82702923-3210-4638-a64f-55b582fe7570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:56.022056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82702923-3210-4638-a64f-55b582fe7570 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:56.022992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82702923-3210-4638-a64f-55b582fe7570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:56.023491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82702923-3210-4638-a64f-55b582fe7570 admin admin] PATH_INFO: `/v3/projects/9ba69402e23d4c3991d7686c204a8582/users/6cda46689c0c4a0f85119c495598b78e/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:56.035968 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 945/1882] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:56.071944 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82702923-3210-4638-a64f-55b582fe7570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ba69402e23d4c3991d7686c204a8582, user_id=6cda46689c0c4a0f85119c495598b78e, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:56.080201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82702923-3210-4638-a64f-55b582fe7570 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:56.137626 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 938/1883] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:55 2022] PUT /identity/v3/projects/9ba69402e23d4c3991d7686c204a8582/users/6cda46689c0c4a0f85119c495598b78e/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:56.139919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb31b6-434d-403c-ab1c-d0380ebc2bb8 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:56.153023 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:56.190828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb31b6-434d-403c-ab1c-d0380ebc2bb8 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:56.345274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82702923-3210-4638-a64f-55b582fe7570 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:56.350556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-82702923-3210-4638-a64f-55b582fe7570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:56.506600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d597f-7b1d-487e-9884-b299c1b9e2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:56.509382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d597f-7b1d-487e-9884-b299c1b9e2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:56.513247 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d597f-7b1d-487e-9884-b299c1b9e2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:56.513836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d597f-7b1d-487e-9884-b299c1b9e2f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:56.515671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d597f-7b1d-487e-9884-b299c1b9e2f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:56.519421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d597f-7b1d-487e-9884-b299c1b9e2f7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:56.564887 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 946/1884] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:09:56.569811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d597f-7b1d-487e-9884-b299c1b9e2f7 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:56.601563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d597f-7b1d-487e-9884-b299c1b9e2f7 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:56.622947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286b80b-b36a-49c6-9207-db277f024368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:56.626055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286b80b-b36a-49c6-9207-db277f024368 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:56.627430 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286b80b-b36a-49c6-9207-db277f024368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:56.629008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286b80b-b36a-49c6-9207-db277f024368 admin admin] PATH_INFO: `/v3/projects/9ba69402e23d4c3991d7686c204a8582/users/6cda46689c0c4a0f85119c495598b78e/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:56.638264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286b80b-b36a-49c6-9207-db277f024368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ba69402e23d4c3991d7686c204a8582, user_id=6cda46689c0c4a0f85119c495598b78e, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:56.652358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286b80b-b36a-49c6-9207-db277f024368 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:56.690886 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82702923-3210-4638-a64f-55b582fe7570 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:56.697978 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 947/1885] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:09:56 2022] PUT /identity/v3/projects/9ba69402e23d4c3991d7686c204a8582/users/6cda46689c0c4a0f85119c495598b78e/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:56.716844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21263c2-0251-4449-90a6-14ca325e1fd8 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:56.717150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21263c2-0251-4449-90a6-14ca325e1fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:56.717338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21263c2-0251-4449-90a6-14ca325e1fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:56.823803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e21263c2-0251-4449-90a6-14ca325e1fd8 None None] MFA Rules not processed for user `6cda46689c0c4a0f85119c495598b78e`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:56.825347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e21263c2-0251-4449-90a6-14ca325e1fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:56.954935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8681a-0ef3-4b6d-a2f9-6302a111c1e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:56.959600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8681a-0ef3-4b6d-a2f9-6302a111c1e1 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:56.960447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8681a-0ef3-4b6d-a2f9-6302a111c1e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:56.961127 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8681a-0ef3-4b6d-a2f9-6302a111c1e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:57.045032 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:57.153925 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 948/1886] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:09:57.169760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21263c2-0251-4449-90a6-14ca325e1fd8 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:57.174373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e21263c2-0251-4449-90a6-14ca325e1fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:57.219761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8681a-0ef3-4b6d-a2f9-6302a111c1e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:57.233976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8681a-0ef3-4b6d-a2f9-6302a111c1e1 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:57.272452 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 939/1887] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:56 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 929 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:57.412587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21263c2-0251-4449-90a6-14ca325e1fd8 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:57.426980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bbd14-2338-4a22-9ddd-77e33b68c878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:57.427744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bbd14-2338-4a22-9ddd-77e33b68c878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:57.428049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bbd14-2338-4a22-9ddd-77e33b68c878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:57.428325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bbd14-2338-4a22-9ddd-77e33b68c878 admin admin] PATH_INFO: `/v3/projects/4f263fc12abc4b40ab771109bb7a3d85` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:57.431920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bbd14-2338-4a22-9ddd-77e33b68c878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f263fc12abc4b40ab771109bb7a3d85)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:57.437087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bbd14-2338-4a22-9ddd-77e33b68c878 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:57.472197 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:57.521987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8681a-0ef3-4b6d-a2f9-6302a111c1e1 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:57.544931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8681a-0ef3-4b6d-a2f9-6302a111c1e1 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:57.636754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bd1bbd14-2338-4a22-9ddd-77e33b68c878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f263fc12abc4b40ab771109bb7a3d85', 'request_id': 'req-bd1bbd14-2338-4a22-9ddd-77e33b68c878'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:57.681399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bd1bbd14-2338-4a22-9ddd-77e33b68c878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f263fc12abc4b40ab771109bb7a3d85', 'request_id': 'req-bd1bbd14-2338-4a22-9ddd-77e33b68c878'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:57.696941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bd1bbd14-2338-4a22-9ddd-77e33b68c878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f263fc12abc4b40ab771109bb7a3d85', 'request_id': 'req-bd1bbd14-2338-4a22-9ddd-77e33b68c878'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:57.738194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bd1bbd14-2338-4a22-9ddd-77e33b68c878 admin admin] The token cache is being invalidate because project 4f263fc12abc4b40ab771109bb7a3d85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:09:57.739589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bd1bbd14-2338-4a22-9ddd-77e33b68c878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:57.740336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bd1bbd14-2338-4a22-9ddd-77e33b68c878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:57.747031 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 949/1888] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:09:57 2022] DELETE /identity/v3/projects/4f263fc12abc4b40ab771109bb7a3d85 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:57.754742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bbd14-2338-4a22-9ddd-77e33b68c878 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:57.761952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-bd1bbd14-2338-4a22-9ddd-77e33b68c878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:57.825751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d5239-0f64-4719-948f-f670fe63b0fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:57.826646 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d5239-0f64-4719-948f-f670fe63b0fa service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:57.827078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d5239-0f64-4719-948f-f670fe63b0fa service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:57.827384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d5239-0f64-4719-948f-f670fe63b0fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:57.830196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-488d5239-0f64-4719-948f-f670fe63b0fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:57.964375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bbd14-2338-4a22-9ddd-77e33b68c878 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:57.988684 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00eae62-aaf6-4fe2-beb3-82d5229e797b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:57.990435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00eae62-aaf6-4fe2-beb3-82d5229e797b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:57.990989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d5239-0f64-4719-948f-f670fe63b0fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:57.991456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00eae62-aaf6-4fe2-beb3-82d5229e797b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:57.992274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00eae62-aaf6-4fe2-beb3-82d5229e797b admin admin] PATH_INFO: `/v3/users/4c0b0c4fb5c94dc6bec1534839c9e4a3` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:57.992824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d5239-0f64-4719-948f-f670fe63b0fa service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:57.994321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00eae62-aaf6-4fe2-beb3-82d5229e797b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c0b0c4fb5c94dc6bec1534839c9e4a3)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:58.000474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00eae62-aaf6-4fe2-beb3-82d5229e797b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:58.022892 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 940/1889] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:09:58.099533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d00eae62-aaf6-4fe2-beb3-82d5229e797b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c0b0c4fb5c94dc6bec1534839c9e4a3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:58.125130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d00eae62-aaf6-4fe2-beb3-82d5229e797b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c0b0c4fb5c94dc6bec1534839c9e4a3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:58.168890 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d5239-0f64-4719-948f-f670fe63b0fa service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:58.172102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-488d5239-0f64-4719-948f-f670fe63b0fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:58.211414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d00eae62-aaf6-4fe2-beb3-82d5229e797b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c0b0c4fb5c94dc6bec1534839c9e4a3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:58.213208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d00eae62-aaf6-4fe2-beb3-82d5229e797b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c0b0c4fb5c94dc6bec1534839c9e4a3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:58.221925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d5239-0f64-4719-948f-f670fe63b0fa service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:58.228424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a8e554-f734-4c24-9c3a-0ce79dc88794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:58.229260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d00eae62-aaf6-4fe2-beb3-82d5229e797b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c0b0c4fb5c94dc6bec1534839c9e4a3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:58.229410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8e554-f734-4c24-9c3a-0ce79dc88794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:58.229751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8e554-f734-4c24-9c3a-0ce79dc88794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:58.230334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a8e554-f734-4c24-9c3a-0ce79dc88794 admin admin] PATH_INFO: `/v3/users/1f6554c6afcb4148901186f0a17df313` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:58.232156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a8e554-f734-4c24-9c3a-0ce79dc88794 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f6554c6afcb4148901186f0a17df313)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:58.234268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a8e554-f734-4c24-9c3a-0ce79dc88794 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:58.248917 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 950/1890] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:09:57 2022] DELETE /identity/v3/users/4c0b0c4fb5c94dc6bec1534839c9e4a3 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:58.316052 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:58.337583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-29a8e554-f734-4c24-9c3a-0ce79dc88794 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f6554c6afcb4148901186f0a17df313'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:58.352909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-29a8e554-f734-4c24-9c3a-0ce79dc88794 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f6554c6afcb4148901186f0a17df313'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:58.375822 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-29a8e554-f734-4c24-9c3a-0ce79dc88794 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f6554c6afcb4148901186f0a17df313'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:58.377761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-29a8e554-f734-4c24-9c3a-0ce79dc88794 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f6554c6afcb4148901186f0a17df313'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:58.395522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-29a8e554-f734-4c24-9c3a-0ce79dc88794 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f6554c6afcb4148901186f0a17df313'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:58.435527 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 941/1891] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:09:58 2022] DELETE /identity/v3/users/1f6554c6afcb4148901186f0a17df313 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:58.444671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c1e30-c314-42ec-92b2-8de6673cd44e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:58.445355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c1e30-c314-42ec-92b2-8de6673cd44e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:58.446240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c1e30-c314-42ec-92b2-8de6673cd44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:58.478847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0c303-2956-46b5-84d2-7d991a408e6f None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:58.480192 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0c303-2956-46b5-84d2-7d991a408e6f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:58.480547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0c303-2956-46b5-84d2-7d991a408e6f None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:58.484182 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 942/1892] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:09:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:09:58.490963 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0c303-2956-46b5-84d2-7d991a408e6f None None] Authenticating service token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:09:58.493310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c2e0c303-2956-46b5-84d2-7d991a408e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:58.516660 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9b3c1e30-c314-42ec-92b2-8de6673cd44e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:58.520634 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9b3c1e30-c314-42ec-92b2-8de6673cd44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:58.564291 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:58.677464 n-d-master-1 devstack@keystone.service[80493]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0c303-2956-46b5-84d2-7d991a408e6f None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Aug 07 01:09:58.679121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0c303-2956-46b5-84d2-7d991a408e6f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:58.682176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c2e0c303-2956-46b5-84d2-7d991a408e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:58.689023 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 951/1893] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:09:58.710647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c1e30-c314-42ec-92b2-8de6673cd44e None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:58.712451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9b3c1e30-c314-42ec-92b2-8de6673cd44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:58.831422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c1e30-c314-42ec-92b2-8de6673cd44e None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:58.839114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41fa93b-14ff-4e7f-a564-98feb9ab7f56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:58.839400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fa93b-14ff-4e7f-a564-98feb9ab7f56 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:58.839750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fa93b-14ff-4e7f-a564-98feb9ab7f56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:58.840110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fa93b-14ff-4e7f-a564-98feb9ab7f56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:58.846017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0c303-2956-46b5-84d2-7d991a408e6f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:58.852489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41fa93b-14ff-4e7f-a564-98feb9ab7f56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:58.854232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41fa93b-14ff-4e7f-a564-98feb9ab7f56 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:58.855314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d975a-865d-49b2-b767-142cd3b124c4 tempest-FlavorsAccessTestJSON-700592258 tempest-FlavorsAccessTestJSON-700592258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cda46689c0c4a0f85119c495598b78e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba69402e23d4c3991d7686c204a8582', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:58.856484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d975a-865d-49b2-b767-142cd3b124c4 tempest-FlavorsAccessTestJSON-700592258 tempest-FlavorsAccessTestJSON-700592258-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:58.856997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d975a-865d-49b2-b767-142cd3b124c4 tempest-FlavorsAccessTestJSON-700592258 tempest-FlavorsAccessTestJSON-700592258-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:58.857501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d975a-865d-49b2-b767-142cd3b124c4 tempest-FlavorsAccessTestJSON-700592258 tempest-FlavorsAccessTestJSON-700592258-project-admin] PATH_INFO: `/v3/projects/5b93d58fe82b4d6bb4d4865c492dbaad` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:58.859816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d975a-865d-49b2-b767-142cd3b124c4 tempest-FlavorsAccessTestJSON-700592258 tempest-FlavorsAccessTestJSON-700592258-project-admin] RBAC: Authorizing `identity:get_project(project_id=5b93d58fe82b4d6bb4d4865c492dbaad)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:58.864525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d975a-865d-49b2-b767-142cd3b124c4 tempest-FlavorsAccessTestJSON-700592258 tempest-FlavorsAccessTestJSON-700592258-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:58.868666 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 943/1894] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:09:58 2022] GET /identity/v3/projects/5b93d58fe82b4d6bb4d4865c492dbaad => generated 379 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:09:58.879777 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 952/1895] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:58.922454 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d975a-865d-49b2-b767-142cd3b124c4 tempest-FlavorsAccessTestJSON-700592258 tempest-FlavorsAccessTestJSON-700592258-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:58.951304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d975a-865d-49b2-b767-142cd3b124c4 tempest-FlavorsAccessTestJSON-700592258 tempest-FlavorsAccessTestJSON-700592258-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:58.965838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e68a3-788b-4dee-b58e-da27af7f3cbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:58.967754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e68a3-788b-4dee-b58e-da27af7f3cbe service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:58.968748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e68a3-788b-4dee-b58e-da27af7f3cbe service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:58.970614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e68a3-788b-4dee-b58e-da27af7f3cbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:58.991648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-205e68a3-788b-4dee-b58e-da27af7f3cbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:59.103352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41fa93b-14ff-4e7f-a564-98feb9ab7f56 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:59.106181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d41fa93b-14ff-4e7f-a564-98feb9ab7f56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:59.109487 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:59.131133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41fa93b-14ff-4e7f-a564-98feb9ab7f56 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:59.140341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa0daf8-7478-444c-8b40-b8c04400e25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:59.141458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0daf8-7478-444c-8b40-b8c04400e25b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:59.141961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0daf8-7478-444c-8b40-b8c04400e25b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:59.142762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa0daf8-7478-444c-8b40-b8c04400e25b admin admin] PATH_INFO: `/v3/projects/08a594efa62f415490f0fdb741a2647e` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:59.144938 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0daf8-7478-444c-8b40-b8c04400e25b admin admin] RBAC: Authorizing `identity:delete_project(project_id=08a594efa62f415490f0fdb741a2647e)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:59.148851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa0daf8-7478-444c-8b40-b8c04400e25b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:59.149863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e68a3-788b-4dee-b58e-da27af7f3cbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:59.153548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e68a3-788b-4dee-b58e-da27af7f3cbe service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:59.184229 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 944/1896] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:09:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:09:59.248314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2aa0daf8-7478-444c-8b40-b8c04400e25b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08a594efa62f415490f0fdb741a2647e', 'request_id': 'req-2aa0daf8-7478-444c-8b40-b8c04400e25b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:59.259784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2aa0daf8-7478-444c-8b40-b8c04400e25b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08a594efa62f415490f0fdb741a2647e', 'request_id': 'req-2aa0daf8-7478-444c-8b40-b8c04400e25b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:59.273416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2aa0daf8-7478-444c-8b40-b8c04400e25b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08a594efa62f415490f0fdb741a2647e', 'request_id': 'req-2aa0daf8-7478-444c-8b40-b8c04400e25b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:59.281988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d400c-dc70-44a9-bbd0-c60f71ec17b8 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:59.282919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d400c-dc70-44a9-bbd0-c60f71ec17b8 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:59.283435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d400c-dc70-44a9-bbd0-c60f71ec17b8 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:59.287679 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 945/1897] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:09:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:09:59.298564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2aa0daf8-7478-444c-8b40-b8c04400e25b admin admin] The token cache is being invalidate because project 08a594efa62f415490f0fdb741a2647e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:09:59.299176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d400c-dc70-44a9-bbd0-c60f71ec17b8 None None] Authenticating service token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:09:59.299491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2aa0daf8-7478-444c-8b40-b8c04400e25b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:59.300626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2aa0daf8-7478-444c-8b40-b8c04400e25b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:59.302319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a10d400c-dc70-44a9-bbd0-c60f71ec17b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:59.303390 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 953/1898] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:09:59 2022] DELETE /identity/v3/projects/08a594efa62f415490f0fdb741a2647e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:59.311228 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd8f5f-e038-4ae0-a111-3a7c6a630e89 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:59.311599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd8f5f-e038-4ae0-a111-3a7c6a630e89 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:59.312105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd8f5f-e038-4ae0-a111-3a7c6a630e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:59.347239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-87dd8f5f-e038-4ae0-a111-3a7c6a630e89 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:59.349421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-87dd8f5f-e038-4ae0-a111-3a7c6a630e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:59.445180 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:59.461295 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d400c-dc70-44a9-bbd0-c60f71ec17b8 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:59.485893 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 954/1899] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:09:59.487421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd8f5f-e038-4ae0-a111-3a7c6a630e89 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:59.489757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-87dd8f5f-e038-4ae0-a111-3a7c6a630e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:59.512281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd8f5f-e038-4ae0-a111-3a7c6a630e89 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:59.521987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73561268-3ee8-4cfe-9c03-d309c074ee3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:59.523159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73561268-3ee8-4cfe-9c03-d309c074ee3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:59.523707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73561268-3ee8-4cfe-9c03-d309c074ee3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:59.524205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73561268-3ee8-4cfe-9c03-d309c074ee3f admin admin] PATH_INFO: `/v3/projects/3e6f5c6f095145569a21febacb2f2bbe` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:59.526799 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73561268-3ee8-4cfe-9c03-d309c074ee3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e6f5c6f095145569a21febacb2f2bbe)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:59.530427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73561268-3ee8-4cfe-9c03-d309c074ee3f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:59.581491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d400c-dc70-44a9-bbd0-c60f71ec17b8 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:59.591552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453c6dc-6814-4240-aa0b-5c0766246a4b tempest-FlavorsAccessTestJSON-700592258 tempest-FlavorsAccessTestJSON-700592258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6cda46689c0c4a0f85119c495598b78e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba69402e23d4c3991d7686c204a8582', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:59.592826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453c6dc-6814-4240-aa0b-5c0766246a4b tempest-FlavorsAccessTestJSON-700592258 tempest-FlavorsAccessTestJSON-700592258-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:59.593476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453c6dc-6814-4240-aa0b-5c0766246a4b tempest-FlavorsAccessTestJSON-700592258 tempest-FlavorsAccessTestJSON-700592258-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:59.594084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453c6dc-6814-4240-aa0b-5c0766246a4b tempest-FlavorsAccessTestJSON-700592258 tempest-FlavorsAccessTestJSON-700592258-project-admin] PATH_INFO: `/v3/projects/5b93d58fe82b4d6bb4d4865c492dbaad` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:59.596567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453c6dc-6814-4240-aa0b-5c0766246a4b tempest-FlavorsAccessTestJSON-700592258 tempest-FlavorsAccessTestJSON-700592258-project-admin] RBAC: Authorizing `identity:get_project(project_id=5b93d58fe82b4d6bb4d4865c492dbaad)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:59.600909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453c6dc-6814-4240-aa0b-5c0766246a4b tempest-FlavorsAccessTestJSON-700592258 tempest-FlavorsAccessTestJSON-700592258-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:59.605589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73561268-3ee8-4cfe-9c03-d309c074ee3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e6f5c6f095145569a21febacb2f2bbe', 'request_id': 'req-73561268-3ee8-4cfe-9c03-d309c074ee3f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:59.607995 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 946/1900] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:09:59 2022] GET /identity/v3/projects/5b93d58fe82b4d6bb4d4865c492dbaad => generated 379 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:09:59.612292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adc37d-f484-49c5-af91-2673ea5af673 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:59.613658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adc37d-f484-49c5-af91-2673ea5af673 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:59.614045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71adc37d-f484-49c5-af91-2673ea5af673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:59.614360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73561268-3ee8-4cfe-9c03-d309c074ee3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e6f5c6f095145569a21febacb2f2bbe', 'request_id': 'req-73561268-3ee8-4cfe-9c03-d309c074ee3f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:59.630302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73561268-3ee8-4cfe-9c03-d309c074ee3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e6f5c6f095145569a21febacb2f2bbe', 'request_id': 'req-73561268-3ee8-4cfe-9c03-d309c074ee3f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:59.649026 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-71adc37d-f484-49c5-af91-2673ea5af673 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:09:59.658559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-71adc37d-f484-49c5-af91-2673ea5af673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:59.668690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73561268-3ee8-4cfe-9c03-d309c074ee3f admin admin] The token cache is being invalidate because project 3e6f5c6f095145569a21febacb2f2bbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:09:59.668999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73561268-3ee8-4cfe-9c03-d309c074ee3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:59.669782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73561268-3ee8-4cfe-9c03-d309c074ee3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:59.674672 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 955/1901] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:09:59 2022] DELETE /identity/v3/projects/3e6f5c6f095145569a21febacb2f2bbe => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:09:59.675723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73561268-3ee8-4cfe-9c03-d309c074ee3f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:59.677366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-73561268-3ee8-4cfe-9c03-d309c074ee3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:09:59.787015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73561268-3ee8-4cfe-9c03-d309c074ee3f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:59.790430 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 947/1902] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:09:59.795315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d8232-4928-4e59-b3ef-d0f248e4a04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:59.795746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71adc37d-f484-49c5-af91-2673ea5af673 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:59.796079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d8232-4928-4e59-b3ef-d0f248e4a04c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:59.796362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d8232-4928-4e59-b3ef-d0f248e4a04c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:59.796653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d8232-4928-4e59-b3ef-d0f248e4a04c admin admin] PATH_INFO: `/v3/users/971b9fe909e84d2a8208350fe022c58a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:59.798481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d8232-4928-4e59-b3ef-d0f248e4a04c admin admin] RBAC: Authorizing `identity:delete_user(user_id=971b9fe909e84d2a8208350fe022c58a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:59.800707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d8232-4928-4e59-b3ef-d0f248e4a04c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:59.819429 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71adc37d-f484-49c5-af91-2673ea5af673 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:59.827261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51d479-f429-4b44-9b6a-85311445d5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:59.828551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51d479-f429-4b44-9b6a-85311445d5da admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:59.829025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51d479-f429-4b44-9b6a-85311445d5da admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:59.829531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51d479-f429-4b44-9b6a-85311445d5da admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:59.831120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51d479-f429-4b44-9b6a-85311445d5da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:09:59.831120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51d479-f429-4b44-9b6a-85311445d5da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:59.833975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51d479-f429-4b44-9b6a-85311445d5da admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:59.857248 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 948/1903] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:09:59.865995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51d479-f429-4b44-9b6a-85311445d5da admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:59.893135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51d479-f429-4b44-9b6a-85311445d5da admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:09:59.900364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7fa27-c532-4f9b-b320-91ba16885e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:09:59.901326 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7fa27-c532-4f9b-b320-91ba16885e65 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:09:59.901624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7fa27-c532-4f9b-b320-91ba16885e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:09:59.901872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7fa27-c532-4f9b-b320-91ba16885e65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:09:59.902535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7fa27-c532-4f9b-b320-91ba16885e65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:09:59.905438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7fa27-c532-4f9b-b320-91ba16885e65 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:09:59.907963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-241d8232-4928-4e59-b3ef-d0f248e4a04c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '971b9fe909e84d2a8208350fe022c58a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:59.920954 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-241d8232-4928-4e59-b3ef-d0f248e4a04c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '971b9fe909e84d2a8208350fe022c58a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:59.924818 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:59.945870 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:09:59.949214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-241d8232-4928-4e59-b3ef-d0f248e4a04c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '971b9fe909e84d2a8208350fe022c58a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:59.950849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-241d8232-4928-4e59-b3ef-d0f248e4a04c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '971b9fe909e84d2a8208350fe022c58a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:09:59.959907 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 949/1904] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:09:59 2022] POST /identity/v3/projects => generated 375 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:09:59.962707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7fa27-c532-4f9b-b320-91ba16885e65 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:09:59.981340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-241d8232-4928-4e59-b3ef-d0f248e4a04c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '971b9fe909e84d2a8208350fe022c58a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:00.011142 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 956/1905] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:09:59 2022] DELETE /identity/v3/users/971b9fe909e84d2a8208350fe022c58a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:00.108541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7fa27-c532-4f9b-b320-91ba16885e65 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:00.198621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d8232-4928-4e59-b3ef-d0f248e4a04c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:00.200860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-241d8232-4928-4e59-b3ef-d0f248e4a04c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:00.230173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315da7b7-2cad-489f-913f-7cb421327248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:00.230881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315da7b7-2cad-489f-913f-7cb421327248 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:00.231300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315da7b7-2cad-489f-913f-7cb421327248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:00.231564 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315da7b7-2cad-489f-913f-7cb421327248 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:00.232261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315da7b7-2cad-489f-913f-7cb421327248 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:00.234948 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315da7b7-2cad-489f-913f-7cb421327248 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:00.269049 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 950/1906] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:09:59 2022] POST /identity/v3/users => generated 288 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:10:00.277985 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315da7b7-2cad-489f-913f-7cb421327248 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:00.281150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-315da7b7-2cad-489f-913f-7cb421327248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:00.304466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315da7b7-2cad-489f-913f-7cb421327248 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:00.315063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7258fd-9fb3-44af-b73b-bde988799277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:00.316901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7258fd-9fb3-44af-b73b-bde988799277 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:00.317072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7258fd-9fb3-44af-b73b-bde988799277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:00.317732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7258fd-9fb3-44af-b73b-bde988799277 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:00.318924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7258fd-9fb3-44af-b73b-bde988799277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:00.322614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7258fd-9fb3-44af-b73b-bde988799277 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:00.345303 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 951/1907] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:00.352320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7258fd-9fb3-44af-b73b-bde988799277 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:00.355929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d8232-4928-4e59-b3ef-d0f248e4a04c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:00.363060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d4dc3-25e0-4c27-9488-da5a30e80c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:00.363848 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d4dc3-25e0-4c27-9488-da5a30e80c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:00.364639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d4dc3-25e0-4c27-9488-da5a30e80c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:00.364639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d4dc3-25e0-4c27-9488-da5a30e80c96 admin admin] PATH_INFO: `/v3/users/73cdf8b421e747f1824625a174368323` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:00.366647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d4dc3-25e0-4c27-9488-da5a30e80c96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73cdf8b421e747f1824625a174368323)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:00.369169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d4dc3-25e0-4c27-9488-da5a30e80c96 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:00.373600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7258fd-9fb3-44af-b73b-bde988799277 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:00.383679 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6592466-0b75-4737-b37e-e65addab0618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:00.385287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6592466-0b75-4737-b37e-e65addab0618 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:00.386714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6592466-0b75-4737-b37e-e65addab0618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:00.387455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6592466-0b75-4737-b37e-e65addab0618 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:00.389029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6592466-0b75-4737-b37e-e65addab0618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:00.392264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6592466-0b75-4737-b37e-e65addab0618 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:00.431043 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 952/1908] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:00.436994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6592466-0b75-4737-b37e-e65addab0618 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:00.455365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6592466-0b75-4737-b37e-e65addab0618 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:00.460794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb5896-ad8d-4c1f-812f-b21636ed7336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:00.461480 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb5896-ad8d-4c1f-812f-b21636ed7336 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:00.461748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb5896-ad8d-4c1f-812f-b21636ed7336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:00.462110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb5896-ad8d-4c1f-812f-b21636ed7336 admin admin] PATH_INFO: `/v3/projects/dd15a198eb35462bb1ece74eaf657bfc/users/23a6fd6c8b6d45898ee26441d05a3018/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:00.485808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb5896-ad8d-4c1f-812f-b21636ed7336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd15a198eb35462bb1ece74eaf657bfc, user_id=23a6fd6c8b6d45898ee26441d05a3018, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:00.488874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb5896-ad8d-4c1f-812f-b21636ed7336 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:00.501122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-af7d4dc3-25e0-4c27-9488-da5a30e80c96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73cdf8b421e747f1824625a174368323'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:00.511853 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 953/1909] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:10:00 2022] PUT /identity/v3/projects/dd15a198eb35462bb1ece74eaf657bfc/users/23a6fd6c8b6d45898ee26441d05a3018/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:00.520961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-af7d4dc3-25e0-4c27-9488-da5a30e80c96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73cdf8b421e747f1824625a174368323'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:00.523823 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aab900-4d77-41ce-8c83-5776ae8e7e80 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:00.524164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aab900-4d77-41ce-8c83-5776ae8e7e80 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:00.524687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aab900-4d77-41ce-8c83-5776ae8e7e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:00.551455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-af7d4dc3-25e0-4c27-9488-da5a30e80c96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73cdf8b421e747f1824625a174368323'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:00.552836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-af7d4dc3-25e0-4c27-9488-da5a30e80c96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73cdf8b421e747f1824625a174368323'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:00.566713 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-af7d4dc3-25e0-4c27-9488-da5a30e80c96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73cdf8b421e747f1824625a174368323'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:00.570563 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e8aab900-4d77-41ce-8c83-5776ae8e7e80 None None] MFA Rules not processed for user `23a6fd6c8b6d45898ee26441d05a3018`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:00.572151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e8aab900-4d77-41ce-8c83-5776ae8e7e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:00.581145 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 957/1910] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:10:00 2022] DELETE /identity/v3/users/73cdf8b421e747f1824625a174368323 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:10:00.585846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a22f93-a831-459b-81a5-8f142c535770 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:00.586422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a22f93-a831-459b-81a5-8f142c535770 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:00.586754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a22f93-a831-459b-81a5-8f142c535770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:00.610084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-57a22f93-a831-459b-81a5-8f142c535770 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:00.611320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-57a22f93-a831-459b-81a5-8f142c535770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:00.634571 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:00.703969 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 954/1911] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:10:00.703969 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aab900-4d77-41ce-8c83-5776ae8e7e80 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:00.703969 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e8aab900-4d77-41ce-8c83-5776ae8e7e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:00.718273 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 958/1912] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:00.719471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a22f93-a831-459b-81a5-8f142c535770 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:00.721264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-57a22f93-a831-459b-81a5-8f142c535770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:00.737102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a22f93-a831-459b-81a5-8f142c535770 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:00.742315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474001ec-62c2-4ecf-90d6-f46280a6f9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:00.742952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474001ec-62c2-4ecf-90d6-f46280a6f9b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:00.743227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474001ec-62c2-4ecf-90d6-f46280a6f9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:00.743496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474001ec-62c2-4ecf-90d6-f46280a6f9b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:00.744173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474001ec-62c2-4ecf-90d6-f46280a6f9b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:00.746218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474001ec-62c2-4ecf-90d6-f46280a6f9b7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:00.752470 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:00.784723 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 959/1913] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:10:00 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:00.785679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474001ec-62c2-4ecf-90d6-f46280a6f9b7 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:00.788043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-474001ec-62c2-4ecf-90d6-f46280a6f9b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:00.811839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aab900-4d77-41ce-8c83-5776ae8e7e80 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:00.906917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474001ec-62c2-4ecf-90d6-f46280a6f9b7 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:00.916192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d307f-0e5f-4871-b1da-75de406a2138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:00.919185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d307f-0e5f-4871-b1da-75de406a2138 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:00.919705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d307f-0e5f-4871-b1da-75de406a2138 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:00.920337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d307f-0e5f-4871-b1da-75de406a2138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:00.921187 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf898b-e36d-484d-b02a-d62f96f05097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:00.922240 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf898b-e36d-484d-b02a-d62f96f05097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:00.923001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf898b-e36d-484d-b02a-d62f96f05097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:00.923391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf898b-e36d-484d-b02a-d62f96f05097 admin admin] PATH_INFO: `/v3/projects/08b6f347456346eeb80c9a1fe8f786f7` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:00.925272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf898b-e36d-484d-b02a-d62f96f05097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08b6f347456346eeb80c9a1fe8f786f7)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:00.928181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf898b-e36d-484d-b02a-d62f96f05097 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:00.944225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d307f-0e5f-4871-b1da-75de406a2138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:00.948284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d307f-0e5f-4871-b1da-75de406a2138 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:00.968908 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 960/1914] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:00.970086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d307f-0e5f-4871-b1da-75de406a2138 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:00.983839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d307f-0e5f-4871-b1da-75de406a2138 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:00.993712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298c5d0-cfa0-43df-94f7-c5d19fb6afb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:00.995246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298c5d0-cfa0-43df-94f7-c5d19fb6afb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:00.995637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298c5d0-cfa0-43df-94f7-c5d19fb6afb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:00.996396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298c5d0-cfa0-43df-94f7-c5d19fb6afb9 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:00.997422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298c5d0-cfa0-43df-94f7-c5d19fb6afb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:01.000389 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298c5d0-cfa0-43df-94f7-c5d19fb6afb9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:01.041042 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 961/1915] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:10:00 2022] POST /identity/v3/users => generated 293 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:01.044025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298c5d0-cfa0-43df-94f7-c5d19fb6afb9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:01.071841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1baf898b-e36d-484d-b02a-d62f96f05097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08b6f347456346eeb80c9a1fe8f786f7', 'request_id': 'req-1baf898b-e36d-484d-b02a-d62f96f05097'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:01.072315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298c5d0-cfa0-43df-94f7-c5d19fb6afb9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:01.091131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1baf898b-e36d-484d-b02a-d62f96f05097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08b6f347456346eeb80c9a1fe8f786f7', 'request_id': 'req-1baf898b-e36d-484d-b02a-d62f96f05097'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:01.133086 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1baf898b-e36d-484d-b02a-d62f96f05097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08b6f347456346eeb80c9a1fe8f786f7', 'request_id': 'req-1baf898b-e36d-484d-b02a-d62f96f05097'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:01.178941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1baf898b-e36d-484d-b02a-d62f96f05097 admin admin] The token cache is being invalidate because project 08b6f347456346eeb80c9a1fe8f786f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:10:01.179863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1baf898b-e36d-484d-b02a-d62f96f05097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:01.181407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1baf898b-e36d-484d-b02a-d62f96f05097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:01.186510 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 955/1916] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:10:00 2022] DELETE /identity/v3/projects/08b6f347456346eeb80c9a1fe8f786f7 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:01.195824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861d393-719e-4243-9392-7185f359658d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:01.196408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861d393-719e-4243-9392-7185f359658d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:01.196829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861d393-719e-4243-9392-7185f359658d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:01.260785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-5861d393-719e-4243-9392-7185f359658d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:01.262684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5861d393-719e-4243-9392-7185f359658d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:01.270974 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:01.281108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c697d-2c44-47cf-8a21-9e116c080aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:01.281746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c697d-2c44-47cf-8a21-9e116c080aad admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:01.282166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c697d-2c44-47cf-8a21-9e116c080aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:01.282529 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c697d-2c44-47cf-8a21-9e116c080aad admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:01.286607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c697d-2c44-47cf-8a21-9e116c080aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:01.289287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c697d-2c44-47cf-8a21-9e116c080aad admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:01.319644 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 962/1917] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:01.321271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c697d-2c44-47cf-8a21-9e116c080aad admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:01.324880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-911c697d-2c44-47cf-8a21-9e116c080aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:01.346281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c697d-2c44-47cf-8a21-9e116c080aad admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:01.351991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc5af4-e8e5-42b5-b6b4-014fbf7f51d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:01.352830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc5af4-e8e5-42b5-b6b4-014fbf7f51d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:01.353185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc5af4-e8e5-42b5-b6b4-014fbf7f51d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:01.353537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc5af4-e8e5-42b5-b6b4-014fbf7f51d1 admin admin] PATH_INFO: `/v3/projects/bcca9e43fb4a400097c745b6db514981/users/779b095655bf42f9be5d826798dfe76c/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:01.376137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc5af4-e8e5-42b5-b6b4-014fbf7f51d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcca9e43fb4a400097c745b6db514981, user_id=779b095655bf42f9be5d826798dfe76c, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:01.379493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc5af4-e8e5-42b5-b6b4-014fbf7f51d1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:01.413721 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 963/1918] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:10:01 2022] PUT /identity/v3/projects/bcca9e43fb4a400097c745b6db514981/users/779b095655bf42f9be5d826798dfe76c/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:01.415395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc5af4-e8e5-42b5-b6b4-014fbf7f51d1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:01.432724 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 956/1919] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:01.437633 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe29077-c7cf-4764-b952-e1c4c64595b0 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:01.439332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe29077-c7cf-4764-b952-e1c4c64595b0 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:01.439932 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe29077-c7cf-4764-b952-e1c4c64595b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:01.478138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2fe29077-c7cf-4764-b952-e1c4c64595b0 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:01.480577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2fe29077-c7cf-4764-b952-e1c4c64595b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:01.538425 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:01.585907 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc5af4-e8e5-42b5-b6b4-014fbf7f51d1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:01.609519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4c616-0d32-4d47-9ef5-520149a3a6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:01.610651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4c616-0d32-4d47-9ef5-520149a3a6cf admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:01.614879 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4c616-0d32-4d47-9ef5-520149a3a6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:01.615487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4c616-0d32-4d47-9ef5-520149a3a6cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:01.617039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4c616-0d32-4d47-9ef5-520149a3a6cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:01.619961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4c616-0d32-4d47-9ef5-520149a3a6cf admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:01.663828 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 964/1920] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:01.669310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4c616-0d32-4d47-9ef5-520149a3a6cf admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:01.700442 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 957/1921] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:01.701706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4c616-0d32-4d47-9ef5-520149a3a6cf admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:01.702822 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe29077-c7cf-4764-b952-e1c4c64595b0 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:01.717184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0088fb-8452-4ec2-a8f8-0649ed4ad022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:01.718403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0088fb-8452-4ec2-a8f8-0649ed4ad022 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:01.719096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0088fb-8452-4ec2-a8f8-0649ed4ad022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:01.719760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0088fb-8452-4ec2-a8f8-0649ed4ad022 admin admin] PATH_INFO: `/v3/projects/bcca9e43fb4a400097c745b6db514981/users/779b095655bf42f9be5d826798dfe76c/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:01.723381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe29077-c7cf-4764-b952-e1c4c64595b0 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:01.725418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0088fb-8452-4ec2-a8f8-0649ed4ad022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcca9e43fb4a400097c745b6db514981, user_id=779b095655bf42f9be5d826798dfe76c, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:01.731910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0088fb-8452-4ec2-a8f8-0649ed4ad022 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:01.735580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fb9a6-1f03-4d97-a2f4-0b762973b572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:01.736887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fb9a6-1f03-4d97-a2f4-0b762973b572 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:01.737378 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fb9a6-1f03-4d97-a2f4-0b762973b572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:01.737861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fb9a6-1f03-4d97-a2f4-0b762973b572 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:01.740119 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fb9a6-1f03-4d97-a2f4-0b762973b572 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:10:01.740914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fb9a6-1f03-4d97-a2f4-0b762973b572 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:01.745400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fb9a6-1f03-4d97-a2f4-0b762973b572 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:01.773924 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 958/1922] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:10:01.778025 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 965/1923] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:10:01 2022] PUT /identity/v3/projects/bcca9e43fb4a400097c745b6db514981/users/779b095655bf42f9be5d826798dfe76c/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:01.792069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fb9a6-1f03-4d97-a2f4-0b762973b572 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:01.803826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503b679-8d5c-45d6-b9f1-dac1d037182e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:01.804366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503b679-8d5c-45d6-b9f1-dac1d037182e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:01.804851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503b679-8d5c-45d6-b9f1-dac1d037182e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:01.813916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fb9a6-1f03-4d97-a2f4-0b762973b572 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:01.895957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d503b679-8d5c-45d6-b9f1-dac1d037182e None None] MFA Rules not processed for user `779b095655bf42f9be5d826798dfe76c`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:01.898823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d503b679-8d5c-45d6-b9f1-dac1d037182e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:01.931567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feccb072-b1dc-4d8c-b9ab-0fbce4549736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:01.933317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccb072-b1dc-4d8c-b9ab-0fbce4549736 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:01.934587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccb072-b1dc-4d8c-b9ab-0fbce4549736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:01.934587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccb072-b1dc-4d8c-b9ab-0fbce4549736 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:01.935945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feccb072-b1dc-4d8c-b9ab-0fbce4549736 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:01.939986 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feccb072-b1dc-4d8c-b9ab-0fbce4549736 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:01.985644 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 959/1924] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:10:01 2022] POST /identity/v3/projects => generated 371 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:01.985644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feccb072-b1dc-4d8c-b9ab-0fbce4549736 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:01.990372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-feccb072-b1dc-4d8c-b9ab-0fbce4549736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:02.011764 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 966/1925] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:10:02.014486 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503b679-8d5c-45d6-b9f1-dac1d037182e None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:02.029041 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:02.035702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503b679-8d5c-45d6-b9f1-dac1d037182e None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:02.120185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feccb072-b1dc-4d8c-b9ab-0fbce4549736 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:02.127941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1f03f-4bad-4ab9-a2d8-83729ac4a468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:02.130375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1f03f-4bad-4ab9-a2d8-83729ac4a468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:02.130375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1f03f-4bad-4ab9-a2d8-83729ac4a468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:02.130375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1f03f-4bad-4ab9-a2d8-83729ac4a468 admin admin] PATH_INFO: `/v3/projects/5b93d58fe82b4d6bb4d4865c492dbaad` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:02.132809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1f03f-4bad-4ab9-a2d8-83729ac4a468 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b93d58fe82b4d6bb4d4865c492dbaad)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:02.137215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1f03f-4bad-4ab9-a2d8-83729ac4a468 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:02.182456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafd3e6-6dc2-4fb8-a369-585cd4a4b5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:02.184037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafd3e6-6dc2-4fb8-a369-585cd4a4b5bf admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:02.184491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafd3e6-6dc2-4fb8-a369-585cd4a4b5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:02.184981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafd3e6-6dc2-4fb8-a369-585cd4a4b5bf admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:02.186194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fafd3e6-6dc2-4fb8-a369-585cd4a4b5bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:02.190499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fafd3e6-6dc2-4fb8-a369-585cd4a4b5bf admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:02.234630 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 967/1926] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:10:02 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:02.235425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-faa1f03f-4bad-4ab9-a2d8-83729ac4a468 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b93d58fe82b4d6bb4d4865c492dbaad', 'request_id': 'req-faa1f03f-4bad-4ab9-a2d8-83729ac4a468'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:02.235930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafd3e6-6dc2-4fb8-a369-585cd4a4b5bf admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:02.252478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-faa1f03f-4bad-4ab9-a2d8-83729ac4a468 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b93d58fe82b4d6bb4d4865c492dbaad', 'request_id': 'req-faa1f03f-4bad-4ab9-a2d8-83729ac4a468'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:02.273938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-faa1f03f-4bad-4ab9-a2d8-83729ac4a468 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b93d58fe82b4d6bb4d4865c492dbaad', 'request_id': 'req-faa1f03f-4bad-4ab9-a2d8-83729ac4a468'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:02.299928 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:02.307640 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-faa1f03f-4bad-4ab9-a2d8-83729ac4a468 admin admin] The token cache is being invalidate because project 5b93d58fe82b4d6bb4d4865c492dbaad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:10:02.308787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-faa1f03f-4bad-4ab9-a2d8-83729ac4a468 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:02.311199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-faa1f03f-4bad-4ab9-a2d8-83729ac4a468 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:02.316276 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 960/1927] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:10:01 2022] DELETE /identity/v3/projects/5b93d58fe82b4d6bb4d4865c492dbaad => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:02.319981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1f03f-4bad-4ab9-a2d8-83729ac4a468 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:02.323372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-faa1f03f-4bad-4ab9-a2d8-83729ac4a468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:02.343751 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafd3e6-6dc2-4fb8-a369-585cd4a4b5bf admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:02.474390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1f03f-4bad-4ab9-a2d8-83729ac4a468 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:02.488041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1b4cf-e4df-4414-b723-6a1d22d651d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:02.489107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1b4cf-e4df-4414-b723-6a1d22d651d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:02.490248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1b4cf-e4df-4414-b723-6a1d22d651d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:02.490695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1b4cf-e4df-4414-b723-6a1d22d651d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:02.492033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1b4cf-e4df-4414-b723-6a1d22d651d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:02.495966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1b4cf-e4df-4414-b723-6a1d22d651d4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:02.501490 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b850273-6dca-43a2-8b57-873d874caa36 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '779b095655bf42f9be5d826798dfe76c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcca9e43fb4a400097c745b6db514981', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:02.502555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b850273-6dca-43a2-8b57-873d874caa36 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:02.503049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b850273-6dca-43a2-8b57-873d874caa36 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:02.503938 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b850273-6dca-43a2-8b57-873d874caa36 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:02.505194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b850273-6dca-43a2-8b57-873d874caa36 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:10:02.509432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b850273-6dca-43a2-8b57-873d874caa36 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:02.511600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b850273-6dca-43a2-8b57-873d874caa36 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:02.528129 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 961/1928] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:02.530994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1b4cf-e4df-4414-b723-6a1d22d651d4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:02.534555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c4b1b4cf-e4df-4414-b723-6a1d22d651d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:02.542646 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 968/1929] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:10:02.544655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b850273-6dca-43a2-8b57-873d874caa36 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:02.546447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2b850273-6dca-43a2-8b57-873d874caa36 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:02.557720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1b4cf-e4df-4414-b723-6a1d22d651d4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:02.564048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b850273-6dca-43a2-8b57-873d874caa36 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:02.566129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7d8d9-2537-44f2-9948-c1a992d32711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:02.566939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7d8d9-2537-44f2-9948-c1a992d32711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:02.567367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7d8d9-2537-44f2-9948-c1a992d32711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:02.567643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7d8d9-2537-44f2-9948-c1a992d32711 admin admin] PATH_INFO: `/v3/users/6cda46689c0c4a0f85119c495598b78e` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:02.568990 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d7d8d9-2537-44f2-9948-c1a992d32711 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cda46689c0c4a0f85119c495598b78e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:02.571397 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d7d8d9-2537-44f2-9948-c1a992d32711 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:02.571925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae237b4-c3ad-4236-a701-8cc5d897101d tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '779b095655bf42f9be5d826798dfe76c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcca9e43fb4a400097c745b6db514981', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:02.573771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae237b4-c3ad-4236-a701-8cc5d897101d tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:02.574107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae237b4-c3ad-4236-a701-8cc5d897101d tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:02.574893 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae237b4-c3ad-4236-a701-8cc5d897101d tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:02.576698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae237b4-c3ad-4236-a701-8cc5d897101d tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:02.580425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae237b4-c3ad-4236-a701-8cc5d897101d tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:02.628779 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 969/1930] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:10:02 2022] POST /identity/v3/projects => generated 371 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:02.630665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae237b4-c3ad-4236-a701-8cc5d897101d tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:02.648785 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:02.655790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d6d7d8d9-2537-44f2-9948-c1a992d32711 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cda46689c0c4a0f85119c495598b78e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:02.667921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d6d7d8d9-2537-44f2-9948-c1a992d32711 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cda46689c0c4a0f85119c495598b78e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:02.689988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d6d7d8d9-2537-44f2-9948-c1a992d32711 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cda46689c0c4a0f85119c495598b78e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:02.691682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d6d7d8d9-2537-44f2-9948-c1a992d32711 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cda46689c0c4a0f85119c495598b78e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:02.705991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d6d7d8d9-2537-44f2-9948-c1a992d32711 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cda46689c0c4a0f85119c495598b78e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:02.721578 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 962/1931] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:10:02 2022] DELETE /identity/v3/users/6cda46689c0c4a0f85119c495598b78e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:02.727491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7d8d9-2537-44f2-9948-c1a992d32711 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:02.730094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d6d7d8d9-2537-44f2-9948-c1a992d32711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:02.752792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae237b4-c3ad-4236-a701-8cc5d897101d tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:02.861956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7d8d9-2537-44f2-9948-c1a992d32711 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:02.879404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9635c-dfcd-41f3-95b4-0415fe73657c tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '779b095655bf42f9be5d826798dfe76c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcca9e43fb4a400097c745b6db514981', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:02.881996 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9635c-dfcd-41f3-95b4-0415fe73657c tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:02.883044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9635c-dfcd-41f3-95b4-0415fe73657c tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:02.883856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9635c-dfcd-41f3-95b4-0415fe73657c tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:02.887603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649d84b-dc8a-443f-aa49-6fbd66b7235d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:02.888332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9635c-dfcd-41f3-95b4-0415fe73657c tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:10:02.889076 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9635c-dfcd-41f3-95b4-0415fe73657c tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:02.889425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649d84b-dc8a-443f-aa49-6fbd66b7235d admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:02.890233 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649d84b-dc8a-443f-aa49-6fbd66b7235d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:02.890943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649d84b-dc8a-443f-aa49-6fbd66b7235d admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:02.892369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649d84b-dc8a-443f-aa49-6fbd66b7235d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:02.895755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649d84b-dc8a-443f-aa49-6fbd66b7235d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:02.896561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9635c-dfcd-41f3-95b4-0415fe73657c tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:02.919795 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 970/1932] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:02.932237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649d84b-dc8a-443f-aa49-6fbd66b7235d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:02.933259 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 963/1933] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:10:02.935557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5649d84b-dc8a-443f-aa49-6fbd66b7235d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:02.957671 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:02.990904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649d84b-dc8a-443f-aa49-6fbd66b7235d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:02.997781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e2c7a-1682-4822-9861-442b32a1e2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:02.998661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e2c7a-1682-4822-9861-442b32a1e2cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:02.999131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e2c7a-1682-4822-9861-442b32a1e2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:02.999694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e2c7a-1682-4822-9861-442b32a1e2cc admin admin] PATH_INFO: `/v3/projects/ba9e7a1c1fe14f47b5a5acf2fe8893b5/users/0327f14a188e45fba98a58e5fd061248/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:03.031378 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e2c7a-1682-4822-9861-442b32a1e2cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba9e7a1c1fe14f47b5a5acf2fe8893b5, user_id=0327f14a188e45fba98a58e5fd061248, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:03.035673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7e2c7a-1682-4822-9861-442b32a1e2cc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:03.057541 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 971/1934] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:10:02 2022] PUT /identity/v3/projects/ba9e7a1c1fe14f47b5a5acf2fe8893b5/users/0327f14a188e45fba98a58e5fd061248/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:03.067516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df713907-2e2d-4706-bcdd-ba932a2e573a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:03.068539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df713907-2e2d-4706-bcdd-ba932a2e573a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:03.069537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df713907-2e2d-4706-bcdd-ba932a2e573a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:03.113828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-df713907-2e2d-4706-bcdd-ba932a2e573a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:03.116433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-df713907-2e2d-4706-bcdd-ba932a2e573a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:03.208118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e2c7a-1682-4822-9861-442b32a1e2cc admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:03.216091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ba7e2c7a-1682-4822-9861-442b32a1e2cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:03.264495 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 964/1935] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:03.280228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df713907-2e2d-4706-bcdd-ba932a2e573a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:03.282635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-df713907-2e2d-4706-bcdd-ba932a2e573a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:03.414840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e2c7a-1682-4822-9861-442b32a1e2cc admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:03.419490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df713907-2e2d-4706-bcdd-ba932a2e573a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:03.427067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4379b6-aeeb-4eee-be1f-6c37db08a8e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:03.428579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4379b6-aeeb-4eee-be1f-6c37db08a8e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:03.428834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4379b6-aeeb-4eee-be1f-6c37db08a8e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:03.429177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4379b6-aeeb-4eee-be1f-6c37db08a8e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:03.436116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f3b2d-c724-4eaa-950b-c6a42ea4ab3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:03.438549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f3b2d-c724-4eaa-950b-c6a42ea4ab3f service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:03.441894 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f3b2d-c724-4eaa-950b-c6a42ea4ab3f service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:03.442407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f3b2d-c724-4eaa-950b-c6a42ea4ab3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:03.452739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4379b6-aeeb-4eee-be1f-6c37db08a8e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:03.456323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4379b6-aeeb-4eee-be1f-6c37db08a8e6 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:03.465500 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:03.490828 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 965/1936] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:03.614021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f3b2d-c724-4eaa-950b-c6a42ea4ab3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:03.620180 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f3b2d-c724-4eaa-950b-c6a42ea4ab3f service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:03.662180 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 972/1937] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:03.717637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ae482-a3aa-48a8-bfb3-cfed6979075c None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:03.718044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ae482-a3aa-48a8-bfb3-cfed6979075c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:03.718424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ae482-a3aa-48a8-bfb3-cfed6979075c None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:03.719940 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 966/1938] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:10:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:10:03.730194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f3b2d-c724-4eaa-950b-c6a42ea4ab3f service nova] Authenticating service token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:10:03.752314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ae482-a3aa-48a8-bfb3-cfed6979075c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:03.755083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-987ae482-a3aa-48a8-bfb3-cfed6979075c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:03.774933 n-d-master-1 devstack@keystone.service[80492]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f3b2d-c724-4eaa-950b-c6a42ea4ab3f service nova] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Aug 07 01:10:03.780093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f3b2d-c724-4eaa-950b-c6a42ea4ab3f service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:03.804733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ae482-a3aa-48a8-bfb3-cfed6979075c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:03.827272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde4ae7-ed96-4601-aa38-9cd216f0ef7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:03.828001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde4ae7-ed96-4601-aa38-9cd216f0ef7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:03.828291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde4ae7-ed96-4601-aa38-9cd216f0ef7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:03.828565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde4ae7-ed96-4601-aa38-9cd216f0ef7f admin admin] PATH_INFO: `/v3/projects/9ba69402e23d4c3991d7686c204a8582` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:03.832130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde4ae7-ed96-4601-aa38-9cd216f0ef7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ba69402e23d4c3991d7686c204a8582)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:03.834339 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde4ae7-ed96-4601-aa38-9cd216f0ef7f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:03.863942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f3b2d-c724-4eaa-950b-c6a42ea4ab3f service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:03.884113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0bfc04-de2e-4310-86a0-636db52958b2 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '779b095655bf42f9be5d826798dfe76c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcca9e43fb4a400097c745b6db514981', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:03.884794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bfc04-de2e-4310-86a0-636db52958b2 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:03.885581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bfc04-de2e-4310-86a0-636db52958b2 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:03.885912 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bfc04-de2e-4310-86a0-636db52958b2 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] PATH_INFO: `/v3/projects/aebbd95a13394dc6b6b7585e5f3dbc20` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:03.890374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0bfc04-de2e-4310-86a0-636db52958b2 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: Authorizing `identity:get_project(project_id=aebbd95a13394dc6b6b7585e5f3dbc20)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:03.896447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0bfc04-de2e-4310-86a0-636db52958b2 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:03.901333 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 973/1939] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:10:03 2022] GET /identity/v3/projects/aebbd95a13394dc6b6b7585e5f3dbc20 => generated 371 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:10:03.908642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a021fb3-1a93-4916-8753-6f71c27b6339 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:03.909031 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a021fb3-1a93-4916-8753-6f71c27b6339 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:03.909323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a021fb3-1a93-4916-8753-6f71c27b6339 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:03.911025 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 974/1940] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 01:10:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:10:03.919713 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6a109-b107-46e9-8287-4697551d5935 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:03.920034 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6a109-b107-46e9-8287-4697551d5935 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:03.920314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6a109-b107-46e9-8287-4697551d5935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:03.957792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-cbb6a109-b107-46e9-8287-4697551d5935 None None] MFA Rules not processed for user `6c70d5a72d424db68de7c7b8257fe02c`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:03.959806 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-cbb6a109-b107-46e9-8287-4697551d5935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:03.980630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2fde4ae7-ed96-4601-aa38-9cd216f0ef7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ba69402e23d4c3991d7686c204a8582', 'request_id': 'req-2fde4ae7-ed96-4601-aa38-9cd216f0ef7f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:04.004278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2fde4ae7-ed96-4601-aa38-9cd216f0ef7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ba69402e23d4c3991d7686c204a8582', 'request_id': 'req-2fde4ae7-ed96-4601-aa38-9cd216f0ef7f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:04.004472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2fde4ae7-ed96-4601-aa38-9cd216f0ef7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ba69402e23d4c3991d7686c204a8582', 'request_id': 'req-2fde4ae7-ed96-4601-aa38-9cd216f0ef7f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:04.041992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2fde4ae7-ed96-4601-aa38-9cd216f0ef7f admin admin] The token cache is being invalidate because project 9ba69402e23d4c3991d7686c204a8582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:10:04.042446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2fde4ae7-ed96-4601-aa38-9cd216f0ef7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:04.044293 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2fde4ae7-ed96-4601-aa38-9cd216f0ef7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:04.049984 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 967/1941] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:10:03 2022] DELETE /identity/v3/projects/9ba69402e23d4c3991d7686c204a8582 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:10:04.060513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0427151-c2dd-4f7b-aef0-71da361747ec None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:04.060928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0427151-c2dd-4f7b-aef0-71da361747ec None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:04.061205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0427151-c2dd-4f7b-aef0-71da361747ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:04.111095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c0427151-c2dd-4f7b-aef0-71da361747ec None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:04.112681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c0427151-c2dd-4f7b-aef0-71da361747ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:04.148489 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:04.207979 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 968/1942] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:10:04.207979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d73a4-637d-4c34-b137-72ebe55459d3 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:04.207979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d73a4-637d-4c34-b137-72ebe55459d3 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:04.207979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d73a4-637d-4c34-b137-72ebe55459d3 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:04.209719 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 969/1943] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:10:04.210189 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 975/1944] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 01:10:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:10:04.219851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c4f89-a51c-4f2b-b129-cc04bf31e575 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:04.220257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c4f89-a51c-4f2b-b129-cc04bf31e575 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:04.220529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c4f89-a51c-4f2b-b129-cc04bf31e575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:04.224050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6a109-b107-46e9-8287-4697551d5935 None None] Authenticating service token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:10:04.232166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-cbb6a109-b107-46e9-8287-4697551d5935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:04.255710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ff6c4f89-a51c-4f2b-b129-cc04bf31e575 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:04.257072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ff6c4f89-a51c-4f2b-b129-cc04bf31e575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:04.274895 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6a109-b107-46e9-8287-4697551d5935 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:04.281811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-cbb6a109-b107-46e9-8287-4697551d5935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:04.287668 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 970/1945] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:04.294526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c4f89-a51c-4f2b-b129-cc04bf31e575 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:04.312381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c4f89-a51c-4f2b-b129-cc04bf31e575 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:04.324504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff271d-2695-408d-bd39-61c60fdb0049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:04.325679 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff271d-2695-408d-bd39-61c60fdb0049 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:04.326235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff271d-2695-408d-bd39-61c60fdb0049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:04.327150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff271d-2695-408d-bd39-61c60fdb0049 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:04.328439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff271d-2695-408d-bd39-61c60fdb0049 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:10:04.329055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff271d-2695-408d-bd39-61c60fdb0049 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:04.333129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff271d-2695-408d-bd39-61c60fdb0049 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:04.368961 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 971/1946] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:10:04.372684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff271d-2695-408d-bd39-61c60fdb0049 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:04.412975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff271d-2695-408d-bd39-61c60fdb0049 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:04.430876 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7344d5-ff64-4aec-a84b-55c2e4c452fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:04.432691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7344d5-ff64-4aec-a84b-55c2e4c452fe admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:04.433298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7344d5-ff64-4aec-a84b-55c2e4c452fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:04.433824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7344d5-ff64-4aec-a84b-55c2e4c452fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:04.434713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7344d5-ff64-4aec-a84b-55c2e4c452fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:04.438645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7344d5-ff64-4aec-a84b-55c2e4c452fe admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:04.501637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6a109-b107-46e9-8287-4697551d5935 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:04.519792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c0c59-b883-46f0-9b64-bfdd0748a478 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '779b095655bf42f9be5d826798dfe76c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcca9e43fb4a400097c745b6db514981', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:04.522284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c0c59-b883-46f0-9b64-bfdd0748a478 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:04.530324 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 972/1947] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:10:04 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:04.531511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c0c59-b883-46f0-9b64-bfdd0748a478 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:04.532075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c0c59-b883-46f0-9b64-bfdd0748a478 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] PATH_INFO: `/v3/projects/aebbd95a13394dc6b6b7585e5f3dbc20` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:04.536436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c0c59-b883-46f0-9b64-bfdd0748a478 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: Authorizing `identity:get_project(project_id=aebbd95a13394dc6b6b7585e5f3dbc20)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:04.541672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c0c59-b883-46f0-9b64-bfdd0748a478 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:04.542874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7344d5-ff64-4aec-a84b-55c2e4c452fe admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:04.560792 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 976/1948] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:10:04 2022] GET /identity/v3/projects/aebbd95a13394dc6b6b7585e5f3dbc20 => generated 371 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:10:04.661773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c0c59-b883-46f0-9b64-bfdd0748a478 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:04.679554 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:04.697525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c0c59-b883-46f0-9b64-bfdd0748a478 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:04.759951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7344d5-ff64-4aec-a84b-55c2e4c452fe admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:04.786909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f64bce-723e-4ef2-95ae-9ec12f02959b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:04.793095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f64bce-723e-4ef2-95ae-9ec12f02959b admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:04.793744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f64bce-723e-4ef2-95ae-9ec12f02959b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:04.794219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f64bce-723e-4ef2-95ae-9ec12f02959b admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:04.795428 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f64bce-723e-4ef2-95ae-9ec12f02959b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:04.803118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f64bce-723e-4ef2-95ae-9ec12f02959b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:04.847707 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 973/1949] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:10:04 2022] POST /identity/v3/users => generated 293 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:04.854148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f64bce-723e-4ef2-95ae-9ec12f02959b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:04.937843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12af66-4978-47e7-b222-6de5395de8ba tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '779b095655bf42f9be5d826798dfe76c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcca9e43fb4a400097c745b6db514981', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:04.939112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12af66-4978-47e7-b222-6de5395de8ba tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:04.939657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12af66-4978-47e7-b222-6de5395de8ba tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:04.941185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12af66-4978-47e7-b222-6de5395de8ba tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:04.942444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12af66-4978-47e7-b222-6de5395de8ba tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:10:04.942977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12af66-4978-47e7-b222-6de5395de8ba tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:04.947082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12af66-4978-47e7-b222-6de5395de8ba tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:04.990687 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 977/1950] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:10:04.993143 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12af66-4978-47e7-b222-6de5395de8ba tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:05.018203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12af66-4978-47e7-b222-6de5395de8ba tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:05.037634 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359802d-4a0e-4ee8-9161-c1794e76d3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:05.038777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359802d-4a0e-4ee8-9161-c1794e76d3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:05.039850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359802d-4a0e-4ee8-9161-c1794e76d3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:05.040449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359802d-4a0e-4ee8-9161-c1794e76d3f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:05.041676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1359802d-4a0e-4ee8-9161-c1794e76d3f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:05.044775 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1359802d-4a0e-4ee8-9161-c1794e76d3f5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:05.082419 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 978/1951] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:05.082419 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359802d-4a0e-4ee8-9161-c1794e76d3f5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:05.092035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f64bce-723e-4ef2-95ae-9ec12f02959b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:05.103093 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05dca12-52b6-4993-a68d-bd6837e8de57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:05.104406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dca12-52b6-4993-a68d-bd6837e8de57 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:05.105212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dca12-52b6-4993-a68d-bd6837e8de57 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:05.105817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dca12-52b6-4993-a68d-bd6837e8de57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:05.106845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1359802d-4a0e-4ee8-9161-c1794e76d3f5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:05.115958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ded73-a0c8-4a74-a8ea-85404bc5535a tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '779b095655bf42f9be5d826798dfe76c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcca9e43fb4a400097c745b6db514981', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:05.116958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ded73-a0c8-4a74-a8ea-85404bc5535a tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:05.117505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ded73-a0c8-4a74-a8ea-85404bc5535a tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:05.118215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ded73-a0c8-4a74-a8ea-85404bc5535a tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:05.120036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ded73-a0c8-4a74-a8ea-85404bc5535a tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:05.125558 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ded73-a0c8-4a74-a8ea-85404bc5535a tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:05.126418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05dca12-52b6-4993-a68d-bd6837e8de57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:05.129504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05dca12-52b6-4993-a68d-bd6837e8de57 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:05.157087 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 974/1952] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:05.158784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05dca12-52b6-4993-a68d-bd6837e8de57 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:05.178769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05dca12-52b6-4993-a68d-bd6837e8de57 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:05.196758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6942f-b486-4a6b-8bec-9b5fbc1c223b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:05.196758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6942f-b486-4a6b-8bec-9b5fbc1c223b admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:05.196758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6942f-b486-4a6b-8bec-9b5fbc1c223b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:05.196758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6942f-b486-4a6b-8bec-9b5fbc1c223b admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:05.198562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef6942f-b486-4a6b-8bec-9b5fbc1c223b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:05.199293 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 979/1953] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:10:05 2022] POST /identity/v3/users => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:05.202717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef6942f-b486-4a6b-8bec-9b5fbc1c223b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:05.203412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ded73-a0c8-4a74-a8ea-85404bc5535a tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:05.226717 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 975/1954] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:05.229468 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ded73-a0c8-4a74-a8ea-85404bc5535a tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:05.235330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6942f-b486-4a6b-8bec-9b5fbc1c223b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:05.240510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fd82c-2589-4698-97ce-631bb3ce7cfb tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '779b095655bf42f9be5d826798dfe76c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcca9e43fb4a400097c745b6db514981', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:05.243776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fd82c-2589-4698-97ce-631bb3ce7cfb tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:05.244919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fd82c-2589-4698-97ce-631bb3ce7cfb tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:05.247122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fd82c-2589-4698-97ce-631bb3ce7cfb tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:05.249240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fd82c-2589-4698-97ce-631bb3ce7cfb tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:10:05.255957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fd82c-2589-4698-97ce-631bb3ce7cfb tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:05.262791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fd82c-2589-4698-97ce-631bb3ce7cfb tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:05.264120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6942f-b486-4a6b-8bec-9b5fbc1c223b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:05.279326 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd901558-2036-4f80-a314-8d229801339b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:05.280390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd901558-2036-4f80-a314-8d229801339b admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:05.281241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd901558-2036-4f80-a314-8d229801339b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:05.281963 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd901558-2036-4f80-a314-8d229801339b admin admin] PATH_INFO: `/v3/projects/4c4d9f510efa4929ac1f4105f6b937f1/users/77fb2af9a47b43a1b41860dbf147d25e/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:05.309067 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 980/1955] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:10:05.338878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd901558-2036-4f80-a314-8d229801339b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c4d9f510efa4929ac1f4105f6b937f1, user_id=77fb2af9a47b43a1b41860dbf147d25e, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:05.344121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd901558-2036-4f80-a314-8d229801339b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:05.372506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419e546-5f0d-4221-b0b6-5f5fa453ed28 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:05.372775 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 976/1956] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:10:05 2022] PUT /identity/v3/projects/4c4d9f510efa4929ac1f4105f6b937f1/users/77fb2af9a47b43a1b41860dbf147d25e/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:05.374519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419e546-5f0d-4221-b0b6-5f5fa453ed28 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:05.375043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419e546-5f0d-4221-b0b6-5f5fa453ed28 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:05.377022 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 981/1957] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:10:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:10:05.394025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae041f-c3b1-4343-9d44-fd302d1e55f1 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:05.394332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae041f-c3b1-4343-9d44-fd302d1e55f1 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:05.394607 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd901558-2036-4f80-a314-8d229801339b admin admin] Authenticating service token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:10:05.394764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae041f-c3b1-4343-9d44-fd302d1e55f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:05.476402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-56ae041f-c3b1-4343-9d44-fd302d1e55f1 None None] MFA Rules not processed for user `77fb2af9a47b43a1b41860dbf147d25e`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:05.479732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-56ae041f-c3b1-4343-9d44-fd302d1e55f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:05.562365 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:05.589927 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd901558-2036-4f80-a314-8d229801339b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:05.624969 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:05.660418 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 982/1958] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:10:05.666523 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae041f-c3b1-4343-9d44-fd302d1e55f1 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:05.771392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd901558-2036-4f80-a314-8d229801339b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:05.786485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734eacb-4908-4dc0-a962-1459ccf09dc7 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '779b095655bf42f9be5d826798dfe76c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcca9e43fb4a400097c745b6db514981', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:05.787307 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734eacb-4908-4dc0-a962-1459ccf09dc7 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:05.788042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734eacb-4908-4dc0-a962-1459ccf09dc7 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:05.788527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734eacb-4908-4dc0-a962-1459ccf09dc7 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] PATH_INFO: `/v3/projects/aebbd95a13394dc6b6b7585e5f3dbc20` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:05.790869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734eacb-4908-4dc0-a962-1459ccf09dc7 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: Authorizing `identity:get_project(project_id=aebbd95a13394dc6b6b7585e5f3dbc20)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:05.796570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734eacb-4908-4dc0-a962-1459ccf09dc7 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:05.800852 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 977/1959] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:10:05 2022] GET /identity/v3/projects/aebbd95a13394dc6b6b7585e5f3dbc20 => generated 371 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:10:05.849298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae041f-c3b1-4343-9d44-fd302d1e55f1 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:05.869639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7a869-6e1f-4280-9bfc-a74d709bbfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:05.870479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7a869-6e1f-4280-9bfc-a74d709bbfbf admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:05.870793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7a869-6e1f-4280-9bfc-a74d709bbfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:05.871063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7a869-6e1f-4280-9bfc-a74d709bbfbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:05.871933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7a869-6e1f-4280-9bfc-a74d709bbfbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:05.878091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7a869-6e1f-4280-9bfc-a74d709bbfbf admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:05.964511 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 983/1960] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:10:05 2022] POST /identity/v3/projects => generated 385 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:05.974422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734eacb-4908-4dc0-a962-1459ccf09dc7 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:06.009351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734eacb-4908-4dc0-a962-1459ccf09dc7 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:06.217288 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2de10-4f92-412f-a0c8-13c1a39644f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:06.218755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2de10-4f92-412f-a0c8-13c1a39644f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:06.219576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2de10-4f92-412f-a0c8-13c1a39644f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:06.221934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2de10-4f92-412f-a0c8-13c1a39644f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:06.222912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be2de10-4f92-412f-a0c8-13c1a39644f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:06.225343 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be2de10-4f92-412f-a0c8-13c1a39644f9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:06.263653 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 978/1961] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:10:05 2022] POST /identity/v3/users => generated 299 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:06.270937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7a869-6e1f-4280-9bfc-a74d709bbfbf admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:06.296667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7a869-6e1f-4280-9bfc-a74d709bbfbf admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:06.313795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ca60b-d748-4937-8298-eedaac0bd6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:06.315499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ca60b-d748-4937-8298-eedaac0bd6de admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:06.316124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ca60b-d748-4937-8298-eedaac0bd6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:06.316774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ca60b-d748-4937-8298-eedaac0bd6de admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:06.318421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4ca60b-d748-4937-8298-eedaac0bd6de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:06.323757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4ca60b-d748-4937-8298-eedaac0bd6de admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:06.360114 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 984/1962] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:10:06.364041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2de10-4f92-412f-a0c8-13c1a39644f9 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:06.404651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2de10-4f92-412f-a0c8-13c1a39644f9 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:06.419246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbec7b9-a0a9-463c-9f9e-21225e372f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:06.420549 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbec7b9-a0a9-463c-9f9e-21225e372f3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:06.421104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbec7b9-a0a9-463c-9f9e-21225e372f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:06.421596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbec7b9-a0a9-463c-9f9e-21225e372f3c admin admin] PATH_INFO: `/v3/projects/a39a507590a34feaad53669540204a94/users/2241cd0e6a484cc0b3fa051852a254b2/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:06.437878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10d75c-7b17-41d6-95d9-85ee61f4ecfd None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:06.438831 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10d75c-7b17-41d6-95d9-85ee61f4ecfd None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:06.439604 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10d75c-7b17-41d6-95d9-85ee61f4ecfd None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:06.443838 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 985/1963] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:10:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:10:06.453687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10d75c-7b17-41d6-95d9-85ee61f4ecfd None None] Authenticating service token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:10:06.479258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbec7b9-a0a9-463c-9f9e-21225e372f3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a39a507590a34feaad53669540204a94, user_id=2241cd0e6a484cc0b3fa051852a254b2, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:06.487807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbec7b9-a0a9-463c-9f9e-21225e372f3c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:06.531028 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 979/1964] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:10:06 2022] PUT /identity/v3/projects/a39a507590a34feaad53669540204a94/users/2241cd0e6a484cc0b3fa051852a254b2/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:06.537128 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbec7b9-a0a9-463c-9f9e-21225e372f3c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:06.642164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10d75c-7b17-41d6-95d9-85ee61f4ecfd None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:06.726814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbec7b9-a0a9-463c-9f9e-21225e372f3c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:06.739160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae253d3-42c7-47f3-b734-a8b7e57079a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:06.739536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae253d3-42c7-47f3-b734-a8b7e57079a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:06.739831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae253d3-42c7-47f3-b734-a8b7e57079a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:06.740710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae253d3-42c7-47f3-b734-a8b7e57079a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:06.741448 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae253d3-42c7-47f3-b734-a8b7e57079a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:06.743859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae253d3-42c7-47f3-b734-a8b7e57079a7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:06.765939 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 980/1965] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:06.768279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae253d3-42c7-47f3-b734-a8b7e57079a7 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:06.784299 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:06.793727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae253d3-42c7-47f3-b734-a8b7e57079a7 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:06.809471 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b7459-2bd3-42c6-923b-a04e9f677770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:06.810777 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b7459-2bd3-42c6-923b-a04e9f677770 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:06.811601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b7459-2bd3-42c6-923b-a04e9f677770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:06.811995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b7459-2bd3-42c6-923b-a04e9f677770 admin admin] PATH_INFO: `/v3/projects/a39a507590a34feaad53669540204a94/users/2241cd0e6a484cc0b3fa051852a254b2/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:06.817507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b7459-2bd3-42c6-923b-a04e9f677770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a39a507590a34feaad53669540204a94, user_id=2241cd0e6a484cc0b3fa051852a254b2, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:06.825456 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b7459-2bd3-42c6-923b-a04e9f677770 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:06.830444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10d75c-7b17-41d6-95d9-85ee61f4ecfd None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:06.852725 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 981/1966] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:10:06 2022] PUT /identity/v3/projects/a39a507590a34feaad53669540204a94/users/2241cd0e6a484cc0b3fa051852a254b2/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:06.880753 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429c901-d53f-48eb-80a9-5efbc433e4f7 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:06.882739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429c901-d53f-48eb-80a9-5efbc433e4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:06.884329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429c901-d53f-48eb-80a9-5efbc433e4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:06.919306 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:07.028360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3429c901-d53f-48eb-80a9-5efbc433e4f7 None None] MFA Rules not processed for user `2241cd0e6a484cc0b3fa051852a254b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:07.031415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3429c901-d53f-48eb-80a9-5efbc433e4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:07.044362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046935d-fd8a-4c52-8783-9447ba908e37 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '779b095655bf42f9be5d826798dfe76c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcca9e43fb4a400097c745b6db514981', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:07.045621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046935d-fd8a-4c52-8783-9447ba908e37 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:07.046142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046935d-fd8a-4c52-8783-9447ba908e37 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:07.046560 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046935d-fd8a-4c52-8783-9447ba908e37 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] PATH_INFO: `/v3/projects/aebbd95a13394dc6b6b7585e5f3dbc20` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:07.048130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f046935d-fd8a-4c52-8783-9447ba908e37 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: Authorizing `identity:get_project(project_id=aebbd95a13394dc6b6b7585e5f3dbc20)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:07.051334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f046935d-fd8a-4c52-8783-9447ba908e37 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:07.054157 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 986/1967] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:10:06 2022] GET /identity/v3/projects/aebbd95a13394dc6b6b7585e5f3dbc20 => generated 371 bytes in 601 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:10:07.106917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046935d-fd8a-4c52-8783-9447ba908e37 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:07.125317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046935d-fd8a-4c52-8783-9447ba908e37 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:07.277306 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 982/1968] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:06 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:07.397599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0e7b8-0781-4b19-913c-a535f02dfe46 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '779b095655bf42f9be5d826798dfe76c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcca9e43fb4a400097c745b6db514981', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:07.398415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0e7b8-0781-4b19-913c-a535f02dfe46 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:07.398790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0e7b8-0781-4b19-913c-a535f02dfe46 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:07.399285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0e7b8-0781-4b19-913c-a535f02dfe46 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] PATH_INFO: `/v3/users/bf43921711e143768552e82fc078435c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:07.456817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0e7b8-0781-4b19-913c-a535f02dfe46 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bf43921711e143768552e82fc078435c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:07.468386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0e7b8-0781-4b19-913c-a535f02dfe46 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:07.638081 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a4e0e7b8-0781-4b19-913c-a535f02dfe46 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf43921711e143768552e82fc078435c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:07.691212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a4e0e7b8-0781-4b19-913c-a535f02dfe46 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf43921711e143768552e82fc078435c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:07.743597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a4e0e7b8-0781-4b19-913c-a535f02dfe46 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf43921711e143768552e82fc078435c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:07.747167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a4e0e7b8-0781-4b19-913c-a535f02dfe46 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf43921711e143768552e82fc078435c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:07.767714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a4e0e7b8-0781-4b19-913c-a535f02dfe46 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf43921711e143768552e82fc078435c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:07.802885 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 987/1969] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:10:07 2022] DELETE /identity/v3/users/bf43921711e143768552e82fc078435c => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:10:07.809323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429c901-d53f-48eb-80a9-5efbc433e4f7 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:07.830003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429c901-d53f-48eb-80a9-5efbc433e4f7 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:08.088396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6a9b6-3f1c-4435-9963-ad2cdb3e9267 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '779b095655bf42f9be5d826798dfe76c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bcca9e43fb4a400097c745b6db514981', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:08.093482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6a9b6-3f1c-4435-9963-ad2cdb3e9267 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:08.094214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6a9b6-3f1c-4435-9963-ad2cdb3e9267 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:08.094690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6a9b6-3f1c-4435-9963-ad2cdb3e9267 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] PATH_INFO: `/v3/projects/aebbd95a13394dc6b6b7585e5f3dbc20` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:08.101575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6a9b6-3f1c-4435-9963-ad2cdb3e9267 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: Authorizing `identity:delete_project(project_id=aebbd95a13394dc6b6b7585e5f3dbc20)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:08.114487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6a9b6-3f1c-4435-9963-ad2cdb3e9267 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:08.238015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0ad6a9b6-3f1c-4435-9963-ad2cdb3e9267 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aebbd95a13394dc6b6b7585e5f3dbc20', 'request_id': 'req-0ad6a9b6-3f1c-4435-9963-ad2cdb3e9267'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:08.249954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0ad6a9b6-3f1c-4435-9963-ad2cdb3e9267 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aebbd95a13394dc6b6b7585e5f3dbc20', 'request_id': 'req-0ad6a9b6-3f1c-4435-9963-ad2cdb3e9267'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:08.263835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0ad6a9b6-3f1c-4435-9963-ad2cdb3e9267 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aebbd95a13394dc6b6b7585e5f3dbc20', 'request_id': 'req-0ad6a9b6-3f1c-4435-9963-ad2cdb3e9267'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:08.300505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0ad6a9b6-3f1c-4435-9963-ad2cdb3e9267 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] The token cache is being invalidate because project aebbd95a13394dc6b6b7585e5f3dbc20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:10:08.302847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0ad6a9b6-3f1c-4435-9963-ad2cdb3e9267 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:08.304130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0ad6a9b6-3f1c-4435-9963-ad2cdb3e9267 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:08.309127 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 983/1970] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:10:07 2022] DELETE /identity/v3/projects/aebbd95a13394dc6b6b7585e5f3dbc20 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:08.319579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0e7b8-0781-4b19-913c-a535f02dfe46 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:08.322090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a4e0e7b8-0781-4b19-913c-a535f02dfe46 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:08.331500 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:08.387039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6a9b6-3f1c-4435-9963-ad2cdb3e9267 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:08.390726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0ad6a9b6-3f1c-4435-9963-ad2cdb3e9267 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:08.523032 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:08.629372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0e7b8-0781-4b19-913c-a535f02dfe46 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:08.693635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6a9b6-3f1c-4435-9963-ad2cdb3e9267 tempest-QuotasAdminTestV236-675111525 tempest-QuotasAdminTestV236-675111525-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:08.709651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08037613-0aba-43b5-98c6-976c6e53fa0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:08.711304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08037613-0aba-43b5-98c6-976c6e53fa0e service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:08.712141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08037613-0aba-43b5-98c6-976c6e53fa0e service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:08.712631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08037613-0aba-43b5-98c6-976c6e53fa0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:08.719023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-08037613-0aba-43b5-98c6-976c6e53fa0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:08.777855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3789e-b5b0-4c94-98e2-8e4232e10b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:08.779002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3789e-b5b0-4c94-98e2-8e4232e10b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:08.779481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3789e-b5b0-4c94-98e2-8e4232e10b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:08.780007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3789e-b5b0-4c94-98e2-8e4232e10b40 admin admin] PATH_INFO: `/v3/users/23a6fd6c8b6d45898ee26441d05a3018` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:08.782563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3789e-b5b0-4c94-98e2-8e4232e10b40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23a6fd6c8b6d45898ee26441d05a3018)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:08.786695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3789e-b5b0-4c94-98e2-8e4232e10b40 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:08.883923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08037613-0aba-43b5-98c6-976c6e53fa0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:08.888901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08037613-0aba-43b5-98c6-976c6e53fa0e service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:08.894174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3ca3789e-b5b0-4c94-98e2-8e4232e10b40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23a6fd6c8b6d45898ee26441d05a3018'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:08.911396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3ca3789e-b5b0-4c94-98e2-8e4232e10b40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23a6fd6c8b6d45898ee26441d05a3018'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:08.913395 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 984/1971] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:08.938725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3ca3789e-b5b0-4c94-98e2-8e4232e10b40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23a6fd6c8b6d45898ee26441d05a3018'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:08.940575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3ca3789e-b5b0-4c94-98e2-8e4232e10b40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23a6fd6c8b6d45898ee26441d05a3018'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:08.959545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3ca3789e-b5b0-4c94-98e2-8e4232e10b40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23a6fd6c8b6d45898ee26441d05a3018'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:08.973486 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 988/1972] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:10:08 2022] DELETE /identity/v3/users/23a6fd6c8b6d45898ee26441d05a3018 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:08.981758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cae30-259e-4568-bdd9-d7f0dc0b654f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:08.982518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cae30-259e-4568-bdd9-d7f0dc0b654f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:08.983265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cae30-259e-4568-bdd9-d7f0dc0b654f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:09.031335 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-540cae30-259e-4568-bdd9-d7f0dc0b654f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:09.033746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-540cae30-259e-4568-bdd9-d7f0dc0b654f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:09.234029 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 985/1973] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:09.246781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3789e-b5b0-4c94-98e2-8e4232e10b40 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:09.248593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3ca3789e-b5b0-4c94-98e2-8e4232e10b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:09.328575 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:09.397180 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3789e-b5b0-4c94-98e2-8e4232e10b40 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:09.403624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70fe1c-4fa0-4408-a91b-32f7dfa482a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:09.404307 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70fe1c-4fa0-4408-a91b-32f7dfa482a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:09.404690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70fe1c-4fa0-4408-a91b-32f7dfa482a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:09.405020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70fe1c-4fa0-4408-a91b-32f7dfa482a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:09.418775 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70fe1c-4fa0-4408-a91b-32f7dfa482a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:09.420918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70fe1c-4fa0-4408-a91b-32f7dfa482a2 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:09.439280 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 989/1974] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:10:10.514858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cae30-259e-4568-bdd9-d7f0dc0b654f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:10.517518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-540cae30-259e-4568-bdd9-d7f0dc0b654f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:10.589531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70fe1c-4fa0-4408-a91b-32f7dfa482a2 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:10.591259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6c70fe1c-4fa0-4408-a91b-32f7dfa482a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:10.661110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70fe1c-4fa0-4408-a91b-32f7dfa482a2 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:10.686952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401338d-89c0-4221-a5ad-831d28300bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:10.691932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401338d-89c0-4221-a5ad-831d28300bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:10.692792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401338d-89c0-4221-a5ad-831d28300bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:10.693504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c401338d-89c0-4221-a5ad-831d28300bd1 admin admin] PATH_INFO: `/v3/projects/dd15a198eb35462bb1ece74eaf657bfc` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:10.702597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c401338d-89c0-4221-a5ad-831d28300bd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd15a198eb35462bb1ece74eaf657bfc)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:10.714992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c401338d-89c0-4221-a5ad-831d28300bd1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:10.754490 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:10.820587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cae30-259e-4568-bdd9-d7f0dc0b654f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:10.892338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c401338d-89c0-4221-a5ad-831d28300bd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd15a198eb35462bb1ece74eaf657bfc', 'request_id': 'req-c401338d-89c0-4221-a5ad-831d28300bd1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:10.912146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c401338d-89c0-4221-a5ad-831d28300bd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd15a198eb35462bb1ece74eaf657bfc', 'request_id': 'req-c401338d-89c0-4221-a5ad-831d28300bd1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:10.926208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c401338d-89c0-4221-a5ad-831d28300bd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd15a198eb35462bb1ece74eaf657bfc', 'request_id': 'req-c401338d-89c0-4221-a5ad-831d28300bd1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:10.966588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c401338d-89c0-4221-a5ad-831d28300bd1 admin admin] The token cache is being invalidate because project dd15a198eb35462bb1ece74eaf657bfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:10:10.969059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c401338d-89c0-4221-a5ad-831d28300bd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:10.970721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c401338d-89c0-4221-a5ad-831d28300bd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:10.983987 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 990/1975] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:10:10 2022] DELETE /identity/v3/projects/dd15a198eb35462bb1ece74eaf657bfc => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:10.987246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401338d-89c0-4221-a5ad-831d28300bd1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:10.990797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c401338d-89c0-4221-a5ad-831d28300bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:11.031975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef71ed0-ec2e-425f-a9b8-58b0ecb481d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:11.034108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef71ed0-ec2e-425f-a9b8-58b0ecb481d3 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:11.034823 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef71ed0-ec2e-425f-a9b8-58b0ecb481d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:11.035486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef71ed0-ec2e-425f-a9b8-58b0ecb481d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:11.040331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0ef71ed0-ec2e-425f-a9b8-58b0ecb481d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:11.162305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c401338d-89c0-4221-a5ad-831d28300bd1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:11.173045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff529b-abd1-47af-ace7-d82d2a1ff4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:11.174101 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff529b-abd1-47af-ace7-d82d2a1ff4ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:11.174556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff529b-abd1-47af-ace7-d82d2a1ff4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:11.175006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff529b-abd1-47af-ace7-d82d2a1ff4ca admin admin] PATH_INFO: `/v3/users/77fb2af9a47b43a1b41860dbf147d25e` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:11.177402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff529b-abd1-47af-ace7-d82d2a1ff4ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=77fb2af9a47b43a1b41860dbf147d25e)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:11.181869 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff529b-abd1-47af-ace7-d82d2a1ff4ca admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:11.198963 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef71ed0-ec2e-425f-a9b8-58b0ecb481d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:11.201398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef71ed0-ec2e-425f-a9b8-58b0ecb481d3 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:11.219266 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 986/1976] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:10 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 706 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:11.221373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef71ed0-ec2e-425f-a9b8-58b0ecb481d3 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:11.224097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0ef71ed0-ec2e-425f-a9b8-58b0ecb481d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:11.258177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef71ed0-ec2e-425f-a9b8-58b0ecb481d3 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:11.291840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1eb41-4aae-492c-9401-286606e4590b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:11.293111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1eb41-4aae-492c-9401-286606e4590b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:11.293871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1eb41-4aae-492c-9401-286606e4590b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:11.294562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1eb41-4aae-492c-9401-286606e4590b admin admin] PATH_INFO: `/v3/users/779b095655bf42f9be5d826798dfe76c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:11.298137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1eb41-4aae-492c-9401-286606e4590b admin admin] RBAC: Authorizing `identity:delete_user(user_id=779b095655bf42f9be5d826798dfe76c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:11.303931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1eb41-4aae-492c-9401-286606e4590b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:11.338117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-82ff529b-abd1-47af-ace7-d82d2a1ff4ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77fb2af9a47b43a1b41860dbf147d25e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:11.355018 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-82ff529b-abd1-47af-ace7-d82d2a1ff4ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77fb2af9a47b43a1b41860dbf147d25e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:11.357925 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:11.399212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-82ff529b-abd1-47af-ace7-d82d2a1ff4ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77fb2af9a47b43a1b41860dbf147d25e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:11.403451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-82ff529b-abd1-47af-ace7-d82d2a1ff4ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77fb2af9a47b43a1b41860dbf147d25e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:11.421810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dfb1eb41-4aae-492c-9401-286606e4590b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '779b095655bf42f9be5d826798dfe76c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:11.426450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-82ff529b-abd1-47af-ace7-d82d2a1ff4ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77fb2af9a47b43a1b41860dbf147d25e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:11.451595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dfb1eb41-4aae-492c-9401-286606e4590b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '779b095655bf42f9be5d826798dfe76c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:11.459408 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 991/1977] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:10:10 2022] DELETE /identity/v3/users/77fb2af9a47b43a1b41860dbf147d25e => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:11.461883 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed756da-24df-4120-9ac3-6177a952a78f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:11.462491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed756da-24df-4120-9ac3-6177a952a78f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:11.463180 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed756da-24df-4120-9ac3-6177a952a78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:11.484656 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dfb1eb41-4aae-492c-9401-286606e4590b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '779b095655bf42f9be5d826798dfe76c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:11.489932 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dfb1eb41-4aae-492c-9401-286606e4590b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '779b095655bf42f9be5d826798dfe76c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:11.500232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-aed756da-24df-4120-9ac3-6177a952a78f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:11.500777 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:11.502695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-aed756da-24df-4120-9ac3-6177a952a78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:11.518920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dfb1eb41-4aae-492c-9401-286606e4590b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '779b095655bf42f9be5d826798dfe76c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:11.563446 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 987/1978] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:10:11 2022] DELETE /identity/v3/users/779b095655bf42f9be5d826798dfe76c => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:11.791833 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 992/1979] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:11.833162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1eb41-4aae-492c-9401-286606e4590b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:11.836732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-dfb1eb41-4aae-492c-9401-286606e4590b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:12.077999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1eb41-4aae-492c-9401-286606e4590b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:12.099933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd721f-5b5e-49e4-9149-beb600bde07b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:12.102221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd721f-5b5e-49e4-9149-beb600bde07b service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:12.106289 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd721f-5b5e-49e4-9149-beb600bde07b service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:12.108066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd721f-5b5e-49e4-9149-beb600bde07b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:12.266825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd721f-5b5e-49e4-9149-beb600bde07b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:12.269858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd721f-5b5e-49e4-9149-beb600bde07b service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:12.291266 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 988/1980] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:12.481303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed756da-24df-4120-9ac3-6177a952a78f None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:12.483169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-aed756da-24df-4120-9ac3-6177a952a78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:12.779085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed756da-24df-4120-9ac3-6177a952a78f None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:13.059391 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d461a0-dffa-463f-9a02-a3030b3acfde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:13.061831 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d461a0-dffa-463f-9a02-a3030b3acfde service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:13.062710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d461a0-dffa-463f-9a02-a3030b3acfde service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:13.063509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d461a0-dffa-463f-9a02-a3030b3acfde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:13.067043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e8d461a0-dffa-463f-9a02-a3030b3acfde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:13.086805 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:13.310050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d461a0-dffa-463f-9a02-a3030b3acfde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:13.313623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d461a0-dffa-463f-9a02-a3030b3acfde service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:13.350772 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 993/1981] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 870 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:10:13.663305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd721f-5b5e-49e4-9149-beb600bde07b service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:13.667586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1ecd721f-5b5e-49e4-9149-beb600bde07b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:13.735803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd721f-5b5e-49e4-9149-beb600bde07b service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:13.761085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe3e23-d683-4958-8465-fa1ab15abed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:13.762812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe3e23-d683-4958-8465-fa1ab15abed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:13.763545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe3e23-d683-4958-8465-fa1ab15abed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:13.764217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe3e23-d683-4958-8465-fa1ab15abed4 admin admin] PATH_INFO: `/v3/projects/4c4d9f510efa4929ac1f4105f6b937f1` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:13.779339 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe3e23-d683-4958-8465-fa1ab15abed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c4d9f510efa4929ac1f4105f6b937f1)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:13.783272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe3e23-d683-4958-8465-fa1ab15abed4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:13.994598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-68fe3e23-d683-4958-8465-fa1ab15abed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c4d9f510efa4929ac1f4105f6b937f1', 'request_id': 'req-68fe3e23-d683-4958-8465-fa1ab15abed4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:14.025690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-68fe3e23-d683-4958-8465-fa1ab15abed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c4d9f510efa4929ac1f4105f6b937f1', 'request_id': 'req-68fe3e23-d683-4958-8465-fa1ab15abed4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:14.056005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-68fe3e23-d683-4958-8465-fa1ab15abed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c4d9f510efa4929ac1f4105f6b937f1', 'request_id': 'req-68fe3e23-d683-4958-8465-fa1ab15abed4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:14.113031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-68fe3e23-d683-4958-8465-fa1ab15abed4 admin admin] The token cache is being invalidate because project 4c4d9f510efa4929ac1f4105f6b937f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:10:14.113031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-68fe3e23-d683-4958-8465-fa1ab15abed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:14.124681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-68fe3e23-d683-4958-8465-fa1ab15abed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:14.129710 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 989/1982] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:10:13 2022] DELETE /identity/v3/projects/4c4d9f510efa4929ac1f4105f6b937f1 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:14.136661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d461a0-dffa-463f-9a02-a3030b3acfde service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:14.152268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe3e23-d683-4958-8465-fa1ab15abed4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:14.160219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-68fe3e23-d683-4958-8465-fa1ab15abed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:14.189750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d461a0-dffa-463f-9a02-a3030b3acfde service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:14.379136 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:14.463408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd414a-ecc0-4454-a9b9-459a5d361dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:14.464566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd414a-ecc0-4454-a9b9-459a5d361dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:14.465105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd414a-ecc0-4454-a9b9-459a5d361dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:14.466574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd414a-ecc0-4454-a9b9-459a5d361dfc admin admin] PATH_INFO: `/v3/users/2241cd0e6a484cc0b3fa051852a254b2` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:14.470254 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd414a-ecc0-4454-a9b9-459a5d361dfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2241cd0e6a484cc0b3fa051852a254b2)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:14.476589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd414a-ecc0-4454-a9b9-459a5d361dfc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:14.544038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe3e23-d683-4958-8465-fa1ab15abed4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:14.575385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f731b1-8fbb-4287-9056-1754908347c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:14.595510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f731b1-8fbb-4287-9056-1754908347c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:14.597538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f731b1-8fbb-4287-9056-1754908347c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:14.603001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f731b1-8fbb-4287-9056-1754908347c0 admin admin] PATH_INFO: `/v3/projects/bcca9e43fb4a400097c745b6db514981` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:14.605670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f731b1-8fbb-4287-9056-1754908347c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcca9e43fb4a400097c745b6db514981)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:14.609828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f731b1-8fbb-4287-9056-1754908347c0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:14.635459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d1dd414a-ecc0-4454-a9b9-459a5d361dfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2241cd0e6a484cc0b3fa051852a254b2'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:14.659261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d1dd414a-ecc0-4454-a9b9-459a5d361dfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2241cd0e6a484cc0b3fa051852a254b2'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:14.697862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d1dd414a-ecc0-4454-a9b9-459a5d361dfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2241cd0e6a484cc0b3fa051852a254b2'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:14.701735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d1dd414a-ecc0-4454-a9b9-459a5d361dfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2241cd0e6a484cc0b3fa051852a254b2'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:14.730211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d1dd414a-ecc0-4454-a9b9-459a5d361dfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2241cd0e6a484cc0b3fa051852a254b2'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:14.739454 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-78f731b1-8fbb-4287-9056-1754908347c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcca9e43fb4a400097c745b6db514981', 'request_id': 'req-78f731b1-8fbb-4287-9056-1754908347c0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:14.758069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-78f731b1-8fbb-4287-9056-1754908347c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcca9e43fb4a400097c745b6db514981', 'request_id': 'req-78f731b1-8fbb-4287-9056-1754908347c0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:14.758544 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 994/1983] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:10:14 2022] DELETE /identity/v3/users/2241cd0e6a484cc0b3fa051852a254b2 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:14.778571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-78f731b1-8fbb-4287-9056-1754908347c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcca9e43fb4a400097c745b6db514981', 'request_id': 'req-78f731b1-8fbb-4287-9056-1754908347c0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:14.811252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-78f731b1-8fbb-4287-9056-1754908347c0 admin admin] The token cache is being invalidate because project bcca9e43fb4a400097c745b6db514981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:10:14.811813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-78f731b1-8fbb-4287-9056-1754908347c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:14.817060 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-78f731b1-8fbb-4287-9056-1754908347c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:14.821626 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 990/1984] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:10:14 2022] DELETE /identity/v3/projects/bcca9e43fb4a400097c745b6db514981 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:14.843753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6755fc7-1082-4b25-8dba-7949b2628ed3 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:14.844356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6755fc7-1082-4b25-8dba-7949b2628ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:14.844801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6755fc7-1082-4b25-8dba-7949b2628ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:14.850739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f35034-0445-4834-8540-7090997a69be None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:14.851756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f35034-0445-4834-8540-7090997a69be None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:14.852528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f35034-0445-4834-8540-7090997a69be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:14.911001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a6755fc7-1082-4b25-8dba-7949b2628ed3 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:14.917510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a6755fc7-1082-4b25-8dba-7949b2628ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:14.937966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d5f35034-0445-4834-8540-7090997a69be None None] MFA Rules not processed for user `0327f14a188e45fba98a58e5fd061248`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:14.940616 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d5f35034-0445-4834-8540-7090997a69be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:14.980221 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:15.090965 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 995/1985] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:15.100346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb27574-61be-4d44-a93e-7772472e2f5b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:15.100784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb27574-61be-4d44-a93e-7772472e2f5b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:15.101092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb27574-61be-4d44-a93e-7772472e2f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:15.150263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9bb27574-61be-4d44-a93e-7772472e2f5b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:15.151590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9bb27574-61be-4d44-a93e-7772472e2f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:15.170114 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 996/1986] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:15.181612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb27574-61be-4d44-a93e-7772472e2f5b None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:15.210821 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 991/1987] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:15.210821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f35034-0445-4834-8540-7090997a69be None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:15.214245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d5f35034-0445-4834-8540-7090997a69be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:15.216374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb27574-61be-4d44-a93e-7772472e2f5b None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:15.227815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aadb025-e6bb-47f3-81e2-f74f78b83655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:15.229255 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadb025-e6bb-47f3-81e2-f74f78b83655 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:15.229895 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadb025-e6bb-47f3-81e2-f74f78b83655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:15.231378 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadb025-e6bb-47f3-81e2-f74f78b83655 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:15.233107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aadb025-e6bb-47f3-81e2-f74f78b83655 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:10:15.233814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aadb025-e6bb-47f3-81e2-f74f78b83655 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:15.237798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aadb025-e6bb-47f3-81e2-f74f78b83655 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:15.248364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f35034-0445-4834-8540-7090997a69be None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:15.261106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114dbcc-fbc1-4ec0-8d63-9344df8759bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:15.262237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114dbcc-fbc1-4ec0-8d63-9344df8759bd admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:15.262731 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114dbcc-fbc1-4ec0-8d63-9344df8759bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:15.263219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114dbcc-fbc1-4ec0-8d63-9344df8759bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:15.264447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114dbcc-fbc1-4ec0-8d63-9344df8759bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:15.277689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114dbcc-fbc1-4ec0-8d63-9344df8759bd admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:15.335458 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 997/1988] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:10:15.341743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aadb025-e6bb-47f3-81e2-f74f78b83655 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:15.355867 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 992/1989] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:10:15 2022] POST /identity/v3/projects => generated 367 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:15.358819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114dbcc-fbc1-4ec0-8d63-9344df8759bd admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:15.364999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aadb025-e6bb-47f3-81e2-f74f78b83655 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:15.437894 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:15.505178 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114dbcc-fbc1-4ec0-8d63-9344df8759bd admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:15.507578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00bede-1cc9-497a-ace9-7c2973c0f076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:15.509896 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00bede-1cc9-497a-ace9-7c2973c0f076 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:15.511404 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00bede-1cc9-497a-ace9-7c2973c0f076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:15.512336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00bede-1cc9-497a-ace9-7c2973c0f076 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:15.514187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00bede-1cc9-497a-ace9-7c2973c0f076 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:15.514682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e088d9b-96d5-43cc-8aa8-443131c6a8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:15.516327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e088d9b-96d5-43cc-8aa8-443131c6a8bc admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:15.516746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e088d9b-96d5-43cc-8aa8-443131c6a8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:15.517265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e088d9b-96d5-43cc-8aa8-443131c6a8bc admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:15.518482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e088d9b-96d5-43cc-8aa8-443131c6a8bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:15.522540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e088d9b-96d5-43cc-8aa8-443131c6a8bc admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:15.536987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00bede-1cc9-497a-ace9-7c2973c0f076 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:15.577836 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 993/1990] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:10:15 2022] POST /identity/v3/users => generated 290 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:15.583032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e088d9b-96d5-43cc-8aa8-443131c6a8bc admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:15.631416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e088d9b-96d5-43cc-8aa8-443131c6a8bc admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:15.641787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377e787-9f44-4692-990c-3cca77e2b944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:15.642959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377e787-9f44-4692-990c-3cca77e2b944 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:15.643716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377e787-9f44-4692-990c-3cca77e2b944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:15.644315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377e787-9f44-4692-990c-3cca77e2b944 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:15.645049 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 998/1991] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:10:15 2022] POST /identity/v3/projects => generated 385 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:15.652195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377e787-9f44-4692-990c-3cca77e2b944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:15.653840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00bede-1cc9-497a-ace9-7c2973c0f076 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:15.655910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377e787-9f44-4692-990c-3cca77e2b944 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:15.679854 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 994/1992] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:15.703034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377e787-9f44-4692-990c-3cca77e2b944 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:15.731703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377e787-9f44-4692-990c-3cca77e2b944 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:15.847487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00bede-1cc9-497a-ace9-7c2973c0f076 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:15.862703 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc641c-5183-4a9b-b207-c45379fdfe8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:15.864778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc641c-5183-4a9b-b207-c45379fdfe8d admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:15.873203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc641c-5183-4a9b-b207-c45379fdfe8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:15.874433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc641c-5183-4a9b-b207-c45379fdfe8d admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:15.874900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc641c-5183-4a9b-b207-c45379fdfe8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:15.884960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc641c-5183-4a9b-b207-c45379fdfe8d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:15.945299 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 999/1993] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:10:15 2022] POST /identity/v3/users => generated 293 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:15.947127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc641c-5183-4a9b-b207-c45379fdfe8d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:15.950710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f7fc641c-5183-4a9b-b207-c45379fdfe8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:15.985928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc641c-5183-4a9b-b207-c45379fdfe8d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:15.992044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4b9b1-caea-4532-90a7-1dd7401c7f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:15.992704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4b9b1-caea-4532-90a7-1dd7401c7f5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:15.993011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4b9b1-caea-4532-90a7-1dd7401c7f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:15.993266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4b9b1-caea-4532-90a7-1dd7401c7f5c admin admin] PATH_INFO: `/v3/projects/a39a507590a34feaad53669540204a94` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:15.997265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4b9b1-caea-4532-90a7-1dd7401c7f5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a39a507590a34feaad53669540204a94)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:15.997756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4b9b1-caea-4532-90a7-1dd7401c7f5c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:16.012064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d72702-b3ee-4fe6-9fc0-ddcbd3b21464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:16.015049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d72702-b3ee-4fe6-9fc0-ddcbd3b21464 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:16.015445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d72702-b3ee-4fe6-9fc0-ddcbd3b21464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:16.015727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d72702-b3ee-4fe6-9fc0-ddcbd3b21464 admin admin] PATH_INFO: `/v3/projects/bc03c42891a04651a913e443de7e1c37/users/38ed89a4458f4f23aaf725706c2d027b/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:16.031063 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:16.062858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d72702-b3ee-4fe6-9fc0-ddcbd3b21464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc03c42891a04651a913e443de7e1c37, user_id=38ed89a4458f4f23aaf725706c2d027b, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:16.071185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d72702-b3ee-4fe6-9fc0-ddcbd3b21464 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:16.097968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7ee4b9b1-caea-4532-90a7-1dd7401c7f5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a39a507590a34feaad53669540204a94', 'request_id': 'req-7ee4b9b1-caea-4532-90a7-1dd7401c7f5c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:16.111664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7ee4b9b1-caea-4532-90a7-1dd7401c7f5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a39a507590a34feaad53669540204a94', 'request_id': 'req-7ee4b9b1-caea-4532-90a7-1dd7401c7f5c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:16.121622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7ee4b9b1-caea-4532-90a7-1dd7401c7f5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a39a507590a34feaad53669540204a94', 'request_id': 'req-7ee4b9b1-caea-4532-90a7-1dd7401c7f5c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:16.151640 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7ee4b9b1-caea-4532-90a7-1dd7401c7f5c admin admin] The token cache is being invalidate because project a39a507590a34feaad53669540204a94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:10:16.151640 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7ee4b9b1-caea-4532-90a7-1dd7401c7f5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:16.154250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7ee4b9b1-caea-4532-90a7-1dd7401c7f5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:16.157737 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1000/1994] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:10:15 2022] DELETE /identity/v3/projects/a39a507590a34feaad53669540204a94 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:16.159875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4b9b1-caea-4532-90a7-1dd7401c7f5c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:16.163752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7ee4b9b1-caea-4532-90a7-1dd7401c7f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:16.181681 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 995/1995] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:10:15 2022] PUT /identity/v3/projects/bc03c42891a04651a913e443de7e1c37/users/38ed89a4458f4f23aaf725706c2d027b/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:16.184383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f9989-510d-41ea-891f-b3ec35035003 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:16.184856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f9989-510d-41ea-891f-b3ec35035003 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:16.187506 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f9989-510d-41ea-891f-b3ec35035003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:16.251468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-399f9989-510d-41ea-891f-b3ec35035003 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:16.253958 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-399f9989-510d-41ea-891f-b3ec35035003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:16.372356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4b9b1-caea-4532-90a7-1dd7401c7f5c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:16.413699 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 996/1996] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:16.415009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f9989-510d-41ea-891f-b3ec35035003 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:16.418307 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-399f9989-510d-41ea-891f-b3ec35035003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:16.459999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f9989-510d-41ea-891f-b3ec35035003 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:16.469176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b0c18-5660-4947-a82b-9738e13a6f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:16.470535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b0c18-5660-4947-a82b-9738e13a6f96 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:16.471040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b0c18-5660-4947-a82b-9738e13a6f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:16.472193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b0c18-5660-4947-a82b-9738e13a6f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:16.473491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b0c18-5660-4947-a82b-9738e13a6f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:16.477408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b0c18-5660-4947-a82b-9738e13a6f96 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:16.503931 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 997/1997] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:16.507006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f14632-9c6f-4e99-9177-64df6c1d6b3c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:16.507818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f14632-9c6f-4e99-9177-64df6c1d6b3c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:16.508490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f14632-9c6f-4e99-9177-64df6c1d6b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:16.543854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18e32f-9a21-4d69-aa61-bb28a445dad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:16.546733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18e32f-9a21-4d69-aa61-bb28a445dad4 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:16.547045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18e32f-9a21-4d69-aa61-bb28a445dad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:16.547343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18e32f-9a21-4d69-aa61-bb28a445dad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:16.548168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18e32f-9a21-4d69-aa61-bb28a445dad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:16.549435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-51f14632-9c6f-4e99-9177-64df6c1d6b3c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:16.549864 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18e32f-9a21-4d69-aa61-bb28a445dad4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:16.552003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-51f14632-9c6f-4e99-9177-64df6c1d6b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:16.565363 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1001/1998] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:16.566545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18e32f-9a21-4d69-aa61-bb28a445dad4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:16.578257 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 998/1999] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:16.580834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f14632-9c6f-4e99-9177-64df6c1d6b3c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:16.601591 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f14632-9c6f-4e99-9177-64df6c1d6b3c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:16.611091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18e32f-9a21-4d69-aa61-bb28a445dad4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:16.613161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c96ed-d991-4df2-ac84-b58eca1280f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:16.615238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c96ed-d991-4df2-ac84-b58eca1280f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:16.616270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c96ed-d991-4df2-ac84-b58eca1280f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:16.616743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c96ed-d991-4df2-ac84-b58eca1280f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:16.619160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c96ed-d991-4df2-ac84-b58eca1280f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:16.623777 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c96ed-d991-4df2-ac84-b58eca1280f1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:16.635916 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:16.637927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57282e-877c-459a-b95c-4d92c64538b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:16.639199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57282e-877c-459a-b95c-4d92c64538b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:16.639710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57282e-877c-459a-b95c-4d92c64538b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:16.640275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57282e-877c-459a-b95c-4d92c64538b0 admin admin] PATH_INFO: `/v3/projects/bc03c42891a04651a913e443de7e1c37/users/38ed89a4458f4f23aaf725706c2d027b/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:16.649963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57282e-877c-459a-b95c-4d92c64538b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc03c42891a04651a913e443de7e1c37, user_id=38ed89a4458f4f23aaf725706c2d027b, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:16.655866 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 999/2000] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:16.657724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c96ed-d991-4df2-ac84-b58eca1280f1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:16.660154 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57282e-877c-459a-b95c-4d92c64538b0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:16.682950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c96ed-d991-4df2-ac84-b58eca1280f1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:16.692936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af74902-b349-46e4-945d-f253d131fde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:16.694032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af74902-b349-46e4-945d-f253d131fde3 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:16.694685 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af74902-b349-46e4-945d-f253d131fde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:16.695324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af74902-b349-46e4-945d-f253d131fde3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:16.696762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af74902-b349-46e4-945d-f253d131fde3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:10:16.697446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af74902-b349-46e4-945d-f253d131fde3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:16.700158 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1002/2001] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:10:16 2022] PUT /identity/v3/projects/bc03c42891a04651a913e443de7e1c37/users/38ed89a4458f4f23aaf725706c2d027b/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:16.701360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af74902-b349-46e4-945d-f253d131fde3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:16.701697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57282e-877c-459a-b95c-4d92c64538b0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:16.753007 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1000/2002] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:10:16.759806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af74902-b349-46e4-945d-f253d131fde3 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:16.792912 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:16.795828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af74902-b349-46e4-945d-f253d131fde3 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:16.868053 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57282e-877c-459a-b95c-4d92c64538b0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:16.879126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087cbf9-6451-4b27-a1cd-b3d7cde6fad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:16.880459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087cbf9-6451-4b27-a1cd-b3d7cde6fad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:16.881104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087cbf9-6451-4b27-a1cd-b3d7cde6fad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:16.881683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087cbf9-6451-4b27-a1cd-b3d7cde6fad9 admin admin] PATH_INFO: `/v3/projects/3e6d319a0452448485aa65b7cf1c5b0e/users/7e9dce42ff994d81b1ad6d6c05356c37/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:16.915187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087cbf9-6451-4b27-a1cd-b3d7cde6fad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e6d319a0452448485aa65b7cf1c5b0e, user_id=7e9dce42ff994d81b1ad6d6c05356c37, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:16.922436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087cbf9-6451-4b27-a1cd-b3d7cde6fad9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:17.009657 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1003/2003] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:10:16 2022] PUT /identity/v3/projects/3e6d319a0452448485aa65b7cf1c5b0e/users/7e9dce42ff994d81b1ad6d6c05356c37/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:17.012216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b102a-a2ff-4af0-bd38-f3e18a809bbe None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:17.016829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b102a-a2ff-4af0-bd38-f3e18a809bbe None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:17.017371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b102a-a2ff-4af0-bd38-f3e18a809bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:17.057859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7656c-d429-44bd-af2d-6de5eea4619d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:17.058988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7656c-d429-44bd-af2d-6de5eea4619d admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:17.059779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7656c-d429-44bd-af2d-6de5eea4619d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:17.061098 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7656c-d429-44bd-af2d-6de5eea4619d admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:17.062630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7656c-d429-44bd-af2d-6de5eea4619d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:17.080352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7656c-d429-44bd-af2d-6de5eea4619d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:17.099829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-cc5b102a-a2ff-4af0-bd38-f3e18a809bbe None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:17.102674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-cc5b102a-a2ff-4af0-bd38-f3e18a809bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:17.225170 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1001/2004] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:10:16 2022] POST /identity/v3/projects => generated 379 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:10:17.230839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7656c-d429-44bd-af2d-6de5eea4619d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:17.238207 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1004/2005] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:17.256342 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b102a-a2ff-4af0-bd38-f3e18a809bbe None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:17.258096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-cc5b102a-a2ff-4af0-bd38-f3e18a809bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:17.488873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b102a-a2ff-4af0-bd38-f3e18a809bbe None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:17.582331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7656c-d429-44bd-af2d-6de5eea4619d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:17.615037 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba38acee-364b-4e7c-bf53-145111503e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:17.622750 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38acee-364b-4e7c-bf53-145111503e97 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:17.623826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38acee-364b-4e7c-bf53-145111503e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:17.624574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38acee-364b-4e7c-bf53-145111503e97 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:17.626024 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38acee-364b-4e7c-bf53-145111503e97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:17.638398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba38acee-364b-4e7c-bf53-145111503e97 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:17.685313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b90183-b14e-40bc-9750-5d9821c37c99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:17.685971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b90183-b14e-40bc-9750-5d9821c37c99 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:17.686263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b90183-b14e-40bc-9750-5d9821c37c99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:17.686605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b90183-b14e-40bc-9750-5d9821c37c99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:17.712715 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b90183-b14e-40bc-9750-5d9821c37c99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:17.715201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b90183-b14e-40bc-9750-5d9821c37c99 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:17.753962 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1005/2006] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:10:17.797197 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1002/2007] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:10:17 2022] POST /identity/v3/users => generated 290 bytes in 565 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:17.800425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b90183-b14e-40bc-9750-5d9821c37c99 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:17.832273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b90183-b14e-40bc-9750-5d9821c37c99 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:17.844452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b24179-54ce-4e16-ab77-de4641555a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:17.845505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b24179-54ce-4e16-ab77-de4641555a2e admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:17.852686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b24179-54ce-4e16-ab77-de4641555a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:17.852686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b24179-54ce-4e16-ab77-de4641555a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:17.852686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b24179-54ce-4e16-ab77-de4641555a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:17.875545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b24179-54ce-4e16-ab77-de4641555a2e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:17.901974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea3892-2240-4fb1-997e-336e1588d050 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:17.902436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea3892-2240-4fb1-997e-336e1588d050 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:17.902908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea3892-2240-4fb1-997e-336e1588d050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:17.911757 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1006/2008] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:17.920790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b24179-54ce-4e16-ab77-de4641555a2e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:17.951783 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:17.959649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b24179-54ce-4e16-ab77-de4641555a2e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:17.960238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-f1ea3892-2240-4fb1-997e-336e1588d050 None None] MFA Rules not processed for user `909b8165f015473c9977ef92aaf0741b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:17.966453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f1ea3892-2240-4fb1-997e-336e1588d050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:17.979154 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69c658-584a-4db7-82a7-c60fae8b3229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:17.981405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69c658-584a-4db7-82a7-c60fae8b3229 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:17.981405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69c658-584a-4db7-82a7-c60fae8b3229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:17.981405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69c658-584a-4db7-82a7-c60fae8b3229 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:17.996419 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69c658-584a-4db7-82a7-c60fae8b3229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:17.999715 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69c658-584a-4db7-82a7-c60fae8b3229 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:18.048790 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1007/2009] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:18.055408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69c658-584a-4db7-82a7-c60fae8b3229 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:18.085877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69c658-584a-4db7-82a7-c60fae8b3229 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:18.108042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de9f75-bc8d-48b9-8b84-755d37eda96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:18.109537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de9f75-bc8d-48b9-8b84-755d37eda96f admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:18.110216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de9f75-bc8d-48b9-8b84-755d37eda96f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:18.110818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de9f75-bc8d-48b9-8b84-755d37eda96f admin admin] PATH_INFO: `/v3/projects/30dcd40f157645cbbc04ad884828d76f/users/10c2aa7a625c4d03ba8c974bcefbf962/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:18.220557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de9f75-bc8d-48b9-8b84-755d37eda96f admin admin] RBAC: Authorizing `identity:create_grant(project_id=30dcd40f157645cbbc04ad884828d76f, user_id=10c2aa7a625c4d03ba8c974bcefbf962, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:18.226420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de9f75-bc8d-48b9-8b84-755d37eda96f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:18.236992 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1003/2010] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:10:18.302039 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1008/2011] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:10:18 2022] PUT /identity/v3/projects/30dcd40f157645cbbc04ad884828d76f/users/10c2aa7a625c4d03ba8c974bcefbf962/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:10:18.323013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4caf20-525c-498a-965b-7ef951a508d6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:18.323355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4caf20-525c-498a-965b-7ef951a508d6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:18.323844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4caf20-525c-498a-965b-7ef951a508d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:18.375417 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:18.410164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-4a4caf20-525c-498a-965b-7ef951a508d6 None None] MFA Rules not processed for user `10c2aa7a625c4d03ba8c974bcefbf962`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:18.424753 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4a4caf20-525c-498a-965b-7ef951a508d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:18.605960 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1004/2012] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:18.607856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de9f75-bc8d-48b9-8b84-755d37eda96f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:18.831533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de9f75-bc8d-48b9-8b84-755d37eda96f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:18.848342 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7dbbc-f2fb-4f44-9b1d-d0124b7b55b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:18.849778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7dbbc-f2fb-4f44-9b1d-d0124b7b55b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:18.850580 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7dbbc-f2fb-4f44-9b1d-d0124b7b55b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:18.851291 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7dbbc-f2fb-4f44-9b1d-d0124b7b55b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:18.853442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7dbbc-f2fb-4f44-9b1d-d0124b7b55b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:18.858504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7dbbc-f2fb-4f44-9b1d-d0124b7b55b0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:18.925365 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1009/2013] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:10:18 2022] POST /identity/v3/projects => generated 379 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:18.931330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4caf20-525c-498a-965b-7ef951a508d6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:18.961389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4caf20-525c-498a-965b-7ef951a508d6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:19.122422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbd4e7-456d-4097-bed1-27c1cc7e48b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:19.123602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbd4e7-456d-4097-bed1-27c1cc7e48b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:19.124389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbd4e7-456d-4097-bed1-27c1cc7e48b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:19.124891 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbd4e7-456d-4097-bed1-27c1cc7e48b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:19.127187 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afbd4e7-456d-4097-bed1-27c1cc7e48b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:19.133327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afbd4e7-456d-4097-bed1-27c1cc7e48b7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:19.192556 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1005/2014] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:10:18 2022] POST /identity/v3/users => generated 296 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:10:19.194234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7dbbc-f2fb-4f44-9b1d-d0124b7b55b0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:19.218165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7dbbc-f2fb-4f44-9b1d-d0124b7b55b0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:19.227397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b16fdf-acd5-4d9a-9f2f-b2f93bbddfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:19.229337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b16fdf-acd5-4d9a-9f2f-b2f93bbddfcd admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:19.230113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b16fdf-acd5-4d9a-9f2f-b2f93bbddfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:19.230817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b16fdf-acd5-4d9a-9f2f-b2f93bbddfcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:19.232505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b16fdf-acd5-4d9a-9f2f-b2f93bbddfcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:19.236075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b16fdf-acd5-4d9a-9f2f-b2f93bbddfcd admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:19.262425 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1010/2015] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:19.269705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbd4e7-456d-4097-bed1-27c1cc7e48b7 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:19.295729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbd4e7-456d-4097-bed1-27c1cc7e48b7 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:19.313035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ef869-7a99-4262-b60d-fc7b7be4f222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:19.314390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ef869-7a99-4262-b60d-fc7b7be4f222 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:19.315034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ef869-7a99-4262-b60d-fc7b7be4f222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:19.315713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ef869-7a99-4262-b60d-fc7b7be4f222 admin admin] PATH_INFO: `/v3/projects/e7159283c3904591ae9556a7ecd61163/users/3dcb91112c4843a7a9a19a5f6b7582f4/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:19.367106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ef869-7a99-4262-b60d-fc7b7be4f222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7159283c3904591ae9556a7ecd61163, user_id=3dcb91112c4843a7a9a19a5f6b7582f4, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:19.373758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ef869-7a99-4262-b60d-fc7b7be4f222 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:19.412533 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1006/2016] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:10:19 2022] PUT /identity/v3/projects/e7159283c3904591ae9556a7ecd61163/users/3dcb91112c4843a7a9a19a5f6b7582f4/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:19.413854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b16fdf-acd5-4d9a-9f2f-b2f93bbddfcd admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:19.445481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b16fdf-acd5-4d9a-9f2f-b2f93bbddfcd admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:19.625830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe966bab-72f0-417c-9ba9-aa120470d656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:19.626524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe966bab-72f0-417c-9ba9-aa120470d656 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:19.627563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe966bab-72f0-417c-9ba9-aa120470d656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:19.627563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe966bab-72f0-417c-9ba9-aa120470d656 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:19.628352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe966bab-72f0-417c-9ba9-aa120470d656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:19.632960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe966bab-72f0-417c-9ba9-aa120470d656 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:19.651068 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1011/2017] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:19.657290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ef869-7a99-4262-b60d-fc7b7be4f222 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:19.680272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ef869-7a99-4262-b60d-fc7b7be4f222 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:19.687398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa0286-233a-40a1-a8c1-28d673a05079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:19.688347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa0286-233a-40a1-a8c1-28d673a05079 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:19.688879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa0286-233a-40a1-a8c1-28d673a05079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:19.689504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa0286-233a-40a1-a8c1-28d673a05079 admin admin] PATH_INFO: `/v3/projects/e7159283c3904591ae9556a7ecd61163/users/3dcb91112c4843a7a9a19a5f6b7582f4/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:19.693014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa0286-233a-40a1-a8c1-28d673a05079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7159283c3904591ae9556a7ecd61163, user_id=3dcb91112c4843a7a9a19a5f6b7582f4, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:19.696313 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa0286-233a-40a1-a8c1-28d673a05079 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:19.713226 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1007/2018] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:10:19 2022] PUT /identity/v3/projects/e7159283c3904591ae9556a7ecd61163/users/3dcb91112c4843a7a9a19a5f6b7582f4/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:19.741755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e5088-ab8b-4af7-83a1-ccb4a70751d3 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:19.741755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e5088-ab8b-4af7-83a1-ccb4a70751d3 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:19.741755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e5088-ab8b-4af7-83a1-ccb4a70751d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:19.822610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-8f7e5088-ab8b-4af7-83a1-ccb4a70751d3 None None] MFA Rules not processed for user `3dcb91112c4843a7a9a19a5f6b7582f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:19.825511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8f7e5088-ab8b-4af7-83a1-ccb4a70751d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:19.913998 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:20.051054 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1012/2019] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:10:20.070199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa0286-233a-40a1-a8c1-28d673a05079 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:20.073034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7caa0286-233a-40a1-a8c1-28d673a05079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:20.292157 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:20.413752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa0286-233a-40a1-a8c1-28d673a05079 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:20.428562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905ba82-fdaa-4bfe-ab8f-c951fecc7b40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:20.429965 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905ba82-fdaa-4bfe-ab8f-c951fecc7b40 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:20.430568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905ba82-fdaa-4bfe-ab8f-c951fecc7b40 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:20.434352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905ba82-fdaa-4bfe-ab8f-c951fecc7b40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:20.459581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905ba82-fdaa-4bfe-ab8f-c951fecc7b40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:20.464846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905ba82-fdaa-4bfe-ab8f-c951fecc7b40 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:20.487587 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1008/2020] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:20 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:20.931612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e5088-ab8b-4af7-83a1-ccb4a70751d3 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:21.193743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e5088-ab8b-4af7-83a1-ccb4a70751d3 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:21.201664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadeabe-ac01-4136-99ba-e0ec68ddc2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:21.202767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadeabe-ac01-4136-99ba-e0ec68ddc2a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:21.203214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadeabe-ac01-4136-99ba-e0ec68ddc2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:21.203694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadeabe-ac01-4136-99ba-e0ec68ddc2a7 admin admin] PATH_INFO: `/v3/users/10c2aa7a625c4d03ba8c974bcefbf962` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:21.208543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddadeabe-ac01-4136-99ba-e0ec68ddc2a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10c2aa7a625c4d03ba8c974bcefbf962)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:21.211419 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddadeabe-ac01-4136-99ba-e0ec68ddc2a7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:21.364417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ddadeabe-ac01-4136-99ba-e0ec68ddc2a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10c2aa7a625c4d03ba8c974bcefbf962'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:21.387081 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ddadeabe-ac01-4136-99ba-e0ec68ddc2a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10c2aa7a625c4d03ba8c974bcefbf962'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:21.518460 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ddadeabe-ac01-4136-99ba-e0ec68ddc2a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10c2aa7a625c4d03ba8c974bcefbf962'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:21.521299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ddadeabe-ac01-4136-99ba-e0ec68ddc2a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10c2aa7a625c4d03ba8c974bcefbf962'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:21.587390 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ddadeabe-ac01-4136-99ba-e0ec68ddc2a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10c2aa7a625c4d03ba8c974bcefbf962'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:21.616435 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1013/2021] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:10:20 2022] DELETE /identity/v3/users/10c2aa7a625c4d03ba8c974bcefbf962 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:21.625445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389dd8f3-9033-472a-ba45-3914ca07a784 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:21.626276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389dd8f3-9033-472a-ba45-3914ca07a784 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:21.626689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389dd8f3-9033-472a-ba45-3914ca07a784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:21.692667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-389dd8f3-9033-472a-ba45-3914ca07a784 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:21.695803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-389dd8f3-9033-472a-ba45-3914ca07a784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:22.069615 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1009/2022] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:22.101090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadeabe-ac01-4136-99ba-e0ec68ddc2a7 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:22.106373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ddadeabe-ac01-4136-99ba-e0ec68ddc2a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:22.380037 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:22.424650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadeabe-ac01-4136-99ba-e0ec68ddc2a7 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:22.464030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d31c2-03dc-4317-b59b-c47d08ae670e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:22.465134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d31c2-03dc-4317-b59b-c47d08ae670e service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:22.465616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d31c2-03dc-4317-b59b-c47d08ae670e service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:22.466082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d31c2-03dc-4317-b59b-c47d08ae670e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:22.511021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d31c2-03dc-4317-b59b-c47d08ae670e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:22.514662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d31c2-03dc-4317-b59b-c47d08ae670e service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:22.565982 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1014/2023] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:24.520483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389dd8f3-9033-472a-ba45-3914ca07a784 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:24.522225 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-389dd8f3-9033-472a-ba45-3914ca07a784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:24.577499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389dd8f3-9033-472a-ba45-3914ca07a784 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:24.597389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcb35f-6906-414d-a6a4-df06909fc2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:24.598063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcb35f-6906-414d-a6a4-df06909fc2e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:24.598449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcb35f-6906-414d-a6a4-df06909fc2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:24.598730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcb35f-6906-414d-a6a4-df06909fc2e4 admin admin] PATH_INFO: `/v3/users/2e60f068764c4a259771662a83663cb9` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:24.600929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcb35f-6906-414d-a6a4-df06909fc2e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e60f068764c4a259771662a83663cb9)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:24.603766 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcb35f-6906-414d-a6a4-df06909fc2e4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:24.766984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4cfcb35f-6906-414d-a6a4-df06909fc2e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e60f068764c4a259771662a83663cb9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:24.795784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4cfcb35f-6906-414d-a6a4-df06909fc2e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e60f068764c4a259771662a83663cb9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:24.848298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d31c2-03dc-4317-b59b-c47d08ae670e service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:24.849306 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4cfcb35f-6906-414d-a6a4-df06909fc2e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e60f068764c4a259771662a83663cb9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:24.852997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4cfcb35f-6906-414d-a6a4-df06909fc2e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e60f068764c4a259771662a83663cb9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:24.853690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a75d31c2-03dc-4317-b59b-c47d08ae670e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:24.872182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4cfcb35f-6906-414d-a6a4-df06909fc2e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e60f068764c4a259771662a83663cb9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:24.902779 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1010/2024] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:10:24 2022] DELETE /identity/v3/users/2e60f068764c4a259771662a83663cb9 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:10:24.909376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097c6df-85ca-465e-bb2d-859517867d72 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:24.909702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097c6df-85ca-465e-bb2d-859517867d72 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:24.909956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097c6df-85ca-465e-bb2d-859517867d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:24.921245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d31c2-03dc-4317-b59b-c47d08ae670e service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:24.943392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-5097c6df-85ca-465e-bb2d-859517867d72 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:24.945004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5097c6df-85ca-465e-bb2d-859517867d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:25.159040 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:25.225665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0734b41-7aee-4454-8c3a-4ee2e3096fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:25.227670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0734b41-7aee-4454-8c3a-4ee2e3096fcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:25.231442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0734b41-7aee-4454-8c3a-4ee2e3096fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:25.232434 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0734b41-7aee-4454-8c3a-4ee2e3096fcf admin admin] PATH_INFO: `/v3/projects/30dcd40f157645cbbc04ad884828d76f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:25.244717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0734b41-7aee-4454-8c3a-4ee2e3096fcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=30dcd40f157645cbbc04ad884828d76f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:25.249203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0734b41-7aee-4454-8c3a-4ee2e3096fcf admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:25.272812 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1011/2025] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:25.400519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097c6df-85ca-465e-bb2d-859517867d72 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:25.405401 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5097c6df-85ca-465e-bb2d-859517867d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:25.514591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e0734b41-7aee-4454-8c3a-4ee2e3096fcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30dcd40f157645cbbc04ad884828d76f', 'request_id': 'req-e0734b41-7aee-4454-8c3a-4ee2e3096fcf'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:25.543093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e0734b41-7aee-4454-8c3a-4ee2e3096fcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30dcd40f157645cbbc04ad884828d76f', 'request_id': 'req-e0734b41-7aee-4454-8c3a-4ee2e3096fcf'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:25.588925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e0734b41-7aee-4454-8c3a-4ee2e3096fcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30dcd40f157645cbbc04ad884828d76f', 'request_id': 'req-e0734b41-7aee-4454-8c3a-4ee2e3096fcf'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:25.736495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097c6df-85ca-465e-bb2d-859517867d72 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:25.745279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e0734b41-7aee-4454-8c3a-4ee2e3096fcf admin admin] The token cache is being invalidate because project 30dcd40f157645cbbc04ad884828d76f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:10:25.745870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e0734b41-7aee-4454-8c3a-4ee2e3096fcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:25.757072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e0734b41-7aee-4454-8c3a-4ee2e3096fcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:25.769984 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1015/2026] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:10:24 2022] DELETE /identity/v3/projects/30dcd40f157645cbbc04ad884828d76f => generated 0 bytes in 923 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:10:25.783547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0734b41-7aee-4454-8c3a-4ee2e3096fcf admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:25.790872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e0734b41-7aee-4454-8c3a-4ee2e3096fcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:25.917084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8aa4d-ff08-45bc-8bdf-846cba1e1480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:25.918804 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8aa4d-ff08-45bc-8bdf-846cba1e1480 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:25.919596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8aa4d-ff08-45bc-8bdf-846cba1e1480 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:25.920686 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8aa4d-ff08-45bc-8bdf-846cba1e1480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:25.927705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-30a8aa4d-ff08-45bc-8bdf-846cba1e1480 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:26.133388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0734b41-7aee-4454-8c3a-4ee2e3096fcf admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:26.141436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8aa4d-ff08-45bc-8bdf-846cba1e1480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:26.160290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc17920-e850-4e73-b34b-2adfd955f443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:26.161802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc17920-e850-4e73-b34b-2adfd955f443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:26.162732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc17920-e850-4e73-b34b-2adfd955f443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:26.163436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc17920-e850-4e73-b34b-2adfd955f443 admin admin] PATH_INFO: `/v3/users/3dcb91112c4843a7a9a19a5f6b7582f4` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:26.167702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc17920-e850-4e73-b34b-2adfd955f443 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dcb91112c4843a7a9a19a5f6b7582f4)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:26.185482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc17920-e850-4e73-b34b-2adfd955f443 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:26.188267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8aa4d-ff08-45bc-8bdf-846cba1e1480 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:26.235768 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1012/2027] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 834 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:26.294571 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:26.402645 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4bc17920-e850-4e73-b34b-2adfd955f443 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dcb91112c4843a7a9a19a5f6b7582f4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:26.451199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4bc17920-e850-4e73-b34b-2adfd955f443 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dcb91112c4843a7a9a19a5f6b7582f4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:26.532459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4bc17920-e850-4e73-b34b-2adfd955f443 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dcb91112c4843a7a9a19a5f6b7582f4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:26.533276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4bc17920-e850-4e73-b34b-2adfd955f443 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dcb91112c4843a7a9a19a5f6b7582f4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:26.554068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4bc17920-e850-4e73-b34b-2adfd955f443 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dcb91112c4843a7a9a19a5f6b7582f4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:26.584735 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1016/2028] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:10:25 2022] DELETE /identity/v3/users/3dcb91112c4843a7a9a19a5f6b7582f4 => generated 0 bytes in 804 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:27.224935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8aa4d-ff08-45bc-8bdf-846cba1e1480 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:27.229366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-30a8aa4d-ff08-45bc-8bdf-846cba1e1480 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:27.265015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8aa4d-ff08-45bc-8bdf-846cba1e1480 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:27.490734 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:27.523636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d778d-f807-41b2-972a-3bd5b9ec4a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:27.525121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d778d-f807-41b2-972a-3bd5b9ec4a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:27.525615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d778d-f807-41b2-972a-3bd5b9ec4a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:27.526088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d778d-f807-41b2-972a-3bd5b9ec4a00 admin admin] PATH_INFO: `/v3/projects/8d0af4ec538f41868c10700c90e816d6` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:27.530441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d778d-f807-41b2-972a-3bd5b9ec4a00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d0af4ec538f41868c10700c90e816d6)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:27.534086 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d778d-f807-41b2-972a-3bd5b9ec4a00 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:27.714222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e28d778d-f807-41b2-972a-3bd5b9ec4a00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d0af4ec538f41868c10700c90e816d6', 'request_id': 'req-e28d778d-f807-41b2-972a-3bd5b9ec4a00'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:27.727274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e28d778d-f807-41b2-972a-3bd5b9ec4a00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d0af4ec538f41868c10700c90e816d6', 'request_id': 'req-e28d778d-f807-41b2-972a-3bd5b9ec4a00'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:27.744183 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e28d778d-f807-41b2-972a-3bd5b9ec4a00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d0af4ec538f41868c10700c90e816d6', 'request_id': 'req-e28d778d-f807-41b2-972a-3bd5b9ec4a00'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:27.799455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e28d778d-f807-41b2-972a-3bd5b9ec4a00 admin admin] The token cache is being invalidate because project 8d0af4ec538f41868c10700c90e816d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:10:27.799455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e28d778d-f807-41b2-972a-3bd5b9ec4a00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:27.806734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e28d778d-f807-41b2-972a-3bd5b9ec4a00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:27.813608 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1013/2029] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:10:27 2022] DELETE /identity/v3/projects/8d0af4ec538f41868c10700c90e816d6 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:27.820099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc17920-e850-4e73-b34b-2adfd955f443 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:27.821907 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4bc17920-e850-4e73-b34b-2adfd955f443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:27.846168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc17920-e850-4e73-b34b-2adfd955f443 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:28.184849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43223a8e-7de4-45f4-a5f2-dbae222f559c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:28.187040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43223a8e-7de4-45f4-a5f2-dbae222f559c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:28.187799 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43223a8e-7de4-45f4-a5f2-dbae222f559c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:28.188312 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43223a8e-7de4-45f4-a5f2-dbae222f559c admin admin] PATH_INFO: `/v3/users/5ff86b78b7574be485bca55324b517e0` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:28.215077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43223a8e-7de4-45f4-a5f2-dbae222f559c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ff86b78b7574be485bca55324b517e0)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:28.231780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43223a8e-7de4-45f4-a5f2-dbae222f559c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:28.474469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-43223a8e-7de4-45f4-a5f2-dbae222f559c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ff86b78b7574be485bca55324b517e0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:28.499262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-43223a8e-7de4-45f4-a5f2-dbae222f559c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ff86b78b7574be485bca55324b517e0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:28.556188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-43223a8e-7de4-45f4-a5f2-dbae222f559c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ff86b78b7574be485bca55324b517e0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:28.557062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-43223a8e-7de4-45f4-a5f2-dbae222f559c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ff86b78b7574be485bca55324b517e0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:28.577681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-43223a8e-7de4-45f4-a5f2-dbae222f559c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ff86b78b7574be485bca55324b517e0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:28.587782 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1017/2030] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:10:27 2022] DELETE /identity/v3/users/5ff86b78b7574be485bca55324b517e0 => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:10:30.145504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d778d-f807-41b2-972a-3bd5b9ec4a00 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:30.147750 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e28d778d-f807-41b2-972a-3bd5b9ec4a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:30.189473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d778d-f807-41b2-972a-3bd5b9ec4a00 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:30.427785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43223a8e-7de4-45f4-a5f2-dbae222f559c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:30.432230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-43223a8e-7de4-45f4-a5f2-dbae222f559c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:30.521563 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021da449-414b-48d9-ac92-76be0f5bfda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:30.525723 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021da449-414b-48d9-ac92-76be0f5bfda9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:30.532112 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:30.534705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021da449-414b-48d9-ac92-76be0f5bfda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:30.535363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021da449-414b-48d9-ac92-76be0f5bfda9 admin admin] PATH_INFO: `/v3/projects/e7159283c3904591ae9556a7ecd61163` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:30.549175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021da449-414b-48d9-ac92-76be0f5bfda9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7159283c3904591ae9556a7ecd61163)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:30.557408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021da449-414b-48d9-ac92-76be0f5bfda9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:30.774378 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-021da449-414b-48d9-ac92-76be0f5bfda9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7159283c3904591ae9556a7ecd61163', 'request_id': 'req-021da449-414b-48d9-ac92-76be0f5bfda9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:30.782877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-021da449-414b-48d9-ac92-76be0f5bfda9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7159283c3904591ae9556a7ecd61163', 'request_id': 'req-021da449-414b-48d9-ac92-76be0f5bfda9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:30.788551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43223a8e-7de4-45f4-a5f2-dbae222f559c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:30.792663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-021da449-414b-48d9-ac92-76be0f5bfda9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7159283c3904591ae9556a7ecd61163', 'request_id': 'req-021da449-414b-48d9-ac92-76be0f5bfda9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:30.824478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-021da449-414b-48d9-ac92-76be0f5bfda9 admin admin] The token cache is being invalidate because project e7159283c3904591ae9556a7ecd61163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:10:30.826246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-021da449-414b-48d9-ac92-76be0f5bfda9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:30.828556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-021da449-414b-48d9-ac92-76be0f5bfda9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:30.832909 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1014/2031] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:10:30 2022] DELETE /identity/v3/projects/e7159283c3904591ae9556a7ecd61163 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:30.836604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021da449-414b-48d9-ac92-76be0f5bfda9 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:30.841163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-021da449-414b-48d9-ac92-76be0f5bfda9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:30.892060 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:31.069273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11ee6c-6f1e-43db-b027-742ab65d971c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:31.070392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11ee6c-6f1e-43db-b027-742ab65d971c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:31.071189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11ee6c-6f1e-43db-b027-742ab65d971c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:31.071785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11ee6c-6f1e-43db-b027-742ab65d971c admin admin] PATH_INFO: `/v3/projects/aabb9a49690d4678a44ec7ba410bdd77` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:31.075652 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11ee6c-6f1e-43db-b027-742ab65d971c admin admin] RBAC: Authorizing `identity:delete_project(project_id=aabb9a49690d4678a44ec7ba410bdd77)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:31.085048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11ee6c-6f1e-43db-b027-742ab65d971c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:31.167112 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021da449-414b-48d9-ac92-76be0f5bfda9 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:31.191212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d550b-2dfd-45ec-b09c-ec507f658940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:31.193504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d550b-2dfd-45ec-b09c-ec507f658940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:31.196429 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d550b-2dfd-45ec-b09c-ec507f658940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:31.196851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d550b-2dfd-45ec-b09c-ec507f658940 admin admin] PATH_INFO: `/v3/users/60d4f703c4d6468e853b2a27d64df026` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:31.201514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d550b-2dfd-45ec-b09c-ec507f658940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60d4f703c4d6468e853b2a27d64df026)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:31.212160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d550b-2dfd-45ec-b09c-ec507f658940 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:31.367769 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2f11ee6c-6f1e-43db-b027-742ab65d971c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aabb9a49690d4678a44ec7ba410bdd77', 'request_id': 'req-2f11ee6c-6f1e-43db-b027-742ab65d971c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:31.385236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2f11ee6c-6f1e-43db-b027-742ab65d971c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aabb9a49690d4678a44ec7ba410bdd77', 'request_id': 'req-2f11ee6c-6f1e-43db-b027-742ab65d971c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:31.402489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2f11ee6c-6f1e-43db-b027-742ab65d971c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aabb9a49690d4678a44ec7ba410bdd77', 'request_id': 'req-2f11ee6c-6f1e-43db-b027-742ab65d971c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:31.464524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2f11ee6c-6f1e-43db-b027-742ab65d971c admin admin] The token cache is being invalidate because project aabb9a49690d4678a44ec7ba410bdd77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:10:31.467919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2f11ee6c-6f1e-43db-b027-742ab65d971c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:31.471000 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2f11ee6c-6f1e-43db-b027-742ab65d971c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:31.480318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d19d550b-2dfd-45ec-b09c-ec507f658940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60d4f703c4d6468e853b2a27d64df026'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:31.482794 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1018/2032] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:10:30 2022] DELETE /identity/v3/projects/aabb9a49690d4678a44ec7ba410bdd77 => generated 0 bytes in 1056 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:10:31.492259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52ff6e-3451-4a12-ad29-083fef543eb9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:31.493540 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52ff6e-3451-4a12-ad29-083fef543eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:31.496648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52ff6e-3451-4a12-ad29-083fef543eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:31.537551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d19d550b-2dfd-45ec-b09c-ec507f658940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60d4f703c4d6468e853b2a27d64df026'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:31.592403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-fe52ff6e-3451-4a12-ad29-083fef543eb9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:31.599119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fe52ff6e-3451-4a12-ad29-083fef543eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:31.648031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d19d550b-2dfd-45ec-b09c-ec507f658940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60d4f703c4d6468e853b2a27d64df026'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:31.653567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d19d550b-2dfd-45ec-b09c-ec507f658940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60d4f703c4d6468e853b2a27d64df026'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:31.679418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d19d550b-2dfd-45ec-b09c-ec507f658940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60d4f703c4d6468e853b2a27d64df026'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:31.709252 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1015/2033] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:10:30 2022] DELETE /identity/v3/users/60d4f703c4d6468e853b2a27d64df026 => generated 0 bytes in 871 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:31.709846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc1b31-57a5-4fd9-91b4-4a45b0b6c442 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:31.710351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc1b31-57a5-4fd9-91b4-4a45b0b6c442 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:31.710841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc1b31-57a5-4fd9-91b4-4a45b0b6c442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:31.791772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d1cc1b31-57a5-4fd9-91b4-4a45b0b6c442 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:31.804109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d1cc1b31-57a5-4fd9-91b4-4a45b0b6c442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:31.868799 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:31.944029 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1019/2034] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:31.946516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b53dd-c9cf-4f92-ae9e-98c0fb627a52 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:31.947010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b53dd-c9cf-4f92-ae9e-98c0fb627a52 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:31.947497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b53dd-c9cf-4f92-ae9e-98c0fb627a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:32.034879 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-457b53dd-c9cf-4f92-ae9e-98c0fb627a52 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:32.041359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-457b53dd-c9cf-4f92-ae9e-98c0fb627a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:32.215566 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1016/2035] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 510 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:32.219264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded4acf-23a4-4700-937e-57d3e3ae0774 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:32.222833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded4acf-23a4-4700-937e-57d3e3ae0774 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:32.229071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded4acf-23a4-4700-937e-57d3e3ae0774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:32.283793 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1020/2036] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:32.284283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b53dd-c9cf-4f92-ae9e-98c0fb627a52 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:32.286151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-457b53dd-c9cf-4f92-ae9e-98c0fb627a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:32.314355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1ded4acf-23a4-4700-937e-57d3e3ae0774 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:32.315790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457b53dd-c9cf-4f92-ae9e-98c0fb627a52 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:32.322380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1ded4acf-23a4-4700-937e-57d3e3ae0774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:32.330550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f82592-5c01-48a9-b03c-2d05b51071fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:32.337221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f82592-5c01-48a9-b03c-2d05b51071fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:32.337221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f82592-5c01-48a9-b03c-2d05b51071fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:32.337221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f82592-5c01-48a9-b03c-2d05b51071fc admin admin] PATH_INFO: `/v3/users/fb017971b41b4cdf86c12b94dad84414` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:32.338894 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f82592-5c01-48a9-b03c-2d05b51071fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb017971b41b4cdf86c12b94dad84414)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:32.341050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f82592-5c01-48a9-b03c-2d05b51071fc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:32.378432 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1017/2037] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:32.382320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f0568-6920-409a-b910-6d5aca06d64b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:32.386469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f0568-6920-409a-b910-6d5aca06d64b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:32.386910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f0568-6920-409a-b910-6d5aca06d64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:32.493481 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-655f0568-6920-409a-b910-6d5aca06d64b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:32.495572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-655f0568-6920-409a-b910-6d5aca06d64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:32.518544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-38f82592-5c01-48a9-b03c-2d05b51071fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb017971b41b4cdf86c12b94dad84414'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:32.531722 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1018/2038] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:32.535116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f0568-6920-409a-b910-6d5aca06d64b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:32.563430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f0568-6920-409a-b910-6d5aca06d64b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:32.564403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-38f82592-5c01-48a9-b03c-2d05b51071fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb017971b41b4cdf86c12b94dad84414'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:32.597650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68d794-9fa7-4fb0-a71d-47353425fd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:32.597650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68d794-9fa7-4fb0-a71d-47353425fd08 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:32.597650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68d794-9fa7-4fb0-a71d-47353425fd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:32.597650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68d794-9fa7-4fb0-a71d-47353425fd08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:32.599744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68d794-9fa7-4fb0-a71d-47353425fd08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:10:32.599744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68d794-9fa7-4fb0-a71d-47353425fd08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:32.610376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68d794-9fa7-4fb0-a71d-47353425fd08 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:32.645346 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1019/2039] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:10:32.646529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68d794-9fa7-4fb0-a71d-47353425fd08 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:32.654950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3b68d794-9fa7-4fb0-a71d-47353425fd08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:32.672473 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:32.689644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-38f82592-5c01-48a9-b03c-2d05b51071fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb017971b41b4cdf86c12b94dad84414'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:32.692099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-38f82592-5c01-48a9-b03c-2d05b51071fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb017971b41b4cdf86c12b94dad84414'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:32.743075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-38f82592-5c01-48a9-b03c-2d05b51071fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb017971b41b4cdf86c12b94dad84414'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:32.750436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68d794-9fa7-4fb0-a71d-47353425fd08 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:32.762213 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb347938-af95-4afc-b3ee-e00ea693aaf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:32.762213 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb347938-af95-4afc-b3ee-e00ea693aaf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:32.762213 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb347938-af95-4afc-b3ee-e00ea693aaf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:32.762213 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb347938-af95-4afc-b3ee-e00ea693aaf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:32.772871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bb347938-af95-4afc-b3ee-e00ea693aaf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:32.790656 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1021/2040] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:10:32 2022] DELETE /identity/v3/users/fb017971b41b4cdf86c12b94dad84414 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:32.800289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f82592-5c01-48a9-b03c-2d05b51071fc admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:32.806800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-38f82592-5c01-48a9-b03c-2d05b51071fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:32.814320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb347938-af95-4afc-b3ee-e00ea693aaf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:32.817308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb347938-af95-4afc-b3ee-e00ea693aaf8 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:32.846491 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1020/2041] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:32.847629 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb347938-af95-4afc-b3ee-e00ea693aaf8 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:32.851095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bb347938-af95-4afc-b3ee-e00ea693aaf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:32.888756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb347938-af95-4afc-b3ee-e00ea693aaf8 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:33.047494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e19a0a-612e-44ab-9430-42962b7e62bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:33.049184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e19a0a-612e-44ab-9430-42962b7e62bf admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:33.049562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e19a0a-612e-44ab-9430-42962b7e62bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:33.049833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e19a0a-612e-44ab-9430-42962b7e62bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:33.051660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e19a0a-612e-44ab-9430-42962b7e62bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:33.053715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e19a0a-612e-44ab-9430-42962b7e62bf admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:33.084357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f82592-5c01-48a9-b03c-2d05b51071fc admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:33.097698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253b1cb6-f208-42aa-9211-a6387ec490dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:33.099771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b1cb6-f208-42aa-9211-a6387ec490dc admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:33.100165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b1cb6-f208-42aa-9211-a6387ec490dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:33.100425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253b1cb6-f208-42aa-9211-a6387ec490dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:33.101077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b1cb6-f208-42aa-9211-a6387ec490dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:10:33.101379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b1cb6-f208-42aa-9211-a6387ec490dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:33.106434 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253b1cb6-f208-42aa-9211-a6387ec490dc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:33.143670 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1021/2042] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:10:32 2022] POST /identity/v3/projects => generated 379 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:33.143670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e19a0a-612e-44ab-9430-42962b7e62bf admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:33.148739 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:33.151852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-99e19a0a-612e-44ab-9430-42962b7e62bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:33.165636 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1022/2043] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:10:33.181807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51c65b-6a96-4700-9acf-8136ce2d76f7 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:33.182489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51c65b-6a96-4700-9acf-8136ce2d76f7 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:33.182777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51c65b-6a96-4700-9acf-8136ce2d76f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:33.259483 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ee51c65b-6a96-4700-9acf-8136ce2d76f7 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:33.265557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ee51c65b-6a96-4700-9acf-8136ce2d76f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:33.426781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e19a0a-612e-44ab-9430-42962b7e62bf admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:33.442505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdb3e5-3fe9-494b-9240-3c2e7776fc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:33.443174 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdb3e5-3fe9-494b-9240-3c2e7776fc9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:33.443457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdb3e5-3fe9-494b-9240-3c2e7776fc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:33.443742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdb3e5-3fe9-494b-9240-3c2e7776fc9b admin admin] PATH_INFO: `/v3/users/37a892781ecd4300b6dd10b9c235e263` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:33.445157 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cdb3e5-3fe9-494b-9240-3c2e7776fc9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=37a892781ecd4300b6dd10b9c235e263)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:33.447819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cdb3e5-3fe9-494b-9240-3c2e7776fc9b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:33.491911 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1023/2044] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:33.494908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51c65b-6a96-4700-9acf-8136ce2d76f7 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:33.533258 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51c65b-6a96-4700-9acf-8136ce2d76f7 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:33.542555 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:33.557164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc2828-a0c2-4af8-b720-8f7ade5e2f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:33.558310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc2828-a0c2-4af8-b720-8f7ade5e2f48 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:33.558838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc2828-a0c2-4af8-b720-8f7ade5e2f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:33.559514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc2828-a0c2-4af8-b720-8f7ade5e2f48 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:33.561393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc2828-a0c2-4af8-b720-8f7ade5e2f48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:33.567383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc2828-a0c2-4af8-b720-8f7ade5e2f48 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:33.570234 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-01cdb3e5-3fe9-494b-9240-3c2e7776fc9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37a892781ecd4300b6dd10b9c235e263'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:33.589507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-01cdb3e5-3fe9-494b-9240-3c2e7776fc9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37a892781ecd4300b6dd10b9c235e263'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:33.617738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-01cdb3e5-3fe9-494b-9240-3c2e7776fc9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37a892781ecd4300b6dd10b9c235e263'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:33.620483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-01cdb3e5-3fe9-494b-9240-3c2e7776fc9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37a892781ecd4300b6dd10b9c235e263'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:33.636119 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-01cdb3e5-3fe9-494b-9240-3c2e7776fc9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37a892781ecd4300b6dd10b9c235e263'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:33.654242 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1022/2045] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:10:33 2022] DELETE /identity/v3/users/37a892781ecd4300b6dd10b9c235e263 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:33.654242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdb3e5-3fe9-494b-9240-3c2e7776fc9b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:33.654545 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1024/2046] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:10:33 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:33.654688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-01cdb3e5-3fe9-494b-9240-3c2e7776fc9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:33.656898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc2828-a0c2-4af8-b720-8f7ade5e2f48 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:33.666849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8ffc2828-a0c2-4af8-b720-8f7ade5e2f48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:33.823610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdb3e5-3fe9-494b-9240-3c2e7776fc9b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:33.837977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b010609-6918-4dd8-9626-ce72c5427a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:33.838616 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b010609-6918-4dd8-9626-ce72c5427a17 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:33.839052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b010609-6918-4dd8-9626-ce72c5427a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:33.839328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b010609-6918-4dd8-9626-ce72c5427a17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:33.840012 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b010609-6918-4dd8-9626-ce72c5427a17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:33.841999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b010609-6918-4dd8-9626-ce72c5427a17 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:33.849335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc2828-a0c2-4af8-b720-8f7ade5e2f48 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:33.922177 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1023/2047] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:10:33 2022] POST /identity/v3/projects => generated 393 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:33.927472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef58d8-34d6-48cd-bf34-3e8b2ba9ea40 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:33.927750 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef58d8-34d6-48cd-bf34-3e8b2ba9ea40 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:33.928659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef58d8-34d6-48cd-bf34-3e8b2ba9ea40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:33.988067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-4bef58d8-34d6-48cd-bf34-3e8b2ba9ea40 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:33.989640 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4bef58d8-34d6-48cd-bf34-3e8b2ba9ea40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:34.027242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c733264-a823-44f8-9894-734bed18330d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:34.027918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c733264-a823-44f8-9894-734bed18330d service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:34.028221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c733264-a823-44f8-9894-734bed18330d service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:34.028500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c733264-a823-44f8-9894-734bed18330d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:34.033451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1c733264-a823-44f8-9894-734bed18330d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:34.070539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c733264-a823-44f8-9894-734bed18330d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:34.072468 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c733264-a823-44f8-9894-734bed18330d service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:34.109495 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1025/2048] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:34.112799 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c733264-a823-44f8-9894-734bed18330d service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:34.121887 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1c733264-a823-44f8-9894-734bed18330d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:34.166763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c733264-a823-44f8-9894-734bed18330d service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:34.222238 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1024/2049] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:34.225726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef58d8-34d6-48cd-bf34-3e8b2ba9ea40 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:34.254267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef58d8-34d6-48cd-bf34-3e8b2ba9ea40 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:34.275171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03a8fc-d1eb-4125-ae36-3724a1ca34d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:34.276365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03a8fc-d1eb-4125-ae36-3724a1ca34d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:34.276794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03a8fc-d1eb-4125-ae36-3724a1ca34d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:34.277227 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b03a8fc-d1eb-4125-ae36-3724a1ca34d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:34.277972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03a8fc-d1eb-4125-ae36-3724a1ca34d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:34.281831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b03a8fc-d1eb-4125-ae36-3724a1ca34d0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:34.393617 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1025/2050] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:10:34 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:34.394669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03a8fc-d1eb-4125-ae36-3724a1ca34d0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:34.414091 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:34.498707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14065965-fc7f-41b0-b9bd-249f50c11174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:34.502730 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14065965-fc7f-41b0-b9bd-249f50c11174 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:34.503449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14065965-fc7f-41b0-b9bd-249f50c11174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:34.504055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14065965-fc7f-41b0-b9bd-249f50c11174 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:34.506753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14065965-fc7f-41b0-b9bd-249f50c11174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:34.511959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14065965-fc7f-41b0-b9bd-249f50c11174 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:34.528793 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:34.530591 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1026/2051] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:34.532604 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14065965-fc7f-41b0-b9bd-249f50c11174 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:34.552798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14065965-fc7f-41b0-b9bd-249f50c11174 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:34.561590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33508f16-872b-4570-a269-da21664af046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:34.563416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33508f16-872b-4570-a269-da21664af046 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:34.565468 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33508f16-872b-4570-a269-da21664af046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:34.565973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33508f16-872b-4570-a269-da21664af046 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:34.568101 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33508f16-872b-4570-a269-da21664af046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:34.572665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33508f16-872b-4570-a269-da21664af046 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:34.612999 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1027/2052] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:34.615081 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33508f16-872b-4570-a269-da21664af046 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:34.644460 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33508f16-872b-4570-a269-da21664af046 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:34.661217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0534f-3706-411c-b0f8-0b22ec9f648f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:34.662287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0534f-3706-411c-b0f8-0b22ec9f648f admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:34.662828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0534f-3706-411c-b0f8-0b22ec9f648f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:34.663117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b03a8fc-d1eb-4125-ae36-3724a1ca34d0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:34.663557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0534f-3706-411c-b0f8-0b22ec9f648f admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:34.664588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0534f-3706-411c-b0f8-0b22ec9f648f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:34.671433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f0534f-3706-411c-b0f8-0b22ec9f648f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:34.674276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce17995-e47c-42a3-8f7c-dd8e30d2e121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:34.675451 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce17995-e47c-42a3-8f7c-dd8e30d2e121 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:34.678776 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce17995-e47c-42a3-8f7c-dd8e30d2e121 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:34.678776 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce17995-e47c-42a3-8f7c-dd8e30d2e121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:34.705692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce17995-e47c-42a3-8f7c-dd8e30d2e121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:34.708293 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1028/2053] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:34.709993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0534f-3706-411c-b0f8-0b22ec9f648f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:34.720452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce17995-e47c-42a3-8f7c-dd8e30d2e121 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:34.749488 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0534f-3706-411c-b0f8-0b22ec9f648f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:34.754119 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1026/2054] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:34.756099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce17995-e47c-42a3-8f7c-dd8e30d2e121 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:34.759569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5ce17995-e47c-42a3-8f7c-dd8e30d2e121 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:34.793245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbc440-4ebf-41b5-bb9d-6a0f9ff806bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:34.794308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbc440-4ebf-41b5-bb9d-6a0f9ff806bc admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:34.794803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbc440-4ebf-41b5-bb9d-6a0f9ff806bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:34.795291 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbc440-4ebf-41b5-bb9d-6a0f9ff806bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:34.797637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccbc440-4ebf-41b5-bb9d-6a0f9ff806bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:34.800392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccbc440-4ebf-41b5-bb9d-6a0f9ff806bc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:34.803406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce17995-e47c-42a3-8f7c-dd8e30d2e121 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:34.838256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a7fdc-cfbd-45ea-8190-fe225f99b3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:34.847925 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1029/2055] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:34.847925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbc440-4ebf-41b5-bb9d-6a0f9ff806bc admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:34.848324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a7fdc-cfbd-45ea-8190-fe225f99b3d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:34.848324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a7fdc-cfbd-45ea-8190-fe225f99b3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:34.848324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a7fdc-cfbd-45ea-8190-fe225f99b3d2 admin admin] PATH_INFO: `/v3/projects/248e2243d5a54a9d94e8452fe43680c8` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:34.849135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a7fdc-cfbd-45ea-8190-fe225f99b3d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=248e2243d5a54a9d94e8452fe43680c8)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:34.854669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a7fdc-cfbd-45ea-8190-fe225f99b3d2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:34.889904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbc440-4ebf-41b5-bb9d-6a0f9ff806bc admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:34.923531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9cd6f-2267-48ea-9839-d8e8ea99812b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:34.924603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9cd6f-2267-48ea-9839-d8e8ea99812b admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:34.925086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9cd6f-2267-48ea-9839-d8e8ea99812b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:34.925617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9cd6f-2267-48ea-9839-d8e8ea99812b admin admin] PATH_INFO: `/v3/projects/5705e5a01af14bb6add2b1da39636196/users/40fc46029deb4b92819a6c76a6eaae32/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:34.965287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9cd6f-2267-48ea-9839-d8e8ea99812b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5705e5a01af14bb6add2b1da39636196, user_id=40fc46029deb4b92819a6c76a6eaae32, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:34.976373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9cd6f-2267-48ea-9839-d8e8ea99812b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:35.024974 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1030/2056] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:10:34 2022] PUT /identity/v3/projects/5705e5a01af14bb6add2b1da39636196/users/40fc46029deb4b92819a6c76a6eaae32/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:35.028562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9cd6f-2267-48ea-9839-d8e8ea99812b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:35.057995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3c9a7fdc-cfbd-45ea-8190-fe225f99b3d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '248e2243d5a54a9d94e8452fe43680c8', 'request_id': 'req-3c9a7fdc-cfbd-45ea-8190-fe225f99b3d2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:35.069686 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3c9a7fdc-cfbd-45ea-8190-fe225f99b3d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '248e2243d5a54a9d94e8452fe43680c8', 'request_id': 'req-3c9a7fdc-cfbd-45ea-8190-fe225f99b3d2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:35.088598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3c9a7fdc-cfbd-45ea-8190-fe225f99b3d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '248e2243d5a54a9d94e8452fe43680c8', 'request_id': 'req-3c9a7fdc-cfbd-45ea-8190-fe225f99b3d2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:35.119708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3c9a7fdc-cfbd-45ea-8190-fe225f99b3d2 admin admin] The token cache is being invalidate because project 248e2243d5a54a9d94e8452fe43680c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:10:35.132770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3c9a7fdc-cfbd-45ea-8190-fe225f99b3d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:35.139465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3c9a7fdc-cfbd-45ea-8190-fe225f99b3d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:35.144044 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1027/2057] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:10:34 2022] DELETE /identity/v3/projects/248e2243d5a54a9d94e8452fe43680c8 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:35.154194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732166cc-63f5-458c-b717-fcfc8e748ea1 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:35.157628 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732166cc-63f5-458c-b717-fcfc8e748ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:35.159815 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732166cc-63f5-458c-b717-fcfc8e748ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:35.300002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-732166cc-63f5-458c-b717-fcfc8e748ea1 None None] MFA Rules not processed for user `40fc46029deb4b92819a6c76a6eaae32`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:35.302747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-732166cc-63f5-458c-b717-fcfc8e748ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:35.334840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9cd6f-2267-48ea-9839-d8e8ea99812b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:35.559036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1d750-3e0a-484b-90bd-cd25c00de356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:35.561559 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1d750-3e0a-484b-90bd-cd25c00de356 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:35.562131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1d750-3e0a-484b-90bd-cd25c00de356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:35.562744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1d750-3e0a-484b-90bd-cd25c00de356 admin admin] PATH_INFO: `/v3/projects/5f58ed0fcf42424596a5a06cc32a064e/users/600c5ba5ceed46f195a8a97325f0ac96/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:35.567343 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1028/2058] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:35.576016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732166cc-63f5-458c-b717-fcfc8e748ea1 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:35.579980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-732166cc-63f5-458c-b717-fcfc8e748ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:35.629098 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1d750-3e0a-484b-90bd-cd25c00de356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f58ed0fcf42424596a5a06cc32a064e, user_id=600c5ba5ceed46f195a8a97325f0ac96, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:35.644695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732166cc-63f5-458c-b717-fcfc8e748ea1 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:35.645010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1d750-3e0a-484b-90bd-cd25c00de356 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:35.695510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e542f5-ae32-4d0f-85d3-2354542b92c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:35.701624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e542f5-ae32-4d0f-85d3-2354542b92c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:35.704454 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e542f5-ae32-4d0f-85d3-2354542b92c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:35.705135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e542f5-ae32-4d0f-85d3-2354542b92c4 admin admin] PATH_INFO: `/v3/users/c7f69d5acc5547dba7f05bd2ea205e71` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:35.706801 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1031/2059] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:10:35 2022] PUT /identity/v3/projects/5f58ed0fcf42424596a5a06cc32a064e/users/600c5ba5ceed46f195a8a97325f0ac96/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:35.713278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e542f5-ae32-4d0f-85d3-2354542b92c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7f69d5acc5547dba7f05bd2ea205e71)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:35.725558 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1d750-3e0a-484b-90bd-cd25c00de356 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:35.728395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e542f5-ae32-4d0f-85d3-2354542b92c4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:35.729900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-43b1d750-3e0a-484b-90bd-cd25c00de356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:35.767512 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:35.879670 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:35.910358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d0e542f5-ae32-4d0f-85d3-2354542b92c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7f69d5acc5547dba7f05bd2ea205e71'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:35.937400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d0e542f5-ae32-4d0f-85d3-2354542b92c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7f69d5acc5547dba7f05bd2ea205e71'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:35.949201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1d750-3e0a-484b-90bd-cd25c00de356 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:35.977961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880944a7-890a-440b-bc1e-bce4334ac3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:35.979292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880944a7-890a-440b-bc1e-bce4334ac3dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:35.981768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880944a7-890a-440b-bc1e-bce4334ac3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:35.982276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d0e542f5-ae32-4d0f-85d3-2354542b92c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7f69d5acc5547dba7f05bd2ea205e71'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:35.984216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d0e542f5-ae32-4d0f-85d3-2354542b92c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7f69d5acc5547dba7f05bd2ea205e71'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:36.001538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880944a7-890a-440b-bc1e-bce4334ac3dd admin admin] PATH_INFO: `/v3/projects/c15e7e61e7eb4c9490b7632bde85d2cd` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:36.002776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880944a7-890a-440b-bc1e-bce4334ac3dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c15e7e61e7eb4c9490b7632bde85d2cd)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:36.008501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880944a7-890a-440b-bc1e-bce4334ac3dd admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:36.017038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d0e542f5-ae32-4d0f-85d3-2354542b92c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7f69d5acc5547dba7f05bd2ea205e71'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:36.027730 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1029/2060] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:10:35 2022] DELETE /identity/v3/users/c7f69d5acc5547dba7f05bd2ea205e71 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:36.029329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e542f5-ae32-4d0f-85d3-2354542b92c4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:36.034479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d0e542f5-ae32-4d0f-85d3-2354542b92c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:36.150571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-880944a7-890a-440b-bc1e-bce4334ac3dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c15e7e61e7eb4c9490b7632bde85d2cd', 'request_id': 'req-880944a7-890a-440b-bc1e-bce4334ac3dd'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:36.166461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-880944a7-890a-440b-bc1e-bce4334ac3dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c15e7e61e7eb4c9490b7632bde85d2cd', 'request_id': 'req-880944a7-890a-440b-bc1e-bce4334ac3dd'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:36.182644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-880944a7-890a-440b-bc1e-bce4334ac3dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c15e7e61e7eb4c9490b7632bde85d2cd', 'request_id': 'req-880944a7-890a-440b-bc1e-bce4334ac3dd'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:36.251840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-880944a7-890a-440b-bc1e-bce4334ac3dd admin admin] The token cache is being invalidate because project c15e7e61e7eb4c9490b7632bde85d2cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:10:36.252859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-880944a7-890a-440b-bc1e-bce4334ac3dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:36.255793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-880944a7-890a-440b-bc1e-bce4334ac3dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:36.267484 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1032/2061] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:10:35 2022] DELETE /identity/v3/projects/c15e7e61e7eb4c9490b7632bde85d2cd => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:36.270799 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bee9f-4286-4ea1-8973-f5a9cf1b99d9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:36.272788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bee9f-4286-4ea1-8973-f5a9cf1b99d9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:36.274715 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bee9f-4286-4ea1-8973-f5a9cf1b99d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:36.347096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d43bee9f-4286-4ea1-8973-f5a9cf1b99d9 None None] MFA Rules not processed for user `600c5ba5ceed46f195a8a97325f0ac96`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:36.350029 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d43bee9f-4286-4ea1-8973-f5a9cf1b99d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:36.375959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e542f5-ae32-4d0f-85d3-2354542b92c4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:36.533825 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1033/2062] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:36.534759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43bee9f-4286-4ea1-8973-f5a9cf1b99d9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:36.543971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d43bee9f-4286-4ea1-8973-f5a9cf1b99d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:36.721721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff03cb7-729d-4b57-9806-f9348014e6e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:36.723097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff03cb7-729d-4b57-9806-f9348014e6e7 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:36.723388 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff03cb7-729d-4b57-9806-f9348014e6e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:36.723669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff03cb7-729d-4b57-9806-f9348014e6e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:36.726742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0ff03cb7-729d-4b57-9806-f9348014e6e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:36.761116 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:36.883097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43bee9f-4286-4ea1-8973-f5a9cf1b99d9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:36.910914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385e2be-ccf9-4f06-a835-ff55529d68b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:36.912635 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:36.913707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385e2be-ccf9-4f06-a835-ff55529d68b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:36.916451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385e2be-ccf9-4f06-a835-ff55529d68b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:36.918349 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385e2be-ccf9-4f06-a835-ff55529d68b1 admin admin] PATH_INFO: `/v3/projects/4100cbdf8697462ab2da94054ab02a82` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:36.926762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d385e2be-ccf9-4f06-a835-ff55529d68b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4100cbdf8697462ab2da94054ab02a82)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:36.938167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d385e2be-ccf9-4f06-a835-ff55529d68b1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:36.977843 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff03cb7-729d-4b57-9806-f9348014e6e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:36.981764 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff03cb7-729d-4b57-9806-f9348014e6e7 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:37.050063 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1030/2063] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 1021 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:37.050859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff03cb7-729d-4b57-9806-f9348014e6e7 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:37.061245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0ff03cb7-729d-4b57-9806-f9348014e6e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:37.128555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff03cb7-729d-4b57-9806-f9348014e6e7 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:37.146079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d385e2be-ccf9-4f06-a835-ff55529d68b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4100cbdf8697462ab2da94054ab02a82', 'request_id': 'req-d385e2be-ccf9-4f06-a835-ff55529d68b1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:37.176882 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d385e2be-ccf9-4f06-a835-ff55529d68b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4100cbdf8697462ab2da94054ab02a82', 'request_id': 'req-d385e2be-ccf9-4f06-a835-ff55529d68b1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:37.208914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d385e2be-ccf9-4f06-a835-ff55529d68b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4100cbdf8697462ab2da94054ab02a82', 'request_id': 'req-d385e2be-ccf9-4f06-a835-ff55529d68b1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:37.245597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d385e2be-ccf9-4f06-a835-ff55529d68b1 admin admin] The token cache is being invalidate because project 4100cbdf8697462ab2da94054ab02a82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:10:37.246100 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d385e2be-ccf9-4f06-a835-ff55529d68b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:37.252293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d385e2be-ccf9-4f06-a835-ff55529d68b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:37.259816 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1034/2064] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:10:36 2022] DELETE /identity/v3/projects/4100cbdf8697462ab2da94054ab02a82 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:37.259816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385e2be-ccf9-4f06-a835-ff55529d68b1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:37.261675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d385e2be-ccf9-4f06-a835-ff55529d68b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:37.386461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d7940-0944-43d2-8de0-74505e60228d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:37.388213 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d7940-0944-43d2-8de0-74505e60228d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:37.388739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d7940-0944-43d2-8de0-74505e60228d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:37.389398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d7940-0944-43d2-8de0-74505e60228d admin admin] PATH_INFO: `/v3/users/e8b354f4536d40d3adedc0c10609d467` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:37.392022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d7940-0944-43d2-8de0-74505e60228d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8b354f4536d40d3adedc0c10609d467)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:37.396768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d7940-0944-43d2-8de0-74505e60228d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:37.514986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385e2be-ccf9-4f06-a835-ff55529d68b1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:37.536541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e611ef-561c-4d25-b906-e54f7178fe15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:37.538211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e611ef-561c-4d25-b906-e54f7178fe15 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:37.538690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e611ef-561c-4d25-b906-e54f7178fe15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:37.539653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e611ef-561c-4d25-b906-e54f7178fe15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:37.542070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e611ef-561c-4d25-b906-e54f7178fe15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:37.553657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e611ef-561c-4d25-b906-e54f7178fe15 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:37.573955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-595d7940-0944-43d2-8de0-74505e60228d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8b354f4536d40d3adedc0c10609d467'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:37.605751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-595d7940-0944-43d2-8de0-74505e60228d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8b354f4536d40d3adedc0c10609d467'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:37.660896 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1035/2065] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:10:37 2022] POST /identity/v3/projects => generated 393 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:37.662509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-595d7940-0944-43d2-8de0-74505e60228d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8b354f4536d40d3adedc0c10609d467'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:37.663460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-595d7940-0944-43d2-8de0-74505e60228d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8b354f4536d40d3adedc0c10609d467'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:37.665074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e611ef-561c-4d25-b906-e54f7178fe15 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:37.676403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-69e611ef-561c-4d25-b906-e54f7178fe15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:37.694317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-595d7940-0944-43d2-8de0-74505e60228d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8b354f4536d40d3adedc0c10609d467'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:37.719293 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1031/2066] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:10:37 2022] DELETE /identity/v3/users/e8b354f4536d40d3adedc0c10609d467 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:37.725980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d7940-0944-43d2-8de0-74505e60228d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:37.728925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-595d7940-0944-43d2-8de0-74505e60228d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:37.876938 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:37.982064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e611ef-561c-4d25-b906-e54f7178fe15 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:38.028916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d7940-0944-43d2-8de0-74505e60228d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:38.047998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da44399-3ac5-4277-a8d5-f6c1a096d2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:38.048778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da44399-3ac5-4277-a8d5-f6c1a096d2c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:38.049103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da44399-3ac5-4277-a8d5-f6c1a096d2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:38.049421 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da44399-3ac5-4277-a8d5-f6c1a096d2c9 admin admin] PATH_INFO: `/v3/projects/60b8430a79264d20b633391ab7bc6790` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:38.051204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da44399-3ac5-4277-a8d5-f6c1a096d2c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60b8430a79264d20b633391ab7bc6790)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:38.053706 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da44399-3ac5-4277-a8d5-f6c1a096d2c9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:38.070410 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:38.159243 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ebe156-56fd-4cc3-a162-984a4feb263c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:38.160197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebe156-56fd-4cc3-a162-984a4feb263c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:38.160493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebe156-56fd-4cc3-a162-984a4feb263c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:38.160848 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebe156-56fd-4cc3-a162-984a4feb263c admin admin] PATH_INFO: `/v3/users/fdd64e9af9744fbea3765833eedeb117` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:38.163190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ebe156-56fd-4cc3-a162-984a4feb263c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdd64e9af9744fbea3765833eedeb117)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:38.168007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ebe156-56fd-4cc3-a162-984a4feb263c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:38.186326 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9da44399-3ac5-4277-a8d5-f6c1a096d2c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60b8430a79264d20b633391ab7bc6790', 'request_id': 'req-9da44399-3ac5-4277-a8d5-f6c1a096d2c9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:38.217266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9da44399-3ac5-4277-a8d5-f6c1a096d2c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60b8430a79264d20b633391ab7bc6790', 'request_id': 'req-9da44399-3ac5-4277-a8d5-f6c1a096d2c9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:38.236978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9da44399-3ac5-4277-a8d5-f6c1a096d2c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60b8430a79264d20b633391ab7bc6790', 'request_id': 'req-9da44399-3ac5-4277-a8d5-f6c1a096d2c9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:38.276731 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9da44399-3ac5-4277-a8d5-f6c1a096d2c9 admin admin] The token cache is being invalidate because project 60b8430a79264d20b633391ab7bc6790 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:10:38.277139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9da44399-3ac5-4277-a8d5-f6c1a096d2c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:38.278072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9da44399-3ac5-4277-a8d5-f6c1a096d2c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:38.292669 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1032/2067] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:10:37 2022] DELETE /identity/v3/projects/60b8430a79264d20b633391ab7bc6790 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:38.293998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da44399-3ac5-4277-a8d5-f6c1a096d2c9 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:38.305630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9da44399-3ac5-4277-a8d5-f6c1a096d2c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:38.339115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b4ebe156-56fd-4cc3-a162-984a4feb263c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdd64e9af9744fbea3765833eedeb117'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:38.362811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b4ebe156-56fd-4cc3-a162-984a4feb263c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdd64e9af9744fbea3765833eedeb117'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:38.402994 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b4ebe156-56fd-4cc3-a162-984a4feb263c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdd64e9af9744fbea3765833eedeb117'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:38.404438 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b4ebe156-56fd-4cc3-a162-984a4feb263c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdd64e9af9744fbea3765833eedeb117'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:38.472543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b4ebe156-56fd-4cc3-a162-984a4feb263c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdd64e9af9744fbea3765833eedeb117'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:38.523340 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1036/2068] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:10:37 2022] DELETE /identity/v3/users/fdd64e9af9744fbea3765833eedeb117 => generated 0 bytes in 855 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:38.528389 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa86868-2863-4bb1-838e-a52a818179dd None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:38.528889 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa86868-2863-4bb1-838e-a52a818179dd None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:38.529426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa86868-2863-4bb1-838e-a52a818179dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:38.551340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da44399-3ac5-4277-a8d5-f6c1a096d2c9 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:38.613582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-4aa86868-2863-4bb1-838e-a52a818179dd None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:38.615434 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4aa86868-2863-4bb1-838e-a52a818179dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:38.797422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df358a1a-43e9-4db5-a38e-ecafa33d41a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:38.800533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df358a1a-43e9-4db5-a38e-ecafa33d41a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:38.801600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df358a1a-43e9-4db5-a38e-ecafa33d41a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:38.803717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df358a1a-43e9-4db5-a38e-ecafa33d41a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:38.807363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df358a1a-43e9-4db5-a38e-ecafa33d41a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:38.821481 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df358a1a-43e9-4db5-a38e-ecafa33d41a3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:38.904065 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1033/2069] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:10:38 2022] POST /identity/v3/users => generated 303 bytes in 611 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:38.905491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df358a1a-43e9-4db5-a38e-ecafa33d41a3 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:38.916648 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1037/2070] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:10:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:38.919142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b5a94-1b0b-4955-82ef-91d92b39a736 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:38.920520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b5a94-1b0b-4955-82ef-91d92b39a736 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:38.921136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b5a94-1b0b-4955-82ef-91d92b39a736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:38.926173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-df358a1a-43e9-4db5-a38e-ecafa33d41a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:39.022427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df358a1a-43e9-4db5-a38e-ecafa33d41a3 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:39.050532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac945bb-8e74-4b0c-b9b4-8d3e90eff454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:39.053722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac945bb-8e74-4b0c-b9b4-8d3e90eff454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:39.054099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac945bb-8e74-4b0c-b9b4-8d3e90eff454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:39.054366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e74b5a94-1b0b-4955-82ef-91d92b39a736 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:39.054610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac945bb-8e74-4b0c-b9b4-8d3e90eff454 admin admin] PATH_INFO: `/v3/projects/5990c8b61fe5439fb2ae91810d353225` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:39.058935 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e74b5a94-1b0b-4955-82ef-91d92b39a736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:39.062579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac945bb-8e74-4b0c-b9b4-8d3e90eff454 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5990c8b61fe5439fb2ae91810d353225)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:39.086276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac945bb-8e74-4b0c-b9b4-8d3e90eff454 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:39.093511 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1038/2071] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:39.095482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b5a94-1b0b-4955-82ef-91d92b39a736 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:39.098384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e74b5a94-1b0b-4955-82ef-91d92b39a736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:39.133386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b5a94-1b0b-4955-82ef-91d92b39a736 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:39.142833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a11652-746b-4e2f-b55d-dec1b0168449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:39.144481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a11652-746b-4e2f-b55d-dec1b0168449 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:39.145471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a11652-746b-4e2f-b55d-dec1b0168449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:39.146313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a11652-746b-4e2f-b55d-dec1b0168449 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:39.147861 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a11652-746b-4e2f-b55d-dec1b0168449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:39.152164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a11652-746b-4e2f-b55d-dec1b0168449 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:39.164106 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:39.184737 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1039/2072] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:39.187172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a11652-746b-4e2f-b55d-dec1b0168449 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:39.191052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e8a11652-746b-4e2f-b55d-dec1b0168449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:39.209272 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:39.246261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0ac945bb-8e74-4b0c-b9b4-8d3e90eff454 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5990c8b61fe5439fb2ae91810d353225', 'request_id': 'req-0ac945bb-8e74-4b0c-b9b4-8d3e90eff454'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:39.259525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0ac945bb-8e74-4b0c-b9b4-8d3e90eff454 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5990c8b61fe5439fb2ae91810d353225', 'request_id': 'req-0ac945bb-8e74-4b0c-b9b4-8d3e90eff454'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:39.272458 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0ac945bb-8e74-4b0c-b9b4-8d3e90eff454 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5990c8b61fe5439fb2ae91810d353225', 'request_id': 'req-0ac945bb-8e74-4b0c-b9b4-8d3e90eff454'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:39.314245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0ac945bb-8e74-4b0c-b9b4-8d3e90eff454 admin admin] The token cache is being invalidate because project 5990c8b61fe5439fb2ae91810d353225 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:10:39.314759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0ac945bb-8e74-4b0c-b9b4-8d3e90eff454 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:39.316254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0ac945bb-8e74-4b0c-b9b4-8d3e90eff454 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:39.320030 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1034/2073] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:10:38 2022] DELETE /identity/v3/projects/5990c8b61fe5439fb2ae91810d353225 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:39.323878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d3117-db4f-41a0-b449-eac7c8bff48f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:39.325956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d3117-db4f-41a0-b449-eac7c8bff48f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:39.327008 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d3117-db4f-41a0-b449-eac7c8bff48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:39.380663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-702d3117-db4f-41a0-b449-eac7c8bff48f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:39.384493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-702d3117-db4f-41a0-b449-eac7c8bff48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:39.403277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a11652-746b-4e2f-b55d-dec1b0168449 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:39.542985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0292b1f-dbf3-4cad-892b-38de966f5e33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:39.543626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0292b1f-dbf3-4cad-892b-38de966f5e33 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:39.543934 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0292b1f-dbf3-4cad-892b-38de966f5e33 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:39.544238 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0292b1f-dbf3-4cad-892b-38de966f5e33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:39.552454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e0292b1f-dbf3-4cad-892b-38de966f5e33 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:39.562317 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1035/2074] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:39.569201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d3117-db4f-41a0-b449-eac7c8bff48f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:39.571486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-702d3117-db4f-41a0-b449-eac7c8bff48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:39.585714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d3117-db4f-41a0-b449-eac7c8bff48f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:39.593253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e6459-211f-4da4-b456-e22f352e5a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:39.593924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e6459-211f-4da4-b456-e22f352e5a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:39.594211 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e6459-211f-4da4-b456-e22f352e5a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:39.594496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e6459-211f-4da4-b456-e22f352e5a86 admin admin] PATH_INFO: `/v3/projects/8329ceada8244e55b467957d108fc43b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:39.597486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e6459-211f-4da4-b456-e22f352e5a86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8329ceada8244e55b467957d108fc43b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:39.599206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e6459-211f-4da4-b456-e22f352e5a86 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:39.670267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0292b1f-dbf3-4cad-892b-38de966f5e33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:39.674578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0292b1f-dbf3-4cad-892b-38de966f5e33 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:39.689560 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1040/2075] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:10:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:10:39.690532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0292b1f-dbf3-4cad-892b-38de966f5e33 service swift] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:39.693522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e0292b1f-dbf3-4cad-892b-38de966f5e33 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:39.719182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0292b1f-dbf3-4cad-892b-38de966f5e33 service swift] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:39.728192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163e9e9-cb7d-4f96-81bc-3fb39516d217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:39.729545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163e9e9-cb7d-4f96-81bc-3fb39516d217 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:39.730288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163e9e9-cb7d-4f96-81bc-3fb39516d217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:39.730711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163e9e9-cb7d-4f96-81bc-3fb39516d217 admin admin] PATH_INFO: `/v3/projects/950b69a484c14cea9e621e7409e72fbc/users/be556fbd71b04f408dac0c12c6de69b8/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:39.761930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163e9e9-cb7d-4f96-81bc-3fb39516d217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=950b69a484c14cea9e621e7409e72fbc, user_id=be556fbd71b04f408dac0c12c6de69b8, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:39.766530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163e9e9-cb7d-4f96-81bc-3fb39516d217 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:39.787624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d00e6459-211f-4da4-b456-e22f352e5a86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8329ceada8244e55b467957d108fc43b', 'request_id': 'req-d00e6459-211f-4da4-b456-e22f352e5a86'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:39.791836 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1041/2076] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:10:39 2022] PUT /identity/v3/projects/950b69a484c14cea9e621e7409e72fbc/users/be556fbd71b04f408dac0c12c6de69b8/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:39.793591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380436b-8e2c-4201-84ce-b0e3365ef2ae None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:39.793963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380436b-8e2c-4201-84ce-b0e3365ef2ae None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:39.794239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380436b-8e2c-4201-84ce-b0e3365ef2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:39.800693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d00e6459-211f-4da4-b456-e22f352e5a86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8329ceada8244e55b467957d108fc43b', 'request_id': 'req-d00e6459-211f-4da4-b456-e22f352e5a86'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:39.813386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d00e6459-211f-4da4-b456-e22f352e5a86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8329ceada8244e55b467957d108fc43b', 'request_id': 'req-d00e6459-211f-4da4-b456-e22f352e5a86'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:39.821701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e380436b-8e2c-4201-84ce-b0e3365ef2ae None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:39.823196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e380436b-8e2c-4201-84ce-b0e3365ef2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:39.839782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d00e6459-211f-4da4-b456-e22f352e5a86 admin admin] The token cache is being invalidate because project 8329ceada8244e55b467957d108fc43b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:10:39.840215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d00e6459-211f-4da4-b456-e22f352e5a86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:39.841271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d00e6459-211f-4da4-b456-e22f352e5a86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:39.843305 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1036/2077] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:10:39 2022] DELETE /identity/v3/projects/8329ceada8244e55b467957d108fc43b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:39.844834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e6459-211f-4da4-b456-e22f352e5a86 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:39.850781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d00e6459-211f-4da4-b456-e22f352e5a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:39.857064 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:39.971056 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:40.085630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e6459-211f-4da4-b456-e22f352e5a86 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:40.104938 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1042/2078] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:40.106598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093233b-5285-4142-be89-668768829737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:40.107383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380436b-8e2c-4201-84ce-b0e3365ef2ae None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:40.108737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093233b-5285-4142-be89-668768829737 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:40.109026 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093233b-5285-4142-be89-668768829737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:40.109858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e380436b-8e2c-4201-84ce-b0e3365ef2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:40.110540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093233b-5285-4142-be89-668768829737 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:40.116581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093233b-5285-4142-be89-668768829737 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:10:40.116581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093233b-5285-4142-be89-668768829737 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:40.121502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093233b-5285-4142-be89-668768829737 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:40.151588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380436b-8e2c-4201-84ce-b0e3365ef2ae None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:40.166305 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1037/2079] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:10:40.166305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923708c-7d3b-4723-bf3a-cedf3056be27 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:40.166305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923708c-7d3b-4723-bf3a-cedf3056be27 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:40.166305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923708c-7d3b-4723-bf3a-cedf3056be27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:40.188009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfc1de-50a3-4162-90a9-e5a3cb1040e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:40.193379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfc1de-50a3-4162-90a9-e5a3cb1040e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:40.193688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfc1de-50a3-4162-90a9-e5a3cb1040e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:40.196790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfc1de-50a3-4162-90a9-e5a3cb1040e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:40.197526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-5923708c-7d3b-4723-bf3a-cedf3056be27 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:40.199190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5923708c-7d3b-4723-bf3a-cedf3056be27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:40.200712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dfc1de-50a3-4162-90a9-e5a3cb1040e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:40.207535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dfc1de-50a3-4162-90a9-e5a3cb1040e8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:40.228113 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1038/2080] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:40.228113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420c4eb-8478-4eef-88e1-4c6f31723f1c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:40.228113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420c4eb-8478-4eef-88e1-4c6f31723f1c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:40.228113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420c4eb-8478-4eef-88e1-4c6f31723f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:40.262248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2420c4eb-8478-4eef-88e1-4c6f31723f1c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:40.263506 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2420c4eb-8478-4eef-88e1-4c6f31723f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:40.279339 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1043/2081] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:40.279339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710a93b-fce4-42df-802d-5f50af8a52e6 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:40.279339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710a93b-fce4-42df-802d-5f50af8a52e6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:40.280299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710a93b-fce4-42df-802d-5f50af8a52e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:40.287358 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1039/2082] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:40.288434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420c4eb-8478-4eef-88e1-4c6f31723f1c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:40.301622 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420c4eb-8478-4eef-88e1-4c6f31723f1c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:40.313289 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0d540-3346-4b08-b04d-c40a26d7c440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:40.313919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0d540-3346-4b08-b04d-c40a26d7c440 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:40.314232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0d540-3346-4b08-b04d-c40a26d7c440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:40.314651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0d540-3346-4b08-b04d-c40a26d7c440 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:40.315368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0d540-3346-4b08-b04d-c40a26d7c440 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:40.321600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0d540-3346-4b08-b04d-c40a26d7c440 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:40.324914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b710a93b-fce4-42df-802d-5f50af8a52e6 None None] MFA Rules not processed for user `40fc46029deb4b92819a6c76a6eaae32`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:40.327244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b710a93b-fce4-42df-802d-5f50af8a52e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:40.386069 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1040/2083] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:10:40 2022] POST /identity/v3/projects => generated 403 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:40.395001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6abfc0-d8cc-4359-959e-71d02fed2a04 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:40.395156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6abfc0-d8cc-4359-959e-71d02fed2a04 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:40.396242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6abfc0-d8cc-4359-959e-71d02fed2a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:40.435180 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1b6abfc0-d8cc-4359-959e-71d02fed2a04 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:40.438415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1b6abfc0-d8cc-4359-959e-71d02fed2a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:40.561882 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1044/2084] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:40.567544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710a93b-fce4-42df-802d-5f50af8a52e6 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:40.619398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710a93b-fce4-42df-802d-5f50af8a52e6 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:40.681918 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1041/2085] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:40.681918 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6abfc0-d8cc-4359-959e-71d02fed2a04 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:40.727374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6abfc0-d8cc-4359-959e-71d02fed2a04 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:40.739178 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f8a77-bdb2-4ac7-8964-136c537b2549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:40.740018 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f8a77-bdb2-4ac7-8964-136c537b2549 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:40.740327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f8a77-bdb2-4ac7-8964-136c537b2549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:40.740651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f8a77-bdb2-4ac7-8964-136c537b2549 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:40.741379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f8a77-bdb2-4ac7-8964-136c537b2549 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:10:40.741680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f8a77-bdb2-4ac7-8964-136c537b2549 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:40.746847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f8a77-bdb2-4ac7-8964-136c537b2549 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:40.783755 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1042/2086] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:10:40.785376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f8a77-bdb2-4ac7-8964-136c537b2549 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:40.819996 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e680d-f5fb-4b44-ae41-4ad0a7b71a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:40.820418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f8a77-bdb2-4ac7-8964-136c537b2549 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:40.821103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e680d-f5fb-4b44-ae41-4ad0a7b71a37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:40.821103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e680d-f5fb-4b44-ae41-4ad0a7b71a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:40.828039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e680d-f5fb-4b44-ae41-4ad0a7b71a37 admin admin] PATH_INFO: `/v3/projects/950b69a484c14cea9e621e7409e72fbc/users/be556fbd71b04f408dac0c12c6de69b8/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:40.828330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e61553-3d13-48f3-bf33-bb6e01faeaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:40.828833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e680d-f5fb-4b44-ae41-4ad0a7b71a37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=950b69a484c14cea9e621e7409e72fbc, user_id=be556fbd71b04f408dac0c12c6de69b8, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:40.829220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e61553-3d13-48f3-bf33-bb6e01faeaee admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:40.829699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e61553-3d13-48f3-bf33-bb6e01faeaee admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:40.830146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e61553-3d13-48f3-bf33-bb6e01faeaee admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:40.831342 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e61553-3d13-48f3-bf33-bb6e01faeaee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:40.834784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e680d-f5fb-4b44-ae41-4ad0a7b71a37 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:40.835121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e61553-3d13-48f3-bf33-bb6e01faeaee admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:40.882935 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1045/2087] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:10:40 2022] PUT /identity/v3/projects/950b69a484c14cea9e621e7409e72fbc/users/be556fbd71b04f408dac0c12c6de69b8/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:40.884735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e680d-f5fb-4b44-ae41-4ad0a7b71a37 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:40.924484 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1043/2088] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:10:40 2022] POST /identity/v3/users => generated 302 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:40.924484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e61553-3d13-48f3-bf33-bb6e01faeaee admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:40.952190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e61553-3d13-48f3-bf33-bb6e01faeaee admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:41.112908 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:41.162747 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e680d-f5fb-4b44-ae41-4ad0a7b71a37 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:41.177050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcb597-ddbe-496e-9d84-1ba858f22e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:41.178464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcb597-ddbe-496e-9d84-1ba858f22e34 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:41.181144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcb597-ddbe-496e-9d84-1ba858f22e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:41.183074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcb597-ddbe-496e-9d84-1ba858f22e34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:41.187656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bcb597-ddbe-496e-9d84-1ba858f22e34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:10:41.188681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bcb597-ddbe-496e-9d84-1ba858f22e34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:41.193633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bcb597-ddbe-496e-9d84-1ba858f22e34 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:41.237514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2df86-b656-43b0-b591-a68b7ce5b22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:41.243424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2df86-b656-43b0-b591-a68b7ce5b22c admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:41.245643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2df86-b656-43b0-b591-a68b7ce5b22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:41.248001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2df86-b656-43b0-b591-a68b7ce5b22c admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:41.251218 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1046/2089] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:10:41.253446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2df86-b656-43b0-b591-a68b7ce5b22c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:41.263283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2df86-b656-43b0-b591-a68b7ce5b22c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:41.267905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5234c4d-b515-4c92-959f-2060216b67cd None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:41.268760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5234c4d-b515-4c92-959f-2060216b67cd None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:41.269389 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5234c4d-b515-4c92-959f-2060216b67cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:41.324651 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:41.384157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a5234c4d-b515-4c92-959f-2060216b67cd None None] MFA Rules not processed for user `be556fbd71b04f408dac0c12c6de69b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:41.387286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a5234c4d-b515-4c92-959f-2060216b67cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:41.428488 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1044/2090] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:10:40 2022] POST /identity/v3/projects => generated 391 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:41.428674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2df86-b656-43b0-b591-a68b7ce5b22c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:41.513433 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1047/2091] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:41 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:41.515198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5234c4d-b515-4c92-959f-2060216b67cd None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:41.538901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5234c4d-b515-4c92-959f-2060216b67cd None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:41.692543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2df86-b656-43b0-b591-a68b7ce5b22c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:41.706795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c7441-e5d0-4208-83f2-e747a3fcf69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:41.710237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c7441-e5d0-4208-83f2-e747a3fcf69c admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:41.710237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c7441-e5d0-4208-83f2-e747a3fcf69c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:41.717393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c7441-e5d0-4208-83f2-e747a3fcf69c admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:41.717393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c7441-e5d0-4208-83f2-e747a3fcf69c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:41.717393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c7441-e5d0-4208-83f2-e747a3fcf69c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:41.746480 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1045/2092] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:41.748687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c7441-e5d0-4208-83f2-e747a3fcf69c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:41.768860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c7441-e5d0-4208-83f2-e747a3fcf69c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:41.774702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42cb0fa-9b44-40de-aa18-86e3084f33e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:41.776020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cb0fa-9b44-40de-aa18-86e3084f33e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:41.776607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cb0fa-9b44-40de-aa18-86e3084f33e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:41.777096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cb0fa-9b44-40de-aa18-86e3084f33e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:41.777426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764428da-e02a-4133-8719-665e155a021c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:41.778379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42cb0fa-9b44-40de-aa18-86e3084f33e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:41.779530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764428da-e02a-4133-8719-665e155a021c admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:41.782064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764428da-e02a-4133-8719-665e155a021c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:41.782381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42cb0fa-9b44-40de-aa18-86e3084f33e1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:41.783056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764428da-e02a-4133-8719-665e155a021c admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:41.784983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764428da-e02a-4133-8719-665e155a021c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:41.793518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764428da-e02a-4133-8719-665e155a021c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:41.870429 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1046/2093] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:10:41 2022] POST /identity/v3/users => generated 296 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:41.872344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764428da-e02a-4133-8719-665e155a021c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:41.875389 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1048/2094] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:10:41 2022] POST /identity/v3/projects => generated 389 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:41.880484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c55ff0-7f2e-41ad-b03d-0f93d4414d44 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:41.881481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c55ff0-7f2e-41ad-b03d-0f93d4414d44 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:41.883016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c55ff0-7f2e-41ad-b03d-0f93d4414d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:41.888451 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-764428da-e02a-4133-8719-665e155a021c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:41.945510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f4c55ff0-7f2e-41ad-b03d-0f93d4414d44 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:41.953227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f4c55ff0-7f2e-41ad-b03d-0f93d4414d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:42.143280 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:42.181964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764428da-e02a-4133-8719-665e155a021c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:42.183957 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1049/2095] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:10:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:42.197011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c55ff0-7f2e-41ad-b03d-0f93d4414d44 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:42.480860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df184f6-5db8-4e48-ac4f-14296888a2e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:42.483863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df184f6-5db8-4e48-ac4f-14296888a2e2 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:42.485877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df184f6-5db8-4e48-ac4f-14296888a2e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:42.486194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df184f6-5db8-4e48-ac4f-14296888a2e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:42.487409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c55ff0-7f2e-41ad-b03d-0f93d4414d44 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:42.496626 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:42.496904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a9c0f-9cc7-4df8-bc90-60c9d43e1eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:42.498009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a9c0f-9cc7-4df8-bc90-60c9d43e1eec admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:42.508615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a9c0f-9cc7-4df8-bc90-60c9d43e1eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:42.509218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a9c0f-9cc7-4df8-bc90-60c9d43e1eec admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:42.510590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a9c0f-9cc7-4df8-bc90-60c9d43e1eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:42.519080 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a9c0f-9cc7-4df8-bc90-60c9d43e1eec admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:42.557899 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1050/2096] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:42.568459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a9c0f-9cc7-4df8-bc90-60c9d43e1eec admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:42.598881 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a9c0f-9cc7-4df8-bc90-60c9d43e1eec admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:42.631091 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df184f6-5db8-4e48-ac4f-14296888a2e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:42.631590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c198b4-7e3a-4a72-8dd0-136cac7176ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:42.632687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c198b4-7e3a-4a72-8dd0-136cac7176ca admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:42.634665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df184f6-5db8-4e48-ac4f-14296888a2e2 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:42.639745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c198b4-7e3a-4a72-8dd0-136cac7176ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:42.640203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c198b4-7e3a-4a72-8dd0-136cac7176ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:42.641427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c198b4-7e3a-4a72-8dd0-136cac7176ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:42.650963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c198b4-7e3a-4a72-8dd0-136cac7176ca admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:42.660688 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1047/2097] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:41 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 790 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:42.662720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df184f6-5db8-4e48-ac4f-14296888a2e2 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:42.689201 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1051/2098] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:42.690355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df184f6-5db8-4e48-ac4f-14296888a2e2 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:42.690835 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c198b4-7e3a-4a72-8dd0-136cac7176ca admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:42.695551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a8c198b4-7e3a-4a72-8dd0-136cac7176ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:42.708402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14fb2e-ae51-4229-be4d-4ea704944d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:42.709557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14fb2e-ae51-4229-be4d-4ea704944d1f admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:42.710070 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14fb2e-ae51-4229-be4d-4ea704944d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:42.710556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14fb2e-ae51-4229-be4d-4ea704944d1f admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:42.712376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14fb2e-ae51-4229-be4d-4ea704944d1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:42.716551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14fb2e-ae51-4229-be4d-4ea704944d1f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:42.805529 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1048/2099] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:10:42 2022] POST /identity/v3/users => generated 295 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:42.807587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14fb2e-ae51-4229-be4d-4ea704944d1f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:42.829075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14fb2e-ae51-4229-be4d-4ea704944d1f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:42.839333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bb5ec-ebad-4299-850e-a98dfece6cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:42.840843 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bb5ec-ebad-4299-850e-a98dfece6cc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:42.841530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bb5ec-ebad-4299-850e-a98dfece6cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:42.842191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bb5ec-ebad-4299-850e-a98dfece6cc2 admin admin] PATH_INFO: `/v3/projects/6a06211ba44e4f6d88f9095969001aab/users/96d08a2479f847b4b06d6690f1aedb18/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:42.865452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c198b4-7e3a-4a72-8dd0-136cac7176ca admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:42.875668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a48be0-e382-4dec-85a1-fe6c2a8dfa68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:42.877620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a48be0-e382-4dec-85a1-fe6c2a8dfa68 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:42.877878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742bb5ec-ebad-4299-850e-a98dfece6cc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a06211ba44e4f6d88f9095969001aab, user_id=96d08a2479f847b4b06d6690f1aedb18, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:42.880267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a48be0-e382-4dec-85a1-fe6c2a8dfa68 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:42.881244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a48be0-e382-4dec-85a1-fe6c2a8dfa68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:42.883835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742bb5ec-ebad-4299-850e-a98dfece6cc2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:42.907668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a48be0-e382-4dec-85a1-fe6c2a8dfa68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:42.909717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a48be0-e382-4dec-85a1-fe6c2a8dfa68 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:42.924300 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1049/2100] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:10:42 2022] PUT /identity/v3/projects/6a06211ba44e4f6d88f9095969001aab/users/96d08a2479f847b4b06d6690f1aedb18/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:42.926530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bb5ec-ebad-4299-850e-a98dfece6cc2 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:42.972854 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1052/2101] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:10:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:10:42.974809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a48be0-e382-4dec-85a1-fe6c2a8dfa68 service swift] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:43.067645 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a48be0-e382-4dec-85a1-fe6c2a8dfa68 service swift] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:43.272633 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bb5ec-ebad-4299-850e-a98dfece6cc2 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:43.293928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcdb8b3-0960-4872-9f86-317fbd9f28ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:43.294804 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdb8b3-0960-4872-9f86-317fbd9f28ce admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:43.294990 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdb8b3-0960-4872-9f86-317fbd9f28ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:43.297794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdb8b3-0960-4872-9f86-317fbd9f28ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:43.302883 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcdb8b3-0960-4872-9f86-317fbd9f28ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:43.307025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcdb8b3-0960-4872-9f86-317fbd9f28ce admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:43.348541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5eff58-dfa2-4511-a24a-1fc0f8cd09eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:43.349470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5eff58-dfa2-4511-a24a-1fc0f8cd09eb service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:43.349470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5eff58-dfa2-4511-a24a-1fc0f8cd09eb service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:43.349787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5eff58-dfa2-4511-a24a-1fc0f8cd09eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:43.353394 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7f5eff58-dfa2-4511-a24a-1fc0f8cd09eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:43.368313 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:43.369534 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1050/2102] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:43.372364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcdb8b3-0960-4872-9f86-317fbd9f28ce admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:43.399743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcdb8b3-0960-4872-9f86-317fbd9f28ce admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:43.409406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ec4d4-0d72-4dec-910f-366082924e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:43.411004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ec4d4-0d72-4dec-910f-366082924e3a admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:43.411796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ec4d4-0d72-4dec-910f-366082924e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:43.412776 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ec4d4-0d72-4dec-910f-366082924e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:43.414636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ec4d4-0d72-4dec-910f-366082924e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:43.420285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ec4d4-0d72-4dec-910f-366082924e3a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:43.442518 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1051/2103] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:43.444419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a222b-392e-4a69-9c6b-0cb5bb5ddae1 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:43.444932 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a222b-392e-4a69-9c6b-0cb5bb5ddae1 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:43.445917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a222b-392e-4a69-9c6b-0cb5bb5ddae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:43.474394 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-bc7a222b-392e-4a69-9c6b-0cb5bb5ddae1 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:43.476079 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bc7a222b-392e-4a69-9c6b-0cb5bb5ddae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:43.483208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5eff58-dfa2-4511-a24a-1fc0f8cd09eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:43.490011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5eff58-dfa2-4511-a24a-1fc0f8cd09eb service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:43.505082 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1052/2104] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:43.508478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123c18a-4b26-4cc1-be36-9e1f8a93df56 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:43.508930 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123c18a-4b26-4cc1-be36-9e1f8a93df56 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:43.509395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123c18a-4b26-4cc1-be36-9e1f8a93df56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:43.543764 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1053/2105] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:42 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:43.545688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5eff58-dfa2-4511-a24a-1fc0f8cd09eb service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:43.552385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7f5eff58-dfa2-4511-a24a-1fc0f8cd09eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:43.590943 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-8123c18a-4b26-4cc1-be36-9e1f8a93df56 None None] MFA Rules not processed for user `38ed89a4458f4f23aaf725706c2d027b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:43.598351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8123c18a-4b26-4cc1-be36-9e1f8a93df56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:43.603593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5eff58-dfa2-4511-a24a-1fc0f8cd09eb service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:43.626827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64aee2-432f-4253-a532-417f7722eced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:43.627702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64aee2-432f-4253-a532-417f7722eced admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:43.628347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64aee2-432f-4253-a532-417f7722eced admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:43.628882 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64aee2-432f-4253-a532-417f7722eced admin admin] PATH_INFO: `/v3/users/40fc46029deb4b92819a6c76a6eaae32` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:43.631202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64aee2-432f-4253-a532-417f7722eced admin admin] RBAC: Authorizing `identity:delete_user(user_id=40fc46029deb4b92819a6c76a6eaae32)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:43.637967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64aee2-432f-4253-a532-417f7722eced admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:43.654232 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:43.723800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9a64aee2-432f-4253-a532-417f7722eced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40fc46029deb4b92819a6c76a6eaae32'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:43.737468 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9a64aee2-432f-4253-a532-417f7722eced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40fc46029deb4b92819a6c76a6eaae32'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:43.772370 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9a64aee2-432f-4253-a532-417f7722eced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40fc46029deb4b92819a6c76a6eaae32'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:43.774680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9a64aee2-432f-4253-a532-417f7722eced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40fc46029deb4b92819a6c76a6eaae32'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:43.787375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9a64aee2-432f-4253-a532-417f7722eced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40fc46029deb4b92819a6c76a6eaae32'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:43.799343 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1053/2106] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:43.801384 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1054/2107] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:10:43 2022] DELETE /identity/v3/users/40fc46029deb4b92819a6c76a6eaae32 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:43.806991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64aee2-432f-4253-a532-417f7722eced admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:43.808232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123c18a-4b26-4cc1-be36-9e1f8a93df56 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:43.809975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9a64aee2-432f-4253-a532-417f7722eced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:43.860387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123c18a-4b26-4cc1-be36-9e1f8a93df56 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:43.912979 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64aee2-432f-4253-a532-417f7722eced admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:43.925531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db84fa9-8e44-459c-aded-5f497a46ac78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:43.926821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db84fa9-8e44-459c-aded-5f497a46ac78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:43.927462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db84fa9-8e44-459c-aded-5f497a46ac78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:43.927990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db84fa9-8e44-459c-aded-5f497a46ac78 admin admin] PATH_INFO: `/v3/projects/01a04222bcde49e59e746386b54d90a0/users/852b7ed92928432db151af35a713a77b/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:43.957394 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db84fa9-8e44-459c-aded-5f497a46ac78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01a04222bcde49e59e746386b54d90a0, user_id=852b7ed92928432db151af35a713a77b, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:43.963626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db84fa9-8e44-459c-aded-5f497a46ac78 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:44.011200 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1055/2108] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:10:43 2022] PUT /identity/v3/projects/01a04222bcde49e59e746386b54d90a0/users/852b7ed92928432db151af35a713a77b/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:44.011200 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db84fa9-8e44-459c-aded-5f497a46ac78 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:44.016245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8db84fa9-8e44-459c-aded-5f497a46ac78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:44.029625 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:44.079386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141ecab-b2d8-42d9-a887-9531b7ed44dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:44.083967 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141ecab-b2d8-42d9-a887-9531b7ed44dd admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:44.084548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141ecab-b2d8-42d9-a887-9531b7ed44dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:44.085111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d141ecab-b2d8-42d9-a887-9531b7ed44dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:44.087153 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d141ecab-b2d8-42d9-a887-9531b7ed44dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:44.104291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d141ecab-b2d8-42d9-a887-9531b7ed44dd admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:44.140210 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1054/2109] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:43 2022] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:44.142215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141ecab-b2d8-42d9-a887-9531b7ed44dd admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:44.145027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d141ecab-b2d8-42d9-a887-9531b7ed44dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:44.173162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d141ecab-b2d8-42d9-a887-9531b7ed44dd admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:44.194539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db84fa9-8e44-459c-aded-5f497a46ac78 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:44.214720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a3d08-5b1d-4ae4-b1cc-dfda4f3a465a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:44.217383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a3d08-5b1d-4ae4-b1cc-dfda4f3a465a service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:44.217854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a3d08-5b1d-4ae4-b1cc-dfda4f3a465a service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:44.218360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a3d08-5b1d-4ae4-b1cc-dfda4f3a465a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:44.222491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-448a3d08-5b1d-4ae4-b1cc-dfda4f3a465a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:44.357365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c619758-8dd8-4fcc-baff-d137ce5da1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:44.358677 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c619758-8dd8-4fcc-baff-d137ce5da1dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:44.359174 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c619758-8dd8-4fcc-baff-d137ce5da1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:44.359651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c619758-8dd8-4fcc-baff-d137ce5da1dc admin admin] PATH_INFO: `/v3/users/600c5ba5ceed46f195a8a97325f0ac96` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:44.371195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c619758-8dd8-4fcc-baff-d137ce5da1dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=600c5ba5ceed46f195a8a97325f0ac96)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:44.376237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c619758-8dd8-4fcc-baff-d137ce5da1dc admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:44.413509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a3d08-5b1d-4ae4-b1cc-dfda4f3a465a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:44.417259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a3d08-5b1d-4ae4-b1cc-dfda4f3a465a service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:44.441708 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1056/2110] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:44.444011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4aa05-0bbb-421b-aebb-dff7982ae160 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:44.444497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4aa05-0bbb-421b-aebb-dff7982ae160 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:44.444981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4aa05-0bbb-421b-aebb-dff7982ae160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:44.581184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0fc4aa05-0bbb-421b-aebb-dff7982ae160 None None] MFA Rules not processed for user `7e9dce42ff994d81b1ad6d6c05356c37`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:44.584391 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0fc4aa05-0bbb-421b-aebb-dff7982ae160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:44.603964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9c619758-8dd8-4fcc-baff-d137ce5da1dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '600c5ba5ceed46f195a8a97325f0ac96'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:44.628386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9c619758-8dd8-4fcc-baff-d137ce5da1dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '600c5ba5ceed46f195a8a97325f0ac96'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:44.655987 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:44.699073 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9c619758-8dd8-4fcc-baff-d137ce5da1dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '600c5ba5ceed46f195a8a97325f0ac96'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:44.705004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9c619758-8dd8-4fcc-baff-d137ce5da1dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '600c5ba5ceed46f195a8a97325f0ac96'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:44.740673 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9c619758-8dd8-4fcc-baff-d137ce5da1dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '600c5ba5ceed46f195a8a97325f0ac96'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:44.782323 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1055/2111] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:10:44 2022] DELETE /identity/v3/users/600c5ba5ceed46f195a8a97325f0ac96 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:44.785534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcfe9c-0986-4736-980c-e6b6be31b63f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:44.786480 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcfe9c-0986-4736-980c-e6b6be31b63f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:44.792031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcfe9c-0986-4736-980c-e6b6be31b63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:44.839366 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1057/2112] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:44.839366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae86cc-c865-4576-856c-c44b0c5bec2e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:44.839366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae86cc-c865-4576-856c-c44b0c5bec2e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:44.839366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae86cc-c865-4576-856c-c44b0c5bec2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:44.934467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b9dcfe9c-0986-4736-980c-e6b6be31b63f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:44.942013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b9dcfe9c-0986-4736-980c-e6b6be31b63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:44.949901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-19ae86cc-c865-4576-856c-c44b0c5bec2e None None] MFA Rules not processed for user `0327f14a188e45fba98a58e5fd061248`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:44.953976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-19ae86cc-c865-4576-856c-c44b0c5bec2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:45.132794 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:45.152088 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1056/2113] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:45.153500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef9a33-b3ac-42de-830c-d7551bf56f3f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:45.153823 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef9a33-b3ac-42de-830c-d7551bf56f3f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:45.154242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef9a33-b3ac-42de-830c-d7551bf56f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:45.219184 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1058/2114] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:45.219184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae86cc-c865-4576-856c-c44b0c5bec2e None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:45.228191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-19ae86cc-c865-4576-856c-c44b0c5bec2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:45.237195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e8ef9a33-b3ac-42de-830c-d7551bf56f3f None None] MFA Rules not processed for user `852b7ed92928432db151af35a713a77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:45.238598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e8ef9a33-b3ac-42de-830c-d7551bf56f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:45.257519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae86cc-c865-4576-856c-c44b0c5bec2e None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:45.268857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891e67f-62d2-4332-a49e-0b7e351d9e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:45.272289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891e67f-62d2-4332-a49e-0b7e351d9e18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:45.273318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891e67f-62d2-4332-a49e-0b7e351d9e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:45.273318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891e67f-62d2-4332-a49e-0b7e351d9e18 admin admin] PATH_INFO: `/v3/projects/f7cb02b703124a7bb199b9a798f1beb0/users/8e897f44489c4006a81baa41ca1d5a1e/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:45.335453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891e67f-62d2-4332-a49e-0b7e351d9e18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7cb02b703124a7bb199b9a798f1beb0, user_id=8e897f44489c4006a81baa41ca1d5a1e, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:45.347512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891e67f-62d2-4332-a49e-0b7e351d9e18 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:45.394641 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1059/2115] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:10:45 2022] PUT /identity/v3/projects/f7cb02b703124a7bb199b9a798f1beb0/users/8e897f44489c4006a81baa41ca1d5a1e/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:45.397219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df637b-9bea-4f9f-ac7a-90fb1ce6d2a0 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:45.397690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df637b-9bea-4f9f-ac7a-90fb1ce6d2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:45.398164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df637b-9bea-4f9f-ac7a-90fb1ce6d2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:45.467532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b7df637b-9bea-4f9f-ac7a-90fb1ce6d2a0 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:45.468899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b7df637b-9bea-4f9f-ac7a-90fb1ce6d2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:45.549431 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1057/2116] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:45 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:45.552275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef9a33-b3ac-42de-830c-d7551bf56f3f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:45.556522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e8ef9a33-b3ac-42de-830c-d7551bf56f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:45.588812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef9a33-b3ac-42de-830c-d7551bf56f3f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:45.683713 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1060/2117] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:45.685661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df637b-9bea-4f9f-ac7a-90fb1ce6d2a0 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:45.689068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b7df637b-9bea-4f9f-ac7a-90fb1ce6d2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:45.818170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c932b7c-0878-430e-8857-e5f65b148352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:45.819622 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c932b7c-0878-430e-8857-e5f65b148352 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:45.820131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c932b7c-0878-430e-8857-e5f65b148352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:45.820573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c932b7c-0878-430e-8857-e5f65b148352 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:45.823836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df637b-9bea-4f9f-ac7a-90fb1ce6d2a0 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:45.836595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f5d52-3217-48ad-bece-61c7d15a8f3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:45.837813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f5d52-3217-48ad-bece-61c7d15a8f3a service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:45.838480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f5d52-3217-48ad-bece-61c7d15a8f3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:45.838898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f5d52-3217-48ad-bece-61c7d15a8f3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:45.839489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c932b7c-0878-430e-8857-e5f65b148352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:45.845278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c932b7c-0878-430e-8857-e5f65b148352 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:45.871211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f5d52-3217-48ad-bece-61c7d15a8f3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:45.873838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f5d52-3217-48ad-bece-61c7d15a8f3a service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:45.897840 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1061/2118] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:45.900413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f5d52-3217-48ad-bece-61c7d15a8f3a service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:45.904156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-431f5d52-3217-48ad-bece-61c7d15a8f3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:45.930911 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:45.981066 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1058/2119] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:10:45 2022] POST /identity/v3/projects => generated 385 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:45.996218 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54231720-7b4f-4608-a8bc-411c0f778676 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:46.000896 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54231720-7b4f-4608-a8bc-411c0f778676 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:46.001658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54231720-7b4f-4608-a8bc-411c0f778676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:46.120793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-54231720-7b4f-4608-a8bc-411c0f778676 None None] MFA Rules not processed for user `8e897f44489c4006a81baa41ca1d5a1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:46.127360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-54231720-7b4f-4608-a8bc-411c0f778676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:46.131393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f5d52-3217-48ad-bece-61c7d15a8f3a service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:46.142066 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:46.356374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebab2e8-1c10-4ded-93a3-d3076ab7c20b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:46.357492 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebab2e8-1c10-4ded-93a3-d3076ab7c20b service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:46.365885 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebab2e8-1c10-4ded-93a3-d3076ab7c20b service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:46.366505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebab2e8-1c10-4ded-93a3-d3076ab7c20b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:46.386603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3ebab2e8-1c10-4ded-93a3-d3076ab7c20b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:46.406934 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1059/2120] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:46.412953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54231720-7b4f-4608-a8bc-411c0f778676 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:46.419249 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-54231720-7b4f-4608-a8bc-411c0f778676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:46.574921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebab2e8-1c10-4ded-93a3-d3076ab7c20b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:46.578707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebab2e8-1c10-4ded-93a3-d3076ab7c20b service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:46.604951 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1062/2121] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 706 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:46.606877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebab2e8-1c10-4ded-93a3-d3076ab7c20b service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:46.610672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3ebab2e8-1c10-4ded-93a3-d3076ab7c20b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:46.831341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebab2e8-1c10-4ded-93a3-d3076ab7c20b service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:46.848689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed3d78-784c-4625-b725-3e54ad75d464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:46.849820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed3d78-784c-4625-b725-3e54ad75d464 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:46.850276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed3d78-784c-4625-b725-3e54ad75d464 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:46.850747 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed3d78-784c-4625-b725-3e54ad75d464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:46.858797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54231720-7b4f-4608-a8bc-411c0f778676 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:46.878857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e726b-5464-4d23-8893-c8c090a03b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:46.882422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e726b-5464-4d23-8893-c8c090a03b89 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:46.883133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e726b-5464-4d23-8893-c8c090a03b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:46.884045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e726b-5464-4d23-8893-c8c090a03b89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:46.887042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e726b-5464-4d23-8893-c8c090a03b89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:46.898049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e726b-5464-4d23-8893-c8c090a03b89 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:46.911257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed3d78-784c-4625-b725-3e54ad75d464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:46.921057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed3d78-784c-4625-b725-3e54ad75d464 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:46.991728 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1060/2122] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:10:46 2022] POST /identity/v3/projects => generated 393 bytes in 577 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:46.991728 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e726b-5464-4d23-8893-c8c090a03b89 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:47.017019 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1063/2123] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:47.019507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed3d78-784c-4625-b725-3e54ad75d464 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:47.045512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed3d78-784c-4625-b725-3e54ad75d464 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:47.174969 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:47.226183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d48d15-d5f0-4312-9c3b-be867a0af1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:47.227006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d48d15-d5f0-4312-9c3b-be867a0af1ba admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:47.229701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d48d15-d5f0-4312-9c3b-be867a0af1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:47.229898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d48d15-d5f0-4312-9c3b-be867a0af1ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:47.232458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d48d15-d5f0-4312-9c3b-be867a0af1ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:47.240822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d48d15-d5f0-4312-9c3b-be867a0af1ba admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:47.348591 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e726b-5464-4d23-8893-c8c090a03b89 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:47.368444 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1064/2124] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:10:47 2022] POST /identity/v3/projects => generated 389 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:47.377340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d48d15-d5f0-4312-9c3b-be867a0af1ba admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:47.386502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879909da-3794-4120-9658-8676e28b2e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:47.387569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879909da-3794-4120-9658-8676e28b2e4f admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:47.388127 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879909da-3794-4120-9658-8676e28b2e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:47.388586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879909da-3794-4120-9658-8676e28b2e4f admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:47.389668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879909da-3794-4120-9658-8676e28b2e4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:47.399356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879909da-3794-4120-9658-8676e28b2e4f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:47.471704 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:47.500926 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1061/2125] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:10:46 2022] POST /identity/v3/users => generated 299 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:47.500926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879909da-3794-4120-9658-8676e28b2e4f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:47.532923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879909da-3794-4120-9658-8676e28b2e4f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:47.592307 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d48d15-d5f0-4312-9c3b-be867a0af1ba admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:47.608385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeea1d6-1a76-4a1b-9652-993c5e1912a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:47.609303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeea1d6-1a76-4a1b-9652-993c5e1912a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:47.609719 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeea1d6-1a76-4a1b-9652-993c5e1912a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:47.610118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeea1d6-1a76-4a1b-9652-993c5e1912a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:47.610900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeea1d6-1a76-4a1b-9652-993c5e1912a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:47.613128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeea1d6-1a76-4a1b-9652-993c5e1912a8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:47.669172 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1065/2126] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:10:47 2022] POST /identity/v3/users => generated 303 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:47.669656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeea1d6-1a76-4a1b-9652-993c5e1912a8 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:47.693117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeea1d6-1a76-4a1b-9652-993c5e1912a8 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:47.708790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2ec5e-3e60-40ca-a23f-57068088a1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:47.709643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2ec5e-3e60-40ca-a23f-57068088a1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:47.710091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2ec5e-3e60-40ca-a23f-57068088a1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:47.710441 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa2ec5e-3e60-40ca-a23f-57068088a1e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:47.712260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2ec5e-3e60-40ca-a23f-57068088a1e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:47.723631 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa2ec5e-3e60-40ca-a23f-57068088a1e3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:47.755447 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1066/2127] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:47.760349 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2ec5e-3e60-40ca-a23f-57068088a1e3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:47.783853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa2ec5e-3e60-40ca-a23f-57068088a1e3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:47.798071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25014ec-e96a-4147-9c07-f3af6636ae01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:47.799259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25014ec-e96a-4147-9c07-f3af6636ae01 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:47.799784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25014ec-e96a-4147-9c07-f3af6636ae01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:47.800725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25014ec-e96a-4147-9c07-f3af6636ae01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:47.801482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25014ec-e96a-4147-9c07-f3af6636ae01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:47.810496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25014ec-e96a-4147-9c07-f3af6636ae01 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:47.818163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbeaa4f-5d29-4a8c-8a1b-aa0c06693047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:47.819853 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbeaa4f-5d29-4a8c-8a1b-aa0c06693047 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:47.821180 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbeaa4f-5d29-4a8c-8a1b-aa0c06693047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:47.821933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbeaa4f-5d29-4a8c-8a1b-aa0c06693047 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:47.823450 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbeaa4f-5d29-4a8c-8a1b-aa0c06693047 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:47.831565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbeaa4f-5d29-4a8c-8a1b-aa0c06693047 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:47.854710 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1067/2128] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:47.859110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25014ec-e96a-4147-9c07-f3af6636ae01 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:47.889345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25014ec-e96a-4147-9c07-f3af6636ae01 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:47.912392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0c88d-6ce5-478d-b092-55fa23e1294f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:47.914545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0c88d-6ce5-478d-b092-55fa23e1294f admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:47.915037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0c88d-6ce5-478d-b092-55fa23e1294f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:47.915453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0c88d-6ce5-478d-b092-55fa23e1294f admin admin] PATH_INFO: `/v3/projects/d5ea429307984908b718fa99c7391fb4/users/48ba57d381ee4569b9bce256d01bc5c6/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:47.934281 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1062/2129] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:10:47 2022] POST /identity/v3/users => generated 301 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:47.936655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbeaa4f-5d29-4a8c-8a1b-aa0c06693047 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:47.959719 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0c88d-6ce5-478d-b092-55fa23e1294f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5ea429307984908b718fa99c7391fb4, user_id=48ba57d381ee4569b9bce256d01bc5c6, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:47.963760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0c88d-6ce5-478d-b092-55fa23e1294f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:48.000756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbeaa4f-5d29-4a8c-8a1b-aa0c06693047 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:48.012561 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1068/2130] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:10:47 2022] PUT /identity/v3/projects/d5ea429307984908b718fa99c7391fb4/users/48ba57d381ee4569b9bce256d01bc5c6/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:48.013639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0c88d-6ce5-478d-b092-55fa23e1294f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:48.231997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c37bb4-e1a7-4102-a771-80b0be1cfd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:48.233659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c37bb4-e1a7-4102-a771-80b0be1cfd8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:48.234386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c37bb4-e1a7-4102-a771-80b0be1cfd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:48.235064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c37bb4-e1a7-4102-a771-80b0be1cfd8d admin admin] PATH_INFO: `/v3/projects/ffca783753d8464da99a508374e3551c/users/1d41b32b2deb4713841afe180277b8f3/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:48.236650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0c88d-6ce5-478d-b092-55fa23e1294f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:48.259416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99430fbc-4f0d-48f7-a0f8-6a1c0947ae3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:48.260261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99430fbc-4f0d-48f7-a0f8-6a1c0947ae3f admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:48.260647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99430fbc-4f0d-48f7-a0f8-6a1c0947ae3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:48.261026 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99430fbc-4f0d-48f7-a0f8-6a1c0947ae3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:48.261826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99430fbc-4f0d-48f7-a0f8-6a1c0947ae3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:48.264095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99430fbc-4f0d-48f7-a0f8-6a1c0947ae3f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:48.301200 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1069/2131] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:48.305952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99430fbc-4f0d-48f7-a0f8-6a1c0947ae3f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:48.306244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c37bb4-e1a7-4102-a771-80b0be1cfd8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffca783753d8464da99a508374e3551c, user_id=1d41b32b2deb4713841afe180277b8f3, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:48.311737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c37bb4-e1a7-4102-a771-80b0be1cfd8d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:48.329729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99430fbc-4f0d-48f7-a0f8-6a1c0947ae3f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:48.358938 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:48.378708 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1063/2132] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:10:47 2022] PUT /identity/v3/projects/ffca783753d8464da99a508374e3551c/users/1d41b32b2deb4713841afe180277b8f3/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:48.381296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e268f-bb6a-4e2c-919c-3143e32853d6 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:48.381771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e268f-bb6a-4e2c-919c-3143e32853d6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:48.382643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e268f-bb6a-4e2c-919c-3143e32853d6 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:48.396953 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1064/2133] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:10:48 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:10:48.398835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e268f-bb6a-4e2c-919c-3143e32853d6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:48.518294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dbf466-351f-4ef3-a178-7685f0257f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:48.520797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbf466-351f-4ef3-a178-7685f0257f37 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:48.521464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbf466-351f-4ef3-a178-7685f0257f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:48.521977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbf466-351f-4ef3-a178-7685f0257f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:48.522917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dbf466-351f-4ef3-a178-7685f0257f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:48.527633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dbf466-351f-4ef3-a178-7685f0257f37 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:48.557078 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1070/2134] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:48.558897 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dbf466-351f-4ef3-a178-7685f0257f37 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:48.593304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dbf466-351f-4ef3-a178-7685f0257f37 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:48.615056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d01e1-0ed7-432a-b9e4-7306e7f71340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:48.616139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d01e1-0ed7-432a-b9e4-7306e7f71340 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:48.623398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d01e1-0ed7-432a-b9e4-7306e7f71340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:48.629008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d01e1-0ed7-432a-b9e4-7306e7f71340 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:48.637849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d01e1-0ed7-432a-b9e4-7306e7f71340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:48.641524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d01e1-0ed7-432a-b9e4-7306e7f71340 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:48.668709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e268f-bb6a-4e2c-919c-3143e32853d6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:48.680533 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1071/2135] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:48.681772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60962b91-2433-4206-8f2b-8efab57589ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:48.683628 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60962b91-2433-4206-8f2b-8efab57589ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:48.684382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4fe8b-118c-463a-8687-37589c113b86 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:48.684768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60962b91-2433-4206-8f2b-8efab57589ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:48.685152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4fe8b-118c-463a-8687-37589c113b86 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:48.685545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60962b91-2433-4206-8f2b-8efab57589ac admin admin] PATH_INFO: `/v3/projects/47b1fddf09644b6680321adadf6833fe/users/5f63191ef3b9460aa302dbd56324e94f/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:48.685983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4fe8b-118c-463a-8687-37589c113b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:48.713813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-7dd4fe8b-118c-463a-8687-37589c113b86 None None] MFA Rules not processed for user `b219e01934fa477fbaa053cca586f01b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:48.715306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7dd4fe8b-118c-463a-8687-37589c113b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:48.760438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60962b91-2433-4206-8f2b-8efab57589ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=47b1fddf09644b6680321adadf6833fe, user_id=5f63191ef3b9460aa302dbd56324e94f, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:48.781313 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60962b91-2433-4206-8f2b-8efab57589ac admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:48.790464 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:48.797749 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1072/2136] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:10:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:48.802511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4fe8b-118c-463a-8687-37589c113b86 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:48.805057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7dd4fe8b-118c-463a-8687-37589c113b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:48.829713 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4fe8b-118c-463a-8687-37589c113b86 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:48.841778 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1065/2137] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:10:48 2022] PUT /identity/v3/projects/47b1fddf09644b6680321adadf6833fe/users/5f63191ef3b9460aa302dbd56324e94f/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:48.845246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60962b91-2433-4206-8f2b-8efab57589ac admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:48.849187 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-60962b91-2433-4206-8f2b-8efab57589ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:48.970603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac10af-60b7-4da8-a6ba-389759b15289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:48.972071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac10af-60b7-4da8-a6ba-389759b15289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:48.972633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac10af-60b7-4da8-a6ba-389759b15289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:48.977409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac10af-60b7-4da8-a6ba-389759b15289 admin admin] PATH_INFO: `/v3/users/909b8165f015473c9977ef92aaf0741b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:48.979393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac10af-60b7-4da8-a6ba-389759b15289 admin admin] RBAC: Authorizing `identity:delete_user(user_id=909b8165f015473c9977ef92aaf0741b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:48.982577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac10af-60b7-4da8-a6ba-389759b15289 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:49.108001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ccac10af-60b7-4da8-a6ba-389759b15289 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '909b8165f015473c9977ef92aaf0741b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:49.110032 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:49.125231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ccac10af-60b7-4da8-a6ba-389759b15289 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '909b8165f015473c9977ef92aaf0741b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:49.158087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ccac10af-60b7-4da8-a6ba-389759b15289 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '909b8165f015473c9977ef92aaf0741b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:49.158796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ccac10af-60b7-4da8-a6ba-389759b15289 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '909b8165f015473c9977ef92aaf0741b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:49.185893 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ccac10af-60b7-4da8-a6ba-389759b15289 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '909b8165f015473c9977ef92aaf0741b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:49.199041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60962b91-2433-4206-8f2b-8efab57589ac admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:49.203120 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1073/2138] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:10:48 2022] DELETE /identity/v3/users/909b8165f015473c9977ef92aaf0741b => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:49.207118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac10af-60b7-4da8-a6ba-389759b15289 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:49.209231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ccac10af-60b7-4da8-a6ba-389759b15289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:49.389167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7dfa86-a69f-4578-94de-1e03ca8f7dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:49.390154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dfa86-a69f-4578-94de-1e03ca8f7dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:49.390650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dfa86-a69f-4578-94de-1e03ca8f7dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:49.391206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dfa86-a69f-4578-94de-1e03ca8f7dc0 admin admin] PATH_INFO: `/v3/projects/5705e5a01af14bb6add2b1da39636196` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:49.393714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7dfa86-a69f-4578-94de-1e03ca8f7dc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5705e5a01af14bb6add2b1da39636196)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:49.398446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7dfa86-a69f-4578-94de-1e03ca8f7dc0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:49.414119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac10af-60b7-4da8-a6ba-389759b15289 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:49.427010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193be25-c6d7-4781-a81e-1a9b46d85b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:49.428011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193be25-c6d7-4781-a81e-1a9b46d85b84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:49.428685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193be25-c6d7-4781-a81e-1a9b46d85b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:49.430862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193be25-c6d7-4781-a81e-1a9b46d85b84 admin admin] PATH_INFO: `/v3/projects/d5ea429307984908b718fa99c7391fb4/users/48ba57d381ee4569b9bce256d01bc5c6/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:49.434232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193be25-c6d7-4781-a81e-1a9b46d85b84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5ea429307984908b718fa99c7391fb4, user_id=48ba57d381ee4569b9bce256d01bc5c6, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:49.437930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193be25-c6d7-4781-a81e-1a9b46d85b84 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:49.455415 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1074/2139] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:10:49 2022] PUT /identity/v3/projects/d5ea429307984908b718fa99c7391fb4/users/48ba57d381ee4569b9bce256d01bc5c6/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:49.456955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193be25-c6d7-4781-a81e-1a9b46d85b84 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:49.459066 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0193be25-c6d7-4781-a81e-1a9b46d85b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:49.575054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ff7dfa86-a69f-4578-94de-1e03ca8f7dc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5705e5a01af14bb6add2b1da39636196', 'request_id': 'req-ff7dfa86-a69f-4578-94de-1e03ca8f7dc0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:49.602111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ff7dfa86-a69f-4578-94de-1e03ca8f7dc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5705e5a01af14bb6add2b1da39636196', 'request_id': 'req-ff7dfa86-a69f-4578-94de-1e03ca8f7dc0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:49.625865 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193be25-c6d7-4781-a81e-1a9b46d85b84 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:49.634493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ff7dfa86-a69f-4578-94de-1e03ca8f7dc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5705e5a01af14bb6add2b1da39636196', 'request_id': 'req-ff7dfa86-a69f-4578-94de-1e03ca8f7dc0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:49.674474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ff7dfa86-a69f-4578-94de-1e03ca8f7dc0 admin admin] The token cache is being invalidate because project 5705e5a01af14bb6add2b1da39636196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:10:49.675137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ff7dfa86-a69f-4578-94de-1e03ca8f7dc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:49.677893 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ff7dfa86-a69f-4578-94de-1e03ca8f7dc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:49.688097 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1066/2140] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:10:48 2022] DELETE /identity/v3/projects/5705e5a01af14bb6add2b1da39636196 => generated 0 bytes in 842 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:49.688097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7dfa86-a69f-4578-94de-1e03ca8f7dc0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:49.695563 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ff7dfa86-a69f-4578-94de-1e03ca8f7dc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:49.795772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e043be8-e284-4fea-bc06-6719678fea03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:49.797824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e043be8-e284-4fea-bc06-6719678fea03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:49.798658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e043be8-e284-4fea-bc06-6719678fea03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:49.799423 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e043be8-e284-4fea-bc06-6719678fea03 admin admin] PATH_INFO: `/v3/projects/ffca783753d8464da99a508374e3551c/users/1d41b32b2deb4713841afe180277b8f3/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:49.804734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e043be8-e284-4fea-bc06-6719678fea03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffca783753d8464da99a508374e3551c, user_id=1d41b32b2deb4713841afe180277b8f3, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:49.811373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e043be8-e284-4fea-bc06-6719678fea03 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:49.826745 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:49.854614 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1075/2141] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:10:49 2022] PUT /identity/v3/projects/ffca783753d8464da99a508374e3551c/users/1d41b32b2deb4713841afe180277b8f3/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:49.854614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e043be8-e284-4fea-bc06-6719678fea03 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:49.854614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2e043be8-e284-4fea-bc06-6719678fea03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:49.868770 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:49.931063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7dfa86-a69f-4578-94de-1e03ca8f7dc0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:50.123379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e043be8-e284-4fea-bc06-6719678fea03 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:50.136078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac252a-a3e3-4f25-b10f-6d0d18982a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:50.138475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac252a-a3e3-4f25-b10f-6d0d18982a54 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:50.139150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac252a-a3e3-4f25-b10f-6d0d18982a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:50.140077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac252a-a3e3-4f25-b10f-6d0d18982a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:50.142977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac252a-a3e3-4f25-b10f-6d0d18982a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:50.150266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac252a-a3e3-4f25-b10f-6d0d18982a54 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:50.220102 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1076/2142] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:50.225568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac252a-a3e3-4f25-b10f-6d0d18982a54 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:50.230703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d691b4-312d-4e98-b8bf-d43fe3d11d8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:50.234094 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-eeac252a-a3e3-4f25-b10f-6d0d18982a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:50.237697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d691b4-312d-4e98-b8bf-d43fe3d11d8a service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:50.238404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d691b4-312d-4e98-b8bf-d43fe3d11d8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:50.238783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d691b4-312d-4e98-b8bf-d43fe3d11d8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:50.250314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f2d691b4-312d-4e98-b8bf-d43fe3d11d8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:50.270404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d691b4-312d-4e98-b8bf-d43fe3d11d8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:50.274515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d691b4-312d-4e98-b8bf-d43fe3d11d8a service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:50.286234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac252a-a3e3-4f25-b10f-6d0d18982a54 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:50.290989 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1067/2143] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:50.292245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da0868-2c84-495b-9aff-acfc846d7d1c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:50.292570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da0868-2c84-495b-9aff-acfc846d7d1c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:50.292841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da0868-2c84-495b-9aff-acfc846d7d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:50.300584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b637bb-a052-4b81-8535-50ab2d563602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:50.301350 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b637bb-a052-4b81-8535-50ab2d563602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:50.301633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b637bb-a052-4b81-8535-50ab2d563602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:50.301933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b637bb-a052-4b81-8535-50ab2d563602 admin admin] PATH_INFO: `/v3/projects/5f58ed0fcf42424596a5a06cc32a064e` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:50.303985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b637bb-a052-4b81-8535-50ab2d563602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f58ed0fcf42424596a5a06cc32a064e)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:50.308976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b637bb-a052-4b81-8535-50ab2d563602 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:50.329434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-a6da0868-2c84-495b-9aff-acfc846d7d1c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:50.329900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a6da0868-2c84-495b-9aff-acfc846d7d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:50.357014 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1068/2144] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:50.357014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2c62e-dad0-4159-a05d-b80bc7a200bc None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:50.357014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2c62e-dad0-4159-a05d-b80bc7a200bc None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:50.357014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2c62e-dad0-4159-a05d-b80bc7a200bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:50.382568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9ad2c62e-dad0-4159-a05d-b80bc7a200bc None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:50.387443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9ad2c62e-dad0-4159-a05d-b80bc7a200bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:50.430261 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1069/2145] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:50.449004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a2182-e41d-43ca-ad9d-f597bc4d9dff None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:50.452273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a2182-e41d-43ca-ad9d-f597bc4d9dff None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:50.454064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a2182-e41d-43ca-ad9d-f597bc4d9dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:50.470528 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e5b637bb-a052-4b81-8535-50ab2d563602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f58ed0fcf42424596a5a06cc32a064e', 'request_id': 'req-e5b637bb-a052-4b81-8535-50ab2d563602'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:50.480285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e5b637bb-a052-4b81-8535-50ab2d563602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f58ed0fcf42424596a5a06cc32a064e', 'request_id': 'req-e5b637bb-a052-4b81-8535-50ab2d563602'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:50.503527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e5b637bb-a052-4b81-8535-50ab2d563602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f58ed0fcf42424596a5a06cc32a064e', 'request_id': 'req-e5b637bb-a052-4b81-8535-50ab2d563602'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:50.533999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e5b637bb-a052-4b81-8535-50ab2d563602 admin admin] The token cache is being invalidate because project 5f58ed0fcf42424596a5a06cc32a064e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:10:50.534503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e5b637bb-a052-4b81-8535-50ab2d563602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:50.535913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e5b637bb-a052-4b81-8535-50ab2d563602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:50.540878 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1077/2146] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:10:50 2022] DELETE /identity/v3/projects/5f58ed0fcf42424596a5a06cc32a064e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:50.540878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b637bb-a052-4b81-8535-50ab2d563602 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:50.542114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e5b637bb-a052-4b81-8535-50ab2d563602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:50.567777 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e56a2182-e41d-43ca-ad9d-f597bc4d9dff None None] MFA Rules not processed for user `1d41b32b2deb4713841afe180277b8f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:50.574914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e56a2182-e41d-43ca-ad9d-f597bc4d9dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:50.675171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b637bb-a052-4b81-8535-50ab2d563602 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:50.684001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d38ac-ea1b-4ff7-9bc9-4338a038de10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:50.686403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d38ac-ea1b-4ff7-9bc9-4338a038de10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:50.687092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d38ac-ea1b-4ff7-9bc9-4338a038de10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:50.687628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d38ac-ea1b-4ff7-9bc9-4338a038de10 admin admin] PATH_INFO: `/v3/projects/47b1fddf09644b6680321adadf6833fe/users/5f63191ef3b9460aa302dbd56324e94f/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:50.690449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d38ac-ea1b-4ff7-9bc9-4338a038de10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47b1fddf09644b6680321adadf6833fe, user_id=5f63191ef3b9460aa302dbd56324e94f, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:50.697484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d38ac-ea1b-4ff7-9bc9-4338a038de10 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:50.716209 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1078/2147] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:10:50 2022] PUT /identity/v3/projects/47b1fddf09644b6680321adadf6833fe/users/5f63191ef3b9460aa302dbd56324e94f/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:50.717546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d38ac-ea1b-4ff7-9bc9-4338a038de10 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:50.720720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-192d38ac-ea1b-4ff7-9bc9-4338a038de10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:50.748449 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:50.777741 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1070/2148] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:50 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:50.777741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535096ae-dad6-4839-9ba8-8e7387c1d4b5 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:50.777741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535096ae-dad6-4839-9ba8-8e7387c1d4b5 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:50.777741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535096ae-dad6-4839-9ba8-8e7387c1d4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:50.821778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-535096ae-dad6-4839-9ba8-8e7387c1d4b5 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:50.823744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-535096ae-dad6-4839-9ba8-8e7387c1d4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:50.872573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d38ac-ea1b-4ff7-9bc9-4338a038de10 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:50.892176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c6e70-b31a-4d41-8ed4-e0eae3ee3155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:50.893864 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c6e70-b31a-4d41-8ed4-e0eae3ee3155 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:50.895344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c6e70-b31a-4d41-8ed4-e0eae3ee3155 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:50.896960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c6e70-b31a-4d41-8ed4-e0eae3ee3155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:50.906621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-de5c6e70-b31a-4d41-8ed4-e0eae3ee3155 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:51.046779 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1071/2149] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:51.056299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535096ae-dad6-4839-9ba8-8e7387c1d4b5 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:51.072376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-535096ae-dad6-4839-9ba8-8e7387c1d4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:51.110909 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:51.138014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535096ae-dad6-4839-9ba8-8e7387c1d4b5 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:51.154421 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd08136-1cd3-4e27-b271-f035ace5cc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:51.155400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd08136-1cd3-4e27-b271-f035ace5cc04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:51.161683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd08136-1cd3-4e27-b271-f035ace5cc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:51.162242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd08136-1cd3-4e27-b271-f035ace5cc04 admin admin] PATH_INFO: `/v3/users/be556fbd71b04f408dac0c12c6de69b8` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:51.165784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c6e70-b31a-4d41-8ed4-e0eae3ee3155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:51.168048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c6e70-b31a-4d41-8ed4-e0eae3ee3155 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:51.168528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd08136-1cd3-4e27-b271-f035ace5cc04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be556fbd71b04f408dac0c12c6de69b8)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:51.175828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd08136-1cd3-4e27-b271-f035ace5cc04 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:51.190895 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1079/2150] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:51.193458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c0058-4b2e-4062-8650-0fef7aa93260 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:51.195717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c0058-4b2e-4062-8650-0fef7aa93260 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:51.196451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c0058-4b2e-4062-8650-0fef7aa93260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:51.319584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3d8c0058-4b2e-4062-8650-0fef7aa93260 None None] MFA Rules not processed for user `5f63191ef3b9460aa302dbd56324e94f`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:51.321973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3d8c0058-4b2e-4062-8650-0fef7aa93260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:51.390197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0fd08136-1cd3-4e27-b271-f035ace5cc04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be556fbd71b04f408dac0c12c6de69b8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:51.426704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0fd08136-1cd3-4e27-b271-f035ace5cc04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be556fbd71b04f408dac0c12c6de69b8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:51.484223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0fd08136-1cd3-4e27-b271-f035ace5cc04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be556fbd71b04f408dac0c12c6de69b8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:51.488573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0fd08136-1cd3-4e27-b271-f035ace5cc04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be556fbd71b04f408dac0c12c6de69b8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:51.515286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0fd08136-1cd3-4e27-b271-f035ace5cc04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be556fbd71b04f408dac0c12c6de69b8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:51.542524 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1072/2151] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:10:51 2022] DELETE /identity/v3/users/be556fbd71b04f408dac0c12c6de69b8 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:51.548568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd08136-1cd3-4e27-b271-f035ace5cc04 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:51.551070 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0fd08136-1cd3-4e27-b271-f035ace5cc04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:51.687613 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1080/2152] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:51 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 496 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:51.689673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c0058-4b2e-4062-8650-0fef7aa93260 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:51.708778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3d8c0058-4b2e-4062-8650-0fef7aa93260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:51.775279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c0058-4b2e-4062-8650-0fef7aa93260 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:51.846876 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd08136-1cd3-4e27-b271-f035ace5cc04 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:51.872744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab2b66-090d-4a05-b705-8b3abe73525e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:51.873851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab2b66-090d-4a05-b705-8b3abe73525e admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:51.874398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab2b66-090d-4a05-b705-8b3abe73525e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:51.874881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab2b66-090d-4a05-b705-8b3abe73525e admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:51.876128 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab2b66-090d-4a05-b705-8b3abe73525e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:51.883157 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab2b66-090d-4a05-b705-8b3abe73525e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:51.982168 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:51.987424 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1073/2153] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:10:51 2022] POST /identity/v3/projects => generated 395 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:51.993066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab2b66-090d-4a05-b705-8b3abe73525e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:51.998074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3dab2b66-090d-4a05-b705-8b3abe73525e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:52.065351 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7941a46-bd58-4eee-abcd-5ab5c421d05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:52.073377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7941a46-bd58-4eee-abcd-5ab5c421d05c admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:52.083941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7941a46-bd58-4eee-abcd-5ab5c421d05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:52.084216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7941a46-bd58-4eee-abcd-5ab5c421d05c admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:52.085464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7941a46-bd58-4eee-abcd-5ab5c421d05c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:10:52.086601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7941a46-bd58-4eee-abcd-5ab5c421d05c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:52.118962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7941a46-bd58-4eee-abcd-5ab5c421d05c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:52.190768 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:52.253376 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1081/2154] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 565 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:10:52.256203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7941a46-bd58-4eee-abcd-5ab5c421d05c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:52.294974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab2b66-090d-4a05-b705-8b3abe73525e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:52.316395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c61a8-199e-4d16-92a4-7e80a92ef641 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:52.317919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c61a8-199e-4d16-92a4-7e80a92ef641 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:52.318882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c61a8-199e-4d16-92a4-7e80a92ef641 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:52.319659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c61a8-199e-4d16-92a4-7e80a92ef641 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:52.334308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7941a46-bd58-4eee-abcd-5ab5c421d05c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:52.553898 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c61a8-199e-4d16-92a4-7e80a92ef641 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:52.557241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c61a8-199e-4d16-92a4-7e80a92ef641 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:52.576687 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1074/2155] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:51 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:52.578318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c61a8-199e-4d16-92a4-7e80a92ef641 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:52.718095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327dd2d5-4ff5-4c29-a638-152018dc4d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:52.721356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dd2d5-4ff5-4c29-a638-152018dc4d0a admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:52.732258 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dd2d5-4ff5-4c29-a638-152018dc4d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:52.733523 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dd2d5-4ff5-4c29-a638-152018dc4d0a admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:52.739067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327dd2d5-4ff5-4c29-a638-152018dc4d0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:52.754721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327dd2d5-4ff5-4c29-a638-152018dc4d0a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:52.856222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c61a8-199e-4d16-92a4-7e80a92ef641 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:52.889999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795caeb6-ebcc-4428-a736-2fa9bd44fa57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:52.891180 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795caeb6-ebcc-4428-a736-2fa9bd44fa57 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:52.891684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795caeb6-ebcc-4428-a736-2fa9bd44fa57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:52.894474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795caeb6-ebcc-4428-a736-2fa9bd44fa57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:52.895704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795caeb6-ebcc-4428-a736-2fa9bd44fa57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:52.915670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795caeb6-ebcc-4428-a736-2fa9bd44fa57 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:52.937180 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1082/2156] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:10:52 2022] POST /identity/v3/users => generated 298 bytes in 683 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:52.939249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327dd2d5-4ff5-4c29-a638-152018dc4d0a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:52.949944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-327dd2d5-4ff5-4c29-a638-152018dc4d0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:53.024284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327dd2d5-4ff5-4c29-a638-152018dc4d0a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:53.039780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda23e0d-d68e-403a-a839-5fd514a63762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:53.040913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda23e0d-d68e-403a-a839-5fd514a63762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:53.041276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda23e0d-d68e-403a-a839-5fd514a63762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:53.041556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda23e0d-d68e-403a-a839-5fd514a63762 admin admin] PATH_INFO: `/v3/projects/950b69a484c14cea9e621e7409e72fbc` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:53.044644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda23e0d-d68e-403a-a839-5fd514a63762 admin admin] RBAC: Authorizing `identity:delete_project(project_id=950b69a484c14cea9e621e7409e72fbc)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:53.049208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda23e0d-d68e-403a-a839-5fd514a63762 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:53.100453 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1075/2157] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:10:52 2022] POST /identity/v3/projects => generated 397 bytes in 523 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:53.109197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795caeb6-ebcc-4428-a736-2fa9bd44fa57 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:53.269082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fda23e0d-d68e-403a-a839-5fd514a63762 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '950b69a484c14cea9e621e7409e72fbc', 'request_id': 'req-fda23e0d-d68e-403a-a839-5fd514a63762'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:53.286525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fda23e0d-d68e-403a-a839-5fd514a63762 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '950b69a484c14cea9e621e7409e72fbc', 'request_id': 'req-fda23e0d-d68e-403a-a839-5fd514a63762'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:53.300943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fda23e0d-d68e-403a-a839-5fd514a63762 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '950b69a484c14cea9e621e7409e72fbc', 'request_id': 'req-fda23e0d-d68e-403a-a839-5fd514a63762'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:53.328534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fda23e0d-d68e-403a-a839-5fd514a63762 admin admin] The token cache is being invalidate because project 950b69a484c14cea9e621e7409e72fbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:10:53.329040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fda23e0d-d68e-403a-a839-5fd514a63762 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:53.331412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fda23e0d-d68e-403a-a839-5fd514a63762 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:53.337981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795caeb6-ebcc-4428-a736-2fa9bd44fa57 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:53.340610 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1083/2158] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:10:52 2022] DELETE /identity/v3/projects/950b69a484c14cea9e621e7409e72fbc => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:53.341708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda23e0d-d68e-403a-a839-5fd514a63762 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:53.345130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fda23e0d-d68e-403a-a839-5fd514a63762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:53.394178 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:53.471009 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:53.487718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda23e0d-d68e-403a-a839-5fd514a63762 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:53.503975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309a5ec-0bbc-4776-8d67-cc968b43d376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:53.505488 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309a5ec-0bbc-4776-8d67-cc968b43d376 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:53.506294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309a5ec-0bbc-4776-8d67-cc968b43d376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:53.507056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309a5ec-0bbc-4776-8d67-cc968b43d376 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:53.509574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309a5ec-0bbc-4776-8d67-cc968b43d376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:53.515545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309a5ec-0bbc-4776-8d67-cc968b43d376 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:53.546969 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1084/2159] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:53.549359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309a5ec-0bbc-4776-8d67-cc968b43d376 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:53.558782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4309a5ec-0bbc-4776-8d67-cc968b43d376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:53.586797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309a5ec-0bbc-4776-8d67-cc968b43d376 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:53.603874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f2d5a-8fd0-4e4a-85dd-2c8311a20f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:53.606060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f2d5a-8fd0-4e4a-85dd-2c8311a20f8b admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:53.608381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f2d5a-8fd0-4e4a-85dd-2c8311a20f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:53.609244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f2d5a-8fd0-4e4a-85dd-2c8311a20f8b admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:53.612681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f2d5a-8fd0-4e4a-85dd-2c8311a20f8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:53.616226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f2d5a-8fd0-4e4a-85dd-2c8311a20f8b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:53.629714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb3900-b84c-41f1-8ad5-87fec1f7655a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:53.631439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb3900-b84c-41f1-8ad5-87fec1f7655a service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:53.632033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb3900-b84c-41f1-8ad5-87fec1f7655a service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:53.633336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb3900-b84c-41f1-8ad5-87fec1f7655a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:53.646425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e9fb3900-b84c-41f1-8ad5-87fec1f7655a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:53.674260 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1085/2160] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:10:53 2022] POST /identity/v3/users => generated 299 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:53.675878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710dd15-cde0-4eb4-b1c0-b6ba80ed9c22 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:53.676302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710dd15-cde0-4eb4-b1c0-b6ba80ed9c22 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:53.677588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710dd15-cde0-4eb4-b1c0-b6ba80ed9c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:53.707782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0710dd15-cde0-4eb4-b1c0-b6ba80ed9c22 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:53.710172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0710dd15-cde0-4eb4-b1c0-b6ba80ed9c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:53.747258 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1086/2161] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:53.748403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710dd15-cde0-4eb4-b1c0-b6ba80ed9c22 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:53.783669 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710dd15-cde0-4eb4-b1c0-b6ba80ed9c22 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:53.792557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ebfdf4-c752-49f1-930b-624d922b6d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:53.793479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebfdf4-c752-49f1-930b-624d922b6d10 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:53.793885 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebfdf4-c752-49f1-930b-624d922b6d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:53.794519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebfdf4-c752-49f1-930b-624d922b6d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:53.795825 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ebfdf4-c752-49f1-930b-624d922b6d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:53.797857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ebfdf4-c752-49f1-930b-624d922b6d10 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:53.817293 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1087/2162] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:53.817293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ebfdf4-c752-49f1-930b-624d922b6d10 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:53.854897 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ebfdf4-c752-49f1-930b-624d922b6d10 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:53.877262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83cc027-cdc6-427c-8316-b87c88d3c71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:53.878299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cc027-cdc6-427c-8316-b87c88d3c71e admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:53.879291 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cc027-cdc6-427c-8316-b87c88d3c71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:53.879291 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cc027-cdc6-427c-8316-b87c88d3c71e admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:53.880252 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83cc027-cdc6-427c-8316-b87c88d3c71e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:53.883003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83cc027-cdc6-427c-8316-b87c88d3c71e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:53.914813 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1088/2163] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:53.920736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bfd0b-6c4d-4def-beef-5e920b853a68 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:53.921033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bfd0b-6c4d-4def-beef-5e920b853a68 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:53.921343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05bfd0b-6c4d-4def-beef-5e920b853a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:53.943963 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb3900-b84c-41f1-8ad5-87fec1f7655a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:53.948033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb3900-b84c-41f1-8ad5-87fec1f7655a service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:53.949213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a05bfd0b-6c4d-4def-beef-5e920b853a68 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:53.950735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a05bfd0b-6c4d-4def-beef-5e920b853a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:53.963389 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1089/2164] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:53.963389 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05bfd0b-6c4d-4def-beef-5e920b853a68 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:53.979264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05bfd0b-6c4d-4def-beef-5e920b853a68 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:53.986228 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49540f9d-cbc0-4492-ac9e-d5ff77dba110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:53.987226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49540f9d-cbc0-4492-ac9e-d5ff77dba110 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:53.987508 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49540f9d-cbc0-4492-ac9e-d5ff77dba110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:53.987775 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49540f9d-cbc0-4492-ac9e-d5ff77dba110 admin admin] PATH_INFO: `/v3/projects/bc6cabea74704570a310547c7077b366/users/bd2dc7cb2edc4a799521b0578f3b6af0/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:54.038482 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1076/2165] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:53 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 937 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:54.040872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb3900-b84c-41f1-8ad5-87fec1f7655a service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:54.063517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49540f9d-cbc0-4492-ac9e-d5ff77dba110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc6cabea74704570a310547c7077b366, user_id=bd2dc7cb2edc4a799521b0578f3b6af0, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:54.071789 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49540f9d-cbc0-4492-ac9e-d5ff77dba110 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:54.082510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb3900-b84c-41f1-8ad5-87fec1f7655a service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:54.091814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60f418-7b23-41bf-afb6-3846093342bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:54.092552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60f418-7b23-41bf-afb6-3846093342bb admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:54.092830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60f418-7b23-41bf-afb6-3846093342bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:54.093252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60f418-7b23-41bf-afb6-3846093342bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:54.093945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60f418-7b23-41bf-afb6-3846093342bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:54.096365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60f418-7b23-41bf-afb6-3846093342bb admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:54.137181 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1090/2166] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:10:53 2022] PUT /identity/v3/projects/bc6cabea74704570a310547c7077b366/users/bd2dc7cb2edc4a799521b0578f3b6af0/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:54.142338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49540f9d-cbc0-4492-ac9e-d5ff77dba110 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:54.189673 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1077/2167] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:54.192573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dad82-a0a5-4431-aa31-56fe13dbda17 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:54.193074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dad82-a0a5-4431-aa31-56fe13dbda17 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:54.193572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dad82-a0a5-4431-aa31-56fe13dbda17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:54.353682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-245dad82-a0a5-4431-aa31-56fe13dbda17 None None] MFA Rules not processed for user `bd2dc7cb2edc4a799521b0578f3b6af0`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:54.355990 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-245dad82-a0a5-4431-aa31-56fe13dbda17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:54.388378 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49540f9d-cbc0-4492-ac9e-d5ff77dba110 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:54.401133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3238eb-bdcd-4537-b5b1-68f28ddc1cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:54.401133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3238eb-bdcd-4537-b5b1-68f28ddc1cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:54.401133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3238eb-bdcd-4537-b5b1-68f28ddc1cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:54.401133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3238eb-bdcd-4537-b5b1-68f28ddc1cd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:54.403581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3238eb-bdcd-4537-b5b1-68f28ddc1cd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:10:54.403581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3238eb-bdcd-4537-b5b1-68f28ddc1cd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:54.410790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3238eb-bdcd-4537-b5b1-68f28ddc1cd5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:54.460362 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1091/2168] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:10:54.461851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3238eb-bdcd-4537-b5b1-68f28ddc1cd5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:54.502688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3238eb-bdcd-4537-b5b1-68f28ddc1cd5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:54.521685 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1078/2169] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:54 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:54.524752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245dad82-a0a5-4431-aa31-56fe13dbda17 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:54.555629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf02d3-3e6b-41d6-b81a-a68122fe643b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:54.559303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf02d3-3e6b-41d6-b81a-a68122fe643b admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:54.559655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf02d3-3e6b-41d6-b81a-a68122fe643b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:54.564174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf02d3-3e6b-41d6-b81a-a68122fe643b admin admin] PATH_INFO: `/v3/projects/49d7d246942240b3a406be0ccfdec120/users/9dec618a8f8f4d26b2ddaf5d9d8d8a4c/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:54.572781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245dad82-a0a5-4431-aa31-56fe13dbda17 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:54.599422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ca640-f6eb-4f8d-a8f7-5f085d98200e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:54.600583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ca640-f6eb-4f8d-a8f7-5f085d98200e admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:54.601193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ca640-f6eb-4f8d-a8f7-5f085d98200e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:54.601626 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ca640-f6eb-4f8d-a8f7-5f085d98200e admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:54.602448 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ca640-f6eb-4f8d-a8f7-5f085d98200e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:54.604781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724ca640-f6eb-4f8d-a8f7-5f085d98200e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:54.682351 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf02d3-3e6b-41d6-b81a-a68122fe643b admin admin] RBAC: Authorizing `identity:create_grant(project_id=49d7d246942240b3a406be0ccfdec120, user_id=9dec618a8f8f4d26b2ddaf5d9d8d8a4c, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:54.694564 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1079/2170] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:10:54 2022] POST /identity/v3/projects => generated 369 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:54.700374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ca640-f6eb-4f8d-a8f7-5f085d98200e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:54.709354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-724ca640-f6eb-4f8d-a8f7-5f085d98200e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:54.719682 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf02d3-3e6b-41d6-b81a-a68122fe643b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:54.756986 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:54.797092 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1092/2171] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:10:54 2022] PUT /identity/v3/projects/49d7d246942240b3a406be0ccfdec120/users/9dec618a8f8f4d26b2ddaf5d9d8d8a4c/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:54.803138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf02d3-3e6b-41d6-b81a-a68122fe643b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:54.819368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-29bf02d3-3e6b-41d6-b81a-a68122fe643b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:54.998555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724ca640-f6eb-4f8d-a8f7-5f085d98200e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:55.065952 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:55.135115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf02d3-3e6b-41d6-b81a-a68122fe643b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:55.150828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268def9e-360f-4439-917b-56a8e99ed7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:55.150828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268def9e-360f-4439-917b-56a8e99ed7d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:55.151967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268def9e-360f-4439-917b-56a8e99ed7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:55.152144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268def9e-360f-4439-917b-56a8e99ed7d8 admin admin] PATH_INFO: `/v3/projects/010ea68aed824d6bac970360d34ab747` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:55.155193 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268def9e-360f-4439-917b-56a8e99ed7d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=010ea68aed824d6bac970360d34ab747)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:55.158164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268def9e-360f-4439-917b-56a8e99ed7d8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:55.185162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a786a-8ad9-4a5b-8b66-162a48c72884 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:55.185873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a786a-8ad9-4a5b-8b66-162a48c72884 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:55.186310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a786a-8ad9-4a5b-8b66-162a48c72884 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:55.186928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a786a-8ad9-4a5b-8b66-162a48c72884 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:55.191251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7d4a786a-8ad9-4a5b-8b66-162a48c72884 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:55.270199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-268def9e-360f-4439-917b-56a8e99ed7d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '010ea68aed824d6bac970360d34ab747', 'request_id': 'req-268def9e-360f-4439-917b-56a8e99ed7d8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:55.285061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-268def9e-360f-4439-917b-56a8e99ed7d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '010ea68aed824d6bac970360d34ab747', 'request_id': 'req-268def9e-360f-4439-917b-56a8e99ed7d8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:55.307280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-268def9e-360f-4439-917b-56a8e99ed7d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '010ea68aed824d6bac970360d34ab747', 'request_id': 'req-268def9e-360f-4439-917b-56a8e99ed7d8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:55.344240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-268def9e-360f-4439-917b-56a8e99ed7d8 admin admin] The token cache is being invalidate because project 010ea68aed824d6bac970360d34ab747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:10:55.344709 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-268def9e-360f-4439-917b-56a8e99ed7d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:55.345583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-268def9e-360f-4439-917b-56a8e99ed7d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:55.353637 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1093/2172] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:10:54 2022] DELETE /identity/v3/projects/010ea68aed824d6bac970360d34ab747 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:55.353929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268def9e-360f-4439-917b-56a8e99ed7d8 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:55.357329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-268def9e-360f-4439-917b-56a8e99ed7d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:55.402989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a786a-8ad9-4a5b-8b66-162a48c72884 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:55.407597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a786a-8ad9-4a5b-8b66-162a48c72884 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:55.447019 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1080/2173] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:54 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 755 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:55.451619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69650a0-0bae-413d-82bf-4e3c3140426e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:55.452989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69650a0-0bae-413d-82bf-4e3c3140426e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:55.453824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69650a0-0bae-413d-82bf-4e3c3140426e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:55.559049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e69650a0-0bae-413d-82bf-4e3c3140426e None None] MFA Rules not processed for user `9dec618a8f8f4d26b2ddaf5d9d8d8a4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:55.561836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e69650a0-0bae-413d-82bf-4e3c3140426e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:55.596328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268def9e-360f-4439-917b-56a8e99ed7d8 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:55.616221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f3fd5-0fdb-4817-b2a7-f2997ae19399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:55.617482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f3fd5-0fdb-4817-b2a7-f2997ae19399 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:55.618042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f3fd5-0fdb-4817-b2a7-f2997ae19399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:55.618728 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f3fd5-0fdb-4817-b2a7-f2997ae19399 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:55.619738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f3fd5-0fdb-4817-b2a7-f2997ae19399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:55.622167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f3fd5-0fdb-4817-b2a7-f2997ae19399 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:55.678207 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1094/2174] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:10:55 2022] POST /identity/v3/users => generated 285 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:10:55.680480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f3fd5-0fdb-4817-b2a7-f2997ae19399 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:55.684086 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:55.689551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-855f3fd5-0fdb-4817-b2a7-f2997ae19399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:55.732231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f3fd5-0fdb-4817-b2a7-f2997ae19399 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:55.762368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805a7d3-06d1-4765-a7e5-6d43a38f7c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:55.763616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805a7d3-06d1-4765-a7e5-6d43a38f7c9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:55.764148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805a7d3-06d1-4765-a7e5-6d43a38f7c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:55.767352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805a7d3-06d1-4765-a7e5-6d43a38f7c9f admin admin] PATH_INFO: `/v3/users/8e897f44489c4006a81baa41ca1d5a1e` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:55.772215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805a7d3-06d1-4765-a7e5-6d43a38f7c9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e897f44489c4006a81baa41ca1d5a1e)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:55.783955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805a7d3-06d1-4765-a7e5-6d43a38f7c9f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:55.881912 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1081/2175] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:55 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:55.885234 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69650a0-0bae-413d-82bf-4e3c3140426e None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:55.892977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e69650a0-0bae-413d-82bf-4e3c3140426e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:55.980521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69650a0-0bae-413d-82bf-4e3c3140426e None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:55.991270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf8810-8797-4d43-8edb-ad5452b4c873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:55.992752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf8810-8797-4d43-8edb-ad5452b4c873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:55.994955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf8810-8797-4d43-8edb-ad5452b4c873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:55.995699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf8810-8797-4d43-8edb-ad5452b4c873 admin admin] PATH_INFO: `/v3/users/9accbb8655b84894be9a101d7ffdcf33` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:56.000013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf8810-8797-4d43-8edb-ad5452b4c873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9accbb8655b84894be9a101d7ffdcf33)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:56.003621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf8810-8797-4d43-8edb-ad5452b4c873 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:56.047470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1805a7d3-06d1-4765-a7e5-6d43a38f7c9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e897f44489c4006a81baa41ca1d5a1e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:56.086173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1805a7d3-06d1-4765-a7e5-6d43a38f7c9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e897f44489c4006a81baa41ca1d5a1e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:56.094944 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=82,keystone:DELETE=14,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:56.108504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3ccf8810-8797-4d43-8edb-ad5452b4c873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9accbb8655b84894be9a101d7ffdcf33'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:56.130326 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3ccf8810-8797-4d43-8edb-ad5452b4c873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9accbb8655b84894be9a101d7ffdcf33'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:56.140092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1805a7d3-06d1-4765-a7e5-6d43a38f7c9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e897f44489c4006a81baa41ca1d5a1e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:56.141315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1805a7d3-06d1-4765-a7e5-6d43a38f7c9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e897f44489c4006a81baa41ca1d5a1e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:56.169784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1805a7d3-06d1-4765-a7e5-6d43a38f7c9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e897f44489c4006a81baa41ca1d5a1e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:56.177532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3ccf8810-8797-4d43-8edb-ad5452b4c873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9accbb8655b84894be9a101d7ffdcf33'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:56.179160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3ccf8810-8797-4d43-8edb-ad5452b4c873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9accbb8655b84894be9a101d7ffdcf33'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:56.189742 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1095/2176] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:10:55 2022] DELETE /identity/v3/users/8e897f44489c4006a81baa41ca1d5a1e => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:56.192356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae3f5a-a13f-4b87-a3c8-5eebad168151 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:56.192849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae3f5a-a13f-4b87-a3c8-5eebad168151 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:56.193332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae3f5a-a13f-4b87-a3c8-5eebad168151 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:56.198403 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1096/2177] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:10:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:10:56.199995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae3f5a-a13f-4b87-a3c8-5eebad168151 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:56.206422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3ccf8810-8797-4d43-8edb-ad5452b4c873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9accbb8655b84894be9a101d7ffdcf33'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:56.213716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-10ae3f5a-a13f-4b87-a3c8-5eebad168151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:56.227142 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1082/2178] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:10:55 2022] DELETE /identity/v3/users/9accbb8655b84894be9a101d7ffdcf33 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:56.230144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf8810-8797-4d43-8edb-ad5452b4c873 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:56.235786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3ccf8810-8797-4d43-8edb-ad5452b4c873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:56.454272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf8810-8797-4d43-8edb-ad5452b4c873 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:56.477425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeefb23-5105-4775-b68f-a20be643d7c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:56.478141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeefb23-5105-4775-b68f-a20be643d7c4 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:56.478629 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeefb23-5105-4775-b68f-a20be643d7c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:56.479112 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeefb23-5105-4775-b68f-a20be643d7c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:56.488681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-fbeefb23-5105-4775-b68f-a20be643d7c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:56.528998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae3f5a-a13f-4b87-a3c8-5eebad168151 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:56.614382 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:56.688142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeefb23-5105-4775-b68f-a20be643d7c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:56.694659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeefb23-5105-4775-b68f-a20be643d7c4 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:56.759109 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1083/2179] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:56 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:56.769118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bf9cf-1338-43c4-a4b2-28a351833ed4 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:56.769485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bf9cf-1338-43c4-a4b2-28a351833ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:56.769868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33bf9cf-1338-43c4-a4b2-28a351833ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:56.829781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731da80-3c17-412d-8066-01359acfc4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:56.830630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731da80-3c17-412d-8066-01359acfc4ba admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:56.831100 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731da80-3c17-412d-8066-01359acfc4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:56.835862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731da80-3c17-412d-8066-01359acfc4ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:56.840988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731da80-3c17-412d-8066-01359acfc4ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:56.845515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731da80-3c17-412d-8066-01359acfc4ba admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:56.879980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-f33bf9cf-1338-43c4-a4b2-28a351833ed4 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:56.879980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f33bf9cf-1338-43c4-a4b2-28a351833ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:56.893793 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1097/2180] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 694 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:56.895692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731da80-3c17-412d-8066-01359acfc4ba admin admin] Authenticating service token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:10:56.904593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1731da80-3c17-412d-8066-01359acfc4ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:56.910751 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1084/2181] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:56.924110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33bf9cf-1338-43c4-a4b2-28a351833ed4 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:56.936783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f33bf9cf-1338-43c4-a4b2-28a351833ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:56.982957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33bf9cf-1338-43c4-a4b2-28a351833ed4 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:57.005053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da060b4-0a39-4899-ba30-b293f6847122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:57.008504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da060b4-0a39-4899-ba30-b293f6847122 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:57.009016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da060b4-0a39-4899-ba30-b293f6847122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:57.009487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da060b4-0a39-4899-ba30-b293f6847122 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:57.011146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da060b4-0a39-4899-ba30-b293f6847122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:57.021110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da060b4-0a39-4899-ba30-b293f6847122 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:57.076277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731da80-3c17-412d-8066-01359acfc4ba admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:57.084594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1731da80-3c17-412d-8066-01359acfc4ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:57.085232 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1085/2182] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:10:57.087046 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da060b4-0a39-4899-ba30-b293f6847122 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:57.095194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2da060b4-0a39-4899-ba30-b293f6847122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:57.316873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da060b4-0a39-4899-ba30-b293f6847122 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:57.336030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf88532-bdce-4225-93e7-708442cea41a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:57.337804 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf88532-bdce-4225-93e7-708442cea41a service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:57.339072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf88532-bdce-4225-93e7-708442cea41a service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:57.339903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf88532-bdce-4225-93e7-708442cea41a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:57.386043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf88532-bdce-4225-93e7-708442cea41a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:57.392383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf88532-bdce-4225-93e7-708442cea41a service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:57.418182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731da80-3c17-412d-8066-01359acfc4ba admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:57.443928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d387fc-0ba9-4d17-be28-4110de04d38c tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d41b32b2deb4713841afe180277b8f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffca783753d8464da99a508374e3551c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:57.446358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d387fc-0ba9-4d17-be28-4110de04d38c tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:57.447651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d387fc-0ba9-4d17-be28-4110de04d38c tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:57.449949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d387fc-0ba9-4d17-be28-4110de04d38c tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] PATH_INFO: `/v3/projects/01a04222bcde49e59e746386b54d90a0` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:57.450348 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1086/2183] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:57.452042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf88532-bdce-4225-93e7-708442cea41a service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:57.459639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d387fc-0ba9-4d17-be28-4110de04d38c tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] RBAC: Authorizing `identity:get_project(project_id=01a04222bcde49e59e746386b54d90a0)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:57.470456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d387fc-0ba9-4d17-be28-4110de04d38c tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:57.481504 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1098/2184] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:10:56 2022] GET /identity/v3/projects/01a04222bcde49e59e746386b54d90a0 => generated 391 bytes in 586 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:10:57.497773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf88532-bdce-4225-93e7-708442cea41a service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:57.509995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0d27e-d4ed-4248-9636-c5de68a994a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:57.512014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0d27e-d4ed-4248-9636-c5de68a994a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:57.512422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0d27e-d4ed-4248-9636-c5de68a994a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:57.517981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0d27e-d4ed-4248-9636-c5de68a994a3 admin admin] PATH_INFO: `/v3/projects/5287596e52c24ecda951e44ac05ce31e/users/3f083c0ffad244c197833a86ab279a25/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:57.628705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb0d27e-d4ed-4248-9636-c5de68a994a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5287596e52c24ecda951e44ac05ce31e, user_id=3f083c0ffad244c197833a86ab279a25, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:57.637613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb0d27e-d4ed-4248-9636-c5de68a994a3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:57.685898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227612e3-b37e-4c22-a9c2-25ae75ee4acd None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:57.688787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227612e3-b37e-4c22-a9c2-25ae75ee4acd None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:57.689374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227612e3-b37e-4c22-a9c2-25ae75ee4acd None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:57.693803 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1099/2185] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:10:57 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:10:57.718292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227612e3-b37e-4c22-a9c2-25ae75ee4acd None None] Authenticating service token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:10:57.753393 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1087/2186] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:10:57 2022] PUT /identity/v3/projects/5287596e52c24ecda951e44ac05ce31e/users/3f083c0ffad244c197833a86ab279a25/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:57.780427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f13009-a21b-4b48-abc6-e14eb0d118f6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:57.780949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f13009-a21b-4b48-abc6-e14eb0d118f6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:57.781647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f13009-a21b-4b48-abc6-e14eb0d118f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:57.858034 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:57.932897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-02f13009-a21b-4b48-abc6-e14eb0d118f6 None None] MFA Rules not processed for user `3f083c0ffad244c197833a86ab279a25`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:57.937428 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-02f13009-a21b-4b48-abc6-e14eb0d118f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:58.152664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227612e3-b37e-4c22-a9c2-25ae75ee4acd None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:58.251674 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1088/2187] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:58.260757 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f13009-a21b-4b48-abc6-e14eb0d118f6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:58.266568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-02f13009-a21b-4b48-abc6-e14eb0d118f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:58.443295 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:10:58.458687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227612e3-b37e-4c22-a9c2-25ae75ee4acd None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:58.485707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de401bd8-29a6-47e2-b25a-79066b5f7745 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d41b32b2deb4713841afe180277b8f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffca783753d8464da99a508374e3551c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:58.486986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de401bd8-29a6-47e2-b25a-79066b5f7745 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:58.487493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de401bd8-29a6-47e2-b25a-79066b5f7745 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:58.492512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de401bd8-29a6-47e2-b25a-79066b5f7745 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] PATH_INFO: `/v3/projects/01a04222bcde49e59e746386b54d90a0` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:58.502412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de401bd8-29a6-47e2-b25a-79066b5f7745 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] RBAC: Authorizing `identity:get_project(project_id=01a04222bcde49e59e746386b54d90a0)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:58.514069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de401bd8-29a6-47e2-b25a-79066b5f7745 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:58.536775 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1100/2188] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:10:57 2022] GET /identity/v3/projects/01a04222bcde49e59e746386b54d90a0 => generated 391 bytes in 819 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:10:58.540366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de401bd8-29a6-47e2-b25a-79066b5f7745 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:58.593120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de401bd8-29a6-47e2-b25a-79066b5f7745 tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:58.628530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc1fbf-a8fd-40ff-8921-2b22731ff008 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:58.628530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc1fbf-a8fd-40ff-8921-2b22731ff008 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:58.628530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc1fbf-a8fd-40ff-8921-2b22731ff008 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:58.628530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc1fbf-a8fd-40ff-8921-2b22731ff008 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:58.667567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc1fbf-a8fd-40ff-8921-2b22731ff008 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:58.667567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc1fbf-a8fd-40ff-8921-2b22731ff008 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:58.700704 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1101/2189] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:10:58.715224 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f13009-a21b-4b48-abc6-e14eb0d118f6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:58.749297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a55414-42ef-4c31-a7a8-08359f019a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:58.754262 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a55414-42ef-4c31-a7a8-08359f019a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:58.757459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a55414-42ef-4c31-a7a8-08359f019a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:58.757459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a55414-42ef-4c31-a7a8-08359f019a9c admin admin] PATH_INFO: `/v3/users/9dec618a8f8f4d26b2ddaf5d9d8d8a4c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:58.760535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a55414-42ef-4c31-a7a8-08359f019a9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dec618a8f8f4d26b2ddaf5d9d8d8a4c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:58.777925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a55414-42ef-4c31-a7a8-08359f019a9c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:58.843956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eedc6f-58b4-4f7d-8775-f23473ff676c None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:58.844858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eedc6f-58b4-4f7d-8775-f23473ff676c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:58.845550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eedc6f-58b4-4f7d-8775-f23473ff676c None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:58.852565 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1102/2190] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:10:58 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:10:58.859989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eedc6f-58b4-4f7d-8775-f23473ff676c None None] Authenticating service token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:10:58.911335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eedc6f-58b4-4f7d-8775-f23473ff676c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:58.932922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eedc6f-58b4-4f7d-8775-f23473ff676c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:58.949408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b29209-02d4-49e5-be8e-0b6b4ba16b4f tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d41b32b2deb4713841afe180277b8f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffca783753d8464da99a508374e3551c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:58.953158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b29209-02d4-49e5-be8e-0b6b4ba16b4f tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:58.953949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b29209-02d4-49e5-be8e-0b6b4ba16b4f tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:58.954795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b29209-02d4-49e5-be8e-0b6b4ba16b4f tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] PATH_INFO: `/v3/projects/01a04222bcde49e59e746386b54d90a0` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:58.957613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b29209-02d4-49e5-be8e-0b6b4ba16b4f tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] RBAC: Authorizing `identity:get_project(project_id=01a04222bcde49e59e746386b54d90a0)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:58.958857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-56a55414-42ef-4c31-a7a8-08359f019a9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dec618a8f8f4d26b2ddaf5d9d8d8a4c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:58.963511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b29209-02d4-49e5-be8e-0b6b4ba16b4f tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:58.975650 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1103/2191] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:10:58 2022] GET /identity/v3/projects/01a04222bcde49e59e746386b54d90a0 => generated 391 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:10:58.982019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-56a55414-42ef-4c31-a7a8-08359f019a9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dec618a8f8f4d26b2ddaf5d9d8d8a4c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:59.005155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-56a55414-42ef-4c31-a7a8-08359f019a9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dec618a8f8f4d26b2ddaf5d9d8d8a4c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:59.006618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-56a55414-42ef-4c31-a7a8-08359f019a9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dec618a8f8f4d26b2ddaf5d9d8d8a4c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:59.027723 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-56a55414-42ef-4c31-a7a8-08359f019a9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dec618a8f8f4d26b2ddaf5d9d8d8a4c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:10:59.045903 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1089/2192] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:10:58 2022] DELETE /identity/v3/users/9dec618a8f8f4d26b2ddaf5d9d8d8a4c => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:10:59.051738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1232c-d832-450d-bf0b-3bb5937b80cc None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:59.052658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1232c-d832-450d-bf0b-3bb5937b80cc None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:59.053060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1232c-d832-450d-bf0b-3bb5937b80cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:59.112789 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-fef1232c-d832-450d-bf0b-3bb5937b80cc None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:10:59.117746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fef1232c-d832-450d-bf0b-3bb5937b80cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:59.292524 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1104/2193] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:10:59.406975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a55414-42ef-4c31-a7a8-08359f019a9c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:10:59.412029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-56a55414-42ef-4c31-a7a8-08359f019a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:10:59.764299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a55414-42ef-4c31-a7a8-08359f019a9c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:10:59.785737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271585c-b9be-47d7-97b9-555f99f151eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:10:59.787496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271585c-b9be-47d7-97b9-555f99f151eb service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:10:59.788625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271585c-b9be-47d7-97b9-555f99f151eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:10:59.789097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271585c-b9be-47d7-97b9-555f99f151eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:10:59.825450 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271585c-b9be-47d7-97b9-555f99f151eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:10:59.829719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271585c-b9be-47d7-97b9-555f99f151eb service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:10:59.882593 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1090/2194] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:10:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:00.139172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1232c-d832-450d-bf0b-3bb5937b80cc None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:00.144295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fef1232c-d832-450d-bf0b-3bb5937b80cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:00.177110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271585c-b9be-47d7-97b9-555f99f151eb service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:00.181089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b271585c-b9be-47d7-97b9-555f99f151eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:00.193621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1232c-d832-450d-bf0b-3bb5937b80cc None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:00.213372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a828b0-146e-4e3e-bcd9-e607966bb0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:00.219734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a828b0-146e-4e3e-bcd9-e607966bb0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:00.224179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a828b0-146e-4e3e-bcd9-e607966bb0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:00.225112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a828b0-146e-4e3e-bcd9-e607966bb0f3 admin admin] PATH_INFO: `/v3/projects/f2239ad86993401085b946379209eda3` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:00.229891 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a828b0-146e-4e3e-bcd9-e607966bb0f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2239ad86993401085b946379209eda3)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:00.269705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a828b0-146e-4e3e-bcd9-e607966bb0f3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:00.431963 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:00.450724 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:00.501879 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-42a828b0-146e-4e3e-bcd9-e607966bb0f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2239ad86993401085b946379209eda3', 'request_id': 'req-42a828b0-146e-4e3e-bcd9-e607966bb0f3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:00.516854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-42a828b0-146e-4e3e-bcd9-e607966bb0f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2239ad86993401085b946379209eda3', 'request_id': 'req-42a828b0-146e-4e3e-bcd9-e607966bb0f3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:00.536851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271585c-b9be-47d7-97b9-555f99f151eb service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:00.540049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-42a828b0-146e-4e3e-bcd9-e607966bb0f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2239ad86993401085b946379209eda3', 'request_id': 'req-42a828b0-146e-4e3e-bcd9-e607966bb0f3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:00.586785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-42a828b0-146e-4e3e-bcd9-e607966bb0f3 admin admin] The token cache is being invalidate because project f2239ad86993401085b946379209eda3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:11:00.587956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-42a828b0-146e-4e3e-bcd9-e607966bb0f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:00.602674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-42a828b0-146e-4e3e-bcd9-e607966bb0f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:00.606857 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1105/2195] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:11:00 2022] DELETE /identity/v3/projects/f2239ad86993401085b946379209eda3 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:11:00.615135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd5f0b-4937-4cdf-8923-0eef539889af None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:00.623022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd5f0b-4937-4cdf-8923-0eef539889af None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:00.626834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd5f0b-4937-4cdf-8923-0eef539889af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:00.732018 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f4bd5f0b-4937-4cdf-8923-0eef539889af None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:00.738522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f4bd5f0b-4937-4cdf-8923-0eef539889af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:00.865869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb508308-823a-46b7-8944-16ed6cbb768a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:00.868011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb508308-823a-46b7-8944-16ed6cbb768a service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:00.868992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb508308-823a-46b7-8944-16ed6cbb768a service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:00.870477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb508308-823a-46b7-8944-16ed6cbb768a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:00.874859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-eb508308-823a-46b7-8944-16ed6cbb768a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:01.071014 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1106/2196] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:01.073759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d6df6-114f-4ef1-bb26-a4fff6799f33 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:01.074246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d6df6-114f-4ef1-bb26-a4fff6799f33 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:01.074729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d6df6-114f-4ef1-bb26-a4fff6799f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:01.079125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb508308-823a-46b7-8944-16ed6cbb768a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:01.083468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb508308-823a-46b7-8944-16ed6cbb768a service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:01.128650 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1091/2197] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:00 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 953 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:01.210736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-167d6df6-114f-4ef1-bb26-a4fff6799f33 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:01.213629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-167d6df6-114f-4ef1-bb26-a4fff6799f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:01.271210 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1107/2198] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:11:01.278479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb508308-823a-46b7-8944-16ed6cbb768a service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:01.300349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb508308-823a-46b7-8944-16ed6cbb768a service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:01.308782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b130d87-ef73-4bd6-986e-8f3ae45dabcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:01.309986 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b130d87-ef73-4bd6-986e-8f3ae45dabcc admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:01.310291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b130d87-ef73-4bd6-986e-8f3ae45dabcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:01.310553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b130d87-ef73-4bd6-986e-8f3ae45dabcc admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:01.311622 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b130d87-ef73-4bd6-986e-8f3ae45dabcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:11:01.312011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b130d87-ef73-4bd6-986e-8f3ae45dabcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:01.314710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b130d87-ef73-4bd6-986e-8f3ae45dabcc admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:01.352792 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1092/2199] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:11:01.353091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d6df6-114f-4ef1-bb26-a4fff6799f33 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:01.369798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d6df6-114f-4ef1-bb26-a4fff6799f33 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:01.375979 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce49bb-376b-404d-bf66-b43cf775dc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:01.376992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce49bb-376b-404d-bf66-b43cf775dc1f admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:01.377475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce49bb-376b-404d-bf66-b43cf775dc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:01.378003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce49bb-376b-404d-bf66-b43cf775dc1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:01.379013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce49bb-376b-404d-bf66-b43cf775dc1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:01.381077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce49bb-376b-404d-bf66-b43cf775dc1f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:01.493568 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1108/2200] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:11:01 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:11:01.496595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b130d87-ef73-4bd6-986e-8f3ae45dabcc admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:01.513990 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b130d87-ef73-4bd6-986e-8f3ae45dabcc admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:01.593450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce49bb-376b-404d-bf66-b43cf775dc1f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:01.597087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-16ce49bb-376b-404d-bf66-b43cf775dc1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:01.856903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f20f8-dd0a-49ef-8233-bef109caba8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:01.858636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f20f8-dd0a-49ef-8233-bef109caba8e admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:01.858786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f20f8-dd0a-49ef-8233-bef109caba8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:01.859148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f20f8-dd0a-49ef-8233-bef109caba8e admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:01.860226 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f20f8-dd0a-49ef-8233-bef109caba8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:01.863751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f20f8-dd0a-49ef-8233-bef109caba8e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:01.870105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce49bb-376b-404d-bf66-b43cf775dc1f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:01.884753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44387321-818c-40ba-aec0-1be2f53e47af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:01.885972 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44387321-818c-40ba-aec0-1be2f53e47af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:01.886484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44387321-818c-40ba-aec0-1be2f53e47af admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:01.887206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44387321-818c-40ba-aec0-1be2f53e47af admin admin] PATH_INFO: `/v3/projects/f7cb02b703124a7bb199b9a798f1beb0` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:01.888829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44387321-818c-40ba-aec0-1be2f53e47af admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7cb02b703124a7bb199b9a798f1beb0)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:01.897186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44387321-818c-40ba-aec0-1be2f53e47af admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:02.000994 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:02.027792 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1093/2201] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:11:01 2022] POST /identity/v3/users => generated 293 bytes in 532 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:02.043698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23ecee-0463-4831-aefc-359753eb4083 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:02.048483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23ecee-0463-4831-aefc-359753eb4083 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:02.049365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23ecee-0463-4831-aefc-359753eb4083 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:02.065742 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1094/2202] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:11:02 2022] GET /identity => generated 270 bytes in 37 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:11:02.067866 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23ecee-0463-4831-aefc-359753eb4083 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:02.092487 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:02.096089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-44387321-818c-40ba-aec0-1be2f53e47af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7cb02b703124a7bb199b9a798f1beb0', 'request_id': 'req-44387321-818c-40ba-aec0-1be2f53e47af'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:02.114529 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-44387321-818c-40ba-aec0-1be2f53e47af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7cb02b703124a7bb199b9a798f1beb0', 'request_id': 'req-44387321-818c-40ba-aec0-1be2f53e47af'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:02.140362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-44387321-818c-40ba-aec0-1be2f53e47af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7cb02b703124a7bb199b9a798f1beb0', 'request_id': 'req-44387321-818c-40ba-aec0-1be2f53e47af'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:02.172612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-44387321-818c-40ba-aec0-1be2f53e47af admin admin] The token cache is being invalidate because project f7cb02b703124a7bb199b9a798f1beb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:11:02.174758 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-44387321-818c-40ba-aec0-1be2f53e47af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:02.181086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-44387321-818c-40ba-aec0-1be2f53e47af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:02.194070 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1109/2203] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:11:01 2022] DELETE /identity/v3/projects/f7cb02b703124a7bb199b9a798f1beb0 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:02.199667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44387321-818c-40ba-aec0-1be2f53e47af admin admin] Authenticating service token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:11:02.209978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-44387321-818c-40ba-aec0-1be2f53e47af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:02.332175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23ecee-0463-4831-aefc-359753eb4083 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:02.342095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0afc68-bc84-4773-acac-d3fa8d6b5bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:02.345412 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0afc68-bc84-4773-acac-d3fa8d6b5bfa admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:02.346725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0afc68-bc84-4773-acac-d3fa8d6b5bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:02.347019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0afc68-bc84-4773-acac-d3fa8d6b5bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:02.348719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0afc68-bc84-4773-acac-d3fa8d6b5bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:02.350783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0afc68-bc84-4773-acac-d3fa8d6b5bfa admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:02.380686 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1095/2204] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:02.382443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0afc68-bc84-4773-acac-d3fa8d6b5bfa admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:02.389385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ad0afc68-bc84-4773-acac-d3fa8d6b5bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:02.425919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0afc68-bc84-4773-acac-d3fa8d6b5bfa admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:02.444138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141606e-2889-428b-8e4f-19d91c68672a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:02.445860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141606e-2889-428b-8e4f-19d91c68672a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:02.446357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141606e-2889-428b-8e4f-19d91c68672a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:02.446830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141606e-2889-428b-8e4f-19d91c68672a admin admin] PATH_INFO: `/v3/users/5f63191ef3b9460aa302dbd56324e94f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:02.452896 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141606e-2889-428b-8e4f-19d91c68672a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f63191ef3b9460aa302dbd56324e94f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:02.459983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141606e-2889-428b-8e4f-19d91c68672a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:02.511839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44387321-818c-40ba-aec0-1be2f53e47af admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:02.513936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-44387321-818c-40ba-aec0-1be2f53e47af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:02.611845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8141606e-2889-428b-8e4f-19d91c68672a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f63191ef3b9460aa302dbd56324e94f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:02.655306 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8141606e-2889-428b-8e4f-19d91c68672a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f63191ef3b9460aa302dbd56324e94f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:02.692967 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8141606e-2889-428b-8e4f-19d91c68672a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f63191ef3b9460aa302dbd56324e94f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:02.693962 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8141606e-2889-428b-8e4f-19d91c68672a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f63191ef3b9460aa302dbd56324e94f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:02.710922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8141606e-2889-428b-8e4f-19d91c68672a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f63191ef3b9460aa302dbd56324e94f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:02.720418 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1096/2205] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:11:02 2022] DELETE /identity/v3/users/5f63191ef3b9460aa302dbd56324e94f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:02.721558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141606e-2889-428b-8e4f-19d91c68672a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:02.725234 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8141606e-2889-428b-8e4f-19d91c68672a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:02.837653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141606e-2889-428b-8e4f-19d91c68672a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:02.846225 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32842b3-394e-429b-b88a-9cec079e0ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:02.847743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32842b3-394e-429b-b88a-9cec079e0ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:02.848461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32842b3-394e-429b-b88a-9cec079e0ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:02.848914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32842b3-394e-429b-b88a-9cec079e0ac8 admin admin] PATH_INFO: `/v3/users/3f083c0ffad244c197833a86ab279a25` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:02.851053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32842b3-394e-429b-b88a-9cec079e0ac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f083c0ffad244c197833a86ab279a25)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:02.855965 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32842b3-394e-429b-b88a-9cec079e0ac8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:02.890485 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:02.912396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44387321-818c-40ba-aec0-1be2f53e47af admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:03.062379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a32842b3-394e-429b-b88a-9cec079e0ac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f083c0ffad244c197833a86ab279a25'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:03.083279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a32842b3-394e-429b-b88a-9cec079e0ac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f083c0ffad244c197833a86ab279a25'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:03.146491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a32842b3-394e-429b-b88a-9cec079e0ac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f083c0ffad244c197833a86ab279a25'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:03.149518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a32842b3-394e-429b-b88a-9cec079e0ac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f083c0ffad244c197833a86ab279a25'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:03.158522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a08795-ef76-431e-bc70-2169db646edd tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d41b32b2deb4713841afe180277b8f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffca783753d8464da99a508374e3551c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:03.160466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a08795-ef76-431e-bc70-2169db646edd tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:03.160841 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a08795-ef76-431e-bc70-2169db646edd tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:03.161032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a08795-ef76-431e-bc70-2169db646edd tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] PATH_INFO: `/v3/projects/01a04222bcde49e59e746386b54d90a0` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:03.163734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a08795-ef76-431e-bc70-2169db646edd tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] RBAC: Authorizing `identity:get_project(project_id=01a04222bcde49e59e746386b54d90a0)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:03.166674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a08795-ef76-431e-bc70-2169db646edd tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:03.169658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a32842b3-394e-429b-b88a-9cec079e0ac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f083c0ffad244c197833a86ab279a25'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:03.178170 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1110/2206] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:11:02 2022] GET /identity/v3/projects/01a04222bcde49e59e746386b54d90a0 => generated 391 bytes in 981 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:11:03.184695 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1097/2207] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:11:02 2022] DELETE /identity/v3/users/3f083c0ffad244c197833a86ab279a25 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:03.186150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a08795-ef76-431e-bc70-2169db646edd tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:03.187357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e35c9-1293-4396-94f2-89fadbe17ac5 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:03.187657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e35c9-1293-4396-94f2-89fadbe17ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:03.188552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e35c9-1293-4396-94f2-89fadbe17ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:03.192557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-83a08795-ef76-431e-bc70-2169db646edd tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:03.219551 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:03.249930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a08795-ef76-431e-bc70-2169db646edd tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:03.266129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-f52e35c9-1293-4396-94f2-89fadbe17ac5 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:03.271091 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f52e35c9-1293-4396-94f2-89fadbe17ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:03.426385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936f05a-afa2-462b-b434-a8916350f135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:03.427683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936f05a-afa2-462b-b434-a8916350f135 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:03.428298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936f05a-afa2-462b-b434-a8916350f135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:03.429825 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936f05a-afa2-462b-b434-a8916350f135 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:03.430995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936f05a-afa2-462b-b434-a8916350f135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:03.434719 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936f05a-afa2-462b-b434-a8916350f135 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:03.462398 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1111/2208] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:03.474052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d46f9-2fb7-4b0f-8002-6b36f2a1811b None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:03.476566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d46f9-2fb7-4b0f-8002-6b36f2a1811b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:03.479141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d46f9-2fb7-4b0f-8002-6b36f2a1811b None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:03.496314 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1112/2209] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:11:03 2022] GET /identity => generated 270 bytes in 33 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:11:03.497735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d46f9-2fb7-4b0f-8002-6b36f2a1811b None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:03.526786 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d46f9-2fb7-4b0f-8002-6b36f2a1811b None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:03.534107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016aecef-0602-4a30-86d5-9825686390c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:03.536632 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016aecef-0602-4a30-86d5-9825686390c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:03.537171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016aecef-0602-4a30-86d5-9825686390c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:03.537663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016aecef-0602-4a30-86d5-9825686390c0 admin admin] PATH_INFO: `/v3/projects/506ab56f68a640b29a72f149321ada3b/users/765b46b5d30e4bc1b8b399a58ce99e85/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:03.586788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016aecef-0602-4a30-86d5-9825686390c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=506ab56f68a640b29a72f149321ada3b, user_id=765b46b5d30e4bc1b8b399a58ce99e85, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:03.614233 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016aecef-0602-4a30-86d5-9825686390c0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:03.620692 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1098/2210] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:03.624684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e35c9-1293-4396-94f2-89fadbe17ac5 None None] Authenticating service token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:11:03.631284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f52e35c9-1293-4396-94f2-89fadbe17ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:03.656005 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1113/2211] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:11:03 2022] PUT /identity/v3/projects/506ab56f68a640b29a72f149321ada3b/users/765b46b5d30e4bc1b8b399a58ce99e85/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:03.671497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016aecef-0602-4a30-86d5-9825686390c0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:03.674176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-016aecef-0602-4a30-86d5-9825686390c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:03.878092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e35c9-1293-4396-94f2-89fadbe17ac5 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:03.890217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f52e35c9-1293-4396-94f2-89fadbe17ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:03.898087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016aecef-0602-4a30-86d5-9825686390c0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:03.921068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ce870-8a8c-4f79-b478-6ce9fea425ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:03.925646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ce870-8a8c-4f79-b478-6ce9fea425ac service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:03.926208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ce870-8a8c-4f79-b478-6ce9fea425ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:03.929101 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ce870-8a8c-4f79-b478-6ce9fea425ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:04.013247 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:04.134036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e35c9-1293-4396-94f2-89fadbe17ac5 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:04.207505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ce870-8a8c-4f79-b478-6ce9fea425ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:04.212131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ce870-8a8c-4f79-b478-6ce9fea425ac service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:04.235820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f6af8-985f-4275-b69e-35d58e2c773b tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d41b32b2deb4713841afe180277b8f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffca783753d8464da99a508374e3551c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:04.236724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f6af8-985f-4275-b69e-35d58e2c773b tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:04.237222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f6af8-985f-4275-b69e-35d58e2c773b tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:04.237632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f6af8-985f-4275-b69e-35d58e2c773b tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] PATH_INFO: `/v3/projects/01a04222bcde49e59e746386b54d90a0` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:04.239610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f6af8-985f-4275-b69e-35d58e2c773b tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] RBAC: Authorizing `identity:get_project(project_id=01a04222bcde49e59e746386b54d90a0)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:04.244954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f6af8-985f-4275-b69e-35d58e2c773b tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:04.260268 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1099/2212] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:11:03 2022] GET /identity/v3/projects/01a04222bcde49e59e746386b54d90a0 => generated 391 bytes in 639 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:11:04.264374 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1114/2213] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:04.266265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65d18c-d236-4961-829c-8d94db907f76 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:04.268226 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65d18c-d236-4961-829c-8d94db907f76 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:04.268981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65d18c-d236-4961-829c-8d94db907f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:04.357248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1c65d18c-d236-4961-829c-8d94db907f76 None None] MFA Rules not processed for user `765b46b5d30e4bc1b8b399a58ce99e85`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:04.361842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1c65d18c-d236-4961-829c-8d94db907f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:04.476527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ce870-8a8c-4f79-b478-6ce9fea425ac service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:04.479464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-188ce870-8a8c-4f79-b478-6ce9fea425ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:04.531174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ce870-8a8c-4f79-b478-6ce9fea425ac service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:04.559525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99a05a-b50f-400a-8efa-57e301f1c08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:04.565337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99a05a-b50f-400a-8efa-57e301f1c08d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:04.566046 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99a05a-b50f-400a-8efa-57e301f1c08d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:04.566672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e99a05a-b50f-400a-8efa-57e301f1c08d admin admin] PATH_INFO: `/v3/projects/49d7d246942240b3a406be0ccfdec120` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:04.570984 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99a05a-b50f-400a-8efa-57e301f1c08d admin admin] RBAC: Authorizing `identity:delete_project(project_id=49d7d246942240b3a406be0ccfdec120)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:04.585232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e99a05a-b50f-400a-8efa-57e301f1c08d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:04.597709 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1100/2214] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:04.605552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65d18c-d236-4961-829c-8d94db907f76 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:04.637835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65d18c-d236-4961-829c-8d94db907f76 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:04.654081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d439fc-7fc0-4fc2-8485-47b20b49d45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:04.654792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d439fc-7fc0-4fc2-8485-47b20b49d45b admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:04.655076 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d439fc-7fc0-4fc2-8485-47b20b49d45b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:04.655456 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d439fc-7fc0-4fc2-8485-47b20b49d45b admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:04.656161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d439fc-7fc0-4fc2-8485-47b20b49d45b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:04.658523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d439fc-7fc0-4fc2-8485-47b20b49d45b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:04.693228 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:04.751867 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1101/2215] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:11:04 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:11:04.751867 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87209097-2871-45a6-9c44-ce7cf408304a None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:04.752352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87209097-2871-45a6-9c44-ce7cf408304a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:04.754464 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87209097-2871-45a6-9c44-ce7cf408304a None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:04.761048 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1102/2216] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:11:04 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:11:04.762103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87209097-2871-45a6-9c44-ce7cf408304a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:04.806136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6e99a05a-b50f-400a-8efa-57e301f1c08d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49d7d246942240b3a406be0ccfdec120', 'request_id': 'req-6e99a05a-b50f-400a-8efa-57e301f1c08d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:04.824076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6e99a05a-b50f-400a-8efa-57e301f1c08d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49d7d246942240b3a406be0ccfdec120', 'request_id': 'req-6e99a05a-b50f-400a-8efa-57e301f1c08d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:04.844345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6e99a05a-b50f-400a-8efa-57e301f1c08d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49d7d246942240b3a406be0ccfdec120', 'request_id': 'req-6e99a05a-b50f-400a-8efa-57e301f1c08d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:04.905239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6e99a05a-b50f-400a-8efa-57e301f1c08d admin admin] The token cache is being invalidate because project 49d7d246942240b3a406be0ccfdec120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:11:04.906677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6e99a05a-b50f-400a-8efa-57e301f1c08d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:04.926778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6e99a05a-b50f-400a-8efa-57e301f1c08d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:04.936809 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1115/2217] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:11:04 2022] DELETE /identity/v3/projects/49d7d246942240b3a406be0ccfdec120 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:04.942999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99a05a-b50f-400a-8efa-57e301f1c08d admin admin] Authenticating service token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:11:04.952863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6e99a05a-b50f-400a-8efa-57e301f1c08d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:04.957368 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:05.041249 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87209097-2871-45a6-9c44-ce7cf408304a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:05.055173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c8c53-0941-43af-8773-aa29083597a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:05.056485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c8c53-0941-43af-8773-aa29083597a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:05.060491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c8c53-0941-43af-8773-aa29083597a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:05.061320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c8c53-0941-43af-8773-aa29083597a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:05.064011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c8c53-0941-43af-8773-aa29083597a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:05.068262 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c8c53-0941-43af-8773-aa29083597a9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:05.150978 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1103/2218] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:11:04 2022] POST /identity/v3/users => generated 299 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:05.153472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3893e5-b350-4933-af44-3f7cee4c3c71 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:05.153888 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3893e5-b350-4933-af44-3f7cee4c3c71 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:05.154378 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3893e5-b350-4933-af44-3f7cee4c3c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:05.224254 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99a05a-b50f-400a-8efa-57e301f1c08d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:05.231575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6e99a05a-b50f-400a-8efa-57e301f1c08d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:05.261519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7b3893e5-b350-4933-af44-3f7cee4c3c71 None None] MFA Rules not processed for user `96d08a2479f847b4b06d6690f1aedb18`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:05.268659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7b3893e5-b350-4933-af44-3f7cee4c3c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:05.459392 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1104/2219] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:05 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:05.461743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbaf6bb-21a0-4943-a59d-a1a7c7eef1d4 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:05.462040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbaf6bb-21a0-4943-a59d-a1a7c7eef1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:05.462454 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbaf6bb-21a0-4943-a59d-a1a7c7eef1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:05.476434 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e99a05a-b50f-400a-8efa-57e301f1c08d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:05.514449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6cbaf6bb-21a0-4943-a59d-a1a7c7eef1d4 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:05.515826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6cbaf6bb-21a0-4943-a59d-a1a7c7eef1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:05.535495 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1105/2220] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:05.537181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbaf6bb-21a0-4943-a59d-a1a7c7eef1d4 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:05.549801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6cbaf6bb-21a0-4943-a59d-a1a7c7eef1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:05.583840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbaf6bb-21a0-4943-a59d-a1a7c7eef1d4 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:05.596043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e001c-124e-47f7-97ff-616bad7fea10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:05.597421 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e001c-124e-47f7-97ff-616bad7fea10 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:05.598624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e001c-124e-47f7-97ff-616bad7fea10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:05.599627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e001c-124e-47f7-97ff-616bad7fea10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:05.601982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e001c-124e-47f7-97ff-616bad7fea10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:05.605392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e001c-124e-47f7-97ff-616bad7fea10 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:05.634994 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:05.661304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44debf45-ff14-4929-954e-84fcbebe60cf tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d41b32b2deb4713841afe180277b8f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffca783753d8464da99a508374e3551c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:05.661547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44debf45-ff14-4929-954e-84fcbebe60cf tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:05.661895 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44debf45-ff14-4929-954e-84fcbebe60cf tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:05.662185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44debf45-ff14-4929-954e-84fcbebe60cf tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] PATH_INFO: `/v3/projects/bc6cabea74704570a310547c7077b366` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:05.664073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44debf45-ff14-4929-954e-84fcbebe60cf tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] RBAC: Authorizing `identity:get_project(project_id=bc6cabea74704570a310547c7077b366)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:05.668192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44debf45-ff14-4929-954e-84fcbebe60cf tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:05.676448 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1106/2221] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:05.678239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e001c-124e-47f7-97ff-616bad7fea10 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:05.678695 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1116/2222] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:11:04 2022] GET /identity/v3/projects/bc6cabea74704570a310547c7077b366 => generated 395 bytes in 740 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:11:05.679796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44debf45-ff14-4929-954e-84fcbebe60cf tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:05.682120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7d6e001c-124e-47f7-97ff-616bad7fea10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:05.687845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-44debf45-ff14-4929-954e-84fcbebe60cf tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:05.743794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e001c-124e-47f7-97ff-616bad7fea10 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:05.747007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44debf45-ff14-4929-954e-84fcbebe60cf tempest-FlavorsAccessNegativeTestJSON-149643226 tempest-FlavorsAccessNegativeTestJSON-149643226-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:05.771967 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d5025-8252-4966-8daf-d85ab3a3adcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:05.775752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d5025-8252-4966-8daf-d85ab3a3adcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:05.779084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d5025-8252-4966-8daf-d85ab3a3adcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:05.780105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d5025-8252-4966-8daf-d85ab3a3adcd admin admin] PATH_INFO: `/v3/projects/47b1fddf09644b6680321adadf6833fe` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:05.783771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d5025-8252-4966-8daf-d85ab3a3adcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=47b1fddf09644b6680321adadf6833fe)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:05.789329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d5025-8252-4966-8daf-d85ab3a3adcd admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:05.793826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c72de2-0695-4e0d-a6d3-adc3f339a0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:05.794823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c72de2-0695-4e0d-a6d3-adc3f339a0cd admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:05.795261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c72de2-0695-4e0d-a6d3-adc3f339a0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:05.795772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c72de2-0695-4e0d-a6d3-adc3f339a0cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:05.796898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c72de2-0695-4e0d-a6d3-adc3f339a0cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:05.808089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c72de2-0695-4e0d-a6d3-adc3f339a0cd admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:05.887205 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1117/2223] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:11:05 2022] POST /identity/v3/projects => generated 403 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:05.887707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c7e00-810e-4489-90a3-3dd6090e95ba None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:05.890376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c7e00-810e-4489-90a3-3dd6090e95ba None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:05.892310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c7e00-810e-4489-90a3-3dd6090e95ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:05.932567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f58d5025-8252-4966-8daf-d85ab3a3adcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47b1fddf09644b6680321adadf6833fe', 'request_id': 'req-f58d5025-8252-4966-8daf-d85ab3a3adcd'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:05.948116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3d2c7e00-810e-4489-90a3-3dd6090e95ba None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:05.948577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f58d5025-8252-4966-8daf-d85ab3a3adcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47b1fddf09644b6680321adadf6833fe', 'request_id': 'req-f58d5025-8252-4966-8daf-d85ab3a3adcd'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:05.950989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3d2c7e00-810e-4489-90a3-3dd6090e95ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:05.969055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f58d5025-8252-4966-8daf-d85ab3a3adcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47b1fddf09644b6680321adadf6833fe', 'request_id': 'req-f58d5025-8252-4966-8daf-d85ab3a3adcd'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:05.998014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f58d5025-8252-4966-8daf-d85ab3a3adcd admin admin] The token cache is being invalidate because project 47b1fddf09644b6680321adadf6833fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:11:05.998301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f58d5025-8252-4966-8daf-d85ab3a3adcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:06.004532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f58d5025-8252-4966-8daf-d85ab3a3adcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:06.006374 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1107/2224] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:11:05 2022] DELETE /identity/v3/projects/47b1fddf09644b6680321adadf6833fe => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:06.007447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d5025-8252-4966-8daf-d85ab3a3adcd admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:06.011436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f58d5025-8252-4966-8daf-d85ab3a3adcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:06.106634 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:06.127797 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1118/2225] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:06.130556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c7e00-810e-4489-90a3-3dd6090e95ba None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:06.135076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3d2c7e00-810e-4489-90a3-3dd6090e95ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:06.166892 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c7e00-810e-4489-90a3-3dd6090e95ba None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:06.178408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d0bab-1e02-4d3e-b139-3c2a8a4a07e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:06.180779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d0bab-1e02-4d3e-b139-3c2a8a4a07e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:06.181994 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d0bab-1e02-4d3e-b139-3c2a8a4a07e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:06.182869 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d0bab-1e02-4d3e-b139-3c2a8a4a07e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:06.185109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d0bab-1e02-4d3e-b139-3c2a8a4a07e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:06.186313 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d5025-8252-4966-8daf-d85ab3a3adcd admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:06.189599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d0bab-1e02-4d3e-b139-3c2a8a4a07e9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:06.195913 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec25101-0cde-4c47-87a0-6871e66720e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:06.196644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec25101-0cde-4c47-87a0-6871e66720e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:06.196977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec25101-0cde-4c47-87a0-6871e66720e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:06.197255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec25101-0cde-4c47-87a0-6871e66720e4 admin admin] PATH_INFO: `/v3/projects/b81a2c4f9cfa4594898a938fa0b38a71/users/23be4c2fe6ff41479da6cf5a888a1a81/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:06.282188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec25101-0cde-4c47-87a0-6871e66720e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b81a2c4f9cfa4594898a938fa0b38a71, user_id=23be4c2fe6ff41479da6cf5a888a1a81, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:06.287185 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1119/2226] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:11:06 2022] POST /identity/v3/users => generated 308 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:06.289929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec25101-0cde-4c47-87a0-6871e66720e4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:06.290092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1b18e-da6d-461c-a07b-1ec1faf9526a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:06.290621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1b18e-da6d-461c-a07b-1ec1faf9526a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:06.291161 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1b18e-da6d-461c-a07b-1ec1faf9526a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:06.341446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-43e1b18e-da6d-461c-a07b-1ec1faf9526a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:06.343594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-43e1b18e-da6d-461c-a07b-1ec1faf9526a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:06.345898 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1108/2227] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:11:06 2022] PUT /identity/v3/projects/b81a2c4f9cfa4594898a938fa0b38a71/users/23be4c2fe6ff41479da6cf5a888a1a81/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:06.347831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec25101-0cde-4c47-87a0-6871e66720e4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:06.357992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cec25101-0cde-4c47-87a0-6871e66720e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:06.495731 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec25101-0cde-4c47-87a0-6871e66720e4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:06.514482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472c916-06ad-46e7-8afd-b0bf863a68f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:06.515937 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472c916-06ad-46e7-8afd-b0bf863a68f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:06.516267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472c916-06ad-46e7-8afd-b0bf863a68f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:06.516601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472c916-06ad-46e7-8afd-b0bf863a68f9 admin admin] PATH_INFO: `/v3/users/852b7ed92928432db151af35a713a77b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:06.525469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472c916-06ad-46e7-8afd-b0bf863a68f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=852b7ed92928432db151af35a713a77b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:06.529024 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1120/2228] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:06.530368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472c916-06ad-46e7-8afd-b0bf863a68f9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:06.530583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1b18e-da6d-461c-a07b-1ec1faf9526a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:06.574337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1b18e-da6d-461c-a07b-1ec1faf9526a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:06.596250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8969f18-0557-4772-93b8-a7b1f47b12a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:06.600174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8969f18-0557-4772-93b8-a7b1f47b12a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:06.601515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8969f18-0557-4772-93b8-a7b1f47b12a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:06.602377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8969f18-0557-4772-93b8-a7b1f47b12a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:06.605385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8969f18-0557-4772-93b8-a7b1f47b12a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:11:06.610040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8969f18-0557-4772-93b8-a7b1f47b12a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:06.620525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8969f18-0557-4772-93b8-a7b1f47b12a8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:06.652453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7472c916-06ad-46e7-8afd-b0bf863a68f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '852b7ed92928432db151af35a713a77b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:06.684294 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1121/2229] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:11:06.686319 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8969f18-0557-4772-93b8-a7b1f47b12a8 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:06.691187 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7472c916-06ad-46e7-8afd-b0bf863a68f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '852b7ed92928432db151af35a713a77b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:06.694312 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c8969f18-0557-4772-93b8-a7b1f47b12a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:06.719112 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7472c916-06ad-46e7-8afd-b0bf863a68f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '852b7ed92928432db151af35a713a77b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:06.720409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7472c916-06ad-46e7-8afd-b0bf863a68f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '852b7ed92928432db151af35a713a77b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:06.733511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7472c916-06ad-46e7-8afd-b0bf863a68f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '852b7ed92928432db151af35a713a77b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:06.734793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8969f18-0557-4772-93b8-a7b1f47b12a8 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:06.744373 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1109/2230] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:11:06 2022] DELETE /identity/v3/users/852b7ed92928432db151af35a713a77b => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:06.750292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472c916-06ad-46e7-8afd-b0bf863a68f9 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:06.752367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7472c916-06ad-46e7-8afd-b0bf863a68f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:06.761696 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898ca07-dba8-4a29-ac69-c27da7de8866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:06.762043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898ca07-dba8-4a29-ac69-c27da7de8866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:06.763606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898ca07-dba8-4a29-ac69-c27da7de8866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:06.763606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0898ca07-dba8-4a29-ac69-c27da7de8866 admin admin] PATH_INFO: `/v3/projects/5287596e52c24ecda951e44ac05ce31e` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:06.764383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0898ca07-dba8-4a29-ac69-c27da7de8866 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5287596e52c24ecda951e44ac05ce31e)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:06.767536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0898ca07-dba8-4a29-ac69-c27da7de8866 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:06.802573 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:06.828311 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:06.847536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0898ca07-dba8-4a29-ac69-c27da7de8866 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5287596e52c24ecda951e44ac05ce31e', 'request_id': 'req-0898ca07-dba8-4a29-ac69-c27da7de8866'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:06.859296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0898ca07-dba8-4a29-ac69-c27da7de8866 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5287596e52c24ecda951e44ac05ce31e', 'request_id': 'req-0898ca07-dba8-4a29-ac69-c27da7de8866'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:06.870273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472c916-06ad-46e7-8afd-b0bf863a68f9 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:06.871296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0898ca07-dba8-4a29-ac69-c27da7de8866 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5287596e52c24ecda951e44ac05ce31e', 'request_id': 'req-0898ca07-dba8-4a29-ac69-c27da7de8866'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:06.902392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0898ca07-dba8-4a29-ac69-c27da7de8866 admin admin] The token cache is being invalidate because project 5287596e52c24ecda951e44ac05ce31e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:11:06.902832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0898ca07-dba8-4a29-ac69-c27da7de8866 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:06.905659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0898ca07-dba8-4a29-ac69-c27da7de8866 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:06.911179 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1122/2231] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:11:06 2022] DELETE /identity/v3/projects/5287596e52c24ecda951e44ac05ce31e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:06.911179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898ca07-dba8-4a29-ac69-c27da7de8866 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:06.911179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0898ca07-dba8-4a29-ac69-c27da7de8866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:06.979022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7530678-5d52-4673-accb-a89b50976b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:06.980475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7530678-5d52-4673-accb-a89b50976b12 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:06.980909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7530678-5d52-4673-accb-a89b50976b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:06.981355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7530678-5d52-4673-accb-a89b50976b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:06.982251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7530678-5d52-4673-accb-a89b50976b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:06.988452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7530678-5d52-4673-accb-a89b50976b12 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:07.011678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0898ca07-dba8-4a29-ac69-c27da7de8866 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:07.016412 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1110/2232] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:07.017953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712b083-32da-4a92-900d-a0e54615580d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:07.018254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712b083-32da-4a92-900d-a0e54615580d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:07.018630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712b083-32da-4a92-900d-a0e54615580d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:07.026550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee501ce-19ee-491b-bd0b-5ba9acde8145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:07.027403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee501ce-19ee-491b-bd0b-5ba9acde8145 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:07.027775 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee501ce-19ee-491b-bd0b-5ba9acde8145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:07.028140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee501ce-19ee-491b-bd0b-5ba9acde8145 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:07.029192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee501ce-19ee-491b-bd0b-5ba9acde8145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:07.040788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee501ce-19ee-491b-bd0b-5ba9acde8145 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:07.064189 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3712b083-32da-4a92-900d-a0e54615580d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:07.064763 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1123/2233] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:07.066978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee501ce-19ee-491b-bd0b-5ba9acde8145 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:07.068873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3712b083-32da-4a92-900d-a0e54615580d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:07.074077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2ee501ce-19ee-491b-bd0b-5ba9acde8145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:07.079239 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1111/2234] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:07.081359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c3670-72c1-44fa-9255-654b501f6221 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:07.081359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c3670-72c1-44fa-9255-654b501f6221 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:07.081603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c3670-72c1-44fa-9255-654b501f6221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:07.106676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-567c3670-72c1-44fa-9255-654b501f6221 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:07.108947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-567c3670-72c1-44fa-9255-654b501f6221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:07.113920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee501ce-19ee-491b-bd0b-5ba9acde8145 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:07.124469 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1112/2235] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:07.126413 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3500912-f0b9-4625-8a77-d7a20fd58b83 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:07.126777 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3500912-f0b9-4625-8a77-d7a20fd58b83 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:07.127119 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3500912-f0b9-4625-8a77-d7a20fd58b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:07.131542 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8689e-095c-415b-a897-ae2195a1d127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:07.132641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8689e-095c-415b-a897-ae2195a1d127 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:07.133126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8689e-095c-415b-a897-ae2195a1d127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:07.133569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8689e-095c-415b-a897-ae2195a1d127 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:07.134410 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8689e-095c-415b-a897-ae2195a1d127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:07.136803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8689e-095c-415b-a897-ae2195a1d127 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:07.156774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c3500912-f0b9-4625-8a77-d7a20fd58b83 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:07.158576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c3500912-f0b9-4625-8a77-d7a20fd58b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:07.184385 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1113/2236] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:07.185497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3500912-f0b9-4625-8a77-d7a20fd58b83 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:07.187860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c3500912-f0b9-4625-8a77-d7a20fd58b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:07.232621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3500912-f0b9-4625-8a77-d7a20fd58b83 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:07.242847 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1124/2237] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:11:07 2022] POST /identity/v3/projects => generated 397 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:07.248342 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8689e-095c-415b-a897-ae2195a1d127 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:07.384983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5322e97-7cc1-4a65-9e03-75f33c26f7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:07.387036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5322e97-7cc1-4a65-9e03-75f33c26f7e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:07.389042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5322e97-7cc1-4a65-9e03-75f33c26f7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:07.389312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5322e97-7cc1-4a65-9e03-75f33c26f7e5 admin admin] PATH_INFO: `/v3/projects/e0645466b9624cc59802802f819897cf/users/1bb91c5d1c274ef38ad02e7fa176b4c6/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:07.414505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8689e-095c-415b-a897-ae2195a1d127 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:07.422489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5322e97-7cc1-4a65-9e03-75f33c26f7e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0645466b9624cc59802802f819897cf, user_id=1bb91c5d1c274ef38ad02e7fa176b4c6, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:07.424585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc2ca4-5267-4a3a-a128-ebf3b2166563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:07.425741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc2ca4-5267-4a3a-a128-ebf3b2166563 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:07.426228 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc2ca4-5267-4a3a-a128-ebf3b2166563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:07.426725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc2ca4-5267-4a3a-a128-ebf3b2166563 admin admin] PATH_INFO: `/v3/projects/b81a2c4f9cfa4594898a938fa0b38a71/users/23be4c2fe6ff41479da6cf5a888a1a81/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:07.427047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5322e97-7cc1-4a65-9e03-75f33c26f7e5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:07.431668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc2ca4-5267-4a3a-a128-ebf3b2166563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b81a2c4f9cfa4594898a938fa0b38a71, user_id=23be4c2fe6ff41479da6cf5a888a1a81, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:07.437811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc2ca4-5267-4a3a-a128-ebf3b2166563 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:07.463351 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1114/2238] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:11:07 2022] PUT /identity/v3/projects/e0645466b9624cc59802802f819897cf/users/1bb91c5d1c274ef38ad02e7fa176b4c6/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:07.464999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5322e97-7cc1-4a65-9e03-75f33c26f7e5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:07.472322 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1125/2239] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:11:07 2022] PUT /identity/v3/projects/b81a2c4f9cfa4594898a938fa0b38a71/users/23be4c2fe6ff41479da6cf5a888a1a81/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:07.475074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67853366-9b49-4ed7-83e5-9e008a89a975 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:07.475513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67853366-9b49-4ed7-83e5-9e008a89a975 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:07.476063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67853366-9b49-4ed7-83e5-9e008a89a975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:07.523052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-67853366-9b49-4ed7-83e5-9e008a89a975 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:07.526657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-67853366-9b49-4ed7-83e5-9e008a89a975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:07.539927 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:07.574487 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:07.585172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5322e97-7cc1-4a65-9e03-75f33c26f7e5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:07.634481 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1126/2240] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:07.636081 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67853366-9b49-4ed7-83e5-9e008a89a975 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:07.637852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-67853366-9b49-4ed7-83e5-9e008a89a975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:07.738460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21c096-ee6d-41f8-8ab0-0d35a758788a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:07.739276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21c096-ee6d-41f8-8ab0-0d35a758788a admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:07.739555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21c096-ee6d-41f8-8ab0-0d35a758788a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:07.739869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21c096-ee6d-41f8-8ab0-0d35a758788a admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:07.740709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21c096-ee6d-41f8-8ab0-0d35a758788a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:11:07.741622 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21c096-ee6d-41f8-8ab0-0d35a758788a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:07.743516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21c096-ee6d-41f8-8ab0-0d35a758788a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:07.774967 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1115/2241] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:11:07.779185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21c096-ee6d-41f8-8ab0-0d35a758788a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:07.785828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67853366-9b49-4ed7-83e5-9e008a89a975 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:07.796535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127124e-9bc3-4bdb-ba6c-3638d1c20ee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:07.797820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127124e-9bc3-4bdb-ba6c-3638d1c20ee6 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:07.798670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127124e-9bc3-4bdb-ba6c-3638d1c20ee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:07.799409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127124e-9bc3-4bdb-ba6c-3638d1c20ee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:07.802299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21c096-ee6d-41f8-8ab0-0d35a758788a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:07.817305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18bafd-bf43-4fc3-962e-3760e8e0f564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:07.818075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18bafd-bf43-4fc3-962e-3760e8e0f564 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:07.818362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18bafd-bf43-4fc3-962e-3760e8e0f564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:07.818631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18bafd-bf43-4fc3-962e-3760e8e0f564 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:07.819436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd18bafd-bf43-4fc3-962e-3760e8e0f564 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:07.825120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127124e-9bc3-4bdb-ba6c-3638d1c20ee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:07.826096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd18bafd-bf43-4fc3-962e-3760e8e0f564 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:07.828494 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127124e-9bc3-4bdb-ba6c-3638d1c20ee6 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:07.849912 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1127/2242] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:07.852176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127124e-9bc3-4bdb-ba6c-3638d1c20ee6 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:07.870544 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1116/2243] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:11:07 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:07.872006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee78cab-c879-4d61-a0d0-660554ed97d9 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:07.872315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee78cab-c879-4d61-a0d0-660554ed97d9 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:07.872588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee78cab-c879-4d61-a0d0-660554ed97d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:07.885347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127124e-9bc3-4bdb-ba6c-3638d1c20ee6 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:07.900265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f63cf-d0a8-49ec-b387-16f7e56f3489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:07.902014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f63cf-d0a8-49ec-b387-16f7e56f3489 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:07.902610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f63cf-d0a8-49ec-b387-16f7e56f3489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:07.903191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f63cf-d0a8-49ec-b387-16f7e56f3489 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:07.908314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f63cf-d0a8-49ec-b387-16f7e56f3489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:07.912161 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f63cf-d0a8-49ec-b387-16f7e56f3489 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:07.946528 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1128/2244] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:07.948945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f63cf-d0a8-49ec-b387-16f7e56f3489 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:07.949489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3ee78cab-c879-4d61-a0d0-660554ed97d9 None None] MFA Rules not processed for user `23be4c2fe6ff41479da6cf5a888a1a81`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:07.950863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3ee78cab-c879-4d61-a0d0-660554ed97d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:07.980069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f63cf-d0a8-49ec-b387-16f7e56f3489 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:07.990753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ffe25-5bfd-4b4d-94a4-69c338b44089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:07.992084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ffe25-5bfd-4b4d-94a4-69c338b44089 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:07.994872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ffe25-5bfd-4b4d-94a4-69c338b44089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:07.995456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ffe25-5bfd-4b4d-94a4-69c338b44089 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:07.996867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ffe25-5bfd-4b4d-94a4-69c338b44089 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:11:07.999974 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ffe25-5bfd-4b4d-94a4-69c338b44089 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:08.004335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ffe25-5bfd-4b4d-94a4-69c338b44089 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:08.043457 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1129/2245] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:11:08.045211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ffe25-5bfd-4b4d-94a4-69c338b44089 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:08.106147 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ffe25-5bfd-4b4d-94a4-69c338b44089 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:08.115061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90343a25-040a-4681-8c86-9a6636defb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:08.116337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90343a25-040a-4681-8c86-9a6636defb50 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:08.116814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90343a25-040a-4681-8c86-9a6636defb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:08.117508 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90343a25-040a-4681-8c86-9a6636defb50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:08.118734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90343a25-040a-4681-8c86-9a6636defb50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:08.124817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90343a25-040a-4681-8c86-9a6636defb50 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:08.158230 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1117/2246] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:08.159181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee78cab-c879-4d61-a0d0-660554ed97d9 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:08.199924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee78cab-c879-4d61-a0d0-660554ed97d9 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:08.222163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b5ebe-0796-4b7a-b15b-15f85da24f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:08.222816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b5ebe-0796-4b7a-b15b-15f85da24f7d admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:08.223158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b5ebe-0796-4b7a-b15b-15f85da24f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:08.223429 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b5ebe-0796-4b7a-b15b-15f85da24f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:08.224535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b5ebe-0796-4b7a-b15b-15f85da24f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:08.228192 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b5ebe-0796-4b7a-b15b-15f85da24f7d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:08.232513 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1130/2247] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:11:08 2022] POST /identity/v3/projects => generated 399 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:08.235457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90343a25-040a-4681-8c86-9a6636defb50 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:08.257470 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1118/2248] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:08.260640 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b5ebe-0796-4b7a-b15b-15f85da24f7d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:08.310340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b5ebe-0796-4b7a-b15b-15f85da24f7d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:08.435661 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:08.457777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90343a25-040a-4681-8c86-9a6636defb50 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:08.524169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a8165-7cc8-48bb-a43b-8889c7dab544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:08.524769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a8165-7cc8-48bb-a43b-8889c7dab544 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:08.525042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a8165-7cc8-48bb-a43b-8889c7dab544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:08.525317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a8165-7cc8-48bb-a43b-8889c7dab544 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:08.525959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a8165-7cc8-48bb-a43b-8889c7dab544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:08.528022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a8165-7cc8-48bb-a43b-8889c7dab544 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:08.529597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209ec5b-0a9b-4cc0-a2e4-77dba3050b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:08.534550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209ec5b-0a9b-4cc0-a2e4-77dba3050b35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:08.535210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209ec5b-0a9b-4cc0-a2e4-77dba3050b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:08.535774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209ec5b-0a9b-4cc0-a2e4-77dba3050b35 admin admin] PATH_INFO: `/v3/projects/e0645466b9624cc59802802f819897cf/users/1bb91c5d1c274ef38ad02e7fa176b4c6/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:08.572942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209ec5b-0a9b-4cc0-a2e4-77dba3050b35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0645466b9624cc59802802f819897cf, user_id=1bb91c5d1c274ef38ad02e7fa176b4c6, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:08.612428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209ec5b-0a9b-4cc0-a2e4-77dba3050b35 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:08.619133 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1119/2249] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:11:08 2022] POST /identity/v3/projects => generated 391 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:08.619818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a8165-7cc8-48bb-a43b-8889c7dab544 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:08.630865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a52a8165-7cc8-48bb-a43b-8889c7dab544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:08.714588 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1131/2250] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:11:08 2022] PUT /identity/v3/projects/e0645466b9624cc59802802f819897cf/users/1bb91c5d1c274ef38ad02e7fa176b4c6/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:08.729519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209ec5b-0a9b-4cc0-a2e4-77dba3050b35 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:08.858802 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:08.925206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a8165-7cc8-48bb-a43b-8889c7dab544 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:09.022788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209ec5b-0a9b-4cc0-a2e4-77dba3050b35 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:09.033196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a117df4-2702-41d6-8703-bdcba9cf0f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:09.034013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a117df4-2702-41d6-8703-bdcba9cf0f53 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:09.034355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a117df4-2702-41d6-8703-bdcba9cf0f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:09.034930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a117df4-2702-41d6-8703-bdcba9cf0f53 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:09.036416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a117df4-2702-41d6-8703-bdcba9cf0f53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:09.057926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a117df4-2702-41d6-8703-bdcba9cf0f53 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:09.095361 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1132/2251] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:11:08 2022] POST /identity/v3/users => generated 300 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:09.095361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a117df4-2702-41d6-8703-bdcba9cf0f53 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:09.102422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283e4e3-a252-4ff3-b049-5c340087cf4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:09.103085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283e4e3-a252-4ff3-b049-5c340087cf4d service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:09.103388 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283e4e3-a252-4ff3-b049-5c340087cf4d service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:09.103693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283e4e3-a252-4ff3-b049-5c340087cf4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:09.129320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a117df4-2702-41d6-8703-bdcba9cf0f53 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:09.142589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1aa28a-d4f9-4094-a6e1-f598b42a58b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:09.144464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1aa28a-d4f9-4094-a6e1-f598b42a58b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:09.144765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1aa28a-d4f9-4094-a6e1-f598b42a58b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:09.145011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1aa28a-d4f9-4094-a6e1-f598b42a58b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:09.148556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1aa28a-d4f9-4094-a6e1-f598b42a58b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:09.152839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1aa28a-d4f9-4094-a6e1-f598b42a58b1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:09.191166 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1133/2252] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:09.192295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1aa28a-d4f9-4094-a6e1-f598b42a58b1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:09.233753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1aa28a-d4f9-4094-a6e1-f598b42a58b1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:09.247716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb5c8c-9eff-4d0c-be4c-ff8a66ad4f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:09.248451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb5c8c-9eff-4d0c-be4c-ff8a66ad4f8e admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:09.248824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb5c8c-9eff-4d0c-be4c-ff8a66ad4f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:09.249108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb5c8c-9eff-4d0c-be4c-ff8a66ad4f8e admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:09.249741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb5c8c-9eff-4d0c-be4c-ff8a66ad4f8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:09.252144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb5c8c-9eff-4d0c-be4c-ff8a66ad4f8e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:09.269182 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:09.288520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283e4e3-a252-4ff3-b049-5c340087cf4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:09.293235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283e4e3-a252-4ff3-b049-5c340087cf4d service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:09.315325 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1134/2253] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:11:09 2022] POST /identity/v3/users => generated 296 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:09.323138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb5c8c-9eff-4d0c-be4c-ff8a66ad4f8e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:09.335689 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1120/2254] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 716 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:09.338422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283e4e3-a252-4ff3-b049-5c340087cf4d service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:09.348256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb5c8c-9eff-4d0c-be4c-ff8a66ad4f8e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:09.358540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283e4e3-a252-4ff3-b049-5c340087cf4d service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:09.361598 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d4247-f99e-45e7-acbc-fe98aa512d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:09.362346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d4247-f99e-45e7-acbc-fe98aa512d7d admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:09.362689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d4247-f99e-45e7-acbc-fe98aa512d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:09.362965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d4247-f99e-45e7-acbc-fe98aa512d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:09.363688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d4247-f99e-45e7-acbc-fe98aa512d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:09.365451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d4247-f99e-45e7-acbc-fe98aa512d7d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:09.386181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fadda2-0562-4cf1-848f-d7da7d3bb12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:09.387068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fadda2-0562-4cf1-848f-d7da7d3bb12d admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:09.387993 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fadda2-0562-4cf1-848f-d7da7d3bb12d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:09.387993 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fadda2-0562-4cf1-848f-d7da7d3bb12d admin admin] PATH_INFO: `/v3/projects/4e443158f15b42a3a795950a7c409a38/users/c135ba135fd946149ace9a86c7c52e80/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:09.398724 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1135/2255] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:09.399851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d4247-f99e-45e7-acbc-fe98aa512d7d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:09.436514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fadda2-0562-4cf1-848f-d7da7d3bb12d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e443158f15b42a3a795950a7c409a38, user_id=c135ba135fd946149ace9a86c7c52e80, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:09.443338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d4247-f99e-45e7-acbc-fe98aa512d7d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:09.450048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fadda2-0562-4cf1-848f-d7da7d3bb12d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:09.466760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e4290-82f5-49c5-85a2-229611b7e8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:09.479738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e4290-82f5-49c5-85a2-229611b7e8ec admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:09.479738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e4290-82f5-49c5-85a2-229611b7e8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:09.479738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e4290-82f5-49c5-85a2-229611b7e8ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:09.481370 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e4290-82f5-49c5-85a2-229611b7e8ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:09.491981 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1121/2256] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:11:09 2022] PUT /identity/v3/projects/4e443158f15b42a3a795950a7c409a38/users/c135ba135fd946149ace9a86c7c52e80/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:09.493624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fadda2-0562-4cf1-848f-d7da7d3bb12d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:09.494161 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e4290-82f5-49c5-85a2-229611b7e8ec admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:09.536424 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1136/2257] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:09.540164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74afd5-8833-43ed-846a-d6eaced1062e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:09.541063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74afd5-8833-43ed-846a-d6eaced1062e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:09.541785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74afd5-8833-43ed-846a-d6eaced1062e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:09.607750 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fadda2-0562-4cf1-848f-d7da7d3bb12d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:09.613254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e11da-4ef9-4f87-9269-edc4eff7ff04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:09.613886 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e11da-4ef9-4f87-9269-edc4eff7ff04 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:09.614163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e11da-4ef9-4f87-9269-edc4eff7ff04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:09.614430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e11da-4ef9-4f87-9269-edc4eff7ff04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:09.616383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e11da-4ef9-4f87-9269-edc4eff7ff04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:09.618623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e11da-4ef9-4f87-9269-edc4eff7ff04 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:09.629131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5b74afd5-8833-43ed-846a-d6eaced1062e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:09.635554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5b74afd5-8833-43ed-846a-d6eaced1062e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:09.647552 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1122/2258] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:09.650829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e11da-4ef9-4f87-9269-edc4eff7ff04 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:09.665174 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1137/2259] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:09.669486 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74afd5-8833-43ed-846a-d6eaced1062e None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:09.680755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e11da-4ef9-4f87-9269-edc4eff7ff04 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:09.693485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f698d7c-0990-42ac-a163-badb5a7c43fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:09.694774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f698d7c-0990-42ac-a163-badb5a7c43fd admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:09.695091 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f698d7c-0990-42ac-a163-badb5a7c43fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:09.695269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f698d7c-0990-42ac-a163-badb5a7c43fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:09.696671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74afd5-8833-43ed-846a-d6eaced1062e None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:09.698535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f698d7c-0990-42ac-a163-badb5a7c43fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:09.702192 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f698d7c-0990-42ac-a163-badb5a7c43fd admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:09.762170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b689289-3492-44f8-81e1-8625f896305c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:09.762882 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b689289-3492-44f8-81e1-8625f896305c admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:09.763145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b689289-3492-44f8-81e1-8625f896305c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:09.763422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b689289-3492-44f8-81e1-8625f896305c admin admin] PATH_INFO: `/v3/projects/632a206a638349cbb3414d6356182761/users/8a3f540f769a484cbe719b17ff8aa0a2/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:09.796974 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1123/2260] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:09.798883 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f698d7c-0990-42ac-a163-badb5a7c43fd admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:09.815060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b689289-3492-44f8-81e1-8625f896305c admin admin] RBAC: Authorizing `identity:create_grant(project_id=632a206a638349cbb3414d6356182761, user_id=8a3f540f769a484cbe719b17ff8aa0a2, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:09.815383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2f698d7c-0990-42ac-a163-badb5a7c43fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:09.818973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b689289-3492-44f8-81e1-8625f896305c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:09.870163 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1138/2261] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:11:09 2022] PUT /identity/v3/projects/632a206a638349cbb3414d6356182761/users/8a3f540f769a484cbe719b17ff8aa0a2/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:09.878022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b689289-3492-44f8-81e1-8625f896305c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:10.019604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f698d7c-0990-42ac-a163-badb5a7c43fd admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:10.085961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b689289-3492-44f8-81e1-8625f896305c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:10.096290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650aec6-e5aa-4b06-b2ac-4ac053503849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:10.096959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650aec6-e5aa-4b06-b2ac-4ac053503849 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:10.097234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650aec6-e5aa-4b06-b2ac-4ac053503849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:10.097681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650aec6-e5aa-4b06-b2ac-4ac053503849 admin admin] PATH_INFO: `/v3/projects/7c2c9ff9beef426785b22ee0e2876c08/users/aaaa793a840141369476d821307497c0/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:10.154684 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650aec6-e5aa-4b06-b2ac-4ac053503849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c2c9ff9beef426785b22ee0e2876c08, user_id=aaaa793a840141369476d821307497c0, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:10.158506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9650aec6-e5aa-4b06-b2ac-4ac053503849 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:10.187241 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1139/2262] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:11:09 2022] PUT /identity/v3/projects/7c2c9ff9beef426785b22ee0e2876c08/users/aaaa793a840141369476d821307497c0/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:10.190292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2ee75-8693-44cb-9537-94823174d697 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:10.193809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2ee75-8693-44cb-9537-94823174d697 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:10.193809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2ee75-8693-44cb-9537-94823174d697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:10.301594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fc351-0afd-4e03-b96e-f2bd5b8581a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:10.302659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fc351-0afd-4e03-b96e-f2bd5b8581a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:10.314665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fc351-0afd-4e03-b96e-f2bd5b8581a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:10.314665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fc351-0afd-4e03-b96e-f2bd5b8581a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:10.327050 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:10.343817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-acb2ee75-8693-44cb-9537-94823174d697 None None] MFA Rules not processed for user `8a3f540f769a484cbe719b17ff8aa0a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:10.348033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-acb2ee75-8693-44cb-9537-94823174d697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:10.367097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545fc351-0afd-4e03-b96e-f2bd5b8581a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:10.369807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545fc351-0afd-4e03-b96e-f2bd5b8581a4 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:10.414852 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1124/2263] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:10.421986 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ec218-57c6-4899-9fd6-4e9cf15573b2 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:10.421986 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ec218-57c6-4899-9fd6-4e9cf15573b2 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:10.422306 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ec218-57c6-4899-9fd6-4e9cf15573b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:10.509879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-541ec218-57c6-4899-9fd6-4e9cf15573b2 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:10.512045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-541ec218-57c6-4899-9fd6-4e9cf15573b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:10.544335 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:10.598741 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1140/2264] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:10 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:10.603420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2ee75-8693-44cb-9537-94823174d697 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:10.759277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2ee75-8693-44cb-9537-94823174d697 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:10.767157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17152f-bc57-4868-9c92-f059805e359b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:10.767459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17152f-bc57-4868-9c92-f059805e359b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:10.767794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17152f-bc57-4868-9c92-f059805e359b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:10.768117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17152f-bc57-4868-9c92-f059805e359b admin admin] PATH_INFO: `/v3/users/765b46b5d30e4bc1b8b399a58ce99e85` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:10.769888 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d17152f-bc57-4868-9c92-f059805e359b admin admin] RBAC: Authorizing `identity:delete_user(user_id=765b46b5d30e4bc1b8b399a58ce99e85)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:10.772940 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d17152f-bc57-4868-9c92-f059805e359b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:10.846577 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1125/2265] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:10.848499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ec218-57c6-4899-9fd6-4e9cf15573b2 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:10.879499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7d17152f-bc57-4868-9c92-f059805e359b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '765b46b5d30e4bc1b8b399a58ce99e85'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:10.888885 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ec218-57c6-4899-9fd6-4e9cf15573b2 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:10.906221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7d17152f-bc57-4868-9c92-f059805e359b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '765b46b5d30e4bc1b8b399a58ce99e85'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:10.907144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c134a8a-e791-4078-9c04-067bf6afa564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:10.908353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c134a8a-e791-4078-9c04-067bf6afa564 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:10.909030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c134a8a-e791-4078-9c04-067bf6afa564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:10.909618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c134a8a-e791-4078-9c04-067bf6afa564 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:10.910843 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c134a8a-e791-4078-9c04-067bf6afa564 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:10.926896 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c134a8a-e791-4078-9c04-067bf6afa564 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:10.929463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7d17152f-bc57-4868-9c92-f059805e359b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '765b46b5d30e4bc1b8b399a58ce99e85'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:10.930538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7d17152f-bc57-4868-9c92-f059805e359b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '765b46b5d30e4bc1b8b399a58ce99e85'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:10.945292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7d17152f-bc57-4868-9c92-f059805e359b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '765b46b5d30e4bc1b8b399a58ce99e85'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:10.962142 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1141/2266] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:11:10 2022] DELETE /identity/v3/users/765b46b5d30e4bc1b8b399a58ce99e85 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:10.963496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17152f-bc57-4868-9c92-f059805e359b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:10.967246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7d17152f-bc57-4868-9c92-f059805e359b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:11.049149 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1126/2267] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:11:10 2022] POST /identity/v3/projects => generated 399 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:11.072982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c60be-11db-4af2-8615-d1824f9fc9ad None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:11.079949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c60be-11db-4af2-8615-d1824f9fc9ad None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:11.080361 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:11.092216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c60be-11db-4af2-8615-d1824f9fc9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:11.199255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-646c60be-11db-4af2-8615-d1824f9fc9ad None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:11.200059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17152f-bc57-4868-9c92-f059805e359b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:11.202082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-646c60be-11db-4af2-8615-d1824f9fc9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:11.386817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e60b4-e3cd-4d2d-a4f1-de94b02b5aab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:11.389199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e60b4-e3cd-4d2d-a4f1-de94b02b5aab service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:11.389580 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e60b4-e3cd-4d2d-a4f1-de94b02b5aab service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:11.389958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e60b4-e3cd-4d2d-a4f1-de94b02b5aab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:11.392665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8c4e60b4-e3cd-4d2d-a4f1-de94b02b5aab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:11.510573 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1127/2268] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:11.513650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c60be-11db-4af2-8615-d1824f9fc9ad None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:11.520243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-646c60be-11db-4af2-8615-d1824f9fc9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:11.555345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e60b4-e3cd-4d2d-a4f1-de94b02b5aab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:11.560407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e60b4-e3cd-4d2d-a4f1-de94b02b5aab service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:11.575636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c60be-11db-4af2-8615-d1824f9fc9ad None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:11.591304 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1142/2269] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:11.592537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e60b4-e3cd-4d2d-a4f1-de94b02b5aab service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:11.599377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8c4e60b4-e3cd-4d2d-a4f1-de94b02b5aab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:11.605703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305847d0-e352-4604-a8aa-2292d771a59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:11.606985 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305847d0-e352-4604-a8aa-2292d771a59d admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:11.607609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305847d0-e352-4604-a8aa-2292d771a59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:11.608320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305847d0-e352-4604-a8aa-2292d771a59d admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:11.610505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305847d0-e352-4604-a8aa-2292d771a59d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:11.620872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305847d0-e352-4604-a8aa-2292d771a59d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:11.635486 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e60b4-e3cd-4d2d-a4f1-de94b02b5aab service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:11.650733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd45c0-7038-4381-bd3a-034a57d27088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:11.651413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd45c0-7038-4381-bd3a-034a57d27088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:11.651934 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd45c0-7038-4381-bd3a-034a57d27088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:11.652311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd45c0-7038-4381-bd3a-034a57d27088 admin admin] PATH_INFO: `/v3/projects/01a04222bcde49e59e746386b54d90a0` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:11.656001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd45c0-7038-4381-bd3a-034a57d27088 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01a04222bcde49e59e746386b54d90a0)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:11.660573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd45c0-7038-4381-bd3a-034a57d27088 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:11.687697 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1128/2270] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:11:11 2022] POST /identity/v3/users => generated 306 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:11.692895 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305847d0-e352-4604-a8aa-2292d771a59d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:11.748693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305847d0-e352-4604-a8aa-2292d771a59d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:11.771261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f343c94-1169-476f-b162-dd2d069299f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:11.773540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f343c94-1169-476f-b162-dd2d069299f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:11.780274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f343c94-1169-476f-b162-dd2d069299f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:11.781188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f343c94-1169-476f-b162-dd2d069299f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:11.782819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f343c94-1169-476f-b162-dd2d069299f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:11.790635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f343c94-1169-476f-b162-dd2d069299f1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:11.835344 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1129/2271] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:11.837615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f343c94-1169-476f-b162-dd2d069299f1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:11.839538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-15fd45c0-7038-4381-bd3a-034a57d27088 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01a04222bcde49e59e746386b54d90a0', 'request_id': 'req-15fd45c0-7038-4381-bd3a-034a57d27088'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:11.878271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-15fd45c0-7038-4381-bd3a-034a57d27088 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01a04222bcde49e59e746386b54d90a0', 'request_id': 'req-15fd45c0-7038-4381-bd3a-034a57d27088'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:11.886887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f343c94-1169-476f-b162-dd2d069299f1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:11.911001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-15fd45c0-7038-4381-bd3a-034a57d27088 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01a04222bcde49e59e746386b54d90a0', 'request_id': 'req-15fd45c0-7038-4381-bd3a-034a57d27088'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:11.965072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-15fd45c0-7038-4381-bd3a-034a57d27088 admin admin] The token cache is being invalidate because project 01a04222bcde49e59e746386b54d90a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:11:11.965851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-15fd45c0-7038-4381-bd3a-034a57d27088 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:11.967348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-15fd45c0-7038-4381-bd3a-034a57d27088 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:11.972408 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1143/2272] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:11:11 2022] DELETE /identity/v3/projects/01a04222bcde49e59e746386b54d90a0 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:11.974355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd45c0-7038-4381-bd3a-034a57d27088 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:11.982080 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-15fd45c0-7038-4381-bd3a-034a57d27088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:12.032584 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:12.114932 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2cd86f-8037-45f0-a716-71517004cff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:12.115821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cd86f-8037-45f0-a716-71517004cff3 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:12.116073 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cd86f-8037-45f0-a716-71517004cff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:12.116512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cd86f-8037-45f0-a716-71517004cff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:12.121816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0d2cd86f-8037-45f0-a716-71517004cff3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:12.152398 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:12.272466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd45c0-7038-4381-bd3a-034a57d27088 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:12.291120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34975dc5-49c5-42d7-8d78-0713d2db1f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:12.293470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34975dc5-49c5-42d7-8d78-0713d2db1f44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:12.294386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34975dc5-49c5-42d7-8d78-0713d2db1f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:12.295428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34975dc5-49c5-42d7-8d78-0713d2db1f44 admin admin] PATH_INFO: `/v3/projects/80ff574e4abe47cb8b202df05e3ebd8d/users/8dff39efa9e544708bba668923a74e26/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:12.367632 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34975dc5-49c5-42d7-8d78-0713d2db1f44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80ff574e4abe47cb8b202df05e3ebd8d, user_id=8dff39efa9e544708bba668923a74e26, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:12.376981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2cd86f-8037-45f0-a716-71517004cff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:12.379907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2cd86f-8037-45f0-a716-71517004cff3 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:12.383463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34975dc5-49c5-42d7-8d78-0713d2db1f44 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:12.433000 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1130/2273] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:12.436431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2cd86f-8037-45f0-a716-71517004cff3 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:12.446330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0d2cd86f-8037-45f0-a716-71517004cff3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:12.477564 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1144/2274] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:11:11 2022] PUT /identity/v3/projects/80ff574e4abe47cb8b202df05e3ebd8d/users/8dff39efa9e544708bba668923a74e26/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:12.484800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34975dc5-49c5-42d7-8d78-0713d2db1f44 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:12.512244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2cd86f-8037-45f0-a716-71517004cff3 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:12.776268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34975dc5-49c5-42d7-8d78-0713d2db1f44 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:12.806612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e085c37-6633-4e53-8219-a78c4490570a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:12.807445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e085c37-6633-4e53-8219-a78c4490570a admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:12.807946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e085c37-6633-4e53-8219-a78c4490570a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:12.808395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e085c37-6633-4e53-8219-a78c4490570a admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:12.809504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e085c37-6633-4e53-8219-a78c4490570a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:12.819976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e085c37-6633-4e53-8219-a78c4490570a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:12.843001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b7282-c7d8-4f14-a948-7ae783f3a87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:12.845244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b7282-c7d8-4f14-a948-7ae783f3a87e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:12.845744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b7282-c7d8-4f14-a948-7ae783f3a87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:12.846922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b7282-c7d8-4f14-a948-7ae783f3a87e admin admin] PATH_INFO: `/v3/users/1d41b32b2deb4713841afe180277b8f3` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:12.851277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b7282-c7d8-4f14-a948-7ae783f3a87e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d41b32b2deb4713841afe180277b8f3)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:12.854923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b7282-c7d8-4f14-a948-7ae783f3a87e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:12.902159 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1145/2275] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:12.907451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e085c37-6633-4e53-8219-a78c4490570a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:12.937367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e085c37-6633-4e53-8219-a78c4490570a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:12.957927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90511c7-a50b-4636-8eb5-55d40163f054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:12.960125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90511c7-a50b-4636-8eb5-55d40163f054 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:12.997036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90511c7-a50b-4636-8eb5-55d40163f054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:12.998007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90511c7-a50b-4636-8eb5-55d40163f054 admin admin] PATH_INFO: `/v3/projects/80ff574e4abe47cb8b202df05e3ebd8d/users/8dff39efa9e544708bba668923a74e26/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:13.004584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90511c7-a50b-4636-8eb5-55d40163f054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80ff574e4abe47cb8b202df05e3ebd8d, user_id=8dff39efa9e544708bba668923a74e26, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:13.025526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90511c7-a50b-4636-8eb5-55d40163f054 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:13.073629 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e03b7282-c7d8-4f14-a948-7ae783f3a87e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d41b32b2deb4713841afe180277b8f3'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:13.089675 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1146/2276] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:11:12 2022] PUT /identity/v3/projects/80ff574e4abe47cb8b202df05e3ebd8d/users/8dff39efa9e544708bba668923a74e26/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:13.091386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8cbfe-3900-4f14-b31c-326d2357c6fb None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:13.093327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8cbfe-3900-4f14-b31c-326d2357c6fb None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:13.093645 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8cbfe-3900-4f14-b31c-326d2357c6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:13.108891 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e03b7282-c7d8-4f14-a948-7ae783f3a87e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d41b32b2deb4713841afe180277b8f3'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:13.159016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e03b7282-c7d8-4f14-a948-7ae783f3a87e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d41b32b2deb4713841afe180277b8f3'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:13.163485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e03b7282-c7d8-4f14-a948-7ae783f3a87e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d41b32b2deb4713841afe180277b8f3'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:13.204814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e03b7282-c7d8-4f14-a948-7ae783f3a87e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d41b32b2deb4713841afe180277b8f3'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:13.224660 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1131/2277] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:11:12 2022] DELETE /identity/v3/users/1d41b32b2deb4713841afe180277b8f3 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:13.228657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-61a8cbfe-3900-4f14-b31c-326d2357c6fb None None] MFA Rules not processed for user `8dff39efa9e544708bba668923a74e26`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:13.244016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-61a8cbfe-3900-4f14-b31c-326d2357c6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:13.430970 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1147/2278] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:13 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:13.442386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b7282-c7d8-4f14-a948-7ae783f3a87e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:13.445585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e03b7282-c7d8-4f14-a948-7ae783f3a87e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:13.579392 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:13.646298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b7282-c7d8-4f14-a948-7ae783f3a87e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:13.655607 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f75b76-94ae-46ae-9eda-cb8f7ba79bca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:13.656538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f75b76-94ae-46ae-9eda-cb8f7ba79bca service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:13.656817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f75b76-94ae-46ae-9eda-cb8f7ba79bca service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:13.657111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f75b76-94ae-46ae-9eda-cb8f7ba79bca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:13.659675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-87f75b76-94ae-46ae-9eda-cb8f7ba79bca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:13.777203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f75b76-94ae-46ae-9eda-cb8f7ba79bca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:13.779946 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f75b76-94ae-46ae-9eda-cb8f7ba79bca service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:13.792758 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1132/2279] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:13 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:13.927547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a8cbfe-3900-4f14-b31c-326d2357c6fb None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:13.943445 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:13.993387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a8cbfe-3900-4f14-b31c-326d2357c6fb None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:14.016313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91495ca3-b608-4ace-933e-9c329beca1b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:14.017493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91495ca3-b608-4ace-933e-9c329beca1b6 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:14.017988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91495ca3-b608-4ace-933e-9c329beca1b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:14.018475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91495ca3-b608-4ace-933e-9c329beca1b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:14.044350 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91495ca3-b608-4ace-933e-9c329beca1b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:14.047587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91495ca3-b608-4ace-933e-9c329beca1b6 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:14.070768 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1148/2280] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:13 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:14.451149 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f75b76-94ae-46ae-9eda-cb8f7ba79bca service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:14.453879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-87f75b76-94ae-46ae-9eda-cb8f7ba79bca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:14.576179 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f75b76-94ae-46ae-9eda-cb8f7ba79bca service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:14.582963 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a0b32-87cf-4f9f-8804-dd281b4b0351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:14.584071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a0b32-87cf-4f9f-8804-dd281b4b0351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:14.585505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a0b32-87cf-4f9f-8804-dd281b4b0351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:14.586053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a0b32-87cf-4f9f-8804-dd281b4b0351 admin admin] PATH_INFO: `/v3/users/8a3f540f769a484cbe719b17ff8aa0a2` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:14.588655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a0b32-87cf-4f9f-8804-dd281b4b0351 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a3f540f769a484cbe719b17ff8aa0a2)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:14.591868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a0b32-87cf-4f9f-8804-dd281b4b0351 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:14.641297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fd0b8-2829-4c5d-8510-26a33f8f52a0 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:14.642409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fd0b8-2829-4c5d-8510-26a33f8f52a0 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:14.643181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fd0b8-2829-4c5d-8510-26a33f8f52a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:14.705555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d86a0b32-87cf-4f9f-8804-dd281b4b0351 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a3f540f769a484cbe719b17ff8aa0a2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:14.717567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-061fd0b8-2829-4c5d-8510-26a33f8f52a0 None None] MFA Rules not processed for user `48ba57d381ee4569b9bce256d01bc5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:14.718848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d86a0b32-87cf-4f9f-8804-dd281b4b0351 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a3f540f769a484cbe719b17ff8aa0a2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:14.726237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-061fd0b8-2829-4c5d-8510-26a33f8f52a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:14.731773 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:14.740567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d86a0b32-87cf-4f9f-8804-dd281b4b0351 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a3f540f769a484cbe719b17ff8aa0a2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:14.742784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d86a0b32-87cf-4f9f-8804-dd281b4b0351 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a3f540f769a484cbe719b17ff8aa0a2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:14.759986 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d86a0b32-87cf-4f9f-8804-dd281b4b0351 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a3f540f769a484cbe719b17ff8aa0a2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:14.785371 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1133/2281] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:11:14 2022] DELETE /identity/v3/users/8a3f540f769a484cbe719b17ff8aa0a2 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:14.787042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426437e-ece9-40db-89c4-d38d2320d268 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:14.787384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426437e-ece9-40db-89c4-d38d2320d268 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:14.787865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426437e-ece9-40db-89c4-d38d2320d268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:14.819460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2426437e-ece9-40db-89c4-d38d2320d268 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:14.821488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2426437e-ece9-40db-89c4-d38d2320d268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:15.033266 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1149/2282] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:15.069637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fd0b8-2829-4c5d-8510-26a33f8f52a0 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:15.071982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-061fd0b8-2829-4c5d-8510-26a33f8f52a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:15.082056 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1134/2283] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:15.106088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fd0b8-2829-4c5d-8510-26a33f8f52a0 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:15.142573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426437e-ece9-40db-89c4-d38d2320d268 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:15.146066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2426437e-ece9-40db-89c4-d38d2320d268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:15.394063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426437e-ece9-40db-89c4-d38d2320d268 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:15.429681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d93b16-e412-410b-bf71-7fe5a2d802d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:15.439540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d93b16-e412-410b-bf71-7fe5a2d802d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:15.440215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d93b16-e412-410b-bf71-7fe5a2d802d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:15.440709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d93b16-e412-410b-bf71-7fe5a2d802d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:15.442682 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c4e7b-d6b4-42d4-8e8f-37966593241a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:15.443833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c4e7b-d6b4-42d4-8e8f-37966593241a service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:15.444419 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c4e7b-d6b4-42d4-8e8f-37966593241a service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:15.446750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c4e7b-d6b4-42d4-8e8f-37966593241a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:15.454020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9d6c4e7b-d6b4-42d4-8e8f-37966593241a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:15.502064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d93b16-e412-410b-bf71-7fe5a2d802d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:15.508106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d93b16-e412-410b-bf71-7fe5a2d802d5 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:15.575903 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1135/2284] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:15.577702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d93b16-e412-410b-bf71-7fe5a2d802d5 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:15.585722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-68d93b16-e412-410b-bf71-7fe5a2d802d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:15.627968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d93b16-e412-410b-bf71-7fe5a2d802d5 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:15.643952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c86745-36a9-49fb-9bff-f057920a37ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:15.644622 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c86745-36a9-49fb-9bff-f057920a37ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:15.644899 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c86745-36a9-49fb-9bff-f057920a37ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:15.645172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c86745-36a9-49fb-9bff-f057920a37ae admin admin] PATH_INFO: `/v3/projects/506ab56f68a640b29a72f149321ada3b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:15.647381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c86745-36a9-49fb-9bff-f057920a37ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=506ab56f68a640b29a72f149321ada3b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:15.649725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c86745-36a9-49fb-9bff-f057920a37ae admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:15.677003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c4e7b-d6b4-42d4-8e8f-37966593241a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:15.682168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c4e7b-d6b4-42d4-8e8f-37966593241a service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:15.697978 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1150/2285] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:15.698922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c4e7b-d6b4-42d4-8e8f-37966593241a service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:15.700423 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9d6c4e7b-d6b4-42d4-8e8f-37966593241a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:15.725994 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c4e7b-d6b4-42d4-8e8f-37966593241a service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:15.738739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea097a7-d5a9-45db-a345-946f63563f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:15.744366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea097a7-d5a9-45db-a345-946f63563f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:15.745507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea097a7-d5a9-45db-a345-946f63563f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:15.748337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea097a7-d5a9-45db-a345-946f63563f8b admin admin] PATH_INFO: `/v3/projects/ffca783753d8464da99a508374e3551c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:15.751783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea097a7-d5a9-45db-a345-946f63563f8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffca783753d8464da99a508374e3551c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:15.779425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea097a7-d5a9-45db-a345-946f63563f8b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:15.781554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a0c86745-36a9-49fb-9bff-f057920a37ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '506ab56f68a640b29a72f149321ada3b', 'request_id': 'req-a0c86745-36a9-49fb-9bff-f057920a37ae'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:15.798170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a0c86745-36a9-49fb-9bff-f057920a37ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '506ab56f68a640b29a72f149321ada3b', 'request_id': 'req-a0c86745-36a9-49fb-9bff-f057920a37ae'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:15.802426 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:15.817172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a0c86745-36a9-49fb-9bff-f057920a37ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '506ab56f68a640b29a72f149321ada3b', 'request_id': 'req-a0c86745-36a9-49fb-9bff-f057920a37ae'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:15.841440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a0c86745-36a9-49fb-9bff-f057920a37ae admin admin] The token cache is being invalidate because project 506ab56f68a640b29a72f149321ada3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:11:15.841716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a0c86745-36a9-49fb-9bff-f057920a37ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:15.844278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a0c86745-36a9-49fb-9bff-f057920a37ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:15.850946 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1136/2286] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:11:15 2022] DELETE /identity/v3/projects/506ab56f68a640b29a72f149321ada3b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:15.854393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c86745-36a9-49fb-9bff-f057920a37ae admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:15.857661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a0c86745-36a9-49fb-9bff-f057920a37ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:15.897881 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:15.942984 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1ea097a7-d5a9-45db-a345-946f63563f8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffca783753d8464da99a508374e3551c', 'request_id': 'req-1ea097a7-d5a9-45db-a345-946f63563f8b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:15.995686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1ea097a7-d5a9-45db-a345-946f63563f8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffca783753d8464da99a508374e3551c', 'request_id': 'req-1ea097a7-d5a9-45db-a345-946f63563f8b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:16.004017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c86745-36a9-49fb-9bff-f057920a37ae admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:16.014912 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1ea097a7-d5a9-45db-a345-946f63563f8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffca783753d8464da99a508374e3551c', 'request_id': 'req-1ea097a7-d5a9-45db-a345-946f63563f8b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:16.050685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1ea097a7-d5a9-45db-a345-946f63563f8b admin admin] The token cache is being invalidate because project ffca783753d8464da99a508374e3551c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:11:16.051406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1ea097a7-d5a9-45db-a345-946f63563f8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:16.058719 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1ea097a7-d5a9-45db-a345-946f63563f8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:16.062495 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1151/2287] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:11:15 2022] DELETE /identity/v3/projects/ffca783753d8464da99a508374e3551c => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:16.069134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea097a7-d5a9-45db-a345-946f63563f8b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:16.073060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1ea097a7-d5a9-45db-a345-946f63563f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:16.159728 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033da34-cb5f-4929-9a28-1b957cc88772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:16.160377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033da34-cb5f-4929-9a28-1b957cc88772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:16.160757 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033da34-cb5f-4929-9a28-1b957cc88772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:16.161051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033da34-cb5f-4929-9a28-1b957cc88772 admin admin] PATH_INFO: `/v3/users/23be4c2fe6ff41479da6cf5a888a1a81` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:16.166336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033da34-cb5f-4929-9a28-1b957cc88772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23be4c2fe6ff41479da6cf5a888a1a81)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:16.173472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033da34-cb5f-4929-9a28-1b957cc88772 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:16.238931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea097a7-d5a9-45db-a345-946f63563f8b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:16.249885 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfda85-68aa-4575-861a-999591edf21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:16.253745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfda85-68aa-4575-861a-999591edf21a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:16.256257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfda85-68aa-4575-861a-999591edf21a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:16.258368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abfda85-68aa-4575-861a-999591edf21a admin admin] PATH_INFO: `/v3/users/bd2dc7cb2edc4a799521b0578f3b6af0` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:16.262317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfda85-68aa-4575-861a-999591edf21a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd2dc7cb2edc4a799521b0578f3b6af0)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:16.267745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abfda85-68aa-4575-861a-999591edf21a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:16.385370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e033da34-cb5f-4929-9a28-1b957cc88772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23be4c2fe6ff41479da6cf5a888a1a81'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:16.411495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e033da34-cb5f-4929-9a28-1b957cc88772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23be4c2fe6ff41479da6cf5a888a1a81'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:16.436416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e033da34-cb5f-4929-9a28-1b957cc88772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23be4c2fe6ff41479da6cf5a888a1a81'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:16.437971 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e033da34-cb5f-4929-9a28-1b957cc88772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23be4c2fe6ff41479da6cf5a888a1a81'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:16.453584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e033da34-cb5f-4929-9a28-1b957cc88772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23be4c2fe6ff41479da6cf5a888a1a81'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:16.467998 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1137/2288] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:11:15 2022] DELETE /identity/v3/users/23be4c2fe6ff41479da6cf5a888a1a81 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:16.488071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7abfda85-68aa-4575-861a-999591edf21a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd2dc7cb2edc4a799521b0578f3b6af0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:16.506715 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7abfda85-68aa-4575-861a-999591edf21a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd2dc7cb2edc4a799521b0578f3b6af0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:16.541090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7abfda85-68aa-4575-861a-999591edf21a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd2dc7cb2edc4a799521b0578f3b6af0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:16.542822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7abfda85-68aa-4575-861a-999591edf21a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd2dc7cb2edc4a799521b0578f3b6af0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:16.560539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7abfda85-68aa-4575-861a-999591edf21a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd2dc7cb2edc4a799521b0578f3b6af0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:16.584538 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1152/2289] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:11:16 2022] DELETE /identity/v3/users/bd2dc7cb2edc4a799521b0578f3b6af0 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:11:17.242724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033da34-cb5f-4929-9a28-1b957cc88772 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:17.248617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e033da34-cb5f-4929-9a28-1b957cc88772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:17.434651 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:17.531703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033da34-cb5f-4929-9a28-1b957cc88772 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:17.787931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfda85-68aa-4575-861a-999591edf21a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:17.790021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7abfda85-68aa-4575-861a-999591edf21a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:17.836392 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:17.914188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf3d8e-0549-4215-9aca-b1501ea8c107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:17.920318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf3d8e-0549-4215-9aca-b1501ea8c107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:17.921194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf3d8e-0549-4215-9aca-b1501ea8c107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:17.928643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf3d8e-0549-4215-9aca-b1501ea8c107 admin admin] PATH_INFO: `/v3/projects/632a206a638349cbb3414d6356182761` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:17.936896 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf3d8e-0549-4215-9aca-b1501ea8c107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=632a206a638349cbb3414d6356182761)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:17.939839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abfda85-68aa-4575-861a-999591edf21a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:17.941551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf3d8e-0549-4215-9aca-b1501ea8c107 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:17.957878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae445d0-f01d-44fd-ac80-3d33ca322bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:17.958574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae445d0-f01d-44fd-ac80-3d33ca322bf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:17.959516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae445d0-f01d-44fd-ac80-3d33ca322bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:17.959862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae445d0-f01d-44fd-ac80-3d33ca322bf0 admin admin] PATH_INFO: `/v3/projects/b81a2c4f9cfa4594898a938fa0b38a71` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:17.961798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae445d0-f01d-44fd-ac80-3d33ca322bf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b81a2c4f9cfa4594898a938fa0b38a71)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:17.968924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae445d0-f01d-44fd-ac80-3d33ca322bf0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:18.076594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3acf3d8e-0549-4215-9aca-b1501ea8c107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '632a206a638349cbb3414d6356182761', 'request_id': 'req-3acf3d8e-0549-4215-9aca-b1501ea8c107'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:18.079383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6ae445d0-f01d-44fd-ac80-3d33ca322bf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b81a2c4f9cfa4594898a938fa0b38a71', 'request_id': 'req-6ae445d0-f01d-44fd-ac80-3d33ca322bf0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:18.087828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6ae445d0-f01d-44fd-ac80-3d33ca322bf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b81a2c4f9cfa4594898a938fa0b38a71', 'request_id': 'req-6ae445d0-f01d-44fd-ac80-3d33ca322bf0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:18.094893 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3acf3d8e-0549-4215-9aca-b1501ea8c107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '632a206a638349cbb3414d6356182761', 'request_id': 'req-3acf3d8e-0549-4215-9aca-b1501ea8c107'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:18.098029 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6ae445d0-f01d-44fd-ac80-3d33ca322bf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b81a2c4f9cfa4594898a938fa0b38a71', 'request_id': 'req-6ae445d0-f01d-44fd-ac80-3d33ca322bf0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:18.112410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3acf3d8e-0549-4215-9aca-b1501ea8c107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '632a206a638349cbb3414d6356182761', 'request_id': 'req-3acf3d8e-0549-4215-9aca-b1501ea8c107'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:18.125003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6ae445d0-f01d-44fd-ac80-3d33ca322bf0 admin admin] The token cache is being invalidate because project b81a2c4f9cfa4594898a938fa0b38a71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:11:18.125595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6ae445d0-f01d-44fd-ac80-3d33ca322bf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:18.128641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6ae445d0-f01d-44fd-ac80-3d33ca322bf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:18.135875 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1153/2290] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:11:17 2022] DELETE /identity/v3/projects/b81a2c4f9cfa4594898a938fa0b38a71 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:18.141933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a567c8-6b54-4da1-8546-df9c464a8982 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:18.142353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a567c8-6b54-4da1-8546-df9c464a8982 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:18.148436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a567c8-6b54-4da1-8546-df9c464a8982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:18.163203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3acf3d8e-0549-4215-9aca-b1501ea8c107 admin admin] The token cache is being invalidate because project 632a206a638349cbb3414d6356182761 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:11:18.164264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3acf3d8e-0549-4215-9aca-b1501ea8c107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:18.167151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3acf3d8e-0549-4215-9aca-b1501ea8c107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:18.174397 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1138/2291] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:11:17 2022] DELETE /identity/v3/projects/632a206a638349cbb3414d6356182761 => generated 0 bytes in 935 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:18.180764 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf3d8e-0549-4215-9aca-b1501ea8c107 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:18.184744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3acf3d8e-0549-4215-9aca-b1501ea8c107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:18.196734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-67a567c8-6b54-4da1-8546-df9c464a8982 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:18.213959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-67a567c8-6b54-4da1-8546-df9c464a8982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:18.325511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf3d8e-0549-4215-9aca-b1501ea8c107 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:18.377025 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:18.426195 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1154/2292] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:18.441776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d6ffc-2c8f-40d0-9198-610d0157da07 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:18.444253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d6ffc-2c8f-40d0-9198-610d0157da07 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:18.444778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d6ffc-2c8f-40d0-9198-610d0157da07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:18.527872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f61a52-04c5-4251-a066-64fccb266b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:18.530025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f61a52-04c5-4251-a066-64fccb266b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:18.530836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f61a52-04c5-4251-a066-64fccb266b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:18.531338 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f61a52-04c5-4251-a066-64fccb266b75 admin admin] PATH_INFO: `/v3/users/8dff39efa9e544708bba668923a74e26` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:18.533796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f61a52-04c5-4251-a066-64fccb266b75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dff39efa9e544708bba668923a74e26)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:18.537679 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f61a52-04c5-4251-a066-64fccb266b75 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:18.555278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c46d6ffc-2c8f-40d0-9198-610d0157da07 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:18.559487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c46d6ffc-2c8f-40d0-9198-610d0157da07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:18.584780 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1155/2293] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:11:18.589599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d6ffc-2c8f-40d0-9198-610d0157da07 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:18.612622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d6ffc-2c8f-40d0-9198-610d0157da07 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:18.628524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac161cb-9648-4879-8306-37e63a219204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:18.634351 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac161cb-9648-4879-8306-37e63a219204 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:18.634696 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac161cb-9648-4879-8306-37e63a219204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:18.635126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac161cb-9648-4879-8306-37e63a219204 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:18.635987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac161cb-9648-4879-8306-37e63a219204 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:11:18.636301 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac161cb-9648-4879-8306-37e63a219204 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:18.638009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac161cb-9648-4879-8306-37e63a219204 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:18.673942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e1f61a52-04c5-4251-a066-64fccb266b75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dff39efa9e544708bba668923a74e26'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:18.682125 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1156/2294] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:11:18.685517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac161cb-9648-4879-8306-37e63a219204 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:18.697312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e1f61a52-04c5-4251-a066-64fccb266b75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dff39efa9e544708bba668923a74e26'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:18.702596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac161cb-9648-4879-8306-37e63a219204 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:18.717590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bfb50-7e80-4109-8a4d-e17bd9208a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:18.720122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bfb50-7e80-4109-8a4d-e17bd9208a3d admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:18.720335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bfb50-7e80-4109-8a4d-e17bd9208a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:18.720666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bfb50-7e80-4109-8a4d-e17bd9208a3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:18.721457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984bfb50-7e80-4109-8a4d-e17bd9208a3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:18.728229 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e1f61a52-04c5-4251-a066-64fccb266b75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dff39efa9e544708bba668923a74e26'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:18.728746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984bfb50-7e80-4109-8a4d-e17bd9208a3d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:18.729127 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e1f61a52-04c5-4251-a066-64fccb266b75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dff39efa9e544708bba668923a74e26'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:18.744521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e1f61a52-04c5-4251-a066-64fccb266b75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dff39efa9e544708bba668923a74e26'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:18.759933 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1139/2295] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:11:18 2022] DELETE /identity/v3/users/8dff39efa9e544708bba668923a74e26 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:18.796832 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1157/2296] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:11:18 2022] POST /identity/v3/projects => generated 391 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:11:18.798272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f61a52-04c5-4251-a066-64fccb266b75 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:18.801368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e1f61a52-04c5-4251-a066-64fccb266b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:19.087620 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f61a52-04c5-4251-a066-64fccb266b75 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:19.238223 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:19.270843 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f305b6-e1c6-4684-aac3-2fc2c6d57fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:19.270843 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f305b6-e1c6-4684-aac3-2fc2c6d57fea admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:19.277177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f305b6-e1c6-4684-aac3-2fc2c6d57fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:19.277584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f305b6-e1c6-4684-aac3-2fc2c6d57fea admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:19.278497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f305b6-e1c6-4684-aac3-2fc2c6d57fea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:19.282221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f305b6-e1c6-4684-aac3-2fc2c6d57fea admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:19.330956 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1140/2297] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:11:18 2022] POST /identity/v3/users => generated 296 bytes in 531 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:11:19.332413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bfb50-7e80-4109-8a4d-e17bd9208a3d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:19.340680 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:19.346870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bfb50-7e80-4109-8a4d-e17bd9208a3d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:19.358106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6849e6-17a9-479d-b66c-58205be84fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:19.360064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6849e6-17a9-479d-b66c-58205be84fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:19.361030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6849e6-17a9-479d-b66c-58205be84fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:19.362160 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6849e6-17a9-479d-b66c-58205be84fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:19.363273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6849e6-17a9-479d-b66c-58205be84fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:19.368381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6849e6-17a9-479d-b66c-58205be84fb5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:19.387874 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1158/2298] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:19.392089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f305b6-e1c6-4684-aac3-2fc2c6d57fea admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:19.411233 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f305b6-e1c6-4684-aac3-2fc2c6d57fea admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:19.429260 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239dd10-c917-4e94-ae06-b67e6a2db82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:19.430618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239dd10-c917-4e94-ae06-b67e6a2db82a admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:19.431119 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239dd10-c917-4e94-ae06-b67e6a2db82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:19.431606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239dd10-c917-4e94-ae06-b67e6a2db82a admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:19.433641 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239dd10-c917-4e94-ae06-b67e6a2db82a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:19.436417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239dd10-c917-4e94-ae06-b67e6a2db82a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:19.458073 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1141/2299] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:19.462099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6849e6-17a9-479d-b66c-58205be84fb5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:19.478168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6849e6-17a9-479d-b66c-58205be84fb5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:19.486527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f6c36-9b8c-49cb-bb71-220532f93360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:19.488058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f6c36-9b8c-49cb-bb71-220532f93360 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:19.488058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f6c36-9b8c-49cb-bb71-220532f93360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:19.488276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f6c36-9b8c-49cb-bb71-220532f93360 admin admin] PATH_INFO: `/v3/projects/674f18b0cd8c45969fa5d72007ebf4cb/users/a9f5e953db8f4bc5ab594189a31726a2/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:19.519878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f6c36-9b8c-49cb-bb71-220532f93360 admin admin] RBAC: Authorizing `identity:create_grant(project_id=674f18b0cd8c45969fa5d72007ebf4cb, user_id=a9f5e953db8f4bc5ab594189a31726a2, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:19.523290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f6c36-9b8c-49cb-bb71-220532f93360 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:19.588282 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1159/2300] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:11:19 2022] PUT /identity/v3/projects/674f18b0cd8c45969fa5d72007ebf4cb/users/a9f5e953db8f4bc5ab594189a31726a2/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:19.594962 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672fecd-af34-438e-9f88-0b8e8771a4b6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:19.595590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672fecd-af34-438e-9f88-0b8e8771a4b6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:19.596217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672fecd-af34-438e-9f88-0b8e8771a4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:19.615776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f6c36-9b8c-49cb-bb71-220532f93360 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:19.618115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ca8f6c36-9b8c-49cb-bb71-220532f93360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:19.731188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7672fecd-af34-438e-9f88-0b8e8771a4b6 None None] MFA Rules not processed for user `a9f5e953db8f4bc5ab594189a31726a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:19.738165 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7672fecd-af34-438e-9f88-0b8e8771a4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:20.013913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f6c36-9b8c-49cb-bb71-220532f93360 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:20.029100 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65879236-a81d-4b9c-b802-ad8caa4a8e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:20.029800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65879236-a81d-4b9c-b802-ad8caa4a8e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:20.030295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65879236-a81d-4b9c-b802-ad8caa4a8e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:20.030733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65879236-a81d-4b9c-b802-ad8caa4a8e17 admin admin] PATH_INFO: `/v3/projects/bc6cabea74704570a310547c7077b366` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:20.032796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65879236-a81d-4b9c-b802-ad8caa4a8e17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc6cabea74704570a310547c7077b366)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:20.039297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65879236-a81d-4b9c-b802-ad8caa4a8e17 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:20.109486 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1142/2301] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 519 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:20.112716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672fecd-af34-438e-9f88-0b8e8771a4b6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:20.118405 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7672fecd-af34-438e-9f88-0b8e8771a4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:20.182664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672fecd-af34-438e-9f88-0b8e8771a4b6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:20.196627 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-65879236-a81d-4b9c-b802-ad8caa4a8e17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc6cabea74704570a310547c7077b366', 'request_id': 'req-65879236-a81d-4b9c-b802-ad8caa4a8e17'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:20.225765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-65879236-a81d-4b9c-b802-ad8caa4a8e17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc6cabea74704570a310547c7077b366', 'request_id': 'req-65879236-a81d-4b9c-b802-ad8caa4a8e17'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:20.253467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-65879236-a81d-4b9c-b802-ad8caa4a8e17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc6cabea74704570a310547c7077b366', 'request_id': 'req-65879236-a81d-4b9c-b802-ad8caa4a8e17'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:20.305791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-65879236-a81d-4b9c-b802-ad8caa4a8e17 admin admin] The token cache is being invalidate because project bc6cabea74704570a310547c7077b366 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:11:20.306058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-65879236-a81d-4b9c-b802-ad8caa4a8e17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:20.315374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-65879236-a81d-4b9c-b802-ad8caa4a8e17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:20.329142 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1160/2302] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:11:19 2022] DELETE /identity/v3/projects/bc6cabea74704570a310547c7077b366 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:20.329142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65879236-a81d-4b9c-b802-ad8caa4a8e17 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:20.329142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-65879236-a81d-4b9c-b802-ad8caa4a8e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:20.392587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c709cb-5ca7-4a02-89fa-492961d01983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:20.393830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c709cb-5ca7-4a02-89fa-492961d01983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:20.394408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c709cb-5ca7-4a02-89fa-492961d01983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:20.394975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c709cb-5ca7-4a02-89fa-492961d01983 admin admin] PATH_INFO: `/v3/projects/80ff574e4abe47cb8b202df05e3ebd8d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:20.398752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c709cb-5ca7-4a02-89fa-492961d01983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80ff574e4abe47cb8b202df05e3ebd8d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:20.403304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c709cb-5ca7-4a02-89fa-492961d01983 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:20.448462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65879236-a81d-4b9c-b802-ad8caa4a8e17 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:20.449784 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:20.460282 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5245467-cea5-43f9-be1e-382998753651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:20.462446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5245467-cea5-43f9-be1e-382998753651 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:20.462899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5245467-cea5-43f9-be1e-382998753651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:20.463708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5245467-cea5-43f9-be1e-382998753651 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:20.466236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5245467-cea5-43f9-be1e-382998753651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:20.469829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5245467-cea5-43f9-be1e-382998753651 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:20.561997 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1161/2303] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:11:20 2022] POST /identity/v3/projects => generated 391 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:20.561997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b09c20-7ae4-4962-936b-9565076d590b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:20.561997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b09c20-7ae4-4962-936b-9565076d590b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:20.561997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b09c20-7ae4-4962-936b-9565076d590b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:20.600028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b2c709cb-5ca7-4a02-89fa-492961d01983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80ff574e4abe47cb8b202df05e3ebd8d', 'request_id': 'req-b2c709cb-5ca7-4a02-89fa-492961d01983'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:20.604842 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-11b09c20-7ae4-4962-936b-9565076d590b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:20.607750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-11b09c20-7ae4-4962-936b-9565076d590b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:20.621054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b2c709cb-5ca7-4a02-89fa-492961d01983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80ff574e4abe47cb8b202df05e3ebd8d', 'request_id': 'req-b2c709cb-5ca7-4a02-89fa-492961d01983'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:20.626941 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:20.651947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b2c709cb-5ca7-4a02-89fa-492961d01983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80ff574e4abe47cb8b202df05e3ebd8d', 'request_id': 'req-b2c709cb-5ca7-4a02-89fa-492961d01983'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:20.700604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b2c709cb-5ca7-4a02-89fa-492961d01983 admin admin] The token cache is being invalidate because project 80ff574e4abe47cb8b202df05e3ebd8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:11:20.702373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b2c709cb-5ca7-4a02-89fa-492961d01983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:20.704805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b2c709cb-5ca7-4a02-89fa-492961d01983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:20.714756 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1143/2304] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:11:20 2022] DELETE /identity/v3/projects/80ff574e4abe47cb8b202df05e3ebd8d => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:20.718938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c709cb-5ca7-4a02-89fa-492961d01983 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:20.728446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b2c709cb-5ca7-4a02-89fa-492961d01983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:20.930683 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1162/2305] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:20.933280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220bb9a-da45-4251-b8e5-8effdf7bfa13 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:20.944603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220bb9a-da45-4251-b8e5-8effdf7bfa13 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:20.945575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220bb9a-da45-4251-b8e5-8effdf7bfa13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:21.042569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3220bb9a-da45-4251-b8e5-8effdf7bfa13 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:21.046045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3220bb9a-da45-4251-b8e5-8effdf7bfa13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:21.080872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c709cb-5ca7-4a02-89fa-492961d01983 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:21.086292 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1163/2306] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:21.092085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1134b-7444-494c-b084-7a2527bbc8f9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:21.093261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1134b-7444-494c-b084-7a2527bbc8f9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:21.095322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d38da9-8b12-4610-85e3-f04d89e3121a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:21.096135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1134b-7444-494c-b084-7a2527bbc8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:21.096410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d38da9-8b12-4610-85e3-f04d89e3121a admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:21.096853 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d38da9-8b12-4610-85e3-f04d89e3121a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:21.097383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d38da9-8b12-4610-85e3-f04d89e3121a admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:21.098608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d38da9-8b12-4610-85e3-f04d89e3121a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:21.102781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d38da9-8b12-4610-85e3-f04d89e3121a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:21.155191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-19f1134b-7444-494c-b084-7a2527bbc8f9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:21.161677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-19f1134b-7444-494c-b084-7a2527bbc8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:21.200030 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1144/2307] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:11:20 2022] POST /identity/v3/users => generated 302 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:21.213708 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1164/2308] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:21.213708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1134b-7444-494c-b084-7a2527bbc8f9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:21.223625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f01527-87f4-4362-88f3-1c6dfabc8ab6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:21.236404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f01527-87f4-4362-88f3-1c6dfabc8ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:21.239577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1134b-7444-494c-b084-7a2527bbc8f9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:21.241079 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f01527-87f4-4362-88f3-1c6dfabc8ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:21.270102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60189bb6-9128-459b-835f-73739dc84b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:21.271416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60189bb6-9128-459b-835f-73739dc84b43 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:21.272120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60189bb6-9128-459b-835f-73739dc84b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:21.272727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60189bb6-9128-459b-835f-73739dc84b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:21.274505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60189bb6-9128-459b-835f-73739dc84b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:21.279868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60189bb6-9128-459b-835f-73739dc84b43 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:21.327279 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1165/2309] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:21.330150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60189bb6-9128-459b-835f-73739dc84b43 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:21.377505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-56f01527-87f4-4362-88f3-1c6dfabc8ab6 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:21.379588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-56f01527-87f4-4362-88f3-1c6dfabc8ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:21.385092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60189bb6-9128-459b-835f-73739dc84b43 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:21.422009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24ea83-4016-4b13-8229-6b252f6b56b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:21.423417 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1145/2310] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:21.424994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f01527-87f4-4362-88f3-1c6dfabc8ab6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:21.425633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24ea83-4016-4b13-8229-6b252f6b56b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:21.427583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24ea83-4016-4b13-8229-6b252f6b56b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:21.430178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae24ea83-4016-4b13-8229-6b252f6b56b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:21.437621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24ea83-4016-4b13-8229-6b252f6b56b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:11:21.443777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24ea83-4016-4b13-8229-6b252f6b56b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:21.451388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae24ea83-4016-4b13-8229-6b252f6b56b7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:21.479042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f01527-87f4-4362-88f3-1c6dfabc8ab6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:21.508977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97696d-4134-4e3a-b572-df5ee4c027c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:21.510040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97696d-4134-4e3a-b572-df5ee4c027c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:21.510541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97696d-4134-4e3a-b572-df5ee4c027c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:21.511069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97696d-4134-4e3a-b572-df5ee4c027c1 admin admin] PATH_INFO: `/v3/projects/2169d941acc24c44a3d6fa774c055a1a/users/d2a6bb194a0d4d82883ae7651f4ff418/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:21.518520 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1166/2311] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:11:21.529828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24ea83-4016-4b13-8229-6b252f6b56b7 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:21.589505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae24ea83-4016-4b13-8229-6b252f6b56b7 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:21.617693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97696d-4134-4e3a-b572-df5ee4c027c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2169d941acc24c44a3d6fa774c055a1a, user_id=d2a6bb194a0d4d82883ae7651f4ff418, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:21.625164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047cf1cc-c6b5-46c1-a536-1b6543d121ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:21.626736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cf1cc-c6b5-46c1-a536-1b6543d121ee admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:21.634606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97696d-4134-4e3a-b572-df5ee4c027c1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:21.642484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cf1cc-c6b5-46c1-a536-1b6543d121ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:21.642996 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cf1cc-c6b5-46c1-a536-1b6543d121ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:21.645535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047cf1cc-c6b5-46c1-a536-1b6543d121ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:11:21.646079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047cf1cc-c6b5-46c1-a536-1b6543d121ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:21.661402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047cf1cc-c6b5-46c1-a536-1b6543d121ee admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:21.710212 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1146/2312] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:11:21 2022] PUT /identity/v3/projects/2169d941acc24c44a3d6fa774c055a1a/users/d2a6bb194a0d4d82883ae7651f4ff418/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:21.711766 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97696d-4134-4e3a-b572-df5ee4c027c1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:21.718732 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1167/2313] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:11:21.720778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047cf1cc-c6b5-46c1-a536-1b6543d121ee admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:21.767781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047cf1cc-c6b5-46c1-a536-1b6543d121ee admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:21.927278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97696d-4134-4e3a-b572-df5ee4c027c1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:21.937208 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630e145-cc9b-400f-bfa5-cf2463993ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:21.938336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630e145-cc9b-400f-bfa5-cf2463993ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:21.938926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630e145-cc9b-400f-bfa5-cf2463993ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:21.939494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630e145-cc9b-400f-bfa5-cf2463993ae8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:21.941499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630e145-cc9b-400f-bfa5-cf2463993ae8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:21.945843 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630e145-cc9b-400f-bfa5-cf2463993ae8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:22.018981 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1147/2314] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:11:21 2022] POST /identity/v3/projects => generated 393 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:22.022248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630e145-cc9b-400f-bfa5-cf2463993ae8 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:22.039419 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e7700-395c-4dae-9fde-5f7cf792a501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:22.040494 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e7700-395c-4dae-9fde-5f7cf792a501 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:22.040933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e7700-395c-4dae-9fde-5f7cf792a501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:22.045340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e7700-395c-4dae-9fde-5f7cf792a501 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:22.046623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e7700-395c-4dae-9fde-5f7cf792a501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:22.051721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e7700-395c-4dae-9fde-5f7cf792a501 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:22.109244 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1168/2315] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:22.117872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e7700-395c-4dae-9fde-5f7cf792a501 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:22.163554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e7700-395c-4dae-9fde-5f7cf792a501 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:22.193522 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:22.272601 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:22.293994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630e145-cc9b-400f-bfa5-cf2463993ae8 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:22.312523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f739fc0-b2bc-41c2-b68f-de02ea5ae599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:22.314127 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f739fc0-b2bc-41c2-b68f-de02ea5ae599 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:22.314931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f739fc0-b2bc-41c2-b68f-de02ea5ae599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:22.315717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f739fc0-b2bc-41c2-b68f-de02ea5ae599 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:22.317308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f739fc0-b2bc-41c2-b68f-de02ea5ae599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:22.322619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f739fc0-b2bc-41c2-b68f-de02ea5ae599 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:22.382047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2cf1a-0eee-4279-b0c3-69110c1bd2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:22.382683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2cf1a-0eee-4279-b0c3-69110c1bd2af admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:22.383175 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2cf1a-0eee-4279-b0c3-69110c1bd2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:22.383452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2cf1a-0eee-4279-b0c3-69110c1bd2af admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:22.384022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b2cf1a-0eee-4279-b0c3-69110c1bd2af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:22.386024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b2cf1a-0eee-4279-b0c3-69110c1bd2af admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:22.399544 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1148/2316] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:11:22 2022] POST /identity/v3/projects => generated 373 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:22.401417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f739fc0-b2bc-41c2-b68f-de02ea5ae599 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:22.433217 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1169/2317] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:11:22 2022] POST /identity/v3/users => generated 297 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:22.437577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2cf1a-0eee-4279-b0c3-69110c1bd2af admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:22.460317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2cf1a-0eee-4279-b0c3-69110c1bd2af admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:22.631192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b6833-d8a4-4f9d-9720-23e7ec6475cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:22.631836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b6833-d8a4-4f9d-9720-23e7ec6475cb admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:22.632147 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b6833-d8a4-4f9d-9720-23e7ec6475cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:22.632416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b6833-d8a4-4f9d-9720-23e7ec6475cb admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:22.633062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b6833-d8a4-4f9d-9720-23e7ec6475cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:22.635053 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b6833-d8a4-4f9d-9720-23e7ec6475cb admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:22.678161 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1170/2318] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:11:22 2022] POST /identity/v3/users => generated 287 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:22.680121 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b6833-d8a4-4f9d-9720-23e7ec6475cb admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:22.701058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b6833-d8a4-4f9d-9720-23e7ec6475cb admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:22.701317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f739fc0-b2bc-41c2-b68f-de02ea5ae599 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:22.716537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be00468-0585-454f-818d-bc9a24cc6b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:22.717866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be00468-0585-454f-818d-bc9a24cc6b15 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:22.718532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be00468-0585-454f-818d-bc9a24cc6b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:22.718848 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be00468-0585-454f-818d-bc9a24cc6b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:22.720214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be00468-0585-454f-818d-bc9a24cc6b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:22.722644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36998c4b-eb02-47ad-87ed-ae25517410f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:22.725356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be00468-0585-454f-818d-bc9a24cc6b15 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:22.726214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36998c4b-eb02-47ad-87ed-ae25517410f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:22.726523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36998c4b-eb02-47ad-87ed-ae25517410f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:22.726811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36998c4b-eb02-47ad-87ed-ae25517410f4 admin admin] PATH_INFO: `/v3/projects/2169d941acc24c44a3d6fa774c055a1a/users/d2a6bb194a0d4d82883ae7651f4ff418/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:22.734902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36998c4b-eb02-47ad-87ed-ae25517410f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2169d941acc24c44a3d6fa774c055a1a, user_id=d2a6bb194a0d4d82883ae7651f4ff418, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:22.741275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36998c4b-eb02-47ad-87ed-ae25517410f4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:22.748974 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1171/2319] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:22.752444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be00468-0585-454f-818d-bc9a24cc6b15 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:22.773488 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1149/2320] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:11:22 2022] PUT /identity/v3/projects/2169d941acc24c44a3d6fa774c055a1a/users/d2a6bb194a0d4d82883ae7651f4ff418/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:22.775832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be00468-0585-454f-818d-bc9a24cc6b15 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:22.788460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36998c4b-eb02-47ad-87ed-ae25517410f4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:22.940369 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36998c4b-eb02-47ad-87ed-ae25517410f4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:22.946709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74055cfa-3b92-410a-93b5-5231ae891c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:22.947514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74055cfa-3b92-410a-93b5-5231ae891c7e admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:22.947799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74055cfa-3b92-410a-93b5-5231ae891c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:22.948164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74055cfa-3b92-410a-93b5-5231ae891c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:22.949215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74055cfa-3b92-410a-93b5-5231ae891c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:22.952188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74055cfa-3b92-410a-93b5-5231ae891c7e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:22.973584 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1150/2321] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:22.975595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa65b3-d70d-483d-99e9-051c9e76e329 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:22.975878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa65b3-d70d-483d-99e9-051c9e76e329 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:22.976357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa65b3-d70d-483d-99e9-051c9e76e329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:22.988549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d89a8-d40e-4581-a8ce-bbf0cb48f845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:22.990837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d89a8-d40e-4581-a8ce-bbf0cb48f845 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:22.991319 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d89a8-d40e-4581-a8ce-bbf0cb48f845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:22.991914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d89a8-d40e-4581-a8ce-bbf0cb48f845 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:22.993787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d89a8-d40e-4581-a8ce-bbf0cb48f845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:22.995738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d89a8-d40e-4581-a8ce-bbf0cb48f845 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:23.025898 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1172/2322] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:23.027123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d89a8-d40e-4581-a8ce-bbf0cb48f845 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:23.031246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-deaa65b3-d70d-483d-99e9-051c9e76e329 None None] MFA Rules not processed for user `d2a6bb194a0d4d82883ae7651f4ff418`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:23.034570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-deaa65b3-d70d-483d-99e9-051c9e76e329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:23.053764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d89a8-d40e-4581-a8ce-bbf0cb48f845 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:23.077044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72093d3-274e-473e-9bfb-1b5c8bc94721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:23.078199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72093d3-274e-473e-9bfb-1b5c8bc94721 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:23.078694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72093d3-274e-473e-9bfb-1b5c8bc94721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:23.079254 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72093d3-274e-473e-9bfb-1b5c8bc94721 admin admin] PATH_INFO: `/v3/projects/73fc0ad44da6450caa86e773d4210dd6/users/52ecd35e1c8e4c9b8343eae6014fde3b/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:23.112908 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:23.149588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72093d3-274e-473e-9bfb-1b5c8bc94721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73fc0ad44da6450caa86e773d4210dd6, user_id=52ecd35e1c8e4c9b8343eae6014fde3b, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:23.166793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72093d3-274e-473e-9bfb-1b5c8bc94721 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:23.210238 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1173/2323] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:11:23 2022] PUT /identity/v3/projects/73fc0ad44da6450caa86e773d4210dd6/users/52ecd35e1c8e4c9b8343eae6014fde3b/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:23.211065 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72093d3-274e-473e-9bfb-1b5c8bc94721 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:23.233807 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1151/2324] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:22 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:23.244015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ac8fc-69fb-43c6-91df-d97d29bf7fd8 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:23.244015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ac8fc-69fb-43c6-91df-d97d29bf7fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:23.244015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ac8fc-69fb-43c6-91df-d97d29bf7fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:23.244437 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:23.352644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e18ac8fc-69fb-43c6-91df-d97d29bf7fd8 None None] MFA Rules not processed for user `52ecd35e1c8e4c9b8343eae6014fde3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:23.355204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e18ac8fc-69fb-43c6-91df-d97d29bf7fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:23.383173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72093d3-274e-473e-9bfb-1b5c8bc94721 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:23.399082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c73400-a8bb-4963-b83f-7d5f6b1fb954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:23.399766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c73400-a8bb-4963-b83f-7d5f6b1fb954 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:23.400270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c73400-a8bb-4963-b83f-7d5f6b1fb954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:23.400454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c73400-a8bb-4963-b83f-7d5f6b1fb954 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:23.401144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c73400-a8bb-4963-b83f-7d5f6b1fb954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:23.403790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c73400-a8bb-4963-b83f-7d5f6b1fb954 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:23.430125 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1174/2325] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:23.431224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c73400-a8bb-4963-b83f-7d5f6b1fb954 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:23.435930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b8c73400-a8bb-4963-b83f-7d5f6b1fb954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:23.609352 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1152/2326] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:23.609352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ac8fc-69fb-43c6-91df-d97d29bf7fd8 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:23.659105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ac8fc-69fb-43c6-91df-d97d29bf7fd8 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:23.670592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87301f16-68db-487a-84d9-0bdfa37b1467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:23.678534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87301f16-68db-487a-84d9-0bdfa37b1467 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:23.680084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87301f16-68db-487a-84d9-0bdfa37b1467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:23.681383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87301f16-68db-487a-84d9-0bdfa37b1467 admin admin] PATH_INFO: `/v3/projects/b525a2b221d843c0b1ec95a81acc0159/users/96da5d25cbbd4653b222290714febb05/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:23.691654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c73400-a8bb-4963-b83f-7d5f6b1fb954 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:23.723088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91530b-a16c-4d1a-bc4b-19b2192b3f82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:23.723827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91530b-a16c-4d1a-bc4b-19b2192b3f82 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:23.724813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91530b-a16c-4d1a-bc4b-19b2192b3f82 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:23.725161 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91530b-a16c-4d1a-bc4b-19b2192b3f82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:23.768097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87301f16-68db-487a-84d9-0bdfa37b1467 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b525a2b221d843c0b1ec95a81acc0159, user_id=96da5d25cbbd4653b222290714febb05, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:23.771215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87301f16-68db-487a-84d9-0bdfa37b1467 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:23.829380 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1153/2327] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:11:23 2022] PUT /identity/v3/projects/b525a2b221d843c0b1ec95a81acc0159/users/96da5d25cbbd4653b222290714febb05/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:23.843224 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87301f16-68db-487a-84d9-0bdfa37b1467 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:23.997449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91530b-a16c-4d1a-bc4b-19b2192b3f82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:23.999472 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91530b-a16c-4d1a-bc4b-19b2192b3f82 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:24.033312 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1175/2328] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:23 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:24.041401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8267fd-9006-4e16-a6bd-01181121a98c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:24.041840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8267fd-9006-4e16-a6bd-01181121a98c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:24.042634 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8267fd-9006-4e16-a6bd-01181121a98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:24.054686 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87301f16-68db-487a-84d9-0bdfa37b1467 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:24.076186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80388c-0c7b-4f69-9753-2a229edacf15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:24.076826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80388c-0c7b-4f69-9753-2a229edacf15 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:24.077106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80388c-0c7b-4f69-9753-2a229edacf15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:24.077381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80388c-0c7b-4f69-9753-2a229edacf15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:24.078035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80388c-0c7b-4f69-9753-2a229edacf15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:24.080399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80388c-0c7b-4f69-9753-2a229edacf15 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:24.119292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ba8267fd-9006-4e16-a6bd-01181121a98c None None] MFA Rules not processed for user `96da5d25cbbd4653b222290714febb05`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:24.120805 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ba8267fd-9006-4e16-a6bd-01181121a98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:24.167939 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1154/2329] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:11:23 2022] POST /identity/v3/projects => generated 395 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:24.174202 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80388c-0c7b-4f69-9753-2a229edacf15 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:24.223915 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:24.273228 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:24.389739 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1176/2330] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:24.391290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8267fd-9006-4e16-a6bd-01181121a98c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:24.417998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8267fd-9006-4e16-a6bd-01181121a98c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:24.421313 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80388c-0c7b-4f69-9753-2a229edacf15 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:24.442215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc94ff-b0ca-40a4-ba79-3382425bcd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:24.443579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc94ff-b0ca-40a4-ba79-3382425bcd5e admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:24.444347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc94ff-b0ca-40a4-ba79-3382425bcd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:24.444826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc94ff-b0ca-40a4-ba79-3382425bcd5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:24.447207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc94ff-b0ca-40a4-ba79-3382425bcd5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:24.454989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc94ff-b0ca-40a4-ba79-3382425bcd5e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:24.461479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec781a-030d-4bdb-b364-4c89aaf564a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:24.462117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec781a-030d-4bdb-b364-4c89aaf564a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:24.462391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec781a-030d-4bdb-b364-4c89aaf564a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:24.462658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdec781a-030d-4bdb-b364-4c89aaf564a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:24.465609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec781a-030d-4bdb-b364-4c89aaf564a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:24.465609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdec781a-030d-4bdb-b364-4c89aaf564a6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:24.557837 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1155/2331] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:11:24 2022] POST /identity/v3/users => generated 304 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:24.561695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec781a-030d-4bdb-b364-4c89aaf564a6 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:24.590949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdec781a-030d-4bdb-b364-4c89aaf564a6 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:24.608431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25cb15-eb01-4fcc-8432-e64fb276762e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:24.609100 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25cb15-eb01-4fcc-8432-e64fb276762e admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:24.609439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25cb15-eb01-4fcc-8432-e64fb276762e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:24.609775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25cb15-eb01-4fcc-8432-e64fb276762e admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:24.611727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25cb15-eb01-4fcc-8432-e64fb276762e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:24.615825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25cb15-eb01-4fcc-8432-e64fb276762e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:24.635818 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1177/2332] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:11:24 2022] POST /identity/v3/projects => generated 375 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:24.640836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc94ff-b0ca-40a4-ba79-3382425bcd5e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:24.656008 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1156/2333] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:24.661958 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25cb15-eb01-4fcc-8432-e64fb276762e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:24.725514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25cb15-eb01-4fcc-8432-e64fb276762e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:24.939804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc94ff-b0ca-40a4-ba79-3382425bcd5e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:24.983626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479dd7a2-0304-43bc-8bc6-326de1f67bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:24.985178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479dd7a2-0304-43bc-8bc6-326de1f67bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:24.985178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479dd7a2-0304-43bc-8bc6-326de1f67bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:24.985497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479dd7a2-0304-43bc-8bc6-326de1f67bd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:25.004786 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479dd7a2-0304-43bc-8bc6-326de1f67bd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:25.014896 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479dd7a2-0304-43bc-8bc6-326de1f67bd7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:25.071930 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1178/2334] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:11:24 2022] POST /identity/v3/users => generated 294 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:25.076956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479dd7a2-0304-43bc-8bc6-326de1f67bd7 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:25.097759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd38760-b93a-423c-b307-7f99733e5c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:25.098924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479dd7a2-0304-43bc-8bc6-326de1f67bd7 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:25.100103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd38760-b93a-423c-b307-7f99733e5c12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:25.100835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd38760-b93a-423c-b307-7f99733e5c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:25.101770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd38760-b93a-423c-b307-7f99733e5c12 admin admin] PATH_INFO: `/v3/projects/2a830bc63f8c494a85b79b29350935c7/users/4c407209b9f94e9e93e5231a3291d91d/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:25.115127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ba40f-d28c-4543-8925-637393530a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:25.115936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ba40f-d28c-4543-8925-637393530a02 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:25.116259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ba40f-d28c-4543-8925-637393530a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:25.116528 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ba40f-d28c-4543-8925-637393530a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:25.117280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ba40f-d28c-4543-8925-637393530a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:25.119098 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ba40f-d28c-4543-8925-637393530a02 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:25.146894 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd38760-b93a-423c-b307-7f99733e5c12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a830bc63f8c494a85b79b29350935c7, user_id=4c407209b9f94e9e93e5231a3291d91d, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:25.150078 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1179/2335] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:11:25.151068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ba40f-d28c-4543-8925-637393530a02 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:25.157402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd38760-b93a-423c-b307-7f99733e5c12 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:25.181719 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ba40f-d28c-4543-8925-637393530a02 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:25.244658 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1157/2336] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:11:24 2022] PUT /identity/v3/projects/2a830bc63f8c494a85b79b29350935c7/users/4c407209b9f94e9e93e5231a3291d91d/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:25.247257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd38760-b93a-423c-b307-7f99733e5c12 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:25.413993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e772075-ab11-4822-8b00-6ee60af4af98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:25.415060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e772075-ab11-4822-8b00-6ee60af4af98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:25.415712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e772075-ab11-4822-8b00-6ee60af4af98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:25.415712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e772075-ab11-4822-8b00-6ee60af4af98 admin admin] PATH_INFO: `/v3/users/a9f5e953db8f4bc5ab594189a31726a2` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:25.419222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e772075-ab11-4822-8b00-6ee60af4af98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9f5e953db8f4bc5ab594189a31726a2)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:25.431715 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e772075-ab11-4822-8b00-6ee60af4af98 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:25.437565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd38760-b93a-423c-b307-7f99733e5c12 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:25.467752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f5457-04dd-4cbf-b14b-67e72c7e2c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:25.468827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f5457-04dd-4cbf-b14b-67e72c7e2c8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:25.469087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f5457-04dd-4cbf-b14b-67e72c7e2c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:25.470159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f5457-04dd-4cbf-b14b-67e72c7e2c8e admin admin] PATH_INFO: `/v3/projects/cf310fb8a76e4b43a6567b29f506c84e/users/78bb2d3253f14b62864ab6cfb2577743/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:25.508507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3f5457-04dd-4cbf-b14b-67e72c7e2c8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf310fb8a76e4b43a6567b29f506c84e, user_id=78bb2d3253f14b62864ab6cfb2577743, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:25.512408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3f5457-04dd-4cbf-b14b-67e72c7e2c8e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:25.534471 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:25.542419 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1158/2337] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:11:25 2022] PUT /identity/v3/projects/cf310fb8a76e4b43a6567b29f506c84e/users/78bb2d3253f14b62864ab6cfb2577743/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:25.542419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f5457-04dd-4cbf-b14b-67e72c7e2c8e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:25.562614 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:25.612488 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0e772075-ab11-4822-8b00-6ee60af4af98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9f5e953db8f4bc5ab594189a31726a2'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:25.635389 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0e772075-ab11-4822-8b00-6ee60af4af98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9f5e953db8f4bc5ab594189a31726a2'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:25.660532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f5457-04dd-4cbf-b14b-67e72c7e2c8e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:25.674003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675bf25-c2ff-4a8e-a526-7874c6ea1a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:25.675499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675bf25-c2ff-4a8e-a526-7874c6ea1a35 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:25.676111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675bf25-c2ff-4a8e-a526-7874c6ea1a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:25.676625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675bf25-c2ff-4a8e-a526-7874c6ea1a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:25.678030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675bf25-c2ff-4a8e-a526-7874c6ea1a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:25.680721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675bf25-c2ff-4a8e-a526-7874c6ea1a35 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:25.687441 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0e772075-ab11-4822-8b00-6ee60af4af98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9f5e953db8f4bc5ab594189a31726a2'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:25.694343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0e772075-ab11-4822-8b00-6ee60af4af98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9f5e953db8f4bc5ab594189a31726a2'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:25.701472 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1159/2338] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:25.703004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675bf25-c2ff-4a8e-a526-7874c6ea1a35 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:25.717328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0e772075-ab11-4822-8b00-6ee60af4af98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9f5e953db8f4bc5ab594189a31726a2'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:25.740042 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1180/2339] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:11:25 2022] DELETE /identity/v3/users/a9f5e953db8f4bc5ab594189a31726a2 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:25.740472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675bf25-c2ff-4a8e-a526-7874c6ea1a35 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:25.741578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e772075-ab11-4822-8b00-6ee60af4af98 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:25.749837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0e772075-ab11-4822-8b00-6ee60af4af98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:25.856311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a2ece-8c4c-4aa5-a7c7-7355f4c5ba73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:25.858518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a2ece-8c4c-4aa5-a7c7-7355f4c5ba73 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:25.861526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a2ece-8c4c-4aa5-a7c7-7355f4c5ba73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:25.863080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a2ece-8c4c-4aa5-a7c7-7355f4c5ba73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:25.864512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a2ece-8c4c-4aa5-a7c7-7355f4c5ba73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:25.867605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a2ece-8c4c-4aa5-a7c7-7355f4c5ba73 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:25.905132 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1160/2340] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:25.910459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943256b-7f13-47c6-8cb2-10bc501cb834 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:25.911002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943256b-7f13-47c6-8cb2-10bc501cb834 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:25.911409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943256b-7f13-47c6-8cb2-10bc501cb834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:25.967200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7943256b-7f13-47c6-8cb2-10bc501cb834 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:25.969563 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7943256b-7f13-47c6-8cb2-10bc501cb834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:25.981202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e772075-ab11-4822-8b00-6ee60af4af98 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:25.997438 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbec030-211d-45a4-a493-ca73a1747d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:25.998916 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1161/2341] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:26.000597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943256b-7f13-47c6-8cb2-10bc501cb834 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:26.001560 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbec030-211d-45a4-a493-ca73a1747d9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:26.002396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbec030-211d-45a4-a493-ca73a1747d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:26.003171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbec030-211d-45a4-a493-ca73a1747d9e admin admin] PATH_INFO: `/v3/projects/2a830bc63f8c494a85b79b29350935c7/users/4c407209b9f94e9e93e5231a3291d91d/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:26.007393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7943256b-7f13-47c6-8cb2-10bc501cb834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:26.012743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbec030-211d-45a4-a493-ca73a1747d9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a830bc63f8c494a85b79b29350935c7, user_id=4c407209b9f94e9e93e5231a3291d91d, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:26.020344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbec030-211d-45a4-a493-ca73a1747d9e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:26.056850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943256b-7f13-47c6-8cb2-10bc501cb834 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:26.107280 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1181/2342] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:11:25 2022] PUT /identity/v3/projects/2a830bc63f8c494a85b79b29350935c7/users/4c407209b9f94e9e93e5231a3291d91d/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:26.114824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbec030-211d-45a4-a493-ca73a1747d9e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:26.128649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4bbec030-211d-45a4-a493-ca73a1747d9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:26.234868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7c197-f012-433b-a65d-45545bdcc9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:26.236290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7c197-f012-433b-a65d-45545bdcc9a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:26.236909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7c197-f012-433b-a65d-45545bdcc9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:26.236909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7c197-f012-433b-a65d-45545bdcc9a4 admin admin] PATH_INFO: `/v3/projects/cf310fb8a76e4b43a6567b29f506c84e/users/78bb2d3253f14b62864ab6cfb2577743/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:26.240057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7c197-f012-433b-a65d-45545bdcc9a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf310fb8a76e4b43a6567b29f506c84e, user_id=78bb2d3253f14b62864ab6cfb2577743, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:26.248780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7c197-f012-433b-a65d-45545bdcc9a4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:26.305387 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1162/2343] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:11:25 2022] PUT /identity/v3/projects/cf310fb8a76e4b43a6567b29f506c84e/users/78bb2d3253f14b62864ab6cfb2577743/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:26.307620 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d85f8-fd91-4b91-b355-4b1d243a1146 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:26.307929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d85f8-fd91-4b91-b355-4b1d243a1146 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:26.308450 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d85f8-fd91-4b91-b355-4b1d243a1146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:26.350820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-963d85f8-fd91-4b91-b355-4b1d243a1146 None None] MFA Rules not processed for user `4c407209b9f94e9e93e5231a3291d91d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:26.352298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-963d85f8-fd91-4b91-b355-4b1d243a1146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:26.373174 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:26.374948 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbec030-211d-45a4-a493-ca73a1747d9e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:26.530521 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1163/2344] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:26 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:26.532251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5f7c1-9622-4ad4-babd-69702a874bb3 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:26.532627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5f7c1-9622-4ad4-babd-69702a874bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:26.532908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5f7c1-9622-4ad4-babd-69702a874bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:26.602498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4234cbf-16b6-4e89-a667-3a21f4036c49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:26.604258 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4234cbf-16b6-4e89-a667-3a21f4036c49 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:26.605204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4234cbf-16b6-4e89-a667-3a21f4036c49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:26.606174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4234cbf-16b6-4e89-a667-3a21f4036c49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:26.611536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d0a5f7c1-9622-4ad4-babd-69702a874bb3 None None] MFA Rules not processed for user `78bb2d3253f14b62864ab6cfb2577743`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:26.613024 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d0a5f7c1-9622-4ad4-babd-69702a874bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:26.631247 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:26.851606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4234cbf-16b6-4e89-a667-3a21f4036c49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:26.871238 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1164/2345] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:26.871801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4234cbf-16b6-4e89-a667-3a21f4036c49 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:26.875252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5f7c1-9622-4ad4-babd-69702a874bb3 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:26.879450 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d0a5f7c1-9622-4ad4-babd-69702a874bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:26.891995 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1182/2346] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 784 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:26.893439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5376e-3e34-4ffa-bae0-c9750819cc10 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:26.893724 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5376e-3e34-4ffa-bae0-c9750819cc10 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:26.893999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5376e-3e34-4ffa-bae0-c9750819cc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:26.928956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-54b5376e-3e34-4ffa-bae0-c9750819cc10 None None] MFA Rules not processed for user `7e9dce42ff994d81b1ad6d6c05356c37`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:26.935270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-54b5376e-3e34-4ffa-bae0-c9750819cc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:27.124465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5f7c1-9622-4ad4-babd-69702a874bb3 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:27.162807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e6da7-88b5-41c1-9708-177c920d0fb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:27.164283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e6da7-88b5-41c1-9708-177c920d0fb3 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:27.165011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e6da7-88b5-41c1-9708-177c920d0fb3 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:27.170145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e6da7-88b5-41c1-9708-177c920d0fb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:27.220349 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1183/2347] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:27.223751 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd996460-aa10-4e7e-ba9e-7ee02689ee08 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:27.224910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd996460-aa10-4e7e-ba9e-7ee02689ee08 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:27.225554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd996460-aa10-4e7e-ba9e-7ee02689ee08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:27.262012 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e6da7-88b5-41c1-9708-177c920d0fb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:27.267406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e6da7-88b5-41c1-9708-177c920d0fb3 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:27.280235 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-fd996460-aa10-4e7e-ba9e-7ee02689ee08 None None] MFA Rules not processed for user `96da5d25cbbd4653b222290714febb05`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:27.282798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fd996460-aa10-4e7e-ba9e-7ee02689ee08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:27.311299 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1165/2348] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:26 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:27.313699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e6da7-88b5-41c1-9708-177c920d0fb3 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:27.318795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d13e6da7-88b5-41c1-9708-177c920d0fb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:27.392868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e6da7-88b5-41c1-9708-177c920d0fb3 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:27.443377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1957f3d-3afe-43c2-b5cf-88bc55c413fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:27.446298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1957f3d-3afe-43c2-b5cf-88bc55c413fd service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:27.449226 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1957f3d-3afe-43c2-b5cf-88bc55c413fd service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:27.450081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1957f3d-3afe-43c2-b5cf-88bc55c413fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:27.467945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d1957f3d-3afe-43c2-b5cf-88bc55c413fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:27.552244 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:27.624581 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1184/2349] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:27.794282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1957f3d-3afe-43c2-b5cf-88bc55c413fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:27.797087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1957f3d-3afe-43c2-b5cf-88bc55c413fd service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:27.878708 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1166/2350] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:27 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:29.130720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd996460-aa10-4e7e-ba9e-7ee02689ee08 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:29.132397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fd996460-aa10-4e7e-ba9e-7ee02689ee08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:29.167547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd996460-aa10-4e7e-ba9e-7ee02689ee08 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:29.172905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24370cc1-e06a-46fb-a8e6-67b5f3011594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:29.176853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24370cc1-e06a-46fb-a8e6-67b5f3011594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:29.177828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24370cc1-e06a-46fb-a8e6-67b5f3011594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:29.178253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24370cc1-e06a-46fb-a8e6-67b5f3011594 admin admin] PATH_INFO: `/v3/projects/674f18b0cd8c45969fa5d72007ebf4cb` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:29.181840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24370cc1-e06a-46fb-a8e6-67b5f3011594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=674f18b0cd8c45969fa5d72007ebf4cb)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:29.184243 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24370cc1-e06a-46fb-a8e6-67b5f3011594 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:29.315256 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:29.318170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-24370cc1-e06a-46fb-a8e6-67b5f3011594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '674f18b0cd8c45969fa5d72007ebf4cb', 'request_id': 'req-24370cc1-e06a-46fb-a8e6-67b5f3011594'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:29.347628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-24370cc1-e06a-46fb-a8e6-67b5f3011594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '674f18b0cd8c45969fa5d72007ebf4cb', 'request_id': 'req-24370cc1-e06a-46fb-a8e6-67b5f3011594'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:29.370428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-24370cc1-e06a-46fb-a8e6-67b5f3011594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '674f18b0cd8c45969fa5d72007ebf4cb', 'request_id': 'req-24370cc1-e06a-46fb-a8e6-67b5f3011594'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:29.419688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-24370cc1-e06a-46fb-a8e6-67b5f3011594 admin admin] The token cache is being invalidate because project 674f18b0cd8c45969fa5d72007ebf4cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:11:29.420376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-24370cc1-e06a-46fb-a8e6-67b5f3011594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:29.421944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-24370cc1-e06a-46fb-a8e6-67b5f3011594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:29.424665 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1185/2351] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:11:29 2022] DELETE /identity/v3/projects/674f18b0cd8c45969fa5d72007ebf4cb => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:29.431449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1957f3d-3afe-43c2-b5cf-88bc55c413fd service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:29.466258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1957f3d-3afe-43c2-b5cf-88bc55c413fd service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:29.663452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24370cc1-e06a-46fb-a8e6-67b5f3011594 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:29.666081 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-24370cc1-e06a-46fb-a8e6-67b5f3011594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:29.805327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c8717-7fa7-4eef-b4f2-0b2a1a358c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:29.806342 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c8717-7fa7-4eef-b4f2-0b2a1a358c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:29.806813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c8717-7fa7-4eef-b4f2-0b2a1a358c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:29.807292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c8717-7fa7-4eef-b4f2-0b2a1a358c63 admin admin] PATH_INFO: `/v3/users/d2a6bb194a0d4d82883ae7651f4ff418` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:29.814030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c8717-7fa7-4eef-b4f2-0b2a1a358c63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2a6bb194a0d4d82883ae7651f4ff418)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:29.822973 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c8717-7fa7-4eef-b4f2-0b2a1a358c63 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:30.002124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24370cc1-e06a-46fb-a8e6-67b5f3011594 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:30.041651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31cabdf-3d49-4f3e-bc4f-e624c479a573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:30.042747 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cabdf-3d49-4f3e-bc4f-e624c479a573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:30.043211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cabdf-3d49-4f3e-bc4f-e624c479a573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:30.043731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cabdf-3d49-4f3e-bc4f-e624c479a573 admin admin] PATH_INFO: `/v3/users/52ecd35e1c8e4c9b8343eae6014fde3b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:30.049746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31cabdf-3d49-4f3e-bc4f-e624c479a573 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52ecd35e1c8e4c9b8343eae6014fde3b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:30.051392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f60c8717-7fa7-4eef-b4f2-0b2a1a358c63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2a6bb194a0d4d82883ae7651f4ff418'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:30.060742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31cabdf-3d49-4f3e-bc4f-e624c479a573 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:30.120287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f60c8717-7fa7-4eef-b4f2-0b2a1a358c63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2a6bb194a0d4d82883ae7651f4ff418'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:30.183760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f60c8717-7fa7-4eef-b4f2-0b2a1a358c63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2a6bb194a0d4d82883ae7651f4ff418'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:30.187312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f60c8717-7fa7-4eef-b4f2-0b2a1a358c63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2a6bb194a0d4d82883ae7651f4ff418'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:30.212185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f60c8717-7fa7-4eef-b4f2-0b2a1a358c63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2a6bb194a0d4d82883ae7651f4ff418'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:30.234151 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1167/2352] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:11:29 2022] DELETE /identity/v3/users/d2a6bb194a0d4d82883ae7651f4ff418 => generated 0 bytes in 801 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:30.235972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c8717-7fa7-4eef-b4f2-0b2a1a358c63 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:30.238156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f60c8717-7fa7-4eef-b4f2-0b2a1a358c63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:30.316699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a31cabdf-3d49-4f3e-bc4f-e624c479a573 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52ecd35e1c8e4c9b8343eae6014fde3b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:30.357644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a31cabdf-3d49-4f3e-bc4f-e624c479a573 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52ecd35e1c8e4c9b8343eae6014fde3b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:30.440084 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:30.441856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a31cabdf-3d49-4f3e-bc4f-e624c479a573 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52ecd35e1c8e4c9b8343eae6014fde3b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:30.443518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a31cabdf-3d49-4f3e-bc4f-e624c479a573 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52ecd35e1c8e4c9b8343eae6014fde3b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:30.483782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a31cabdf-3d49-4f3e-bc4f-e624c479a573 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52ecd35e1c8e4c9b8343eae6014fde3b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:30.501280 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1186/2353] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:11:29 2022] DELETE /identity/v3/users/52ecd35e1c8e4c9b8343eae6014fde3b => generated 0 bytes in 840 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:11:30.506652 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755afe8-04a8-46a3-bc07-75b5c4a4aaec None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:30.507103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755afe8-04a8-46a3-bc07-75b5c4a4aaec None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:30.508060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755afe8-04a8-46a3-bc07-75b5c4a4aaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:30.561580 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a755afe8-04a8-46a3-bc07-75b5c4a4aaec None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:30.566624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a755afe8-04a8-46a3-bc07-75b5c4a4aaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:30.596775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c8717-7fa7-4eef-b4f2-0b2a1a358c63 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:30.782929 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:30.811274 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1187/2354] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:30.889630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da147231-c5ba-4b96-bca7-f8d9b52f73cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:30.889630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da147231-c5ba-4b96-bca7-f8d9b52f73cd service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:30.890141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da147231-c5ba-4b96-bca7-f8d9b52f73cd service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:30.890141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da147231-c5ba-4b96-bca7-f8d9b52f73cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:30.893772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-da147231-c5ba-4b96-bca7-f8d9b52f73cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:31.097091 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da147231-c5ba-4b96-bca7-f8d9b52f73cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:31.101081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da147231-c5ba-4b96-bca7-f8d9b52f73cd service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:31.203765 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1168/2355] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 968 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:31.526024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755afe8-04a8-46a3-bc07-75b5c4a4aaec None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:31.527823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a755afe8-04a8-46a3-bc07-75b5c4a4aaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:31.731021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755afe8-04a8-46a3-bc07-75b5c4a4aaec None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:31.744309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04c195-7635-4822-9aec-452c828ce99f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:31.745670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04c195-7635-4822-9aec-452c828ce99f service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:31.746462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04c195-7635-4822-9aec-452c828ce99f service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:31.749663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04c195-7635-4822-9aec-452c828ce99f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:31.834252 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04c195-7635-4822-9aec-452c828ce99f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:31.847545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04c195-7635-4822-9aec-452c828ce99f service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:31.927597 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1188/2356] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:11:32.404333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da147231-c5ba-4b96-bca7-f8d9b52f73cd service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:32.408498 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-da147231-c5ba-4b96-bca7-f8d9b52f73cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:32.471921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da147231-c5ba-4b96-bca7-f8d9b52f73cd service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:32.502142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c137207-c857-4e57-b1cb-ed7ae0786fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:32.503803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c137207-c857-4e57-b1cb-ed7ae0786fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:32.506871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c137207-c857-4e57-b1cb-ed7ae0786fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:32.509219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c137207-c857-4e57-b1cb-ed7ae0786fcc admin admin] PATH_INFO: `/v3/projects/2169d941acc24c44a3d6fa774c055a1a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:32.513650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c137207-c857-4e57-b1cb-ed7ae0786fcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2169d941acc24c44a3d6fa774c055a1a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:32.526101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c137207-c857-4e57-b1cb-ed7ae0786fcc admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:32.703708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0c137207-c857-4e57-b1cb-ed7ae0786fcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2169d941acc24c44a3d6fa774c055a1a', 'request_id': 'req-0c137207-c857-4e57-b1cb-ed7ae0786fcc'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:32.730897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0c137207-c857-4e57-b1cb-ed7ae0786fcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2169d941acc24c44a3d6fa774c055a1a', 'request_id': 'req-0c137207-c857-4e57-b1cb-ed7ae0786fcc'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:32.758874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0c137207-c857-4e57-b1cb-ed7ae0786fcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2169d941acc24c44a3d6fa774c055a1a', 'request_id': 'req-0c137207-c857-4e57-b1cb-ed7ae0786fcc'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:32.767849 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:32.805780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0c137207-c857-4e57-b1cb-ed7ae0786fcc admin admin] The token cache is being invalidate because project 2169d941acc24c44a3d6fa774c055a1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:11:32.807819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0c137207-c857-4e57-b1cb-ed7ae0786fcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:32.815080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0c137207-c857-4e57-b1cb-ed7ae0786fcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:32.827922 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1169/2357] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:11:32 2022] DELETE /identity/v3/projects/2169d941acc24c44a3d6fa774c055a1a => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:32.830966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08a857-7dda-40d9-943c-a0be506b7181 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:32.831976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08a857-7dda-40d9-943c-a0be506b7181 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:32.831976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08a857-7dda-40d9-943c-a0be506b7181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:32.999310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2d08a857-7dda-40d9-943c-a0be506b7181 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:33.007336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2d08a857-7dda-40d9-943c-a0be506b7181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:33.271126 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1189/2358] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:33.285467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd83706-1bc5-4a84-9a71-e0022d3af417 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:33.286844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd83706-1bc5-4a84-9a71-e0022d3af417 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:33.287509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd83706-1bc5-4a84-9a71-e0022d3af417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:33.413907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9dd83706-1bc5-4a84-9a71-e0022d3af417 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:33.426695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9dd83706-1bc5-4a84-9a71-e0022d3af417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:33.506275 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1170/2359] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:11:33.507722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08a857-7dda-40d9-943c-a0be506b7181 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:33.585190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08a857-7dda-40d9-943c-a0be506b7181 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:33.633050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0984d-fc08-4958-8114-bc94794f5176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:33.638780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0984d-fc08-4958-8114-bc94794f5176 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:33.645079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0984d-fc08-4958-8114-bc94794f5176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:33.657051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0984d-fc08-4958-8114-bc94794f5176 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:33.659018 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0984d-fc08-4958-8114-bc94794f5176 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:11:33.659876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0984d-fc08-4958-8114-bc94794f5176 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:33.668615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0984d-fc08-4958-8114-bc94794f5176 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:33.753940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd83706-1bc5-4a84-9a71-e0022d3af417 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:33.763520 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1190/2360] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:11:33.784004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd83706-1bc5-4a84-9a71-e0022d3af417 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:33.808197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77114dec-4bea-46e4-9a92-cc1ee0cbcdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:33.808836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77114dec-4bea-46e4-9a92-cc1ee0cbcdc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:33.809111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77114dec-4bea-46e4-9a92-cc1ee0cbcdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:33.824132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77114dec-4bea-46e4-9a92-cc1ee0cbcdc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:33.824942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77114dec-4bea-46e4-9a92-cc1ee0cbcdc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:33.837472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77114dec-4bea-46e4-9a92-cc1ee0cbcdc5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:34.043025 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1171/2361] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:11:33 2022] POST /identity/v3/projects => generated 377 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:11:34.050217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0984d-fc08-4958-8114-bc94794f5176 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:34.081298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0984d-fc08-4958-8114-bc94794f5176 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:34.397947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938294b-eb75-4354-8980-5ec77d8a364d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:34.399673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938294b-eb75-4354-8980-5ec77d8a364d admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:34.400511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938294b-eb75-4354-8980-5ec77d8a364d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:34.401145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0938294b-eb75-4354-8980-5ec77d8a364d admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:34.404307 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938294b-eb75-4354-8980-5ec77d8a364d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:34.407726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0684b2-9300-46ad-bf2c-c0917eab699a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:34.408976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0684b2-9300-46ad-bf2c-c0917eab699a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:34.409881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0684b2-9300-46ad-bf2c-c0917eab699a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:34.410510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0938294b-eb75-4354-8980-5ec77d8a364d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:34.552781 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1191/2362] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:11:34 2022] POST /identity/v3/users => generated 289 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:11:34.555283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938294b-eb75-4354-8980-5ec77d8a364d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:34.584697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ab0684b2-9300-46ad-bf2c-c0917eab699a None None] MFA Rules not processed for user `aaaa793a840141369476d821307497c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:34.586878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ab0684b2-9300-46ad-bf2c-c0917eab699a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:34.609096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0938294b-eb75-4354-8980-5ec77d8a364d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:34.625745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f88e7-576b-4d36-86ab-60a04f469022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:34.627768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f88e7-576b-4d36-86ab-60a04f469022 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:34.630802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f88e7-576b-4d36-86ab-60a04f469022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:34.631253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f88e7-576b-4d36-86ab-60a04f469022 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:34.632133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f88e7-576b-4d36-86ab-60a04f469022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:34.635941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f88e7-576b-4d36-86ab-60a04f469022 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:34.674744 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1192/2363] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:34.677687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b61611-56a8-451b-b3df-97b90ef46a83 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:34.677997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b61611-56a8-451b-b3df-97b90ef46a83 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:34.678272 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b61611-56a8-451b-b3df-97b90ef46a83 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:34.691400 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1193/2364] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 01:11:34 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:11:34.693033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b61611-56a8-451b-b3df-97b90ef46a83 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:34.713273 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:34.729597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b61611-56a8-451b-b3df-97b90ef46a83 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:34.741671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d5a69-ece5-48f8-a632-273a41d52ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:34.742481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d5a69-ece5-48f8-a632-273a41d52ecf admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:34.742768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d5a69-ece5-48f8-a632-273a41d52ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:34.743035 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d5a69-ece5-48f8-a632-273a41d52ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:34.743712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d5a69-ece5-48f8-a632-273a41d52ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:34.745702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d5a69-ece5-48f8-a632-273a41d52ecf admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:34.778672 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1194/2365] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:34.784079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba0f6e-d392-4057-8af1-ff13448e97d1 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:34.784079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba0f6e-d392-4057-8af1-ff13448e97d1 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:34.784462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba0f6e-d392-4057-8af1-ff13448e97d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:34.815531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-41ba0f6e-d392-4057-8af1-ff13448e97d1 None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:34.818331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-41ba0f6e-d392-4057-8af1-ff13448e97d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:34.841185 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1172/2366] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:11:34.842468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0684b2-9300-46ad-bf2c-c0917eab699a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:34.871733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0684b2-9300-46ad-bf2c-c0917eab699a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:34.889044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0d579-317b-44be-9b10-16ed945d6d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:34.893970 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0d579-317b-44be-9b10-16ed945d6d38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:34.909581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0d579-317b-44be-9b10-16ed945d6d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:34.909979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0d579-317b-44be-9b10-16ed945d6d38 admin admin] PATH_INFO: `/v3/projects/ba72ffc81ed54208bb16ef17583e8562/users/2e66778890e8464f9912b5b120ba94a3/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:34.960185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0d579-317b-44be-9b10-16ed945d6d38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba72ffc81ed54208bb16ef17583e8562, user_id=2e66778890e8464f9912b5b120ba94a3, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:34.965450 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0d579-317b-44be-9b10-16ed945d6d38 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:35.019211 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1195/2367] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 01:11:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:35.024934 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1173/2368] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:11:34 2022] PUT /identity/v3/projects/ba72ffc81ed54208bb16ef17583e8562/users/2e66778890e8464f9912b5b120ba94a3/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:35.046097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcb9f4-6a70-4a74-b1b3-34bd14081fc8 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:35.047125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcb9f4-6a70-4a74-b1b3-34bd14081fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:35.048432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcb9f4-6a70-4a74-b1b3-34bd14081fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:35.097390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0d579-317b-44be-9b10-16ed945d6d38 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:35.101763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a0c0d579-317b-44be-9b10-16ed945d6d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:35.200612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-98fcb9f4-6a70-4a74-b1b3-34bd14081fc8 None None] MFA Rules not processed for user `2e66778890e8464f9912b5b120ba94a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:35.206013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-98fcb9f4-6a70-4a74-b1b3-34bd14081fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:35.501206 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1196/2369] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:11:35.502922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcb9f4-6a70-4a74-b1b3-34bd14081fc8 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:35.508365 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-98fcb9f4-6a70-4a74-b1b3-34bd14081fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:35.522811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0d579-317b-44be-9b10-16ed945d6d38 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:35.543291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b8f5b5-d1e6-4e39-8b45-8246237c5cba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:35.544799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8f5b5-d1e6-4e39-8b45-8246237c5cba service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:35.545650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8f5b5-d1e6-4e39-8b45-8246237c5cba service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:35.546458 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8f5b5-d1e6-4e39-8b45-8246237c5cba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:35.600429 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b8f5b5-d1e6-4e39-8b45-8246237c5cba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:35.603694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b8f5b5-d1e6-4e39-8b45-8246237c5cba service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:35.657776 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1174/2370] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:11:35.659278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b8f5b5-d1e6-4e39-8b45-8246237c5cba service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:35.667495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f8b8f5b5-d1e6-4e39-8b45-8246237c5cba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:35.787806 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:35.888607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcb9f4-6a70-4a74-b1b3-34bd14081fc8 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:35.908161 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0eccb6-9116-4be3-b2f6-29275aba6c76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:35.908815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0eccb6-9116-4be3-b2f6-29275aba6c76 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:35.909130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0eccb6-9116-4be3-b2f6-29275aba6c76 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:35.911911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0eccb6-9116-4be3-b2f6-29275aba6c76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:35.964870 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:36.120649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b8f5b5-d1e6-4e39-8b45-8246237c5cba service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:36.141087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0eccb6-9116-4be3-b2f6-29275aba6c76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:36.150506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0eccb6-9116-4be3-b2f6-29275aba6c76 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:36.163716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4743c5-baba-4dc8-8e41-72794a573bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:36.164737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4743c5-baba-4dc8-8e41-72794a573bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:36.165002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4743c5-baba-4dc8-8e41-72794a573bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:36.165482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4743c5-baba-4dc8-8e41-72794a573bc4 admin admin] PATH_INFO: `/v3/projects/73fc0ad44da6450caa86e773d4210dd6` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:36.182762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4743c5-baba-4dc8-8e41-72794a573bc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73fc0ad44da6450caa86e773d4210dd6)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:36.186372 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1197/2371] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:35 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:36.187502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0eccb6-9116-4be3-b2f6-29275aba6c76 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:36.212385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4743c5-baba-4dc8-8e41-72794a573bc4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:36.222152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0eccb6-9116-4be3-b2f6-29275aba6c76 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:36.263191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bc0ac-a11c-4191-83da-384d75d6517c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:36.264655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bc0ac-a11c-4191-83da-384d75d6517c admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:36.272239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bc0ac-a11c-4191-83da-384d75d6517c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:36.275422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bc0ac-a11c-4191-83da-384d75d6517c admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:36.287579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0bc0ac-a11c-4191-83da-384d75d6517c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:36.296829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0bc0ac-a11c-4191-83da-384d75d6517c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:36.419173 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1198/2372] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:11:36 2022] POST /identity/v3/projects => generated 375 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:36.433434 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bc0ac-a11c-4191-83da-384d75d6517c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:36.508621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3b4743c5-baba-4dc8-8e41-72794a573bc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73fc0ad44da6450caa86e773d4210dd6', 'request_id': 'req-3b4743c5-baba-4dc8-8e41-72794a573bc4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:36.521668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3b4743c5-baba-4dc8-8e41-72794a573bc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73fc0ad44da6450caa86e773d4210dd6', 'request_id': 'req-3b4743c5-baba-4dc8-8e41-72794a573bc4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:36.534307 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3b4743c5-baba-4dc8-8e41-72794a573bc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73fc0ad44da6450caa86e773d4210dd6', 'request_id': 'req-3b4743c5-baba-4dc8-8e41-72794a573bc4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:36.578488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3b4743c5-baba-4dc8-8e41-72794a573bc4 admin admin] The token cache is being invalidate because project 73fc0ad44da6450caa86e773d4210dd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:11:36.578864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3b4743c5-baba-4dc8-8e41-72794a573bc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:36.580406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3b4743c5-baba-4dc8-8e41-72794a573bc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:36.583720 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1175/2373] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:11:35 2022] DELETE /identity/v3/projects/73fc0ad44da6450caa86e773d4210dd6 => generated 0 bytes in 925 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:36.588952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4743c5-baba-4dc8-8e41-72794a573bc4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:36.599356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3b4743c5-baba-4dc8-8e41-72794a573bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:36.825011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bc0ac-a11c-4191-83da-384d75d6517c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:36.898928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4743c5-baba-4dc8-8e41-72794a573bc4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:36.924558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73dfdfd-1953-41a5-afe6-adcdfca124b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:36.925946 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73dfdfd-1953-41a5-afe6-adcdfca124b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:36.926251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73dfdfd-1953-41a5-afe6-adcdfca124b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:36.926828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73dfdfd-1953-41a5-afe6-adcdfca124b1 admin admin] PATH_INFO: `/v3/users/4c407209b9f94e9e93e5231a3291d91d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:36.929598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73dfdfd-1953-41a5-afe6-adcdfca124b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c407209b9f94e9e93e5231a3291d91d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:36.945041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73dfdfd-1953-41a5-afe6-adcdfca124b1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:37.051937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376e9fb-efb3-467b-9a45-6c3f36bf4c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:37.053468 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376e9fb-efb3-467b-9a45-6c3f36bf4c6c admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:37.053877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376e9fb-efb3-467b-9a45-6c3f36bf4c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:37.054298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376e9fb-efb3-467b-9a45-6c3f36bf4c6c admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:37.058114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376e9fb-efb3-467b-9a45-6c3f36bf4c6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:37.062988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376e9fb-efb3-467b-9a45-6c3f36bf4c6c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:37.132613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b73dfdfd-1953-41a5-afe6-adcdfca124b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c407209b9f94e9e93e5231a3291d91d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:37.145888 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1199/2374] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:11:36 2022] POST /identity/v3/users => generated 294 bytes in 714 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:37.146512 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:37.146928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376e9fb-efb3-467b-9a45-6c3f36bf4c6c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:37.155317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f376e9fb-efb3-467b-9a45-6c3f36bf4c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:37.163379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b73dfdfd-1953-41a5-afe6-adcdfca124b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c407209b9f94e9e93e5231a3291d91d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:37.210821 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:37.216238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b73dfdfd-1953-41a5-afe6-adcdfca124b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c407209b9f94e9e93e5231a3291d91d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:37.222885 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b73dfdfd-1953-41a5-afe6-adcdfca124b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c407209b9f94e9e93e5231a3291d91d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:37.246289 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b73dfdfd-1953-41a5-afe6-adcdfca124b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c407209b9f94e9e93e5231a3291d91d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:37.280684 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1176/2375] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:11:36 2022] DELETE /identity/v3/users/4c407209b9f94e9e93e5231a3291d91d => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:37.282353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73dfdfd-1953-41a5-afe6-adcdfca124b1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:37.292193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b73dfdfd-1953-41a5-afe6-adcdfca124b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:37.360258 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376e9fb-efb3-467b-9a45-6c3f36bf4c6c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:37.666705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73dfdfd-1953-41a5-afe6-adcdfca124b1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:37.686697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3accb218-1275-4a40-8bf4-96405df68931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:37.687979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accb218-1275-4a40-8bf4-96405df68931 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:37.688623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accb218-1275-4a40-8bf4-96405df68931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:37.690156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accb218-1275-4a40-8bf4-96405df68931 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:37.691361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3accb218-1275-4a40-8bf4-96405df68931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:37.699696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3accb218-1275-4a40-8bf4-96405df68931 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:37.743524 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1177/2376] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 462 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:37.745298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d815244-e46b-489b-b02f-e0c0aa3240a5 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:37.745592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d815244-e46b-489b-b02f-e0c0aa3240a5 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:37.745871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d815244-e46b-489b-b02f-e0c0aa3240a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:37.787767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7e2dd-3df4-482f-a230-adfa55661782 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:37.789608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7e2dd-3df4-482f-a230-adfa55661782 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:37.791982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7e2dd-3df4-482f-a230-adfa55661782 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:37.793450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7e2dd-3df4-482f-a230-adfa55661782 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:37.801498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e7b7e2dd-3df4-482f-a230-adfa55661782 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:37.834501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2d815244-e46b-489b-b02f-e0c0aa3240a5 None None] MFA Rules not processed for user `c135ba135fd946149ace9a86c7c52e80`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:37.836215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2d815244-e46b-489b-b02f-e0c0aa3240a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:37.843317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7e2dd-3df4-482f-a230-adfa55661782 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:37.851933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7e2dd-3df4-482f-a230-adfa55661782 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:37.884452 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1200/2377] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 738 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:37.885539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7e2dd-3df4-482f-a230-adfa55661782 service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:37.952567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7e2dd-3df4-482f-a230-adfa55661782 service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:37.972292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e054c33-51ec-4667-b039-5aee7b9c8f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:37.976322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e054c33-51ec-4667-b039-5aee7b9c8f60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:37.976653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e054c33-51ec-4667-b039-5aee7b9c8f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:37.977080 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e054c33-51ec-4667-b039-5aee7b9c8f60 admin admin] PATH_INFO: `/v3/projects/d914ab3076e844818aadc1a1314ec043/users/7773115ae92a4b7b9bee60a87457c572/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:38.053754 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1178/2378] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:37 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:38.059285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e054c33-51ec-4667-b039-5aee7b9c8f60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d914ab3076e844818aadc1a1314ec043, user_id=7773115ae92a4b7b9bee60a87457c572, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:38.071059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e054c33-51ec-4667-b039-5aee7b9c8f60 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:38.073942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe126a0-f0f3-4eb3-a08f-89ea3be66e60 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:38.074212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe126a0-f0f3-4eb3-a08f-89ea3be66e60 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:38.074509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe126a0-f0f3-4eb3-a08f-89ea3be66e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:38.110042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3fe126a0-f0f3-4eb3-a08f-89ea3be66e60 None None] MFA Rules not processed for user `c135ba135fd946149ace9a86c7c52e80`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:38.111368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3fe126a0-f0f3-4eb3-a08f-89ea3be66e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:38.115328 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1201/2379] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:11:37 2022] PUT /identity/v3/projects/d914ab3076e844818aadc1a1314ec043/users/7773115ae92a4b7b9bee60a87457c572/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:38.117547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e054c33-51ec-4667-b039-5aee7b9c8f60 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:38.244316 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:38.270736 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1179/2380] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:38 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:38.309898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e054c33-51ec-4667-b039-5aee7b9c8f60 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:38.327605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790868f4-9cf5-40bc-907c-91cf34ee3a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:38.328569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790868f4-9cf5-40bc-907c-91cf34ee3a87 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:38.328569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790868f4-9cf5-40bc-907c-91cf34ee3a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:38.329158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790868f4-9cf5-40bc-907c-91cf34ee3a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:38.329800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790868f4-9cf5-40bc-907c-91cf34ee3a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:38.331728 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790868f4-9cf5-40bc-907c-91cf34ee3a87 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:38.350484 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1202/2381] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:38.356330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe126a0-f0f3-4eb3-a08f-89ea3be66e60 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:38.408811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe126a0-f0f3-4eb3-a08f-89ea3be66e60 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:38.417088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae6da9-c24b-4b9b-a3db-94d2181c6457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:38.418627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae6da9-c24b-4b9b-a3db-94d2181c6457 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:38.419126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae6da9-c24b-4b9b-a3db-94d2181c6457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:38.419616 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae6da9-c24b-4b9b-a3db-94d2181c6457 admin admin] PATH_INFO: `/v3/projects/d914ab3076e844818aadc1a1314ec043/users/7773115ae92a4b7b9bee60a87457c572/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:38.424205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae6da9-c24b-4b9b-a3db-94d2181c6457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d914ab3076e844818aadc1a1314ec043, user_id=7773115ae92a4b7b9bee60a87457c572, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:38.433068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae6da9-c24b-4b9b-a3db-94d2181c6457 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:38.463181 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1180/2382] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:11:38 2022] PUT /identity/v3/projects/d914ab3076e844818aadc1a1314ec043/users/7773115ae92a4b7b9bee60a87457c572/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:11:38.479778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608369ae-5942-4ec3-b6e4-0bc9fdd63195 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:38.481367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608369ae-5942-4ec3-b6e4-0bc9fdd63195 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:38.481869 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608369ae-5942-4ec3-b6e4-0bc9fdd63195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:38.575907 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-608369ae-5942-4ec3-b6e4-0bc9fdd63195 None None] MFA Rules not processed for user `7773115ae92a4b7b9bee60a87457c572`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:38.578269 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-608369ae-5942-4ec3-b6e4-0bc9fdd63195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:38.716827 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:38.933546 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae6da9-c24b-4b9b-a3db-94d2181c6457 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:38.936762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-88ae6da9-c24b-4b9b-a3db-94d2181c6457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:38.992986 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1203/2383] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 514 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:39.049107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b32a04-5040-409c-9aa3-775d2a277ecb None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:39.049336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b32a04-5040-409c-9aa3-775d2a277ecb None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:39.049655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b32a04-5040-409c-9aa3-775d2a277ecb None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:39.057218 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1204/2384] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 01:11:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:11:39.066439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a68be9-8952-48dc-86f2-3283266ae0a7 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:39.067172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a68be9-8952-48dc-86f2-3283266ae0a7 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:39.068697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a68be9-8952-48dc-86f2-3283266ae0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:39.112436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-06a68be9-8952-48dc-86f2-3283266ae0a7 None None] MFA Rules not processed for user `6c70d5a72d424db68de7c7b8257fe02c`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:39.117123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-06a68be9-8952-48dc-86f2-3283266ae0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:39.284123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae6da9-c24b-4b9b-a3db-94d2181c6457 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:39.330644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878e012-cc3b-43dc-8baa-b5a781570e6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:39.330946 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878e012-cc3b-43dc-8baa-b5a781570e6f service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:39.331304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878e012-cc3b-43dc-8baa-b5a781570e6f service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:39.331941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878e012-cc3b-43dc-8baa-b5a781570e6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:39.444963 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1205/2385] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 01:11:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:39.448910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a68be9-8952-48dc-86f2-3283266ae0a7 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:39.452602 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-06a68be9-8952-48dc-86f2-3283266ae0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:39.543611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878e012-cc3b-43dc-8baa-b5a781570e6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:39.545826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878e012-cc3b-43dc-8baa-b5a781570e6f service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:39.573045 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1181/2386] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:38 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:11:39.576177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878e012-cc3b-43dc-8baa-b5a781570e6f service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:39.581884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8878e012-cc3b-43dc-8baa-b5a781570e6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:39.593948 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a68be9-8952-48dc-86f2-3283266ae0a7 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:39.603930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7ad42-3422-4ccc-96ad-97c88ac329c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:39.604879 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7ad42-3422-4ccc-96ad-97c88ac329c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:39.605323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7ad42-3422-4ccc-96ad-97c88ac329c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:39.606286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7ad42-3422-4ccc-96ad-97c88ac329c0 admin admin] PATH_INFO: `/v3/projects/2a830bc63f8c494a85b79b29350935c7` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:39.608855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7ad42-3422-4ccc-96ad-97c88ac329c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a830bc63f8c494a85b79b29350935c7)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:39.614923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7ad42-3422-4ccc-96ad-97c88ac329c0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:39.774226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9cc7ad42-3422-4ccc-96ad-97c88ac329c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a830bc63f8c494a85b79b29350935c7', 'request_id': 'req-9cc7ad42-3422-4ccc-96ad-97c88ac329c0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:39.792162 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:39.796328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9cc7ad42-3422-4ccc-96ad-97c88ac329c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a830bc63f8c494a85b79b29350935c7', 'request_id': 'req-9cc7ad42-3422-4ccc-96ad-97c88ac329c0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:39.809369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9cc7ad42-3422-4ccc-96ad-97c88ac329c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a830bc63f8c494a85b79b29350935c7', 'request_id': 'req-9cc7ad42-3422-4ccc-96ad-97c88ac329c0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:39.839970 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9cc7ad42-3422-4ccc-96ad-97c88ac329c0 admin admin] The token cache is being invalidate because project 2a830bc63f8c494a85b79b29350935c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:11:39.840455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9cc7ad42-3422-4ccc-96ad-97c88ac329c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:39.842849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9cc7ad42-3422-4ccc-96ad-97c88ac329c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:39.848697 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1206/2387] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:11:39 2022] DELETE /identity/v3/projects/2a830bc63f8c494a85b79b29350935c7 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:39.850707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cc1a4-d23e-4ddd-bef6-32b7b00dcfb1 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:39.850990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cc1a4-d23e-4ddd-bef6-32b7b00dcfb1 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:39.851273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cc1a4-d23e-4ddd-bef6-32b7b00dcfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:39.862379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878e012-cc3b-43dc-8baa-b5a781570e6f service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:39.919234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c21cc1a4-d23e-4ddd-bef6-32b7b00dcfb1 None None] MFA Rules not processed for user `1bb91c5d1c274ef38ad02e7fa176b4c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:39.954692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c21cc1a4-d23e-4ddd-bef6-32b7b00dcfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:40.006028 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:40.037031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d1aad-6533-4f8a-b1e3-9e1fc22ab2cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:40.037686 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d1aad-6533-4f8a-b1e3-9e1fc22ab2cd service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:40.038019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d1aad-6533-4f8a-b1e3-9e1fc22ab2cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:40.038381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d1aad-6533-4f8a-b1e3-9e1fc22ab2cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:40.043010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f93d1aad-6533-4f8a-b1e3-9e1fc22ab2cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:40.191816 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1207/2388] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:39 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:40.194243 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcbc50-0fcb-4cda-a2cd-5164fc075479 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:40.194541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcbc50-0fcb-4cda-a2cd-5164fc075479 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:40.194992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcbc50-0fcb-4cda-a2cd-5164fc075479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:40.273651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-93fcbc50-0fcb-4cda-a2cd-5164fc075479 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:40.277133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-93fcbc50-0fcb-4cda-a2cd-5164fc075479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:40.308854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d1aad-6533-4f8a-b1e3-9e1fc22ab2cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:40.310577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d1aad-6533-4f8a-b1e3-9e1fc22ab2cd service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:40.343801 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1182/2389] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 770 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:40.374236 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e94886-22b4-4932-85a4-7220ccec777e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:40.374621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e94886-22b4-4932-85a4-7220ccec777e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:40.374998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e94886-22b4-4932-85a4-7220ccec777e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:40.433618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b0e94886-22b4-4932-85a4-7220ccec777e None None] MFA Rules not processed for user `b219e01934fa477fbaa053cca586f01b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:40.440515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b0e94886-22b4-4932-85a4-7220ccec777e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:40.469982 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1183/2390] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 01:11:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:11:40.496981 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1208/2391] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:40.498530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d673f-90be-4824-b1be-be2191be294b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:40.498805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d673f-90be-4824-b1be-be2191be294b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:40.499076 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d673f-90be-4824-b1be-be2191be294b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:40.516562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fcbc50-0fcb-4cda-a2cd-5164fc075479 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:40.518661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-93fcbc50-0fcb-4cda-a2cd-5164fc075479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:40.545146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2c5d673f-90be-4824-b1be-be2191be294b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:40.546563 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2c5d673f-90be-4824-b1be-be2191be294b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:40.566186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fcbc50-0fcb-4cda-a2cd-5164fc075479 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:40.569885 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1184/2392] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:11:40.575638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d673f-90be-4824-b1be-be2191be294b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:40.577556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e6dbb-eea1-4610-8965-740b2b542390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:40.578630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e6dbb-eea1-4610-8965-740b2b542390 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:40.579117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e6dbb-eea1-4610-8965-740b2b542390 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:40.579593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e6dbb-eea1-4610-8965-740b2b542390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:40.597106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d673f-90be-4824-b1be-be2191be294b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:40.616674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939fa43-c88f-4e08-a9de-ae3f6d4945e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:40.617576 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e6dbb-eea1-4610-8965-740b2b542390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:40.618530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939fa43-c88f-4e08-a9de-ae3f6d4945e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:40.618530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939fa43-c88f-4e08-a9de-ae3f6d4945e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:40.618939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939fa43-c88f-4e08-a9de-ae3f6d4945e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:40.620240 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939fa43-c88f-4e08-a9de-ae3f6d4945e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:11:40.620492 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e6dbb-eea1-4610-8965-740b2b542390 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:40.628795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939fa43-c88f-4e08-a9de-ae3f6d4945e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:40.634193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939fa43-c88f-4e08-a9de-ae3f6d4945e0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:40.650941 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1209/2393] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:11:40.682490 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1185/2394] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:11:40.688511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e6dbb-eea1-4610-8965-740b2b542390 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:40.726003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e6dbb-eea1-4610-8965-740b2b542390 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:40.759926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793be3e-35c6-4ed6-a7ce-8ee02ac2b1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:40.761130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793be3e-35c6-4ed6-a7ce-8ee02ac2b1d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:40.761618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793be3e-35c6-4ed6-a7ce-8ee02ac2b1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:40.762097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793be3e-35c6-4ed6-a7ce-8ee02ac2b1d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:40.763293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3793be3e-35c6-4ed6-a7ce-8ee02ac2b1d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:40.774429 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3793be3e-35c6-4ed6-a7ce-8ee02ac2b1d9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:40.886941 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1210/2395] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:11:40 2022] POST /identity/v3/projects => generated 411 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:40.892506 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939fa43-c88f-4e08-a9de-ae3f6d4945e0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:40.913671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939fa43-c88f-4e08-a9de-ae3f6d4945e0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:41.026849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfea154-eaaf-4005-9b61-3531106529b8 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:41.027346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfea154-eaaf-4005-9b61-3531106529b8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:41.027832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfea154-eaaf-4005-9b61-3531106529b8 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:41.032877 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1211/2396] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:11:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:11:41.048171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1fb90-8c1e-46a0-a215-ec64834d6f7c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:41.049499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1fb90-8c1e-46a0-a215-ec64834d6f7c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:41.050362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1fb90-8c1e-46a0-a215-ec64834d6f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:41.107305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b1a1fb90-8c1e-46a0-a215-ec64834d6f7c None None] MFA Rules not processed for user `b219e01934fa477fbaa053cca586f01b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:41.110472 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b1a1fb90-8c1e-46a0-a215-ec64834d6f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:41.134059 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3576562-ad9c-4186-8d7c-4678d60210f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:41.134985 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3576562-ad9c-4186-8d7c-4678d60210f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:41.135484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3576562-ad9c-4186-8d7c-4678d60210f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:41.135942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3576562-ad9c-4186-8d7c-4678d60210f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:41.136607 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3576562-ad9c-4186-8d7c-4678d60210f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:41.144363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3576562-ad9c-4186-8d7c-4678d60210f8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:41.212730 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1186/2397] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:11:40 2022] POST /identity/v3/users => generated 306 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:41.214411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3576562-ad9c-4186-8d7c-4678d60210f8 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:41.239266 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:41.259358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3576562-ad9c-4186-8d7c-4678d60210f8 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:41.278126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8cc46-abe6-499d-b0ef-a0cdb69a49a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:41.278906 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8cc46-abe6-499d-b0ef-a0cdb69a49a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:41.279232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8cc46-abe6-499d-b0ef-a0cdb69a49a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:41.279508 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8cc46-abe6-499d-b0ef-a0cdb69a49a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:41.280222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8cc46-abe6-499d-b0ef-a0cdb69a49a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:41.281903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8cc46-abe6-499d-b0ef-a0cdb69a49a9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:41.316291 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1187/2398] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:41.319732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8cc46-abe6-499d-b0ef-a0cdb69a49a9 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:41.332253 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1212/2399] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:11:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:41.342129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8cc46-abe6-499d-b0ef-a0cdb69a49a9 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:41.352020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308bd6b-c391-4fba-b01d-062f7e3f44cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:41.352654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308bd6b-c391-4fba-b01d-062f7e3f44cf admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:41.352931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308bd6b-c391-4fba-b01d-062f7e3f44cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:41.353242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308bd6b-c391-4fba-b01d-062f7e3f44cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:41.353927 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e308bd6b-c391-4fba-b01d-062f7e3f44cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:41.355691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e308bd6b-c391-4fba-b01d-062f7e3f44cf admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:41.387038 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1188/2400] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:11:41.387316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1fb90-8c1e-46a0-a215-ec64834d6f7c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:41.388867 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308bd6b-c391-4fba-b01d-062f7e3f44cf admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:41.410734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1fb90-8c1e-46a0-a215-ec64834d6f7c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:41.412060 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e308bd6b-c391-4fba-b01d-062f7e3f44cf admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:41.419030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0029632-0e5f-4f58-afb1-3be934866cdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:41.420925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0029632-0e5f-4f58-afb1-3be934866cdd service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:41.420925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0029632-0e5f-4f58-afb1-3be934866cdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:41.421522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0029632-0e5f-4f58-afb1-3be934866cdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:41.424756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61600e1-2ddf-4027-8163-a93dcf9ac27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:41.425457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61600e1-2ddf-4027-8163-a93dcf9ac27c admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:41.425805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61600e1-2ddf-4027-8163-a93dcf9ac27c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:41.427441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61600e1-2ddf-4027-8163-a93dcf9ac27c admin admin] PATH_INFO: `/v3/projects/1e5583649e1e4c6188e30de4b17fee1f/users/0f52af6ab5924b1d8834a49af0c9b7d8/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:41.443194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0029632-0e5f-4f58-afb1-3be934866cdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:41.455934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61600e1-2ddf-4027-8163-a93dcf9ac27c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e5583649e1e4c6188e30de4b17fee1f, user_id=0f52af6ab5924b1d8834a49af0c9b7d8, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:41.458458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0029632-0e5f-4f58-afb1-3be934866cdd service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:41.458725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61600e1-2ddf-4027-8163-a93dcf9ac27c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:41.484523 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:41.500933 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1189/2401] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:11:41 2022] PUT /identity/v3/projects/1e5583649e1e4c6188e30de4b17fee1f/users/0f52af6ab5924b1d8834a49af0c9b7d8/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:41.503242 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1213/2402] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:11:41.503853 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486e325-2fe7-42da-90f0-d2f44db186df None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:41.504183 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486e325-2fe7-42da-90f0-d2f44db186df None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:41.505464 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486e325-2fe7-42da-90f0-d2f44db186df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:41.573206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b486e325-2fe7-42da-90f0-d2f44db186df None None] MFA Rules not processed for user `0f52af6ab5924b1d8834a49af0c9b7d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:41.576337 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b486e325-2fe7-42da-90f0-d2f44db186df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:41.855679 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1190/2403] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:41 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:11:41.862863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0029632-0e5f-4f58-afb1-3be934866cdd service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:41.930398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0029632-0e5f-4f58-afb1-3be934866cdd service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:42.170392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1971ce-f647-4a56-97a4-a2c465aacb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:42.171038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1971ce-f647-4a56-97a4-a2c465aacb6c admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:42.171318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1971ce-f647-4a56-97a4-a2c465aacb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:42.171586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1971ce-f647-4a56-97a4-a2c465aacb6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:42.172377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1971ce-f647-4a56-97a4-a2c465aacb6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:42.184925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1971ce-f647-4a56-97a4-a2c465aacb6c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:42.255868 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1214/2404] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:11:41 2022] POST /identity/v3/projects => generated 409 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:42.261105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486e325-2fe7-42da-90f0-d2f44db186df None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:42.302982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486e325-2fe7-42da-90f0-d2f44db186df None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:42.533427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1971ce-f647-4a56-97a4-a2c465aacb6c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:42.535621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ed1971ce-f647-4a56-97a4-a2c465aacb6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:42.552163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ec20f-8b07-4a91-8132-844fe2299298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:42.566589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ec20f-8b07-4a91-8132-844fe2299298 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:42.569939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ec20f-8b07-4a91-8132-844fe2299298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:42.570453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ec20f-8b07-4a91-8132-844fe2299298 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:42.572621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ec20f-8b07-4a91-8132-844fe2299298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:42.583878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ec20f-8b07-4a91-8132-844fe2299298 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:42.656051 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1191/2405] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:11:42 2022] POST /identity/v3/users => generated 311 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:42.663964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ec20f-8b07-4a91-8132-844fe2299298 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:42.689505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ec20f-8b07-4a91-8132-844fe2299298 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:42.714197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be401acc-9e3e-4a30-903c-9e4f6be69ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:42.714490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be401acc-9e3e-4a30-903c-9e4f6be69ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:42.714952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be401acc-9e3e-4a30-903c-9e4f6be69ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:42.715212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be401acc-9e3e-4a30-903c-9e4f6be69ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:42.716655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be401acc-9e3e-4a30-903c-9e4f6be69ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:42.719362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be401acc-9e3e-4a30-903c-9e4f6be69ee9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:42.751344 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1192/2406] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:42.755577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be401acc-9e3e-4a30-903c-9e4f6be69ee9 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:42.777628 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be401acc-9e3e-4a30-903c-9e4f6be69ee9 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:42.779376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1971ce-f647-4a56-97a4-a2c465aacb6c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:42.807315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0de2be-3ff3-4a65-9a81-f175b7eebdf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:42.808475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0de2be-3ff3-4a65-9a81-f175b7eebdf9 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:42.808475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0de2be-3ff3-4a65-9a81-f175b7eebdf9 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:42.808803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0de2be-3ff3-4a65-9a81-f175b7eebdf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:42.815284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4c0de2be-3ff3-4a65-9a81-f175b7eebdf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:42.838995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e0f40-ff38-4dfa-aa64-74a4c28c4fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:42.844768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e0f40-ff38-4dfa-aa64-74a4c28c4fcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:42.847766 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e0f40-ff38-4dfa-aa64-74a4c28c4fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:42.849008 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e0f40-ff38-4dfa-aa64-74a4c28c4fcd admin admin] PATH_INFO: `/v3/projects/edee02f16b3146ba97237a4ebf1a9622/users/8847c18cb4a0446c9fa97bef15014fdb/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:42.907220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e0f40-ff38-4dfa-aa64-74a4c28c4fcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=edee02f16b3146ba97237a4ebf1a9622, user_id=8847c18cb4a0446c9fa97bef15014fdb, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:42.919794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e0f40-ff38-4dfa-aa64-74a4c28c4fcd admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:42.980781 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1193/2407] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:11:42 2022] PUT /identity/v3/projects/edee02f16b3146ba97237a4ebf1a9622/users/8847c18cb4a0446c9fa97bef15014fdb/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:11:42.987992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e0f40-ff38-4dfa-aa64-74a4c28c4fcd admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:43.041665 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:43.117885 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0de2be-3ff3-4a65-9a81-f175b7eebdf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:43.121706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0de2be-3ff3-4a65-9a81-f175b7eebdf9 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:43.179738 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1215/2408] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:43.210618 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:43.254896 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e0f40-ff38-4dfa-aa64-74a4c28c4fcd admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:43.266952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88360583-349c-4dd8-9c91-26a477c2fcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:43.267753 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88360583-349c-4dd8-9c91-26a477c2fcf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:43.268176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88360583-349c-4dd8-9c91-26a477c2fcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:43.269716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88360583-349c-4dd8-9c91-26a477c2fcf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:43.270752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88360583-349c-4dd8-9c91-26a477c2fcf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:43.280850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88360583-349c-4dd8-9c91-26a477c2fcf6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:43.354281 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1194/2409] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:43.360367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0de2be-3ff3-4a65-9a81-f175b7eebdf9 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:43.441485 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0de2be-3ff3-4a65-9a81-f175b7eebdf9 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:43.505679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3c7b3-417a-431d-824b-86ec4fff236b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:43.508694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3c7b3-417a-431d-824b-86ec4fff236b admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:43.509166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3c7b3-417a-431d-824b-86ec4fff236b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:43.509649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3c7b3-417a-431d-824b-86ec4fff236b admin admin] PATH_INFO: `/v3/projects/edee02f16b3146ba97237a4ebf1a9622/users/8847c18cb4a0446c9fa97bef15014fdb/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:43.518818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88360583-349c-4dd8-9c91-26a477c2fcf6 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:43.522754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-88360583-349c-4dd8-9c91-26a477c2fcf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:43.527417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3c7b3-417a-431d-824b-86ec4fff236b admin admin] RBAC: Authorizing `identity:create_grant(project_id=edee02f16b3146ba97237a4ebf1a9622, user_id=8847c18cb4a0446c9fa97bef15014fdb, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:43.577701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3c7b3-417a-431d-824b-86ec4fff236b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:43.657576 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1216/2410] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:11:43 2022] PUT /identity/v3/projects/edee02f16b3146ba97237a4ebf1a9622/users/8847c18cb4a0446c9fa97bef15014fdb/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:11:43.678844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8ebcf-eae5-46bf-bc12-86bf1cdc9ce9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:43.679356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8ebcf-eae5-46bf-bc12-86bf1cdc9ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:43.680095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8ebcf-eae5-46bf-bc12-86bf1cdc9ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:43.784865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88360583-349c-4dd8-9c91-26a477c2fcf6 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:43.811183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-83b8ebcf-eae5-46bf-bc12-86bf1cdc9ce9 None None] MFA Rules not processed for user `8847c18cb4a0446c9fa97bef15014fdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:43.820155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-83b8ebcf-eae5-46bf-bc12-86bf1cdc9ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:44.043730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef0ede-0011-40fa-8ed5-ffe8d03c24f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:44.045019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef0ede-0011-40fa-8ed5-ffe8d03c24f4 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:44.045537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef0ede-0011-40fa-8ed5-ffe8d03c24f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:44.046127 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef0ede-0011-40fa-8ed5-ffe8d03c24f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:44.050620 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-caef0ede-0011-40fa-8ed5-ffe8d03c24f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:44.135987 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1217/2411] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:43 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:44.305532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef0ede-0011-40fa-8ed5-ffe8d03c24f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:44.312137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef0ede-0011-40fa-8ed5-ffe8d03c24f4 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:44.382660 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1195/2412] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:43 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 866 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:45.752234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8ebcf-eae5-46bf-bc12-86bf1cdc9ce9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:45.791507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8ebcf-eae5-46bf-bc12-86bf1cdc9ce9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:45.812144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd1b7f-e6c2-4509-bc4d-0fd859481125 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:45.812900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd1b7f-e6c2-4509-bc4d-0fd859481125 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:45.815382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd1b7f-e6c2-4509-bc4d-0fd859481125 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:45.815696 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd1b7f-e6c2-4509-bc4d-0fd859481125 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:45.849245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd1b7f-e6c2-4509-bc4d-0fd859481125 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:45.854434 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd1b7f-e6c2-4509-bc4d-0fd859481125 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:45.907707 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1218/2413] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:45 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:45.980851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef0ede-0011-40fa-8ed5-ffe8d03c24f4 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:46.040795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef0ede-0011-40fa-8ed5-ffe8d03c24f4 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:46.063657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf8245-4976-4630-bafc-1ec80b880a30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:46.065400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf8245-4976-4630-bafc-1ec80b880a30 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:46.065951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf8245-4976-4630-bafc-1ec80b880a30 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:46.066515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf8245-4976-4630-bafc-1ec80b880a30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:46.092616 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:46.302739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf8245-4976-4630-bafc-1ec80b880a30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:46.305219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf8245-4976-4630-bafc-1ec80b880a30 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:46.338227 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1196/2414] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:45 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:46.794840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd1b7f-e6c2-4509-bc4d-0fd859481125 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:46.813026 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd1b7f-e6c2-4509-bc4d-0fd859481125 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:46.844587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c839d-3fd2-430d-bb4f-924f075eef3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:46.845933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c839d-3fd2-430d-bb4f-924f075eef3c service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:46.846546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c839d-3fd2-430d-bb4f-924f075eef3c service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:46.847449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c839d-3fd2-430d-bb4f-924f075eef3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:47.094956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c839d-3fd2-430d-bb4f-924f075eef3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:47.102293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c839d-3fd2-430d-bb4f-924f075eef3c service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:47.154860 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1219/2415] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:46 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:47.611965 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf8245-4976-4630-bafc-1ec80b880a30 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:47.937202 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf8245-4976-4630-bafc-1ec80b880a30 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:47.955042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587ce6c-ec2f-4b8f-b952-49d05a9e50b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:47.956226 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587ce6c-ec2f-4b8f-b952-49d05a9e50b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:47.956700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587ce6c-ec2f-4b8f-b952-49d05a9e50b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:47.957178 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587ce6c-ec2f-4b8f-b952-49d05a9e50b9 admin admin] PATH_INFO: `/v3/users/0f52af6ab5924b1d8834a49af0c9b7d8` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:47.961197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587ce6c-ec2f-4b8f-b952-49d05a9e50b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f52af6ab5924b1d8834a49af0c9b7d8)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:47.990775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587ce6c-ec2f-4b8f-b952-49d05a9e50b9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:48.165096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1587ce6c-ec2f-4b8f-b952-49d05a9e50b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f52af6ab5924b1d8834a49af0c9b7d8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:48.181895 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1587ce6c-ec2f-4b8f-b952-49d05a9e50b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f52af6ab5924b1d8834a49af0c9b7d8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:48.249865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1587ce6c-ec2f-4b8f-b952-49d05a9e50b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f52af6ab5924b1d8834a49af0c9b7d8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:48.251150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1587ce6c-ec2f-4b8f-b952-49d05a9e50b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f52af6ab5924b1d8834a49af0c9b7d8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:48.274154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1587ce6c-ec2f-4b8f-b952-49d05a9e50b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f52af6ab5924b1d8834a49af0c9b7d8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:48.294849 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1197/2416] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:11:47 2022] DELETE /identity/v3/users/0f52af6ab5924b1d8834a49af0c9b7d8 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:48.300829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf53738-89e6-4004-8c51-717b908aa91f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:48.303303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf53738-89e6-4004-8c51-717b908aa91f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:48.303917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf53738-89e6-4004-8c51-717b908aa91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:48.370203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6bf53738-89e6-4004-8c51-717b908aa91f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:48.372006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6bf53738-89e6-4004-8c51-717b908aa91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:48.453817 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:48.486761 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1220/2417] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:48.601819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587ce6c-ec2f-4b8f-b952-49d05a9e50b9 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:48.606495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1587ce6c-ec2f-4b8f-b952-49d05a9e50b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:48.726436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf53738-89e6-4004-8c51-717b908aa91f None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:48.727999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6bf53738-89e6-4004-8c51-717b908aa91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:48.755269 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf53738-89e6-4004-8c51-717b908aa91f None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:48.770038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd843a4-95ee-47da-a1d0-64552f05e765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:48.770966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd843a4-95ee-47da-a1d0-64552f05e765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:48.772245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd843a4-95ee-47da-a1d0-64552f05e765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:48.773010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd843a4-95ee-47da-a1d0-64552f05e765 admin admin] PATH_INFO: `/v3/users/2e66778890e8464f9912b5b120ba94a3` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:48.779028 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd843a4-95ee-47da-a1d0-64552f05e765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e66778890e8464f9912b5b120ba94a3)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:48.783190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd843a4-95ee-47da-a1d0-64552f05e765 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:48.794822 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:48.927039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587ce6c-ec2f-4b8f-b952-49d05a9e50b9 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:48.933868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0cd843a4-95ee-47da-a1d0-64552f05e765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e66778890e8464f9912b5b120ba94a3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:48.934751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21ac50-b5ea-454a-a32c-3fce917998ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:48.936181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21ac50-b5ea-454a-a32c-3fce917998ca service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:48.936857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21ac50-b5ea-454a-a32c-3fce917998ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:48.937517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21ac50-b5ea-454a-a32c-3fce917998ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:48.952273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0cd843a4-95ee-47da-a1d0-64552f05e765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e66778890e8464f9912b5b120ba94a3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:48.958571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21ac50-b5ea-454a-a32c-3fce917998ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:48.961673 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21ac50-b5ea-454a-a32c-3fce917998ca service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:48.997730 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1198/2418] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:49.026265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0cd843a4-95ee-47da-a1d0-64552f05e765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e66778890e8464f9912b5b120ba94a3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:49.027574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0cd843a4-95ee-47da-a1d0-64552f05e765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e66778890e8464f9912b5b120ba94a3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:49.054158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0cd843a4-95ee-47da-a1d0-64552f05e765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e66778890e8464f9912b5b120ba94a3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:49.093606 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1221/2419] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:11:48 2022] DELETE /identity/v3/users/2e66778890e8464f9912b5b120ba94a3 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:49.099012 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad076a6-159f-45a2-867f-74e01f1e735b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:49.100226 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad076a6-159f-45a2-867f-74e01f1e735b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:49.100800 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad076a6-159f-45a2-867f-74e01f1e735b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:49.155315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6ad076a6-159f-45a2-867f-74e01f1e735b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:49.161912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6ad076a6-159f-45a2-867f-74e01f1e735b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:49.309111 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1199/2420] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:49.389854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd843a4-95ee-47da-a1d0-64552f05e765 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:49.396721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0cd843a4-95ee-47da-a1d0-64552f05e765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:49.584545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd843a4-95ee-47da-a1d0-64552f05e765 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:49.590553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee4908-3785-4f6e-ab7c-ff83200efc1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:49.591859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee4908-3785-4f6e-ab7c-ff83200efc1f service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:49.592174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee4908-3785-4f6e-ab7c-ff83200efc1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:49.592468 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee4908-3785-4f6e-ab7c-ff83200efc1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:49.623980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee4908-3785-4f6e-ab7c-ff83200efc1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:49.630604 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee4908-3785-4f6e-ab7c-ff83200efc1f service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:49.652371 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1222/2421] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:11:51.854477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4362f-d78c-479b-8fd4-7e4c879aaf8f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:51.856695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4362f-d78c-479b-8fd4-7e4c879aaf8f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:51.857490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4362f-d78c-479b-8fd4-7e4c879aaf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:51.916840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee4908-3785-4f6e-ab7c-ff83200efc1f service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:51.928358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-60a4362f-d78c-479b-8fd4-7e4c879aaf8f None None] MFA Rules not processed for user `96d08a2479f847b4b06d6690f1aedb18`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:51.931225 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-60a4362f-d78c-479b-8fd4-7e4c879aaf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:51.935093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-35ee4908-3785-4f6e-ab7c-ff83200efc1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:52.015833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee4908-3785-4f6e-ab7c-ff83200efc1f service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:52.034163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffa3b9-f990-4f3e-9e2e-ccda64f980a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:52.035727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffa3b9-f990-4f3e-9e2e-ccda64f980a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:52.036074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffa3b9-f990-4f3e-9e2e-ccda64f980a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:52.036440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffa3b9-f990-4f3e-9e2e-ccda64f980a5 admin admin] PATH_INFO: `/v3/projects/1e5583649e1e4c6188e30de4b17fee1f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:52.038559 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffa3b9-f990-4f3e-9e2e-ccda64f980a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e5583649e1e4c6188e30de4b17fee1f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:52.042024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffa3b9-f990-4f3e-9e2e-ccda64f980a5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:52.167047 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1200/2422] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:51 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:52.185794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e5ffa3b9-f990-4f3e-9e2e-ccda64f980a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e5583649e1e4c6188e30de4b17fee1f', 'request_id': 'req-e5ffa3b9-f990-4f3e-9e2e-ccda64f980a5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:52.196607 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:52.206292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e5ffa3b9-f990-4f3e-9e2e-ccda64f980a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e5583649e1e4c6188e30de4b17fee1f', 'request_id': 'req-e5ffa3b9-f990-4f3e-9e2e-ccda64f980a5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:52.226784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e5ffa3b9-f990-4f3e-9e2e-ccda64f980a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e5583649e1e4c6188e30de4b17fee1f', 'request_id': 'req-e5ffa3b9-f990-4f3e-9e2e-ccda64f980a5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:52.255858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e5ffa3b9-f990-4f3e-9e2e-ccda64f980a5 admin admin] The token cache is being invalidate because project 1e5583649e1e4c6188e30de4b17fee1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:11:52.256469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e5ffa3b9-f990-4f3e-9e2e-ccda64f980a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:52.269025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e5ffa3b9-f990-4f3e-9e2e-ccda64f980a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:52.271838 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1223/2423] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:11:51 2022] DELETE /identity/v3/projects/1e5583649e1e4c6188e30de4b17fee1f => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:52.277936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4362f-d78c-479b-8fd4-7e4c879aaf8f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:52.318061 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4362f-d78c-479b-8fd4-7e4c879aaf8f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:52.387941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffa3b9-f990-4f3e-9e2e-ccda64f980a5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:52.390257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e5ffa3b9-f990-4f3e-9e2e-ccda64f980a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:52.487971 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32528132-c462-4c63-922b-537c98862573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:52.489394 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32528132-c462-4c63-922b-537c98862573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:52.490429 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32528132-c462-4c63-922b-537c98862573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:52.491610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32528132-c462-4c63-922b-537c98862573 admin admin] PATH_INFO: `/v3/users/8847c18cb4a0446c9fa97bef15014fdb` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:52.494891 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32528132-c462-4c63-922b-537c98862573 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8847c18cb4a0446c9fa97bef15014fdb)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:52.502597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32528132-c462-4c63-922b-537c98862573 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:52.552682 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:52.624757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffa3b9-f990-4f3e-9e2e-ccda64f980a5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:52.652470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62043ab-19c8-4b04-8458-a4363b6c9cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:52.653707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62043ab-19c8-4b04-8458-a4363b6c9cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:52.654286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62043ab-19c8-4b04-8458-a4363b6c9cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:52.654834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62043ab-19c8-4b04-8458-a4363b6c9cba admin admin] PATH_INFO: `/v3/projects/ba72ffc81ed54208bb16ef17583e8562` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:52.661672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62043ab-19c8-4b04-8458-a4363b6c9cba admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba72ffc81ed54208bb16ef17583e8562)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:52.665160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-32528132-c462-4c63-922b-537c98862573 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8847c18cb4a0446c9fa97bef15014fdb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:52.669587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62043ab-19c8-4b04-8458-a4363b6c9cba admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:52.697409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-32528132-c462-4c63-922b-537c98862573 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8847c18cb4a0446c9fa97bef15014fdb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:52.726500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-32528132-c462-4c63-922b-537c98862573 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8847c18cb4a0446c9fa97bef15014fdb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:52.727689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-32528132-c462-4c63-922b-537c98862573 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8847c18cb4a0446c9fa97bef15014fdb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:52.744954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-32528132-c462-4c63-922b-537c98862573 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8847c18cb4a0446c9fa97bef15014fdb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:52.759086 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1201/2424] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:11:52 2022] DELETE /identity/v3/users/8847c18cb4a0446c9fa97bef15014fdb => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:52.780896 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f62043ab-19c8-4b04-8458-a4363b6c9cba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba72ffc81ed54208bb16ef17583e8562', 'request_id': 'req-f62043ab-19c8-4b04-8458-a4363b6c9cba'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:52.793286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f62043ab-19c8-4b04-8458-a4363b6c9cba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba72ffc81ed54208bb16ef17583e8562', 'request_id': 'req-f62043ab-19c8-4b04-8458-a4363b6c9cba'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:52.802918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f62043ab-19c8-4b04-8458-a4363b6c9cba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba72ffc81ed54208bb16ef17583e8562', 'request_id': 'req-f62043ab-19c8-4b04-8458-a4363b6c9cba'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:52.840273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f62043ab-19c8-4b04-8458-a4363b6c9cba admin admin] The token cache is being invalidate because project ba72ffc81ed54208bb16ef17583e8562 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:11:52.840673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f62043ab-19c8-4b04-8458-a4363b6c9cba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:52.841588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f62043ab-19c8-4b04-8458-a4363b6c9cba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:52.843719 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1224/2425] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:11:52 2022] DELETE /identity/v3/projects/ba72ffc81ed54208bb16ef17583e8562 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:52.857340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32528132-c462-4c63-922b-537c98862573 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:52.859266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-32528132-c462-4c63-922b-537c98862573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:53.037676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32528132-c462-4c63-922b-537c98862573 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:53.048625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840005f-ebda-4902-b8dd-4c9c6e545476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:53.050052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840005f-ebda-4902-b8dd-4c9c6e545476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:53.051985 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840005f-ebda-4902-b8dd-4c9c6e545476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:53.051985 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840005f-ebda-4902-b8dd-4c9c6e545476 admin admin] PATH_INFO: `/v3/users/7773115ae92a4b7b9bee60a87457c572` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:53.054306 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d840005f-ebda-4902-b8dd-4c9c6e545476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7773115ae92a4b7b9bee60a87457c572)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:53.059280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d840005f-ebda-4902-b8dd-4c9c6e545476 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:53.173319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d840005f-ebda-4902-b8dd-4c9c6e545476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7773115ae92a4b7b9bee60a87457c572'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:53.207250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d840005f-ebda-4902-b8dd-4c9c6e545476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7773115ae92a4b7b9bee60a87457c572'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:53.260807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d840005f-ebda-4902-b8dd-4c9c6e545476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7773115ae92a4b7b9bee60a87457c572'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:53.268996 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d840005f-ebda-4902-b8dd-4c9c6e545476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7773115ae92a4b7b9bee60a87457c572'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:53.308799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d840005f-ebda-4902-b8dd-4c9c6e545476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7773115ae92a4b7b9bee60a87457c572'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:53.338688 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1202/2426] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:11:52 2022] DELETE /identity/v3/users/7773115ae92a4b7b9bee60a87457c572 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:11:53.986660 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62043ab-19c8-4b04-8458-a4363b6c9cba admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:53.996133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f62043ab-19c8-4b04-8458-a4363b6c9cba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:54.332502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62043ab-19c8-4b04-8458-a4363b6c9cba admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:54.365793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840005f-ebda-4902-b8dd-4c9c6e545476 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:54.367380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d840005f-ebda-4902-b8dd-4c9c6e545476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:54.398531 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:54.400496 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:54.525904 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840005f-ebda-4902-b8dd-4c9c6e545476 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:54.539428 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d1da5-5435-4e58-8951-6910cebd72ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:54.542051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d1da5-5435-4e58-8951-6910cebd72ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:54.542668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d1da5-5435-4e58-8951-6910cebd72ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:54.543222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d1da5-5435-4e58-8951-6910cebd72ab admin admin] PATH_INFO: `/v3/projects/d914ab3076e844818aadc1a1314ec043` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:54.545660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d1da5-5435-4e58-8951-6910cebd72ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=d914ab3076e844818aadc1a1314ec043)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:54.554397 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d1da5-5435-4e58-8951-6910cebd72ab admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:54.588298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac6113-f555-453a-9b1d-0218323f9b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:54.589489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac6113-f555-453a-9b1d-0218323f9b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:54.595765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac6113-f555-453a-9b1d-0218323f9b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:54.596333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac6113-f555-453a-9b1d-0218323f9b0b admin admin] PATH_INFO: `/v3/projects/edee02f16b3146ba97237a4ebf1a9622` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:54.601179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac6113-f555-453a-9b1d-0218323f9b0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=edee02f16b3146ba97237a4ebf1a9622)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:54.612405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac6113-f555-453a-9b1d-0218323f9b0b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:54.692855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c81d1da5-5435-4e58-8951-6910cebd72ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd914ab3076e844818aadc1a1314ec043', 'request_id': 'req-c81d1da5-5435-4e58-8951-6910cebd72ab'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:54.706309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c81d1da5-5435-4e58-8951-6910cebd72ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd914ab3076e844818aadc1a1314ec043', 'request_id': 'req-c81d1da5-5435-4e58-8951-6910cebd72ab'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:54.719145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c81d1da5-5435-4e58-8951-6910cebd72ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd914ab3076e844818aadc1a1314ec043', 'request_id': 'req-c81d1da5-5435-4e58-8951-6910cebd72ab'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:54.765105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c81d1da5-5435-4e58-8951-6910cebd72ab admin admin] The token cache is being invalidate because project d914ab3076e844818aadc1a1314ec043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:11:54.765869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c81d1da5-5435-4e58-8951-6910cebd72ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:54.769788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c81d1da5-5435-4e58-8951-6910cebd72ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:54.774689 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1203/2427] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:11:54 2022] DELETE /identity/v3/projects/d914ab3076e844818aadc1a1314ec043 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:11:54.784088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09664360-9d99-4088-a599-882e9b281112 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:54.786041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09664360-9d99-4088-a599-882e9b281112 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:54.788159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09664360-9d99-4088-a599-882e9b281112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:54.827612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-09664360-9d99-4088-a599-882e9b281112 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:54.831459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-09664360-9d99-4088-a599-882e9b281112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:54.871352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-21ac6113-f555-453a-9b1d-0218323f9b0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edee02f16b3146ba97237a4ebf1a9622', 'request_id': 'req-21ac6113-f555-453a-9b1d-0218323f9b0b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:54.891292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-21ac6113-f555-453a-9b1d-0218323f9b0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edee02f16b3146ba97237a4ebf1a9622', 'request_id': 'req-21ac6113-f555-453a-9b1d-0218323f9b0b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:54.915558 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-21ac6113-f555-453a-9b1d-0218323f9b0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edee02f16b3146ba97237a4ebf1a9622', 'request_id': 'req-21ac6113-f555-453a-9b1d-0218323f9b0b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:54.973341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-21ac6113-f555-453a-9b1d-0218323f9b0b admin admin] The token cache is being invalidate because project edee02f16b3146ba97237a4ebf1a9622 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:11:54.973341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-21ac6113-f555-453a-9b1d-0218323f9b0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:54.975031 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-21ac6113-f555-453a-9b1d-0218323f9b0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:11:54.979969 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1225/2428] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:11:53 2022] DELETE /identity/v3/projects/edee02f16b3146ba97237a4ebf1a9622 => generated 0 bytes in 994 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:54.986225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b647c9-b047-4238-b232-b397eb098b26 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:54.987107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b647c9-b047-4238-b232-b397eb098b26 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:54.987780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b647c9-b047-4238-b232-b397eb098b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:54.996511 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1204/2429] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:55.014975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004a9cc-eb63-45d8-878b-9ccea1da27e9 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:55.015455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004a9cc-eb63-45d8-878b-9ccea1da27e9 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:55.015943 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004a9cc-eb63-45d8-878b-9ccea1da27e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:55.056731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-04b647c9-b047-4238-b232-b397eb098b26 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:55.058129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-04b647c9-b047-4238-b232-b397eb098b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:55.081622 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c004a9cc-eb63-45d8-878b-9ccea1da27e9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:55.083499 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1226/2430] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:55.093968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6533268-e222-42a4-ab61-4fce80ef1cd9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:55.094444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6533268-e222-42a4-ab61-4fce80ef1cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:55.094968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c004a9cc-eb63-45d8-878b-9ccea1da27e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:55.098097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6533268-e222-42a4-ab61-4fce80ef1cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:55.133565 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1205/2431] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:11:55.135376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004a9cc-eb63-45d8-878b-9ccea1da27e9 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:55.170411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004a9cc-eb63-45d8-878b-9ccea1da27e9 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:55.174505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a6533268-e222-42a4-ab61-4fce80ef1cd9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:55.178491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a6533268-e222-42a4-ab61-4fce80ef1cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:55.188881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16b7a1-abdc-4ef4-8fb3-c05774f0d783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:55.189960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16b7a1-abdc-4ef4-8fb3-c05774f0d783 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:55.190866 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16b7a1-abdc-4ef4-8fb3-c05774f0d783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:55.191425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16b7a1-abdc-4ef4-8fb3-c05774f0d783 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:55.196276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16b7a1-abdc-4ef4-8fb3-c05774f0d783 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:11:55.196605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16b7a1-abdc-4ef4-8fb3-c05774f0d783 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:55.201269 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1227/2432] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:55.206051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16b7a1-abdc-4ef4-8fb3-c05774f0d783 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:55.208668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6533268-e222-42a4-ab61-4fce80ef1cd9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:55.240517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6533268-e222-42a4-ab61-4fce80ef1cd9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:55.252488 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1206/2433] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:11:55.253896 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16b7a1-abdc-4ef4-8fb3-c05774f0d783 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:55.265186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff552aa5-4129-4bb1-af10-0f292f807ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:55.265837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff552aa5-4129-4bb1-af10-0f292f807ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:55.266111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff552aa5-4129-4bb1-af10-0f292f807ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:55.267983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff552aa5-4129-4bb1-af10-0f292f807ae4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:55.269417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff552aa5-4129-4bb1-af10-0f292f807ae4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:11:55.273742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16b7a1-abdc-4ef4-8fb3-c05774f0d783 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:55.275102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff552aa5-4129-4bb1-af10-0f292f807ae4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:55.278731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff552aa5-4129-4bb1-af10-0f292f807ae4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:55.302962 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c57bd8-bb37-4dc9-879c-5a1d02daea6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:55.304006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c57bd8-bb37-4dc9-879c-5a1d02daea6b admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:55.304478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c57bd8-bb37-4dc9-879c-5a1d02daea6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:55.304947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c57bd8-bb37-4dc9-879c-5a1d02daea6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:55.307361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c57bd8-bb37-4dc9-879c-5a1d02daea6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:55.313975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c57bd8-bb37-4dc9-879c-5a1d02daea6b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:55.331155 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1228/2434] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:11:55.338546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff552aa5-4129-4bb1-af10-0f292f807ae4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:55.358284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff552aa5-4129-4bb1-af10-0f292f807ae4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:55.367647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbc164-39cf-4296-8700-2fa29d338957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:55.369023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbc164-39cf-4296-8700-2fa29d338957 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:55.370718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbc164-39cf-4296-8700-2fa29d338957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:55.371517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbc164-39cf-4296-8700-2fa29d338957 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:55.372881 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edbc164-39cf-4296-8700-2fa29d338957 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:55.379207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edbc164-39cf-4296-8700-2fa29d338957 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:55.436443 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1207/2435] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:11:55 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:11:55.436443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c57bd8-bb37-4dc9-879c-5a1d02daea6b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:55.444873 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:55.496293 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1229/2436] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:11:55 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:55.500684 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbc164-39cf-4296-8700-2fa29d338957 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:55.734898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbc164-39cf-4296-8700-2fa29d338957 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:55.739107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c57bd8-bb37-4dc9-879c-5a1d02daea6b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:55.745786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99418c3e-6b9b-48ed-91e2-ec049fdd29b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:55.747173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99418c3e-6b9b-48ed-91e2-ec049fdd29b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:55.748048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99418c3e-6b9b-48ed-91e2-ec049fdd29b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:55.748884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99418c3e-6b9b-48ed-91e2-ec049fdd29b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:55.750585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99418c3e-6b9b-48ed-91e2-ec049fdd29b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:55.752219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90c36d-17f1-4713-aa49-e2f439fb86a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:55.753338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90c36d-17f1-4713-aa49-e2f439fb86a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:55.754253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90c36d-17f1-4713-aa49-e2f439fb86a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:55.754631 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90c36d-17f1-4713-aa49-e2f439fb86a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:55.755385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb90c36d-17f1-4713-aa49-e2f439fb86a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:55.756970 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99418c3e-6b9b-48ed-91e2-ec049fdd29b6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:55.757964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb90c36d-17f1-4713-aa49-e2f439fb86a5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:55.769733 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:55.795991 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1230/2437] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:11:55 2022] POST /identity/v3/users => generated 287 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:55.814211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90c36d-17f1-4713-aa49-e2f439fb86a5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:55.821838 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1208/2438] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:11:55 2022] POST /identity/v3/users => generated 293 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:11:55.830593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99418c3e-6b9b-48ed-91e2-ec049fdd29b6 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:55.851006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90c36d-17f1-4713-aa49-e2f439fb86a5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:55.871284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93087b23-87a2-4d6a-8813-67845d8962d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:55.873162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93087b23-87a2-4d6a-8813-67845d8962d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:55.873603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93087b23-87a2-4d6a-8813-67845d8962d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:55.873991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93087b23-87a2-4d6a-8813-67845d8962d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:55.876061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93087b23-87a2-4d6a-8813-67845d8962d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:55.876268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99418c3e-6b9b-48ed-91e2-ec049fdd29b6 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:55.877931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93087b23-87a2-4d6a-8813-67845d8962d6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:55.889191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5c3df-9b6f-40c3-af44-4040e3e49fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:55.890240 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5c3df-9b6f-40c3-af44-4040e3e49fda admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:55.890712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5c3df-9b6f-40c3-af44-4040e3e49fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:55.891197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5c3df-9b6f-40c3-af44-4040e3e49fda admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:55.893031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5c3df-9b6f-40c3-af44-4040e3e49fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:55.896345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5c3df-9b6f-40c3-af44-4040e3e49fda admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:55.916995 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1231/2439] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:55.920365 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93087b23-87a2-4d6a-8813-67845d8962d6 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:55.930960 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1209/2440] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:55.935319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5c3df-9b6f-40c3-af44-4040e3e49fda admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:55.954111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93087b23-87a2-4d6a-8813-67845d8962d6 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:55.963636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5c3df-9b6f-40c3-af44-4040e3e49fda admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:55.968226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce941cf-96c7-4a89-bbd9-16c8bab1ce50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:55.969109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce941cf-96c7-4a89-bbd9-16c8bab1ce50 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:55.969435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce941cf-96c7-4a89-bbd9-16c8bab1ce50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:55.969715 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce941cf-96c7-4a89-bbd9-16c8bab1ce50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:55.971827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce941cf-96c7-4a89-bbd9-16c8bab1ce50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:55.974206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce941cf-96c7-4a89-bbd9-16c8bab1ce50 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:56.004736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59de5c-2fda-4511-95f4-fa4750b5562b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:56.006127 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59de5c-2fda-4511-95f4-fa4750b5562b admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:56.006707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59de5c-2fda-4511-95f4-fa4750b5562b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:56.007282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59de5c-2fda-4511-95f4-fa4750b5562b admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:56.010148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59de5c-2fda-4511-95f4-fa4750b5562b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:56.014576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59de5c-2fda-4511-95f4-fa4750b5562b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:56.042607 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1210/2441] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:11:56.049025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59de5c-2fda-4511-95f4-fa4750b5562b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:56.077089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59de5c-2fda-4511-95f4-fa4750b5562b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:56.089060 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffba93f-42ab-4401-8381-aec6f8cacaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:56.090216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffba93f-42ab-4401-8381-aec6f8cacaab admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:56.090698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffba93f-42ab-4401-8381-aec6f8cacaab admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:56.091449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffba93f-42ab-4401-8381-aec6f8cacaab admin admin] PATH_INFO: `/v3/projects/6a7279db9d4f497b8430fd45280b5da4/users/cc0200a0753e46399d0b212c665aebce/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:56.125398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffba93f-42ab-4401-8381-aec6f8cacaab admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a7279db9d4f497b8430fd45280b5da4, user_id=cc0200a0753e46399d0b212c665aebce, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:56.131006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffba93f-42ab-4401-8381-aec6f8cacaab admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:56.150968 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1232/2442] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:56.157209 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce941cf-96c7-4a89-bbd9-16c8bab1ce50 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:56.171597 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1211/2443] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:11:56 2022] PUT /identity/v3/projects/6a7279db9d4f497b8430fd45280b5da4/users/cc0200a0753e46399d0b212c665aebce/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:11:56.172054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce941cf-96c7-4a89-bbd9-16c8bab1ce50 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:56.191953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee935ed3-ea0a-490d-ba03-f3a056695c8f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:56.200067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee935ed3-ea0a-490d-ba03-f3a056695c8f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:56.200911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee935ed3-ea0a-490d-ba03-f3a056695c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:56.291709 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843601f-5949-4a89-af39-fc75df5cb005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:56.292335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843601f-5949-4a89-af39-fc75df5cb005 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:56.293090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843601f-5949-4a89-af39-fc75df5cb005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:56.293889 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843601f-5949-4a89-af39-fc75df5cb005 admin admin] PATH_INFO: `/v3/projects/4651068d5dc542b3aee65535e104867b/users/035b2ee8ebe04592a93b2fb839b6e29c/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:56.314818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ee935ed3-ea0a-490d-ba03-f3a056695c8f None None] MFA Rules not processed for user `cc0200a0753e46399d0b212c665aebce`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:56.318462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ee935ed3-ea0a-490d-ba03-f3a056695c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:56.337980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843601f-5949-4a89-af39-fc75df5cb005 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4651068d5dc542b3aee65535e104867b, user_id=035b2ee8ebe04592a93b2fb839b6e29c, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:56.344140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843601f-5949-4a89-af39-fc75df5cb005 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:56.385986 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1233/2444] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:11:56 2022] PUT /identity/v3/projects/4651068d5dc542b3aee65535e104867b/users/035b2ee8ebe04592a93b2fb839b6e29c/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:11:56.403009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ede2ef-893e-4ec9-ae70-68e470c8fb7b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:56.403402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ede2ef-893e-4ec9-ae70-68e470c8fb7b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:56.403578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ede2ef-893e-4ec9-ae70-68e470c8fb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:56.496370 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-83ede2ef-893e-4ec9-ae70-68e470c8fb7b None None] MFA Rules not processed for user `035b2ee8ebe04592a93b2fb839b6e29c`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:56.509052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-83ede2ef-893e-4ec9-ae70-68e470c8fb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:56.571222 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1212/2445] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:11:56.573023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee935ed3-ea0a-490d-ba03-f3a056695c8f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:56.590768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee935ed3-ea0a-490d-ba03-f3a056695c8f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:56.648238 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:56.733949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350122d-55c7-42d0-9356-e8cbfbfde617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:56.734962 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350122d-55c7-42d0-9356-e8cbfbfde617 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:56.735440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350122d-55c7-42d0-9356-e8cbfbfde617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:56.735973 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350122d-55c7-42d0-9356-e8cbfbfde617 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:56.740939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5350122d-55c7-42d0-9356-e8cbfbfde617 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:56.771222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5350122d-55c7-42d0-9356-e8cbfbfde617 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:56.867104 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1234/2446] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:56.874608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ede2ef-893e-4ec9-ae70-68e470c8fb7b None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:56.892186 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1213/2447] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:11:56 2022] POST /identity/v3/projects => generated 385 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:56.893785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350122d-55c7-42d0-9356-e8cbfbfde617 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:56.921877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ede2ef-893e-4ec9-ae70-68e470c8fb7b None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:57.085415 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:57.142107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350122d-55c7-42d0-9356-e8cbfbfde617 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:57.156079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe7b20-31f2-4183-9d34-43e224ff95e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:57.157212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe7b20-31f2-4183-9d34-43e224ff95e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:57.157718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe7b20-31f2-4183-9d34-43e224ff95e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:57.158179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe7b20-31f2-4183-9d34-43e224ff95e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:57.159354 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe7b20-31f2-4183-9d34-43e224ff95e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:57.163371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe7b20-31f2-4183-9d34-43e224ff95e0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:57.168832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c6052-ed05-420a-a83a-3160a10dc93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:57.169918 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c6052-ed05-420a-a83a-3160a10dc93b admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:57.170410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c6052-ed05-420a-a83a-3160a10dc93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:57.170902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c6052-ed05-420a-a83a-3160a10dc93b admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:57.172150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c6052-ed05-420a-a83a-3160a10dc93b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:57.176529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c6052-ed05-420a-a83a-3160a10dc93b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:57.241019 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1214/2448] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:11:56 2022] POST /identity/v3/users => generated 299 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:57.251523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c6052-ed05-420a-a83a-3160a10dc93b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:57.261254 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1235/2449] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:11:56 2022] POST /identity/v3/projects => generated 373 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:11:57.268561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe7b20-31f2-4183-9d34-43e224ff95e0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:57.286007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c6052-ed05-420a-a83a-3160a10dc93b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:57.508711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cef8fb-d42b-4499-8706-43eb28317d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:57.510149 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cef8fb-d42b-4499-8706-43eb28317d4b admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:57.510693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cef8fb-d42b-4499-8706-43eb28317d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:57.511283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cef8fb-d42b-4499-8706-43eb28317d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:57.515218 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cef8fb-d42b-4499-8706-43eb28317d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:57.520521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cef8fb-d42b-4499-8706-43eb28317d4b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:57.548956 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1215/2450] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:11:57.557926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cef8fb-d42b-4499-8706-43eb28317d4b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:57.578815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe7b20-31f2-4183-9d34-43e224ff95e0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:57.598782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae1a41-6913-44bc-82a1-838ec2656eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:57.603070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae1a41-6913-44bc-82a1-838ec2656eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:57.604844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae1a41-6913-44bc-82a1-838ec2656eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:57.605668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae1a41-6913-44bc-82a1-838ec2656eb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:57.607141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cef8fb-d42b-4499-8706-43eb28317d4b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:57.610127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae1a41-6913-44bc-82a1-838ec2656eb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:57.615104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae1a41-6913-44bc-82a1-838ec2656eb3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:57.651952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c7a7b-68a6-4a74-a338-afe5d4f23f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:57.656503 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c7a7b-68a6-4a74-a338-afe5d4f23f86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:57.657297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c7a7b-68a6-4a74-a338-afe5d4f23f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:57.657850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c7a7b-68a6-4a74-a338-afe5d4f23f86 admin admin] PATH_INFO: `/v3/projects/eb582d220421404ba7f60af09d58fe62/users/423b935e72ae42d9a49b9b8390ab20d6/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:57.694370 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1236/2451] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:11:57 2022] POST /identity/v3/users => generated 293 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:11:57.699611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae1a41-6913-44bc-82a1-838ec2656eb3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:57.719437 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c7a7b-68a6-4a74-a338-afe5d4f23f86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb582d220421404ba7f60af09d58fe62, user_id=423b935e72ae42d9a49b9b8390ab20d6, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:57.729554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c7a7b-68a6-4a74-a338-afe5d4f23f86 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:57.754862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae1a41-6913-44bc-82a1-838ec2656eb3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:57.783222 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1216/2452] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:11:57 2022] PUT /identity/v3/projects/eb582d220421404ba7f60af09d58fe62/users/423b935e72ae42d9a49b9b8390ab20d6/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:57.799779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c7a7b-68a6-4a74-a338-afe5d4f23f86 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:57.913003 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:58.001881 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5daff-2be9-42a0-b0c1-e1b962a72e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:58.002551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5daff-2be9-42a0-b0c1-e1b962a72e49 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:58.004579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5daff-2be9-42a0-b0c1-e1b962a72e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:58.004579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5daff-2be9-42a0-b0c1-e1b962a72e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:58.005408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5daff-2be9-42a0-b0c1-e1b962a72e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:58.008632 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5daff-2be9-42a0-b0c1-e1b962a72e49 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:58.028159 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1237/2453] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:58.035540 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5daff-2be9-42a0-b0c1-e1b962a72e49 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:58.069019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5daff-2be9-42a0-b0c1-e1b962a72e49 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:58.073826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c7a7b-68a6-4a74-a338-afe5d4f23f86 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:58.080811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a084dd-dd4c-4e62-b5a3-f0c9e363df41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:58.082917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a084dd-dd4c-4e62-b5a3-f0c9e363df41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:58.083552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a084dd-dd4c-4e62-b5a3-f0c9e363df41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:58.084503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a084dd-dd4c-4e62-b5a3-f0c9e363df41 admin admin] PATH_INFO: `/v3/projects/c3e5a37bd4a8488181fa6e2963c063e5/users/4f00d6a5ac1b4ec7ba557be767778e3f/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:58.088043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e42303-f053-4d59-87ac-82d3d4015477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:58.088992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e42303-f053-4d59-87ac-82d3d4015477 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:58.091004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e42303-f053-4d59-87ac-82d3d4015477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:58.092308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e42303-f053-4d59-87ac-82d3d4015477 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:58.094638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e42303-f053-4d59-87ac-82d3d4015477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:58.105780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e42303-f053-4d59-87ac-82d3d4015477 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:58.180354 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a084dd-dd4c-4e62-b5a3-f0c9e363df41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3e5a37bd4a8488181fa6e2963c063e5, user_id=4f00d6a5ac1b4ec7ba557be767778e3f, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:58.187177 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a084dd-dd4c-4e62-b5a3-f0c9e363df41 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:58.193102 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1217/2454] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:58.205137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e42303-f053-4d59-87ac-82d3d4015477 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:58.231027 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1238/2455] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:11:58 2022] PUT /identity/v3/projects/c3e5a37bd4a8488181fa6e2963c063e5/users/4f00d6a5ac1b4ec7ba557be767778e3f/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:58.234272 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a084dd-dd4c-4e62-b5a3-f0c9e363df41 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:58.254755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e42303-f053-4d59-87ac-82d3d4015477 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:58.360110 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:58.428582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a084dd-dd4c-4e62-b5a3-f0c9e363df41 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:58.445396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafaf0da-f5d3-4258-9d4d-a06fcd72251b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:58.446583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafaf0da-f5d3-4258-9d4d-a06fcd72251b admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:58.448514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafaf0da-f5d3-4258-9d4d-a06fcd72251b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:58.449054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafaf0da-f5d3-4258-9d4d-a06fcd72251b admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:58.450068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafaf0da-f5d3-4258-9d4d-a06fcd72251b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:58.452597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafaf0da-f5d3-4258-9d4d-a06fcd72251b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:58.470995 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1239/2456] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:11:58.480115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafaf0da-f5d3-4258-9d4d-a06fcd72251b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:58.514716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad316d85-f5ef-47bc-baca-0bea04ebf6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:58.514716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad316d85-f5ef-47bc-baca-0bea04ebf6f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:58.514716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad316d85-f5ef-47bc-baca-0bea04ebf6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:58.514716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad316d85-f5ef-47bc-baca-0bea04ebf6f1 admin admin] PATH_INFO: `/v3/projects/eb582d220421404ba7f60af09d58fe62/users/423b935e72ae42d9a49b9b8390ab20d6/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:58.523533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafaf0da-f5d3-4258-9d4d-a06fcd72251b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:58.527864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad316d85-f5ef-47bc-baca-0bea04ebf6f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb582d220421404ba7f60af09d58fe62, user_id=423b935e72ae42d9a49b9b8390ab20d6, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:58.533141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad316d85-f5ef-47bc-baca-0bea04ebf6f1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:58.553708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df011c4d-1620-4030-a868-48a65da6007d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:58.554863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df011c4d-1620-4030-a868-48a65da6007d admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:58.559506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df011c4d-1620-4030-a868-48a65da6007d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:58.559506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df011c4d-1620-4030-a868-48a65da6007d admin admin] PATH_INFO: `/v3/projects/c3e5a37bd4a8488181fa6e2963c063e5/users/4f00d6a5ac1b4ec7ba557be767778e3f/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:58.568358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df011c4d-1620-4030-a868-48a65da6007d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3e5a37bd4a8488181fa6e2963c063e5, user_id=4f00d6a5ac1b4ec7ba557be767778e3f, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:58.572886 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df011c4d-1620-4030-a868-48a65da6007d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:58.578732 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1218/2457] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:11:58 2022] PUT /identity/v3/projects/eb582d220421404ba7f60af09d58fe62/users/423b935e72ae42d9a49b9b8390ab20d6/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:11:58.598333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34df69-9e64-4440-883d-2375134354af None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:58.598976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34df69-9e64-4440-883d-2375134354af None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:58.599610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34df69-9e64-4440-883d-2375134354af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:58.602185 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1240/2458] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:11:58 2022] PUT /identity/v3/projects/c3e5a37bd4a8488181fa6e2963c063e5/users/4f00d6a5ac1b4ec7ba557be767778e3f/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:11:58.619119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ab565-8e68-4edc-9cf6-2005d09cbe3a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:58.619711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ab565-8e68-4edc-9cf6-2005d09cbe3a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:58.620173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ab565-8e68-4edc-9cf6-2005d09cbe3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:58.689510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-964ab565-8e68-4edc-9cf6-2005d09cbe3a None None] MFA Rules not processed for user `4f00d6a5ac1b4ec7ba557be767778e3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:58.692703 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-964ab565-8e68-4edc-9cf6-2005d09cbe3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:58.745214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1f34df69-9e64-4440-883d-2375134354af None None] MFA Rules not processed for user `423b935e72ae42d9a49b9b8390ab20d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:58.749306 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1f34df69-9e64-4440-883d-2375134354af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:58.868486 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1241/2459] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:58.885491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ab565-8e68-4edc-9cf6-2005d09cbe3a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:58.907644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ab565-8e68-4edc-9cf6-2005d09cbe3a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:58.930105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd3bfc-ef8d-4762-8c83-734bc62aa6b9 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f00d6a5ac1b4ec7ba557be767778e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3e5a37bd4a8488181fa6e2963c063e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:58.933267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd3bfc-ef8d-4762-8c83-734bc62aa6b9 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:58.934372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd3bfc-ef8d-4762-8c83-734bc62aa6b9 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:58.935761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd3bfc-ef8d-4762-8c83-734bc62aa6b9 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:58.937423 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd3bfc-ef8d-4762-8c83-734bc62aa6b9 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:11:58.943066 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd3bfc-ef8d-4762-8c83-734bc62aa6b9 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:58.949670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd3bfc-ef8d-4762-8c83-734bc62aa6b9 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:58.995093 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1219/2460] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:58 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:11:59.005414 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1242/2461] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:11:59.011410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d70cd1-7afe-461b-a3f7-0a178364b921 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:59.011676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d70cd1-7afe-461b-a3f7-0a178364b921 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:59.012187 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d70cd1-7afe-461b-a3f7-0a178364b921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:59.012773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd3bfc-ef8d-4762-8c83-734bc62aa6b9 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:59.036336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd3bfc-ef8d-4762-8c83-734bc62aa6b9 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:59.046877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97659d44-2312-4288-a2b0-3e38e6f488c9 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f00d6a5ac1b4ec7ba557be767778e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3e5a37bd4a8488181fa6e2963c063e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:59.047623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-23d70cd1-7afe-461b-a3f7-0a178364b921 None None] MFA Rules not processed for user `cc0200a0753e46399d0b212c665aebce`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:11:59.049190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97659d44-2312-4288-a2b0-3e38e6f488c9 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:59.049405 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-23d70cd1-7afe-461b-a3f7-0a178364b921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:59.050735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97659d44-2312-4288-a2b0-3e38e6f488c9 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:59.051585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97659d44-2312-4288-a2b0-3e38e6f488c9 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:59.054694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97659d44-2312-4288-a2b0-3e38e6f488c9 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:59.062800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97659d44-2312-4288-a2b0-3e38e6f488c9 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:59.139961 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:59.165667 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1243/2462] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:11:59 2022] POST /identity/v3/projects => generated 369 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:11:59.178288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97659d44-2312-4288-a2b0-3e38e6f488c9 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:59.199503 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1220/2463] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:11:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:11:59.334973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97659d44-2312-4288-a2b0-3e38e6f488c9 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:59.343856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0c741-1c25-4c05-9cc7-4beb3fae3caa tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f00d6a5ac1b4ec7ba557be767778e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3e5a37bd4a8488181fa6e2963c063e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:59.345112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0c741-1c25-4c05-9cc7-4beb3fae3caa tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:59.345680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0c741-1c25-4c05-9cc7-4beb3fae3caa tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:59.346245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0c741-1c25-4c05-9cc7-4beb3fae3caa tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:59.348739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0c741-1c25-4c05-9cc7-4beb3fae3caa tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:11:59.348972 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0c741-1c25-4c05-9cc7-4beb3fae3caa tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:11:59.352156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0c741-1c25-4c05-9cc7-4beb3fae3caa tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:11:59.356919 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:11:59.371534 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1244/2464] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:11:59.526541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d70cd1-7afe-461b-a3f7-0a178364b921 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:11:59.529266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-23d70cd1-7afe-461b-a3f7-0a178364b921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:11:59.661092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d70cd1-7afe-461b-a3f7-0a178364b921 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:11:59.813251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a628c-1d8d-4c8e-afae-c47b86f1e306 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:11:59.818266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a628c-1d8d-4c8e-afae-c47b86f1e306 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:59.820175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a628c-1d8d-4c8e-afae-c47b86f1e306 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:59.821357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a628c-1d8d-4c8e-afae-c47b86f1e306 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:59.841577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d890c-5ac9-4d5a-8b65-5e5a6f129934 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:59.842023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d890c-5ac9-4d5a-8b65-5e5a6f129934 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:59.842431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d890c-5ac9-4d5a-8b65-5e5a6f129934 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:11:59.844101 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1245/2465] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 01:11:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:11:59.931462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c42210-6a8d-4841-b3d4-392eb448c6c6 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:11:59.934095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c42210-6a8d-4841-b3d4-392eb448c6c6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:11:59.934095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c42210-6a8d-4841-b3d4-392eb448c6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:00.031061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a5c42210-6a8d-4841-b3d4-392eb448c6c6 None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:12:00.033995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a5c42210-6a8d-4841-b3d4-392eb448c6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:00.034089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a628c-1d8d-4c8e-afae-c47b86f1e306 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:00.038535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a628c-1d8d-4c8e-afae-c47b86f1e306 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:00.065280 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1221/2466] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:11:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:12:00.098921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a628c-1d8d-4c8e-afae-c47b86f1e306 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:00.109102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f24a628c-1d8d-4c8e-afae-c47b86f1e306 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:00.187913 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a628c-1d8d-4c8e-afae-c47b86f1e306 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:00.215331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a621b2b-8b8e-4fa1-8e9e-37885fdd07a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:00.219206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a621b2b-8b8e-4fa1-8e9e-37885fdd07a9 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:00.219541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a621b2b-8b8e-4fa1-8e9e-37885fdd07a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:00.219926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a621b2b-8b8e-4fa1-8e9e-37885fdd07a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:00.269887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a621b2b-8b8e-4fa1-8e9e-37885fdd07a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:00.283950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a621b2b-8b8e-4fa1-8e9e-37885fdd07a9 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:00.308729 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1246/2467] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 01:11:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:12:00.310689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c42210-6a8d-4841-b3d4-392eb448c6c6 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:00.312966 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1222/2468] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:12:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:12:00.313909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a5c42210-6a8d-4841-b3d4-392eb448c6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:00.342672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825dc8f-2e39-4268-a681-c81f0644a0e3 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:00.342983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825dc8f-2e39-4268-a681-c81f0644a0e3 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:00.344917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825dc8f-2e39-4268-a681-c81f0644a0e3 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:00.349160 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1223/2469] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:12:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:12:00.364066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825dc8f-2e39-4268-a681-c81f0644a0e3 None None] Authenticating service token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:12:00.382562 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:00.393583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825dc8f-2e39-4268-a681-c81f0644a0e3 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:00.409377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825dc8f-2e39-4268-a681-c81f0644a0e3 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:00.417828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b152a9c-dd63-47f8-bb9c-36967c4b40dc tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f00d6a5ac1b4ec7ba557be767778e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3e5a37bd4a8488181fa6e2963c063e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:00.418784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b152a9c-dd63-47f8-bb9c-36967c4b40dc tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:00.419205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b152a9c-dd63-47f8-bb9c-36967c4b40dc tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:00.419627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b152a9c-dd63-47f8-bb9c-36967c4b40dc tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] PATH_INFO: `/v3/projects/2f29ba2f6ff743bf983f4d3ca9c29173` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:00.421440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b152a9c-dd63-47f8-bb9c-36967c4b40dc tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorizing `identity:get_project(project_id=2f29ba2f6ff743bf983f4d3ca9c29173)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:00.427481 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b152a9c-dd63-47f8-bb9c-36967c4b40dc tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:00.430158 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1224/2470] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:12:00 2022] GET /identity/v3/projects/2f29ba2f6ff743bf983f4d3ca9c29173 => generated 369 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:12:00.431709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b152a9c-dd63-47f8-bb9c-36967c4b40dc tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:00.434563 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7b152a9c-dd63-47f8-bb9c-36967c4b40dc tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:00.466782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b152a9c-dd63-47f8-bb9c-36967c4b40dc tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:00.471478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c42210-6a8d-4841-b3d4-392eb448c6c6 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:00.478146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901dc006-bdf5-4eb0-aac6-143c9ddc1515 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:00.492221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901dc006-bdf5-4eb0-aac6-143c9ddc1515 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:00.492221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901dc006-bdf5-4eb0-aac6-143c9ddc1515 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:00.492221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901dc006-bdf5-4eb0-aac6-143c9ddc1515 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:00.497051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63cc3c5-852c-455a-8d0d-021336e4a6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:00.498702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cc3c5-852c-455a-8d0d-021336e4a6e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:00.499130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cc3c5-852c-455a-8d0d-021336e4a6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:00.500120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63cc3c5-852c-455a-8d0d-021336e4a6e1 admin admin] PATH_INFO: `/v3/users/aaaa793a840141369476d821307497c0` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:00.503218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63cc3c5-852c-455a-8d0d-021336e4a6e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaaa793a840141369476d821307497c0)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:00.506270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63cc3c5-852c-455a-8d0d-021336e4a6e1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:00.522451 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901dc006-bdf5-4eb0-aac6-143c9ddc1515 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:00.530248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901dc006-bdf5-4eb0-aac6-143c9ddc1515 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:00.559953 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1225/2471] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:12:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:12:00.612218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d63cc3c5-852c-455a-8d0d-021336e4a6e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaaa793a840141369476d821307497c0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:00.624880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d63cc3c5-852c-455a-8d0d-021336e4a6e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaaa793a840141369476d821307497c0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:00.653666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d63cc3c5-852c-455a-8d0d-021336e4a6e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaaa793a840141369476d821307497c0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:00.655028 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d63cc3c5-852c-455a-8d0d-021336e4a6e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaaa793a840141369476d821307497c0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:00.672785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d63cc3c5-852c-455a-8d0d-021336e4a6e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaaa793a840141369476d821307497c0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:00.703945 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1247/2472] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:12:00 2022] DELETE /identity/v3/users/aaaa793a840141369476d821307497c0 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:12:01.271778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901dc006-bdf5-4eb0-aac6-143c9ddc1515 service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:01.312235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901dc006-bdf5-4eb0-aac6-143c9ddc1515 service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:01.468590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6bf2a-08cf-42c6-a196-b0d65248c7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:01.469932 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6bf2a-08cf-42c6-a196-b0d65248c7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:01.470444 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6bf2a-08cf-42c6-a196-b0d65248c7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:01.471063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6bf2a-08cf-42c6-a196-b0d65248c7d9 admin admin] PATH_INFO: `/v3/projects/7c2c9ff9beef426785b22ee0e2876c08` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:01.473478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6bf2a-08cf-42c6-a196-b0d65248c7d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c2c9ff9beef426785b22ee0e2876c08)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:01.477833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e6bf2a-08cf-42c6-a196-b0d65248c7d9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:01.595585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-53e6bf2a-08cf-42c6-a196-b0d65248c7d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c2c9ff9beef426785b22ee0e2876c08', 'request_id': 'req-53e6bf2a-08cf-42c6-a196-b0d65248c7d9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:01.615103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-53e6bf2a-08cf-42c6-a196-b0d65248c7d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c2c9ff9beef426785b22ee0e2876c08', 'request_id': 'req-53e6bf2a-08cf-42c6-a196-b0d65248c7d9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:01.634136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-53e6bf2a-08cf-42c6-a196-b0d65248c7d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c2c9ff9beef426785b22ee0e2876c08', 'request_id': 'req-53e6bf2a-08cf-42c6-a196-b0d65248c7d9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:01.666312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-53e6bf2a-08cf-42c6-a196-b0d65248c7d9 admin admin] The token cache is being invalidate because project 7c2c9ff9beef426785b22ee0e2876c08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:12:01.666617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-53e6bf2a-08cf-42c6-a196-b0d65248c7d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:01.668178 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-53e6bf2a-08cf-42c6-a196-b0d65248c7d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:01.671508 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1226/2473] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:12:01 2022] DELETE /identity/v3/projects/7c2c9ff9beef426785b22ee0e2876c08 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:12:01.680919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b16d5-f807-4cb2-bd2f-e2853cdc56df None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:01.681760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b16d5-f807-4cb2-bd2f-e2853cdc56df None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:01.682208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b16d5-f807-4cb2-bd2f-e2853cdc56df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:01.793036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-250b16d5-f807-4cb2-bd2f-e2853cdc56df None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:12:01.809812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-250b16d5-f807-4cb2-bd2f-e2853cdc56df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:01.825221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcecb30-3992-4a94-bf62-bc224a4704a6 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:01.825706 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcecb30-3992-4a94-bf62-bc224a4704a6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:01.826057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcecb30-3992-4a94-bf62-bc224a4704a6 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:01.828478 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1227/2474] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:12:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:12:01.858570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcecb30-3992-4a94-bf62-bc224a4704a6 None None] Authenticating service token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:12:01.859027 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:01.861990 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6fcecb30-3992-4a94-bf62-bc224a4704a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:02.048780 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1248/2475] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:12:02.061710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dd457-6a9f-47e4-98e6-f4a48797897a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:02.062064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dd457-6a9f-47e4-98e6-f4a48797897a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:02.062235 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dd457-6a9f-47e4-98e6-f4a48797897a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:02.133420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0f9dd457-6a9f-47e4-98e6-f4a48797897a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:12:02.135554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0f9dd457-6a9f-47e4-98e6-f4a48797897a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:02.168805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcecb30-3992-4a94-bf62-bc224a4704a6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:02.170738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6fcecb30-3992-4a94-bf62-bc224a4704a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:02.171530 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1249/2476] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:12:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:12:02.178463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9dd457-6a9f-47e4-98e6-f4a48797897a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:02.202904 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:02.204570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9dd457-6a9f-47e4-98e6-f4a48797897a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:02.213148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d16acd-08bd-4428-a89f-5b5e330d2df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:02.214535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d16acd-08bd-4428-a89f-5b5e330d2df2 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:02.215593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d16acd-08bd-4428-a89f-5b5e330d2df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:02.218374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d16acd-08bd-4428-a89f-5b5e330d2df2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:02.219595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d16acd-08bd-4428-a89f-5b5e330d2df2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:12:02.220205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d16acd-08bd-4428-a89f-5b5e330d2df2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:02.222299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d16acd-08bd-4428-a89f-5b5e330d2df2 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:02.257956 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1250/2477] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:12:02.263355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d16acd-08bd-4428-a89f-5b5e330d2df2 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:02.294381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d16acd-08bd-4428-a89f-5b5e330d2df2 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:02.301617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9c8bc-864f-4ea1-bb5e-b7594feea029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:02.302499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9c8bc-864f-4ea1-bb5e-b7594feea029 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:02.302499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9c8bc-864f-4ea1-bb5e-b7594feea029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:02.302712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9c8bc-864f-4ea1-bb5e-b7594feea029 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:02.303412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9c8bc-864f-4ea1-bb5e-b7594feea029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:02.305408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9c8bc-864f-4ea1-bb5e-b7594feea029 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:02.361082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcecb30-3992-4a94-bf62-bc224a4704a6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:02.370596 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1251/2478] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:12:02 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:12:02.371853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9c8bc-864f-4ea1-bb5e-b7594feea029 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:02.520609 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9c8bc-864f-4ea1-bb5e-b7594feea029 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:02.537655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c67168-1929-443c-ad5b-b12e3c2da538 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f00d6a5ac1b4ec7ba557be767778e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3e5a37bd4a8488181fa6e2963c063e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:02.538693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c67168-1929-443c-ad5b-b12e3c2da538 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:02.539137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c67168-1929-443c-ad5b-b12e3c2da538 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:02.539645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c67168-1929-443c-ad5b-b12e3c2da538 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] PATH_INFO: `/v3/projects/2f29ba2f6ff743bf983f4d3ca9c29173` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:02.541191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c67168-1929-443c-ad5b-b12e3c2da538 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorizing `identity:get_project(project_id=2f29ba2f6ff743bf983f4d3ca9c29173)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:02.542577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e73e5a-ce48-48a1-8889-c87e2e47cb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:02.543775 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e73e5a-ce48-48a1-8889-c87e2e47cb4a admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:02.544346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c67168-1929-443c-ad5b-b12e3c2da538 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:02.544536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e73e5a-ce48-48a1-8889-c87e2e47cb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:02.544940 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e73e5a-ce48-48a1-8889-c87e2e47cb4a admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:02.546722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e73e5a-ce48-48a1-8889-c87e2e47cb4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:02.547609 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1228/2479] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:12:01 2022] GET /identity/v3/projects/2f29ba2f6ff743bf983f4d3ca9c29173 => generated 369 bytes in 689 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:12:02.570968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e73e5a-ce48-48a1-8889-c87e2e47cb4a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:02.642786 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1252/2480] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:12:02 2022] POST /identity/v3/users => generated 292 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:12:02.646590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c67168-1929-443c-ad5b-b12e3c2da538 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:02.660830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c67168-1929-443c-ad5b-b12e3c2da538 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:02.667103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a62479-8c65-4940-b0c0-1998dc03884a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:02.668132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a62479-8c65-4940-b0c0-1998dc03884a admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:02.668646 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a62479-8c65-4940-b0c0-1998dc03884a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:02.669152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a62479-8c65-4940-b0c0-1998dc03884a admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:02.670185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a62479-8c65-4940-b0c0-1998dc03884a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:02.672899 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a62479-8c65-4940-b0c0-1998dc03884a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:02.687925 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1229/2481] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:12:02.693418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e73e5a-ce48-48a1-8889-c87e2e47cb4a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:02.710134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e73e5a-ce48-48a1-8889-c87e2e47cb4a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:02.716386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0cd2d-4a18-45c8-9c37-428190d5e576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:02.717131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0cd2d-4a18-45c8-9c37-428190d5e576 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:02.717406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0cd2d-4a18-45c8-9c37-428190d5e576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:02.717675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0cd2d-4a18-45c8-9c37-428190d5e576 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:02.718402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0cd2d-4a18-45c8-9c37-428190d5e576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:02.720412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0cd2d-4a18-45c8-9c37-428190d5e576 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:02.740120 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1253/2482] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:12:02.751295 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a62479-8c65-4940-b0c0-1998dc03884a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:02.784136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a62479-8c65-4940-b0c0-1998dc03884a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:02.793823 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a41a4d-3d2a-4f2e-a652-aadefc4cb613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:02.795063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a41a4d-3d2a-4f2e-a652-aadefc4cb613 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:02.795259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a41a4d-3d2a-4f2e-a652-aadefc4cb613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:02.795570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a41a4d-3d2a-4f2e-a652-aadefc4cb613 admin admin] PATH_INFO: `/v3/projects/dc5c39a06e41406a8c6c99d2e84ab282/users/1d0d09d844bf453cb3e2637d630614ff/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:02.844913 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a41a4d-3d2a-4f2e-a652-aadefc4cb613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc5c39a06e41406a8c6c99d2e84ab282, user_id=1d0d09d844bf453cb3e2637d630614ff, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:02.854604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a41a4d-3d2a-4f2e-a652-aadefc4cb613 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:02.891850 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1230/2483] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:12:02 2022] PUT /identity/v3/projects/dc5c39a06e41406a8c6c99d2e84ab282/users/1d0d09d844bf453cb3e2637d630614ff/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:12:02.909667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da2a18-5df3-4d3f-bf06-6bf8ed510f7c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:02.910324 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da2a18-5df3-4d3f-bf06-6bf8ed510f7c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:02.910770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da2a18-5df3-4d3f-bf06-6bf8ed510f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:03.005117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-19da2a18-5df3-4d3f-bf06-6bf8ed510f7c None None] MFA Rules not processed for user `1d0d09d844bf453cb3e2637d630614ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:12:03.006753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-19da2a18-5df3-4d3f-bf06-6bf8ed510f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:03.136876 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:03.203801 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1254/2484] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:12:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:12:03.216005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abfe88-42ff-451f-84da-58e62a3740ab None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:03.216005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abfe88-42ff-451f-84da-58e62a3740ab None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:03.216005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abfe88-42ff-451f-84da-58e62a3740ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:03.257044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-77abfe88-42ff-451f-84da-58e62a3740ab None None] MFA Rules not processed for user `1d0d09d844bf453cb3e2637d630614ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:12:03.258615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-77abfe88-42ff-451f-84da-58e62a3740ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:03.274324 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1231/2485] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:12:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:12:04.032674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da2a18-5df3-4d3f-bf06-6bf8ed510f7c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:04.240658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da2a18-5df3-4d3f-bf06-6bf8ed510f7c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:04.251730 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df1fbf-3c7a-47a0-8454-14c24581e163 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:04.254086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df1fbf-3c7a-47a0-8454-14c24581e163 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:04.254945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df1fbf-3c7a-47a0-8454-14c24581e163 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:04.255724 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df1fbf-3c7a-47a0-8454-14c24581e163 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:04.274955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df1fbf-3c7a-47a0-8454-14c24581e163 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:04.277814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96df1fbf-3c7a-47a0-8454-14c24581e163 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:04.296509 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1255/2486] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:12:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:12:04.551410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319b66a-51a8-4287-ab87-ccaaa7acf872 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:04.552040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319b66a-51a8-4287-ab87-ccaaa7acf872 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:04.552426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319b66a-51a8-4287-ab87-ccaaa7acf872 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:04.556918 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1232/2487] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:12:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:12:04.567253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df1fbf-3c7a-47a0-8454-14c24581e163 service nova] Authenticating service token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:12:04.569620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-96df1fbf-3c7a-47a0-8454-14c24581e163 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:04.601560 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df1fbf-3c7a-47a0-8454-14c24581e163 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:04.720692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df1fbf-3c7a-47a0-8454-14c24581e163 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:04.726798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e93f12a-c3c5-469b-9197-4481d869b561 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f00d6a5ac1b4ec7ba557be767778e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3e5a37bd4a8488181fa6e2963c063e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:04.727462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93f12a-c3c5-469b-9197-4481d869b561 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:04.727754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93f12a-c3c5-469b-9197-4481d869b561 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:04.728075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93f12a-c3c5-469b-9197-4481d869b561 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] PATH_INFO: `/v3/projects/2f29ba2f6ff743bf983f4d3ca9c29173` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:04.729360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e93f12a-c3c5-469b-9197-4481d869b561 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorizing `identity:get_project(project_id=2f29ba2f6ff743bf983f4d3ca9c29173)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:04.731875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e93f12a-c3c5-469b-9197-4481d869b561 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:04.734535 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1256/2488] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:12:04 2022] GET /identity/v3/projects/2f29ba2f6ff743bf983f4d3ca9c29173 => generated 369 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:12:04.786664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319b66a-51a8-4287-ab87-ccaaa7acf872 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:04.840657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319b66a-51a8-4287-ab87-ccaaa7acf872 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:04.863852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7e144-dbe2-4680-b64b-7d92a337a5f1 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f00d6a5ac1b4ec7ba557be767778e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3e5a37bd4a8488181fa6e2963c063e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:04.867271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7e144-dbe2-4680-b64b-7d92a337a5f1 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:04.867824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7e144-dbe2-4680-b64b-7d92a337a5f1 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:04.868349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7e144-dbe2-4680-b64b-7d92a337a5f1 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] PATH_INFO: `/v3/projects/2f29ba2f6ff743bf983f4d3ca9c29173` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:04.872923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7e144-dbe2-4680-b64b-7d92a337a5f1 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2f29ba2f6ff743bf983f4d3ca9c29173)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:04.876034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7e144-dbe2-4680-b64b-7d92a337a5f1 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:04.975874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1cd7e144-dbe2-4680-b64b-7d92a337a5f1 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f29ba2f6ff743bf983f4d3ca9c29173', 'request_id': 'req-1cd7e144-dbe2-4680-b64b-7d92a337a5f1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:04.985451 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1cd7e144-dbe2-4680-b64b-7d92a337a5f1 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f29ba2f6ff743bf983f4d3ca9c29173', 'request_id': 'req-1cd7e144-dbe2-4680-b64b-7d92a337a5f1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:04.996579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1cd7e144-dbe2-4680-b64b-7d92a337a5f1 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f29ba2f6ff743bf983f4d3ca9c29173', 'request_id': 'req-1cd7e144-dbe2-4680-b64b-7d92a337a5f1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:05.020705 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:05.031910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1cd7e144-dbe2-4680-b64b-7d92a337a5f1 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] The token cache is being invalidate because project 2f29ba2f6ff743bf983f4d3ca9c29173 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:12:05.032463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1cd7e144-dbe2-4680-b64b-7d92a337a5f1 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:05.033075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1cd7e144-dbe2-4680-b64b-7d92a337a5f1 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:05.042753 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1233/2489] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:12:04 2022] DELETE /identity/v3/projects/2f29ba2f6ff743bf983f4d3ca9c29173 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:12:05.776612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea15ac7-f565-4235-bace-64acdf19e284 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:05.777490 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea15ac7-f565-4235-bace-64acdf19e284 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:05.777679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea15ac7-f565-4235-bace-64acdf19e284 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:05.781219 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1257/2490] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:12:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:12:05.796943 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7e144-dbe2-4680-b64b-7d92a337a5f1 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Authenticating service token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:12:05.801865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1cd7e144-dbe2-4680-b64b-7d92a337a5f1 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:06.167258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7e144-dbe2-4680-b64b-7d92a337a5f1 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:06.170621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1cd7e144-dbe2-4680-b64b-7d92a337a5f1 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:06.379489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7e144-dbe2-4680-b64b-7d92a337a5f1 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:06.403247 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2bb1e-704d-4e2f-8962-24ee55d677a4 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f00d6a5ac1b4ec7ba557be767778e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3e5a37bd4a8488181fa6e2963c063e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:06.404600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2bb1e-704d-4e2f-8962-24ee55d677a4 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:06.405367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2bb1e-704d-4e2f-8962-24ee55d677a4 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:06.405849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2bb1e-704d-4e2f-8962-24ee55d677a4 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] PATH_INFO: `/v3/projects/4651068d5dc542b3aee65535e104867b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:06.413521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2bb1e-704d-4e2f-8962-24ee55d677a4 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorizing `identity:get_project(project_id=4651068d5dc542b3aee65535e104867b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:06.419139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2bb1e-704d-4e2f-8962-24ee55d677a4 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:06.428759 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1234/2491] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:12:05 2022] GET /identity/v3/projects/4651068d5dc542b3aee65535e104867b => generated 373 bytes in 636 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:12:06.459812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea15ac7-f565-4235-bace-64acdf19e284 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:06.495711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea15ac7-f565-4235-bace-64acdf19e284 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:06.515733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12f29d-8e7e-4f2e-a079-0f134f82e1aa tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f00d6a5ac1b4ec7ba557be767778e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3e5a37bd4a8488181fa6e2963c063e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:06.524148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12f29d-8e7e-4f2e-a079-0f134f82e1aa tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:06.525303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12f29d-8e7e-4f2e-a079-0f134f82e1aa tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:06.526083 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12f29d-8e7e-4f2e-a079-0f134f82e1aa tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:06.530094 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12f29d-8e7e-4f2e-a079-0f134f82e1aa tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:12:06.531085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12f29d-8e7e-4f2e-a079-0f134f82e1aa tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:06.536830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12f29d-8e7e-4f2e-a079-0f134f82e1aa tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:06.591793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2bb1e-704d-4e2f-8962-24ee55d677a4 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:06.592288 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1258/2492] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:12:06.608925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2bb1e-704d-4e2f-8962-24ee55d677a4 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:06.630431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a3bfc-21ce-4ad4-b4b7-c4d330cc6305 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f00d6a5ac1b4ec7ba557be767778e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3e5a37bd4a8488181fa6e2963c063e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:06.633334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a3bfc-21ce-4ad4-b4b7-c4d330cc6305 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:06.634769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a3bfc-21ce-4ad4-b4b7-c4d330cc6305 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:06.635153 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a3bfc-21ce-4ad4-b4b7-c4d330cc6305 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:06.636271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a3bfc-21ce-4ad4-b4b7-c4d330cc6305 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:06.641945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a3bfc-21ce-4ad4-b4b7-c4d330cc6305 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:06.733839 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1235/2493] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:12:06 2022] POST /identity/v3/projects => generated 371 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:12:06.737002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12f29d-8e7e-4f2e-a079-0f134f82e1aa tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:06.770735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12f29d-8e7e-4f2e-a079-0f134f82e1aa tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:06.969472 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:07.013799 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4825e-faac-4a2c-a603-ffe0f4fabc9a tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f00d6a5ac1b4ec7ba557be767778e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3e5a37bd4a8488181fa6e2963c063e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:07.014118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4825e-faac-4a2c-a603-ffe0f4fabc9a tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:07.014327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4825e-faac-4a2c-a603-ffe0f4fabc9a tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:07.014500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4825e-faac-4a2c-a603-ffe0f4fabc9a tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:07.015187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4825e-faac-4a2c-a603-ffe0f4fabc9a tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:12:07.015495 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4825e-faac-4a2c-a603-ffe0f4fabc9a tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:07.017376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4825e-faac-4a2c-a603-ffe0f4fabc9a tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:07.055187 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1259/2494] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:12:07.745687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988ee82-8dec-4d5e-aedd-ff7f73e7da54 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:07.747011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988ee82-8dec-4d5e-aedd-ff7f73e7da54 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:07.747528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988ee82-8dec-4d5e-aedd-ff7f73e7da54 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:07.750001 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1236/2495] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:12:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:12:07.760549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4825e-faac-4a2c-a603-ffe0f4fabc9a tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Authenticating service token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:12:07.854855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20efbef-5b7a-47d8-9acd-2e23f01a136a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:07.855640 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20efbef-5b7a-47d8-9acd-2e23f01a136a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:07.856532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20efbef-5b7a-47d8-9acd-2e23f01a136a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:07.937896 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c20efbef-5b7a-47d8-9acd-2e23f01a136a None None] MFA Rules not processed for user `0327f14a188e45fba98a58e5fd061248`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:12:07.945128 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c20efbef-5b7a-47d8-9acd-2e23f01a136a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:08.137637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4825e-faac-4a2c-a603-ffe0f4fabc9a tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:08.205788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4825e-faac-4a2c-a603-ffe0f4fabc9a tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:08.222959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deacd01-e69a-4afc-9235-2a6b983a3622 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f00d6a5ac1b4ec7ba557be767778e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3e5a37bd4a8488181fa6e2963c063e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:08.227629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deacd01-e69a-4afc-9235-2a6b983a3622 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:08.228328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deacd01-e69a-4afc-9235-2a6b983a3622 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:08.228938 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deacd01-e69a-4afc-9235-2a6b983a3622 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] PATH_INFO: `/v3/projects/cc27df5d850c4a258e9476177a0e0490` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:08.231496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deacd01-e69a-4afc-9235-2a6b983a3622 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorizing `identity:get_project(project_id=cc27df5d850c4a258e9476177a0e0490)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:08.240173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deacd01-e69a-4afc-9235-2a6b983a3622 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:08.252296 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1260/2496] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:12:07 2022] GET /identity/v3/projects/cc27df5d850c4a258e9476177a0e0490 => generated 371 bytes in 492 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:12:08.260347 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1237/2497] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:12:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:12:09.053546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4e0c3-ee08-4dcd-ab37-1493eb119810 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:09.054672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4e0c3-ee08-4dcd-ab37-1493eb119810 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:09.055783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4e0c3-ee08-4dcd-ab37-1493eb119810 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:09.059078 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1261/2498] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:12:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:12:09.068417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20efbef-5b7a-47d8-9acd-2e23f01a136a None None] Authenticating service token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:12:09.087647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20efbef-5b7a-47d8-9acd-2e23f01a136a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:09.102581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20efbef-5b7a-47d8-9acd-2e23f01a136a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:09.108650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccacbaa-2955-41c9-a3ab-0465e05384b3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f00d6a5ac1b4ec7ba557be767778e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3e5a37bd4a8488181fa6e2963c063e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:09.109854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccacbaa-2955-41c9-a3ab-0465e05384b3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:09.110188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccacbaa-2955-41c9-a3ab-0465e05384b3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:09.110395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccacbaa-2955-41c9-a3ab-0465e05384b3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] PATH_INFO: `/v3/projects/cc27df5d850c4a258e9476177a0e0490` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:09.112560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccacbaa-2955-41c9-a3ab-0465e05384b3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorizing `identity:get_project(project_id=cc27df5d850c4a258e9476177a0e0490)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:09.116984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccacbaa-2955-41c9-a3ab-0465e05384b3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:09.120149 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1238/2499] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:12:09 2022] GET /identity/v3/projects/cc27df5d850c4a258e9476177a0e0490 => generated 371 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:12:09.273984 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4e0c3-ee08-4dcd-ab37-1493eb119810 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:09.309735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4e0c3-ee08-4dcd-ab37-1493eb119810 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:09.336397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ef012-ddce-47d6-9b8c-31ada7ae293a tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f00d6a5ac1b4ec7ba557be767778e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3e5a37bd4a8488181fa6e2963c063e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:09.338590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ef012-ddce-47d6-9b8c-31ada7ae293a tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:09.341626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ef012-ddce-47d6-9b8c-31ada7ae293a tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:09.343353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ef012-ddce-47d6-9b8c-31ada7ae293a tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:09.348287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ef012-ddce-47d6-9b8c-31ada7ae293a tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:12:09.349525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ef012-ddce-47d6-9b8c-31ada7ae293a tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:09.358976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ef012-ddce-47d6-9b8c-31ada7ae293a tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:09.416296 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1262/2500] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:12:09.421360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccacbaa-2955-41c9-a3ab-0465e05384b3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:09.440314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccacbaa-2955-41c9-a3ab-0465e05384b3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:09.452043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6f4fe-5059-411a-9768-1c20715917cc tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f00d6a5ac1b4ec7ba557be767778e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3e5a37bd4a8488181fa6e2963c063e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:09.452697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6f4fe-5059-411a-9768-1c20715917cc tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:09.452966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6f4fe-5059-411a-9768-1c20715917cc tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:09.453454 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6f4fe-5059-411a-9768-1c20715917cc tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:09.454376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6f4fe-5059-411a-9768-1c20715917cc tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:09.458299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6f4fe-5059-411a-9768-1c20715917cc tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:09.489886 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:09.541754 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1239/2501] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:12:09 2022] POST /identity/v3/users => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:12:09.545900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ef012-ddce-47d6-9b8c-31ada7ae293a tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:09.569842 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ef012-ddce-47d6-9b8c-31ada7ae293a tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:09.584533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cce67-1f5f-4266-a79e-259f3f72a47d tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f00d6a5ac1b4ec7ba557be767778e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3e5a37bd4a8488181fa6e2963c063e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:09.586529 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cce67-1f5f-4266-a79e-259f3f72a47d tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:09.587758 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cce67-1f5f-4266-a79e-259f3f72a47d tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:09.588656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cce67-1f5f-4266-a79e-259f3f72a47d tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:09.590267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0cce67-1f5f-4266-a79e-259f3f72a47d tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:12:09.591166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0cce67-1f5f-4266-a79e-259f3f72a47d tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:09.594687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0cce67-1f5f-4266-a79e-259f3f72a47d tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:09.640060 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1263/2502] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:12:10.314797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2633710-6b3e-4415-8135-0a9cab3ae738 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:10.316280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2633710-6b3e-4415-8135-0a9cab3ae738 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:10.316721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2633710-6b3e-4415-8135-0a9cab3ae738 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:10.318307 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1240/2503] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:12:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:12:10.324828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cce67-1f5f-4266-a79e-259f3f72a47d tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Authenticating service token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:12:10.326848 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5d0cce67-1f5f-4266-a79e-259f3f72a47d tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:10.350037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cce67-1f5f-4266-a79e-259f3f72a47d tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:10.366427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cce67-1f5f-4266-a79e-259f3f72a47d tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:10.378713 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20719d16-3e6e-41f6-abc6-e00e04dc7ee9 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f00d6a5ac1b4ec7ba557be767778e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3e5a37bd4a8488181fa6e2963c063e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:10.380464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20719d16-3e6e-41f6-abc6-e00e04dc7ee9 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:10.381367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20719d16-3e6e-41f6-abc6-e00e04dc7ee9 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:10.382181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20719d16-3e6e-41f6-abc6-e00e04dc7ee9 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] PATH_INFO: `/v3/projects/cc27df5d850c4a258e9476177a0e0490` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:10.384939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20719d16-3e6e-41f6-abc6-e00e04dc7ee9 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorizing `identity:get_project(project_id=cc27df5d850c4a258e9476177a0e0490)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:10.390497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20719d16-3e6e-41f6-abc6-e00e04dc7ee9 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:10.395381 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1264/2504] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:12:10 2022] GET /identity/v3/projects/cc27df5d850c4a258e9476177a0e0490 => generated 371 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:12:11.111519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040d08e-e84d-4011-bae5-79a44f26645b None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:11.112311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040d08e-e84d-4011-bae5-79a44f26645b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:11.113040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040d08e-e84d-4011-bae5-79a44f26645b None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:11.116729 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1241/2505] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:12:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:12:11.124525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20719d16-3e6e-41f6-abc6-e00e04dc7ee9 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Authenticating service token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:12:11.147234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20719d16-3e6e-41f6-abc6-e00e04dc7ee9 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:11.178417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20719d16-3e6e-41f6-abc6-e00e04dc7ee9 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:11.187025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045cc93-f317-47f8-bae2-2a0482813e1e tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f00d6a5ac1b4ec7ba557be767778e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3e5a37bd4a8488181fa6e2963c063e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:11.188169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045cc93-f317-47f8-bae2-2a0482813e1e tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:11.188673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045cc93-f317-47f8-bae2-2a0482813e1e tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:11.189225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045cc93-f317-47f8-bae2-2a0482813e1e tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] PATH_INFO: `/v3/projects/cc27df5d850c4a258e9476177a0e0490` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:11.191725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045cc93-f317-47f8-bae2-2a0482813e1e tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorizing `identity:get_project(project_id=cc27df5d850c4a258e9476177a0e0490)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:11.195998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045cc93-f317-47f8-bae2-2a0482813e1e tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:11.210064 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1265/2506] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:12:11 2022] GET /identity/v3/projects/cc27df5d850c4a258e9476177a0e0490 => generated 371 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:12:11.259098 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040d08e-e84d-4011-bae5-79a44f26645b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:11.281526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040d08e-e84d-4011-bae5-79a44f26645b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:11.293423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db30c1-0248-4891-aade-07715506b556 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f00d6a5ac1b4ec7ba557be767778e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3e5a37bd4a8488181fa6e2963c063e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:11.294600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db30c1-0248-4891-aade-07715506b556 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:11.295530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db30c1-0248-4891-aade-07715506b556 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:11.296145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db30c1-0248-4891-aade-07715506b556 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] PATH_INFO: `/v3/users/e8399b1beb35424eab48124850ef4f42` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:11.323241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db30c1-0248-4891-aade-07715506b556 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e8399b1beb35424eab48124850ef4f42)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:11.326473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db30c1-0248-4891-aade-07715506b556 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:11.407462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b4db30c1-0248-4891-aade-07715506b556 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8399b1beb35424eab48124850ef4f42'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:11.426185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b4db30c1-0248-4891-aade-07715506b556 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8399b1beb35424eab48124850ef4f42'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:11.450865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b4db30c1-0248-4891-aade-07715506b556 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8399b1beb35424eab48124850ef4f42'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:11.451707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b4db30c1-0248-4891-aade-07715506b556 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8399b1beb35424eab48124850ef4f42'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:11.461980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b4db30c1-0248-4891-aade-07715506b556 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8399b1beb35424eab48124850ef4f42'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:11.470382 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1242/2507] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:12:11 2022] DELETE /identity/v3/users/e8399b1beb35424eab48124850ef4f42 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:12:11.478242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045cc93-f317-47f8-bae2-2a0482813e1e tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:11.482109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a045cc93-f317-47f8-bae2-2a0482813e1e tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:11.509133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045cc93-f317-47f8-bae2-2a0482813e1e tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:11.623177 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08145f7-25fc-4680-b7ae-e1eefbfc7bb3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f00d6a5ac1b4ec7ba557be767778e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3e5a37bd4a8488181fa6e2963c063e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:11.624106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08145f7-25fc-4680-b7ae-e1eefbfc7bb3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:11.624732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08145f7-25fc-4680-b7ae-e1eefbfc7bb3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:11.625007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08145f7-25fc-4680-b7ae-e1eefbfc7bb3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] PATH_INFO: `/v3/projects/cc27df5d850c4a258e9476177a0e0490` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:11.626459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08145f7-25fc-4680-b7ae-e1eefbfc7bb3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cc27df5d850c4a258e9476177a0e0490)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:11.628821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08145f7-25fc-4680-b7ae-e1eefbfc7bb3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:11.717404 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:11.752901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c08145f7-25fc-4680-b7ae-e1eefbfc7bb3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc27df5d850c4a258e9476177a0e0490', 'request_id': 'req-c08145f7-25fc-4680-b7ae-e1eefbfc7bb3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:11.762680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c08145f7-25fc-4680-b7ae-e1eefbfc7bb3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc27df5d850c4a258e9476177a0e0490', 'request_id': 'req-c08145f7-25fc-4680-b7ae-e1eefbfc7bb3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:11.773131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c08145f7-25fc-4680-b7ae-e1eefbfc7bb3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc27df5d850c4a258e9476177a0e0490', 'request_id': 'req-c08145f7-25fc-4680-b7ae-e1eefbfc7bb3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:11.793055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c08145f7-25fc-4680-b7ae-e1eefbfc7bb3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] The token cache is being invalidate because project cc27df5d850c4a258e9476177a0e0490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:12:11.793466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c08145f7-25fc-4680-b7ae-e1eefbfc7bb3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:11.794417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c08145f7-25fc-4680-b7ae-e1eefbfc7bb3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:11.802430 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1266/2508] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:12:11 2022] DELETE /identity/v3/projects/cc27df5d850c4a258e9476177a0e0490 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:12:12.107052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0e156-5e30-4ed9-a0c4-35670faa913b None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:12.107795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0e156-5e30-4ed9-a0c4-35670faa913b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:12.108294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0e156-5e30-4ed9-a0c4-35670faa913b None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:12.110114 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1243/2509] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:12:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:12:12.116585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08145f7-25fc-4680-b7ae-e1eefbfc7bb3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Authenticating service token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:12:12.119014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c08145f7-25fc-4680-b7ae-e1eefbfc7bb3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:12.277682 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08145f7-25fc-4680-b7ae-e1eefbfc7bb3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:12.278992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c08145f7-25fc-4680-b7ae-e1eefbfc7bb3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:12.364583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08145f7-25fc-4680-b7ae-e1eefbfc7bb3 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:12.370481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd36546-b6a2-4182-a65d-8499cb16d5ff tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f00d6a5ac1b4ec7ba557be767778e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3e5a37bd4a8488181fa6e2963c063e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:12.371276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd36546-b6a2-4182-a65d-8499cb16d5ff tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:12.371659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd36546-b6a2-4182-a65d-8499cb16d5ff tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:12.372131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd36546-b6a2-4182-a65d-8499cb16d5ff tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] PATH_INFO: `/v3/projects/4651068d5dc542b3aee65535e104867b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:12.373594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd36546-b6a2-4182-a65d-8499cb16d5ff tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorizing `identity:get_project(project_id=4651068d5dc542b3aee65535e104867b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:12.375772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd36546-b6a2-4182-a65d-8499cb16d5ff tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:12.379632 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1267/2510] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:12:12 2022] GET /identity/v3/projects/4651068d5dc542b3aee65535e104867b => generated 373 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:12:12.395482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0e156-5e30-4ed9-a0c4-35670faa913b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:12.412339 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0e156-5e30-4ed9-a0c4-35670faa913b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:12.418288 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34685188-20ef-468f-90e8-2e546d6d5e67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:12.418930 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34685188-20ef-468f-90e8-2e546d6d5e67 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:12.419177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34685188-20ef-468f-90e8-2e546d6d5e67 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:12.419446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34685188-20ef-468f-90e8-2e546d6d5e67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:12.421421 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-34685188-20ef-468f-90e8-2e546d6d5e67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:12.559122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34685188-20ef-468f-90e8-2e546d6d5e67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:12.562723 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34685188-20ef-468f-90e8-2e546d6d5e67 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:12.581864 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1244/2511] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:12:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:12:13.045606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3b6f7-1cb5-44a7-bcba-286e0ebb04ef None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:13.046186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3b6f7-1cb5-44a7-bcba-286e0ebb04ef None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:13.046186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3b6f7-1cb5-44a7-bcba-286e0ebb04ef None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:13.047809 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1268/2512] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:12:13.056901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34685188-20ef-468f-90e8-2e546d6d5e67 service nova] Authenticating service token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:12:13.060094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-34685188-20ef-468f-90e8-2e546d6d5e67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:13.084745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34685188-20ef-468f-90e8-2e546d6d5e67 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:13.100882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34685188-20ef-468f-90e8-2e546d6d5e67 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:13.109738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce785a1-8047-4a3b-aee9-51c7f1fecff8 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f00d6a5ac1b4ec7ba557be767778e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3e5a37bd4a8488181fa6e2963c063e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:13.111297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce785a1-8047-4a3b-aee9-51c7f1fecff8 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:13.111697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce785a1-8047-4a3b-aee9-51c7f1fecff8 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:13.112853 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce785a1-8047-4a3b-aee9-51c7f1fecff8 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] PATH_INFO: `/v3/projects/4651068d5dc542b3aee65535e104867b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:13.116072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce785a1-8047-4a3b-aee9-51c7f1fecff8 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorizing `identity:get_project(project_id=4651068d5dc542b3aee65535e104867b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:13.120052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce785a1-8047-4a3b-aee9-51c7f1fecff8 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:13.123804 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1245/2513] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:12:13 2022] GET /identity/v3/projects/4651068d5dc542b3aee65535e104867b => generated 373 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:12:14.368361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ae1c6-0b39-4cc7-9743-2ef63491cdd7 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:14.368908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ae1c6-0b39-4cc7-9743-2ef63491cdd7 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:14.369110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ae1c6-0b39-4cc7-9743-2ef63491cdd7 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:14.370464 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1269/2514] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:12:14.375636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce785a1-8047-4a3b-aee9-51c7f1fecff8 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Authenticating service token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:12:14.389614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce785a1-8047-4a3b-aee9-51c7f1fecff8 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:14.401154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce785a1-8047-4a3b-aee9-51c7f1fecff8 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:14.406026 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca11b7-7ac3-4979-afa6-a09b2907d375 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f00d6a5ac1b4ec7ba557be767778e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3e5a37bd4a8488181fa6e2963c063e5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:14.406796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca11b7-7ac3-4979-afa6-a09b2907d375 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:14.407077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca11b7-7ac3-4979-afa6-a09b2907d375 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:14.407357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca11b7-7ac3-4979-afa6-a09b2907d375 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] PATH_INFO: `/v3/projects/4651068d5dc542b3aee65535e104867b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:14.409515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca11b7-7ac3-4979-afa6-a09b2907d375 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorizing `identity:get_project(project_id=4651068d5dc542b3aee65535e104867b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:14.411331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca11b7-7ac3-4979-afa6-a09b2907d375 tempest-QuotasAdminTestJSON-222977065 tempest-QuotasAdminTestJSON-222977065-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:14.413714 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1246/2515] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:12:14 2022] GET /identity/v3/projects/4651068d5dc542b3aee65535e104867b => generated 373 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:12:14.913091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ae1c6-0b39-4cc7-9743-2ef63491cdd7 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:14.915489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ac2ae1c6-0b39-4cc7-9743-2ef63491cdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:15.078401 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:15.091177 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ae1c6-0b39-4cc7-9743-2ef63491cdd7 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:15.098529 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e77f4d-ce4d-499d-a48e-20fbe0c84b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:15.100209 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e77f4d-ce4d-499d-a48e-20fbe0c84b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:15.100983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e77f4d-ce4d-499d-a48e-20fbe0c84b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:15.101326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e77f4d-ce4d-499d-a48e-20fbe0c84b3d admin admin] PATH_INFO: `/v3/users/035b2ee8ebe04592a93b2fb839b6e29c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:15.102949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e77f4d-ce4d-499d-a48e-20fbe0c84b3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=035b2ee8ebe04592a93b2fb839b6e29c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:15.105041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e77f4d-ce4d-499d-a48e-20fbe0c84b3d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:15.195247 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a2e77f4d-ce4d-499d-a48e-20fbe0c84b3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '035b2ee8ebe04592a93b2fb839b6e29c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:15.208917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a2e77f4d-ce4d-499d-a48e-20fbe0c84b3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '035b2ee8ebe04592a93b2fb839b6e29c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:15.228224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a2e77f4d-ce4d-499d-a48e-20fbe0c84b3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '035b2ee8ebe04592a93b2fb839b6e29c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:15.229226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a2e77f4d-ce4d-499d-a48e-20fbe0c84b3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '035b2ee8ebe04592a93b2fb839b6e29c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:15.250975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a2e77f4d-ce4d-499d-a48e-20fbe0c84b3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '035b2ee8ebe04592a93b2fb839b6e29c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:15.258706 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1270/2516] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:12:14 2022] DELETE /identity/v3/users/035b2ee8ebe04592a93b2fb839b6e29c => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:12:15.263491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9495e89-c320-4d5c-b41e-299a9d8227a1 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:15.264339 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9495e89-c320-4d5c-b41e-299a9d8227a1 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:15.265014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9495e89-c320-4d5c-b41e-299a9d8227a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:15.298270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b9495e89-c320-4d5c-b41e-299a9d8227a1 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:12:15.302882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b9495e89-c320-4d5c-b41e-299a9d8227a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:15.364768 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:15.425206 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1247/2517] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:12:15.442617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e77f4d-ce4d-499d-a48e-20fbe0c84b3d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:15.448538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a2e77f4d-ce4d-499d-a48e-20fbe0c84b3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:15.551925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e77f4d-ce4d-499d-a48e-20fbe0c84b3d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:15.559629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561c327-5912-4c27-96ac-d443f55b9e17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:15.561605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561c327-5912-4c27-96ac-d443f55b9e17 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:15.563671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561c327-5912-4c27-96ac-d443f55b9e17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:15.564220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561c327-5912-4c27-96ac-d443f55b9e17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:15.585346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561c327-5912-4c27-96ac-d443f55b9e17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:15.587755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561c327-5912-4c27-96ac-d443f55b9e17 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:15.603767 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1271/2518] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:12:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:12:16.242856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9495e89-c320-4d5c-b41e-299a9d8227a1 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:16.244819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b9495e89-c320-4d5c-b41e-299a9d8227a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:16.290586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9495e89-c320-4d5c-b41e-299a9d8227a1 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:16.301487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0edf904-a399-46a2-8291-4cf442231963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:16.302598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edf904-a399-46a2-8291-4cf442231963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:16.305028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edf904-a399-46a2-8291-4cf442231963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:16.305694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0edf904-a399-46a2-8291-4cf442231963 admin admin] PATH_INFO: `/v3/projects/4651068d5dc542b3aee65535e104867b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:16.307588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0edf904-a399-46a2-8291-4cf442231963 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4651068d5dc542b3aee65535e104867b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:16.329645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0edf904-a399-46a2-8291-4cf442231963 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:16.450370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f0edf904-a399-46a2-8291-4cf442231963 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4651068d5dc542b3aee65535e104867b', 'request_id': 'req-f0edf904-a399-46a2-8291-4cf442231963'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:16.460110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f0edf904-a399-46a2-8291-4cf442231963 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4651068d5dc542b3aee65535e104867b', 'request_id': 'req-f0edf904-a399-46a2-8291-4cf442231963'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:16.469521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f0edf904-a399-46a2-8291-4cf442231963 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4651068d5dc542b3aee65535e104867b', 'request_id': 'req-f0edf904-a399-46a2-8291-4cf442231963'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:16.513258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f0edf904-a399-46a2-8291-4cf442231963 admin admin] The token cache is being invalidate because project 4651068d5dc542b3aee65535e104867b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:12:16.517057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f0edf904-a399-46a2-8291-4cf442231963 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:16.520551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f0edf904-a399-46a2-8291-4cf442231963 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:16.531118 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1248/2519] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:12:16 2022] DELETE /identity/v3/projects/4651068d5dc542b3aee65535e104867b => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:12:16.533656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561c327-5912-4c27-96ac-d443f55b9e17 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:16.547320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561c327-5912-4c27-96ac-d443f55b9e17 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:16.729396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e91594-8a40-4f45-81f4-2743a005c68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:16.730965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e91594-8a40-4f45-81f4-2743a005c68f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:16.752524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e91594-8a40-4f45-81f4-2743a005c68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:16.753157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e91594-8a40-4f45-81f4-2743a005c68f admin admin] PATH_INFO: `/v3/users/4f00d6a5ac1b4ec7ba557be767778e3f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:16.756128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e91594-8a40-4f45-81f4-2743a005c68f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f00d6a5ac1b4ec7ba557be767778e3f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:16.773082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e91594-8a40-4f45-81f4-2743a005c68f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:16.839237 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:16.885235 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-82e91594-8a40-4f45-81f4-2743a005c68f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f00d6a5ac1b4ec7ba557be767778e3f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:16.894622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-82e91594-8a40-4f45-81f4-2743a005c68f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f00d6a5ac1b4ec7ba557be767778e3f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:16.916365 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-82e91594-8a40-4f45-81f4-2743a005c68f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f00d6a5ac1b4ec7ba557be767778e3f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:16.917326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-82e91594-8a40-4f45-81f4-2743a005c68f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f00d6a5ac1b4ec7ba557be767778e3f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:16.930384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-82e91594-8a40-4f45-81f4-2743a005c68f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f00d6a5ac1b4ec7ba557be767778e3f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:16.951108 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1272/2520] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:12:16 2022] DELETE /identity/v3/users/4f00d6a5ac1b4ec7ba557be767778e3f => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:12:18.574521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0edf904-a399-46a2-8291-4cf442231963 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:18.577389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f0edf904-a399-46a2-8291-4cf442231963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:18.597249 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0edf904-a399-46a2-8291-4cf442231963 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:18.769192 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6959b1-7144-48f0-8135-7603d795c5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:18.770383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6959b1-7144-48f0-8135-7603d795c5ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:18.770978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6959b1-7144-48f0-8135-7603d795c5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:18.771482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6959b1-7144-48f0-8135-7603d795c5ba admin admin] PATH_INFO: `/v3/projects/c3e5a37bd4a8488181fa6e2963c063e5` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:18.774194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6959b1-7144-48f0-8135-7603d795c5ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3e5a37bd4a8488181fa6e2963c063e5)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:18.778701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6959b1-7144-48f0-8135-7603d795c5ba admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:18.896437 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9d6959b1-7144-48f0-8135-7603d795c5ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3e5a37bd4a8488181fa6e2963c063e5', 'request_id': 'req-9d6959b1-7144-48f0-8135-7603d795c5ba'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:18.904564 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:18.909064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9d6959b1-7144-48f0-8135-7603d795c5ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3e5a37bd4a8488181fa6e2963c063e5', 'request_id': 'req-9d6959b1-7144-48f0-8135-7603d795c5ba'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:18.920081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9d6959b1-7144-48f0-8135-7603d795c5ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3e5a37bd4a8488181fa6e2963c063e5', 'request_id': 'req-9d6959b1-7144-48f0-8135-7603d795c5ba'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:18.941327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9d6959b1-7144-48f0-8135-7603d795c5ba admin admin] The token cache is being invalidate because project c3e5a37bd4a8488181fa6e2963c063e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:12:18.941806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9d6959b1-7144-48f0-8135-7603d795c5ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:18.942754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9d6959b1-7144-48f0-8135-7603d795c5ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:18.945265 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1249/2521] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:12:18 2022] DELETE /identity/v3/projects/c3e5a37bd4a8488181fa6e2963c063e5 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:12:18.953353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7cb37-25dd-4354-8b57-e8f193c3efba None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:18.954207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7cb37-25dd-4354-8b57-e8f193c3efba None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:18.954856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7cb37-25dd-4354-8b57-e8f193c3efba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:18.995548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ffe7cb37-25dd-4354-8b57-e8f193c3efba None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:12:18.996937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ffe7cb37-25dd-4354-8b57-e8f193c3efba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:19.088903 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1273/2522] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:12:19.098313 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f644e37-cfb2-42fc-9409-f98d1d391d3a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:19.098672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f644e37-cfb2-42fc-9409-f98d1d391d3a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:19.098887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f644e37-cfb2-42fc-9409-f98d1d391d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:19.129056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6f644e37-cfb2-42fc-9409-f98d1d391d3a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:12:19.131640 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6f644e37-cfb2-42fc-9409-f98d1d391d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:19.152923 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1250/2523] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:12:19.158111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7cb37-25dd-4354-8b57-e8f193c3efba None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:19.188914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7cb37-25dd-4354-8b57-e8f193c3efba None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:19.197047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e72f6c-5213-4fcc-88ae-2f7bfc7961bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:19.197686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e72f6c-5213-4fcc-88ae-2f7bfc7961bd admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:19.198067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e72f6c-5213-4fcc-88ae-2f7bfc7961bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:19.198343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e72f6c-5213-4fcc-88ae-2f7bfc7961bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:19.199050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e72f6c-5213-4fcc-88ae-2f7bfc7961bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:12:19.199354 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e72f6c-5213-4fcc-88ae-2f7bfc7961bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:19.203261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e72f6c-5213-4fcc-88ae-2f7bfc7961bd admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:19.234779 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1274/2524] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:12:19.241388 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f644e37-cfb2-42fc-9409-f98d1d391d3a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:19.281324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f644e37-cfb2-42fc-9409-f98d1d391d3a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:19.302849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b1efb-4b7f-4f7a-a494-84c46791aceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:19.303774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b1efb-4b7f-4f7a-a494-84c46791aceb admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:19.304292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b1efb-4b7f-4f7a-a494-84c46791aceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:19.309642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b1efb-4b7f-4f7a-a494-84c46791aceb admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:19.309860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b1efb-4b7f-4f7a-a494-84c46791aceb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:19.314786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35b1efb-4b7f-4f7a-a494-84c46791aceb admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:19.397324 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1251/2525] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:12:19 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:12:19.402906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e72f6c-5213-4fcc-88ae-2f7bfc7961bd admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:19.422390 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e72f6c-5213-4fcc-88ae-2f7bfc7961bd admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:19.529316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffad0ec-f024-4b1b-8201-4e685365ff71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:19.530834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffad0ec-f024-4b1b-8201-4e685365ff71 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:19.530834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffad0ec-f024-4b1b-8201-4e685365ff71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:19.530834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffad0ec-f024-4b1b-8201-4e685365ff71 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:19.531626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffad0ec-f024-4b1b-8201-4e685365ff71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:19.535000 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffad0ec-f024-4b1b-8201-4e685365ff71 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:19.571476 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1275/2526] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:12:19 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:12:19.577011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b1efb-4b7f-4f7a-a494-84c46791aceb admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:19.595088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b1efb-4b7f-4f7a-a494-84c46791aceb admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:19.602767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b747ca-55a0-45d6-bdee-5acbc9413d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:19.604272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b747ca-55a0-45d6-bdee-5acbc9413d40 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:19.604742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b747ca-55a0-45d6-bdee-5acbc9413d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:19.605281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b747ca-55a0-45d6-bdee-5acbc9413d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:19.606444 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b747ca-55a0-45d6-bdee-5acbc9413d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:19.608512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b747ca-55a0-45d6-bdee-5acbc9413d40 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:19.622314 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1252/2527] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:12:19.626953 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffad0ec-f024-4b1b-8201-4e685365ff71 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:19.639591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffad0ec-f024-4b1b-8201-4e685365ff71 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:19.649146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d48f3-cb07-476f-b0c6-3a8e5760f2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:19.650227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d48f3-cb07-476f-b0c6-3a8e5760f2cb admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:19.651136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d48f3-cb07-476f-b0c6-3a8e5760f2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:19.652557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d48f3-cb07-476f-b0c6-3a8e5760f2cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:19.655097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d48f3-cb07-476f-b0c6-3a8e5760f2cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:19.659548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d48f3-cb07-476f-b0c6-3a8e5760f2cb admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:19.684298 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1276/2528] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:12:19.686657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b747ca-55a0-45d6-bdee-5acbc9413d40 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:19.719691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b747ca-55a0-45d6-bdee-5acbc9413d40 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:19.731196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae091d11-5669-4f12-a047-0a3297f8fd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:19.732474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae091d11-5669-4f12-a047-0a3297f8fd60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:19.732968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae091d11-5669-4f12-a047-0a3297f8fd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:19.733470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae091d11-5669-4f12-a047-0a3297f8fd60 admin admin] PATH_INFO: `/v3/projects/5d9d0ab4f54745b9a82dc911edc73656/users/126d18c747e64805a6e4e9c81f41d05e/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:19.802881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae091d11-5669-4f12-a047-0a3297f8fd60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d9d0ab4f54745b9a82dc911edc73656, user_id=126d18c747e64805a6e4e9c81f41d05e, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:19.805937 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae091d11-5669-4f12-a047-0a3297f8fd60 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:19.839939 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1253/2529] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:12:19 2022] PUT /identity/v3/projects/5d9d0ab4f54745b9a82dc911edc73656/users/126d18c747e64805a6e4e9c81f41d05e/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:12:19.862845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859d524-203b-48ab-bb18-f658babd7145 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:19.863109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859d524-203b-48ab-bb18-f658babd7145 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:19.863366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859d524-203b-48ab-bb18-f658babd7145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:19.872351 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:19.914224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6859d524-203b-48ab-bb18-f658babd7145 None None] MFA Rules not processed for user `126d18c747e64805a6e4e9c81f41d05e`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:12:19.916206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6859d524-203b-48ab-bb18-f658babd7145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:20.044153 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1277/2530] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:12:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:12:20.048684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae091d11-5669-4f12-a047-0a3297f8fd60 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:20.186964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae091d11-5669-4f12-a047-0a3297f8fd60 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:20.195400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb687c-6375-47f2-a834-7ec617bd4aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:20.197697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb687c-6375-47f2-a834-7ec617bd4aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:20.197697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb687c-6375-47f2-a834-7ec617bd4aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:20.197697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb687c-6375-47f2-a834-7ec617bd4aa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:20.198971 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafb687c-6375-47f2-a834-7ec617bd4aa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:20.202853 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafb687c-6375-47f2-a834-7ec617bd4aa5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:20.273548 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1254/2531] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:12:20 2022] POST /identity/v3/projects => generated 373 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:12:20.280727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859d524-203b-48ab-bb18-f658babd7145 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:20.298523 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859d524-203b-48ab-bb18-f658babd7145 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:20.418056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565a2c6-0cba-4942-ad2a-e917b6e95913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:20.419137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565a2c6-0cba-4942-ad2a-e917b6e95913 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:20.420496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565a2c6-0cba-4942-ad2a-e917b6e95913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:20.421000 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565a2c6-0cba-4942-ad2a-e917b6e95913 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:20.422570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565a2c6-0cba-4942-ad2a-e917b6e95913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:20.427284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565a2c6-0cba-4942-ad2a-e917b6e95913 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:20.500777 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1278/2532] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:12:20 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:12:20.507254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb687c-6375-47f2-a834-7ec617bd4aa5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:20.540950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb687c-6375-47f2-a834-7ec617bd4aa5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:20.573648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bf45c-c0c4-4c26-bc4d-bd23d375618a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:20.574628 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bf45c-c0c4-4c26-bc4d-bd23d375618a admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:20.575277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bf45c-c0c4-4c26-bc4d-bd23d375618a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:20.575752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bf45c-c0c4-4c26-bc4d-bd23d375618a admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:20.576947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825bf45c-c0c4-4c26-bc4d-bd23d375618a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:20.581311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825bf45c-c0c4-4c26-bc4d-bd23d375618a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:20.629016 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1255/2533] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:12:20.631266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565a2c6-0cba-4942-ad2a-e917b6e95913 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:20.653037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565a2c6-0cba-4942-ad2a-e917b6e95913 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:20.667090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ddea9-05bf-400c-a7e4-28600533850f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:20.667845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ddea9-05bf-400c-a7e4-28600533850f admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:20.668220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ddea9-05bf-400c-a7e4-28600533850f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:20.668492 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ddea9-05bf-400c-a7e4-28600533850f admin admin] PATH_INFO: `/v3/projects/1cec62de4581401f90cdd189decae079/users/46ce1da78b684d7b83412b17f9d55471/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:20.745596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ddea9-05bf-400c-a7e4-28600533850f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cec62de4581401f90cdd189decae079, user_id=46ce1da78b684d7b83412b17f9d55471, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:20.749361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ddea9-05bf-400c-a7e4-28600533850f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:20.803400 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1279/2534] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:12:20 2022] PUT /identity/v3/projects/1cec62de4581401f90cdd189decae079/users/46ce1da78b684d7b83412b17f9d55471/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:12:20.808353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bf45c-c0c4-4c26-bc4d-bd23d375618a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:20.842280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bf45c-c0c4-4c26-bc4d-bd23d375618a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:20.989693 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:21.029744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196685b-7b38-46e2-9fa6-517978c2cd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:21.031006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196685b-7b38-46e2-9fa6-517978c2cd5b admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:21.031584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196685b-7b38-46e2-9fa6-517978c2cd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:21.032528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196685b-7b38-46e2-9fa6-517978c2cd5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:21.050691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196685b-7b38-46e2-9fa6-517978c2cd5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:21.052435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196685b-7b38-46e2-9fa6-517978c2cd5b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:21.077201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ddea9-05bf-400c-a7e4-28600533850f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:21.088707 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1256/2535] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:12:21.101410 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ddea9-05bf-400c-a7e4-28600533850f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:21.112574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c267d-1047-4b13-9ccb-96b79ba7550a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:21.114177 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c267d-1047-4b13-9ccb-96b79ba7550a admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:21.114957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c267d-1047-4b13-9ccb-96b79ba7550a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:21.117077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c267d-1047-4b13-9ccb-96b79ba7550a admin admin] PATH_INFO: `/v3/projects/1cec62de4581401f90cdd189decae079/users/46ce1da78b684d7b83412b17f9d55471/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:21.122708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c267d-1047-4b13-9ccb-96b79ba7550a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cec62de4581401f90cdd189decae079, user_id=46ce1da78b684d7b83412b17f9d55471, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:21.130356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c267d-1047-4b13-9ccb-96b79ba7550a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:21.157629 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1280/2536] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:12:21 2022] PUT /identity/v3/projects/1cec62de4581401f90cdd189decae079/users/46ce1da78b684d7b83412b17f9d55471/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:12:21.169138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac826727-f865-419b-8a54-2abf364c8c76 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:21.171152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac826727-f865-419b-8a54-2abf364c8c76 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:21.173280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac826727-f865-419b-8a54-2abf364c8c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:21.251916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ac826727-f865-419b-8a54-2abf364c8c76 None None] MFA Rules not processed for user `46ce1da78b684d7b83412b17f9d55471`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:12:21.251916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ac826727-f865-419b-8a54-2abf364c8c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:21.381268 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1257/2537] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:12:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:12:21.382907 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c267d-1047-4b13-9ccb-96b79ba7550a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:21.403845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c267d-1047-4b13-9ccb-96b79ba7550a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:21.420914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0d0fb-73e3-4c84-99ad-2ddc9dab62db tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46ce1da78b684d7b83412b17f9d55471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cec62de4581401f90cdd189decae079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:21.422220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0d0fb-73e3-4c84-99ad-2ddc9dab62db tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:21.425680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0d0fb-73e3-4c84-99ad-2ddc9dab62db tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:21.426159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0d0fb-73e3-4c84-99ad-2ddc9dab62db tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:21.429887 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0d0fb-73e3-4c84-99ad-2ddc9dab62db tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:12:21.430508 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0d0fb-73e3-4c84-99ad-2ddc9dab62db tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:21.434406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0d0fb-73e3-4c84-99ad-2ddc9dab62db tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:21.501400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac826727-f865-419b-8a54-2abf364c8c76 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:21.501830 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1281/2538] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:12:21.516816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac826727-f865-419b-8a54-2abf364c8c76 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:21.529420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10735993-d026-4732-96b8-6a2dbaf373c3 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46ce1da78b684d7b83412b17f9d55471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cec62de4581401f90cdd189decae079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:21.530166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10735993-d026-4732-96b8-6a2dbaf373c3 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:21.530515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10735993-d026-4732-96b8-6a2dbaf373c3 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:21.531010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10735993-d026-4732-96b8-6a2dbaf373c3 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:21.531715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10735993-d026-4732-96b8-6a2dbaf373c3 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:21.534735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10735993-d026-4732-96b8-6a2dbaf373c3 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:21.636278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0d0fb-73e3-4c84-99ad-2ddc9dab62db tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:21.639985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-22e0d0fb-73e3-4c84-99ad-2ddc9dab62db tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:21.676257 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1258/2539] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:12:21 2022] POST /identity/v3/projects => generated 371 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:12:21.678457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10735993-d026-4732-96b8-6a2dbaf373c3 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:21.748986 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:21.805529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10735993-d026-4732-96b8-6a2dbaf373c3 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:21.810970 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbf584-3014-4bec-a07c-d4e0a35d49b5 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46ce1da78b684d7b83412b17f9d55471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cec62de4581401f90cdd189decae079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:21.811608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbf584-3014-4bec-a07c-d4e0a35d49b5 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:21.811991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbf584-3014-4bec-a07c-d4e0a35d49b5 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:21.812217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbf584-3014-4bec-a07c-d4e0a35d49b5 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:21.812906 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecbf584-3014-4bec-a07c-d4e0a35d49b5 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:12:21.813214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecbf584-3014-4bec-a07c-d4e0a35d49b5 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:21.814963 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecbf584-3014-4bec-a07c-d4e0a35d49b5 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:21.833073 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1259/2540] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:12:21.849942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbf584-3014-4bec-a07c-d4e0a35d49b5 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:21.852125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8ecbf584-3014-4bec-a07c-d4e0a35d49b5 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:21.870312 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0d0fb-73e3-4c84-99ad-2ddc9dab62db tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:22.008558 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b15614-ab1f-418f-bd8c-501ca9142770 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:22.009690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b15614-ab1f-418f-bd8c-501ca9142770 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:22.010337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b15614-ab1f-418f-bd8c-501ca9142770 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:22.010976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b15614-ab1f-418f-bd8c-501ca9142770 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:22.015213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-08b15614-ab1f-418f-bd8c-501ca9142770 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:22.034426 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:22.107846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbf584-3014-4bec-a07c-d4e0a35d49b5 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:22.127555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c77b205-9fc2-40fa-a343-2422b9c845e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:22.128672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77b205-9fc2-40fa-a343-2422b9c845e3 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:22.129182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77b205-9fc2-40fa-a343-2422b9c845e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:22.129675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c77b205-9fc2-40fa-a343-2422b9c845e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:22.187727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77b205-9fc2-40fa-a343-2422b9c845e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:22.193371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c77b205-9fc2-40fa-a343-2422b9c845e3 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:22.216600 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1260/2541] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:12:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:12:22.260949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3f6e6-ab6f-4587-9388-0e5df13d57f8 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:22.261448 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3f6e6-ab6f-4587-9388-0e5df13d57f8 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:22.261945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3f6e6-ab6f-4587-9388-0e5df13d57f8 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:22.265208 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1261/2542] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:12:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:12:22.278463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3f6e6-ab6f-4587-9388-0e5df13d57f8 None None] Authenticating service token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:12:22.285742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b15614-ab1f-418f-bd8c-501ca9142770 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:22.289135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b15614-ab1f-418f-bd8c-501ca9142770 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:22.304270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3f6e6-ab6f-4587-9388-0e5df13d57f8 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:22.312365 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1282/2543] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:12:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 677 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:12:22.318489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3f6e6-ab6f-4587-9388-0e5df13d57f8 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:22.325197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1407581-7cae-48f2-a487-9e9f1c1cc76e tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46ce1da78b684d7b83412b17f9d55471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cec62de4581401f90cdd189decae079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:22.326841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1407581-7cae-48f2-a487-9e9f1c1cc76e tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:22.327341 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1407581-7cae-48f2-a487-9e9f1c1cc76e tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:22.327778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1407581-7cae-48f2-a487-9e9f1c1cc76e tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] PATH_INFO: `/v3/projects/83da20dfe5d04940b1e1895997513baf` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:22.329445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1407581-7cae-48f2-a487-9e9f1c1cc76e tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: Authorizing `identity:get_project(project_id=83da20dfe5d04940b1e1895997513baf)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:22.332949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1407581-7cae-48f2-a487-9e9f1c1cc76e tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:22.335117 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1262/2544] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:12:22 2022] GET /identity/v3/projects/83da20dfe5d04940b1e1895997513baf => generated 371 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:12:23.370226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d8587-5c6d-47a7-8786-3f3e040bde69 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:23.371215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d8587-5c6d-47a7-8786-3f3e040bde69 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:23.371549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d8587-5c6d-47a7-8786-3f3e040bde69 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:23.373499 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1283/2545] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:12:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:12:23.381237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1407581-7cae-48f2-a487-9e9f1c1cc76e tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Authenticating service token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:12:23.410037 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1407581-7cae-48f2-a487-9e9f1c1cc76e tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:23.432796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1407581-7cae-48f2-a487-9e9f1c1cc76e tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:23.442231 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7d9eb-461f-485b-8bb5-b62f4c8b5db8 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46ce1da78b684d7b83412b17f9d55471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cec62de4581401f90cdd189decae079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:23.443556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7d9eb-461f-485b-8bb5-b62f4c8b5db8 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:23.444270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7d9eb-461f-485b-8bb5-b62f4c8b5db8 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:23.444771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7d9eb-461f-485b-8bb5-b62f4c8b5db8 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] PATH_INFO: `/v3/projects/83da20dfe5d04940b1e1895997513baf` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:23.446925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7d9eb-461f-485b-8bb5-b62f4c8b5db8 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: Authorizing `identity:get_project(project_id=83da20dfe5d04940b1e1895997513baf)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:23.451266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7d9eb-461f-485b-8bb5-b62f4c8b5db8 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:23.454724 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1263/2546] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:12:23 2022] GET /identity/v3/projects/83da20dfe5d04940b1e1895997513baf => generated 371 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:12:23.544151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d8587-5c6d-47a7-8786-3f3e040bde69 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:23.581083 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d8587-5c6d-47a7-8786-3f3e040bde69 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:23.590552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d7067-206d-4d32-a4ef-8135d018f2db tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46ce1da78b684d7b83412b17f9d55471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cec62de4581401f90cdd189decae079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:23.591597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d7067-206d-4d32-a4ef-8135d018f2db tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:23.592340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d7067-206d-4d32-a4ef-8135d018f2db tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:23.593264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d7067-206d-4d32-a4ef-8135d018f2db tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:23.595011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d7067-206d-4d32-a4ef-8135d018f2db tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:12:23.597957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d7067-206d-4d32-a4ef-8135d018f2db tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:23.601017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d7067-206d-4d32-a4ef-8135d018f2db tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:23.624928 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1284/2547] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:12:23.631123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7d9eb-461f-485b-8bb5-b62f4c8b5db8 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:23.651843 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7d9eb-461f-485b-8bb5-b62f4c8b5db8 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:23.662563 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e393a5f6-9c4f-4a00-9303-00a87155de3f tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46ce1da78b684d7b83412b17f9d55471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cec62de4581401f90cdd189decae079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:23.663597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393a5f6-9c4f-4a00-9303-00a87155de3f tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:23.664882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393a5f6-9c4f-4a00-9303-00a87155de3f tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:23.665416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e393a5f6-9c4f-4a00-9303-00a87155de3f tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:23.666658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393a5f6-9c4f-4a00-9303-00a87155de3f tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:23.670924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e393a5f6-9c4f-4a00-9303-00a87155de3f tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:23.740978 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1264/2548] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:12:23 2022] POST /identity/v3/users => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:12:23.742160 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d7067-206d-4d32-a4ef-8135d018f2db tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:23.769281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d7067-206d-4d32-a4ef-8135d018f2db tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:23.779989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ee746-0116-48c3-9e12-bb242eddfcbb tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46ce1da78b684d7b83412b17f9d55471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cec62de4581401f90cdd189decae079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:23.780618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ee746-0116-48c3-9e12-bb242eddfcbb tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:23.781112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ee746-0116-48c3-9e12-bb242eddfcbb tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:23.781387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ee746-0116-48c3-9e12-bb242eddfcbb tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:23.782692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ee746-0116-48c3-9e12-bb242eddfcbb tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:12:23.783689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ee746-0116-48c3-9e12-bb242eddfcbb tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:23.785587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ee746-0116-48c3-9e12-bb242eddfcbb tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:23.809914 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1285/2549] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:12:23.902847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6c280-c21e-4c6b-88e3-b774cf86d1b8 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:23.903605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6c280-c21e-4c6b-88e3-b774cf86d1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:23.904230 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6c280-c21e-4c6b-88e3-b774cf86d1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:23.939092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-42c6c280-c21e-4c6b-88e3-b774cf86d1b8 None None] MFA Rules not processed for user `cc0200a0753e46399d0b212c665aebce`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:12:23.939375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-42c6c280-c21e-4c6b-88e3-b774cf86d1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:24.039679 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1265/2550] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:12:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:12:24.047728 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daf692-be4b-45e6-98ca-9f956f45c598 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:24.048446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daf692-be4b-45e6-98ca-9f956f45c598 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:24.049835 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2daf692-be4b-45e6-98ca-9f956f45c598 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:24.050945 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1286/2551] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:12:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:12:24.056614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6c280-c21e-4c6b-88e3-b774cf86d1b8 None None] Authenticating service token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:12:24.076196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6c280-c21e-4c6b-88e3-b774cf86d1b8 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:24.091458 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6c280-c21e-4c6b-88e3-b774cf86d1b8 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:24.096354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50576f3a-925b-4921-a5e7-c1b03c653481 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46ce1da78b684d7b83412b17f9d55471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cec62de4581401f90cdd189decae079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:24.096928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50576f3a-925b-4921-a5e7-c1b03c653481 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:24.097210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50576f3a-925b-4921-a5e7-c1b03c653481 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:24.097531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50576f3a-925b-4921-a5e7-c1b03c653481 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] PATH_INFO: `/v3/projects/83da20dfe5d04940b1e1895997513baf` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:24.099071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50576f3a-925b-4921-a5e7-c1b03c653481 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: Authorizing `identity:get_project(project_id=83da20dfe5d04940b1e1895997513baf)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:24.101283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50576f3a-925b-4921-a5e7-c1b03c653481 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:24.103251 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1266/2552] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:12:24 2022] GET /identity/v3/projects/83da20dfe5d04940b1e1895997513baf => generated 371 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:12:24.691064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672b8d4-3d21-41a7-959c-3f2684dd0f86 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:24.691064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672b8d4-3d21-41a7-959c-3f2684dd0f86 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:24.691064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672b8d4-3d21-41a7-959c-3f2684dd0f86 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:24.692957 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1287/2553] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:12:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:12:24.702371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50576f3a-925b-4921-a5e7-c1b03c653481 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Authenticating service token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:12:24.727773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50576f3a-925b-4921-a5e7-c1b03c653481 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:24.744623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50576f3a-925b-4921-a5e7-c1b03c653481 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:24.752694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34118dad-b2d0-4da5-98fc-2bb350997027 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46ce1da78b684d7b83412b17f9d55471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cec62de4581401f90cdd189decae079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:24.753730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34118dad-b2d0-4da5-98fc-2bb350997027 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:24.754529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34118dad-b2d0-4da5-98fc-2bb350997027 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:24.755344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34118dad-b2d0-4da5-98fc-2bb350997027 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] PATH_INFO: `/v3/projects/83da20dfe5d04940b1e1895997513baf` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:24.757683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34118dad-b2d0-4da5-98fc-2bb350997027 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: Authorizing `identity:get_project(project_id=83da20dfe5d04940b1e1895997513baf)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:24.761854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34118dad-b2d0-4da5-98fc-2bb350997027 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:24.764938 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1267/2554] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:12:24 2022] GET /identity/v3/projects/83da20dfe5d04940b1e1895997513baf => generated 371 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:12:24.815812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672b8d4-3d21-41a7-959c-3f2684dd0f86 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:24.844552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672b8d4-3d21-41a7-959c-3f2684dd0f86 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:24.855426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af70f53-003a-4cd7-b351-ab96afeb8e9c tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46ce1da78b684d7b83412b17f9d55471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cec62de4581401f90cdd189decae079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:24.858377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af70f53-003a-4cd7-b351-ab96afeb8e9c tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:24.859683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af70f53-003a-4cd7-b351-ab96afeb8e9c tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:24.860192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af70f53-003a-4cd7-b351-ab96afeb8e9c tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] PATH_INFO: `/v3/users/3fd6d55b125c4e17bed6aa3f2e1de358` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:24.889679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af70f53-003a-4cd7-b351-ab96afeb8e9c tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3fd6d55b125c4e17bed6aa3f2e1de358)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:24.894706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af70f53-003a-4cd7-b351-ab96afeb8e9c tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:24.968903 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:25.032075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8af70f53-003a-4cd7-b351-ab96afeb8e9c tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fd6d55b125c4e17bed6aa3f2e1de358'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:25.047125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8af70f53-003a-4cd7-b351-ab96afeb8e9c tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fd6d55b125c4e17bed6aa3f2e1de358'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:25.076901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8af70f53-003a-4cd7-b351-ab96afeb8e9c tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fd6d55b125c4e17bed6aa3f2e1de358'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:25.079771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8af70f53-003a-4cd7-b351-ab96afeb8e9c tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fd6d55b125c4e17bed6aa3f2e1de358'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:25.106931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8af70f53-003a-4cd7-b351-ab96afeb8e9c tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fd6d55b125c4e17bed6aa3f2e1de358'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:25.136091 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34118dad-b2d0-4da5-98fc-2bb350997027 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:25.137871 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1288/2555] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:12:24 2022] DELETE /identity/v3/users/3fd6d55b125c4e17bed6aa3f2e1de358 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:12:25.141274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-34118dad-b2d0-4da5-98fc-2bb350997027 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:25.178316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34118dad-b2d0-4da5-98fc-2bb350997027 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:25.361906 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13ed72-03ca-4197-a746-432fa8abe5f6 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46ce1da78b684d7b83412b17f9d55471', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cec62de4581401f90cdd189decae079', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:25.362811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13ed72-03ca-4197-a746-432fa8abe5f6 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:25.363145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13ed72-03ca-4197-a746-432fa8abe5f6 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:25.363438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13ed72-03ca-4197-a746-432fa8abe5f6 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] PATH_INFO: `/v3/projects/83da20dfe5d04940b1e1895997513baf` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:25.365145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13ed72-03ca-4197-a746-432fa8abe5f6 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: Authorizing `identity:delete_project(project_id=83da20dfe5d04940b1e1895997513baf)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:25.368176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13ed72-03ca-4197-a746-432fa8abe5f6 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:25.442103 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:25.480189 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cb13ed72-03ca-4197-a746-432fa8abe5f6 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83da20dfe5d04940b1e1895997513baf', 'request_id': 'req-cb13ed72-03ca-4197-a746-432fa8abe5f6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:25.492875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cb13ed72-03ca-4197-a746-432fa8abe5f6 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83da20dfe5d04940b1e1895997513baf', 'request_id': 'req-cb13ed72-03ca-4197-a746-432fa8abe5f6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:25.503060 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cb13ed72-03ca-4197-a746-432fa8abe5f6 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83da20dfe5d04940b1e1895997513baf', 'request_id': 'req-cb13ed72-03ca-4197-a746-432fa8abe5f6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:25.531535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cb13ed72-03ca-4197-a746-432fa8abe5f6 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] The token cache is being invalidate because project 83da20dfe5d04940b1e1895997513baf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:12:25.532111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cb13ed72-03ca-4197-a746-432fa8abe5f6 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:25.533321 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cb13ed72-03ca-4197-a746-432fa8abe5f6 tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:25.536536 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1268/2556] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:12:25 2022] DELETE /identity/v3/projects/83da20dfe5d04940b1e1895997513baf => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:12:25.545605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af70f53-003a-4cd7-b351-ab96afeb8e9c tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:25.547511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8af70f53-003a-4cd7-b351-ab96afeb8e9c tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:25.707962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af70f53-003a-4cd7-b351-ab96afeb8e9c tempest-QuotasAdminTestV257-120391679 tempest-QuotasAdminTestV257-120391679-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:25.827817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064150fe-356d-41c6-af12-4b69c12b0909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:25.828621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064150fe-356d-41c6-af12-4b69c12b0909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:25.829109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064150fe-356d-41c6-af12-4b69c12b0909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:25.829737 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064150fe-356d-41c6-af12-4b69c12b0909 admin admin] PATH_INFO: `/v3/users/126d18c747e64805a6e4e9c81f41d05e` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:25.833182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064150fe-356d-41c6-af12-4b69c12b0909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=126d18c747e64805a6e4e9c81f41d05e)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:25.836620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064150fe-356d-41c6-af12-4b69c12b0909 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:25.939002 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:25.947591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-064150fe-356d-41c6-af12-4b69c12b0909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '126d18c747e64805a6e4e9c81f41d05e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:25.974371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-064150fe-356d-41c6-af12-4b69c12b0909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '126d18c747e64805a6e4e9c81f41d05e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:26.011106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-064150fe-356d-41c6-af12-4b69c12b0909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '126d18c747e64805a6e4e9c81f41d05e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:26.013044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-064150fe-356d-41c6-af12-4b69c12b0909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '126d18c747e64805a6e4e9c81f41d05e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:26.029507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-064150fe-356d-41c6-af12-4b69c12b0909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '126d18c747e64805a6e4e9c81f41d05e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:26.048234 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1289/2557] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:12:25 2022] DELETE /identity/v3/users/126d18c747e64805a6e4e9c81f41d05e => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:12:26.053591 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a85460-7208-4702-af8b-008dd10e2361 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:26.054297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a85460-7208-4702-af8b-008dd10e2361 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:26.054297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a85460-7208-4702-af8b-008dd10e2361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:26.085379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-19a85460-7208-4702-af8b-008dd10e2361 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:12:26.087023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-19a85460-7208-4702-af8b-008dd10e2361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:26.224594 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1269/2558] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:12:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:12:26.237463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064150fe-356d-41c6-af12-4b69c12b0909 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:26.239394 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-064150fe-356d-41c6-af12-4b69c12b0909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:26.334390 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064150fe-356d-41c6-af12-4b69c12b0909 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:26.338830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafb6d2-3be3-45ae-a4e8-acee672a9b0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:26.339473 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafb6d2-3be3-45ae-a4e8-acee672a9b0b service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:26.339796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafb6d2-3be3-45ae-a4e8-acee672a9b0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:26.340104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafb6d2-3be3-45ae-a4e8-acee672a9b0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:26.352250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaafb6d2-3be3-45ae-a4e8-acee672a9b0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:26.353837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaafb6d2-3be3-45ae-a4e8-acee672a9b0b service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:26.368184 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1290/2559] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:12:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:12:27.546689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a85460-7208-4702-af8b-008dd10e2361 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:27.550426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-19a85460-7208-4702-af8b-008dd10e2361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:27.594060 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a85460-7208-4702-af8b-008dd10e2361 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:27.617029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce58b1-97f8-4449-b5a7-438b32305a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:27.618507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce58b1-97f8-4449-b5a7-438b32305a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:27.619620 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce58b1-97f8-4449-b5a7-438b32305a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:27.622339 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce58b1-97f8-4449-b5a7-438b32305a0f admin admin] PATH_INFO: `/v3/projects/5d9d0ab4f54745b9a82dc911edc73656` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:27.629366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce58b1-97f8-4449-b5a7-438b32305a0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d9d0ab4f54745b9a82dc911edc73656)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:27.633578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce58b1-97f8-4449-b5a7-438b32305a0f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:27.810449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-51ce58b1-97f8-4449-b5a7-438b32305a0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d9d0ab4f54745b9a82dc911edc73656', 'request_id': 'req-51ce58b1-97f8-4449-b5a7-438b32305a0f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:27.866992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-51ce58b1-97f8-4449-b5a7-438b32305a0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d9d0ab4f54745b9a82dc911edc73656', 'request_id': 'req-51ce58b1-97f8-4449-b5a7-438b32305a0f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:27.919017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-51ce58b1-97f8-4449-b5a7-438b32305a0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d9d0ab4f54745b9a82dc911edc73656', 'request_id': 'req-51ce58b1-97f8-4449-b5a7-438b32305a0f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:27.954383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-51ce58b1-97f8-4449-b5a7-438b32305a0f admin admin] The token cache is being invalidate because project 5d9d0ab4f54745b9a82dc911edc73656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:12:27.955125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-51ce58b1-97f8-4449-b5a7-438b32305a0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:27.957638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-51ce58b1-97f8-4449-b5a7-438b32305a0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:27.976482 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1270/2560] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:12:27 2022] DELETE /identity/v3/projects/5d9d0ab4f54745b9a82dc911edc73656 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:12:27.978996 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafb6d2-3be3-45ae-a4e8-acee672a9b0b service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:28.013537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafb6d2-3be3-45ae-a4e8-acee672a9b0b service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:28.132123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46ff76-e99f-460e-945f-89c8b5ef863d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:28.132828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46ff76-e99f-460e-945f-89c8b5ef863d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:28.133098 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46ff76-e99f-460e-945f-89c8b5ef863d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:28.133548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf46ff76-e99f-460e-945f-89c8b5ef863d admin admin] PATH_INFO: `/v3/users/46ce1da78b684d7b83412b17f9d55471` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:28.135171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46ff76-e99f-460e-945f-89c8b5ef863d admin admin] RBAC: Authorizing `identity:delete_user(user_id=46ce1da78b684d7b83412b17f9d55471)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:28.137538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf46ff76-e99f-460e-945f-89c8b5ef863d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:28.235790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cf46ff76-e99f-460e-945f-89c8b5ef863d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46ce1da78b684d7b83412b17f9d55471'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:28.254769 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cf46ff76-e99f-460e-945f-89c8b5ef863d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46ce1da78b684d7b83412b17f9d55471'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:28.277377 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:28.285525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cf46ff76-e99f-460e-945f-89c8b5ef863d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46ce1da78b684d7b83412b17f9d55471'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:28.286409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cf46ff76-e99f-460e-945f-89c8b5ef863d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46ce1da78b684d7b83412b17f9d55471'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:28.306771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cf46ff76-e99f-460e-945f-89c8b5ef863d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46ce1da78b684d7b83412b17f9d55471'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:28.331242 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1291/2561] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:12:27 2022] DELETE /identity/v3/users/46ce1da78b684d7b83412b17f9d55471 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:12:29.241454 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce58b1-97f8-4449-b5a7-438b32305a0f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:29.244563 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-51ce58b1-97f8-4449-b5a7-438b32305a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:29.389625 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:29.468055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce58b1-97f8-4449-b5a7-438b32305a0f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:29.602343 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa88037-7482-4e1f-9d53-7a5d939548a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:29.603576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa88037-7482-4e1f-9d53-7a5d939548a3 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:29.604204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa88037-7482-4e1f-9d53-7a5d939548a3 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:29.604784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa88037-7482-4e1f-9d53-7a5d939548a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:29.608291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-faa88037-7482-4e1f-9d53-7a5d939548a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:29.634229 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa88037-7482-4e1f-9d53-7a5d939548a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:29.641068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa88037-7482-4e1f-9d53-7a5d939548a3 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:29.670790 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1271/2562] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:12:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:12:29.797869 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46ff76-e99f-460e-945f-89c8b5ef863d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:29.801828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-cf46ff76-e99f-460e-945f-89c8b5ef863d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:30.019648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf46ff76-e99f-460e-945f-89c8b5ef863d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:30.030693 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b19524-395e-44bc-a998-9b0f519547a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:30.031707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b19524-395e-44bc-a998-9b0f519547a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:30.032096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b19524-395e-44bc-a998-9b0f519547a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:30.032437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b19524-395e-44bc-a998-9b0f519547a3 admin admin] PATH_INFO: `/v3/projects/1cec62de4581401f90cdd189decae079` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:30.034378 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b19524-395e-44bc-a998-9b0f519547a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cec62de4581401f90cdd189decae079)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:30.039010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b19524-395e-44bc-a998-9b0f519547a3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:30.135547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-09b19524-395e-44bc-a998-9b0f519547a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cec62de4581401f90cdd189decae079', 'request_id': 'req-09b19524-395e-44bc-a998-9b0f519547a3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:30.148014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-09b19524-395e-44bc-a998-9b0f519547a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cec62de4581401f90cdd189decae079', 'request_id': 'req-09b19524-395e-44bc-a998-9b0f519547a3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:30.160458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-09b19524-395e-44bc-a998-9b0f519547a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cec62de4581401f90cdd189decae079', 'request_id': 'req-09b19524-395e-44bc-a998-9b0f519547a3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:30.188519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-09b19524-395e-44bc-a998-9b0f519547a3 admin admin] The token cache is being invalidate because project 1cec62de4581401f90cdd189decae079 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:12:30.189142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-09b19524-395e-44bc-a998-9b0f519547a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:30.190407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-09b19524-395e-44bc-a998-9b0f519547a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:30.192813 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1292/2563] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:12:29 2022] DELETE /identity/v3/projects/1cec62de4581401f90cdd189decae079 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:12:30.204817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7918eb-ae93-459b-8f07-31a208c60e02 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:30.205874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7918eb-ae93-459b-8f07-31a208c60e02 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:30.206360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7918eb-ae93-459b-8f07-31a208c60e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:30.244423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9b7918eb-ae93-459b-8f07-31a208c60e02 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:12:30.246606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9b7918eb-ae93-459b-8f07-31a208c60e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:30.401781 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1272/2564] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:12:30.402862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630fe5a-249b-4e82-b769-82a61a2e5c52 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:30.403351 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630fe5a-249b-4e82-b769-82a61a2e5c52 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:30.403828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630fe5a-249b-4e82-b769-82a61a2e5c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:30.445622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3630fe5a-249b-4e82-b769-82a61a2e5c52 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:12:30.448229 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3630fe5a-249b-4e82-b769-82a61a2e5c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:30.464559 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1293/2565] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:12:30.472012 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7918eb-ae93-459b-8f07-31a208c60e02 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:30.505666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7918eb-ae93-459b-8f07-31a208c60e02 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:30.518623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1f65c-1d4e-40d1-8103-e583431c29fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:30.520895 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1f65c-1d4e-40d1-8103-e583431c29fe admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:30.522222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1f65c-1d4e-40d1-8103-e583431c29fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:30.523601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1f65c-1d4e-40d1-8103-e583431c29fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:30.525749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1f65c-1d4e-40d1-8103-e583431c29fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:12:30.526420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1f65c-1d4e-40d1-8103-e583431c29fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:30.530250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1f65c-1d4e-40d1-8103-e583431c29fe admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:30.574846 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1273/2566] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:12:30.582851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630fe5a-249b-4e82-b769-82a61a2e5c52 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:30.616310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630fe5a-249b-4e82-b769-82a61a2e5c52 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:30.639945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ce512-7d13-4e0b-a27b-8503d2bf44d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:30.641035 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ce512-7d13-4e0b-a27b-8503d2bf44d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:30.641524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ce512-7d13-4e0b-a27b-8503d2bf44d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:30.642036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ce512-7d13-4e0b-a27b-8503d2bf44d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:30.647220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ce512-7d13-4e0b-a27b-8503d2bf44d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:30.652250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ce512-7d13-4e0b-a27b-8503d2bf44d4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:30.741199 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1294/2567] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:12:30 2022] POST /identity/v3/projects => generated 393 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:12:30.746584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1f65c-1d4e-40d1-8103-e583431c29fe admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:30.794941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1f65c-1d4e-40d1-8103-e583431c29fe admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:31.038989 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:31.089227 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d275f-38cf-42ff-84e4-ead6f4b7d24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:31.090482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d275f-38cf-42ff-84e4-ead6f4b7d24e admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:31.090991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d275f-38cf-42ff-84e4-ead6f4b7d24e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:31.091468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d275f-38cf-42ff-84e4-ead6f4b7d24e admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:31.092682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d275f-38cf-42ff-84e4-ead6f4b7d24e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:31.101722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d275f-38cf-42ff-84e4-ead6f4b7d24e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:31.161622 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1274/2568] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:12:30 2022] POST /identity/v3/users => generated 297 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:12:31.163073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ce512-7d13-4e0b-a27b-8503d2bf44d4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:31.185038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ce512-7d13-4e0b-a27b-8503d2bf44d4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:31.196556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357d1f2-e449-4f70-bc14-eda672416c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:31.198166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357d1f2-e449-4f70-bc14-eda672416c48 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:31.201195 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357d1f2-e449-4f70-bc14-eda672416c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:31.201708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357d1f2-e449-4f70-bc14-eda672416c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:31.202579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357d1f2-e449-4f70-bc14-eda672416c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:31.204682 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357d1f2-e449-4f70-bc14-eda672416c48 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:31.232306 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1295/2569] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:12:31.238158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d275f-38cf-42ff-84e4-ead6f4b7d24e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:31.256479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d275f-38cf-42ff-84e4-ead6f4b7d24e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:31.276125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b6adf-5b3e-4279-9583-0908aac3239b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:31.276824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b6adf-5b3e-4279-9583-0908aac3239b admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:31.277098 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b6adf-5b3e-4279-9583-0908aac3239b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:31.277374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b6adf-5b3e-4279-9583-0908aac3239b admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:31.278052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b6adf-5b3e-4279-9583-0908aac3239b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:31.279731 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b6adf-5b3e-4279-9583-0908aac3239b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:31.303244 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1275/2570] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:12:31.309246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357d1f2-e449-4f70-bc14-eda672416c48 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:31.328796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357d1f2-e449-4f70-bc14-eda672416c48 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:31.350025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42429c-9911-48a7-aceb-088298c8569a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:31.351591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42429c-9911-48a7-aceb-088298c8569a admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:31.353038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42429c-9911-48a7-aceb-088298c8569a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:31.353684 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42429c-9911-48a7-aceb-088298c8569a admin admin] PATH_INFO: `/v3/projects/380ac8cbc5d64648b03ab13bce91cfe4/users/80ec78e02379498e884758d48f5454fd/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:31.406748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42429c-9911-48a7-aceb-088298c8569a admin admin] RBAC: Authorizing `identity:create_grant(project_id=380ac8cbc5d64648b03ab13bce91cfe4, user_id=80ec78e02379498e884758d48f5454fd, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:31.410334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42429c-9911-48a7-aceb-088298c8569a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:31.447541 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1296/2571] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:12:31 2022] PUT /identity/v3/projects/380ac8cbc5d64648b03ab13bce91cfe4/users/80ec78e02379498e884758d48f5454fd/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:12:31.470839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea220db0-0d5f-4955-a708-e4f23fbbbd73 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:31.472254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea220db0-0d5f-4955-a708-e4f23fbbbd73 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:31.473260 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea220db0-0d5f-4955-a708-e4f23fbbbd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:31.523186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ea220db0-0d5f-4955-a708-e4f23fbbbd73 None None] MFA Rules not processed for user `80ec78e02379498e884758d48f5454fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:12:31.526115 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ea220db0-0d5f-4955-a708-e4f23fbbbd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:31.716750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42429c-9911-48a7-aceb-088298c8569a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:31.720168 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1276/2572] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:12:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:12:31.750854 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:31.843332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42429c-9911-48a7-aceb-088298c8569a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:31.852005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82378881-4114-40da-a450-856ede23cd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:31.853661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82378881-4114-40da-a450-856ede23cd4d admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:31.853900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82378881-4114-40da-a450-856ede23cd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:31.854232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82378881-4114-40da-a450-856ede23cd4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:31.856594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82378881-4114-40da-a450-856ede23cd4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:31.862360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82378881-4114-40da-a450-856ede23cd4d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:31.926724 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1297/2573] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:12:31 2022] POST /identity/v3/projects => generated 393 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:12:31.934774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea220db0-0d5f-4955-a708-e4f23fbbbd73 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:31.958295 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea220db0-0d5f-4955-a708-e4f23fbbbd73 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:32.128293 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a191769-69f9-47e8-847c-41269e0f1d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:32.129182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a191769-69f9-47e8-847c-41269e0f1d06 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:32.129558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a191769-69f9-47e8-847c-41269e0f1d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:32.130008 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a191769-69f9-47e8-847c-41269e0f1d06 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:32.130949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a191769-69f9-47e8-847c-41269e0f1d06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:32.134266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a191769-69f9-47e8-847c-41269e0f1d06 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:32.188591 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1277/2574] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:12:31 2022] POST /identity/v3/users => generated 303 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:12:32.192799 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82378881-4114-40da-a450-856ede23cd4d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:32.224164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82378881-4114-40da-a450-856ede23cd4d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:32.234417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e780f7b-3a51-4de9-a302-bcc9ec8c347a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:32.236557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e780f7b-3a51-4de9-a302-bcc9ec8c347a admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:32.237302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e780f7b-3a51-4de9-a302-bcc9ec8c347a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:32.256148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e780f7b-3a51-4de9-a302-bcc9ec8c347a admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:32.257768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e780f7b-3a51-4de9-a302-bcc9ec8c347a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:32.263037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e780f7b-3a51-4de9-a302-bcc9ec8c347a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:32.323201 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1298/2575] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:12:32.329081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a191769-69f9-47e8-847c-41269e0f1d06 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:32.368482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a191769-69f9-47e8-847c-41269e0f1d06 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:32.391424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af535c0-ea01-4aad-b26b-91f1e1a9cada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:32.392965 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af535c0-ea01-4aad-b26b-91f1e1a9cada admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:32.393641 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af535c0-ea01-4aad-b26b-91f1e1a9cada admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:32.394285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af535c0-ea01-4aad-b26b-91f1e1a9cada admin admin] PATH_INFO: `/v3/projects/2ea36d93758041d090e40c076e3089c8/users/5b1d47cd2a9c4ffca3796a4fc4216751/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:32.456600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af535c0-ea01-4aad-b26b-91f1e1a9cada admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea36d93758041d090e40c076e3089c8, user_id=5b1d47cd2a9c4ffca3796a4fc4216751, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:32.462852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af535c0-ea01-4aad-b26b-91f1e1a9cada admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:32.504731 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1278/2576] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:12:32 2022] PUT /identity/v3/projects/2ea36d93758041d090e40c076e3089c8/users/5b1d47cd2a9c4ffca3796a4fc4216751/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:12:32.511616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e780f7b-3a51-4de9-a302-bcc9ec8c347a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:32.537197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e780f7b-3a51-4de9-a302-bcc9ec8c347a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:32.671722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f9d7a-38e3-4cad-8d7e-fd6ccb35a7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:32.675152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f9d7a-38e3-4cad-8d7e-fd6ccb35a7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:32.675960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f9d7a-38e3-4cad-8d7e-fd6ccb35a7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:32.679473 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f9d7a-38e3-4cad-8d7e-fd6ccb35a7d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:32.681196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f9d7a-38e3-4cad-8d7e-fd6ccb35a7d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:32.685422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f9d7a-38e3-4cad-8d7e-fd6ccb35a7d9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:32.711854 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1299/2577] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:12:32.716340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af535c0-ea01-4aad-b26b-91f1e1a9cada admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:32.761668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af535c0-ea01-4aad-b26b-91f1e1a9cada admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:32.786911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd42342-3d14-4811-a679-2c9b65b32a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:32.788859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd42342-3d14-4811-a679-2c9b65b32a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:32.789394 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd42342-3d14-4811-a679-2c9b65b32a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:32.789859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd42342-3d14-4811-a679-2c9b65b32a96 admin admin] PATH_INFO: `/v3/projects/2ea36d93758041d090e40c076e3089c8/users/5b1d47cd2a9c4ffca3796a4fc4216751/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:32.794404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd42342-3d14-4811-a679-2c9b65b32a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea36d93758041d090e40c076e3089c8, user_id=5b1d47cd2a9c4ffca3796a4fc4216751, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:32.800284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd42342-3d14-4811-a679-2c9b65b32a96 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:32.833297 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1279/2578] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:12:32 2022] PUT /identity/v3/projects/2ea36d93758041d090e40c076e3089c8/users/5b1d47cd2a9c4ffca3796a4fc4216751/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:12:32.854087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74298824-5ec7-465b-9b9d-1231f22d08a5 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:32.854595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74298824-5ec7-465b-9b9d-1231f22d08a5 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:32.854988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74298824-5ec7-465b-9b9d-1231f22d08a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:32.960141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-74298824-5ec7-465b-9b9d-1231f22d08a5 None None] MFA Rules not processed for user `5b1d47cd2a9c4ffca3796a4fc4216751`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:12:32.961811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-74298824-5ec7-465b-9b9d-1231f22d08a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:33.272701 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1300/2579] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:12:32 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:12:33.278847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486a9c6-da0e-4af6-a580-95ecb8ecd271 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:33.279337 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486a9c6-da0e-4af6-a580-95ecb8ecd271 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:33.279823 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486a9c6-da0e-4af6-a580-95ecb8ecd271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:33.356163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9486a9c6-da0e-4af6-a580-95ecb8ecd271 None None] MFA Rules not processed for user `80ec78e02379498e884758d48f5454fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:12:33.358173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9486a9c6-da0e-4af6-a580-95ecb8ecd271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:33.393338 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:33.484404 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57696f30-4e7c-4318-8356-e1d6835812f7 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:33.485379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57696f30-4e7c-4318-8356-e1d6835812f7 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:33.486746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57696f30-4e7c-4318-8356-e1d6835812f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:33.513501 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:33.527846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-57696f30-4e7c-4318-8356-e1d6835812f7 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:12:33.529962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-57696f30-4e7c-4318-8356-e1d6835812f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:33.544757 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1280/2580] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:12:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:12:33.555296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486a9c6-da0e-4af6-a580-95ecb8ecd271 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:33.560174 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9486a9c6-da0e-4af6-a580-95ecb8ecd271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:33.741415 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1301/2581] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:12:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:12:33.823386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486a9c6-da0e-4af6-a580-95ecb8ecd271 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:33.825734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57696f30-4e7c-4318-8356-e1d6835812f7 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:33.828069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-57696f30-4e7c-4318-8356-e1d6835812f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:33.843821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2ba3a-ff31-4439-8137-82884cdd5d24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:33.845517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2ba3a-ff31-4439-8137-82884cdd5d24 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:33.847390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2ba3a-ff31-4439-8137-82884cdd5d24 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:33.848256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2ba3a-ff31-4439-8137-82884cdd5d24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:33.867509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2ba3a-ff31-4439-8137-82884cdd5d24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:33.872378 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2ba3a-ff31-4439-8137-82884cdd5d24 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:33.898084 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1281/2582] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:12:33 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:12:34.032363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57696f30-4e7c-4318-8356-e1d6835812f7 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:34.042368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c60e9-6667-4c67-923a-52ffa7f0c20c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:34.043384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c60e9-6667-4c67-923a-52ffa7f0c20c service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:34.043847 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c60e9-6667-4c67-923a-52ffa7f0c20c service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:34.044341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c60e9-6667-4c67-923a-52ffa7f0c20c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:34.058144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c60e9-6667-4c67-923a-52ffa7f0c20c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:34.060365 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c60e9-6667-4c67-923a-52ffa7f0c20c service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:34.072204 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1302/2583] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:12:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:12:35.508001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a320ac5-7bd6-4ae4-aa93-1fe9bfe8d10e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:35.509250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a320ac5-7bd6-4ae4-aa93-1fe9bfe8d10e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:35.509842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a320ac5-7bd6-4ae4-aa93-1fe9bfe8d10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:35.560878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-4a320ac5-7bd6-4ae4-aa93-1fe9bfe8d10e None None] MFA Rules not processed for user `c135ba135fd946149ace9a86c7c52e80`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:12:35.562143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4a320ac5-7bd6-4ae4-aa93-1fe9bfe8d10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:35.657536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1f5ef-47a5-43d0-97a7-49cbaea4cdd4 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:35.658839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1f5ef-47a5-43d0-97a7-49cbaea4cdd4 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:35.658990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1f5ef-47a5-43d0-97a7-49cbaea4cdd4 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:35.662286 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1303/2584] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 01:12:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:12:35.682643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9482d2-f296-417a-b86a-e1adea1733b8 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:35.683051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9482d2-f296-417a-b86a-e1adea1733b8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:35.683530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9482d2-f296-417a-b86a-e1adea1733b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:35.724299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-7e9482d2-f296-417a-b86a-e1adea1733b8 None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:12:35.727915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7e9482d2-f296-417a-b86a-e1adea1733b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:35.736006 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1282/2585] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:12:35 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:12:35.993802 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1304/2586] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 01:12:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:12:36.028136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a320ac5-7bd6-4ae4-aa93-1fe9bfe8d10e None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:36.036749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4a320ac5-7bd6-4ae4-aa93-1fe9bfe8d10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:36.093215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a320ac5-7bd6-4ae4-aa93-1fe9bfe8d10e None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:36.102648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833910b-681f-4c86-849f-1da9a5dfbdd5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:36.103696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833910b-681f-4c86-849f-1da9a5dfbdd5 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:36.103848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833910b-681f-4c86-849f-1da9a5dfbdd5 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:36.104090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833910b-681f-4c86-849f-1da9a5dfbdd5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:36.131071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833910b-681f-4c86-849f-1da9a5dfbdd5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:36.134194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833910b-681f-4c86-849f-1da9a5dfbdd5 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:36.170050 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1283/2587] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:12:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:12:37.514591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9482d2-f296-417a-b86a-e1adea1733b8 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:37.519357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7e9482d2-f296-417a-b86a-e1adea1733b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:37.579374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9482d2-f296-417a-b86a-e1adea1733b8 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:37.609393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85759c1e-d305-4cde-a004-e4c09cfd6b1e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:37.614129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85759c1e-d305-4cde-a004-e4c09cfd6b1e service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:37.614695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85759c1e-d305-4cde-a004-e4c09cfd6b1e service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:37.615147 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85759c1e-d305-4cde-a004-e4c09cfd6b1e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:37.623639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-85759c1e-d305-4cde-a004-e4c09cfd6b1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:37.674834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85759c1e-d305-4cde-a004-e4c09cfd6b1e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:37.684655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85759c1e-d305-4cde-a004-e4c09cfd6b1e service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:37.741633 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1305/2588] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:12:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:12:38.299415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fd108-ce3c-4b5c-8fc0-715963afb0eb None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:38.300458 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fd108-ce3c-4b5c-8fc0-715963afb0eb None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:38.300909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fd108-ce3c-4b5c-8fc0-715963afb0eb None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:38.304177 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1284/2589] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 01:12:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:12:38.324697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ee740-1eac-49df-b3a1-19092a041f57 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:38.325731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ee740-1eac-49df-b3a1-19092a041f57 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:38.326308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ee740-1eac-49df-b3a1-19092a041f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:38.411200 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d89ee740-1eac-49df-b3a1-19092a041f57 None None] MFA Rules not processed for user `6c70d5a72d424db68de7c7b8257fe02c`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:12:38.431998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d89ee740-1eac-49df-b3a1-19092a041f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:38.513774 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1306/2590] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 01:12:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:12:38.537841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5fd108-ce3c-4b5c-8fc0-715963afb0eb None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:38.542721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7f5fd108-ce3c-4b5c-8fc0-715963afb0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:38.921550 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:39.032915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5fd108-ce3c-4b5c-8fc0-715963afb0eb None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:39.049544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f05d9-60ce-4b29-b5d4-eea53e15acd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:39.050722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f05d9-60ce-4b29-b5d4-eea53e15acd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:39.051265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f05d9-60ce-4b29-b5d4-eea53e15acd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:39.054370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f05d9-60ce-4b29-b5d4-eea53e15acd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:39.083853 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f05d9-60ce-4b29-b5d4-eea53e15acd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:39.086078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f05d9-60ce-4b29-b5d4-eea53e15acd9 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:39.138658 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1285/2591] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:12:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:12:39.194581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59535a2d-9b08-4e66-b83c-d3676264ece9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:39.195466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59535a2d-9b08-4e66-b83c-d3676264ece9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:39.195466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59535a2d-9b08-4e66-b83c-d3676264ece9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:39.240262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-59535a2d-9b08-4e66-b83c-d3676264ece9 None None] MFA Rules not processed for user `b219e01934fa477fbaa053cca586f01b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:12:39.242739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-59535a2d-9b08-4e66-b83c-d3676264ece9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:39.254332 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1307/2592] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 01:12:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:12:39.320613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f05d9-60ce-4b29-b5d4-eea53e15acd9 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:39.357074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f05d9-60ce-4b29-b5d4-eea53e15acd9 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:39.369712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d47cf-af8e-4c8d-949b-9fde278b22ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:39.372345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d47cf-af8e-4c8d-949b-9fde278b22ff service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:39.373258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d47cf-af8e-4c8d-949b-9fde278b22ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:39.375226 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d47cf-af8e-4c8d-949b-9fde278b22ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:39.435004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d47cf-af8e-4c8d-949b-9fde278b22ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:39.440266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d47cf-af8e-4c8d-949b-9fde278b22ff service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:39.514895 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1286/2593] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:12:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:12:49.225332 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:49.481451 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=14 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:12:55.560552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2dc9d-a728-4b22-adde-48dad08f19e1 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:55.561420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2dc9d-a728-4b22-adde-48dad08f19e1 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:55.561853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2dc9d-a728-4b22-adde-48dad08f19e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:55.662994 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b1d2dc9d-a728-4b22-adde-48dad08f19e1 None None] MFA Rules not processed for user `96d08a2479f847b4b06d6690f1aedb18`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:12:55.664257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b1d2dc9d-a728-4b22-adde-48dad08f19e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:55.839320 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1308/2594] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:12:55 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:12:59.141722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d47cf-af8e-4c8d-949b-9fde278b22ff service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:59.144016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cd8d47cf-af8e-4c8d-949b-9fde278b22ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:59.301242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d47cf-af8e-4c8d-949b-9fde278b22ff service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:12:59.309330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c765c-9801-46d2-9d22-bfcb2c5e8828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:12:59.310784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c765c-9801-46d2-9d22-bfcb2c5e8828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:59.310784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c765c-9801-46d2-9d22-bfcb2c5e8828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:59.310784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c765c-9801-46d2-9d22-bfcb2c5e8828 admin admin] PATH_INFO: `/v3/users/96da5d25cbbd4653b222290714febb05` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:59.312241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c765c-9801-46d2-9d22-bfcb2c5e8828 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96da5d25cbbd4653b222290714febb05)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:12:59.314309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c765c-9801-46d2-9d22-bfcb2c5e8828 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:12:59.506432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2b6c765c-9801-46d2-9d22-bfcb2c5e8828 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96da5d25cbbd4653b222290714febb05'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:59.533111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2b6c765c-9801-46d2-9d22-bfcb2c5e8828 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96da5d25cbbd4653b222290714febb05'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:59.561955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2b6c765c-9801-46d2-9d22-bfcb2c5e8828 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96da5d25cbbd4653b222290714febb05'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:59.563476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2b6c765c-9801-46d2-9d22-bfcb2c5e8828 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96da5d25cbbd4653b222290714febb05'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:59.641289 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2b6c765c-9801-46d2-9d22-bfcb2c5e8828 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96da5d25cbbd4653b222290714febb05'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:12:59.667571 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1287/2595] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:12:59 2022] DELETE /identity/v3/users/96da5d25cbbd4653b222290714febb05 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:12:59.674311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f221110-5249-49f8-8dd6-f7592edbe35e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:12:59.677989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f221110-5249-49f8-8dd6-f7592edbe35e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:12:59.677989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f221110-5249-49f8-8dd6-f7592edbe35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:12:59.727492 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0f221110-5249-49f8-8dd6-f7592edbe35e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:12:59.729160 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0f221110-5249-49f8-8dd6-f7592edbe35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:12:59.866785 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1309/2596] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:12:59.934418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c765c-9801-46d2-9d22-bfcb2c5e8828 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:12:59.938091 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2b6c765c-9801-46d2-9d22-bfcb2c5e8828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:00.322026 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c765c-9801-46d2-9d22-bfcb2c5e8828 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:00.335611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c163cc-2384-4cc2-99f0-cedbd5f9327b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:00.336672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c163cc-2384-4cc2-99f0-cedbd5f9327b service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:00.337165 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c163cc-2384-4cc2-99f0-cedbd5f9327b service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:00.338843 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c163cc-2384-4cc2-99f0-cedbd5f9327b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:00.352780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c163cc-2384-4cc2-99f0-cedbd5f9327b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:00.354381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c163cc-2384-4cc2-99f0-cedbd5f9327b service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:00.370702 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1288/2597] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:12:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:13:01.088168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f221110-5249-49f8-8dd6-f7592edbe35e None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:01.090825 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0f221110-5249-49f8-8dd6-f7592edbe35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:01.116816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f221110-5249-49f8-8dd6-f7592edbe35e None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:01.141032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba026f1-8e94-40eb-a7d1-a6772f5ec416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:01.141708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba026f1-8e94-40eb-a7d1-a6772f5ec416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:01.141972 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba026f1-8e94-40eb-a7d1-a6772f5ec416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:01.147218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba026f1-8e94-40eb-a7d1-a6772f5ec416 admin admin] PATH_INFO: `/v3/projects/b525a2b221d843c0b1ec95a81acc0159` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:01.152498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba026f1-8e94-40eb-a7d1-a6772f5ec416 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b525a2b221d843c0b1ec95a81acc0159)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:01.154962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba026f1-8e94-40eb-a7d1-a6772f5ec416 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:01.288212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7ba026f1-8e94-40eb-a7d1-a6772f5ec416 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b525a2b221d843c0b1ec95a81acc0159', 'request_id': 'req-7ba026f1-8e94-40eb-a7d1-a6772f5ec416'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:01.299503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7ba026f1-8e94-40eb-a7d1-a6772f5ec416 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b525a2b221d843c0b1ec95a81acc0159', 'request_id': 'req-7ba026f1-8e94-40eb-a7d1-a6772f5ec416'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:01.320897 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7ba026f1-8e94-40eb-a7d1-a6772f5ec416 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b525a2b221d843c0b1ec95a81acc0159', 'request_id': 'req-7ba026f1-8e94-40eb-a7d1-a6772f5ec416'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:01.358633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7ba026f1-8e94-40eb-a7d1-a6772f5ec416 admin admin] The token cache is being invalidate because project b525a2b221d843c0b1ec95a81acc0159 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:13:01.359607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7ba026f1-8e94-40eb-a7d1-a6772f5ec416 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:01.366660 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7ba026f1-8e94-40eb-a7d1-a6772f5ec416 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:01.371989 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1310/2598] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:13:01 2022] DELETE /identity/v3/projects/b525a2b221d843c0b1ec95a81acc0159 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:13:01.378013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c163cc-2384-4cc2-99f0-cedbd5f9327b service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:01.402168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c163cc-2384-4cc2-99f0-cedbd5f9327b service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:01.503084 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:01.651319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004e8ea-a1e5-4c77-8e06-ddab2b7ee25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:01.652527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004e8ea-a1e5-4c77-8e06-ddab2b7ee25c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:01.653161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004e8ea-a1e5-4c77-8e06-ddab2b7ee25c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:01.653704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004e8ea-a1e5-4c77-8e06-ddab2b7ee25c admin admin] PATH_INFO: `/v3/users/78bb2d3253f14b62864ab6cfb2577743` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:01.656977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004e8ea-a1e5-4c77-8e06-ddab2b7ee25c admin admin] RBAC: Authorizing `identity:delete_user(user_id=78bb2d3253f14b62864ab6cfb2577743)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:01.660851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004e8ea-a1e5-4c77-8e06-ddab2b7ee25c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:01.775123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5004e8ea-a1e5-4c77-8e06-ddab2b7ee25c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78bb2d3253f14b62864ab6cfb2577743'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:01.808763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5004e8ea-a1e5-4c77-8e06-ddab2b7ee25c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78bb2d3253f14b62864ab6cfb2577743'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:01.835259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5004e8ea-a1e5-4c77-8e06-ddab2b7ee25c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78bb2d3253f14b62864ab6cfb2577743'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:01.837529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5004e8ea-a1e5-4c77-8e06-ddab2b7ee25c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78bb2d3253f14b62864ab6cfb2577743'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:01.863582 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5004e8ea-a1e5-4c77-8e06-ddab2b7ee25c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78bb2d3253f14b62864ab6cfb2577743'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:01.884735 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1289/2599] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:13:01 2022] DELETE /identity/v3/users/78bb2d3253f14b62864ab6cfb2577743 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:13:02.834695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3834d-f535-474d-8987-136ced90e1ea None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:02.835306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3834d-f535-474d-8987-136ced90e1ea None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:02.835548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3834d-f535-474d-8987-136ced90e1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:02.908215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004e8ea-a1e5-4c77-8e06-ddab2b7ee25c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:02.910802 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5004e8ea-a1e5-4c77-8e06-ddab2b7ee25c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:02.925509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-52d3834d-f535-474d-8987-136ced90e1ea None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:02.932765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-52d3834d-f535-474d-8987-136ced90e1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:03.018186 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:03.146091 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1311/2600] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:13:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:13:03.167393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3834d-f535-474d-8987-136ced90e1ea None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:03.171485 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-52d3834d-f535-474d-8987-136ced90e1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:03.199652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004e8ea-a1e5-4c77-8e06-ddab2b7ee25c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:03.236710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3beed-8220-4980-a9e2-635242bd090d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:03.237378 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3beed-8220-4980-a9e2-635242bd090d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:03.237655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3beed-8220-4980-a9e2-635242bd090d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:03.237926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3beed-8220-4980-a9e2-635242bd090d admin admin] PATH_INFO: `/v3/projects/cf310fb8a76e4b43a6567b29f506c84e` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:03.242147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3beed-8220-4980-a9e2-635242bd090d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf310fb8a76e4b43a6567b29f506c84e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:03.244201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3beed-8220-4980-a9e2-635242bd090d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:03.463605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3834d-f535-474d-8987-136ced90e1ea None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:03.463832 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:03.491380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0bc3beed-8220-4980-a9e2-635242bd090d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf310fb8a76e4b43a6567b29f506c84e', 'request_id': 'req-0bc3beed-8220-4980-a9e2-635242bd090d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:03.526470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0bc3beed-8220-4980-a9e2-635242bd090d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf310fb8a76e4b43a6567b29f506c84e', 'request_id': 'req-0bc3beed-8220-4980-a9e2-635242bd090d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:03.542177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0bc3beed-8220-4980-a9e2-635242bd090d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf310fb8a76e4b43a6567b29f506c84e', 'request_id': 'req-0bc3beed-8220-4980-a9e2-635242bd090d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:03.584230 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0bc3beed-8220-4980-a9e2-635242bd090d admin admin] The token cache is being invalidate because project cf310fb8a76e4b43a6567b29f506c84e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:13:03.584934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0bc3beed-8220-4980-a9e2-635242bd090d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:03.588465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0bc3beed-8220-4980-a9e2-635242bd090d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:03.590961 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1290/2601] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:13:02 2022] DELETE /identity/v3/projects/cf310fb8a76e4b43a6567b29f506c84e => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:13:03.598386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac584e-f2ca-47f8-869b-b4753f3ac023 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:03.599293 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac584e-f2ca-47f8-869b-b4753f3ac023 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:03.599771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac584e-f2ca-47f8-869b-b4753f3ac023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:03.651024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96991748-629a-4d2c-b67d-bc09e1983c5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:03.651674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96991748-629a-4d2c-b67d-bc09e1983c5f service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:03.651997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96991748-629a-4d2c-b67d-bc09e1983c5f service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:03.652262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96991748-629a-4d2c-b67d-bc09e1983c5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:03.653106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-f0ac584e-f2ca-47f8-869b-b4753f3ac023 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:03.654373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f0ac584e-f2ca-47f8-869b-b4753f3ac023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:03.672550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-96991748-629a-4d2c-b67d-bc09e1983c5f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:03.832701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96991748-629a-4d2c-b67d-bc09e1983c5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:03.834394 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96991748-629a-4d2c-b67d-bc09e1983c5f service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:03.839363 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1291/2602] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:13:03.849349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21700dc4-b1d9-4176-aba2-bf9f95a2f188 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:03.849647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21700dc4-b1d9-4176-aba2-bf9f95a2f188 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:03.849949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21700dc4-b1d9-4176-aba2-bf9f95a2f188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:03.869606 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1312/2603] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:13:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:13:03.879056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-21700dc4-b1d9-4176-aba2-bf9f95a2f188 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:03.881700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-21700dc4-b1d9-4176-aba2-bf9f95a2f188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:03.896898 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1292/2604] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:13:03.897621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96991748-629a-4d2c-b67d-bc09e1983c5f service swift] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:03.912749 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96991748-629a-4d2c-b67d-bc09e1983c5f service swift] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:03.940843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479b7d8-de25-4d2e-b77d-9fef27cfdbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:03.941514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479b7d8-de25-4d2e-b77d-9fef27cfdbb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:03.941790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479b7d8-de25-4d2e-b77d-9fef27cfdbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:03.942068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479b7d8-de25-4d2e-b77d-9fef27cfdbb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:03.942802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1479b7d8-de25-4d2e-b77d-9fef27cfdbb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:13:03.943105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1479b7d8-de25-4d2e-b77d-9fef27cfdbb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:03.944899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1479b7d8-de25-4d2e-b77d-9fef27cfdbb9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:03.997205 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1313/2605] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:13:04.002982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21700dc4-b1d9-4176-aba2-bf9f95a2f188 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:04.018889 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21700dc4-b1d9-4176-aba2-bf9f95a2f188 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:04.035492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e030b1-1558-401f-9f6a-0d80f52a3dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:04.036436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e030b1-1558-401f-9f6a-0d80f52a3dbf admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:04.040013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e030b1-1558-401f-9f6a-0d80f52a3dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:04.040701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e030b1-1558-401f-9f6a-0d80f52a3dbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:04.041449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e030b1-1558-401f-9f6a-0d80f52a3dbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:04.047664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e030b1-1558-401f-9f6a-0d80f52a3dbf admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:04.119059 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1293/2606] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:13:04 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:13:04.121626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479b7d8-de25-4d2e-b77d-9fef27cfdbb9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:04.129480 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:04.139596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479b7d8-de25-4d2e-b77d-9fef27cfdbb9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:04.336971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b0684-a7cb-4d73-aa20-59112046c62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:04.340631 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b0684-a7cb-4d73-aa20-59112046c62f admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:04.341336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b0684-a7cb-4d73-aa20-59112046c62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:04.343150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b0684-a7cb-4d73-aa20-59112046c62f admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:04.344305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b0684-a7cb-4d73-aa20-59112046c62f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:04.351028 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b0684-a7cb-4d73-aa20-59112046c62f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:04.400366 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1314/2607] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:13:04 2022] POST /identity/v3/users => generated 292 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:13:04.404174 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e030b1-1558-401f-9f6a-0d80f52a3dbf admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:04.427664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e030b1-1558-401f-9f6a-0d80f52a3dbf admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:04.461270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1e91e-b4f2-4d57-bdb1-449233a6a991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:04.463954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1e91e-b4f2-4d57-bdb1-449233a6a991 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:04.463954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1e91e-b4f2-4d57-bdb1-449233a6a991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:04.463954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1e91e-b4f2-4d57-bdb1-449233a6a991 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:04.463954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1e91e-b4f2-4d57-bdb1-449233a6a991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:04.465611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1e91e-b4f2-4d57-bdb1-449233a6a991 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:04.526717 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1294/2608] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:13:04.531728 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b0684-a7cb-4d73-aa20-59112046c62f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:04.566764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b0684-a7cb-4d73-aa20-59112046c62f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:04.590974 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cadf7-1080-42d5-ab09-5581a9c3036d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:04.592865 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cadf7-1080-42d5-ab09-5581a9c3036d admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:04.594062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cadf7-1080-42d5-ab09-5581a9c3036d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:04.594519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cadf7-1080-42d5-ab09-5581a9c3036d admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:04.595639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cadf7-1080-42d5-ab09-5581a9c3036d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:04.598577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cadf7-1080-42d5-ab09-5581a9c3036d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:04.641581 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1315/2609] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:13:04.648577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1e91e-b4f2-4d57-bdb1-449233a6a991 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:04.675845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1e91e-b4f2-4d57-bdb1-449233a6a991 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:04.682465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c84bd4-81d8-4cb1-b703-892b89b704ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:04.688606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c84bd4-81d8-4cb1-b703-892b89b704ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:04.688919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c84bd4-81d8-4cb1-b703-892b89b704ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:04.689345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c84bd4-81d8-4cb1-b703-892b89b704ae admin admin] PATH_INFO: `/v3/projects/d08d010c14a64f759887be0d2364c6e4/users/32fc1959d8aa41eabcead217b9d7bc47/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:04.758589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c84bd4-81d8-4cb1-b703-892b89b704ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=d08d010c14a64f759887be0d2364c6e4, user_id=32fc1959d8aa41eabcead217b9d7bc47, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:04.763195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c84bd4-81d8-4cb1-b703-892b89b704ae admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:04.813015 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1295/2610] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:13:04 2022] PUT /identity/v3/projects/d08d010c14a64f759887be0d2364c6e4/users/32fc1959d8aa41eabcead217b9d7bc47/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:13:04.838212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5b2a7-5db9-431a-b85a-0d324284da5f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:04.838768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5b2a7-5db9-431a-b85a-0d324284da5f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:04.839193 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5b2a7-5db9-431a-b85a-0d324284da5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:04.928245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b1d5b2a7-5db9-431a-b85a-0d324284da5f None None] MFA Rules not processed for user `32fc1959d8aa41eabcead217b9d7bc47`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:04.929729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b1d5b2a7-5db9-431a-b85a-0d324284da5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:05.121828 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1316/2611] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:13:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:13:05.128940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c84bd4-81d8-4cb1-b703-892b89b704ae admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:05.372333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c84bd4-81d8-4cb1-b703-892b89b704ae admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:05.382219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960071f-7de2-4335-b59c-45cbf3c167af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:05.383027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960071f-7de2-4335-b59c-45cbf3c167af admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:05.383196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960071f-7de2-4335-b59c-45cbf3c167af admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:05.383501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5960071f-7de2-4335-b59c-45cbf3c167af admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:05.384331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960071f-7de2-4335-b59c-45cbf3c167af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:05.386688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5960071f-7de2-4335-b59c-45cbf3c167af admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:05.435430 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:05.460430 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1296/2612] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:13:05 2022] POST /identity/v3/projects => generated 381 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:13:05.465154 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5b2a7-5db9-431a-b85a-0d324284da5f None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:05.482228 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5b2a7-5db9-431a-b85a-0d324284da5f None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:05.638772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970e1f7-7359-4272-94f4-89766af30609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:05.639498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970e1f7-7359-4272-94f4-89766af30609 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:05.639782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970e1f7-7359-4272-94f4-89766af30609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:05.643325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970e1f7-7359-4272-94f4-89766af30609 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:05.644051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970e1f7-7359-4272-94f4-89766af30609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:05.646644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970e1f7-7359-4272-94f4-89766af30609 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:05.716342 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1317/2613] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:13:05 2022] POST /identity/v3/users => generated 297 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:13:05.722176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960071f-7de2-4335-b59c-45cbf3c167af admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:05.740396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5960071f-7de2-4335-b59c-45cbf3c167af admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:05.749154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe8d55-5e1a-40f1-99e1-31a7321dff85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:05.750362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe8d55-5e1a-40f1-99e1-31a7321dff85 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:05.750990 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe8d55-5e1a-40f1-99e1-31a7321dff85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:05.751466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe8d55-5e1a-40f1-99e1-31a7321dff85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:05.752422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe8d55-5e1a-40f1-99e1-31a7321dff85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:05.754500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe8d55-5e1a-40f1-99e1-31a7321dff85 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:05.780790 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1297/2614] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:13:05.789297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970e1f7-7359-4272-94f4-89766af30609 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:05.798429 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:05.808041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970e1f7-7359-4272-94f4-89766af30609 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:05.816256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e12ce9-5be0-40c2-a343-425a8bdd89a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:05.817072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e12ce9-5be0-40c2-a343-425a8bdd89a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:05.818136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e12ce9-5be0-40c2-a343-425a8bdd89a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:05.818136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e12ce9-5be0-40c2-a343-425a8bdd89a9 admin admin] PATH_INFO: `/v3/projects/a6d2b0cc41e54e5fbf25bafe59210a55/users/30200e98f11c4146a614cb47ad0f351e/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:05.866355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e12ce9-5be0-40c2-a343-425a8bdd89a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6d2b0cc41e54e5fbf25bafe59210a55, user_id=30200e98f11c4146a614cb47ad0f351e, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:05.871297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e12ce9-5be0-40c2-a343-425a8bdd89a9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:05.891250 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1318/2615] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:13:05 2022] PUT /identity/v3/projects/a6d2b0cc41e54e5fbf25bafe59210a55/users/30200e98f11c4146a614cb47ad0f351e/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:13:05.895460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe8d55-5e1a-40f1-99e1-31a7321dff85 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:05.935622 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe8d55-5e1a-40f1-99e1-31a7321dff85 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:06.034820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e455369-e86e-4fdd-931e-3204ca0a1dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:06.035605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e455369-e86e-4fdd-931e-3204ca0a1dec admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:06.036077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e455369-e86e-4fdd-931e-3204ca0a1dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:06.036250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e455369-e86e-4fdd-931e-3204ca0a1dec admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:06.036919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e455369-e86e-4fdd-931e-3204ca0a1dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:06.038565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e455369-e86e-4fdd-931e-3204ca0a1dec admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:06.058859 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1298/2616] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:13:06.064450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e12ce9-5be0-40c2-a343-425a8bdd89a9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:06.083084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e12ce9-5be0-40c2-a343-425a8bdd89a9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:06.090468 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc061ee-8b0f-4bd1-aaef-efddcac8553c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:06.091305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc061ee-8b0f-4bd1-aaef-efddcac8553c admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:06.091772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc061ee-8b0f-4bd1-aaef-efddcac8553c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:06.094071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc061ee-8b0f-4bd1-aaef-efddcac8553c admin admin] PATH_INFO: `/v3/projects/a6d2b0cc41e54e5fbf25bafe59210a55/users/30200e98f11c4146a614cb47ad0f351e/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:06.095683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc061ee-8b0f-4bd1-aaef-efddcac8553c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6d2b0cc41e54e5fbf25bafe59210a55, user_id=30200e98f11c4146a614cb47ad0f351e, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:06.098597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc061ee-8b0f-4bd1-aaef-efddcac8553c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:06.114347 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1319/2617] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:13:06 2022] PUT /identity/v3/projects/a6d2b0cc41e54e5fbf25bafe59210a55/users/30200e98f11c4146a614cb47ad0f351e/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:13:06.127606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9850b-9b78-48e2-89c6-b5223a404207 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:06.128384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9850b-9b78-48e2-89c6-b5223a404207 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:06.128384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9850b-9b78-48e2-89c6-b5223a404207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:06.166591 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-87f9850b-9b78-48e2-89c6-b5223a404207 None None] MFA Rules not processed for user `30200e98f11c4146a614cb47ad0f351e`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:06.168858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-87f9850b-9b78-48e2-89c6-b5223a404207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:06.305288 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1299/2618] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:13:06 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:13:06.324201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e116e-4c29-4e23-81db-7ed82e499255 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:06.324816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e116e-4c29-4e23-81db-7ed82e499255 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:06.325451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e116e-4c29-4e23-81db-7ed82e499255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:06.368765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-151e116e-4c29-4e23-81db-7ed82e499255 None None] MFA Rules not processed for user `32fc1959d8aa41eabcead217b9d7bc47`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:06.368765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-151e116e-4c29-4e23-81db-7ed82e499255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:06.480764 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1320/2619] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:13:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:13:06.578394 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9850b-9b78-48e2-89c6-b5223a404207 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:06.585327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-87f9850b-9b78-48e2-89c6-b5223a404207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:06.611618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e116e-4c29-4e23-81db-7ed82e499255 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:06.614229 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-151e116e-4c29-4e23-81db-7ed82e499255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:06.764477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e116e-4c29-4e23-81db-7ed82e499255 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:06.771045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2483bd-84a5-42c7-b642-61b19c2098d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:06.772499 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:06.773285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2483bd-84a5-42c7-b642-61b19c2098d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:06.773285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2483bd-84a5-42c7-b642-61b19c2098d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:06.773285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2483bd-84a5-42c7-b642-61b19c2098d8 admin admin] PATH_INFO: `/v3/users/cc0200a0753e46399d0b212c665aebce` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:06.777267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2483bd-84a5-42c7-b642-61b19c2098d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc0200a0753e46399d0b212c665aebce)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:06.779930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2483bd-84a5-42c7-b642-61b19c2098d8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:06.787101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9850b-9b78-48e2-89c6-b5223a404207 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:06.809110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710ac52-25f4-4944-9304-e857c6f42e9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:06.809110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710ac52-25f4-4944-9304-e857c6f42e9d service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:06.809110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710ac52-25f4-4944-9304-e857c6f42e9d service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:06.809110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710ac52-25f4-4944-9304-e857c6f42e9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:06.823272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710ac52-25f4-4944-9304-e857c6f42e9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:06.827865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710ac52-25f4-4944-9304-e857c6f42e9d service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:06.860349 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1300/2620] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:13:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:13:06.908355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cd2483bd-84a5-42c7-b642-61b19c2098d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc0200a0753e46399d0b212c665aebce'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:06.947280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cd2483bd-84a5-42c7-b642-61b19c2098d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc0200a0753e46399d0b212c665aebce'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:06.972660 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:06.979487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cd2483bd-84a5-42c7-b642-61b19c2098d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc0200a0753e46399d0b212c665aebce'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:06.988049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cd2483bd-84a5-42c7-b642-61b19c2098d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc0200a0753e46399d0b212c665aebce'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:07.007764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cd2483bd-84a5-42c7-b642-61b19c2098d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc0200a0753e46399d0b212c665aebce'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:07.026317 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1321/2621] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:13:06 2022] DELETE /identity/v3/users/cc0200a0753e46399d0b212c665aebce => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:13:07.032908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b3171-2758-4b06-8b32-8d918e2071dc None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:07.033281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b3171-2758-4b06-8b32-8d918e2071dc None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:07.033523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b3171-2758-4b06-8b32-8d918e2071dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:07.064512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c89b3171-2758-4b06-8b32-8d918e2071dc None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:07.065802 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c89b3171-2758-4b06-8b32-8d918e2071dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:07.218429 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1301/2622] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:13:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:13:07.232111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2483bd-84a5-42c7-b642-61b19c2098d8 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:07.234252 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-cd2483bd-84a5-42c7-b642-61b19c2098d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:07.337580 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2483bd-84a5-42c7-b642-61b19c2098d8 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:07.341965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa698124-ae71-425f-826a-2127bc9e0670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:07.342726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa698124-ae71-425f-826a-2127bc9e0670 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:07.343077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa698124-ae71-425f-826a-2127bc9e0670 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:07.343536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa698124-ae71-425f-826a-2127bc9e0670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:07.357590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa698124-ae71-425f-826a-2127bc9e0670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:07.359971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa698124-ae71-425f-826a-2127bc9e0670 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:07.375658 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1322/2623] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:13:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:13:07.842063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b3171-2758-4b06-8b32-8d918e2071dc None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:07.844266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c89b3171-2758-4b06-8b32-8d918e2071dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:07.881362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b3171-2758-4b06-8b32-8d918e2071dc None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:07.905525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062822d-6865-44c2-9095-f860d0dc758b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:07.906705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062822d-6865-44c2-9095-f860d0dc758b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:07.907059 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062822d-6865-44c2-9095-f860d0dc758b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:07.907548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062822d-6865-44c2-9095-f860d0dc758b admin admin] PATH_INFO: `/v3/projects/6a7279db9d4f497b8430fd45280b5da4` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:07.910658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062822d-6865-44c2-9095-f860d0dc758b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a7279db9d4f497b8430fd45280b5da4)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:07.914574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062822d-6865-44c2-9095-f860d0dc758b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:08.119129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0062822d-6865-44c2-9095-f860d0dc758b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a7279db9d4f497b8430fd45280b5da4', 'request_id': 'req-0062822d-6865-44c2-9095-f860d0dc758b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:08.140943 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0062822d-6865-44c2-9095-f860d0dc758b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a7279db9d4f497b8430fd45280b5da4', 'request_id': 'req-0062822d-6865-44c2-9095-f860d0dc758b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:08.155128 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0062822d-6865-44c2-9095-f860d0dc758b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a7279db9d4f497b8430fd45280b5da4', 'request_id': 'req-0062822d-6865-44c2-9095-f860d0dc758b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:08.184905 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0062822d-6865-44c2-9095-f860d0dc758b admin admin] The token cache is being invalidate because project 6a7279db9d4f497b8430fd45280b5da4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:13:08.185929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0062822d-6865-44c2-9095-f860d0dc758b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:08.188173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0062822d-6865-44c2-9095-f860d0dc758b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:08.191542 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1302/2624] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:13:07 2022] DELETE /identity/v3/projects/6a7279db9d4f497b8430fd45280b5da4 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:13:08.199348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa698124-ae71-425f-826a-2127bc9e0670 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:08.253658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa698124-ae71-425f-826a-2127bc9e0670 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:08.388387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07d966-5695-4943-b253-12c4c8a157a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:08.390573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07d966-5695-4943-b253-12c4c8a157a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:08.391034 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07d966-5695-4943-b253-12c4c8a157a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:08.391505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07d966-5695-4943-b253-12c4c8a157a7 admin admin] PATH_INFO: `/v3/users/423b935e72ae42d9a49b9b8390ab20d6` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:08.393832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07d966-5695-4943-b253-12c4c8a157a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=423b935e72ae42d9a49b9b8390ab20d6)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:08.398098 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07d966-5695-4943-b253-12c4c8a157a7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:08.567846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ce07d966-5695-4943-b253-12c4c8a157a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '423b935e72ae42d9a49b9b8390ab20d6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:08.588614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ce07d966-5695-4943-b253-12c4c8a157a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '423b935e72ae42d9a49b9b8390ab20d6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:08.637677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ce07d966-5695-4943-b253-12c4c8a157a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '423b935e72ae42d9a49b9b8390ab20d6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:08.639359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ce07d966-5695-4943-b253-12c4c8a157a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '423b935e72ae42d9a49b9b8390ab20d6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:08.674382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ce07d966-5695-4943-b253-12c4c8a157a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '423b935e72ae42d9a49b9b8390ab20d6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:08.691584 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1323/2625] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:13:08 2022] DELETE /identity/v3/users/423b935e72ae42d9a49b9b8390ab20d6 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:13:09.121811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062822d-6865-44c2-9095-f860d0dc758b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:09.124658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0062822d-6865-44c2-9095-f860d0dc758b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:09.150536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062822d-6865-44c2-9095-f860d0dc758b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:09.317571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ae5b7-44b7-4343-b26b-4444c014f1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:09.318583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ae5b7-44b7-4343-b26b-4444c014f1f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:09.319133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ae5b7-44b7-4343-b26b-4444c014f1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:09.319712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ae5b7-44b7-4343-b26b-4444c014f1f5 admin admin] PATH_INFO: `/v3/projects/eb582d220421404ba7f60af09d58fe62` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:09.321795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ae5b7-44b7-4343-b26b-4444c014f1f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb582d220421404ba7f60af09d58fe62)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:09.324885 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ae5b7-44b7-4343-b26b-4444c014f1f5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:09.355819 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:09.442690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f02ae5b7-44b7-4343-b26b-4444c014f1f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb582d220421404ba7f60af09d58fe62', 'request_id': 'req-f02ae5b7-44b7-4343-b26b-4444c014f1f5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:09.463029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f02ae5b7-44b7-4343-b26b-4444c014f1f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb582d220421404ba7f60af09d58fe62', 'request_id': 'req-f02ae5b7-44b7-4343-b26b-4444c014f1f5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:09.476923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f02ae5b7-44b7-4343-b26b-4444c014f1f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb582d220421404ba7f60af09d58fe62', 'request_id': 'req-f02ae5b7-44b7-4343-b26b-4444c014f1f5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:09.500704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f02ae5b7-44b7-4343-b26b-4444c014f1f5 admin admin] The token cache is being invalidate because project eb582d220421404ba7f60af09d58fe62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:13:09.501218 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f02ae5b7-44b7-4343-b26b-4444c014f1f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:09.502370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f02ae5b7-44b7-4343-b26b-4444c014f1f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:09.505135 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1303/2626] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:13:09 2022] DELETE /identity/v3/projects/eb582d220421404ba7f60af09d58fe62 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:13:09.512131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a6465-4809-450a-8e2e-216558bb0aa0 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:09.512131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a6465-4809-450a-8e2e-216558bb0aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:09.512131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a6465-4809-450a-8e2e-216558bb0aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:09.539421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-110a6465-4809-450a-8e2e-216558bb0aa0 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:09.541003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-110a6465-4809-450a-8e2e-216558bb0aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:09.548687 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:09.660196 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1324/2627] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:13:09.668312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046ad41-5e6d-44bf-8ee7-ed18cd5fc094 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:09.668581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046ad41-5e6d-44bf-8ee7-ed18cd5fc094 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:09.668861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046ad41-5e6d-44bf-8ee7-ed18cd5fc094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:09.714348 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1046ad41-5e6d-44bf-8ee7-ed18cd5fc094 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:09.715616 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1046ad41-5e6d-44bf-8ee7-ed18cd5fc094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:09.728538 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1304/2628] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:13:09.734613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a6465-4809-450a-8e2e-216558bb0aa0 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:09.756300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a6465-4809-450a-8e2e-216558bb0aa0 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:09.771278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b9a6f-c5c3-433c-94ec-469d6fb274a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:09.773804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b9a6f-c5c3-433c-94ec-469d6fb274a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:09.774292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b9a6f-c5c3-433c-94ec-469d6fb274a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:09.775582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466b9a6f-c5c3-433c-94ec-469d6fb274a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:09.777472 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b9a6f-c5c3-433c-94ec-469d6fb274a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:13:09.778114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b9a6f-c5c3-433c-94ec-469d6fb274a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:09.782763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466b9a6f-c5c3-433c-94ec-469d6fb274a7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:09.810229 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1325/2629] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:13:09.819507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046ad41-5e6d-44bf-8ee7-ed18cd5fc094 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:09.844374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046ad41-5e6d-44bf-8ee7-ed18cd5fc094 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:09.863690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fd92a-e182-49ef-ad3d-80a52940bfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:09.865025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fd92a-e182-49ef-ad3d-80a52940bfc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:09.865907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fd92a-e182-49ef-ad3d-80a52940bfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:09.866242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fd92a-e182-49ef-ad3d-80a52940bfc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:09.870426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712fd92a-e182-49ef-ad3d-80a52940bfc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:09.881064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712fd92a-e182-49ef-ad3d-80a52940bfc8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:09.978286 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1305/2630] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:13:09 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:13:09.985365 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b9a6f-c5c3-433c-94ec-469d6fb274a7 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:10.016663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466b9a6f-c5c3-433c-94ec-469d6fb274a7 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:10.149557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18366dc-86b4-44ce-8b8a-239629e568ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:10.149557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18366dc-86b4-44ce-8b8a-239629e568ac admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:10.149557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18366dc-86b4-44ce-8b8a-239629e568ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:10.150070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18366dc-86b4-44ce-8b8a-239629e568ac admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:10.150802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18366dc-86b4-44ce-8b8a-239629e568ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:10.153460 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18366dc-86b4-44ce-8b8a-239629e568ac admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:10.198639 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1326/2631] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:13:09 2022] POST /identity/v3/users => generated 288 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:13:10.203308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fd92a-e182-49ef-ad3d-80a52940bfc8 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:10.218860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fd92a-e182-49ef-ad3d-80a52940bfc8 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:10.226104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b09b75-7939-4237-bbbe-517e5f1d6ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:10.226934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b09b75-7939-4237-bbbe-517e5f1d6ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:10.227517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b09b75-7939-4237-bbbe-517e5f1d6ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:10.228502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b09b75-7939-4237-bbbe-517e5f1d6ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:10.229495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b09b75-7939-4237-bbbe-517e5f1d6ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:10.231873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b09b75-7939-4237-bbbe-517e5f1d6ac0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:10.251406 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1306/2632] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:13:10.252841 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18366dc-86b4-44ce-8b8a-239629e568ac admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:10.268951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18366dc-86b4-44ce-8b8a-239629e568ac admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:10.273554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54133f43-d4a1-4b33-8569-bb289eca88d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:10.274166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54133f43-d4a1-4b33-8569-bb289eca88d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:10.274536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54133f43-d4a1-4b33-8569-bb289eca88d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:10.274715 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54133f43-d4a1-4b33-8569-bb289eca88d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:10.275542 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54133f43-d4a1-4b33-8569-bb289eca88d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:10.277375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54133f43-d4a1-4b33-8569-bb289eca88d1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:10.279945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b09b75-7939-4237-bbbe-517e5f1d6ac0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:10.283167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e2b09b75-7939-4237-bbbe-517e5f1d6ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:10.293374 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1327/2633] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:13:10.298174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54133f43-d4a1-4b33-8569-bb289eca88d1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:10.308081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b09b75-7939-4237-bbbe-517e5f1d6ac0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:10.322644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa50637-e9d2-4bd8-91e5-32c51dbd0403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:10.323307 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa50637-e9d2-4bd8-91e5-32c51dbd0403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:10.323583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa50637-e9d2-4bd8-91e5-32c51dbd0403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:10.323922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa50637-e9d2-4bd8-91e5-32c51dbd0403 admin admin] PATH_INFO: `/v3/users/80ec78e02379498e884758d48f5454fd` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:10.329423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa50637-e9d2-4bd8-91e5-32c51dbd0403 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80ec78e02379498e884758d48f5454fd)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:10.331594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa50637-e9d2-4bd8-91e5-32c51dbd0403 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:10.339161 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54133f43-d4a1-4b33-8569-bb289eca88d1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:10.363676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0c5bf-92cf-4f74-be7f-f8cb608689de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:10.364588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0c5bf-92cf-4f74-be7f-f8cb608689de admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:10.364766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0c5bf-92cf-4f74-be7f-f8cb608689de admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:10.365039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0c5bf-92cf-4f74-be7f-f8cb608689de admin admin] PATH_INFO: `/v3/projects/1911abc893ef4c01aa80ca9079dea6e9/users/b945db9a6f7a4143a544b76be5e9af9f/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:10.404998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0c5bf-92cf-4f74-be7f-f8cb608689de admin admin] RBAC: Authorizing `identity:create_grant(project_id=1911abc893ef4c01aa80ca9079dea6e9, user_id=b945db9a6f7a4143a544b76be5e9af9f, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:10.408677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0c5bf-92cf-4f74-be7f-f8cb608689de admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:10.444559 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1328/2634] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:13:10 2022] PUT /identity/v3/projects/1911abc893ef4c01aa80ca9079dea6e9/users/b945db9a6f7a4143a544b76be5e9af9f/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:13:10.449723 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-caa50637-e9d2-4bd8-91e5-32c51dbd0403 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80ec78e02379498e884758d48f5454fd'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:10.456601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff3987-3ac2-4073-9e36-c3f0e79760f6 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:10.457150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff3987-3ac2-4073-9e36-c3f0e79760f6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:10.457980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff3987-3ac2-4073-9e36-c3f0e79760f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:10.471813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-caa50637-e9d2-4bd8-91e5-32c51dbd0403 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80ec78e02379498e884758d48f5454fd'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:10.499828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-caa50637-e9d2-4bd8-91e5-32c51dbd0403 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80ec78e02379498e884758d48f5454fd'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:10.500883 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-caa50637-e9d2-4bd8-91e5-32c51dbd0403 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80ec78e02379498e884758d48f5454fd'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:10.524303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-76ff3987-3ac2-4073-9e36-c3f0e79760f6 None None] MFA Rules not processed for user `b945db9a6f7a4143a544b76be5e9af9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:10.525447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-76ff3987-3ac2-4073-9e36-c3f0e79760f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:10.528345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-caa50637-e9d2-4bd8-91e5-32c51dbd0403 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80ec78e02379498e884758d48f5454fd'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:10.560989 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1307/2635] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:13:10 2022] DELETE /identity/v3/users/80ec78e02379498e884758d48f5454fd => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:13:10.585017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273339e0-2831-44df-a220-85faa78e6f36 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:10.585540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273339e0-2831-44df-a220-85faa78e6f36 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:10.586049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273339e0-2831-44df-a220-85faa78e6f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:10.591031 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:10.632144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-273339e0-2831-44df-a220-85faa78e6f36 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:10.632144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-273339e0-2831-44df-a220-85faa78e6f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:10.640575 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1329/2636] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:13:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:13:10.645826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff3987-3ac2-4073-9e36-c3f0e79760f6 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:10.647622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-76ff3987-3ac2-4073-9e36-c3f0e79760f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:10.736194 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:10.833256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff3987-3ac2-4073-9e36-c3f0e79760f6 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:10.838693 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201eaa07-ac01-41b3-a0ff-758028485ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:10.839423 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201eaa07-ac01-41b3-a0ff-758028485ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:10.839735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201eaa07-ac01-41b3-a0ff-758028485ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:10.840102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201eaa07-ac01-41b3-a0ff-758028485ee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:10.840844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201eaa07-ac01-41b3-a0ff-758028485ee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:10.843461 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1308/2637] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:13:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:13:10.843671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201eaa07-ac01-41b3-a0ff-758028485ee7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:10.873895 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273339e0-2831-44df-a220-85faa78e6f36 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:10.876570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-273339e0-2831-44df-a220-85faa78e6f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:10.891792 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1330/2638] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:13:10 2022] POST /identity/v3/projects => generated 373 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:13:10.896289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201eaa07-ac01-41b3-a0ff-758028485ee7 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:10.993602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273339e0-2831-44df-a220-85faa78e6f36 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:11.088285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201eaa07-ac01-41b3-a0ff-758028485ee7 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:11.109367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b073a9-84e6-4047-adf9-147e3683d077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:11.110008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b073a9-84e6-4047-adf9-147e3683d077 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:11.110284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b073a9-84e6-4047-adf9-147e3683d077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:11.110551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b073a9-84e6-4047-adf9-147e3683d077 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:11.111199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b073a9-84e6-4047-adf9-147e3683d077 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:11.113416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b073a9-84e6-4047-adf9-147e3683d077 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:11.148037 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e99b17-bf2f-4a1b-99c9-f6289cbc2dc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:11.148674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e99b17-bf2f-4a1b-99c9-f6289cbc2dc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:11.148955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e99b17-bf2f-4a1b-99c9-f6289cbc2dc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:11.149228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e99b17-bf2f-4a1b-99c9-f6289cbc2dc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:11.202079 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1331/2639] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:13:10 2022] POST /identity/v3/users => generated 293 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:13:11.203320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e99b17-bf2f-4a1b-99c9-f6289cbc2dc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:11.204369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b073a9-84e6-4047-adf9-147e3683d077 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:11.206621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e99b17-bf2f-4a1b-99c9-f6289cbc2dc2 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:11.224118 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1309/2640] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:13:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:13:11.246675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b073a9-84e6-4047-adf9-147e3683d077 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:11.250200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff38990-ecf6-45ed-95f3-49d3037b3190 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:11.251328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff38990-ecf6-45ed-95f3-49d3037b3190 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:11.252381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff38990-ecf6-45ed-95f3-49d3037b3190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:11.263744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc5df4-57e1-4afa-81e8-3db7d9b494af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:11.264662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc5df4-57e1-4afa-81e8-3db7d9b494af admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:11.265009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc5df4-57e1-4afa-81e8-3db7d9b494af admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:11.265818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc5df4-57e1-4afa-81e8-3db7d9b494af admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:11.267965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc5df4-57e1-4afa-81e8-3db7d9b494af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:11.273074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc5df4-57e1-4afa-81e8-3db7d9b494af admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:11.315270 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1332/2641] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:13:11.321260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc5df4-57e1-4afa-81e8-3db7d9b494af admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:11.330837 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-cff38990-ecf6-45ed-95f3-49d3037b3190 None None] MFA Rules not processed for user `0327f14a188e45fba98a58e5fd061248`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:11.349801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc5df4-57e1-4afa-81e8-3db7d9b494af admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:11.361666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cff38990-ecf6-45ed-95f3-49d3037b3190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:11.362944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb20bc3-c222-4206-83a4-e846f3df4b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:11.365903 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb20bc3-c222-4206-83a4-e846f3df4b5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:11.366254 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb20bc3-c222-4206-83a4-e846f3df4b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:11.366530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb20bc3-c222-4206-83a4-e846f3df4b5e admin admin] PATH_INFO: `/v3/projects/57856e905c9940819ef8a5bac1a1f66f/users/fd62e88119574de6b8a03ace83572773/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:11.426309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb20bc3-c222-4206-83a4-e846f3df4b5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=57856e905c9940819ef8a5bac1a1f66f, user_id=fd62e88119574de6b8a03ace83572773, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:11.432827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb20bc3-c222-4206-83a4-e846f3df4b5e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:11.458549 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1333/2642] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:13:11 2022] PUT /identity/v3/projects/57856e905c9940819ef8a5bac1a1f66f/users/fd62e88119574de6b8a03ace83572773/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:13:11.460203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb20bc3-c222-4206-83a4-e846f3df4b5e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:11.462328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3eb20bc3-c222-4206-83a4-e846f3df4b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:11.532581 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1310/2643] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:13:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:13:11.534062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff38990-ecf6-45ed-95f3-49d3037b3190 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:11.573447 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:11.588606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff38990-ecf6-45ed-95f3-49d3037b3190 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:11.732724 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:11.748830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb20bc3-c222-4206-83a4-e846f3df4b5e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:11.756708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4e7f1-4740-41f2-8682-299feebb3bcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:11.757599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4e7f1-4740-41f2-8682-299feebb3bcc service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:11.758043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4e7f1-4740-41f2-8682-299feebb3bcc service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:11.758731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4e7f1-4740-41f2-8682-299feebb3bcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:11.761316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd389e22-670f-4205-9953-6e437f56259d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:11.762086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-bde4e7f1-4740-41f2-8682-299feebb3bcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:11.762746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd389e22-670f-4205-9953-6e437f56259d admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:11.763277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd389e22-670f-4205-9953-6e437f56259d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:11.764032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd389e22-670f-4205-9953-6e437f56259d admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:11.766442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd389e22-670f-4205-9953-6e437f56259d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:11.770840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd389e22-670f-4205-9953-6e437f56259d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:11.794390 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1311/2644] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:13:11.798962 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd389e22-670f-4205-9953-6e437f56259d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:11.829557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd389e22-670f-4205-9953-6e437f56259d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:11.836502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e5182-e682-441e-b681-f90657413d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:11.837402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e5182-e682-441e-b681-f90657413d6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:11.837872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e5182-e682-441e-b681-f90657413d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:11.838796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e5182-e682-441e-b681-f90657413d6a admin admin] PATH_INFO: `/v3/projects/57856e905c9940819ef8a5bac1a1f66f/users/fd62e88119574de6b8a03ace83572773/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:11.841238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e5182-e682-441e-b681-f90657413d6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=57856e905c9940819ef8a5bac1a1f66f, user_id=fd62e88119574de6b8a03ace83572773, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:11.846480 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e5182-e682-441e-b681-f90657413d6a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:11.875918 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1312/2645] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:13:11 2022] PUT /identity/v3/projects/57856e905c9940819ef8a5bac1a1f66f/users/fd62e88119574de6b8a03ace83572773/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:13:11.875918 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c8060-e5ec-47a9-9c15-fdc8e43de16c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:11.875918 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c8060-e5ec-47a9-9c15-fdc8e43de16c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:11.875918 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c8060-e5ec-47a9-9c15-fdc8e43de16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:11.908103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4e7f1-4740-41f2-8682-299feebb3bcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:11.908429 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b55c8060-e5ec-47a9-9c15-fdc8e43de16c None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:11.908429 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b55c8060-e5ec-47a9-9c15-fdc8e43de16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:11.908814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4e7f1-4740-41f2-8682-299feebb3bcc service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:11.938779 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1334/2646] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:13:11 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:13:11.964871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228a51d-acd3-49cf-b3ac-5bd1f4de646d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:11.966021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228a51d-acd3-49cf-b3ac-5bd1f4de646d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:11.966738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228a51d-acd3-49cf-b3ac-5bd1f4de646d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:12.025249 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1313/2647] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:13:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:13:12.042708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c8060-e5ec-47a9-9c15-fdc8e43de16c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:12.044746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b55c8060-e5ec-47a9-9c15-fdc8e43de16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:12.072938 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a228a51d-acd3-49cf-b3ac-5bd1f4de646d None None] MFA Rules not processed for user `fd62e88119574de6b8a03ace83572773`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:12.074227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a228a51d-acd3-49cf-b3ac-5bd1f4de646d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:12.144989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c8060-e5ec-47a9-9c15-fdc8e43de16c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:12.151107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6cffd-452a-43e8-a37d-52b94c2562ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:12.152978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6cffd-452a-43e8-a37d-52b94c2562ac service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:12.153396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6cffd-452a-43e8-a37d-52b94c2562ac service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:12.153765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6cffd-452a-43e8-a37d-52b94c2562ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:12.166123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6cffd-452a-43e8-a37d-52b94c2562ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:12.167859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6cffd-452a-43e8-a37d-52b94c2562ac service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:12.208048 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1314/2648] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:13:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:13:12.356135 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1335/2649] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:13:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:13:12.370255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04621b-7c93-42bc-8408-e5bab01aa501 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:12.370583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04621b-7c93-42bc-8408-e5bab01aa501 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:12.370857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04621b-7c93-42bc-8408-e5bab01aa501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:12.496366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3f04621b-7c93-42bc-8408-e5bab01aa501 None None] MFA Rules not processed for user `b945db9a6f7a4143a544b76be5e9af9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:12.504566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3f04621b-7c93-42bc-8408-e5bab01aa501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:12.646942 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1315/2650] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:13:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:13:12.920095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228a51d-acd3-49cf-b3ac-5bd1f4de646d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:12.923308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a228a51d-acd3-49cf-b3ac-5bd1f4de646d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:13.081189 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:13.136379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228a51d-acd3-49cf-b3ac-5bd1f4de646d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:13.150100 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d320f4f-bc6b-4cb6-866a-d2aa3965cc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:13.151455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d320f4f-bc6b-4cb6-866a-d2aa3965cc3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:13.153983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d320f4f-bc6b-4cb6-866a-d2aa3965cc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:13.154912 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d320f4f-bc6b-4cb6-866a-d2aa3965cc3d admin admin] PATH_INFO: `/v3/projects/380ac8cbc5d64648b03ab13bce91cfe4` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:13.158339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d320f4f-bc6b-4cb6-866a-d2aa3965cc3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=380ac8cbc5d64648b03ab13bce91cfe4)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:13.171964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d320f4f-bc6b-4cb6-866a-d2aa3965cc3d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:13.277215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6d320f4f-bc6b-4cb6-866a-d2aa3965cc3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '380ac8cbc5d64648b03ab13bce91cfe4', 'request_id': 'req-6d320f4f-bc6b-4cb6-866a-d2aa3965cc3d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:13.287108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6d320f4f-bc6b-4cb6-866a-d2aa3965cc3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '380ac8cbc5d64648b03ab13bce91cfe4', 'request_id': 'req-6d320f4f-bc6b-4cb6-866a-d2aa3965cc3d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:13.300156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6d320f4f-bc6b-4cb6-866a-d2aa3965cc3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '380ac8cbc5d64648b03ab13bce91cfe4', 'request_id': 'req-6d320f4f-bc6b-4cb6-866a-d2aa3965cc3d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:13.325277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6d320f4f-bc6b-4cb6-866a-d2aa3965cc3d admin admin] The token cache is being invalidate because project 380ac8cbc5d64648b03ab13bce91cfe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:13:13.325651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6d320f4f-bc6b-4cb6-866a-d2aa3965cc3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:13.326514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6d320f4f-bc6b-4cb6-866a-d2aa3965cc3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:13.340687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04621b-7c93-42bc-8408-e5bab01aa501 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:13.343540 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1336/2651] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:13:12 2022] DELETE /identity/v3/projects/380ac8cbc5d64648b03ab13bce91cfe4 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:13:13.352635 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:13.361437 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04621b-7c93-42bc-8408-e5bab01aa501 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:13.582692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2170a2-a705-4a60-a68a-88756b956453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:13.583782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2170a2-a705-4a60-a68a-88756b956453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:13.584460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2170a2-a705-4a60-a68a-88756b956453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:13.585053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2170a2-a705-4a60-a68a-88756b956453 admin admin] PATH_INFO: `/v3/users/5b1d47cd2a9c4ffca3796a4fc4216751` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:13.587805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2170a2-a705-4a60-a68a-88756b956453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b1d47cd2a9c4ffca3796a4fc4216751)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:13.590130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2170a2-a705-4a60-a68a-88756b956453 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:13.731382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ca2170a2-a705-4a60-a68a-88756b956453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b1d47cd2a9c4ffca3796a4fc4216751'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:13.748094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ca2170a2-a705-4a60-a68a-88756b956453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b1d47cd2a9c4ffca3796a4fc4216751'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:13.840459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ca2170a2-a705-4a60-a68a-88756b956453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b1d47cd2a9c4ffca3796a4fc4216751'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:13.841886 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ca2170a2-a705-4a60-a68a-88756b956453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b1d47cd2a9c4ffca3796a4fc4216751'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:13.863921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ca2170a2-a705-4a60-a68a-88756b956453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b1d47cd2a9c4ffca3796a4fc4216751'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:13.876438 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1316/2652] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:13:13 2022] DELETE /identity/v3/users/5b1d47cd2a9c4ffca3796a4fc4216751 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:13:14.476206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d320f4f-bc6b-4cb6-866a-d2aa3965cc3d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:14.478572 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6d320f4f-bc6b-4cb6-866a-d2aa3965cc3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:14.907833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2170a2-a705-4a60-a68a-88756b956453 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:14.909959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ca2170a2-a705-4a60-a68a-88756b956453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:14.910173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d320f4f-bc6b-4cb6-866a-d2aa3965cc3d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:15.191565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2170a2-a705-4a60-a68a-88756b956453 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:15.217992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fb6ea-7908-45b3-8f52-6d5e39c9ed98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:15.225282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fb6ea-7908-45b3-8f52-6d5e39c9ed98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:15.225799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fb6ea-7908-45b3-8f52-6d5e39c9ed98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:15.227323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fb6ea-7908-45b3-8f52-6d5e39c9ed98 admin admin] PATH_INFO: `/v3/projects/2ea36d93758041d090e40c076e3089c8` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:15.230035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3fb6ea-7908-45b3-8f52-6d5e39c9ed98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ea36d93758041d090e40c076e3089c8)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:15.237468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3fb6ea-7908-45b3-8f52-6d5e39c9ed98 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:15.319370 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:15.377289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc45f7-1df3-4948-af07-7fc29e146a70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:15.378817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc45f7-1df3-4948-af07-7fc29e146a70 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:15.380702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc45f7-1df3-4948-af07-7fc29e146a70 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:15.381205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc45f7-1df3-4948-af07-7fc29e146a70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:15.387089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-cacc45f7-1df3-4948-af07-7fc29e146a70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:15.397704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8e3fb6ea-7908-45b3-8f52-6d5e39c9ed98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ea36d93758041d090e40c076e3089c8', 'request_id': 'req-8e3fb6ea-7908-45b3-8f52-6d5e39c9ed98'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:15.421791 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:15.437563 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8e3fb6ea-7908-45b3-8f52-6d5e39c9ed98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ea36d93758041d090e40c076e3089c8', 'request_id': 'req-8e3fb6ea-7908-45b3-8f52-6d5e39c9ed98'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:15.470242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8e3fb6ea-7908-45b3-8f52-6d5e39c9ed98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ea36d93758041d090e40c076e3089c8', 'request_id': 'req-8e3fb6ea-7908-45b3-8f52-6d5e39c9ed98'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:15.496251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8e3fb6ea-7908-45b3-8f52-6d5e39c9ed98 admin admin] The token cache is being invalidate because project 2ea36d93758041d090e40c076e3089c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:13:15.497501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8e3fb6ea-7908-45b3-8f52-6d5e39c9ed98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:15.500676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8e3fb6ea-7908-45b3-8f52-6d5e39c9ed98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:15.502570 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1317/2653] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:13:14 2022] DELETE /identity/v3/projects/2ea36d93758041d090e40c076e3089c8 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:13:15.510144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209dca3-899d-461e-8f43-34584abdcc38 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:15.510470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209dca3-899d-461e-8f43-34584abdcc38 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:15.510751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209dca3-899d-461e-8f43-34584abdcc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:15.565562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-4209dca3-899d-461e-8f43-34584abdcc38 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:15.568739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4209dca3-899d-461e-8f43-34584abdcc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:15.587462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc45f7-1df3-4948-af07-7fc29e146a70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:15.592509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc45f7-1df3-4948-af07-7fc29e146a70 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:15.623207 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1337/2654] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:13:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 1147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:13:15.731314 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1318/2655] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:13:15.838759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb46c5-4150-4ed0-9f37-5d5bc67d7376 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:15.839052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb46c5-4150-4ed0-9f37-5d5bc67d7376 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:15.839505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb46c5-4150-4ed0-9f37-5d5bc67d7376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:15.893638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-fabb46c5-4150-4ed0-9f37-5d5bc67d7376 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:15.896106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fabb46c5-4150-4ed0-9f37-5d5bc67d7376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:15.907496 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1338/2656] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:13:15.912404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209dca3-899d-461e-8f43-34584abdcc38 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:15.930844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209dca3-899d-461e-8f43-34584abdcc38 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:15.952268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed0ee0-4b4e-4296-acb0-7606feb0e07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:15.953212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed0ee0-4b4e-4296-acb0-7606feb0e07b admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:15.953613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed0ee0-4b4e-4296-acb0-7606feb0e07b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:15.954003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed0ee0-4b4e-4296-acb0-7606feb0e07b admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:15.954746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed0ee0-4b4e-4296-acb0-7606feb0e07b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:13:15.955053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed0ee0-4b4e-4296-acb0-7606feb0e07b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:15.958950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed0ee0-4b4e-4296-acb0-7606feb0e07b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:16.005650 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1319/2657] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:13:16.007943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb46c5-4150-4ed0-9f37-5d5bc67d7376 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:16.033063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb46c5-4150-4ed0-9f37-5d5bc67d7376 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:16.058483 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ec4b0-c135-4471-9b84-968db419f931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:16.062358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ec4b0-c135-4471-9b84-968db419f931 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:16.062784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ec4b0-c135-4471-9b84-968db419f931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:16.079978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ec4b0-c135-4471-9b84-968db419f931 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:16.082140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ec4b0-c135-4471-9b84-968db419f931 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:16.095359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ec4b0-c135-4471-9b84-968db419f931 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:16.275928 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1339/2658] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:13:16 2022] POST /identity/v3/projects => generated 373 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:13:16.277176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed0ee0-4b4e-4296-acb0-7606feb0e07b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:16.291956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed0ee0-4b4e-4296-acb0-7606feb0e07b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:16.671605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfb43d-a590-4ec3-b81d-815009857fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:16.672726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfb43d-a590-4ec3-b81d-815009857fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:16.673177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfb43d-a590-4ec3-b81d-815009857fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:16.673664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfb43d-a590-4ec3-b81d-815009857fa8 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:16.674835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdfb43d-a590-4ec3-b81d-815009857fa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:16.678789 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdfb43d-a590-4ec3-b81d-815009857fa8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:16.792533 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1320/2659] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:13:16 2022] POST /identity/v3/users => generated 287 bytes in 516 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:13:16.793857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ec4b0-c135-4471-9b84-968db419f931 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:16.823287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ec4b0-c135-4471-9b84-968db419f931 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:16.838472 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8dd23-13ed-4d96-a3fe-15efa0e667f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:16.839168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8dd23-13ed-4d96-a3fe-15efa0e667f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:16.839437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8dd23-13ed-4d96-a3fe-15efa0e667f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:16.839929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8dd23-13ed-4d96-a3fe-15efa0e667f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:16.841411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8dd23-13ed-4d96-a3fe-15efa0e667f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:16.855586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff8dd23-13ed-4d96-a3fe-15efa0e667f1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:16.922115 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1340/2660] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:13:16.929131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfb43d-a590-4ec3-b81d-815009857fa8 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:16.988421 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfb43d-a590-4ec3-b81d-815009857fa8 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:17.028948 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1359cbc-2970-4f00-b967-f251536871d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:17.030063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1359cbc-2970-4f00-b967-f251536871d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:17.030962 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1359cbc-2970-4f00-b967-f251536871d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:17.031477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1359cbc-2970-4f00-b967-f251536871d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:17.032801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1359cbc-2970-4f00-b967-f251536871d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:17.035918 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1359cbc-2970-4f00-b967-f251536871d2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:17.121246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8dd23-13ed-4d96-a3fe-15efa0e667f1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:17.122177 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1321/2661] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:13:17.136360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8dd23-13ed-4d96-a3fe-15efa0e667f1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:17.154253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e1634-b59a-49a4-97cd-1edeef39be0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:17.156209 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e1634-b59a-49a4-97cd-1edeef39be0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:17.158263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e1634-b59a-49a4-97cd-1edeef39be0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:17.158806 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e1634-b59a-49a4-97cd-1edeef39be0a admin admin] PATH_INFO: `/v3/projects/76537752718449e19d6ad94c8e3bc973/users/26994bfd2e094415bb9b6e265d52eeae/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:17.263306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e1634-b59a-49a4-97cd-1edeef39be0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=76537752718449e19d6ad94c8e3bc973, user_id=26994bfd2e094415bb9b6e265d52eeae, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:17.274973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e1634-b59a-49a4-97cd-1edeef39be0a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:17.321255 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1341/2662] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:13:17 2022] PUT /identity/v3/projects/76537752718449e19d6ad94c8e3bc973/users/26994bfd2e094415bb9b6e265d52eeae/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:13:17.326026 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971eeb01-7597-4f67-8e8f-01dba1357cf0 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:17.326340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971eeb01-7597-4f67-8e8f-01dba1357cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:17.326573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971eeb01-7597-4f67-8e8f-01dba1357cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:17.392283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-971eeb01-7597-4f67-8e8f-01dba1357cf0 None None] MFA Rules not processed for user `26994bfd2e094415bb9b6e265d52eeae`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:17.395509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-971eeb01-7597-4f67-8e8f-01dba1357cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:17.402646 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:17.671627 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e1634-b59a-49a4-97cd-1edeef39be0a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:17.677768 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1322/2663] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:13:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:13:17.951322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e1634-b59a-49a4-97cd-1edeef39be0a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:17.978200 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81299d96-f414-4cc6-8201-3b8aa9e5e592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:17.980745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81299d96-f414-4cc6-8201-3b8aa9e5e592 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:17.981276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81299d96-f414-4cc6-8201-3b8aa9e5e592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:17.981559 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81299d96-f414-4cc6-8201-3b8aa9e5e592 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:17.982295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81299d96-f414-4cc6-8201-3b8aa9e5e592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:17.985114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81299d96-f414-4cc6-8201-3b8aa9e5e592 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:18.060606 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1342/2664] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:13:17 2022] POST /identity/v3/projects => generated 377 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:13:18.066747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971eeb01-7597-4f67-8e8f-01dba1357cf0 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:18.109133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971eeb01-7597-4f67-8e8f-01dba1357cf0 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:18.330173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0eb9c7-4353-43ac-849a-7ff24e39f36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:18.331082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0eb9c7-4353-43ac-849a-7ff24e39f36d admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:18.331619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0eb9c7-4353-43ac-849a-7ff24e39f36d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:18.332129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0eb9c7-4353-43ac-849a-7ff24e39f36d admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:18.337085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0eb9c7-4353-43ac-849a-7ff24e39f36d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:18.339774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0eb9c7-4353-43ac-849a-7ff24e39f36d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:18.391793 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1323/2665] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:13:18 2022] POST /identity/v3/users => generated 295 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:13:18.395697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81299d96-f414-4cc6-8201-3b8aa9e5e592 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:18.429489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81299d96-f414-4cc6-8201-3b8aa9e5e592 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:18.454069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aae7c9-f50a-4eac-9b71-341c58becb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:18.458583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aae7c9-f50a-4eac-9b71-341c58becb9c admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:18.459933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aae7c9-f50a-4eac-9b71-341c58becb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:18.462695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aae7c9-f50a-4eac-9b71-341c58becb9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:18.465993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aae7c9-f50a-4eac-9b71-341c58becb9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:18.472397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aae7c9-f50a-4eac-9b71-341c58becb9c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:18.523140 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1343/2666] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:13:18.528457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0eb9c7-4353-43ac-849a-7ff24e39f36d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:18.549647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0eb9c7-4353-43ac-849a-7ff24e39f36d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:18.564180 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f439a28-b6d9-4489-9e2e-0efd28fb201d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:18.570902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f439a28-b6d9-4489-9e2e-0efd28fb201d admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:18.570902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f439a28-b6d9-4489-9e2e-0efd28fb201d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:18.570902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f439a28-b6d9-4489-9e2e-0efd28fb201d admin admin] PATH_INFO: `/v3/projects/74f742bd8b784b54a4829b141ad92a48/users/6cd45880a78e4ace93cfdc9223b75f73/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:18.636809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f439a28-b6d9-4489-9e2e-0efd28fb201d admin admin] RBAC: Authorizing `identity:create_grant(project_id=74f742bd8b784b54a4829b141ad92a48, user_id=6cd45880a78e4ace93cfdc9223b75f73, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:18.644837 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f439a28-b6d9-4489-9e2e-0efd28fb201d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:18.734905 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1324/2667] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:13:18 2022] PUT /identity/v3/projects/74f742bd8b784b54a4829b141ad92a48/users/6cd45880a78e4ace93cfdc9223b75f73/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:13:18.736234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aae7c9-f50a-4eac-9b71-341c58becb9c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:18.752499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aae7c9-f50a-4eac-9b71-341c58becb9c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:18.817514 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:19.003126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cda5b8-1f0a-4f20-9d2c-3fc5fc8ad6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:19.003930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cda5b8-1f0a-4f20-9d2c-3fc5fc8ad6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:19.004249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cda5b8-1f0a-4f20-9d2c-3fc5fc8ad6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:19.004591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cda5b8-1f0a-4f20-9d2c-3fc5fc8ad6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:19.005584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cda5b8-1f0a-4f20-9d2c-3fc5fc8ad6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:19.007660 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cda5b8-1f0a-4f20-9d2c-3fc5fc8ad6a3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:19.051832 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1344/2668] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:13:19.055955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f439a28-b6d9-4489-9e2e-0efd28fb201d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:19.080346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f439a28-b6d9-4489-9e2e-0efd28fb201d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:19.108361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa89a3b-dadf-4877-9f39-be6644f5aa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:19.109701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa89a3b-dadf-4877-9f39-be6644f5aa36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:19.110284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa89a3b-dadf-4877-9f39-be6644f5aa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:19.111802 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa89a3b-dadf-4877-9f39-be6644f5aa36 admin admin] PATH_INFO: `/v3/projects/74f742bd8b784b54a4829b141ad92a48/users/6cd45880a78e4ace93cfdc9223b75f73/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:19.114367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa89a3b-dadf-4877-9f39-be6644f5aa36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74f742bd8b784b54a4829b141ad92a48, user_id=6cd45880a78e4ace93cfdc9223b75f73, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:19.117612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa89a3b-dadf-4877-9f39-be6644f5aa36 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:19.132960 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1325/2669] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:13:19 2022] PUT /identity/v3/projects/74f742bd8b784b54a4829b141ad92a48/users/6cd45880a78e4ace93cfdc9223b75f73/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:13:19.159232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b23e3-8f89-4db2-a7ea-5763d4aa9cc9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:19.160336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b23e3-8f89-4db2-a7ea-5763d4aa9cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:19.161056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b23e3-8f89-4db2-a7ea-5763d4aa9cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:19.222262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-4e6b23e3-8f89-4db2-a7ea-5763d4aa9cc9 None None] MFA Rules not processed for user `6cd45880a78e4ace93cfdc9223b75f73`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:19.223870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4e6b23e3-8f89-4db2-a7ea-5763d4aa9cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:19.394397 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1345/2670] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:13:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:13:19.417280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d68734-5bc2-480a-9b10-bc4a98654d1e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:19.417858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d68734-5bc2-480a-9b10-bc4a98654d1e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:19.418215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d68734-5bc2-480a-9b10-bc4a98654d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:19.502042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-14d68734-5bc2-480a-9b10-bc4a98654d1e None None] MFA Rules not processed for user `26994bfd2e094415bb9b6e265d52eeae`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:19.516945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-14d68734-5bc2-480a-9b10-bc4a98654d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:19.713057 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1326/2671] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:13:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:13:20.278280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b23e3-8f89-4db2-a7ea-5763d4aa9cc9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:20.284337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4e6b23e3-8f89-4db2-a7ea-5763d4aa9cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:20.895939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b23e3-8f89-4db2-a7ea-5763d4aa9cc9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:20.918144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171da1a-41d0-44a0-ac83-a4f1b4aa3f18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:20.919241 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171da1a-41d0-44a0-ac83-a4f1b4aa3f18 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:20.919794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171da1a-41d0-44a0-ac83-a4f1b4aa3f18 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:20.920417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171da1a-41d0-44a0-ac83-a4f1b4aa3f18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:20.939495 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9171da1a-41d0-44a0-ac83-a4f1b4aa3f18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:20.942619 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9171da1a-41d0-44a0-ac83-a4f1b4aa3f18 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:20.976505 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1346/2672] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:13:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:13:22.818240 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c450b-03d9-4809-8a63-c1b7e6f3dacb None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:22.819161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c450b-03d9-4809-8a63-c1b7e6f3dacb None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:22.819414 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c450b-03d9-4809-8a63-c1b7e6f3dacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:22.838555 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:22.905503 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-075c450b-03d9-4809-8a63-c1b7e6f3dacb None None] MFA Rules not processed for user `26994bfd2e094415bb9b6e265d52eeae`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:22.908651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-075c450b-03d9-4809-8a63-c1b7e6f3dacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:22.940500 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1327/2673] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:13:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:13:24.339699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599fa4b-27a6-4030-a734-68d66164e1fd None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:24.340720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599fa4b-27a6-4030-a734-68d66164e1fd None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:24.341372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3599fa4b-27a6-4030-a734-68d66164e1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:24.429661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3599fa4b-27a6-4030-a734-68d66164e1fd None None] MFA Rules not processed for user `c135ba135fd946149ace9a86c7c52e80`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:24.439547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3599fa4b-27a6-4030-a734-68d66164e1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:24.537263 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:24.671671 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1347/2674] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:13:24 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:13:29.224605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d2f6f-6cfb-452c-9366-3c6b408f1a6e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:29.225539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d2f6f-6cfb-452c-9366-3c6b408f1a6e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:29.226057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d2f6f-6cfb-452c-9366-3c6b408f1a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:29.264662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b54d2f6f-6cfb-452c-9366-3c6b408f1a6e None None] MFA Rules not processed for user `7e9dce42ff994d81b1ad6d6c05356c37`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:29.268662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b54d2f6f-6cfb-452c-9366-3c6b408f1a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:29.450727 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1328/2675] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:13:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:13:34.631875 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=15 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:37.873600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599fa4b-27a6-4030-a734-68d66164e1fd None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:37.877497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3599fa4b-27a6-4030-a734-68d66164e1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:37.953239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3599fa4b-27a6-4030-a734-68d66164e1fd None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:38.006050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef081d-8e5c-489b-a5dd-e81323051715 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:38.007615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef081d-8e5c-489b-a5dd-e81323051715 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:38.012682 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef081d-8e5c-489b-a5dd-e81323051715 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:38.013642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef081d-8e5c-489b-a5dd-e81323051715 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:38.021848 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-09ef081d-8e5c-489b-a5dd-e81323051715 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:38.237841 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef081d-8e5c-489b-a5dd-e81323051715 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:38.239526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef081d-8e5c-489b-a5dd-e81323051715 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:38.253271 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1348/2676] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:13:37 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:13:39.436666 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=26 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:40.558999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58316a16-70cf-424a-910e-eef0529f1009 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:40.561150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58316a16-70cf-424a-910e-eef0529f1009 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:40.561619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58316a16-70cf-424a-910e-eef0529f1009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:40.593739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-58316a16-70cf-424a-910e-eef0529f1009 None None] MFA Rules not processed for user `32fc1959d8aa41eabcead217b9d7bc47`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:40.596099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-58316a16-70cf-424a-910e-eef0529f1009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:40.700681 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1329/2677] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:13:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:13:42.272760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebd452-dd36-4465-b5b1-15edaeee98b0 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:42.280610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebd452-dd36-4465-b5b1-15edaeee98b0 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:42.281084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebd452-dd36-4465-b5b1-15edaeee98b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:42.331790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-66ebd452-dd36-4465-b5b1-15edaeee98b0 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:42.334607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-66ebd452-dd36-4465-b5b1-15edaeee98b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:42.445390 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1349/2678] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:13:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:13:42.462954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58316a16-70cf-424a-910e-eef0529f1009 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:42.465047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-58316a16-70cf-424a-910e-eef0529f1009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:42.604749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58316a16-70cf-424a-910e-eef0529f1009 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:42.613291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25065aad-5fbc-4f92-9a7b-21166743d6c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:42.614641 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25065aad-5fbc-4f92-9a7b-21166743d6c0 service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:42.615096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25065aad-5fbc-4f92-9a7b-21166743d6c0 service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:42.615548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25065aad-5fbc-4f92-9a7b-21166743d6c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:42.633290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25065aad-5fbc-4f92-9a7b-21166743d6c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:42.636821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25065aad-5fbc-4f92-9a7b-21166743d6c0 service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:42.654819 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1330/2679] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:13:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:13:43.442891 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebd452-dd36-4465-b5b1-15edaeee98b0 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:43.459297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebd452-dd36-4465-b5b1-15edaeee98b0 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:43.471082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4fa20-04cc-41f6-9f64-a242fde47b27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:43.472293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4fa20-04cc-41f6-9f64-a242fde47b27 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:43.473069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4fa20-04cc-41f6-9f64-a242fde47b27 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:43.473860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4fa20-04cc-41f6-9f64-a242fde47b27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:43.477096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-52f4fa20-04cc-41f6-9f64-a242fde47b27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:43.575207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f4fa20-04cc-41f6-9f64-a242fde47b27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:43.578016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f4fa20-04cc-41f6-9f64-a242fde47b27 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:43.588680 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1350/2680] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:13:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:13:44.326669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e9d56-0fee-40df-a582-49b23db512c1 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:44.327771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e9d56-0fee-40df-a582-49b23db512c1 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:44.330170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e9d56-0fee-40df-a582-49b23db512c1 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:44.334648 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1331/2681] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:13:44 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:13:44.346132 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680789c-3a52-430f-8dd6-902d02d34b4c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:44.346664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680789c-3a52-430f-8dd6-902d02d34b4c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:44.347490 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680789c-3a52-430f-8dd6-902d02d34b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:44.396651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2680789c-3a52-430f-8dd6-902d02d34b4c None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:44.399413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2680789c-3a52-430f-8dd6-902d02d34b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:44.471005 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:44.623559 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1351/2682] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:13:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:13:44.662918 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e9d56-0fee-40df-a582-49b23db512c1 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:44.664820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a90e9d56-0fee-40df-a582-49b23db512c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:44.700992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e9d56-0fee-40df-a582-49b23db512c1 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:44.708581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c4044-d78a-46df-9e19-8526bf9e65ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:44.709678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c4044-d78a-46df-9e19-8526bf9e65ec service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:44.710066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c4044-d78a-46df-9e19-8526bf9e65ec service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:44.710429 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c4044-d78a-46df-9e19-8526bf9e65ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:44.723115 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c4044-d78a-46df-9e19-8526bf9e65ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:44.724965 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c4044-d78a-46df-9e19-8526bf9e65ec service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:44.749893 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1332/2683] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:13:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:13:45.331766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb93bf-4d5c-42eb-8a7d-10369ae509ca None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:45.332840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb93bf-4d5c-42eb-8a7d-10369ae509ca None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:45.333624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb93bf-4d5c-42eb-8a7d-10369ae509ca None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:45.337202 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1352/2684] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 01:13:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:13:45.347935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e725c4-b0be-49f9-9715-7bf5c8d54193 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:45.348495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e725c4-b0be-49f9-9715-7bf5c8d54193 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:45.348495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e725c4-b0be-49f9-9715-7bf5c8d54193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:45.375589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-75e725c4-b0be-49f9-9715-7bf5c8d54193 None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:45.390381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-75e725c4-b0be-49f9-9715-7bf5c8d54193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:45.431557 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1333/2685] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 01:13:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:13:45.506898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb93bf-4d5c-42eb-8a7d-10369ae509ca None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:45.551277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb93bf-4d5c-42eb-8a7d-10369ae509ca None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:45.571297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5304ec-ccfb-403f-84c9-7ab31d8e8371 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:45.572081 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5304ec-ccfb-403f-84c9-7ab31d8e8371 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:45.572584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5304ec-ccfb-403f-84c9-7ab31d8e8371 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:45.572979 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5304ec-ccfb-403f-84c9-7ab31d8e8371 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:45.595653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5304ec-ccfb-403f-84c9-7ab31d8e8371 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:45.598131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5304ec-ccfb-403f-84c9-7ab31d8e8371 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:45.615937 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1353/2686] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:13:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:13:45.990000 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73a888-fa48-443f-96dd-49ccc9e83fe8 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:45.990446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73a888-fa48-443f-96dd-49ccc9e83fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:45.990845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73a888-fa48-443f-96dd-49ccc9e83fe8 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:45.994757 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1334/2687] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 01:13:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:13:46.003321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafd886-5df9-4a20-a480-2cd7508f4ddd None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:46.004406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafd886-5df9-4a20-a480-2cd7508f4ddd None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:46.004868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafd886-5df9-4a20-a480-2cd7508f4ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:46.027968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6aafd886-5df9-4a20-a480-2cd7508f4ddd None None] MFA Rules not processed for user `6c70d5a72d424db68de7c7b8257fe02c`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:46.030177 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6aafd886-5df9-4a20-a480-2cd7508f4ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:46.041359 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1354/2688] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 01:13:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:13:46.055909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73a888-fa48-443f-96dd-49ccc9e83fe8 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:46.058280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7c73a888-fa48-443f-96dd-49ccc9e83fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:46.157873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73a888-fa48-443f-96dd-49ccc9e83fe8 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:46.166622 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97a215-80f2-40e7-ac1a-2c895dfe8558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:46.167772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97a215-80f2-40e7-ac1a-2c895dfe8558 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:46.168424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97a215-80f2-40e7-ac1a-2c895dfe8558 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:46.169519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97a215-80f2-40e7-ac1a-2c895dfe8558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:46.210258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97a215-80f2-40e7-ac1a-2c895dfe8558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:46.219682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97a215-80f2-40e7-ac1a-2c895dfe8558 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:46.258820 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1335/2689] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:13:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:13:50.766225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafd886-5df9-4a20-a480-2cd7508f4ddd None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:50.769040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6aafd886-5df9-4a20-a480-2cd7508f4ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:50.904905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafd886-5df9-4a20-a480-2cd7508f4ddd None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:50.912459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a27002-4dc8-4f31-b6fe-420297fbddc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:50.913490 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a27002-4dc8-4f31-b6fe-420297fbddc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:50.913806 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a27002-4dc8-4f31-b6fe-420297fbddc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:50.914076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a27002-4dc8-4f31-b6fe-420297fbddc0 admin admin] PATH_INFO: `/v3/users/1d0d09d844bf453cb3e2637d630614ff` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:50.915697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a27002-4dc8-4f31-b6fe-420297fbddc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d0d09d844bf453cb3e2637d630614ff)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:50.924661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a27002-4dc8-4f31-b6fe-420297fbddc0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:51.007107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d0a27002-4dc8-4f31-b6fe-420297fbddc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d0d09d844bf453cb3e2637d630614ff'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:51.019159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d0a27002-4dc8-4f31-b6fe-420297fbddc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d0d09d844bf453cb3e2637d630614ff'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:51.053336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d0a27002-4dc8-4f31-b6fe-420297fbddc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d0d09d844bf453cb3e2637d630614ff'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:51.054655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d0a27002-4dc8-4f31-b6fe-420297fbddc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d0d09d844bf453cb3e2637d630614ff'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:51.065675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d0a27002-4dc8-4f31-b6fe-420297fbddc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d0d09d844bf453cb3e2637d630614ff'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:51.077598 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1355/2690] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:13:50 2022] DELETE /identity/v3/users/1d0d09d844bf453cb3e2637d630614ff => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:13:51.083206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dac5d8-0ca5-4c45-b13e-0e628611dc95 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:51.083798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dac5d8-0ca5-4c45-b13e-0e628611dc95 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:51.083798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dac5d8-0ca5-4c45-b13e-0e628611dc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:51.115426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d0dac5d8-0ca5-4c45-b13e-0e628611dc95 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:51.117094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d0dac5d8-0ca5-4c45-b13e-0e628611dc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:51.135437 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:51.238905 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1336/2691] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:13:51.256978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a27002-4dc8-4f31-b6fe-420297fbddc0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:51.258861 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d0a27002-4dc8-4f31-b6fe-420297fbddc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:51.322955 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:51.410113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a27002-4dc8-4f31-b6fe-420297fbddc0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:51.421891 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de226d4-3d37-4a23-8eb0-a234d576bdb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:51.423018 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de226d4-3d37-4a23-8eb0-a234d576bdb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:51.424762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de226d4-3d37-4a23-8eb0-a234d576bdb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:51.425182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de226d4-3d37-4a23-8eb0-a234d576bdb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:51.460812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de226d4-3d37-4a23-8eb0-a234d576bdb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:51.463895 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de226d4-3d37-4a23-8eb0-a234d576bdb0 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:51.484706 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1356/2692] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:13:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:13:51.789805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dac5d8-0ca5-4c45-b13e-0e628611dc95 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:51.792686 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d0dac5d8-0ca5-4c45-b13e-0e628611dc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:51.823261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dac5d8-0ca5-4c45-b13e-0e628611dc95 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:51.841021 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0bd31-f5aa-42f3-94f8-a1f9805ccfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:51.842430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0bd31-f5aa-42f3-94f8-a1f9805ccfb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:51.843205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0bd31-f5aa-42f3-94f8-a1f9805ccfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:51.843704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0bd31-f5aa-42f3-94f8-a1f9805ccfb7 admin admin] PATH_INFO: `/v3/projects/dc5c39a06e41406a8c6c99d2e84ab282` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:51.845319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0bd31-f5aa-42f3-94f8-a1f9805ccfb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc5c39a06e41406a8c6c99d2e84ab282)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:51.849159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0bd31-f5aa-42f3-94f8-a1f9805ccfb7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:51.942788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-79e0bd31-f5aa-42f3-94f8-a1f9805ccfb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc5c39a06e41406a8c6c99d2e84ab282', 'request_id': 'req-79e0bd31-f5aa-42f3-94f8-a1f9805ccfb7'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:51.954583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-79e0bd31-f5aa-42f3-94f8-a1f9805ccfb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc5c39a06e41406a8c6c99d2e84ab282', 'request_id': 'req-79e0bd31-f5aa-42f3-94f8-a1f9805ccfb7'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:51.964464 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-79e0bd31-f5aa-42f3-94f8-a1f9805ccfb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc5c39a06e41406a8c6c99d2e84ab282', 'request_id': 'req-79e0bd31-f5aa-42f3-94f8-a1f9805ccfb7'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:51.991715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-79e0bd31-f5aa-42f3-94f8-a1f9805ccfb7 admin admin] The token cache is being invalidate because project dc5c39a06e41406a8c6c99d2e84ab282 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:13:52.008136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-79e0bd31-f5aa-42f3-94f8-a1f9805ccfb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:52.009198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-79e0bd31-f5aa-42f3-94f8-a1f9805ccfb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:13:52.012991 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1337/2693] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:13:51 2022] DELETE /identity/v3/projects/dc5c39a06e41406a8c6c99d2e84ab282 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:13:52.018577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3b983-1180-46f3-9ba3-6f9e693d4b66 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:52.019106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3b983-1180-46f3-9ba3-6f9e693d4b66 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:52.019216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3b983-1180-46f3-9ba3-6f9e693d4b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:52.098202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-24a3b983-1180-46f3-9ba3-6f9e693d4b66 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:52.100904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-24a3b983-1180-46f3-9ba3-6f9e693d4b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:52.188348 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1357/2694] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:13:52.203836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04763162-a3d5-441c-abbe-1977a1b00264 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:52.204574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04763162-a3d5-441c-abbe-1977a1b00264 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:52.205233 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04763162-a3d5-441c-abbe-1977a1b00264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:52.271972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-04763162-a3d5-441c-abbe-1977a1b00264 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:52.274907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-04763162-a3d5-441c-abbe-1977a1b00264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:52.303394 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1338/2695] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:13:52.307383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3b983-1180-46f3-9ba3-6f9e693d4b66 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:52.322224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3b983-1180-46f3-9ba3-6f9e693d4b66 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:52.328852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783a2e4-f219-4dff-89ee-995313f2a22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:52.329224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783a2e4-f219-4dff-89ee-995313f2a22c admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:52.329440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783a2e4-f219-4dff-89ee-995313f2a22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:52.329707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783a2e4-f219-4dff-89ee-995313f2a22c admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:52.331216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783a2e4-f219-4dff-89ee-995313f2a22c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:13:52.331709 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783a2e4-f219-4dff-89ee-995313f2a22c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:52.333559 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783a2e4-f219-4dff-89ee-995313f2a22c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:52.357487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04763162-a3d5-441c-abbe-1977a1b00264 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:52.359221 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1358/2696] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:13:52.378982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04763162-a3d5-441c-abbe-1977a1b00264 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:52.384496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1cee33-52f6-48dc-9287-3ea244c8a2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:52.385381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cee33-52f6-48dc-9287-3ea244c8a2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:52.385924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cee33-52f6-48dc-9287-3ea244c8a2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:52.386453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cee33-52f6-48dc-9287-3ea244c8a2c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:52.387500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1cee33-52f6-48dc-9287-3ea244c8a2c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:52.389772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1cee33-52f6-48dc-9287-3ea244c8a2c2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:52.427685 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1339/2697] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:13:52 2022] POST /identity/v3/projects => generated 403 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:13:52.433150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783a2e4-f219-4dff-89ee-995313f2a22c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:52.444190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783a2e4-f219-4dff-89ee-995313f2a22c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:52.535302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b754a1b-039b-4dde-8cf5-8cfac5779bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:52.536089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b754a1b-039b-4dde-8cf5-8cfac5779bda admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:52.536432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b754a1b-039b-4dde-8cf5-8cfac5779bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:52.536710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b754a1b-039b-4dde-8cf5-8cfac5779bda admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:52.537439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b754a1b-039b-4dde-8cf5-8cfac5779bda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:52.539843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b754a1b-039b-4dde-8cf5-8cfac5779bda admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:52.575992 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1359/2698] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:13:52 2022] POST /identity/v3/users => generated 302 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:13:52.578514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1cee33-52f6-48dc-9287-3ea244c8a2c2 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:52.590954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1cee33-52f6-48dc-9287-3ea244c8a2c2 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:52.598685 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c9d13-ad65-421b-8fc6-8a9033f7c8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:52.599480 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c9d13-ad65-421b-8fc6-8a9033f7c8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:52.599827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c9d13-ad65-421b-8fc6-8a9033f7c8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:52.600310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c9d13-ad65-421b-8fc6-8a9033f7c8a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:52.601071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c9d13-ad65-421b-8fc6-8a9033f7c8a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:52.602939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c9d13-ad65-421b-8fc6-8a9033f7c8a3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:52.620579 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1340/2699] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:13:52.621187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b754a1b-039b-4dde-8cf5-8cfac5779bda admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:52.633821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b754a1b-039b-4dde-8cf5-8cfac5779bda admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:52.639746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775fbad-85a0-46f9-949e-ec9f35a992cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:52.640556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775fbad-85a0-46f9-949e-ec9f35a992cd admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:52.640915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775fbad-85a0-46f9-949e-ec9f35a992cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:52.641308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775fbad-85a0-46f9-949e-ec9f35a992cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:52.642055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775fbad-85a0-46f9-949e-ec9f35a992cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:52.644676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775fbad-85a0-46f9-949e-ec9f35a992cd admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:52.664066 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1360/2700] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:13:52.664462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c9d13-ad65-421b-8fc6-8a9033f7c8a3 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:52.678254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c9d13-ad65-421b-8fc6-8a9033f7c8a3 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:52.684839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654d67f-bbde-41c2-8001-d5db0e2fd051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:52.685719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654d67f-bbde-41c2-8001-d5db0e2fd051 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:52.686027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654d67f-bbde-41c2-8001-d5db0e2fd051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:52.686316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654d67f-bbde-41c2-8001-d5db0e2fd051 admin admin] PATH_INFO: `/v3/projects/c7ad37611d074f0e989d14d4d02cf4af/users/72ffacc6ff884be9b0e38e0afd244362/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:52.710423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654d67f-bbde-41c2-8001-d5db0e2fd051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7ad37611d074f0e989d14d4d02cf4af, user_id=72ffacc6ff884be9b0e38e0afd244362, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:52.713725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654d67f-bbde-41c2-8001-d5db0e2fd051 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:52.734451 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1341/2701] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:13:52 2022] PUT /identity/v3/projects/c7ad37611d074f0e989d14d4d02cf4af/users/72ffacc6ff884be9b0e38e0afd244362/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:13:52.744503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bfdbd-9085-4c10-8a9e-a678bd17730a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:52.745033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bfdbd-9085-4c10-8a9e-a678bd17730a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:52.746450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2bfdbd-9085-4c10-8a9e-a678bd17730a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:52.779578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ff2bfdbd-9085-4c10-8a9e-a678bd17730a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:52.781699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ff2bfdbd-9085-4c10-8a9e-a678bd17730a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:52.855629 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:52.904522 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1361/2702] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:13:52.923277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654d67f-bbde-41c2-8001-d5db0e2fd051 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:13:52.925797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c654d67f-bbde-41c2-8001-d5db0e2fd051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:53.006654 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:13:53.039544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654d67f-bbde-41c2-8001-d5db0e2fd051 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:13:53.044578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53972a47-c82f-47fb-8d76-ab0df6d10b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:13:53.045403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53972a47-c82f-47fb-8d76-ab0df6d10b65 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:53.045689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53972a47-c82f-47fb-8d76-ab0df6d10b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:53.045959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53972a47-c82f-47fb-8d76-ab0df6d10b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:53.058739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53972a47-c82f-47fb-8d76-ab0df6d10b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:13:53.062190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53972a47-c82f-47fb-8d76-ab0df6d10b65 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:13:53.077551 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1342/2703] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:13:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:13:56.250146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033723aa-f196-4eb7-bd3f-9d3d67b79b6a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:13:56.250750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033723aa-f196-4eb7-bd3f-9d3d67b79b6a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:13:56.250750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033723aa-f196-4eb7-bd3f-9d3d67b79b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:13:56.336761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-033723aa-f196-4eb7-bd3f-9d3d67b79b6a None None] MFA Rules not processed for user `26994bfd2e094415bb9b6e265d52eeae`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:13:56.343933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-033723aa-f196-4eb7-bd3f-9d3d67b79b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:13:56.564640 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1362/2704] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:13:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:14:03.070705 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=9 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:04.723031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076ad9b-352f-49a4-9569-f3789a527868 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:04.723737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076ad9b-352f-49a4-9569-f3789a527868 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:04.723737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076ad9b-352f-49a4-9569-f3789a527868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:04.771636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0076ad9b-352f-49a4-9569-f3789a527868 None None] MFA Rules not processed for user `72ffacc6ff884be9b0e38e0afd244362`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:14:04.778874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0076ad9b-352f-49a4-9569-f3789a527868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:04.986368 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1343/2705] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:14:04 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:14:05.000454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033723aa-f196-4eb7-bd3f-9d3d67b79b6a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:05.001946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-033723aa-f196-4eb7-bd3f-9d3d67b79b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:05.241641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033723aa-f196-4eb7-bd3f-9d3d67b79b6a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:05.252292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ac1bf-3bd3-484e-baf8-84e13f36d828 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:05.253322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ac1bf-3bd3-484e-baf8-84e13f36d828 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:05.253896 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ac1bf-3bd3-484e-baf8-84e13f36d828 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:05.260240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ac1bf-3bd3-484e-baf8-84e13f36d828 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:05.276465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ac1bf-3bd3-484e-baf8-84e13f36d828 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:05.278909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ac1bf-3bd3-484e-baf8-84e13f36d828 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:05.302018 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1363/2706] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:14:04 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:14:14.034556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414a443-3361-4146-b338-61c8bdc9cab9 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:14.036420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414a443-3361-4146-b338-61c8bdc9cab9 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:14.036906 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414a443-3361-4146-b338-61c8bdc9cab9 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:14.038756 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1344/2707] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 01:14:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:14:14.071874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cc064-ba86-4417-8abf-54c00204f21e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:14.073038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cc064-ba86-4417-8abf-54c00204f21e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:14.073539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cc064-ba86-4417-8abf-54c00204f21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:14.151093 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:14.161853 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414a443-3361-4146-b338-61c8bdc9cab9 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:14.165333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8414a443-3361-4146-b338-61c8bdc9cab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:14.244348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-229cc064-ba86-4417-8abf-54c00204f21e None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:14:14.252348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-229cc064-ba86-4417-8abf-54c00204f21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:14.389489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414a443-3361-4146-b338-61c8bdc9cab9 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:14.407099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8434d8-7073-4bd0-b02e-db299a146fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:14.408649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8434d8-7073-4bd0-b02e-db299a146fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:14.409188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8434d8-7073-4bd0-b02e-db299a146fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:14.411002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8434d8-7073-4bd0-b02e-db299a146fa8 admin admin] PATH_INFO: `/v3/users/c135ba135fd946149ace9a86c7c52e80` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:14.415842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8434d8-7073-4bd0-b02e-db299a146fa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c135ba135fd946149ace9a86c7c52e80)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:14.423237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8434d8-7073-4bd0-b02e-db299a146fa8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:14.495735 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1364/2708] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 01:14:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:14:14.520004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229cc064-ba86-4417-8abf-54c00204f21e None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:14.521639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-229cc064-ba86-4417-8abf-54c00204f21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:14.545345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229cc064-ba86-4417-8abf-54c00204f21e None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:14.561944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966eb271-b270-4d83-a469-1086a71de9bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:14.562768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966eb271-b270-4d83-a469-1086a71de9bb service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:14.563155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966eb271-b270-4d83-a469-1086a71de9bb service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:14.563534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966eb271-b270-4d83-a469-1086a71de9bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:14.568911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7b8434d8-7073-4bd0-b02e-db299a146fa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c135ba135fd946149ace9a86c7c52e80'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:14.580063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7b8434d8-7073-4bd0-b02e-db299a146fa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c135ba135fd946149ace9a86c7c52e80'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:14.606203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966eb271-b270-4d83-a469-1086a71de9bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:14.616587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966eb271-b270-4d83-a469-1086a71de9bb service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:14.616892 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7b8434d8-7073-4bd0-b02e-db299a146fa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c135ba135fd946149ace9a86c7c52e80'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:14.616892 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7b8434d8-7073-4bd0-b02e-db299a146fa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c135ba135fd946149ace9a86c7c52e80'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:14.629603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7b8434d8-7073-4bd0-b02e-db299a146fa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c135ba135fd946149ace9a86c7c52e80'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:14.648616 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1365/2709] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:14:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:14:14.653748 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1345/2710] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:14:14 2022] DELETE /identity/v3/users/c135ba135fd946149ace9a86c7c52e80 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:14:15.356599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966eb271-b270-4d83-a469-1086a71de9bb service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:15.375331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966eb271-b270-4d83-a469-1086a71de9bb service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:15.552927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420af54-55a0-4302-ba51-993b59069d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:15.554445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420af54-55a0-4302-ba51-993b59069d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:15.556334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420af54-55a0-4302-ba51-993b59069d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:15.556950 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420af54-55a0-4302-ba51-993b59069d8a admin admin] PATH_INFO: `/v3/projects/4e443158f15b42a3a795950a7c409a38` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:15.562663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0420af54-55a0-4302-ba51-993b59069d8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e443158f15b42a3a795950a7c409a38)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:15.570656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0420af54-55a0-4302-ba51-993b59069d8a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:15.724548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0420af54-55a0-4302-ba51-993b59069d8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e443158f15b42a3a795950a7c409a38', 'request_id': 'req-0420af54-55a0-4302-ba51-993b59069d8a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:15.757642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0420af54-55a0-4302-ba51-993b59069d8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e443158f15b42a3a795950a7c409a38', 'request_id': 'req-0420af54-55a0-4302-ba51-993b59069d8a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:15.794696 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0420af54-55a0-4302-ba51-993b59069d8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e443158f15b42a3a795950a7c409a38', 'request_id': 'req-0420af54-55a0-4302-ba51-993b59069d8a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:15.805746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512c8a9-edbc-4dfc-ae23-ca1dabb2d78d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:15.806362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512c8a9-edbc-4dfc-ae23-ca1dabb2d78d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:15.806758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512c8a9-edbc-4dfc-ae23-ca1dabb2d78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:15.858236 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7512c8a9-edbc-4dfc-ae23-ca1dabb2d78d None None] MFA Rules not processed for user `32fc1959d8aa41eabcead217b9d7bc47`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:14:15.862416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7512c8a9-edbc-4dfc-ae23-ca1dabb2d78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:15.878545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0420af54-55a0-4302-ba51-993b59069d8a admin admin] The token cache is being invalidate because project 4e443158f15b42a3a795950a7c409a38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:14:15.879676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0420af54-55a0-4302-ba51-993b59069d8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:15.887713 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0420af54-55a0-4302-ba51-993b59069d8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:15.899406 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1366/2711] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:14:15 2022] DELETE /identity/v3/projects/4e443158f15b42a3a795950a7c409a38 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:14:15.908430 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f1945-1787-4eaf-ae85-e51561fe1346 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:15.908888 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f1945-1787-4eaf-ae85-e51561fe1346 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:15.909350 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f1945-1787-4eaf-ae85-e51561fe1346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:15.997014 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:16.006817 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:16.097059 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1346/2712] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:14:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:14:16.147155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5f9f1945-1787-4eaf-ae85-e51561fe1346 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:14:16.148615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5f9f1945-1787-4eaf-ae85-e51561fe1346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:16.410670 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1367/2713] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:14:16.427396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f700f5-7261-4780-8d6a-0c55dd1f2433 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:16.429743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f700f5-7261-4780-8d6a-0c55dd1f2433 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:16.434905 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f700f5-7261-4780-8d6a-0c55dd1f2433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:16.496233 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-78f700f5-7261-4780-8d6a-0c55dd1f2433 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:14:16.505767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-78f700f5-7261-4780-8d6a-0c55dd1f2433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:16.538417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f1945-1787-4eaf-ae85-e51561fe1346 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:16.540751 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1347/2714] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:14:16.557958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f1945-1787-4eaf-ae85-e51561fe1346 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:16.570258 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20b90c-c829-4b1e-9726-dc51d5fff401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:16.570738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20b90c-c829-4b1e-9726-dc51d5fff401 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:16.572138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20b90c-c829-4b1e-9726-dc51d5fff401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:16.572511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20b90c-c829-4b1e-9726-dc51d5fff401 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:16.574120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c20b90c-c829-4b1e-9726-dc51d5fff401 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:14:16.574475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c20b90c-c829-4b1e-9726-dc51d5fff401 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:16.577602 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c20b90c-c829-4b1e-9726-dc51d5fff401 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:16.611941 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1368/2715] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:14:16.615002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f700f5-7261-4780-8d6a-0c55dd1f2433 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:16.644080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f700f5-7261-4780-8d6a-0c55dd1f2433 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:16.665313 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd1968-145b-4bb1-a7c4-927d0bd3cc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:16.666387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd1968-145b-4bb1-a7c4-927d0bd3cc18 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:16.666858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd1968-145b-4bb1-a7c4-927d0bd3cc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:16.667307 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd1968-145b-4bb1-a7c4-927d0bd3cc18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:16.668459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd1968-145b-4bb1-a7c4-927d0bd3cc18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:16.674527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbd1968-145b-4bb1-a7c4-927d0bd3cc18 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:16.783841 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1348/2716] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:14:16 2022] POST /identity/v3/projects => generated 389 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:14:16.784823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20b90c-c829-4b1e-9726-dc51d5fff401 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:16.818285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20b90c-c829-4b1e-9726-dc51d5fff401 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:16.944273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989776b-049a-48ab-bc02-1711365d0a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:16.947013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989776b-049a-48ab-bc02-1711365d0a93 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:16.947697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989776b-049a-48ab-bc02-1711365d0a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:16.949165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989776b-049a-48ab-bc02-1711365d0a93 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:16.950621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989776b-049a-48ab-bc02-1711365d0a93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:16.957445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989776b-049a-48ab-bc02-1711365d0a93 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:17.021818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd1968-145b-4bb1-a7c4-927d0bd3cc18 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:17.037701 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1369/2717] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:14:16 2022] POST /identity/v3/users => generated 295 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:14:17.044459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd1968-145b-4bb1-a7c4-927d0bd3cc18 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:17.052075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68be99-22c2-426d-88a9-af8adc8252cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:17.053172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68be99-22c2-426d-88a9-af8adc8252cc admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:17.053723 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68be99-22c2-426d-88a9-af8adc8252cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:17.054347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68be99-22c2-426d-88a9-af8adc8252cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:17.055260 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68be99-22c2-426d-88a9-af8adc8252cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:17.058388 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68be99-22c2-426d-88a9-af8adc8252cc admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:17.079067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989776b-049a-48ab-bc02-1711365d0a93 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:17.091258 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1349/2718] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:14:17.096277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989776b-049a-48ab-bc02-1711365d0a93 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:17.102405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199e6c9-a3b9-4888-a7bb-7630667606d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:17.103420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199e6c9-a3b9-4888-a7bb-7630667606d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:17.104060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199e6c9-a3b9-4888-a7bb-7630667606d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:17.106022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199e6c9-a3b9-4888-a7bb-7630667606d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:17.106822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199e6c9-a3b9-4888-a7bb-7630667606d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:17.109239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199e6c9-a3b9-4888-a7bb-7630667606d5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:17.135663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68be99-22c2-426d-88a9-af8adc8252cc admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:17.136719 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1370/2719] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:14:17.158866 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68be99-22c2-426d-88a9-af8adc8252cc admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:17.177277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47856aa4-84dc-4a5f-a1dd-7e6ee5cd0ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:17.178364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47856aa4-84dc-4a5f-a1dd-7e6ee5cd0ed3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:17.179307 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47856aa4-84dc-4a5f-a1dd-7e6ee5cd0ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:17.179802 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47856aa4-84dc-4a5f-a1dd-7e6ee5cd0ed3 admin admin] PATH_INFO: `/v3/projects/45ac882e61ac45eb9abc60630e7337c3/users/ae4f4a7231e4431c89712c557c4fa1df/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:17.217358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47856aa4-84dc-4a5f-a1dd-7e6ee5cd0ed3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45ac882e61ac45eb9abc60630e7337c3, user_id=ae4f4a7231e4431c89712c557c4fa1df, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:17.220542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47856aa4-84dc-4a5f-a1dd-7e6ee5cd0ed3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:17.250841 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1350/2720] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:14:17 2022] PUT /identity/v3/projects/45ac882e61ac45eb9abc60630e7337c3/users/ae4f4a7231e4431c89712c557c4fa1df/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:14:17.259230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59840ab9-085e-4a21-8cfa-11492ab0e7ae None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:17.259618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59840ab9-085e-4a21-8cfa-11492ab0e7ae None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:17.262009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59840ab9-085e-4a21-8cfa-11492ab0e7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:17.345301 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-59840ab9-085e-4a21-8cfa-11492ab0e7ae None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:14:17.347489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-59840ab9-085e-4a21-8cfa-11492ab0e7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:17.476361 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:17.492826 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1371/2721] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:14:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:14:17.520296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47856aa4-84dc-4a5f-a1dd-7e6ee5cd0ed3 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:17.523480 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-47856aa4-84dc-4a5f-a1dd-7e6ee5cd0ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:17.851977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47856aa4-84dc-4a5f-a1dd-7e6ee5cd0ed3 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:17.877176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d7c02-fa9f-4ed0-ad41-c1bd042f9579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:17.877972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d7c02-fa9f-4ed0-ad41-c1bd042f9579 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:17.878261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d7c02-fa9f-4ed0-ad41-c1bd042f9579 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:17.880404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d7c02-fa9f-4ed0-ad41-c1bd042f9579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:17.903528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d7c02-fa9f-4ed0-ad41-c1bd042f9579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:17.905259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d7c02-fa9f-4ed0-ad41-c1bd042f9579 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:17.940223 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1351/2722] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:14:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:14:25.453339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59840ab9-085e-4a21-8cfa-11492ab0e7ae None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:25.455025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-59840ab9-085e-4a21-8cfa-11492ab0e7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:25.703064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59840ab9-085e-4a21-8cfa-11492ab0e7ae None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:25.719877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd548b6e-0350-48bb-9c04-c78291cdfa90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:25.721128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd548b6e-0350-48bb-9c04-c78291cdfa90 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:25.721517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd548b6e-0350-48bb-9c04-c78291cdfa90 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:25.721956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd548b6e-0350-48bb-9c04-c78291cdfa90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:25.725929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dd548b6e-0350-48bb-9c04-c78291cdfa90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:25.933610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd548b6e-0350-48bb-9c04-c78291cdfa90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:25.935341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd548b6e-0350-48bb-9c04-c78291cdfa90 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:25.974167 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1372/2723] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:14:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:14:27.921466 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=76,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:29.179644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d7c02-fa9f-4ed0-ad41-c1bd042f9579 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:29.181373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bb6d7c02-fa9f-4ed0-ad41-c1bd042f9579 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:29.220595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d7c02-fa9f-4ed0-ad41-c1bd042f9579 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:29.237912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c626a7-833e-4b63-92bb-14628a3baa34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:29.239019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c626a7-833e-4b63-92bb-14628a3baa34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:29.239468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c626a7-833e-4b63-92bb-14628a3baa34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:29.239933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c626a7-833e-4b63-92bb-14628a3baa34 admin admin] PATH_INFO: `/v3/users/72ffacc6ff884be9b0e38e0afd244362` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:29.243928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c626a7-833e-4b63-92bb-14628a3baa34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72ffacc6ff884be9b0e38e0afd244362)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:29.246253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c626a7-833e-4b63-92bb-14628a3baa34 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:29.367669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-45c626a7-833e-4b63-92bb-14628a3baa34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72ffacc6ff884be9b0e38e0afd244362'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:29.383778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-45c626a7-833e-4b63-92bb-14628a3baa34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72ffacc6ff884be9b0e38e0afd244362'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:29.414735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-45c626a7-833e-4b63-92bb-14628a3baa34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72ffacc6ff884be9b0e38e0afd244362'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:29.415542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-45c626a7-833e-4b63-92bb-14628a3baa34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72ffacc6ff884be9b0e38e0afd244362'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:29.430593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-45c626a7-833e-4b63-92bb-14628a3baa34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72ffacc6ff884be9b0e38e0afd244362'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:29.444059 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1352/2724] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:14:29 2022] DELETE /identity/v3/users/72ffacc6ff884be9b0e38e0afd244362 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:14:32.117758 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd548b6e-0350-48bb-9c04-c78291cdfa90 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:32.130582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd548b6e-0350-48bb-9c04-c78291cdfa90 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:32.311657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b48a6-6027-432c-8226-b200abdb741e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:32.313200 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b48a6-6027-432c-8226-b200abdb741e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:32.313502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b48a6-6027-432c-8226-b200abdb741e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:32.313776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b48a6-6027-432c-8226-b200abdb741e admin admin] PATH_INFO: `/v3/projects/c7ad37611d074f0e989d14d4d02cf4af` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:32.321251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b48a6-6027-432c-8226-b200abdb741e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7ad37611d074f0e989d14d4d02cf4af)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:32.324142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b48a6-6027-432c-8226-b200abdb741e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:32.426810 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:32.455990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c49b48a6-6027-432c-8226-b200abdb741e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7ad37611d074f0e989d14d4d02cf4af', 'request_id': 'req-c49b48a6-6027-432c-8226-b200abdb741e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:32.471230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c49b48a6-6027-432c-8226-b200abdb741e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7ad37611d074f0e989d14d4d02cf4af', 'request_id': 'req-c49b48a6-6027-432c-8226-b200abdb741e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:32.488001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c49b48a6-6027-432c-8226-b200abdb741e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7ad37611d074f0e989d14d4d02cf4af', 'request_id': 'req-c49b48a6-6027-432c-8226-b200abdb741e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:32.511685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c49b48a6-6027-432c-8226-b200abdb741e admin admin] The token cache is being invalidate because project c7ad37611d074f0e989d14d4d02cf4af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:14:32.512001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c49b48a6-6027-432c-8226-b200abdb741e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:32.512780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c49b48a6-6027-432c-8226-b200abdb741e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:32.517343 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1373/2725] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:14:32 2022] DELETE /identity/v3/projects/c7ad37611d074f0e989d14d4d02cf4af => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:14:32.523435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b75994-d8fe-460e-95d5-f2a5c3419075 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:32.524085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b75994-d8fe-460e-95d5-f2a5c3419075 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:32.524085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b75994-d8fe-460e-95d5-f2a5c3419075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:32.563714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-04b75994-d8fe-460e-95d5-f2a5c3419075 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:14:32.565366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-04b75994-d8fe-460e-95d5-f2a5c3419075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:32.844188 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1353/2726] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:14:32.850722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279228a6-0c4a-49f5-8739-db098f9b1e34 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:32.850722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279228a6-0c4a-49f5-8739-db098f9b1e34 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:32.850722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279228a6-0c4a-49f5-8739-db098f9b1e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:32.922152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-279228a6-0c4a-49f5-8739-db098f9b1e34 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:14:32.924926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-279228a6-0c4a-49f5-8739-db098f9b1e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:32.967300 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1374/2727] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:14:32.969081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b75994-d8fe-460e-95d5-f2a5c3419075 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:32.993111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b75994-d8fe-460e-95d5-f2a5c3419075 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:33.003180 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff83ac5-369b-43e1-857a-b6502a02d22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:33.004575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff83ac5-369b-43e1-857a-b6502a02d22b admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:33.005322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff83ac5-369b-43e1-857a-b6502a02d22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:33.007148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff83ac5-369b-43e1-857a-b6502a02d22b admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:33.008354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff83ac5-369b-43e1-857a-b6502a02d22b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:14:33.008926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff83ac5-369b-43e1-857a-b6502a02d22b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:33.011432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff83ac5-369b-43e1-857a-b6502a02d22b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:33.046204 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1354/2728] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:14:33.052738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279228a6-0c4a-49f5-8739-db098f9b1e34 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:33.090447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279228a6-0c4a-49f5-8739-db098f9b1e34 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:33.117498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f878ab1-0bdc-4214-a2ae-1a1b1987df31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:33.118499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f878ab1-0bdc-4214-a2ae-1a1b1987df31 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:33.119791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f878ab1-0bdc-4214-a2ae-1a1b1987df31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:33.120075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f878ab1-0bdc-4214-a2ae-1a1b1987df31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:33.124283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f878ab1-0bdc-4214-a2ae-1a1b1987df31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:33.127374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f878ab1-0bdc-4214-a2ae-1a1b1987df31 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:33.179923 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1375/2729] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:14:33 2022] POST /identity/v3/projects => generated 397 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:14:33.185635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff83ac5-369b-43e1-857a-b6502a02d22b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:33.233839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff83ac5-369b-43e1-857a-b6502a02d22b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:33.395590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105cd3e-f510-492a-84da-0f0a7143a3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:33.396305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105cd3e-f510-492a-84da-0f0a7143a3d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:33.396586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105cd3e-f510-492a-84da-0f0a7143a3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:33.398898 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105cd3e-f510-492a-84da-0f0a7143a3d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:33.399686 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105cd3e-f510-492a-84da-0f0a7143a3d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:33.402256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8105cd3e-f510-492a-84da-0f0a7143a3d0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:33.421992 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:33.451318 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1355/2730] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:14:33 2022] POST /identity/v3/users => generated 299 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:14:33.457463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f878ab1-0bdc-4214-a2ae-1a1b1987df31 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:33.472904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f878ab1-0bdc-4214-a2ae-1a1b1987df31 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:33.485644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be090b3-d9a3-47fe-9286-61084ead47ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:33.486290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be090b3-d9a3-47fe-9286-61084ead47ac admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:33.486642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be090b3-d9a3-47fe-9286-61084ead47ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:33.486910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be090b3-d9a3-47fe-9286-61084ead47ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:33.487579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be090b3-d9a3-47fe-9286-61084ead47ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:33.489240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be090b3-d9a3-47fe-9286-61084ead47ac admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:33.523680 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1376/2731] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:14:33.528293 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105cd3e-f510-492a-84da-0f0a7143a3d0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:33.557634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105cd3e-f510-492a-84da-0f0a7143a3d0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:33.573264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dc8ef-0491-48e0-b4cf-9fad1b6b4005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:33.574371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dc8ef-0491-48e0-b4cf-9fad1b6b4005 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:33.575369 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dc8ef-0491-48e0-b4cf-9fad1b6b4005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:33.576110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dc8ef-0491-48e0-b4cf-9fad1b6b4005 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:33.577670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55dc8ef-0491-48e0-b4cf-9fad1b6b4005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:33.581051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55dc8ef-0491-48e0-b4cf-9fad1b6b4005 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:33.627539 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1356/2732] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:14:33.631652 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be090b3-d9a3-47fe-9286-61084ead47ac admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:33.633015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dc8ef-0491-48e0-b4cf-9fad1b6b4005 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:33.637518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3be090b3-d9a3-47fe-9286-61084ead47ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:33.675783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dc8ef-0491-48e0-b4cf-9fad1b6b4005 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:33.693631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8db43-80a1-4cc4-830a-79685a4c6205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:33.694736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8db43-80a1-4cc4-830a-79685a4c6205 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:33.695203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8db43-80a1-4cc4-830a-79685a4c6205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:33.695673 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8db43-80a1-4cc4-830a-79685a4c6205 admin admin] PATH_INFO: `/v3/projects/dab3ac719e1b4d6c913fc593c388dc3d/users/21219c93625d4e6b802d8a99b3e520d6/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:33.756402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8db43-80a1-4cc4-830a-79685a4c6205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab3ac719e1b4d6c913fc593c388dc3d, user_id=21219c93625d4e6b802d8a99b3e520d6, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:33.769446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f8db43-80a1-4cc4-830a-79685a4c6205 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:33.799708 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1357/2733] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:14:33 2022] PUT /identity/v3/projects/dab3ac719e1b4d6c913fc593c388dc3d/users/21219c93625d4e6b802d8a99b3e520d6/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:14:33.804862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98278f54-252f-4bba-9a5c-615434525498 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:33.805222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98278f54-252f-4bba-9a5c-615434525498 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:33.805570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98278f54-252f-4bba-9a5c-615434525498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:33.851570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be090b3-d9a3-47fe-9286-61084ead47ac admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:33.856171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-98278f54-252f-4bba-9a5c-615434525498 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:14:33.856785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-98278f54-252f-4bba-9a5c-615434525498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:34.000068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dbb8af-ef6e-494f-83d1-e65c25af158f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:34.001233 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbb8af-ef6e-494f-83d1-e65c25af158f service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:34.001685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbb8af-ef6e-494f-83d1-e65c25af158f service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:34.001961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbb8af-ef6e-494f-83d1-e65c25af158f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:34.008265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-39dbb8af-ef6e-494f-83d1-e65c25af158f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:34.018088 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1358/2734] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:14:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:14:34.036955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98278f54-252f-4bba-9a5c-615434525498 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:34.038644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-98278f54-252f-4bba-9a5c-615434525498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:34.067896 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98278f54-252f-4bba-9a5c-615434525498 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:34.079334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4e4b0-fe7a-4e1e-a8f3-c8dd2f09f2c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:34.080254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4e4b0-fe7a-4e1e-a8f3-c8dd2f09f2c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:34.080638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4e4b0-fe7a-4e1e-a8f3-c8dd2f09f2c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:34.081019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4e4b0-fe7a-4e1e-a8f3-c8dd2f09f2c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:34.092934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6dd4e4b0-fe7a-4e1e-a8f3-c8dd2f09f2c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:34.201563 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:34.258320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4e4b0-fe7a-4e1e-a8f3-c8dd2f09f2c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:34.260754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4e4b0-fe7a-4e1e-a8f3-c8dd2f09f2c2 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:34.275782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dbb8af-ef6e-494f-83d1-e65c25af158f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:34.280244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dbb8af-ef6e-494f-83d1-e65c25af158f service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:34.281961 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1359/2735] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:14:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:14:34.283026 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4e4b0-fe7a-4e1e-a8f3-c8dd2f09f2c2 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:34.295968 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1377/2736] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:14:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:14:34.302102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4e4b0-fe7a-4e1e-a8f3-c8dd2f09f2c2 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:34.309803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047e4ee-b7fb-43ac-bd85-b85e071c1835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:34.310571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047e4ee-b7fb-43ac-bd85-b85e071c1835 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:34.317850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047e4ee-b7fb-43ac-bd85-b85e071c1835 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:34.318349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047e4ee-b7fb-43ac-bd85-b85e071c1835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:34.333691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047e4ee-b7fb-43ac-bd85-b85e071c1835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:34.336294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047e4ee-b7fb-43ac-bd85-b85e071c1835 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:34.355828 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1360/2737] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:14:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:14:39.442403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affb7de-af55-41b8-a3fe-cf9314705668 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:39.443140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affb7de-af55-41b8-a3fe-cf9314705668 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:39.443140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affb7de-af55-41b8-a3fe-cf9314705668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:39.503405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9affb7de-af55-41b8-a3fe-cf9314705668 None None] MFA Rules not processed for user `ae4f4a7231e4431c89712c557c4fa1df`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:14:39.504983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9affb7de-af55-41b8-a3fe-cf9314705668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:39.702222 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1378/2738] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:14:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:14:39.724968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb798a7-3ae9-42c5-adea-6b7d407c1e08 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:39.725510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb798a7-3ae9-42c5-adea-6b7d407c1e08 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:39.725510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb798a7-3ae9-42c5-adea-6b7d407c1e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:39.764535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1eb798a7-3ae9-42c5-adea-6b7d407c1e08 None None] MFA Rules not processed for user `ae4f4a7231e4431c89712c557c4fa1df`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:14:39.767287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1eb798a7-3ae9-42c5-adea-6b7d407c1e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:39.780381 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1361/2739] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:14:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:14:39.793172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affb7de-af55-41b8-a3fe-cf9314705668 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:39.795127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9affb7de-af55-41b8-a3fe-cf9314705668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:39.820591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affb7de-af55-41b8-a3fe-cf9314705668 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:39.836170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17587de7-dd37-49ab-b897-cb9a6da4407b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:39.836798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17587de7-dd37-49ab-b897-cb9a6da4407b service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:39.837306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17587de7-dd37-49ab-b897-cb9a6da4407b service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:39.837733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17587de7-dd37-49ab-b897-cb9a6da4407b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:39.854803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17587de7-dd37-49ab-b897-cb9a6da4407b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:39.856462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17587de7-dd37-49ab-b897-cb9a6da4407b service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:39.944609 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1379/2740] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:14:39 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:14:40.618298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb798a7-3ae9-42c5-adea-6b7d407c1e08 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:40.640962 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb798a7-3ae9-42c5-adea-6b7d407c1e08 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:40.654983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85a226-6222-4898-9c92-fdda37ef1aec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:40.658341 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85a226-6222-4898-9c92-fdda37ef1aec service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:40.659914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85a226-6222-4898-9c92-fdda37ef1aec service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:40.660319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85a226-6222-4898-9c92-fdda37ef1aec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:40.666172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8d85a226-6222-4898-9c92-fdda37ef1aec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:40.706309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85a226-6222-4898-9c92-fdda37ef1aec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:40.710600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85a226-6222-4898-9c92-fdda37ef1aec service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:40.752561 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1362/2741] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:14:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:14:42.133834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17587de7-dd37-49ab-b897-cb9a6da4407b service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:42.137412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-17587de7-dd37-49ab-b897-cb9a6da4407b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:42.356896 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17587de7-dd37-49ab-b897-cb9a6da4407b service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:42.369999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd97c7b-fd19-40a2-921a-6e28ecd41367 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:42.372136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd97c7b-fd19-40a2-921a-6e28ecd41367 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:42.372591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd97c7b-fd19-40a2-921a-6e28ecd41367 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:42.373377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd97c7b-fd19-40a2-921a-6e28ecd41367 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:42.376904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6fd97c7b-fd19-40a2-921a-6e28ecd41367 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:42.395389 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd97c7b-fd19-40a2-921a-6e28ecd41367 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:42.398439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd97c7b-fd19-40a2-921a-6e28ecd41367 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:42.418917 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1380/2742] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:14:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:14:43.350798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ec770-0507-4a2d-9e49-5e400e364297 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:43.351762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ec770-0507-4a2d-9e49-5e400e364297 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:43.352234 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ec770-0507-4a2d-9e49-5e400e364297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:43.370611 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:43.383792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b84ec770-0507-4a2d-9e49-5e400e364297 None None] MFA Rules not processed for user `b945db9a6f7a4143a544b76be5e9af9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:14:43.388750 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b84ec770-0507-4a2d-9e49-5e400e364297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:43.663636 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1363/2743] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:14:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:14:52.159949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d1f3c-b919-4f91-ab49-8d1598efb91b None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:52.160571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d1f3c-b919-4f91-ab49-8d1598efb91b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:52.160571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d1f3c-b919-4f91-ab49-8d1598efb91b None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:52.161861 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1381/2744] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 01:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:14:52.169374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e69841-7eee-413a-b6ea-6da00744fe1f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:52.169953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e69841-7eee-413a-b6ea-6da00744fe1f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:52.169953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e69841-7eee-413a-b6ea-6da00744fe1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:52.202891 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-f3e69841-7eee-413a-b6ea-6da00744fe1f None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:14:52.207200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f3e69841-7eee-413a-b6ea-6da00744fe1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:52.217986 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1364/2745] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 01:14:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:14:52.256540 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d1f3c-b919-4f91-ab49-8d1598efb91b None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:52.258522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-737d1f3c-b919-4f91-ab49-8d1598efb91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:52.284845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d1f3c-b919-4f91-ab49-8d1598efb91b None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:52.293588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6130de-08e1-428e-9bfb-64c30ff8f7a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:52.296305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6130de-08e1-428e-9bfb-64c30ff8f7a1 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:52.301012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6130de-08e1-428e-9bfb-64c30ff8f7a1 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:52.301710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6130de-08e1-428e-9bfb-64c30ff8f7a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:52.319497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6130de-08e1-428e-9bfb-64c30ff8f7a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:52.342736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6130de-08e1-428e-9bfb-64c30ff8f7a1 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:52.382476 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1382/2746] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:14:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:14:53.713625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d38c1-5fc9-46c5-afc1-7e22e1a27d67 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:53.716074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d38c1-5fc9-46c5-afc1-7e22e1a27d67 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:53.716796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d38c1-5fc9-46c5-afc1-7e22e1a27d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:53.743751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-fe9d38c1-5fc9-46c5-afc1-7e22e1a27d67 None None] MFA Rules not processed for user `32fc1959d8aa41eabcead217b9d7bc47`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:14:53.745551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-fe9d38c1-5fc9-46c5-afc1-7e22e1a27d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:53.898305 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1365/2747] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:14:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:14:54.503313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6130de-08e1-428e-9bfb-64c30ff8f7a1 service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:54.526107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6130de-08e1-428e-9bfb-64c30ff8f7a1 service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:54.535014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74a6f6-54b9-4c29-ac54-24e68e9d3822 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:54.536124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74a6f6-54b9-4c29-ac54-24e68e9d3822 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:54.536606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74a6f6-54b9-4c29-ac54-24e68e9d3822 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:54.537040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74a6f6-54b9-4c29-ac54-24e68e9d3822 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:54.540197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5e74a6f6-54b9-4c29-ac54-24e68e9d3822 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:54.556766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74a6f6-54b9-4c29-ac54-24e68e9d3822 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:54.557285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d38c1-5fc9-46c5-afc1-7e22e1a27d67 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:54.559322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74a6f6-54b9-4c29-ac54-24e68e9d3822 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:54.588530 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1383/2748] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:14:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:14:54.591074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d38c1-5fc9-46c5-afc1-7e22e1a27d67 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:54.611311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb29c8-dd0d-4c08-9dbd-a68967074519 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:54.612415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb29c8-dd0d-4c08-9dbd-a68967074519 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:54.620469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb29c8-dd0d-4c08-9dbd-a68967074519 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:54.624393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb29c8-dd0d-4c08-9dbd-a68967074519 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:54.646774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb29c8-dd0d-4c08-9dbd-a68967074519 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:54.648761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb29c8-dd0d-4c08-9dbd-a68967074519 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:54.671475 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1366/2749] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:14:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:14:55.010132 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74a6f6-54b9-4c29-ac54-24e68e9d3822 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:55.015002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5e74a6f6-54b9-4c29-ac54-24e68e9d3822 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:55.049795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74a6f6-54b9-4c29-ac54-24e68e9d3822 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:55.058626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b784da6-3ba8-4e91-9fe8-520f3072bdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:55.059288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b784da6-3ba8-4e91-9fe8-520f3072bdb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:55.059677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b784da6-3ba8-4e91-9fe8-520f3072bdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:55.060189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b784da6-3ba8-4e91-9fe8-520f3072bdb9 admin admin] PATH_INFO: `/v3/users/96d08a2479f847b4b06d6690f1aedb18` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:55.062197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b784da6-3ba8-4e91-9fe8-520f3072bdb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96d08a2479f847b4b06d6690f1aedb18)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:55.065144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b784da6-3ba8-4e91-9fe8-520f3072bdb9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:55.111451 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:55.195125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3b784da6-3ba8-4e91-9fe8-520f3072bdb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96d08a2479f847b4b06d6690f1aedb18'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:55.204348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3b784da6-3ba8-4e91-9fe8-520f3072bdb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96d08a2479f847b4b06d6690f1aedb18'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:55.226557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3b784da6-3ba8-4e91-9fe8-520f3072bdb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96d08a2479f847b4b06d6690f1aedb18'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:55.228603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3b784da6-3ba8-4e91-9fe8-520f3072bdb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96d08a2479f847b4b06d6690f1aedb18'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:55.243656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3b784da6-3ba8-4e91-9fe8-520f3072bdb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96d08a2479f847b4b06d6690f1aedb18'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:55.258706 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1384/2750] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:14:55 2022] DELETE /identity/v3/users/96d08a2479f847b4b06d6690f1aedb18 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:14:55.920487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb29c8-dd0d-4c08-9dbd-a68967074519 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:55.943239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb29c8-dd0d-4c08-9dbd-a68967074519 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:56.110392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bfe73-d286-422a-8c37-219fa0853c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:56.111427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bfe73-d286-422a-8c37-219fa0853c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:56.112134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bfe73-d286-422a-8c37-219fa0853c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:56.113257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bfe73-d286-422a-8c37-219fa0853c56 admin admin] PATH_INFO: `/v3/projects/6a06211ba44e4f6d88f9095969001aab` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:56.116221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4bfe73-d286-422a-8c37-219fa0853c56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a06211ba44e4f6d88f9095969001aab)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:56.118979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4bfe73-d286-422a-8c37-219fa0853c56 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:56.178522 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:56.190452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ab4bfe73-d286-422a-8c37-219fa0853c56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a06211ba44e4f6d88f9095969001aab', 'request_id': 'req-ab4bfe73-d286-422a-8c37-219fa0853c56'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:56.198830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ab4bfe73-d286-422a-8c37-219fa0853c56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a06211ba44e4f6d88f9095969001aab', 'request_id': 'req-ab4bfe73-d286-422a-8c37-219fa0853c56'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:56.207928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ab4bfe73-d286-422a-8c37-219fa0853c56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a06211ba44e4f6d88f9095969001aab', 'request_id': 'req-ab4bfe73-d286-422a-8c37-219fa0853c56'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:56.230330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ab4bfe73-d286-422a-8c37-219fa0853c56 admin admin] The token cache is being invalidate because project 6a06211ba44e4f6d88f9095969001aab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:14:56.230816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ab4bfe73-d286-422a-8c37-219fa0853c56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:56.232591 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ab4bfe73-d286-422a-8c37-219fa0853c56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:56.237965 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1367/2751] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:14:55 2022] DELETE /identity/v3/projects/6a06211ba44e4f6d88f9095969001aab => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:14:56.239248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b784da6-3ba8-4e91-9fe8-520f3072bdb9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:56.240735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3b784da6-3ba8-4e91-9fe8-520f3072bdb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:56.256108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b784da6-3ba8-4e91-9fe8-520f3072bdb9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:56.336934 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b181d20-6dad-4586-9dda-a932cc1dfcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:56.338107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b181d20-6dad-4586-9dda-a932cc1dfcc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:56.338428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b181d20-6dad-4586-9dda-a932cc1dfcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:56.338939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b181d20-6dad-4586-9dda-a932cc1dfcc2 admin admin] PATH_INFO: `/v3/users/1bb91c5d1c274ef38ad02e7fa176b4c6` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:56.340398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b181d20-6dad-4586-9dda-a932cc1dfcc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bb91c5d1c274ef38ad02e7fa176b4c6)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:56.342554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b181d20-6dad-4586-9dda-a932cc1dfcc2 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:56.399063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4b181d20-6dad-4586-9dda-a932cc1dfcc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bb91c5d1c274ef38ad02e7fa176b4c6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:56.406798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4b181d20-6dad-4586-9dda-a932cc1dfcc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bb91c5d1c274ef38ad02e7fa176b4c6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:56.420862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4b181d20-6dad-4586-9dda-a932cc1dfcc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bb91c5d1c274ef38ad02e7fa176b4c6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:56.422436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4b181d20-6dad-4586-9dda-a932cc1dfcc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bb91c5d1c274ef38ad02e7fa176b4c6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:56.432094 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4b181d20-6dad-4586-9dda-a932cc1dfcc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bb91c5d1c274ef38ad02e7fa176b4c6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:56.443458 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1385/2752] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:14:56 2022] DELETE /identity/v3/users/1bb91c5d1c274ef38ad02e7fa176b4c6 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:14:57.797114 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bfe73-d286-422a-8c37-219fa0853c56 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:57.798627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ab4bfe73-d286-422a-8c37-219fa0853c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:57.829910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bfe73-d286-422a-8c37-219fa0853c56 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:57.987491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da3016-01cb-4c64-982f-2c45a6a879da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:57.988685 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da3016-01cb-4c64-982f-2c45a6a879da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:57.988685 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da3016-01cb-4c64-982f-2c45a6a879da admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:57.990396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da3016-01cb-4c64-982f-2c45a6a879da admin admin] PATH_INFO: `/v3/projects/e0645466b9624cc59802802f819897cf` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:57.994754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da3016-01cb-4c64-982f-2c45a6a879da admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0645466b9624cc59802802f819897cf)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:57.996797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da3016-01cb-4c64-982f-2c45a6a879da admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:58.099067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-62da3016-01cb-4c64-982f-2c45a6a879da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0645466b9624cc59802802f819897cf', 'request_id': 'req-62da3016-01cb-4c64-982f-2c45a6a879da'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:58.108433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-62da3016-01cb-4c64-982f-2c45a6a879da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0645466b9624cc59802802f819897cf', 'request_id': 'req-62da3016-01cb-4c64-982f-2c45a6a879da'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:58.119310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-62da3016-01cb-4c64-982f-2c45a6a879da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0645466b9624cc59802802f819897cf', 'request_id': 'req-62da3016-01cb-4c64-982f-2c45a6a879da'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:58.143746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-62da3016-01cb-4c64-982f-2c45a6a879da admin admin] The token cache is being invalidate because project e0645466b9624cc59802802f819897cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:14:58.146419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-62da3016-01cb-4c64-982f-2c45a6a879da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:58.148320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-62da3016-01cb-4c64-982f-2c45a6a879da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:14:58.150050 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1368/2753] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:14:57 2022] DELETE /identity/v3/projects/e0645466b9624cc59802802f819897cf => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:14:58.157900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08605f3a-3fed-4eb1-8faf-59e1be2f4594 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:58.158433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08605f3a-3fed-4eb1-8faf-59e1be2f4594 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:58.158541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08605f3a-3fed-4eb1-8faf-59e1be2f4594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:58.199724 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-08605f3a-3fed-4eb1-8faf-59e1be2f4594 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:14:58.202593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-08605f3a-3fed-4eb1-8faf-59e1be2f4594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:58.221373 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:58.336517 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1386/2754] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:14:58.344573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dd60d-60b4-46bf-b3b2-11e5bb0e747a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:58.344840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dd60d-60b4-46bf-b3b2-11e5bb0e747a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:58.345122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dd60d-60b4-46bf-b3b2-11e5bb0e747a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:58.393880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08605f3a-3fed-4eb1-8faf-59e1be2f4594 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:58.395943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-08605f3a-3fed-4eb1-8faf-59e1be2f4594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:58.410203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9e2dd60d-60b4-46bf-b3b2-11e5bb0e747a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:14:58.413923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9e2dd60d-60b4-46bf-b3b2-11e5bb0e747a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:58.450416 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1369/2755] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:14:58.454756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dd60d-60b4-46bf-b3b2-11e5bb0e747a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:58.480322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dd60d-60b4-46bf-b3b2-11e5bb0e747a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:58.496967 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbc442-85ab-4860-8e14-5b45b30025da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:58.497914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbc442-85ab-4860-8e14-5b45b30025da admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:58.498551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbc442-85ab-4860-8e14-5b45b30025da admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:58.498986 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbc442-85ab-4860-8e14-5b45b30025da admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:58.499833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cbc442-85ab-4860-8e14-5b45b30025da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:14:58.500347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cbc442-85ab-4860-8e14-5b45b30025da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:58.503699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cbc442-85ab-4860-8e14-5b45b30025da admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:58.537284 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1370/2756] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:14:58.553945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbc442-85ab-4860-8e14-5b45b30025da admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:58.587510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbc442-85ab-4860-8e14-5b45b30025da admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:58.600448 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7e160-d4bd-448f-9b1d-b4d626e7ec87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:58.603209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7e160-d4bd-448f-9b1d-b4d626e7ec87 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:58.603699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7e160-d4bd-448f-9b1d-b4d626e7ec87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:58.604008 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7e160-d4bd-448f-9b1d-b4d626e7ec87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:58.604663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7e160-d4bd-448f-9b1d-b4d626e7ec87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:58.623913 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7e160-d4bd-448f-9b1d-b4d626e7ec87 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:58.669566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08605f3a-3fed-4eb1-8faf-59e1be2f4594 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:58.684411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39bb24-0435-4fd4-896b-8be44fd33c02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:58.688147 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39bb24-0435-4fd4-896b-8be44fd33c02 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:58.688446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39bb24-0435-4fd4-896b-8be44fd33c02 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:58.689645 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39bb24-0435-4fd4-896b-8be44fd33c02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:58.697339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-cd39bb24-0435-4fd4-896b-8be44fd33c02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:58.731846 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1371/2757] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:14:58 2022] POST /identity/v3/projects => generated 375 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:14:58.734766 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7e160-d4bd-448f-9b1d-b4d626e7ec87 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:58.749024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd39bb24-0435-4fd4-896b-8be44fd33c02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:58.751639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd39bb24-0435-4fd4-896b-8be44fd33c02 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:58.793038 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1387/2758] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:14:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:14:58.809049 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:58.925628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39bb24-0435-4fd4-896b-8be44fd33c02 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:58.950003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39bb24-0435-4fd4-896b-8be44fd33c02 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:58.952712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7e160-d4bd-448f-9b1d-b4d626e7ec87 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:58.969261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677486bf-3816-441c-8bbf-74ad6c6feb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:58.970164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677486bf-3816-441c-8bbf-74ad6c6feb75 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:58.970879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677486bf-3816-441c-8bbf-74ad6c6feb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:58.971697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677486bf-3816-441c-8bbf-74ad6c6feb75 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:58.972978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677486bf-3816-441c-8bbf-74ad6c6feb75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:58.975877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677486bf-3816-441c-8bbf-74ad6c6feb75 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:59.027223 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1372/2759] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:14:58 2022] POST /identity/v3/users => generated 288 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:14:59.034304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677486bf-3816-441c-8bbf-74ad6c6feb75 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:59.100560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677486bf-3816-441c-8bbf-74ad6c6feb75 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:59.153984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1ab2b-b58f-49c8-a708-9250bfb06ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:59.157849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1ab2b-b58f-49c8-a708-9250bfb06ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:59.158926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1ab2b-b58f-49c8-a708-9250bfb06ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:59.160741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1ab2b-b58f-49c8-a708-9250bfb06ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:59.165056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1ab2b-b58f-49c8-a708-9250bfb06ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:59.168629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8f3df-4b6b-43a5-8dbc-d46ca56da904 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:59.175404 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8f3df-4b6b-43a5-8dbc-d46ca56da904 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:59.175934 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8f3df-4b6b-43a5-8dbc-d46ca56da904 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:59.176433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8f3df-4b6b-43a5-8dbc-d46ca56da904 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:59.178298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1ab2b-b58f-49c8-a708-9250bfb06ce0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:59.192541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-24c8f3df-4b6b-43a5-8dbc-d46ca56da904 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:59.232242 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1373/2760] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:14:59.235810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0c484-e75d-4d24-9524-0a08438dfe5e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:59.236425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0c484-e75d-4d24-9524-0a08438dfe5e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:59.236858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0c484-e75d-4d24-9524-0a08438dfe5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:59.242352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8f3df-4b6b-43a5-8dbc-d46ca56da904 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:59.245584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8f3df-4b6b-43a5-8dbc-d46ca56da904 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:59.321479 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1388/2761] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:14:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:14:59.335787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8f3df-4b6b-43a5-8dbc-d46ca56da904 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:59.356101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-dcd0c484-e75d-4d24-9524-0a08438dfe5e None None] MFA Rules not processed for user `21219c93625d4e6b802d8a99b3e520d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:14:59.365942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-dcd0c484-e75d-4d24-9524-0a08438dfe5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:59.388073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8f3df-4b6b-43a5-8dbc-d46ca56da904 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:59.410647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68545759-585d-4b76-bb67-3629e082dc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:59.411283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68545759-585d-4b76-bb67-3629e082dc8a admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:59.416699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68545759-585d-4b76-bb67-3629e082dc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:59.416988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68545759-585d-4b76-bb67-3629e082dc8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:59.420937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68545759-585d-4b76-bb67-3629e082dc8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:59.434987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68545759-585d-4b76-bb67-3629e082dc8a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:59.475937 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1389/2762] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:14:59.493023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68545759-585d-4b76-bb67-3629e082dc8a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:59.523868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68545759-585d-4b76-bb67-3629e082dc8a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:14:59.543510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c228d-7778-4e9b-8ffb-780028a646c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:14:59.544553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c228d-7778-4e9b-8ffb-780028a646c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:59.545025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c228d-7778-4e9b-8ffb-780028a646c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:59.545475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c228d-7778-4e9b-8ffb-780028a646c4 admin admin] PATH_INFO: `/v3/projects/31d94e547b5742f7bc2cdc09f37dcbe8/users/0f9ff851d71b43de96fe0c37995f84cc/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:59.566642 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:14:59.586083 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c228d-7778-4e9b-8ffb-780028a646c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31d94e547b5742f7bc2cdc09f37dcbe8, user_id=0f9ff851d71b43de96fe0c37995f84cc, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:14:59.589309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c228d-7778-4e9b-8ffb-780028a646c4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:14:59.634354 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1390/2763] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:14:59 2022] PUT /identity/v3/projects/31d94e547b5742f7bc2cdc09f37dcbe8/users/0f9ff851d71b43de96fe0c37995f84cc/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:14:59.637474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ad50c-41ce-41de-a72f-a4288ac81861 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:14:59.637715 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ad50c-41ce-41de-a72f-a4288ac81861 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:14:59.637826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ad50c-41ce-41de-a72f-a4288ac81861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:14:59.762507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e84ad50c-41ce-41de-a72f-a4288ac81861 None None] MFA Rules not processed for user `0f9ff851d71b43de96fe0c37995f84cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:14:59.763840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e84ad50c-41ce-41de-a72f-a4288ac81861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:14:59.854932 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1374/2764] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:14:59 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 622 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:14:59.929519 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1391/2765] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:14:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:14:59.935413 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0c484-e75d-4d24-9524-0a08438dfe5e None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:14:59.952301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0c484-e75d-4d24-9524-0a08438dfe5e None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:00.148258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc9e53-5995-4d60-94f9-2840f9434156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:00.149488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc9e53-5995-4d60-94f9-2840f9434156 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:00.149772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc9e53-5995-4d60-94f9-2840f9434156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:00.150061 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc9e53-5995-4d60-94f9-2840f9434156 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:00.150675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc9e53-5995-4d60-94f9-2840f9434156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:00.152665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc9e53-5995-4d60-94f9-2840f9434156 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:00.210526 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1375/2766] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:14:59 2022] POST /identity/v3/projects => generated 373 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:15:00.212279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ad50c-41ce-41de-a72f-a4288ac81861 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:00.244091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ad50c-41ce-41de-a72f-a4288ac81861 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:00.435600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2ce4a-c34b-4433-954d-2a3ec19f92e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:00.437087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2ce4a-c34b-4433-954d-2a3ec19f92e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:00.437738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2ce4a-c34b-4433-954d-2a3ec19f92e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:00.438356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2ce4a-c34b-4433-954d-2a3ec19f92e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:00.439962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2ce4a-c34b-4433-954d-2a3ec19f92e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:00.452120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2ce4a-c34b-4433-954d-2a3ec19f92e2 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:00.519018 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1392/2767] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:15:00 2022] POST /identity/v3/users => generated 293 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:15:00.522967 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc9e53-5995-4d60-94f9-2840f9434156 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:00.563498 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc9e53-5995-4d60-94f9-2840f9434156 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:00.583383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc829b93-c330-49a7-a4f7-21c6d3de5df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:00.584444 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc829b93-c330-49a7-a4f7-21c6d3de5df2 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:00.584914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc829b93-c330-49a7-a4f7-21c6d3de5df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:00.585367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc829b93-c330-49a7-a4f7-21c6d3de5df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:00.587569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc829b93-c330-49a7-a4f7-21c6d3de5df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:00.590168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc829b93-c330-49a7-a4f7-21c6d3de5df2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:00.604745 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:00.650763 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1376/2768] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:15:00.657619 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2ce4a-c34b-4433-954d-2a3ec19f92e2 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:00.692278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2ce4a-c34b-4433-954d-2a3ec19f92e2 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:00.713716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e330df-2bcf-46d6-bf61-e35ac578d2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:00.716852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e330df-2bcf-46d6-bf61-e35ac578d2ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:00.717357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e330df-2bcf-46d6-bf61-e35ac578d2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:00.718506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e330df-2bcf-46d6-bf61-e35ac578d2ae admin admin] PATH_INFO: `/v3/projects/2a91c1dd78664621804b0fedebb523da/users/ccc29c4b20f649cead7bf16d07f83f6e/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:00.792436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e330df-2bcf-46d6-bf61-e35ac578d2ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a91c1dd78664621804b0fedebb523da, user_id=ccc29c4b20f649cead7bf16d07f83f6e, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:00.808726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e330df-2bcf-46d6-bf61-e35ac578d2ae admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:00.860144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc829b93-c330-49a7-a4f7-21c6d3de5df2 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:00.871462 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1393/2769] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:15:00 2022] PUT /identity/v3/projects/2a91c1dd78664621804b0fedebb523da/users/ccc29c4b20f649cead7bf16d07f83f6e/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:00.877714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc829b93-c330-49a7-a4f7-21c6d3de5df2 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:01.077375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c9bf2-35ae-4231-93ce-1fea9561b53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:01.078413 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c9bf2-35ae-4231-93ce-1fea9561b53a admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:01.079122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c9bf2-35ae-4231-93ce-1fea9561b53a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:01.080237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c9bf2-35ae-4231-93ce-1fea9561b53a admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:01.080885 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c9bf2-35ae-4231-93ce-1fea9561b53a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:01.085765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c9bf2-35ae-4231-93ce-1fea9561b53a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:01.121895 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1377/2770] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:15:00 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:15:01.122443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e330df-2bcf-46d6-bf61-e35ac578d2ae admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:01.139661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e330df-2bcf-46d6-bf61-e35ac578d2ae admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:01.157330 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd94d1-1e52-4564-83d8-cc8faf221615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:01.159359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd94d1-1e52-4564-83d8-cc8faf221615 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:01.163618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd94d1-1e52-4564-83d8-cc8faf221615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:01.163974 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd94d1-1e52-4564-83d8-cc8faf221615 admin admin] PATH_INFO: `/v3/projects/2a91c1dd78664621804b0fedebb523da/users/ccc29c4b20f649cead7bf16d07f83f6e/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:01.168061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd94d1-1e52-4564-83d8-cc8faf221615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a91c1dd78664621804b0fedebb523da, user_id=ccc29c4b20f649cead7bf16d07f83f6e, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:01.173775 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd94d1-1e52-4564-83d8-cc8faf221615 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:01.243309 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1394/2771] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:15:01 2022] PUT /identity/v3/projects/2a91c1dd78664621804b0fedebb523da/users/ccc29c4b20f649cead7bf16d07f83f6e/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:01.259639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b57c8-1851-4e90-848c-da3b25ca8875 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:01.261190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b57c8-1851-4e90-848c-da3b25ca8875 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:01.261772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b57c8-1851-4e90-848c-da3b25ca8875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:01.271008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd94d1-1e52-4564-83d8-cc8faf221615 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:01.274579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-abbd94d1-1e52-4564-83d8-cc8faf221615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:01.364804 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-cb0b57c8-1851-4e90-848c-da3b25ca8875 None None] MFA Rules not processed for user `ccc29c4b20f649cead7bf16d07f83f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:01.368642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cb0b57c8-1851-4e90-848c-da3b25ca8875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:01.372673 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:01.489263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd94d1-1e52-4564-83d8-cc8faf221615 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:01.496360 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1378/2772] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:01.505441 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f9975-bb27-4e2e-af32-bb122d978cb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:01.506201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f9975-bb27-4e2e-af32-bb122d978cb9 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:01.506388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f9975-bb27-4e2e-af32-bb122d978cb9 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:01.506591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f9975-bb27-4e2e-af32-bb122d978cb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:01.642973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f9975-bb27-4e2e-af32-bb122d978cb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:01.646371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f9975-bb27-4e2e-af32-bb122d978cb9 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:01.662769 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1395/2773] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:01 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:15:02.848109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b57c8-1851-4e90-848c-da3b25ca8875 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:02.870410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b57c8-1851-4e90-848c-da3b25ca8875 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:02.904650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19a096-19eb-4c39-ac06-b44dce8b5cf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:02.905524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19a096-19eb-4c39-ac06-b44dce8b5cf6 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:02.905939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19a096-19eb-4c39-ac06-b44dce8b5cf6 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:02.906314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19a096-19eb-4c39-ac06-b44dce8b5cf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:02.919815 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19a096-19eb-4c39-ac06-b44dce8b5cf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:02.922638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19a096-19eb-4c39-ac06-b44dce8b5cf6 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:02.966408 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1379/2774] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:15:03.624761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f9975-bb27-4e2e-af32-bb122d978cb9 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:03.638681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f9975-bb27-4e2e-af32-bb122d978cb9 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:03.659391 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59fbdd-965d-4d7b-b08e-1a371a963c82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:03.660375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59fbdd-965d-4d7b-b08e-1a371a963c82 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:03.660842 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59fbdd-965d-4d7b-b08e-1a371a963c82 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:03.661277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59fbdd-965d-4d7b-b08e-1a371a963c82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:03.813332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59fbdd-965d-4d7b-b08e-1a371a963c82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:03.815260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59fbdd-965d-4d7b-b08e-1a371a963c82 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:03.843044 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1396/2775] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:15:05.281212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19a096-19eb-4c39-ac06-b44dce8b5cf6 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:05.283586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0d19a096-19eb-4c39-ac06-b44dce8b5cf6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:05.537613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19a096-19eb-4c39-ac06-b44dce8b5cf6 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:05.551679 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308b649-9e0e-4687-8cc3-4d52ff9a8299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:05.553727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308b649-9e0e-4687-8cc3-4d52ff9a8299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:05.556112 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308b649-9e0e-4687-8cc3-4d52ff9a8299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:05.557522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308b649-9e0e-4687-8cc3-4d52ff9a8299 admin admin] PATH_INFO: `/v3/users/7e9dce42ff994d81b1ad6d6c05356c37` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:05.559481 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308b649-9e0e-4687-8cc3-4d52ff9a8299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e9dce42ff994d81b1ad6d6c05356c37)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:05.563107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308b649-9e0e-4687-8cc3-4d52ff9a8299 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:05.570767 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:05.744812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1308b649-9e0e-4687-8cc3-4d52ff9a8299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e9dce42ff994d81b1ad6d6c05356c37'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:05.767029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1308b649-9e0e-4687-8cc3-4d52ff9a8299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e9dce42ff994d81b1ad6d6c05356c37'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:05.801159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1308b649-9e0e-4687-8cc3-4d52ff9a8299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e9dce42ff994d81b1ad6d6c05356c37'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:05.805810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1308b649-9e0e-4687-8cc3-4d52ff9a8299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e9dce42ff994d81b1ad6d6c05356c37'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:05.821116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1308b649-9e0e-4687-8cc3-4d52ff9a8299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e9dce42ff994d81b1ad6d6c05356c37'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:05.831329 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1380/2776] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:15:05 2022] DELETE /identity/v3/users/7e9dce42ff994d81b1ad6d6c05356c37 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:06.378717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59fbdd-965d-4d7b-b08e-1a371a963c82 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:06.408434 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59fbdd-965d-4d7b-b08e-1a371a963c82 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:06.583343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f91ba-023e-4662-8f0b-e8488ccae605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:06.584527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f91ba-023e-4662-8f0b-e8488ccae605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:06.584814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f91ba-023e-4662-8f0b-e8488ccae605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:06.585091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f91ba-023e-4662-8f0b-e8488ccae605 admin admin] PATH_INFO: `/v3/users/0f9ff851d71b43de96fe0c37995f84cc` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:06.587355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f91ba-023e-4662-8f0b-e8488ccae605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f9ff851d71b43de96fe0c37995f84cc)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:06.589751 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f91ba-023e-4662-8f0b-e8488ccae605 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:06.599104 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:06.681037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dd5f91ba-023e-4662-8f0b-e8488ccae605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f9ff851d71b43de96fe0c37995f84cc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:06.690568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dd5f91ba-023e-4662-8f0b-e8488ccae605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f9ff851d71b43de96fe0c37995f84cc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:06.709346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dd5f91ba-023e-4662-8f0b-e8488ccae605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f9ff851d71b43de96fe0c37995f84cc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:06.710334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dd5f91ba-023e-4662-8f0b-e8488ccae605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f9ff851d71b43de96fe0c37995f84cc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:06.725477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dd5f91ba-023e-4662-8f0b-e8488ccae605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f9ff851d71b43de96fe0c37995f84cc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:06.741498 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1397/2777] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:15:06 2022] DELETE /identity/v3/users/0f9ff851d71b43de96fe0c37995f84cc => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:06.747009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06729b34-48cc-4f01-b1ce-4ff61fb83b87 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:06.748032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06729b34-48cc-4f01-b1ce-4ff61fb83b87 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:06.748468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06729b34-48cc-4f01-b1ce-4ff61fb83b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:06.797418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-06729b34-48cc-4f01-b1ce-4ff61fb83b87 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:06.805821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-06729b34-48cc-4f01-b1ce-4ff61fb83b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:07.029937 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1381/2778] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:15:07.077768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f91ba-023e-4662-8f0b-e8488ccae605 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:07.079498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dd5f91ba-023e-4662-8f0b-e8488ccae605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:07.218808 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f91ba-023e-4662-8f0b-e8488ccae605 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:07.244933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605735cc-b9b5-48d5-93f9-138c1dda0b03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:07.245920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605735cc-b9b5-48d5-93f9-138c1dda0b03 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:07.245920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605735cc-b9b5-48d5-93f9-138c1dda0b03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:07.246292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605735cc-b9b5-48d5-93f9-138c1dda0b03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:07.272584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605735cc-b9b5-48d5-93f9-138c1dda0b03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:07.274654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605735cc-b9b5-48d5-93f9-138c1dda0b03 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:07.305644 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1398/2779] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:15:07.577473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06729b34-48cc-4f01-b1ce-4ff61fb83b87 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:07.582044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-06729b34-48cc-4f01-b1ce-4ff61fb83b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:07.614454 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06729b34-48cc-4f01-b1ce-4ff61fb83b87 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:07.622658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5163c512-7232-4082-8670-c700fae4414b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:07.624784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163c512-7232-4082-8670-c700fae4414b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:07.625515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163c512-7232-4082-8670-c700fae4414b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:07.626402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163c512-7232-4082-8670-c700fae4414b admin admin] PATH_INFO: `/v3/projects/3e6d319a0452448485aa65b7cf1c5b0e` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:07.631309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5163c512-7232-4082-8670-c700fae4414b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e6d319a0452448485aa65b7cf1c5b0e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:07.636138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5163c512-7232-4082-8670-c700fae4414b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:07.763494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5163c512-7232-4082-8670-c700fae4414b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e6d319a0452448485aa65b7cf1c5b0e', 'request_id': 'req-5163c512-7232-4082-8670-c700fae4414b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:07.777436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5163c512-7232-4082-8670-c700fae4414b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e6d319a0452448485aa65b7cf1c5b0e', 'request_id': 'req-5163c512-7232-4082-8670-c700fae4414b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:07.789736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5163c512-7232-4082-8670-c700fae4414b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e6d319a0452448485aa65b7cf1c5b0e', 'request_id': 'req-5163c512-7232-4082-8670-c700fae4414b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:07.826057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5163c512-7232-4082-8670-c700fae4414b admin admin] The token cache is being invalidate because project 3e6d319a0452448485aa65b7cf1c5b0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:15:07.826350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5163c512-7232-4082-8670-c700fae4414b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:07.827221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5163c512-7232-4082-8670-c700fae4414b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:07.828975 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1382/2780] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:15:07 2022] DELETE /identity/v3/projects/3e6d319a0452448485aa65b7cf1c5b0e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:07.833709 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605735cc-b9b5-48d5-93f9-138c1dda0b03 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:07.854226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605735cc-b9b5-48d5-93f9-138c1dda0b03 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:07.997243 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f9209-627a-44f5-ada0-7942c8ddd12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:07.998710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f9209-627a-44f5-ada0-7942c8ddd12b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:07.999437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f9209-627a-44f5-ada0-7942c8ddd12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:07.999999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f9209-627a-44f5-ada0-7942c8ddd12b admin admin] PATH_INFO: `/v3/users/48ba57d381ee4569b9bce256d01bc5c6` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:08.001731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f9209-627a-44f5-ada0-7942c8ddd12b admin admin] RBAC: Authorizing `identity:delete_user(user_id=48ba57d381ee4569b9bce256d01bc5c6)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:08.005289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f9209-627a-44f5-ada0-7942c8ddd12b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:08.073114 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:08.111663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cb2f9209-627a-44f5-ada0-7942c8ddd12b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48ba57d381ee4569b9bce256d01bc5c6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:08.124735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cb2f9209-627a-44f5-ada0-7942c8ddd12b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48ba57d381ee4569b9bce256d01bc5c6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:08.145023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cb2f9209-627a-44f5-ada0-7942c8ddd12b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48ba57d381ee4569b9bce256d01bc5c6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:08.146419 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cb2f9209-627a-44f5-ada0-7942c8ddd12b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48ba57d381ee4569b9bce256d01bc5c6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:08.163565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cb2f9209-627a-44f5-ada0-7942c8ddd12b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48ba57d381ee4569b9bce256d01bc5c6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:08.179354 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1399/2781] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:15:07 2022] DELETE /identity/v3/users/48ba57d381ee4569b9bce256d01bc5c6 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:08.746522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5163c512-7232-4082-8670-c700fae4414b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:08.748367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5163c512-7232-4082-8670-c700fae4414b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:08.774547 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:08.889692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f9209-627a-44f5-ada0-7942c8ddd12b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:08.891917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-cb2f9209-627a-44f5-ada0-7942c8ddd12b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:08.968108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5163c512-7232-4082-8670-c700fae4414b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:09.038651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f9209-627a-44f5-ada0-7942c8ddd12b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:09.052858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fce0a-0e62-4a33-a15a-b2072d712139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:09.054626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fce0a-0e62-4a33-a15a-b2072d712139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:09.055123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fce0a-0e62-4a33-a15a-b2072d712139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:09.055564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fce0a-0e62-4a33-a15a-b2072d712139 admin admin] PATH_INFO: `/v3/projects/d5ea429307984908b718fa99c7391fb4` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:09.058177 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fce0a-0e62-4a33-a15a-b2072d712139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5ea429307984908b718fa99c7391fb4)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:09.060976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fce0a-0e62-4a33-a15a-b2072d712139 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:09.157963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-324fce0a-0e62-4a33-a15a-b2072d712139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5ea429307984908b718fa99c7391fb4', 'request_id': 'req-324fce0a-0e62-4a33-a15a-b2072d712139'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:09.168899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-324fce0a-0e62-4a33-a15a-b2072d712139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5ea429307984908b718fa99c7391fb4', 'request_id': 'req-324fce0a-0e62-4a33-a15a-b2072d712139'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:09.178345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-324fce0a-0e62-4a33-a15a-b2072d712139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5ea429307984908b718fa99c7391fb4', 'request_id': 'req-324fce0a-0e62-4a33-a15a-b2072d712139'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:09.205383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-324fce0a-0e62-4a33-a15a-b2072d712139 admin admin] The token cache is being invalidate because project d5ea429307984908b718fa99c7391fb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:15:09.206094 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-324fce0a-0e62-4a33-a15a-b2072d712139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:09.208093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-324fce0a-0e62-4a33-a15a-b2072d712139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:09.216943 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1400/2782] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:15:08 2022] DELETE /identity/v3/projects/d5ea429307984908b718fa99c7391fb4 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:15:09.216943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fce0a-0e62-4a33-a15a-b2072d712139 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:09.217743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-324fce0a-0e62-4a33-a15a-b2072d712139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:09.219105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e67fac-a51e-4e5a-a997-97852afb2a9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:09.225438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e67fac-a51e-4e5a-a997-97852afb2a9d service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:09.225438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e67fac-a51e-4e5a-a997-97852afb2a9d service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:09.225438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e67fac-a51e-4e5a-a997-97852afb2a9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:09.227709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d1e67fac-a51e-4e5a-a997-97852afb2a9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:09.250595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e67fac-a51e-4e5a-a997-97852afb2a9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:09.252999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e67fac-a51e-4e5a-a997-97852afb2a9d service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:09.271727 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1383/2783] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:15:09.273333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8dc88-08f9-4b46-98a9-40465f86979f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:09.273714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8dc88-08f9-4b46-98a9-40465f86979f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:09.273901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8dc88-08f9-4b46-98a9-40465f86979f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:09.339991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1cf8dc88-08f9-4b46-98a9-40465f86979f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:09.341244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1cf8dc88-08f9-4b46-98a9-40465f86979f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:09.347401 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:09.396448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fce0a-0e62-4a33-a15a-b2072d712139 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:09.403810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4af4eb-090a-4f69-b64c-05727670efdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:09.404607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4af4eb-090a-4f69-b64c-05727670efdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:09.405039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4af4eb-090a-4f69-b64c-05727670efdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:09.405198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4af4eb-090a-4f69-b64c-05727670efdb admin admin] PATH_INFO: `/v3/projects/31d94e547b5742f7bc2cdc09f37dcbe8` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:09.406658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4af4eb-090a-4f69-b64c-05727670efdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=31d94e547b5742f7bc2cdc09f37dcbe8)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:09.412938 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4af4eb-090a-4f69-b64c-05727670efdb admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:09.535417 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1384/2784] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:09.537234 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb15124-8916-49c1-9b66-0d1ca34cb63c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:09.537704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb15124-8916-49c1-9b66-0d1ca34cb63c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:09.541011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb15124-8916-49c1-9b66-0d1ca34cb63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:09.585784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9eb15124-8916-49c1-9b66-0d1ca34cb63c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:09.588838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9eb15124-8916-49c1-9b66-0d1ca34cb63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:09.599666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bc4af4eb-090a-4f69-b64c-05727670efdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31d94e547b5742f7bc2cdc09f37dcbe8', 'request_id': 'req-bc4af4eb-090a-4f69-b64c-05727670efdb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:09.620092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bc4af4eb-090a-4f69-b64c-05727670efdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31d94e547b5742f7bc2cdc09f37dcbe8', 'request_id': 'req-bc4af4eb-090a-4f69-b64c-05727670efdb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:09.641529 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bc4af4eb-090a-4f69-b64c-05727670efdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31d94e547b5742f7bc2cdc09f37dcbe8', 'request_id': 'req-bc4af4eb-090a-4f69-b64c-05727670efdb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:09.691270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bc4af4eb-090a-4f69-b64c-05727670efdb admin admin] The token cache is being invalidate because project 31d94e547b5742f7bc2cdc09f37dcbe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:15:09.692651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bc4af4eb-090a-4f69-b64c-05727670efdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:09.697322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bc4af4eb-090a-4f69-b64c-05727670efdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:09.701472 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1401/2785] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:15:09 2022] DELETE /identity/v3/projects/31d94e547b5742f7bc2cdc09f37dcbe8 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:09.706414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4af4eb-090a-4f69-b64c-05727670efdb admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:09.708745 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:09.711522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-bc4af4eb-090a-4f69-b64c-05727670efdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:09.814228 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1385/2786] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:09.819549 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb15124-8916-49c1-9b66-0d1ca34cb63c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:09.846921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb15124-8916-49c1-9b66-0d1ca34cb63c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:09.860660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a860c20-41f9-43e2-bf2c-053d1c6113d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:09.861494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a860c20-41f9-43e2-bf2c-053d1c6113d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:09.861785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a860c20-41f9-43e2-bf2c-053d1c6113d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:09.862058 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a860c20-41f9-43e2-bf2c-053d1c6113d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:09.862997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a860c20-41f9-43e2-bf2c-053d1c6113d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:15:09.863483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a860c20-41f9-43e2-bf2c-053d1c6113d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:09.866143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a860c20-41f9-43e2-bf2c-053d1c6113d0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:09.882333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4af4eb-090a-4f69-b64c-05727670efdb admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:09.892256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f9480-5322-4390-b41a-fb68c233579d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:09.895021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f9480-5322-4390-b41a-fb68c233579d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:09.895649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f9480-5322-4390-b41a-fb68c233579d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:09.896178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f9480-5322-4390-b41a-fb68c233579d admin admin] PATH_INFO: `/v3/users/ccc29c4b20f649cead7bf16d07f83f6e` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:09.898900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f9480-5322-4390-b41a-fb68c233579d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccc29c4b20f649cead7bf16d07f83f6e)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:09.902870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f9480-5322-4390-b41a-fb68c233579d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:09.912545 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1386/2787] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:15:09.915313 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a860c20-41f9-43e2-bf2c-053d1c6113d0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:09.954677 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a860c20-41f9-43e2-bf2c-053d1c6113d0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:09.973686 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b559d7-c055-4ed7-a8f1-37cefafb4660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:09.974319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b559d7-c055-4ed7-a8f1-37cefafb4660 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:09.974599 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b559d7-c055-4ed7-a8f1-37cefafb4660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:09.974871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b559d7-c055-4ed7-a8f1-37cefafb4660 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:09.975519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b559d7-c055-4ed7-a8f1-37cefafb4660 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:09.981508 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b559d7-c055-4ed7-a8f1-37cefafb4660 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:10.053151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ef8f9480-5322-4390-b41a-fb68c233579d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccc29c4b20f649cead7bf16d07f83f6e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:10.076183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ef8f9480-5322-4390-b41a-fb68c233579d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccc29c4b20f649cead7bf16d07f83f6e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:10.077881 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1387/2788] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:15:09 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:15:10.082558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b559d7-c055-4ed7-a8f1-37cefafb4660 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:10.087592 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:10.110845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ef8f9480-5322-4390-b41a-fb68c233579d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccc29c4b20f649cead7bf16d07f83f6e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:10.111857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ef8f9480-5322-4390-b41a-fb68c233579d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccc29c4b20f649cead7bf16d07f83f6e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:10.123943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ef8f9480-5322-4390-b41a-fb68c233579d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccc29c4b20f649cead7bf16d07f83f6e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:10.137512 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1402/2789] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:15:09 2022] DELETE /identity/v3/users/ccc29c4b20f649cead7bf16d07f83f6e => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:10.181730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b559d7-c055-4ed7-a8f1-37cefafb4660 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:10.283460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293227b-a789-47d8-b54c-ceb98b81b2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:10.284128 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293227b-a789-47d8-b54c-ceb98b81b2af admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:10.284404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293227b-a789-47d8-b54c-ceb98b81b2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:10.284712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293227b-a789-47d8-b54c-ceb98b81b2af admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:10.285861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293227b-a789-47d8-b54c-ceb98b81b2af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:10.289313 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293227b-a789-47d8-b54c-ceb98b81b2af admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:10.324185 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1388/2790] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:15:10 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:15:10.328066 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f9480-5322-4390-b41a-fb68c233579d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:10.329537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ef8f9480-5322-4390-b41a-fb68c233579d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:10.345395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f9480-5322-4390-b41a-fb68c233579d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:10.366452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9a43a-355a-4545-898d-628111e2fa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:10.366452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9a43a-355a-4545-898d-628111e2fa88 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:10.366452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9a43a-355a-4545-898d-628111e2fa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:10.366452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9a43a-355a-4545-898d-628111e2fa88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:10.367117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9a43a-355a-4545-898d-628111e2fa88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:10.367117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9a43a-355a-4545-898d-628111e2fa88 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:10.392836 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1403/2791] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:15:10.399640 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293227b-a789-47d8-b54c-ceb98b81b2af admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:10.421618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293227b-a789-47d8-b54c-ceb98b81b2af admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:10.429035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a885f-ec52-4720-aa44-498b75eb8b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:10.429035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a885f-ec52-4720-aa44-498b75eb8b35 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:10.429035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a885f-ec52-4720-aa44-498b75eb8b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:10.429035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a885f-ec52-4720-aa44-498b75eb8b35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:10.432541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a885f-ec52-4720-aa44-498b75eb8b35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:10.433594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a885f-ec52-4720-aa44-498b75eb8b35 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:10.455045 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1389/2792] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:15:10.456846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9a43a-355a-4545-898d-628111e2fa88 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:10.476492 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9a43a-355a-4545-898d-628111e2fa88 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:10.485135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059c801-1293-4bf6-b51d-cde59ec7557c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:10.486386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059c801-1293-4bf6-b51d-cde59ec7557c admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:10.486853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059c801-1293-4bf6-b51d-cde59ec7557c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:10.487352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059c801-1293-4bf6-b51d-cde59ec7557c admin admin] PATH_INFO: `/v3/projects/d52b2f7281344decbddc23df77af996d/users/6b504ab8d5dc4e2aa169b47ef24b3752/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:10.511798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059c801-1293-4bf6-b51d-cde59ec7557c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d52b2f7281344decbddc23df77af996d, user_id=6b504ab8d5dc4e2aa169b47ef24b3752, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:10.514827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059c801-1293-4bf6-b51d-cde59ec7557c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:10.540517 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1404/2793] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:15:10 2022] PUT /identity/v3/projects/d52b2f7281344decbddc23df77af996d/users/6b504ab8d5dc4e2aa169b47ef24b3752/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:10.544417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce768589-06c7-49ab-9f82-e882d9c7ff44 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:10.544683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce768589-06c7-49ab-9f82-e882d9c7ff44 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:10.545811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce768589-06c7-49ab-9f82-e882d9c7ff44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:10.594385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ce768589-06c7-49ab-9f82-e882d9c7ff44 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:10.595669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ce768589-06c7-49ab-9f82-e882d9c7ff44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:10.629812 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:10.770079 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1390/2794] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:10.811290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059c801-1293-4bf6-b51d-cde59ec7557c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:10.815717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7059c801-1293-4bf6-b51d-cde59ec7557c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:11.166072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059c801-1293-4bf6-b51d-cde59ec7557c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:11.181917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8b0a8-65fc-4534-9647-28dfb2fc412f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:11.183371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8b0a8-65fc-4534-9647-28dfb2fc412f service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:11.185185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8b0a8-65fc-4534-9647-28dfb2fc412f service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:11.185504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8b0a8-65fc-4534-9647-28dfb2fc412f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:11.229321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8b0a8-65fc-4534-9647-28dfb2fc412f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:11.230946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8b0a8-65fc-4534-9647-28dfb2fc412f service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:11.251349 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1405/2795] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:15:11.573396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce768589-06c7-49ab-9f82-e882d9c7ff44 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:11.575154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ce768589-06c7-49ab-9f82-e882d9c7ff44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:11.594162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce768589-06c7-49ab-9f82-e882d9c7ff44 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:11.602914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c198c1-80ca-4066-b269-ff641d2484f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:11.603760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c198c1-80ca-4066-b269-ff641d2484f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:11.604266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c198c1-80ca-4066-b269-ff641d2484f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:11.604648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c198c1-80ca-4066-b269-ff641d2484f7 admin admin] PATH_INFO: `/v3/projects/2a91c1dd78664621804b0fedebb523da` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:11.606346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c198c1-80ca-4066-b269-ff641d2484f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a91c1dd78664621804b0fedebb523da)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:11.609708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c198c1-80ca-4066-b269-ff641d2484f7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:11.736637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-10c198c1-80ca-4066-b269-ff641d2484f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a91c1dd78664621804b0fedebb523da', 'request_id': 'req-10c198c1-80ca-4066-b269-ff641d2484f7'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:11.755006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-10c198c1-80ca-4066-b269-ff641d2484f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a91c1dd78664621804b0fedebb523da', 'request_id': 'req-10c198c1-80ca-4066-b269-ff641d2484f7'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:11.766609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-10c198c1-80ca-4066-b269-ff641d2484f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a91c1dd78664621804b0fedebb523da', 'request_id': 'req-10c198c1-80ca-4066-b269-ff641d2484f7'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:11.849816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-10c198c1-80ca-4066-b269-ff641d2484f7 admin admin] The token cache is being invalidate because project 2a91c1dd78664621804b0fedebb523da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:15:11.851479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-10c198c1-80ca-4066-b269-ff641d2484f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:11.854306 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-10c198c1-80ca-4066-b269-ff641d2484f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:11.859491 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1391/2796] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:15:11 2022] DELETE /identity/v3/projects/2a91c1dd78664621804b0fedebb523da => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:11.868786 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1975fdd-1ae5-43e7-9fcb-d22d5bcb7418 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:11.869280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1975fdd-1ae5-43e7-9fcb-d22d5bcb7418 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:11.869776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1975fdd-1ae5-43e7-9fcb-d22d5bcb7418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:11.933906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b1975fdd-1ae5-43e7-9fcb-d22d5bcb7418 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:11.936480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b1975fdd-1ae5-43e7-9fcb-d22d5bcb7418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:12.147568 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1406/2797] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:12.158848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367c55a-9533-46ed-b828-3d4f4ec05243 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:12.159423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367c55a-9533-46ed-b828-3d4f4ec05243 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:12.160726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367c55a-9533-46ed-b828-3d4f4ec05243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:12.208536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7367c55a-9533-46ed-b828-3d4f4ec05243 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:12.212078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7367c55a-9533-46ed-b828-3d4f4ec05243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:12.233283 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1392/2798] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:12.238075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1975fdd-1ae5-43e7-9fcb-d22d5bcb7418 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:12.254596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1975fdd-1ae5-43e7-9fcb-d22d5bcb7418 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:12.278189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612de865-5d7e-4034-9538-2a17d4c10cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:12.283727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612de865-5d7e-4034-9538-2a17d4c10cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:12.285011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612de865-5d7e-4034-9538-2a17d4c10cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:12.285011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612de865-5d7e-4034-9538-2a17d4c10cf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:12.287315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612de865-5d7e-4034-9538-2a17d4c10cf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:15:12.288894 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612de865-5d7e-4034-9538-2a17d4c10cf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:12.292105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612de865-5d7e-4034-9538-2a17d4c10cf9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:12.322752 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1407/2799] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:15:12.327537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367c55a-9533-46ed-b828-3d4f4ec05243 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:12.342268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367c55a-9533-46ed-b828-3d4f4ec05243 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:12.381026 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600c1ba-698e-49bc-9cb7-30676a8af180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:12.382633 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600c1ba-698e-49bc-9cb7-30676a8af180 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:12.383122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600c1ba-698e-49bc-9cb7-30676a8af180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:12.383593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600c1ba-698e-49bc-9cb7-30676a8af180 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:12.385171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600c1ba-698e-49bc-9cb7-30676a8af180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:12.389035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600c1ba-698e-49bc-9cb7-30676a8af180 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:12.485789 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1393/2800] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:15:12 2022] POST /identity/v3/projects => generated 371 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:15:12.493087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612de865-5d7e-4034-9538-2a17d4c10cf9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:12.513956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612de865-5d7e-4034-9538-2a17d4c10cf9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:12.600561 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:12.635201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754f6f7-d4e3-4b28-b0d4-f87023cb5a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:12.636108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754f6f7-d4e3-4b28-b0d4-f87023cb5a1c admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:12.636573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754f6f7-d4e3-4b28-b0d4-f87023cb5a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:12.637035 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754f6f7-d4e3-4b28-b0d4-f87023cb5a1c admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:12.638011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754f6f7-d4e3-4b28-b0d4-f87023cb5a1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:12.640611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754f6f7-d4e3-4b28-b0d4-f87023cb5a1c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:12.682829 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1408/2801] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:15:12 2022] POST /identity/v3/users => generated 286 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:15:12.688323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600c1ba-698e-49bc-9cb7-30676a8af180 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:12.701481 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600c1ba-698e-49bc-9cb7-30676a8af180 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:12.717601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096c361-fbc4-41e3-9d78-30437592c817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:12.718440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096c361-fbc4-41e3-9d78-30437592c817 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:12.718956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096c361-fbc4-41e3-9d78-30437592c817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:12.719325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096c361-fbc4-41e3-9d78-30437592c817 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:12.720160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096c361-fbc4-41e3-9d78-30437592c817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:12.722162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096c361-fbc4-41e3-9d78-30437592c817 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:12.738052 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1394/2802] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:15:12.744955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754f6f7-d4e3-4b28-b0d4-f87023cb5a1c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:12.776006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754f6f7-d4e3-4b28-b0d4-f87023cb5a1c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:12.798451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc9e67-37ff-4132-87bf-dc560edf0b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:12.801223 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc9e67-37ff-4132-87bf-dc560edf0b93 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:12.803787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc9e67-37ff-4132-87bf-dc560edf0b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:12.806210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc9e67-37ff-4132-87bf-dc560edf0b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:12.807629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc9e67-37ff-4132-87bf-dc560edf0b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:12.815355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc9e67-37ff-4132-87bf-dc560edf0b93 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:12.854745 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1409/2803] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:15:12.860189 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096c361-fbc4-41e3-9d78-30437592c817 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:12.879748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096c361-fbc4-41e3-9d78-30437592c817 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:12.889993 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38e2a1-4844-480a-ad2a-47dba3c29897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:12.906982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38e2a1-4844-480a-ad2a-47dba3c29897 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:12.907545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38e2a1-4844-480a-ad2a-47dba3c29897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:12.914715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38e2a1-4844-480a-ad2a-47dba3c29897 admin admin] PATH_INFO: `/v3/projects/0232f73f13954623bf9ddf8bcc4717db/users/1d4d71e94fb24feba19445db49761015/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:12.975096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38e2a1-4844-480a-ad2a-47dba3c29897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0232f73f13954623bf9ddf8bcc4717db, user_id=1d4d71e94fb24feba19445db49761015, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:12.980697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c38e2a1-4844-480a-ad2a-47dba3c29897 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:13.015964 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1395/2804] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:15:12 2022] PUT /identity/v3/projects/0232f73f13954623bf9ddf8bcc4717db/users/1d4d71e94fb24feba19445db49761015/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:13.029411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bda472-eeaf-4dcc-b977-284f29a6b0d6 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:13.029926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bda472-eeaf-4dcc-b977-284f29a6b0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:13.030407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bda472-eeaf-4dcc-b977-284f29a6b0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:13.088708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-69bda472-eeaf-4dcc-b977-284f29a6b0d6 None None] MFA Rules not processed for user `1d4d71e94fb24feba19445db49761015`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:13.091534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-69bda472-eeaf-4dcc-b977-284f29a6b0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:13.245503 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1410/2805] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:13.256848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38e2a1-4844-480a-ad2a-47dba3c29897 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:13.330595 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:13.370077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38e2a1-4844-480a-ad2a-47dba3c29897 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:13.382533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98bc053-fdd9-4dc7-b778-9f2192ae50c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:13.385126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98bc053-fdd9-4dc7-b778-9f2192ae50c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:13.386033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98bc053-fdd9-4dc7-b778-9f2192ae50c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:13.386702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98bc053-fdd9-4dc7-b778-9f2192ae50c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:13.389701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98bc053-fdd9-4dc7-b778-9f2192ae50c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:13.392873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98bc053-fdd9-4dc7-b778-9f2192ae50c0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:13.512635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bda472-eeaf-4dcc-b977-284f29a6b0d6 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:13.515314 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1396/2806] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:15:13 2022] POST /identity/v3/projects => generated 371 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:15:13.550530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bda472-eeaf-4dcc-b977-284f29a6b0d6 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:13.715689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5570e0-549d-43e9-8a3d-4ae21114b653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:13.717119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5570e0-549d-43e9-8a3d-4ae21114b653 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:13.717630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5570e0-549d-43e9-8a3d-4ae21114b653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:13.718325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5570e0-549d-43e9-8a3d-4ae21114b653 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:13.719538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5570e0-549d-43e9-8a3d-4ae21114b653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:13.722619 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5570e0-549d-43e9-8a3d-4ae21114b653 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:13.755967 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1411/2807] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:15:13 2022] POST /identity/v3/users => generated 292 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:15:13.761246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98bc053-fdd9-4dc7-b778-9f2192ae50c0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:13.779099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98bc053-fdd9-4dc7-b778-9f2192ae50c0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:13.787425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2815fc-d01d-428a-85f7-d3c37c66a95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:13.789559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2815fc-d01d-428a-85f7-d3c37c66a95c admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:13.790222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2815fc-d01d-428a-85f7-d3c37c66a95c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:13.791448 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2815fc-d01d-428a-85f7-d3c37c66a95c admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:13.793487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2815fc-d01d-428a-85f7-d3c37c66a95c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:13.797934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2815fc-d01d-428a-85f7-d3c37c66a95c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:13.826787 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1397/2808] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:15:13.831732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5570e0-549d-43e9-8a3d-4ae21114b653 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:13.859779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5570e0-549d-43e9-8a3d-4ae21114b653 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:13.868091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c66b6-ec6d-4a66-aa1a-43b75cfeb215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:13.868915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c66b6-ec6d-4a66-aa1a-43b75cfeb215 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:13.869409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c66b6-ec6d-4a66-aa1a-43b75cfeb215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:13.870007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c66b6-ec6d-4a66-aa1a-43b75cfeb215 admin admin] PATH_INFO: `/v3/projects/57711fd8aa0d406db001faf2c36fc09d/users/09c06bcce30c47338183cbd21b5db345/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:13.897906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c66b6-ec6d-4a66-aa1a-43b75cfeb215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57711fd8aa0d406db001faf2c36fc09d, user_id=09c06bcce30c47338183cbd21b5db345, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:13.904036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c66b6-ec6d-4a66-aa1a-43b75cfeb215 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:13.933976 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1412/2809] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:15:13 2022] PUT /identity/v3/projects/57711fd8aa0d406db001faf2c36fc09d/users/09c06bcce30c47338183cbd21b5db345/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:15:13.938097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2815fc-d01d-428a-85f7-d3c37c66a95c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:13.953105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2815fc-d01d-428a-85f7-d3c37c66a95c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:14.133120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d03a7-4a27-40e3-8f33-d7acf522fd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:14.133848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d03a7-4a27-40e3-8f33-d7acf522fd79 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:14.135699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d03a7-4a27-40e3-8f33-d7acf522fd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:14.135699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d03a7-4a27-40e3-8f33-d7acf522fd79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:14.136461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d03a7-4a27-40e3-8f33-d7acf522fd79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:14.139147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d03a7-4a27-40e3-8f33-d7acf522fd79 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:14.176141 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1398/2810] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:15:14.194248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c66b6-ec6d-4a66-aa1a-43b75cfeb215 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:14.215816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c66b6-ec6d-4a66-aa1a-43b75cfeb215 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:14.226119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dce096-773e-44e4-b876-9bff44a82aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:14.227126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dce096-773e-44e4-b876-9bff44a82aae admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:14.227845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dce096-773e-44e4-b876-9bff44a82aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:14.230233 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dce096-773e-44e4-b876-9bff44a82aae admin admin] PATH_INFO: `/v3/projects/57711fd8aa0d406db001faf2c36fc09d/users/09c06bcce30c47338183cbd21b5db345/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:14.238723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dce096-773e-44e4-b876-9bff44a82aae admin admin] RBAC: Authorizing `identity:create_grant(project_id=57711fd8aa0d406db001faf2c36fc09d, user_id=09c06bcce30c47338183cbd21b5db345, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:14.244952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dce096-773e-44e4-b876-9bff44a82aae admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:14.260509 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:14.282236 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1413/2811] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:15:14 2022] PUT /identity/v3/projects/57711fd8aa0d406db001faf2c36fc09d/users/09c06bcce30c47338183cbd21b5db345/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:14.300313 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a984ae4-7d34-4dd7-9ba3-1dac1c54f9e7 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:14.300593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a984ae4-7d34-4dd7-9ba3-1dac1c54f9e7 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:14.300948 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a984ae4-7d34-4dd7-9ba3-1dac1c54f9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:14.358573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-4a984ae4-7d34-4dd7-9ba3-1dac1c54f9e7 None None] MFA Rules not processed for user `09c06bcce30c47338183cbd21b5db345`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:14.360745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4a984ae4-7d34-4dd7-9ba3-1dac1c54f9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:14.564647 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1399/2812] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:14.948109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dce096-773e-44e4-b876-9bff44a82aae admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:14.950336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-67dce096-773e-44e4-b876-9bff44a82aae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:15.166288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dce096-773e-44e4-b876-9bff44a82aae admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:15.182435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4805ce-702f-4f22-987c-e1bda7008b9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:15.185815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4805ce-702f-4f22-987c-e1bda7008b9c service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:15.187258 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4805ce-702f-4f22-987c-e1bda7008b9c service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:15.188257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4805ce-702f-4f22-987c-e1bda7008b9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:15.220514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4805ce-702f-4f22-987c-e1bda7008b9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:15.222536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4805ce-702f-4f22-987c-e1bda7008b9c service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:15.251935 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1414/2813] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:15:17.018123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a984ae4-7d34-4dd7-9ba3-1dac1c54f9e7 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:17.020533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4a984ae4-7d34-4dd7-9ba3-1dac1c54f9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:17.123110 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:17.174610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a984ae4-7d34-4dd7-9ba3-1dac1c54f9e7 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:17.183634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a489f5a-ec9e-49a1-8618-4e1a037ed87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:17.184713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a489f5a-ec9e-49a1-8618-4e1a037ed87f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:17.185185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a489f5a-ec9e-49a1-8618-4e1a037ed87f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:17.185657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a489f5a-ec9e-49a1-8618-4e1a037ed87f admin admin] PATH_INFO: `/v3/users/21219c93625d4e6b802d8a99b3e520d6` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:17.187681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a489f5a-ec9e-49a1-8618-4e1a037ed87f admin admin] RBAC: Authorizing `identity:delete_user(user_id=21219c93625d4e6b802d8a99b3e520d6)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:17.191592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a489f5a-ec9e-49a1-8618-4e1a037ed87f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:17.277324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0a489f5a-ec9e-49a1-8618-4e1a037ed87f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21219c93625d4e6b802d8a99b3e520d6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:17.293457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0a489f5a-ec9e-49a1-8618-4e1a037ed87f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21219c93625d4e6b802d8a99b3e520d6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:17.313590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0a489f5a-ec9e-49a1-8618-4e1a037ed87f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21219c93625d4e6b802d8a99b3e520d6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:17.324391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0a489f5a-ec9e-49a1-8618-4e1a037ed87f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21219c93625d4e6b802d8a99b3e520d6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:17.346960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0a489f5a-ec9e-49a1-8618-4e1a037ed87f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21219c93625d4e6b802d8a99b3e520d6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:17.379912 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1400/2814] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:15:17 2022] DELETE /identity/v3/users/21219c93625d4e6b802d8a99b3e520d6 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:17.852720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a4106-0c3d-41a3-9e97-c0620fcec6ce None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:17.853762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a4106-0c3d-41a3-9e97-c0620fcec6ce None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:17.854209 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a4106-0c3d-41a3-9e97-c0620fcec6ce None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:17.856808 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1415/2815] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 01:15:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:15:17.865107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08ef19-949f-4da9-9888-15d88e18e32b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:17.865107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08ef19-949f-4da9-9888-15d88e18e32b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:17.865107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08ef19-949f-4da9-9888-15d88e18e32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:17.919615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0b08ef19-949f-4da9-9888-15d88e18e32b None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:17.921928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0b08ef19-949f-4da9-9888-15d88e18e32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:18.143128 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1401/2816] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 01:15:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:18.179125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a4106-0c3d-41a3-9e97-c0620fcec6ce None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:18.182448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-356a4106-0c3d-41a3-9e97-c0620fcec6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:18.241631 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a4106-0c3d-41a3-9e97-c0620fcec6ce None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:18.282915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a281f28-f599-4237-a49b-65456d49e1a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:18.284974 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a281f28-f599-4237-a49b-65456d49e1a7 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:18.286791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a281f28-f599-4237-a49b-65456d49e1a7 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:18.292704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a281f28-f599-4237-a49b-65456d49e1a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:18.395360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a281f28-f599-4237-a49b-65456d49e1a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:18.406609 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a281f28-f599-4237-a49b-65456d49e1a7 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:18.483201 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1416/2817] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:15:18.773836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08ef19-949f-4da9-9888-15d88e18e32b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:18.775761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0b08ef19-949f-4da9-9888-15d88e18e32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:18.998392 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:19.026512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08ef19-949f-4da9-9888-15d88e18e32b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:19.052215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb55d4-52e3-4760-92da-9bede8f81d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:19.053670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb55d4-52e3-4760-92da-9bede8f81d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:19.054340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb55d4-52e3-4760-92da-9bede8f81d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:19.055292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb55d4-52e3-4760-92da-9bede8f81d1c admin admin] PATH_INFO: `/v3/projects/dab3ac719e1b4d6c913fc593c388dc3d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:19.062525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb55d4-52e3-4760-92da-9bede8f81d1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dab3ac719e1b4d6c913fc593c388dc3d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:19.090971 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb55d4-52e3-4760-92da-9bede8f81d1c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:19.310315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1cbb55d4-52e3-4760-92da-9bede8f81d1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dab3ac719e1b4d6c913fc593c388dc3d', 'request_id': 'req-1cbb55d4-52e3-4760-92da-9bede8f81d1c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:19.332413 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1cbb55d4-52e3-4760-92da-9bede8f81d1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dab3ac719e1b4d6c913fc593c388dc3d', 'request_id': 'req-1cbb55d4-52e3-4760-92da-9bede8f81d1c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:19.358485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1cbb55d4-52e3-4760-92da-9bede8f81d1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dab3ac719e1b4d6c913fc593c388dc3d', 'request_id': 'req-1cbb55d4-52e3-4760-92da-9bede8f81d1c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:19.394363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1cbb55d4-52e3-4760-92da-9bede8f81d1c admin admin] The token cache is being invalidate because project dab3ac719e1b4d6c913fc593c388dc3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:15:19.394363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1cbb55d4-52e3-4760-92da-9bede8f81d1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:19.395769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1cbb55d4-52e3-4760-92da-9bede8f81d1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:19.409092 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1402/2818] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:15:18 2022] DELETE /identity/v3/projects/dab3ac719e1b4d6c913fc593c388dc3d => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:15:19.412106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc63fd6-a170-4676-8d0a-c9a185c7d211 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:19.412862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc63fd6-a170-4676-8d0a-c9a185c7d211 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:19.413371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc63fd6-a170-4676-8d0a-c9a185c7d211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:19.468289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1dc63fd6-a170-4676-8d0a-c9a185c7d211 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:19.470504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1dc63fd6-a170-4676-8d0a-c9a185c7d211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:19.698884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb55d4-52e3-4760-92da-9bede8f81d1c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:19.702091 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1cbb55d4-52e3-4760-92da-9bede8f81d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:19.738405 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1417/2819] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:19.749842 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e2aea-830c-47a8-af08-221d444cd55b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:19.750095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e2aea-830c-47a8-af08-221d444cd55b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:19.750461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e2aea-830c-47a8-af08-221d444cd55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:19.755998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb55d4-52e3-4760-92da-9bede8f81d1c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:19.788092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092ee52-c237-4fdc-a71a-d47e073ce7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:19.789273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092ee52-c237-4fdc-a71a-d47e073ce7b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:19.789916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092ee52-c237-4fdc-a71a-d47e073ce7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:19.790526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092ee52-c237-4fdc-a71a-d47e073ce7b3 admin admin] PATH_INFO: `/v3/users/1d4d71e94fb24feba19445db49761015` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:19.794073 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092ee52-c237-4fdc-a71a-d47e073ce7b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d4d71e94fb24feba19445db49761015)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:19.801089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092ee52-c237-4fdc-a71a-d47e073ce7b3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:19.856473 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b63e2aea-830c-47a8-af08-221d444cd55b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:19.862839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b63e2aea-830c-47a8-af08-221d444cd55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:19.909393 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1418/2820] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:15:19.916536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e2aea-830c-47a8-af08-221d444cd55b None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:19.954362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e2aea-830c-47a8-af08-221d444cd55b None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:19.999315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cfbcf-e98d-4e84-8308-8add94a0549b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:20.001621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cfbcf-e98d-4e84-8308-8add94a0549b admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:20.002379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cfbcf-e98d-4e84-8308-8add94a0549b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:20.003493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2092ee52-c237-4fdc-a71a-d47e073ce7b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d4d71e94fb24feba19445db49761015'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:20.004231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cfbcf-e98d-4e84-8308-8add94a0549b admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:20.007637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9cfbcf-e98d-4e84-8308-8add94a0549b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:15:20.008951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9cfbcf-e98d-4e84-8308-8add94a0549b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:20.011925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9cfbcf-e98d-4e84-8308-8add94a0549b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:20.028433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2092ee52-c237-4fdc-a71a-d47e073ce7b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d4d71e94fb24feba19445db49761015'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:20.039966 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1419/2821] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:15:20.046472 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cfbcf-e98d-4e84-8308-8add94a0549b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:20.062938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2092ee52-c237-4fdc-a71a-d47e073ce7b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d4d71e94fb24feba19445db49761015'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:20.062938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2092ee52-c237-4fdc-a71a-d47e073ce7b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d4d71e94fb24feba19445db49761015'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:20.084561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cfbcf-e98d-4e84-8308-8add94a0549b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:20.106998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2092ee52-c237-4fdc-a71a-d47e073ce7b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d4d71e94fb24feba19445db49761015'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:20.123718 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1403/2822] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:15:19 2022] DELETE /identity/v3/users/1d4d71e94fb24feba19445db49761015 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:20.134291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1de9e-db21-4fdf-bdec-b092fd500a63 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:20.134863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1de9e-db21-4fdf-bdec-b092fd500a63 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:20.138601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550e2e6-0d5b-4e86-af75-ae50ec442b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:20.139939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550e2e6-0d5b-4e86-af75-ae50ec442b37 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:20.140726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550e2e6-0d5b-4e86-af75-ae50ec442b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:20.140932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550e2e6-0d5b-4e86-af75-ae50ec442b37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:20.142090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550e2e6-0d5b-4e86-af75-ae50ec442b37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:20.145795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1de9e-db21-4fdf-bdec-b092fd500a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:20.165905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c550e2e6-0d5b-4e86-af75-ae50ec442b37 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:20.221449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e8a1de9e-db21-4fdf-bdec-b092fd500a63 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:20.229171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e8a1de9e-db21-4fdf-bdec-b092fd500a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:20.303322 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1420/2823] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:15:20 2022] POST /identity/v3/projects => generated 359 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:15:20.307648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550e2e6-0d5b-4e86-af75-ae50ec442b37 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:20.310880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c550e2e6-0d5b-4e86-af75-ae50ec442b37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:20.412752 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:20.436670 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:20.464288 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1404/2824] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:20.495013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550e2e6-0d5b-4e86-af75-ae50ec442b37 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:20.506384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6354fa-a958-4c91-af10-e6287623f25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:20.507994 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6354fa-a958-4c91-af10-e6287623f25b admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:20.508419 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6354fa-a958-4c91-af10-e6287623f25b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:20.508851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6354fa-a958-4c91-af10-e6287623f25b admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:20.509519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6354fa-a958-4c91-af10-e6287623f25b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:20.511538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6354fa-a958-4c91-af10-e6287623f25b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:20.570804 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1421/2825] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:15:20 2022] POST /identity/v3/users => generated 280 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:15:20.571839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1de9e-db21-4fdf-bdec-b092fd500a63 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:20.595801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1de9e-db21-4fdf-bdec-b092fd500a63 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:20.620920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6354fa-a958-4c91-af10-e6287623f25b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:20.621500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de53cf-9b08-4e16-873b-33b60cf2508d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:20.623453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de53cf-9b08-4e16-873b-33b60cf2508d admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:20.623453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de53cf-9b08-4e16-873b-33b60cf2508d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:20.623453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de53cf-9b08-4e16-873b-33b60cf2508d admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:20.624760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de53cf-9b08-4e16-873b-33b60cf2508d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:20.626997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6f6354fa-a958-4c91-af10-e6287623f25b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:20.627936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de53cf-9b08-4e16-873b-33b60cf2508d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:20.724485 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1405/2826] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:15:20.731343 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de53cf-9b08-4e16-873b-33b60cf2508d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:20.761349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de53cf-9b08-4e16-873b-33b60cf2508d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:20.801977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1170694-fd88-4e9d-8d7a-a08056f65520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:20.803457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1170694-fd88-4e9d-8d7a-a08056f65520 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:20.803743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1170694-fd88-4e9d-8d7a-a08056f65520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:20.805523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1170694-fd88-4e9d-8d7a-a08056f65520 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:20.809106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1170694-fd88-4e9d-8d7a-a08056f65520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:20.812819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1170694-fd88-4e9d-8d7a-a08056f65520 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:20.847420 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1406/2827] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:15:20.852941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1170694-fd88-4e9d-8d7a-a08056f65520 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:20.879347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6354fa-a958-4c91-af10-e6287623f25b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:20.891957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7344321-e024-4a87-895c-1ea136359d8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:20.892518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1170694-fd88-4e9d-8d7a-a08056f65520 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:20.892895 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7344321-e024-4a87-895c-1ea136359d8a service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:20.893181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7344321-e024-4a87-895c-1ea136359d8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:20.893500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7344321-e024-4a87-895c-1ea136359d8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:20.903338 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55912e83-842c-4993-8538-31b70fbcd688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:20.904365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55912e83-842c-4993-8538-31b70fbcd688 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:20.904908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55912e83-842c-4993-8538-31b70fbcd688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:20.905424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55912e83-842c-4993-8538-31b70fbcd688 admin admin] PATH_INFO: `/v3/projects/62d5f38b79284de2a2d00acd4187afd5/users/96b8a503f705494ca22307f93b3580b0/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:20.919222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7344321-e024-4a87-895c-1ea136359d8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:20.924304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7344321-e024-4a87-895c-1ea136359d8a service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:20.958234 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1422/2828] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:15:20.959258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55912e83-842c-4993-8538-31b70fbcd688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62d5f38b79284de2a2d00acd4187afd5, user_id=96b8a503f705494ca22307f93b3580b0, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:20.969205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55912e83-842c-4993-8538-31b70fbcd688 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:21.032487 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1407/2829] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:15:20 2022] PUT /identity/v3/projects/62d5f38b79284de2a2d00acd4187afd5/users/96b8a503f705494ca22307f93b3580b0/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:21.046165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133e7af-c016-4512-ba41-843a2964dfa5 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:21.046619 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133e7af-c016-4512-ba41-843a2964dfa5 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:21.048040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133e7af-c016-4512-ba41-843a2964dfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:21.097041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9133e7af-c016-4512-ba41-843a2964dfa5 None None] MFA Rules not processed for user `96b8a503f705494ca22307f93b3580b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:21.099329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9133e7af-c016-4512-ba41-843a2964dfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:21.342719 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1423/2830] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:22.296449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55912e83-842c-4993-8538-31b70fbcd688 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:22.299347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-55912e83-842c-4993-8538-31b70fbcd688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:22.443446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55912e83-842c-4993-8538-31b70fbcd688 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:22.462317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a69d3-275b-4fb3-a664-1fd555f82e91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:22.464486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a69d3-275b-4fb3-a664-1fd555f82e91 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:22.468113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a69d3-275b-4fb3-a664-1fd555f82e91 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:22.468679 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a69d3-275b-4fb3-a664-1fd555f82e91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:22.471750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133e7af-c016-4512-ba41-843a2964dfa5 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:22.474103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9133e7af-c016-4512-ba41-843a2964dfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:22.502995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a69d3-275b-4fb3-a664-1fd555f82e91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:22.507174 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a69d3-275b-4fb3-a664-1fd555f82e91 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:22.543378 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1408/2831] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:22 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:15:22.627213 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a69d3-275b-4fb3-a664-1fd555f82e91 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:22.698890 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:22.744343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133e7af-c016-4512-ba41-843a2964dfa5 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:22.764726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dec9f4-d2c2-4d47-8b82-976881997062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:22.765871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dec9f4-d2c2-4d47-8b82-976881997062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:22.766406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dec9f4-d2c2-4d47-8b82-976881997062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:22.767017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dec9f4-d2c2-4d47-8b82-976881997062 admin admin] PATH_INFO: `/v3/projects/0232f73f13954623bf9ddf8bcc4717db` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:22.774612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dec9f4-d2c2-4d47-8b82-976881997062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0232f73f13954623bf9ddf8bcc4717db)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:22.778280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dec9f4-d2c2-4d47-8b82-976881997062 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:22.856629 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a69d3-275b-4fb3-a664-1fd555f82e91 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:22.863213 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f96db-62c1-4f5e-89cf-e690bb1ce233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:22.863956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f96db-62c1-4f5e-89cf-e690bb1ce233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:22.864271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f96db-62c1-4f5e-89cf-e690bb1ce233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:22.864544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f96db-62c1-4f5e-89cf-e690bb1ce233 admin admin] PATH_INFO: `/v3/users/96b8a503f705494ca22307f93b3580b0` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:22.866205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f96db-62c1-4f5e-89cf-e690bb1ce233 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96b8a503f705494ca22307f93b3580b0)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:22.869077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f96db-62c1-4f5e-89cf-e690bb1ce233 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:22.913028 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-16dec9f4-d2c2-4d47-8b82-976881997062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0232f73f13954623bf9ddf8bcc4717db', 'request_id': 'req-16dec9f4-d2c2-4d47-8b82-976881997062'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:22.927669 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-16dec9f4-d2c2-4d47-8b82-976881997062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0232f73f13954623bf9ddf8bcc4717db', 'request_id': 'req-16dec9f4-d2c2-4d47-8b82-976881997062'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:22.950734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-16dec9f4-d2c2-4d47-8b82-976881997062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0232f73f13954623bf9ddf8bcc4717db', 'request_id': 'req-16dec9f4-d2c2-4d47-8b82-976881997062'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:22.954904 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:22.983858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-218f96db-62c1-4f5e-89cf-e690bb1ce233 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96b8a503f705494ca22307f93b3580b0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:22.992376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-16dec9f4-d2c2-4d47-8b82-976881997062 admin admin] The token cache is being invalidate because project 0232f73f13954623bf9ddf8bcc4717db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:15:22.992765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-16dec9f4-d2c2-4d47-8b82-976881997062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:22.994162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-16dec9f4-d2c2-4d47-8b82-976881997062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:22.996174 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1424/2832] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:15:22 2022] DELETE /identity/v3/projects/0232f73f13954623bf9ddf8bcc4717db => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:23.004076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dec9f4-d2c2-4d47-8b82-976881997062 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:23.007833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-16dec9f4-d2c2-4d47-8b82-976881997062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:23.013050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-218f96db-62c1-4f5e-89cf-e690bb1ce233 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96b8a503f705494ca22307f93b3580b0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:23.054872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-218f96db-62c1-4f5e-89cf-e690bb1ce233 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96b8a503f705494ca22307f93b3580b0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:23.056501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-218f96db-62c1-4f5e-89cf-e690bb1ce233 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96b8a503f705494ca22307f93b3580b0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:23.074318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-218f96db-62c1-4f5e-89cf-e690bb1ce233 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96b8a503f705494ca22307f93b3580b0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:23.104103 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1409/2833] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:15:22 2022] DELETE /identity/v3/users/96b8a503f705494ca22307f93b3580b0 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:15:23.107366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aab3a5-8c82-4e2a-be8c-4e45e7b95655 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:23.107785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aab3a5-8c82-4e2a-be8c-4e45e7b95655 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:23.108422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aab3a5-8c82-4e2a-be8c-4e45e7b95655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:23.188555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-49aab3a5-8c82-4e2a-be8c-4e45e7b95655 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:23.195173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-49aab3a5-8c82-4e2a-be8c-4e45e7b95655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:23.308331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dec9f4-d2c2-4d47-8b82-976881997062 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:23.451871 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1410/2834] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:23.511989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56053277-3994-4ba4-960f-5dd804d8324f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:23.513321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56053277-3994-4ba4-960f-5dd804d8324f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:23.513822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56053277-3994-4ba4-960f-5dd804d8324f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:23.514273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56053277-3994-4ba4-960f-5dd804d8324f admin admin] PATH_INFO: `/v3/users/09c06bcce30c47338183cbd21b5db345` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:23.516520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56053277-3994-4ba4-960f-5dd804d8324f admin admin] RBAC: Authorizing `identity:delete_user(user_id=09c06bcce30c47338183cbd21b5db345)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:23.520598 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56053277-3994-4ba4-960f-5dd804d8324f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:23.581672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aab3a5-8c82-4e2a-be8c-4e45e7b95655 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:23.584800 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-49aab3a5-8c82-4e2a-be8c-4e45e7b95655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:23.711477 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:23.785234 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aab3a5-8c82-4e2a-be8c-4e45e7b95655 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:23.798405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-56053277-3994-4ba4-960f-5dd804d8324f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09c06bcce30c47338183cbd21b5db345'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:23.805233 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a458ee-dac6-4a94-9836-5694cb29c239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:23.808106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a458ee-dac6-4a94-9836-5694cb29c239 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:23.808668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a458ee-dac6-4a94-9836-5694cb29c239 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:23.809169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a458ee-dac6-4a94-9836-5694cb29c239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:23.831076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-56053277-3994-4ba4-960f-5dd804d8324f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09c06bcce30c47338183cbd21b5db345'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:23.847828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a458ee-dac6-4a94-9836-5694cb29c239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:23.853084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a458ee-dac6-4a94-9836-5694cb29c239 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:23.892536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-56053277-3994-4ba4-960f-5dd804d8324f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09c06bcce30c47338183cbd21b5db345'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:23.896372 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1411/2835] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:15:23.896868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-56053277-3994-4ba4-960f-5dd804d8324f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09c06bcce30c47338183cbd21b5db345'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:23.927678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-56053277-3994-4ba4-960f-5dd804d8324f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09c06bcce30c47338183cbd21b5db345'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:23.941798 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1425/2836] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:15:22 2022] DELETE /identity/v3/users/09c06bcce30c47338183cbd21b5db345 => generated 0 bytes in 942 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:15:25.473438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a458ee-dac6-4a94-9836-5694cb29c239 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:25.476923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-49a458ee-dac6-4a94-9836-5694cb29c239 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:25.493309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a458ee-dac6-4a94-9836-5694cb29c239 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:25.664347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c958c-2a85-40e6-9e53-437986b5632a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:25.665540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c958c-2a85-40e6-9e53-437986b5632a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:25.666050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c958c-2a85-40e6-9e53-437986b5632a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:25.666513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c958c-2a85-40e6-9e53-437986b5632a admin admin] PATH_INFO: `/v3/projects/62d5f38b79284de2a2d00acd4187afd5` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:25.668726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c958c-2a85-40e6-9e53-437986b5632a admin admin] RBAC: Authorizing `identity:delete_project(project_id=62d5f38b79284de2a2d00acd4187afd5)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:25.674667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c958c-2a85-40e6-9e53-437986b5632a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:25.674667 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:25.766475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a98c958c-2a85-40e6-9e53-437986b5632a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62d5f38b79284de2a2d00acd4187afd5', 'request_id': 'req-a98c958c-2a85-40e6-9e53-437986b5632a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:25.777384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a98c958c-2a85-40e6-9e53-437986b5632a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62d5f38b79284de2a2d00acd4187afd5', 'request_id': 'req-a98c958c-2a85-40e6-9e53-437986b5632a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:25.785964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a98c958c-2a85-40e6-9e53-437986b5632a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62d5f38b79284de2a2d00acd4187afd5', 'request_id': 'req-a98c958c-2a85-40e6-9e53-437986b5632a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:25.823938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a98c958c-2a85-40e6-9e53-437986b5632a admin admin] The token cache is being invalidate because project 62d5f38b79284de2a2d00acd4187afd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:15:25.823938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a98c958c-2a85-40e6-9e53-437986b5632a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:25.823938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a98c958c-2a85-40e6-9e53-437986b5632a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:25.823938 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1412/2837] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:15:25 2022] DELETE /identity/v3/projects/62d5f38b79284de2a2d00acd4187afd5 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:25.826588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2091b-b759-48b8-ab72-02c0d671d506 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:25.827093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2091b-b759-48b8-ab72-02c0d671d506 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:25.827491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2091b-b759-48b8-ab72-02c0d671d506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:25.861737 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-65c2091b-b759-48b8-ab72-02c0d671d506 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:25.862966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-65c2091b-b759-48b8-ab72-02c0d671d506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:25.970251 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1426/2838] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:25.978950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce6b0e-e176-401a-a6f3-99233b9cf032 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:25.979260 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce6b0e-e176-401a-a6f3-99233b9cf032 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:25.979570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce6b0e-e176-401a-a6f3-99233b9cf032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:26.030916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-dcce6b0e-e176-401a-a6f3-99233b9cf032 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:26.033073 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-dcce6b0e-e176-401a-a6f3-99233b9cf032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:26.066932 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1413/2839] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:26.072974 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2091b-b759-48b8-ab72-02c0d671d506 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:26.091083 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2091b-b759-48b8-ab72-02c0d671d506 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:26.099770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59421f03-dfca-4889-9b55-43dd596cc8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:26.102074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59421f03-dfca-4889-9b55-43dd596cc8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:26.102820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59421f03-dfca-4889-9b55-43dd596cc8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:26.103415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59421f03-dfca-4889-9b55-43dd596cc8f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:26.105147 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59421f03-dfca-4889-9b55-43dd596cc8f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:15:26.105984 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59421f03-dfca-4889-9b55-43dd596cc8f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:26.108694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59421f03-dfca-4889-9b55-43dd596cc8f7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:26.152911 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1427/2840] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:15:26.158100 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce6b0e-e176-401a-a6f3-99233b9cf032 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:26.185371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8302c-6129-43cb-9e3c-020aaeb9445b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:26.185844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8302c-6129-43cb-9e3c-020aaeb9445b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:26.186416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8302c-6129-43cb-9e3c-020aaeb9445b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:26.188605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce6b0e-e176-401a-a6f3-99233b9cf032 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:26.211617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7556491-97ab-402c-a1a8-f90b96d65b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:26.212569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7556491-97ab-402c-a1a8-f90b96d65b42 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:26.212840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7556491-97ab-402c-a1a8-f90b96d65b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:26.213129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7556491-97ab-402c-a1a8-f90b96d65b42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:26.213923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7556491-97ab-402c-a1a8-f90b96d65b42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:26.216909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7556491-97ab-402c-a1a8-f90b96d65b42 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:26.227613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-07e8302c-6129-43cb-9e3c-020aaeb9445b None None] MFA Rules not processed for user `32fc1959d8aa41eabcead217b9d7bc47`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:26.232315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-07e8302c-6129-43cb-9e3c-020aaeb9445b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:26.279745 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1414/2841] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:15:26 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:15:26.281529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7556491-97ab-402c-a1a8-f90b96d65b42 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:26.285267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a7556491-97ab-402c-a1a8-f90b96d65b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:26.373685 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1428/2842] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:15:26.374659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8302c-6129-43cb-9e3c-020aaeb9445b None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:26.418661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8302c-6129-43cb-9e3c-020aaeb9445b None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:26.512908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7556491-97ab-402c-a1a8-f90b96d65b42 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:26.518675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfa2b1-e542-411b-a623-5c552b0217ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:26.519422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfa2b1-e542-411b-a623-5c552b0217ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:26.519770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfa2b1-e542-411b-a623-5c552b0217ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:26.520169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfa2b1-e542-411b-a623-5c552b0217ae admin admin] PATH_INFO: `/v3/projects/57711fd8aa0d406db001faf2c36fc09d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:26.522215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcfa2b1-e542-411b-a623-5c552b0217ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=57711fd8aa0d406db001faf2c36fc09d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:26.524640 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcfa2b1-e542-411b-a623-5c552b0217ae admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:26.536501 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:26.590568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2a53f-ec88-479c-b911-16e0292365a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:26.591320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2a53f-ec88-479c-b911-16e0292365a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:26.591571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2a53f-ec88-479c-b911-16e0292365a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:26.591846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2a53f-ec88-479c-b911-16e0292365a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:26.592539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2a53f-ec88-479c-b911-16e0292365a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:26.595511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2a53f-ec88-479c-b911-16e0292365a6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:26.617222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1bcfa2b1-e542-411b-a623-5c552b0217ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57711fd8aa0d406db001faf2c36fc09d', 'request_id': 'req-1bcfa2b1-e542-411b-a623-5c552b0217ae'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:26.632809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1bcfa2b1-e542-411b-a623-5c552b0217ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57711fd8aa0d406db001faf2c36fc09d', 'request_id': 'req-1bcfa2b1-e542-411b-a623-5c552b0217ae'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:26.651920 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1429/2843] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:15:26 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:15:26.653515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1bcfa2b1-e542-411b-a623-5c552b0217ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57711fd8aa0d406db001faf2c36fc09d', 'request_id': 'req-1bcfa2b1-e542-411b-a623-5c552b0217ae'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:26.657219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2a53f-ec88-479c-b911-16e0292365a6 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:26.672285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2a53f-ec88-479c-b911-16e0292365a6 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:26.674582 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:26.705485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1bcfa2b1-e542-411b-a623-5c552b0217ae admin admin] The token cache is being invalidate because project 57711fd8aa0d406db001faf2c36fc09d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:15:26.706547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1bcfa2b1-e542-411b-a623-5c552b0217ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:26.707637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1bcfa2b1-e542-411b-a623-5c552b0217ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:26.711190 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1415/2844] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:15:26 2022] DELETE /identity/v3/projects/57711fd8aa0d406db001faf2c36fc09d => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:26.717994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb5440-0f63-4a8e-bd47-83ac407efd2b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:26.718349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb5440-0f63-4a8e-bd47-83ac407efd2b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:26.718668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb5440-0f63-4a8e-bd47-83ac407efd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:26.759196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e5cb5440-0f63-4a8e-bd47-83ac407efd2b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:26.760555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e5cb5440-0f63-4a8e-bd47-83ac407efd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:26.783040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc679ffb-9777-48f6-94e5-7c33c3ad0bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:26.783691 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc679ffb-9777-48f6-94e5-7c33c3ad0bba admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:26.784145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc679ffb-9777-48f6-94e5-7c33c3ad0bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:26.784581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc679ffb-9777-48f6-94e5-7c33c3ad0bba admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:26.785614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc679ffb-9777-48f6-94e5-7c33c3ad0bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:26.788981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc679ffb-9777-48f6-94e5-7c33c3ad0bba admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:26.802369 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1430/2845] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:15:26.806678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc679ffb-9777-48f6-94e5-7c33c3ad0bba admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:26.809167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dc679ffb-9777-48f6-94e5-7c33c3ad0bba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:26.828477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc679ffb-9777-48f6-94e5-7c33c3ad0bba admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:26.834164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d53f47-0e52-44d5-82fc-0564d916fe20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:26.835650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d53f47-0e52-44d5-82fc-0564d916fe20 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:26.836160 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d53f47-0e52-44d5-82fc-0564d916fe20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:26.836519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d53f47-0e52-44d5-82fc-0564d916fe20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:26.837245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d53f47-0e52-44d5-82fc-0564d916fe20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:26.840014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d53f47-0e52-44d5-82fc-0564d916fe20 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:26.856226 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1431/2846] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:15:26.857930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d53f47-0e52-44d5-82fc-0564d916fe20 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:26.859544 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1416/2847] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:15:26.872576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da3094-74eb-4576-9ff8-7816f76ffa74 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:26.873111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da3094-74eb-4576-9ff8-7816f76ffa74 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:26.873602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da3094-74eb-4576-9ff8-7816f76ffa74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:26.894772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d53f47-0e52-44d5-82fc-0564d916fe20 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:26.905179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff2588-2a9b-4bb1-a15d-c865db96720e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:26.906031 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff2588-2a9b-4bb1-a15d-c865db96720e admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:26.906394 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff2588-2a9b-4bb1-a15d-c865db96720e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:26.907605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff2588-2a9b-4bb1-a15d-c865db96720e admin admin] PATH_INFO: `/v3/projects/e1530b8294fc4dd4bc7e7b228ad2b95c/users/065d8324da60445ea1e97e1dc892f183/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:26.924754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-07da3094-74eb-4576-9ff8-7816f76ffa74 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:26.926180 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-07da3094-74eb-4576-9ff8-7816f76ffa74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:26.936580 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff2588-2a9b-4bb1-a15d-c865db96720e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1530b8294fc4dd4bc7e7b228ad2b95c, user_id=065d8324da60445ea1e97e1dc892f183, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:26.941749 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff2588-2a9b-4bb1-a15d-c865db96720e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:26.962549 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1417/2848] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:15:26.964281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da3094-74eb-4576-9ff8-7816f76ffa74 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:26.984427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da3094-74eb-4576-9ff8-7816f76ffa74 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:27.001927 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1432/2849] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:15:26 2022] PUT /identity/v3/projects/e1530b8294fc4dd4bc7e7b228ad2b95c/users/065d8324da60445ea1e97e1dc892f183/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:27.003732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec665f72-87e6-47a8-a742-6972b969fff9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:27.004020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec665f72-87e6-47a8-a742-6972b969fff9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:27.005099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec665f72-87e6-47a8-a742-6972b969fff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:27.029068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ec665f72-87e6-47a8-a742-6972b969fff9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:27.029900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ec665f72-87e6-47a8-a742-6972b969fff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:27.146339 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047f965-f18b-4a2b-9aaa-9633bfc1a52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:27.148389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047f965-f18b-4a2b-9aaa-9633bfc1a52c admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:27.148960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047f965-f18b-4a2b-9aaa-9633bfc1a52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:27.149505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047f965-f18b-4a2b-9aaa-9633bfc1a52c admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:27.151392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047f965-f18b-4a2b-9aaa-9633bfc1a52c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:15:27.151949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047f965-f18b-4a2b-9aaa-9633bfc1a52c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:27.161959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047f965-f18b-4a2b-9aaa-9633bfc1a52c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:27.196167 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1418/2850] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:15:27.201581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047f965-f18b-4a2b-9aaa-9633bfc1a52c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:27.210312 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1433/2851] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:27.226449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047f965-f18b-4a2b-9aaa-9633bfc1a52c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:27.239709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da34267-5625-41a1-b7a4-e9a4e81f1144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:27.241855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da34267-5625-41a1-b7a4-e9a4e81f1144 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:27.242510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da34267-5625-41a1-b7a4-e9a4e81f1144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:27.243144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da34267-5625-41a1-b7a4-e9a4e81f1144 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:27.244738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da34267-5625-41a1-b7a4-e9a4e81f1144 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:27.249958 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da34267-5625-41a1-b7a4-e9a4e81f1144 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:27.258844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec665f72-87e6-47a8-a742-6972b969fff9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:27.262502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ec665f72-87e6-47a8-a742-6972b969fff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:27.324135 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1419/2852] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:15:27 2022] POST /identity/v3/projects => generated 381 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:15:27.330395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da34267-5625-41a1-b7a4-e9a4e81f1144 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:27.409688 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:27.449005 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:27.457852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da34267-5625-41a1-b7a4-e9a4e81f1144 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:27.460323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec665f72-87e6-47a8-a742-6972b969fff9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:27.469569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdea686-cf05-42c4-8766-40c848346ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:27.470768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdea686-cf05-42c4-8766-40c848346ceb admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:27.471376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdea686-cf05-42c4-8766-40c848346ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:27.471954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdea686-cf05-42c4-8766-40c848346ceb admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:27.472747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdea686-cf05-42c4-8766-40c848346ceb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:27.474824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdea686-cf05-42c4-8766-40c848346ceb admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:27.509047 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1420/2853] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:15:27 2022] POST /identity/v3/users => generated 291 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:15:27.510890 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdea686-cf05-42c4-8766-40c848346ceb admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:27.527577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdea686-cf05-42c4-8766-40c848346ceb admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:27.545872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae07b1b-9175-4c45-b4d4-ba0972aeaf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:27.547320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae07b1b-9175-4c45-b4d4-ba0972aeaf68 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:27.548294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae07b1b-9175-4c45-b4d4-ba0972aeaf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:27.548867 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae07b1b-9175-4c45-b4d4-ba0972aeaf68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:27.550525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae07b1b-9175-4c45-b4d4-ba0972aeaf68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:27.560368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae07b1b-9175-4c45-b4d4-ba0972aeaf68 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:27.610223 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1421/2854] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:15:27.611993 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee15af-f9b3-4187-b55d-d4c34da3b4ab None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:27.613002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee15af-f9b3-4187-b55d-d4c34da3b4ab None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:27.613002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee15af-f9b3-4187-b55d-d4c34da3b4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:27.636595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60132e23-d048-44d3-9180-2df04e46684d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:27.637665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60132e23-d048-44d3-9180-2df04e46684d service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:27.638223 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60132e23-d048-44d3-9180-2df04e46684d service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:27.638713 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60132e23-d048-44d3-9180-2df04e46684d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:27.668430 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60132e23-d048-44d3-9180-2df04e46684d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:27.670039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60132e23-d048-44d3-9180-2df04e46684d service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:27.690149 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-96ee15af-f9b3-4187-b55d-d4c34da3b4ab None None] MFA Rules not processed for user `6b504ab8d5dc4e2aa169b47ef24b3752`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:27.692761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-96ee15af-f9b3-4187-b55d-d4c34da3b4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:27.707329 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1434/2855] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:15:27.710186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60132e23-d048-44d3-9180-2df04e46684d service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:27.739641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60132e23-d048-44d3-9180-2df04e46684d service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:27.751584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f62c4e-be03-41d3-ab8f-b8dd31d4900e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:27.752338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f62c4e-be03-41d3-ab8f-b8dd31d4900e admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:27.752621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f62c4e-be03-41d3-ab8f-b8dd31d4900e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:27.752899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f62c4e-be03-41d3-ab8f-b8dd31d4900e admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:27.753635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f62c4e-be03-41d3-ab8f-b8dd31d4900e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:27.755619 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f62c4e-be03-41d3-ab8f-b8dd31d4900e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:27.796625 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1435/2856] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:15:27.797622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f62c4e-be03-41d3-ab8f-b8dd31d4900e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:27.824321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f62c4e-be03-41d3-ab8f-b8dd31d4900e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:27.833762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3618f4e-aad7-41cb-9c29-a7871e13b0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:27.835037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3618f4e-aad7-41cb-9c29-a7871e13b0e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:27.835300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3618f4e-aad7-41cb-9c29-a7871e13b0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:27.840567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3618f4e-aad7-41cb-9c29-a7871e13b0e8 admin admin] PATH_INFO: `/v3/projects/182a772cd3df4361aa80b84a029ec62f/users/f11cc5111f8548b2bdeea9061ceb70cc/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:27.880265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3618f4e-aad7-41cb-9c29-a7871e13b0e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=182a772cd3df4361aa80b84a029ec62f, user_id=f11cc5111f8548b2bdeea9061ceb70cc, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:27.890709 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3618f4e-aad7-41cb-9c29-a7871e13b0e8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:27.897983 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1422/2857] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:27.935257 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1436/2858] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:15:27 2022] PUT /identity/v3/projects/182a772cd3df4361aa80b84a029ec62f/users/f11cc5111f8548b2bdeea9061ceb70cc/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:27.936741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8580d4f-78c8-405c-afa6-862b600586c6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:27.937033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8580d4f-78c8-405c-afa6-862b600586c6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:27.937322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8580d4f-78c8-405c-afa6-862b600586c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:27.984971 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e8580d4f-78c8-405c-afa6-862b600586c6 None None] MFA Rules not processed for user `f11cc5111f8548b2bdeea9061ceb70cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:27.989844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e8580d4f-78c8-405c-afa6-862b600586c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:28.174130 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1423/2859] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:28.178942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3618f4e-aad7-41cb-9c29-a7871e13b0e8 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:28.290568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8580d4f-78c8-405c-afa6-862b600586c6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:28.292217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e8580d4f-78c8-405c-afa6-862b600586c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:28.348256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3618f4e-aad7-41cb-9c29-a7871e13b0e8 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:28.348256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128eceb-dc87-45bb-ad06-18cc2dfbd396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:28.348256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128eceb-dc87-45bb-ad06-18cc2dfbd396 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:28.348256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128eceb-dc87-45bb-ad06-18cc2dfbd396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:28.348612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128eceb-dc87-45bb-ad06-18cc2dfbd396 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:28.349515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128eceb-dc87-45bb-ad06-18cc2dfbd396 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:28.352403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128eceb-dc87-45bb-ad06-18cc2dfbd396 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:28.436620 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1437/2860] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:15:28 2022] POST /identity/v3/projects => generated 383 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:15:28.442421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128eceb-dc87-45bb-ad06-18cc2dfbd396 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:28.464933 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:28.545511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8580d4f-78c8-405c-afa6-862b600586c6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:28.627016 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:28.680691 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128eceb-dc87-45bb-ad06-18cc2dfbd396 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:28.686283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f33fbd-4452-4da7-921f-d2ca4c240f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:28.686986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f33fbd-4452-4da7-921f-d2ca4c240f4b admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:28.687484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f33fbd-4452-4da7-921f-d2ca4c240f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:28.687759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f33fbd-4452-4da7-921f-d2ca4c240f4b admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:28.688613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f33fbd-4452-4da7-921f-d2ca4c240f4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:28.690821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f33fbd-4452-4da7-921f-d2ca4c240f4b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:28.742125 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1438/2861] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:15:28 2022] POST /identity/v3/users => generated 298 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:15:28.747282 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f33fbd-4452-4da7-921f-d2ca4c240f4b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:28.752580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37f85b-8445-486d-8a44-7ebcff4844ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:28.753214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37f85b-8445-486d-8a44-7ebcff4844ca service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:28.753495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37f85b-8445-486d-8a44-7ebcff4844ca service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:28.753768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37f85b-8445-486d-8a44-7ebcff4844ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:28.770690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f33fbd-4452-4da7-921f-d2ca4c240f4b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:28.786255 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622a87a-06da-4559-9c61-c17f9b921477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:28.787193 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622a87a-06da-4559-9c61-c17f9b921477 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:28.787520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622a87a-06da-4559-9c61-c17f9b921477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:28.787796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622a87a-06da-4559-9c61-c17f9b921477 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:28.788573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622a87a-06da-4559-9c61-c17f9b921477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:28.792243 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622a87a-06da-4559-9c61-c17f9b921477 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:28.826971 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1439/2862] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:15:28.829928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622a87a-06da-4559-9c61-c17f9b921477 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:28.888292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b37f85b-8445-486d-8a44-7ebcff4844ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:28.893537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b37f85b-8445-486d-8a44-7ebcff4844ca service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:28.894624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622a87a-06da-4559-9c61-c17f9b921477 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:28.926448 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1424/2863] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:15:28.932876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023781e-0440-44d9-ba6f-fd927d7a70ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:28.933885 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023781e-0440-44d9-ba6f-fd927d7a70ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:28.934322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023781e-0440-44d9-ba6f-fd927d7a70ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:28.934770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023781e-0440-44d9-ba6f-fd927d7a70ea admin admin] PATH_INFO: `/v3/projects/bd99b67c7b7a469eb676cb6419353f7a/users/8b5dea1c08cb4bef85fdf2bfa018a9e4/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:28.982679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8023781e-0440-44d9-ba6f-fd927d7a70ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd99b67c7b7a469eb676cb6419353f7a, user_id=8b5dea1c08cb4bef85fdf2bfa018a9e4, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:28.990503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8023781e-0440-44d9-ba6f-fd927d7a70ea admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:29.034381 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1440/2864] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:15:28 2022] PUT /identity/v3/projects/bd99b67c7b7a469eb676cb6419353f7a/users/8b5dea1c08cb4bef85fdf2bfa018a9e4/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:29.039663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37f85b-8445-486d-8a44-7ebcff4844ca service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:29.059123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37f85b-8445-486d-8a44-7ebcff4844ca service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:29.229033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e4fe5-0d56-4e4d-9883-99e961871de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:29.230029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e4fe5-0d56-4e4d-9883-99e961871de7 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:29.230465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e4fe5-0d56-4e4d-9883-99e961871de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:29.230999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e4fe5-0d56-4e4d-9883-99e961871de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:29.232074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e4fe5-0d56-4e4d-9883-99e961871de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:29.233758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e4fe5-0d56-4e4d-9883-99e961871de7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:29.262334 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1425/2865] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:15:29.268940 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023781e-0440-44d9-ba6f-fd927d7a70ea admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:29.299646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023781e-0440-44d9-ba6f-fd927d7a70ea admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:29.333882 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c1482-6a2c-4949-bd4e-ac7a76f92678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:29.334624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c1482-6a2c-4949-bd4e-ac7a76f92678 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:29.334912 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c1482-6a2c-4949-bd4e-ac7a76f92678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:29.342333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c1482-6a2c-4949-bd4e-ac7a76f92678 admin admin] PATH_INFO: `/v3/projects/bd99b67c7b7a469eb676cb6419353f7a/users/8b5dea1c08cb4bef85fdf2bfa018a9e4/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:29.357568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c1482-6a2c-4949-bd4e-ac7a76f92678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd99b67c7b7a469eb676cb6419353f7a, user_id=8b5dea1c08cb4bef85fdf2bfa018a9e4, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:29.360361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c1482-6a2c-4949-bd4e-ac7a76f92678 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:29.413330 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1441/2866] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:15:29 2022] PUT /identity/v3/projects/bd99b67c7b7a469eb676cb6419353f7a/users/8b5dea1c08cb4bef85fdf2bfa018a9e4/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:29.415094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b5b10-23ae-443e-841a-7a001c5b9225 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:29.415452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b5b10-23ae-443e-841a-7a001c5b9225 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:29.415801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b5b10-23ae-443e-841a-7a001c5b9225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:29.479224 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-157b5b10-23ae-443e-841a-7a001c5b9225 None None] MFA Rules not processed for user `8b5dea1c08cb4bef85fdf2bfa018a9e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:29.480676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-157b5b10-23ae-443e-841a-7a001c5b9225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:29.527003 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:29.697183 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1426/2867] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:31.089814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c1482-6a2c-4949-bd4e-ac7a76f92678 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:31.094760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-152c1482-6a2c-4949-bd4e-ac7a76f92678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:31.343299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c1482-6a2c-4949-bd4e-ac7a76f92678 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:31.356053 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0947e1d-b75e-42ed-86ff-9b7005ebd244 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:31.357988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0947e1d-b75e-42ed-86ff-9b7005ebd244 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:31.358468 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0947e1d-b75e-42ed-86ff-9b7005ebd244 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:31.358741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0947e1d-b75e-42ed-86ff-9b7005ebd244 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:31.384741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0947e1d-b75e-42ed-86ff-9b7005ebd244 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:31.389060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0947e1d-b75e-42ed-86ff-9b7005ebd244 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:31.416250 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1442/2868] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:15:36.900017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b5b10-23ae-443e-841a-7a001c5b9225 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:37.084052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b5b10-23ae-443e-841a-7a001c5b9225 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:37.090076 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b461f-9d77-42d7-a1f2-b1abec99d570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:37.090873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b461f-9d77-42d7-a1f2-b1abec99d570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:37.091250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b461f-9d77-42d7-a1f2-b1abec99d570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:37.091643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b461f-9d77-42d7-a1f2-b1abec99d570 admin admin] PATH_INFO: `/v3/users/f11cc5111f8548b2bdeea9061ceb70cc` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:37.093018 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b461f-9d77-42d7-a1f2-b1abec99d570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f11cc5111f8548b2bdeea9061ceb70cc)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:37.095733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b461f-9d77-42d7-a1f2-b1abec99d570 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:37.165176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1d1b461f-9d77-42d7-a1f2-b1abec99d570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f11cc5111f8548b2bdeea9061ceb70cc'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:37.177224 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1d1b461f-9d77-42d7-a1f2-b1abec99d570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f11cc5111f8548b2bdeea9061ceb70cc'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:37.203495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1d1b461f-9d77-42d7-a1f2-b1abec99d570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f11cc5111f8548b2bdeea9061ceb70cc'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:37.204291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1d1b461f-9d77-42d7-a1f2-b1abec99d570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f11cc5111f8548b2bdeea9061ceb70cc'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:37.218201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1d1b461f-9d77-42d7-a1f2-b1abec99d570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f11cc5111f8548b2bdeea9061ceb70cc'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:37.240772 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1427/2869] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:15:36 2022] DELETE /identity/v3/users/f11cc5111f8548b2bdeea9061ceb70cc => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:37.244524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48acb65-584e-4b03-baac-e8f5755cc6b2 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:37.245098 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48acb65-584e-4b03-baac-e8f5755cc6b2 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:37.245321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48acb65-584e-4b03-baac-e8f5755cc6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:37.288778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c48acb65-584e-4b03-baac-e8f5755cc6b2 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:37.291101 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c48acb65-584e-4b03-baac-e8f5755cc6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:37.456124 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1443/2870] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:37.517937 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b461f-9d77-42d7-a1f2-b1abec99d570 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:37.521083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1d1b461f-9d77-42d7-a1f2-b1abec99d570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:37.620291 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:37.671625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b461f-9d77-42d7-a1f2-b1abec99d570 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:37.676601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37a9b3-5adc-413c-a46c-81b049f65b29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:37.678168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37a9b3-5adc-413c-a46c-81b049f65b29 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:37.678491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37a9b3-5adc-413c-a46c-81b049f65b29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:37.678770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37a9b3-5adc-413c-a46c-81b049f65b29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:37.702786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37a9b3-5adc-413c-a46c-81b049f65b29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:37.704315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37a9b3-5adc-413c-a46c-81b049f65b29 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:37.723327 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1428/2871] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:15:38.748112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48acb65-584e-4b03-baac-e8f5755cc6b2 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:38.749935 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c48acb65-584e-4b03-baac-e8f5755cc6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:38.776085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48acb65-584e-4b03-baac-e8f5755cc6b2 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:38.784665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45526971-51ad-4d4b-bb91-2cfcd15e4b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:38.785491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45526971-51ad-4d4b-bb91-2cfcd15e4b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:38.786120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45526971-51ad-4d4b-bb91-2cfcd15e4b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:38.786243 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45526971-51ad-4d4b-bb91-2cfcd15e4b29 admin admin] PATH_INFO: `/v3/projects/182a772cd3df4361aa80b84a029ec62f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:38.788665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45526971-51ad-4d4b-bb91-2cfcd15e4b29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=182a772cd3df4361aa80b84a029ec62f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:38.792437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45526971-51ad-4d4b-bb91-2cfcd15e4b29 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:38.804456 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:38.990009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-45526971-51ad-4d4b-bb91-2cfcd15e4b29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '182a772cd3df4361aa80b84a029ec62f', 'request_id': 'req-45526971-51ad-4d4b-bb91-2cfcd15e4b29'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:39.007822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-45526971-51ad-4d4b-bb91-2cfcd15e4b29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '182a772cd3df4361aa80b84a029ec62f', 'request_id': 'req-45526971-51ad-4d4b-bb91-2cfcd15e4b29'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:39.032607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-45526971-51ad-4d4b-bb91-2cfcd15e4b29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '182a772cd3df4361aa80b84a029ec62f', 'request_id': 'req-45526971-51ad-4d4b-bb91-2cfcd15e4b29'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:39.067944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-45526971-51ad-4d4b-bb91-2cfcd15e4b29 admin admin] The token cache is being invalidate because project 182a772cd3df4361aa80b84a029ec62f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:15:39.069418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-45526971-51ad-4d4b-bb91-2cfcd15e4b29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:39.070316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-45526971-51ad-4d4b-bb91-2cfcd15e4b29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:39.076369 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1444/2872] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:15:38 2022] DELETE /identity/v3/projects/182a772cd3df4361aa80b84a029ec62f => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:39.077323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37a9b3-5adc-413c-a46c-81b049f65b29 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:39.095295 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37a9b3-5adc-413c-a46c-81b049f65b29 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:39.203232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d75322-0676-47c2-91fc-e0aaf189c043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:39.204726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d75322-0676-47c2-91fc-e0aaf189c043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:39.205177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d75322-0676-47c2-91fc-e0aaf189c043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:39.205671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d75322-0676-47c2-91fc-e0aaf189c043 admin admin] PATH_INFO: `/v3/users/8b5dea1c08cb4bef85fdf2bfa018a9e4` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:39.207655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d75322-0676-47c2-91fc-e0aaf189c043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b5dea1c08cb4bef85fdf2bfa018a9e4)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:39.212279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d75322-0676-47c2-91fc-e0aaf189c043 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:39.290759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-76d75322-0676-47c2-91fc-e0aaf189c043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b5dea1c08cb4bef85fdf2bfa018a9e4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:39.304911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-76d75322-0676-47c2-91fc-e0aaf189c043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b5dea1c08cb4bef85fdf2bfa018a9e4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:39.336791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-76d75322-0676-47c2-91fc-e0aaf189c043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b5dea1c08cb4bef85fdf2bfa018a9e4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:39.337738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-76d75322-0676-47c2-91fc-e0aaf189c043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b5dea1c08cb4bef85fdf2bfa018a9e4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:39.372445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-76d75322-0676-47c2-91fc-e0aaf189c043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b5dea1c08cb4bef85fdf2bfa018a9e4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:39.394779 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1429/2873] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:15:39 2022] DELETE /identity/v3/users/8b5dea1c08cb4bef85fdf2bfa018a9e4 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:40.207329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45526971-51ad-4d4b-bb91-2cfcd15e4b29 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:40.209856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-45526971-51ad-4d4b-bb91-2cfcd15e4b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:40.245235 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45526971-51ad-4d4b-bb91-2cfcd15e4b29 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:40.378308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918301c-e710-4d6b-b4aa-8a0172d6bd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:40.381528 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918301c-e710-4d6b-b4aa-8a0172d6bd11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:40.382451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918301c-e710-4d6b-b4aa-8a0172d6bd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:40.384082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918301c-e710-4d6b-b4aa-8a0172d6bd11 admin admin] PATH_INFO: `/v3/projects/bd99b67c7b7a469eb676cb6419353f7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:40.386003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918301c-e710-4d6b-b4aa-8a0172d6bd11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd99b67c7b7a469eb676cb6419353f7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:40.388947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918301c-e710-4d6b-b4aa-8a0172d6bd11 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:40.468420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8918301c-e710-4d6b-b4aa-8a0172d6bd11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd99b67c7b7a469eb676cb6419353f7a', 'request_id': 'req-8918301c-e710-4d6b-b4aa-8a0172d6bd11'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:40.481564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8918301c-e710-4d6b-b4aa-8a0172d6bd11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd99b67c7b7a469eb676cb6419353f7a', 'request_id': 'req-8918301c-e710-4d6b-b4aa-8a0172d6bd11'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:40.493941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8918301c-e710-4d6b-b4aa-8a0172d6bd11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd99b67c7b7a469eb676cb6419353f7a', 'request_id': 'req-8918301c-e710-4d6b-b4aa-8a0172d6bd11'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:40.515703 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8918301c-e710-4d6b-b4aa-8a0172d6bd11 admin admin] The token cache is being invalidate because project bd99b67c7b7a469eb676cb6419353f7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:15:40.516250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8918301c-e710-4d6b-b4aa-8a0172d6bd11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:40.518131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8918301c-e710-4d6b-b4aa-8a0172d6bd11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:40.520797 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1445/2874] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:15:40 2022] DELETE /identity/v3/projects/bd99b67c7b7a469eb676cb6419353f7a => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:40.526335 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12e54c-82e0-4d88-96c4-0352b460532a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:40.527194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12e54c-82e0-4d88-96c4-0352b460532a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:40.527655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12e54c-82e0-4d88-96c4-0352b460532a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:40.555495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ad12e54c-82e0-4d88-96c4-0352b460532a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:40.556775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ad12e54c-82e0-4d88-96c4-0352b460532a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:40.638708 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:40.665242 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1430/2875] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:40.666998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b10ce9-86c4-4f23-a38e-d99ef32f5722 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:40.667314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b10ce9-86c4-4f23-a38e-d99ef32f5722 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:40.667664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b10ce9-86c4-4f23-a38e-d99ef32f5722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:40.694081 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b6b10ce9-86c4-4f23-a38e-d99ef32f5722 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:40.695332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b6b10ce9-86c4-4f23-a38e-d99ef32f5722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:40.706322 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1446/2876] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:40.711470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12e54c-82e0-4d88-96c4-0352b460532a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:40.726727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12e54c-82e0-4d88-96c4-0352b460532a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:40.733374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a6cac-82cf-4484-b871-a11465871e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:40.734499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a6cac-82cf-4484-b871-a11465871e5e admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:40.734868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a6cac-82cf-4484-b871-a11465871e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:40.735374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a6cac-82cf-4484-b871-a11465871e5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:40.739490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a6cac-82cf-4484-b871-a11465871e5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:15:40.739996 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a6cac-82cf-4484-b871-a11465871e5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:40.742317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a6cac-82cf-4484-b871-a11465871e5e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:40.772700 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1431/2877] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:15:40.773095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b10ce9-86c4-4f23-a38e-d99ef32f5722 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:40.783366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b10ce9-86c4-4f23-a38e-d99ef32f5722 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:40.789450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f136812-c356-4c78-856b-5839615fc106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:40.790238 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f136812-c356-4c78-856b-5839615fc106 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:40.790523 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f136812-c356-4c78-856b-5839615fc106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:40.790792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f136812-c356-4c78-856b-5839615fc106 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:40.791436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f136812-c356-4c78-856b-5839615fc106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:40.793634 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f136812-c356-4c78-856b-5839615fc106 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:40.813190 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:40.842789 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1447/2878] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:15:40 2022] POST /identity/v3/projects => generated 409 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:15:40.844020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a6cac-82cf-4484-b871-a11465871e5e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:40.855189 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a6cac-82cf-4484-b871-a11465871e5e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:40.946649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9695e1-672d-469c-94c3-fed99c3237b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:40.947678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9695e1-672d-469c-94c3-fed99c3237b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:40.948299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9695e1-672d-469c-94c3-fed99c3237b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:40.948686 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9695e1-672d-469c-94c3-fed99c3237b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:40.949826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9695e1-672d-469c-94c3-fed99c3237b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:40.953980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9695e1-672d-469c-94c3-fed99c3237b5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:40.991360 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1432/2879] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:15:40 2022] POST /identity/v3/users => generated 305 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:15:40.992697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f136812-c356-4c78-856b-5839615fc106 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:41.009285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffeb7e-dc17-4596-af09-ba150d92d67d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:41.009994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffeb7e-dc17-4596-af09-ba150d92d67d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:41.010569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffeb7e-dc17-4596-af09-ba150d92d67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:41.024311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f136812-c356-4c78-856b-5839615fc106 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:41.033001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404661d5-7616-43af-a773-91f7784ded58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:41.033001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404661d5-7616-43af-a773-91f7784ded58 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:41.033001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404661d5-7616-43af-a773-91f7784ded58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:41.033815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404661d5-7616-43af-a773-91f7784ded58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:41.034125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404661d5-7616-43af-a773-91f7784ded58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:41.035874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404661d5-7616-43af-a773-91f7784ded58 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:41.057565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-77ffeb7e-dc17-4596-af09-ba150d92d67d None None] MFA Rules not processed for user `065d8324da60445ea1e97e1dc892f183`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:41.059249 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-77ffeb7e-dc17-4596-af09-ba150d92d67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:41.062589 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1448/2880] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:15:41.068774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404661d5-7616-43af-a773-91f7784ded58 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:41.091744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404661d5-7616-43af-a773-91f7784ded58 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:41.115053 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c936e75-5e1d-4547-9089-1f6c44012091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:41.115817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c936e75-5e1d-4547-9089-1f6c44012091 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:41.116140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c936e75-5e1d-4547-9089-1f6c44012091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:41.116546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c936e75-5e1d-4547-9089-1f6c44012091 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:41.117273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c936e75-5e1d-4547-9089-1f6c44012091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:41.118967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c936e75-5e1d-4547-9089-1f6c44012091 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:41.135218 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1449/2881] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:15:41.140751 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c936e75-5e1d-4547-9089-1f6c44012091 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:41.156118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c936e75-5e1d-4547-9089-1f6c44012091 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:41.162326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29542ad8-ef21-4b6e-94e5-14da409026d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:41.163533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29542ad8-ef21-4b6e-94e5-14da409026d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:41.163817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29542ad8-ef21-4b6e-94e5-14da409026d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:41.164155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29542ad8-ef21-4b6e-94e5-14da409026d3 admin admin] PATH_INFO: `/v3/projects/857d9950e6fb4b2d88e69bd5a3a1764b/users/1225eed7296f489383edbee588257620/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:41.189376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29542ad8-ef21-4b6e-94e5-14da409026d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=857d9950e6fb4b2d88e69bd5a3a1764b, user_id=1225eed7296f489383edbee588257620, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:41.194178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29542ad8-ef21-4b6e-94e5-14da409026d3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:41.218235 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1450/2882] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:15:41 2022] PUT /identity/v3/projects/857d9950e6fb4b2d88e69bd5a3a1764b/users/1225eed7296f489383edbee588257620/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:41.230763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582705f-c8a4-402d-9faa-dcccd4e5773b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:41.231824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582705f-c8a4-402d-9faa-dcccd4e5773b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:41.232149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582705f-c8a4-402d-9faa-dcccd4e5773b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:41.233401 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1433/2883] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:41.282580 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3582705f-c8a4-402d-9faa-dcccd4e5773b None None] MFA Rules not processed for user `1225eed7296f489383edbee588257620`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:41.284104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3582705f-c8a4-402d-9faa-dcccd4e5773b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:41.389548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ffeb7e-dc17-4596-af09-ba150d92d67d None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:41.391159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-77ffeb7e-dc17-4596-af09-ba150d92d67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:41.400011 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1451/2884] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:41 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:15:41.401060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582705f-c8a4-402d-9faa-dcccd4e5773b None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:41.488685 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:41.521857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ffeb7e-dc17-4596-af09-ba150d92d67d None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:41.533801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582705f-c8a4-402d-9faa-dcccd4e5773b None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:41.543622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58d8ca-5282-4cd7-92f9-4fa9f76665d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:41.544294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58d8ca-5282-4cd7-92f9-4fa9f76665d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:41.544652 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58d8ca-5282-4cd7-92f9-4fa9f76665d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:41.544860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d58d8ca-5282-4cd7-92f9-4fa9f76665d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:41.545545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58d8ca-5282-4cd7-92f9-4fa9f76665d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:41.553236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d58d8ca-5282-4cd7-92f9-4fa9f76665d9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:41.595668 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1452/2885] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:15:41 2022] POST /identity/v3/projects => generated 407 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:15:41.597453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58d8ca-5282-4cd7-92f9-4fa9f76665d9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:41.635724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c8a28-a22f-4896-b74e-1c561f83bac0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:41.637788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c8a28-a22f-4896-b74e-1c561f83bac0 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:41.638718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c8a28-a22f-4896-b74e-1c561f83bac0 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:41.639227 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c8a28-a22f-4896-b74e-1c561f83bac0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:41.645319 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:41.734444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d58d8ca-5282-4cd7-92f9-4fa9f76665d9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:41.743520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bedb34-317d-47f4-a938-9fe050e82f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:41.744693 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bedb34-317d-47f4-a938-9fe050e82f6a admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:41.745610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bedb34-317d-47f4-a938-9fe050e82f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:41.746244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bedb34-317d-47f4-a938-9fe050e82f6a admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:41.747207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bedb34-317d-47f4-a938-9fe050e82f6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:41.750326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bedb34-317d-47f4-a938-9fe050e82f6a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:41.793280 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1453/2886] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:15:41 2022] POST /identity/v3/users => generated 310 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:15:41.797641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bedb34-317d-47f4-a938-9fe050e82f6a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:41.806681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c8a28-a22f-4896-b74e-1c561f83bac0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:41.808718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c8a28-a22f-4896-b74e-1c561f83bac0 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:41.815954 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bedb34-317d-47f4-a938-9fe050e82f6a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:41.825631 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1434/2887] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:15:41.841961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9f83a-4edf-4fc9-b43b-7f3e850e106f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:41.841961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9f83a-4edf-4fc9-b43b-7f3e850e106f admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:41.841961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9f83a-4edf-4fc9-b43b-7f3e850e106f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:41.841961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9f83a-4edf-4fc9-b43b-7f3e850e106f admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:41.842337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9f83a-4edf-4fc9-b43b-7f3e850e106f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:41.844619 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9f83a-4edf-4fc9-b43b-7f3e850e106f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:41.876510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c8a28-a22f-4896-b74e-1c561f83bac0 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:41.878976 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1454/2888] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:15:41.893750 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c8a28-a22f-4896-b74e-1c561f83bac0 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:41.899737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70016c11-ca4c-45ff-9a3b-4eb86e0b8568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:41.901074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70016c11-ca4c-45ff-9a3b-4eb86e0b8568 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:41.902035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70016c11-ca4c-45ff-9a3b-4eb86e0b8568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:41.902035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70016c11-ca4c-45ff-9a3b-4eb86e0b8568 admin admin] PATH_INFO: `/v3/projects/bfe98a2f33794cbeac55e1ed64947157/users/0000ca500ed648b79c0e00a3ae9db120/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:41.944818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70016c11-ca4c-45ff-9a3b-4eb86e0b8568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe98a2f33794cbeac55e1ed64947157, user_id=0000ca500ed648b79c0e00a3ae9db120, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:41.953717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70016c11-ca4c-45ff-9a3b-4eb86e0b8568 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:41.991481 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1435/2889] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:15:41 2022] PUT /identity/v3/projects/bfe98a2f33794cbeac55e1ed64947157/users/0000ca500ed648b79c0e00a3ae9db120/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:41.996769 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9f83a-4edf-4fc9-b43b-7f3e850e106f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:42.009301 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9f83a-4edf-4fc9-b43b-7f3e850e106f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:42.113166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcece1-96df-4613-9c03-660ea6769254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:42.113770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcece1-96df-4613-9c03-660ea6769254 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:42.114075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcece1-96df-4613-9c03-660ea6769254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:42.114354 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcece1-96df-4613-9c03-660ea6769254 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:42.115922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcece1-96df-4613-9c03-660ea6769254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:42.117567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcece1-96df-4613-9c03-660ea6769254 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:42.131577 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1455/2890] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:15:42.136371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70016c11-ca4c-45ff-9a3b-4eb86e0b8568 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:42.152423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70016c11-ca4c-45ff-9a3b-4eb86e0b8568 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:42.163423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c315f-eefe-4017-b756-b0c2fd1f772e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:42.164224 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c315f-eefe-4017-b756-b0c2fd1f772e admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:42.164556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c315f-eefe-4017-b756-b0c2fd1f772e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:42.164891 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c315f-eefe-4017-b756-b0c2fd1f772e admin admin] PATH_INFO: `/v3/projects/bfe98a2f33794cbeac55e1ed64947157/users/0000ca500ed648b79c0e00a3ae9db120/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:42.167201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c315f-eefe-4017-b756-b0c2fd1f772e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe98a2f33794cbeac55e1ed64947157, user_id=0000ca500ed648b79c0e00a3ae9db120, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:42.170895 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c315f-eefe-4017-b756-b0c2fd1f772e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:42.194857 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1436/2891] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:15:42 2022] PUT /identity/v3/projects/bfe98a2f33794cbeac55e1ed64947157/users/0000ca500ed648b79c0e00a3ae9db120/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:42.196298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19963a1-5bb6-4f2d-8f00-17d00f118b50 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:42.196900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19963a1-5bb6-4f2d-8f00-17d00f118b50 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:42.196900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19963a1-5bb6-4f2d-8f00-17d00f118b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:42.280616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b19963a1-5bb6-4f2d-8f00-17d00f118b50 None None] MFA Rules not processed for user `0000ca500ed648b79c0e00a3ae9db120`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:42.288227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b19963a1-5bb6-4f2d-8f00-17d00f118b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:42.482868 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1456/2892] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:42 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:43.789903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c315f-eefe-4017-b756-b0c2fd1f772e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:43.938280 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:43.967279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c315f-eefe-4017-b756-b0c2fd1f772e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:43.976175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2755c-246b-42c2-ab0e-748580d613df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:43.977749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2755c-246b-42c2-ab0e-748580d613df service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:43.978051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2755c-246b-42c2-ab0e-748580d613df service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:43.978346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2755c-246b-42c2-ab0e-748580d613df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:43.995955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2755c-246b-42c2-ab0e-748580d613df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:43.999566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2755c-246b-42c2-ab0e-748580d613df service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:44.013681 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1437/2893] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:43 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:15:44.916208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19963a1-5bb6-4f2d-8f00-17d00f118b50 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:44.931292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19963a1-5bb6-4f2d-8f00-17d00f118b50 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:44.937183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b8222-ab19-4c06-9f5c-471946fed447 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:44.937880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b8222-ab19-4c06-9f5c-471946fed447 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:44.938070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b8222-ab19-4c06-9f5c-471946fed447 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:44.938554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b8222-ab19-4c06-9f5c-471946fed447 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:44.979717 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:45.055961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b8222-ab19-4c06-9f5c-471946fed447 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:45.057701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b8222-ab19-4c06-9f5c-471946fed447 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:45.072776 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1457/2894] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:44 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:15:45.637711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb1117-77de-4034-be36-057ceceac370 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:45.638317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb1117-77de-4034-be36-057ceceac370 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:45.638317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb1117-77de-4034-be36-057ceceac370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:45.661230 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-34eb1117-77de-4034-be36-057ceceac370 None None] MFA Rules not processed for user `065d8324da60445ea1e97e1dc892f183`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:45.663488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-34eb1117-77de-4034-be36-057ceceac370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:45.742278 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1438/2895] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:46.361776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b8222-ab19-4c06-9f5c-471946fed447 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:46.363705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-258b8222-ab19-4c06-9f5c-471946fed447 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:46.464903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb1117-77de-4034-be36-057ceceac370 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:46.509477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b8222-ab19-4c06-9f5c-471946fed447 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:46.517007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4903227-5679-4254-b4eb-f779e647c5f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:46.517646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4903227-5679-4254-b4eb-f779e647c5f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:46.517921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4903227-5679-4254-b4eb-f779e647c5f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:46.518195 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4903227-5679-4254-b4eb-f779e647c5f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:46.523270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c4903227-5679-4254-b4eb-f779e647c5f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:46.580910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb1117-77de-4034-be36-057ceceac370 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:46.588333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6e464-7596-4491-88b9-c85b3befa831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:46.589258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6e464-7596-4491-88b9-c85b3befa831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:46.590087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6e464-7596-4491-88b9-c85b3befa831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:46.590087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6e464-7596-4491-88b9-c85b3befa831 admin admin] PATH_INFO: `/v3/users/1225eed7296f489383edbee588257620` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:46.591217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6e464-7596-4491-88b9-c85b3befa831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1225eed7296f489383edbee588257620)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:46.594163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6e464-7596-4491-88b9-c85b3befa831 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:46.635357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4903227-5679-4254-b4eb-f779e647c5f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:46.637639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4903227-5679-4254-b4eb-f779e647c5f7 service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:46.666249 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1458/2896] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:15:46.679798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-01a6e464-7596-4491-88b9-c85b3befa831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1225eed7296f489383edbee588257620'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:46.689073 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-01a6e464-7596-4491-88b9-c85b3befa831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1225eed7296f489383edbee588257620'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:46.707293 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-01a6e464-7596-4491-88b9-c85b3befa831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1225eed7296f489383edbee588257620'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:46.708404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-01a6e464-7596-4491-88b9-c85b3befa831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1225eed7296f489383edbee588257620'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:46.719831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-01a6e464-7596-4491-88b9-c85b3befa831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1225eed7296f489383edbee588257620'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:46.742157 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1439/2897] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:15:46 2022] DELETE /identity/v3/users/1225eed7296f489383edbee588257620 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:46.744916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea9df0-af87-4e0c-bf8a-45b2dd9d5185 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:46.745208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea9df0-af87-4e0c-bf8a-45b2dd9d5185 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:46.745475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea9df0-af87-4e0c-bf8a-45b2dd9d5185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:46.772813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-52ea9df0-af87-4e0c-bf8a-45b2dd9d5185 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:46.775875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-52ea9df0-af87-4e0c-bf8a-45b2dd9d5185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:46.870513 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:46.906222 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1459/2898] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:46.931596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6e464-7596-4491-88b9-c85b3befa831 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:46.933812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-01a6e464-7596-4491-88b9-c85b3befa831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:46.954214 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:47.037361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6e464-7596-4491-88b9-c85b3befa831 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:47.050088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92d980-ca68-48af-a347-5ac1cbda1ff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:47.050088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92d980-ca68-48af-a347-5ac1cbda1ff6 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:47.051516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92d980-ca68-48af-a347-5ac1cbda1ff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:47.051516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92d980-ca68-48af-a347-5ac1cbda1ff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:47.110342 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b92d980-ca68-48af-a347-5ac1cbda1ff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:47.111744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b92d980-ca68-48af-a347-5ac1cbda1ff6 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:47.125190 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1440/2899] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:15:48.207005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea9df0-af87-4e0c-bf8a-45b2dd9d5185 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:48.209192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-52ea9df0-af87-4e0c-bf8a-45b2dd9d5185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:48.241681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea9df0-af87-4e0c-bf8a-45b2dd9d5185 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:48.268233 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73705bae-4ffd-4790-89a0-74d6a014eb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:48.268724 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73705bae-4ffd-4790-89a0-74d6a014eb4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:48.269147 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73705bae-4ffd-4790-89a0-74d6a014eb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:48.269447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73705bae-4ffd-4790-89a0-74d6a014eb4a admin admin] PATH_INFO: `/v3/projects/857d9950e6fb4b2d88e69bd5a3a1764b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:48.272274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73705bae-4ffd-4790-89a0-74d6a014eb4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=857d9950e6fb4b2d88e69bd5a3a1764b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:48.275194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73705bae-4ffd-4790-89a0-74d6a014eb4a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:48.358218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73705bae-4ffd-4790-89a0-74d6a014eb4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '857d9950e6fb4b2d88e69bd5a3a1764b', 'request_id': 'req-73705bae-4ffd-4790-89a0-74d6a014eb4a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:48.368602 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73705bae-4ffd-4790-89a0-74d6a014eb4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '857d9950e6fb4b2d88e69bd5a3a1764b', 'request_id': 'req-73705bae-4ffd-4790-89a0-74d6a014eb4a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:48.377671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73705bae-4ffd-4790-89a0-74d6a014eb4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '857d9950e6fb4b2d88e69bd5a3a1764b', 'request_id': 'req-73705bae-4ffd-4790-89a0-74d6a014eb4a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:48.396576 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73705bae-4ffd-4790-89a0-74d6a014eb4a admin admin] The token cache is being invalidate because project 857d9950e6fb4b2d88e69bd5a3a1764b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:15:48.396972 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73705bae-4ffd-4790-89a0-74d6a014eb4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:48.398731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73705bae-4ffd-4790-89a0-74d6a014eb4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:48.400800 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1460/2900] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:15:48 2022] DELETE /identity/v3/projects/857d9950e6fb4b2d88e69bd5a3a1764b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:48.404720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92d980-ca68-48af-a347-5ac1cbda1ff6 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:48.420148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92d980-ca68-48af-a347-5ac1cbda1ff6 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:48.522695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613543e-485a-45d0-8554-33eddc94c1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:48.523358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613543e-485a-45d0-8554-33eddc94c1c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:48.523646 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613543e-485a-45d0-8554-33eddc94c1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:48.523953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613543e-485a-45d0-8554-33eddc94c1c2 admin admin] PATH_INFO: `/v3/users/0000ca500ed648b79c0e00a3ae9db120` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:48.525259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613543e-485a-45d0-8554-33eddc94c1c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0000ca500ed648b79c0e00a3ae9db120)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:48.527220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613543e-485a-45d0-8554-33eddc94c1c2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:48.595850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0613543e-485a-45d0-8554-33eddc94c1c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0000ca500ed648b79c0e00a3ae9db120'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:48.606365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0613543e-485a-45d0-8554-33eddc94c1c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0000ca500ed648b79c0e00a3ae9db120'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:48.621979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0613543e-485a-45d0-8554-33eddc94c1c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0000ca500ed648b79c0e00a3ae9db120'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:48.622833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0613543e-485a-45d0-8554-33eddc94c1c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0000ca500ed648b79c0e00a3ae9db120'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:48.634154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0613543e-485a-45d0-8554-33eddc94c1c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0000ca500ed648b79c0e00a3ae9db120'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:48.643299 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1441/2901] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:15:48 2022] DELETE /identity/v3/users/0000ca500ed648b79c0e00a3ae9db120 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:49.289146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806be8ce-460a-420a-b797-6311c739d550 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:49.290316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806be8ce-460a-420a-b797-6311c739d550 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:49.290777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806be8ce-460a-420a-b797-6311c739d550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:49.316601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-806be8ce-460a-420a-b797-6311c739d550 None None] MFA Rules not processed for user `32fc1959d8aa41eabcead217b9d7bc47`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:49.319310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-806be8ce-460a-420a-b797-6311c739d550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:49.376880 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613543e-485a-45d0-8554-33eddc94c1c2 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:49.386314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0613543e-485a-45d0-8554-33eddc94c1c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:49.469996 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1461/2902] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:49.526332 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:49.576966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613543e-485a-45d0-8554-33eddc94c1c2 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:49.583878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cce50-1992-477a-9f80-50c1725cee14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:49.584694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cce50-1992-477a-9f80-50c1725cee14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:49.585071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cce50-1992-477a-9f80-50c1725cee14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:49.585440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cce50-1992-477a-9f80-50c1725cee14 admin admin] PATH_INFO: `/v3/projects/bfe98a2f33794cbeac55e1ed64947157` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:49.587712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02cce50-1992-477a-9f80-50c1725cee14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfe98a2f33794cbeac55e1ed64947157)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:49.589791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02cce50-1992-477a-9f80-50c1725cee14 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:49.734849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d02cce50-1992-477a-9f80-50c1725cee14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfe98a2f33794cbeac55e1ed64947157', 'request_id': 'req-d02cce50-1992-477a-9f80-50c1725cee14'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:49.747185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d02cce50-1992-477a-9f80-50c1725cee14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfe98a2f33794cbeac55e1ed64947157', 'request_id': 'req-d02cce50-1992-477a-9f80-50c1725cee14'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:49.767057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d02cce50-1992-477a-9f80-50c1725cee14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfe98a2f33794cbeac55e1ed64947157', 'request_id': 'req-d02cce50-1992-477a-9f80-50c1725cee14'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:49.803643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d02cce50-1992-477a-9f80-50c1725cee14 admin admin] The token cache is being invalidate because project bfe98a2f33794cbeac55e1ed64947157 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:15:49.803990 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d02cce50-1992-477a-9f80-50c1725cee14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:49.806158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d02cce50-1992-477a-9f80-50c1725cee14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:15:49.812574 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1442/2903] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:15:49 2022] DELETE /identity/v3/projects/bfe98a2f33794cbeac55e1ed64947157 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:15:49.817728 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32b3ba-43aa-4eba-9b5c-4b7dc6d60283 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:49.817997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32b3ba-43aa-4eba-9b5c-4b7dc6d60283 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:49.818382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32b3ba-43aa-4eba-9b5c-4b7dc6d60283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:49.855778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-cb32b3ba-43aa-4eba-9b5c-4b7dc6d60283 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:49.857475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-cb32b3ba-43aa-4eba-9b5c-4b7dc6d60283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:49.959507 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1462/2904] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:49.969723 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c97927-6057-4314-acac-f24cfddb9c2b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:49.970014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c97927-6057-4314-acac-f24cfddb9c2b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:49.973500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c97927-6057-4314-acac-f24cfddb9c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:50.010981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c5c97927-6057-4314-acac-f24cfddb9c2b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:50.012726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c5c97927-6057-4314-acac-f24cfddb9c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:50.023620 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1443/2905] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:15:50.027809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32b3ba-43aa-4eba-9b5c-4b7dc6d60283 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:50.041475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32b3ba-43aa-4eba-9b5c-4b7dc6d60283 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:50.048644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e5a48-27a4-403e-bb57-fc02b58ef4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:50.049382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e5a48-27a4-403e-bb57-fc02b58ef4dc admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:50.049781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e5a48-27a4-403e-bb57-fc02b58ef4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:50.050317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e5a48-27a4-403e-bb57-fc02b58ef4dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:50.052920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e5a48-27a4-403e-bb57-fc02b58ef4dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:15:50.053395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e5a48-27a4-403e-bb57-fc02b58ef4dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:50.055764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e5a48-27a4-403e-bb57-fc02b58ef4dc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:50.097289 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1463/2906] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:15:50.102143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c97927-6057-4314-acac-f24cfddb9c2b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:50.123171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c97927-6057-4314-acac-f24cfddb9c2b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:50.140999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61634073-e5c7-46b8-a8da-f05d614d5b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:50.141253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61634073-e5c7-46b8-a8da-f05d614d5b17 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:50.141414 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61634073-e5c7-46b8-a8da-f05d614d5b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:50.142089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61634073-e5c7-46b8-a8da-f05d614d5b17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:50.142952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61634073-e5c7-46b8-a8da-f05d614d5b17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:50.152191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61634073-e5c7-46b8-a8da-f05d614d5b17 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:50.216259 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1444/2907] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:15:50 2022] POST /identity/v3/projects => generated 395 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:15:50.220573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e5a48-27a4-403e-bb57-fc02b58ef4dc admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:50.240597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e5a48-27a4-403e-bb57-fc02b58ef4dc admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:50.263983 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:50.404405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899b180-978b-4f62-b9f8-71b0b5289cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:50.407137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899b180-978b-4f62-b9f8-71b0b5289cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:50.407637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899b180-978b-4f62-b9f8-71b0b5289cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:50.409656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899b180-978b-4f62-b9f8-71b0b5289cd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:50.411015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899b180-978b-4f62-b9f8-71b0b5289cd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:50.415641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899b180-978b-4f62-b9f8-71b0b5289cd5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:50.465144 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1464/2908] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:15:50 2022] POST /identity/v3/users => generated 298 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:15:50.469137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61634073-e5c7-46b8-a8da-f05d614d5b17 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:50.488874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61634073-e5c7-46b8-a8da-f05d614d5b17 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:50.511425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490be6d7-cdb1-43ef-a00d-003921acac18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:50.512740 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490be6d7-cdb1-43ef-a00d-003921acac18 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:50.513399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490be6d7-cdb1-43ef-a00d-003921acac18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:50.513894 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490be6d7-cdb1-43ef-a00d-003921acac18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:50.514790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490be6d7-cdb1-43ef-a00d-003921acac18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:50.519132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490be6d7-cdb1-43ef-a00d-003921acac18 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:50.545645 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1445/2909] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:15:50.549760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899b180-978b-4f62-b9f8-71b0b5289cd5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:50.560750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899b180-978b-4f62-b9f8-71b0b5289cd5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:50.567662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6e21e-bb2a-46d8-82c9-5f19d618215c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:50.568504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6e21e-bb2a-46d8-82c9-5f19d618215c admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:50.569094 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6e21e-bb2a-46d8-82c9-5f19d618215c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:50.569531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6e21e-bb2a-46d8-82c9-5f19d618215c admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:50.570337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6e21e-bb2a-46d8-82c9-5f19d618215c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:50.572783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6e21e-bb2a-46d8-82c9-5f19d618215c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:50.586224 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1465/2910] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:15:50.590919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490be6d7-cdb1-43ef-a00d-003921acac18 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:50.604493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490be6d7-cdb1-43ef-a00d-003921acac18 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:50.610644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bc6d3-b729-4c76-920e-c6a5741370e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:50.611764 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bc6d3-b729-4c76-920e-c6a5741370e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:50.612355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bc6d3-b729-4c76-920e-c6a5741370e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:50.612858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bc6d3-b729-4c76-920e-c6a5741370e1 admin admin] PATH_INFO: `/v3/projects/1371b7aebfcf4088a02780393de8200f/users/45ed48709ab84fa4b5b341332a843ad8/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:50.653747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577bc6d3-b729-4c76-920e-c6a5741370e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1371b7aebfcf4088a02780393de8200f, user_id=45ed48709ab84fa4b5b341332a843ad8, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:50.659671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577bc6d3-b729-4c76-920e-c6a5741370e1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:50.704291 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1446/2911] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:15:50 2022] PUT /identity/v3/projects/1371b7aebfcf4088a02780393de8200f/users/45ed48709ab84fa4b5b341332a843ad8/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:15:50.710107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fd8f7-eb1c-4512-ab06-d707a96a9af5 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:50.710471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fd8f7-eb1c-4512-ab06-d707a96a9af5 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:50.710677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fd8f7-eb1c-4512-ab06-d707a96a9af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:50.760729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-460fd8f7-eb1c-4512-ab06-d707a96a9af5 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:50.770017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-460fd8f7-eb1c-4512-ab06-d707a96a9af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:50.884184 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1466/2912] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:15:50.982727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bc6d3-b729-4c76-920e-c6a5741370e1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:15:50.986258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-577bc6d3-b729-4c76-920e-c6a5741370e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:51.089477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bc6d3-b729-4c76-920e-c6a5741370e1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:15:51.093899 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01cc216-7d6d-4bf5-8842-a7ecbffaf694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:15:51.094673 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cc216-7d6d-4bf5-8842-a7ecbffaf694 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:51.095050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cc216-7d6d-4bf5-8842-a7ecbffaf694 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:51.095419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cc216-7d6d-4bf5-8842-a7ecbffaf694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:51.107735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01cc216-7d6d-4bf5-8842-a7ecbffaf694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:15:51.109616 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01cc216-7d6d-4bf5-8842-a7ecbffaf694 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:15:51.114511 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:15:51.125830 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1447/2913] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:15:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:15:56.583033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3536028-f6b3-4dee-aac6-0daef3dde4fa None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:15:56.583759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3536028-f6b3-4dee-aac6-0daef3dde4fa None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:15:56.584036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3536028-f6b3-4dee-aac6-0daef3dde4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:15:56.632005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d3536028-f6b3-4dee-aac6-0daef3dde4fa None None] MFA Rules not processed for user `0327f14a188e45fba98a58e5fd061248`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:15:56.635149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d3536028-f6b3-4dee-aac6-0daef3dde4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:15:56.805999 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1467/2914] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:15:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:16:01.130057 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:02.639807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01cc216-7d6d-4bf5-8842-a7ecbffaf694 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:02.642919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e01cc216-7d6d-4bf5-8842-a7ecbffaf694 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:02.667317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01cc216-7d6d-4bf5-8842-a7ecbffaf694 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:02.695055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09098e6b-ab7f-479b-8937-6a1c120e49b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:02.721027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09098e6b-ab7f-479b-8937-6a1c120e49b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:02.730103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09098e6b-ab7f-479b-8937-6a1c120e49b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:02.730602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09098e6b-ab7f-479b-8937-6a1c120e49b8 admin admin] PATH_INFO: `/v3/users/ae4f4a7231e4431c89712c557c4fa1df` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:02.738151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09098e6b-ab7f-479b-8937-6a1c120e49b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae4f4a7231e4431c89712c557c4fa1df)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:02.760841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09098e6b-ab7f-479b-8937-6a1c120e49b8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:02.875370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-09098e6b-ab7f-479b-8937-6a1c120e49b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae4f4a7231e4431c89712c557c4fa1df'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:02.893847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-09098e6b-ab7f-479b-8937-6a1c120e49b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae4f4a7231e4431c89712c557c4fa1df'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:02.944903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-09098e6b-ab7f-479b-8937-6a1c120e49b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae4f4a7231e4431c89712c557c4fa1df'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:02.947456 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-09098e6b-ab7f-479b-8937-6a1c120e49b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae4f4a7231e4431c89712c557c4fa1df'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:02.972052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-09098e6b-ab7f-479b-8937-6a1c120e49b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae4f4a7231e4431c89712c557c4fa1df'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:03.006325 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1448/2915] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:16:02 2022] DELETE /identity/v3/users/ae4f4a7231e4431c89712c557c4fa1df => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:16:03.338440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3536028-f6b3-4dee-aac6-0daef3dde4fa None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:03.372052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3536028-f6b3-4dee-aac6-0daef3dde4fa None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:03.482633 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:03.527549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59aaa3-882b-4718-ba45-997a2261c2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:03.529050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59aaa3-882b-4718-ba45-997a2261c2cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:03.530520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59aaa3-882b-4718-ba45-997a2261c2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:03.533615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59aaa3-882b-4718-ba45-997a2261c2cb admin admin] PATH_INFO: `/v3/projects/45ac882e61ac45eb9abc60630e7337c3` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:03.536148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59aaa3-882b-4718-ba45-997a2261c2cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=45ac882e61ac45eb9abc60630e7337c3)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:03.540068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59aaa3-882b-4718-ba45-997a2261c2cb admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:03.661504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7d59aaa3-882b-4718-ba45-997a2261c2cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45ac882e61ac45eb9abc60630e7337c3', 'request_id': 'req-7d59aaa3-882b-4718-ba45-997a2261c2cb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:03.684640 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7d59aaa3-882b-4718-ba45-997a2261c2cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45ac882e61ac45eb9abc60630e7337c3', 'request_id': 'req-7d59aaa3-882b-4718-ba45-997a2261c2cb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:03.702697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7d59aaa3-882b-4718-ba45-997a2261c2cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45ac882e61ac45eb9abc60630e7337c3', 'request_id': 'req-7d59aaa3-882b-4718-ba45-997a2261c2cb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:03.734670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7d59aaa3-882b-4718-ba45-997a2261c2cb admin admin] The token cache is being invalidate because project 45ac882e61ac45eb9abc60630e7337c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:16:03.735207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7d59aaa3-882b-4718-ba45-997a2261c2cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:03.736316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7d59aaa3-882b-4718-ba45-997a2261c2cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:03.739303 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1468/2916] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:16:03 2022] DELETE /identity/v3/projects/45ac882e61ac45eb9abc60630e7337c3 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:16:03.745940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ac1e7-7fb9-4f20-a5db-5651c27bb8e8 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:03.746650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ac1e7-7fb9-4f20-a5db-5651c27bb8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:03.746650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ac1e7-7fb9-4f20-a5db-5651c27bb8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:03.780151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c46ac1e7-7fb9-4f20-a5db-5651c27bb8e8 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:03.781452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c46ac1e7-7fb9-4f20-a5db-5651c27bb8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:03.908319 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1449/2917] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:16:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:16:03.917709 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4fafb-f18e-4156-9513-f1bcdbfa7367 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:03.918439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4fafb-f18e-4156-9513-f1bcdbfa7367 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:03.918733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4fafb-f18e-4156-9513-f1bcdbfa7367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:03.949719 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-4ae4fafb-f18e-4156-9513-f1bcdbfa7367 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:03.953741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4ae4fafb-f18e-4156-9513-f1bcdbfa7367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:03.974710 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1469/2918] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:16:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:03.988701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ac1e7-7fb9-4f20-a5db-5651c27bb8e8 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:04.006554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ac1e7-7fb9-4f20-a5db-5651c27bb8e8 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:04.038851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5bde07-f5d9-4be0-a9cf-1ef6ac476129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:04.040116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bde07-f5d9-4be0-a9cf-1ef6ac476129 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:04.040857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bde07-f5d9-4be0-a9cf-1ef6ac476129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:04.041654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bde07-f5d9-4be0-a9cf-1ef6ac476129 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:04.043369 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5bde07-f5d9-4be0-a9cf-1ef6ac476129 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:16:04.044120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5bde07-f5d9-4be0-a9cf-1ef6ac476129 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:04.047512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5bde07-f5d9-4be0-a9cf-1ef6ac476129 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:04.102746 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1450/2919] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:16:04.103468 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4fafb-f18e-4156-9513-f1bcdbfa7367 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:04.116520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4fafb-f18e-4156-9513-f1bcdbfa7367 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:04.127560 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f00438-65cd-4563-802c-a3744cd02cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:04.128244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f00438-65cd-4563-802c-a3744cd02cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:04.128551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f00438-65cd-4563-802c-a3744cd02cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:04.129360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f00438-65cd-4563-802c-a3744cd02cb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:04.130203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f00438-65cd-4563-802c-a3744cd02cb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:04.137603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f00438-65cd-4563-802c-a3744cd02cb4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:04.210034 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1470/2920] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:16:04 2022] POST /identity/v3/projects => generated 397 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:16:04.215706 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5bde07-f5d9-4be0-a9cf-1ef6ac476129 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:04.233388 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5bde07-f5d9-4be0-a9cf-1ef6ac476129 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:04.368200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b8ddb-82ce-4db7-ada0-00394e2370a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:04.373854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b8ddb-82ce-4db7-ada0-00394e2370a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:04.374486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b8ddb-82ce-4db7-ada0-00394e2370a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:04.374959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b8ddb-82ce-4db7-ada0-00394e2370a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:04.378078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b8ddb-82ce-4db7-ada0-00394e2370a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:04.381372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b8ddb-82ce-4db7-ada0-00394e2370a5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:04.393668 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:04.421304 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1451/2921] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:16:04 2022] POST /identity/v3/users => generated 299 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:16:04.424813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f00438-65cd-4563-802c-a3744cd02cb4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:04.447345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f00438-65cd-4563-802c-a3744cd02cb4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:04.468003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb4984-6a0b-4e64-89f9-905ded54ee5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:04.473498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb4984-6a0b-4e64-89f9-905ded54ee5d admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:04.474311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb4984-6a0b-4e64-89f9-905ded54ee5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:04.475134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb4984-6a0b-4e64-89f9-905ded54ee5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:04.476744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb4984-6a0b-4e64-89f9-905ded54ee5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:04.480072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eb4984-6a0b-4e64-89f9-905ded54ee5d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:04.515641 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1471/2922] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:16:04.519557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b8ddb-82ce-4db7-ada0-00394e2370a5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:04.538917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b8ddb-82ce-4db7-ada0-00394e2370a5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:04.546583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1ba5c-33a7-47b0-a260-800d8431580a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:04.546583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1ba5c-33a7-47b0-a260-800d8431580a admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:04.547136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1ba5c-33a7-47b0-a260-800d8431580a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:04.547433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1ba5c-33a7-47b0-a260-800d8431580a admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:04.548312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1ba5c-33a7-47b0-a260-800d8431580a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:04.551342 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1ba5c-33a7-47b0-a260-800d8431580a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:04.568262 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1452/2923] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:16:04.573071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb4984-6a0b-4e64-89f9-905ded54ee5d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:04.597858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb4984-6a0b-4e64-89f9-905ded54ee5d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:04.604398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb41696-8722-4a84-9a8b-7e45e5e1644a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:04.605646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb41696-8722-4a84-9a8b-7e45e5e1644a admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:04.606461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb41696-8722-4a84-9a8b-7e45e5e1644a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:04.606943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb41696-8722-4a84-9a8b-7e45e5e1644a admin admin] PATH_INFO: `/v3/projects/65b47199573142cfabb119e111b69c9d/users/0af4775c28774015bc168bbcfc9b784d/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:04.635039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb41696-8722-4a84-9a8b-7e45e5e1644a admin admin] RBAC: Authorizing `identity:create_grant(project_id=65b47199573142cfabb119e111b69c9d, user_id=0af4775c28774015bc168bbcfc9b784d, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:04.638256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb41696-8722-4a84-9a8b-7e45e5e1644a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:04.666090 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1472/2924] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:16:04 2022] PUT /identity/v3/projects/65b47199573142cfabb119e111b69c9d/users/0af4775c28774015bc168bbcfc9b784d/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:16:04.672228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57936327-cd87-4bc5-8d79-a8994abb2efc None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:04.673268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57936327-cd87-4bc5-8d79-a8994abb2efc None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:04.673268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57936327-cd87-4bc5-8d79-a8994abb2efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:04.702807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-57936327-cd87-4bc5-8d79-a8994abb2efc None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:04.705849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-57936327-cd87-4bc5-8d79-a8994abb2efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:04.870209 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1453/2925] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:04.902239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb41696-8722-4a84-9a8b-7e45e5e1644a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:04.907276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4eb41696-8722-4a84-9a8b-7e45e5e1644a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:05.057246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb41696-8722-4a84-9a8b-7e45e5e1644a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:05.068568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134f7ee-576a-46df-a955-96cdf08b6b94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:05.069981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134f7ee-576a-46df-a955-96cdf08b6b94 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:05.070772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134f7ee-576a-46df-a955-96cdf08b6b94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:05.071537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134f7ee-576a-46df-a955-96cdf08b6b94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:05.099007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134f7ee-576a-46df-a955-96cdf08b6b94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:05.101924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134f7ee-576a-46df-a955-96cdf08b6b94 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:05.126205 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1473/2926] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:16:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:16:14.856386 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:INSERT=3,keystone:SELECT=34 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:15.114140 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:15.891010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb63251-a56c-45a1-8505-d6fbea2b670f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:15.891010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb63251-a56c-45a1-8505-d6fbea2b670f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:15.897408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb63251-a56c-45a1-8505-d6fbea2b670f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:15.962373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3eb63251-a56c-45a1-8505-d6fbea2b670f None None] MFA Rules not processed for user `b945db9a6f7a4143a544b76be5e9af9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:15.965247 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3eb63251-a56c-45a1-8505-d6fbea2b670f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:16.133986 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1454/2927] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:16:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:20.708782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134f7ee-576a-46df-a955-96cdf08b6b94 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:20.710870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5134f7ee-576a-46df-a955-96cdf08b6b94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:20.742877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134f7ee-576a-46df-a955-96cdf08b6b94 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:20.767549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d03a22-6c51-4032-b28c-7805731de320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:20.769114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d03a22-6c51-4032-b28c-7805731de320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:20.769114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d03a22-6c51-4032-b28c-7805731de320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:20.770961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d03a22-6c51-4032-b28c-7805731de320 admin admin] PATH_INFO: `/v3/users/6b504ab8d5dc4e2aa169b47ef24b3752` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:20.773731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d03a22-6c51-4032-b28c-7805731de320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b504ab8d5dc4e2aa169b47ef24b3752)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:20.777413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d03a22-6c51-4032-b28c-7805731de320 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:20.924291 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-99d03a22-6c51-4032-b28c-7805731de320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b504ab8d5dc4e2aa169b47ef24b3752'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:20.946369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-99d03a22-6c51-4032-b28c-7805731de320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b504ab8d5dc4e2aa169b47ef24b3752'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:20.981777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-99d03a22-6c51-4032-b28c-7805731de320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b504ab8d5dc4e2aa169b47ef24b3752'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:20.983186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-99d03a22-6c51-4032-b28c-7805731de320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b504ab8d5dc4e2aa169b47ef24b3752'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:21.011689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-99d03a22-6c51-4032-b28c-7805731de320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b504ab8d5dc4e2aa169b47ef24b3752'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:21.016169 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1474/2928] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:16:20 2022] DELETE /identity/v3/users/6b504ab8d5dc4e2aa169b47ef24b3752 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:16:21.781939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb63251-a56c-45a1-8505-d6fbea2b670f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:21.812217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb63251-a56c-45a1-8505-d6fbea2b670f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:22.038156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfe1a1-b5a9-41e1-86dc-6cdca4a19fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:22.039211 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfe1a1-b5a9-41e1-86dc-6cdca4a19fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:22.039676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfe1a1-b5a9-41e1-86dc-6cdca4a19fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:22.040176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfe1a1-b5a9-41e1-86dc-6cdca4a19fbf admin admin] PATH_INFO: `/v3/projects/d52b2f7281344decbddc23df77af996d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:22.042467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfe1a1-b5a9-41e1-86dc-6cdca4a19fbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d52b2f7281344decbddc23df77af996d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:22.046908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfe1a1-b5a9-41e1-86dc-6cdca4a19fbf admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:22.254069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9ebfe1a1-b5a9-41e1-86dc-6cdca4a19fbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd52b2f7281344decbddc23df77af996d', 'request_id': 'req-9ebfe1a1-b5a9-41e1-86dc-6cdca4a19fbf'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:22.272718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9ebfe1a1-b5a9-41e1-86dc-6cdca4a19fbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd52b2f7281344decbddc23df77af996d', 'request_id': 'req-9ebfe1a1-b5a9-41e1-86dc-6cdca4a19fbf'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:22.286089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9ebfe1a1-b5a9-41e1-86dc-6cdca4a19fbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd52b2f7281344decbddc23df77af996d', 'request_id': 'req-9ebfe1a1-b5a9-41e1-86dc-6cdca4a19fbf'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:22.324009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9ebfe1a1-b5a9-41e1-86dc-6cdca4a19fbf admin admin] The token cache is being invalidate because project d52b2f7281344decbddc23df77af996d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:16:22.330980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9ebfe1a1-b5a9-41e1-86dc-6cdca4a19fbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:22.330980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9ebfe1a1-b5a9-41e1-86dc-6cdca4a19fbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:22.339970 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1455/2929] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:16:21 2022] DELETE /identity/v3/projects/d52b2f7281344decbddc23df77af996d => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:16:22.347832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211be7ef-346f-49c4-b9d7-a9f0146cce8f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:22.349562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211be7ef-346f-49c4-b9d7-a9f0146cce8f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:22.350292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211be7ef-346f-49c4-b9d7-a9f0146cce8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:22.406905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-211be7ef-346f-49c4-b9d7-a9f0146cce8f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:22.408326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-211be7ef-346f-49c4-b9d7-a9f0146cce8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:22.624799 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1475/2930] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:22.643025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98004f2b-52ab-40eb-8c45-96e8165ee56d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:22.644231 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98004f2b-52ab-40eb-8c45-96e8165ee56d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:22.644231 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98004f2b-52ab-40eb-8c45-96e8165ee56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:22.704825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-98004f2b-52ab-40eb-8c45-96e8165ee56d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:22.708685 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-98004f2b-52ab-40eb-8c45-96e8165ee56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:22.736763 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1456/2931] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:22.739324 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211be7ef-346f-49c4-b9d7-a9f0146cce8f None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:22.763672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211be7ef-346f-49c4-b9d7-a9f0146cce8f None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:22.774048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dddaac-ef69-40af-99cb-0f2b2af7898b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:22.774810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dddaac-ef69-40af-99cb-0f2b2af7898b admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:22.775103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dddaac-ef69-40af-99cb-0f2b2af7898b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:22.775377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dddaac-ef69-40af-99cb-0f2b2af7898b admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:22.776214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dddaac-ef69-40af-99cb-0f2b2af7898b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:16:22.776523 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dddaac-ef69-40af-99cb-0f2b2af7898b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:22.778573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dddaac-ef69-40af-99cb-0f2b2af7898b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:22.802631 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1476/2932] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:16:22.807769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98004f2b-52ab-40eb-8c45-96e8165ee56d None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:22.823433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98004f2b-52ab-40eb-8c45-96e8165ee56d None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:22.833339 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58317cb4-9628-4fcb-b2e6-9488ab9f6b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:22.834592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58317cb4-9628-4fcb-b2e6-9488ab9f6b2e admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:22.834592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58317cb4-9628-4fcb-b2e6-9488ab9f6b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:22.834960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58317cb4-9628-4fcb-b2e6-9488ab9f6b2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:22.836775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58317cb4-9628-4fcb-b2e6-9488ab9f6b2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:22.840303 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58317cb4-9628-4fcb-b2e6-9488ab9f6b2e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:22.889404 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1457/2933] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:16:22 2022] POST /identity/v3/projects => generated 385 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:16:22.896290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dddaac-ef69-40af-99cb-0f2b2af7898b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:22.946832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dddaac-ef69-40af-99cb-0f2b2af7898b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:23.102716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4d255-ee5c-4dca-b3f3-65c039f682f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:23.104288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4d255-ee5c-4dca-b3f3-65c039f682f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:23.104963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4d255-ee5c-4dca-b3f3-65c039f682f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:23.105818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4d255-ee5c-4dca-b3f3-65c039f682f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:23.107294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a4d255-ee5c-4dca-b3f3-65c039f682f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:23.112004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a4d255-ee5c-4dca-b3f3-65c039f682f1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:23.132082 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:23.170121 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1477/2934] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:16:22 2022] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:16:23.176735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58317cb4-9628-4fcb-b2e6-9488ab9f6b2e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:23.202255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58317cb4-9628-4fcb-b2e6-9488ab9f6b2e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:23.211527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2de72-6ee1-4a23-85cd-d88f8e4ca683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:23.212618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2de72-6ee1-4a23-85cd-d88f8e4ca683 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:23.213101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2de72-6ee1-4a23-85cd-d88f8e4ca683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:23.213583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2de72-6ee1-4a23-85cd-d88f8e4ca683 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:23.215023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2de72-6ee1-4a23-85cd-d88f8e4ca683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:23.218190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2de72-6ee1-4a23-85cd-d88f8e4ca683 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:23.221572 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:23.246641 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1458/2935] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:16:23.248942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4d255-ee5c-4dca-b3f3-65c039f682f1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:23.285375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4d255-ee5c-4dca-b3f3-65c039f682f1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:23.308026 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b658ac-2257-4178-adcb-e2fb55894d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:23.315204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b658ac-2257-4178-adcb-e2fb55894d4c admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:23.315916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b658ac-2257-4178-adcb-e2fb55894d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:23.317252 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b658ac-2257-4178-adcb-e2fb55894d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:23.324638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b658ac-2257-4178-adcb-e2fb55894d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:23.327054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b658ac-2257-4178-adcb-e2fb55894d4c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:23.392542 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1478/2936] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:16:23.398591 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2de72-6ee1-4a23-85cd-d88f8e4ca683 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:23.399119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b658ac-2257-4178-adcb-e2fb55894d4c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:23.406797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-def2de72-6ee1-4a23-85cd-d88f8e4ca683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:23.431285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2de72-6ee1-4a23-85cd-d88f8e4ca683 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:23.436678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afeb2b-501a-4d15-8da5-451375dc219a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:23.437332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afeb2b-501a-4d15-8da5-451375dc219a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:23.437914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afeb2b-501a-4d15-8da5-451375dc219a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:23.438192 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afeb2b-501a-4d15-8da5-451375dc219a admin admin] PATH_INFO: `/v3/users/26994bfd2e094415bb9b6e265d52eeae` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:23.440124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24afeb2b-501a-4d15-8da5-451375dc219a admin admin] RBAC: Authorizing `identity:delete_user(user_id=26994bfd2e094415bb9b6e265d52eeae)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:23.442360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24afeb2b-501a-4d15-8da5-451375dc219a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:23.444074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b658ac-2257-4178-adcb-e2fb55894d4c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:23.456700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb2bc4-8681-494c-be37-0a7fd2f9aa31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:23.458449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb2bc4-8681-494c-be37-0a7fd2f9aa31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:23.458811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb2bc4-8681-494c-be37-0a7fd2f9aa31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:23.459308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb2bc4-8681-494c-be37-0a7fd2f9aa31 admin admin] PATH_INFO: `/v3/projects/614797cd26be4995b087ab864f35d235/users/786962988b754fb69bd48070c2992e13/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:23.478335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb2bc4-8681-494c-be37-0a7fd2f9aa31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=614797cd26be4995b087ab864f35d235, user_id=786962988b754fb69bd48070c2992e13, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:23.481907 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb2bc4-8681-494c-be37-0a7fd2f9aa31 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:23.502318 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1479/2937] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:16:23 2022] PUT /identity/v3/projects/614797cd26be4995b087ab864f35d235/users/786962988b754fb69bd48070c2992e13/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:16:23.522296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e2d95-b4d1-404e-b27f-4cbdbd86d115 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:23.522739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e2d95-b4d1-404e-b27f-4cbdbd86d115 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:23.523092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e2d95-b4d1-404e-b27f-4cbdbd86d115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:23.576159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-24afeb2b-501a-4d15-8da5-451375dc219a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26994bfd2e094415bb9b6e265d52eeae'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:23.595120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-534e2d95-b4d1-404e-b27f-4cbdbd86d115 None None] MFA Rules not processed for user `786962988b754fb69bd48070c2992e13`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:23.596604 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-534e2d95-b4d1-404e-b27f-4cbdbd86d115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:23.606773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-24afeb2b-501a-4d15-8da5-451375dc219a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26994bfd2e094415bb9b6e265d52eeae'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:23.627824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-24afeb2b-501a-4d15-8da5-451375dc219a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26994bfd2e094415bb9b6e265d52eeae'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:23.629803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-24afeb2b-501a-4d15-8da5-451375dc219a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26994bfd2e094415bb9b6e265d52eeae'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:23.644036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-24afeb2b-501a-4d15-8da5-451375dc219a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26994bfd2e094415bb9b6e265d52eeae'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:23.686372 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1459/2938] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:16:23 2022] DELETE /identity/v3/users/26994bfd2e094415bb9b6e265d52eeae => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:16:23.699673 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72867347-0d08-42b5-8eff-723d25f19f1c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:23.700289 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72867347-0d08-42b5-8eff-723d25f19f1c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:23.700743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72867347-0d08-42b5-8eff-723d25f19f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:23.738294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-72867347-0d08-42b5-8eff-723d25f19f1c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:23.739698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-72867347-0d08-42b5-8eff-723d25f19f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:23.764182 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1480/2939] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:16:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:16:23.781371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e2d95-b4d1-404e-b27f-4cbdbd86d115 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:23.783038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-534e2d95-b4d1-404e-b27f-4cbdbd86d115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:23.888915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e2d95-b4d1-404e-b27f-4cbdbd86d115 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:23.968996 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1460/2940] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:16:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:16:23.983318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72867347-0d08-42b5-8eff-723d25f19f1c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:23.985454 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-72867347-0d08-42b5-8eff-723d25f19f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:23.991101 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d32d8-433f-4517-9d1e-60484d157f02 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:23.991811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d32d8-433f-4517-9d1e-60484d157f02 service glance] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:23.994485 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d32d8-433f-4517-9d1e-60484d157f02 service glance] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:23.994826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d32d8-433f-4517-9d1e-60484d157f02 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:24.031420 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:24.132064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d32d8-433f-4517-9d1e-60484d157f02 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:24.135364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72867347-0d08-42b5-8eff-723d25f19f1c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:24.136392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d32d8-433f-4517-9d1e-60484d157f02 service glance] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:24.152724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f605b0b-eb02-44c5-845b-9c7b45f568b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:24.153925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f605b0b-eb02-44c5-845b-9c7b45f568b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:24.154558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f605b0b-eb02-44c5-845b-9c7b45f568b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:24.155159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f605b0b-eb02-44c5-845b-9c7b45f568b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:24.180842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f605b0b-eb02-44c5-845b-9c7b45f568b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:24.184308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f605b0b-eb02-44c5-845b-9c7b45f568b7 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:24.203368 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1481/2941] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:16:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:16:24.208760 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1461/2942] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:16:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:16:24.532343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda0691-96d6-44fc-88f2-036db2f5fa36 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:24.533106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda0691-96d6-44fc-88f2-036db2f5fa36 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:24.533428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda0691-96d6-44fc-88f2-036db2f5fa36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:24.679329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-cbda0691-96d6-44fc-88f2-036db2f5fa36 None None] MFA Rules not processed for user `45ed48709ab84fa4b5b341332a843ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:24.681534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-cbda0691-96d6-44fc-88f2-036db2f5fa36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:24.936991 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1482/2943] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:16:24 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:24.938947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f605b0b-eb02-44c5-845b-9c7b45f568b7 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:24.942297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8f605b0b-eb02-44c5-845b-9c7b45f568b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:25.011682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f605b0b-eb02-44c5-845b-9c7b45f568b7 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:25.031507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15be2c3-f70b-4adf-a256-6fa5405a4ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:25.032346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15be2c3-f70b-4adf-a256-6fa5405a4ede admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:25.033010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15be2c3-f70b-4adf-a256-6fa5405a4ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:25.033654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15be2c3-f70b-4adf-a256-6fa5405a4ede admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:25.035553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15be2c3-f70b-4adf-a256-6fa5405a4ede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:25.043914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15be2c3-f70b-4adf-a256-6fa5405a4ede admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:25.088822 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:25.160665 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1462/2944] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:16:24 2022] POST /identity/v3/projects => generated 397 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:16:25.162776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda0691-96d6-44fc-88f2-036db2f5fa36 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:25.199921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda0691-96d6-44fc-88f2-036db2f5fa36 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:25.382883 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5209e3-f959-4fea-a830-0caf5b59fe0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:25.384612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5209e3-f959-4fea-a830-0caf5b59fe0d admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:25.385743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5209e3-f959-4fea-a830-0caf5b59fe0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:25.386444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5209e3-f959-4fea-a830-0caf5b59fe0d admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:25.387634 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5209e3-f959-4fea-a830-0caf5b59fe0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:25.392235 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5209e3-f959-4fea-a830-0caf5b59fe0d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:25.455664 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1483/2945] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:16:25 2022] POST /identity/v3/users => generated 305 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:16:25.462111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15be2c3-f70b-4adf-a256-6fa5405a4ede admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:25.489810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15be2c3-f70b-4adf-a256-6fa5405a4ede admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:25.498146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc07585-d65d-40c1-9da3-a760a2948842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:25.500020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc07585-d65d-40c1-9da3-a760a2948842 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:25.500978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc07585-d65d-40c1-9da3-a760a2948842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:25.501560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc07585-d65d-40c1-9da3-a760a2948842 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:25.502874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc07585-d65d-40c1-9da3-a760a2948842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:25.505603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc07585-d65d-40c1-9da3-a760a2948842 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:25.534444 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1463/2946] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:16:25.541456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5209e3-f959-4fea-a830-0caf5b59fe0d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:25.575198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5209e3-f959-4fea-a830-0caf5b59fe0d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:25.589156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a8f73-2472-4392-92ff-40d869d4217d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:25.589742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a8f73-2472-4392-92ff-40d869d4217d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:25.591216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a8f73-2472-4392-92ff-40d869d4217d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:25.623074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795360e1-704a-4d1e-94c4-92d0aace4a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:25.634029 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795360e1-704a-4d1e-94c4-92d0aace4a65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:25.634809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795360e1-704a-4d1e-94c4-92d0aace4a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:25.643061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795360e1-704a-4d1e-94c4-92d0aace4a65 admin admin] PATH_INFO: `/v3/projects/eb2a52526fc445dabfacf2e025652e89/users/cd8929be3902460ea06f780dd43955d9/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:25.694335 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-531a8f73-2472-4392-92ff-40d869d4217d None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:25.695376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-531a8f73-2472-4392-92ff-40d869d4217d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:25.729578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795360e1-704a-4d1e-94c4-92d0aace4a65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb2a52526fc445dabfacf2e025652e89, user_id=cd8929be3902460ea06f780dd43955d9, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:25.761409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795360e1-704a-4d1e-94c4-92d0aace4a65 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:25.779789 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1464/2947] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:16:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:16:25.791278 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1484/2948] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:16:25 2022] PUT /identity/v3/projects/eb2a52526fc445dabfacf2e025652e89/users/cd8929be3902460ea06f780dd43955d9/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:16:25.795557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a8f73-2472-4392-92ff-40d869d4217d None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:25.833480 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a8f73-2472-4392-92ff-40d869d4217d None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:25.884410 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795360e1-704a-4d1e-94c4-92d0aace4a65 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:25.887528 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-795360e1-704a-4d1e-94c4-92d0aace4a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:25.945875 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:26.096454 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9653d-faea-4c58-b788-bfbae95d3291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:26.097828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9653d-faea-4c58-b788-bfbae95d3291 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:26.098602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9653d-faea-4c58-b788-bfbae95d3291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:26.099341 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9653d-faea-4c58-b788-bfbae95d3291 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:26.100873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9653d-faea-4c58-b788-bfbae95d3291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:26.107107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9653d-faea-4c58-b788-bfbae95d3291 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:26.156627 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1465/2949] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:16:26.161860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9653d-faea-4c58-b788-bfbae95d3291 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:26.209156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9653d-faea-4c58-b788-bfbae95d3291 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:26.210737 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795360e1-704a-4d1e-94c4-92d0aace4a65 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:26.224133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27263c2e-8482-4fe7-ae42-38d1410c69e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:26.225765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27263c2e-8482-4fe7-ae42-38d1410c69e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:26.226522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27263c2e-8482-4fe7-ae42-38d1410c69e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:26.227218 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27263c2e-8482-4fe7-ae42-38d1410c69e3 admin admin] PATH_INFO: `/v3/projects/eb2a52526fc445dabfacf2e025652e89/users/cd8929be3902460ea06f780dd43955d9/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:26.230041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81bdf4-3d0b-4a93-94c3-6ab8118e1a22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:26.231753 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27263c2e-8482-4fe7-ae42-38d1410c69e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb2a52526fc445dabfacf2e025652e89, user_id=cd8929be3902460ea06f780dd43955d9, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:26.232290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81bdf4-3d0b-4a93-94c3-6ab8118e1a22 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:26.232578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81bdf4-3d0b-4a93-94c3-6ab8118e1a22 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:26.232859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81bdf4-3d0b-4a93-94c3-6ab8118e1a22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:26.238677 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27263c2e-8482-4fe7-ae42-38d1410c69e3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:26.280994 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1466/2950] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:16:26 2022] PUT /identity/v3/projects/eb2a52526fc445dabfacf2e025652e89/users/cd8929be3902460ea06f780dd43955d9/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:16:26.283802 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27263c2e-8482-4fe7-ae42-38d1410c69e3 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:26.296915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-27263c2e-8482-4fe7-ae42-38d1410c69e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:26.411995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc81bdf4-3d0b-4a93-94c3-6ab8118e1a22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:26.416056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc81bdf4-3d0b-4a93-94c3-6ab8118e1a22 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:26.460276 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1485/2951] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:16:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:16:26.628394 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27263c2e-8482-4fe7-ae42-38d1410c69e3 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:26.649558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445f4b8-84d1-4d6f-ac38-11afd8c1f7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:26.654145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445f4b8-84d1-4d6f-ac38-11afd8c1f7a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:26.655999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445f4b8-84d1-4d6f-ac38-11afd8c1f7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:26.657154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445f4b8-84d1-4d6f-ac38-11afd8c1f7a7 admin admin] PATH_INFO: `/v3/projects/76537752718449e19d6ad94c8e3bc973` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:26.664606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445f4b8-84d1-4d6f-ac38-11afd8c1f7a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76537752718449e19d6ad94c8e3bc973)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:26.676964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445f4b8-84d1-4d6f-ac38-11afd8c1f7a7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:26.719669 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:26.919201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7445f4b8-84d1-4d6f-ac38-11afd8c1f7a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76537752718449e19d6ad94c8e3bc973', 'request_id': 'req-7445f4b8-84d1-4d6f-ac38-11afd8c1f7a7'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:26.936740 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7445f4b8-84d1-4d6f-ac38-11afd8c1f7a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76537752718449e19d6ad94c8e3bc973', 'request_id': 'req-7445f4b8-84d1-4d6f-ac38-11afd8c1f7a7'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:26.968450 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7445f4b8-84d1-4d6f-ac38-11afd8c1f7a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76537752718449e19d6ad94c8e3bc973', 'request_id': 'req-7445f4b8-84d1-4d6f-ac38-11afd8c1f7a7'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:27.013612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7445f4b8-84d1-4d6f-ac38-11afd8c1f7a7 admin admin] The token cache is being invalidate because project 76537752718449e19d6ad94c8e3bc973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:16:27.014134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7445f4b8-84d1-4d6f-ac38-11afd8c1f7a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:27.045627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7445f4b8-84d1-4d6f-ac38-11afd8c1f7a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:27.054602 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1467/2952] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:16:26 2022] DELETE /identity/v3/projects/76537752718449e19d6ad94c8e3bc973 => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:16:27.061126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81bdf4-3d0b-4a93-94c3-6ab8118e1a22 service swift] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:27.092408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81bdf4-3d0b-4a93-94c3-6ab8118e1a22 service swift] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:27.434173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bce9c2-ba37-4d9e-affe-3f22ccfafa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:27.435380 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bce9c2-ba37-4d9e-affe-3f22ccfafa29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:27.435840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bce9c2-ba37-4d9e-affe-3f22ccfafa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:27.436331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bce9c2-ba37-4d9e-affe-3f22ccfafa29 admin admin] PATH_INFO: `/v3/users/6cd45880a78e4ace93cfdc9223b75f73` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:27.443193 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bce9c2-ba37-4d9e-affe-3f22ccfafa29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cd45880a78e4ace93cfdc9223b75f73)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:27.453771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bce9c2-ba37-4d9e-affe-3f22ccfafa29 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:27.685834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-52bce9c2-ba37-4d9e-affe-3f22ccfafa29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cd45880a78e4ace93cfdc9223b75f73'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:27.711437 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:27.737480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-52bce9c2-ba37-4d9e-affe-3f22ccfafa29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cd45880a78e4ace93cfdc9223b75f73'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:27.846073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-52bce9c2-ba37-4d9e-affe-3f22ccfafa29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cd45880a78e4ace93cfdc9223b75f73'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:27.847579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-52bce9c2-ba37-4d9e-affe-3f22ccfafa29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cd45880a78e4ace93cfdc9223b75f73'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:27.880793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-52bce9c2-ba37-4d9e-affe-3f22ccfafa29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cd45880a78e4ace93cfdc9223b75f73'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:27.918487 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1486/2953] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:16:27 2022] DELETE /identity/v3/users/6cd45880a78e4ace93cfdc9223b75f73 => generated 0 bytes in 859 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:16:28.815514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13519a3-6e63-4e36-897d-c9a377383998 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:28.816109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13519a3-6e63-4e36-897d-c9a377383998 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:28.817709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13519a3-6e63-4e36-897d-c9a377383998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:28.867384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c13519a3-6e63-4e36-897d-c9a377383998 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:28.871701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c13519a3-6e63-4e36-897d-c9a377383998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:29.103803 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1468/2954] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:16:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:29.119300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bce9c2-ba37-4d9e-affe-3f22ccfafa29 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:29.122616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-52bce9c2-ba37-4d9e-affe-3f22ccfafa29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:29.469365 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bce9c2-ba37-4d9e-affe-3f22ccfafa29 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:29.494952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d283e-83c4-488d-875a-b11ae70e7471 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:29.496632 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d283e-83c4-488d-875a-b11ae70e7471 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:29.497411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d283e-83c4-488d-875a-b11ae70e7471 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:29.498138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d283e-83c4-488d-875a-b11ae70e7471 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:29.537547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d283e-83c4-488d-875a-b11ae70e7471 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:29.547593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d283e-83c4-488d-875a-b11ae70e7471 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:29.587871 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1487/2955] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:16:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:16:29.734388 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13519a3-6e63-4e36-897d-c9a377383998 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:29.738001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c13519a3-6e63-4e36-897d-c9a377383998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:30.061822 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13519a3-6e63-4e36-897d-c9a377383998 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:30.085283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9480552-c628-497b-ba3d-621608906465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:30.086713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9480552-c628-497b-ba3d-621608906465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:30.087481 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9480552-c628-497b-ba3d-621608906465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:30.088278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9480552-c628-497b-ba3d-621608906465 admin admin] PATH_INFO: `/v3/projects/74f742bd8b784b54a4829b141ad92a48` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:30.093869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9480552-c628-497b-ba3d-621608906465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74f742bd8b784b54a4829b141ad92a48)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:30.100394 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9480552-c628-497b-ba3d-621608906465 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:30.330753 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:30.346369 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e9480552-c628-497b-ba3d-621608906465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74f742bd8b784b54a4829b141ad92a48', 'request_id': 'req-e9480552-c628-497b-ba3d-621608906465'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:30.372879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e9480552-c628-497b-ba3d-621608906465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74f742bd8b784b54a4829b141ad92a48', 'request_id': 'req-e9480552-c628-497b-ba3d-621608906465'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:30.426073 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e9480552-c628-497b-ba3d-621608906465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74f742bd8b784b54a4829b141ad92a48', 'request_id': 'req-e9480552-c628-497b-ba3d-621608906465'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:30.474190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e9480552-c628-497b-ba3d-621608906465 admin admin] The token cache is being invalidate because project 74f742bd8b784b54a4829b141ad92a48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:16:30.479960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e9480552-c628-497b-ba3d-621608906465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:30.481639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e9480552-c628-497b-ba3d-621608906465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:16:30.485207 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1469/2956] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:16:29 2022] DELETE /identity/v3/projects/74f742bd8b784b54a4829b141ad92a48 => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:16:30.494321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b9a6e-29e7-4cc2-81aa-ca3f45df5602 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:30.494928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b9a6e-29e7-4cc2-81aa-ca3f45df5602 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:30.495457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b9a6e-29e7-4cc2-81aa-ca3f45df5602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:30.599952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-516b9a6e-29e7-4cc2-81aa-ca3f45df5602 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:30.607750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-516b9a6e-29e7-4cc2-81aa-ca3f45df5602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:30.890055 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1488/2957] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:30.908007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4f11d-f90c-4cb2-9278-49f43983956c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:30.908673 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4f11d-f90c-4cb2-9278-49f43983956c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:30.909272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4f11d-f90c-4cb2-9278-49f43983956c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:30.987560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-4fa4f11d-f90c-4cb2-9278-49f43983956c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:30.990693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4fa4f11d-f90c-4cb2-9278-49f43983956c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:31.027037 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1470/2958] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:31.031923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b9a6e-29e7-4cc2-81aa-ca3f45df5602 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:31.063394 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b9a6e-29e7-4cc2-81aa-ca3f45df5602 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:31.083454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73d2f8-76c3-4be8-9bb6-37b6079a9485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:31.084539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73d2f8-76c3-4be8-9bb6-37b6079a9485 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:31.085016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73d2f8-76c3-4be8-9bb6-37b6079a9485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:31.085481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73d2f8-76c3-4be8-9bb6-37b6079a9485 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:31.092716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c73d2f8-76c3-4be8-9bb6-37b6079a9485 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:16:31.093393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c73d2f8-76c3-4be8-9bb6-37b6079a9485 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:31.100443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c73d2f8-76c3-4be8-9bb6-37b6079a9485 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:31.152904 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1489/2959] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:16:31.159256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4f11d-f90c-4cb2-9278-49f43983956c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:31.190344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4f11d-f90c-4cb2-9278-49f43983956c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:31.209027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f76100-ce30-48d0-9f78-d92328cd1e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:31.210641 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f76100-ce30-48d0-9f78-d92328cd1e03 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:31.211489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f76100-ce30-48d0-9f78-d92328cd1e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:31.212314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f76100-ce30-48d0-9f78-d92328cd1e03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:31.225478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f76100-ce30-48d0-9f78-d92328cd1e03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:31.230047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f76100-ce30-48d0-9f78-d92328cd1e03 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:31.354764 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1471/2960] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:16:31 2022] POST /identity/v3/projects => generated 403 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:16:31.359408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73d2f8-76c3-4be8-9bb6-37b6079a9485 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:31.398800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73d2f8-76c3-4be8-9bb6-37b6079a9485 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:31.616412 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:31.662871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761b5b2-3099-41f9-9525-9fd2e1ee53f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:31.663730 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761b5b2-3099-41f9-9525-9fd2e1ee53f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:31.664044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761b5b2-3099-41f9-9525-9fd2e1ee53f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:31.664319 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761b5b2-3099-41f9-9525-9fd2e1ee53f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:31.664988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761b5b2-3099-41f9-9525-9fd2e1ee53f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:31.672077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761b5b2-3099-41f9-9525-9fd2e1ee53f8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:31.735723 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1490/2961] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:16:31 2022] POST /identity/v3/users => generated 302 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:16:31.738709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f76100-ce30-48d0-9f78-d92328cd1e03 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:31.825144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f76100-ce30-48d0-9f78-d92328cd1e03 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:31.854233 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a4539-52c8-4549-98fd-60fb8be890fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:31.857092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a4539-52c8-4549-98fd-60fb8be890fe admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:31.862174 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a4539-52c8-4549-98fd-60fb8be890fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:31.863657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a4539-52c8-4549-98fd-60fb8be890fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:31.869586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a4539-52c8-4549-98fd-60fb8be890fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:31.873879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a4539-52c8-4549-98fd-60fb8be890fe admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:31.928947 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1472/2962] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:16:31.934086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761b5b2-3099-41f9-9525-9fd2e1ee53f8 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:31.959486 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761b5b2-3099-41f9-9525-9fd2e1ee53f8 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:31.971768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335efbe-c3ff-4384-b4ae-eaae105f13d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:31.971768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335efbe-c3ff-4384-b4ae-eaae105f13d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:31.971768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335efbe-c3ff-4384-b4ae-eaae105f13d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:31.972589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335efbe-c3ff-4384-b4ae-eaae105f13d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:31.974335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335efbe-c3ff-4384-b4ae-eaae105f13d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:31.976327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1335efbe-c3ff-4384-b4ae-eaae105f13d8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:32.022017 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1491/2963] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:16:32.027337 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a4539-52c8-4549-98fd-60fb8be890fe admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:32.063185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a4539-52c8-4549-98fd-60fb8be890fe admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:32.098557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62aa339-0dcd-478d-bdac-0210d41f2865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:32.100016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62aa339-0dcd-478d-bdac-0210d41f2865 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:32.100201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62aa339-0dcd-478d-bdac-0210d41f2865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:32.100647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62aa339-0dcd-478d-bdac-0210d41f2865 admin admin] PATH_INFO: `/v3/projects/a42ccb7403cb4ab399ff83253b1ca038/users/af1e7cba69374a7187623daae828ddfa/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:32.187541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62aa339-0dcd-478d-bdac-0210d41f2865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a42ccb7403cb4ab399ff83253b1ca038, user_id=af1e7cba69374a7187623daae828ddfa, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:32.195696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62aa339-0dcd-478d-bdac-0210d41f2865 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:32.248366 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1473/2964] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:16:32 2022] PUT /identity/v3/projects/a42ccb7403cb4ab399ff83253b1ca038/users/af1e7cba69374a7187623daae828ddfa/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:16:32.256705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e614e-0539-49b9-a219-f68eef114e99 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:32.257135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e614e-0539-49b9-a219-f68eef114e99 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:32.257600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e614e-0539-49b9-a219-f68eef114e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:32.291061 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9b551-c644-4338-9234-a066cb167fed None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:32.291512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9b551-c644-4338-9234-a066cb167fed None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:32.292067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9b551-c644-4338-9234-a066cb167fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:32.344587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3c9e614e-0539-49b9-a219-f68eef114e99 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:32.346797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3c9e614e-0539-49b9-a219-f68eef114e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:32.376911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6cb9b551-c644-4338-9234-a066cb167fed None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:32.382719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6cb9b551-c644-4338-9234-a066cb167fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:32.580434 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1492/2965] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:16:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:32.637443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e614e-0539-49b9-a219-f68eef114e99 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:32.639277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3c9e614e-0539-49b9-a219-f68eef114e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:32.683173 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1474/2966] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:16:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:16:32.697216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9b551-c644-4338-9234-a066cb167fed None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:32.699097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6cb9b551-c644-4338-9234-a066cb167fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:32.968004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e614e-0539-49b9-a219-f68eef114e99 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:32.993914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb14538-6804-4a72-8cd2-b67653e90adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:32.996922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb14538-6804-4a72-8cd2-b67653e90adb service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:33.003562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb14538-6804-4a72-8cd2-b67653e90adb service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:33.004665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb14538-6804-4a72-8cd2-b67653e90adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:33.101912 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb14538-6804-4a72-8cd2-b67653e90adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:33.107030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb14538-6804-4a72-8cd2-b67653e90adb service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:33.147336 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1493/2967] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:16:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:16:33.209701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9b551-c644-4338-9234-a066cb167fed None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:33.252934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089dbc01-2df3-4771-a80a-caffb62b07ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:33.254817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dbc01-2df3-4771-a80a-caffb62b07ec service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:33.255808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dbc01-2df3-4771-a80a-caffb62b07ec service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:33.258260 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dbc01-2df3-4771-a80a-caffb62b07ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:33.345664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089dbc01-2df3-4771-a80a-caffb62b07ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:33.353866 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089dbc01-2df3-4771-a80a-caffb62b07ec service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:33.383437 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1475/2968] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:16:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 687 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:16:33.998846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad9536-d90c-44ec-ae6f-000f34844d40 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:33.999350 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad9536-d90c-44ec-ae6f-000f34844d40 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:34.000140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad9536-d90c-44ec-ae6f-000f34844d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:34.114870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-13ad9536-d90c-44ec-ae6f-000f34844d40 None None] MFA Rules not processed for user `786962988b754fb69bd48070c2992e13`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:34.131055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-13ad9536-d90c-44ec-ae6f-000f34844d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:34.449750 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1494/2969] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:16:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:35.829461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d152826-de8b-40b4-a1d5-f9e07abb0cb7 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:35.830853 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d152826-de8b-40b4-a1d5-f9e07abb0cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:35.831644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d152826-de8b-40b4-a1d5-f9e07abb0cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:35.871371 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:35.929940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2d152826-de8b-40b4-a1d5-f9e07abb0cb7 None None] MFA Rules not processed for user `786962988b754fb69bd48070c2992e13`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:35.932742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2d152826-de8b-40b4-a1d5-f9e07abb0cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:35.975318 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1476/2970] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:16:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:42.591124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663f2ad-1895-4167-80f7-7304f776f1a5 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:42.591712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663f2ad-1895-4167-80f7-7304f776f1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:42.592079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663f2ad-1895-4167-80f7-7304f776f1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:42.661968 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:42.672215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6663f2ad-1895-4167-80f7-7304f776f1a5 None None] MFA Rules not processed for user `0af4775c28774015bc168bbcfc9b784d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:42.676897 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6663f2ad-1895-4167-80f7-7304f776f1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:42.840330 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1495/2971] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:16:42 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:16:42.858606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d721277-1766-42ff-bbbf-03f173d8f5e6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:42.859291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d721277-1766-42ff-bbbf-03f173d8f5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:42.859578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d721277-1766-42ff-bbbf-03f173d8f5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:42.897546 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-5d721277-1766-42ff-bbbf-03f173d8f5e6 None None] MFA Rules not processed for user `0af4775c28774015bc168bbcfc9b784d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:42.900213 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5d721277-1766-42ff-bbbf-03f173d8f5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:42.921574 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1477/2972] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:16:42 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:16:43.409238 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663f2ad-1895-4167-80f7-7304f776f1a5 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:43.412288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6663f2ad-1895-4167-80f7-7304f776f1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:43.593192 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d721277-1766-42ff-bbbf-03f173d8f5e6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:43.632543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d721277-1766-42ff-bbbf-03f173d8f5e6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:43.649357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d039d5-f21b-47e1-afc4-aedbe58eb254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:43.650441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d039d5-f21b-47e1-afc4-aedbe58eb254 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:43.664682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d039d5-f21b-47e1-afc4-aedbe58eb254 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:43.665345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d039d5-f21b-47e1-afc4-aedbe58eb254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:43.676458 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b5d039d5-f21b-47e1-afc4-aedbe58eb254 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:43.688744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663f2ad-1895-4167-80f7-7304f776f1a5 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:43.727869 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee673b03-7917-4a52-ba49-349283883a9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:43.743067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee673b03-7917-4a52-ba49-349283883a9b service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:43.744105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee673b03-7917-4a52-ba49-349283883a9b service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:43.746435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee673b03-7917-4a52-ba49-349283883a9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:43.765549 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d039d5-f21b-47e1-afc4-aedbe58eb254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:43.773890 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d039d5-f21b-47e1-afc4-aedbe58eb254 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:43.781315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee673b03-7917-4a52-ba49-349283883a9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:43.786310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee673b03-7917-4a52-ba49-349283883a9b service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:43.818666 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1478/2973] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:16:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:16:43.830722 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1496/2974] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:16:43 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:16:44.782459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d039d5-f21b-47e1-afc4-aedbe58eb254 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:44.784349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b5d039d5-f21b-47e1-afc4-aedbe58eb254 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:44.810414 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d039d5-f21b-47e1-afc4-aedbe58eb254 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:44.823161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6abcd-1ea8-4f09-b671-d2eab5f77d24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:44.824646 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6abcd-1ea8-4f09-b671-d2eab5f77d24 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:44.825094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6abcd-1ea8-4f09-b671-d2eab5f77d24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:44.825688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6abcd-1ea8-4f09-b671-d2eab5f77d24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:44.828280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cbc6abcd-1ea8-4f09-b671-d2eab5f77d24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:44.841517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6abcd-1ea8-4f09-b671-d2eab5f77d24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:44.843427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6abcd-1ea8-4f09-b671-d2eab5f77d24 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:44.854514 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1479/2975] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:16:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:16:53.814730 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=60 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:54.849507 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=17 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:16:55.477315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acdf63f-097c-4940-8fcc-49cf542e2b3d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:55.477905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acdf63f-097c-4940-8fcc-49cf542e2b3d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:55.478075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acdf63f-097c-4940-8fcc-49cf542e2b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:55.550669 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-7acdf63f-097c-4940-8fcc-49cf542e2b3d None None] MFA Rules not processed for user `cd8929be3902460ea06f780dd43955d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:55.552310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7acdf63f-097c-4940-8fcc-49cf542e2b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:55.755916 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1497/2976] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:16:55 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:55.765262 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614f5c2-2160-4d50-afaf-a69b4ee65f37 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:55.765484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614f5c2-2160-4d50-afaf-a69b4ee65f37 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:55.765626 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614f5c2-2160-4d50-afaf-a69b4ee65f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:55.830691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2614f5c2-2160-4d50-afaf-a69b4ee65f37 None None] MFA Rules not processed for user `45ed48709ab84fa4b5b341332a843ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:16:55.833862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2614f5c2-2160-4d50-afaf-a69b4ee65f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:55.961556 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1480/2977] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:16:55 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:16:56.342905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acdf63f-097c-4940-8fcc-49cf542e2b3d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:16:56.367714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acdf63f-097c-4940-8fcc-49cf542e2b3d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:16:56.391618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621aa60-7786-4b0c-ae56-64440d02fd38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:16:56.392332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621aa60-7786-4b0c-ae56-64440d02fd38 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:16:56.392863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621aa60-7786-4b0c-ae56-64440d02fd38 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:16:56.393149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621aa60-7786-4b0c-ae56-64440d02fd38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:16:56.395114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7621aa60-7786-4b0c-ae56-64440d02fd38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:16:56.415639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621aa60-7786-4b0c-ae56-64440d02fd38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:16:56.417361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621aa60-7786-4b0c-ae56-64440d02fd38 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:16:56.442224 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1498/2978] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:16:56 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:05.300484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614f5c2-2160-4d50-afaf-a69b4ee65f37 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:05.322699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614f5c2-2160-4d50-afaf-a69b4ee65f37 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:05.337774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ddec0-fa44-401e-92e0-66b013dca81a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:05.339142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ddec0-fa44-401e-92e0-66b013dca81a service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:05.339588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ddec0-fa44-401e-92e0-66b013dca81a service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:05.340147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ddec0-fa44-401e-92e0-66b013dca81a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:05.342703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8a3ddec0-fa44-401e-92e0-66b013dca81a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:05.369390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ddec0-fa44-401e-92e0-66b013dca81a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:05.371162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ddec0-fa44-401e-92e0-66b013dca81a service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:05.376029 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b6123-2373-4d23-bc32-912c023946fd None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:05.376916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b6123-2373-4d23-bc32-912c023946fd None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:05.377404 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b6123-2373-4d23-bc32-912c023946fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:05.385701 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1481/2979] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:05.414808 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9b8b6123-2373-4d23-bc32-912c023946fd None None] MFA Rules not processed for user `af1e7cba69374a7187623daae828ddfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:05.416345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9b8b6123-2373-4d23-bc32-912c023946fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:05.541665 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1499/2980] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:17:05 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:17:05.680897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6624af9-df19-45c5-bb6e-c260d7afac0c None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:05.681503 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6624af9-df19-45c5-bb6e-c260d7afac0c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:05.681958 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6624af9-df19-45c5-bb6e-c260d7afac0c None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:05.683829 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1482/2981] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 01:17:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:17:05.691083 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580feb3-55d1-491e-bbf4-d78241d18317 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:05.691370 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580feb3-55d1-491e-bbf4-d78241d18317 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:05.691651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580feb3-55d1-491e-bbf4-d78241d18317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:05.719226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b580feb3-55d1-491e-bbf4-d78241d18317 None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:05.720620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b580feb3-55d1-491e-bbf4-d78241d18317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:05.783257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6624af9-df19-45c5-bb6e-c260d7afac0c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:05.805061 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6624af9-df19-45c5-bb6e-c260d7afac0c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:05.814053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78922b-f1ee-49bb-83b7-a4101e80c047 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:05.815382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78922b-f1ee-49bb-83b7-a4101e80c047 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:05.816063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78922b-f1ee-49bb-83b7-a4101e80c047 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:05.816352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78922b-f1ee-49bb-83b7-a4101e80c047 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:05.832658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78922b-f1ee-49bb-83b7-a4101e80c047 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:05.835218 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78922b-f1ee-49bb-83b7-a4101e80c047 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:05.862596 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:05.867541 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1483/2982] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:05 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:05.903863 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1500/2983] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 01:17:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:05.912389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78922b-f1ee-49bb-83b7-a4101e80c047 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:05.914193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3c78922b-f1ee-49bb-83b7-a4101e80c047 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:05.935176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78922b-f1ee-49bb-83b7-a4101e80c047 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:05.943799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c2a599-5219-48f6-8a5b-6f7553da7172 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:05.944757 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2a599-5219-48f6-8a5b-6f7553da7172 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:05.945284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2a599-5219-48f6-8a5b-6f7553da7172 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:05.945842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c2a599-5219-48f6-8a5b-6f7553da7172 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:05.959181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c2a599-5219-48f6-8a5b-6f7553da7172 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:05.962326 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c2a599-5219-48f6-8a5b-6f7553da7172 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:05.983159 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1484/2984] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:10.250419 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580feb3-55d1-491e-bbf4-d78241d18317 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:10.255402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b580feb3-55d1-491e-bbf4-d78241d18317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:10.279751 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580feb3-55d1-491e-bbf4-d78241d18317 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:10.289534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3021201-bda3-44e0-bafb-4954af3952b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:10.291069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3021201-bda3-44e0-bafb-4954af3952b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:10.292248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3021201-bda3-44e0-bafb-4954af3952b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:10.293214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3021201-bda3-44e0-bafb-4954af3952b4 admin admin] PATH_INFO: `/v3/users/32fc1959d8aa41eabcead217b9d7bc47` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:10.295166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3021201-bda3-44e0-bafb-4954af3952b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32fc1959d8aa41eabcead217b9d7bc47)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:10.299794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3021201-bda3-44e0-bafb-4954af3952b4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:10.395272 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b3021201-bda3-44e0-bafb-4954af3952b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32fc1959d8aa41eabcead217b9d7bc47'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:10.428413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b3021201-bda3-44e0-bafb-4954af3952b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32fc1959d8aa41eabcead217b9d7bc47'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:10.457750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b3021201-bda3-44e0-bafb-4954af3952b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32fc1959d8aa41eabcead217b9d7bc47'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:10.458924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b3021201-bda3-44e0-bafb-4954af3952b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32fc1959d8aa41eabcead217b9d7bc47'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:10.497093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b3021201-bda3-44e0-bafb-4954af3952b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32fc1959d8aa41eabcead217b9d7bc47'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:10.545376 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1501/2985] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:10 2022] DELETE /identity/v3/users/32fc1959d8aa41eabcead217b9d7bc47 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:10.551491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7f576-1d96-4155-8090-fe15463b92a7 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:10.553410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7f576-1d96-4155-8090-fe15463b92a7 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:10.555809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7f576-1d96-4155-8090-fe15463b92a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:10.617297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d1f7f576-1d96-4155-8090-fe15463b92a7 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:10.618536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d1f7f576-1d96-4155-8090-fe15463b92a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:10.754550 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1485/2986] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:10.803773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3021201-bda3-44e0-bafb-4954af3952b4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:10.808055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b3021201-bda3-44e0-bafb-4954af3952b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:10.904635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3021201-bda3-44e0-bafb-4954af3952b4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:10.908405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c814c1-3727-487a-8967-cfee287effba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:10.909272 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c814c1-3727-487a-8967-cfee287effba service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:10.910140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c814c1-3727-487a-8967-cfee287effba service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:10.910312 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c814c1-3727-487a-8967-cfee287effba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:10.921376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c814c1-3727-487a-8967-cfee287effba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:10.922784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c814c1-3727-487a-8967-cfee287effba service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:10.945778 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1502/2987] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:11.734350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7f576-1d96-4155-8090-fe15463b92a7 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:11.736518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d1f7f576-1d96-4155-8090-fe15463b92a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:11.768821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7f576-1d96-4155-8090-fe15463b92a7 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:11.780765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b032c10-9f8f-4781-b1e8-255943dfea30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:11.789315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b032c10-9f8f-4781-b1e8-255943dfea30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:11.790915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b032c10-9f8f-4781-b1e8-255943dfea30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:11.792391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b032c10-9f8f-4781-b1e8-255943dfea30 admin admin] PATH_INFO: `/v3/projects/d08d010c14a64f759887be0d2364c6e4` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:11.799878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b032c10-9f8f-4781-b1e8-255943dfea30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d08d010c14a64f759887be0d2364c6e4)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:11.808841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b032c10-9f8f-4781-b1e8-255943dfea30 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:11.877496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0b032c10-9f8f-4781-b1e8-255943dfea30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd08d010c14a64f759887be0d2364c6e4', 'request_id': 'req-0b032c10-9f8f-4781-b1e8-255943dfea30'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:11.885916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0b032c10-9f8f-4781-b1e8-255943dfea30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd08d010c14a64f759887be0d2364c6e4', 'request_id': 'req-0b032c10-9f8f-4781-b1e8-255943dfea30'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:11.888955 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:11.913368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0b032c10-9f8f-4781-b1e8-255943dfea30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd08d010c14a64f759887be0d2364c6e4', 'request_id': 'req-0b032c10-9f8f-4781-b1e8-255943dfea30'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:12.007139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0b032c10-9f8f-4781-b1e8-255943dfea30 admin admin] The token cache is being invalidate because project d08d010c14a64f759887be0d2364c6e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:12.008202 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0b032c10-9f8f-4781-b1e8-255943dfea30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:12.009186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0b032c10-9f8f-4781-b1e8-255943dfea30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:12.012741 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1486/2988] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:11 2022] DELETE /identity/v3/projects/d08d010c14a64f759887be0d2364c6e4 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:12.017684 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c814c1-3727-487a-8967-cfee287effba service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:12.055518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c814c1-3727-487a-8967-cfee287effba service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:12.191184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91635062-12e7-4473-a13c-5a915ff141eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:12.192476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91635062-12e7-4473-a13c-5a915ff141eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:12.193432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91635062-12e7-4473-a13c-5a915ff141eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:12.193963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91635062-12e7-4473-a13c-5a915ff141eb admin admin] PATH_INFO: `/v3/users/30200e98f11c4146a614cb47ad0f351e` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:12.195732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91635062-12e7-4473-a13c-5a915ff141eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=30200e98f11c4146a614cb47ad0f351e)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:12.198683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91635062-12e7-4473-a13c-5a915ff141eb admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:12.221171 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:12.330606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-91635062-12e7-4473-a13c-5a915ff141eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30200e98f11c4146a614cb47ad0f351e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:12.358238 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-91635062-12e7-4473-a13c-5a915ff141eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30200e98f11c4146a614cb47ad0f351e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:12.456496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-91635062-12e7-4473-a13c-5a915ff141eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30200e98f11c4146a614cb47ad0f351e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:12.464966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-91635062-12e7-4473-a13c-5a915ff141eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30200e98f11c4146a614cb47ad0f351e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:12.502904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-91635062-12e7-4473-a13c-5a915ff141eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30200e98f11c4146a614cb47ad0f351e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:12.525012 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1503/2989] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:12 2022] DELETE /identity/v3/users/30200e98f11c4146a614cb47ad0f351e => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:13.743593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b032c10-9f8f-4781-b1e8-255943dfea30 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:13.747140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0b032c10-9f8f-4781-b1e8-255943dfea30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:13.799212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b032c10-9f8f-4781-b1e8-255943dfea30 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:13.952635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf2d29-a56d-4ea5-aa81-0ee754b344b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:13.953338 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf2d29-a56d-4ea5-aa81-0ee754b344b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:13.953622 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf2d29-a56d-4ea5-aa81-0ee754b344b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:13.953958 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf2d29-a56d-4ea5-aa81-0ee754b344b0 admin admin] PATH_INFO: `/v3/projects/a6d2b0cc41e54e5fbf25bafe59210a55` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:13.955573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf2d29-a56d-4ea5-aa81-0ee754b344b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6d2b0cc41e54e5fbf25bafe59210a55)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:13.958170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf2d29-a56d-4ea5-aa81-0ee754b344b0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:14.067184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fccf2d29-a56d-4ea5-aa81-0ee754b344b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6d2b0cc41e54e5fbf25bafe59210a55', 'request_id': 'req-fccf2d29-a56d-4ea5-aa81-0ee754b344b0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:14.079286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fccf2d29-a56d-4ea5-aa81-0ee754b344b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6d2b0cc41e54e5fbf25bafe59210a55', 'request_id': 'req-fccf2d29-a56d-4ea5-aa81-0ee754b344b0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:14.088116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fccf2d29-a56d-4ea5-aa81-0ee754b344b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6d2b0cc41e54e5fbf25bafe59210a55', 'request_id': 'req-fccf2d29-a56d-4ea5-aa81-0ee754b344b0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:14.105333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fccf2d29-a56d-4ea5-aa81-0ee754b344b0 admin admin] The token cache is being invalidate because project a6d2b0cc41e54e5fbf25bafe59210a55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:14.106777 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fccf2d29-a56d-4ea5-aa81-0ee754b344b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:14.106777 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fccf2d29-a56d-4ea5-aa81-0ee754b344b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:14.108627 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1487/2990] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:13 2022] DELETE /identity/v3/projects/a6d2b0cc41e54e5fbf25bafe59210a55 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:14.113664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e697152-ce2f-4fff-95ac-e1875803cede None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:14.114730 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e697152-ce2f-4fff-95ac-e1875803cede None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:14.114730 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e697152-ce2f-4fff-95ac-e1875803cede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:14.141745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9e697152-ce2f-4fff-95ac-e1875803cede None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:14.143516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9e697152-ce2f-4fff-95ac-e1875803cede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:14.247575 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1504/2991] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:17:14.267347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2ca65-7cfa-453b-8535-2921a485834a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:14.268962 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2ca65-7cfa-453b-8535-2921a485834a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:14.269390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2ca65-7cfa-453b-8535-2921a485834a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:14.314141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-83e2ca65-7cfa-453b-8535-2921a485834a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:14.314141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-83e2ca65-7cfa-453b-8535-2921a485834a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:14.340802 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1488/2992] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:17:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:14.341622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e697152-ce2f-4fff-95ac-e1875803cede None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:14.368716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e697152-ce2f-4fff-95ac-e1875803cede None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:14.384535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d413b-573a-4178-9a75-cefdd029367a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:14.385230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d413b-573a-4178-9a75-cefdd029367a admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:14.385735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d413b-573a-4178-9a75-cefdd029367a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:14.386058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d413b-573a-4178-9a75-cefdd029367a admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:14.386757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d413b-573a-4178-9a75-cefdd029367a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:17:14.387063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d413b-573a-4178-9a75-cefdd029367a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:14.389948 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d413b-573a-4178-9a75-cefdd029367a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:14.430003 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1505/2993] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:17:14.434872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2ca65-7cfa-453b-8535-2921a485834a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:14.461687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2ca65-7cfa-453b-8535-2921a485834a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:14.475699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316708f-67ee-4f92-b27b-b08699e1c2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:14.476499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316708f-67ee-4f92-b27b-b08699e1c2b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:14.476795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316708f-67ee-4f92-b27b-b08699e1c2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:14.477067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316708f-67ee-4f92-b27b-b08699e1c2b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:14.477727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316708f-67ee-4f92-b27b-b08699e1c2b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:14.479862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316708f-67ee-4f92-b27b-b08699e1c2b5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:14.526864 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1489/2994] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:14 2022] POST /identity/v3/projects => generated 393 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:14.532126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d413b-573a-4178-9a75-cefdd029367a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:14.574786 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d413b-573a-4178-9a75-cefdd029367a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:14.752009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffd3cb-0a6b-45b7-aa0c-9d4209ff4757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:14.753585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffd3cb-0a6b-45b7-aa0c-9d4209ff4757 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:14.753849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffd3cb-0a6b-45b7-aa0c-9d4209ff4757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:14.754226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffd3cb-0a6b-45b7-aa0c-9d4209ff4757 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:14.758109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ffd3cb-0a6b-45b7-aa0c-9d4209ff4757 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:14.767176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ffd3cb-0a6b-45b7-aa0c-9d4209ff4757 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:14.846322 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1506/2995] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:14 2022] POST /identity/v3/users => generated 297 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:14.848515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316708f-67ee-4f92-b27b-b08699e1c2b5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:14.888252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316708f-67ee-4f92-b27b-b08699e1c2b5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:14.909655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4676ab-b8fd-480b-975d-a3acaaa16b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:14.910301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4676ab-b8fd-480b-975d-a3acaaa16b27 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:14.910569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4676ab-b8fd-480b-975d-a3acaaa16b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:14.916384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4676ab-b8fd-480b-975d-a3acaaa16b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:14.917346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4676ab-b8fd-480b-975d-a3acaaa16b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:14.921188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4676ab-b8fd-480b-975d-a3acaaa16b27 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:14.998924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffd3cb-0a6b-45b7-aa0c-9d4209ff4757 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:15.009599 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1490/2996] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:17:15.023211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffd3cb-0a6b-45b7-aa0c-9d4209ff4757 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:15.034835 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e4e56-01bd-407e-b024-f66abac27c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:15.035845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e4e56-01bd-407e-b024-f66abac27c14 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:15.036327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e4e56-01bd-407e-b024-f66abac27c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:15.036788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e4e56-01bd-407e-b024-f66abac27c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:15.038331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e4e56-01bd-407e-b024-f66abac27c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:15.041739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e4e56-01bd-407e-b024-f66abac27c14 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:15.045913 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:15.104255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4676ab-b8fd-480b-975d-a3acaaa16b27 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:15.124315 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1507/2997] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:15.168596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4676ab-b8fd-480b-975d-a3acaaa16b27 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:15.179666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ccd02-9c6e-4168-84b1-fc8111945d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:15.182022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ccd02-9c6e-4168-84b1-fc8111945d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:15.182879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ccd02-9c6e-4168-84b1-fc8111945d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:15.183628 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ccd02-9c6e-4168-84b1-fc8111945d47 admin admin] PATH_INFO: `/v3/projects/2389688d1f844f46a38347db9de6bdf0/users/a0cfe8884b8b49c8b38c4e91d77e994e/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:15.272914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ccd02-9c6e-4168-84b1-fc8111945d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2389688d1f844f46a38347db9de6bdf0, user_id=a0cfe8884b8b49c8b38c4e91d77e994e, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:15.278842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ccd02-9c6e-4168-84b1-fc8111945d47 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:15.357400 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1491/2998] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:15 2022] PUT /identity/v3/projects/2389688d1f844f46a38347db9de6bdf0/users/a0cfe8884b8b49c8b38c4e91d77e994e/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:15.453277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7375d3-2422-4776-8165-3c2772216d90 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:15.453588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7375d3-2422-4776-8165-3c2772216d90 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:15.453806 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7375d3-2422-4776-8165-3c2772216d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:15.491631 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-8c7375d3-2422-4776-8165-3c2772216d90 None None] MFA Rules not processed for user `a0cfe8884b8b49c8b38c4e91d77e994e`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:15.493559 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8c7375d3-2422-4776-8165-3c2772216d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:15.577070 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ccd02-9c6e-4168-84b1-fc8111945d47 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:15.579139 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1508/2999] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:17:15 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:15.600864 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:15.713189 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ccd02-9c6e-4168-84b1-fc8111945d47 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:15.725848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081f78e-e82d-49af-9bb8-159f97e728fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:15.729054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081f78e-e82d-49af-9bb8-159f97e728fc admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:15.729054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081f78e-e82d-49af-9bb8-159f97e728fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:15.729054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081f78e-e82d-49af-9bb8-159f97e728fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:15.733439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081f78e-e82d-49af-9bb8-159f97e728fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:15.735598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081f78e-e82d-49af-9bb8-159f97e728fc admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:15.796116 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1492/3000] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:15 2022] POST /identity/v3/projects => generated 395 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:15.797753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7375d3-2422-4776-8165-3c2772216d90 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:15.815838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7375d3-2422-4776-8165-3c2772216d90 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:15.964737 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7e61f-7ca2-4553-a57b-55fe5de6ca58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:15.965575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7e61f-7ca2-4553-a57b-55fe5de6ca58 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:15.966051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7e61f-7ca2-4553-a57b-55fe5de6ca58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:15.966483 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7e61f-7ca2-4553-a57b-55fe5de6ca58 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:15.967318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7e61f-7ca2-4553-a57b-55fe5de6ca58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:15.969585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7e61f-7ca2-4553-a57b-55fe5de6ca58 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:16.008674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081f78e-e82d-49af-9bb8-159f97e728fc admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:16.009185 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1509/3001] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:15 2022] POST /identity/v3/users => generated 304 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:16.025819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081f78e-e82d-49af-9bb8-159f97e728fc admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:16.038435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5b39d-adcc-4864-82ca-7f4e9793eaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:16.039696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5b39d-adcc-4864-82ca-7f4e9793eaaa admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:16.040259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5b39d-adcc-4864-82ca-7f4e9793eaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:16.040779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5b39d-adcc-4864-82ca-7f4e9793eaaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:16.041881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5b39d-adcc-4864-82ca-7f4e9793eaaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:16.044218 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5b39d-adcc-4864-82ca-7f4e9793eaaa admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:16.068191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7e61f-7ca2-4553-a57b-55fe5de6ca58 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:16.079719 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1493/3002] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:16.085144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7e61f-7ca2-4553-a57b-55fe5de6ca58 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:16.092279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf0c28-a9e8-47f0-82cc-7f84170805d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:16.093619 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf0c28-a9e8-47f0-82cc-7f84170805d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:16.093996 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf0c28-a9e8-47f0-82cc-7f84170805d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:16.094370 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf0c28-a9e8-47f0-82cc-7f84170805d9 admin admin] PATH_INFO: `/v3/projects/bab7eb6f1db14b5db9d732ac7e240fa7/users/1dfb28a136c6409f8cc9d8690fca7a25/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:16.119034 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf0c28-a9e8-47f0-82cc-7f84170805d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bab7eb6f1db14b5db9d732ac7e240fa7, user_id=1dfb28a136c6409f8cc9d8690fca7a25, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:16.122263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf0c28-a9e8-47f0-82cc-7f84170805d9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:16.147486 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1510/3003] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:16 2022] PUT /identity/v3/projects/bab7eb6f1db14b5db9d732ac7e240fa7/users/1dfb28a136c6409f8cc9d8690fca7a25/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:17:16.152554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5b39d-adcc-4864-82ca-7f4e9793eaaa admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:16.178352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5b39d-adcc-4864-82ca-7f4e9793eaaa admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:16.274162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691daee2-ef49-44ee-8685-2c46dfc817e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:16.275067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691daee2-ef49-44ee-8685-2c46dfc817e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:16.275412 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691daee2-ef49-44ee-8685-2c46dfc817e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:16.275745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691daee2-ef49-44ee-8685-2c46dfc817e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:16.276513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691daee2-ef49-44ee-8685-2c46dfc817e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:16.278657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691daee2-ef49-44ee-8685-2c46dfc817e5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:16.311407 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1494/3004] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:16.316429 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf0c28-a9e8-47f0-82cc-7f84170805d9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:16.348822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf0c28-a9e8-47f0-82cc-7f84170805d9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:16.355385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4358caa-90d1-439c-89ac-c7e102951b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:16.356695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4358caa-90d1-439c-89ac-c7e102951b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:16.357096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4358caa-90d1-439c-89ac-c7e102951b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:16.357248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4358caa-90d1-439c-89ac-c7e102951b97 admin admin] PATH_INFO: `/v3/projects/bab7eb6f1db14b5db9d732ac7e240fa7/users/1dfb28a136c6409f8cc9d8690fca7a25/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:16.365160 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4358caa-90d1-439c-89ac-c7e102951b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bab7eb6f1db14b5db9d732ac7e240fa7, user_id=1dfb28a136c6409f8cc9d8690fca7a25, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:16.373898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4358caa-90d1-439c-89ac-c7e102951b97 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:16.400417 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1511/3005] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:16 2022] PUT /identity/v3/projects/bab7eb6f1db14b5db9d732ac7e240fa7/users/1dfb28a136c6409f8cc9d8690fca7a25/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:16.402246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10698d5d-905a-47ed-a5c0-6fdce68b401b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:16.402471 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10698d5d-905a-47ed-a5c0-6fdce68b401b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:16.402749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10698d5d-905a-47ed-a5c0-6fdce68b401b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:16.443632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-10698d5d-905a-47ed-a5c0-6fdce68b401b None None] MFA Rules not processed for user `1dfb28a136c6409f8cc9d8690fca7a25`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:16.444926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-10698d5d-905a-47ed-a5c0-6fdce68b401b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:16.577837 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1495/3006] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:17:16 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:16.649356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4358caa-90d1-439c-89ac-c7e102951b97 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:16.651601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b4358caa-90d1-439c-89ac-c7e102951b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:16.792330 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:16.792847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10698d5d-905a-47ed-a5c0-6fdce68b401b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:16.795444 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-10698d5d-905a-47ed-a5c0-6fdce68b401b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:16.843244 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:16.868734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4358caa-90d1-439c-89ac-c7e102951b97 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:16.880822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd184d8e-2a9d-4401-88c9-9daff342f936 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:16.882356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd184d8e-2a9d-4401-88c9-9daff342f936 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:16.883120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd184d8e-2a9d-4401-88c9-9daff342f936 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:16.883630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd184d8e-2a9d-4401-88c9-9daff342f936 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:16.902393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd184d8e-2a9d-4401-88c9-9daff342f936 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:16.904621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd184d8e-2a9d-4401-88c9-9daff342f936 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:16.922119 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1512/3007] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:16 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:16.923834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e556f6-b682-413e-8430-1ff4775b4d1d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:16.924240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e556f6-b682-413e-8430-1ff4775b4d1d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:16.925194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e556f6-b682-413e-8430-1ff4775b4d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:16.947500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10698d5d-905a-47ed-a5c0-6fdce68b401b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:16.995837 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d10fcb-e1f8-4771-9dc7-6a0098e525e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:16.996464 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d10fcb-e1f8-4771-9dc7-6a0098e525e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:16.996915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d10fcb-e1f8-4771-9dc7-6a0098e525e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:16.997197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d10fcb-e1f8-4771-9dc7-6a0098e525e3 admin admin] PATH_INFO: `/v3/users/af1e7cba69374a7187623daae828ddfa` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:17.004713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d10fcb-e1f8-4771-9dc7-6a0098e525e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af1e7cba69374a7187623daae828ddfa)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:17.005999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-47e556f6-b682-413e-8430-1ff4775b4d1d None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:17.008890 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d10fcb-e1f8-4771-9dc7-6a0098e525e3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:17.009947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-47e556f6-b682-413e-8430-1ff4775b4d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:17.123639 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1513/3008] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:17:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:17.132478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-89d10fcb-e1f8-4771-9dc7-6a0098e525e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af1e7cba69374a7187623daae828ddfa'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:17.135508 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e556f6-b682-413e-8430-1ff4775b4d1d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:17.137124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-47e556f6-b682-413e-8430-1ff4775b4d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:17.145702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-89d10fcb-e1f8-4771-9dc7-6a0098e525e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af1e7cba69374a7187623daae828ddfa'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:17.173738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-89d10fcb-e1f8-4771-9dc7-6a0098e525e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af1e7cba69374a7187623daae828ddfa'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:17.179129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-89d10fcb-e1f8-4771-9dc7-6a0098e525e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af1e7cba69374a7187623daae828ddfa'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:17.191374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-89d10fcb-e1f8-4771-9dc7-6a0098e525e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af1e7cba69374a7187623daae828ddfa'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:17.199027 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1496/3009] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:16 2022] DELETE /identity/v3/users/af1e7cba69374a7187623daae828ddfa => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:17.256232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e556f6-b682-413e-8430-1ff4775b4d1d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:17.403009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d10fcb-e1f8-4771-9dc7-6a0098e525e3 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:17.406966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-89d10fcb-e1f8-4771-9dc7-6a0098e525e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:17.437220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872ceae-6449-4386-8bd4-ad82ce60baa9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:17.438222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872ceae-6449-4386-8bd4-ad82ce60baa9 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:17.438701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872ceae-6449-4386-8bd4-ad82ce60baa9 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:17.439153 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872ceae-6449-4386-8bd4-ad82ce60baa9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:17.446671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1872ceae-6449-4386-8bd4-ad82ce60baa9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:17.487248 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:17.601013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872ceae-6449-4386-8bd4-ad82ce60baa9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:17.603039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872ceae-6449-4386-8bd4-ad82ce60baa9 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:17.627279 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1514/3010] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:17:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:17:17.629177 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872ceae-6449-4386-8bd4-ad82ce60baa9 service swift] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:17.632182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1872ceae-6449-4386-8bd4-ad82ce60baa9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:17.765690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d10fcb-e1f8-4771-9dc7-6a0098e525e3 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:17.779744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53721fbd-ca38-47bc-80a5-19bd2f22c4fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:17.780764 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53721fbd-ca38-47bc-80a5-19bd2f22c4fb service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:17.784847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53721fbd-ca38-47bc-80a5-19bd2f22c4fb service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:17.785121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53721fbd-ca38-47bc-80a5-19bd2f22c4fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:17.795021 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-53721fbd-ca38-47bc-80a5-19bd2f22c4fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:17.833798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53721fbd-ca38-47bc-80a5-19bd2f22c4fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:17.841054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53721fbd-ca38-47bc-80a5-19bd2f22c4fb service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:17.849770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872ceae-6449-4386-8bd4-ad82ce60baa9 service swift] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:17.856529 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:17.861479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca167e-2d0a-4e8c-b281-dae6b5150606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:17.862222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca167e-2d0a-4e8c-b281-dae6b5150606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:17.862505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca167e-2d0a-4e8c-b281-dae6b5150606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:17.862845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca167e-2d0a-4e8c-b281-dae6b5150606 admin admin] PATH_INFO: `/v3/users/065d8324da60445ea1e97e1dc892f183` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:17.864076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca167e-2d0a-4e8c-b281-dae6b5150606 admin admin] RBAC: Authorizing `identity:delete_user(user_id=065d8324da60445ea1e97e1dc892f183)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:17.866139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca167e-2d0a-4e8c-b281-dae6b5150606 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:17.866493 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1497/3011] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:17:17.867779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53721fbd-ca38-47bc-80a5-19bd2f22c4fb service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:17.875834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-53721fbd-ca38-47bc-80a5-19bd2f22c4fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:17.922164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53721fbd-ca38-47bc-80a5-19bd2f22c4fb service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:17.948687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bacbc8-422e-448b-9d5a-79c49252375e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:17.949436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bacbc8-422e-448b-9d5a-79c49252375e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:17.949732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bacbc8-422e-448b-9d5a-79c49252375e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:17.950030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bacbc8-422e-448b-9d5a-79c49252375e admin admin] PATH_INFO: `/v3/projects/a42ccb7403cb4ab399ff83253b1ca038` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:17.953412 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bacbc8-422e-448b-9d5a-79c49252375e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a42ccb7403cb4ab399ff83253b1ca038)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:17.959502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bacbc8-422e-448b-9d5a-79c49252375e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:17.979196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b8ca167e-2d0a-4e8c-b281-dae6b5150606 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '065d8324da60445ea1e97e1dc892f183'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:18.001122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b8ca167e-2d0a-4e8c-b281-dae6b5150606 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '065d8324da60445ea1e97e1dc892f183'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:18.029510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b8ca167e-2d0a-4e8c-b281-dae6b5150606 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '065d8324da60445ea1e97e1dc892f183'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:18.030085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b8ca167e-2d0a-4e8c-b281-dae6b5150606 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '065d8324da60445ea1e97e1dc892f183'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:18.043835 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b8ca167e-2d0a-4e8c-b281-dae6b5150606 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '065d8324da60445ea1e97e1dc892f183'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:18.063779 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1515/3012] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:17 2022] DELETE /identity/v3/users/065d8324da60445ea1e97e1dc892f183 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:18.090247 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-55bacbc8-422e-448b-9d5a-79c49252375e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a42ccb7403cb4ab399ff83253b1ca038', 'request_id': 'req-55bacbc8-422e-448b-9d5a-79c49252375e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:18.104840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-55bacbc8-422e-448b-9d5a-79c49252375e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a42ccb7403cb4ab399ff83253b1ca038', 'request_id': 'req-55bacbc8-422e-448b-9d5a-79c49252375e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:18.128783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-55bacbc8-422e-448b-9d5a-79c49252375e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a42ccb7403cb4ab399ff83253b1ca038', 'request_id': 'req-55bacbc8-422e-448b-9d5a-79c49252375e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:18.172731 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-55bacbc8-422e-448b-9d5a-79c49252375e admin admin] The token cache is being invalidate because project a42ccb7403cb4ab399ff83253b1ca038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:18.173008 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-55bacbc8-422e-448b-9d5a-79c49252375e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:18.175849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-55bacbc8-422e-448b-9d5a-79c49252375e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:18.199006 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1498/3013] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:17 2022] DELETE /identity/v3/projects/a42ccb7403cb4ab399ff83253b1ca038 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:18.204367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd58d46-071f-4221-bb17-aa5793befd42 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:18.204602 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd58d46-071f-4221-bb17-aa5793befd42 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:18.204860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd58d46-071f-4221-bb17-aa5793befd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:18.252011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6cd58d46-071f-4221-bb17-aa5793befd42 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:18.260941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6cd58d46-071f-4221-bb17-aa5793befd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:18.352370 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:18.426813 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1516/3014] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:17:18.433809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f287839-9446-4a40-a140-195a8cf4eeda None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:18.434284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f287839-9446-4a40-a140-195a8cf4eeda None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:18.434572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f287839-9446-4a40-a140-195a8cf4eeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:18.513566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3f287839-9446-4a40-a140-195a8cf4eeda None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:18.519598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3f287839-9446-4a40-a140-195a8cf4eeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:18.545489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd58d46-071f-4221-bb17-aa5793befd42 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:18.545718 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1499/3015] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:18.549581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6cd58d46-071f-4221-bb17-aa5793befd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:18.551717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f287839-9446-4a40-a140-195a8cf4eeda None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:18.567405 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f287839-9446-4a40-a140-195a8cf4eeda None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:18.575625 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd58d46-071f-4221-bb17-aa5793befd42 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:18.578620 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07a571-7ae6-42ca-b1f9-0cbc0770be3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:18.579371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07a571-7ae6-42ca-b1f9-0cbc0770be3b admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:18.579716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07a571-7ae6-42ca-b1f9-0cbc0770be3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:18.580069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07a571-7ae6-42ca-b1f9-0cbc0770be3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:18.580699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a07a571-7ae6-42ca-b1f9-0cbc0770be3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:17:18.581005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a07a571-7ae6-42ca-b1f9-0cbc0770be3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:18.584567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a07a571-7ae6-42ca-b1f9-0cbc0770be3b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:18.597498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc854b7-9277-4c37-a444-f880a855b089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:18.598250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc854b7-9277-4c37-a444-f880a855b089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:18.598533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc854b7-9277-4c37-a444-f880a855b089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:18.598793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc854b7-9277-4c37-a444-f880a855b089 admin admin] PATH_INFO: `/v3/projects/e1530b8294fc4dd4bc7e7b228ad2b95c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:18.604779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc854b7-9277-4c37-a444-f880a855b089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1530b8294fc4dd4bc7e7b228ad2b95c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:18.606964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc854b7-9277-4c37-a444-f880a855b089 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:18.628753 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1500/3016] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:17:18.629882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07a571-7ae6-42ca-b1f9-0cbc0770be3b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:18.667156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07a571-7ae6-42ca-b1f9-0cbc0770be3b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:18.682389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89d968-3402-4a5d-a459-abfde27642e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:18.683022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89d968-3402-4a5d-a459-abfde27642e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:18.683304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89d968-3402-4a5d-a459-abfde27642e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:18.683578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89d968-3402-4a5d-a459-abfde27642e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:18.684249 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd89d968-3402-4a5d-a459-abfde27642e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:18.686357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd89d968-3402-4a5d-a459-abfde27642e4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:18.745349 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2cc854b7-9277-4c37-a444-f880a855b089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1530b8294fc4dd4bc7e7b228ad2b95c', 'request_id': 'req-2cc854b7-9277-4c37-a444-f880a855b089'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:18.754360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2cc854b7-9277-4c37-a444-f880a855b089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1530b8294fc4dd4bc7e7b228ad2b95c', 'request_id': 'req-2cc854b7-9277-4c37-a444-f880a855b089'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:18.769847 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1501/3017] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:18 2022] POST /identity/v3/projects => generated 379 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:18.773196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2cc854b7-9277-4c37-a444-f880a855b089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1530b8294fc4dd4bc7e7b228ad2b95c', 'request_id': 'req-2cc854b7-9277-4c37-a444-f880a855b089'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:18.775940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89d968-3402-4a5d-a459-abfde27642e4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:18.791841 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2cc854b7-9277-4c37-a444-f880a855b089 admin admin] The token cache is being invalidate because project e1530b8294fc4dd4bc7e7b228ad2b95c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:18.792221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2cc854b7-9277-4c37-a444-f880a855b089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:18.793686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2cc854b7-9277-4c37-a444-f880a855b089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:18.795671 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1517/3018] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:18 2022] DELETE /identity/v3/projects/e1530b8294fc4dd4bc7e7b228ad2b95c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:17:18.811575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58afa5-a5b4-4fa8-8e6a-7d8916ba7d80 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:18.812639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58afa5-a5b4-4fa8-8e6a-7d8916ba7d80 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:18.812639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58afa5-a5b4-4fa8-8e6a-7d8916ba7d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:18.899554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6c58afa5-a5b4-4fa8-8e6a-7d8916ba7d80 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:18.904325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6c58afa5-a5b4-4fa8-8e6a-7d8916ba7d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:18.986470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89d968-3402-4a5d-a459-abfde27642e4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:18.994179 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d5510-c3c4-4ca2-b268-42acc9bd1758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:18.995040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d5510-c3c4-4ca2-b268-42acc9bd1758 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:18.995552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d5510-c3c4-4ca2-b268-42acc9bd1758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:18.996054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d5510-c3c4-4ca2-b268-42acc9bd1758 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:18.997089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d5510-c3c4-4ca2-b268-42acc9bd1758 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:19.000130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d5510-c3c4-4ca2-b268-42acc9bd1758 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:19.036545 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1502/3019] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:18 2022] POST /identity/v3/users => generated 290 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:19.041944 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d5510-c3c4-4ca2-b268-42acc9bd1758 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:19.055480 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1c5d5510-c3c4-4ca2-b268-42acc9bd1758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:19.086272 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1518/3020] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:19.088034 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58afa5-a5b4-4fa8-8e6a-7d8916ba7d80 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:19.106388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6c58afa5-a5b4-4fa8-8e6a-7d8916ba7d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:19.124202 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:19.156175 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58afa5-a5b4-4fa8-8e6a-7d8916ba7d80 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:19.164318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9545aec-82e0-4333-89ca-f87d39512e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:19.166009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9545aec-82e0-4333-89ca-f87d39512e4c admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:19.166569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9545aec-82e0-4333-89ca-f87d39512e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:19.167072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9545aec-82e0-4333-89ca-f87d39512e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:19.168504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9545aec-82e0-4333-89ca-f87d39512e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:19.171076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9545aec-82e0-4333-89ca-f87d39512e4c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:19.187014 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1519/3021] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:19.188763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71f1ac-4a33-430a-84a0-dcd3eeff66a9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:19.189316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71f1ac-4a33-430a-84a0-dcd3eeff66a9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:19.189830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71f1ac-4a33-430a-84a0-dcd3eeff66a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:19.195863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d5510-c3c4-4ca2-b268-42acc9bd1758 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:19.215419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb15c62-7f15-4783-a611-bebe44cc7ea1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:19.216120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb15c62-7f15-4783-a611-bebe44cc7ea1 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:19.216478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb15c62-7f15-4783-a611-bebe44cc7ea1 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:19.216767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb15c62-7f15-4783-a611-bebe44cc7ea1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:19.219782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ac71f1ac-4a33-430a-84a0-dcd3eeff66a9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:19.221841 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ac71f1ac-4a33-430a-84a0-dcd3eeff66a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:19.226212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4fb15c62-7f15-4783-a611-bebe44cc7ea1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:19.234231 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1520/3022] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:19.235585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71f1ac-4a33-430a-84a0-dcd3eeff66a9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:19.248701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71f1ac-4a33-430a-84a0-dcd3eeff66a9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:19.260952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d82613-46ce-414a-8670-46c5296c3237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:19.261675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d82613-46ce-414a-8670-46c5296c3237 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:19.261924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d82613-46ce-414a-8670-46c5296c3237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:19.262126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d82613-46ce-414a-8670-46c5296c3237 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:19.264538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d82613-46ce-414a-8670-46c5296c3237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:19.266457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d82613-46ce-414a-8670-46c5296c3237 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:19.289886 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1521/3023] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:19.291231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d82613-46ce-414a-8670-46c5296c3237 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:19.307855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d82613-46ce-414a-8670-46c5296c3237 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:19.318542 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302d973-661f-4ccd-9cc7-20b4c8f539b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:19.319427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302d973-661f-4ccd-9cc7-20b4c8f539b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:19.319926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302d973-661f-4ccd-9cc7-20b4c8f539b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:19.320325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302d973-661f-4ccd-9cc7-20b4c8f539b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:19.321389 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302d973-661f-4ccd-9cc7-20b4c8f539b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:17:19.321700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302d973-661f-4ccd-9cc7-20b4c8f539b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:19.323546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302d973-661f-4ccd-9cc7-20b4c8f539b4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:19.329990 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb15c62-7f15-4783-a611-bebe44cc7ea1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:19.331749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb15c62-7f15-4783-a611-bebe44cc7ea1 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:19.343396 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1522/3024] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:17:19.343396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302d973-661f-4ccd-9cc7-20b4c8f539b4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:19.352191 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1503/3025] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:19 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:19.353654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb15c62-7f15-4783-a611-bebe44cc7ea1 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:19.364835 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302d973-661f-4ccd-9cc7-20b4c8f539b4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:19.373117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5115c24-4267-4226-a850-152cbf86dfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:19.373980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5115c24-4267-4226-a850-152cbf86dfe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:19.374317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5115c24-4267-4226-a850-152cbf86dfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:19.378712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5115c24-4267-4226-a850-152cbf86dfe4 admin admin] PATH_INFO: `/v3/projects/010990a44647402c9a355de2ec0176a7/users/bd2118b664634f1297fe908f30609f42/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:19.382242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb15c62-7f15-4783-a611-bebe44cc7ea1 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:19.388352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898295e2-3e01-43e9-9ddd-25e0151989f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:19.388964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898295e2-3e01-43e9-9ddd-25e0151989f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:19.389486 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:19.389696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898295e2-3e01-43e9-9ddd-25e0151989f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:19.389970 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898295e2-3e01-43e9-9ddd-25e0151989f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:19.390748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898295e2-3e01-43e9-9ddd-25e0151989f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:19.392800 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898295e2-3e01-43e9-9ddd-25e0151989f8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:19.393960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5115c24-4267-4226-a850-152cbf86dfe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=010990a44647402c9a355de2ec0176a7, user_id=bd2118b664634f1297fe908f30609f42, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:19.397932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5115c24-4267-4226-a850-152cbf86dfe4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:19.439688 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1504/3026] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:19 2022] POST /identity/v3/projects => generated 385 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:19.439688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898295e2-3e01-43e9-9ddd-25e0151989f8 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:19.439688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-898295e2-3e01-43e9-9ddd-25e0151989f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:19.449753 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1523/3027] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:19 2022] PUT /identity/v3/projects/010990a44647402c9a355de2ec0176a7/users/bd2118b664634f1297fe908f30609f42/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:19.450807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5115c24-4267-4226-a850-152cbf86dfe4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:19.637166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5115c24-4267-4226-a850-152cbf86dfe4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:19.654530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d7e5b-f68c-4e88-9e33-e9254185f2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:19.655168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d7e5b-f68c-4e88-9e33-e9254185f2c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:19.655451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d7e5b-f68c-4e88-9e33-e9254185f2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:19.655722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d7e5b-f68c-4e88-9e33-e9254185f2c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:19.656386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d7e5b-f68c-4e88-9e33-e9254185f2c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:19.658679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d7e5b-f68c-4e88-9e33-e9254185f2c5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:19.678857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898295e2-3e01-43e9-9ddd-25e0151989f8 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:19.694493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24215a57-78ac-468e-ad14-6519a47554dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:19.695158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24215a57-78ac-468e-ad14-6519a47554dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:19.695443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24215a57-78ac-468e-ad14-6519a47554dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:19.695724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24215a57-78ac-468e-ad14-6519a47554dd admin admin] PATH_INFO: `/v3/users/a0cfe8884b8b49c8b38c4e91d77e994e` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:19.697893 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24215a57-78ac-468e-ad14-6519a47554dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0cfe8884b8b49c8b38c4e91d77e994e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:19.705147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24215a57-78ac-468e-ad14-6519a47554dd admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:19.739509 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1524/3028] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:19 2022] POST /identity/v3/users => generated 293 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:19.740934 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc972a6e-2075-4b0b-938c-109dadeae65d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:19.741219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc972a6e-2075-4b0b-938c-109dadeae65d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:19.741496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc972a6e-2075-4b0b-938c-109dadeae65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:19.809785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-dc972a6e-2075-4b0b-938c-109dadeae65d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:19.811203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dc972a6e-2075-4b0b-938c-109dadeae65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:19.840178 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1525/3029] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:19.840859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc972a6e-2075-4b0b-938c-109dadeae65d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:19.847903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-24215a57-78ac-468e-ad14-6519a47554dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0cfe8884b8b49c8b38c4e91d77e994e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:19.849414 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:19.863652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-24215a57-78ac-468e-ad14-6519a47554dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0cfe8884b8b49c8b38c4e91d77e994e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:19.870561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc972a6e-2075-4b0b-938c-109dadeae65d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:19.890775 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c0cb1-2fe6-45e2-96c5-61d954ac91f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:19.891375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c0cb1-2fe6-45e2-96c5-61d954ac91f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:19.891674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c0cb1-2fe6-45e2-96c5-61d954ac91f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:19.891976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c0cb1-2fe6-45e2-96c5-61d954ac91f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:19.892891 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c0cb1-2fe6-45e2-96c5-61d954ac91f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:19.895031 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c0cb1-2fe6-45e2-96c5-61d954ac91f7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:19.896568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-24215a57-78ac-468e-ad14-6519a47554dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0cfe8884b8b49c8b38c4e91d77e994e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:19.898896 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-24215a57-78ac-468e-ad14-6519a47554dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0cfe8884b8b49c8b38c4e91d77e994e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:19.916974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-24215a57-78ac-468e-ad14-6519a47554dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0cfe8884b8b49c8b38c4e91d77e994e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:19.925171 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1526/3030] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:19.925171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c0cb1-2fe6-45e2-96c5-61d954ac91f7 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:19.928952 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1505/3031] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:19 2022] DELETE /identity/v3/users/a0cfe8884b8b49c8b38c4e91d77e994e => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:19.932402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b11c0cb1-2fe6-45e2-96c5-61d954ac91f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:19.934393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24215a57-78ac-468e-ad14-6519a47554dd admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:19.943434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-24215a57-78ac-468e-ad14-6519a47554dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:20.135481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c0cb1-2fe6-45e2-96c5-61d954ac91f7 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:20.161781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24215a57-78ac-468e-ad14-6519a47554dd admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:20.171911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa254b51-d247-4314-9a47-fd00a7960646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:20.173116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa254b51-d247-4314-9a47-fd00a7960646 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:20.173404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa254b51-d247-4314-9a47-fd00a7960646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:20.173677 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa254b51-d247-4314-9a47-fd00a7960646 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:20.174338 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa254b51-d247-4314-9a47-fd00a7960646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:20.180734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa254b51-d247-4314-9a47-fd00a7960646 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:20.199447 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1506/3032] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:20.199447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2a663-c60e-4dbc-8e71-c097f901f966 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:20.199447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2a663-c60e-4dbc-8e71-c097f901f966 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:20.199447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2a663-c60e-4dbc-8e71-c097f901f966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:20.254037 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-97a2a663-c60e-4dbc-8e71-c097f901f966 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:20.257564 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-97a2a663-c60e-4dbc-8e71-c097f901f966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:20.283294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8461f-281a-4bfb-bd63-142dd5eedba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:20.285299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8461f-281a-4bfb-bd63-142dd5eedba3 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:20.285420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8461f-281a-4bfb-bd63-142dd5eedba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:20.285601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8461f-281a-4bfb-bd63-142dd5eedba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:20.298059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d7d8461f-281a-4bfb-bd63-142dd5eedba3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:20.299270 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1507/3033] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:20.300891 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2a663-c60e-4dbc-8e71-c097f901f966 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:20.325190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8461f-281a-4bfb-bd63-142dd5eedba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:20.326761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8461f-281a-4bfb-bd63-142dd5eedba3 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:20.327774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2a663-c60e-4dbc-8e71-c097f901f966 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:20.343622 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1527/3034] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:20.344262 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b7671-e58f-402e-8627-b5b2d551b050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:20.344444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8461f-281a-4bfb-bd63-142dd5eedba3 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:20.345874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b7671-e58f-402e-8627-b5b2d551b050 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:20.346375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b7671-e58f-402e-8627-b5b2d551b050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:20.348046 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b7671-e58f-402e-8627-b5b2d551b050 admin admin] PATH_INFO: `/v3/projects/4b4cbb3c65be44668687983c0a76901c/users/4a359309c39a49c98f1f7aea48189efa/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:20.371688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8461f-281a-4bfb-bd63-142dd5eedba3 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:20.385761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b7671-e58f-402e-8627-b5b2d551b050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b4cbb3c65be44668687983c0a76901c, user_id=4a359309c39a49c98f1f7aea48189efa, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:20.389151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26805a-6964-4f86-af85-22f50359555a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:20.397461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26805a-6964-4f86-af85-22f50359555a service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:20.401127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26805a-6964-4f86-af85-22f50359555a service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:20.401460 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26805a-6964-4f86-af85-22f50359555a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:20.402084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b7671-e58f-402e-8627-b5b2d551b050 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:20.449814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26805a-6964-4f86-af85-22f50359555a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:20.455019 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1508/3035] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:20 2022] PUT /identity/v3/projects/4b4cbb3c65be44668687983c0a76901c/users/4a359309c39a49c98f1f7aea48189efa/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:20.455789 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26805a-6964-4f86-af85-22f50359555a service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:20.461697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fde6f-5227-43e3-b135-b218543bd992 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:20.462043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fde6f-5227-43e3-b135-b218543bd992 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:20.462878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fde6f-5227-43e3-b135-b218543bd992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:20.502688 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1528/3036] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:20.517004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-087fde6f-5227-43e3-b135-b218543bd992 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:20.520752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-087fde6f-5227-43e3-b135-b218543bd992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:20.740209 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1509/3037] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:20.762545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26805a-6964-4f86-af85-22f50359555a service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:20.794478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26805a-6964-4f86-af85-22f50359555a service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:20.811865 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:21.030753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c70521-87d7-40d0-8ff0-1c10d0b003f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:21.040716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c70521-87d7-40d0-8ff0-1c10d0b003f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:21.041422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c70521-87d7-40d0-8ff0-1c10d0b003f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:21.042942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c70521-87d7-40d0-8ff0-1c10d0b003f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:21.089935 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c70521-87d7-40d0-8ff0-1c10d0b003f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:21.092600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c70521-87d7-40d0-8ff0-1c10d0b003f5 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:21.124921 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1529/3038] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:21.541202 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fde6f-5227-43e3-b135-b218543bd992 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:21.545019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-087fde6f-5227-43e3-b135-b218543bd992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:21.637491 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:21.739485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fde6f-5227-43e3-b135-b218543bd992 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:21.754902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9024c-0c15-4d85-b701-e22694ce5b23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:21.756517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9024c-0c15-4d85-b701-e22694ce5b23 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:21.757121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9024c-0c15-4d85-b701-e22694ce5b23 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:21.757743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9024c-0c15-4d85-b701-e22694ce5b23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:21.761484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-99e9024c-0c15-4d85-b701-e22694ce5b23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:22.044557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9024c-0c15-4d85-b701-e22694ce5b23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:22.055092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9024c-0c15-4d85-b701-e22694ce5b23 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:22.160355 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1510/3039] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:21 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:22.187260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c70521-87d7-40d0-8ff0-1c10d0b003f5 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:22.189870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-50c70521-87d7-40d0-8ff0-1c10d0b003f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:22.229711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c70521-87d7-40d0-8ff0-1c10d0b003f5 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:22.246832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b327f24-5df9-40d3-bb02-04c2f1410a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:22.247561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b327f24-5df9-40d3-bb02-04c2f1410a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:22.247931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b327f24-5df9-40d3-bb02-04c2f1410a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:22.248414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b327f24-5df9-40d3-bb02-04c2f1410a2e admin admin] PATH_INFO: `/v3/projects/2389688d1f844f46a38347db9de6bdf0` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:22.250306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b327f24-5df9-40d3-bb02-04c2f1410a2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2389688d1f844f46a38347db9de6bdf0)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:22.256624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b327f24-5df9-40d3-bb02-04c2f1410a2e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:22.415069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6b327f24-5df9-40d3-bb02-04c2f1410a2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2389688d1f844f46a38347db9de6bdf0', 'request_id': 'req-6b327f24-5df9-40d3-bb02-04c2f1410a2e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:22.423678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6b327f24-5df9-40d3-bb02-04c2f1410a2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2389688d1f844f46a38347db9de6bdf0', 'request_id': 'req-6b327f24-5df9-40d3-bb02-04c2f1410a2e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:22.437006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6b327f24-5df9-40d3-bb02-04c2f1410a2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2389688d1f844f46a38347db9de6bdf0', 'request_id': 'req-6b327f24-5df9-40d3-bb02-04c2f1410a2e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:22.497638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6b327f24-5df9-40d3-bb02-04c2f1410a2e admin admin] The token cache is being invalidate because project 2389688d1f844f46a38347db9de6bdf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:22.498052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6b327f24-5df9-40d3-bb02-04c2f1410a2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:22.499400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6b327f24-5df9-40d3-bb02-04c2f1410a2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:22.501455 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1530/3040] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:22 2022] DELETE /identity/v3/projects/2389688d1f844f46a38347db9de6bdf0 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:22.506940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9024c-0c15-4d85-b701-e22694ce5b23 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:22.533002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9024c-0c15-4d85-b701-e22694ce5b23 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:22.693246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac402e1-0ecd-44f5-a42e-52f3d409dd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:22.694592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac402e1-0ecd-44f5-a42e-52f3d409dd25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:22.694880 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac402e1-0ecd-44f5-a42e-52f3d409dd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:22.695157 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac402e1-0ecd-44f5-a42e-52f3d409dd25 admin admin] PATH_INFO: `/v3/users/1dfb28a136c6409f8cc9d8690fca7a25` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:22.697164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac402e1-0ecd-44f5-a42e-52f3d409dd25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dfb28a136c6409f8cc9d8690fca7a25)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:22.700137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac402e1-0ecd-44f5-a42e-52f3d409dd25 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:22.786005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9ac402e1-0ecd-44f5-a42e-52f3d409dd25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dfb28a136c6409f8cc9d8690fca7a25'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:22.805528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9ac402e1-0ecd-44f5-a42e-52f3d409dd25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dfb28a136c6409f8cc9d8690fca7a25'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:22.821641 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:22.840993 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9ac402e1-0ecd-44f5-a42e-52f3d409dd25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dfb28a136c6409f8cc9d8690fca7a25'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:22.844033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9ac402e1-0ecd-44f5-a42e-52f3d409dd25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dfb28a136c6409f8cc9d8690fca7a25'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:22.856845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9ac402e1-0ecd-44f5-a42e-52f3d409dd25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dfb28a136c6409f8cc9d8690fca7a25'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:22.910640 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1511/3041] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:22 2022] DELETE /identity/v3/users/1dfb28a136c6409f8cc9d8690fca7a25 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:24.225298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b327f24-5df9-40d3-bb02-04c2f1410a2e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:24.230168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6b327f24-5df9-40d3-bb02-04c2f1410a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:24.288167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b327f24-5df9-40d3-bb02-04c2f1410a2e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:24.501660 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd8e992-b4f9-4546-9923-6675c33afa02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:24.505266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8e992-b4f9-4546-9923-6675c33afa02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:24.505620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8e992-b4f9-4546-9923-6675c33afa02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:24.505951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8e992-b4f9-4546-9923-6675c33afa02 admin admin] PATH_INFO: `/v3/projects/bab7eb6f1db14b5db9d732ac7e240fa7` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:24.507264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd8e992-b4f9-4546-9923-6675c33afa02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bab7eb6f1db14b5db9d732ac7e240fa7)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:24.509260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd8e992-b4f9-4546-9923-6675c33afa02 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:24.523029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02099ce8-34db-4423-9050-5c22b6428547 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:24.524409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02099ce8-34db-4423-9050-5c22b6428547 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:24.524765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02099ce8-34db-4423-9050-5c22b6428547 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:24.526882 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1512/3042] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 01:17:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:17:24.533610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac057cc-3df2-406e-8d66-416ce221a8bf None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:24.533880 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac057cc-3df2-406e-8d66-416ce221a8bf None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:24.534163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac057cc-3df2-406e-8d66-416ce221a8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:24.619822 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:24.641926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1ac057cc-3df2-406e-8d66-416ce221a8bf None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:24.643216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1ac057cc-3df2-406e-8d66-416ce221a8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:24.649651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5cd8e992-b4f9-4546-9923-6675c33afa02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bab7eb6f1db14b5db9d732ac7e240fa7', 'request_id': 'req-5cd8e992-b4f9-4546-9923-6675c33afa02'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:24.666351 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5cd8e992-b4f9-4546-9923-6675c33afa02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bab7eb6f1db14b5db9d732ac7e240fa7', 'request_id': 'req-5cd8e992-b4f9-4546-9923-6675c33afa02'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:24.690365 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5cd8e992-b4f9-4546-9923-6675c33afa02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bab7eb6f1db14b5db9d732ac7e240fa7', 'request_id': 'req-5cd8e992-b4f9-4546-9923-6675c33afa02'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:24.715860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5cd8e992-b4f9-4546-9923-6675c33afa02 admin admin] The token cache is being invalidate because project bab7eb6f1db14b5db9d732ac7e240fa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:24.716182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5cd8e992-b4f9-4546-9923-6675c33afa02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:24.720132 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5cd8e992-b4f9-4546-9923-6675c33afa02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:24.728752 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1531/3043] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:24 2022] DELETE /identity/v3/projects/bab7eb6f1db14b5db9d732ac7e240fa7 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:24.730840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e215672-301d-4d2d-b1c6-9338e1106029 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:24.731126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e215672-301d-4d2d-b1c6-9338e1106029 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:24.731672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e215672-301d-4d2d-b1c6-9338e1106029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:24.789270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-4e215672-301d-4d2d-b1c6-9338e1106029 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:24.797514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4e215672-301d-4d2d-b1c6-9338e1106029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:24.884397 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1513/3044] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 01:17:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:24.921284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac057cc-3df2-406e-8d66-416ce221a8bf None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:24.922829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1ac057cc-3df2-406e-8d66-416ce221a8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:24.967514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac057cc-3df2-406e-8d66-416ce221a8bf None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:24.994891 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255c691-ee23-43d0-bd44-373ce202c7ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:24.995807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255c691-ee23-43d0-bd44-373ce202c7ac service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:24.996215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255c691-ee23-43d0-bd44-373ce202c7ac service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:24.996620 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255c691-ee23-43d0-bd44-373ce202c7ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:25.036152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255c691-ee23-43d0-bd44-373ce202c7ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:25.040836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255c691-ee23-43d0-bd44-373ce202c7ac service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:25.042561 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1532/3045] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:25.052675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df236e07-66f3-4ba3-aa17-dfc454b06252 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:25.053111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df236e07-66f3-4ba3-aa17-dfc454b06252 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:25.053494 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df236e07-66f3-4ba3-aa17-dfc454b06252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:25.061134 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1514/3046] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:25.119035 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-df236e07-66f3-4ba3-aa17-dfc454b06252 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:25.121479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-df236e07-66f3-4ba3-aa17-dfc454b06252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:25.146143 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1533/3047] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:25.151251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255c691-ee23-43d0-bd44-373ce202c7ac service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:25.188939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255c691-ee23-43d0-bd44-373ce202c7ac service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:25.217429 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da0577-dfbe-483e-800e-cca55346152c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:25.231512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da0577-dfbe-483e-800e-cca55346152c admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:25.237092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da0577-dfbe-483e-800e-cca55346152c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:25.238219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da0577-dfbe-483e-800e-cca55346152c admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:25.243539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da0577-dfbe-483e-800e-cca55346152c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:17:25.245502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da0577-dfbe-483e-800e-cca55346152c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:25.247776 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da0577-dfbe-483e-800e-cca55346152c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:25.348748 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1515/3048] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:17:25.353883 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df236e07-66f3-4ba3-aa17-dfc454b06252 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:25.385817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df236e07-66f3-4ba3-aa17-dfc454b06252 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:25.399189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c611c-b39f-45a7-8bb8-6b0bf90ca5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:25.401489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c611c-b39f-45a7-8bb8-6b0bf90ca5a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:25.401923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c611c-b39f-45a7-8bb8-6b0bf90ca5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:25.403975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c611c-b39f-45a7-8bb8-6b0bf90ca5a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:25.405070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c611c-b39f-45a7-8bb8-6b0bf90ca5a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:25.412649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c611c-b39f-45a7-8bb8-6b0bf90ca5a3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:25.507544 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1534/3049] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:25 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:25.513210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da0577-dfbe-483e-800e-cca55346152c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:25.532105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da0577-dfbe-483e-800e-cca55346152c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:25.600185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c611c-b39f-45a7-8bb8-6b0bf90ca5a3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:25.667787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6dd6f2-285c-40ec-b87e-b12c546c8d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:25.668904 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dd6f2-285c-40ec-b87e-b12c546c8d74 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:25.669280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dd6f2-285c-40ec-b87e-b12c546c8d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:25.669741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dd6f2-285c-40ec-b87e-b12c546c8d74 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:25.671083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6dd6f2-285c-40ec-b87e-b12c546c8d74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:25.673498 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6dd6f2-285c-40ec-b87e-b12c546c8d74 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:25.735205 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1516/3050] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:25 2022] POST /identity/v3/users => generated 292 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:25.742106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6dd6f2-285c-40ec-b87e-b12c546c8d74 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:25.769421 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6dd6f2-285c-40ec-b87e-b12c546c8d74 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:25.787811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbca79a-d426-484a-922e-82210fe17a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:25.788849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbca79a-d426-484a-922e-82210fe17a6b admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:25.789013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbca79a-d426-484a-922e-82210fe17a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:25.789306 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbca79a-d426-484a-922e-82210fe17a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:25.790064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbca79a-d426-484a-922e-82210fe17a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:25.792002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbca79a-d426-484a-922e-82210fe17a6b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:25.803516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c611c-b39f-45a7-8bb8-6b0bf90ca5a3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:25.813733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9c836-eafa-441d-8e3c-77229b31b671 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:25.814722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9c836-eafa-441d-8e3c-77229b31b671 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:25.815170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9c836-eafa-441d-8e3c-77229b31b671 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:25.815637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9c836-eafa-441d-8e3c-77229b31b671 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:25.823857 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1517/3051] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:25.828423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbca79a-d426-484a-922e-82210fe17a6b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:25.829876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e0e9c836-eafa-441d-8e3c-77229b31b671 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:25.857896 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbca79a-d426-484a-922e-82210fe17a6b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:25.858460 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9c836-eafa-441d-8e3c-77229b31b671 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:25.860550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9c836-eafa-441d-8e3c-77229b31b671 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:25.871412 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050274b6-5b30-43b4-b558-dbbae6426188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:25.872376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050274b6-5b30-43b4-b558-dbbae6426188 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:25.872923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050274b6-5b30-43b4-b558-dbbae6426188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:25.873501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050274b6-5b30-43b4-b558-dbbae6426188 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:25.874588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050274b6-5b30-43b4-b558-dbbae6426188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:25.881332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050274b6-5b30-43b4-b558-dbbae6426188 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:25.913240 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1535/3052] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:17:25.919011 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1518/3053] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:25.922480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9c836-eafa-441d-8e3c-77229b31b671 service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:25.956170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9c836-eafa-441d-8e3c-77229b31b671 service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:25.987802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c983d6-4a2a-4e30-8bd1-b11133f39999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:25.988699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c983d6-4a2a-4e30-8bd1-b11133f39999 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:25.989096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c983d6-4a2a-4e30-8bd1-b11133f39999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:25.989449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c983d6-4a2a-4e30-8bd1-b11133f39999 admin admin] PATH_INFO: `/v3/projects/bc6a995089fa447e8f74df7d111b1c6b/users/5080c88d51a8455bba8b70e33cca958b/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:26.025764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c983d6-4a2a-4e30-8bd1-b11133f39999 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc6a995089fa447e8f74df7d111b1c6b, user_id=5080c88d51a8455bba8b70e33cca958b, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:26.029426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c983d6-4a2a-4e30-8bd1-b11133f39999 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:26.047562 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1536/3054] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:25 2022] PUT /identity/v3/projects/bc6a995089fa447e8f74df7d111b1c6b/users/5080c88d51a8455bba8b70e33cca958b/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:17:26.052558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab1b2f-7685-4645-b90c-f5157b709098 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:26.053312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab1b2f-7685-4645-b90c-f5157b709098 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:26.053803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab1b2f-7685-4645-b90c-f5157b709098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:26.084311 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:26.096958 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-25ab1b2f-7685-4645-b90c-f5157b709098 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:26.098660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-25ab1b2f-7685-4645-b90c-f5157b709098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:26.284951 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1519/3055] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:26.299059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c983d6-4a2a-4e30-8bd1-b11133f39999 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:26.302645 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-02c983d6-4a2a-4e30-8bd1-b11133f39999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:26.319754 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:26.517248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c983d6-4a2a-4e30-8bd1-b11133f39999 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:26.542084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382a982-fbde-4f43-92a6-b2c1b067d0fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:26.543059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382a982-fbde-4f43-92a6-b2c1b067d0fe service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:26.543543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382a982-fbde-4f43-92a6-b2c1b067d0fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:26.544162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382a982-fbde-4f43-92a6-b2c1b067d0fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:26.581439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382a982-fbde-4f43-92a6-b2c1b067d0fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:26.583145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382a982-fbde-4f43-92a6-b2c1b067d0fe service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:26.617610 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1537/3056] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:31.824654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab1b2f-7685-4645-b90c-f5157b709098 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:31.829735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-25ab1b2f-7685-4645-b90c-f5157b709098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:32.108796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab1b2f-7685-4645-b90c-f5157b709098 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:32.129517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99f81d-398f-4fe2-b08e-a99994933f5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:32.130729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99f81d-398f-4fe2-b08e-a99994933f5e service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:32.132435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99f81d-398f-4fe2-b08e-a99994933f5e service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:32.135014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99f81d-398f-4fe2-b08e-a99994933f5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:32.140216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ed99f81d-398f-4fe2-b08e-a99994933f5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:32.354644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99f81d-398f-4fe2-b08e-a99994933f5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:32.361978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed99f81d-398f-4fe2-b08e-a99994933f5e service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:32.426907 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1520/3057] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:31 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:35.124762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0d2a9-27da-4911-9f61-f39bf5efbcf3 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:35.126404 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0d2a9-27da-4911-9f61-f39bf5efbcf3 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:35.127207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0d2a9-27da-4911-9f61-f39bf5efbcf3 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:35.130211 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1538/3058] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 01:17:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:17:35.140544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2570d-5ef6-46fb-ba85-0e9f6efcfef0 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:35.148491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2570d-5ef6-46fb-ba85-0e9f6efcfef0 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:35.151346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2570d-5ef6-46fb-ba85-0e9f6efcfef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:35.205955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9dc2570d-5ef6-46fb-ba85-0e9f6efcfef0 None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:35.208868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9dc2570d-5ef6-46fb-ba85-0e9f6efcfef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:35.357950 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:35.455112 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1521/3059] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 01:17:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:35.503809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0d2a9-27da-4911-9f61-f39bf5efbcf3 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:35.506651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-bcd0d2a9-27da-4911-9f61-f39bf5efbcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:35.586768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0d2a9-27da-4911-9f61-f39bf5efbcf3 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:35.619916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705911d-6e9e-453b-872e-6994f9fad255 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:35.627514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705911d-6e9e-453b-872e-6994f9fad255 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:35.631051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705911d-6e9e-453b-872e-6994f9fad255 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:35.632041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705911d-6e9e-453b-872e-6994f9fad255 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:35.676990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705911d-6e9e-453b-872e-6994f9fad255 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:35.680515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705911d-6e9e-453b-872e-6994f9fad255 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:35.750484 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1539/3060] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:35.761109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2570d-5ef6-46fb-ba85-0e9f6efcfef0 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:35.811557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2570d-5ef6-46fb-ba85-0e9f6efcfef0 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:35.858822 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0283b8-968f-4194-8895-78cbb28eeea9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:35.860289 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0283b8-968f-4194-8895-78cbb28eeea9 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:35.868559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0283b8-968f-4194-8895-78cbb28eeea9 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:35.869320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0283b8-968f-4194-8895-78cbb28eeea9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:35.881296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bb0283b8-968f-4194-8895-78cbb28eeea9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:35.982102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0283b8-968f-4194-8895-78cbb28eeea9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:35.988757 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0283b8-968f-4194-8895-78cbb28eeea9 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:36.069897 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1522/3061] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:39.123846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705911d-6e9e-453b-872e-6994f9fad255 service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:39.139511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705911d-6e9e-453b-872e-6994f9fad255 service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:39.145955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aff0a4-6379-480f-8dd9-3195fd69f788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:39.148082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aff0a4-6379-480f-8dd9-3195fd69f788 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:39.148670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aff0a4-6379-480f-8dd9-3195fd69f788 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:39.149198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aff0a4-6379-480f-8dd9-3195fd69f788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:39.153437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-34aff0a4-6379-480f-8dd9-3195fd69f788 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:39.173535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aff0a4-6379-480f-8dd9-3195fd69f788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:39.175780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aff0a4-6379-480f-8dd9-3195fd69f788 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:39.189968 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1540/3062] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:40.809608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983dce03-7ff6-4e75-97d0-d64585abe49a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:40.811271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983dce03-7ff6-4e75-97d0-d64585abe49a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:40.812009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983dce03-7ff6-4e75-97d0-d64585abe49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:40.891043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-983dce03-7ff6-4e75-97d0-d64585abe49a None None] MFA Rules not processed for user `4a359309c39a49c98f1f7aea48189efa`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:40.902606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-983dce03-7ff6-4e75-97d0-d64585abe49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:41.122948 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1523/3063] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:17:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:17:41.130121 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6742b7-7fe7-4a89-ac07-5d45b585e965 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:41.133719 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6742b7-7fe7-4a89-ac07-5d45b585e965 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:41.134501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6742b7-7fe7-4a89-ac07-5d45b585e965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:41.185241 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1e6742b7-7fe7-4a89-ac07-5d45b585e965 None None] MFA Rules not processed for user `4a359309c39a49c98f1f7aea48189efa`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:41.188346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1e6742b7-7fe7-4a89-ac07-5d45b585e965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:41.208564 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1541/3064] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:17:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:42.014694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983dce03-7ff6-4e75-97d0-d64585abe49a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:42.016633 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-983dce03-7ff6-4e75-97d0-d64585abe49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:42.137333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983dce03-7ff6-4e75-97d0-d64585abe49a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:42.194344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b93db7-75c8-4942-8f1f-14d03ee1bf02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:42.195246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b93db7-75c8-4942-8f1f-14d03ee1bf02 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:42.195524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b93db7-75c8-4942-8f1f-14d03ee1bf02 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:42.195797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b93db7-75c8-4942-8f1f-14d03ee1bf02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:42.267396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b93db7-75c8-4942-8f1f-14d03ee1bf02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:42.276932 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b93db7-75c8-4942-8f1f-14d03ee1bf02 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:42.326994 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1524/3065] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:44.047041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6742b7-7fe7-4a89-ac07-5d45b585e965 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:44.050128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1e6742b7-7fe7-4a89-ac07-5d45b585e965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:44.106505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6742b7-7fe7-4a89-ac07-5d45b585e965 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:44.123373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dddb16-7d3e-4aeb-99d1-9aa3dd63ffe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:44.124654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dddb16-7d3e-4aeb-99d1-9aa3dd63ffe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:44.127469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dddb16-7d3e-4aeb-99d1-9aa3dd63ffe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:44.128540 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dddb16-7d3e-4aeb-99d1-9aa3dd63ffe4 admin admin] PATH_INFO: `/v3/users/0af4775c28774015bc168bbcfc9b784d` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:44.138009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dddb16-7d3e-4aeb-99d1-9aa3dd63ffe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0af4775c28774015bc168bbcfc9b784d)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:44.149388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dddb16-7d3e-4aeb-99d1-9aa3dd63ffe4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:44.323380 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e6dddb16-7d3e-4aeb-99d1-9aa3dd63ffe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0af4775c28774015bc168bbcfc9b784d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:44.364629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e6dddb16-7d3e-4aeb-99d1-9aa3dd63ffe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0af4775c28774015bc168bbcfc9b784d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:44.441981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e6dddb16-7d3e-4aeb-99d1-9aa3dd63ffe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0af4775c28774015bc168bbcfc9b784d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:44.443201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e6dddb16-7d3e-4aeb-99d1-9aa3dd63ffe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0af4775c28774015bc168bbcfc9b784d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:44.462020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e6dddb16-7d3e-4aeb-99d1-9aa3dd63ffe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0af4775c28774015bc168bbcfc9b784d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:44.477346 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1542/3066] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:17:44 2022] DELETE /identity/v3/users/0af4775c28774015bc168bbcfc9b784d => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:45.295859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b93db7-75c8-4942-8f1f-14d03ee1bf02 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:45.309235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b93db7-75c8-4942-8f1f-14d03ee1bf02 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:45.560274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183f856-3c38-486e-a020-8f2a5c255e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:45.560915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183f856-3c38-486e-a020-8f2a5c255e2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:45.561184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183f856-3c38-486e-a020-8f2a5c255e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:45.565015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183f856-3c38-486e-a020-8f2a5c255e2a admin admin] PATH_INFO: `/v3/projects/65b47199573142cfabb119e111b69c9d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:45.569595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183f856-3c38-486e-a020-8f2a5c255e2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=65b47199573142cfabb119e111b69c9d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:45.573793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183f856-3c38-486e-a020-8f2a5c255e2a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:45.766619 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:45.818444 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d183f856-3c38-486e-a020-8f2a5c255e2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65b47199573142cfabb119e111b69c9d', 'request_id': 'req-d183f856-3c38-486e-a020-8f2a5c255e2a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:45.857527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d183f856-3c38-486e-a020-8f2a5c255e2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65b47199573142cfabb119e111b69c9d', 'request_id': 'req-d183f856-3c38-486e-a020-8f2a5c255e2a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:45.903691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d183f856-3c38-486e-a020-8f2a5c255e2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65b47199573142cfabb119e111b69c9d', 'request_id': 'req-d183f856-3c38-486e-a020-8f2a5c255e2a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:45.953575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d183f856-3c38-486e-a020-8f2a5c255e2a admin admin] The token cache is being invalidate because project 65b47199573142cfabb119e111b69c9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:17:45.967067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d183f856-3c38-486e-a020-8f2a5c255e2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:45.967067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d183f856-3c38-486e-a020-8f2a5c255e2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:17:45.970880 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1525/3067] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:17:45 2022] DELETE /identity/v3/projects/65b47199573142cfabb119e111b69c9d => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:45.979771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe864d0-5240-49ba-ad69-fed196d8195d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:45.980315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe864d0-5240-49ba-ad69-fed196d8195d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:45.980413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe864d0-5240-49ba-ad69-fed196d8195d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:46.044422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6fe864d0-5240-49ba-ad69-fed196d8195d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:46.049903 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6fe864d0-5240-49ba-ad69-fed196d8195d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:46.211277 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:46.338207 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1543/3068] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:46.344845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af756d3a-7353-4bdb-88f2-fa57d31daaeb None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:46.345348 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af756d3a-7353-4bdb-88f2-fa57d31daaeb None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:46.345348 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af756d3a-7353-4bdb-88f2-fa57d31daaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:46.407597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-af756d3a-7353-4bdb-88f2-fa57d31daaeb None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:46.409370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-af756d3a-7353-4bdb-88f2-fa57d31daaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:46.452660 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1526/3069] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:46.456176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe864d0-5240-49ba-ad69-fed196d8195d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:46.507589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe864d0-5240-49ba-ad69-fed196d8195d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:46.537285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567d13f-1e01-499f-b8db-f8d234ba4c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:46.537925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567d13f-1e01-499f-b8db-f8d234ba4c76 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:46.538199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567d13f-1e01-499f-b8db-f8d234ba4c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:46.538471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567d13f-1e01-499f-b8db-f8d234ba4c76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:46.539318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567d13f-1e01-499f-b8db-f8d234ba4c76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:17:46.539817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567d13f-1e01-499f-b8db-f8d234ba4c76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:46.542439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567d13f-1e01-499f-b8db-f8d234ba4c76 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:46.594873 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1544/3070] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:17:46.596402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af756d3a-7353-4bdb-88f2-fa57d31daaeb None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:46.610688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af756d3a-7353-4bdb-88f2-fa57d31daaeb None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:46.648874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749a805-0dd9-426a-84ce-17cc594d4f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:46.649509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749a805-0dd9-426a-84ce-17cc594d4f4e admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:46.649784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749a805-0dd9-426a-84ce-17cc594d4f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:46.662333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749a805-0dd9-426a-84ce-17cc594d4f4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:46.666487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749a805-0dd9-426a-84ce-17cc594d4f4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:46.672005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749a805-0dd9-426a-84ce-17cc594d4f4e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:46.767755 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1527/3071] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:46 2022] POST /identity/v3/projects => generated 365 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:46.772574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567d13f-1e01-499f-b8db-f8d234ba4c76 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:46.788735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567d13f-1e01-499f-b8db-f8d234ba4c76 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:46.992739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc167f-823d-4b22-bf95-3e04f8a973c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:46.993462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc167f-823d-4b22-bf95-3e04f8a973c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:46.993681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc167f-823d-4b22-bf95-3e04f8a973c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:46.994021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc167f-823d-4b22-bf95-3e04f8a973c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:46.994766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc167f-823d-4b22-bf95-3e04f8a973c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:47.000371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc167f-823d-4b22-bf95-3e04f8a973c7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:47.066661 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1545/3072] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:46 2022] POST /identity/v3/users => generated 283 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:47.072056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749a805-0dd9-426a-84ce-17cc594d4f4e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:47.091931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749a805-0dd9-426a-84ce-17cc594d4f4e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:47.113513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c512f13-4136-42d4-b5d2-c1bb364af176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:47.114146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c512f13-4136-42d4-b5d2-c1bb364af176 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:47.114411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c512f13-4136-42d4-b5d2-c1bb364af176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:47.115177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c512f13-4136-42d4-b5d2-c1bb364af176 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:47.116227 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c512f13-4136-42d4-b5d2-c1bb364af176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:47.118047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c512f13-4136-42d4-b5d2-c1bb364af176 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:47.147836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc167f-823d-4b22-bf95-3e04f8a973c7 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:47.148229 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1528/3073] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:47.165159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc167f-823d-4b22-bf95-3e04f8a973c7 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:47.174347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1779e45-deca-47d3-a678-93421abfc456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:47.177064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1779e45-deca-47d3-a678-93421abfc456 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:47.178062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1779e45-deca-47d3-a678-93421abfc456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:47.178470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1779e45-deca-47d3-a678-93421abfc456 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:47.180120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1779e45-deca-47d3-a678-93421abfc456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:47.184731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1779e45-deca-47d3-a678-93421abfc456 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:47.194660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c512f13-4136-42d4-b5d2-c1bb364af176 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:47.198381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0c512f13-4136-42d4-b5d2-c1bb364af176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:47.219763 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1546/3074] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:47 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:17:47.228459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1779e45-deca-47d3-a678-93421abfc456 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:47.281712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1779e45-deca-47d3-a678-93421abfc456 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:47.296405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2d14d-0b2a-4f4c-b032-e7d88f094484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:47.297672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2d14d-0b2a-4f4c-b032-e7d88f094484 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:47.298204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2d14d-0b2a-4f4c-b032-e7d88f094484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:47.298742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2d14d-0b2a-4f4c-b032-e7d88f094484 admin admin] PATH_INFO: `/v3/projects/efad066360cb45b3a6e9ba872118ea57/users/d4f7282c7251455086368d5274a4fac5/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:47.338253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2d14d-0b2a-4f4c-b032-e7d88f094484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efad066360cb45b3a6e9ba872118ea57, user_id=d4f7282c7251455086368d5274a4fac5, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:47.341187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2d14d-0b2a-4f4c-b032-e7d88f094484 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:47.373426 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1547/3075] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:47 2022] PUT /identity/v3/projects/efad066360cb45b3a6e9ba872118ea57/users/d4f7282c7251455086368d5274a4fac5/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:47.379185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718bc31-5384-4eb3-a09b-bc55b79045c5 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:47.379806 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718bc31-5384-4eb3-a09b-bc55b79045c5 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:47.380337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718bc31-5384-4eb3-a09b-bc55b79045c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:47.427114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f718bc31-5384-4eb3-a09b-bc55b79045c5 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:47.430064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f718bc31-5384-4eb3-a09b-bc55b79045c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:47.461334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c512f13-4136-42d4-b5d2-c1bb364af176 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:47.673009 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1548/3076] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:17:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:47.677052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d6e47-bf67-4f37-ad6a-2bab46f560ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:47.677909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d6e47-bf67-4f37-ad6a-2bab46f560ad service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:47.678291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d6e47-bf67-4f37-ad6a-2bab46f560ad service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:47.678667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d6e47-bf67-4f37-ad6a-2bab46f560ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:47.681136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7a5d6e47-bf67-4f37-ad6a-2bab46f560ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:47.695922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d6e47-bf67-4f37-ad6a-2bab46f560ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:47.698922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718bc31-5384-4eb3-a09b-bc55b79045c5 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:47.700938 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f718bc31-5384-4eb3-a09b-bc55b79045c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:47.707156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d6e47-bf67-4f37-ad6a-2bab46f560ad service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:47.763904 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1529/3077] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:17:47.799409 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:47.850562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718bc31-5384-4eb3-a09b-bc55b79045c5 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:47.858394 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7931c1-178d-4566-ae36-d90d0aabd4c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:47.860002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7931c1-178d-4566-ae36-d90d0aabd4c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:47.860414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7931c1-178d-4566-ae36-d90d0aabd4c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:47.861692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7931c1-178d-4566-ae36-d90d0aabd4c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:47.893019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7931c1-178d-4566-ae36-d90d0aabd4c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:47.895046 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7931c1-178d-4566-ae36-d90d0aabd4c0 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:47.918949 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1549/3078] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:51.215591 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a16f54-7fa4-4e8e-885f-991d6e7c1671 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:51.216645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a16f54-7fa4-4e8e-885f-991d6e7c1671 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:51.217117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a16f54-7fa4-4e8e-885f-991d6e7c1671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:51.312279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d7a16f54-7fa4-4e8e-885f-991d6e7c1671 None None] MFA Rules not processed for user `bd2118b664634f1297fe908f30609f42`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:51.313869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d7a16f54-7fa4-4e8e-885f-991d6e7c1671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:51.341451 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:51.494592 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1530/3079] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:17:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:17:51.508765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ea097-3507-4eec-90dd-bb908f07add0 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:51.509409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ea097-3507-4eec-90dd-bb908f07add0 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:51.509409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ea097-3507-4eec-90dd-bb908f07add0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:51.553294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2d6ea097-3507-4eec-90dd-bb908f07add0 None None] MFA Rules not processed for user `bd2118b664634f1297fe908f30609f42`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:51.554473 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2d6ea097-3507-4eec-90dd-bb908f07add0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:51.563014 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1550/3080] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:17:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:52.320926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a16f54-7fa4-4e8e-885f-991d6e7c1671 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:52.322595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d7a16f54-7fa4-4e8e-885f-991d6e7c1671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:52.662527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a16f54-7fa4-4e8e-885f-991d6e7c1671 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:52.682016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be7629-7a7f-479b-81d9-d1182871a2b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:52.682570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be7629-7a7f-479b-81d9-d1182871a2b7 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:52.682897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be7629-7a7f-479b-81d9-d1182871a2b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:52.683167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be7629-7a7f-479b-81d9-d1182871a2b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:52.694421 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be7629-7a7f-479b-81d9-d1182871a2b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:52.697351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be7629-7a7f-479b-81d9-d1182871a2b7 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:52.742956 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1531/3081] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:17:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:17:53.627979 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff4162-abfa-42fe-8149-3237cc73444b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:53.628492 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff4162-abfa-42fe-8149-3237cc73444b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:53.628847 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff4162-abfa-42fe-8149-3237cc73444b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:53.690367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-8fff4162-abfa-42fe-8149-3237cc73444b None None] MFA Rules not processed for user `5080c88d51a8455bba8b70e33cca958b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:53.691926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8fff4162-abfa-42fe-8149-3237cc73444b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:53.831714 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1551/3082] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:17:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:53.832350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be7629-7a7f-479b-81d9-d1182871a2b7 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:53.833923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-84be7629-7a7f-479b-81d9-d1182871a2b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:53.871541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be7629-7a7f-479b-81d9-d1182871a2b7 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:53.889661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f1b6b-b8d4-4bb7-a809-95405ab433c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:53.890292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f1b6b-b8d4-4bb7-a809-95405ab433c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:53.890573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f1b6b-b8d4-4bb7-a809-95405ab433c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:53.891080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f1b6b-b8d4-4bb7-a809-95405ab433c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:53.891498 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f1b6b-b8d4-4bb7-a809-95405ab433c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:53.893785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f1b6b-b8d4-4bb7-a809-95405ab433c5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:53.958213 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1532/3083] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:17:53 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:17:53.966012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff4162-abfa-42fe-8149-3237cc73444b None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:53.983435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff4162-abfa-42fe-8149-3237cc73444b None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:54.154230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fab277-3042-4ffc-8c14-f3bffee6025e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:54.155655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fab277-3042-4ffc-8c14-f3bffee6025e admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:54.156248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fab277-3042-4ffc-8c14-f3bffee6025e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:54.157034 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fab277-3042-4ffc-8c14-f3bffee6025e admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:54.157665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fab277-3042-4ffc-8c14-f3bffee6025e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:54.166738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fab277-3042-4ffc-8c14-f3bffee6025e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:54.246226 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1552/3084] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:17:53 2022] POST /identity/v3/users => generated 299 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:17:54.250606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f1b6b-b8d4-4bb7-a809-95405ab433c5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:54.271729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f1b6b-b8d4-4bb7-a809-95405ab433c5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:54.292686 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571c3bf-0dda-4aa0-b2f9-265d9f400896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:54.293297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571c3bf-0dda-4aa0-b2f9-265d9f400896 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:54.293577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571c3bf-0dda-4aa0-b2f9-265d9f400896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:54.293847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6571c3bf-0dda-4aa0-b2f9-265d9f400896 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:54.294733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6571c3bf-0dda-4aa0-b2f9-265d9f400896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:54.296579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6571c3bf-0dda-4aa0-b2f9-265d9f400896 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:54.338079 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1533/3085] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:54.342459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fab277-3042-4ffc-8c14-f3bffee6025e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:54.373839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fab277-3042-4ffc-8c14-f3bffee6025e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:54.394503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8994e-1d6d-49eb-97f9-c49c9fedf298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:54.395200 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8994e-1d6d-49eb-97f9-c49c9fedf298 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:54.395637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8994e-1d6d-49eb-97f9-c49c9fedf298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:54.395775 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd8994e-1d6d-49eb-97f9-c49c9fedf298 admin admin] PATH_INFO: `/v3/projects/a9fb6ec931d04850855bd36adf4ba3ee/users/473e0736f4cd49d289e882f2d69f18cc/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:54.432723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8994e-1d6d-49eb-97f9-c49c9fedf298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9fb6ec931d04850855bd36adf4ba3ee, user_id=473e0736f4cd49d289e882f2d69f18cc, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:54.435999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd8994e-1d6d-49eb-97f9-c49c9fedf298 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:54.457963 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1553/3086] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:54 2022] PUT /identity/v3/projects/a9fb6ec931d04850855bd36adf4ba3ee/users/473e0736f4cd49d289e882f2d69f18cc/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:54.462105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571c3bf-0dda-4aa0-b2f9-265d9f400896 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:54.479365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6571c3bf-0dda-4aa0-b2f9-265d9f400896 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:54.565350 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:54.639108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ebf75-194e-4e0f-b3b2-f867f067f989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:54.639757 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ebf75-194e-4e0f-b3b2-f867f067f989 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:54.640078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ebf75-194e-4e0f-b3b2-f867f067f989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:54.640590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ebf75-194e-4e0f-b3b2-f867f067f989 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:54.641443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ebf75-194e-4e0f-b3b2-f867f067f989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:54.643329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ebf75-194e-4e0f-b3b2-f867f067f989 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:54.670051 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1534/3087] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:17:54.673970 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8994e-1d6d-49eb-97f9-c49c9fedf298 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:54.695134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd8994e-1d6d-49eb-97f9-c49c9fedf298 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:54.712569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd1761-92dd-4eb3-9d48-dc0b96496e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:54.714249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd1761-92dd-4eb3-9d48-dc0b96496e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:54.714759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd1761-92dd-4eb3-9d48-dc0b96496e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:54.715205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd1761-92dd-4eb3-9d48-dc0b96496e76 admin admin] PATH_INFO: `/v3/projects/a9fb6ec931d04850855bd36adf4ba3ee/users/473e0736f4cd49d289e882f2d69f18cc/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:54.717924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd1761-92dd-4eb3-9d48-dc0b96496e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9fb6ec931d04850855bd36adf4ba3ee, user_id=473e0736f4cd49d289e882f2d69f18cc, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:54.721042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdd1761-92dd-4eb3-9d48-dc0b96496e76 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:54.742429 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1554/3088] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:17:54 2022] PUT /identity/v3/projects/a9fb6ec931d04850855bd36adf4ba3ee/users/473e0736f4cd49d289e882f2d69f18cc/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:17:56.087220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15477f7e-7d98-42ef-b699-a218107f356c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:56.087760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15477f7e-7d98-42ef-b699-a218107f356c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:56.088001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15477f7e-7d98-42ef-b699-a218107f356c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:56.127550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-15477f7e-7d98-42ef-b699-a218107f356c None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:17:56.131506 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-15477f7e-7d98-42ef-b699-a218107f356c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:56.339863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd1761-92dd-4eb3-9d48-dc0b96496e76 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:17:56.341295 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1535/3089] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:17:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:17:56.342497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-bcdd1761-92dd-4eb3-9d48-dc0b96496e76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:17:56.352961 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:17:56.604248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd1761-92dd-4eb3-9d48-dc0b96496e76 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:17:56.617176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465bb12-66b4-4ab9-b496-0ce5d3c2f809 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:17:56.621830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465bb12-66b4-4ab9-b496-0ce5d3c2f809 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:56.622457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465bb12-66b4-4ab9-b496-0ce5d3c2f809 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:56.623396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465bb12-66b4-4ab9-b496-0ce5d3c2f809 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:56.655992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c465bb12-66b4-4ab9-b496-0ce5d3c2f809 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:17:56.660568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c465bb12-66b4-4ab9-b496-0ce5d3c2f809 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:17:56.718361 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1555/3090] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:17:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:17:59.907587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec0242-1ee0-4145-a0c1-7288ec417b31 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:17:59.908214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec0242-1ee0-4145-a0c1-7288ec417b31 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:17:59.908214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec0242-1ee0-4145-a0c1-7288ec417b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:17:59.998929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ecec0242-1ee0-4145-a0c1-7288ec417b31 None None] MFA Rules not processed for user `45ed48709ab84fa4b5b341332a843ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:00.001149 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ecec0242-1ee0-4145-a0c1-7288ec417b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:00.158464 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1536/3091] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:17:59 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:00.389088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243cc07-10f0-4dc5-a44a-6517575e2d3a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:00.389088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243cc07-10f0-4dc5-a44a-6517575e2d3a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:00.389088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243cc07-10f0-4dc5-a44a-6517575e2d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:00.481224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6243cc07-10f0-4dc5-a44a-6517575e2d3a None None] MFA Rules not processed for user `b945db9a6f7a4143a544b76be5e9af9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:00.482479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6243cc07-10f0-4dc5-a44a-6517575e2d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:00.804601 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1556/3092] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:18:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:10.134844 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=62 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:10.762035 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=55 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:16.607373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4609c0-6071-45b3-9f5f-c5743ceb1b00 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:16.608001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4609c0-6071-45b3-9f5f-c5743ceb1b00 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:16.608001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4609c0-6071-45b3-9f5f-c5743ceb1b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:16.639243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-4a4609c0-6071-45b3-9f5f-c5743ceb1b00 None None] MFA Rules not processed for user `473e0736f4cd49d289e882f2d69f18cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:16.640777 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4a4609c0-6071-45b3-9f5f-c5743ceb1b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:16.733005 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1537/3093] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:18:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:16.747631 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243cc07-10f0-4dc5-a44a-6517575e2d3a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:16.749697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6243cc07-10f0-4dc5-a44a-6517575e2d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:16.897391 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243cc07-10f0-4dc5-a44a-6517575e2d3a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:16.908014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2529b5-d72f-476d-b1fc-9ed8f39d740d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:16.909263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2529b5-d72f-476d-b1fc-9ed8f39d740d service glance] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:16.910950 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2529b5-d72f-476d-b1fc-9ed8f39d740d service glance] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:16.911315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2529b5-d72f-476d-b1fc-9ed8f39d740d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:16.943652 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2529b5-d72f-476d-b1fc-9ed8f39d740d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:16.945991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2529b5-d72f-476d-b1fc-9ed8f39d740d service glance] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:16.984541 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1557/3094] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:18:17.308648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952818d-f0ee-4169-a92a-ab41c44525e7 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:17.309298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952818d-f0ee-4169-a92a-ab41c44525e7 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:17.309767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952818d-f0ee-4169-a92a-ab41c44525e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:17.499829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2952818d-f0ee-4169-a92a-ab41c44525e7 None None] MFA Rules not processed for user `d4f7282c7251455086368d5274a4fac5`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:17.506222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2952818d-f0ee-4169-a92a-ab41c44525e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:17.792385 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1538/3095] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:18:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 484 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:17.807942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aacb84-e1ca-4538-908c-55bb2454c9ba None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:17.808545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aacb84-e1ca-4538-908c-55bb2454c9ba None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:17.808740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aacb84-e1ca-4538-908c-55bb2454c9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:17.861077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-60aacb84-e1ca-4538-908c-55bb2454c9ba None None] MFA Rules not processed for user `d4f7282c7251455086368d5274a4fac5`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:17.865815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-60aacb84-e1ca-4538-908c-55bb2454c9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:17.884725 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1558/3096] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:18:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:18.037352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952818d-f0ee-4169-a92a-ab41c44525e7 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:18.221956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952818d-f0ee-4169-a92a-ab41c44525e7 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:18.234126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf76092-843c-4acc-a961-a9ae7e411581 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:18.237548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf76092-843c-4acc-a961-a9ae7e411581 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:18.238232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf76092-843c-4acc-a961-a9ae7e411581 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:18.240493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf76092-843c-4acc-a961-a9ae7e411581 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:18.244340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-daf76092-843c-4acc-a961-a9ae7e411581 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:18.283455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf76092-843c-4acc-a961-a9ae7e411581 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:18.299790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf76092-843c-4acc-a961-a9ae7e411581 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:18.326534 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:18.329846 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1539/3097] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:18:22.880122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aacb84-e1ca-4538-908c-55bb2454c9ba None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:22.882436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-60aacb84-e1ca-4538-908c-55bb2454c9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:22.965367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aacb84-e1ca-4538-908c-55bb2454c9ba None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:23.007295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3699258-1558-475d-a1ae-e331fbe9d638 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:23.016169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3699258-1558-475d-a1ae-e331fbe9d638 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:23.016452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3699258-1558-475d-a1ae-e331fbe9d638 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:23.016726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3699258-1558-475d-a1ae-e331fbe9d638 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:23.110581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3699258-1558-475d-a1ae-e331fbe9d638 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:23.117858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3699258-1558-475d-a1ae-e331fbe9d638 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:23.292416 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1559/3098] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:18:33.236751 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=35 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:33.391729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7f8f4-1321-40a2-9001-960dc307c2eb None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:33.392435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7f8f4-1321-40a2-9001-960dc307c2eb None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:33.393441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7f8f4-1321-40a2-9001-960dc307c2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:33.437818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-31b7f8f4-1321-40a2-9001-960dc307c2eb None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:33.441039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-31b7f8f4-1321-40a2-9001-960dc307c2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:33.452256 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1540/3099] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:18:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:33.505756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3699258-1558-475d-a1ae-e331fbe9d638 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:33.556242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3699258-1558-475d-a1ae-e331fbe9d638 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:33.563254 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe37626-8bac-4317-a1ff-2c9d124f406e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:33.564290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe37626-8bac-4317-a1ff-2c9d124f406e service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:33.565456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe37626-8bac-4317-a1ff-2c9d124f406e service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:33.565977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe37626-8bac-4317-a1ff-2c9d124f406e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:33.585876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe37626-8bac-4317-a1ff-2c9d124f406e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:33.589295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe37626-8bac-4317-a1ff-2c9d124f406e service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:33.611549 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1560/3100] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:18:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:18:35.253498 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff409d-9974-4d38-b562-7ed5a1d6fea5 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:35.254536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff409d-9974-4d38-b562-7ed5a1d6fea5 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:35.255146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff409d-9974-4d38-b562-7ed5a1d6fea5 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:35.257852 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1541/3101] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:18:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:18:35.262792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d668fa-f4f6-4b1b-a6d0-94590ea4bf06 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:35.263317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d668fa-f4f6-4b1b-a6d0-94590ea4bf06 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:35.263317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d668fa-f4f6-4b1b-a6d0-94590ea4bf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:35.285589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f7d668fa-f4f6-4b1b-a6d0-94590ea4bf06 None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:35.286940 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f7d668fa-f4f6-4b1b-a6d0-94590ea4bf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:35.406274 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1561/3102] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:18:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:35.426798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff409d-9974-4d38-b562-7ed5a1d6fea5 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:35.443086 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff409d-9974-4d38-b562-7ed5a1d6fea5 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:35.449007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a4315-bb49-4203-af9e-dcba202fdd2b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:35.449698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a4315-bb49-4203-af9e-dcba202fdd2b service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:35.450161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a4315-bb49-4203-af9e-dcba202fdd2b service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:35.450488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a4315-bb49-4203-af9e-dcba202fdd2b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:35.468344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a4315-bb49-4203-af9e-dcba202fdd2b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:35.477364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98a4315-bb49-4203-af9e-dcba202fdd2b service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:35.511758 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1542/3103] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:18:35.910010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d668fa-f4f6-4b1b-a6d0-94590ea4bf06 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:35.912581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f7d668fa-f4f6-4b1b-a6d0-94590ea4bf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:36.069282 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d668fa-f4f6-4b1b-a6d0-94590ea4bf06 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:36.080356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079f385-c5aa-4927-9f9b-666261fada54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:36.080977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079f385-c5aa-4927-9f9b-666261fada54 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:36.081252 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079f385-c5aa-4927-9f9b-666261fada54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:36.081519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079f385-c5aa-4927-9f9b-666261fada54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:36.089771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8079f385-c5aa-4927-9f9b-666261fada54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:36.114546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079f385-c5aa-4927-9f9b-666261fada54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:36.117115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079f385-c5aa-4927-9f9b-666261fada54 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:36.150577 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1562/3104] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:18:36.445491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe9cdb-ab63-489b-81f0-fdfcb8ffa3ce None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:36.446092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe9cdb-ab63-489b-81f0-fdfcb8ffa3ce None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:36.451486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe9cdb-ab63-489b-81f0-fdfcb8ffa3ce None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:36.456990 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1543/3105] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 01:18:36 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:18:36.505366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f3bf6-ebf5-4215-b89c-b15dd03297c3 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:36.512600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f3bf6-ebf5-4215-b89c-b15dd03297c3 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:36.513222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f3bf6-ebf5-4215-b89c-b15dd03297c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:36.631129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0a8f3bf6-ebf5-4215-b89c-b15dd03297c3 None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:36.633041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0a8f3bf6-ebf5-4215-b89c-b15dd03297c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:36.652037 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1563/3106] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 01:18:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:36.699981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe9cdb-ab63-489b-81f0-fdfcb8ffa3ce None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:36.761330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe9cdb-ab63-489b-81f0-fdfcb8ffa3ce None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:36.790781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a798dbd-a1e8-437a-8149-0813f30149c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:36.795242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a798dbd-a1e8-437a-8149-0813f30149c0 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:36.795592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a798dbd-a1e8-437a-8149-0813f30149c0 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:36.795798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a798dbd-a1e8-437a-8149-0813f30149c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:36.834436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a798dbd-a1e8-437a-8149-0813f30149c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:36.837435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a798dbd-a1e8-437a-8149-0813f30149c0 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:36.856487 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1544/3107] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:18:38.262656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f199e5-9fea-46e7-a852-6c406bc5c41a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:38.263205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f199e5-9fea-46e7-a852-6c406bc5c41a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:38.263607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f199e5-9fea-46e7-a852-6c406bc5c41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:38.306259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-55f199e5-9fea-46e7-a852-6c406bc5c41a None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:38.308562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-55f199e5-9fea-46e7-a852-6c406bc5c41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:38.326263 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1564/3108] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:18:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:38.336328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a798dbd-a1e8-437a-8149-0813f30149c0 service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:38.357526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a798dbd-a1e8-437a-8149-0813f30149c0 service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:38.369916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a549b-0438-4de6-aca8-ca6e5671a6a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:38.372740 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a549b-0438-4de6-aca8-ca6e5671a6a8 service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:38.373030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a549b-0438-4de6-aca8-ca6e5671a6a8 service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:38.373304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a549b-0438-4de6-aca8-ca6e5671a6a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:38.383783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a549b-0438-4de6-aca8-ca6e5671a6a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:38.385791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a549b-0438-4de6-aca8-ca6e5671a6a8 service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:38.425391 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1545/3109] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:18:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:18:42.796301 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2ac6e-5a91-4da4-84ef-c65dd4e6a7a7 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:42.796978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2ac6e-5a91-4da4-84ef-c65dd4e6a7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:42.796978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2ac6e-5a91-4da4-84ef-c65dd4e6a7a7 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:42.799326 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1565/3110] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 01:18:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:18:42.809310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e45190-bea2-4ea5-b7b5-c18308b5d639 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:42.810568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e45190-bea2-4ea5-b7b5-c18308b5d639 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:42.812415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e45190-bea2-4ea5-b7b5-c18308b5d639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:42.864183 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-90e45190-bea2-4ea5-b7b5-c18308b5d639 None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:42.865801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-90e45190-bea2-4ea5-b7b5-c18308b5d639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:42.892051 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1546/3111] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 01:18:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:42.918422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2ac6e-5a91-4da4-84ef-c65dd4e6a7a7 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:42.956002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2ac6e-5a91-4da4-84ef-c65dd4e6a7a7 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:42.991729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97833ce8-f588-4911-a597-6a979a7984a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:42.992740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97833ce8-f588-4911-a597-6a979a7984a6 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:42.993373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97833ce8-f588-4911-a597-6a979a7984a6 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:42.993873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97833ce8-f588-4911-a597-6a979a7984a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:43.014655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97833ce8-f588-4911-a597-6a979a7984a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:43.016793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97833ce8-f588-4911-a597-6a979a7984a6 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:43.038682 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1566/3112] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:18:48.532835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e45190-bea2-4ea5-b7b5-c18308b5d639 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:48.534311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-90e45190-bea2-4ea5-b7b5-c18308b5d639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:48.796810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e45190-bea2-4ea5-b7b5-c18308b5d639 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:48.813606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3aa973-0c60-4f1e-8f13-e955cafba4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:48.815542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3aa973-0c60-4f1e-8f13-e955cafba4f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:48.820362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3aa973-0c60-4f1e-8f13-e955cafba4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:48.820921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3aa973-0c60-4f1e-8f13-e955cafba4f1 admin admin] PATH_INFO: `/v3/users/bd2118b664634f1297fe908f30609f42` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:48.822691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3aa973-0c60-4f1e-8f13-e955cafba4f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd2118b664634f1297fe908f30609f42)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:48.824932 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3aa973-0c60-4f1e-8f13-e955cafba4f1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:49.040370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6d3aa973-0c60-4f1e-8f13-e955cafba4f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd2118b664634f1297fe908f30609f42'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:49.067975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6d3aa973-0c60-4f1e-8f13-e955cafba4f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd2118b664634f1297fe908f30609f42'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:49.140867 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6d3aa973-0c60-4f1e-8f13-e955cafba4f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd2118b664634f1297fe908f30609f42'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:49.141729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6d3aa973-0c60-4f1e-8f13-e955cafba4f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd2118b664634f1297fe908f30609f42'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:49.158793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6d3aa973-0c60-4f1e-8f13-e955cafba4f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd2118b664634f1297fe908f30609f42'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:49.176986 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1547/3113] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:18:48 2022] DELETE /identity/v3/users/bd2118b664634f1297fe908f30609f42 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:18:50.619697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97833ce8-f588-4911-a597-6a979a7984a6 service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:50.642173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97833ce8-f588-4911-a597-6a979a7984a6 service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:50.801743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d7678a-8567-40f5-a3c1-097a40f741df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:50.803678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7678a-8567-40f5-a3c1-097a40f741df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:50.804777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7678a-8567-40f5-a3c1-097a40f741df admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:50.806056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7678a-8567-40f5-a3c1-097a40f741df admin admin] PATH_INFO: `/v3/projects/010990a44647402c9a355de2ec0176a7` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:50.809520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d7678a-8567-40f5-a3c1-097a40f741df admin admin] RBAC: Authorizing `identity:delete_project(project_id=010990a44647402c9a355de2ec0176a7)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:50.815273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d7678a-8567-40f5-a3c1-097a40f741df admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:50.819252 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:50.949707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a9d7678a-8567-40f5-a3c1-097a40f741df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '010990a44647402c9a355de2ec0176a7', 'request_id': 'req-a9d7678a-8567-40f5-a3c1-097a40f741df'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:51.011204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a9d7678a-8567-40f5-a3c1-097a40f741df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '010990a44647402c9a355de2ec0176a7', 'request_id': 'req-a9d7678a-8567-40f5-a3c1-097a40f741df'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:51.058806 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a9d7678a-8567-40f5-a3c1-097a40f741df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '010990a44647402c9a355de2ec0176a7', 'request_id': 'req-a9d7678a-8567-40f5-a3c1-097a40f741df'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:51.135842 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a9d7678a-8567-40f5-a3c1-097a40f741df admin admin] The token cache is being invalidate because project 010990a44647402c9a355de2ec0176a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:18:51.138336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a9d7678a-8567-40f5-a3c1-097a40f741df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:51.143505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a9d7678a-8567-40f5-a3c1-097a40f741df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:51.156298 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1567/3114] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:50 2022] DELETE /identity/v3/projects/010990a44647402c9a355de2ec0176a7 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:51.162263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43c949-ef90-422f-b689-539d55684a05 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:51.163856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43c949-ef90-422f-b689-539d55684a05 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:51.165278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43c949-ef90-422f-b689-539d55684a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:51.258494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0d43c949-ef90-422f-b689-539d55684a05 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:51.264311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0d43c949-ef90-422f-b689-539d55684a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:51.370353 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:51.532784 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1548/3115] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:18:51.546616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b1ade-83ba-41a4-931e-05bac26c789b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:51.547404 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b1ade-83ba-41a4-931e-05bac26c789b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:51.547850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b1ade-83ba-41a4-931e-05bac26c789b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:51.604376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-708b1ade-83ba-41a4-931e-05bac26c789b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:51.606081 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-708b1ade-83ba-41a4-931e-05bac26c789b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:51.629633 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1568/3116] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:51.637017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43c949-ef90-422f-b689-539d55684a05 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:51.667632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43c949-ef90-422f-b689-539d55684a05 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:51.697992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525887a0-e01b-41f8-8adf-d37b1f0a72d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:51.698935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525887a0-e01b-41f8-8adf-d37b1f0a72d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:51.699561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525887a0-e01b-41f8-8adf-d37b1f0a72d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:51.700135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525887a0-e01b-41f8-8adf-d37b1f0a72d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:51.702233 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525887a0-e01b-41f8-8adf-d37b1f0a72d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:18:51.702802 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525887a0-e01b-41f8-8adf-d37b1f0a72d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:51.705332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525887a0-e01b-41f8-8adf-d37b1f0a72d8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:51.750585 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1549/3117] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:18:51.755634 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b1ade-83ba-41a4-931e-05bac26c789b None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:51.814949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b1ade-83ba-41a4-931e-05bac26c789b None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:51.861010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5fae5-ba0e-4c10-87eb-9e004befcaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:51.863188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5fae5-ba0e-4c10-87eb-9e004befcaf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:51.869955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5fae5-ba0e-4c10-87eb-9e004befcaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:51.870427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5fae5-ba0e-4c10-87eb-9e004befcaf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:51.872997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5fae5-ba0e-4c10-87eb-9e004befcaf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:51.874837 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e564d8c-7d04-4b18-9a5b-b2ad3d35c93e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:51.876254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e564d8c-7d04-4b18-9a5b-b2ad3d35c93e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:51.877261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e564d8c-7d04-4b18-9a5b-b2ad3d35c93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:51.897985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5fae5-ba0e-4c10-87eb-9e004befcaf0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:51.950564 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0e564d8c-7d04-4b18-9a5b-b2ad3d35c93e None None] MFA Rules not processed for user `d4f7282c7251455086368d5274a4fac5`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:51.954020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0e564d8c-7d04-4b18-9a5b-b2ad3d35c93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:52.020192 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1569/3118] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:18:51 2022] POST /identity/v3/projects => generated 379 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:18:52.024388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5fae5-ba0e-4c10-87eb-9e004befcaf0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:52.175855 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1550/3119] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:18:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:18:52.282208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5fae5-ba0e-4c10-87eb-9e004befcaf0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:52.300584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1416b9b-2d4b-4215-99e2-1aff86c87cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:52.301555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1416b9b-2d4b-4215-99e2-1aff86c87cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:52.301992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1416b9b-2d4b-4215-99e2-1aff86c87cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:52.307741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1416b9b-2d4b-4215-99e2-1aff86c87cb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:52.310089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1416b9b-2d4b-4215-99e2-1aff86c87cb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:52.313878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1416b9b-2d4b-4215-99e2-1aff86c87cb3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:52.353926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e564d8c-7d04-4b18-9a5b-b2ad3d35c93e None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:52.357416 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1570/3120] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:18:52 2022] POST /identity/v3/users => generated 290 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:18:52.376188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e564d8c-7d04-4b18-9a5b-b2ad3d35c93e None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:52.395177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b65e08-646d-439a-a70b-381564fa2483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:52.399558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b65e08-646d-439a-a70b-381564fa2483 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:52.399900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b65e08-646d-439a-a70b-381564fa2483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:52.400160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b65e08-646d-439a-a70b-381564fa2483 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:52.405209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b65e08-646d-439a-a70b-381564fa2483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:52.407315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b65e08-646d-439a-a70b-381564fa2483 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:52.447696 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1551/3121] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:18:52.452877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1416b9b-2d4b-4215-99e2-1aff86c87cb3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:52.471766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1416b9b-2d4b-4215-99e2-1aff86c87cb3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:52.485338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda7214-c26f-4957-b4c9-64b18468f7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:52.486863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda7214-c26f-4957-b4c9-64b18468f7dd admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:52.487144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda7214-c26f-4957-b4c9-64b18468f7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:52.487406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda7214-c26f-4957-b4c9-64b18468f7dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:52.488103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda7214-c26f-4957-b4c9-64b18468f7dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:52.489891 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda7214-c26f-4957-b4c9-64b18468f7dd admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:52.524581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b65e08-646d-439a-a70b-381564fa2483 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:52.531978 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1571/3122] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:18:52.538352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b65e08-646d-439a-a70b-381564fa2483 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:52.549714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15187cb7-06f4-4b78-b781-3f9c22e43b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:52.550449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15187cb7-06f4-4b78-b781-3f9c22e43b66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:52.550725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15187cb7-06f4-4b78-b781-3f9c22e43b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:52.550994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15187cb7-06f4-4b78-b781-3f9c22e43b66 admin admin] PATH_INFO: `/v3/projects/aa56870f27ec4edb844373f8b557fb02/users/52f7afb557fc4426a8666691c6ff115f/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:52.585678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15187cb7-06f4-4b78-b781-3f9c22e43b66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa56870f27ec4edb844373f8b557fb02, user_id=52f7afb557fc4426a8666691c6ff115f, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:52.589260 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15187cb7-06f4-4b78-b781-3f9c22e43b66 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:52.616285 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1552/3123] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:18:52 2022] PUT /identity/v3/projects/aa56870f27ec4edb844373f8b557fb02/users/52f7afb557fc4426a8666691c6ff115f/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:52.626536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d01f8-c8b9-49bd-bb0f-ea3585d38c7f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:52.627645 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d01f8-c8b9-49bd-bb0f-ea3585d38c7f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:52.628315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d01f8-c8b9-49bd-bb0f-ea3585d38c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:52.687991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d29d01f8-c8b9-49bd-bb0f-ea3585d38c7f None None] MFA Rules not processed for user `52f7afb557fc4426a8666691c6ff115f`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:52.689984 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d29d01f8-c8b9-49bd-bb0f-ea3585d38c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:52.806944 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:52.989092 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1572/3124] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:18:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:54.929933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15187cb7-06f4-4b78-b781-3f9c22e43b66 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:54.932847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-15187cb7-06f4-4b78-b781-3f9c22e43b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:55.083576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15187cb7-06f4-4b78-b781-3f9c22e43b66 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:55.097250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dbaca2-1492-4a99-aa34-c106105ff550 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:55.098132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbaca2-1492-4a99-aa34-c106105ff550 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:55.098502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbaca2-1492-4a99-aa34-c106105ff550 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:55.098869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbaca2-1492-4a99-aa34-c106105ff550 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:55.108492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dbaca2-1492-4a99-aa34-c106105ff550 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:55.110519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dbaca2-1492-4a99-aa34-c106105ff550 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:55.129870 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1553/3125] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:18:55.191119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d01f8-c8b9-49bd-bb0f-ea3585d38c7f None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:55.339786 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d01f8-c8b9-49bd-bb0f-ea3585d38c7f None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:55.355323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0663e-8ba9-4fd5-a7c7-566870cc7249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:55.356178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0663e-8ba9-4fd5-a7c7-566870cc7249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:55.356461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0663e-8ba9-4fd5-a7c7-566870cc7249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:55.356731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0663e-8ba9-4fd5-a7c7-566870cc7249 admin admin] PATH_INFO: `/v3/users/52f7afb557fc4426a8666691c6ff115f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:55.358400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0663e-8ba9-4fd5-a7c7-566870cc7249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52f7afb557fc4426a8666691c6ff115f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:55.363700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0663e-8ba9-4fd5-a7c7-566870cc7249 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:55.480389 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a8d0663e-8ba9-4fd5-a7c7-566870cc7249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52f7afb557fc4426a8666691c6ff115f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:55.500184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a8d0663e-8ba9-4fd5-a7c7-566870cc7249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52f7afb557fc4426a8666691c6ff115f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:55.552204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a8d0663e-8ba9-4fd5-a7c7-566870cc7249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52f7afb557fc4426a8666691c6ff115f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:55.553116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a8d0663e-8ba9-4fd5-a7c7-566870cc7249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52f7afb557fc4426a8666691c6ff115f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:55.572686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a8d0663e-8ba9-4fd5-a7c7-566870cc7249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52f7afb557fc4426a8666691c6ff115f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:55.601751 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1573/3126] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:18:55 2022] DELETE /identity/v3/users/52f7afb557fc4426a8666691c6ff115f => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:55.603453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778cc28-3479-47dd-8a4e-336b2bc45ade None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:55.603737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778cc28-3479-47dd-8a4e-336b2bc45ade None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:55.604068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778cc28-3479-47dd-8a4e-336b2bc45ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:55.636696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-4778cc28-3479-47dd-8a4e-336b2bc45ade None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:55.638266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4778cc28-3479-47dd-8a4e-336b2bc45ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:55.650520 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:55.713702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0663e-8ba9-4fd5-a7c7-566870cc7249 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:55.715968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a8d0663e-8ba9-4fd5-a7c7-566870cc7249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:55.849936 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:55.895076 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1554/3127] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:55.911663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778cc28-3479-47dd-8a4e-336b2bc45ade None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:55.913897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4778cc28-3479-47dd-8a4e-336b2bc45ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:56.060039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0663e-8ba9-4fd5-a7c7-566870cc7249 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:56.076677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e452bc6-83a4-46d3-8a05-e44ce02ae961 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:56.077439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e452bc6-83a4-46d3-8a05-e44ce02ae961 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:56.077774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e452bc6-83a4-46d3-8a05-e44ce02ae961 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:56.078058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e452bc6-83a4-46d3-8a05-e44ce02ae961 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:56.081103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7e452bc6-83a4-46d3-8a05-e44ce02ae961 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:56.176875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778cc28-3479-47dd-8a4e-336b2bc45ade None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:56.193904 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff18de5-c58a-4dfe-bc8a-211424cb703e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:56.194536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff18de5-c58a-4dfe-bc8a-211424cb703e service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:56.197609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff18de5-c58a-4dfe-bc8a-211424cb703e service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:56.197954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff18de5-c58a-4dfe-bc8a-211424cb703e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:56.235812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff18de5-c58a-4dfe-bc8a-211424cb703e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:56.241621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff18de5-c58a-4dfe-bc8a-211424cb703e service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:56.253134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e452bc6-83a4-46d3-8a05-e44ce02ae961 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:56.255047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e452bc6-83a4-46d3-8a05-e44ce02ae961 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:56.284640 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1574/3128] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:18:56.289430 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1555/3129] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:18:56.602921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de18ee9-1815-41ad-8000-2ddae0b2bc5a None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:56.604756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de18ee9-1815-41ad-8000-2ddae0b2bc5a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:56.604756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de18ee9-1815-41ad-8000-2ddae0b2bc5a None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:56.604996 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1575/3130] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:18:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:18:56.619092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdbc9e-4da9-415f-9b03-11dd93c9483a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:56.619988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdbc9e-4da9-415f-9b03-11dd93c9483a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:56.620484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdbc9e-4da9-415f-9b03-11dd93c9483a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:56.693944 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-29fdbc9e-4da9-415f-9b03-11dd93c9483a None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:56.700018 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-29fdbc9e-4da9-415f-9b03-11dd93c9483a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:56.989152 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1556/3131] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:18:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:57.034897 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de18ee9-1815-41ad-8000-2ddae0b2bc5a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:57.037657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2de18ee9-1815-41ad-8000-2ddae0b2bc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:57.061385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de18ee9-1815-41ad-8000-2ddae0b2bc5a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:57.073510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e67c2-c158-44df-830b-d9efb81461f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:57.075664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e67c2-c158-44df-830b-d9efb81461f7 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:57.076050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e67c2-c158-44df-830b-d9efb81461f7 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:57.076525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e67c2-c158-44df-830b-d9efb81461f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:57.088868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e67c2-c158-44df-830b-d9efb81461f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:57.091029 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e67c2-c158-44df-830b-d9efb81461f7 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:57.110304 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1576/3132] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:18:57.591233 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdbc9e-4da9-415f-9b03-11dd93c9483a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:57.597480 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-29fdbc9e-4da9-415f-9b03-11dd93c9483a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:57.617968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1aea7-29b5-4e60-821a-e6d06d16346b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:57.618519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1aea7-29b5-4e60-821a-e6d06d16346b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:57.618841 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1aea7-29b5-4e60-821a-e6d06d16346b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:57.670637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdbc9e-4da9-415f-9b03-11dd93c9483a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:57.676111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-faa1aea7-29b5-4e60-821a-e6d06d16346b None None] MFA Rules not processed for user `d4f7282c7251455086368d5274a4fac5`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:57.677763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-faa1aea7-29b5-4e60-821a-e6d06d16346b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:57.695251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237b4ef-2336-47a6-822b-bc747a4ae823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:57.695920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237b4ef-2336-47a6-822b-bc747a4ae823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:57.696187 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237b4ef-2336-47a6-822b-bc747a4ae823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:57.696489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237b4ef-2336-47a6-822b-bc747a4ae823 admin admin] PATH_INFO: `/v3/projects/aa56870f27ec4edb844373f8b557fb02` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:57.698453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237b4ef-2336-47a6-822b-bc747a4ae823 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa56870f27ec4edb844373f8b557fb02)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:57.703941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237b4ef-2336-47a6-822b-bc747a4ae823 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:57.820192 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1577/3133] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:18:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:57.912645 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:57.932767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5237b4ef-2336-47a6-822b-bc747a4ae823 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa56870f27ec4edb844373f8b557fb02', 'request_id': 'req-5237b4ef-2336-47a6-822b-bc747a4ae823'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:57.949328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5237b4ef-2336-47a6-822b-bc747a4ae823 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa56870f27ec4edb844373f8b557fb02', 'request_id': 'req-5237b4ef-2336-47a6-822b-bc747a4ae823'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:57.960951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5237b4ef-2336-47a6-822b-bc747a4ae823 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa56870f27ec4edb844373f8b557fb02', 'request_id': 'req-5237b4ef-2336-47a6-822b-bc747a4ae823'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:57.978844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5237b4ef-2336-47a6-822b-bc747a4ae823 admin admin] The token cache is being invalidate because project aa56870f27ec4edb844373f8b557fb02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:18:57.979388 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5237b4ef-2336-47a6-822b-bc747a4ae823 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:57.980252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5237b4ef-2336-47a6-822b-bc747a4ae823 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:18:57.982267 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1557/3134] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:18:57 2022] DELETE /identity/v3/projects/aa56870f27ec4edb844373f8b557fb02 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:57.990090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a71acd-a559-4f25-bba9-6ed636ae103f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:57.990090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a71acd-a559-4f25-bba9-6ed636ae103f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:57.990324 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a71acd-a559-4f25-bba9-6ed636ae103f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:58.047589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b5a71acd-a559-4f25-bba9-6ed636ae103f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:58.049581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b5a71acd-a559-4f25-bba9-6ed636ae103f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:58.240185 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1578/3135] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:58.242702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817ce10-143d-4b65-99e0-9f7e702639b5 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:58.243516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817ce10-143d-4b65-99e0-9f7e702639b5 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:58.244282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817ce10-143d-4b65-99e0-9f7e702639b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:58.312594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c817ce10-143d-4b65-99e0-9f7e702639b5 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:58.314366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c817ce10-143d-4b65-99e0-9f7e702639b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:58.324645 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1558/3136] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:58.328979 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a71acd-a559-4f25-bba9-6ed636ae103f None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:58.344518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a71acd-a559-4f25-bba9-6ed636ae103f None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:58.371648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408fed4-f457-4e3f-bb74-704a370323ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:58.373515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408fed4-f457-4e3f-bb74-704a370323ab admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:58.373912 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408fed4-f457-4e3f-bb74-704a370323ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:58.374198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408fed4-f457-4e3f-bb74-704a370323ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:58.375257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408fed4-f457-4e3f-bb74-704a370323ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:18:58.375257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408fed4-f457-4e3f-bb74-704a370323ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:58.380850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408fed4-f457-4e3f-bb74-704a370323ab admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:58.406550 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1579/3137] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:18:58.412180 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817ce10-143d-4b65-99e0-9f7e702639b5 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:58.431137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817ce10-143d-4b65-99e0-9f7e702639b5 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:58.437877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107aa26-f9f4-4d48-9d01-d5db7aee6785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:58.441052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107aa26-f9f4-4d48-9d01-d5db7aee6785 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:58.441918 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107aa26-f9f4-4d48-9d01-d5db7aee6785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:58.442430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107aa26-f9f4-4d48-9d01-d5db7aee6785 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:58.443318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107aa26-f9f4-4d48-9d01-d5db7aee6785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:58.446195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107aa26-f9f4-4d48-9d01-d5db7aee6785 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:58.484767 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1559/3138] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:18:58 2022] POST /identity/v3/projects => generated 395 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:18:58.484971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408fed4-f457-4e3f-bb74-704a370323ab admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:58.500021 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:18:58.503738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408fed4-f457-4e3f-bb74-704a370323ab admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:58.613752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9936fe-fa23-4af4-b997-fdc62567513c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:58.614374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9936fe-fa23-4af4-b997-fdc62567513c admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:58.614653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9936fe-fa23-4af4-b997-fdc62567513c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:58.614920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9936fe-fa23-4af4-b997-fdc62567513c admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:58.615654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9936fe-fa23-4af4-b997-fdc62567513c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:58.619405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9936fe-fa23-4af4-b997-fdc62567513c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:58.655652 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1580/3139] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:18:58 2022] POST /identity/v3/users => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:18:58.657145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107aa26-f9f4-4d48-9d01-d5db7aee6785 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:58.667830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107aa26-f9f4-4d48-9d01-d5db7aee6785 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:58.672866 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d2831-3825-4f78-be80-4548b34e9017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:58.673496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d2831-3825-4f78-be80-4548b34e9017 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:58.673860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d2831-3825-4f78-be80-4548b34e9017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:58.674020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d2831-3825-4f78-be80-4548b34e9017 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:58.674996 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d2831-3825-4f78-be80-4548b34e9017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:58.676539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d2831-3825-4f78-be80-4548b34e9017 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:58.692821 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1560/3140] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:18:58.695848 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9936fe-fa23-4af4-b997-fdc62567513c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:58.711002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9936fe-fa23-4af4-b997-fdc62567513c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:58.717499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aab54c-cf07-4b79-8ed7-20584db4e892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:58.718119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aab54c-cf07-4b79-8ed7-20584db4e892 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:58.718400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aab54c-cf07-4b79-8ed7-20584db4e892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:58.718667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aab54c-cf07-4b79-8ed7-20584db4e892 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:58.719559 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aab54c-cf07-4b79-8ed7-20584db4e892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:58.721263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aab54c-cf07-4b79-8ed7-20584db4e892 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:58.738429 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d2831-3825-4f78-be80-4548b34e9017 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:58.741982 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1581/3141] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:18:58.754030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d2831-3825-4f78-be80-4548b34e9017 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:58.760483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c84c7-421a-491b-a4e9-bbf9216befdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:58.761650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c84c7-421a-491b-a4e9-bbf9216befdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:58.762314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c84c7-421a-491b-a4e9-bbf9216befdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:58.762899 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c84c7-421a-491b-a4e9-bbf9216befdd admin admin] PATH_INFO: `/v3/projects/75894dc30ff34892932d810a03b6b928/users/ea93e1ba81f34ecaa8e458b89a88e355/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:58.786933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c84c7-421a-491b-a4e9-bbf9216befdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=75894dc30ff34892932d810a03b6b928, user_id=ea93e1ba81f34ecaa8e458b89a88e355, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:58.791130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c84c7-421a-491b-a4e9-bbf9216befdd admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:58.812041 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1561/3142] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:18:58 2022] PUT /identity/v3/projects/75894dc30ff34892932d810a03b6b928/users/ea93e1ba81f34ecaa8e458b89a88e355/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:18:58.824740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f48429-4a15-45ec-a6b1-2f547df91b56 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:58.825047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f48429-4a15-45ec-a6b1-2f547df91b56 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:58.825553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f48429-4a15-45ec-a6b1-2f547df91b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:58.861886 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b9f48429-4a15-45ec-a6b1-2f547df91b56 None None] MFA Rules not processed for user `ea93e1ba81f34ecaa8e458b89a88e355`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:58.863264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b9f48429-4a15-45ec-a6b1-2f547df91b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:58.956655 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1582/3143] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:18:58 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:18:59.253297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c84c7-421a-491b-a4e9-bbf9216befdd admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:18:59.256267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-550c84c7-421a-491b-a4e9-bbf9216befdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:59.432319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c84c7-421a-491b-a4e9-bbf9216befdd admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:18:59.443110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e47fd-7b9f-43d4-9c00-de6da1f16381 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:18:59.444118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e47fd-7b9f-43d4-9c00-de6da1f16381 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:59.444837 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e47fd-7b9f-43d4-9c00-de6da1f16381 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:59.446237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e47fd-7b9f-43d4-9c00-de6da1f16381 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:59.465256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e47fd-7b9f-43d4-9c00-de6da1f16381 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:18:59.468567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e47fd-7b9f-43d4-9c00-de6da1f16381 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:18:59.496272 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1562/3144] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:18:59 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:18:59.590910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54dc3eb-516f-42c7-b937-470a8369f1b9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:18:59.591220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54dc3eb-516f-42c7-b937-470a8369f1b9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:18:59.591582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54dc3eb-516f-42c7-b937-470a8369f1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:18:59.656115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e54dc3eb-516f-42c7-b937-470a8369f1b9 None None] MFA Rules not processed for user `ea93e1ba81f34ecaa8e458b89a88e355`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:18:59.658789 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e54dc3eb-516f-42c7-b937-470a8369f1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:18:59.677612 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1583/3145] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:18:59 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:00.559286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069390ed-e880-42fc-a1af-d79c2153d04d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:00.560181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069390ed-e880-42fc-a1af-d79c2153d04d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:00.560617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069390ed-e880-42fc-a1af-d79c2153d04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:00.588175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-069390ed-e880-42fc-a1af-d79c2153d04d None None] MFA Rules not processed for user `4a359309c39a49c98f1f7aea48189efa`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:00.589704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-069390ed-e880-42fc-a1af-d79c2153d04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:00.613159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54dc3eb-516f-42c7-b937-470a8369f1b9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:00.734397 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:00.752499 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1563/3146] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:19:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:00.809557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54dc3eb-516f-42c7-b937-470a8369f1b9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:00.817432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a4255-5ef3-4d28-9dad-517585b34bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:00.818426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a4255-5ef3-4d28-9dad-517585b34bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:00.818960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a4255-5ef3-4d28-9dad-517585b34bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:00.819399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a4255-5ef3-4d28-9dad-517585b34bc2 admin admin] PATH_INFO: `/v3/users/ea93e1ba81f34ecaa8e458b89a88e355` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:00.820935 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a4255-5ef3-4d28-9dad-517585b34bc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea93e1ba81f34ecaa8e458b89a88e355)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:00.823628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a4255-5ef3-4d28-9dad-517585b34bc2 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:00.832689 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:00.894846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0a9a4255-5ef3-4d28-9dad-517585b34bc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea93e1ba81f34ecaa8e458b89a88e355'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:00.906165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0a9a4255-5ef3-4d28-9dad-517585b34bc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea93e1ba81f34ecaa8e458b89a88e355'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:00.920960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0a9a4255-5ef3-4d28-9dad-517585b34bc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea93e1ba81f34ecaa8e458b89a88e355'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:00.921692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0a9a4255-5ef3-4d28-9dad-517585b34bc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea93e1ba81f34ecaa8e458b89a88e355'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:00.932087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0a9a4255-5ef3-4d28-9dad-517585b34bc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea93e1ba81f34ecaa8e458b89a88e355'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:00.952432 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1584/3147] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:19:00 2022] DELETE /identity/v3/users/ea93e1ba81f34ecaa8e458b89a88e355 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:00.957775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a5c0d-14bb-4d84-affd-4e5398647c0a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:00.958159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a5c0d-14bb-4d84-affd-4e5398647c0a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:00.958525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a5c0d-14bb-4d84-affd-4e5398647c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:00.996145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-cb4a5c0d-14bb-4d84-affd-4e5398647c0a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:00.997398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cb4a5c0d-14bb-4d84-affd-4e5398647c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:01.095623 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1564/3148] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:01.105475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a4255-5ef3-4d28-9dad-517585b34bc2 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:01.107279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0a9a4255-5ef3-4d28-9dad-517585b34bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:01.243145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a4255-5ef3-4d28-9dad-517585b34bc2 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:01.249073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dcbfbd-7931-40bb-b17b-9f2ebae6824f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:01.250938 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcbfbd-7931-40bb-b17b-9f2ebae6824f service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:01.251488 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcbfbd-7931-40bb-b17b-9f2ebae6824f service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:01.252409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcbfbd-7931-40bb-b17b-9f2ebae6824f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:01.272502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dcbfbd-7931-40bb-b17b-9f2ebae6824f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:01.279802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dcbfbd-7931-40bb-b17b-9f2ebae6824f service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:01.309923 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1585/3149] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:19:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:19:01.617468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865acbe-d0f6-4663-984b-e8b7d9a11eaa None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:01.618382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865acbe-d0f6-4663-984b-e8b7d9a11eaa None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:01.619107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865acbe-d0f6-4663-984b-e8b7d9a11eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:01.668581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0865acbe-d0f6-4663-984b-e8b7d9a11eaa None None] MFA Rules not processed for user `5080c88d51a8455bba8b70e33cca958b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:01.670054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0865acbe-d0f6-4663-984b-e8b7d9a11eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:01.836501 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1565/3150] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:19:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:02.086562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dcbfbd-7931-40bb-b17b-9f2ebae6824f service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:02.100865 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e9dcbfbd-7931-40bb-b17b-9f2ebae6824f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:02.124530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dcbfbd-7931-40bb-b17b-9f2ebae6824f service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:02.193833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10946e20-12aa-434b-9ea7-1dabfc8c79ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:02.196378 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10946e20-12aa-434b-9ea7-1dabfc8c79ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:02.196894 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10946e20-12aa-434b-9ea7-1dabfc8c79ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:02.204877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10946e20-12aa-434b-9ea7-1dabfc8c79ba admin admin] PATH_INFO: `/v3/projects/75894dc30ff34892932d810a03b6b928` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:02.208499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10946e20-12aa-434b-9ea7-1dabfc8c79ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=75894dc30ff34892932d810a03b6b928)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:02.211164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10946e20-12aa-434b-9ea7-1dabfc8c79ba admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:02.366482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-10946e20-12aa-434b-9ea7-1dabfc8c79ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75894dc30ff34892932d810a03b6b928', 'request_id': 'req-10946e20-12aa-434b-9ea7-1dabfc8c79ba'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:02.385433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-10946e20-12aa-434b-9ea7-1dabfc8c79ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75894dc30ff34892932d810a03b6b928', 'request_id': 'req-10946e20-12aa-434b-9ea7-1dabfc8c79ba'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:02.396754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-10946e20-12aa-434b-9ea7-1dabfc8c79ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75894dc30ff34892932d810a03b6b928', 'request_id': 'req-10946e20-12aa-434b-9ea7-1dabfc8c79ba'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:02.425769 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-10946e20-12aa-434b-9ea7-1dabfc8c79ba admin admin] The token cache is being invalidate because project 75894dc30ff34892932d810a03b6b928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:19:02.426491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-10946e20-12aa-434b-9ea7-1dabfc8c79ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:02.427677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-10946e20-12aa-434b-9ea7-1dabfc8c79ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:02.435748 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1586/3151] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:19:02 2022] DELETE /identity/v3/projects/75894dc30ff34892932d810a03b6b928 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:02.441569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37d2d5-f779-4cd7-860e-35c758d7e7db None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:02.441951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37d2d5-f779-4cd7-860e-35c758d7e7db None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:02.442137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37d2d5-f779-4cd7-860e-35c758d7e7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:02.545345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7e37d2d5-f779-4cd7-860e-35c758d7e7db None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:02.546608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7e37d2d5-f779-4cd7-860e-35c758d7e7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:02.759678 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1566/3152] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:02.762244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83362fa-25bd-435f-8db2-7d63fcbbf1e9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:02.762869 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83362fa-25bd-435f-8db2-7d63fcbbf1e9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:02.763598 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83362fa-25bd-435f-8db2-7d63fcbbf1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:02.801101 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b83362fa-25bd-435f-8db2-7d63fcbbf1e9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:02.802957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b83362fa-25bd-435f-8db2-7d63fcbbf1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:02.816295 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1587/3153] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:02.819695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37d2d5-f779-4cd7-860e-35c758d7e7db None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:02.839727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37d2d5-f779-4cd7-860e-35c758d7e7db None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:02.852855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f067c-c0bd-4e18-aba0-ec231a2fac01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:02.853843 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f067c-c0bd-4e18-aba0-ec231a2fac01 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:02.854302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f067c-c0bd-4e18-aba0-ec231a2fac01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:02.854763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f067c-c0bd-4e18-aba0-ec231a2fac01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:02.855625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f067c-c0bd-4e18-aba0-ec231a2fac01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:19:02.856144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f067c-c0bd-4e18-aba0-ec231a2fac01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:02.858028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f067c-c0bd-4e18-aba0-ec231a2fac01 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:02.928350 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1567/3154] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:19:02.929620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83362fa-25bd-435f-8db2-7d63fcbbf1e9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:02.946884 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:02.957146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83362fa-25bd-435f-8db2-7d63fcbbf1e9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:03.019287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801947c-3c03-44e0-8147-e51f7921a255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:03.020710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801947c-3c03-44e0-8147-e51f7921a255 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:03.020710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801947c-3c03-44e0-8147-e51f7921a255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:03.020984 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801947c-3c03-44e0-8147-e51f7921a255 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:03.021412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801947c-3c03-44e0-8147-e51f7921a255 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:03.023522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801947c-3c03-44e0-8147-e51f7921a255 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:03.084217 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1588/3155] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:19:02 2022] POST /identity/v3/projects => generated 387 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:19:03.091192 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f067c-c0bd-4e18-aba0-ec231a2fac01 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:03.106543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f067c-c0bd-4e18-aba0-ec231a2fac01 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:03.212655 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:03.322255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec8430-b7f4-44ae-a43b-05694535d758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:03.323015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec8430-b7f4-44ae-a43b-05694535d758 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:03.323505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec8430-b7f4-44ae-a43b-05694535d758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:03.323855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec8430-b7f4-44ae-a43b-05694535d758 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:03.324610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec8430-b7f4-44ae-a43b-05694535d758 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:03.327306 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec8430-b7f4-44ae-a43b-05694535d758 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:03.381001 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1568/3156] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:19:03 2022] POST /identity/v3/users => generated 294 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:19:03.385311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801947c-3c03-44e0-8147-e51f7921a255 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:03.400469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801947c-3c03-44e0-8147-e51f7921a255 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:03.408871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73871458-9ba0-43de-9e1a-66650e1ecd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:03.409556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73871458-9ba0-43de-9e1a-66650e1ecd7b admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:03.409910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73871458-9ba0-43de-9e1a-66650e1ecd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:03.410589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73871458-9ba0-43de-9e1a-66650e1ecd7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:03.411806 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73871458-9ba0-43de-9e1a-66650e1ecd7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:03.414794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73871458-9ba0-43de-9e1a-66650e1ecd7b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:03.434838 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1589/3157] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:19:03.439740 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec8430-b7f4-44ae-a43b-05694535d758 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:03.455389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec8430-b7f4-44ae-a43b-05694535d758 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:03.470586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad71092-22bb-4b9f-a065-3bad49e1aea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:03.471220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad71092-22bb-4b9f-a065-3bad49e1aea5 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:03.471489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad71092-22bb-4b9f-a065-3bad49e1aea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:03.471774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad71092-22bb-4b9f-a065-3bad49e1aea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:03.472485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad71092-22bb-4b9f-a065-3bad49e1aea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:03.474844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad71092-22bb-4b9f-a065-3bad49e1aea5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:03.495280 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1569/3158] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:19:03.499739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73871458-9ba0-43de-9e1a-66650e1ecd7b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:03.511769 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73871458-9ba0-43de-9e1a-66650e1ecd7b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:03.528494 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80976bdd-62c9-4ab4-a340-9e21248c8390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:03.530931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80976bdd-62c9-4ab4-a340-9e21248c8390 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:03.530931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80976bdd-62c9-4ab4-a340-9e21248c8390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:03.530931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80976bdd-62c9-4ab4-a340-9e21248c8390 admin admin] PATH_INFO: `/v3/projects/173a9cd21505478684a69dc461813349/users/cb6a1da42d354933aa782ccdbb5831ac/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:03.571239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80976bdd-62c9-4ab4-a340-9e21248c8390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=173a9cd21505478684a69dc461813349, user_id=cb6a1da42d354933aa782ccdbb5831ac, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:03.578670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80976bdd-62c9-4ab4-a340-9e21248c8390 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:03.608537 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1590/3159] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:19:03 2022] PUT /identity/v3/projects/173a9cd21505478684a69dc461813349/users/cb6a1da42d354933aa782ccdbb5831ac/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:19:03.616807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec9b1a-8435-4021-8cad-d10c9bd30531 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:03.617345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec9b1a-8435-4021-8cad-d10c9bd30531 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:03.617478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec9b1a-8435-4021-8cad-d10c9bd30531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:03.661126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-afec9b1a-8435-4021-8cad-d10c9bd30531 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:03.662736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-afec9b1a-8435-4021-8cad-d10c9bd30531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:03.820125 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1570/3160] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:19:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:03.832499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80976bdd-62c9-4ab4-a340-9e21248c8390 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:03.834925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-80976bdd-62c9-4ab4-a340-9e21248c8390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:03.927841 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80976bdd-62c9-4ab4-a340-9e21248c8390 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:03.947470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ffd4c-2b3f-4c94-b63a-9ccfd1fe48ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:03.949897 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ffd4c-2b3f-4c94-b63a-9ccfd1fe48ea service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:03.950184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ffd4c-2b3f-4c94-b63a-9ccfd1fe48ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:03.950527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ffd4c-2b3f-4c94-b63a-9ccfd1fe48ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:03.974363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ffd4c-2b3f-4c94-b63a-9ccfd1fe48ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:03.982142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ffd4c-2b3f-4c94-b63a-9ccfd1fe48ea service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:04.005057 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1591/3161] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:19:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:19:06.198309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb599e7-83ca-4f85-bff5-0b40ca6ba718 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:06.199358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb599e7-83ca-4f85-bff5-0b40ca6ba718 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:06.199875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb599e7-83ca-4f85-bff5-0b40ca6ba718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:06.229926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9bb599e7-83ca-4f85-bff5-0b40ca6ba718 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:06.231729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9bb599e7-83ca-4f85-bff5-0b40ca6ba718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:06.362932 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1571/3162] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:19:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:06.379439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ffd4c-2b3f-4c94-b63a-9ccfd1fe48ea service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:06.381813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-988ffd4c-2b3f-4c94-b63a-9ccfd1fe48ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:06.598955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ffd4c-2b3f-4c94-b63a-9ccfd1fe48ea service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:06.614957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2864bb2-dbb0-44e6-ae24-777bc3958451 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:06.616011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2864bb2-dbb0-44e6-ae24-777bc3958451 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:06.617083 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2864bb2-dbb0-44e6-ae24-777bc3958451 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:06.617693 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2864bb2-dbb0-44e6-ae24-777bc3958451 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:06.643332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2864bb2-dbb0-44e6-ae24-777bc3958451 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:06.647965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2864bb2-dbb0-44e6-ae24-777bc3958451 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:06.675659 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1592/3163] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:19:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:19:07.357835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71049a64-b5ac-4ba0-98cd-ab931758ea56 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:07.358501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71049a64-b5ac-4ba0-98cd-ab931758ea56 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:07.358881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71049a64-b5ac-4ba0-98cd-ab931758ea56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:07.412946 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-71049a64-b5ac-4ba0-98cd-ab931758ea56 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:07.417606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-71049a64-b5ac-4ba0-98cd-ab931758ea56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:07.466361 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1572/3164] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:19:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:07.510409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2864bb2-dbb0-44e6-ae24-777bc3958451 service swift] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:07.532284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2864bb2-dbb0-44e6-ae24-777bc3958451 service swift] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:07.568722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8be91-b3e4-4e62-aafc-f7c0ad55c81c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:07.569355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8be91-b3e4-4e62-aafc-f7c0ad55c81c service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:07.569631 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8be91-b3e4-4e62-aafc-f7c0ad55c81c service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:07.569904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda8be91-b3e4-4e62-aafc-f7c0ad55c81c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:07.601115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda8be91-b3e4-4e62-aafc-f7c0ad55c81c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:07.602890 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda8be91-b3e4-4e62-aafc-f7c0ad55c81c service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:07.632213 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1593/3165] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:19:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:19:09.225517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9734b-cc68-42b7-a96a-b92208a113d1 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:09.226507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9734b-cc68-42b7-a96a-b92208a113d1 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:09.227123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9734b-cc68-42b7-a96a-b92208a113d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:09.287502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3aa9734b-cc68-42b7-a96a-b92208a113d1 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:09.289035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3aa9734b-cc68-42b7-a96a-b92208a113d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:09.299470 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1573/3166] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:19:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:09.319722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8be91-b3e4-4e62-aafc-f7c0ad55c81c service swift] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:09.338632 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda8be91-b3e4-4e62-aafc-f7c0ad55c81c service swift] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:09.360475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1646c2-42d8-4405-b6e6-be07ba236f2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:09.361327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1646c2-42d8-4405-b6e6-be07ba236f2d service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:09.361614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1646c2-42d8-4405-b6e6-be07ba236f2d service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:09.361882 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1646c2-42d8-4405-b6e6-be07ba236f2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:09.388472 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1646c2-42d8-4405-b6e6-be07ba236f2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:09.390308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1646c2-42d8-4405-b6e6-be07ba236f2d service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:09.420808 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1594/3167] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:19:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:19:11.863465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f5b18-a844-4208-82b7-e122c2aaa828 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:11.865454 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f5b18-a844-4208-82b7-e122c2aaa828 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:11.866164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f5b18-a844-4208-82b7-e122c2aaa828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:11.994104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-493f5b18-a844-4208-82b7-e122c2aaa828 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:11.995660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-493f5b18-a844-4208-82b7-e122c2aaa828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:12.036393 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1574/3168] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:19:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:12.072933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1646c2-42d8-4405-b6e6-be07ba236f2d service swift] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:12.102688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1646c2-42d8-4405-b6e6-be07ba236f2d service swift] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:12.116824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d44073-8356-46cf-9e9f-77bd6bb92be2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:12.117693 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d44073-8356-46cf-9e9f-77bd6bb92be2 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:12.118199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d44073-8356-46cf-9e9f-77bd6bb92be2 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:12.118649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d44073-8356-46cf-9e9f-77bd6bb92be2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:12.158924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d44073-8356-46cf-9e9f-77bd6bb92be2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:12.160999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d44073-8356-46cf-9e9f-77bd6bb92be2 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:12.166980 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:12.182845 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1595/3169] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:19:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:19:17.426102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337353f0-1bd6-423d-821c-92f56d730cde None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:17.426647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337353f0-1bd6-423d-821c-92f56d730cde None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:17.426647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337353f0-1bd6-423d-821c-92f56d730cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:17.460339 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-337353f0-1bd6-423d-821c-92f56d730cde None None] MFA Rules not processed for user `45ed48709ab84fa4b5b341332a843ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:17.462046 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-337353f0-1bd6-423d-821c-92f56d730cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:17.552273 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:17.626091 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1575/3170] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:19:17 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:18.918498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8292a9f-41fc-46da-9681-ae587c7133dc None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:18.918498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8292a9f-41fc-46da-9681-ae587c7133dc None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:18.919170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8292a9f-41fc-46da-9681-ae587c7133dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:19.012809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a8292a9f-41fc-46da-9681-ae587c7133dc None None] MFA Rules not processed for user `cb6a1da42d354933aa782ccdbb5831ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:19.019942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a8292a9f-41fc-46da-9681-ae587c7133dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:19.193505 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1596/3171] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:19:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:20.186833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337353f0-1bd6-423d-821c-92f56d730cde None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:20.186833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-337353f0-1bd6-423d-821c-92f56d730cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:20.419117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337353f0-1bd6-423d-821c-92f56d730cde None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:20.428316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ba8a7-1199-4a1f-934d-c914825f99a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:20.428991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ba8a7-1199-4a1f-934d-c914825f99a9 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:20.429197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ba8a7-1199-4a1f-934d-c914825f99a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:20.429463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ba8a7-1199-4a1f-934d-c914825f99a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:20.457758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ba8a7-1199-4a1f-934d-c914825f99a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:20.461244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37ba8a7-1199-4a1f-934d-c914825f99a9 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:20.502063 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1576/3172] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:19:20 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:19:20.707517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8292a9f-41fc-46da-9681-ae587c7133dc None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:20.710666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a8292a9f-41fc-46da-9681-ae587c7133dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:20.731490 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8292a9f-41fc-46da-9681-ae587c7133dc None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:20.739699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2bf7d-0df8-4a5c-94de-8399d9a0d31a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:20.741239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2bf7d-0df8-4a5c-94de-8399d9a0d31a service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:20.741702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2bf7d-0df8-4a5c-94de-8399d9a0d31a service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:20.742141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c2bf7d-0df8-4a5c-94de-8399d9a0d31a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:20.744668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-81c2bf7d-0df8-4a5c-94de-8399d9a0d31a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:20.764780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2bf7d-0df8-4a5c-94de-8399d9a0d31a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:20.766555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c2bf7d-0df8-4a5c-94de-8399d9a0d31a service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:20.807951 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1597/3173] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:19:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:19:27.307839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4db52-7469-4bcd-8b2c-dcdb90584bec None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:27.308513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4db52-7469-4bcd-8b2c-dcdb90584bec None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:27.308513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4db52-7469-4bcd-8b2c-dcdb90584bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:27.333862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e7b4db52-7469-4bcd-8b2c-dcdb90584bec None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:27.335545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e7b4db52-7469-4bcd-8b2c-dcdb90584bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:27.347733 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1577/3174] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:19:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:27.367932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2bf7d-0df8-4a5c-94de-8399d9a0d31a service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:27.389676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c2bf7d-0df8-4a5c-94de-8399d9a0d31a service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:27.400263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b87ff-0b5b-46fd-a698-086acc544695 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:27.401176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b87ff-0b5b-46fd-a698-086acc544695 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:27.402183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b87ff-0b5b-46fd-a698-086acc544695 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:27.402935 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b87ff-0b5b-46fd-a698-086acc544695 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:27.421382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b87ff-0b5b-46fd-a698-086acc544695 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:27.424997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b87ff-0b5b-46fd-a698-086acc544695 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:27.437556 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1598/3175] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:19:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:19:28.373519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3b874-333e-4452-ab31-0c55db0db9eb None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:28.374446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3b874-333e-4452-ab31-0c55db0db9eb None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:28.374934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3b874-333e-4452-ab31-0c55db0db9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:28.402123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-80c3b874-333e-4452-ab31-0c55db0db9eb None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:28.404980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-80c3b874-333e-4452-ab31-0c55db0db9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:28.421025 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1578/3176] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:19:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:28.442293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b87ff-0b5b-46fd-a698-086acc544695 service swift] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:28.458627 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b87ff-0b5b-46fd-a698-086acc544695 service swift] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:28.463988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4c5c0-01f6-4d4a-9ada-549bebafe213 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:28.465405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4c5c0-01f6-4d4a-9ada-549bebafe213 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:28.466265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4c5c0-01f6-4d4a-9ada-549bebafe213 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:28.466535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f4c5c0-01f6-4d4a-9ada-549bebafe213 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:28.482040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4c5c0-01f6-4d4a-9ada-549bebafe213 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:28.487947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f4c5c0-01f6-4d4a-9ada-549bebafe213 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:28.518224 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1599/3177] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:19:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:19:29.942425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e8d6a-cab2-4862-8f19-f5658732c997 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:29.943051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e8d6a-cab2-4862-8f19-f5658732c997 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:29.943051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e8d6a-cab2-4862-8f19-f5658732c997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:29.966747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-da9e8d6a-cab2-4862-8f19-f5658732c997 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:29.980403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-da9e8d6a-cab2-4862-8f19-f5658732c997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:30.000884 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1579/3178] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:19:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:19:30.015048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4c5c0-01f6-4d4a-9ada-549bebafe213 service swift] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:30.035051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f4c5c0-01f6-4d4a-9ada-549bebafe213 service swift] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:30.044138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1e044-352c-48c8-8405-b958b88ca3b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:30.045330 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1e044-352c-48c8-8405-b958b88ca3b4 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:30.045330 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1e044-352c-48c8-8405-b958b88ca3b4 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:30.045846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1e044-352c-48c8-8405-b958b88ca3b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:30.062912 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1e044-352c-48c8-8405-b958b88ca3b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:30.064654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1e044-352c-48c8-8405-b958b88ca3b4 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:30.077804 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1600/3179] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:19:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:19:30.208997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e8d6a-cab2-4862-8f19-f5658732c997 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:30.210780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-da9e8d6a-cab2-4862-8f19-f5658732c997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:30.229022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e8d6a-cab2-4862-8f19-f5658732c997 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:30.234804 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598530f4-adc3-41d9-809f-8ef0a67979dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:30.236115 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598530f4-adc3-41d9-809f-8ef0a67979dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:30.236224 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598530f4-adc3-41d9-809f-8ef0a67979dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:30.236417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598530f4-adc3-41d9-809f-8ef0a67979dd admin admin] PATH_INFO: `/v3/users/786962988b754fb69bd48070c2992e13` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:30.241942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598530f4-adc3-41d9-809f-8ef0a67979dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=786962988b754fb69bd48070c2992e13)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:30.243931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598530f4-adc3-41d9-809f-8ef0a67979dd admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:30.323366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-598530f4-adc3-41d9-809f-8ef0a67979dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '786962988b754fb69bd48070c2992e13'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:30.332214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-598530f4-adc3-41d9-809f-8ef0a67979dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '786962988b754fb69bd48070c2992e13'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:30.355873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-598530f4-adc3-41d9-809f-8ef0a67979dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '786962988b754fb69bd48070c2992e13'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:30.357089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-598530f4-adc3-41d9-809f-8ef0a67979dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '786962988b754fb69bd48070c2992e13'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:30.366740 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-598530f4-adc3-41d9-809f-8ef0a67979dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '786962988b754fb69bd48070c2992e13'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:30.381782 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1580/3180] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:19:30 2022] DELETE /identity/v3/users/786962988b754fb69bd48070c2992e13 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:30.386065 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67073376-e207-412f-949d-c247d7b2e0b1 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:30.386724 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67073376-e207-412f-949d-c247d7b2e0b1 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:30.387382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67073376-e207-412f-949d-c247d7b2e0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:30.430618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-67073376-e207-412f-949d-c247d7b2e0b1 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:30.432149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-67073376-e207-412f-949d-c247d7b2e0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:30.538552 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1601/3181] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:19:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:30.562813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598530f4-adc3-41d9-809f-8ef0a67979dd admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:30.565126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-598530f4-adc3-41d9-809f-8ef0a67979dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:30.623993 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:30.719049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598530f4-adc3-41d9-809f-8ef0a67979dd admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:30.729361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb439289-4086-4317-88d4-fb560a11a3f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:30.733205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb439289-4086-4317-88d4-fb560a11a3f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:30.733768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb439289-4086-4317-88d4-fb560a11a3f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:30.734209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb439289-4086-4317-88d4-fb560a11a3f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:30.755710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb439289-4086-4317-88d4-fb560a11a3f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:30.757829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb439289-4086-4317-88d4-fb560a11a3f7 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:30.781543 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1581/3182] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:19:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:19:31.049074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7aa1e2-90f0-4daf-b444-f940643c5cb4 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:31.049697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7aa1e2-90f0-4daf-b444-f940643c5cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:31.049869 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7aa1e2-90f0-4daf-b444-f940643c5cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:31.131863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-af7aa1e2-90f0-4daf-b444-f940643c5cb4 None None] MFA Rules not processed for user `d4f7282c7251455086368d5274a4fac5`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:31.137190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-af7aa1e2-90f0-4daf-b444-f940643c5cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:31.309448 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:31.403122 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1602/3183] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:19:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:31.427561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb439289-4086-4317-88d4-fb560a11a3f7 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:31.429279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cb439289-4086-4317-88d4-fb560a11a3f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:31.462620 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb439289-4086-4317-88d4-fb560a11a3f7 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:31.468828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3cbaa9-f11a-44dc-a982-e634d2ea4ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:31.470247 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cbaa9-f11a-44dc-a982-e634d2ea4ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:31.470684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cbaa9-f11a-44dc-a982-e634d2ea4ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:31.471103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cbaa9-f11a-44dc-a982-e634d2ea4ebb admin admin] PATH_INFO: `/v3/projects/614797cd26be4995b087ab864f35d235` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:31.473986 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3cbaa9-f11a-44dc-a982-e634d2ea4ebb admin admin] RBAC: Authorizing `identity:delete_project(project_id=614797cd26be4995b087ab864f35d235)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:31.476928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3cbaa9-f11a-44dc-a982-e634d2ea4ebb admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:31.569815 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ea3cbaa9-f11a-44dc-a982-e634d2ea4ebb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '614797cd26be4995b087ab864f35d235', 'request_id': 'req-ea3cbaa9-f11a-44dc-a982-e634d2ea4ebb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:31.580622 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ea3cbaa9-f11a-44dc-a982-e634d2ea4ebb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '614797cd26be4995b087ab864f35d235', 'request_id': 'req-ea3cbaa9-f11a-44dc-a982-e634d2ea4ebb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:31.597858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ea3cbaa9-f11a-44dc-a982-e634d2ea4ebb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '614797cd26be4995b087ab864f35d235', 'request_id': 'req-ea3cbaa9-f11a-44dc-a982-e634d2ea4ebb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:31.629436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ea3cbaa9-f11a-44dc-a982-e634d2ea4ebb admin admin] The token cache is being invalidate because project 614797cd26be4995b087ab864f35d235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:19:31.629806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ea3cbaa9-f11a-44dc-a982-e634d2ea4ebb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:31.631378 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ea3cbaa9-f11a-44dc-a982-e634d2ea4ebb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:31.638736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cf2a4-fd13-4055-b7db-57dd8591cb9b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:31.639017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cf2a4-fd13-4055-b7db-57dd8591cb9b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:31.639284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330cf2a4-fd13-4055-b7db-57dd8591cb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:31.640003 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1582/3184] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:19:31 2022] DELETE /identity/v3/projects/614797cd26be4995b087ab864f35d235 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:31.682902 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-330cf2a4-fd13-4055-b7db-57dd8591cb9b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:31.685020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-330cf2a4-fd13-4055-b7db-57dd8591cb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:31.819957 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1603/3185] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:19:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:19:31.828349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b57d35-0ac4-47e1-bbab-20872cc4d3b8 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:31.828705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b57d35-0ac4-47e1-bbab-20872cc4d3b8 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:31.829555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b57d35-0ac4-47e1-bbab-20872cc4d3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:31.894938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-95b57d35-0ac4-47e1-bbab-20872cc4d3b8 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:31.897563 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-95b57d35-0ac4-47e1-bbab-20872cc4d3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:31.931584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cf2a4-fd13-4055-b7db-57dd8591cb9b None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:31.931826 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1583/3186] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:19:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:31.948891 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330cf2a4-fd13-4055-b7db-57dd8591cb9b None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:31.959917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5363c80-a2c4-4d69-8d68-f74b1738509d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:31.960868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5363c80-a2c4-4d69-8d68-f74b1738509d admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:31.961335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5363c80-a2c4-4d69-8d68-f74b1738509d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:31.961789 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5363c80-a2c4-4d69-8d68-f74b1738509d admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:31.962731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5363c80-a2c4-4d69-8d68-f74b1738509d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:19:31.963350 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5363c80-a2c4-4d69-8d68-f74b1738509d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:31.965272 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5363c80-a2c4-4d69-8d68-f74b1738509d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:31.996509 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1604/3187] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:19:32.000901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b57d35-0ac4-47e1-bbab-20872cc4d3b8 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:32.013299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b57d35-0ac4-47e1-bbab-20872cc4d3b8 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:32.025055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ba601-0b43-4ee3-8b83-84160d26bc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:32.025691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ba601-0b43-4ee3-8b83-84160d26bc7e admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:32.025967 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ba601-0b43-4ee3-8b83-84160d26bc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:32.026234 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ba601-0b43-4ee3-8b83-84160d26bc7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:32.026873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ba601-0b43-4ee3-8b83-84160d26bc7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:32.028879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ba601-0b43-4ee3-8b83-84160d26bc7e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:32.103457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5363c80-a2c4-4d69-8d68-f74b1738509d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:32.104185 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1584/3188] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:19:31 2022] POST /identity/v3/projects => generated 401 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:19:32.128655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5363c80-a2c4-4d69-8d68-f74b1738509d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:32.325190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7dacf-1c8a-44d7-9926-0e0f0ff8d36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:32.326077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7dacf-1c8a-44d7-9926-0e0f0ff8d36e admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:32.326422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7dacf-1c8a-44d7-9926-0e0f0ff8d36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:32.326805 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7dacf-1c8a-44d7-9926-0e0f0ff8d36e admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:32.327564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7dacf-1c8a-44d7-9926-0e0f0ff8d36e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:32.330400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7dacf-1c8a-44d7-9926-0e0f0ff8d36e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:32.366512 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1605/3189] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:19:32 2022] POST /identity/v3/users => generated 301 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:19:32.368232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ba601-0b43-4ee3-8b83-84160d26bc7e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:32.387251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ba601-0b43-4ee3-8b83-84160d26bc7e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:32.394130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322947ea-4146-4995-bc95-972d98008667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:32.394839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322947ea-4146-4995-bc95-972d98008667 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:32.395142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322947ea-4146-4995-bc95-972d98008667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:32.395415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322947ea-4146-4995-bc95-972d98008667 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:32.396376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322947ea-4146-4995-bc95-972d98008667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:32.398223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322947ea-4146-4995-bc95-972d98008667 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:32.424741 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1585/3190] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:19:32.428711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7dacf-1c8a-44d7-9926-0e0f0ff8d36e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:32.443400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7dacf-1c8a-44d7-9926-0e0f0ff8d36e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:32.453227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcae9b-8043-4943-bd21-28bc1c2c58da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:32.454696 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcae9b-8043-4943-bd21-28bc1c2c58da admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:32.455338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcae9b-8043-4943-bd21-28bc1c2c58da admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:32.456457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcae9b-8043-4943-bd21-28bc1c2c58da admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:32.458557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffcae9b-8043-4943-bd21-28bc1c2c58da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:32.460687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffcae9b-8043-4943-bd21-28bc1c2c58da admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:32.483037 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1606/3191] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:19:32.489235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322947ea-4146-4995-bc95-972d98008667 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:32.511983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322947ea-4146-4995-bc95-972d98008667 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:32.530426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590416fd-ce1a-4863-b8ef-9d5176ef5739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:32.531184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590416fd-ce1a-4863-b8ef-9d5176ef5739 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:32.531471 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590416fd-ce1a-4863-b8ef-9d5176ef5739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:32.531738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590416fd-ce1a-4863-b8ef-9d5176ef5739 admin admin] PATH_INFO: `/v3/projects/220e8f7e3524463d816698a16ece9e21/users/5c03a3fc3d0f47e79930637bf24330e1/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:32.557274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590416fd-ce1a-4863-b8ef-9d5176ef5739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=220e8f7e3524463d816698a16ece9e21, user_id=5c03a3fc3d0f47e79930637bf24330e1, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:32.560876 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590416fd-ce1a-4863-b8ef-9d5176ef5739 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:32.608925 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1586/3192] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:19:32 2022] PUT /identity/v3/projects/220e8f7e3524463d816698a16ece9e21/users/5c03a3fc3d0f47e79930637bf24330e1/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:19:32.615457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530881aa-4ef9-425a-abbf-c5645502c0de None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:32.615457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530881aa-4ef9-425a-abbf-c5645502c0de None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:32.615457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530881aa-4ef9-425a-abbf-c5645502c0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:32.714570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-530881aa-4ef9-425a-abbf-c5645502c0de None None] MFA Rules not processed for user `5c03a3fc3d0f47e79930637bf24330e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:32.716570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-530881aa-4ef9-425a-abbf-c5645502c0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:32.785639 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:32.847119 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1607/3193] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:19:32 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:33.198960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590416fd-ce1a-4863-b8ef-9d5176ef5739 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:33.202190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-590416fd-ce1a-4863-b8ef-9d5176ef5739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:33.354917 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:33.402737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590416fd-ce1a-4863-b8ef-9d5176ef5739 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:33.410175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35e3b7-0ce3-43ef-ac0e-c19e1a1d65ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:33.411122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35e3b7-0ce3-43ef-ac0e-c19e1a1d65ff service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:33.411419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35e3b7-0ce3-43ef-ac0e-c19e1a1d65ff service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:33.412239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35e3b7-0ce3-43ef-ac0e-c19e1a1d65ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:33.425198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35e3b7-0ce3-43ef-ac0e-c19e1a1d65ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:33.427484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35e3b7-0ce3-43ef-ac0e-c19e1a1d65ff service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:33.443538 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1587/3194] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:19:33 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:19:33.519635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530881aa-4ef9-425a-abbf-c5645502c0de None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:33.650708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530881aa-4ef9-425a-abbf-c5645502c0de None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:33.661901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3b3b4-7600-40fc-b83a-fbfbe00416d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:33.664379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3b3b4-7600-40fc-b83a-fbfbe00416d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:33.664928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3b3b4-7600-40fc-b83a-fbfbe00416d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:33.665647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3b3b4-7600-40fc-b83a-fbfbe00416d3 admin admin] PATH_INFO: `/v3/users/5c03a3fc3d0f47e79930637bf24330e1` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:33.667211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3b3b4-7600-40fc-b83a-fbfbe00416d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c03a3fc3d0f47e79930637bf24330e1)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:33.670191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3b3b4-7600-40fc-b83a-fbfbe00416d3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:33.760474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ebb3b3b4-7600-40fc-b83a-fbfbe00416d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c03a3fc3d0f47e79930637bf24330e1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:33.778501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ebb3b3b4-7600-40fc-b83a-fbfbe00416d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c03a3fc3d0f47e79930637bf24330e1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:33.822435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ebb3b3b4-7600-40fc-b83a-fbfbe00416d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c03a3fc3d0f47e79930637bf24330e1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:33.829673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ebb3b3b4-7600-40fc-b83a-fbfbe00416d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c03a3fc3d0f47e79930637bf24330e1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:33.863544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ebb3b3b4-7600-40fc-b83a-fbfbe00416d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c03a3fc3d0f47e79930637bf24330e1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:33.874607 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1608/3195] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:19:33 2022] DELETE /identity/v3/users/5c03a3fc3d0f47e79930637bf24330e1 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:33.879431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712165fd-7453-425e-a292-797e736b753c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:33.879947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712165fd-7453-425e-a292-797e736b753c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:33.880182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712165fd-7453-425e-a292-797e736b753c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:33.923279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-712165fd-7453-425e-a292-797e736b753c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:33.941909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-712165fd-7453-425e-a292-797e736b753c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:34.162389 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1588/3196] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:19:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:34.201834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3b3b4-7600-40fc-b83a-fbfbe00416d3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:34.203752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ebb3b3b4-7600-40fc-b83a-fbfbe00416d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:34.344587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3b3b4-7600-40fc-b83a-fbfbe00416d3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:34.348732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bf403-cee0-4841-837c-594eba66dbe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:34.349534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bf403-cee0-4841-837c-594eba66dbe1 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:34.349716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bf403-cee0-4841-837c-594eba66dbe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:34.349887 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bf403-cee0-4841-837c-594eba66dbe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:34.361163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bf403-cee0-4841-837c-594eba66dbe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:34.362375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6bf403-cee0-4841-837c-594eba66dbe1 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:34.369097 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:34.387050 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1609/3197] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:19:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:19:34.498745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712165fd-7453-425e-a292-797e736b753c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:34.511700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712165fd-7453-425e-a292-797e736b753c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:34.515789 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3db193-ab41-4d76-acba-a44313717bd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:34.516491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3db193-ab41-4d76-acba-a44313717bd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:34.517718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3db193-ab41-4d76-acba-a44313717bd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:34.517997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3db193-ab41-4d76-acba-a44313717bd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:34.519825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3f3db193-ab41-4d76-acba-a44313717bd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:34.533995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bf403-cee0-4841-837c-594eba66dbe1 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:34.536493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5f6bf403-cee0-4841-837c-594eba66dbe1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:34.550305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bf403-cee0-4841-837c-594eba66dbe1 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:34.554594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4e31f-0733-47c8-8572-eda3339160ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:34.555329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4e31f-0733-47c8-8572-eda3339160ed service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:34.555642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4e31f-0733-47c8-8572-eda3339160ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:34.555957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe4e31f-0733-47c8-8572-eda3339160ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:34.559103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dfe4e31f-0733-47c8-8572-eda3339160ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:34.659390 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4e31f-0733-47c8-8572-eda3339160ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:34.660936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe4e31f-0733-47c8-8572-eda3339160ed service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:34.676189 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3db193-ab41-4d76-acba-a44313717bd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:34.677463 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1610/3198] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:19:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:19:34.678115 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3db193-ab41-4d76-acba-a44313717bd5 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:34.694532 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1589/3199] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:19:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:19:35.548757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4e31f-0733-47c8-8572-eda3339160ed service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:35.550411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dfe4e31f-0733-47c8-8572-eda3339160ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:35.565457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe4e31f-0733-47c8-8572-eda3339160ed service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:35.573400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa759b-3a86-4da6-8957-f8136f03594f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:35.574514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa759b-3a86-4da6-8957-f8136f03594f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:35.575020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa759b-3a86-4da6-8957-f8136f03594f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:35.575357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa759b-3a86-4da6-8957-f8136f03594f admin admin] PATH_INFO: `/v3/projects/220e8f7e3524463d816698a16ece9e21` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:35.577119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa759b-3a86-4da6-8957-f8136f03594f admin admin] RBAC: Authorizing `identity:delete_project(project_id=220e8f7e3524463d816698a16ece9e21)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:35.579928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa759b-3a86-4da6-8957-f8136f03594f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:35.647430 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-49aa759b-3a86-4da6-8957-f8136f03594f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '220e8f7e3524463d816698a16ece9e21', 'request_id': 'req-49aa759b-3a86-4da6-8957-f8136f03594f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:35.654627 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-49aa759b-3a86-4da6-8957-f8136f03594f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '220e8f7e3524463d816698a16ece9e21', 'request_id': 'req-49aa759b-3a86-4da6-8957-f8136f03594f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:35.667160 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-49aa759b-3a86-4da6-8957-f8136f03594f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '220e8f7e3524463d816698a16ece9e21', 'request_id': 'req-49aa759b-3a86-4da6-8957-f8136f03594f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:35.692883 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-49aa759b-3a86-4da6-8957-f8136f03594f admin admin] The token cache is being invalidate because project 220e8f7e3524463d816698a16ece9e21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:19:35.693124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-49aa759b-3a86-4da6-8957-f8136f03594f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:35.693793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-49aa759b-3a86-4da6-8957-f8136f03594f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:35.699438 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1611/3200] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:19:35 2022] DELETE /identity/v3/projects/220e8f7e3524463d816698a16ece9e21 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:35.701269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427a1b6-66be-414c-b972-126c95f0ca74 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:35.701926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427a1b6-66be-414c-b972-126c95f0ca74 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:35.702216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427a1b6-66be-414c-b972-126c95f0ca74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:35.726116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-5427a1b6-66be-414c-b972-126c95f0ca74 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:35.727382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5427a1b6-66be-414c-b972-126c95f0ca74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:35.792496 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:35.816043 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1590/3201] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:35.825184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35442043-356f-4cb3-8ffe-c1ecea438f77 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:35.825470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35442043-356f-4cb3-8ffe-c1ecea438f77 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:35.825730 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35442043-356f-4cb3-8ffe-c1ecea438f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:35.850163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-35442043-356f-4cb3-8ffe-c1ecea438f77 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:35.852124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-35442043-356f-4cb3-8ffe-c1ecea438f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:35.869055 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1612/3202] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:35.871414 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427a1b6-66be-414c-b972-126c95f0ca74 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:35.887395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427a1b6-66be-414c-b972-126c95f0ca74 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:35.894245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcaf77-896e-47b0-8106-28c33df35ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:35.895454 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcaf77-896e-47b0-8106-28c33df35ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:35.896278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcaf77-896e-47b0-8106-28c33df35ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:35.896843 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcaf77-896e-47b0-8106-28c33df35ec8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:35.898884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bcaf77-896e-47b0-8106-28c33df35ec8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:19:35.899505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bcaf77-896e-47b0-8106-28c33df35ec8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:35.901587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bcaf77-896e-47b0-8106-28c33df35ec8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:35.918880 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1591/3203] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:19:35.926640 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35442043-356f-4cb3-8ffe-c1ecea438f77 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:35.975587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35442043-356f-4cb3-8ffe-c1ecea438f77 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:35.998658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4670d-9d6f-4990-96e9-7dfb597ce5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:36.001708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4670d-9d6f-4990-96e9-7dfb597ce5ed admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:36.002334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4670d-9d6f-4990-96e9-7dfb597ce5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:36.004318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4670d-9d6f-4990-96e9-7dfb597ce5ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:36.005955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4670d-9d6f-4990-96e9-7dfb597ce5ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:36.008735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4670d-9d6f-4990-96e9-7dfb597ce5ed admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:36.046114 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1613/3204] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:19:35 2022] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:19:36.051472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcaf77-896e-47b0-8106-28c33df35ec8 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:36.065137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcaf77-896e-47b0-8106-28c33df35ec8 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:36.167577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f38618-43d5-4732-a8e3-d0b3cc866198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:36.168715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f38618-43d5-4732-a8e3-d0b3cc866198 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:36.169225 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f38618-43d5-4732-a8e3-d0b3cc866198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:36.169916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f38618-43d5-4732-a8e3-d0b3cc866198 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:36.171516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f38618-43d5-4732-a8e3-d0b3cc866198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:36.174235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f38618-43d5-4732-a8e3-d0b3cc866198 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:36.215735 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1592/3205] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:19:36 2022] POST /identity/v3/users => generated 283 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:19:36.216424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4670d-9d6f-4990-96e9-7dfb597ce5ed admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:36.231128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4670d-9d6f-4990-96e9-7dfb597ce5ed admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:36.238838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8b26e-13a2-4362-8a95-9a2e986b316b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:36.240507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8b26e-13a2-4362-8a95-9a2e986b316b admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:36.240507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8b26e-13a2-4362-8a95-9a2e986b316b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:36.240507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8b26e-13a2-4362-8a95-9a2e986b316b admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:36.241051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8b26e-13a2-4362-8a95-9a2e986b316b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:36.242753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8b26e-13a2-4362-8a95-9a2e986b316b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:36.264253 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1614/3206] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:19:36.268522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f38618-43d5-4732-a8e3-d0b3cc866198 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:36.283961 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f38618-43d5-4732-a8e3-d0b3cc866198 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:36.290982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad164e94-adc1-4c52-9a64-db291bdd933f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:36.291683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad164e94-adc1-4c52-9a64-db291bdd933f admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:36.292083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad164e94-adc1-4c52-9a64-db291bdd933f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:36.292525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad164e94-adc1-4c52-9a64-db291bdd933f admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:36.293439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad164e94-adc1-4c52-9a64-db291bdd933f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:36.295267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad164e94-adc1-4c52-9a64-db291bdd933f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:36.319731 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1593/3207] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:19:36.320534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8b26e-13a2-4362-8a95-9a2e986b316b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:36.332218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8b26e-13a2-4362-8a95-9a2e986b316b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:36.339521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72595392-b98d-446b-8aeb-ad9f23f87896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:36.340261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72595392-b98d-446b-8aeb-ad9f23f87896 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:36.340539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72595392-b98d-446b-8aeb-ad9f23f87896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:36.340813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72595392-b98d-446b-8aeb-ad9f23f87896 admin admin] PATH_INFO: `/v3/projects/5897e4c216e646aaa3a4c9ec2c7a1cfb/users/80f8680c2a39400c8fcfc221872fa299/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:36.360957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72595392-b98d-446b-8aeb-ad9f23f87896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5897e4c216e646aaa3a4c9ec2c7a1cfb, user_id=80f8680c2a39400c8fcfc221872fa299, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:36.364962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72595392-b98d-446b-8aeb-ad9f23f87896 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:36.391854 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1615/3208] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:19:36 2022] PUT /identity/v3/projects/5897e4c216e646aaa3a4c9ec2c7a1cfb/users/80f8680c2a39400c8fcfc221872fa299/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:19:36.395905 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e632f-c00c-405e-a869-09fb553cbe9a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:36.397010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e632f-c00c-405e-a869-09fb553cbe9a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:36.398317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e632f-c00c-405e-a869-09fb553cbe9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:36.428279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-bd0e632f-c00c-405e-a869-09fb553cbe9a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:36.430190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bd0e632f-c00c-405e-a869-09fb553cbe9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:36.538531 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1594/3209] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:36.636646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72595392-b98d-446b-8aeb-ad9f23f87896 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:36.639633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-72595392-b98d-446b-8aeb-ad9f23f87896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:36.649212 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:36.733260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72595392-b98d-446b-8aeb-ad9f23f87896 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:36.740340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f8a3b-8042-496b-a8be-7fa5fcedf671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:36.741275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f8a3b-8042-496b-a8be-7fa5fcedf671 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:36.741852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f8a3b-8042-496b-a8be-7fa5fcedf671 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:36.742227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f8a3b-8042-496b-a8be-7fa5fcedf671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:36.755439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f8a3b-8042-496b-a8be-7fa5fcedf671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:36.756901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f8a3b-8042-496b-a8be-7fa5fcedf671 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:36.804109 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1616/3210] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:19:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:19:39.539356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e632f-c00c-405e-a869-09fb553cbe9a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:39.544583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bd0e632f-c00c-405e-a869-09fb553cbe9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:39.563386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e632f-c00c-405e-a869-09fb553cbe9a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:39.567915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17579a-5b7c-4c57-9559-56b2e90ddb28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:39.568628 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17579a-5b7c-4c57-9559-56b2e90ddb28 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:39.568907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17579a-5b7c-4c57-9559-56b2e90ddb28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:39.569179 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17579a-5b7c-4c57-9559-56b2e90ddb28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:39.571239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ab17579a-5b7c-4c57-9559-56b2e90ddb28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:39.584784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17579a-5b7c-4c57-9559-56b2e90ddb28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:39.586515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17579a-5b7c-4c57-9559-56b2e90ddb28 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:39.599676 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1595/3211] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:19:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:19:42.255866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f8a3b-8042-496b-a8be-7fa5fcedf671 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:42.257369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-217f8a3b-8042-496b-a8be-7fa5fcedf671 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:42.365884 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f8a3b-8042-496b-a8be-7fa5fcedf671 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:42.373641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d5b5b-5b49-4f5b-bb0c-0571f5818d40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:42.374275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d5b5b-5b49-4f5b-bb0c-0571f5818d40 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:42.374638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d5b5b-5b49-4f5b-bb0c-0571f5818d40 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:42.375112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d5b5b-5b49-4f5b-bb0c-0571f5818d40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:42.376856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e98d5b5b-5b49-4f5b-bb0c-0571f5818d40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:42.487828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d5b5b-5b49-4f5b-bb0c-0571f5818d40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:42.494432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d5b5b-5b49-4f5b-bb0c-0571f5818d40 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:42.512760 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1617/3212] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:19:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:19:46.253608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17579a-5b7c-4c57-9559-56b2e90ddb28 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:46.256770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ab17579a-5b7c-4c57-9559-56b2e90ddb28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:46.362463 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:46.431788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d5b5b-5b49-4f5b-bb0c-0571f5818d40 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:46.434025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e98d5b5b-5b49-4f5b-bb0c-0571f5818d40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:46.465987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17579a-5b7c-4c57-9559-56b2e90ddb28 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:46.475752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d5b5b-5b49-4f5b-bb0c-0571f5818d40 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:46.484298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d8a23-5504-4948-b9f1-c4afb191eb85 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:46.485760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d8a23-5504-4948-b9f1-c4afb191eb85 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:46.486213 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d8a23-5504-4948-b9f1-c4afb191eb85 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:46.486650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d8a23-5504-4948-b9f1-c4afb191eb85 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:46.489186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cffde-5b75-49ff-9a0d-6c36824ccd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:46.490414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cffde-5b75-49ff-9a0d-6c36824ccd5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:46.491104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cffde-5b75-49ff-9a0d-6c36824ccd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:46.491554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cffde-5b75-49ff-9a0d-6c36824ccd5d admin admin] PATH_INFO: `/v3/users/0327f14a188e45fba98a58e5fd061248` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:46.493087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6cffde-5b75-49ff-9a0d-6c36824ccd5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0327f14a188e45fba98a58e5fd061248)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:46.497759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6cffde-5b75-49ff-9a0d-6c36824ccd5d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:46.497946 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c34d8a23-5504-4948-b9f1-c4afb191eb85 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:46.521011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d8a23-5504-4948-b9f1-c4afb191eb85 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:46.523199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d8a23-5504-4948-b9f1-c4afb191eb85 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:46.554985 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1596/3213] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:19:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:19:46.634115 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:46.676019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8b6cffde-5b75-49ff-9a0d-6c36824ccd5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0327f14a188e45fba98a58e5fd061248'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:46.716870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8b6cffde-5b75-49ff-9a0d-6c36824ccd5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0327f14a188e45fba98a58e5fd061248'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:46.742493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8b6cffde-5b75-49ff-9a0d-6c36824ccd5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0327f14a188e45fba98a58e5fd061248'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:46.743576 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8b6cffde-5b75-49ff-9a0d-6c36824ccd5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0327f14a188e45fba98a58e5fd061248'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:46.760393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8b6cffde-5b75-49ff-9a0d-6c36824ccd5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0327f14a188e45fba98a58e5fd061248'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:46.767857 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1618/3214] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:19:46 2022] DELETE /identity/v3/users/0327f14a188e45fba98a58e5fd061248 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:19:47.455915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d8a23-5504-4948-b9f1-c4afb191eb85 service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:47.519828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d8a23-5504-4948-b9f1-c4afb191eb85 service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:47.791329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431265d0-79bc-48bf-b13f-0a41b068c48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:47.792255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431265d0-79bc-48bf-b13f-0a41b068c48c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:47.792906 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431265d0-79bc-48bf-b13f-0a41b068c48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:47.793580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431265d0-79bc-48bf-b13f-0a41b068c48c admin admin] PATH_INFO: `/v3/projects/ba9e7a1c1fe14f47b5a5acf2fe8893b5` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:47.794985 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431265d0-79bc-48bf-b13f-0a41b068c48c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba9e7a1c1fe14f47b5a5acf2fe8893b5)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:47.802475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431265d0-79bc-48bf-b13f-0a41b068c48c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:47.918920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-431265d0-79bc-48bf-b13f-0a41b068c48c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'request_id': 'req-431265d0-79bc-48bf-b13f-0a41b068c48c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:47.933256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-431265d0-79bc-48bf-b13f-0a41b068c48c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'request_id': 'req-431265d0-79bc-48bf-b13f-0a41b068c48c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:47.943790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-431265d0-79bc-48bf-b13f-0a41b068c48c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba9e7a1c1fe14f47b5a5acf2fe8893b5', 'request_id': 'req-431265d0-79bc-48bf-b13f-0a41b068c48c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:47.981653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-431265d0-79bc-48bf-b13f-0a41b068c48c admin admin] The token cache is being invalidate because project ba9e7a1c1fe14f47b5a5acf2fe8893b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:19:47.981653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-431265d0-79bc-48bf-b13f-0a41b068c48c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:47.981653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-431265d0-79bc-48bf-b13f-0a41b068c48c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:47.984079 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1597/3215] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:19:47 2022] DELETE /identity/v3/projects/ba9e7a1c1fe14f47b5a5acf2fe8893b5 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:47.988267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cffde-5b75-49ff-9a0d-6c36824ccd5d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:47.989767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8b6cffde-5b75-49ff-9a0d-6c36824ccd5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:48.018046 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cffde-5b75-49ff-9a0d-6c36824ccd5d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:48.053535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067591e-2b2f-4c63-8894-d7739524ee41 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:48.054693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067591e-2b2f-4c63-8894-d7739524ee41 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:48.055382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067591e-2b2f-4c63-8894-d7739524ee41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:48.113493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7067591e-2b2f-4c63-8894-d7739524ee41 None None] MFA Rules not processed for user `80f8680c2a39400c8fcfc221872fa299`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:48.115090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7067591e-2b2f-4c63-8894-d7739524ee41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:48.163571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1feeb-c039-433f-81e0-bd3f3ffe92de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:48.165295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1feeb-c039-433f-81e0-bd3f3ffe92de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:48.167966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1feeb-c039-433f-81e0-bd3f3ffe92de admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:48.168914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1feeb-c039-433f-81e0-bd3f3ffe92de admin admin] PATH_INFO: `/v3/users/38ed89a4458f4f23aaf725706c2d027b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:48.173346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1feeb-c039-433f-81e0-bd3f3ffe92de admin admin] RBAC: Authorizing `identity:delete_user(user_id=38ed89a4458f4f23aaf725706c2d027b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:48.176262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1feeb-c039-433f-81e0-bd3f3ffe92de admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:48.229381 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:48.257289 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1598/3216] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:19:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:48.267934 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-add1feeb-c039-433f-81e0-bd3f3ffe92de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38ed89a4458f4f23aaf725706c2d027b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:48.273882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067591e-2b2f-4c63-8894-d7739524ee41 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:48.276637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7067591e-2b2f-4c63-8894-d7739524ee41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:48.286027 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-add1feeb-c039-433f-81e0-bd3f3ffe92de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38ed89a4458f4f23aaf725706c2d027b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:48.314535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-add1feeb-c039-433f-81e0-bd3f3ffe92de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38ed89a4458f4f23aaf725706c2d027b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:48.315858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-add1feeb-c039-433f-81e0-bd3f3ffe92de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38ed89a4458f4f23aaf725706c2d027b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:48.331082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-add1feeb-c039-433f-81e0-bd3f3ffe92de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38ed89a4458f4f23aaf725706c2d027b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:48.341255 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1619/3217] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:19:47 2022] DELETE /identity/v3/users/38ed89a4458f4f23aaf725706c2d027b => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:48.413156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067591e-2b2f-4c63-8894-d7739524ee41 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:48.526645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b154af1-dbc1-4c88-8dbd-affa5d11ad69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:48.527336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b154af1-dbc1-4c88-8dbd-affa5d11ad69 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:48.527823 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b154af1-dbc1-4c88-8dbd-affa5d11ad69 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:48.528468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b154af1-dbc1-4c88-8dbd-affa5d11ad69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:48.531120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4b154af1-dbc1-4c88-8dbd-affa5d11ad69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:48.665709 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1feeb-c039-433f-81e0-bd3f3ffe92de admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:48.667851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-add1feeb-c039-433f-81e0-bd3f3ffe92de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:48.683747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b154af1-dbc1-4c88-8dbd-affa5d11ad69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:48.691232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b154af1-dbc1-4c88-8dbd-affa5d11ad69 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:48.731867 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1599/3218] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:19:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:19:48.738897 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:48.860348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1feeb-c039-433f-81e0-bd3f3ffe92de admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:48.880601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a4235-e72b-432a-8334-7e61cd899441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:48.881314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a4235-e72b-432a-8334-7e61cd899441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:48.881601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a4235-e72b-432a-8334-7e61cd899441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:48.881875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a4235-e72b-432a-8334-7e61cd899441 admin admin] PATH_INFO: `/v3/projects/bc03c42891a04651a913e443de7e1c37` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:48.883285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a4235-e72b-432a-8334-7e61cd899441 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc03c42891a04651a913e443de7e1c37)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:48.885769 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a4235-e72b-432a-8334-7e61cd899441 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:49.002335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-387a4235-e72b-432a-8334-7e61cd899441 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc03c42891a04651a913e443de7e1c37', 'request_id': 'req-387a4235-e72b-432a-8334-7e61cd899441'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:49.010221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-387a4235-e72b-432a-8334-7e61cd899441 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc03c42891a04651a913e443de7e1c37', 'request_id': 'req-387a4235-e72b-432a-8334-7e61cd899441'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:49.020371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-387a4235-e72b-432a-8334-7e61cd899441 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc03c42891a04651a913e443de7e1c37', 'request_id': 'req-387a4235-e72b-432a-8334-7e61cd899441'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:49.042877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-387a4235-e72b-432a-8334-7e61cd899441 admin admin] The token cache is being invalidate because project bc03c42891a04651a913e443de7e1c37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:19:49.044652 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-387a4235-e72b-432a-8334-7e61cd899441 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:49.045204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-387a4235-e72b-432a-8334-7e61cd899441 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:49.063438 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1620/3219] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:19:48 2022] DELETE /identity/v3/projects/bc03c42891a04651a913e443de7e1c37 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:49.066270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c795c0-75fd-4045-bed7-b7692fb3b07c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:49.066560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c795c0-75fd-4045-bed7-b7692fb3b07c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:49.067501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c795c0-75fd-4045-bed7-b7692fb3b07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:49.099858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-83c795c0-75fd-4045-bed7-b7692fb3b07c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:49.101361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-83c795c0-75fd-4045-bed7-b7692fb3b07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:49.138134 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:49.223435 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1600/3220] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:49.231435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c87a5-eeb4-470a-8b84-f5abf6f20323 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:49.232068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c87a5-eeb4-470a-8b84-f5abf6f20323 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:49.232538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c87a5-eeb4-470a-8b84-f5abf6f20323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:49.280617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-195c87a5-eeb4-470a-8b84-f5abf6f20323 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:49.286136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-195c87a5-eeb4-470a-8b84-f5abf6f20323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:49.319209 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1621/3221] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:49.327184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c795c0-75fd-4045-bed7-b7692fb3b07c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:49.347420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c795c0-75fd-4045-bed7-b7692fb3b07c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:49.357713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b13deb-a157-4095-9a7b-4ca245d6eb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:49.358345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b13deb-a157-4095-9a7b-4ca245d6eb40 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:49.358671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b13deb-a157-4095-9a7b-4ca245d6eb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:49.359048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b13deb-a157-4095-9a7b-4ca245d6eb40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:49.359712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b13deb-a157-4095-9a7b-4ca245d6eb40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:19:49.360490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b13deb-a157-4095-9a7b-4ca245d6eb40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:49.362785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b13deb-a157-4095-9a7b-4ca245d6eb40 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:49.378847 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1601/3222] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:19:49.383407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c87a5-eeb4-470a-8b84-f5abf6f20323 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:49.394840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c87a5-eeb4-470a-8b84-f5abf6f20323 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:49.403000 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381aefbd-fb9b-4166-9c3e-4546c3b7f571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:49.404283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381aefbd-fb9b-4166-9c3e-4546c3b7f571 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:49.405647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381aefbd-fb9b-4166-9c3e-4546c3b7f571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:49.406025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381aefbd-fb9b-4166-9c3e-4546c3b7f571 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:49.406831 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381aefbd-fb9b-4166-9c3e-4546c3b7f571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:49.409664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381aefbd-fb9b-4166-9c3e-4546c3b7f571 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:49.460391 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1622/3223] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:19:49 2022] POST /identity/v3/projects => generated 393 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:19:49.464772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b13deb-a157-4095-9a7b-4ca245d6eb40 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:49.489419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b13deb-a157-4095-9a7b-4ca245d6eb40 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:49.567899 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcc8a8-4228-485f-b49c-1481a7b6643c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:49.569673 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcc8a8-4228-485f-b49c-1481a7b6643c admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:49.569673 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcc8a8-4228-485f-b49c-1481a7b6643c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:49.569965 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcc8a8-4228-485f-b49c-1481a7b6643c admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:49.570413 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdcc8a8-4228-485f-b49c-1481a7b6643c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:49.573432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdcc8a8-4228-485f-b49c-1481a7b6643c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:49.629854 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1602/3224] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:19:49 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:19:49.631518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381aefbd-fb9b-4166-9c3e-4546c3b7f571 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:49.655344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381aefbd-fb9b-4166-9c3e-4546c3b7f571 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:49.668369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead3571-1b64-41e9-9f6c-e0962c430436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:49.669005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead3571-1b64-41e9-9f6c-e0962c430436 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:49.669282 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead3571-1b64-41e9-9f6c-e0962c430436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:49.669550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead3571-1b64-41e9-9f6c-e0962c430436 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:49.670208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead3571-1b64-41e9-9f6c-e0962c430436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:49.671985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead3571-1b64-41e9-9f6c-e0962c430436 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:49.697728 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1623/3225] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:19:49.701978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcc8a8-4228-485f-b49c-1481a7b6643c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:49.718733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcc8a8-4228-485f-b49c-1481a7b6643c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:49.729225 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b652e-b795-4fa4-8c0e-b115ca44e98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:49.731106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b652e-b795-4fa4-8c0e-b115ca44e98c admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:49.731493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b652e-b795-4fa4-8c0e-b115ca44e98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:49.732030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b652e-b795-4fa4-8c0e-b115ca44e98c admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:49.732954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b652e-b795-4fa4-8c0e-b115ca44e98c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:49.735283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b652e-b795-4fa4-8c0e-b115ca44e98c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:49.751311 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1603/3226] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:19:49.755714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead3571-1b64-41e9-9f6c-e0962c430436 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:49.768636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead3571-1b64-41e9-9f6c-e0962c430436 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:49.801464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8c9a5-41a6-4824-aaad-8ec5f56bd4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:49.805263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8c9a5-41a6-4824-aaad-8ec5f56bd4e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:49.807574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8c9a5-41a6-4824-aaad-8ec5f56bd4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:49.808561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8c9a5-41a6-4824-aaad-8ec5f56bd4e9 admin admin] PATH_INFO: `/v3/projects/622262beb7574e388c20207cccd5073d/users/81d0e7a058704483bbad57ef73de92e6/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:49.863339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8c9a5-41a6-4824-aaad-8ec5f56bd4e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=622262beb7574e388c20207cccd5073d, user_id=81d0e7a058704483bbad57ef73de92e6, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:49.868606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8c9a5-41a6-4824-aaad-8ec5f56bd4e9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:49.902627 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1624/3227] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:19:49 2022] PUT /identity/v3/projects/622262beb7574e388c20207cccd5073d/users/81d0e7a058704483bbad57ef73de92e6/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:49.915556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9acd3a-1dc9-40b7-bb71-c68a8a780594 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:49.916004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9acd3a-1dc9-40b7-bb71-c68a8a780594 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:49.917274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9acd3a-1dc9-40b7-bb71-c68a8a780594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:50.008625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-bb9acd3a-1dc9-40b7-bb71-c68a8a780594 None None] MFA Rules not processed for user `81d0e7a058704483bbad57ef73de92e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:50.011343 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bb9acd3a-1dc9-40b7-bb71-c68a8a780594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:50.170998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8c9a5-41a6-4824-aaad-8ec5f56bd4e9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:50.171583 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1604/3228] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:19:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:50.317583 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:50.324127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8c9a5-41a6-4824-aaad-8ec5f56bd4e9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:50.333290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8904628-c158-4b1e-8563-7c64e37355bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:50.334086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8904628-c158-4b1e-8563-7c64e37355bc admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:50.335158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8904628-c158-4b1e-8563-7c64e37355bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:50.335850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8904628-c158-4b1e-8563-7c64e37355bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:50.336900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8904628-c158-4b1e-8563-7c64e37355bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:50.341844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8904628-c158-4b1e-8563-7c64e37355bc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:50.398884 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1625/3229] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:19:50 2022] POST /identity/v3/projects => generated 393 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:19:50.404358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9acd3a-1dc9-40b7-bb71-c68a8a780594 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:50.424604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9acd3a-1dc9-40b7-bb71-c68a8a780594 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:50.468217 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:50.536030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992b904-d7e0-4b7b-831d-e5f80c0888f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:50.536600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992b904-d7e0-4b7b-831d-e5f80c0888f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:50.536879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992b904-d7e0-4b7b-831d-e5f80c0888f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:50.537159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992b904-d7e0-4b7b-831d-e5f80c0888f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:50.537833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992b904-d7e0-4b7b-831d-e5f80c0888f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:50.539776 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992b904-d7e0-4b7b-831d-e5f80c0888f3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:50.594858 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1605/3230] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:19:50 2022] POST /identity/v3/users => generated 303 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:19:50.595750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8904628-c158-4b1e-8563-7c64e37355bc admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:50.607769 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8904628-c158-4b1e-8563-7c64e37355bc admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:50.624489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b844a99-8038-4985-8560-15e2ab2a24c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:50.625124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b844a99-8038-4985-8560-15e2ab2a24c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:50.625435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b844a99-8038-4985-8560-15e2ab2a24c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:50.626232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b844a99-8038-4985-8560-15e2ab2a24c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:50.627103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b844a99-8038-4985-8560-15e2ab2a24c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:50.629139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b844a99-8038-4985-8560-15e2ab2a24c8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:50.645869 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1626/3231] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:19:50.651212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992b904-d7e0-4b7b-831d-e5f80c0888f3 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:50.663243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992b904-d7e0-4b7b-831d-e5f80c0888f3 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:50.669781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a63bc8-aad8-4ea6-a514-2862b1e1bcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:50.671065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a63bc8-aad8-4ea6-a514-2862b1e1bcbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:50.671552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a63bc8-aad8-4ea6-a514-2862b1e1bcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:50.672038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a63bc8-aad8-4ea6-a514-2862b1e1bcbd admin admin] PATH_INFO: `/v3/projects/585770175580432e87542c05b895ae62/users/0c97cf736912462ca8ebb8e3292b4881/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:50.709887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a63bc8-aad8-4ea6-a514-2862b1e1bcbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=585770175580432e87542c05b895ae62, user_id=0c97cf736912462ca8ebb8e3292b4881, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:50.713668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a63bc8-aad8-4ea6-a514-2862b1e1bcbd admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:50.748568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b844a99-8038-4985-8560-15e2ab2a24c8 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:50.748896 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1606/3232] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:19:50 2022] PUT /identity/v3/projects/585770175580432e87542c05b895ae62/users/0c97cf736912462ca8ebb8e3292b4881/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:50.780309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b844a99-8038-4985-8560-15e2ab2a24c8 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:50.863407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5514ebb-3f10-43ba-a7fe-31c9389fa9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:50.864073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5514ebb-3f10-43ba-a7fe-31c9389fa9fd admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:50.864352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5514ebb-3f10-43ba-a7fe-31c9389fa9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:50.864624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5514ebb-3f10-43ba-a7fe-31c9389fa9fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:50.865274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5514ebb-3f10-43ba-a7fe-31c9389fa9fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:50.866868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5514ebb-3f10-43ba-a7fe-31c9389fa9fd admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:50.884178 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1627/3233] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:19:50.885340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a63bc8-aad8-4ea6-a514-2862b1e1bcbd admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:50.900235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a63bc8-aad8-4ea6-a514-2862b1e1bcbd admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:50.905412 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2868a-eb0b-4f0a-9c83-fa793569af00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:50.906213 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2868a-eb0b-4f0a-9c83-fa793569af00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:50.906487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2868a-eb0b-4f0a-9c83-fa793569af00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:50.906793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2868a-eb0b-4f0a-9c83-fa793569af00 admin admin] PATH_INFO: `/v3/projects/585770175580432e87542c05b895ae62/users/0c97cf736912462ca8ebb8e3292b4881/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:50.908818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2868a-eb0b-4f0a-9c83-fa793569af00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=585770175580432e87542c05b895ae62, user_id=0c97cf736912462ca8ebb8e3292b4881, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:50.911504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2868a-eb0b-4f0a-9c83-fa793569af00 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:50.922809 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1607/3234] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:19:50 2022] PUT /identity/v3/projects/585770175580432e87542c05b895ae62/users/0c97cf736912462ca8ebb8e3292b4881/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:50.935313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964262df-d3f3-41ec-8dd4-b8ac29ef5517 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:50.935313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964262df-d3f3-41ec-8dd4-b8ac29ef5517 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:50.935313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964262df-d3f3-41ec-8dd4-b8ac29ef5517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:50.974112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-964262df-d3f3-41ec-8dd4-b8ac29ef5517 None None] MFA Rules not processed for user `0c97cf736912462ca8ebb8e3292b4881`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:50.975443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-964262df-d3f3-41ec-8dd4-b8ac29ef5517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:51.051463 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1628/3235] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:19:50 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:51.064809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804f836-5719-42ec-92bd-997cb10562b3 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:51.065164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804f836-5719-42ec-92bd-997cb10562b3 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:51.065674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804f836-5719-42ec-92bd-997cb10562b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:51.093199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0804f836-5719-42ec-92bd-997cb10562b3 None None] MFA Rules not processed for user `81d0e7a058704483bbad57ef73de92e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:51.095713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0804f836-5719-42ec-92bd-997cb10562b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:51.187477 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1608/3236] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:19:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:51.199704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964262df-d3f3-41ec-8dd4-b8ac29ef5517 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:51.201291 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-964262df-d3f3-41ec-8dd4-b8ac29ef5517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:51.314317 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:51.389658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964262df-d3f3-41ec-8dd4-b8ac29ef5517 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:51.396542 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3b0f4-8837-45f3-9802-05cebe44e513 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:51.397236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3b0f4-8837-45f3-9802-05cebe44e513 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:51.397502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3b0f4-8837-45f3-9802-05cebe44e513 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:51.397766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3b0f4-8837-45f3-9802-05cebe44e513 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:51.434309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3b0f4-8837-45f3-9802-05cebe44e513 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:51.437144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3b0f4-8837-45f3-9802-05cebe44e513 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:51.460866 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1629/3237] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:19:51 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:19:52.085521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804f836-5719-42ec-92bd-997cb10562b3 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:52.087186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0804f836-5719-42ec-92bd-997cb10562b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:52.261303 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0804f836-5719-42ec-92bd-997cb10562b3 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:52.277309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9fb543-db1c-4850-9e66-d49657e7cb61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:52.279416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fb543-db1c-4850-9e66-d49657e7cb61 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:52.280851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fb543-db1c-4850-9e66-d49657e7cb61 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:52.282135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fb543-db1c-4850-9e66-d49657e7cb61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:52.286696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2c9fb543-db1c-4850-9e66-d49657e7cb61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:52.313448 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9fb543-db1c-4850-9e66-d49657e7cb61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:52.316968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9fb543-db1c-4850-9e66-d49657e7cb61 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:52.334598 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1609/3238] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:19:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:19:52.765309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc23deb-a288-469b-9e43-a9b3650e06e8 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:52.768482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc23deb-a288-469b-9e43-a9b3650e06e8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:52.769059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc23deb-a288-469b-9e43-a9b3650e06e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:52.835709 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-adc23deb-a288-469b-9e43-a9b3650e06e8 None None] MFA Rules not processed for user `80f8680c2a39400c8fcfc221872fa299`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:52.839517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-adc23deb-a288-469b-9e43-a9b3650e06e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:53.020677 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1630/3239] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:19:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:53.595139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9fb543-db1c-4850-9e66-d49657e7cb61 service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:53.596971 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2c9fb543-db1c-4850-9e66-d49657e7cb61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:53.643403 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:53.798597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9fb543-db1c-4850-9e66-d49657e7cb61 service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:53.808979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fada6-750a-4ac4-af54-f2ae3ee3fd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:53.810083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fada6-750a-4ac4-af54-f2ae3ee3fd52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:53.810372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fada6-750a-4ac4-af54-f2ae3ee3fd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:53.810639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fada6-750a-4ac4-af54-f2ae3ee3fd52 admin admin] PATH_INFO: `/v3/users/cb6a1da42d354933aa782ccdbb5831ac` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:53.812318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fada6-750a-4ac4-af54-f2ae3ee3fd52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb6a1da42d354933aa782ccdbb5831ac)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:53.814983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fada6-750a-4ac4-af54-f2ae3ee3fd52 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:53.947265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-321fada6-750a-4ac4-af54-f2ae3ee3fd52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb6a1da42d354933aa782ccdbb5831ac'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:53.965914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-321fada6-750a-4ac4-af54-f2ae3ee3fd52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb6a1da42d354933aa782ccdbb5831ac'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:54.003403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-321fada6-750a-4ac4-af54-f2ae3ee3fd52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb6a1da42d354933aa782ccdbb5831ac'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:54.004309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-321fada6-750a-4ac4-af54-f2ae3ee3fd52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb6a1da42d354933aa782ccdbb5831ac'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:54.026257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-321fada6-750a-4ac4-af54-f2ae3ee3fd52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb6a1da42d354933aa782ccdbb5831ac'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:54.039691 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1610/3240] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:19:53 2022] DELETE /identity/v3/users/cb6a1da42d354933aa782ccdbb5831ac => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:19:54.452638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc23deb-a288-469b-9e43-a9b3650e06e8 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:54.506807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc23deb-a288-469b-9e43-a9b3650e06e8 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:54.586221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e14747-faef-4c0e-b700-c4e3e551c9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:54.588273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e14747-faef-4c0e-b700-c4e3e551c9d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:54.588663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e14747-faef-4c0e-b700-c4e3e551c9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:54.589215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e14747-faef-4c0e-b700-c4e3e551c9d3 admin admin] PATH_INFO: `/v3/projects/173a9cd21505478684a69dc461813349` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:54.591386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e14747-faef-4c0e-b700-c4e3e551c9d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=173a9cd21505478684a69dc461813349)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:54.594571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e14747-faef-4c0e-b700-c4e3e551c9d3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:54.680427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d1e14747-faef-4c0e-b700-c4e3e551c9d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '173a9cd21505478684a69dc461813349', 'request_id': 'req-d1e14747-faef-4c0e-b700-c4e3e551c9d3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:54.689400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d1e14747-faef-4c0e-b700-c4e3e551c9d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '173a9cd21505478684a69dc461813349', 'request_id': 'req-d1e14747-faef-4c0e-b700-c4e3e551c9d3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:54.698356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d1e14747-faef-4c0e-b700-c4e3e551c9d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '173a9cd21505478684a69dc461813349', 'request_id': 'req-d1e14747-faef-4c0e-b700-c4e3e551c9d3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:54.731542 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d1e14747-faef-4c0e-b700-c4e3e551c9d3 admin admin] The token cache is being invalidate because project 173a9cd21505478684a69dc461813349 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:19:54.734421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d1e14747-faef-4c0e-b700-c4e3e551c9d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:54.735704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d1e14747-faef-4c0e-b700-c4e3e551c9d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:19:54.748968 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1631/3241] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:19:54 2022] DELETE /identity/v3/projects/173a9cd21505478684a69dc461813349 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:54.752371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1879e46-d6f7-4942-9323-61765f2ebbf6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:54.753248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1879e46-d6f7-4942-9323-61765f2ebbf6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:54.753248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1879e46-d6f7-4942-9323-61765f2ebbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:54.800018 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b1879e46-d6f7-4942-9323-61765f2ebbf6 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:54.801296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b1879e46-d6f7-4942-9323-61765f2ebbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:54.926292 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1611/3242] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:19:54.929961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb307e0-066f-4f87-bdbf-782d88b92cd7 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:54.930295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb307e0-066f-4f87-bdbf-782d88b92cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:54.930552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb307e0-066f-4f87-bdbf-782d88b92cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:54.988665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5bb307e0-066f-4f87-bdbf-782d88b92cd7 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:54.990230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5bb307e0-066f-4f87-bdbf-782d88b92cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:55.012313 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1632/3243] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:55.019524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1879e46-d6f7-4942-9323-61765f2ebbf6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:55.054851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1879e46-d6f7-4942-9323-61765f2ebbf6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:55.085444 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384c1e8-e031-441e-9c46-e9a5720b4374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:55.086197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384c1e8-e031-441e-9c46-e9a5720b4374 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:55.086384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384c1e8-e031-441e-9c46-e9a5720b4374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:55.086657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384c1e8-e031-441e-9c46-e9a5720b4374 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:55.091619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384c1e8-e031-441e-9c46-e9a5720b4374 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:19:55.093737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384c1e8-e031-441e-9c46-e9a5720b4374 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:55.101590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384c1e8-e031-441e-9c46-e9a5720b4374 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:55.133273 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1612/3244] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:19:55.141656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb307e0-066f-4f87-bdbf-782d88b92cd7 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:55.174051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb307e0-066f-4f87-bdbf-782d88b92cd7 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:55.180359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ad7eb-5683-44fe-a8b4-8c117a3e53f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:55.181080 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ad7eb-5683-44fe-a8b4-8c117a3e53f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:55.181296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ad7eb-5683-44fe-a8b4-8c117a3e53f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:55.181630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ad7eb-5683-44fe-a8b4-8c117a3e53f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:55.182525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ad7eb-5683-44fe-a8b4-8c117a3e53f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:55.185912 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ad7eb-5683-44fe-a8b4-8c117a3e53f3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:55.194345 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:55.251400 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1633/3245] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:19:55 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:19:55.257207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384c1e8-e031-441e-9c46-e9a5720b4374 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:55.273492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384c1e8-e031-441e-9c46-e9a5720b4374 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:55.310871 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:19:55.491330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461fa09e-fffd-4bb3-b66f-1bba9436e1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:55.493291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fa09e-fffd-4bb3-b66f-1bba9436e1f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:55.495593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fa09e-fffd-4bb3-b66f-1bba9436e1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:55.496591 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fa09e-fffd-4bb3-b66f-1bba9436e1f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:55.500835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461fa09e-fffd-4bb3-b66f-1bba9436e1f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:55.512541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461fa09e-fffd-4bb3-b66f-1bba9436e1f9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:55.589156 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1613/3246] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:19:55 2022] POST /identity/v3/users => generated 294 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:19:55.596210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ad7eb-5683-44fe-a8b4-8c117a3e53f3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:55.633488 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ad7eb-5683-44fe-a8b4-8c117a3e53f3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:55.651188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0805a9-e006-498d-b997-8e253fe8203f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:55.653914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0805a9-e006-498d-b997-8e253fe8203f admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:55.656384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0805a9-e006-498d-b997-8e253fe8203f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:55.657078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0805a9-e006-498d-b997-8e253fe8203f admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:55.658509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0805a9-e006-498d-b997-8e253fe8203f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:55.664431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0805a9-e006-498d-b997-8e253fe8203f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:55.703567 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1634/3247] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:19:55.726107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461fa09e-fffd-4bb3-b66f-1bba9436e1f9 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:55.749924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461fa09e-fffd-4bb3-b66f-1bba9436e1f9 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:55.755773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe42cae-6bb0-4db3-98a3-08b89d8902ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:55.756559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe42cae-6bb0-4db3-98a3-08b89d8902ab admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:55.756954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe42cae-6bb0-4db3-98a3-08b89d8902ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:55.757290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe42cae-6bb0-4db3-98a3-08b89d8902ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:55.758181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe42cae-6bb0-4db3-98a3-08b89d8902ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:55.760841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe42cae-6bb0-4db3-98a3-08b89d8902ab admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:55.788227 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1614/3248] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:19:55.790865 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0805a9-e006-498d-b997-8e253fe8203f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:55.813445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0805a9-e006-498d-b997-8e253fe8203f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:55.823768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03992a-c6a7-4736-85d2-967ad48ea40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:55.831877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03992a-c6a7-4736-85d2-967ad48ea40d admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:55.832696 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03992a-c6a7-4736-85d2-967ad48ea40d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:55.833094 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03992a-c6a7-4736-85d2-967ad48ea40d admin admin] PATH_INFO: `/v3/projects/b06e7912f1fe423ea1b2a4bcdb90804a/users/e4feb14c621b4090af8c965c9aaf0e2d/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:55.858949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03992a-c6a7-4736-85d2-967ad48ea40d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b06e7912f1fe423ea1b2a4bcdb90804a, user_id=e4feb14c621b4090af8c965c9aaf0e2d, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:55.865557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03992a-c6a7-4736-85d2-967ad48ea40d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:55.898538 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1635/3249] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:19:55 2022] PUT /identity/v3/projects/b06e7912f1fe423ea1b2a4bcdb90804a/users/e4feb14c621b4090af8c965c9aaf0e2d/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:19:55.905797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb035c9b-b1ec-4d49-a5e7-3d1d577fa94b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:55.906331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb035c9b-b1ec-4d49-a5e7-3d1d577fa94b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:55.907487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb035c9b-b1ec-4d49-a5e7-3d1d577fa94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:55.945922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-fb035c9b-b1ec-4d49-a5e7-3d1d577fa94b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:55.947604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-fb035c9b-b1ec-4d49-a5e7-3d1d577fa94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:56.073367 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1615/3250] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:19:56.091222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03992a-c6a7-4736-85d2-967ad48ea40d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:56.093249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8e03992a-c6a7-4736-85d2-967ad48ea40d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:56.215843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03992a-c6a7-4736-85d2-967ad48ea40d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:56.228856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ccf37-3cfb-4cde-8336-f445345d4cb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:56.229616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ccf37-3cfb-4cde-8336-f445345d4cb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:56.229981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ccf37-3cfb-4cde-8336-f445345d4cb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:56.230362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ccf37-3cfb-4cde-8336-f445345d4cb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:56.252062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ccf37-3cfb-4cde-8336-f445345d4cb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:56.254090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ccf37-3cfb-4cde-8336-f445345d4cb0 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:56.267795 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1636/3251] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:19:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:19:57.746173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb035c9b-b1ec-4d49-a5e7-3d1d577fa94b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:19:57.756460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb035c9b-b1ec-4d49-a5e7-3d1d577fa94b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:19:57.764579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448709b5-b3ba-4adf-8bab-a0c71f1a379a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:19:57.766667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448709b5-b3ba-4adf-8bab-a0c71f1a379a service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:57.766938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448709b5-b3ba-4adf-8bab-a0c71f1a379a service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:57.767202 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448709b5-b3ba-4adf-8bab-a0c71f1a379a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:57.770741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-448709b5-b3ba-4adf-8bab-a0c71f1a379a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:57.785106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448709b5-b3ba-4adf-8bab-a0c71f1a379a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:19:57.786769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448709b5-b3ba-4adf-8bab-a0c71f1a379a service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:19:57.804122 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1616/3252] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:19:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:19:58.366139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d8d52-98e4-4c56-9cea-7ac2d1b012a3 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:19:58.366949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d8d52-98e4-4c56-9cea-7ac2d1b012a3 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:19:58.366949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d8d52-98e4-4c56-9cea-7ac2d1b012a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:19:58.420694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a14d8d52-98e4-4c56-9cea-7ac2d1b012a3 None None] MFA Rules not processed for user `d4f7282c7251455086368d5274a4fac5`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:19:58.421880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a14d8d52-98e4-4c56-9cea-7ac2d1b012a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:19:58.542104 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1637/3253] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:19:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:00.120969 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448709b5-b3ba-4adf-8bab-a0c71f1a379a service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:00.123577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-448709b5-b3ba-4adf-8bab-a0c71f1a379a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:00.308706 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448709b5-b3ba-4adf-8bab-a0c71f1a379a service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:00.340628 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed856b1-c99e-460f-9113-d192d7904551 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:00.341907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed856b1-c99e-460f-9113-d192d7904551 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:00.342354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed856b1-c99e-460f-9113-d192d7904551 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:00.343442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed856b1-c99e-460f-9113-d192d7904551 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:00.347958 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3ed856b1-c99e-460f-9113-d192d7904551 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:00.374145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed856b1-c99e-460f-9113-d192d7904551 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:00.389256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed856b1-c99e-460f-9113-d192d7904551 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:00.408816 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1617/3254] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:00.925988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d8d52-98e4-4c56-9cea-7ac2d1b012a3 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:00.973387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d8d52-98e4-4c56-9cea-7ac2d1b012a3 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:01.005650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28296a2b-357a-4d1a-a1fb-4f322fdc8f80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:01.006853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28296a2b-357a-4d1a-a1fb-4f322fdc8f80 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:01.007330 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28296a2b-357a-4d1a-a1fb-4f322fdc8f80 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:01.007804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28296a2b-357a-4d1a-a1fb-4f322fdc8f80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:01.019142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-28296a2b-357a-4d1a-a1fb-4f322fdc8f80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:01.040303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28296a2b-357a-4d1a-a1fb-4f322fdc8f80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:01.042157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28296a2b-357a-4d1a-a1fb-4f322fdc8f80 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:01.060523 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1638/3255] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:07.068435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d853f7b-50fa-4af6-940d-085e020a42b0 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:07.069273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d853f7b-50fa-4af6-940d-085e020a42b0 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:07.069818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d853f7b-50fa-4af6-940d-085e020a42b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:07.121359 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:07.143027 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28296a2b-357a-4d1a-a1fb-4f322fdc8f80 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:07.145368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-28296a2b-357a-4d1a-a1fb-4f322fdc8f80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:07.149396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1d853f7b-50fa-4af6-940d-085e020a42b0 None None] MFA Rules not processed for user `e4feb14c621b4090af8c965c9aaf0e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:07.151556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1d853f7b-50fa-4af6-940d-085e020a42b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:07.162454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28296a2b-357a-4d1a-a1fb-4f322fdc8f80 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:07.170744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d1c3c-1fec-4923-a233-babc50f56615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:07.171640 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d1c3c-1fec-4923-a233-babc50f56615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:07.172139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d1c3c-1fec-4923-a233-babc50f56615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:07.172289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d1c3c-1fec-4923-a233-babc50f56615 admin admin] PATH_INFO: `/v3/users/b945db9a6f7a4143a544b76be5e9af9f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:07.173440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d1c3c-1fec-4923-a233-babc50f56615 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b945db9a6f7a4143a544b76be5e9af9f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:07.175418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d1c3c-1fec-4923-a233-babc50f56615 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:07.230259 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:07.241098 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-567d1c3c-1fec-4923-a233-babc50f56615 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b945db9a6f7a4143a544b76be5e9af9f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:07.253134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-567d1c3c-1fec-4923-a233-babc50f56615 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b945db9a6f7a4143a544b76be5e9af9f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:07.255625 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1618/3256] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:07.271174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-567d1c3c-1fec-4923-a233-babc50f56615 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b945db9a6f7a4143a544b76be5e9af9f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:07.272869 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-567d1c3c-1fec-4923-a233-babc50f56615 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b945db9a6f7a4143a544b76be5e9af9f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:07.277092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d853f7b-50fa-4af6-940d-085e020a42b0 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:07.292422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-567d1c3c-1fec-4923-a233-babc50f56615 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b945db9a6f7a4143a544b76be5e9af9f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:07.296339 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d853f7b-50fa-4af6-940d-085e020a42b0 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:07.302275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474202a8-1410-42dc-a172-3986487f024d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:07.302893 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474202a8-1410-42dc-a172-3986487f024d service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:07.303171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474202a8-1410-42dc-a172-3986487f024d service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:07.303442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474202a8-1410-42dc-a172-3986487f024d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:07.304218 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1639/3257] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:20:07 2022] DELETE /identity/v3/users/b945db9a6f7a4143a544b76be5e9af9f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:20:07.305332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-474202a8-1410-42dc-a172-3986487f024d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:07.309630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7367b-7c85-405a-be44-87a66a6a08d2 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:07.310111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7367b-7c85-405a-be44-87a66a6a08d2 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:07.310504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7367b-7c85-405a-be44-87a66a6a08d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:07.318118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474202a8-1410-42dc-a172-3986487f024d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:07.319807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474202a8-1410-42dc-a172-3986487f024d service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:07.330463 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1619/3258] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:07 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:20:07.332878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-fce7367b-7c85-405a-be44-87a66a6a08d2 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:07.334159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fce7367b-7c85-405a-be44-87a66a6a08d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:07.408161 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1640/3259] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:07.418991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474202a8-1410-42dc-a172-3986487f024d service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:07.420488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-474202a8-1410-42dc-a172-3986487f024d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:07.468242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474202a8-1410-42dc-a172-3986487f024d service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:07.684099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ef53b-7237-41f1-affd-4a6e5cef7121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:07.684994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ef53b-7237-41f1-affd-4a6e5cef7121 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:07.685832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ef53b-7237-41f1-affd-4a6e5cef7121 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:07.685832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ef53b-7237-41f1-affd-4a6e5cef7121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:07.742200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ef53b-7237-41f1-affd-4a6e5cef7121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:07.743857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ef53b-7237-41f1-affd-4a6e5cef7121 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:07.772983 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1620/3260] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:08.408521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7367b-7c85-405a-be44-87a66a6a08d2 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:08.410600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fce7367b-7c85-405a-be44-87a66a6a08d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:08.425406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7367b-7c85-405a-be44-87a66a6a08d2 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:08.442749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ef53b-7237-41f1-affd-4a6e5cef7121 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:08.443364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-811ef53b-7237-41f1-affd-4a6e5cef7121 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:08.451403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6b844-3540-45ee-bbc4-b12b0b118960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:08.452558 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6b844-3540-45ee-bbc4-b12b0b118960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:08.454389 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6b844-3540-45ee-bbc4-b12b0b118960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:08.454925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6b844-3540-45ee-bbc4-b12b0b118960 admin admin] PATH_INFO: `/v3/projects/1911abc893ef4c01aa80ca9079dea6e9` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:08.457443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6b844-3540-45ee-bbc4-b12b0b118960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1911abc893ef4c01aa80ca9079dea6e9)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:08.459666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6b844-3540-45ee-bbc4-b12b0b118960 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:08.556162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-57a6b844-3540-45ee-bbc4-b12b0b118960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1911abc893ef4c01aa80ca9079dea6e9', 'request_id': 'req-57a6b844-3540-45ee-bbc4-b12b0b118960'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:08.565143 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-57a6b844-3540-45ee-bbc4-b12b0b118960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1911abc893ef4c01aa80ca9079dea6e9', 'request_id': 'req-57a6b844-3540-45ee-bbc4-b12b0b118960'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:08.570426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ef53b-7237-41f1-affd-4a6e5cef7121 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:08.573700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-57a6b844-3540-45ee-bbc4-b12b0b118960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1911abc893ef4c01aa80ca9079dea6e9', 'request_id': 'req-57a6b844-3540-45ee-bbc4-b12b0b118960'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:08.595558 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-57a6b844-3540-45ee-bbc4-b12b0b118960 admin admin] The token cache is being invalidate because project 1911abc893ef4c01aa80ca9079dea6e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:20:08.597337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-57a6b844-3540-45ee-bbc4-b12b0b118960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:08.601411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-57a6b844-3540-45ee-bbc4-b12b0b118960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:08.603085 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1641/3261] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:20:08 2022] DELETE /identity/v3/projects/1911abc893ef4c01aa80ca9079dea6e9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:08.608898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6b844-3540-45ee-bbc4-b12b0b118960 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:08.610845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-57a6b844-3540-45ee-bbc4-b12b0b118960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:08.615607 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:08.684590 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:08.702217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd3531-933f-476d-ae0f-2097416bf0f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:08.703048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd3531-933f-476d-ae0f-2097416bf0f6 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:08.704244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd3531-933f-476d-ae0f-2097416bf0f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:08.704535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd3531-933f-476d-ae0f-2097416bf0f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:08.711824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e0cd3531-933f-476d-ae0f-2097416bf0f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:08.713774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6b844-3540-45ee-bbc4-b12b0b118960 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:08.721903 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884711f9-8634-4b13-befb-361d37d487fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:08.722554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884711f9-8634-4b13-befb-361d37d487fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:08.722963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884711f9-8634-4b13-befb-361d37d487fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:08.723327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884711f9-8634-4b13-befb-361d37d487fc admin admin] PATH_INFO: `/v3/users/fd62e88119574de6b8a03ace83572773` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:08.725159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884711f9-8634-4b13-befb-361d37d487fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd62e88119574de6b8a03ace83572773)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:08.727158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884711f9-8634-4b13-befb-361d37d487fc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:08.735945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd3531-933f-476d-ae0f-2097416bf0f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:08.737943 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd3531-933f-476d-ae0f-2097416bf0f6 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:08.754733 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1621/3262] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:08.756109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd3531-933f-476d-ae0f-2097416bf0f6 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:08.758863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e0cd3531-933f-476d-ae0f-2097416bf0f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:08.777754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd3531-933f-476d-ae0f-2097416bf0f6 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:08.787045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac2e48-62e7-491b-afd6-9b1faf78645d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:08.788067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac2e48-62e7-491b-afd6-9b1faf78645d service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:08.788698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac2e48-62e7-491b-afd6-9b1faf78645d service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:08.789222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac2e48-62e7-491b-afd6-9b1faf78645d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:08.792429 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-10ac2e48-62e7-491b-afd6-9b1faf78645d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:08.828272 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-884711f9-8634-4b13-befb-361d37d487fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd62e88119574de6b8a03ace83572773'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:08.838704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-884711f9-8634-4b13-befb-361d37d487fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd62e88119574de6b8a03ace83572773'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:08.858332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-884711f9-8634-4b13-befb-361d37d487fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd62e88119574de6b8a03ace83572773'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:08.859193 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-884711f9-8634-4b13-befb-361d37d487fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd62e88119574de6b8a03ace83572773'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:08.870566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-884711f9-8634-4b13-befb-361d37d487fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd62e88119574de6b8a03ace83572773'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:08.884554 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1642/3263] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:20:08 2022] DELETE /identity/v3/users/fd62e88119574de6b8a03ace83572773 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:20:09.009805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac2e48-62e7-491b-afd6-9b1faf78645d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:09.011682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac2e48-62e7-491b-afd6-9b1faf78645d service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:09.049353 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1622/3264] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:08 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:09.179824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b5791-0025-48f1-94c1-a9d900ae3a51 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:09.180210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b5791-0025-48f1-94c1-a9d900ae3a51 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:09.180499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b5791-0025-48f1-94c1-a9d900ae3a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:09.209628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-034b5791-0025-48f1-94c1-a9d900ae3a51 None None] MFA Rules not processed for user `81d0e7a058704483bbad57ef73de92e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:09.212141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-034b5791-0025-48f1-94c1-a9d900ae3a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:09.318914 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1643/3265] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:09 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:09.618325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac2e48-62e7-491b-afd6-9b1faf78645d service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:09.641668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac2e48-62e7-491b-afd6-9b1faf78645d service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:09.856836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcfef9-8bbf-48e0-9084-8171ba174c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:09.859160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcfef9-8bbf-48e0-9084-8171ba174c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:09.860509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcfef9-8bbf-48e0-9084-8171ba174c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:09.861268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcfef9-8bbf-48e0-9084-8171ba174c72 admin admin] PATH_INFO: `/v3/projects/57856e905c9940819ef8a5bac1a1f66f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:09.864242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bcfef9-8bbf-48e0-9084-8171ba174c72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57856e905c9940819ef8a5bac1a1f66f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:09.866779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bcfef9-8bbf-48e0-9084-8171ba174c72 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:09.991172 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:10.010349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-14bcfef9-8bbf-48e0-9084-8171ba174c72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57856e905c9940819ef8a5bac1a1f66f', 'request_id': 'req-14bcfef9-8bbf-48e0-9084-8171ba174c72'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:10.028808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-14bcfef9-8bbf-48e0-9084-8171ba174c72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57856e905c9940819ef8a5bac1a1f66f', 'request_id': 'req-14bcfef9-8bbf-48e0-9084-8171ba174c72'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:10.039102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-14bcfef9-8bbf-48e0-9084-8171ba174c72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57856e905c9940819ef8a5bac1a1f66f', 'request_id': 'req-14bcfef9-8bbf-48e0-9084-8171ba174c72'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:10.068869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-14bcfef9-8bbf-48e0-9084-8171ba174c72 admin admin] The token cache is being invalidate because project 57856e905c9940819ef8a5bac1a1f66f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:20:10.069223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-14bcfef9-8bbf-48e0-9084-8171ba174c72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:10.069957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-14bcfef9-8bbf-48e0-9084-8171ba174c72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:10.075576 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1623/3266] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:20:09 2022] DELETE /identity/v3/projects/57856e905c9940819ef8a5bac1a1f66f => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:10.077348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb00d32-afce-41f2-a031-6fb139190e32 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:10.078343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb00d32-afce-41f2-a031-6fb139190e32 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:10.078838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb00d32-afce-41f2-a031-6fb139190e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:10.117816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3cb00d32-afce-41f2-a031-6fb139190e32 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:10.122241 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3cb00d32-afce-41f2-a031-6fb139190e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:10.289657 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1644/3267] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:10.290445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219191f-45b5-4a98-9941-4ed03e07cb57 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:10.290806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219191f-45b5-4a98-9941-4ed03e07cb57 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:10.291082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219191f-45b5-4a98-9941-4ed03e07cb57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:10.332118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7219191f-45b5-4a98-9941-4ed03e07cb57 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:10.334191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7219191f-45b5-4a98-9941-4ed03e07cb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:10.353490 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1624/3268] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:20:10.355876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb00d32-afce-41f2-a031-6fb139190e32 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:10.370293 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:10.386918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb00d32-afce-41f2-a031-6fb139190e32 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:10.401193 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeeb02e-7a6a-4e00-97b6-b24e44aa50f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:10.402203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5a5cc-a0a6-4ce8-a4b4-8a2f14bdca67 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:10.402624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5a5cc-a0a6-4ce8-a4b4-8a2f14bdca67 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:10.402934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5a5cc-a0a6-4ce8-a4b4-8a2f14bdca67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:10.404782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeeb02e-7a6a-4e00-97b6-b24e44aa50f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:10.406299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeeb02e-7a6a-4e00-97b6-b24e44aa50f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:10.406894 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeeb02e-7a6a-4e00-97b6-b24e44aa50f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:10.410682 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeeb02e-7a6a-4e00-97b6-b24e44aa50f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:20:10.411356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeeb02e-7a6a-4e00-97b6-b24e44aa50f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:10.417803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeeb02e-7a6a-4e00-97b6-b24e44aa50f1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:10.446918 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1645/3269] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:20:10.458929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c1d5a5cc-a0a6-4ce8-a4b4-8a2f14bdca67 None None] MFA Rules not processed for user `e4feb14c621b4090af8c965c9aaf0e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:10.460096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeeb02e-7a6a-4e00-97b6-b24e44aa50f1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:10.460360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c1d5a5cc-a0a6-4ce8-a4b4-8a2f14bdca67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:10.477959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeeb02e-7a6a-4e00-97b6-b24e44aa50f1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:10.484123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ccfcd-b0d9-49db-9d6a-1440906ca727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:10.486185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ccfcd-b0d9-49db-9d6a-1440906ca727 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:10.487405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ccfcd-b0d9-49db-9d6a-1440906ca727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:10.487836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ccfcd-b0d9-49db-9d6a-1440906ca727 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:10.489185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ccfcd-b0d9-49db-9d6a-1440906ca727 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:10.492374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ccfcd-b0d9-49db-9d6a-1440906ca727 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:10.545774 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1646/3270] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:20:10 2022] POST /identity/v3/projects => generated 381 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:20:10.548591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ccfcd-b0d9-49db-9d6a-1440906ca727 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:10.576231 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1625/3271] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:10.772795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ccfcd-b0d9-49db-9d6a-1440906ca727 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:10.778932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95be3ea-1eda-48f9-aad2-e1fc75c2e752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:10.780254 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95be3ea-1eda-48f9-aad2-e1fc75c2e752 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:10.780536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95be3ea-1eda-48f9-aad2-e1fc75c2e752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:10.780885 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95be3ea-1eda-48f9-aad2-e1fc75c2e752 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:10.782024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95be3ea-1eda-48f9-aad2-e1fc75c2e752 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:10.784315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95be3ea-1eda-48f9-aad2-e1fc75c2e752 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:10.836465 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1647/3272] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:20:10 2022] POST /identity/v3/users => generated 291 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:20:10.841885 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5a5cc-a0a6-4ce8-a4b4-8a2f14bdca67 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:10.877936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5a5cc-a0a6-4ce8-a4b4-8a2f14bdca67 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:10.886679 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf8525-4b8f-4a40-b9d9-8915246033f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:10.887904 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf8525-4b8f-4a40-b9d9-8915246033f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:10.888381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf8525-4b8f-4a40-b9d9-8915246033f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:10.888844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf8525-4b8f-4a40-b9d9-8915246033f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:10.889623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf8525-4b8f-4a40-b9d9-8915246033f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:10.901912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf8525-4b8f-4a40-b9d9-8915246033f2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:10.933110 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1626/3273] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:20:10.937111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95be3ea-1eda-48f9-aad2-e1fc75c2e752 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:10.951791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95be3ea-1eda-48f9-aad2-e1fc75c2e752 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:10.959110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f0025-0da8-4691-9ddf-c0f99eff4bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:10.959971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f0025-0da8-4691-9ddf-c0f99eff4bcc admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:10.960285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f0025-0da8-4691-9ddf-c0f99eff4bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:10.960647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f0025-0da8-4691-9ddf-c0f99eff4bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:10.961531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f0025-0da8-4691-9ddf-c0f99eff4bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:10.963395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f0025-0da8-4691-9ddf-c0f99eff4bcc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:10.991976 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1648/3274] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:20:10.995801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf8525-4b8f-4a40-b9d9-8915246033f2 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:11.010775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf8525-4b8f-4a40-b9d9-8915246033f2 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:11.024786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed966aa-953e-4810-b8b2-51aadc59ccb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:11.025940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed966aa-953e-4810-b8b2-51aadc59ccb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:11.026301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed966aa-953e-4810-b8b2-51aadc59ccb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:11.026722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed966aa-953e-4810-b8b2-51aadc59ccb0 admin admin] PATH_INFO: `/v3/projects/71ce4cdf1cd645a9848172410c68b38f/users/ad21aaed5647465fb3b7921d1a376101/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:11.081627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed966aa-953e-4810-b8b2-51aadc59ccb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71ce4cdf1cd645a9848172410c68b38f, user_id=ad21aaed5647465fb3b7921d1a376101, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:11.085539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed966aa-953e-4810-b8b2-51aadc59ccb0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:11.129246 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1627/3275] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:20:10 2022] PUT /identity/v3/projects/71ce4cdf1cd645a9848172410c68b38f/users/ad21aaed5647465fb3b7921d1a376101/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:20:11.140158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870207f5-d5a5-4d52-b80c-be2e7a3735a4 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:11.140786 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870207f5-d5a5-4d52-b80c-be2e7a3735a4 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:11.140786 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870207f5-d5a5-4d52-b80c-be2e7a3735a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:11.206254 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-870207f5-d5a5-4d52-b80c-be2e7a3735a4 None None] MFA Rules not processed for user `ad21aaed5647465fb3b7921d1a376101`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:11.210138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-870207f5-d5a5-4d52-b80c-be2e7a3735a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:11.496097 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1649/3276] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:20:11.502516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed966aa-953e-4810-b8b2-51aadc59ccb0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:11.631832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed966aa-953e-4810-b8b2-51aadc59ccb0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:11.641577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbea73-86e4-4389-876a-2bd74f32521b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:11.644446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbea73-86e4-4389-876a-2bd74f32521b admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:11.659239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbea73-86e4-4389-876a-2bd74f32521b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:11.660278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbea73-86e4-4389-876a-2bd74f32521b admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:11.661934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fbea73-86e4-4389-876a-2bd74f32521b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:11.667103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fbea73-86e4-4389-876a-2bd74f32521b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:11.760536 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1628/3277] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:20:11 2022] POST /identity/v3/projects => generated 383 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:20:11.761856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870207f5-d5a5-4d52-b80c-be2e7a3735a4 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:11.797888 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870207f5-d5a5-4d52-b80c-be2e7a3735a4 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:11.920329 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:12.027523 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79dbd7-c98e-48e5-8d8d-2b88965984df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:12.028401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79dbd7-c98e-48e5-8d8d-2b88965984df admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:12.028699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79dbd7-c98e-48e5-8d8d-2b88965984df admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:12.028978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79dbd7-c98e-48e5-8d8d-2b88965984df admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:12.029643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79dbd7-c98e-48e5-8d8d-2b88965984df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:12.032838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79dbd7-c98e-48e5-8d8d-2b88965984df admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:12.091545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbea73-86e4-4389-876a-2bd74f32521b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:12.092477 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1650/3278] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:20:11 2022] POST /identity/v3/users => generated 298 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:20:12.114299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbea73-86e4-4389-876a-2bd74f32521b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:12.143104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ec066-bb87-4f0f-beb2-4a0940b81620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:12.144018 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ec066-bb87-4f0f-beb2-4a0940b81620 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:12.144362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ec066-bb87-4f0f-beb2-4a0940b81620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:12.144710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ec066-bb87-4f0f-beb2-4a0940b81620 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:12.145475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ec066-bb87-4f0f-beb2-4a0940b81620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:12.147708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ec066-bb87-4f0f-beb2-4a0940b81620 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:12.173188 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1629/3279] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:20:12.176962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79dbd7-c98e-48e5-8d8d-2b88965984df admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:12.195479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79dbd7-c98e-48e5-8d8d-2b88965984df admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:12.209933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01788f45-355a-4af0-b973-d3c673f33d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:12.210701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01788f45-355a-4af0-b973-d3c673f33d0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:12.211048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01788f45-355a-4af0-b973-d3c673f33d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:12.211324 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01788f45-355a-4af0-b973-d3c673f33d0b admin admin] PATH_INFO: `/v3/projects/ea74e1265236408b8c54c8a87c213ba4/users/5e0ba2876e4d48d38e15ac31da71ba8a/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:12.251441 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01788f45-355a-4af0-b973-d3c673f33d0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea74e1265236408b8c54c8a87c213ba4, user_id=5e0ba2876e4d48d38e15ac31da71ba8a, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:12.254468 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01788f45-355a-4af0-b973-d3c673f33d0b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:12.283724 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1651/3280] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:20:12 2022] PUT /identity/v3/projects/ea74e1265236408b8c54c8a87c213ba4/users/5e0ba2876e4d48d38e15ac31da71ba8a/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:20:12.288363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ec066-bb87-4f0f-beb2-4a0940b81620 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:12.310642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ec066-bb87-4f0f-beb2-4a0940b81620 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:12.327015 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:12.469665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ea26c-a4ea-43e1-8b37-932b4a844852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:12.470836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ea26c-a4ea-43e1-8b37-932b4a844852 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:12.477162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ea26c-a4ea-43e1-8b37-932b4a844852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:12.477799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ea26c-a4ea-43e1-8b37-932b4a844852 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:12.479204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ea26c-a4ea-43e1-8b37-932b4a844852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:12.482808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ea26c-a4ea-43e1-8b37-932b4a844852 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:12.512059 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1630/3281] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:20:12.516582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01788f45-355a-4af0-b973-d3c673f33d0b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:12.538449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01788f45-355a-4af0-b973-d3c673f33d0b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:12.551969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea740e-4dc7-492e-81fe-8dc4ee912b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:12.552655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea740e-4dc7-492e-81fe-8dc4ee912b02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:12.553424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea740e-4dc7-492e-81fe-8dc4ee912b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:12.553725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea740e-4dc7-492e-81fe-8dc4ee912b02 admin admin] PATH_INFO: `/v3/projects/ea74e1265236408b8c54c8a87c213ba4/users/5e0ba2876e4d48d38e15ac31da71ba8a/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:12.560421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea740e-4dc7-492e-81fe-8dc4ee912b02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea74e1265236408b8c54c8a87c213ba4, user_id=5e0ba2876e4d48d38e15ac31da71ba8a, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:12.563397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ea740e-4dc7-492e-81fe-8dc4ee912b02 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:12.617637 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1652/3282] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:20:12 2022] PUT /identity/v3/projects/ea74e1265236408b8c54c8a87c213ba4/users/5e0ba2876e4d48d38e15ac31da71ba8a/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:12.619310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc6e4e-cfbd-418e-9875-96b474fa29a7 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:12.619603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc6e4e-cfbd-418e-9875-96b474fa29a7 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:12.619916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc6e4e-cfbd-418e-9875-96b474fa29a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:12.710252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-eadc6e4e-cfbd-418e-9875-96b474fa29a7 None None] MFA Rules not processed for user `5e0ba2876e4d48d38e15ac31da71ba8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:12.713577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-eadc6e4e-cfbd-418e-9875-96b474fa29a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:12.934691 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1631/3283] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:12 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:12.943183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea740e-4dc7-492e-81fe-8dc4ee912b02 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:12.945909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-92ea740e-4dc7-492e-81fe-8dc4ee912b02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:13.153122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea740e-4dc7-492e-81fe-8dc4ee912b02 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:13.173265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e153770-2d14-4775-99ba-4831aeef8b19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:13.174493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e153770-2d14-4775-99ba-4831aeef8b19 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:13.174817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e153770-2d14-4775-99ba-4831aeef8b19 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:13.176178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e153770-2d14-4775-99ba-4831aeef8b19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:13.201711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e153770-2d14-4775-99ba-4831aeef8b19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:13.203998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e153770-2d14-4775-99ba-4831aeef8b19 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:13.241517 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1653/3284] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:13.272655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b6045-c3b8-4451-a2f2-ab3dbecb6ded None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:13.273598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b6045-c3b8-4451-a2f2-ab3dbecb6ded None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:13.274083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b6045-c3b8-4451-a2f2-ab3dbecb6ded None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:13.276038 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1632/3285] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:20:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:20:13.285162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e153770-2d14-4775-99ba-4831aeef8b19 service nova] Authenticating service token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:20:13.301009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e153770-2d14-4775-99ba-4831aeef8b19 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:13.313123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e153770-2d14-4775-99ba-4831aeef8b19 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:13.320696 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b6541-ccf8-446b-88f0-c8afb3f9831f tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0ba2876e4d48d38e15ac31da71ba8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74e1265236408b8c54c8a87c213ba4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:13.321844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b6541-ccf8-446b-88f0-c8afb3f9831f tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:13.322367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b6541-ccf8-446b-88f0-c8afb3f9831f tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:13.322878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b6541-ccf8-446b-88f0-c8afb3f9831f tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] PATH_INFO: `/v3/projects/71ce4cdf1cd645a9848172410c68b38f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:13.324437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b6541-ccf8-446b-88f0-c8afb3f9831f tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] RBAC: Authorizing `identity:get_project(project_id=71ce4cdf1cd645a9848172410c68b38f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:13.327174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b6541-ccf8-446b-88f0-c8afb3f9831f tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:13.348407 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1654/3286] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:20:13 2022] GET /identity/v3/projects/71ce4cdf1cd645a9848172410c68b38f => generated 381 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:20:13.547951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de8c85-1ee7-453e-bb72-624bd62ca5cc None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:13.548206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de8c85-1ee7-453e-bb72-624bd62ca5cc None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:13.548488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de8c85-1ee7-453e-bb72-624bd62ca5cc None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:13.551184 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1633/3287] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:20:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:20:13.561408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b6541-ccf8-446b-88f0-c8afb3f9831f tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Authenticating service token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:20:13.583519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b6541-ccf8-446b-88f0-c8afb3f9831f tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:13.618220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b6541-ccf8-446b-88f0-c8afb3f9831f tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:13.631974 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52021172-ae1d-4d50-81fe-1f11c424ec98 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0ba2876e4d48d38e15ac31da71ba8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74e1265236408b8c54c8a87c213ba4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:13.632937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52021172-ae1d-4d50-81fe-1f11c424ec98 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:13.633414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52021172-ae1d-4d50-81fe-1f11c424ec98 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:13.633563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52021172-ae1d-4d50-81fe-1f11c424ec98 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] PATH_INFO: `/v3/projects/71ce4cdf1cd645a9848172410c68b38f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:13.635802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52021172-ae1d-4d50-81fe-1f11c424ec98 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] RBAC: Authorizing `identity:get_project(project_id=71ce4cdf1cd645a9848172410c68b38f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:13.641603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52021172-ae1d-4d50-81fe-1f11c424ec98 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:13.648810 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1655/3288] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:20:13 2022] GET /identity/v3/projects/71ce4cdf1cd645a9848172410c68b38f => generated 381 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:20:13.898461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8b529-d89d-47fd-8809-4e1046cefa95 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:13.898743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8b529-d89d-47fd-8809-4e1046cefa95 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:13.899018 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8b529-d89d-47fd-8809-4e1046cefa95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:13.925485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-a5a8b529-d89d-47fd-8809-4e1046cefa95 None None] MFA Rules not processed for user `ad21aaed5647465fb3b7921d1a376101`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:13.928435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a5a8b529-d89d-47fd-8809-4e1046cefa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:14.198618 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1634/3289] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:14.462817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52021172-ae1d-4d50-81fe-1f11c424ec98 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:14.464771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-52021172-ae1d-4d50-81fe-1f11c424ec98 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:14.501602 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52021172-ae1d-4d50-81fe-1f11c424ec98 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:14.520480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8eb10e-248e-4a6b-a3ed-7a1d34e405ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:14.523764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8eb10e-248e-4a6b-a3ed-7a1d34e405ee service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:14.524189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8eb10e-248e-4a6b-a3ed-7a1d34e405ee service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:14.524563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8eb10e-248e-4a6b-a3ed-7a1d34e405ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:14.557383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8eb10e-248e-4a6b-a3ed-7a1d34e405ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:14.571388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8eb10e-248e-4a6b-a3ed-7a1d34e405ee service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:14.627669 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1656/3290] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:16.185776 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e15ad-8d29-449d-9e94-61cbaceed2ef None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:16.186292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e15ad-8d29-449d-9e94-61cbaceed2ef None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:16.186574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e15ad-8d29-449d-9e94-61cbaceed2ef None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:16.188090 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1635/3291] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:20:16.200762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8eb10e-248e-4a6b-a3ed-7a1d34e405ee service nova] Authenticating service token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:20:16.230388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8eb10e-248e-4a6b-a3ed-7a1d34e405ee service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:16.256268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8eb10e-248e-4a6b-a3ed-7a1d34e405ee service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:16.265686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdc8ff-afd4-4609-8740-59902528f8d5 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0ba2876e4d48d38e15ac31da71ba8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74e1265236408b8c54c8a87c213ba4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:16.266661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdc8ff-afd4-4609-8740-59902528f8d5 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:16.267218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdc8ff-afd4-4609-8740-59902528f8d5 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:16.267707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdc8ff-afd4-4609-8740-59902528f8d5 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] PATH_INFO: `/v3/projects/71ce4cdf1cd645a9848172410c68b38f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:16.269144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bdc8ff-afd4-4609-8740-59902528f8d5 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] RBAC: Authorizing `identity:get_project(project_id=71ce4cdf1cd645a9848172410c68b38f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:16.273067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bdc8ff-afd4-4609-8740-59902528f8d5 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:16.294645 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1657/3292] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:20:16 2022] GET /identity/v3/projects/71ce4cdf1cd645a9848172410c68b38f => generated 381 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:20:16.816354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316a4cb-679a-4460-8d01-6f4bbfc910fb None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:16.816727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316a4cb-679a-4460-8d01-6f4bbfc910fb None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:16.817101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316a4cb-679a-4460-8d01-6f4bbfc910fb None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:16.818685 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1636/3293] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:20:16.832067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdc8ff-afd4-4609-8740-59902528f8d5 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Authenticating service token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:20:16.853541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdc8ff-afd4-4609-8740-59902528f8d5 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:16.887466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdc8ff-afd4-4609-8740-59902528f8d5 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:16.916287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29c553-832a-40cb-9631-953721c75932 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0ba2876e4d48d38e15ac31da71ba8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74e1265236408b8c54c8a87c213ba4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:16.918227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29c553-832a-40cb-9631-953721c75932 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:16.919297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29c553-832a-40cb-9631-953721c75932 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:16.919657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29c553-832a-40cb-9631-953721c75932 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] PATH_INFO: `/v3/projects/71ce4cdf1cd645a9848172410c68b38f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:16.922997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29c553-832a-40cb-9631-953721c75932 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] RBAC: Authorizing `identity:get_project(project_id=71ce4cdf1cd645a9848172410c68b38f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:16.927182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29c553-832a-40cb-9631-953721c75932 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:16.933849 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1658/3294] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:20:16 2022] GET /identity/v3/projects/71ce4cdf1cd645a9848172410c68b38f => generated 381 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:20:16.996563 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1091fc-2838-4dd4-9631-f24739d17aae None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:16.997110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1091fc-2838-4dd4-9631-f24739d17aae None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:16.997537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1091fc-2838-4dd4-9631-f24739d17aae None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:16.999033 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1637/3295] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:20:17.007665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29c553-832a-40cb-9631-953721c75932 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Authenticating service token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:20:17.038857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29c553-832a-40cb-9631-953721c75932 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:17.051311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29c553-832a-40cb-9631-953721c75932 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:17.057050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6cb700-d009-4a3e-af4d-99d6bca0f93d tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0ba2876e4d48d38e15ac31da71ba8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74e1265236408b8c54c8a87c213ba4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:17.058501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cb700-d009-4a3e-af4d-99d6bca0f93d tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:17.060433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cb700-d009-4a3e-af4d-99d6bca0f93d tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:17.060878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6cb700-d009-4a3e-af4d-99d6bca0f93d tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] PATH_INFO: `/v3/projects/71ce4cdf1cd645a9848172410c68b38f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:17.068499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6cb700-d009-4a3e-af4d-99d6bca0f93d tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] RBAC: Authorizing `identity:get_project(project_id=71ce4cdf1cd645a9848172410c68b38f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:17.071077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6cb700-d009-4a3e-af4d-99d6bca0f93d tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:17.087375 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1659/3296] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:20:17 2022] GET /identity/v3/projects/71ce4cdf1cd645a9848172410c68b38f => generated 381 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:20:17.238658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c952f55-3e7b-40a5-a146-4a031e2398d6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:17.239132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c952f55-3e7b-40a5-a146-4a031e2398d6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:17.239206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c952f55-3e7b-40a5-a146-4a031e2398d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:17.278242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2c952f55-3e7b-40a5-a146-4a031e2398d6 None None] MFA Rules not processed for user `ad21aaed5647465fb3b7921d1a376101`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:17.282067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2c952f55-3e7b-40a5-a146-4a031e2398d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:17.297541 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1638/3297] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:17.455360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd40e00-93e8-419d-b3b6-a526d1a79956 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:17.455865 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd40e00-93e8-419d-b3b6-a526d1a79956 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:17.455966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd40e00-93e8-419d-b3b6-a526d1a79956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:17.506577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-fcd40e00-93e8-419d-b3b6-a526d1a79956 None None] MFA Rules not processed for user `d4f7282c7251455086368d5274a4fac5`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:17.508580 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fcd40e00-93e8-419d-b3b6-a526d1a79956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:17.566766 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:17.684805 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1660/3298] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:18.443707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0116863-fca9-4448-aae6-68175d342883 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:18.444270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0116863-fca9-4448-aae6-68175d342883 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:18.444270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0116863-fca9-4448-aae6-68175d342883 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:18.445594 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1639/3299] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:20:18.453072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd40e00-93e8-419d-b3b6-a526d1a79956 None None] Authenticating service token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:20:18.473228 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd40e00-93e8-419d-b3b6-a526d1a79956 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:18.490128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd40e00-93e8-419d-b3b6-a526d1a79956 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:18.495250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3833c30-9355-4c69-8135-783920739778 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0ba2876e4d48d38e15ac31da71ba8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74e1265236408b8c54c8a87c213ba4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:18.496378 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3833c30-9355-4c69-8135-783920739778 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:18.496847 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3833c30-9355-4c69-8135-783920739778 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:18.497329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3833c30-9355-4c69-8135-783920739778 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] PATH_INFO: `/v3/projects/71ce4cdf1cd645a9848172410c68b38f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:18.499378 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3833c30-9355-4c69-8135-783920739778 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] RBAC: Authorizing `identity:get_project(project_id=71ce4cdf1cd645a9848172410c68b38f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:18.502075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3833c30-9355-4c69-8135-783920739778 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:18.506441 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1661/3300] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:20:18 2022] GET /identity/v3/projects/71ce4cdf1cd645a9848172410c68b38f => generated 381 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:20:18.666908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52359032-a086-44da-a780-480a559fc7be None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:18.667417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52359032-a086-44da-a780-480a559fc7be None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:18.667931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52359032-a086-44da-a780-480a559fc7be None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:18.669876 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1640/3301] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:20:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:20:18.677304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3833c30-9355-4c69-8135-783920739778 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Authenticating service token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:20:18.698160 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3833c30-9355-4c69-8135-783920739778 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:18.711857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3833c30-9355-4c69-8135-783920739778 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:18.736527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf96bc-4a62-46d0-a774-befaa4572454 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0ba2876e4d48d38e15ac31da71ba8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74e1265236408b8c54c8a87c213ba4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:18.737124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf96bc-4a62-46d0-a774-befaa4572454 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:18.737403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf96bc-4a62-46d0-a774-befaa4572454 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:18.738108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf96bc-4a62-46d0-a774-befaa4572454 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] PATH_INFO: `/v3/projects/71ce4cdf1cd645a9848172410c68b38f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:18.739536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf96bc-4a62-46d0-a774-befaa4572454 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] RBAC: Authorizing `identity:get_project(project_id=71ce4cdf1cd645a9848172410c68b38f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:18.742483 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf96bc-4a62-46d0-a774-befaa4572454 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:18.744811 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1662/3302] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:20:18 2022] GET /identity/v3/projects/71ce4cdf1cd645a9848172410c68b38f => generated 381 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:20:18.803770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf39632-33f8-4d4e-a868-e6327a90f2c0 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:18.804328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf39632-33f8-4d4e-a868-e6327a90f2c0 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:18.804773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf39632-33f8-4d4e-a868-e6327a90f2c0 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:18.806298 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1641/3303] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:20:18.813673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf96bc-4a62-46d0-a774-befaa4572454 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Authenticating service token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:20:18.836814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf96bc-4a62-46d0-a774-befaa4572454 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:18.855688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf96bc-4a62-46d0-a774-befaa4572454 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:18.873913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234e047-5d8d-4515-b424-96b8efcdcabf tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0ba2876e4d48d38e15ac31da71ba8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74e1265236408b8c54c8a87c213ba4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:18.876734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234e047-5d8d-4515-b424-96b8efcdcabf tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:18.878829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234e047-5d8d-4515-b424-96b8efcdcabf tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:18.880249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234e047-5d8d-4515-b424-96b8efcdcabf tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] PATH_INFO: `/v3/projects/71ce4cdf1cd645a9848172410c68b38f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:18.884977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234e047-5d8d-4515-b424-96b8efcdcabf tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] RBAC: Authorizing `identity:get_project(project_id=71ce4cdf1cd645a9848172410c68b38f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:18.894597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234e047-5d8d-4515-b424-96b8efcdcabf tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:18.902827 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1663/3304] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:20:18 2022] GET /identity/v3/projects/71ce4cdf1cd645a9848172410c68b38f => generated 381 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:20:19.088044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068705a2-7e21-4d77-958d-93233c165d98 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:19.088784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068705a2-7e21-4d77-958d-93233c165d98 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:19.089196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068705a2-7e21-4d77-958d-93233c165d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:19.134265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-068705a2-7e21-4d77-958d-93233c165d98 None None] MFA Rules not processed for user `ad21aaed5647465fb3b7921d1a376101`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:19.148382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-068705a2-7e21-4d77-958d-93233c165d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:19.175708 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1642/3305] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:20.338488 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb418a-a2ab-44ff-8f76-6e99a62e9da3 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:20.339170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb418a-a2ab-44ff-8f76-6e99a62e9da3 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:20.339606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb418a-a2ab-44ff-8f76-6e99a62e9da3 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:20.342181 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1664/3306] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:20:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:20:20.352598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068705a2-7e21-4d77-958d-93233c165d98 None None] Authenticating service token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:20:20.390417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068705a2-7e21-4d77-958d-93233c165d98 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:20.416150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068705a2-7e21-4d77-958d-93233c165d98 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:20.421424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72d85d-5afc-43c9-8b2f-ed339af20655 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e0ba2876e4d48d38e15ac31da71ba8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ea74e1265236408b8c54c8a87c213ba4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:20.422329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72d85d-5afc-43c9-8b2f-ed339af20655 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:20.423048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72d85d-5afc-43c9-8b2f-ed339af20655 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:20.423473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72d85d-5afc-43c9-8b2f-ed339af20655 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] PATH_INFO: `/v3/projects/71ce4cdf1cd645a9848172410c68b38f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:20.425069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72d85d-5afc-43c9-8b2f-ed339af20655 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] RBAC: Authorizing `identity:get_project(project_id=71ce4cdf1cd645a9848172410c68b38f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:20.427138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72d85d-5afc-43c9-8b2f-ed339af20655 tempest-QuotasAdminNegativeTest-1475794771 tempest-QuotasAdminNegativeTest-1475794771-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:20.429186 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1643/3307] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:20:20 2022] GET /identity/v3/projects/71ce4cdf1cd645a9848172410c68b38f => generated 381 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:20:20.712259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb418a-a2ab-44ff-8f76-6e99a62e9da3 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:20.878773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb418a-a2ab-44ff-8f76-6e99a62e9da3 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:20.885940 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e6dc8-851c-4bdc-bbd8-31cfd0bb9507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:20.886828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e6dc8-851c-4bdc-bbd8-31cfd0bb9507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:20.887255 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e6dc8-851c-4bdc-bbd8-31cfd0bb9507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:20.887670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e6dc8-851c-4bdc-bbd8-31cfd0bb9507 admin admin] PATH_INFO: `/v3/users/ad21aaed5647465fb3b7921d1a376101` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:20.889108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e6dc8-851c-4bdc-bbd8-31cfd0bb9507 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad21aaed5647465fb3b7921d1a376101)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:20.893123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e6dc8-851c-4bdc-bbd8-31cfd0bb9507 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:21.017381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-756e6dc8-851c-4bdc-bbd8-31cfd0bb9507 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad21aaed5647465fb3b7921d1a376101'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:21.037831 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-756e6dc8-851c-4bdc-bbd8-31cfd0bb9507 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad21aaed5647465fb3b7921d1a376101'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:21.079464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-756e6dc8-851c-4bdc-bbd8-31cfd0bb9507 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad21aaed5647465fb3b7921d1a376101'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:21.080991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-756e6dc8-851c-4bdc-bbd8-31cfd0bb9507 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad21aaed5647465fb3b7921d1a376101'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:21.101646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-756e6dc8-851c-4bdc-bbd8-31cfd0bb9507 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad21aaed5647465fb3b7921d1a376101'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:21.110645 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1665/3308] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:20:20 2022] DELETE /identity/v3/users/ad21aaed5647465fb3b7921d1a376101 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:21.115010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fd6a1-638f-4248-962a-8b64009e26a7 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:21.115366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fd6a1-638f-4248-962a-8b64009e26a7 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:21.115705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fd6a1-638f-4248-962a-8b64009e26a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:21.159745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-491fd6a1-638f-4248-962a-8b64009e26a7 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:21.161755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-491fd6a1-638f-4248-962a-8b64009e26a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:21.210780 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:21.296290 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1644/3309] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:21.306608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e6dc8-851c-4bdc-bbd8-31cfd0bb9507 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:21.308530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-756e6dc8-851c-4bdc-bbd8-31cfd0bb9507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:21.338352 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:21.402181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e6dc8-851c-4bdc-bbd8-31cfd0bb9507 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:21.407155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0ccee-d9bc-48a1-84c5-343133dcb15d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:21.408221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0ccee-d9bc-48a1-84c5-343133dcb15d service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:21.408570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0ccee-d9bc-48a1-84c5-343133dcb15d service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:21.409013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0ccee-d9bc-48a1-84c5-343133dcb15d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:21.436072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0ccee-d9bc-48a1-84c5-343133dcb15d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:21.440530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0ccee-d9bc-48a1-84c5-343133dcb15d service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:21.462719 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1666/3310] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:22.301975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fd6a1-638f-4248-962a-8b64009e26a7 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:22.304524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-491fd6a1-638f-4248-962a-8b64009e26a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:22.336479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fd6a1-638f-4248-962a-8b64009e26a7 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:22.363210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d350276-6051-45c7-ac32-43ec53cc2afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:22.364928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d350276-6051-45c7-ac32-43ec53cc2afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:22.365369 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d350276-6051-45c7-ac32-43ec53cc2afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:22.366572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d350276-6051-45c7-ac32-43ec53cc2afe admin admin] PATH_INFO: `/v3/projects/71ce4cdf1cd645a9848172410c68b38f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:22.369134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d350276-6051-45c7-ac32-43ec53cc2afe admin admin] RBAC: Authorizing `identity:delete_project(project_id=71ce4cdf1cd645a9848172410c68b38f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:22.372085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d350276-6051-45c7-ac32-43ec53cc2afe admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:22.459249 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2d350276-6051-45c7-ac32-43ec53cc2afe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71ce4cdf1cd645a9848172410c68b38f', 'request_id': 'req-2d350276-6051-45c7-ac32-43ec53cc2afe'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:22.468455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2d350276-6051-45c7-ac32-43ec53cc2afe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71ce4cdf1cd645a9848172410c68b38f', 'request_id': 'req-2d350276-6051-45c7-ac32-43ec53cc2afe'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:22.479372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2d350276-6051-45c7-ac32-43ec53cc2afe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71ce4cdf1cd645a9848172410c68b38f', 'request_id': 'req-2d350276-6051-45c7-ac32-43ec53cc2afe'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:22.507967 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2d350276-6051-45c7-ac32-43ec53cc2afe admin admin] The token cache is being invalidate because project 71ce4cdf1cd645a9848172410c68b38f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:20:22.508273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2d350276-6051-45c7-ac32-43ec53cc2afe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:22.521176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2d350276-6051-45c7-ac32-43ec53cc2afe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:22.529150 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1645/3311] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:20:22 2022] DELETE /identity/v3/projects/71ce4cdf1cd645a9848172410c68b38f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:22.533078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0ccee-d9bc-48a1-84c5-343133dcb15d service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:22.549370 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0ccee-d9bc-48a1-84c5-343133dcb15d service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:22.723615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594393c1-7ae9-421c-8d51-7112c783f697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:22.726620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594393c1-7ae9-421c-8d51-7112c783f697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:22.726911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594393c1-7ae9-421c-8d51-7112c783f697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:22.727196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594393c1-7ae9-421c-8d51-7112c783f697 admin admin] PATH_INFO: `/v3/users/5e0ba2876e4d48d38e15ac31da71ba8a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:22.730199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594393c1-7ae9-421c-8d51-7112c783f697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e0ba2876e4d48d38e15ac31da71ba8a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:22.737870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594393c1-7ae9-421c-8d51-7112c783f697 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:22.865748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-594393c1-7ae9-421c-8d51-7112c783f697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e0ba2876e4d48d38e15ac31da71ba8a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:22.898198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-594393c1-7ae9-421c-8d51-7112c783f697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e0ba2876e4d48d38e15ac31da71ba8a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:22.920852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-594393c1-7ae9-421c-8d51-7112c783f697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e0ba2876e4d48d38e15ac31da71ba8a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:22.921917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-594393c1-7ae9-421c-8d51-7112c783f697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e0ba2876e4d48d38e15ac31da71ba8a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:22.940869 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-594393c1-7ae9-421c-8d51-7112c783f697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e0ba2876e4d48d38e15ac31da71ba8a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:22.960240 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1667/3312] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:20:22 2022] DELETE /identity/v3/users/5e0ba2876e4d48d38e15ac31da71ba8a => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:20:23.438466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d350276-6051-45c7-ac32-43ec53cc2afe admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:23.440446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2d350276-6051-45c7-ac32-43ec53cc2afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:23.466303 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d350276-6051-45c7-ac32-43ec53cc2afe admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:23.485162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ece8e-171b-47a7-a567-5a73a5a85973 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:23.486947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ece8e-171b-47a7-a567-5a73a5a85973 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:23.487422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ece8e-171b-47a7-a567-5a73a5a85973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:23.549156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-881ece8e-171b-47a7-a567-5a73a5a85973 None None] MFA Rules not processed for user `4a359309c39a49c98f1f7aea48189efa`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:23.551148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-881ece8e-171b-47a7-a567-5a73a5a85973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:23.633827 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:23.662888 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95518192-a419-4ab0-89cc-9a39024881b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:23.664274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95518192-a419-4ab0-89cc-9a39024881b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:23.664274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95518192-a419-4ab0-89cc-9a39024881b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:23.664599 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95518192-a419-4ab0-89cc-9a39024881b5 admin admin] PATH_INFO: `/v3/projects/ea74e1265236408b8c54c8a87c213ba4` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:23.665903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95518192-a419-4ab0-89cc-9a39024881b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea74e1265236408b8c54c8a87c213ba4)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:23.667999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95518192-a419-4ab0-89cc-9a39024881b5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:23.678586 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1668/3313] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:20:23.731213 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:23.741584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-95518192-a419-4ab0-89cc-9a39024881b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea74e1265236408b8c54c8a87c213ba4', 'request_id': 'req-95518192-a419-4ab0-89cc-9a39024881b5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:23.749920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-95518192-a419-4ab0-89cc-9a39024881b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea74e1265236408b8c54c8a87c213ba4', 'request_id': 'req-95518192-a419-4ab0-89cc-9a39024881b5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:23.760036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-95518192-a419-4ab0-89cc-9a39024881b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea74e1265236408b8c54c8a87c213ba4', 'request_id': 'req-95518192-a419-4ab0-89cc-9a39024881b5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:23.779783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-95518192-a419-4ab0-89cc-9a39024881b5 admin admin] The token cache is being invalidate because project ea74e1265236408b8c54c8a87c213ba4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:20:23.780517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-95518192-a419-4ab0-89cc-9a39024881b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:23.781975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-95518192-a419-4ab0-89cc-9a39024881b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:23.783924 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1646/3314] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:20:23 2022] DELETE /identity/v3/projects/ea74e1265236408b8c54c8a87c213ba4 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:20:23.790436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2a49a-6195-44bd-a522-cd4f51723a15 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:23.791194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2a49a-6195-44bd-a522-cd4f51723a15 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:23.791731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2a49a-6195-44bd-a522-cd4f51723a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:23.816931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-80b2a49a-6195-44bd-a522-cd4f51723a15 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:23.818833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-80b2a49a-6195-44bd-a522-cd4f51723a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:23.961038 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1669/3315] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:20:23.970045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c1098-3a4b-4269-8ffb-0c0e666fd438 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:23.970333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c1098-3a4b-4269-8ffb-0c0e666fd438 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:23.970595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c1098-3a4b-4269-8ffb-0c0e666fd438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:24.013957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-cb8c1098-3a4b-4269-8ffb-0c0e666fd438 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:24.015707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cb8c1098-3a4b-4269-8ffb-0c0e666fd438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:24.046692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2a49a-6195-44bd-a522-cd4f51723a15 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:24.047026 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1647/3316] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:24.058667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2a49a-6195-44bd-a522-cd4f51723a15 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:24.065938 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a433f5-3261-4b51-92f7-06cddd66d939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:24.066910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a433f5-3261-4b51-92f7-06cddd66d939 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:24.067418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a433f5-3261-4b51-92f7-06cddd66d939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:24.067911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a433f5-3261-4b51-92f7-06cddd66d939 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:24.068783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a433f5-3261-4b51-92f7-06cddd66d939 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:20:24.069311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a433f5-3261-4b51-92f7-06cddd66d939 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:24.072253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a433f5-3261-4b51-92f7-06cddd66d939 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:24.089838 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1670/3317] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:20:24.095381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c1098-3a4b-4269-8ffb-0c0e666fd438 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:24.110282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c1098-3a4b-4269-8ffb-0c0e666fd438 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:24.122394 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664af3a2-24e1-421d-a54f-371dcf822cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:24.123022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664af3a2-24e1-421d-a54f-371dcf822cad admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:24.123298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664af3a2-24e1-421d-a54f-371dcf822cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:24.123567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664af3a2-24e1-421d-a54f-371dcf822cad admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:24.124237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664af3a2-24e1-421d-a54f-371dcf822cad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:24.132432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664af3a2-24e1-421d-a54f-371dcf822cad admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:24.206766 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1648/3318] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:20:24 2022] POST /identity/v3/projects => generated 409 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:20:24.211631 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a433f5-3261-4b51-92f7-06cddd66d939 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:24.226878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a433f5-3261-4b51-92f7-06cddd66d939 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:24.347015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7d343-c5a7-4af9-b681-56ffb5ed45bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:24.347135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7d343-c5a7-4af9-b681-56ffb5ed45bc admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:24.347369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7d343-c5a7-4af9-b681-56ffb5ed45bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:24.347657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7d343-c5a7-4af9-b681-56ffb5ed45bc admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:24.348332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7d343-c5a7-4af9-b681-56ffb5ed45bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:24.350408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7d343-c5a7-4af9-b681-56ffb5ed45bc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:24.393059 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1671/3319] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:20:24 2022] POST /identity/v3/users => generated 305 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:20:24.397311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664af3a2-24e1-421d-a54f-371dcf822cad admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:24.424302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664af3a2-24e1-421d-a54f-371dcf822cad admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:24.433507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919c46b-2337-481e-932c-b48200e80133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:24.434502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919c46b-2337-481e-932c-b48200e80133 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:24.435010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919c46b-2337-481e-932c-b48200e80133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:24.435640 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919c46b-2337-481e-932c-b48200e80133 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:24.439922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919c46b-2337-481e-932c-b48200e80133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:24.441883 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919c46b-2337-481e-932c-b48200e80133 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:24.464186 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1649/3320] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:20:24.469540 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7d343-c5a7-4af9-b681-56ffb5ed45bc admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:24.488998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7d343-c5a7-4af9-b681-56ffb5ed45bc admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:24.501192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1037abc-5597-4e44-85cd-c09d52c0a798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:24.502979 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1037abc-5597-4e44-85cd-c09d52c0a798 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:24.503283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1037abc-5597-4e44-85cd-c09d52c0a798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:24.503561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1037abc-5597-4e44-85cd-c09d52c0a798 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:24.504276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1037abc-5597-4e44-85cd-c09d52c0a798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:24.508414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1037abc-5597-4e44-85cd-c09d52c0a798 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:24.549656 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1672/3321] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:20:24.550875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919c46b-2337-481e-932c-b48200e80133 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:24.582006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919c46b-2337-481e-932c-b48200e80133 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:24.592840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efc608-bb9e-48d7-a37b-e43d4e994e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:24.594054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efc608-bb9e-48d7-a37b-e43d4e994e51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:24.594351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efc608-bb9e-48d7-a37b-e43d4e994e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:24.594627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efc608-bb9e-48d7-a37b-e43d4e994e51 admin admin] PATH_INFO: `/v3/projects/1dcd7d9e99aa458e9835b7358b29b00b/users/a3b81270bbff41ce9c02133a138e9a6b/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:24.635734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03efc608-bb9e-48d7-a37b-e43d4e994e51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dcd7d9e99aa458e9835b7358b29b00b, user_id=a3b81270bbff41ce9c02133a138e9a6b, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:24.639847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03efc608-bb9e-48d7-a37b-e43d4e994e51 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:24.692311 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1650/3322] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:20:24 2022] PUT /identity/v3/projects/1dcd7d9e99aa458e9835b7358b29b00b/users/a3b81270bbff41ce9c02133a138e9a6b/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:24.706213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee6635-94fa-4ab3-bc09-8565ed309f84 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:24.706852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee6635-94fa-4ab3-bc09-8565ed309f84 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:24.707486 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee6635-94fa-4ab3-bc09-8565ed309f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:24.849358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e0ee6635-94fa-4ab3-bc09-8565ed309f84 None None] MFA Rules not processed for user `a3b81270bbff41ce9c02133a138e9a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:24.853988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e0ee6635-94fa-4ab3-bc09-8565ed309f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:24.963446 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:25.013273 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1673/3323] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:24 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:25.018208 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efc608-bb9e-48d7-a37b-e43d4e994e51 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:25.118440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efc608-bb9e-48d7-a37b-e43d4e994e51 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:25.125561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ab597-84df-4f96-8828-18b3c941fc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:25.127095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ab597-84df-4f96-8828-18b3c941fc21 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:25.127095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ab597-84df-4f96-8828-18b3c941fc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:25.127308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ab597-84df-4f96-8828-18b3c941fc21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:25.127990 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ab597-84df-4f96-8828-18b3c941fc21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:25.134177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ab597-84df-4f96-8828-18b3c941fc21 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:25.174634 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1651/3324] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:20:25 2022] POST /identity/v3/projects => generated 407 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:20:25.178671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee6635-94fa-4ab3-bc09-8565ed309f84 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:25.193658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee6635-94fa-4ab3-bc09-8565ed309f84 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:25.338936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e67a16-aa83-4e0c-8a5f-9342a0e35cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:25.340041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e67a16-aa83-4e0c-8a5f-9342a0e35cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:25.340560 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e67a16-aa83-4e0c-8a5f-9342a0e35cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:25.341033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e67a16-aa83-4e0c-8a5f-9342a0e35cc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:25.342093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e67a16-aa83-4e0c-8a5f-9342a0e35cc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:25.345131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e67a16-aa83-4e0c-8a5f-9342a0e35cc9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:25.384537 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1674/3325] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:20:25 2022] POST /identity/v3/users => generated 310 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:20:25.384794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ab597-84df-4f96-8828-18b3c941fc21 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:25.402056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ab597-84df-4f96-8828-18b3c941fc21 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:25.416043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97e294-fd77-4853-a8eb-d0dda6f5122e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:25.417145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97e294-fd77-4853-a8eb-d0dda6f5122e admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:25.417427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97e294-fd77-4853-a8eb-d0dda6f5122e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:25.417852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97e294-fd77-4853-a8eb-d0dda6f5122e admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:25.418827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97e294-fd77-4853-a8eb-d0dda6f5122e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:25.422090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a97e294-fd77-4853-a8eb-d0dda6f5122e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:25.452247 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1652/3326] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:20:25.456445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e67a16-aa83-4e0c-8a5f-9342a0e35cc9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:25.474236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e67a16-aa83-4e0c-8a5f-9342a0e35cc9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:25.516656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0264c-e9cc-4700-940f-447a437ee5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:25.520461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0264c-e9cc-4700-940f-447a437ee5dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:25.520735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0264c-e9cc-4700-940f-447a437ee5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:25.522217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0264c-e9cc-4700-940f-447a437ee5dc admin admin] PATH_INFO: `/v3/projects/403025f341374d43a6edee123bd5a3e5/users/edf3d604e85743ed942c22831ad86c86/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:25.587650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0264c-e9cc-4700-940f-447a437ee5dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=403025f341374d43a6edee123bd5a3e5, user_id=edf3d604e85743ed942c22831ad86c86, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:25.594386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0264c-e9cc-4700-940f-447a437ee5dc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:25.640943 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1675/3327] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:20:25 2022] PUT /identity/v3/projects/403025f341374d43a6edee123bd5a3e5/users/edf3d604e85743ed942c22831ad86c86/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:25.645241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97e294-fd77-4853-a8eb-d0dda6f5122e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:25.665899 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a97e294-fd77-4853-a8eb-d0dda6f5122e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:25.781402 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:25.840630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80c81c-003e-4762-8a41-3c8119f672e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:25.842166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80c81c-003e-4762-8a41-3c8119f672e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:25.842688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80c81c-003e-4762-8a41-3c8119f672e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:25.843208 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80c81c-003e-4762-8a41-3c8119f672e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:25.844345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80c81c-003e-4762-8a41-3c8119f672e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:25.846375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80c81c-003e-4762-8a41-3c8119f672e0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:25.859944 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1653/3328] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:20:25.863831 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0264c-e9cc-4700-940f-447a437ee5dc admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:25.886876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0264c-e9cc-4700-940f-447a437ee5dc admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:25.900228 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4426f0-bb46-444b-a850-35e27852a7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:25.902745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4426f0-bb46-444b-a850-35e27852a7a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:25.903469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4426f0-bb46-444b-a850-35e27852a7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:25.904319 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4426f0-bb46-444b-a850-35e27852a7a6 admin admin] PATH_INFO: `/v3/projects/403025f341374d43a6edee123bd5a3e5/users/edf3d604e85743ed942c22831ad86c86/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:25.911478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4426f0-bb46-444b-a850-35e27852a7a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=403025f341374d43a6edee123bd5a3e5, user_id=edf3d604e85743ed942c22831ad86c86, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:25.920272 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4426f0-bb46-444b-a850-35e27852a7a6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:25.957121 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1676/3329] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:20:25 2022] PUT /identity/v3/projects/403025f341374d43a6edee123bd5a3e5/users/edf3d604e85743ed942c22831ad86c86/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:25.967828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad0821-bf71-4502-beb8-a712ac5fbe67 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:25.968880 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad0821-bf71-4502-beb8-a712ac5fbe67 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:25.969429 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad0821-bf71-4502-beb8-a712ac5fbe67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:26.054349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b9ad0821-bf71-4502-beb8-a712ac5fbe67 None None] MFA Rules not processed for user `edf3d604e85743ed942c22831ad86c86`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:26.058000 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b9ad0821-bf71-4502-beb8-a712ac5fbe67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:26.209824 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1654/3330] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:25 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:26.221227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4426f0-bb46-444b-a850-35e27852a7a6 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:26.303131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4426f0-bb46-444b-a850-35e27852a7a6 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:26.308273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bd180-55bc-4ea6-aa8b-466a67f67a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:26.309226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bd180-55bc-4ea6-aa8b-466a67f67a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:26.309226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bd180-55bc-4ea6-aa8b-466a67f67a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:26.309486 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bd180-55bc-4ea6-aa8b-466a67f67a9d admin admin] PATH_INFO: `/v3/users/a3b81270bbff41ce9c02133a138e9a6b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:26.311401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bd180-55bc-4ea6-aa8b-466a67f67a9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3b81270bbff41ce9c02133a138e9a6b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:26.314243 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bd180-55bc-4ea6-aa8b-466a67f67a9d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:26.365794 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:26.389510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-904bd180-55bc-4ea6-aa8b-466a67f67a9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3b81270bbff41ce9c02133a138e9a6b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:26.401399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-904bd180-55bc-4ea6-aa8b-466a67f67a9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3b81270bbff41ce9c02133a138e9a6b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:26.422425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-904bd180-55bc-4ea6-aa8b-466a67f67a9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3b81270bbff41ce9c02133a138e9a6b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:26.424553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-904bd180-55bc-4ea6-aa8b-466a67f67a9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3b81270bbff41ce9c02133a138e9a6b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:26.433678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-904bd180-55bc-4ea6-aa8b-466a67f67a9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3b81270bbff41ce9c02133a138e9a6b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:26.449200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0bbfd-9f31-4d98-8e54-cbb217459c1d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:26.449509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0bbfd-9f31-4d98-8e54-cbb217459c1d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:26.449791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0bbfd-9f31-4d98-8e54-cbb217459c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:26.453441 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1677/3331] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:20:26 2022] DELETE /identity/v3/users/a3b81270bbff41ce9c02133a138e9a6b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:26.501210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-f8b0bbfd-9f31-4d98-8e54-cbb217459c1d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:26.505763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f8b0bbfd-9f31-4d98-8e54-cbb217459c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:26.658915 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1655/3332] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:26.671675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bd180-55bc-4ea6-aa8b-466a67f67a9d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:26.674203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-904bd180-55bc-4ea6-aa8b-466a67f67a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:26.847078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bd180-55bc-4ea6-aa8b-466a67f67a9d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:26.867421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654011b-6e67-4cc4-80cb-f9333e042d48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:26.868170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654011b-6e67-4cc4-80cb-f9333e042d48 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:26.868748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654011b-6e67-4cc4-80cb-f9333e042d48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:26.868992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654011b-6e67-4cc4-80cb-f9333e042d48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:26.908113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9654011b-6e67-4cc4-80cb-f9333e042d48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:26.911549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9654011b-6e67-4cc4-80cb-f9333e042d48 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:26.953933 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1678/3333] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:20:28.319630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0bbfd-9f31-4d98-8e54-cbb217459c1d None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:28.323101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f8b0bbfd-9f31-4d98-8e54-cbb217459c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:28.381176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0bbfd-9f31-4d98-8e54-cbb217459c1d None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:28.404699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacec171-8285-48c9-b2d0-c3f939d1d3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:28.405360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacec171-8285-48c9-b2d0-c3f939d1d3f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:28.405633 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacec171-8285-48c9-b2d0-c3f939d1d3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:28.406486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacec171-8285-48c9-b2d0-c3f939d1d3f1 admin admin] PATH_INFO: `/v3/projects/1dcd7d9e99aa458e9835b7358b29b00b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:28.409904 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacec171-8285-48c9-b2d0-c3f939d1d3f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dcd7d9e99aa458e9835b7358b29b00b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:28.417883 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacec171-8285-48c9-b2d0-c3f939d1d3f1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:28.530573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dacec171-8285-48c9-b2d0-c3f939d1d3f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dcd7d9e99aa458e9835b7358b29b00b', 'request_id': 'req-dacec171-8285-48c9-b2d0-c3f939d1d3f1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:28.544967 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dacec171-8285-48c9-b2d0-c3f939d1d3f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dcd7d9e99aa458e9835b7358b29b00b', 'request_id': 'req-dacec171-8285-48c9-b2d0-c3f939d1d3f1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:28.547784 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:28.555320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dacec171-8285-48c9-b2d0-c3f939d1d3f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dcd7d9e99aa458e9835b7358b29b00b', 'request_id': 'req-dacec171-8285-48c9-b2d0-c3f939d1d3f1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:28.578997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dacec171-8285-48c9-b2d0-c3f939d1d3f1 admin admin] The token cache is being invalidate because project 1dcd7d9e99aa458e9835b7358b29b00b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:20:28.579490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dacec171-8285-48c9-b2d0-c3f939d1d3f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:28.580667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dacec171-8285-48c9-b2d0-c3f939d1d3f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:28.582897 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1656/3334] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:20:28 2022] DELETE /identity/v3/projects/1dcd7d9e99aa458e9835b7358b29b00b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:28.586675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654011b-6e67-4cc4-80cb-f9333e042d48 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:28.597832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9654011b-6e67-4cc4-80cb-f9333e042d48 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:28.779565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c013e-b69a-426a-a7c0-ff1f28e22a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:28.780335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c013e-b69a-426a-a7c0-ff1f28e22a3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:28.780622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c013e-b69a-426a-a7c0-ff1f28e22a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:28.780931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c013e-b69a-426a-a7c0-ff1f28e22a3c admin admin] PATH_INFO: `/v3/users/edf3d604e85743ed942c22831ad86c86` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:28.784577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c013e-b69a-426a-a7c0-ff1f28e22a3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=edf3d604e85743ed942c22831ad86c86)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:28.789223 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c013e-b69a-426a-a7c0-ff1f28e22a3c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:28.932223 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5f2c013e-b69a-426a-a7c0-ff1f28e22a3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edf3d604e85743ed942c22831ad86c86'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:28.946262 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:28.951165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5f2c013e-b69a-426a-a7c0-ff1f28e22a3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edf3d604e85743ed942c22831ad86c86'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:28.989863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5f2c013e-b69a-426a-a7c0-ff1f28e22a3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edf3d604e85743ed942c22831ad86c86'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:28.991939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5f2c013e-b69a-426a-a7c0-ff1f28e22a3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edf3d604e85743ed942c22831ad86c86'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:29.007487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5f2c013e-b69a-426a-a7c0-ff1f28e22a3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edf3d604e85743ed942c22831ad86c86'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:29.030443 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1679/3335] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:20:28 2022] DELETE /identity/v3/users/edf3d604e85743ed942c22831ad86c86 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:29.673420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacec171-8285-48c9-b2d0-c3f939d1d3f1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:29.676194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-dacec171-8285-48c9-b2d0-c3f939d1d3f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:29.706005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacec171-8285-48c9-b2d0-c3f939d1d3f1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:29.856559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f188c8-3c9d-486a-abd4-d3a7e8c63eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:29.857215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f188c8-3c9d-486a-abd4-d3a7e8c63eeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:29.857500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f188c8-3c9d-486a-abd4-d3a7e8c63eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:29.857778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f188c8-3c9d-486a-abd4-d3a7e8c63eeb admin admin] PATH_INFO: `/v3/projects/403025f341374d43a6edee123bd5a3e5` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:29.860817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f188c8-3c9d-486a-abd4-d3a7e8c63eeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=403025f341374d43a6edee123bd5a3e5)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:29.862795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f188c8-3c9d-486a-abd4-d3a7e8c63eeb admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:29.973739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-74f188c8-3c9d-486a-abd4-d3a7e8c63eeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '403025f341374d43a6edee123bd5a3e5', 'request_id': 'req-74f188c8-3c9d-486a-abd4-d3a7e8c63eeb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:30.013221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-74f188c8-3c9d-486a-abd4-d3a7e8c63eeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '403025f341374d43a6edee123bd5a3e5', 'request_id': 'req-74f188c8-3c9d-486a-abd4-d3a7e8c63eeb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:30.030664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-74f188c8-3c9d-486a-abd4-d3a7e8c63eeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '403025f341374d43a6edee123bd5a3e5', 'request_id': 'req-74f188c8-3c9d-486a-abd4-d3a7e8c63eeb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:30.057489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-74f188c8-3c9d-486a-abd4-d3a7e8c63eeb admin admin] The token cache is being invalidate because project 403025f341374d43a6edee123bd5a3e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:20:30.058126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-74f188c8-3c9d-486a-abd4-d3a7e8c63eeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:30.067034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-74f188c8-3c9d-486a-abd4-d3a7e8c63eeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:30.069851 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1657/3336] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:20:29 2022] DELETE /identity/v3/projects/403025f341374d43a6edee123bd5a3e5 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:30.079165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2e60f-5c20-430c-967a-9150735264aa None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:30.080288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2e60f-5c20-430c-967a-9150735264aa None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:30.080288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2e60f-5c20-430c-967a-9150735264aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:30.134180 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-02d2e60f-5c20-430c-967a-9150735264aa None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:30.135869 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-02d2e60f-5c20-430c-967a-9150735264aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:30.251078 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1680/3337] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:30.267195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b917e88-11a5-4e95-98ee-94f51021dee0 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:30.267835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b917e88-11a5-4e95-98ee-94f51021dee0 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:30.268408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b917e88-11a5-4e95-98ee-94f51021dee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:30.314717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-4b917e88-11a5-4e95-98ee-94f51021dee0 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:30.317726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4b917e88-11a5-4e95-98ee-94f51021dee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:30.339572 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1658/3338] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:30.344296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2e60f-5c20-430c-967a-9150735264aa None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:30.379978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2e60f-5c20-430c-967a-9150735264aa None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:30.424361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69cd14-d560-4cb8-9aa9-ebe98246cd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:30.425883 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69cd14-d560-4cb8-9aa9-ebe98246cd91 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:30.426964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69cd14-d560-4cb8-9aa9-ebe98246cd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:30.427391 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69cd14-d560-4cb8-9aa9-ebe98246cd91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:30.428333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c69cd14-d560-4cb8-9aa9-ebe98246cd91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:20:30.432564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c69cd14-d560-4cb8-9aa9-ebe98246cd91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:30.437603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c69cd14-d560-4cb8-9aa9-ebe98246cd91 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:30.497502 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1681/3339] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:20:30.497892 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b917e88-11a5-4e95-98ee-94f51021dee0 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:30.510434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b917e88-11a5-4e95-98ee-94f51021dee0 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:30.536402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49441ba3-a7e9-4c91-bbb0-cf5a3d949ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:30.537039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49441ba3-a7e9-4c91-bbb0-cf5a3d949ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:30.537316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49441ba3-a7e9-4c91-bbb0-cf5a3d949ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:30.537583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49441ba3-a7e9-4c91-bbb0-cf5a3d949ee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:30.538667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49441ba3-a7e9-4c91-bbb0-cf5a3d949ee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:30.540654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49441ba3-a7e9-4c91-bbb0-cf5a3d949ee7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:30.622353 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1659/3340] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:20:30 2022] POST /identity/v3/projects => generated 401 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:20:30.623855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69cd14-d560-4cb8-9aa9-ebe98246cd91 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:30.637152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69cd14-d560-4cb8-9aa9-ebe98246cd91 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:30.770324 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2015a53-fce7-4a65-987b-49819ade5327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:30.773667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2015a53-fce7-4a65-987b-49819ade5327 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:30.774325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2015a53-fce7-4a65-987b-49819ade5327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:30.774987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2015a53-fce7-4a65-987b-49819ade5327 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:30.775958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2015a53-fce7-4a65-987b-49819ade5327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:30.778658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2015a53-fce7-4a65-987b-49819ade5327 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:30.823657 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1682/3341] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:20:30 2022] POST /identity/v3/users => generated 301 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:20:30.826926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49441ba3-a7e9-4c91-bbb0-cf5a3d949ee7 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:30.858860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49441ba3-a7e9-4c91-bbb0-cf5a3d949ee7 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:30.875178 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df132754-5c40-457e-933b-8ec117d82559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:30.876169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df132754-5c40-457e-933b-8ec117d82559 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:30.876728 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df132754-5c40-457e-933b-8ec117d82559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:30.878395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df132754-5c40-457e-933b-8ec117d82559 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:30.879343 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df132754-5c40-457e-933b-8ec117d82559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:30.902059 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df132754-5c40-457e-933b-8ec117d82559 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:30.927872 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1660/3342] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:20:30.929193 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2015a53-fce7-4a65-987b-49819ade5327 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:30.953751 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2015a53-fce7-4a65-987b-49819ade5327 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:30.969164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f46ca2-76ce-4b7c-b85d-7b43a0a5399d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:30.969889 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f46ca2-76ce-4b7c-b85d-7b43a0a5399d admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:30.970297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f46ca2-76ce-4b7c-b85d-7b43a0a5399d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:30.970795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f46ca2-76ce-4b7c-b85d-7b43a0a5399d admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:30.972361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f46ca2-76ce-4b7c-b85d-7b43a0a5399d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:30.975458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f46ca2-76ce-4b7c-b85d-7b43a0a5399d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:31.010667 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1683/3343] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:20:31.014801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df132754-5c40-457e-933b-8ec117d82559 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:31.032207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df132754-5c40-457e-933b-8ec117d82559 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:31.054248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0b77a-97e1-4b80-a9e4-be9eb93af99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:31.055848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0b77a-97e1-4b80-a9e4-be9eb93af99e admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:31.056386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0b77a-97e1-4b80-a9e4-be9eb93af99e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:31.057076 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0b77a-97e1-4b80-a9e4-be9eb93af99e admin admin] PATH_INFO: `/v3/projects/14d3cce0761e4c789e40a9832e385f68/users/d0e4a371822146d28378559885345af1/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:31.110160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0b77a-97e1-4b80-a9e4-be9eb93af99e admin admin] RBAC: Authorizing `identity:create_grant(project_id=14d3cce0761e4c789e40a9832e385f68, user_id=d0e4a371822146d28378559885345af1, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:31.118164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0b77a-97e1-4b80-a9e4-be9eb93af99e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:31.153213 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1661/3344] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:20:31 2022] PUT /identity/v3/projects/14d3cce0761e4c789e40a9832e385f68/users/d0e4a371822146d28378559885345af1/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:31.164929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062d010-ec36-4f97-a488-100132bcaeff None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:31.166231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062d010-ec36-4f97-a488-100132bcaeff None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:31.166766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062d010-ec36-4f97-a488-100132bcaeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:31.242118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f062d010-ec36-4f97-a488-100132bcaeff None None] MFA Rules not processed for user `d0e4a371822146d28378559885345af1`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:31.244062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f062d010-ec36-4f97-a488-100132bcaeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:31.302104 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:31.416271 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1684/3345] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:31 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:31.416427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0b77a-97e1-4b80-a9e4-be9eb93af99e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:31.442086 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:31.620952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0b77a-97e1-4b80-a9e4-be9eb93af99e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:31.637639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf05efe-cc75-4fd3-aeb6-9c5dbed9c7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:31.638535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf05efe-cc75-4fd3-aeb6-9c5dbed9c7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:31.639914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf05efe-cc75-4fd3-aeb6-9c5dbed9c7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:31.640405 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf05efe-cc75-4fd3-aeb6-9c5dbed9c7b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:31.643195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf05efe-cc75-4fd3-aeb6-9c5dbed9c7b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:31.645806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf05efe-cc75-4fd3-aeb6-9c5dbed9c7b7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:31.773202 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1662/3346] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:20:31 2022] POST /identity/v3/projects => generated 401 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:20:31.774387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062d010-ec36-4f97-a488-100132bcaeff None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:31.794648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062d010-ec36-4f97-a488-100132bcaeff None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:32.057144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0fbae-9842-4104-8de9-c2a4b84fa782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:32.062736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0fbae-9842-4104-8de9-c2a4b84fa782 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:32.063030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0fbae-9842-4104-8de9-c2a4b84fa782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:32.063284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0fbae-9842-4104-8de9-c2a4b84fa782 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:32.068181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0fbae-9842-4104-8de9-c2a4b84fa782 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:32.073347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0fbae-9842-4104-8de9-c2a4b84fa782 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:32.196402 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1685/3347] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:20:31 2022] POST /identity/v3/users => generated 307 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:20:32.200931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf05efe-cc75-4fd3-aeb6-9c5dbed9c7b7 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:32.220729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf05efe-cc75-4fd3-aeb6-9c5dbed9c7b7 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:32.241341 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff4dd4-2521-431b-98e8-a81e0594e0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:32.241979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff4dd4-2521-431b-98e8-a81e0594e0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:32.242255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff4dd4-2521-431b-98e8-a81e0594e0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:32.242521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff4dd4-2521-431b-98e8-a81e0594e0f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:32.243299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff4dd4-2521-431b-98e8-a81e0594e0f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:32.260318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff4dd4-2521-431b-98e8-a81e0594e0f3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:32.302414 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1663/3348] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:20:32.306173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0fbae-9842-4104-8de9-c2a4b84fa782 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:32.319355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0fbae-9842-4104-8de9-c2a4b84fa782 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:32.344392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af7c7c-5263-49e2-9156-d4964b84bcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:32.345071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af7c7c-5263-49e2-9156-d4964b84bcca admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:32.345350 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af7c7c-5263-49e2-9156-d4964b84bcca admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:32.345621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af7c7c-5263-49e2-9156-d4964b84bcca admin admin] PATH_INFO: `/v3/projects/c4f155ad32504ee9b269413712089ea6/users/327117236c71482baaad9fdfcebed76a/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:32.401145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af7c7c-5263-49e2-9156-d4964b84bcca admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f155ad32504ee9b269413712089ea6, user_id=327117236c71482baaad9fdfcebed76a, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:32.403856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af7c7c-5263-49e2-9156-d4964b84bcca admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:32.443162 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1686/3349] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:20:32 2022] PUT /identity/v3/projects/c4f155ad32504ee9b269413712089ea6/users/327117236c71482baaad9fdfcebed76a/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:32.447129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff4dd4-2521-431b-98e8-a81e0594e0f3 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:32.465352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff4dd4-2521-431b-98e8-a81e0594e0f3 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:32.664617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e66bf9-205a-4b34-8185-fe095941b9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:32.665484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e66bf9-205a-4b34-8185-fe095941b9fb admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:32.666245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e66bf9-205a-4b34-8185-fe095941b9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:32.666632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e66bf9-205a-4b34-8185-fe095941b9fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:32.667422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e66bf9-205a-4b34-8185-fe095941b9fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:32.669476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e66bf9-205a-4b34-8185-fe095941b9fb admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:32.696997 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1664/3350] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:20:32.698233 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af7c7c-5263-49e2-9156-d4964b84bcca admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:32.734544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af7c7c-5263-49e2-9156-d4964b84bcca admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:32.739992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e3c6a-9870-4534-b7e5-021d72150056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:32.740821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e3c6a-9870-4534-b7e5-021d72150056 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:32.741363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e3c6a-9870-4534-b7e5-021d72150056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:32.741640 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e3c6a-9870-4534-b7e5-021d72150056 admin admin] PATH_INFO: `/v3/projects/c4f155ad32504ee9b269413712089ea6/users/327117236c71482baaad9fdfcebed76a/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:32.744363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e3c6a-9870-4534-b7e5-021d72150056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f155ad32504ee9b269413712089ea6, user_id=327117236c71482baaad9fdfcebed76a, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:32.747346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e3c6a-9870-4534-b7e5-021d72150056 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:32.779715 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1687/3351] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:20:32 2022] PUT /identity/v3/projects/c4f155ad32504ee9b269413712089ea6/users/327117236c71482baaad9fdfcebed76a/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:32.789801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde8b32-fb8e-4cff-b513-d8e5bf551092 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:32.790075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde8b32-fb8e-4cff-b513-d8e5bf551092 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:32.790474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde8b32-fb8e-4cff-b513-d8e5bf551092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:32.851561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-bdde8b32-fb8e-4cff-b513-d8e5bf551092 None None] MFA Rules not processed for user `327117236c71482baaad9fdfcebed76a`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:32.852977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bdde8b32-fb8e-4cff-b513-d8e5bf551092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:32.945576 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1665/3352] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:32 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:32.957970 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e3c6a-9870-4534-b7e5-021d72150056 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:32.960210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-220e3c6a-9870-4534-b7e5-021d72150056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:33.082485 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e3c6a-9870-4534-b7e5-021d72150056 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:33.091083 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71402943-e4c1-41d6-a4b5-8947a4b20341 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:33.092928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71402943-e4c1-41d6-a4b5-8947a4b20341 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:33.093270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71402943-e4c1-41d6-a4b5-8947a4b20341 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:33.094057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71402943-e4c1-41d6-a4b5-8947a4b20341 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:33.104343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71402943-e4c1-41d6-a4b5-8947a4b20341 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:33.106060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71402943-e4c1-41d6-a4b5-8947a4b20341 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:33.118024 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1688/3353] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:32 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:33.664738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde8b32-fb8e-4cff-b513-d8e5bf551092 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:33.667592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bdde8b32-fb8e-4cff-b513-d8e5bf551092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:33.715101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde8b32-fb8e-4cff-b513-d8e5bf551092 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:33.744535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9670377-80c1-40d1-849d-613d5a64ad89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:33.745379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9670377-80c1-40d1-849d-613d5a64ad89 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:33.745478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9670377-80c1-40d1-849d-613d5a64ad89 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:33.746442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9670377-80c1-40d1-849d-613d5a64ad89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:33.761679 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:33.903575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9670377-80c1-40d1-849d-613d5a64ad89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:33.905287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9670377-80c1-40d1-849d-613d5a64ad89 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:33.917430 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1666/3354] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:33 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:33.940416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71402943-e4c1-41d6-a4b5-8947a4b20341 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:33.955935 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:34.098385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71402943-e4c1-41d6-a4b5-8947a4b20341 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:34.111152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4aaa7-3989-4900-9ff1-38734e40b7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:34.112008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4aaa7-3989-4900-9ff1-38734e40b7bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:34.112392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4aaa7-3989-4900-9ff1-38734e40b7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:34.112763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4aaa7-3989-4900-9ff1-38734e40b7bd admin admin] PATH_INFO: `/v3/users/d0e4a371822146d28378559885345af1` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:34.114272 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4aaa7-3989-4900-9ff1-38734e40b7bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0e4a371822146d28378559885345af1)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:34.116634 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4aaa7-3989-4900-9ff1-38734e40b7bd admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:34.209090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-57c4aaa7-3989-4900-9ff1-38734e40b7bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0e4a371822146d28378559885345af1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:34.218575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-57c4aaa7-3989-4900-9ff1-38734e40b7bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0e4a371822146d28378559885345af1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:34.238950 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-57c4aaa7-3989-4900-9ff1-38734e40b7bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0e4a371822146d28378559885345af1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:34.239977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-57c4aaa7-3989-4900-9ff1-38734e40b7bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0e4a371822146d28378559885345af1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:34.253144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-57c4aaa7-3989-4900-9ff1-38734e40b7bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0e4a371822146d28378559885345af1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:34.288595 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1689/3355] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:20:33 2022] DELETE /identity/v3/users/d0e4a371822146d28378559885345af1 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:34.290001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e88e9d-1700-4528-89d2-447fe6330da6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:34.290295 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e88e9d-1700-4528-89d2-447fe6330da6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:34.290576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e88e9d-1700-4528-89d2-447fe6330da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:34.318469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-26e88e9d-1700-4528-89d2-447fe6330da6 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:34.319643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-26e88e9d-1700-4528-89d2-447fe6330da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:34.464498 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1667/3356] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:34.476867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4aaa7-3989-4900-9ff1-38734e40b7bd admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:34.479225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-57c4aaa7-3989-4900-9ff1-38734e40b7bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:34.567047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4aaa7-3989-4900-9ff1-38734e40b7bd admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:34.571270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db073d0-169b-4a5e-ba3a-e5c3c4e0f6c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:34.571950 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db073d0-169b-4a5e-ba3a-e5c3c4e0f6c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:34.572239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db073d0-169b-4a5e-ba3a-e5c3c4e0f6c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:34.572513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db073d0-169b-4a5e-ba3a-e5c3c4e0f6c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:34.584924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db073d0-169b-4a5e-ba3a-e5c3c4e0f6c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:34.586637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db073d0-169b-4a5e-ba3a-e5c3c4e0f6c2 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:34.637431 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1690/3357] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:35.056290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e88e9d-1700-4528-89d2-447fe6330da6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:35.058405 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-26e88e9d-1700-4528-89d2-447fe6330da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:35.072450 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e88e9d-1700-4528-89d2-447fe6330da6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:35.078993 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf5c03-76c1-4dc7-be81-37e8ea80be94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:35.079950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf5c03-76c1-4dc7-be81-37e8ea80be94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:35.080372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf5c03-76c1-4dc7-be81-37e8ea80be94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:35.080785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf5c03-76c1-4dc7-be81-37e8ea80be94 admin admin] PATH_INFO: `/v3/projects/14d3cce0761e4c789e40a9832e385f68` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:35.083867 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf5c03-76c1-4dc7-be81-37e8ea80be94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14d3cce0761e4c789e40a9832e385f68)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:35.087013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf5c03-76c1-4dc7-be81-37e8ea80be94 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:35.191868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-05bf5c03-76c1-4dc7-be81-37e8ea80be94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14d3cce0761e4c789e40a9832e385f68', 'request_id': 'req-05bf5c03-76c1-4dc7-be81-37e8ea80be94'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:35.200272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-05bf5c03-76c1-4dc7-be81-37e8ea80be94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14d3cce0761e4c789e40a9832e385f68', 'request_id': 'req-05bf5c03-76c1-4dc7-be81-37e8ea80be94'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:35.210541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-05bf5c03-76c1-4dc7-be81-37e8ea80be94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14d3cce0761e4c789e40a9832e385f68', 'request_id': 'req-05bf5c03-76c1-4dc7-be81-37e8ea80be94'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:35.227732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-05bf5c03-76c1-4dc7-be81-37e8ea80be94 admin admin] The token cache is being invalidate because project 14d3cce0761e4c789e40a9832e385f68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:20:35.228032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-05bf5c03-76c1-4dc7-be81-37e8ea80be94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:35.228740 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-05bf5c03-76c1-4dc7-be81-37e8ea80be94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:35.230841 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1668/3358] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:20:35 2022] DELETE /identity/v3/projects/14d3cce0761e4c789e40a9832e385f68 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:35.235099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db073d0-169b-4a5e-ba3a-e5c3c4e0f6c2 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:35.246855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db073d0-169b-4a5e-ba3a-e5c3c4e0f6c2 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:35.276630 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:35.316307 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a28c8d-6d06-4f26-8e35-51ea91b4a494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:35.317146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a28c8d-6d06-4f26-8e35-51ea91b4a494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:35.317491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a28c8d-6d06-4f26-8e35-51ea91b4a494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:35.317665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a28c8d-6d06-4f26-8e35-51ea91b4a494 admin admin] PATH_INFO: `/v3/users/327117236c71482baaad9fdfcebed76a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:35.318949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a28c8d-6d06-4f26-8e35-51ea91b4a494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=327117236c71482baaad9fdfcebed76a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:35.320962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a28c8d-6d06-4f26-8e35-51ea91b4a494 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:35.381651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d2a28c8d-6d06-4f26-8e35-51ea91b4a494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '327117236c71482baaad9fdfcebed76a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:35.389119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d2a28c8d-6d06-4f26-8e35-51ea91b4a494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '327117236c71482baaad9fdfcebed76a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:35.403522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d2a28c8d-6d06-4f26-8e35-51ea91b4a494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '327117236c71482baaad9fdfcebed76a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:35.404282 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d2a28c8d-6d06-4f26-8e35-51ea91b4a494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '327117236c71482baaad9fdfcebed76a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:35.413209 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d2a28c8d-6d06-4f26-8e35-51ea91b4a494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '327117236c71482baaad9fdfcebed76a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:35.431646 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1691/3359] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:20:35 2022] DELETE /identity/v3/users/327117236c71482baaad9fdfcebed76a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:36.187331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf5c03-76c1-4dc7-be81-37e8ea80be94 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:36.188915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-05bf5c03-76c1-4dc7-be81-37e8ea80be94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:36.213422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf5c03-76c1-4dc7-be81-37e8ea80be94 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:36.277875 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:36.356968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02442f1-2758-4d23-817e-5cfa14d43533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:36.357795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02442f1-2758-4d23-817e-5cfa14d43533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:36.358256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02442f1-2758-4d23-817e-5cfa14d43533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:36.358529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02442f1-2758-4d23-817e-5cfa14d43533 admin admin] PATH_INFO: `/v3/projects/c4f155ad32504ee9b269413712089ea6` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:36.365037 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02442f1-2758-4d23-817e-5cfa14d43533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4f155ad32504ee9b269413712089ea6)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:36.367027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02442f1-2758-4d23-817e-5cfa14d43533 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:36.483228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f02442f1-2758-4d23-817e-5cfa14d43533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4f155ad32504ee9b269413712089ea6', 'request_id': 'req-f02442f1-2758-4d23-817e-5cfa14d43533'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:36.497291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f02442f1-2758-4d23-817e-5cfa14d43533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4f155ad32504ee9b269413712089ea6', 'request_id': 'req-f02442f1-2758-4d23-817e-5cfa14d43533'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:36.512051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f02442f1-2758-4d23-817e-5cfa14d43533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4f155ad32504ee9b269413712089ea6', 'request_id': 'req-f02442f1-2758-4d23-817e-5cfa14d43533'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:36.535223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f02442f1-2758-4d23-817e-5cfa14d43533 admin admin] The token cache is being invalidate because project c4f155ad32504ee9b269413712089ea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:20:36.535519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f02442f1-2758-4d23-817e-5cfa14d43533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:36.536206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f02442f1-2758-4d23-817e-5cfa14d43533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:36.539932 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1669/3360] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:20:36 2022] DELETE /identity/v3/projects/c4f155ad32504ee9b269413712089ea6 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:36.544689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636c690-7382-4c56-a57e-bb55ef159f69 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:36.545593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636c690-7382-4c56-a57e-bb55ef159f69 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:36.546028 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636c690-7382-4c56-a57e-bb55ef159f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:36.587185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d636c690-7382-4c56-a57e-bb55ef159f69 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:36.588524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d636c690-7382-4c56-a57e-bb55ef159f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:36.695251 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1692/3361] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:36.703395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548f7d8-fb37-4613-883a-f7a49d455118 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:36.703925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548f7d8-fb37-4613-883a-f7a49d455118 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:36.704353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548f7d8-fb37-4613-883a-f7a49d455118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:36.735250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0548f7d8-fb37-4613-883a-f7a49d455118 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:36.736517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0548f7d8-fb37-4613-883a-f7a49d455118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:36.764679 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1670/3362] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:36.769397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636c690-7382-4c56-a57e-bb55ef159f69 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:36.792670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636c690-7382-4c56-a57e-bb55ef159f69 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:36.798218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e57c19-e70f-499d-944b-4001dc9ea49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:36.798997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e57c19-e70f-499d-944b-4001dc9ea49f admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:36.799274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e57c19-e70f-499d-944b-4001dc9ea49f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:36.799542 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e57c19-e70f-499d-944b-4001dc9ea49f admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:36.800320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e57c19-e70f-499d-944b-4001dc9ea49f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:20:36.800625 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e57c19-e70f-499d-944b-4001dc9ea49f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:36.802610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e57c19-e70f-499d-944b-4001dc9ea49f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:36.822324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548f7d8-fb37-4613-883a-f7a49d455118 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:36.835094 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1693/3363] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:20:36.836832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548f7d8-fb37-4613-883a-f7a49d455118 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:36.854887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07aeb5-96e6-4c5b-b299-b951b3583379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:36.855974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07aeb5-96e6-4c5b-b299-b951b3583379 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:36.856261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07aeb5-96e6-4c5b-b299-b951b3583379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:36.856532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07aeb5-96e6-4c5b-b299-b951b3583379 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:36.859154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc07aeb5-96e6-4c5b-b299-b951b3583379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:36.861612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc07aeb5-96e6-4c5b-b299-b951b3583379 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:36.969843 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1671/3364] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:20:36 2022] POST /identity/v3/projects => generated 395 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:20:36.973415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e57c19-e70f-499d-944b-4001dc9ea49f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:36.989637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e57c19-e70f-499d-944b-4001dc9ea49f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:37.111282 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:37.231340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f3a09-efa8-4abc-a571-26e3fcde89ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:37.232072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f3a09-efa8-4abc-a571-26e3fcde89ae admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:37.234798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f3a09-efa8-4abc-a571-26e3fcde89ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:37.234798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f3a09-efa8-4abc-a571-26e3fcde89ae admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:37.234798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f3a09-efa8-4abc-a571-26e3fcde89ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:37.238184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f3a09-efa8-4abc-a571-26e3fcde89ae admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:37.270809 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1694/3365] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:20:36 2022] POST /identity/v3/users => generated 298 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:20:37.275394 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07aeb5-96e6-4c5b-b299-b951b3583379 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:37.291448 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07aeb5-96e6-4c5b-b299-b951b3583379 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:37.314225 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ef10f-60a2-412a-99ec-b4b1d54d658c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:37.314870 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ef10f-60a2-412a-99ec-b4b1d54d658c admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:37.315151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ef10f-60a2-412a-99ec-b4b1d54d658c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:37.315427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ef10f-60a2-412a-99ec-b4b1d54d658c admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:37.316348 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ef10f-60a2-412a-99ec-b4b1d54d658c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:37.318216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ef10f-60a2-412a-99ec-b4b1d54d658c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:37.351228 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1672/3366] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:20:37.351834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f3a09-efa8-4abc-a571-26e3fcde89ae admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:37.367026 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f3a09-efa8-4abc-a571-26e3fcde89ae admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:37.374253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7567e4c-7bf3-4667-ae80-7838166f3a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:37.376129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7567e4c-7bf3-4667-ae80-7838166f3a5a admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:37.376669 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7567e4c-7bf3-4667-ae80-7838166f3a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:37.377129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7567e4c-7bf3-4667-ae80-7838166f3a5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:37.378121 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7567e4c-7bf3-4667-ae80-7838166f3a5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:37.380462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7567e4c-7bf3-4667-ae80-7838166f3a5a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:37.403622 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1695/3367] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:20:37.408148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ef10f-60a2-412a-99ec-b4b1d54d658c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:37.421364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ef10f-60a2-412a-99ec-b4b1d54d658c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:37.429059 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673cad1-acd4-4f41-95f9-d7286c15bb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:37.430068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673cad1-acd4-4f41-95f9-d7286c15bb9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:37.430670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673cad1-acd4-4f41-95f9-d7286c15bb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:37.431659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673cad1-acd4-4f41-95f9-d7286c15bb9d admin admin] PATH_INFO: `/v3/projects/afc8a87d755a42239e9d4572e4bf2f2d/users/5041cbc4adc24ae8871d60064720d680/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:37.453404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673cad1-acd4-4f41-95f9-d7286c15bb9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=afc8a87d755a42239e9d4572e4bf2f2d, user_id=5041cbc4adc24ae8871d60064720d680, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:37.457476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673cad1-acd4-4f41-95f9-d7286c15bb9d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:37.485850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a88d2-1957-4448-b82a-7f38006d9dcb None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:37.487387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a88d2-1957-4448-b82a-7f38006d9dcb None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:37.487921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a88d2-1957-4448-b82a-7f38006d9dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:37.492055 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1673/3368] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:20:37 2022] PUT /identity/v3/projects/afc8a87d755a42239e9d4572e4bf2f2d/users/5041cbc4adc24ae8871d60064720d680/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:20:37.532693 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-8b1a88d2-1957-4448-b82a-7f38006d9dcb None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:37.534426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8b1a88d2-1957-4448-b82a-7f38006d9dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:37.677347 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1696/3369] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:37.683764 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673cad1-acd4-4f41-95f9-d7286c15bb9d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:37.695774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7673cad1-acd4-4f41-95f9-d7286c15bb9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:37.906010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673cad1-acd4-4f41-95f9-d7286c15bb9d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:37.914927 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50961df0-a3fb-459f-8852-d19eb4f3a8d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:37.915728 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50961df0-a3fb-459f-8852-d19eb4f3a8d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:37.916176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50961df0-a3fb-459f-8852-d19eb4f3a8d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:37.916594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50961df0-a3fb-459f-8852-d19eb4f3a8d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:37.940139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50961df0-a3fb-459f-8852-d19eb4f3a8d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:37.941917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50961df0-a3fb-459f-8852-d19eb4f3a8d5 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:37.952561 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:37.966218 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1674/3370] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:38.393561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a88d2-1957-4448-b82a-7f38006d9dcb None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:38.396163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8b1a88d2-1957-4448-b82a-7f38006d9dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:38.412489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a88d2-1957-4448-b82a-7f38006d9dcb None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:38.423552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01305efe-fa95-489e-abd1-cc487b1bec98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:38.424599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01305efe-fa95-489e-abd1-cc487b1bec98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:38.425082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01305efe-fa95-489e-abd1-cc487b1bec98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:38.425551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01305efe-fa95-489e-abd1-cc487b1bec98 admin admin] PATH_INFO: `/v3/users/81d0e7a058704483bbad57ef73de92e6` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:38.427264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01305efe-fa95-489e-abd1-cc487b1bec98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81d0e7a058704483bbad57ef73de92e6)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:38.429834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01305efe-fa95-489e-abd1-cc487b1bec98 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:38.506010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-01305efe-fa95-489e-abd1-cc487b1bec98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81d0e7a058704483bbad57ef73de92e6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:38.516627 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-01305efe-fa95-489e-abd1-cc487b1bec98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81d0e7a058704483bbad57ef73de92e6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:38.533815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-01305efe-fa95-489e-abd1-cc487b1bec98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81d0e7a058704483bbad57ef73de92e6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:38.534823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-01305efe-fa95-489e-abd1-cc487b1bec98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81d0e7a058704483bbad57ef73de92e6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:38.545425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-01305efe-fa95-489e-abd1-cc487b1bec98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81d0e7a058704483bbad57ef73de92e6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:38.557921 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1697/3371] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:20:38 2022] DELETE /identity/v3/users/81d0e7a058704483bbad57ef73de92e6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:38.559114 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8abcb0-c2d3-4045-bace-77f96162f24c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:38.559584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8abcb0-c2d3-4045-bace-77f96162f24c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:38.559668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8abcb0-c2d3-4045-bace-77f96162f24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:38.585877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7f8abcb0-c2d3-4045-bace-77f96162f24c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:38.587224 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7f8abcb0-c2d3-4045-bace-77f96162f24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:38.693715 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1675/3372] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:38.776773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01305efe-fa95-489e-abd1-cc487b1bec98 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:38.779171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-01305efe-fa95-489e-abd1-cc487b1bec98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:38.816065 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:38.867399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01305efe-fa95-489e-abd1-cc487b1bec98 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:38.871494 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88337db-3f04-4de5-a506-6086300bae59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:38.872171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88337db-3f04-4de5-a506-6086300bae59 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:38.872453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88337db-3f04-4de5-a506-6086300bae59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:38.872855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88337db-3f04-4de5-a506-6086300bae59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:38.886748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88337db-3f04-4de5-a506-6086300bae59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:38.888866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88337db-3f04-4de5-a506-6086300bae59 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:38.903748 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1698/3373] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:39.263482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8abcb0-c2d3-4045-bace-77f96162f24c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:39.266053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7f8abcb0-c2d3-4045-bace-77f96162f24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:39.289662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8abcb0-c2d3-4045-bace-77f96162f24c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:39.312503 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744368a-c1af-40aa-bec1-fd0901442afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:39.313345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744368a-c1af-40aa-bec1-fd0901442afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:39.313864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744368a-c1af-40aa-bec1-fd0901442afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:39.314147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744368a-c1af-40aa-bec1-fd0901442afd admin admin] PATH_INFO: `/v3/projects/622262beb7574e388c20207cccd5073d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:39.318568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744368a-c1af-40aa-bec1-fd0901442afd admin admin] RBAC: Authorizing `identity:delete_project(project_id=622262beb7574e388c20207cccd5073d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:39.320593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744368a-c1af-40aa-bec1-fd0901442afd admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:39.456676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4744368a-c1af-40aa-bec1-fd0901442afd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '622262beb7574e388c20207cccd5073d', 'request_id': 'req-4744368a-c1af-40aa-bec1-fd0901442afd'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:39.474366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4744368a-c1af-40aa-bec1-fd0901442afd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '622262beb7574e388c20207cccd5073d', 'request_id': 'req-4744368a-c1af-40aa-bec1-fd0901442afd'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:39.482431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4744368a-c1af-40aa-bec1-fd0901442afd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '622262beb7574e388c20207cccd5073d', 'request_id': 'req-4744368a-c1af-40aa-bec1-fd0901442afd'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:39.503969 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4744368a-c1af-40aa-bec1-fd0901442afd admin admin] The token cache is being invalidate because project 622262beb7574e388c20207cccd5073d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:20:39.504526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4744368a-c1af-40aa-bec1-fd0901442afd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:39.505883 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4744368a-c1af-40aa-bec1-fd0901442afd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:39.509832 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1676/3374] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:20:39 2022] DELETE /identity/v3/projects/622262beb7574e388c20207cccd5073d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:39.515945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88337db-3f04-4de5-a506-6086300bae59 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:39.532248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88337db-3f04-4de5-a506-6086300bae59 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:39.641233 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc85543-ca54-45ce-874b-016e55eb827e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:39.642075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc85543-ca54-45ce-874b-016e55eb827e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:39.643045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc85543-ca54-45ce-874b-016e55eb827e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:39.643410 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc85543-ca54-45ce-874b-016e55eb827e admin admin] PATH_INFO: `/v3/users/0c97cf736912462ca8ebb8e3292b4881` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:39.645063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc85543-ca54-45ce-874b-016e55eb827e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c97cf736912462ca8ebb8e3292b4881)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:39.648556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc85543-ca54-45ce-874b-016e55eb827e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:39.724702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ecc85543-ca54-45ce-874b-016e55eb827e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c97cf736912462ca8ebb8e3292b4881'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:39.733954 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ecc85543-ca54-45ce-874b-016e55eb827e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c97cf736912462ca8ebb8e3292b4881'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:39.751164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ecc85543-ca54-45ce-874b-016e55eb827e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c97cf736912462ca8ebb8e3292b4881'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:39.752044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ecc85543-ca54-45ce-874b-016e55eb827e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c97cf736912462ca8ebb8e3292b4881'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:39.766096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ecc85543-ca54-45ce-874b-016e55eb827e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c97cf736912462ca8ebb8e3292b4881'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:39.781316 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1699/3375] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:20:39 2022] DELETE /identity/v3/users/0c97cf736912462ca8ebb8e3292b4881 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:40.321013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744368a-c1af-40aa-bec1-fd0901442afd admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:40.321013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4744368a-c1af-40aa-bec1-fd0901442afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:40.382663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744368a-c1af-40aa-bec1-fd0901442afd admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:40.561140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa4d82-e397-4a82-9d42-964a54ea748b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:40.562345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa4d82-e397-4a82-9d42-964a54ea748b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:40.562628 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa4d82-e397-4a82-9d42-964a54ea748b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:40.562900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa4d82-e397-4a82-9d42-964a54ea748b admin admin] PATH_INFO: `/v3/projects/585770175580432e87542c05b895ae62` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:40.564624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa4d82-e397-4a82-9d42-964a54ea748b admin admin] RBAC: Authorizing `identity:delete_project(project_id=585770175580432e87542c05b895ae62)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:40.566546 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa4d82-e397-4a82-9d42-964a54ea748b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:40.656836 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:40.681386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-89fa4d82-e397-4a82-9d42-964a54ea748b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '585770175580432e87542c05b895ae62', 'request_id': 'req-89fa4d82-e397-4a82-9d42-964a54ea748b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:40.693819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-89fa4d82-e397-4a82-9d42-964a54ea748b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '585770175580432e87542c05b895ae62', 'request_id': 'req-89fa4d82-e397-4a82-9d42-964a54ea748b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:40.712368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-89fa4d82-e397-4a82-9d42-964a54ea748b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '585770175580432e87542c05b895ae62', 'request_id': 'req-89fa4d82-e397-4a82-9d42-964a54ea748b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:40.769416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-89fa4d82-e397-4a82-9d42-964a54ea748b admin admin] The token cache is being invalidate because project 585770175580432e87542c05b895ae62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:20:40.769831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-89fa4d82-e397-4a82-9d42-964a54ea748b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:40.775610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-89fa4d82-e397-4a82-9d42-964a54ea748b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:20:40.785447 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1677/3376] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:20:40 2022] DELETE /identity/v3/projects/585770175580432e87542c05b895ae62 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:20:40.793213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda9843-167c-4460-bcf7-176e397284b1 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:40.793641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda9843-167c-4460-bcf7-176e397284b1 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:40.793908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda9843-167c-4460-bcf7-176e397284b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:40.836333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1dda9843-167c-4460-bcf7-176e397284b1 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:40.840110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1dda9843-167c-4460-bcf7-176e397284b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:40.973228 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:41.016508 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1700/3377] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:41.021194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa875b-75b9-496d-92b6-10f520a3e3d4 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:41.021613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa875b-75b9-496d-92b6-10f520a3e3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:41.021965 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa875b-75b9-496d-92b6-10f520a3e3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:41.053991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-4cfa875b-75b9-496d-92b6-10f520a3e3d4 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:41.055408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4cfa875b-75b9-496d-92b6-10f520a3e3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:41.073013 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1678/3378] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:41.074833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda9843-167c-4460-bcf7-176e397284b1 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:41.107947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda9843-167c-4460-bcf7-176e397284b1 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:41.126262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e4a53-6bcf-466a-8c95-eaf772f6f0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:41.126955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e4a53-6bcf-466a-8c95-eaf772f6f0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:41.127260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e4a53-6bcf-466a-8c95-eaf772f6f0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:41.127491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e4a53-6bcf-466a-8c95-eaf772f6f0c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:41.130778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e4a53-6bcf-466a-8c95-eaf772f6f0c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:20:41.131090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e4a53-6bcf-466a-8c95-eaf772f6f0c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:41.138071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e4a53-6bcf-466a-8c95-eaf772f6f0c3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:41.184409 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1701/3379] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:20:41.185216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa875b-75b9-496d-92b6-10f520a3e3d4 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:41.230529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa875b-75b9-496d-92b6-10f520a3e3d4 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:41.244738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77ed60-78df-42bc-a430-14abe913ec0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:41.247795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77ed60-78df-42bc-a430-14abe913ec0c admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:41.247795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77ed60-78df-42bc-a430-14abe913ec0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:41.250581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77ed60-78df-42bc-a430-14abe913ec0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:41.251442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77ed60-78df-42bc-a430-14abe913ec0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:41.256785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77ed60-78df-42bc-a430-14abe913ec0c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:41.349293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e4a53-6bcf-466a-8c95-eaf772f6f0c3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:41.349970 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1679/3380] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:20:41 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:20:41.366643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e4a53-6bcf-466a-8c95-eaf772f6f0c3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:41.611622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c964db-7a3e-4530-bf64-2c9d56f3dff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:41.612961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c964db-7a3e-4530-bf64-2c9d56f3dff0 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:41.613445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c964db-7a3e-4530-bf64-2c9d56f3dff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:41.613944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c964db-7a3e-4530-bf64-2c9d56f3dff0 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:41.621547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c964db-7a3e-4530-bf64-2c9d56f3dff0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:41.631518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c964db-7a3e-4530-bf64-2c9d56f3dff0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:41.687993 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1702/3381] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:20:41 2022] POST /identity/v3/users => generated 288 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:20:41.689656 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77ed60-78df-42bc-a430-14abe913ec0c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:41.713090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77ed60-78df-42bc-a430-14abe913ec0c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:41.725302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179c12f-0b5b-4987-bb2b-3a03cacbcd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:41.733243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179c12f-0b5b-4987-bb2b-3a03cacbcd88 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:41.735399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179c12f-0b5b-4987-bb2b-3a03cacbcd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:41.735711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179c12f-0b5b-4987-bb2b-3a03cacbcd88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:41.736468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179c12f-0b5b-4987-bb2b-3a03cacbcd88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:41.742525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179c12f-0b5b-4987-bb2b-3a03cacbcd88 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:41.780120 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1680/3382] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:20:41.781315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c964db-7a3e-4530-bf64-2c9d56f3dff0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:41.802690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c964db-7a3e-4530-bf64-2c9d56f3dff0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:41.822255 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93019f-464a-45f9-98c1-ead5e23640d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:41.829881 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93019f-464a-45f9-98c1-ead5e23640d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:41.830566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93019f-464a-45f9-98c1-ead5e23640d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:41.830566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93019f-464a-45f9-98c1-ead5e23640d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:41.831422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93019f-464a-45f9-98c1-ead5e23640d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:41.841207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93019f-464a-45f9-98c1-ead5e23640d9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:41.891785 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1703/3383] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:20:41.896299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179c12f-0b5b-4987-bb2b-3a03cacbcd88 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:41.912132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179c12f-0b5b-4987-bb2b-3a03cacbcd88 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:41.919845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb069ce5-42bf-49d4-9b72-2331f3bbd3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:41.920715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb069ce5-42bf-49d4-9b72-2331f3bbd3d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:41.921759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb069ce5-42bf-49d4-9b72-2331f3bbd3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:41.922108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb069ce5-42bf-49d4-9b72-2331f3bbd3d1 admin admin] PATH_INFO: `/v3/projects/68f08b38eb9d4956a26450e2fbbf0413/users/dd32243133b8451c9b9e8e3bd6a96080/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:41.925432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ba9ae-0941-442d-b4c3-450417b8aca0 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:41.925711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ba9ae-0941-442d-b4c3-450417b8aca0 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:41.926172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ba9ae-0941-442d-b4c3-450417b8aca0 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:41.927716 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1704/3384] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 01:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:20:41.936568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8bbac-7021-4941-977a-e346a705fd76 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:41.936876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8bbac-7021-4941-977a-e346a705fd76 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:41.937318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8bbac-7021-4941-977a-e346a705fd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:41.945502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb069ce5-42bf-49d4-9b72-2331f3bbd3d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f08b38eb9d4956a26450e2fbbf0413, user_id=dd32243133b8451c9b9e8e3bd6a96080, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:41.949620 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb069ce5-42bf-49d4-9b72-2331f3bbd3d1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:41.965752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6bf8bbac-7021-4941-977a-e346a705fd76 None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:41.967388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6bf8bbac-7021-4941-977a-e346a705fd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:41.977276 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1681/3385] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:20:41 2022] PUT /identity/v3/projects/68f08b38eb9d4956a26450e2fbbf0413/users/dd32243133b8451c9b9e8e3bd6a96080/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:20:41.983202 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ec9df-4242-4541-aa06-d070bcc8ce9a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:41.984240 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ec9df-4242-4541-aa06-d070bcc8ce9a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:41.984580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ec9df-4242-4541-aa06-d070bcc8ce9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:42.065054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d72ec9df-4242-4541-aa06-d070bcc8ce9a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:42.067635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d72ec9df-4242-4541-aa06-d070bcc8ce9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:42.113830 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1705/3386] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 01:20:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:20:42.161319 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8bbac-7021-4941-977a-e346a705fd76 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:42.167395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6bf8bbac-7021-4941-977a-e346a705fd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:42.190295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8bbac-7021-4941-977a-e346a705fd76 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:42.205245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b8d69-8532-4de0-9f84-3792373991e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:42.205955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b8d69-8532-4de0-9f84-3792373991e3 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:42.206237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b8d69-8532-4de0-9f84-3792373991e3 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:42.207327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b8d69-8532-4de0-9f84-3792373991e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:42.218270 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1682/3387] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:42.225185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b8d69-8532-4de0-9f84-3792373991e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:42.227052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b8d69-8532-4de0-9f84-3792373991e3 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:42.236189 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ec9df-4242-4541-aa06-d070bcc8ce9a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:42.237758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d72ec9df-4242-4541-aa06-d070bcc8ce9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:42.240912 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1706/3388] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:20:42.361364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ec9df-4242-4541-aa06-d070bcc8ce9a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:42.365492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4db3b9-8a69-49d3-9b05-6af2734bc9e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:42.366113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4db3b9-8a69-49d3-9b05-6af2734bc9e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:42.366535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4db3b9-8a69-49d3-9b05-6af2734bc9e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:42.366846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4db3b9-8a69-49d3-9b05-6af2734bc9e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:42.375131 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:42.385163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4db3b9-8a69-49d3-9b05-6af2734bc9e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:42.387303 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4db3b9-8a69-49d3-9b05-6af2734bc9e5 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:42.405112 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1683/3389] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:48.899805 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8129290-64f1-4d6b-9e82-cd7deca8382a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:48.900402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8129290-64f1-4d6b-9e82-cd7deca8382a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:48.901691 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8129290-64f1-4d6b-9e82-cd7deca8382a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:49.015137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a8129290-64f1-4d6b-9e82-cd7deca8382a None None] MFA Rules not processed for user `5041cbc4adc24ae8871d60064720d680`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:49.019845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a8129290-64f1-4d6b-9e82-cd7deca8382a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:49.083281 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:49.168939 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1707/3390] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:48 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:49.181347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d6e40-3a91-4f0a-8b83-bf3f230f7c46 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:49.181860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d6e40-3a91-4f0a-8b83-bf3f230f7c46 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:49.182170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d6e40-3a91-4f0a-8b83-bf3f230f7c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:49.242434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-cf2d6e40-3a91-4f0a-8b83-bf3f230f7c46 None None] MFA Rules not processed for user `5041cbc4adc24ae8871d60064720d680`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:49.243797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cf2d6e40-3a91-4f0a-8b83-bf3f230f7c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:49.278349 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1684/3391] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:49 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:49.756125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8129290-64f1-4d6b-9e82-cd7deca8382a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:49.758361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a8129290-64f1-4d6b-9e82-cd7deca8382a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:49.936606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8129290-64f1-4d6b-9e82-cd7deca8382a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:49.957693 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f0153-5f9c-4350-b21e-195356899f74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:49.958324 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f0153-5f9c-4350-b21e-195356899f74 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:49.963228 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f0153-5f9c-4350-b21e-195356899f74 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:49.966581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f0153-5f9c-4350-b21e-195356899f74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:50.009013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f0153-5f9c-4350-b21e-195356899f74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:50.021156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f0153-5f9c-4350-b21e-195356899f74 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:50.074521 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1708/3392] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:49 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:51.281333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005ffb5-72fd-46de-8f65-5e6c7536fab6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:51.281851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005ffb5-72fd-46de-8f65-5e6c7536fab6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:51.281851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005ffb5-72fd-46de-8f65-5e6c7536fab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:51.345978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6005ffb5-72fd-46de-8f65-5e6c7536fab6 None None] MFA Rules not processed for user `d4f7282c7251455086368d5274a4fac5`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:51.347219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6005ffb5-72fd-46de-8f65-5e6c7536fab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:51.512852 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1685/3393] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:56.213941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69830c7-5147-478f-ae4b-551c1af2e610 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:56.213941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69830c7-5147-478f-ae4b-551c1af2e610 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:56.214437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69830c7-5147-478f-ae4b-551c1af2e610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:56.274854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c69830c7-5147-478f-ae4b-551c1af2e610 None None] MFA Rules not processed for user `dd32243133b8451c9b9e8e3bd6a96080`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:56.277039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c69830c7-5147-478f-ae4b-551c1af2e610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:56.399130 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1709/3394] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:20:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:56.577650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005ffb5-72fd-46de-8f65-5e6c7536fab6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:56.606710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005ffb5-72fd-46de-8f65-5e6c7536fab6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:56.641100 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06398e-316f-4692-a93c-7f1a27b31f51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:56.642034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06398e-316f-4692-a93c-7f1a27b31f51 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:56.646488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06398e-316f-4692-a93c-7f1a27b31f51 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:56.647463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06398e-316f-4692-a93c-7f1a27b31f51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:56.679578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06398e-316f-4692-a93c-7f1a27b31f51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:56.682473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06398e-316f-4692-a93c-7f1a27b31f51 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:56.704020 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1686/3395] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:20:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:20:58.740386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fecc5-e1c8-4603-ab77-ee953449cbf8 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:58.740948 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fecc5-e1c8-4603-ab77-ee953449cbf8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:58.741269 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fecc5-e1c8-4603-ab77-ee953449cbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:58.874521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-cb1fecc5-e1c8-4603-ab77-ee953449cbf8 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:20:58.876692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-cb1fecc5-e1c8-4603-ab77-ee953449cbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:58.900542 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:20:59.050475 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1710/3396] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:20:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:20:59.127244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06398e-316f-4692-a93c-7f1a27b31f51 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:20:59.129704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ae06398e-316f-4692-a93c-7f1a27b31f51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:20:59.320625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06398e-316f-4692-a93c-7f1a27b31f51 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:20:59.330440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00e122-8043-46f5-a02f-ccdf0d048c55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:20:59.331511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00e122-8043-46f5-a02f-ccdf0d048c55 service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:20:59.332189 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00e122-8043-46f5-a02f-ccdf0d048c55 service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:20:59.333812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00e122-8043-46f5-a02f-ccdf0d048c55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:20:59.349406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00e122-8043-46f5-a02f-ccdf0d048c55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:20:59.352651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00e122-8043-46f5-a02f-ccdf0d048c55 service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:20:59.381871 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1687/3397] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:20:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:21:09.037218 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=22 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:09.365341 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=78 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:09.691868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fecc5-e1c8-4603-ab77-ee953449cbf8 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:09.697818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-cb1fecc5-e1c8-4603-ab77-ee953449cbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:09.725565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fecc5-e1c8-4603-ab77-ee953449cbf8 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:09.734155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ad3e8-1d20-4624-9409-61100ea085a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:09.735359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ad3e8-1d20-4624-9409-61100ea085a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:09.735761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ad3e8-1d20-4624-9409-61100ea085a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:09.736174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ad3e8-1d20-4624-9409-61100ea085a7 admin admin] PATH_INFO: `/v3/users/4a359309c39a49c98f1f7aea48189efa` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:09.741106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ad3e8-1d20-4624-9409-61100ea085a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a359309c39a49c98f1f7aea48189efa)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:09.745535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ad3e8-1d20-4624-9409-61100ea085a7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:09.835138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-297ad3e8-1d20-4624-9409-61100ea085a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a359309c39a49c98f1f7aea48189efa'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:09.852692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-297ad3e8-1d20-4624-9409-61100ea085a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a359309c39a49c98f1f7aea48189efa'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:09.875684 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-297ad3e8-1d20-4624-9409-61100ea085a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a359309c39a49c98f1f7aea48189efa'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:09.876898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-297ad3e8-1d20-4624-9409-61100ea085a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a359309c39a49c98f1f7aea48189efa'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:09.890061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-297ad3e8-1d20-4624-9409-61100ea085a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a359309c39a49c98f1f7aea48189efa'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:09.899642 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1711/3398] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:21:09 2022] DELETE /identity/v3/users/4a359309c39a49c98f1f7aea48189efa => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:21:10.374478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00e122-8043-46f5-a02f-ccdf0d048c55 service swift] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:10.388662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00e122-8043-46f5-a02f-ccdf0d048c55 service swift] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:10.554215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f5597-91c9-4f29-9213-dbbde98665de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:10.555230 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f5597-91c9-4f29-9213-dbbde98665de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:10.555526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f5597-91c9-4f29-9213-dbbde98665de admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:10.555801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f5597-91c9-4f29-9213-dbbde98665de admin admin] PATH_INFO: `/v3/projects/4b4cbb3c65be44668687983c0a76901c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:10.557644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f5597-91c9-4f29-9213-dbbde98665de admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b4cbb3c65be44668687983c0a76901c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:10.560059 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f5597-91c9-4f29-9213-dbbde98665de admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:10.628368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-501f5597-91c9-4f29-9213-dbbde98665de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b4cbb3c65be44668687983c0a76901c', 'request_id': 'req-501f5597-91c9-4f29-9213-dbbde98665de'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:10.635432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-501f5597-91c9-4f29-9213-dbbde98665de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b4cbb3c65be44668687983c0a76901c', 'request_id': 'req-501f5597-91c9-4f29-9213-dbbde98665de'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:10.644301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-501f5597-91c9-4f29-9213-dbbde98665de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b4cbb3c65be44668687983c0a76901c', 'request_id': 'req-501f5597-91c9-4f29-9213-dbbde98665de'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:10.659109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-501f5597-91c9-4f29-9213-dbbde98665de admin admin] The token cache is being invalidate because project 4b4cbb3c65be44668687983c0a76901c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:21:10.659687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-501f5597-91c9-4f29-9213-dbbde98665de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:10.660567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-501f5597-91c9-4f29-9213-dbbde98665de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:10.665634 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1688/3399] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:21:10 2022] DELETE /identity/v3/projects/4b4cbb3c65be44668687983c0a76901c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:21:10.667639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482cae6-bb6d-4052-84a4-94bd3dbfbd9a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:10.669417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482cae6-bb6d-4052-84a4-94bd3dbfbd9a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:10.670007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482cae6-bb6d-4052-84a4-94bd3dbfbd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:10.698859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b482cae6-bb6d-4052-84a4-94bd3dbfbd9a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:21:10.701538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b482cae6-bb6d-4052-84a4-94bd3dbfbd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:10.809911 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1712/3400] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:21:10.817636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60040bc-7894-4e8a-9f98-a35c563ecebc None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:10.817922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60040bc-7894-4e8a-9f98-a35c563ecebc None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:10.818208 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60040bc-7894-4e8a-9f98-a35c563ecebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:10.866509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c60040bc-7894-4e8a-9f98-a35c563ecebc None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:21:10.868527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c60040bc-7894-4e8a-9f98-a35c563ecebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:10.880038 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1689/3401] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:21:10.884583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482cae6-bb6d-4052-84a4-94bd3dbfbd9a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:10.900471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482cae6-bb6d-4052-84a4-94bd3dbfbd9a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:10.907150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a849a2-954b-4ac9-933a-be698a1842cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:10.908188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a849a2-954b-4ac9-933a-be698a1842cf admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:10.908620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a849a2-954b-4ac9-933a-be698a1842cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:10.909040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a849a2-954b-4ac9-933a-be698a1842cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:10.909852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a849a2-954b-4ac9-933a-be698a1842cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:21:10.910323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a849a2-954b-4ac9-933a-be698a1842cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:10.913276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a849a2-954b-4ac9-933a-be698a1842cf admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:10.933924 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1713/3402] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:21:10.941014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60040bc-7894-4e8a-9f98-a35c563ecebc None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:10.959619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60040bc-7894-4e8a-9f98-a35c563ecebc None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:10.973365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f35f86-ce27-403b-97ad-b15e19f69bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:10.974631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f35f86-ce27-403b-97ad-b15e19f69bfc admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:10.975155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f35f86-ce27-403b-97ad-b15e19f69bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:10.975812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f35f86-ce27-403b-97ad-b15e19f69bfc admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:10.977178 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f35f86-ce27-403b-97ad-b15e19f69bfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:10.979800 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f35f86-ce27-403b-97ad-b15e19f69bfc admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:11.032507 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1690/3403] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:21:10 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:21:11.035703 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a849a2-954b-4ac9-933a-be698a1842cf admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:11.053627 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a849a2-954b-4ac9-933a-be698a1842cf admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:11.153727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d9078-44bb-4277-bb7e-2e8ffe5b7890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:11.154243 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d9078-44bb-4277-bb7e-2e8ffe5b7890 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:11.154549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d9078-44bb-4277-bb7e-2e8ffe5b7890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:11.155346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d9078-44bb-4277-bb7e-2e8ffe5b7890 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:11.156045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d9078-44bb-4277-bb7e-2e8ffe5b7890 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:11.158058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d9078-44bb-4277-bb7e-2e8ffe5b7890 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:11.167281 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:11.195759 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1714/3404] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:21:11 2022] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:21:11.200310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f35f86-ce27-403b-97ad-b15e19f69bfc admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:11.234861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f35f86-ce27-403b-97ad-b15e19f69bfc admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:11.241788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021569c0-bfee-47d4-a2a5-f2febdfd2f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:11.242420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021569c0-bfee-47d4-a2a5-f2febdfd2f2d admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:11.242694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021569c0-bfee-47d4-a2a5-f2febdfd2f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:11.242958 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021569c0-bfee-47d4-a2a5-f2febdfd2f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:11.243619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021569c0-bfee-47d4-a2a5-f2febdfd2f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:11.245361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021569c0-bfee-47d4-a2a5-f2febdfd2f2d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:11.263258 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1691/3405] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:21:11.264676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d9078-44bb-4277-bb7e-2e8ffe5b7890 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:11.278364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d9078-44bb-4277-bb7e-2e8ffe5b7890 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:11.285104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c08088-5d87-4335-b11f-67b3bc3c68a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:11.285732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c08088-5d87-4335-b11f-67b3bc3c68a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:11.286033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c08088-5d87-4335-b11f-67b3bc3c68a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:11.286300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c08088-5d87-4335-b11f-67b3bc3c68a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:11.286954 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c08088-5d87-4335-b11f-67b3bc3c68a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:11.288676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c08088-5d87-4335-b11f-67b3bc3c68a0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:11.307555 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1715/3406] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:21:11.309414 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021569c0-bfee-47d4-a2a5-f2febdfd2f2d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:11.330449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021569c0-bfee-47d4-a2a5-f2febdfd2f2d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:11.336349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f84770-28c0-4d39-871e-10eb5cb75433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:11.337080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f84770-28c0-4d39-871e-10eb5cb75433 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:11.337404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f84770-28c0-4d39-871e-10eb5cb75433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:11.337680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f84770-28c0-4d39-871e-10eb5cb75433 admin admin] PATH_INFO: `/v3/projects/22296c942ac648039f202269c9d64749/users/093384280c5448f6af8915b37082e14b/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:11.362750 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f84770-28c0-4d39-871e-10eb5cb75433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22296c942ac648039f202269c9d64749, user_id=093384280c5448f6af8915b37082e14b, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:11.368062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f84770-28c0-4d39-871e-10eb5cb75433 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:11.412853 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1692/3407] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:21:11 2022] PUT /identity/v3/projects/22296c942ac648039f202269c9d64749/users/093384280c5448f6af8915b37082e14b/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:21:11.418060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c43589-b200-461f-9504-e8ac73f1013b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:11.418473 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c43589-b200-461f-9504-e8ac73f1013b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:11.418872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c43589-b200-461f-9504-e8ac73f1013b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:11.463377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d9c43589-b200-461f-9504-e8ac73f1013b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:21:11.465312 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d9c43589-b200-461f-9504-e8ac73f1013b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:11.560197 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1716/3408] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:21:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:21:11.576494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f84770-28c0-4d39-871e-10eb5cb75433 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:11.579456 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-60f84770-28c0-4d39-871e-10eb5cb75433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:11.627322 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:11.673795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f84770-28c0-4d39-871e-10eb5cb75433 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:11.679705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607136ec-67d8-478a-a0b7-88c400385131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:11.680450 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607136ec-67d8-478a-a0b7-88c400385131 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:11.680737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607136ec-67d8-478a-a0b7-88c400385131 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:11.681042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607136ec-67d8-478a-a0b7-88c400385131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:11.693968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607136ec-67d8-478a-a0b7-88c400385131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:11.695373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607136ec-67d8-478a-a0b7-88c400385131 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:11.707044 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1693/3409] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:21:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:21:18.938611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f605cbf-a1e2-41ca-b94c-4028da02bc6f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:18.939453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f605cbf-a1e2-41ca-b94c-4028da02bc6f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:18.940387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f605cbf-a1e2-41ca-b94c-4028da02bc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:19.017944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-8f605cbf-a1e2-41ca-b94c-4028da02bc6f None None] MFA Rules not processed for user `5041cbc4adc24ae8871d60064720d680`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:21:19.019227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8f605cbf-a1e2-41ca-b94c-4028da02bc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:19.206206 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1717/3410] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:21:18 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:21:19.919560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607136ec-67d8-478a-a0b7-88c400385131 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:19.921116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-607136ec-67d8-478a-a0b7-88c400385131 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:19.941926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607136ec-67d8-478a-a0b7-88c400385131 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:19.954810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f58d19-4de6-4030-84b4-c87ee034317b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:19.970182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f58d19-4de6-4030-84b4-c87ee034317b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:19.970829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f58d19-4de6-4030-84b4-c87ee034317b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:19.972381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f58d19-4de6-4030-84b4-c87ee034317b admin admin] PATH_INFO: `/v3/users/80f8680c2a39400c8fcfc221872fa299` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:19.987118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f58d19-4de6-4030-84b4-c87ee034317b admin admin] RBAC: Authorizing `identity:delete_user(user_id=80f8680c2a39400c8fcfc221872fa299)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:19.991149 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f58d19-4de6-4030-84b4-c87ee034317b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:20.082926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-23f58d19-4de6-4030-84b4-c87ee034317b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80f8680c2a39400c8fcfc221872fa299'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:20.095364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-23f58d19-4de6-4030-84b4-c87ee034317b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80f8680c2a39400c8fcfc221872fa299'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:20.124699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-23f58d19-4de6-4030-84b4-c87ee034317b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80f8680c2a39400c8fcfc221872fa299'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:20.129979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-23f58d19-4de6-4030-84b4-c87ee034317b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80f8680c2a39400c8fcfc221872fa299'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:20.159342 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-23f58d19-4de6-4030-84b4-c87ee034317b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80f8680c2a39400c8fcfc221872fa299'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:20.172421 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1694/3411] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:21:19 2022] DELETE /identity/v3/users/80f8680c2a39400c8fcfc221872fa299 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:21:20.988463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f605cbf-a1e2-41ca-b94c-4028da02bc6f None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:21.000399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f605cbf-a1e2-41ca-b94c-4028da02bc6f None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:21.104774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42022557-6efa-4016-baa7-4b1a5e389da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:21.105858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42022557-6efa-4016-baa7-4b1a5e389da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:21.106272 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42022557-6efa-4016-baa7-4b1a5e389da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:21.107003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42022557-6efa-4016-baa7-4b1a5e389da6 admin admin] PATH_INFO: `/v3/projects/5897e4c216e646aaa3a4c9ec2c7a1cfb` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:21.109416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42022557-6efa-4016-baa7-4b1a5e389da6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5897e4c216e646aaa3a4c9ec2c7a1cfb)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:21.111930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42022557-6efa-4016-baa7-4b1a5e389da6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:21.156219 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:INSERT=3,keystone:SELECT=96,keystone:DELETE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:21.181516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-42022557-6efa-4016-baa7-4b1a5e389da6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5897e4c216e646aaa3a4c9ec2c7a1cfb', 'request_id': 'req-42022557-6efa-4016-baa7-4b1a5e389da6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:21.189827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-42022557-6efa-4016-baa7-4b1a5e389da6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5897e4c216e646aaa3a4c9ec2c7a1cfb', 'request_id': 'req-42022557-6efa-4016-baa7-4b1a5e389da6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:21.210578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-42022557-6efa-4016-baa7-4b1a5e389da6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5897e4c216e646aaa3a4c9ec2c7a1cfb', 'request_id': 'req-42022557-6efa-4016-baa7-4b1a5e389da6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:21.236802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-42022557-6efa-4016-baa7-4b1a5e389da6 admin admin] The token cache is being invalidate because project 5897e4c216e646aaa3a4c9ec2c7a1cfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:21:21.237893 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-42022557-6efa-4016-baa7-4b1a5e389da6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:21.239331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-42022557-6efa-4016-baa7-4b1a5e389da6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:21.247160 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1718/3412] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:21:20 2022] DELETE /identity/v3/projects/5897e4c216e646aaa3a4c9ec2c7a1cfb => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:21:21.249146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804db0e-f1fc-4454-a3a1-bea6fd3b2919 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:21.250033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804db0e-f1fc-4454-a3a1-bea6fd3b2919 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:21.250544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804db0e-f1fc-4454-a3a1-bea6fd3b2919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:21.273935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-a804db0e-f1fc-4454-a3a1-bea6fd3b2919 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:21:21.275769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a804db0e-f1fc-4454-a3a1-bea6fd3b2919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:21.346191 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1695/3413] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:21:21.355395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cb5e6-5d38-4d86-8b08-14a39da34a56 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:21.355654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cb5e6-5d38-4d86-8b08-14a39da34a56 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:21.355862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cb5e6-5d38-4d86-8b08-14a39da34a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:21.382525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-433cb5e6-5d38-4d86-8b08-14a39da34a56 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:21:21.383762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-433cb5e6-5d38-4d86-8b08-14a39da34a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:21.398485 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1719/3414] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:21:21.399553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804db0e-f1fc-4454-a3a1-bea6fd3b2919 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:21.411264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804db0e-f1fc-4454-a3a1-bea6fd3b2919 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:21.417670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61582b46-c1ab-4568-ba1f-0d869eea25c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:21.418452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61582b46-c1ab-4568-ba1f-0d869eea25c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:21.418895 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61582b46-c1ab-4568-ba1f-0d869eea25c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:21.419175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61582b46-c1ab-4568-ba1f-0d869eea25c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:21.419874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61582b46-c1ab-4568-ba1f-0d869eea25c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:21:21.420777 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61582b46-c1ab-4568-ba1f-0d869eea25c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:21.423956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61582b46-c1ab-4568-ba1f-0d869eea25c9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:21.450397 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1696/3415] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:21:21.458120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cb5e6-5d38-4d86-8b08-14a39da34a56 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:21.501395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cb5e6-5d38-4d86-8b08-14a39da34a56 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:21.515818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be0932-1aeb-4051-95a4-c028c6cbd668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:21.519214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be0932-1aeb-4051-95a4-c028c6cbd668 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:21.519735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be0932-1aeb-4051-95a4-c028c6cbd668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:21.521028 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be0932-1aeb-4051-95a4-c028c6cbd668 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:21.521879 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be0932-1aeb-4051-95a4-c028c6cbd668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:21.529590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be0932-1aeb-4051-95a4-c028c6cbd668 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:21.568920 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1720/3416] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:21:21 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:21:21.572897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61582b46-c1ab-4568-ba1f-0d869eea25c9 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:21.587118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61582b46-c1ab-4568-ba1f-0d869eea25c9 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:21.628023 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:21.693340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff076aa-3079-4066-b19d-1cd3ab41cb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:21.694241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff076aa-3079-4066-b19d-1cd3ab41cb7b admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:21.695720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff076aa-3079-4066-b19d-1cd3ab41cb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:21.695995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff076aa-3079-4066-b19d-1cd3ab41cb7b admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:21.696768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff076aa-3079-4066-b19d-1cd3ab41cb7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:21.699785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff076aa-3079-4066-b19d-1cd3ab41cb7b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:21.750805 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1697/3417] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:21:21 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:21:21.754882 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be0932-1aeb-4051-95a4-c028c6cbd668 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:21.779457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be0932-1aeb-4051-95a4-c028c6cbd668 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:21.795847 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2579d0-fecc-45ea-8c86-8fb3cfa1d8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:21.796582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2579d0-fecc-45ea-8c86-8fb3cfa1d8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:21.796867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2579d0-fecc-45ea-8c86-8fb3cfa1d8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:21.797140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2579d0-fecc-45ea-8c86-8fb3cfa1d8f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:21.797807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2579d0-fecc-45ea-8c86-8fb3cfa1d8f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:21.801403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2579d0-fecc-45ea-8c86-8fb3cfa1d8f4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:21.832755 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1721/3418] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:21:21.837292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff076aa-3079-4066-b19d-1cd3ab41cb7b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:21.854729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff076aa-3079-4066-b19d-1cd3ab41cb7b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:21.884062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d29b23-7724-4b3b-a91b-8ff697f8eab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:21.884062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d29b23-7724-4b3b-a91b-8ff697f8eab3 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:21.884062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d29b23-7724-4b3b-a91b-8ff697f8eab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:21.884062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d29b23-7724-4b3b-a91b-8ff697f8eab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:21.884615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d29b23-7724-4b3b-a91b-8ff697f8eab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:21.896811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d29b23-7724-4b3b-a91b-8ff697f8eab3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:21.941989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2579d0-fecc-45ea-8c86-8fb3cfa1d8f4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:21.942885 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1698/3419] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:21:21.974378 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2579d0-fecc-45ea-8c86-8fb3cfa1d8f4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:21.996188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c03dcf-7b3b-45ab-b2c2-5352327df8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:21.996886 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c03dcf-7b3b-45ab-b2c2-5352327df8ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:21.997156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c03dcf-7b3b-45ab-b2c2-5352327df8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:21.997436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c03dcf-7b3b-45ab-b2c2-5352327df8ed admin admin] PATH_INFO: `/v3/projects/7e166fb219464337af5e274671580d80/users/d60a6557665a43cda4a64a83c92e2998/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:22.066038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c03dcf-7b3b-45ab-b2c2-5352327df8ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e166fb219464337af5e274671580d80, user_id=d60a6557665a43cda4a64a83c92e2998, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:22.068829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c03dcf-7b3b-45ab-b2c2-5352327df8ed admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:22.141935 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1722/3420] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:21:21 2022] PUT /identity/v3/projects/7e166fb219464337af5e274671580d80/users/d60a6557665a43cda4a64a83c92e2998/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:21:22.147408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169e37a-56ac-4d12-9fe0-4da2156e8d61 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:22.147934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169e37a-56ac-4d12-9fe0-4da2156e8d61 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:22.148573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169e37a-56ac-4d12-9fe0-4da2156e8d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:22.219510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c169e37a-56ac-4d12-9fe0-4da2156e8d61 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:21:22.228871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c169e37a-56ac-4d12-9fe0-4da2156e8d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:22.525721 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1699/3421] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:21:22.640344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c03dcf-7b3b-45ab-b2c2-5352327df8ed admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:22.642284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-45c03dcf-7b3b-45ab-b2c2-5352327df8ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:22.839215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c03dcf-7b3b-45ab-b2c2-5352327df8ed admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:22.845446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2605ca4-2414-40d9-b9e7-90174332a82f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:22.846074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2605ca4-2414-40d9-b9e7-90174332a82f service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:22.846349 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2605ca4-2414-40d9-b9e7-90174332a82f service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:22.846620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2605ca4-2414-40d9-b9e7-90174332a82f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:22.857027 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2605ca4-2414-40d9-b9e7-90174332a82f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:22.859221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2605ca4-2414-40d9-b9e7-90174332a82f service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:22.871427 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1723/3422] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:21:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:21:23.808764 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169e37a-56ac-4d12-9fe0-4da2156e8d61 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:23.810312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c169e37a-56ac-4d12-9fe0-4da2156e8d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:23.843650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169e37a-56ac-4d12-9fe0-4da2156e8d61 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:23.865790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49984d0-c7d6-4380-a615-64e4b7cdf9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:23.870459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49984d0-c7d6-4380-a615-64e4b7cdf9f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:23.870752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49984d0-c7d6-4380-a615-64e4b7cdf9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:23.871056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49984d0-c7d6-4380-a615-64e4b7cdf9f4 admin admin] PATH_INFO: `/v3/users/dd32243133b8451c9b9e8e3bd6a96080` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:23.877184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49984d0-c7d6-4380-a615-64e4b7cdf9f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd32243133b8451c9b9e8e3bd6a96080)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:23.890007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49984d0-c7d6-4380-a615-64e4b7cdf9f4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:24.065370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f49984d0-c7d6-4380-a615-64e4b7cdf9f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd32243133b8451c9b9e8e3bd6a96080'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:24.088225 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f49984d0-c7d6-4380-a615-64e4b7cdf9f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd32243133b8451c9b9e8e3bd6a96080'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:24.121062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f49984d0-c7d6-4380-a615-64e4b7cdf9f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd32243133b8451c9b9e8e3bd6a96080'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:24.121848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f49984d0-c7d6-4380-a615-64e4b7cdf9f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd32243133b8451c9b9e8e3bd6a96080'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:24.135256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f49984d0-c7d6-4380-a615-64e4b7cdf9f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd32243133b8451c9b9e8e3bd6a96080'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:24.145290 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1700/3423] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:21:23 2022] DELETE /identity/v3/users/dd32243133b8451c9b9e8e3bd6a96080 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:21:25.437074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2605ca4-2414-40d9-b9e7-90174332a82f service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:25.461664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2605ca4-2414-40d9-b9e7-90174332a82f service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:25.609971 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:25.637039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784f8df-22b1-447c-a1af-a262ce0cbca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:25.637702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784f8df-22b1-447c-a1af-a262ce0cbca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:25.637973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784f8df-22b1-447c-a1af-a262ce0cbca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:25.638407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784f8df-22b1-447c-a1af-a262ce0cbca9 admin admin] PATH_INFO: `/v3/projects/68f08b38eb9d4956a26450e2fbbf0413` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:25.641921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784f8df-22b1-447c-a1af-a262ce0cbca9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68f08b38eb9d4956a26450e2fbbf0413)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:25.648886 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784f8df-22b1-447c-a1af-a262ce0cbca9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:25.848233 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c784f8df-22b1-447c-a1af-a262ce0cbca9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68f08b38eb9d4956a26450e2fbbf0413', 'request_id': 'req-c784f8df-22b1-447c-a1af-a262ce0cbca9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:25.903253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c784f8df-22b1-447c-a1af-a262ce0cbca9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68f08b38eb9d4956a26450e2fbbf0413', 'request_id': 'req-c784f8df-22b1-447c-a1af-a262ce0cbca9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:25.951491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c784f8df-22b1-447c-a1af-a262ce0cbca9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68f08b38eb9d4956a26450e2fbbf0413', 'request_id': 'req-c784f8df-22b1-447c-a1af-a262ce0cbca9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:25.995611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c784f8df-22b1-447c-a1af-a262ce0cbca9 admin admin] The token cache is being invalidate because project 68f08b38eb9d4956a26450e2fbbf0413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:21:25.997279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c784f8df-22b1-447c-a1af-a262ce0cbca9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:25.998090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c784f8df-22b1-447c-a1af-a262ce0cbca9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:26.000896 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1724/3424] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:21:25 2022] DELETE /identity/v3/projects/68f08b38eb9d4956a26450e2fbbf0413 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:21:26.005568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d730833-e2b3-45a0-a3ee-ba22b50ba7b3 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:26.006423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d730833-e2b3-45a0-a3ee-ba22b50ba7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:26.006902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d730833-e2b3-45a0-a3ee-ba22b50ba7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:26.048003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7d730833-e2b3-45a0-a3ee-ba22b50ba7b3 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:21:26.050710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7d730833-e2b3-45a0-a3ee-ba22b50ba7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:26.097256 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:26.219093 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1701/3425] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:21:26.227652 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257386ef-a876-4f64-b2cd-0ca0294b3778 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:26.228303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257386ef-a876-4f64-b2cd-0ca0294b3778 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:26.228733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257386ef-a876-4f64-b2cd-0ca0294b3778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:26.286837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-257386ef-a876-4f64-b2cd-0ca0294b3778 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:21:26.288305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-257386ef-a876-4f64-b2cd-0ca0294b3778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:26.325670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d730833-e2b3-45a0-a3ee-ba22b50ba7b3 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:26.326515 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1725/3426] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:21:26.344163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d730833-e2b3-45a0-a3ee-ba22b50ba7b3 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:26.352599 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31243a-40cd-46f9-8f71-57c0d82c319a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:26.358404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31243a-40cd-46f9-8f71-57c0d82c319a admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:26.359001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31243a-40cd-46f9-8f71-57c0d82c319a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:26.359429 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31243a-40cd-46f9-8f71-57c0d82c319a admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:26.360308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31243a-40cd-46f9-8f71-57c0d82c319a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:21:26.360780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31243a-40cd-46f9-8f71-57c0d82c319a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:26.362581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31243a-40cd-46f9-8f71-57c0d82c319a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:26.396474 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1702/3427] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:21:26.398442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257386ef-a876-4f64-b2cd-0ca0294b3778 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:26.440787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257386ef-a876-4f64-b2cd-0ca0294b3778 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:26.447142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9a0ef-cfef-48bc-ab1b-f7b90e1cb680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:26.448043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9a0ef-cfef-48bc-ab1b-f7b90e1cb680 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:26.448496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9a0ef-cfef-48bc-ab1b-f7b90e1cb680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:26.448918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9a0ef-cfef-48bc-ab1b-f7b90e1cb680 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:26.449888 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc9a0ef-cfef-48bc-ab1b-f7b90e1cb680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:26.452556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc9a0ef-cfef-48bc-ab1b-f7b90e1cb680 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:26.556246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31243a-40cd-46f9-8f71-57c0d82c319a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:26.572651 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1726/3428] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:21:26 2022] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:21:26.586460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31243a-40cd-46f9-8f71-57c0d82c319a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:26.721604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f49b8-303f-4b1d-bbcd-89130d96df41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:26.722329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f49b8-303f-4b1d-bbcd-89130d96df41 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:26.723526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f49b8-303f-4b1d-bbcd-89130d96df41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:26.723816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f49b8-303f-4b1d-bbcd-89130d96df41 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:26.724692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f49b8-303f-4b1d-bbcd-89130d96df41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:26.726696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f49b8-303f-4b1d-bbcd-89130d96df41 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:26.764655 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1703/3429] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:21:26 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:21:26.767917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9a0ef-cfef-48bc-ab1b-f7b90e1cb680 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:26.783598 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9a0ef-cfef-48bc-ab1b-f7b90e1cb680 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:26.798186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212d8cf-1e81-4ce6-a803-7593a9f19afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:26.798969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212d8cf-1e81-4ce6-a803-7593a9f19afa admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:26.799244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212d8cf-1e81-4ce6-a803-7593a9f19afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:26.799518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212d8cf-1e81-4ce6-a803-7593a9f19afa admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:26.800221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212d8cf-1e81-4ce6-a803-7593a9f19afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:26.804517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212d8cf-1e81-4ce6-a803-7593a9f19afa admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:26.833879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f49b8-303f-4b1d-bbcd-89130d96df41 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:26.834459 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1727/3430] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:21:26.849504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f49b8-303f-4b1d-bbcd-89130d96df41 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:26.862145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06456d92-bdde-4301-bb92-4da87d5b9df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:26.862952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06456d92-bdde-4301-bb92-4da87d5b9df1 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:26.863270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06456d92-bdde-4301-bb92-4da87d5b9df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:26.863673 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06456d92-bdde-4301-bb92-4da87d5b9df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:26.864490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06456d92-bdde-4301-bb92-4da87d5b9df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:26.867584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06456d92-bdde-4301-bb92-4da87d5b9df1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:26.904761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212d8cf-1e81-4ce6-a803-7593a9f19afa admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:26.920899 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1704/3431] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:21:26.922235 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212d8cf-1e81-4ce6-a803-7593a9f19afa admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:26.927834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb6e47-9377-4a07-a9cc-0664197fa7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:26.929233 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb6e47-9377-4a07-a9cc-0664197fa7fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:26.929702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb6e47-9377-4a07-a9cc-0664197fa7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:26.933983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb6e47-9377-4a07-a9cc-0664197fa7fe admin admin] PATH_INFO: `/v3/projects/b1211639a253415b8f764c77aeabb276/users/69bdc46e9aa540d4ad74e47f57543306/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:26.973012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb6e47-9377-4a07-a9cc-0664197fa7fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1211639a253415b8f764c77aeabb276, user_id=69bdc46e9aa540d4ad74e47f57543306, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:26.980535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb6e47-9377-4a07-a9cc-0664197fa7fe admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:27.012437 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1728/3432] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:21:26 2022] PUT /identity/v3/projects/b1211639a253415b8f764c77aeabb276/users/69bdc46e9aa540d4ad74e47f57543306/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:21:27.015557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff44af-0652-4149-85b9-cfbdcbfa5558 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:27.016502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff44af-0652-4149-85b9-cfbdcbfa5558 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:27.016976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff44af-0652-4149-85b9-cfbdcbfa5558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:27.085884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6dff44af-0652-4149-85b9-cfbdcbfa5558 None None] MFA Rules not processed for user `69bdc46e9aa540d4ad74e47f57543306`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:21:27.089674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6dff44af-0652-4149-85b9-cfbdcbfa5558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:27.250646 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1705/3433] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:21:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:21:27.267456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb6e47-9377-4a07-a9cc-0664197fa7fe admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:27.268695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7dfb6e47-9377-4a07-a9cc-0664197fa7fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:27.485017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb6e47-9377-4a07-a9cc-0664197fa7fe admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:27.494453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c9b44-46dd-4653-94ba-bd5b50fda539 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:27.495342 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c9b44-46dd-4653-94ba-bd5b50fda539 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:27.495772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c9b44-46dd-4653-94ba-bd5b50fda539 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:27.497275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c9b44-46dd-4653-94ba-bd5b50fda539 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:27.536475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58b043-149f-438a-9c80-ac7848a6a6b3 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:27.536811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58b043-149f-438a-9c80-ac7848a6a6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:27.537121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58b043-149f-438a-9c80-ac7848a6a6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:27.559509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c9b44-46dd-4653-94ba-bd5b50fda539 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:27.562051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c9b44-46dd-4653-94ba-bd5b50fda539 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:27.590045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7f58b043-149f-438a-9c80-ac7848a6a6b3 None None] MFA Rules not processed for user `d4f7282c7251455086368d5274a4fac5`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:21:27.591364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7f58b043-149f-438a-9c80-ac7848a6a6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:27.593865 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1729/3434] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:21:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:21:27.610753 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:27.715143 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1706/3435] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:21:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:21:29.189783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c9b44-46dd-4653-94ba-bd5b50fda539 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:29.196792 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:29.277210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c9b44-46dd-4653-94ba-bd5b50fda539 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:29.284700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88393d01-e585-42e7-a943-869ad1d12ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:29.285355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88393d01-e585-42e7-a943-869ad1d12ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:29.285636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88393d01-e585-42e7-a943-869ad1d12ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:29.286009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88393d01-e585-42e7-a943-869ad1d12ffb admin admin] PATH_INFO: `/v3/users/69bdc46e9aa540d4ad74e47f57543306` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:29.287136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88393d01-e585-42e7-a943-869ad1d12ffb admin admin] RBAC: Authorizing `identity:delete_user(user_id=69bdc46e9aa540d4ad74e47f57543306)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:29.290224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88393d01-e585-42e7-a943-869ad1d12ffb admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:29.362558 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-88393d01-e585-42e7-a943-869ad1d12ffb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69bdc46e9aa540d4ad74e47f57543306'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:29.379796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-88393d01-e585-42e7-a943-869ad1d12ffb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69bdc46e9aa540d4ad74e47f57543306'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:29.422392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-88393d01-e585-42e7-a943-869ad1d12ffb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69bdc46e9aa540d4ad74e47f57543306'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:29.423315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-88393d01-e585-42e7-a943-869ad1d12ffb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69bdc46e9aa540d4ad74e47f57543306'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:29.436214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-88393d01-e585-42e7-a943-869ad1d12ffb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69bdc46e9aa540d4ad74e47f57543306'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:29.447119 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1730/3436] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:21:29 2022] DELETE /identity/v3/users/69bdc46e9aa540d4ad74e47f57543306 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:21:29.451842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887900f-b4da-43ff-bd5c-af447a23b60a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:29.452748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887900f-b4da-43ff-bd5c-af447a23b60a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:29.453233 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887900f-b4da-43ff-bd5c-af447a23b60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:29.481680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9887900f-b4da-43ff-bd5c-af447a23b60a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:21:29.483763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9887900f-b4da-43ff-bd5c-af447a23b60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:29.582518 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1707/3437] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:21:29.599096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88393d01-e585-42e7-a943-869ad1d12ffb admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:29.600818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-88393d01-e585-42e7-a943-869ad1d12ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:29.710426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88393d01-e585-42e7-a943-869ad1d12ffb admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:29.717201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2ca89-a5da-4769-a8bb-006552159419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:29.718051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2ca89-a5da-4769-a8bb-006552159419 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:29.718425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2ca89-a5da-4769-a8bb-006552159419 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:29.718778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2ca89-a5da-4769-a8bb-006552159419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:29.731024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2ca89-a5da-4769-a8bb-006552159419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:29.732933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2ca89-a5da-4769-a8bb-006552159419 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:29.749029 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1731/3438] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:21:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:21:32.136808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03267c81-eeaa-4d9c-8235-b0f0d006b0a0 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:32.137430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03267c81-eeaa-4d9c-8235-b0f0d006b0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:32.137430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03267c81-eeaa-4d9c-8235-b0f0d006b0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:32.227557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-03267c81-eeaa-4d9c-8235-b0f0d006b0a0 None None] MFA Rules not processed for user `093384280c5448f6af8915b37082e14b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:21:32.229108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-03267c81-eeaa-4d9c-8235-b0f0d006b0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:32.395632 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1708/3439] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:21:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:21:32.407758 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c90840-7665-4687-96fe-ac0d5776d879 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:32.408366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c90840-7665-4687-96fe-ac0d5776d879 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:32.408487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c90840-7665-4687-96fe-ac0d5776d879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:32.451971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c3c90840-7665-4687-96fe-ac0d5776d879 None None] MFA Rules not processed for user `093384280c5448f6af8915b37082e14b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:21:32.454862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c3c90840-7665-4687-96fe-ac0d5776d879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:32.470692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03267c81-eeaa-4d9c-8235-b0f0d006b0a0 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:32.473269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-03267c81-eeaa-4d9c-8235-b0f0d006b0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:32.495467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03267c81-eeaa-4d9c-8235-b0f0d006b0a0 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:32.502144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e13d33-0548-4698-a851-95ad78e6e8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:32.503129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e13d33-0548-4698-a851-95ad78e6e8b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:32.503682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e13d33-0548-4698-a851-95ad78e6e8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:32.504237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e13d33-0548-4698-a851-95ad78e6e8b3 admin admin] PATH_INFO: `/v3/projects/b1211639a253415b8f764c77aeabb276` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:32.505845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e13d33-0548-4698-a851-95ad78e6e8b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1211639a253415b8f764c77aeabb276)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:32.508119 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1732/3440] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:21:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:21:32.508875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e13d33-0548-4698-a851-95ad78e6e8b3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:32.519721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c90840-7665-4687-96fe-ac0d5776d879 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:32.521212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c3c90840-7665-4687-96fe-ac0d5776d879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:32.578292 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:32.660877 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:32.668923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f2e13d33-0548-4698-a851-95ad78e6e8b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1211639a253415b8f764c77aeabb276', 'request_id': 'req-f2e13d33-0548-4698-a851-95ad78e6e8b3'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:32.685631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f2e13d33-0548-4698-a851-95ad78e6e8b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1211639a253415b8f764c77aeabb276', 'request_id': 'req-f2e13d33-0548-4698-a851-95ad78e6e8b3'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:32.704955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f2e13d33-0548-4698-a851-95ad78e6e8b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1211639a253415b8f764c77aeabb276', 'request_id': 'req-f2e13d33-0548-4698-a851-95ad78e6e8b3'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:32.731848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f2e13d33-0548-4698-a851-95ad78e6e8b3 admin admin] The token cache is being invalidate because project b1211639a253415b8f764c77aeabb276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:21:32.733223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f2e13d33-0548-4698-a851-95ad78e6e8b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:32.735793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f2e13d33-0548-4698-a851-95ad78e6e8b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:32.746329 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1709/3441] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:21:32 2022] DELETE /identity/v3/projects/b1211639a253415b8f764c77aeabb276 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:21:32.749992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa1fcd-a404-4d6f-9d08-6381a6c4210b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:32.750514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa1fcd-a404-4d6f-9d08-6381a6c4210b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:32.752522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa1fcd-a404-4d6f-9d08-6381a6c4210b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:32.758084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c90840-7665-4687-96fe-ac0d5776d879 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:32.808792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-99aa1fcd-a404-4d6f-9d08-6381a6c4210b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:21:32.815171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-99aa1fcd-a404-4d6f-9d08-6381a6c4210b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:32.924829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24f679-6881-4862-a8aa-994d89b46c00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:32.925539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24f679-6881-4862-a8aa-994d89b46c00 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:32.925882 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24f679-6881-4862-a8aa-994d89b46c00 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:32.926214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24f679-6881-4862-a8aa-994d89b46c00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:32.932665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5b24f679-6881-4862-a8aa-994d89b46c00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:33.020786 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1710/3442] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:21:33.034454 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7e9c9-1087-4bee-a74d-f7f34c08770f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:33.035159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7e9c9-1087-4bee-a74d-f7f34c08770f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:33.035637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7e9c9-1087-4bee-a74d-f7f34c08770f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:33.071169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e5f7e9c9-1087-4bee-a74d-f7f34c08770f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:21:33.075275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e5f7e9c9-1087-4bee-a74d-f7f34c08770f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:33.096131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24f679-6881-4862-a8aa-994d89b46c00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:33.098868 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1711/3443] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:21:33.099871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24f679-6881-4862-a8aa-994d89b46c00 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:33.105871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7e9c9-1087-4bee-a74d-f7f34c08770f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:33.129931 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1733/3444] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:21:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:21:33.131512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7e9c9-1087-4bee-a74d-f7f34c08770f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:33.146799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95d5b7-8b5d-4f12-b3b4-326865d75210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:33.147699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95d5b7-8b5d-4f12-b3b4-326865d75210 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:33.147971 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95d5b7-8b5d-4f12-b3b4-326865d75210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:33.148422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95d5b7-8b5d-4f12-b3b4-326865d75210 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:33.149107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95d5b7-8b5d-4f12-b3b4-326865d75210 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:21:33.149466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95d5b7-8b5d-4f12-b3b4-326865d75210 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:33.154023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95d5b7-8b5d-4f12-b3b4-326865d75210 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:33.186354 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1712/3445] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:21:33.190472 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24f679-6881-4862-a8aa-994d89b46c00 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:33.209078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24f679-6881-4862-a8aa-994d89b46c00 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:33.221258 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec1aa9-03ce-457f-b8f9-ef9f2ddbc593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:33.222132 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec1aa9-03ce-457f-b8f9-ef9f2ddbc593 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:33.222626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec1aa9-03ce-457f-b8f9-ef9f2ddbc593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:33.223309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec1aa9-03ce-457f-b8f9-ef9f2ddbc593 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:33.224316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec1aa9-03ce-457f-b8f9-ef9f2ddbc593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:33.229143 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec1aa9-03ce-457f-b8f9-ef9f2ddbc593 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:33.314412 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1734/3446] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:21:33 2022] POST /identity/v3/projects => generated 381 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:21:33.317834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95d5b7-8b5d-4f12-b3b4-326865d75210 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:33.332096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95d5b7-8b5d-4f12-b3b4-326865d75210 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:33.442207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03426ddf-6aba-4813-a6b6-ac0f49a7cf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:33.443493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03426ddf-6aba-4813-a6b6-ac0f49a7cf2f admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:33.444136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03426ddf-6aba-4813-a6b6-ac0f49a7cf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:33.444420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03426ddf-6aba-4813-a6b6-ac0f49a7cf2f admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:33.445081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03426ddf-6aba-4813-a6b6-ac0f49a7cf2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:33.454014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03426ddf-6aba-4813-a6b6-ac0f49a7cf2f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:33.530885 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1713/3447] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:21:33 2022] POST /identity/v3/users => generated 291 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:21:33.535183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec1aa9-03ce-457f-b8f9-ef9f2ddbc593 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:33.558329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec1aa9-03ce-457f-b8f9-ef9f2ddbc593 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:33.578098 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc737b-fad9-48b0-a2b5-cd768d17834a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:33.579422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc737b-fad9-48b0-a2b5-cd768d17834a admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:33.581980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc737b-fad9-48b0-a2b5-cd768d17834a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:33.582454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc737b-fad9-48b0-a2b5-cd768d17834a admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:33.585067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc737b-fad9-48b0-a2b5-cd768d17834a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:33.588895 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc737b-fad9-48b0-a2b5-cd768d17834a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:33.620674 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1735/3448] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:21:33.624825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03426ddf-6aba-4813-a6b6-ac0f49a7cf2f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:33.649737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03426ddf-6aba-4813-a6b6-ac0f49a7cf2f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:33.670364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245400c-584e-417d-a971-bd7085dcfa3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:33.671138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245400c-584e-417d-a971-bd7085dcfa3a admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:33.672095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245400c-584e-417d-a971-bd7085dcfa3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:33.673573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245400c-584e-417d-a971-bd7085dcfa3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:33.674264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245400c-584e-417d-a971-bd7085dcfa3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:33.681816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245400c-584e-417d-a971-bd7085dcfa3a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:33.724118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc737b-fad9-48b0-a2b5-cd768d17834a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:33.731857 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1714/3449] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:21:33.740185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc737b-fad9-48b0-a2b5-cd768d17834a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:33.773311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7525ef9-adf3-4d2a-a0af-ded94980f560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:33.774134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7525ef9-adf3-4d2a-a0af-ded94980f560 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:33.774413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7525ef9-adf3-4d2a-a0af-ded94980f560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:33.774687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7525ef9-adf3-4d2a-a0af-ded94980f560 admin admin] PATH_INFO: `/v3/projects/791ad97e3c374d2d8494abc25b46a0bf/users/51ab58be25a94cd6a59634e7c7cad158/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:33.827182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7525ef9-adf3-4d2a-a0af-ded94980f560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=791ad97e3c374d2d8494abc25b46a0bf, user_id=51ab58be25a94cd6a59634e7c7cad158, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:33.832906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7525ef9-adf3-4d2a-a0af-ded94980f560 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:33.854093 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:33.865164 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1736/3450] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:21:33 2022] PUT /identity/v3/projects/791ad97e3c374d2d8494abc25b46a0bf/users/51ab58be25a94cd6a59634e7c7cad158/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:21:33.870174 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0889b-c861-4ad4-9e4c-5055bacd1f41 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:33.870475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0889b-c861-4ad4-9e4c-5055bacd1f41 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:33.870735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0889b-c861-4ad4-9e4c-5055bacd1f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:33.918093 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6ac0889b-c861-4ad4-9e4c-5055bacd1f41 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:21:33.919724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6ac0889b-c861-4ad4-9e4c-5055bacd1f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:33.993834 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:34.082435 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1715/3451] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:21:34.107549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7525ef9-adf3-4d2a-a0af-ded94980f560 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:34.109531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f7525ef9-adf3-4d2a-a0af-ded94980f560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:34.214666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7525ef9-adf3-4d2a-a0af-ded94980f560 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:34.222206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064952d6-a6c0-4e36-b4a8-9bda237adc3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:34.222989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064952d6-a6c0-4e36-b4a8-9bda237adc3c service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:34.223374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064952d6-a6c0-4e36-b4a8-9bda237adc3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:34.223740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064952d6-a6c0-4e36-b4a8-9bda237adc3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:34.247480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064952d6-a6c0-4e36-b4a8-9bda237adc3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:34.249597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064952d6-a6c0-4e36-b4a8-9bda237adc3c service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:34.276729 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1737/3452] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:21:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:21:34.586762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0889b-c861-4ad4-9e4c-5055bacd1f41 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:34.588416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6ac0889b-c861-4ad4-9e4c-5055bacd1f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:34.608952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0889b-c861-4ad4-9e4c-5055bacd1f41 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:34.629161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59a3ed-a8e0-4a03-a512-fcb72c83d8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:34.629810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59a3ed-a8e0-4a03-a512-fcb72c83d8b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:34.630281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59a3ed-a8e0-4a03-a512-fcb72c83d8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:34.630382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59a3ed-a8e0-4a03-a512-fcb72c83d8b7 admin admin] PATH_INFO: `/v3/users/5080c88d51a8455bba8b70e33cca958b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:34.631527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59a3ed-a8e0-4a03-a512-fcb72c83d8b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5080c88d51a8455bba8b70e33cca958b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:34.633720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59a3ed-a8e0-4a03-a512-fcb72c83d8b7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:34.731842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1e59a3ed-a8e0-4a03-a512-fcb72c83d8b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5080c88d51a8455bba8b70e33cca958b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:34.750521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1e59a3ed-a8e0-4a03-a512-fcb72c83d8b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5080c88d51a8455bba8b70e33cca958b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:34.785136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1e59a3ed-a8e0-4a03-a512-fcb72c83d8b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5080c88d51a8455bba8b70e33cca958b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:34.785923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1e59a3ed-a8e0-4a03-a512-fcb72c83d8b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5080c88d51a8455bba8b70e33cca958b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:34.801373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1e59a3ed-a8e0-4a03-a512-fcb72c83d8b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5080c88d51a8455bba8b70e33cca958b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:34.824548 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1716/3453] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:21:34 2022] DELETE /identity/v3/users/5080c88d51a8455bba8b70e33cca958b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:21:37.821181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064952d6-a6c0-4e36-b4a8-9bda237adc3c service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:37.838493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064952d6-a6c0-4e36-b4a8-9bda237adc3c service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:38.021649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a295d2-19dc-47b6-a37e-c87f98c5e098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:38.022668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a295d2-19dc-47b6-a37e-c87f98c5e098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:38.022958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a295d2-19dc-47b6-a37e-c87f98c5e098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:38.023231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a295d2-19dc-47b6-a37e-c87f98c5e098 admin admin] PATH_INFO: `/v3/projects/bc6a995089fa447e8f74df7d111b1c6b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:38.025623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a295d2-19dc-47b6-a37e-c87f98c5e098 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc6a995089fa447e8f74df7d111b1c6b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:38.027913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a295d2-19dc-47b6-a37e-c87f98c5e098 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:38.187593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-19a295d2-19dc-47b6-a37e-c87f98c5e098 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc6a995089fa447e8f74df7d111b1c6b', 'request_id': 'req-19a295d2-19dc-47b6-a37e-c87f98c5e098'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:38.201662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-19a295d2-19dc-47b6-a37e-c87f98c5e098 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc6a995089fa447e8f74df7d111b1c6b', 'request_id': 'req-19a295d2-19dc-47b6-a37e-c87f98c5e098'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:38.209278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-19a295d2-19dc-47b6-a37e-c87f98c5e098 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc6a995089fa447e8f74df7d111b1c6b', 'request_id': 'req-19a295d2-19dc-47b6-a37e-c87f98c5e098'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:38.259770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-19a295d2-19dc-47b6-a37e-c87f98c5e098 admin admin] The token cache is being invalidate because project bc6a995089fa447e8f74df7d111b1c6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:21:38.260108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-19a295d2-19dc-47b6-a37e-c87f98c5e098 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:38.264848 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-19a295d2-19dc-47b6-a37e-c87f98c5e098 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:38.271434 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1738/3454] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:21:37 2022] DELETE /identity/v3/projects/bc6a995089fa447e8f74df7d111b1c6b => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:21:38.273633 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59a3ed-a8e0-4a03-a512-fcb72c83d8b7 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:38.275401 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1e59a3ed-a8e0-4a03-a512-fcb72c83d8b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:38.305210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59a3ed-a8e0-4a03-a512-fcb72c83d8b7 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:38.552156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151b8a6-efc2-46da-98ad-3f499dcb72e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:38.555000 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151b8a6-efc2-46da-98ad-3f499dcb72e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:38.555515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151b8a6-efc2-46da-98ad-3f499dcb72e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:38.558029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151b8a6-efc2-46da-98ad-3f499dcb72e6 admin admin] PATH_INFO: `/v3/users/473e0736f4cd49d289e882f2d69f18cc` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:38.562033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151b8a6-efc2-46da-98ad-3f499dcb72e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=473e0736f4cd49d289e882f2d69f18cc)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:38.564507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151b8a6-efc2-46da-98ad-3f499dcb72e6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:38.744172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1151b8a6-efc2-46da-98ad-3f499dcb72e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '473e0736f4cd49d289e882f2d69f18cc'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:38.747223 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:38.766395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1151b8a6-efc2-46da-98ad-3f499dcb72e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '473e0736f4cd49d289e882f2d69f18cc'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:38.801519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1151b8a6-efc2-46da-98ad-3f499dcb72e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '473e0736f4cd49d289e882f2d69f18cc'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:38.805177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1151b8a6-efc2-46da-98ad-3f499dcb72e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '473e0736f4cd49d289e882f2d69f18cc'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:38.822840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1151b8a6-efc2-46da-98ad-3f499dcb72e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '473e0736f4cd49d289e882f2d69f18cc'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:38.848498 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1717/3455] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:21:38 2022] DELETE /identity/v3/users/473e0736f4cd49d289e882f2d69f18cc => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:21:40.207173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a295d2-19dc-47b6-a37e-c87f98c5e098 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:40.214123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-19a295d2-19dc-47b6-a37e-c87f98c5e098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:40.242481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a295d2-19dc-47b6-a37e-c87f98c5e098 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:40.338654 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:40.396461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e1d76-607a-4b5a-9479-d9799cc44131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:40.397595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e1d76-607a-4b5a-9479-d9799cc44131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:40.397872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e1d76-607a-4b5a-9479-d9799cc44131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:40.398145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e1d76-607a-4b5a-9479-d9799cc44131 admin admin] PATH_INFO: `/v3/projects/a9fb6ec931d04850855bd36adf4ba3ee` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:40.399472 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e1d76-607a-4b5a-9479-d9799cc44131 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9fb6ec931d04850855bd36adf4ba3ee)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:40.401954 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e1d76-607a-4b5a-9479-d9799cc44131 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:40.493770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-923e1d76-607a-4b5a-9479-d9799cc44131 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9fb6ec931d04850855bd36adf4ba3ee', 'request_id': 'req-923e1d76-607a-4b5a-9479-d9799cc44131'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:40.503140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-923e1d76-607a-4b5a-9479-d9799cc44131 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9fb6ec931d04850855bd36adf4ba3ee', 'request_id': 'req-923e1d76-607a-4b5a-9479-d9799cc44131'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:40.512480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-923e1d76-607a-4b5a-9479-d9799cc44131 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9fb6ec931d04850855bd36adf4ba3ee', 'request_id': 'req-923e1d76-607a-4b5a-9479-d9799cc44131'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:40.530042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-923e1d76-607a-4b5a-9479-d9799cc44131 admin admin] The token cache is being invalidate because project a9fb6ec931d04850855bd36adf4ba3ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:21:40.530368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-923e1d76-607a-4b5a-9479-d9799cc44131 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:40.531105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-923e1d76-607a-4b5a-9479-d9799cc44131 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:21:40.533454 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1739/3456] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:21:40 2022] DELETE /identity/v3/projects/a9fb6ec931d04850855bd36adf4ba3ee => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:21:40.538200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c73bc6-ea7c-4a6e-a2e0-d1965e0804b4 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:40.538890 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c73bc6-ea7c-4a6e-a2e0-d1965e0804b4 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:40.538890 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c73bc6-ea7c-4a6e-a2e0-d1965e0804b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:40.568428 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-65c73bc6-ea7c-4a6e-a2e0-d1965e0804b4 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:21:40.571574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-65c73bc6-ea7c-4a6e-a2e0-d1965e0804b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:40.666444 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1718/3457] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:21:40.675376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec78af9-322f-47f3-9572-5406977dac5f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:40.676079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec78af9-322f-47f3-9572-5406977dac5f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:40.676464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec78af9-322f-47f3-9572-5406977dac5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:40.708825 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5ec78af9-322f-47f3-9572-5406977dac5f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:21:40.710203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5ec78af9-322f-47f3-9572-5406977dac5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:40.720381 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1740/3458] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:21:40.724390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c73bc6-ea7c-4a6e-a2e0-d1965e0804b4 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:40.737833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c73bc6-ea7c-4a6e-a2e0-d1965e0804b4 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:40.743714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc617e4-cc90-4c62-916e-037da27bd30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:40.747445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc617e4-cc90-4c62-916e-037da27bd30b admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:40.747445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc617e4-cc90-4c62-916e-037da27bd30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:40.749114 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc617e4-cc90-4c62-916e-037da27bd30b admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:40.750336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc617e4-cc90-4c62-916e-037da27bd30b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:21:40.751979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc617e4-cc90-4c62-916e-037da27bd30b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:40.753793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc617e4-cc90-4c62-916e-037da27bd30b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:40.775019 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1719/3459] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:21:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:21:40.777901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec78af9-322f-47f3-9572-5406977dac5f None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:40.795114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec78af9-322f-47f3-9572-5406977dac5f None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:40.814833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd9e09-5a9d-4982-90fe-4b7ec5d25158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:40.815530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd9e09-5a9d-4982-90fe-4b7ec5d25158 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:40.815810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd9e09-5a9d-4982-90fe-4b7ec5d25158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:40.816732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd9e09-5a9d-4982-90fe-4b7ec5d25158 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:40.817390 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd9e09-5a9d-4982-90fe-4b7ec5d25158 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:40.819504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd9e09-5a9d-4982-90fe-4b7ec5d25158 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:40.905320 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1741/3460] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:21:40 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:21:40.909290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc617e4-cc90-4c62-916e-037da27bd30b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:40.923040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc617e4-cc90-4c62-916e-037da27bd30b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:41.141207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c46256-e895-410d-a133-971cfb8311f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:41.142134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c46256-e895-410d-a133-971cfb8311f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:41.142568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c46256-e895-410d-a133-971cfb8311f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:41.142888 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c46256-e895-410d-a133-971cfb8311f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:41.143687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c46256-e895-410d-a133-971cfb8311f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:41.145763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c46256-e895-410d-a133-971cfb8311f4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:41.198548 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1720/3461] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:21:40 2022] POST /identity/v3/users => generated 290 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:21:41.202242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd9e09-5a9d-4982-90fe-4b7ec5d25158 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:41.218668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd9e09-5a9d-4982-90fe-4b7ec5d25158 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:41.243594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed918a2-273d-4fbd-bc28-be1448997b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:41.246975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed918a2-273d-4fbd-bc28-be1448997b59 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:41.247567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed918a2-273d-4fbd-bc28-be1448997b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:41.248455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed918a2-273d-4fbd-bc28-be1448997b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:41.252521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed918a2-273d-4fbd-bc28-be1448997b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:41.261943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed918a2-273d-4fbd-bc28-be1448997b59 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:41.317924 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1742/3462] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:21:41.322298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c46256-e895-410d-a133-971cfb8311f4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:41.342139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c46256-e895-410d-a133-971cfb8311f4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:41.353847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357cee02-e85e-4dfe-852f-f6dc649bdac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:41.366746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cee02-e85e-4dfe-852f-f6dc649bdac3 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:41.367491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cee02-e85e-4dfe-852f-f6dc649bdac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:41.368667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357cee02-e85e-4dfe-852f-f6dc649bdac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:41.371706 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357cee02-e85e-4dfe-852f-f6dc649bdac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:41.394973 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357cee02-e85e-4dfe-852f-f6dc649bdac3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:41.448541 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1721/3463] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:21:41.452826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed918a2-273d-4fbd-bc28-be1448997b59 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:41.484702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed918a2-273d-4fbd-bc28-be1448997b59 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:41.510533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7ab90-79ac-4c79-bfbb-b48ca008cb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:41.512379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7ab90-79ac-4c79-bfbb-b48ca008cb6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:41.513432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7ab90-79ac-4c79-bfbb-b48ca008cb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:41.513850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7ab90-79ac-4c79-bfbb-b48ca008cb6a admin admin] PATH_INFO: `/v3/projects/c34f5e0602134ef7ae2eaf6a05f82c32/users/3adbb2fc6f6a48b39962545bb8de46c8/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:41.611054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7ab90-79ac-4c79-bfbb-b48ca008cb6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34f5e0602134ef7ae2eaf6a05f82c32, user_id=3adbb2fc6f6a48b39962545bb8de46c8, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:41.621209 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7ab90-79ac-4c79-bfbb-b48ca008cb6a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:41.654640 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1743/3464] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:21:41 2022] PUT /identity/v3/projects/c34f5e0602134ef7ae2eaf6a05f82c32/users/3adbb2fc6f6a48b39962545bb8de46c8/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:21:41.664934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2e954-9cca-4c85-9225-2ddca2b3be08 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:41.665549 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2e954-9cca-4c85-9225-2ddca2b3be08 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:41.665979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2e954-9cca-4c85-9225-2ddca2b3be08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:41.755814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-cfe2e954-9cca-4c85-9225-2ddca2b3be08 None None] MFA Rules not processed for user `3adbb2fc6f6a48b39962545bb8de46c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:21:41.759436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cfe2e954-9cca-4c85-9225-2ddca2b3be08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:41.826412 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:41.963343 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1722/3465] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:21:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:21:41.983523 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7ab90-79ac-4c79-bfbb-b48ca008cb6a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:41.987126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1ae7ab90-79ac-4c79-bfbb-b48ca008cb6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:42.145492 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:42.179746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7ab90-79ac-4c79-bfbb-b48ca008cb6a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:42.184560 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81feec7a-e49d-4d8d-a3c4-b9196993f54a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:42.185823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81feec7a-e49d-4d8d-a3c4-b9196993f54a service glance] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:42.186099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81feec7a-e49d-4d8d-a3c4-b9196993f54a service glance] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:42.186371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81feec7a-e49d-4d8d-a3c4-b9196993f54a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:42.200973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81feec7a-e49d-4d8d-a3c4-b9196993f54a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:42.202532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81feec7a-e49d-4d8d-a3c4-b9196993f54a service glance] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:42.218422 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1744/3466] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:21:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:21:42.573522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e7b5a-83ed-4f31-b698-b6f8cb77d414 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:42.573789 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e7b5a-83ed-4f31-b698-b6f8cb77d414 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:42.575418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e7b5a-83ed-4f31-b698-b6f8cb77d414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:42.659591 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c32e7b5a-83ed-4f31-b698-b6f8cb77d414 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:21:42.660869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c32e7b5a-83ed-4f31-b698-b6f8cb77d414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:42.817966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9f05d-a302-4f25-a405-f26003de1d56 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:42.818370 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9f05d-a302-4f25-a405-f26003de1d56 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:42.818727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9f05d-a302-4f25-a405-f26003de1d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:42.827360 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1723/3467] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:21:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:21:42.843170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e7b5a-83ed-4f31-b698-b6f8cb77d414 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:42.846245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c32e7b5a-83ed-4f31-b698-b6f8cb77d414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:42.941496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1df9f05d-a302-4f25-a405-f26003de1d56 None None] MFA Rules not processed for user `d60a6557665a43cda4a64a83c92e2998`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:21:42.946763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1df9f05d-a302-4f25-a405-f26003de1d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:43.108579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e7b5a-83ed-4f31-b698-b6f8cb77d414 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:43.127241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb9862-45f7-4f2b-9d26-73061158d264 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:43.127998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb9862-45f7-4f2b-9d26-73061158d264 service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:43.128344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb9862-45f7-4f2b-9d26-73061158d264 service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:43.128681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb9862-45f7-4f2b-9d26-73061158d264 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:43.141711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb9862-45f7-4f2b-9d26-73061158d264 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:43.144253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb9862-45f7-4f2b-9d26-73061158d264 service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:43.175380 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1745/3468] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:21:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:21:43.176805 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9f05d-a302-4f25-a405-f26003de1d56 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:43.181347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1df9f05d-a302-4f25-a405-f26003de1d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:43.184322 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1724/3469] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:21:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:21:43.331387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc464ee0-d583-4f15-b225-0fd5361d8272 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:43.331387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc464ee0-d583-4f15-b225-0fd5361d8272 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:43.331709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc464ee0-d583-4f15-b225-0fd5361d8272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:43.360426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-dc464ee0-d583-4f15-b225-0fd5361d8272 None None] MFA Rules not processed for user `45ed48709ab84fa4b5b341332a843ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:21:43.361844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-dc464ee0-d583-4f15-b225-0fd5361d8272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:43.391952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9f05d-a302-4f25-a405-f26003de1d56 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:43.403516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9a12b-8530-4630-b623-a2c3bd13001c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:43.404301 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9a12b-8530-4630-b623-a2c3bd13001c service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:43.405078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9a12b-8530-4630-b623-a2c3bd13001c service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:43.405628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9a12b-8530-4630-b623-a2c3bd13001c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:43.441073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc9a12b-8530-4630-b623-a2c3bd13001c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:43.442536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc9a12b-8530-4630-b623-a2c3bd13001c service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:43.469064 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1746/3470] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:21:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:21:43.484362 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:43.523237 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1725/3471] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:21:43 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:21:47.174549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8da98d-3a57-48a6-999a-fe5159532823 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:47.175282 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8da98d-3a57-48a6-999a-fe5159532823 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:47.175282 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8da98d-3a57-48a6-999a-fe5159532823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:47.229798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-7c8da98d-3a57-48a6-999a-fe5159532823 None None] MFA Rules not processed for user `d60a6557665a43cda4a64a83c92e2998`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:21:47.230963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7c8da98d-3a57-48a6-999a-fe5159532823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:47.257729 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1747/3472] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:21:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:21:48.538496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc464ee0-d583-4f15-b225-0fd5361d8272 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:48.553836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc464ee0-d583-4f15-b225-0fd5361d8272 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:48.562813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a24b8-8ffd-4591-aab4-8a0a68d1b652 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:48.563805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a24b8-8ffd-4591-aab4-8a0a68d1b652 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:48.564671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a24b8-8ffd-4591-aab4-8a0a68d1b652 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:48.565125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a24b8-8ffd-4591-aab4-8a0a68d1b652 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:48.570178 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4e9a24b8-8ffd-4591-aab4-8a0a68d1b652 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:48.604485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a24b8-8ffd-4591-aab4-8a0a68d1b652 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:48.609782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a24b8-8ffd-4591-aab4-8a0a68d1b652 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:48.629187 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1726/3473] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:21:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:21:50.793377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8da98d-3a57-48a6-999a-fe5159532823 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:50.794903 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7c8da98d-3a57-48a6-999a-fe5159532823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:50.825001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8da98d-3a57-48a6-999a-fe5159532823 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:50.833923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a27ff9-d2aa-4f9b-af52-633e4d8554c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:50.841819 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a27ff9-d2aa-4f9b-af52-633e4d8554c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:50.843577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a27ff9-d2aa-4f9b-af52-633e4d8554c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:50.844125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a27ff9-d2aa-4f9b-af52-633e4d8554c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:50.851983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-76a27ff9-d2aa-4f9b-af52-633e4d8554c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:50.876449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a27ff9-d2aa-4f9b-af52-633e4d8554c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:50.879059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a27ff9-d2aa-4f9b-af52-633e4d8554c7 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:50.906512 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1748/3474] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:21:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:21:56.191846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1873a7-2697-41c2-bbbe-56dd07bdce1e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:56.193206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1873a7-2697-41c2-bbbe-56dd07bdce1e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:56.193840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1873a7-2697-41c2-bbbe-56dd07bdce1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:56.273884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6c1873a7-2697-41c2-bbbe-56dd07bdce1e None None] MFA Rules not processed for user `51ab58be25a94cd6a59634e7c7cad158`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:21:56.277081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6c1873a7-2697-41c2-bbbe-56dd07bdce1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:56.407302 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1727/3475] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:21:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:21:56.813521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a27ff9-d2aa-4f9b-af52-633e4d8554c7 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:56.815814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-76a27ff9-d2aa-4f9b-af52-633e4d8554c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:56.983663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a27ff9-d2aa-4f9b-af52-633e4d8554c7 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:57.005326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06428cfc-f9d5-4bdc-aa2a-96000eeec6d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:57.006286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06428cfc-f9d5-4bdc-aa2a-96000eeec6d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:57.009003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06428cfc-f9d5-4bdc-aa2a-96000eeec6d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:57.010669 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06428cfc-f9d5-4bdc-aa2a-96000eeec6d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:57.015738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-06428cfc-f9d5-4bdc-aa2a-96000eeec6d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:57.046419 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:21:57.065729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06428cfc-f9d5-4bdc-aa2a-96000eeec6d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:57.076815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06428cfc-f9d5-4bdc-aa2a-96000eeec6d5 service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:57.102812 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1749/3476] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:21:56 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:21:57.652658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1873a7-2697-41c2-bbbe-56dd07bdce1e None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:21:57.655520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6c1873a7-2697-41c2-bbbe-56dd07bdce1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:21:57.846863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1873a7-2697-41c2-bbbe-56dd07bdce1e None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:21:57.868945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b65670-b85f-462b-bf3e-4bf3f4f33495 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:21:57.872033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b65670-b85f-462b-bf3e-4bf3f4f33495 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:21:57.872170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b65670-b85f-462b-bf3e-4bf3f4f33495 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:21:57.872409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b65670-b85f-462b-bf3e-4bf3f4f33495 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:21:57.902816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b65670-b85f-462b-bf3e-4bf3f4f33495 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:21:57.908354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b65670-b85f-462b-bf3e-4bf3f4f33495 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:21:57.935469 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1728/3477] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:21:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:22:01.526081 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078edbd4-27c4-4fc5-be76-776e7179be47 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:01.528334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078edbd4-27c4-4fc5-be76-776e7179be47 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:01.529119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078edbd4-27c4-4fc5-be76-776e7179be47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:01.579954 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-078edbd4-27c4-4fc5-be76-776e7179be47 None None] MFA Rules not processed for user `51ab58be25a94cd6a59634e7c7cad158`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:22:01.583745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-078edbd4-27c4-4fc5-be76-776e7179be47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:01.640976 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1750/3478] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:22:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:22:07.917643 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=72 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:08.295667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30c494-f436-4a8a-9f35-11a98821e122 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:08.296126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30c494-f436-4a8a-9f35-11a98821e122 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:08.296502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30c494-f436-4a8a-9f35-11a98821e122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:08.360909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9f30c494-f436-4a8a-9f35-11a98821e122 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:22:08.362168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9f30c494-f436-4a8a-9f35-11a98821e122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:08.394927 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1729/3479] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:22:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:22:08.422029 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078edbd4-27c4-4fc5-be76-776e7179be47 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:08.438022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078edbd4-27c4-4fc5-be76-776e7179be47 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:08.445329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbf56c-242e-4d0d-8c69-47c9bcef7966 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:08.446156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbf56c-242e-4d0d-8c69-47c9bcef7966 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:08.446922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbf56c-242e-4d0d-8c69-47c9bcef7966 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:08.447366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbf56c-242e-4d0d-8c69-47c9bcef7966 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:08.461297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccbf56c-242e-4d0d-8c69-47c9bcef7966 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:08.464202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccbf56c-242e-4d0d-8c69-47c9bcef7966 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:08.482623 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1751/3480] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:22:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:22:08.775334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30c494-f436-4a8a-9f35-11a98821e122 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:08.984353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30c494-f436-4a8a-9f35-11a98821e122 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:08.997893 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d3c72-024d-41b4-8c47-0485abf7d17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:08.998739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d3c72-024d-41b4-8c47-0485abf7d17f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:08.999391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d3c72-024d-41b4-8c47-0485abf7d17f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:08.999793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d3c72-024d-41b4-8c47-0485abf7d17f admin admin] PATH_INFO: `/v3/users/3adbb2fc6f6a48b39962545bb8de46c8` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:09.003762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d3c72-024d-41b4-8c47-0485abf7d17f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3adbb2fc6f6a48b39962545bb8de46c8)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:09.008477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d3c72-024d-41b4-8c47-0485abf7d17f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:09.268649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7c1d3c72-024d-41b4-8c47-0485abf7d17f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3adbb2fc6f6a48b39962545bb8de46c8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:09.300748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7c1d3c72-024d-41b4-8c47-0485abf7d17f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3adbb2fc6f6a48b39962545bb8de46c8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:09.355012 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7c1d3c72-024d-41b4-8c47-0485abf7d17f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3adbb2fc6f6a48b39962545bb8de46c8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:09.355833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7c1d3c72-024d-41b4-8c47-0485abf7d17f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3adbb2fc6f6a48b39962545bb8de46c8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:09.401369 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7c1d3c72-024d-41b4-8c47-0485abf7d17f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3adbb2fc6f6a48b39962545bb8de46c8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:09.413850 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1730/3481] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:22:08 2022] DELETE /identity/v3/users/3adbb2fc6f6a48b39962545bb8de46c8 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:22:09.419277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c927c99-92fa-49ae-9e5b-2efa96e711a4 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:09.420052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c927c99-92fa-49ae-9e5b-2efa96e711a4 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:09.421568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c927c99-92fa-49ae-9e5b-2efa96e711a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:09.481500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5c927c99-92fa-49ae-9e5b-2efa96e711a4 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:22:09.482841 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5c927c99-92fa-49ae-9e5b-2efa96e711a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:09.712460 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1752/3482] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:22:09.812442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d3c72-024d-41b4-8c47-0485abf7d17f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:09.814612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7c1d3c72-024d-41b4-8c47-0485abf7d17f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:10.023545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d3c72-024d-41b4-8c47-0485abf7d17f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:10.036610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374d183-e6e1-4918-8fb6-f6e84d19858a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:10.037406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374d183-e6e1-4918-8fb6-f6e84d19858a service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:10.037688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374d183-e6e1-4918-8fb6-f6e84d19858a service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:10.037958 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374d183-e6e1-4918-8fb6-f6e84d19858a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:10.080370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374d183-e6e1-4918-8fb6-f6e84d19858a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:10.083411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374d183-e6e1-4918-8fb6-f6e84d19858a service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:10.112392 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1731/3483] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:22:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:22:13.047585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c927c99-92fa-49ae-9e5b-2efa96e711a4 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:13.050899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5c927c99-92fa-49ae-9e5b-2efa96e711a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:13.091736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c927c99-92fa-49ae-9e5b-2efa96e711a4 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:13.112807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caeb3ef-c6f6-4c45-931e-f3ef101c878a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:13.113732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caeb3ef-c6f6-4c45-931e-f3ef101c878a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:13.114211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caeb3ef-c6f6-4c45-931e-f3ef101c878a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:13.114656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caeb3ef-c6f6-4c45-931e-f3ef101c878a admin admin] PATH_INFO: `/v3/projects/c34f5e0602134ef7ae2eaf6a05f82c32` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:13.117583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caeb3ef-c6f6-4c45-931e-f3ef101c878a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c34f5e0602134ef7ae2eaf6a05f82c32)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:13.125681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caeb3ef-c6f6-4c45-931e-f3ef101c878a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:13.254834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3caeb3ef-c6f6-4c45-931e-f3ef101c878a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c34f5e0602134ef7ae2eaf6a05f82c32', 'request_id': 'req-3caeb3ef-c6f6-4c45-931e-f3ef101c878a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:13.274448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3caeb3ef-c6f6-4c45-931e-f3ef101c878a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c34f5e0602134ef7ae2eaf6a05f82c32', 'request_id': 'req-3caeb3ef-c6f6-4c45-931e-f3ef101c878a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:13.287671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3caeb3ef-c6f6-4c45-931e-f3ef101c878a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c34f5e0602134ef7ae2eaf6a05f82c32', 'request_id': 'req-3caeb3ef-c6f6-4c45-931e-f3ef101c878a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:13.309126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3caeb3ef-c6f6-4c45-931e-f3ef101c878a admin admin] The token cache is being invalidate because project c34f5e0602134ef7ae2eaf6a05f82c32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:22:13.309458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3caeb3ef-c6f6-4c45-931e-f3ef101c878a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:13.312008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3caeb3ef-c6f6-4c45-931e-f3ef101c878a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:13.314479 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1753/3484] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:22:13 2022] DELETE /identity/v3/projects/c34f5e0602134ef7ae2eaf6a05f82c32 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:22:13.322028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79782edf-b8bb-4169-aded-22bfc76302bb None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:13.322579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79782edf-b8bb-4169-aded-22bfc76302bb None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:13.322579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79782edf-b8bb-4169-aded-22bfc76302bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:13.387495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-79782edf-b8bb-4169-aded-22bfc76302bb None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:22:13.393024 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-79782edf-b8bb-4169-aded-22bfc76302bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:13.420940 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:13.619117 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1732/3485] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:22:13.630118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72b273-1637-4d26-a7cd-63382a02e424 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:13.630330 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72b273-1637-4d26-a7cd-63382a02e424 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:13.630732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72b273-1637-4d26-a7cd-63382a02e424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:13.694680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6e72b273-1637-4d26-a7cd-63382a02e424 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:22:13.697809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6e72b273-1637-4d26-a7cd-63382a02e424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:13.716287 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1754/3486] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:22:13.716792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79782edf-b8bb-4169-aded-22bfc76302bb None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:13.742006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79782edf-b8bb-4169-aded-22bfc76302bb None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:13.753705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990642e-2172-4542-b720-218a554b5033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:13.754928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990642e-2172-4542-b720-218a554b5033 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:13.756687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990642e-2172-4542-b720-218a554b5033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:13.757640 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990642e-2172-4542-b720-218a554b5033 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:13.759157 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990642e-2172-4542-b720-218a554b5033 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:22:13.760575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990642e-2172-4542-b720-218a554b5033 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:13.766295 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990642e-2172-4542-b720-218a554b5033 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:13.815496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72b273-1637-4d26-a7cd-63382a02e424 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:13.826408 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1733/3487] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:22:13.841547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72b273-1637-4d26-a7cd-63382a02e424 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:13.847117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add45fc8-1e1d-4db4-adf7-3b04e64fd771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:13.847760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add45fc8-1e1d-4db4-adf7-3b04e64fd771 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:13.848090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add45fc8-1e1d-4db4-adf7-3b04e64fd771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:13.848363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add45fc8-1e1d-4db4-adf7-3b04e64fd771 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:13.849168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add45fc8-1e1d-4db4-adf7-3b04e64fd771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:13.851901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add45fc8-1e1d-4db4-adf7-3b04e64fd771 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:13.983733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990642e-2172-4542-b720-218a554b5033 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:14.000029 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1755/3488] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:22:13 2022] POST /identity/v3/projects => generated 377 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:22:14.009111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990642e-2172-4542-b720-218a554b5033 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:14.358039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd22fb1-419d-4b4f-9d2a-ae426276873a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:14.359744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd22fb1-419d-4b4f-9d2a-ae426276873a admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:14.360387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd22fb1-419d-4b4f-9d2a-ae426276873a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:14.360932 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd22fb1-419d-4b4f-9d2a-ae426276873a admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:14.361872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd22fb1-419d-4b4f-9d2a-ae426276873a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:14.364192 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd22fb1-419d-4b4f-9d2a-ae426276873a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:14.441393 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1734/3489] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:22:13 2022] POST /identity/v3/users => generated 289 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:22:14.450881 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add45fc8-1e1d-4db4-adf7-3b04e64fd771 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:14.491186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add45fc8-1e1d-4db4-adf7-3b04e64fd771 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:14.510031 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf23c2-342c-4ed4-a823-a8d6d9d0ad8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:14.511279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf23c2-342c-4ed4-a823-a8d6d9d0ad8d admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:14.512619 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf23c2-342c-4ed4-a823-a8d6d9d0ad8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:14.513183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf23c2-342c-4ed4-a823-a8d6d9d0ad8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:14.514260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf23c2-342c-4ed4-a823-a8d6d9d0ad8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:14.516745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf23c2-342c-4ed4-a823-a8d6d9d0ad8d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:14.553020 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1756/3490] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:22:14.555947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd22fb1-419d-4b4f-9d2a-ae426276873a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:14.591573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd22fb1-419d-4b4f-9d2a-ae426276873a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:14.604597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee85df3e-14ae-45ae-8d30-0dbe8e649cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:14.607504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85df3e-14ae-45ae-8d30-0dbe8e649cfc admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:14.609167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85df3e-14ae-45ae-8d30-0dbe8e649cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:14.609641 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85df3e-14ae-45ae-8d30-0dbe8e649cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:14.610928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee85df3e-14ae-45ae-8d30-0dbe8e649cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:14.629177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee85df3e-14ae-45ae-8d30-0dbe8e649cfc admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:14.682087 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1735/3491] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:22:14.687812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf23c2-342c-4ed4-a823-a8d6d9d0ad8d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:14.705457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf23c2-342c-4ed4-a823-a8d6d9d0ad8d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:14.719240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf48eb-ded7-466e-a32e-b422195349a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:14.720085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf48eb-ded7-466e-a32e-b422195349a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:14.720427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf48eb-ded7-466e-a32e-b422195349a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:14.720839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf48eb-ded7-466e-a32e-b422195349a6 admin admin] PATH_INFO: `/v3/projects/6a5267b6a8e34a4397cd94fae11283be/users/2185c595c9df4719bdca76d8797c76e3/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:14.759461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf48eb-ded7-466e-a32e-b422195349a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a5267b6a8e34a4397cd94fae11283be, user_id=2185c595c9df4719bdca76d8797c76e3, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:14.763625 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf48eb-ded7-466e-a32e-b422195349a6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:14.774179 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:14.806406 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1757/3492] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:22:14 2022] PUT /identity/v3/projects/6a5267b6a8e34a4397cd94fae11283be/users/2185c595c9df4719bdca76d8797c76e3/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:22:14.807928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923ad85-f6aa-4796-8528-3fbd009d2e6f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:14.808204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923ad85-f6aa-4796-8528-3fbd009d2e6f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:14.808504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923ad85-f6aa-4796-8528-3fbd009d2e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:14.877324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6923ad85-f6aa-4796-8528-3fbd009d2e6f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:22:14.882792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6923ad85-f6aa-4796-8528-3fbd009d2e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:15.157146 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1736/3493] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:22:15.301821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf48eb-ded7-466e-a32e-b422195349a6 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:15.304514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-18cf48eb-ded7-466e-a32e-b422195349a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:15.570282 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf48eb-ded7-466e-a32e-b422195349a6 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:15.579200 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365ae25-0782-4b98-b042-4a279e731849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:15.580353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365ae25-0782-4b98-b042-4a279e731849 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:15.580785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365ae25-0782-4b98-b042-4a279e731849 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:15.581223 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365ae25-0782-4b98-b042-4a279e731849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:15.601122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365ae25-0782-4b98-b042-4a279e731849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:15.604003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365ae25-0782-4b98-b042-4a279e731849 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:15.643769 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1758/3494] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:22:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:22:25.133786 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=87,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:25.622536 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=28 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:35.383589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e09aab-07a9-4f8f-9db9-d2ec2eb12a8c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:35.384094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e09aab-07a9-4f8f-9db9-d2ec2eb12a8c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:35.384654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e09aab-07a9-4f8f-9db9-d2ec2eb12a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:35.440741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-83e09aab-07a9-4f8f-9db9-d2ec2eb12a8c None None] MFA Rules not processed for user `2185c595c9df4719bdca76d8797c76e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:22:35.442928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-83e09aab-07a9-4f8f-9db9-d2ec2eb12a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:35.612425 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1737/3495] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:22:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:22:36.248532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365ae25-0782-4b98-b042-4a279e731849 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:36.250244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f365ae25-0782-4b98-b042-4a279e731849 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:36.418970 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365ae25-0782-4b98-b042-4a279e731849 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:36.425489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c90e7-b5b1-4684-90b6-59aa61a1d93c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:36.426547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c90e7-b5b1-4684-90b6-59aa61a1d93c service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:36.427010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c90e7-b5b1-4684-90b6-59aa61a1d93c service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:36.427428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c90e7-b5b1-4684-90b6-59aa61a1d93c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:36.441656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c90e7-b5b1-4684-90b6-59aa61a1d93c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:36.443640 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c90e7-b5b1-4684-90b6-59aa61a1d93c service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:36.463409 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1759/3496] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:22:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:22:42.251257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e09aab-07a9-4f8f-9db9-d2ec2eb12a8c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:42.252846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-83e09aab-07a9-4f8f-9db9-d2ec2eb12a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:42.291278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e09aab-07a9-4f8f-9db9-d2ec2eb12a8c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:42.297412 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04989e60-cb21-4aee-add8-4c248264b536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:42.298093 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04989e60-cb21-4aee-add8-4c248264b536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:42.298378 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04989e60-cb21-4aee-add8-4c248264b536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:42.298654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04989e60-cb21-4aee-add8-4c248264b536 admin admin] PATH_INFO: `/v3/users/093384280c5448f6af8915b37082e14b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:42.300107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04989e60-cb21-4aee-add8-4c248264b536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=093384280c5448f6af8915b37082e14b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:42.302531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04989e60-cb21-4aee-add8-4c248264b536 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:42.384414 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-04989e60-cb21-4aee-add8-4c248264b536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '093384280c5448f6af8915b37082e14b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:42.396685 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-04989e60-cb21-4aee-add8-4c248264b536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '093384280c5448f6af8915b37082e14b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:42.425109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-04989e60-cb21-4aee-add8-4c248264b536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '093384280c5448f6af8915b37082e14b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:42.426281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-04989e60-cb21-4aee-add8-4c248264b536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '093384280c5448f6af8915b37082e14b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:42.447028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-04989e60-cb21-4aee-add8-4c248264b536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '093384280c5448f6af8915b37082e14b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:42.477850 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1738/3497] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:22:42 2022] DELETE /identity/v3/users/093384280c5448f6af8915b37082e14b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:22:42.922579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c90e7-b5b1-4684-90b6-59aa61a1d93c service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:42.939584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c90e7-b5b1-4684-90b6-59aa61a1d93c service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:43.056583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb9fe1-9d4a-4e46-bd6e-cd20e5267fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:43.058998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb9fe1-9d4a-4e46-bd6e-cd20e5267fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:43.059517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb9fe1-9d4a-4e46-bd6e-cd20e5267fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:43.059859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb9fe1-9d4a-4e46-bd6e-cd20e5267fc5 admin admin] PATH_INFO: `/v3/projects/22296c942ac648039f202269c9d64749` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:43.061902 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb9fe1-9d4a-4e46-bd6e-cd20e5267fc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22296c942ac648039f202269c9d64749)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:43.064328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb9fe1-9d4a-4e46-bd6e-cd20e5267fc5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:43.148158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-48eb9fe1-9d4a-4e46-bd6e-cd20e5267fc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22296c942ac648039f202269c9d64749', 'request_id': 'req-48eb9fe1-9d4a-4e46-bd6e-cd20e5267fc5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:43.155605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-48eb9fe1-9d4a-4e46-bd6e-cd20e5267fc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22296c942ac648039f202269c9d64749', 'request_id': 'req-48eb9fe1-9d4a-4e46-bd6e-cd20e5267fc5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:43.162728 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-48eb9fe1-9d4a-4e46-bd6e-cd20e5267fc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22296c942ac648039f202269c9d64749', 'request_id': 'req-48eb9fe1-9d4a-4e46-bd6e-cd20e5267fc5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:43.199399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-48eb9fe1-9d4a-4e46-bd6e-cd20e5267fc5 admin admin] The token cache is being invalidate because project 22296c942ac648039f202269c9d64749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:22:43.200654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-48eb9fe1-9d4a-4e46-bd6e-cd20e5267fc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:43.201521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-48eb9fe1-9d4a-4e46-bd6e-cd20e5267fc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:43.205908 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1760/3498] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:22:42 2022] DELETE /identity/v3/projects/22296c942ac648039f202269c9d64749 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:22:43.210705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9a770-5511-43bb-a1de-79aa89fe02cd None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:43.210988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9a770-5511-43bb-a1de-79aa89fe02cd None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:43.211462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9a770-5511-43bb-a1de-79aa89fe02cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:43.243301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-f0c9a770-5511-43bb-a1de-79aa89fe02cd None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:22:43.244677 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f0c9a770-5511-43bb-a1de-79aa89fe02cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:43.385090 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1739/3499] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:22:43.386605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32591232-3851-4ebc-8e06-5749328f5461 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:43.387088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32591232-3851-4ebc-8e06-5749328f5461 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:43.387421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32591232-3851-4ebc-8e06-5749328f5461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:43.474353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-32591232-3851-4ebc-8e06-5749328f5461 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:22:43.476118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-32591232-3851-4ebc-8e06-5749328f5461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:43.492059 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1761/3500] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:22:43.497055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9a770-5511-43bb-a1de-79aa89fe02cd None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:43.501965 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:43.508504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9a770-5511-43bb-a1de-79aa89fe02cd None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:43.518747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32a95b-b929-47e5-815b-091aa9e622bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:43.519378 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32a95b-b929-47e5-815b-091aa9e622bf admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:43.519659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32a95b-b929-47e5-815b-091aa9e622bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:43.519977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32a95b-b929-47e5-815b-091aa9e622bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:43.520659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32a95b-b929-47e5-815b-091aa9e622bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:22:43.521081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32a95b-b929-47e5-815b-091aa9e622bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:43.523122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32a95b-b929-47e5-815b-091aa9e622bf admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:43.537683 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1740/3501] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:22:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:22:43.546084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32591232-3851-4ebc-8e06-5749328f5461 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:43.561154 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32591232-3851-4ebc-8e06-5749328f5461 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:43.567180 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543ce50-70f6-465c-bad3-6e0f3f3c0cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:43.568589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543ce50-70f6-465c-bad3-6e0f3f3c0cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:43.569039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543ce50-70f6-465c-bad3-6e0f3f3c0cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:43.569530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543ce50-70f6-465c-bad3-6e0f3f3c0cd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:43.570552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543ce50-70f6-465c-bad3-6e0f3f3c0cd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:43.572968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea852d2d-8a4f-4cb2-918c-3fbbc29fa547 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:43.574319 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543ce50-70f6-465c-bad3-6e0f3f3c0cd7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:43.575658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea852d2d-8a4f-4cb2-918c-3fbbc29fa547 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:43.576373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea852d2d-8a4f-4cb2-918c-3fbbc29fa547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:43.585579 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:43.628716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ea852d2d-8a4f-4cb2-918c-3fbbc29fa547 None None] MFA Rules not processed for user `2185c595c9df4719bdca76d8797c76e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:22:43.631088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ea852d2d-8a4f-4cb2-918c-3fbbc29fa547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:43.633342 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1762/3502] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:22:43 2022] POST /identity/v3/projects => generated 377 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:22:43.638533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543ce50-70f6-465c-bad3-6e0f3f3c0cd7 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:43.720734 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1741/3503] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:22:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:22:43.738586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543ce50-70f6-465c-bad3-6e0f3f3c0cd7 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:43.744291 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86f7f2-0da9-4dc6-9733-ac23984ff7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:43.745270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86f7f2-0da9-4dc6-9733-ac23984ff7af admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:43.745802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86f7f2-0da9-4dc6-9733-ac23984ff7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:43.746457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86f7f2-0da9-4dc6-9733-ac23984ff7af admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:43.748214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86f7f2-0da9-4dc6-9733-ac23984ff7af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:43.750641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86f7f2-0da9-4dc6-9733-ac23984ff7af admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:43.807001 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1763/3504] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:22:43 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:22:43.811374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea852d2d-8a4f-4cb2-918c-3fbbc29fa547 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:43.824463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea852d2d-8a4f-4cb2-918c-3fbbc29fa547 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:43.837473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035b38c-c0e7-4422-adb9-fbf9a992e466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:43.838406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035b38c-c0e7-4422-adb9-fbf9a992e466 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:43.838904 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035b38c-c0e7-4422-adb9-fbf9a992e466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:43.840153 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035b38c-c0e7-4422-adb9-fbf9a992e466 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:43.841249 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035b38c-c0e7-4422-adb9-fbf9a992e466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:43.843217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8035b38c-c0e7-4422-adb9-fbf9a992e466 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:43.855836 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1742/3505] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:22:43.859549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86f7f2-0da9-4dc6-9733-ac23984ff7af admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:43.872049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86f7f2-0da9-4dc6-9733-ac23984ff7af admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:43.878061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c6c62-481c-47f5-be55-de5e8f3eb702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:43.878768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c6c62-481c-47f5-be55-de5e8f3eb702 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:43.879052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c6c62-481c-47f5-be55-de5e8f3eb702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:43.879324 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c6c62-481c-47f5-be55-de5e8f3eb702 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:43.880386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c6c62-481c-47f5-be55-de5e8f3eb702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:43.881657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c6c62-481c-47f5-be55-de5e8f3eb702 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:43.905551 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1764/3506] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:22:43.906158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035b38c-c0e7-4422-adb9-fbf9a992e466 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:43.917233 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8035b38c-c0e7-4422-adb9-fbf9a992e466 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:43.927526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7aac8-11bf-46d6-9d6f-3fbbc26cfa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:43.928547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7aac8-11bf-46d6-9d6f-3fbbc26cfa1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:43.929391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7aac8-11bf-46d6-9d6f-3fbbc26cfa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:43.929937 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7aac8-11bf-46d6-9d6f-3fbbc26cfa1d admin admin] PATH_INFO: `/v3/projects/939fea7fa6ea4deda8d4fbef70a4e510/users/ef29bd35cca547c39d76c54058d32979/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:43.950225 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7aac8-11bf-46d6-9d6f-3fbbc26cfa1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=939fea7fa6ea4deda8d4fbef70a4e510, user_id=ef29bd35cca547c39d76c54058d32979, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:43.953044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c7aac8-11bf-46d6-9d6f-3fbbc26cfa1d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:43.972708 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1743/3507] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:22:43 2022] PUT /identity/v3/projects/939fea7fa6ea4deda8d4fbef70a4e510/users/ef29bd35cca547c39d76c54058d32979/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:22:43.977618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e65d4-c019-41f2-b44d-49f3b200791c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:43.978573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e65d4-c019-41f2-b44d-49f3b200791c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:43.979267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e65d4-c019-41f2-b44d-49f3b200791c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:44.000153 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-4e7e65d4-c019-41f2-b44d-49f3b200791c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:22:44.001376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4e7e65d4-c019-41f2-b44d-49f3b200791c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:44.070058 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1765/3508] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:22:44.081257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7aac8-11bf-46d6-9d6f-3fbbc26cfa1d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:44.083694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-27c7aac8-11bf-46d6-9d6f-3fbbc26cfa1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:44.170809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7aac8-11bf-46d6-9d6f-3fbbc26cfa1d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:44.175629 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f805d-031a-43a0-86f6-3f961fcf68a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:44.176961 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f805d-031a-43a0-86f6-3f961fcf68a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:44.177508 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f805d-031a-43a0-86f6-3f961fcf68a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:44.178221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f805d-031a-43a0-86f6-3f961fcf68a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:44.193959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f805d-031a-43a0-86f6-3f961fcf68a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:44.195483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f805d-031a-43a0-86f6-3f961fcf68a8 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:44.207852 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1744/3509] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:22:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:22:44.319532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e65d4-c019-41f2-b44d-49f3b200791c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:44.321719 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4e7e65d4-c019-41f2-b44d-49f3b200791c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:44.443709 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e65d4-c019-41f2-b44d-49f3b200791c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:44.452967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff323df-87a7-4280-b62a-571f571a5c06 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:44.453965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff323df-87a7-4280-b62a-571f571a5c06 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:44.454499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff323df-87a7-4280-b62a-571f571a5c06 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:44.454858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff323df-87a7-4280-b62a-571f571a5c06 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:44.458907 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-aff323df-87a7-4280-b62a-571f571a5c06 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:44.479336 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:44.485014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff323df-87a7-4280-b62a-571f571a5c06 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:44.488179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff323df-87a7-4280-b62a-571f571a5c06 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:44.504874 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1766/3510] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:22:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:22:47.195336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f805d-031a-43a0-86f6-3f961fcf68a8 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:47.199354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3e5f805d-031a-43a0-86f6-3f961fcf68a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:47.250559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f805d-031a-43a0-86f6-3f961fcf68a8 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:47.257097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c051d-c27e-4dca-b65c-2d084f62405a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:47.258330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c051d-c27e-4dca-b65c-2d084f62405a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:47.258911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c051d-c27e-4dca-b65c-2d084f62405a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:47.259117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c051d-c27e-4dca-b65c-2d084f62405a admin admin] PATH_INFO: `/v3/users/e4feb14c621b4090af8c965c9aaf0e2d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:47.260449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c051d-c27e-4dca-b65c-2d084f62405a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4feb14c621b4090af8c965c9aaf0e2d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:47.263522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c051d-c27e-4dca-b65c-2d084f62405a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:47.394724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-368c051d-c27e-4dca-b65c-2d084f62405a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4feb14c621b4090af8c965c9aaf0e2d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:47.409313 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-368c051d-c27e-4dca-b65c-2d084f62405a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4feb14c621b4090af8c965c9aaf0e2d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:47.411170 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:47.437978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-368c051d-c27e-4dca-b65c-2d084f62405a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4feb14c621b4090af8c965c9aaf0e2d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:47.439202 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-368c051d-c27e-4dca-b65c-2d084f62405a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4feb14c621b4090af8c965c9aaf0e2d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:47.452939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-368c051d-c27e-4dca-b65c-2d084f62405a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4feb14c621b4090af8c965c9aaf0e2d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:47.463739 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1745/3511] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:22:47 2022] DELETE /identity/v3/users/e4feb14c621b4090af8c965c9aaf0e2d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:22:47.692278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff323df-87a7-4280-b62a-571f571a5c06 service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:47.693866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-aff323df-87a7-4280-b62a-571f571a5c06 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:47.718105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff323df-87a7-4280-b62a-571f571a5c06 service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:47.845402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36560af4-c461-4e4b-8439-4906a8f68e7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:47.847295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36560af4-c461-4e4b-8439-4906a8f68e7c service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:47.847842 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36560af4-c461-4e4b-8439-4906a8f68e7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:47.848496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36560af4-c461-4e4b-8439-4906a8f68e7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:47.852782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-36560af4-c461-4e4b-8439-4906a8f68e7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:48.059444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36560af4-c461-4e4b-8439-4906a8f68e7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:48.066789 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36560af4-c461-4e4b-8439-4906a8f68e7c service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:48.073080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c051d-c27e-4dca-b65c-2d084f62405a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:48.079534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-368c051d-c27e-4dca-b65c-2d084f62405a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:48.098365 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1767/3512] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:22:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:22:48.119778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c051d-c27e-4dca-b65c-2d084f62405a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:48.137130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f305d8-0ebf-4734-a3e4-476e366fc349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:48.139056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f305d8-0ebf-4734-a3e4-476e366fc349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:48.141601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f305d8-0ebf-4734-a3e4-476e366fc349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:48.145505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f305d8-0ebf-4734-a3e4-476e366fc349 admin admin] PATH_INFO: `/v3/projects/b06e7912f1fe423ea1b2a4bcdb90804a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:48.152724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f305d8-0ebf-4734-a3e4-476e366fc349 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b06e7912f1fe423ea1b2a4bcdb90804a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:48.160487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f305d8-0ebf-4734-a3e4-476e366fc349 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:48.315847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-88f305d8-0ebf-4734-a3e4-476e366fc349 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b06e7912f1fe423ea1b2a4bcdb90804a', 'request_id': 'req-88f305d8-0ebf-4734-a3e4-476e366fc349'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:48.345304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-88f305d8-0ebf-4734-a3e4-476e366fc349 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b06e7912f1fe423ea1b2a4bcdb90804a', 'request_id': 'req-88f305d8-0ebf-4734-a3e4-476e366fc349'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:48.378398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-88f305d8-0ebf-4734-a3e4-476e366fc349 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b06e7912f1fe423ea1b2a4bcdb90804a', 'request_id': 'req-88f305d8-0ebf-4734-a3e4-476e366fc349'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:48.409457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-88f305d8-0ebf-4734-a3e4-476e366fc349 admin admin] The token cache is being invalidate because project b06e7912f1fe423ea1b2a4bcdb90804a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:22:48.410044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-88f305d8-0ebf-4734-a3e4-476e366fc349 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:48.411169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-88f305d8-0ebf-4734-a3e4-476e366fc349 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:48.414338 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1746/3513] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:22:48 2022] DELETE /identity/v3/projects/b06e7912f1fe423ea1b2a4bcdb90804a => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:22:48.419824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af37ace-07ba-4d1f-a4b2-903bdec5a4d9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:48.420445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af37ace-07ba-4d1f-a4b2-903bdec5a4d9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:48.420445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af37ace-07ba-4d1f-a4b2-903bdec5a4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:48.445143 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9af37ace-07ba-4d1f-a4b2-903bdec5a4d9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:22:48.446598 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9af37ace-07ba-4d1f-a4b2-903bdec5a4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:48.537402 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1768/3514] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:22:48.546720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10672efb-6ff1-415f-82b2-9ca185d691fb None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:48.547002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10672efb-6ff1-415f-82b2-9ca185d691fb None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:48.547468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10672efb-6ff1-415f-82b2-9ca185d691fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:48.598223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-10672efb-6ff1-415f-82b2-9ca185d691fb None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:22:48.599787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-10672efb-6ff1-415f-82b2-9ca185d691fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:48.613592 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af37ace-07ba-4d1f-a4b2-903bdec5a4d9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:48.614480 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1747/3515] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:22:48.625739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af37ace-07ba-4d1f-a4b2-903bdec5a4d9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:48.631491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9aa7b-0bd2-4840-b867-1271cc5f6ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:48.632446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9aa7b-0bd2-4840-b867-1271cc5f6ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:48.632936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9aa7b-0bd2-4840-b867-1271cc5f6ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:48.633438 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9aa7b-0bd2-4840-b867-1271cc5f6ef8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:48.634384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9aa7b-0bd2-4840-b867-1271cc5f6ef8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:22:48.634893 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9aa7b-0bd2-4840-b867-1271cc5f6ef8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:48.637740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9aa7b-0bd2-4840-b867-1271cc5f6ef8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:48.657795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10672efb-6ff1-415f-82b2-9ca185d691fb None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:48.665559 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1769/3516] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:22:48.672918 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10672efb-6ff1-415f-82b2-9ca185d691fb None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:48.680670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15ed67-3303-4db6-b277-aa94f082d440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:48.681686 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15ed67-3303-4db6-b277-aa94f082d440 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:48.682039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15ed67-3303-4db6-b277-aa94f082d440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:48.682569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15ed67-3303-4db6-b277-aa94f082d440 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:48.684252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15ed67-3303-4db6-b277-aa94f082d440 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:48.686855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15ed67-3303-4db6-b277-aa94f082d440 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:48.735830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9aa7b-0bd2-4840-b867-1271cc5f6ef8 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:48.747942 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1748/3517] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:22:48 2022] POST /identity/v3/projects => generated 399 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:22:48.750856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9aa7b-0bd2-4840-b867-1271cc5f6ef8 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:48.799999 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:48.862682 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8a87f-9166-4446-bac0-e1ab8c61540e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:48.863708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8a87f-9166-4446-bac0-e1ab8c61540e admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:48.864173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8a87f-9166-4446-bac0-e1ab8c61540e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:48.864594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8a87f-9166-4446-bac0-e1ab8c61540e admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:48.865465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e8a87f-9166-4446-bac0-e1ab8c61540e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:48.868488 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e8a87f-9166-4446-bac0-e1ab8c61540e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:48.902895 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1770/3518] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:22:48 2022] POST /identity/v3/users => generated 300 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:22:48.905426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15ed67-3303-4db6-b277-aa94f082d440 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:48.926898 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15ed67-3303-4db6-b277-aa94f082d440 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:48.938749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69709978-1627-4d01-8a5a-4f7c4c0fbe9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:48.939434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69709978-1627-4d01-8a5a-4f7c4c0fbe9c admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:48.939909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69709978-1627-4d01-8a5a-4f7c4c0fbe9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:48.940231 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69709978-1627-4d01-8a5a-4f7c4c0fbe9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:48.940902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69709978-1627-4d01-8a5a-4f7c4c0fbe9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:48.944200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69709978-1627-4d01-8a5a-4f7c4c0fbe9c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:48.961464 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1749/3519] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:22:48.963283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8a87f-9166-4446-bac0-e1ab8c61540e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:48.983417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8a87f-9166-4446-bac0-e1ab8c61540e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:48.990186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75260f-c4cb-4fd5-87ca-cab10e6f8156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:48.990815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75260f-c4cb-4fd5-87ca-cab10e6f8156 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:48.991145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75260f-c4cb-4fd5-87ca-cab10e6f8156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:48.991596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75260f-c4cb-4fd5-87ca-cab10e6f8156 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:48.992522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75260f-c4cb-4fd5-87ca-cab10e6f8156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:48.994421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75260f-c4cb-4fd5-87ca-cab10e6f8156 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:49.008432 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1771/3520] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:22:49.013352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69709978-1627-4d01-8a5a-4f7c4c0fbe9c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:49.027867 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69709978-1627-4d01-8a5a-4f7c4c0fbe9c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:49.034118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0478275-919d-4ad6-9123-dd8285c8fc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:49.035075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0478275-919d-4ad6-9123-dd8285c8fc83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:49.035431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0478275-919d-4ad6-9123-dd8285c8fc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:49.036430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0478275-919d-4ad6-9123-dd8285c8fc83 admin admin] PATH_INFO: `/v3/projects/a7056cca1edc4e60a51a98237d187857/users/07a75cbb3d8a4b4baa361b0444c2370e/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:49.066252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0478275-919d-4ad6-9123-dd8285c8fc83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7056cca1edc4e60a51a98237d187857, user_id=07a75cbb3d8a4b4baa361b0444c2370e, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:49.076811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0478275-919d-4ad6-9123-dd8285c8fc83 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:49.099874 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1750/3521] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:22:49 2022] PUT /identity/v3/projects/a7056cca1edc4e60a51a98237d187857/users/07a75cbb3d8a4b4baa361b0444c2370e/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:22:49.105301 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc453c63-0420-4492-8fde-f94482f702bb None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:49.105815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc453c63-0420-4492-8fde-f94482f702bb None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:49.106300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc453c63-0420-4492-8fde-f94482f702bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:49.134949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-dc453c63-0420-4492-8fde-f94482f702bb None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:22:49.137883 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dc453c63-0420-4492-8fde-f94482f702bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:49.204944 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0478275-919d-4ad6-9123-dd8285c8fc83 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:49.208094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b0478275-919d-4ad6-9123-dd8285c8fc83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:49.352950 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1772/3522] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:22:49.366935 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:49.395790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc453c63-0420-4492-8fde-f94482f702bb None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:49.397424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dc453c63-0420-4492-8fde-f94482f702bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:49.406371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0478275-919d-4ad6-9123-dd8285c8fc83 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:49.421885 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd23af2-81b6-40c5-9875-b554b7cba26a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:49.422718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd23af2-81b6-40c5-9875-b554b7cba26a service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:49.423154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd23af2-81b6-40c5-9875-b554b7cba26a service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:49.423580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd23af2-81b6-40c5-9875-b554b7cba26a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:49.425989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0fd23af2-81b6-40c5-9875-b554b7cba26a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:49.518274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd23af2-81b6-40c5-9875-b554b7cba26a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:49.521952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd23af2-81b6-40c5-9875-b554b7cba26a service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:49.538030 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1751/3523] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:22:49 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:22:49.548404 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc453c63-0420-4492-8fde-f94482f702bb None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:49.554642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1bb29-d13d-42c9-87e7-3f04c23b4e91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:49.555435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1bb29-d13d-42c9-87e7-3f04c23b4e91 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:49.556025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1bb29-d13d-42c9-87e7-3f04c23b4e91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:49.556410 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1bb29-d13d-42c9-87e7-3f04c23b4e91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:49.572839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1bb29-d13d-42c9-87e7-3f04c23b4e91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:49.576553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1bb29-d13d-42c9-87e7-3f04c23b4e91 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:49.593654 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1773/3524] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:22:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:22:52.194153 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36da33b-2d47-4278-af25-bd9d41a8d3d3 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:52.194975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36da33b-2d47-4278-af25-bd9d41a8d3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:52.195298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36da33b-2d47-4278-af25-bd9d41a8d3d3 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:52.197860 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1752/3525] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 01:22:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:22:52.208382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a1518-1a09-44d1-8cf2-27c1152af845 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:52.208875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a1518-1a09-44d1-8cf2-27c1152af845 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:52.209438 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a1518-1a09-44d1-8cf2-27c1152af845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:52.255427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1e8a1518-1a09-44d1-8cf2-27c1152af845 None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:22:52.262311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1e8a1518-1a09-44d1-8cf2-27c1152af845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:52.398962 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:22:52.465470 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1774/3526] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 01:22:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:22:52.487987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36da33b-2d47-4278-af25-bd9d41a8d3d3 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:52.491488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b36da33b-2d47-4278-af25-bd9d41a8d3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:52.525834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36da33b-2d47-4278-af25-bd9d41a8d3d3 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:52.542811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e249d-845d-4f4c-87e7-fcd9acb92044 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:52.543911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e249d-845d-4f4c-87e7-fcd9acb92044 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:52.544363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e249d-845d-4f4c-87e7-fcd9acb92044 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:52.545839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e249d-845d-4f4c-87e7-fcd9acb92044 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:52.566143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e249d-845d-4f4c-87e7-fcd9acb92044 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:52.568889 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e249d-845d-4f4c-87e7-fcd9acb92044 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:52.615700 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1753/3527] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:22:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:22:52.668519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c158c2-cd30-41b1-9f5a-c946ff859e69 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:52.668965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c158c2-cd30-41b1-9f5a-c946ff859e69 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:52.669439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c158c2-cd30-41b1-9f5a-c946ff859e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:52.707409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-57c158c2-cd30-41b1-9f5a-c946ff859e69 None None] MFA Rules not processed for user `51ab58be25a94cd6a59634e7c7cad158`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:22:52.709647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-57c158c2-cd30-41b1-9f5a-c946ff859e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:52.824706 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1775/3528] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:22:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:22:52.984872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e249d-845d-4f4c-87e7-fcd9acb92044 service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:53.014701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e249d-845d-4f4c-87e7-fcd9acb92044 service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:53.029727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3721dc7-92cf-43ef-8dde-fd7a65d21894 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:53.030893 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3721dc7-92cf-43ef-8dde-fd7a65d21894 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:53.031328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3721dc7-92cf-43ef-8dde-fd7a65d21894 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:53.031903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3721dc7-92cf-43ef-8dde-fd7a65d21894 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:53.035208 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f3721dc7-92cf-43ef-8dde-fd7a65d21894 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:53.060746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3721dc7-92cf-43ef-8dde-fd7a65d21894 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:53.064316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3721dc7-92cf-43ef-8dde-fd7a65d21894 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:53.107023 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1754/3529] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:22:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:22:53.584600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c158c2-cd30-41b1-9f5a-c946ff859e69 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:53.602958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c158c2-cd30-41b1-9f5a-c946ff859e69 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:53.610825 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00beb1-4bd5-41d0-98a9-7275666473e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:53.612063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00beb1-4bd5-41d0-98a9-7275666473e8 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:53.612587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00beb1-4bd5-41d0-98a9-7275666473e8 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:53.613103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00beb1-4bd5-41d0-98a9-7275666473e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:53.615657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9a00beb1-4bd5-41d0-98a9-7275666473e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:53.657708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00beb1-4bd5-41d0-98a9-7275666473e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:53.660047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00beb1-4bd5-41d0-98a9-7275666473e8 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:53.696889 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1776/3530] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:22:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:22:54.040940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3721dc7-92cf-43ef-8dde-fd7a65d21894 service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:54.043749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f3721dc7-92cf-43ef-8dde-fd7a65d21894 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:54.063983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3721dc7-92cf-43ef-8dde-fd7a65d21894 service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:54.079012 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00bec5-4ca0-49ad-ae6b-edde83c2dea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:54.079968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00bec5-4ca0-49ad-ae6b-edde83c2dea1 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:54.080249 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00bec5-4ca0-49ad-ae6b-edde83c2dea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:54.080562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00bec5-4ca0-49ad-ae6b-edde83c2dea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:54.089960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cc00bec5-4ca0-49ad-ae6b-edde83c2dea1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:54.143727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00bec5-4ca0-49ad-ae6b-edde83c2dea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:54.146586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00bec5-4ca0-49ad-ae6b-edde83c2dea1 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:54.194364 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1755/3531] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:22:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:22:54.530195 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e772e87-5cab-4328-bee8-34b027c9b44c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:54.531820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e772e87-5cab-4328-bee8-34b027c9b44c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:54.532361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e772e87-5cab-4328-bee8-34b027c9b44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:54.570431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-7e772e87-5cab-4328-bee8-34b027c9b44c None None] MFA Rules not processed for user `d60a6557665a43cda4a64a83c92e2998`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:22:54.576189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7e772e87-5cab-4328-bee8-34b027c9b44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:54.741019 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1777/3532] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:22:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:22:59.614873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00bec5-4ca0-49ad-ae6b-edde83c2dea1 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:22:59.616931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cc00bec5-4ca0-49ad-ae6b-edde83c2dea1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:22:59.646077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00bec5-4ca0-49ad-ae6b-edde83c2dea1 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:22:59.657113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406731b-da23-426e-9d5e-583622891029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:22:59.658043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406731b-da23-426e-9d5e-583622891029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:22:59.658529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406731b-da23-426e-9d5e-583622891029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:22:59.658951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406731b-da23-426e-9d5e-583622891029 admin admin] PATH_INFO: `/v3/users/5041cbc4adc24ae8871d60064720d680` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:22:59.661861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7406731b-da23-426e-9d5e-583622891029 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5041cbc4adc24ae8871d60064720d680)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:22:59.664128 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7406731b-da23-426e-9d5e-583622891029 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:22:59.786199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7406731b-da23-426e-9d5e-583622891029 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5041cbc4adc24ae8871d60064720d680'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:59.820702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7406731b-da23-426e-9d5e-583622891029 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5041cbc4adc24ae8871d60064720d680'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:59.873067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7406731b-da23-426e-9d5e-583622891029 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5041cbc4adc24ae8871d60064720d680'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:59.876666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7406731b-da23-426e-9d5e-583622891029 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5041cbc4adc24ae8871d60064720d680'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:59.898059 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7406731b-da23-426e-9d5e-583622891029 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5041cbc4adc24ae8871d60064720d680'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:22:59.916411 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1756/3533] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:22:59 2022] DELETE /identity/v3/users/5041cbc4adc24ae8871d60064720d680 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:02.183389 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e772e87-5cab-4328-bee8-34b027c9b44c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:02.201428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e772e87-5cab-4328-bee8-34b027c9b44c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:02.303863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46d4d8-505f-4756-9b92-a121abceb4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:02.304983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46d4d8-505f-4756-9b92-a121abceb4e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:02.305431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46d4d8-505f-4756-9b92-a121abceb4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:02.305921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46d4d8-505f-4756-9b92-a121abceb4e1 admin admin] PATH_INFO: `/v3/projects/afc8a87d755a42239e9d4572e4bf2f2d` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:02.308079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46d4d8-505f-4756-9b92-a121abceb4e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afc8a87d755a42239e9d4572e4bf2f2d)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:02.312653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46d4d8-505f-4756-9b92-a121abceb4e1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:02.421968 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:02.450837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8f46d4d8-505f-4756-9b92-a121abceb4e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afc8a87d755a42239e9d4572e4bf2f2d', 'request_id': 'req-8f46d4d8-505f-4756-9b92-a121abceb4e1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:02.460209 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8f46d4d8-505f-4756-9b92-a121abceb4e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afc8a87d755a42239e9d4572e4bf2f2d', 'request_id': 'req-8f46d4d8-505f-4756-9b92-a121abceb4e1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:02.477687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8f46d4d8-505f-4756-9b92-a121abceb4e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afc8a87d755a42239e9d4572e4bf2f2d', 'request_id': 'req-8f46d4d8-505f-4756-9b92-a121abceb4e1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:02.510779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8f46d4d8-505f-4756-9b92-a121abceb4e1 admin admin] The token cache is being invalidate because project afc8a87d755a42239e9d4572e4bf2f2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:23:02.511117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8f46d4d8-505f-4756-9b92-a121abceb4e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:02.513920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8f46d4d8-505f-4756-9b92-a121abceb4e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:02.516369 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1778/3534] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:23:02 2022] DELETE /identity/v3/projects/afc8a87d755a42239e9d4572e4bf2f2d => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:02.522908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eee5a3-c63d-4943-9015-45ac4c8cebbf None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:02.523772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eee5a3-c63d-4943-9015-45ac4c8cebbf None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:02.524279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eee5a3-c63d-4943-9015-45ac4c8cebbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:02.581132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e6eee5a3-c63d-4943-9015-45ac4c8cebbf None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:02.582397 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e6eee5a3-c63d-4943-9015-45ac4c8cebbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:02.616296 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:02.741372 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1757/3535] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:23:02.749250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a612847-26d4-4f51-9fbb-7f9ac925f438 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:02.749728 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a612847-26d4-4f51-9fbb-7f9ac925f438 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:02.750156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a612847-26d4-4f51-9fbb-7f9ac925f438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:02.824544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9a612847-26d4-4f51-9fbb-7f9ac925f438 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:02.827505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9a612847-26d4-4f51-9fbb-7f9ac925f438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:02.873803 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1779/3536] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:23:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:23:02.877921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eee5a3-c63d-4943-9015-45ac4c8cebbf None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:02.892449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eee5a3-c63d-4943-9015-45ac4c8cebbf None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:02.906874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06a52a-2a1b-461f-b507-5fb5697d9b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:02.907410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06a52a-2a1b-461f-b507-5fb5697d9b80 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:02.907687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06a52a-2a1b-461f-b507-5fb5697d9b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:02.908158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06a52a-2a1b-461f-b507-5fb5697d9b80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:02.908983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06a52a-2a1b-461f-b507-5fb5697d9b80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:23:02.909903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06a52a-2a1b-461f-b507-5fb5697d9b80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:02.911541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06a52a-2a1b-461f-b507-5fb5697d9b80 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:02.938987 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1758/3537] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:23:02.946267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a612847-26d4-4f51-9fbb-7f9ac925f438 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:02.964043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a612847-26d4-4f51-9fbb-7f9ac925f438 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:02.973017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f71a63-afbf-4158-8d26-60feb3c8691d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:02.974975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f71a63-afbf-4158-8d26-60feb3c8691d admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:02.977608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f71a63-afbf-4158-8d26-60feb3c8691d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:02.978230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f71a63-afbf-4158-8d26-60feb3c8691d admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:02.979125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f71a63-afbf-4158-8d26-60feb3c8691d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:02.981984 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f71a63-afbf-4158-8d26-60feb3c8691d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:03.073194 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1780/3538] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:23:02 2022] POST /identity/v3/projects => generated 411 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:23:03.076168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06a52a-2a1b-461f-b507-5fb5697d9b80 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:03.097000 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06a52a-2a1b-461f-b507-5fb5697d9b80 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:03.179461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618e071-5e20-47d2-b7ff-1940fa59631a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:03.180293 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618e071-5e20-47d2-b7ff-1940fa59631a admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:03.180896 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618e071-5e20-47d2-b7ff-1940fa59631a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:03.181322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618e071-5e20-47d2-b7ff-1940fa59631a admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:03.182773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618e071-5e20-47d2-b7ff-1940fa59631a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:03.184940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618e071-5e20-47d2-b7ff-1940fa59631a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:03.241444 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1759/3539] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:23:03 2022] POST /identity/v3/users => generated 306 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:23:03.245487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f71a63-afbf-4158-8d26-60feb3c8691d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:03.271533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f71a63-afbf-4158-8d26-60feb3c8691d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:03.293846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c1a77-c091-4a9a-9854-54d8a51bbd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:03.294736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c1a77-c091-4a9a-9854-54d8a51bbd58 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:03.296595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c1a77-c091-4a9a-9854-54d8a51bbd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:03.297060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c1a77-c091-4a9a-9854-54d8a51bbd58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:03.298038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c1a77-c091-4a9a-9854-54d8a51bbd58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:03.300984 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c1a77-c091-4a9a-9854-54d8a51bbd58 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:03.364431 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1781/3540] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:23:03.369650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618e071-5e20-47d2-b7ff-1940fa59631a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:03.387059 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618e071-5e20-47d2-b7ff-1940fa59631a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:03.400271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334fdf3-4631-4ca6-957e-98302f7c64ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:03.402034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334fdf3-4631-4ca6-957e-98302f7c64ec admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:03.405136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334fdf3-4631-4ca6-957e-98302f7c64ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:03.405725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334fdf3-4631-4ca6-957e-98302f7c64ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:03.407348 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d334fdf3-4631-4ca6-957e-98302f7c64ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:03.414226 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d334fdf3-4631-4ca6-957e-98302f7c64ec admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:03.471297 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1760/3541] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:23:03.474901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c1a77-c091-4a9a-9854-54d8a51bbd58 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:03.520396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c1a77-c091-4a9a-9854-54d8a51bbd58 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:03.535768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d167d7a-23fe-48a2-b12f-992b56026ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:03.537170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d167d7a-23fe-48a2-b12f-992b56026ed3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:03.537645 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d167d7a-23fe-48a2-b12f-992b56026ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:03.538106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d167d7a-23fe-48a2-b12f-992b56026ed3 admin admin] PATH_INFO: `/v3/projects/4e24336f2ab84adda758d98cbb785888/users/58a40e444e92495c917f58fbcec63c8c/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:03.567655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d167d7a-23fe-48a2-b12f-992b56026ed3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e24336f2ab84adda758d98cbb785888, user_id=58a40e444e92495c917f58fbcec63c8c, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:03.572430 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d167d7a-23fe-48a2-b12f-992b56026ed3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:03.599190 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1782/3542] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:23:03 2022] PUT /identity/v3/projects/4e24336f2ab84adda758d98cbb785888/users/58a40e444e92495c917f58fbcec63c8c/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:03.607611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f97fc3-8a0d-40f0-87b8-f981eae7d847 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:03.608646 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f97fc3-8a0d-40f0-87b8-f981eae7d847 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:03.610464 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f97fc3-8a0d-40f0-87b8-f981eae7d847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:03.642768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c1f97fc3-8a0d-40f0-87b8-f981eae7d847 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:03.644712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c1f97fc3-8a0d-40f0-87b8-f981eae7d847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:03.807985 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1761/3543] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:23:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:23:03.955480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d167d7a-23fe-48a2-b12f-992b56026ed3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:03.957377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2d167d7a-23fe-48a2-b12f-992b56026ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:04.257579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d167d7a-23fe-48a2-b12f-992b56026ed3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:04.283713 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d57e3-b402-4ed3-b612-725dcd74ce09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:04.284420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d57e3-b402-4ed3-b612-725dcd74ce09 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:04.284777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d57e3-b402-4ed3-b612-725dcd74ce09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:04.285082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d57e3-b402-4ed3-b612-725dcd74ce09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:04.336540 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d57e3-b402-4ed3-b612-725dcd74ce09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:04.350975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d57e3-b402-4ed3-b612-725dcd74ce09 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:04.388628 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1783/3544] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:23:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:23:12.470175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f97fc3-8a0d-40f0-87b8-f981eae7d847 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:12.472248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c1f97fc3-8a0d-40f0-87b8-f981eae7d847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:12.573084 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:12.654438 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d57e3-b402-4ed3-b612-725dcd74ce09 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:12.657445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5d4d57e3-b402-4ed3-b612-725dcd74ce09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:12.731294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d57e3-b402-4ed3-b612-725dcd74ce09 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:12.749895 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60930b57-f421-422d-a51a-cefbe6442be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:12.752734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60930b57-f421-422d-a51a-cefbe6442be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:12.752999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60930b57-f421-422d-a51a-cefbe6442be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:12.753331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60930b57-f421-422d-a51a-cefbe6442be9 admin admin] PATH_INFO: `/v3/users/d4f7282c7251455086368d5274a4fac5` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:12.757756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60930b57-f421-422d-a51a-cefbe6442be9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4f7282c7251455086368d5274a4fac5)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:12.765618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60930b57-f421-422d-a51a-cefbe6442be9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:12.790417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f97fc3-8a0d-40f0-87b8-f981eae7d847 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:12.812666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b90ba-7b80-49eb-a0d9-8a360df8a37b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:12.823188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b90ba-7b80-49eb-a0d9-8a360df8a37b service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:12.825902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b90ba-7b80-49eb-a0d9-8a360df8a37b service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:12.826468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b90ba-7b80-49eb-a0d9-8a360df8a37b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:12.835432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9a9b90ba-7b80-49eb-a0d9-8a360df8a37b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:12.880103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b90ba-7b80-49eb-a0d9-8a360df8a37b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:12.886309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b90ba-7b80-49eb-a0d9-8a360df8a37b service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:12.924276 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1762/3545] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:23:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:23:12.961512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-60930b57-f421-422d-a51a-cefbe6442be9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4f7282c7251455086368d5274a4fac5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:12.978953 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:12.985677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-60930b57-f421-422d-a51a-cefbe6442be9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4f7282c7251455086368d5274a4fac5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:13.029993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-60930b57-f421-422d-a51a-cefbe6442be9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4f7282c7251455086368d5274a4fac5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:13.031373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-60930b57-f421-422d-a51a-cefbe6442be9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4f7282c7251455086368d5274a4fac5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:13.052321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-60930b57-f421-422d-a51a-cefbe6442be9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4f7282c7251455086368d5274a4fac5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:13.090310 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1784/3546] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:23:12 2022] DELETE /identity/v3/users/d4f7282c7251455086368d5274a4fac5 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:14.133648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913b81f-9493-4a37-aa6c-21ca4da63f73 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:14.134169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913b81f-9493-4a37-aa6c-21ca4da63f73 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:14.135899 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913b81f-9493-4a37-aa6c-21ca4da63f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:14.231272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b913b81f-9493-4a37-aa6c-21ca4da63f73 None None] MFA Rules not processed for user `ef29bd35cca547c39d76c54058d32979`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:14.236450 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b913b81f-9493-4a37-aa6c-21ca4da63f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:14.415234 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1763/3547] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:23:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:23:14.592946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60930b57-f421-422d-a51a-cefbe6442be9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:14.594614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-60930b57-f421-422d-a51a-cefbe6442be9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:14.706599 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913b81f-9493-4a37-aa6c-21ca4da63f73 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:14.708521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b913b81f-9493-4a37-aa6c-21ca4da63f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:14.789701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60930b57-f421-422d-a51a-cefbe6442be9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:14.809837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2773c2-ef6b-4afc-a181-892e02d7f1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:14.810850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2773c2-ef6b-4afc-a181-892e02d7f1ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:14.811326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2773c2-ef6b-4afc-a181-892e02d7f1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:14.811808 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2773c2-ef6b-4afc-a181-892e02d7f1ec admin admin] PATH_INFO: `/v3/projects/efad066360cb45b3a6e9ba872118ea57` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:14.813286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2773c2-ef6b-4afc-a181-892e02d7f1ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=efad066360cb45b3a6e9ba872118ea57)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:14.825835 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2773c2-ef6b-4afc-a181-892e02d7f1ec admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:14.941316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8e2773c2-ef6b-4afc-a181-892e02d7f1ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efad066360cb45b3a6e9ba872118ea57', 'request_id': 'req-8e2773c2-ef6b-4afc-a181-892e02d7f1ec'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:14.974086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8e2773c2-ef6b-4afc-a181-892e02d7f1ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efad066360cb45b3a6e9ba872118ea57', 'request_id': 'req-8e2773c2-ef6b-4afc-a181-892e02d7f1ec'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:14.977313 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913b81f-9493-4a37-aa6c-21ca4da63f73 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:14.991479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8e2773c2-ef6b-4afc-a181-892e02d7f1ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efad066360cb45b3a6e9ba872118ea57', 'request_id': 'req-8e2773c2-ef6b-4afc-a181-892e02d7f1ec'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:15.034397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8e2773c2-ef6b-4afc-a181-892e02d7f1ec admin admin] The token cache is being invalidate because project efad066360cb45b3a6e9ba872118ea57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:23:15.034613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8e2773c2-ef6b-4afc-a181-892e02d7f1ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:15.046299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8e2773c2-ef6b-4afc-a181-892e02d7f1ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:15.049930 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1785/3548] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:23:14 2022] DELETE /identity/v3/projects/efad066360cb45b3a6e9ba872118ea57 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:15.059508 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a674d-0004-4a6b-b6ae-48648c7d6bee None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:15.060116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a674d-0004-4a6b-b6ae-48648c7d6bee None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:15.060548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a674d-0004-4a6b-b6ae-48648c7d6bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:15.125142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-df2a674d-0004-4a6b-b6ae-48648c7d6bee None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:15.129097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-df2a674d-0004-4a6b-b6ae-48648c7d6bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:15.139127 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:15.199943 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c1c5d-39a2-46f7-a1b8-417c004aa03f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:15.200582 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c1c5d-39a2-46f7-a1b8-417c004aa03f service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:15.200858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c1c5d-39a2-46f7-a1b8-417c004aa03f service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:15.201307 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c1c5d-39a2-46f7-a1b8-417c004aa03f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:15.203345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-544c1c5d-39a2-46f7-a1b8-417c004aa03f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:15.235587 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:15.252746 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1786/3549] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:23:15.260906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8ce8e-48d5-4700-bcbc-0907fe0db08a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:15.261710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8ce8e-48d5-4700-bcbc-0907fe0db08a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:15.262293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8ce8e-48d5-4700-bcbc-0907fe0db08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:15.335764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2cc8ce8e-48d5-4700-bcbc-0907fe0db08a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:15.342768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2cc8ce8e-48d5-4700-bcbc-0907fe0db08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:15.367710 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1787/3550] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:23:15.372617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8ce8e-48d5-4700-bcbc-0907fe0db08a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:15.387987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8ce8e-48d5-4700-bcbc-0907fe0db08a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:15.396791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899de1d-30d8-4350-a58f-8ed5bfd21765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:15.398343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899de1d-30d8-4350-a58f-8ed5bfd21765 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:15.398343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899de1d-30d8-4350-a58f-8ed5bfd21765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:15.398343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899de1d-30d8-4350-a58f-8ed5bfd21765 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:15.399768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c1c5d-39a2-46f7-a1b8-417c004aa03f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:15.400213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899de1d-30d8-4350-a58f-8ed5bfd21765 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:23:15.401198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899de1d-30d8-4350-a58f-8ed5bfd21765 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:15.402367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c1c5d-39a2-46f7-a1b8-417c004aa03f service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:15.406465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899de1d-30d8-4350-a58f-8ed5bfd21765 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:15.429097 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1788/3551] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:23:15.430160 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1764/3552] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:23:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 724 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:23:15.434529 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899de1d-30d8-4350-a58f-8ed5bfd21765 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:15.454962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899de1d-30d8-4350-a58f-8ed5bfd21765 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:15.484956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5aa9f4-18ff-4d39-97c5-2a5d9157c9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:15.485876 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a2a07-922d-4cb5-b140-9a3390e83a26 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:15.486161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a2a07-922d-4cb5-b140-9a3390e83a26 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:15.486442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a2a07-922d-4cb5-b140-9a3390e83a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:15.487956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5aa9f4-18ff-4d39-97c5-2a5d9157c9ac admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:15.488420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5aa9f4-18ff-4d39-97c5-2a5d9157c9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:15.488526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5aa9f4-18ff-4d39-97c5-2a5d9157c9ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:15.492020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5aa9f4-18ff-4d39-97c5-2a5d9157c9ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:15.501033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5aa9f4-18ff-4d39-97c5-2a5d9157c9ac admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:15.542669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-631a2a07-922d-4cb5-b140-9a3390e83a26 None None] MFA Rules not processed for user `07a75cbb3d8a4b4baa361b0444c2370e`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:15.545871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-631a2a07-922d-4cb5-b140-9a3390e83a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:15.609042 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1789/3553] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:23:15 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:23:15.616649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5aa9f4-18ff-4d39-97c5-2a5d9157c9ac admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:15.702352 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1765/3554] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:23:15 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:23:15.712483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a60e69-cf4a-43ab-824e-08d099170795 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:15.712761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a60e69-cf4a-43ab-824e-08d099170795 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:15.713552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a60e69-cf4a-43ab-824e-08d099170795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:15.757168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-18a60e69-cf4a-43ab-824e-08d099170795 None None] MFA Rules not processed for user `07a75cbb3d8a4b4baa361b0444c2370e`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:15.758420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-18a60e69-cf4a-43ab-824e-08d099170795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:15.771771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5aa9f4-18ff-4d39-97c5-2a5d9157c9ac admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:15.778533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734163e8-778e-45e2-8ce2-05101eafe9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:15.779688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734163e8-778e-45e2-8ce2-05101eafe9b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:15.780214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734163e8-778e-45e2-8ce2-05101eafe9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:15.780707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734163e8-778e-45e2-8ce2-05101eafe9b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:15.781836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734163e8-778e-45e2-8ce2-05101eafe9b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:15.784104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734163e8-778e-45e2-8ce2-05101eafe9b0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:15.830848 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1790/3555] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:23:15 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:23:15.833985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734163e8-778e-45e2-8ce2-05101eafe9b0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:15.856310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734163e8-778e-45e2-8ce2-05101eafe9b0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:15.871554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810b363-2ad6-4fe5-941c-ba67f7bfe508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:15.872621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810b363-2ad6-4fe5-941c-ba67f7bfe508 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:15.873124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810b363-2ad6-4fe5-941c-ba67f7bfe508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:15.873910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810b363-2ad6-4fe5-941c-ba67f7bfe508 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:15.874862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3810b363-2ad6-4fe5-941c-ba67f7bfe508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:15.878344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3810b363-2ad6-4fe5-941c-ba67f7bfe508 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:15.910686 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1791/3556] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:23:15.930942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810b363-2ad6-4fe5-941c-ba67f7bfe508 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:15.944101 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1766/3557] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:23:15 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:23:15.945366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810b363-2ad6-4fe5-941c-ba67f7bfe508 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:15.960866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787cd69f-5afa-42bc-b0f0-dd9a215f05c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:15.962295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cd69f-5afa-42bc-b0f0-dd9a215f05c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:15.962295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cd69f-5afa-42bc-b0f0-dd9a215f05c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:15.962295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787cd69f-5afa-42bc-b0f0-dd9a215f05c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:15.968800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787cd69f-5afa-42bc-b0f0-dd9a215f05c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:15.970575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787cd69f-5afa-42bc-b0f0-dd9a215f05c1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:16.011540 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1792/3558] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:23:16.011940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a60e69-cf4a-43ab-824e-08d099170795 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:16.031343 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a60e69-cf4a-43ab-824e-08d099170795 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:16.046221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ddae4-773b-4f86-8ff1-9f9596e6ebca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:16.047408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ddae4-773b-4f86-8ff1-9f9596e6ebca admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:16.047698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ddae4-773b-4f86-8ff1-9f9596e6ebca admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:16.047997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ddae4-773b-4f86-8ff1-9f9596e6ebca admin admin] PATH_INFO: `/v3/projects/3e033f826a784e72a57e827ab964c012/users/bf6105148497448381fc2eb092a6eb94/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:16.084846 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:16.086773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ddae4-773b-4f86-8ff1-9f9596e6ebca admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e033f826a784e72a57e827ab964c012, user_id=bf6105148497448381fc2eb092a6eb94, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:16.090120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ddae4-773b-4f86-8ff1-9f9596e6ebca admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:16.122901 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1767/3559] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:23:16 2022] PUT /identity/v3/projects/3e033f826a784e72a57e827ab964c012/users/bf6105148497448381fc2eb092a6eb94/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:16.136303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d16eab-34de-4042-9aed-c96ebde54ca0 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:16.136303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d16eab-34de-4042-9aed-c96ebde54ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:16.136588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d16eab-34de-4042-9aed-c96ebde54ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:16.192451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-17d16eab-34de-4042-9aed-c96ebde54ca0 None None] MFA Rules not processed for user `bf6105148497448381fc2eb092a6eb94`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:16.194916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-17d16eab-34de-4042-9aed-c96ebde54ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:16.336168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ddae4-773b-4f86-8ff1-9f9596e6ebca admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:16.338644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-252ddae4-773b-4f86-8ff1-9f9596e6ebca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:16.448385 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1793/3560] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:23:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:23:16.535510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ddae4-773b-4f86-8ff1-9f9596e6ebca admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:16.552043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed37441-0173-404e-a1f9-6d345afa8dcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:16.552769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed37441-0173-404e-a1f9-6d345afa8dcd service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:16.553071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed37441-0173-404e-a1f9-6d345afa8dcd service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:16.556548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed37441-0173-404e-a1f9-6d345afa8dcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:16.737648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed37441-0173-404e-a1f9-6d345afa8dcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:16.744588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed37441-0173-404e-a1f9-6d345afa8dcd service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:16.779443 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1768/3561] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:23:16 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:23:17.082042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d16eab-34de-4042-9aed-c96ebde54ca0 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:17.083592 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-17d16eab-34de-4042-9aed-c96ebde54ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:17.129709 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d16eab-34de-4042-9aed-c96ebde54ca0 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:17.151633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550baac7-1e20-4637-b48f-721cb22cce93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:17.155108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550baac7-1e20-4637-b48f-721cb22cce93 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:17.155965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550baac7-1e20-4637-b48f-721cb22cce93 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:17.156286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550baac7-1e20-4637-b48f-721cb22cce93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:17.184559 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550baac7-1e20-4637-b48f-721cb22cce93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:17.186395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550baac7-1e20-4637-b48f-721cb22cce93 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:17.217010 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1794/3562] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:23:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:23:25.489463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c75839-93fd-47c5-a811-2b7f2d5d7cea None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:25.490099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c75839-93fd-47c5-a811-2b7f2d5d7cea None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:25.490099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c75839-93fd-47c5-a811-2b7f2d5d7cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:25.523638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-36c75839-93fd-47c5-a811-2b7f2d5d7cea None None] MFA Rules not processed for user `ef29bd35cca547c39d76c54058d32979`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:25.526901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-36c75839-93fd-47c5-a811-2b7f2d5d7cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:25.593792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba029d9f-89bb-443e-8691-191ceac37591 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:25.594327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba029d9f-89bb-443e-8691-191ceac37591 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:25.594409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba029d9f-89bb-443e-8691-191ceac37591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:25.603143 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:25.659313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ba029d9f-89bb-443e-8691-191ceac37591 None None] MFA Rules not processed for user `58a40e444e92495c917f58fbcec63c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:25.661204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ba029d9f-89bb-443e-8691-191ceac37591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:25.741216 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1769/3563] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:23:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:23:25.838743 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1795/3564] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:23:25 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:23:25.855878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42c9a8-f7c3-441c-a55b-af2fb2251df4 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:25.856252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42c9a8-f7c3-441c-a55b-af2fb2251df4 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:25.856440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42c9a8-f7c3-441c-a55b-af2fb2251df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:25.933086 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-da42c9a8-f7c3-441c-a55b-af2fb2251df4 None None] MFA Rules not processed for user `58a40e444e92495c917f58fbcec63c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:25.936090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-da42c9a8-f7c3-441c-a55b-af2fb2251df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:25.961477 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1770/3565] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:23:25 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:23:26.375995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba029d9f-89bb-443e-8691-191ceac37591 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:26.401844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba029d9f-89bb-443e-8691-191ceac37591 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:26.419779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0bd16f-63da-45f3-b6a9-51cd03539225 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:26.420826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bd16f-63da-45f3-b6a9-51cd03539225 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:26.421817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bd16f-63da-45f3-b6a9-51cd03539225 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:26.422459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0bd16f-63da-45f3-b6a9-51cd03539225 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:26.452388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0bd16f-63da-45f3-b6a9-51cd03539225 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:26.455171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0bd16f-63da-45f3-b6a9-51cd03539225 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:26.480086 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1796/3566] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:23:26 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:23:35.686814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42c9a8-f7c3-441c-a55b-af2fb2251df4 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:35.716589 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:35.764656 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42c9a8-f7c3-441c-a55b-af2fb2251df4 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:35.770182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c8377-a10f-45aa-9091-7b3c8ba90132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:35.770835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c8377-a10f-45aa-9091-7b3c8ba90132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:35.771113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c8377-a10f-45aa-9091-7b3c8ba90132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:35.771385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c8377-a10f-45aa-9091-7b3c8ba90132 admin admin] PATH_INFO: `/v3/users/bf6105148497448381fc2eb092a6eb94` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:35.773515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c8377-a10f-45aa-9091-7b3c8ba90132 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf6105148497448381fc2eb092a6eb94)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:35.776056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c8377-a10f-45aa-9091-7b3c8ba90132 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:35.843210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ba9c8377-a10f-45aa-9091-7b3c8ba90132 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf6105148497448381fc2eb092a6eb94'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:35.852672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ba9c8377-a10f-45aa-9091-7b3c8ba90132 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf6105148497448381fc2eb092a6eb94'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:35.866895 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ba9c8377-a10f-45aa-9091-7b3c8ba90132 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf6105148497448381fc2eb092a6eb94'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:35.868007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ba9c8377-a10f-45aa-9091-7b3c8ba90132 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf6105148497448381fc2eb092a6eb94'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:35.877885 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ba9c8377-a10f-45aa-9091-7b3c8ba90132 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf6105148497448381fc2eb092a6eb94'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:35.890043 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1771/3567] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:23:35 2022] DELETE /identity/v3/users/bf6105148497448381fc2eb092a6eb94 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:35.891466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8d7f2-f8cb-488e-b479-d446d3ffe5ae None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:35.891977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8d7f2-f8cb-488e-b479-d446d3ffe5ae None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:35.892067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8d7f2-f8cb-488e-b479-d446d3ffe5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:35.923416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-34c8d7f2-f8cb-488e-b479-d446d3ffe5ae None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:35.925061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-34c8d7f2-f8cb-488e-b479-d446d3ffe5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:36.061177 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1797/3568] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:23:36.090876 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c8377-a10f-45aa-9091-7b3c8ba90132 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:36.093407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ba9c8377-a10f-45aa-9091-7b3c8ba90132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:36.266101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c8377-a10f-45aa-9091-7b3c8ba90132 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:36.271210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e344d-b45a-47cb-ba5f-faed3837aa4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:36.277771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e344d-b45a-47cb-ba5f-faed3837aa4b service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:36.278219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e344d-b45a-47cb-ba5f-faed3837aa4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:36.279964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e344d-b45a-47cb-ba5f-faed3837aa4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:36.305826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e344d-b45a-47cb-ba5f-faed3837aa4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:36.308603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e344d-b45a-47cb-ba5f-faed3837aa4b service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:36.350509 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1772/3569] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:23:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:23:37.409368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8d7f2-f8cb-488e-b479-d446d3ffe5ae None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:37.411433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-34c8d7f2-f8cb-488e-b479-d446d3ffe5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:37.426281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8d7f2-f8cb-488e-b479-d446d3ffe5ae None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:37.432666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091e027-22f1-4a19-91be-fb8ea860e06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:37.433317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091e027-22f1-4a19-91be-fb8ea860e06c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:37.433594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091e027-22f1-4a19-91be-fb8ea860e06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:37.434055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091e027-22f1-4a19-91be-fb8ea860e06c admin admin] PATH_INFO: `/v3/projects/3e033f826a784e72a57e827ab964c012` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:37.436721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a091e027-22f1-4a19-91be-fb8ea860e06c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e033f826a784e72a57e827ab964c012)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:37.439998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a091e027-22f1-4a19-91be-fb8ea860e06c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:37.517037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a091e027-22f1-4a19-91be-fb8ea860e06c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e033f826a784e72a57e827ab964c012', 'request_id': 'req-a091e027-22f1-4a19-91be-fb8ea860e06c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:37.528526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a091e027-22f1-4a19-91be-fb8ea860e06c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e033f826a784e72a57e827ab964c012', 'request_id': 'req-a091e027-22f1-4a19-91be-fb8ea860e06c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:37.536350 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a091e027-22f1-4a19-91be-fb8ea860e06c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e033f826a784e72a57e827ab964c012', 'request_id': 'req-a091e027-22f1-4a19-91be-fb8ea860e06c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:37.555757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a091e027-22f1-4a19-91be-fb8ea860e06c admin admin] The token cache is being invalidate because project 3e033f826a784e72a57e827ab964c012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:23:37.556196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a091e027-22f1-4a19-91be-fb8ea860e06c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:37.557006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a091e027-22f1-4a19-91be-fb8ea860e06c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:37.559742 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1798/3570] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:23:37 2022] DELETE /identity/v3/projects/3e033f826a784e72a57e827ab964c012 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:37.566044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94d691-6e1a-404f-a9d5-821bfa643559 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:37.566577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94d691-6e1a-404f-a9d5-821bfa643559 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:37.566577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94d691-6e1a-404f-a9d5-821bfa643559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:37.591167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-aa94d691-6e1a-404f-a9d5-821bfa643559 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:37.592426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-aa94d691-6e1a-404f-a9d5-821bfa643559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:37.659230 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:37.686310 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1773/3571] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:23:37.694296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e477dad-5881-48dc-ab22-757d71b84b21 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:37.695362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e477dad-5881-48dc-ab22-757d71b84b21 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:37.695652 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e477dad-5881-48dc-ab22-757d71b84b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:37.716371 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:37.749183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9e477dad-5881-48dc-ab22-757d71b84b21 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:37.756208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9e477dad-5881-48dc-ab22-757d71b84b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:37.776663 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1799/3572] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:23:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:23:37.781302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94d691-6e1a-404f-a9d5-821bfa643559 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:37.798165 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94d691-6e1a-404f-a9d5-821bfa643559 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:37.814997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae4ad9-965b-4d76-b236-d408935accbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:37.816578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae4ad9-965b-4d76-b236-d408935accbb admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:37.817181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae4ad9-965b-4d76-b236-d408935accbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:37.817968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae4ad9-965b-4d76-b236-d408935accbb admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:37.819423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae4ad9-965b-4d76-b236-d408935accbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:23:37.819981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae4ad9-965b-4d76-b236-d408935accbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:37.823023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae4ad9-965b-4d76-b236-d408935accbb admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:37.849030 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1774/3573] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:23:37.849722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e477dad-5881-48dc-ab22-757d71b84b21 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:37.866657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e477dad-5881-48dc-ab22-757d71b84b21 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:37.876297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e65484-b85c-461b-ba82-55ea8a85957e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:37.878238 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e65484-b85c-461b-ba82-55ea8a85957e admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:37.880153 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e65484-b85c-461b-ba82-55ea8a85957e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:37.880674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e65484-b85c-461b-ba82-55ea8a85957e admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:37.881552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e65484-b85c-461b-ba82-55ea8a85957e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:37.885584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e65484-b85c-461b-ba82-55ea8a85957e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:37.939546 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1800/3574] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:23:37 2022] POST /identity/v3/projects => generated 389 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:23:37.944033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae4ad9-965b-4d76-b236-d408935accbb admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:37.975134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae4ad9-965b-4d76-b236-d408935accbb admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:38.103632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a879ade-c1ef-4a8f-97b6-1fedc172b38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:38.104420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a879ade-c1ef-4a8f-97b6-1fedc172b38e admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:38.104709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a879ade-c1ef-4a8f-97b6-1fedc172b38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:38.105175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a879ade-c1ef-4a8f-97b6-1fedc172b38e admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:38.105832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a879ade-c1ef-4a8f-97b6-1fedc172b38e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:38.107907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a879ade-c1ef-4a8f-97b6-1fedc172b38e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:38.141532 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1775/3575] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:23:37 2022] POST /identity/v3/users => generated 295 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:23:38.145076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e65484-b85c-461b-ba82-55ea8a85957e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:38.159280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e65484-b85c-461b-ba82-55ea8a85957e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:38.166362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450e9af-6a8c-4267-ad11-197180a76bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:38.167417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450e9af-6a8c-4267-ad11-197180a76bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:38.167980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450e9af-6a8c-4267-ad11-197180a76bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:38.168200 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450e9af-6a8c-4267-ad11-197180a76bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:38.169025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450e9af-6a8c-4267-ad11-197180a76bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:38.170782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450e9af-6a8c-4267-ad11-197180a76bb8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:38.189698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a879ade-c1ef-4a8f-97b6-1fedc172b38e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:38.197623 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1801/3576] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:23:38.202267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a879ade-c1ef-4a8f-97b6-1fedc172b38e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:38.208152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a246d2-f9c8-47af-af4b-24e79da3ea87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:38.209353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a246d2-f9c8-47af-af4b-24e79da3ea87 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:38.209353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a246d2-f9c8-47af-af4b-24e79da3ea87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:38.209806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a246d2-f9c8-47af-af4b-24e79da3ea87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:38.210585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a246d2-f9c8-47af-af4b-24e79da3ea87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:38.212513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a246d2-f9c8-47af-af4b-24e79da3ea87 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:38.267877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450e9af-6a8c-4267-ad11-197180a76bb8 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:38.275304 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1776/3577] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:23:38.297048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450e9af-6a8c-4267-ad11-197180a76bb8 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:38.304435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef9340-16c1-48d2-8602-05128f887408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:38.304687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef9340-16c1-48d2-8602-05128f887408 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:38.305011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef9340-16c1-48d2-8602-05128f887408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:38.305335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef9340-16c1-48d2-8602-05128f887408 admin admin] PATH_INFO: `/v3/projects/31669accef6a44ceba05c3bdda6cbb08/users/60f26f45190e47049fa9bd97a70f6fb5/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:38.333702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef9340-16c1-48d2-8602-05128f887408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31669accef6a44ceba05c3bdda6cbb08, user_id=60f26f45190e47049fa9bd97a70f6fb5, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:38.336716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef9340-16c1-48d2-8602-05128f887408 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:38.364318 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1802/3578] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:23:38 2022] PUT /identity/v3/projects/31669accef6a44ceba05c3bdda6cbb08/users/60f26f45190e47049fa9bd97a70f6fb5/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:38.366647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566f836-65e8-4b47-9d8c-087646a4ad50 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:38.366647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566f836-65e8-4b47-9d8c-087646a4ad50 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:38.366647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566f836-65e8-4b47-9d8c-087646a4ad50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:38.406185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2566f836-65e8-4b47-9d8c-087646a4ad50 None None] MFA Rules not processed for user `60f26f45190e47049fa9bd97a70f6fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:38.407345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2566f836-65e8-4b47-9d8c-087646a4ad50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:38.531191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef9340-16c1-48d2-8602-05128f887408 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:38.534370 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1777/3579] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:23:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:23:38.664207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef9340-16c1-48d2-8602-05128f887408 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:38.670769 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bfccb5-77da-4944-b5ef-df45e5da0d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:38.671709 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfccb5-77da-4944-b5ef-df45e5da0d05 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:38.672105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfccb5-77da-4944-b5ef-df45e5da0d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:38.672439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfccb5-77da-4944-b5ef-df45e5da0d05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:38.673753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bfccb5-77da-4944-b5ef-df45e5da0d05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:38.675856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bfccb5-77da-4944-b5ef-df45e5da0d05 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:38.709653 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1803/3580] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:23:38 2022] POST /identity/v3/projects => generated 389 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:23:38.713394 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566f836-65e8-4b47-9d8c-087646a4ad50 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:38.727047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566f836-65e8-4b47-9d8c-087646a4ad50 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:38.808074 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:38.838122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc41c4-5c30-4d5c-a60b-5a4708d5a620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:38.839052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc41c4-5c30-4d5c-a60b-5a4708d5a620 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:38.839596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc41c4-5c30-4d5c-a60b-5a4708d5a620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:38.839958 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc41c4-5c30-4d5c-a60b-5a4708d5a620 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:38.840794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc41c4-5c30-4d5c-a60b-5a4708d5a620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:38.843625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc41c4-5c30-4d5c-a60b-5a4708d5a620 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:38.871967 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1778/3581] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:23:38 2022] POST /identity/v3/users => generated 301 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:23:38.875967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bfccb5-77da-4944-b5ef-df45e5da0d05 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:38.888320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bfccb5-77da-4944-b5ef-df45e5da0d05 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:38.903524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8790eb-70d3-46e6-a480-3edaa0de3fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:38.904362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8790eb-70d3-46e6-a480-3edaa0de3fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:38.904677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8790eb-70d3-46e6-a480-3edaa0de3fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:38.905009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8790eb-70d3-46e6-a480-3edaa0de3fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:38.905719 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8790eb-70d3-46e6-a480-3edaa0de3fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:38.910375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8790eb-70d3-46e6-a480-3edaa0de3fd5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:38.926991 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1804/3582] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:23:38.931184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc41c4-5c30-4d5c-a60b-5a4708d5a620 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:38.944209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc41c4-5c30-4d5c-a60b-5a4708d5a620 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:38.950159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a069409-b31e-46fa-89fb-16c42047d10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:38.951115 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a069409-b31e-46fa-89fb-16c42047d10b admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:38.951556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a069409-b31e-46fa-89fb-16c42047d10b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:38.952087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a069409-b31e-46fa-89fb-16c42047d10b admin admin] PATH_INFO: `/v3/projects/f7ac353de2594f2abba0d359de2996d1/users/56933e8d19cf4226b9a762778de92e73/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:38.972611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a069409-b31e-46fa-89fb-16c42047d10b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7ac353de2594f2abba0d359de2996d1, user_id=56933e8d19cf4226b9a762778de92e73, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:38.977398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a069409-b31e-46fa-89fb-16c42047d10b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:39.004145 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1779/3583] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:23:38 2022] PUT /identity/v3/projects/f7ac353de2594f2abba0d359de2996d1/users/56933e8d19cf4226b9a762778de92e73/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:39.006633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8790eb-70d3-46e6-a480-3edaa0de3fd5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:39.018525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8790eb-70d3-46e6-a480-3edaa0de3fd5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:39.104254 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41e0cf-9df1-41c6-b713-3837eecd9154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:39.105671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41e0cf-9df1-41c6-b713-3837eecd9154 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:39.106135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41e0cf-9df1-41c6-b713-3837eecd9154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:39.106626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41e0cf-9df1-41c6-b713-3837eecd9154 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:39.107424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41e0cf-9df1-41c6-b713-3837eecd9154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:39.109933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41e0cf-9df1-41c6-b713-3837eecd9154 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:39.122933 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1805/3584] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:23:39.125295 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a069409-b31e-46fa-89fb-16c42047d10b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:39.137403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a069409-b31e-46fa-89fb-16c42047d10b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:39.142317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f999ae4f-bf4b-4da8-a0eb-9f8075bad751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:39.143088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999ae4f-bf4b-4da8-a0eb-9f8075bad751 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:39.143827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999ae4f-bf4b-4da8-a0eb-9f8075bad751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:39.143827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999ae4f-bf4b-4da8-a0eb-9f8075bad751 admin admin] PATH_INFO: `/v3/projects/f7ac353de2594f2abba0d359de2996d1/users/56933e8d19cf4226b9a762778de92e73/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:39.145876 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f999ae4f-bf4b-4da8-a0eb-9f8075bad751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7ac353de2594f2abba0d359de2996d1, user_id=56933e8d19cf4226b9a762778de92e73, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:39.148765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f999ae4f-bf4b-4da8-a0eb-9f8075bad751 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:39.162565 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1780/3585] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:23:39 2022] PUT /identity/v3/projects/f7ac353de2594f2abba0d359de2996d1/users/56933e8d19cf4226b9a762778de92e73/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:39.175014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dc4fc-0a90-4687-a83e-518d35809b4f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:39.175518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dc4fc-0a90-4687-a83e-518d35809b4f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:39.176036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dc4fc-0a90-4687-a83e-518d35809b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:39.206443 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:39.221001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-8e0dc4fc-0a90-4687-a83e-518d35809b4f None None] MFA Rules not processed for user `56933e8d19cf4226b9a762778de92e73`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:39.222781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8e0dc4fc-0a90-4687-a83e-518d35809b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:39.315751 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1806/3586] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:23:39 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:23:39.320994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f999ae4f-bf4b-4da8-a0eb-9f8075bad751 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:39.352216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f999ae4f-bf4b-4da8-a0eb-9f8075bad751 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:39.363780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91533b-8268-42fa-b1da-3f51d84dc8ce tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:39.364769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91533b-8268-42fa-b1da-3f51d84dc8ce tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:39.365306 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91533b-8268-42fa-b1da-3f51d84dc8ce tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:39.365918 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91533b-8268-42fa-b1da-3f51d84dc8ce tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:39.366956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91533b-8268-42fa-b1da-3f51d84dc8ce tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:39.368426 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-9d91533b-8268-42fa-b1da-3f51d84dc8ce tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:23:39.368426 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:23:39.368426 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:23:39.370575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d91533b-8268-42fa-b1da-3f51d84dc8ce tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:39.392862 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1781/3587] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Aug 7 01:23:39 2022] POST /identity/v3/domains => generated 276 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:23:39.397448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0dc4fc-0a90-4687-a83e-518d35809b4f None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:39.409519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0dc4fc-0a90-4687-a83e-518d35809b4f None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:39.513864 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce687286-5f20-405f-a2b9-9a5d291ac1ca tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:39.514514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce687286-5f20-405f-a2b9-9a5d291ac1ca tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:39.514858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce687286-5f20-405f-a2b9-9a5d291ac1ca tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:39.515049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce687286-5f20-405f-a2b9-9a5d291ac1ca tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/72a649be868f44728a2a021b1d5238bf/config` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:39.516215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce687286-5f20-405f-a2b9-9a5d291ac1ca tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=72a649be868f44728a2a021b1d5238bf)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:39.518356 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-ce687286-5f20-405f-a2b9-9a5d291ac1ca tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:23:39.518356 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:23:39.518356 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:23:39.519920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce687286-5f20-405f-a2b9-9a5d291ac1ca tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:39.579675 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1807/3588] 10.222.0.39 () {60 vars in 1269 bytes} [Sun Aug 7 01:23:39 2022] PUT /identity/v3/domains/72a649be868f44728a2a021b1d5238bf/config => generated 138 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:23:39.583864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91533b-8268-42fa-b1da-3f51d84dc8ce tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:39.606363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91533b-8268-42fa-b1da-3f51d84dc8ce tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:39.633277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fef82a-f38d-4fd5-90d8-c3a6e395d5ef tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:39.635086 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fef82a-f38d-4fd5-90d8-c3a6e395d5ef tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:39.635396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fef82a-f38d-4fd5-90d8-c3a6e395d5ef tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:39.635670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fef82a-f38d-4fd5-90d8-c3a6e395d5ef tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/72a649be868f44728a2a021b1d5238bf/config/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:39.637644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fef82a-f38d-4fd5-90d8-c3a6e395d5ef tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=72a649be868f44728a2a021b1d5238bf, group=identity)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:39.638832 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-99fef82a-f38d-4fd5-90d8-c3a6e395d5ef tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:23:39.638832 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:23:39.638832 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:23:39.639727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fef82a-f38d-4fd5-90d8-c3a6e395d5ef tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:39.656370 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1782/3589] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Aug 7 01:23:39 2022] GET /identity/v3/domains/72a649be868f44728a2a021b1d5238bf/config/identity => generated 45 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:39.660211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce687286-5f20-405f-a2b9-9a5d291ac1ca tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:39.671773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce687286-5f20-405f-a2b9-9a5d291ac1ca tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:39.677173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c2766-bffa-415b-922e-0294a51103d0 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:39.677862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c2766-bffa-415b-922e-0294a51103d0 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:39.678138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c2766-bffa-415b-922e-0294a51103d0 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:39.678408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c2766-bffa-415b-922e-0294a51103d0 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/72a649be868f44728a2a021b1d5238bf/config/identity/driver` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:39.679606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c2766-bffa-415b-922e-0294a51103d0 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=72a649be868f44728a2a021b1d5238bf, group=identity, option=driver)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:39.680681 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-282c2766-bffa-415b-922e-0294a51103d0 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:23:39.680681 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:23:39.680681 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:23:39.682109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c2766-bffa-415b-922e-0294a51103d0 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:39.690180 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1808/3590] 10.222.0.39 () {58 vars in 1296 bytes} [Sun Aug 7 01:23:39 2022] GET /identity/v3/domains/72a649be868f44728a2a021b1d5238bf/config/identity/driver => generated 31 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:39.694486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fef82a-f38d-4fd5-90d8-c3a6e395d5ef tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:39.719437 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fef82a-f38d-4fd5-90d8-c3a6e395d5ef tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:39.724638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9c8b9-3b5b-4317-94a0-0c93d7e9ee35 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:39.725301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9c8b9-3b5b-4317-94a0-0c93d7e9ee35 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:39.725579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9c8b9-3b5b-4317-94a0-0c93d7e9ee35 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:39.725850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9c8b9-3b5b-4317-94a0-0c93d7e9ee35 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/72a649be868f44728a2a021b1d5238bf/config/ldap` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:39.727243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9c8b9-3b5b-4317-94a0-0c93d7e9ee35 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=72a649be868f44728a2a021b1d5238bf, group=ldap)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:39.729507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9c8b9-3b5b-4317-94a0-0c93d7e9ee35 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:39.735918 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1783/3591] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Aug 7 01:23:39 2022] GET /identity/v3/domains/72a649be868f44728a2a021b1d5238bf/config/ldap => generated 106 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:23:39.740306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c2766-bffa-415b-922e-0294a51103d0 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:39.752826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c2766-bffa-415b-922e-0294a51103d0 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:39.757771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841492df-313d-4a8b-ba76-a662f1f3bd16 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:39.761008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841492df-313d-4a8b-ba76-a662f1f3bd16 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:39.761280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841492df-313d-4a8b-ba76-a662f1f3bd16 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:39.761772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841492df-313d-4a8b-ba76-a662f1f3bd16 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/72a649be868f44728a2a021b1d5238bf/config/ldap/url` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:39.763196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841492df-313d-4a8b-ba76-a662f1f3bd16 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=72a649be868f44728a2a021b1d5238bf, group=ldap, option=url)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:39.765483 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841492df-313d-4a8b-ba76-a662f1f3bd16 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:39.780397 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1809/3592] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Aug 7 01:23:39 2022] GET /identity/v3/domains/72a649be868f44728a2a021b1d5238bf/config/ldap/url => generated 46 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:39.781036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9c8b9-3b5b-4317-94a0-0c93d7e9ee35 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:39.792494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9c8b9-3b5b-4317-94a0-0c93d7e9ee35 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:39.799034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f0716-298e-4597-a512-cf2a42926645 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:39.800338 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f0716-298e-4597-a512-cf2a42926645 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:39.800840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f0716-298e-4597-a512-cf2a42926645 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:39.801471 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f0716-298e-4597-a512-cf2a42926645 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/72a649be868f44728a2a021b1d5238bf/config/ldap/user_tree_dn` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:39.804463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f0716-298e-4597-a512-cf2a42926645 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=72a649be868f44728a2a021b1d5238bf, group=ldap, option=user_tree_dn)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:39.807800 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f0716-298e-4597-a512-cf2a42926645 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:39.815488 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1784/3593] 10.222.0.39 () {58 vars in 1302 bytes} [Sun Aug 7 01:23:39 2022] GET /identity/v3/domains/72a649be868f44728a2a021b1d5238bf/config/ldap/user_tree_dn => generated 63 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 07 01:23:39.819735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841492df-313d-4a8b-ba76-a662f1f3bd16 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:39.831793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841492df-313d-4a8b-ba76-a662f1f3bd16 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:39.839034 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc381d-269a-42e1-8204-1d82ad126ced tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:39.841349 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc381d-269a-42e1-8204-1d82ad126ced tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:39.842015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc381d-269a-42e1-8204-1d82ad126ced tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:39.842635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebc381d-269a-42e1-8204-1d82ad126ced tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/72a649be868f44728a2a021b1d5238bf/config` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:39.844227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc381d-269a-42e1-8204-1d82ad126ced tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=72a649be868f44728a2a021b1d5238bf)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:39.845672 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-6ebc381d-269a-42e1-8204-1d82ad126ced tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:23:39.845672 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:23:39.845672 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:23:39.847147 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebc381d-269a-42e1-8204-1d82ad126ced tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:39.861449 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1810/3594] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Aug 7 01:23:39 2022] DELETE /identity/v3/domains/72a649be868f44728a2a021b1d5238bf/config => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:39.865914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f0716-298e-4597-a512-cf2a42926645 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:39.877841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f0716-298e-4597-a512-cf2a42926645 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:39.882958 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8de0c4-9b46-44df-84be-add057f4659a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:39.883654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8de0c4-9b46-44df-84be-add057f4659a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:39.884001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8de0c4-9b46-44df-84be-add057f4659a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:39.884279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8de0c4-9b46-44df-84be-add057f4659a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/72a649be868f44728a2a021b1d5238bf` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:39.885669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8de0c4-9b46-44df-84be-add057f4659a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=72a649be868f44728a2a021b1d5238bf)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:39.886833 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-db8de0c4-9b46-44df-84be-add057f4659a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:23:39.886833 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:23:39.886833 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:23:39.887762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8de0c4-9b46-44df-84be-add057f4659a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:39.913833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-db8de0c4-9b46-44df-84be-add057f4659a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '72a649be868f44728a2a021b1d5238bf'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:39.914660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-db8de0c4-9b46-44df-84be-add057f4659a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '72a649be868f44728a2a021b1d5238bf'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:39.968689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-db8de0c4-9b46-44df-84be-add057f4659a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '72a649be868f44728a2a021b1d5238bf'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:39.970045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-db8de0c4-9b46-44df-84be-add057f4659a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '72a649be868f44728a2a021b1d5238bf'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:39.973021 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1785/3595] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:23:39 2022] PATCH /identity/v3/domains/72a649be868f44728a2a021b1d5238bf => generated 277 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:23:39.984696 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc381d-269a-42e1-8204-1d82ad126ced tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:39.987666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6ebc381d-269a-42e1-8204-1d82ad126ced tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:40.005860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebc381d-269a-42e1-8204-1d82ad126ced tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:40.051110 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:40.097045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8d005-a89a-4b9c-a008-31d8e4d54f0b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:40.097782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8d005-a89a-4b9c-a008-31d8e4d54f0b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:40.098076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8d005-a89a-4b9c-a008-31d8e4d54f0b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:40.098325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8d005-a89a-4b9c-a008-31d8e4d54f0b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/72a649be868f44728a2a021b1d5238bf` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:40.119163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8d005-a89a-4b9c-a008-31d8e4d54f0b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=72a649be868f44728a2a021b1d5238bf)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:40.120634 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-f5f8d005-a89a-4b9c-a008-31d8e4d54f0b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:23:40.120634 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:23:40.120634 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:23:40.121918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8d005-a89a-4b9c-a008-31d8e4d54f0b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:40.164372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f5f8d005-a89a-4b9c-a008-31d8e4d54f0b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '72a649be868f44728a2a021b1d5238bf'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:40.208908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f5f8d005-a89a-4b9c-a008-31d8e4d54f0b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '72a649be868f44728a2a021b1d5238bf'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:40.268379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f5f8d005-a89a-4b9c-a008-31d8e4d54f0b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72a649be868f44728a2a021b1d5238bf', 'request_id': 'req-f5f8d005-a89a-4b9c-a008-31d8e4d54f0b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:40.282984 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f5f8d005-a89a-4b9c-a008-31d8e4d54f0b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72a649be868f44728a2a021b1d5238bf', 'request_id': 'req-f5f8d005-a89a-4b9c-a008-31d8e4d54f0b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:40.289850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f5f8d005-a89a-4b9c-a008-31d8e4d54f0b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72a649be868f44728a2a021b1d5238bf', 'request_id': 'req-f5f8d005-a89a-4b9c-a008-31d8e4d54f0b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:40.309366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f5f8d005-a89a-4b9c-a008-31d8e4d54f0b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] The token cache is being invalidate because project 72a649be868f44728a2a021b1d5238bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:23:40.309748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f5f8d005-a89a-4b9c-a008-31d8e4d54f0b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:40.310613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f5f8d005-a89a-4b9c-a008-31d8e4d54f0b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:40.346053 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f5f8d005-a89a-4b9c-a008-31d8e4d54f0b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '72a649be868f44728a2a021b1d5238bf', 'request_id': 'req-f5f8d005-a89a-4b9c-a008-31d8e4d54f0b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:40.355089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f5f8d005-a89a-4b9c-a008-31d8e4d54f0b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '72a649be868f44728a2a021b1d5238bf', 'request_id': 'req-f5f8d005-a89a-4b9c-a008-31d8e4d54f0b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:40.356238 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f5f8d005-a89a-4b9c-a008-31d8e4d54f0b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '72a649be868f44728a2a021b1d5238bf', 'request_id': 'req-f5f8d005-a89a-4b9c-a008-31d8e4d54f0b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:40.364121 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1811/3596] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:23:39 2022] DELETE /identity/v3/domains/72a649be868f44728a2a021b1d5238bf => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:40.369706 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8de0c4-9b46-44df-84be-add057f4659a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:40.382038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8de0c4-9b46-44df-84be-add057f4659a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:40.449035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90648e5b-3dfc-4a69-828c-54be81a2e5fd tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:40.449726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90648e5b-3dfc-4a69-828c-54be81a2e5fd tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:40.450010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90648e5b-3dfc-4a69-828c-54be81a2e5fd tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:40.450282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90648e5b-3dfc-4a69-828c-54be81a2e5fd tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:40.450952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90648e5b-3dfc-4a69-828c-54be81a2e5fd tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:40.452663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90648e5b-3dfc-4a69-828c-54be81a2e5fd tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:40.473689 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1786/3597] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Aug 7 01:23:40 2022] POST /identity/v3/domains => generated 275 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:23:40.477568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8d005-a89a-4b9c-a008-31d8e4d54f0b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:40.479081 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f5f8d005-a89a-4b9c-a008-31d8e4d54f0b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:40.492967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8d005-a89a-4b9c-a008-31d8e4d54f0b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:40.558013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80660f15-3bcb-41f6-a25d-a8a75abbb1d5 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:40.558688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80660f15-3bcb-41f6-a25d-a8a75abbb1d5 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:40.558951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80660f15-3bcb-41f6-a25d-a8a75abbb1d5 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:40.559256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80660f15-3bcb-41f6-a25d-a8a75abbb1d5 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/e6f7e64eecd44335abd437466636e1ec/config` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:40.559972 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80660f15-3bcb-41f6-a25d-a8a75abbb1d5 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=e6f7e64eecd44335abd437466636e1ec)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:40.561601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80660f15-3bcb-41f6-a25d-a8a75abbb1d5 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:40.581710 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:40.608003 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1812/3598] 10.222.0.39 () {60 vars in 1269 bytes} [Sun Aug 7 01:23:40 2022] PUT /identity/v3/domains/e6f7e64eecd44335abd437466636e1ec/config => generated 138 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:23:40.611959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90648e5b-3dfc-4a69-828c-54be81a2e5fd tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:40.625689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90648e5b-3dfc-4a69-828c-54be81a2e5fd tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:40.635011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f1086-b2ff-4e26-846c-d431b4d4d107 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:40.635661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f1086-b2ff-4e26-846c-d431b4d4d107 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:40.635966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f1086-b2ff-4e26-846c-d431b4d4d107 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:40.636479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f1086-b2ff-4e26-846c-d431b4d4d107 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/e6f7e64eecd44335abd437466636e1ec/config` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:40.637231 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f1086-b2ff-4e26-846c-d431b4d4d107 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=e6f7e64eecd44335abd437466636e1ec)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:40.638466 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-a91f1086-b2ff-4e26-846c-d431b4d4d107 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:23:40.638466 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:23:40.638466 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:23:40.639380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f1086-b2ff-4e26-846c-d431b4d4d107 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:40.642821 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:UPDATE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:40.686935 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1787/3599] 10.222.0.39 () {60 vars in 1271 bytes} [Sun Aug 7 01:23:40 2022] PATCH /identity/v3/domains/e6f7e64eecd44335abd437466636e1ec/config => generated 142 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:23:40.687595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80660f15-3bcb-41f6-a25d-a8a75abbb1d5 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:40.699300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80660f15-3bcb-41f6-a25d-a8a75abbb1d5 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:40.708603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76049f93-6cbe-4b4c-b84f-6909a19a5899 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:40.709275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76049f93-6cbe-4b4c-b84f-6909a19a5899 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:40.709562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76049f93-6cbe-4b4c-b84f-6909a19a5899 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:40.709840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76049f93-6cbe-4b4c-b84f-6909a19a5899 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/e6f7e64eecd44335abd437466636e1ec/config` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:40.711028 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76049f93-6cbe-4b4c-b84f-6909a19a5899 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=e6f7e64eecd44335abd437466636e1ec)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:40.716922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76049f93-6cbe-4b4c-b84f-6909a19a5899 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:40.733862 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1813/3600] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Aug 7 01:23:40 2022] GET /identity/v3/domains/e6f7e64eecd44335abd437466636e1ec/config => generated 142 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:23:40.738145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f1086-b2ff-4e26-846c-d431b4d4d107 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:40.753659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f1086-b2ff-4e26-846c-d431b4d4d107 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:40.783450 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832dca8-1e39-426e-b1c3-af07ba773d6c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:40.784386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832dca8-1e39-426e-b1c3-af07ba773d6c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:40.784941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832dca8-1e39-426e-b1c3-af07ba773d6c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:40.785321 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832dca8-1e39-426e-b1c3-af07ba773d6c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/e6f7e64eecd44335abd437466636e1ec/config` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:40.787302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832dca8-1e39-426e-b1c3-af07ba773d6c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=e6f7e64eecd44335abd437466636e1ec)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:40.789247 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-b832dca8-1e39-426e-b1c3-af07ba773d6c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:23:40.789247 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:23:40.789247 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:23:40.792630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832dca8-1e39-426e-b1c3-af07ba773d6c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:40.815755 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1788/3601] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Aug 7 01:23:40 2022] DELETE /identity/v3/domains/e6f7e64eecd44335abd437466636e1ec/config => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:40.820072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76049f93-6cbe-4b4c-b84f-6909a19a5899 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:40.834273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76049f93-6cbe-4b4c-b84f-6909a19a5899 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:40.840151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bd8f3-f6ee-4615-ac21-104210c0bd4a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:40.840809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bd8f3-f6ee-4615-ac21-104210c0bd4a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:40.841092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bd8f3-f6ee-4615-ac21-104210c0bd4a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:40.841372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5bd8f3-f6ee-4615-ac21-104210c0bd4a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/e6f7e64eecd44335abd437466636e1ec/config` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:40.842609 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5bd8f3-f6ee-4615-ac21-104210c0bd4a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=e6f7e64eecd44335abd437466636e1ec)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:40.844347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5bd8f3-f6ee-4615-ac21-104210c0bd4a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:40.857483 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-8a5bd8f3-f6ee-4615-ac21-104210c0bd4a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Could not find any options in domain configuration for domain e6f7e64eecd44335abd437466636e1ec.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain e6f7e64eecd44335abd437466636e1ec. Aug 07 01:23:40.857483 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:23:40.857483 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:23:40.857483 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:23:40.857483 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:23:40.857483 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:23:40.857483 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:23:40.857483 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:23:40.857483 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:23:40.857483 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:23:40.857483 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:23:40.857483 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:23:40.857483 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Aug 07 01:23:40.857483 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Aug 07 01:23:40.858953 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Aug 07 01:23:40.858953 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Aug 07 01:23:40.858953 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:23:40.858953 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:23:40.858953 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Aug 07 01:23:40.858953 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Aug 07 01:23:40.858953 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain e6f7e64eecd44335abd437466636e1ec. Aug 07 01:23:40.858953 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:23:40.859815 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1814/3602] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Aug 7 01:23:40 2022] GET /identity/v3/domains/e6f7e64eecd44335abd437466636e1ec/config => generated 151 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:23:40.865245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832dca8-1e39-426e-b1c3-af07ba773d6c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:40.890745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832dca8-1e39-426e-b1c3-af07ba773d6c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:40.898334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76156aef-5ee3-448a-b859-cfad26badd8c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:40.899295 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76156aef-5ee3-448a-b859-cfad26badd8c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:40.899832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76156aef-5ee3-448a-b859-cfad26badd8c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:40.900838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76156aef-5ee3-448a-b859-cfad26badd8c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/e6f7e64eecd44335abd437466636e1ec/config` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:40.901550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76156aef-5ee3-448a-b859-cfad26badd8c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=e6f7e64eecd44335abd437466636e1ec)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:40.904682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76156aef-5ee3-448a-b859-cfad26badd8c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:40.914317 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1789/3603] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Aug 7 01:23:40 2022] DELETE /identity/v3/domains/e6f7e64eecd44335abd437466636e1ec/config => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:40.918773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bd8f3-f6ee-4615-ac21-104210c0bd4a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:40.932306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5bd8f3-f6ee-4615-ac21-104210c0bd4a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:40.939168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e7137-268c-4998-9472-f4c2b667e64c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:40.939810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e7137-268c-4998-9472-f4c2b667e64c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:40.940124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e7137-268c-4998-9472-f4c2b667e64c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:40.940402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e7137-268c-4998-9472-f4c2b667e64c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/e6f7e64eecd44335abd437466636e1ec` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:40.941677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e7137-268c-4998-9472-f4c2b667e64c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e6f7e64eecd44335abd437466636e1ec)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:40.942930 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-de6e7137-268c-4998-9472-f4c2b667e64c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:23:40.942930 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:23:40.942930 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:23:40.943748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e7137-268c-4998-9472-f4c2b667e64c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:40.971108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-de6e7137-268c-4998-9472-f4c2b667e64c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e6f7e64eecd44335abd437466636e1ec'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:40.972138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-de6e7137-268c-4998-9472-f4c2b667e64c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e6f7e64eecd44335abd437466636e1ec'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:41.001680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-de6e7137-268c-4998-9472-f4c2b667e64c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e6f7e64eecd44335abd437466636e1ec'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:41.002318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-de6e7137-268c-4998-9472-f4c2b667e64c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e6f7e64eecd44335abd437466636e1ec'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:41.004877 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1815/3604] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:23:40 2022] PATCH /identity/v3/domains/e6f7e64eecd44335abd437466636e1ec => generated 276 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:23:41.009734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76156aef-5ee3-448a-b859-cfad26badd8c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:41.012749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-76156aef-5ee3-448a-b859-cfad26badd8c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:41.026223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76156aef-5ee3-448a-b859-cfad26badd8c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:41.094478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13313a85-d026-4344-91a9-e6750909f008 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:41.095228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13313a85-d026-4344-91a9-e6750909f008 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:41.095605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13313a85-d026-4344-91a9-e6750909f008 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:41.096015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13313a85-d026-4344-91a9-e6750909f008 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/e6f7e64eecd44335abd437466636e1ec` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:41.110877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13313a85-d026-4344-91a9-e6750909f008 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e6f7e64eecd44335abd437466636e1ec)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:41.112009 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-13313a85-d026-4344-91a9-e6750909f008 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:23:41.112009 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:23:41.112009 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:23:41.112956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13313a85-d026-4344-91a9-e6750909f008 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:41.139334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-13313a85-d026-4344-91a9-e6750909f008 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e6f7e64eecd44335abd437466636e1ec'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:41.160193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-13313a85-d026-4344-91a9-e6750909f008 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e6f7e64eecd44335abd437466636e1ec'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:41.218757 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-13313a85-d026-4344-91a9-e6750909f008 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6f7e64eecd44335abd437466636e1ec', 'request_id': 'req-13313a85-d026-4344-91a9-e6750909f008'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:41.231250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-13313a85-d026-4344-91a9-e6750909f008 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6f7e64eecd44335abd437466636e1ec', 'request_id': 'req-13313a85-d026-4344-91a9-e6750909f008'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:41.239580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-13313a85-d026-4344-91a9-e6750909f008 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6f7e64eecd44335abd437466636e1ec', 'request_id': 'req-13313a85-d026-4344-91a9-e6750909f008'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:41.258516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-13313a85-d026-4344-91a9-e6750909f008 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] The token cache is being invalidate because project e6f7e64eecd44335abd437466636e1ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:23:41.258908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-13313a85-d026-4344-91a9-e6750909f008 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:41.260243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-13313a85-d026-4344-91a9-e6750909f008 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:41.270120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-13313a85-d026-4344-91a9-e6750909f008 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e6f7e64eecd44335abd437466636e1ec', 'request_id': 'req-13313a85-d026-4344-91a9-e6750909f008'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:41.270764 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=20,keystone:INSERT=4,keystone:SELECT=76 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:41.271635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-13313a85-d026-4344-91a9-e6750909f008 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e6f7e64eecd44335abd437466636e1ec', 'request_id': 'req-13313a85-d026-4344-91a9-e6750909f008'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:41.276764 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-13313a85-d026-4344-91a9-e6750909f008 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e6f7e64eecd44335abd437466636e1ec', 'request_id': 'req-13313a85-d026-4344-91a9-e6750909f008'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:41.288298 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1790/3605] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:23:41 2022] DELETE /identity/v3/domains/e6f7e64eecd44335abd437466636e1ec => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:23:41.289342 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e7137-268c-4998-9472-f4c2b667e64c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:41.302866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e7137-268c-4998-9472-f4c2b667e64c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:41.378716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c396f-1024-4482-b9c2-dbe1c5b06c3d tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:41.379443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c396f-1024-4482-b9c2-dbe1c5b06c3d tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:41.379792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c396f-1024-4482-b9c2-dbe1c5b06c3d tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:41.380169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c396f-1024-4482-b9c2-dbe1c5b06c3d tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:41.381608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c396f-1024-4482-b9c2-dbe1c5b06c3d tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:41.382495 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-4e5c396f-1024-4482-b9c2-dbe1c5b06c3d tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:23:41.382495 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:23:41.382495 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:23:41.383570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c396f-1024-4482-b9c2-dbe1c5b06c3d tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:41.412050 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1816/3606] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Aug 7 01:23:41 2022] POST /identity/v3/domains => generated 276 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:23:41.416640 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13313a85-d026-4344-91a9-e6750909f008 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:41.418183 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-13313a85-d026-4344-91a9-e6750909f008 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:41.433282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13313a85-d026-4344-91a9-e6750909f008 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:41.506384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45fac9-b1bd-498c-8ba3-7b4f5433e0d8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:41.507120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45fac9-b1bd-498c-8ba3-7b4f5433e0d8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:41.507409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45fac9-b1bd-498c-8ba3-7b4f5433e0d8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:41.507686 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45fac9-b1bd-498c-8ba3-7b4f5433e0d8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/aab6fe2e5b6342ec9e4048f8416c58d6/config` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:41.508574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45fac9-b1bd-498c-8ba3-7b4f5433e0d8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=aab6fe2e5b6342ec9e4048f8416c58d6)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:41.509777 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-0a45fac9-b1bd-498c-8ba3-7b4f5433e0d8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:23:41.509777 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:23:41.509777 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:23:41.510671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45fac9-b1bd-498c-8ba3-7b4f5433e0d8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:41.552356 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1791/3607] 10.222.0.39 () {60 vars in 1269 bytes} [Sun Aug 7 01:23:41 2022] PUT /identity/v3/domains/aab6fe2e5b6342ec9e4048f8416c58d6/config => generated 138 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:23:41.553475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c396f-1024-4482-b9c2-dbe1c5b06c3d tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:41.566669 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c396f-1024-4482-b9c2-dbe1c5b06c3d tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:41.572950 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cccda-1901-4a32-b28d-c3f62e80d24a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:41.573940 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cccda-1901-4a32-b28d-c3f62e80d24a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:41.573940 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cccda-1901-4a32-b28d-c3f62e80d24a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:41.574150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cccda-1901-4a32-b28d-c3f62e80d24a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/aab6fe2e5b6342ec9e4048f8416c58d6/config/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:41.575067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57cccda-1901-4a32-b28d-c3f62e80d24a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=aab6fe2e5b6342ec9e4048f8416c58d6, group=identity)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:41.576112 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-c57cccda-1901-4a32-b28d-c3f62e80d24a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:23:41.576112 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:23:41.576112 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:23:41.577005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57cccda-1901-4a32-b28d-c3f62e80d24a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:41.609119 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1817/3608] 10.222.0.39 () {60 vars in 1297 bytes} [Sun Aug 7 01:23:41 2022] PATCH /identity/v3/domains/aab6fe2e5b6342ec9e4048f8416c58d6/config/identity => generated 176 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:23:41.613878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45fac9-b1bd-498c-8ba3-7b4f5433e0d8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:41.627579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45fac9-b1bd-498c-8ba3-7b4f5433e0d8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:41.633462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023a71a-7828-427f-9c24-3102837c67ec tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:41.634236 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023a71a-7828-427f-9c24-3102837c67ec tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:41.634518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023a71a-7828-427f-9c24-3102837c67ec tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:41.634797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023a71a-7828-427f-9c24-3102837c67ec tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/aab6fe2e5b6342ec9e4048f8416c58d6/config/identity/driver` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:41.635486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023a71a-7828-427f-9c24-3102837c67ec tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=aab6fe2e5b6342ec9e4048f8416c58d6, group=identity, option=driver)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:41.637119 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023a71a-7828-427f-9c24-3102837c67ec tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:41.671535 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1792/3609] 10.222.0.39 () {60 vars in 1318 bytes} [Sun Aug 7 01:23:41 2022] PATCH /identity/v3/domains/aab6fe2e5b6342ec9e4048f8416c58d6/config/identity/driver => generated 176 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:23:41.672704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cccda-1901-4a32-b28d-c3f62e80d24a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:41.686636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cccda-1901-4a32-b28d-c3f62e80d24a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:41.692019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8dda63-11ad-4e6f-a108-bc168a9f1324 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:41.692862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8dda63-11ad-4e6f-a108-bc168a9f1324 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:41.693288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8dda63-11ad-4e6f-a108-bc168a9f1324 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:41.694095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8dda63-11ad-4e6f-a108-bc168a9f1324 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/aab6fe2e5b6342ec9e4048f8416c58d6/config/identity/driver` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:41.694710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8dda63-11ad-4e6f-a108-bc168a9f1324 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=aab6fe2e5b6342ec9e4048f8416c58d6, group=identity, option=driver)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:41.696597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8dda63-11ad-4e6f-a108-bc168a9f1324 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:41.718387 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1818/3610] 10.222.0.39 () {58 vars in 1299 bytes} [Sun Aug 7 01:23:41 2022] DELETE /identity/v3/domains/aab6fe2e5b6342ec9e4048f8416c58d6/config/identity/driver => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:23:41.722760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023a71a-7828-427f-9c24-3102837c67ec tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:41.736182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023a71a-7828-427f-9c24-3102837c67ec tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:41.742700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d52442-9083-4163-b6de-bd19289f3b48 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:41.744287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d52442-9083-4163-b6de-bd19289f3b48 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:41.744679 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d52442-9083-4163-b6de-bd19289f3b48 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:41.744994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d52442-9083-4163-b6de-bd19289f3b48 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/aab6fe2e5b6342ec9e4048f8416c58d6/config/identity/driver` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:41.746350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d52442-9083-4163-b6de-bd19289f3b48 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=aab6fe2e5b6342ec9e4048f8416c58d6, group=identity, option=driver)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:41.749099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d52442-9083-4163-b6de-bd19289f3b48 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:41.760050 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-f2d52442-9083-4163-b6de-bd19289f3b48 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Could not find option driver in group identity in domain configuration for domain aab6fe2e5b6342ec9e4048f8416c58d6.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain aab6fe2e5b6342ec9e4048f8416c58d6. Aug 07 01:23:41.760050 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:23:41.760050 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:23:41.760050 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:23:41.760050 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:23:41.760050 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:23:41.760050 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:23:41.760050 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:23:41.760050 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:23:41.760050 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:23:41.760050 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:23:41.760050 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:23:41.760050 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Aug 07 01:23:41.761119 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Aug 07 01:23:41.761119 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Aug 07 01:23:41.761119 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Aug 07 01:23:41.761119 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:23:41.761119 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:23:41.761119 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Aug 07 01:23:41.761119 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Aug 07 01:23:41.761119 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain aab6fe2e5b6342ec9e4048f8416c58d6. Aug 07 01:23:41.761119 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:23:41.761672 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1793/3611] 10.222.0.39 () {58 vars in 1296 bytes} [Sun Aug 7 01:23:41 2022] GET /identity/v3/domains/aab6fe2e5b6342ec9e4048f8416c58d6/config/identity/driver => generated 171 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:23:41.765475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8dda63-11ad-4e6f-a108-bc168a9f1324 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:41.778540 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8dda63-11ad-4e6f-a108-bc168a9f1324 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:41.784518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9628a10-f314-4b96-9c60-781762cf848d tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:41.787787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9628a10-f314-4b96-9c60-781762cf848d tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:41.788338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9628a10-f314-4b96-9c60-781762cf848d tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:41.788860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9628a10-f314-4b96-9c60-781762cf848d tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/aab6fe2e5b6342ec9e4048f8416c58d6/config/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:41.789687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9628a10-f314-4b96-9c60-781762cf848d tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=aab6fe2e5b6342ec9e4048f8416c58d6, group=identity)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:41.792212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9628a10-f314-4b96-9c60-781762cf848d tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:41.833481 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1819/3612] 10.222.0.39 () {58 vars in 1278 bytes} [Sun Aug 7 01:23:41 2022] DELETE /identity/v3/domains/aab6fe2e5b6342ec9e4048f8416c58d6/config/identity => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:41.851838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d52442-9083-4163-b6de-bd19289f3b48 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:41.868137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d52442-9083-4163-b6de-bd19289f3b48 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:41.880801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380ac1a-e92f-45a6-9c87-000441e52aa8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:41.882014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380ac1a-e92f-45a6-9c87-000441e52aa8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:41.882533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380ac1a-e92f-45a6-9c87-000441e52aa8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:41.883126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380ac1a-e92f-45a6-9c87-000441e52aa8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/aab6fe2e5b6342ec9e4048f8416c58d6/config/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:41.884932 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c380ac1a-e92f-45a6-9c87-000441e52aa8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=aab6fe2e5b6342ec9e4048f8416c58d6, group=identity)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:41.887752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c380ac1a-e92f-45a6-9c87-000441e52aa8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:41.900597 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-c380ac1a-e92f-45a6-9c87-000441e52aa8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Could not find group identity in domain configuration for domain aab6fe2e5b6342ec9e4048f8416c58d6.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain aab6fe2e5b6342ec9e4048f8416c58d6. Aug 07 01:23:41.900597 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:23:41.900597 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:23:41.900597 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:23:41.900597 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:23:41.900597 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:23:41.900597 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:23:41.900597 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:23:41.900597 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:23:41.900597 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:23:41.900597 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:23:41.900597 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:23:41.900597 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Aug 07 01:23:41.901496 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Aug 07 01:23:41.901496 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Aug 07 01:23:41.901496 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Aug 07 01:23:41.901496 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:23:41.901496 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:23:41.901496 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Aug 07 01:23:41.901496 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Aug 07 01:23:41.901496 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain aab6fe2e5b6342ec9e4048f8416c58d6. Aug 07 01:23:41.901496 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:23:41.904234 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1794/3613] 10.222.0.39 () {58 vars in 1275 bytes} [Sun Aug 7 01:23:41 2022] GET /identity/v3/domains/aab6fe2e5b6342ec9e4048f8416c58d6/config/identity => generated 154 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:23:41.908312 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9628a10-f314-4b96-9c60-781762cf848d tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:41.933522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9628a10-f314-4b96-9c60-781762cf848d tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:41.939429 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6d9cd-7f96-4701-8d5a-69de8729a28a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:41.940168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6d9cd-7f96-4701-8d5a-69de8729a28a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:41.940455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6d9cd-7f96-4701-8d5a-69de8729a28a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:41.940724 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6d9cd-7f96-4701-8d5a-69de8729a28a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/aab6fe2e5b6342ec9e4048f8416c58d6/config` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:41.941579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6d9cd-7f96-4701-8d5a-69de8729a28a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=aab6fe2e5b6342ec9e4048f8416c58d6)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:41.943465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f6d9cd-7f96-4701-8d5a-69de8729a28a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:41.947755 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=84,keystone:DELETE=11,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:41.976699 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1820/3614] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Aug 7 01:23:41 2022] DELETE /identity/v3/domains/aab6fe2e5b6342ec9e4048f8416c58d6/config => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:41.978211 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380ac1a-e92f-45a6-9c87-000441e52aa8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:41.997666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380ac1a-e92f-45a6-9c87-000441e52aa8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:42.004972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca2539-2767-4e60-ad60-08b17b814b91 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:42.005300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca2539-2767-4e60-ad60-08b17b814b91 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:42.005509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca2539-2767-4e60-ad60-08b17b814b91 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:42.006491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca2539-2767-4e60-ad60-08b17b814b91 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/aab6fe2e5b6342ec9e4048f8416c58d6` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:42.008037 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca2539-2767-4e60-ad60-08b17b814b91 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=aab6fe2e5b6342ec9e4048f8416c58d6)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:42.009840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca2539-2767-4e60-ad60-08b17b814b91 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:42.035630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b9ca2539-2767-4e60-ad60-08b17b814b91 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'aab6fe2e5b6342ec9e4048f8416c58d6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:42.036406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b9ca2539-2767-4e60-ad60-08b17b814b91 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'aab6fe2e5b6342ec9e4048f8416c58d6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:42.067840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b9ca2539-2767-4e60-ad60-08b17b814b91 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'aab6fe2e5b6342ec9e4048f8416c58d6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:42.068764 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b9ca2539-2767-4e60-ad60-08b17b814b91 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'aab6fe2e5b6342ec9e4048f8416c58d6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:42.076840 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1795/3615] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:23:41 2022] PATCH /identity/v3/domains/aab6fe2e5b6342ec9e4048f8416c58d6 => generated 277 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:23:42.077922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6d9cd-7f96-4701-8d5a-69de8729a28a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:42.080483 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-93f6d9cd-7f96-4701-8d5a-69de8729a28a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:42.096843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f6d9cd-7f96-4701-8d5a-69de8729a28a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:42.187900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3451a-f6e3-41c4-aeb2-9a156f539c34 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:42.188634 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3451a-f6e3-41c4-aeb2-9a156f539c34 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:42.188917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3451a-f6e3-41c4-aeb2-9a156f539c34 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:42.189188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3451a-f6e3-41c4-aeb2-9a156f539c34 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/aab6fe2e5b6342ec9e4048f8416c58d6` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:42.219503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3451a-f6e3-41c4-aeb2-9a156f539c34 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=aab6fe2e5b6342ec9e4048f8416c58d6)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:42.224104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3451a-f6e3-41c4-aeb2-9a156f539c34 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:42.255137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9fe3451a-f6e3-41c4-aeb2-9a156f539c34 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'aab6fe2e5b6342ec9e4048f8416c58d6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:42.269572 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9fe3451a-f6e3-41c4-aeb2-9a156f539c34 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'aab6fe2e5b6342ec9e4048f8416c58d6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:42.339727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9fe3451a-f6e3-41c4-aeb2-9a156f539c34 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aab6fe2e5b6342ec9e4048f8416c58d6', 'request_id': 'req-9fe3451a-f6e3-41c4-aeb2-9a156f539c34'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:42.350383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9fe3451a-f6e3-41c4-aeb2-9a156f539c34 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aab6fe2e5b6342ec9e4048f8416c58d6', 'request_id': 'req-9fe3451a-f6e3-41c4-aeb2-9a156f539c34'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:42.362477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9fe3451a-f6e3-41c4-aeb2-9a156f539c34 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aab6fe2e5b6342ec9e4048f8416c58d6', 'request_id': 'req-9fe3451a-f6e3-41c4-aeb2-9a156f539c34'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:42.386113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9fe3451a-f6e3-41c4-aeb2-9a156f539c34 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] The token cache is being invalidate because project aab6fe2e5b6342ec9e4048f8416c58d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:23:42.386605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9fe3451a-f6e3-41c4-aeb2-9a156f539c34 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:42.387468 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9fe3451a-f6e3-41c4-aeb2-9a156f539c34 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:42.399242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9fe3451a-f6e3-41c4-aeb2-9a156f539c34 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'aab6fe2e5b6342ec9e4048f8416c58d6', 'request_id': 'req-9fe3451a-f6e3-41c4-aeb2-9a156f539c34'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:42.405401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9fe3451a-f6e3-41c4-aeb2-9a156f539c34 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'aab6fe2e5b6342ec9e4048f8416c58d6', 'request_id': 'req-9fe3451a-f6e3-41c4-aeb2-9a156f539c34'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:42.406835 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9fe3451a-f6e3-41c4-aeb2-9a156f539c34 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'aab6fe2e5b6342ec9e4048f8416c58d6', 'request_id': 'req-9fe3451a-f6e3-41c4-aeb2-9a156f539c34'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:42.419470 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1821/3616] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:23:42 2022] DELETE /identity/v3/domains/aab6fe2e5b6342ec9e4048f8416c58d6 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:23:42.421592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca2539-2767-4e60-ad60-08b17b814b91 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:42.440713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca2539-2767-4e60-ad60-08b17b814b91 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:42.519127 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:42.556964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764f487-ee96-4623-9730-803c11b7f0a3 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:42.557597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764f487-ee96-4623-9730-803c11b7f0a3 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:42.557881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764f487-ee96-4623-9730-803c11b7f0a3 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:42.558155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764f487-ee96-4623-9730-803c11b7f0a3 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:42.558738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764f487-ee96-4623-9730-803c11b7f0a3 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:42.560190 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-9764f487-ee96-4623-9730-803c11b7f0a3 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:23:42.560190 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:23:42.560190 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:23:42.561086 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764f487-ee96-4623-9730-803c11b7f0a3 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:42.570573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3451a-f6e3-41c4-aeb2-9a156f539c34 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:42.572153 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9fe3451a-f6e3-41c4-aeb2-9a156f539c34 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:42.580092 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1796/3617] 10.222.0.39 () {58 vars in 1173 bytes} [Sun Aug 7 01:23:42 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:23:42.586823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3451a-f6e3-41c4-aeb2-9a156f539c34 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:42.592848 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40504c-b34a-4923-af11-1dbb908f5cb0 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:42.593724 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40504c-b34a-4923-af11-1dbb908f5cb0 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:42.594012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40504c-b34a-4923-af11-1dbb908f5cb0 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:42.594432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40504c-b34a-4923-af11-1dbb908f5cb0 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:42.595036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe40504c-b34a-4923-af11-1dbb908f5cb0 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:42.596108 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-fe40504c-b34a-4923-af11-1dbb908f5cb0 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:23:42.596108 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:23:42.596108 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:23:42.597032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe40504c-b34a-4923-af11-1dbb908f5cb0 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:42.603433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764f487-ee96-4623-9730-803c11b7f0a3 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:42.610329 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1822/3618] 10.222.0.39 () {58 vars in 1200 bytes} [Sun Aug 7 01:23:42 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:42.614974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764f487-ee96-4623-9730-803c11b7f0a3 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:42.621045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b70c1a-cef0-4b4f-bc09-7a2d7a1779c2 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:42.621700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b70c1a-cef0-4b4f-bc09-7a2d7a1779c2 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:42.622319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b70c1a-cef0-4b4f-bc09-7a2d7a1779c2 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:42.622700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b70c1a-cef0-4b4f-bc09-7a2d7a1779c2 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:42.623302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b70c1a-cef0-4b4f-bc09-7a2d7a1779c2 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:42.624949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b70c1a-cef0-4b4f-bc09-7a2d7a1779c2 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:42.626295 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1797/3619] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Aug 7 01:23:42 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:42.630413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40504c-b34a-4923-af11-1dbb908f5cb0 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:42.641507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40504c-b34a-4923-af11-1dbb908f5cb0 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:42.648747 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560eb139-6e97-449e-86db-b65bc99ff1de tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:42.649411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560eb139-6e97-449e-86db-b65bc99ff1de tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:42.650222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560eb139-6e97-449e-86db-b65bc99ff1de tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:42.650494 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560eb139-6e97-449e-86db-b65bc99ff1de tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:42.651461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560eb139-6e97-449e-86db-b65bc99ff1de tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:42.652788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560eb139-6e97-449e-86db-b65bc99ff1de tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:42.654252 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1823/3620] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:23:42 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 07 01:23:42.658410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b70c1a-cef0-4b4f-bc09-7a2d7a1779c2 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:42.671488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b70c1a-cef0-4b4f-bc09-7a2d7a1779c2 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:42.677151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b05043-c784-4b68-8a17-d00055d5768a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:42.677707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b05043-c784-4b68-8a17-d00055d5768a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:42.677995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b05043-c784-4b68-8a17-d00055d5768a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:42.678270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b05043-c784-4b68-8a17-d00055d5768a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:42.679981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b05043-c784-4b68-8a17-d00055d5768a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:42.680579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b05043-c784-4b68-8a17-d00055d5768a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:42.686398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560eb139-6e97-449e-86db-b65bc99ff1de tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:42.687924 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1798/3621] 10.222.0.39 () {58 vars in 1188 bytes} [Sun Aug 7 01:23:42 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:23:42.698512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560eb139-6e97-449e-86db-b65bc99ff1de tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:42.703676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584ed42-d9b4-423b-8bf0-37f351998c47 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:42.704359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584ed42-d9b4-423b-8bf0-37f351998c47 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:42.704654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584ed42-d9b4-423b-8bf0-37f351998c47 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:42.704920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584ed42-d9b4-423b-8bf0-37f351998c47 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:42.705574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584ed42-d9b4-423b-8bf0-37f351998c47 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:42.707107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584ed42-d9b4-423b-8bf0-37f351998c47 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:42.709248 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1824/3622] 10.222.0.39 () {58 vars in 1200 bytes} [Sun Aug 7 01:23:42 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 07 01:23:42.713119 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b05043-c784-4b68-8a17-d00055d5768a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:42.724506 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b05043-c784-4b68-8a17-d00055d5768a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:42.730175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850f9fc-76cb-40a9-a106-7fbc13b968ad tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:42.730917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850f9fc-76cb-40a9-a106-7fbc13b968ad tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:42.731289 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850f9fc-76cb-40a9-a106-7fbc13b968ad tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:42.731810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850f9fc-76cb-40a9-a106-7fbc13b968ad tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:42.732506 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850f9fc-76cb-40a9-a106-7fbc13b968ad tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:42.734197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850f9fc-76cb-40a9-a106-7fbc13b968ad tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:42.735550 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1799/3623] 10.222.0.39 () {58 vars in 1203 bytes} [Sun Aug 7 01:23:42 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 07 01:23:42.739511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584ed42-d9b4-423b-8bf0-37f351998c47 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:42.750543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584ed42-d9b4-423b-8bf0-37f351998c47 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:42.756666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d88cfe-d2ba-4d05-be36-508651ff0450 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:42.757120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d88cfe-d2ba-4d05-be36-508651ff0450 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:42.757475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d88cfe-d2ba-4d05-be36-508651ff0450 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:42.757824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d88cfe-d2ba-4d05-be36-508651ff0450 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:42.758484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d88cfe-d2ba-4d05-be36-508651ff0450 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:42.760734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d88cfe-d2ba-4d05-be36-508651ff0450 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:42.764520 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1825/3624] 10.222.0.39 () {58 vars in 1209 bytes} [Sun Aug 7 01:23:42 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:42.766050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850f9fc-76cb-40a9-a106-7fbc13b968ad tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:42.780045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850f9fc-76cb-40a9-a106-7fbc13b968ad tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:42.791113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362bd65-ecf7-410b-a213-a8a07a63e413 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:42.791694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362bd65-ecf7-410b-a213-a8a07a63e413 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:42.792017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362bd65-ecf7-410b-a213-a8a07a63e413 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:42.792393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362bd65-ecf7-410b-a213-a8a07a63e413 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:42.792881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362bd65-ecf7-410b-a213-a8a07a63e413 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:42.794715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362bd65-ecf7-410b-a213-a8a07a63e413 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:42.795873 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1800/3625] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:23:42 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:42.801180 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d88cfe-d2ba-4d05-be36-508651ff0450 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:42.815360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d88cfe-d2ba-4d05-be36-508651ff0450 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:42.821180 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fad26-5a26-4aaa-b31f-492b4c09cb70 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:42.822520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fad26-5a26-4aaa-b31f-492b4c09cb70 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:42.822863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fad26-5a26-4aaa-b31f-492b4c09cb70 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:42.823204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fad26-5a26-4aaa-b31f-492b4c09cb70 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:42.823902 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fad26-5a26-4aaa-b31f-492b4c09cb70 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:42.825608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fad26-5a26-4aaa-b31f-492b4c09cb70 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:42.827304 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1826/3626] 10.222.0.39 () {58 vars in 1218 bytes} [Sun Aug 7 01:23:42 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:42.831684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362bd65-ecf7-410b-a213-a8a07a63e413 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:42.845798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362bd65-ecf7-410b-a213-a8a07a63e413 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:42.854502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c0ea4-2002-4ed2-8418-10b6dae24d05 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:42.855316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c0ea4-2002-4ed2-8418-10b6dae24d05 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:42.855693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c0ea4-2002-4ed2-8418-10b6dae24d05 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:42.856116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c0ea4-2002-4ed2-8418-10b6dae24d05 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:42.856881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c0ea4-2002-4ed2-8418-10b6dae24d05 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:42.859212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c0ea4-2002-4ed2-8418-10b6dae24d05 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:42.859917 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1801/3627] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Aug 7 01:23:42 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:42.864209 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fad26-5a26-4aaa-b31f-492b4c09cb70 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:42.878190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fad26-5a26-4aaa-b31f-492b4c09cb70 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:42.888084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9c304-b1e9-4a81-b566-a85300f825e6 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:42.889283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9c304-b1e9-4a81-b566-a85300f825e6 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:42.889757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9c304-b1e9-4a81-b566-a85300f825e6 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:42.890785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9c304-b1e9-4a81-b566-a85300f825e6 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:42.891606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9c304-b1e9-4a81-b566-a85300f825e6 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:42.893454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9c304-b1e9-4a81-b566-a85300f825e6 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:42.896319 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1827/3628] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:23:42 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:42.901204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c0ea4-2002-4ed2-8418-10b6dae24d05 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:42.917561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c0ea4-2002-4ed2-8418-10b6dae24d05 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:42.946998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ec42b-f86b-4dd1-9eca-18a3ad0a5d0b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:42.957102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ec42b-f86b-4dd1-9eca-18a3ad0a5d0b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:42.957402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ec42b-f86b-4dd1-9eca-18a3ad0a5d0b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:42.957690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ec42b-f86b-4dd1-9eca-18a3ad0a5d0b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:42.958323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ec42b-f86b-4dd1-9eca-18a3ad0a5d0b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:42.968792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ec42b-f86b-4dd1-9eca-18a3ad0a5d0b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:42.975817 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1802/3629] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:23:42 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:42.977043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9c304-b1e9-4a81-b566-a85300f825e6 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:43.011837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9c304-b1e9-4a81-b566-a85300f825e6 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:43.019616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0cbc3-44ec-4b79-bb42-c458f62cbdd3 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:43.020721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0cbc3-44ec-4b79-bb42-c458f62cbdd3 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:43.022218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0cbc3-44ec-4b79-bb42-c458f62cbdd3 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:43.023348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0cbc3-44ec-4b79-bb42-c458f62cbdd3 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:43.024402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0cbc3-44ec-4b79-bb42-c458f62cbdd3 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:43.027171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0cbc3-44ec-4b79-bb42-c458f62cbdd3 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:43.035485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ec42b-f86b-4dd1-9eca-18a3ad0a5d0b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:43.036307 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1828/3630] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Aug 7 01:23:42 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:43.052624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ec42b-f86b-4dd1-9eca-18a3ad0a5d0b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:43.064378 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff0b62-e259-489b-8ad9-982861039f87 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:43.065489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff0b62-e259-489b-8ad9-982861039f87 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:43.066027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff0b62-e259-489b-8ad9-982861039f87 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:43.066549 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff0b62-e259-489b-8ad9-982861039f87 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:43.067353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff0b62-e259-489b-8ad9-982861039f87 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:43.069569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff0b62-e259-489b-8ad9-982861039f87 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:43.075469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0cbc3-44ec-4b79-bb42-c458f62cbdd3 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:43.080259 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1803/3631] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:23:43 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:43.085669 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:43.092520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0cbc3-44ec-4b79-bb42-c458f62cbdd3 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:43.104492 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb303b93-64e9-414f-8e67-5f9495d337cb tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:43.105264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb303b93-64e9-414f-8e67-5f9495d337cb tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:43.105549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb303b93-64e9-414f-8e67-5f9495d337cb tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:43.105918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb303b93-64e9-414f-8e67-5f9495d337cb tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:43.106591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb303b93-64e9-414f-8e67-5f9495d337cb tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:43.108359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb303b93-64e9-414f-8e67-5f9495d337cb tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:43.109653 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1829/3632] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:23:43 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:43.113618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff0b62-e259-489b-8ad9-982861039f87 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:43.126519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff0b62-e259-489b-8ad9-982861039f87 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:43.132379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1097a8-ffb0-4c87-a3b0-336c20dfe78f tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:43.133165 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1097a8-ffb0-4c87-a3b0-336c20dfe78f tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:43.133512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1097a8-ffb0-4c87-a3b0-336c20dfe78f tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:43.133976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1097a8-ffb0-4c87-a3b0-336c20dfe78f tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:43.134627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1097a8-ffb0-4c87-a3b0-336c20dfe78f tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:43.136901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1097a8-ffb0-4c87-a3b0-336c20dfe78f tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:43.142123 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1804/3633] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Aug 7 01:23:43 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:43.143762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb303b93-64e9-414f-8e67-5f9495d337cb tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:43.159392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb303b93-64e9-414f-8e67-5f9495d337cb tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:43.169087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8272e-c112-496b-9b33-4d6beafb9c2c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:43.169757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8272e-c112-496b-9b33-4d6beafb9c2c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:43.170091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8272e-c112-496b-9b33-4d6beafb9c2c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:43.170378 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8272e-c112-496b-9b33-4d6beafb9c2c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:43.171123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8272e-c112-496b-9b33-4d6beafb9c2c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:43.173211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8272e-c112-496b-9b33-4d6beafb9c2c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:43.177666 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1830/3634] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Aug 7 01:23:43 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:43.178900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1097a8-ffb0-4c87-a3b0-336c20dfe78f tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:43.192841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1097a8-ffb0-4c87-a3b0-336c20dfe78f tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:43.199812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7cdf83-e752-495d-ad1b-6f1811d7fd19 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:43.200408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7cdf83-e752-495d-ad1b-6f1811d7fd19 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:43.200685 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7cdf83-e752-495d-ad1b-6f1811d7fd19 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:43.200963 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7cdf83-e752-495d-ad1b-6f1811d7fd19 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:43.201928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7cdf83-e752-495d-ad1b-6f1811d7fd19 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:43.203519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7cdf83-e752-495d-ad1b-6f1811d7fd19 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:43.207610 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1805/3635] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Aug 7 01:23:43 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 07 01:23:43.208828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8272e-c112-496b-9b33-4d6beafb9c2c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:43.220296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8272e-c112-496b-9b33-4d6beafb9c2c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:43.234063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a124ef-685e-4329-90e0-68f4acf4f894 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:43.235299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a124ef-685e-4329-90e0-68f4acf4f894 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:43.236282 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a124ef-685e-4329-90e0-68f4acf4f894 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:43.236567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a124ef-685e-4329-90e0-68f4acf4f894 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:43.237351 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a124ef-685e-4329-90e0-68f4acf4f894 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:43.238976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a124ef-685e-4329-90e0-68f4acf4f894 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:43.243780 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1831/3636] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Aug 7 01:23:43 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 07 01:23:43.245050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7cdf83-e752-495d-ad1b-6f1811d7fd19 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:43.260854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7cdf83-e752-495d-ad1b-6f1811d7fd19 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:43.281136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a251348-8cfd-4d6f-a738-f468ecef9e37 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:43.281791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a251348-8cfd-4d6f-a738-f468ecef9e37 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:43.282069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a251348-8cfd-4d6f-a738-f468ecef9e37 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:43.283072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a251348-8cfd-4d6f-a738-f468ecef9e37 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:43.283072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a251348-8cfd-4d6f-a738-f468ecef9e37 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:43.285943 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a251348-8cfd-4d6f-a738-f468ecef9e37 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:43.292217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a124ef-685e-4329-90e0-68f4acf4f894 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:43.292635 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1806/3637] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Aug 7 01:23:43 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:43.303070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a124ef-685e-4329-90e0-68f4acf4f894 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:43.309638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477a7c6-68d0-4f20-b2ef-0113b0a7c507 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:43.310334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477a7c6-68d0-4f20-b2ef-0113b0a7c507 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:43.310750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477a7c6-68d0-4f20-b2ef-0113b0a7c507 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:43.311031 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477a7c6-68d0-4f20-b2ef-0113b0a7c507 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:43.311729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2477a7c6-68d0-4f20-b2ef-0113b0a7c507 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:43.313346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2477a7c6-68d0-4f20-b2ef-0113b0a7c507 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:43.320131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a251348-8cfd-4d6f-a738-f468ecef9e37 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:43.330895 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1832/3638] 10.222.0.39 () {58 vars in 1257 bytes} [Sun Aug 7 01:23:43 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:43.335297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a251348-8cfd-4d6f-a738-f468ecef9e37 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:43.342474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3179d-ef7f-4ac6-919c-775cd15f9d4a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:43.343382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3179d-ef7f-4ac6-919c-775cd15f9d4a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:43.344127 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3179d-ef7f-4ac6-919c-775cd15f9d4a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:43.344127 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3179d-ef7f-4ac6-919c-775cd15f9d4a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:43.344691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3179d-ef7f-4ac6-919c-775cd15f9d4a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:43.346751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3179d-ef7f-4ac6-919c-775cd15f9d4a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:43.354302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477a7c6-68d0-4f20-b2ef-0113b0a7c507 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:43.355153 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1807/3639] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Aug 7 01:23:43 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:43.374216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477a7c6-68d0-4f20-b2ef-0113b0a7c507 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:43.385382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77a912-0fe0-4cf9-a23c-8302d7b75cb8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:43.386957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77a912-0fe0-4cf9-a23c-8302d7b75cb8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:43.387763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77a912-0fe0-4cf9-a23c-8302d7b75cb8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:43.389234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77a912-0fe0-4cf9-a23c-8302d7b75cb8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:43.390685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77a912-0fe0-4cf9-a23c-8302d7b75cb8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:43.395992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77a912-0fe0-4cf9-a23c-8302d7b75cb8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:43.403614 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1833/3640] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Aug 7 01:23:43 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:43.407672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3179d-ef7f-4ac6-919c-775cd15f9d4a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:43.434547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3179d-ef7f-4ac6-919c-775cd15f9d4a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:43.445362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40170350-2a00-4fe8-9982-3dfd62da979d tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:43.446204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40170350-2a00-4fe8-9982-3dfd62da979d tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:43.447076 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40170350-2a00-4fe8-9982-3dfd62da979d tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:43.447602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40170350-2a00-4fe8-9982-3dfd62da979d tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:43.448447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40170350-2a00-4fe8-9982-3dfd62da979d tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:43.450281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40170350-2a00-4fe8-9982-3dfd62da979d tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:43.451392 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1808/3641] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Aug 7 01:23:43 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:43.455539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77a912-0fe0-4cf9-a23c-8302d7b75cb8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:43.474667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77a912-0fe0-4cf9-a23c-8302d7b75cb8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:43.482680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935612a-d288-4885-8a87-8f40c08d989c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:43.499495 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935612a-d288-4885-8a87-8f40c08d989c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:43.499495 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935612a-d288-4885-8a87-8f40c08d989c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:43.499495 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935612a-d288-4885-8a87-8f40c08d989c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:43.499495 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935612a-d288-4885-8a87-8f40c08d989c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:43.500293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935612a-d288-4885-8a87-8f40c08d989c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:43.500293 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1834/3642] 10.222.0.39 () {58 vars in 1254 bytes} [Sun Aug 7 01:23:43 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:43.503158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40170350-2a00-4fe8-9982-3dfd62da979d tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:43.529217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40170350-2a00-4fe8-9982-3dfd62da979d tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:43.545900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0dcabe-fcd8-498b-a345-a8916df9842b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:43.546632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dcabe-fcd8-498b-a345-a8916df9842b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:43.547498 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dcabe-fcd8-498b-a345-a8916df9842b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:43.547498 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dcabe-fcd8-498b-a345-a8916df9842b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:43.565813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0dcabe-fcd8-498b-a345-a8916df9842b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:43.567576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0dcabe-fcd8-498b-a345-a8916df9842b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:43.568806 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1809/3643] 10.222.0.39 () {58 vars in 1290 bytes} [Sun Aug 7 01:23:43 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:43.572908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935612a-d288-4885-8a87-8f40c08d989c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:43.590383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935612a-d288-4885-8a87-8f40c08d989c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:43.609739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64973e6f-0ee4-41f6-967d-462446827e7b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:43.610494 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64973e6f-0ee4-41f6-967d-462446827e7b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:43.611086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64973e6f-0ee4-41f6-967d-462446827e7b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:43.611510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64973e6f-0ee4-41f6-967d-462446827e7b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:43.613143 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64973e6f-0ee4-41f6-967d-462446827e7b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:43.619921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64973e6f-0ee4-41f6-967d-462446827e7b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:43.621928 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1835/3644] 10.222.0.39 () {58 vars in 1257 bytes} [Sun Aug 7 01:23:43 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 07 01:23:43.626551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0dcabe-fcd8-498b-a345-a8916df9842b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:43.645909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0dcabe-fcd8-498b-a345-a8916df9842b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:43.652108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18187899-8128-4302-bc03-824c28ab0f99 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:43.652951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18187899-8128-4302-bc03-824c28ab0f99 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:43.653296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18187899-8128-4302-bc03-824c28ab0f99 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:43.653785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18187899-8128-4302-bc03-824c28ab0f99 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:43.654457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18187899-8128-4302-bc03-824c28ab0f99 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:43.656364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18187899-8128-4302-bc03-824c28ab0f99 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:43.657960 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1810/3645] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Aug 7 01:23:43 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:43.661988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64973e6f-0ee4-41f6-967d-462446827e7b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:43.704678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64973e6f-0ee4-41f6-967d-462446827e7b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:43.719524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515556c2-e40a-4e65-8bac-d23489611059 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:43.720237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515556c2-e40a-4e65-8bac-d23489611059 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:43.720524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515556c2-e40a-4e65-8bac-d23489611059 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:43.720803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515556c2-e40a-4e65-8bac-d23489611059 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:43.721416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515556c2-e40a-4e65-8bac-d23489611059 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:43.724193 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515556c2-e40a-4e65-8bac-d23489611059 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:43.730538 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1836/3646] 10.222.0.39 () {58 vars in 1308 bytes} [Sun Aug 7 01:23:43 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:43.732032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18187899-8128-4302-bc03-824c28ab0f99 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:43.752576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18187899-8128-4302-bc03-824c28ab0f99 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:43.776596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e171cb-d300-461c-80a2-6092f4b109eb tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:43.777413 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e171cb-d300-461c-80a2-6092f4b109eb tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:43.779620 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e171cb-d300-461c-80a2-6092f4b109eb tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:43.779620 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e171cb-d300-461c-80a2-6092f4b109eb tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:43.780796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e171cb-d300-461c-80a2-6092f4b109eb tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:43.782608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e171cb-d300-461c-80a2-6092f4b109eb tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:43.787473 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1811/3647] 10.222.0.39 () {58 vars in 1290 bytes} [Sun Aug 7 01:23:43 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 07 01:23:43.789851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515556c2-e40a-4e65-8bac-d23489611059 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:43.818989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515556c2-e40a-4e65-8bac-d23489611059 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:43.833404 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f43be-5b06-4bf4-861b-530f6250d65b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:43.834434 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f43be-5b06-4bf4-861b-530f6250d65b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:43.834721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f43be-5b06-4bf4-861b-530f6250d65b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:43.835054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f43be-5b06-4bf4-861b-530f6250d65b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:43.835877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f43be-5b06-4bf4-861b-530f6250d65b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:43.844195 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f43be-5b06-4bf4-861b-530f6250d65b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:43.844195 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1837/3648] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:23:43 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:43.844556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e171cb-d300-461c-80a2-6092f4b109eb tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:43.874405 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e171cb-d300-461c-80a2-6092f4b109eb tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:43.901217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29650e-b780-4f6c-a28c-56a1507459f9 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:43.901986 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29650e-b780-4f6c-a28c-56a1507459f9 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:43.902406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29650e-b780-4f6c-a28c-56a1507459f9 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:43.902690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29650e-b780-4f6c-a28c-56a1507459f9 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:43.903303 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29650e-b780-4f6c-a28c-56a1507459f9 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:43.904967 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29650e-b780-4f6c-a28c-56a1507459f9 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:43.909992 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1812/3649] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Aug 7 01:23:43 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:43.910725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f43be-5b06-4bf4-861b-530f6250d65b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:43.926344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f43be-5b06-4bf4-861b-530f6250d65b tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:43.936035 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14a2a7-ddc1-4a70-81be-1a2c92bdcfa6 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:43.938304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14a2a7-ddc1-4a70-81be-1a2c92bdcfa6 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:43.938619 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14a2a7-ddc1-4a70-81be-1a2c92bdcfa6 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:43.938899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14a2a7-ddc1-4a70-81be-1a2c92bdcfa6 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:43.940397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14a2a7-ddc1-4a70-81be-1a2c92bdcfa6 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:43.945565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e14a2a7-ddc1-4a70-81be-1a2c92bdcfa6 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:43.954767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29650e-b780-4f6c-a28c-56a1507459f9 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:43.955040 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1838/3650] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Aug 7 01:23:43 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:43.998701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29650e-b780-4f6c-a28c-56a1507459f9 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:44.020013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe23c8-22ec-4385-963f-802c5e9bea6a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:44.020777 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe23c8-22ec-4385-963f-802c5e9bea6a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:44.021066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe23c8-22ec-4385-963f-802c5e9bea6a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:44.021347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe23c8-22ec-4385-963f-802c5e9bea6a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:44.021966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe23c8-22ec-4385-963f-802c5e9bea6a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:44.024021 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe23c8-22ec-4385-963f-802c5e9bea6a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:44.026011 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1813/3651] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Aug 7 01:23:43 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 07 01:23:44.030075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14a2a7-ddc1-4a70-81be-1a2c92bdcfa6 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:44.050372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14a2a7-ddc1-4a70-81be-1a2c92bdcfa6 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:44.056584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f915b2a-b83b-4efd-9e05-a909bc19ac74 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:44.057571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f915b2a-b83b-4efd-9e05-a909bc19ac74 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:44.058027 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f915b2a-b83b-4efd-9e05-a909bc19ac74 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:44.058376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f915b2a-b83b-4efd-9e05-a909bc19ac74 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:44.059517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f915b2a-b83b-4efd-9e05-a909bc19ac74 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:44.061863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f915b2a-b83b-4efd-9e05-a909bc19ac74 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:44.063625 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1839/3652] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Aug 7 01:23:44 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:44.067626 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe23c8-22ec-4385-963f-802c5e9bea6a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:44.084163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe23c8-22ec-4385-963f-802c5e9bea6a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:44.092294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841df590-4811-48e5-875a-912d38d4bac7 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:44.094504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841df590-4811-48e5-875a-912d38d4bac7 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:44.095015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841df590-4811-48e5-875a-912d38d4bac7 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:44.095298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841df590-4811-48e5-875a-912d38d4bac7 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:44.096157 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841df590-4811-48e5-875a-912d38d4bac7 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:44.098907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841df590-4811-48e5-875a-912d38d4bac7 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:44.106839 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1814/3653] 10.222.0.39 () {58 vars in 1254 bytes} [Sun Aug 7 01:23:44 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:44.108063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f915b2a-b83b-4efd-9e05-a909bc19ac74 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:44.121170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f915b2a-b83b-4efd-9e05-a909bc19ac74 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:44.126978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c49e1-5b8a-4c6a-ac77-d5d9f439de5a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:44.127855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c49e1-5b8a-4c6a-ac77-d5d9f439de5a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:44.136267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c49e1-5b8a-4c6a-ac77-d5d9f439de5a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:44.136267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c49e1-5b8a-4c6a-ac77-d5d9f439de5a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:44.142888 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c49e1-5b8a-4c6a-ac77-d5d9f439de5a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:44.144632 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c49e1-5b8a-4c6a-ac77-d5d9f439de5a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:44.152031 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1840/3654] 10.222.0.39 () {58 vars in 1257 bytes} [Sun Aug 7 01:23:44 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 07 01:23:44.157512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841df590-4811-48e5-875a-912d38d4bac7 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:44.180071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841df590-4811-48e5-875a-912d38d4bac7 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:44.188236 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a27ded-e003-4689-b2a4-0cbd2219bfb1 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:44.189114 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a27ded-e003-4689-b2a4-0cbd2219bfb1 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:44.189595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a27ded-e003-4689-b2a4-0cbd2219bfb1 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:44.189935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a27ded-e003-4689-b2a4-0cbd2219bfb1 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:44.190681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a27ded-e003-4689-b2a4-0cbd2219bfb1 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:44.192619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a27ded-e003-4689-b2a4-0cbd2219bfb1 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:44.198811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c49e1-5b8a-4c6a-ac77-d5d9f439de5a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:44.205858 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1815/3655] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Aug 7 01:23:44 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:44.212927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c49e1-5b8a-4c6a-ac77-d5d9f439de5a tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:44.224458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98840d9-de72-45ac-926e-72b7429359cd tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:44.225733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98840d9-de72-45ac-926e-72b7429359cd tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:44.226019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98840d9-de72-45ac-926e-72b7429359cd tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:44.226303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98840d9-de72-45ac-926e-72b7429359cd tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:44.227334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98840d9-de72-45ac-926e-72b7429359cd tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:44.229386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98840d9-de72-45ac-926e-72b7429359cd tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:44.233695 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1841/3656] 10.222.0.39 () {58 vars in 1257 bytes} [Sun Aug 7 01:23:44 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:44.238425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a27ded-e003-4689-b2a4-0cbd2219bfb1 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:44.257059 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a27ded-e003-4689-b2a4-0cbd2219bfb1 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:44.266270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9f8e2-475a-4e20-9eca-367850ed0647 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:44.267674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9f8e2-475a-4e20-9eca-367850ed0647 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:44.268562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9f8e2-475a-4e20-9eca-367850ed0647 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:44.268562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9f8e2-475a-4e20-9eca-367850ed0647 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:44.268957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9f8e2-475a-4e20-9eca-367850ed0647 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:44.271562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9f8e2-475a-4e20-9eca-367850ed0647 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:44.276930 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1816/3657] 10.222.0.39 () {58 vars in 1293 bytes} [Sun Aug 7 01:23:44 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:44.277234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98840d9-de72-45ac-926e-72b7429359cd tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:44.300238 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98840d9-de72-45ac-926e-72b7429359cd tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:44.310311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9dd4f7-ae54-4790-be6e-4eb2d982e4ae tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:44.311343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dd4f7-ae54-4790-be6e-4eb2d982e4ae tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:44.312319 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dd4f7-ae54-4790-be6e-4eb2d982e4ae tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:44.313077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dd4f7-ae54-4790-be6e-4eb2d982e4ae tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:44.313581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9dd4f7-ae54-4790-be6e-4eb2d982e4ae tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:44.315222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9dd4f7-ae54-4790-be6e-4eb2d982e4ae tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:44.321168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9f8e2-475a-4e20-9eca-367850ed0647 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:44.328880 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1842/3658] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:23:44 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:44.334364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9f8e2-475a-4e20-9eca-367850ed0647 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:44.342504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d710193-03ad-482d-8464-5e4db0e0c759 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:44.343531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d710193-03ad-482d-8464-5e4db0e0c759 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:44.343840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d710193-03ad-482d-8464-5e4db0e0c759 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:44.345031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d710193-03ad-482d-8464-5e4db0e0c759 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:44.345917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d710193-03ad-482d-8464-5e4db0e0c759 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:44.348374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d710193-03ad-482d-8464-5e4db0e0c759 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:44.362384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9dd4f7-ae54-4790-be6e-4eb2d982e4ae tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:44.372933 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1817/3659] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:23:44 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:44.389447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9dd4f7-ae54-4790-be6e-4eb2d982e4ae tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:44.402646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6226cf-efb6-4c4a-be8f-dd7436124d1c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:44.403360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6226cf-efb6-4c4a-be8f-dd7436124d1c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:44.403641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6226cf-efb6-4c4a-be8f-dd7436124d1c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:44.405810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6226cf-efb6-4c4a-be8f-dd7436124d1c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:44.406037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6226cf-efb6-4c4a-be8f-dd7436124d1c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:44.411024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6226cf-efb6-4c4a-be8f-dd7436124d1c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:44.418536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d710193-03ad-482d-8464-5e4db0e0c759 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:44.442269 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1843/3660] 10.222.0.39 () {58 vars in 1212 bytes} [Sun Aug 7 01:23:44 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:44.450175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d710193-03ad-482d-8464-5e4db0e0c759 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:44.458618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15f218-972b-48b7-a9ba-c8af3acf97d8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:44.460570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15f218-972b-48b7-a9ba-c8af3acf97d8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:44.461144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15f218-972b-48b7-a9ba-c8af3acf97d8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:44.461689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15f218-972b-48b7-a9ba-c8af3acf97d8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:44.462806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15f218-972b-48b7-a9ba-c8af3acf97d8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:44.474974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15f218-972b-48b7-a9ba-c8af3acf97d8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:44.481312 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1818/3661] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Aug 7 01:23:44 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:44.481675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6226cf-efb6-4c4a-be8f-dd7436124d1c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:44.502798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6226cf-efb6-4c4a-be8f-dd7436124d1c tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:44.511818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7965e-3c1c-46df-9405-1b9ef2933120 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:44.514260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7965e-3c1c-46df-9405-1b9ef2933120 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:44.514456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7965e-3c1c-46df-9405-1b9ef2933120 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:44.514774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7965e-3c1c-46df-9405-1b9ef2933120 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:44.515418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7965e-3c1c-46df-9405-1b9ef2933120 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:44.520267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7965e-3c1c-46df-9405-1b9ef2933120 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:44.526707 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1844/3662] 10.222.0.39 () {58 vars in 1215 bytes} [Sun Aug 7 01:23:44 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 07 01:23:44.532196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15f218-972b-48b7-a9ba-c8af3acf97d8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:44.551084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15f218-972b-48b7-a9ba-c8af3acf97d8 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:44.559131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8b578-3bb0-437f-928e-46ad390d1e72 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:44.560249 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8b578-3bb0-437f-928e-46ad390d1e72 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:44.561237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8b578-3bb0-437f-928e-46ad390d1e72 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:44.561237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8b578-3bb0-437f-928e-46ad390d1e72 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:44.561829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8b578-3bb0-437f-928e-46ad390d1e72 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:44.565182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e8b578-3bb0-437f-928e-46ad390d1e72 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:44.569983 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1819/3663] 10.222.0.39 () {58 vars in 1218 bytes} [Sun Aug 7 01:23:44 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:44.571873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7965e-3c1c-46df-9405-1b9ef2933120 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:44.588510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7965e-3c1c-46df-9405-1b9ef2933120 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:44.597448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbe7c6-1508-4bd6-85fd-03681973bddb tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:44.598388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbe7c6-1508-4bd6-85fd-03681973bddb tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:44.598844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbe7c6-1508-4bd6-85fd-03681973bddb tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:44.599488 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbe7c6-1508-4bd6-85fd-03681973bddb tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:44.600909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbe7c6-1508-4bd6-85fd-03681973bddb tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:44.612603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cbe7c6-1508-4bd6-85fd-03681973bddb tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:44.620451 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1845/3664] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:23:44 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:44.632110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8b578-3bb0-437f-928e-46ad390d1e72 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:44.649811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e8b578-3bb0-437f-928e-46ad390d1e72 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:44.662141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fed908-ed99-4a5b-b53e-f1a8b0777762 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:44.663590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fed908-ed99-4a5b-b53e-f1a8b0777762 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:44.663957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fed908-ed99-4a5b-b53e-f1a8b0777762 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:44.664242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fed908-ed99-4a5b-b53e-f1a8b0777762 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:44.666486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fed908-ed99-4a5b-b53e-f1a8b0777762 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:44.671359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fed908-ed99-4a5b-b53e-f1a8b0777762 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:44.677219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbe7c6-1508-4bd6-85fd-03681973bddb tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:44.677634 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1820/3665] 10.222.0.39 () {58 vars in 1239 bytes} [Sun Aug 7 01:23:44 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:44.693493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cbe7c6-1508-4bd6-85fd-03681973bddb tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:44.702368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc336156-3c1d-4fa2-90f4-63706be790fd tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:44.703069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc336156-3c1d-4fa2-90f4-63706be790fd tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:44.703800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc336156-3c1d-4fa2-90f4-63706be790fd tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:44.704293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc336156-3c1d-4fa2-90f4-63706be790fd tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:44.704905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc336156-3c1d-4fa2-90f4-63706be790fd tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:44.708541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc336156-3c1d-4fa2-90f4-63706be790fd tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:44.713996 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1846/3666] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Aug 7 01:23:44 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 07 01:23:44.714581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fed908-ed99-4a5b-b53e-f1a8b0777762 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:44.729373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fed908-ed99-4a5b-b53e-f1a8b0777762 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:44.747099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4eb93d-0162-4f27-a2e6-eca1f24168df tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:44.748214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4eb93d-0162-4f27-a2e6-eca1f24168df tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:44.748756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4eb93d-0162-4f27-a2e6-eca1f24168df tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:44.749251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4eb93d-0162-4f27-a2e6-eca1f24168df tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:44.750108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4eb93d-0162-4f27-a2e6-eca1f24168df tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:44.752874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4eb93d-0162-4f27-a2e6-eca1f24168df tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:44.759694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc336156-3c1d-4fa2-90f4-63706be790fd tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:44.765577 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1821/3667] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Aug 7 01:23:44 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 07 01:23:44.791464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc336156-3c1d-4fa2-90f4-63706be790fd tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:44.808605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df0dae-610e-4ffd-a1c6-179d7454abb9 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:44.809274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df0dae-610e-4ffd-a1c6-179d7454abb9 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:44.809550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df0dae-610e-4ffd-a1c6-179d7454abb9 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:44.809924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df0dae-610e-4ffd-a1c6-179d7454abb9 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:44.810392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df0dae-610e-4ffd-a1c6-179d7454abb9 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:44.812138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df0dae-610e-4ffd-a1c6-179d7454abb9 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:44.815949 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1847/3668] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:23:44 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:44.817252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4eb93d-0162-4f27-a2e6-eca1f24168df tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:44.833552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4eb93d-0162-4f27-a2e6-eca1f24168df tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:44.839258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78db84-fb5b-4197-b9bd-88ebe04c17ae tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:44.839942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78db84-fb5b-4197-b9bd-88ebe04c17ae tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:44.840220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78db84-fb5b-4197-b9bd-88ebe04c17ae tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:44.841970 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78db84-fb5b-4197-b9bd-88ebe04c17ae tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:44.842882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78db84-fb5b-4197-b9bd-88ebe04c17ae tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:44.844961 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78db84-fb5b-4197-b9bd-88ebe04c17ae tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:44.846447 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1822/3669] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:23:44 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:44.851067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df0dae-610e-4ffd-a1c6-179d7454abb9 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:44.885406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df0dae-610e-4ffd-a1c6-179d7454abb9 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:44.905787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b7e53-4433-49cd-9032-730030df1920 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:44.906455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b7e53-4433-49cd-9032-730030df1920 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:44.906734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b7e53-4433-49cd-9032-730030df1920 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:44.907003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b7e53-4433-49cd-9032-730030df1920 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:44.907630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b7e53-4433-49cd-9032-730030df1920 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:44.909283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b7e53-4433-49cd-9032-730030df1920 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:44.922452 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1848/3670] 10.222.0.39 () {58 vars in 1278 bytes} [Sun Aug 7 01:23:44 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Aug 07 01:23:44.924741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78db84-fb5b-4197-b9bd-88ebe04c17ae tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:44.950972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78db84-fb5b-4197-b9bd-88ebe04c17ae tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:44.993705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47baa2-073a-4094-9d70-93d362cca71f tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:44.995072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47baa2-073a-4094-9d70-93d362cca71f tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:44.995510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47baa2-073a-4094-9d70-93d362cca71f tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:44.996127 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47baa2-073a-4094-9d70-93d362cca71f tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/aab6fe2e5b6342ec9e4048f8416c58d6` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:45.017380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47baa2-073a-4094-9d70-93d362cca71f tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:23:45.032882 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-2f47baa2-073a-4094-9d70-93d362cca71f tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Could not find domain: aab6fe2e5b6342ec9e4048f8416c58d6.: keystone.exception.DomainNotFound: Could not find domain: aab6fe2e5b6342ec9e4048f8416c58d6. Aug 07 01:23:45.032882 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:23:45.032882 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 07 01:23:45.032882 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 07 01:23:45.032882 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 01:23:45.032882 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 01:23:45.032882 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 01:23:45.032882 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 01:23:45.032882 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: aab6fe2e5b6342ec9e4048f8416c58d6. Aug 07 01:23:45.032882 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:23:45.032882 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:23:45.032882 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:23:45.032882 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:23:45.032882 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:23:45.032882 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:23:45.033932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:23:45.033932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:23:45.033932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:23:45.033932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:23:45.033932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:23:45.033932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:23:45.033932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:23:45.033932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:23:45.033932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 07 01:23:45.033932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 07 01:23:45.033932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:23:45.033932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:23:45.033932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:23:45.033932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:23:45.033932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:23:45.033932 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:23:45.034929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:23:45.034929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:23:45.034929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:23:45.034929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:23:45.034929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:23:45.034929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 01:23:45.034929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:23:45.034929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:23:45.034929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:23:45.034929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:23:45.034929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:23:45.034929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:23:45.034929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:23:45.034929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:23:45.034929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 07 01:23:45.034929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:23:45.034929 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: aab6fe2e5b6342ec9e4048f8416c58d6. Aug 07 01:23:45.036295 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:23:45.039939 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1823/3671] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:23:44 2022] PATCH /identity/v3/domains/aab6fe2e5b6342ec9e4048f8416c58d6 => generated 112 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:23:45.044762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b7e53-4433-49cd-9032-730030df1920 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:45.060324 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b7e53-4433-49cd-9032-730030df1920 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:45.067138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23199115-2625-49e1-88b4-92fdb8477644 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:45.068364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23199115-2625-49e1-88b4-92fdb8477644 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:45.069187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23199115-2625-49e1-88b4-92fdb8477644 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:45.069778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23199115-2625-49e1-88b4-92fdb8477644 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/e6f7e64eecd44335abd437466636e1ec` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:45.102063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23199115-2625-49e1-88b4-92fdb8477644 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:23:45.108729 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-23199115-2625-49e1-88b4-92fdb8477644 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Could not find domain: e6f7e64eecd44335abd437466636e1ec.: keystone.exception.DomainNotFound: Could not find domain: e6f7e64eecd44335abd437466636e1ec. Aug 07 01:23:45.108729 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:23:45.108729 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 07 01:23:45.108729 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 07 01:23:45.108729 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 01:23:45.108729 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 01:23:45.108729 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 01:23:45.108729 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 01:23:45.108729 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: e6f7e64eecd44335abd437466636e1ec. Aug 07 01:23:45.108729 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:23:45.108729 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:23:45.108729 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:23:45.108729 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:23:45.108729 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:23:45.108729 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:23:45.109736 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:23:45.109736 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:23:45.109736 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:23:45.109736 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:23:45.109736 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:23:45.109736 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:23:45.109736 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:23:45.109736 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:23:45.109736 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 07 01:23:45.109736 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 07 01:23:45.109736 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:23:45.109736 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:23:45.109736 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:23:45.109736 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:23:45.109736 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:23:45.109736 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:23:45.110693 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:23:45.110693 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:23:45.110693 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:23:45.110693 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:23:45.110693 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:23:45.110693 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 01:23:45.110693 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:23:45.110693 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:23:45.110693 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:23:45.110693 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:23:45.110693 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:23:45.110693 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:23:45.110693 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:23:45.110693 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:23:45.110693 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 07 01:23:45.110693 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:23:45.110693 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: e6f7e64eecd44335abd437466636e1ec. Aug 07 01:23:45.111679 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:23:45.111679 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1849/3672] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:23:45 2022] PATCH /identity/v3/domains/e6f7e64eecd44335abd437466636e1ec => generated 112 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 07 01:23:45.115039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47baa2-073a-4094-9d70-93d362cca71f tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:45.150272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47baa2-073a-4094-9d70-93d362cca71f tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:45.168062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7623ff-b77c-4051-b81b-2bd74c068e53 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56933e8d19cf4226b9a762778de92e73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f7ac353de2594f2abba0d359de2996d1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:45.169405 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7623ff-b77c-4051-b81b-2bd74c068e53 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:45.170469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7623ff-b77c-4051-b81b-2bd74c068e53 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:45.171571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7623ff-b77c-4051-b81b-2bd74c068e53 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] PATH_INFO: `/v3/domains/72a649be868f44728a2a021b1d5238bf` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:45.191132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7623ff-b77c-4051-b81b-2bd74c068e53 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:23:45.197252 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-9b7623ff-b77c-4051-b81b-2bd74c068e53 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Could not find domain: 72a649be868f44728a2a021b1d5238bf.: keystone.exception.DomainNotFound: Could not find domain: 72a649be868f44728a2a021b1d5238bf. Aug 07 01:23:45.197252 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:23:45.197252 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 07 01:23:45.197252 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 07 01:23:45.197252 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 01:23:45.197252 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 01:23:45.197252 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 01:23:45.197252 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 01:23:45.197252 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 72a649be868f44728a2a021b1d5238bf. Aug 07 01:23:45.197252 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:23:45.197252 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:23:45.197252 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:23:45.197252 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:23:45.197252 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:23:45.197252 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:23:45.198296 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:23:45.198296 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:23:45.198296 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:23:45.198296 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:23:45.198296 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:23:45.198296 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:23:45.198296 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:23:45.198296 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:23:45.198296 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 07 01:23:45.198296 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 07 01:23:45.198296 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:23:45.198296 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:23:45.198296 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:23:45.198296 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:23:45.198296 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:23:45.198296 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:23:45.200518 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:23:45.200518 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:23:45.200518 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:23:45.200518 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:23:45.200518 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:23:45.200518 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 01:23:45.200518 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:23:45.200518 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:23:45.200518 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:23:45.200518 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:23:45.200518 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:23:45.200518 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:23:45.200518 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:23:45.200518 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:23:45.200518 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 07 01:23:45.200518 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:23:45.200518 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 72a649be868f44728a2a021b1d5238bf. Aug 07 01:23:45.201522 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:23:45.203412 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1824/3673] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:23:45 2022] PATCH /identity/v3/domains/72a649be868f44728a2a021b1d5238bf => generated 112 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:23:45.207399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23199115-2625-49e1-88b4-92fdb8477644 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:45.210355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-23199115-2625-49e1-88b4-92fdb8477644 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:45.390313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23199115-2625-49e1-88b4-92fdb8477644 tempest-DomainConfigurationTestJSON-483699171 tempest-DomainConfigurationTestJSON-483699171-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:45.395523 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa5bf3-5ced-4a62-9c8d-921371e34ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:45.396607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa5bf3-5ced-4a62-9c8d-921371e34ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:45.396607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa5bf3-5ced-4a62-9c8d-921371e34ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:45.396873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa5bf3-5ced-4a62-9c8d-921371e34ee6 admin admin] PATH_INFO: `/v3/users/60f26f45190e47049fa9bd97a70f6fb5` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:45.398557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa5bf3-5ced-4a62-9c8d-921371e34ee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60f26f45190e47049fa9bd97a70f6fb5)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:45.401931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa5bf3-5ced-4a62-9c8d-921371e34ee6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:45.472971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fbaa5bf3-5ced-4a62-9c8d-921371e34ee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60f26f45190e47049fa9bd97a70f6fb5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:45.484395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fbaa5bf3-5ced-4a62-9c8d-921371e34ee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60f26f45190e47049fa9bd97a70f6fb5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:45.500752 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:45.517498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fbaa5bf3-5ced-4a62-9c8d-921371e34ee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60f26f45190e47049fa9bd97a70f6fb5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:45.518863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fbaa5bf3-5ced-4a62-9c8d-921371e34ee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60f26f45190e47049fa9bd97a70f6fb5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:45.543654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fbaa5bf3-5ced-4a62-9c8d-921371e34ee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60f26f45190e47049fa9bd97a70f6fb5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:45.567105 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1850/3674] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:23:45 2022] DELETE /identity/v3/users/60f26f45190e47049fa9bd97a70f6fb5 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:45.570976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7d62c-3815-4db9-83c0-5979340b3c83 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:45.571502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7d62c-3815-4db9-83c0-5979340b3c83 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:45.571790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7d62c-3815-4db9-83c0-5979340b3c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:45.615958 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-8ef7d62c-3815-4db9-83c0-5979340b3c83 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:45.617412 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8ef7d62c-3815-4db9-83c0-5979340b3c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:45.849692 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1825/3675] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:23:45.873844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa5bf3-5ced-4a62-9c8d-921371e34ee6 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:45.875405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fbaa5bf3-5ced-4a62-9c8d-921371e34ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:46.023477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa5bf3-5ced-4a62-9c8d-921371e34ee6 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:46.031499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47921c-4643-4b13-86f8-96d5be35d6a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:46.042004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47921c-4643-4b13-86f8-96d5be35d6a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:46.042357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47921c-4643-4b13-86f8-96d5be35d6a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:46.043351 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47921c-4643-4b13-86f8-96d5be35d6a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:46.065063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47921c-4643-4b13-86f8-96d5be35d6a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:46.066859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47921c-4643-4b13-86f8-96d5be35d6a3 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:46.080953 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1851/3676] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:23:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:23:46.910324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7d62c-3815-4db9-83c0-5979340b3c83 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:46.911799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8ef7d62c-3815-4db9-83c0-5979340b3c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:46.936902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7d62c-3815-4db9-83c0-5979340b3c83 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:46.976989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1c01c-5fd2-439e-9076-a69340c8442c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:46.976989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1c01c-5fd2-439e-9076-a69340c8442c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:46.976989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1c01c-5fd2-439e-9076-a69340c8442c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:46.976989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1c01c-5fd2-439e-9076-a69340c8442c admin admin] PATH_INFO: `/v3/projects/31669accef6a44ceba05c3bdda6cbb08` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:46.989053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1c01c-5fd2-439e-9076-a69340c8442c admin admin] RBAC: Authorizing `identity:delete_project(project_id=31669accef6a44ceba05c3bdda6cbb08)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:46.999076 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1c01c-5fd2-439e-9076-a69340c8442c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:47.010157 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:47.109478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8af1c01c-5fd2-439e-9076-a69340c8442c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31669accef6a44ceba05c3bdda6cbb08', 'request_id': 'req-8af1c01c-5fd2-439e-9076-a69340c8442c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:47.116604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8af1c01c-5fd2-439e-9076-a69340c8442c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31669accef6a44ceba05c3bdda6cbb08', 'request_id': 'req-8af1c01c-5fd2-439e-9076-a69340c8442c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:47.128831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8af1c01c-5fd2-439e-9076-a69340c8442c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31669accef6a44ceba05c3bdda6cbb08', 'request_id': 'req-8af1c01c-5fd2-439e-9076-a69340c8442c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:47.156596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8af1c01c-5fd2-439e-9076-a69340c8442c admin admin] The token cache is being invalidate because project 31669accef6a44ceba05c3bdda6cbb08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:23:47.157143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8af1c01c-5fd2-439e-9076-a69340c8442c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:47.158600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8af1c01c-5fd2-439e-9076-a69340c8442c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:47.160714 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1826/3677] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:23:46 2022] DELETE /identity/v3/projects/31669accef6a44ceba05c3bdda6cbb08 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:47.164536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47921c-4643-4b13-86f8-96d5be35d6a3 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:47.178978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47921c-4643-4b13-86f8-96d5be35d6a3 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:47.343629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942832c-9374-455b-9433-5b68bb817405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:47.344755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942832c-9374-455b-9433-5b68bb817405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:47.345484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942832c-9374-455b-9433-5b68bb817405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:47.346051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942832c-9374-455b-9433-5b68bb817405 admin admin] PATH_INFO: `/v3/users/56933e8d19cf4226b9a762778de92e73` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:47.348120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942832c-9374-455b-9433-5b68bb817405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56933e8d19cf4226b9a762778de92e73)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:47.366401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942832c-9374-455b-9433-5b68bb817405 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:47.458127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4942832c-9374-455b-9433-5b68bb817405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56933e8d19cf4226b9a762778de92e73'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:47.478417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4942832c-9374-455b-9433-5b68bb817405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56933e8d19cf4226b9a762778de92e73'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:47.504677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4942832c-9374-455b-9433-5b68bb817405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56933e8d19cf4226b9a762778de92e73'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:47.505990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4942832c-9374-455b-9433-5b68bb817405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56933e8d19cf4226b9a762778de92e73'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:47.522601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4942832c-9374-455b-9433-5b68bb817405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56933e8d19cf4226b9a762778de92e73'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:47.529576 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1852/3678] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:23:47 2022] DELETE /identity/v3/users/56933e8d19cf4226b9a762778de92e73 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:23:48.026188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1c01c-5fd2-439e-9076-a69340c8442c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:48.027798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8af1c01c-5fd2-439e-9076-a69340c8442c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:48.053927 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1c01c-5fd2-439e-9076-a69340c8442c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:48.147399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def3fa0-983b-4edd-beb4-dceeb602bc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:48.148630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def3fa0-983b-4edd-beb4-dceeb602bc55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:48.149128 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def3fa0-983b-4edd-beb4-dceeb602bc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:48.149855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def3fa0-983b-4edd-beb4-dceeb602bc55 admin admin] PATH_INFO: `/v3/projects/f7ac353de2594f2abba0d359de2996d1` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:48.151273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def3fa0-983b-4edd-beb4-dceeb602bc55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7ac353de2594f2abba0d359de2996d1)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:48.153592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def3fa0-983b-4edd-beb4-dceeb602bc55 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:48.227334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2def3fa0-983b-4edd-beb4-dceeb602bc55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7ac353de2594f2abba0d359de2996d1', 'request_id': 'req-2def3fa0-983b-4edd-beb4-dceeb602bc55'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:48.252048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2def3fa0-983b-4edd-beb4-dceeb602bc55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7ac353de2594f2abba0d359de2996d1', 'request_id': 'req-2def3fa0-983b-4edd-beb4-dceeb602bc55'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:48.269354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2def3fa0-983b-4edd-beb4-dceeb602bc55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7ac353de2594f2abba0d359de2996d1', 'request_id': 'req-2def3fa0-983b-4edd-beb4-dceeb602bc55'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:48.291462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2def3fa0-983b-4edd-beb4-dceeb602bc55 admin admin] The token cache is being invalidate because project f7ac353de2594f2abba0d359de2996d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:23:48.292083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2def3fa0-983b-4edd-beb4-dceeb602bc55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:48.292998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2def3fa0-983b-4edd-beb4-dceeb602bc55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:48.296162 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1827/3679] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:23:48 2022] DELETE /identity/v3/projects/f7ac353de2594f2abba0d359de2996d1 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:48.300642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdadc25-5c5f-49a6-a159-44e2387f5c2f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:48.301278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdadc25-5c5f-49a6-a159-44e2387f5c2f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:48.301617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdadc25-5c5f-49a6-a159-44e2387f5c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:48.330357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-7bdadc25-5c5f-49a6-a159-44e2387f5c2f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:48.332054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7bdadc25-5c5f-49a6-a159-44e2387f5c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:48.337362 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:48.426783 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1853/3680] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:23:48.435618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba184fb4-a01e-4879-b50c-77bb9d50e61f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:48.436318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba184fb4-a01e-4879-b50c-77bb9d50e61f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:48.436692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba184fb4-a01e-4879-b50c-77bb9d50e61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:48.474570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ba184fb4-a01e-4879-b50c-77bb9d50e61f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:48.477090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ba184fb4-a01e-4879-b50c-77bb9d50e61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:48.487309 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1828/3681] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:23:48.490908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdadc25-5c5f-49a6-a159-44e2387f5c2f None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:48.506626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdadc25-5c5f-49a6-a159-44e2387f5c2f None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:48.515996 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e14db-af13-4e63-8ce7-e2f2fe5bc59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:48.517556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e14db-af13-4e63-8ce7-e2f2fe5bc59e admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:48.518059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e14db-af13-4e63-8ce7-e2f2fe5bc59e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:48.518623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e14db-af13-4e63-8ce7-e2f2fe5bc59e admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:48.519528 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e14db-af13-4e63-8ce7-e2f2fe5bc59e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:23:48.520190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e14db-af13-4e63-8ce7-e2f2fe5bc59e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:48.522071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e14db-af13-4e63-8ce7-e2f2fe5bc59e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:48.539200 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1854/3682] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:23:48.544159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba184fb4-a01e-4879-b50c-77bb9d50e61f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:48.558653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba184fb4-a01e-4879-b50c-77bb9d50e61f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:48.578713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8e933-4675-4cf2-9ecd-0b5609eba54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:48.584976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8e933-4675-4cf2-9ecd-0b5609eba54b admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:48.585339 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8e933-4675-4cf2-9ecd-0b5609eba54b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:48.586737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8e933-4675-4cf2-9ecd-0b5609eba54b admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:48.588307 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8e933-4675-4cf2-9ecd-0b5609eba54b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:48.590620 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8e933-4675-4cf2-9ecd-0b5609eba54b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:48.616085 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:48.643219 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1829/3683] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:23:48 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:23:48.647205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e14db-af13-4e63-8ce7-e2f2fe5bc59e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:48.659824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e14db-af13-4e63-8ce7-e2f2fe5bc59e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:48.755509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa703d-0dba-4c86-ba60-6e470f2a8d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:48.758870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa703d-0dba-4c86-ba60-6e470f2a8d93 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:48.759466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa703d-0dba-4c86-ba60-6e470f2a8d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:48.760059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aa703d-0dba-4c86-ba60-6e470f2a8d93 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:48.760878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa703d-0dba-4c86-ba60-6e470f2a8d93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:48.764012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aa703d-0dba-4c86-ba60-6e470f2a8d93 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:48.849004 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1855/3684] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:23:48 2022] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:23:48.849214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8e933-4675-4cf2-9ecd-0b5609eba54b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:48.869767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8e933-4675-4cf2-9ecd-0b5609eba54b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:48.881298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcba499-7c47-44e6-aa6c-a71004596610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:48.884281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcba499-7c47-44e6-aa6c-a71004596610 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:48.884921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcba499-7c47-44e6-aa6c-a71004596610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:48.886041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcba499-7c47-44e6-aa6c-a71004596610 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:48.887283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcba499-7c47-44e6-aa6c-a71004596610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:48.891027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcba499-7c47-44e6-aa6c-a71004596610 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:48.921217 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1830/3685] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:23:48.922566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa703d-0dba-4c86-ba60-6e470f2a8d93 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:48.935852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aa703d-0dba-4c86-ba60-6e470f2a8d93 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:48.944479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b5067-c87c-4465-a36b-bc4b69523b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:48.945504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b5067-c87c-4465-a36b-bc4b69523b36 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:48.945504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b5067-c87c-4465-a36b-bc4b69523b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:48.945837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b5067-c87c-4465-a36b-bc4b69523b36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:48.946994 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b5067-c87c-4465-a36b-bc4b69523b36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:48.949570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b5067-c87c-4465-a36b-bc4b69523b36 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:49.005251 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1856/3686] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:23:49.009653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcba499-7c47-44e6-aa6c-a71004596610 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:49.029875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcba499-7c47-44e6-aa6c-a71004596610 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:49.051428 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c46d85-f0ef-491d-b174-88016cd129f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:49.051668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c46d85-f0ef-491d-b174-88016cd129f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:49.051973 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c46d85-f0ef-491d-b174-88016cd129f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:49.052171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c46d85-f0ef-491d-b174-88016cd129f3 admin admin] PATH_INFO: `/v3/projects/e1225037c5f842edab597f7ec42f9d57/users/8d8d34fadfc84fa4bdcb233a5f7558ad/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:49.122789 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c46d85-f0ef-491d-b174-88016cd129f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1225037c5f842edab597f7ec42f9d57, user_id=8d8d34fadfc84fa4bdcb233a5f7558ad, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:49.125781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c46d85-f0ef-491d-b174-88016cd129f3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:49.172272 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1831/3687] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:23:49 2022] PUT /identity/v3/projects/e1225037c5f842edab597f7ec42f9d57/users/8d8d34fadfc84fa4bdcb233a5f7558ad/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:49.184558 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40c64c-b9f1-4b99-b0a6-510e2a15141d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:49.185266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40c64c-b9f1-4b99-b0a6-510e2a15141d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:49.185803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40c64c-b9f1-4b99-b0a6-510e2a15141d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:49.270597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5f40c64c-b9f1-4b99-b0a6-510e2a15141d None None] MFA Rules not processed for user `8d8d34fadfc84fa4bdcb233a5f7558ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:49.271907 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5f40c64c-b9f1-4b99-b0a6-510e2a15141d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:49.401370 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1857/3688] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:23:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:23:49.405158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c46d85-f0ef-491d-b174-88016cd129f3 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:49.545027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c46d85-f0ef-491d-b174-88016cd129f3 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:49.564469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd194048-0e73-4480-b3b4-af3dc85667a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:49.565212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd194048-0e73-4480-b3b4-af3dc85667a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:49.565698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd194048-0e73-4480-b3b4-af3dc85667a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:49.566038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd194048-0e73-4480-b3b4-af3dc85667a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:49.569724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd194048-0e73-4480-b3b4-af3dc85667a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:49.579323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd194048-0e73-4480-b3b4-af3dc85667a3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:49.688842 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1832/3689] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:23:49 2022] POST /identity/v3/projects => generated 373 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:23:49.688992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40c64c-b9f1-4b99-b0a6-510e2a15141d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:49.699124 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:49.708681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40c64c-b9f1-4b99-b0a6-510e2a15141d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:49.859837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c779407-547e-4cd2-a7d9-c9651bc5d089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:49.860826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c779407-547e-4cd2-a7d9-c9651bc5d089 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:49.861403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c779407-547e-4cd2-a7d9-c9651bc5d089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:49.861896 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c779407-547e-4cd2-a7d9-c9651bc5d089 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:49.862764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c779407-547e-4cd2-a7d9-c9651bc5d089 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:49.865052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c779407-547e-4cd2-a7d9-c9651bc5d089 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:49.894027 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1858/3690] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:23:49 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:23:49.897949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd194048-0e73-4480-b3b4-af3dc85667a3 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:49.921900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd194048-0e73-4480-b3b4-af3dc85667a3 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:49.938737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98af736-d633-4275-aebf-ac99e0299ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:49.945255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98af736-d633-4275-aebf-ac99e0299ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:49.945624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98af736-d633-4275-aebf-ac99e0299ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:49.945906 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98af736-d633-4275-aebf-ac99e0299ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:49.948614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98af736-d633-4275-aebf-ac99e0299ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:49.955776 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98af736-d633-4275-aebf-ac99e0299ea6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:50.005550 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1833/3691] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:23:50.005851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c779407-547e-4cd2-a7d9-c9651bc5d089 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:50.029156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c779407-547e-4cd2-a7d9-c9651bc5d089 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:50.037088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94a032-6f8c-46b8-92af-6e2e1fc92809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:50.037805 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94a032-6f8c-46b8-92af-6e2e1fc92809 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:50.038232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94a032-6f8c-46b8-92af-6e2e1fc92809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:50.038732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94a032-6f8c-46b8-92af-6e2e1fc92809 admin admin] PATH_INFO: `/v3/projects/576767169f70404d8961a3243207d75c/users/ad84d1561a5e4a55800ac43713d34f9e/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:50.070695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c94a032-6f8c-46b8-92af-6e2e1fc92809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=576767169f70404d8961a3243207d75c, user_id=ad84d1561a5e4a55800ac43713d34f9e, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:50.079487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c94a032-6f8c-46b8-92af-6e2e1fc92809 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:50.131551 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1859/3692] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:23:50 2022] PUT /identity/v3/projects/576767169f70404d8961a3243207d75c/users/ad84d1561a5e4a55800ac43713d34f9e/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:50.132925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98af736-d633-4275-aebf-ac99e0299ea6 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:50.148036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98af736-d633-4275-aebf-ac99e0299ea6 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:50.268123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb8524-bd74-4cd4-b81b-27a0b05893d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:50.269897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb8524-bd74-4cd4-b81b-27a0b05893d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:50.270654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb8524-bd74-4cd4-b81b-27a0b05893d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:50.271164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb8524-bd74-4cd4-b81b-27a0b05893d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:50.273152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb8524-bd74-4cd4-b81b-27a0b05893d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:50.275190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb8524-bd74-4cd4-b81b-27a0b05893d3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:50.295692 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1834/3693] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:23:50 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:23:50.300490 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94a032-6f8c-46b8-92af-6e2e1fc92809 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:50.315873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94a032-6f8c-46b8-92af-6e2e1fc92809 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:50.332407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a7344-57cf-475f-a377-0e79025e0bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:50.333141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a7344-57cf-475f-a377-0e79025e0bc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:50.333439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a7344-57cf-475f-a377-0e79025e0bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:50.333932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a7344-57cf-475f-a377-0e79025e0bc4 admin admin] PATH_INFO: `/v3/projects/576767169f70404d8961a3243207d75c/users/ad84d1561a5e4a55800ac43713d34f9e/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:50.341474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a7344-57cf-475f-a377-0e79025e0bc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=576767169f70404d8961a3243207d75c, user_id=ad84d1561a5e4a55800ac43713d34f9e, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:50.344726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a7344-57cf-475f-a377-0e79025e0bc4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:50.406582 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1860/3694] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:23:50 2022] PUT /identity/v3/projects/576767169f70404d8961a3243207d75c/users/ad84d1561a5e4a55800ac43713d34f9e/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:23:50.412457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a7a37-fd09-4e1a-ac06-d20daf91baf0 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:50.413239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a7a37-fd09-4e1a-ac06-d20daf91baf0 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:50.413821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a7a37-fd09-4e1a-ac06-d20daf91baf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:50.487333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-430a7a37-fd09-4e1a-ac06-d20daf91baf0 None None] MFA Rules not processed for user `ad84d1561a5e4a55800ac43713d34f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:50.488574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-430a7a37-fd09-4e1a-ac06-d20daf91baf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:50.507466 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:50.572529 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1835/3695] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:23:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:23:50.577469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a7344-57cf-475f-a377-0e79025e0bc4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:50.608984 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a7344-57cf-475f-a377-0e79025e0bc4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:50.624273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f2792-9927-4919-83a9-e14ec1c2523b tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad84d1561a5e4a55800ac43713d34f9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '576767169f70404d8961a3243207d75c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:50.625022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f2792-9927-4919-83a9-e14ec1c2523b tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:50.625364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f2792-9927-4919-83a9-e14ec1c2523b tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:50.626924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f2792-9927-4919-83a9-e14ec1c2523b tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:50.627819 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f2792-9927-4919-83a9-e14ec1c2523b tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:50.630678 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-0f8f2792-9927-4919-83a9-e14ec1c2523b tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:23:50.630678 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:23:50.630678 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:23:50.633539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f2792-9927-4919-83a9-e14ec1c2523b tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:50.684971 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1861/3696] 10.222.0.39 () {60 vars in 1185 bytes} [Sun Aug 7 01:23:50 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:23:50.686321 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a7a37-fd09-4e1a-ac06-d20daf91baf0 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:50.699663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a7a37-fd09-4e1a-ac06-d20daf91baf0 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:50.711475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fd1b9-fc0b-4efa-be0f-16acae201054 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad84d1561a5e4a55800ac43713d34f9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '576767169f70404d8961a3243207d75c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:50.712661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fd1b9-fc0b-4efa-be0f-16acae201054 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:50.713036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fd1b9-fc0b-4efa-be0f-16acae201054 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:50.713911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fd1b9-fc0b-4efa-be0f-16acae201054 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/3a116ca31f244d0d91564aff6a53342d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:50.718513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1fd1b9-fc0b-4efa-be0f-16acae201054 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=3a116ca31f244d0d91564aff6a53342d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:50.718513 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-9b1fd1b9-fc0b-4efa-be0f-16acae201054 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:23:50.718513 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:23:50.718513 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:23:50.718513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1fd1b9-fc0b-4efa-be0f-16acae201054 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:50.752081 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1836/3697] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Aug 7 01:23:50 2022] GET /identity/v3/OS-OAUTH1/consumers/3a116ca31f244d0d91564aff6a53342d => generated 221 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:23:50.754648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f2792-9927-4919-83a9-e14ec1c2523b tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:50.769024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f2792-9927-4919-83a9-e14ec1c2523b tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:50.784642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b0c80-24b1-47b5-b940-247de46c3918 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad84d1561a5e4a55800ac43713d34f9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '576767169f70404d8961a3243207d75c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:50.785302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b0c80-24b1-47b5-b940-247de46c3918 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:50.785587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b0c80-24b1-47b5-b940-247de46c3918 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:50.785864 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2b0c80-24b1-47b5-b940-247de46c3918 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/3a116ca31f244d0d91564aff6a53342d` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:50.786468 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b0c80-24b1-47b5-b940-247de46c3918 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=3a116ca31f244d0d91564aff6a53342d)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:50.787485 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-ce2b0c80-24b1-47b5-b940-247de46c3918 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:23:50.787485 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:23:50.787485 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:23:50.788415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2b0c80-24b1-47b5-b940-247de46c3918 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:50.788678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ce2b0c80-24b1-47b5-b940-247de46c3918 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Invalidating token cache because consumer 3a116ca31f244d0d91564aff6a53342d has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:23:50.788961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ce2b0c80-24b1-47b5-b940-247de46c3918 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:50.791639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ce2b0c80-24b1-47b5-b940-247de46c3918 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:50.833092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ce2b0c80-24b1-47b5-b940-247de46c3918 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '3a116ca31f244d0d91564aff6a53342d', 'request_id': 'req-ce2b0c80-24b1-47b5-b940-247de46c3918'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:50.860834 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1862/3698] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Aug 7 01:23:50 2022] DELETE /identity/v3/OS-OAUTH1/consumers/3a116ca31f244d0d91564aff6a53342d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:50.861274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fd1b9-fc0b-4efa-be0f-16acae201054 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:50.863445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9b1fd1b9-fc0b-4efa-be0f-16acae201054 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:50.888555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fd1b9-fc0b-4efa-be0f-16acae201054 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:50.896923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe100a2-a2fd-4588-a247-f93cd1b15998 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad84d1561a5e4a55800ac43713d34f9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '576767169f70404d8961a3243207d75c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:50.898218 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe100a2-a2fd-4588-a247-f93cd1b15998 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:50.898488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe100a2-a2fd-4588-a247-f93cd1b15998 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:50.898841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe100a2-a2fd-4588-a247-f93cd1b15998 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:50.899528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe100a2-a2fd-4588-a247-f93cd1b15998 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:50.900739 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-dbe100a2-a2fd-4588-a247-f93cd1b15998 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:23:50.900739 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:23:50.900739 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:23:50.902630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe100a2-a2fd-4588-a247-f93cd1b15998 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:50.947139 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1837/3699] 10.222.0.39 () {60 vars in 1185 bytes} [Sun Aug 7 01:23:50 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:23:50.949197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b0c80-24b1-47b5-b940-247de46c3918 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:50.973344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2b0c80-24b1-47b5-b940-247de46c3918 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:50.988548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c5eab-ab7c-42f6-a49d-97982d213590 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad84d1561a5e4a55800ac43713d34f9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '576767169f70404d8961a3243207d75c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:50.989186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c5eab-ab7c-42f6-a49d-97982d213590 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:50.990245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c5eab-ab7c-42f6-a49d-97982d213590 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:50.990519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c5eab-ab7c-42f6-a49d-97982d213590 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/2b803acff5dc4d8d9f2e086763f6df62` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:50.991121 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c5eab-ab7c-42f6-a49d-97982d213590 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=2b803acff5dc4d8d9f2e086763f6df62)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:50.996565 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-9f1c5eab-ab7c-42f6-a49d-97982d213590 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:23:50.996565 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:23:50.996565 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:23:50.997781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c5eab-ab7c-42f6-a49d-97982d213590 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:51.013870 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1863/3700] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Aug 7 01:23:50 2022] GET /identity/v3/OS-OAUTH1/consumers/2b803acff5dc4d8d9f2e086763f6df62 => generated 220 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:23:51.018517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe100a2-a2fd-4588-a247-f93cd1b15998 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:51.034628 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe100a2-a2fd-4588-a247-f93cd1b15998 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:51.040759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0cdc7-e62c-451d-b4da-d17e072a2a82 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad84d1561a5e4a55800ac43713d34f9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '576767169f70404d8961a3243207d75c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:51.041563 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0cdc7-e62c-451d-b4da-d17e072a2a82 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:51.041838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0cdc7-e62c-451d-b4da-d17e072a2a82 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:51.042109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a0cdc7-e62c-451d-b4da-d17e072a2a82 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/2b803acff5dc4d8d9f2e086763f6df62` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:51.042705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0cdc7-e62c-451d-b4da-d17e072a2a82 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=2b803acff5dc4d8d9f2e086763f6df62)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:51.044885 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-39a0cdc7-e62c-451d-b4da-d17e072a2a82 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:23:51.044885 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:23:51.044885 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:23:51.045822 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a0cdc7-e62c-451d-b4da-d17e072a2a82 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:51.046089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-39a0cdc7-e62c-451d-b4da-d17e072a2a82 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Invalidating token cache because consumer 2b803acff5dc4d8d9f2e086763f6df62 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:23:51.046369 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-39a0cdc7-e62c-451d-b4da-d17e072a2a82 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:51.048888 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-39a0cdc7-e62c-451d-b4da-d17e072a2a82 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:51.083777 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-39a0cdc7-e62c-451d-b4da-d17e072a2a82 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '2b803acff5dc4d8d9f2e086763f6df62', 'request_id': 'req-39a0cdc7-e62c-451d-b4da-d17e072a2a82'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:51.108948 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1838/3701] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Aug 7 01:23:51 2022] DELETE /identity/v3/OS-OAUTH1/consumers/2b803acff5dc4d8d9f2e086763f6df62 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:51.112963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c5eab-ab7c-42f6-a49d-97982d213590 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:51.115065 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9f1c5eab-ab7c-42f6-a49d-97982d213590 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:51.146787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c5eab-ab7c-42f6-a49d-97982d213590 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:51.162695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d285b42-2b21-4910-b0bc-9b6fdae8073a tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad84d1561a5e4a55800ac43713d34f9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '576767169f70404d8961a3243207d75c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:51.163573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d285b42-2b21-4910-b0bc-9b6fdae8073a tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:51.163961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d285b42-2b21-4910-b0bc-9b6fdae8073a tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:51.164305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d285b42-2b21-4910-b0bc-9b6fdae8073a tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/2b803acff5dc4d8d9f2e086763f6df62` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:51.165007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d285b42-2b21-4910-b0bc-9b6fdae8073a tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=2b803acff5dc4d8d9f2e086763f6df62)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:51.166758 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d285b42-2b21-4910-b0bc-9b6fdae8073a tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:51.182009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-5d285b42-2b21-4910-b0bc-9b6fdae8073a tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Aug 07 01:23:51.182009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:23:51.182009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:23:51.182009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:23:51.182009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:23:51.182009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:23:51.182009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:23:51.182009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:23:51.182009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:23:51.182009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:23:51.182009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:23:51.182009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:23:51.182009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Aug 07 01:23:51.182009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Aug 07 01:23:51.182009 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Aug 07 01:23:51.183254 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Aug 07 01:23:51.183254 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Aug 07 01:23:51.183254 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Aug 07 01:23:51.183254 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Aug 07 01:23:51.183254 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Aug 07 01:23:51.183254 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Aug 07 01:23:51.183254 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Aug 07 01:23:51.183254 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Aug 07 01:23:51.183254 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:23:51.184503 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1864/3702] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Aug 7 01:23:51 2022] GET /identity/v3/OS-OAUTH1/consumers/2b803acff5dc4d8d9f2e086763f6df62 => generated 74 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 01:23:51.189419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0cdc7-e62c-451d-b4da-d17e072a2a82 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:51.207827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a0cdc7-e62c-451d-b4da-d17e072a2a82 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:51.215740 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b28dc-c099-4768-99d1-36357f62ec53 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad84d1561a5e4a55800ac43713d34f9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '576767169f70404d8961a3243207d75c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:51.217747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b28dc-c099-4768-99d1-36357f62ec53 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:51.218879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b28dc-c099-4768-99d1-36357f62ec53 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:51.219300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b28dc-c099-4768-99d1-36357f62ec53 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/2b803acff5dc4d8d9f2e086763f6df62` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:51.220243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b28dc-c099-4768-99d1-36357f62ec53 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=2b803acff5dc4d8d9f2e086763f6df62)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:51.225409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b28dc-c099-4768-99d1-36357f62ec53 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:51.225831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7e7b28dc-c099-4768-99d1-36357f62ec53 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Invalidating token cache because consumer 2b803acff5dc4d8d9f2e086763f6df62 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:23:51.226243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7e7b28dc-c099-4768-99d1-36357f62ec53 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:51.227685 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7e7b28dc-c099-4768-99d1-36357f62ec53 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:51.258159 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-7e7b28dc-c099-4768-99d1-36357f62ec53 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Aug 07 01:23:51.258159 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:23:51.258159 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:23:51.258159 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:23:51.258159 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:23:51.258159 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:23:51.258159 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:23:51.258159 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:23:51.258159 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:23:51.258159 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:23:51.258159 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:23:51.258159 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:23:51.258159 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Aug 07 01:23:51.258159 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Aug 07 01:23:51.258159 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:23:51.260097 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:23:51.260097 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Aug 07 01:23:51.260097 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Aug 07 01:23:51.260097 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Aug 07 01:23:51.260097 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Aug 07 01:23:51.260097 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Aug 07 01:23:51.260097 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Aug 07 01:23:51.260097 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Aug 07 01:23:51.260097 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Aug 07 01:23:51.260097 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Aug 07 01:23:51.260097 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:23:51.262087 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1839/3703] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Aug 7 01:23:51 2022] DELETE /identity/v3/OS-OAUTH1/consumers/2b803acff5dc4d8d9f2e086763f6df62 => generated 74 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:23:51.266821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d285b42-2b21-4910-b0bc-9b6fdae8073a tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:51.268690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5d285b42-2b21-4910-b0bc-9b6fdae8073a tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:51.291952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d285b42-2b21-4910-b0bc-9b6fdae8073a tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:51.311980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbe20b-a3c3-4c65-a59e-365a46c93a02 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad84d1561a5e4a55800ac43713d34f9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '576767169f70404d8961a3243207d75c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:51.312965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbe20b-a3c3-4c65-a59e-365a46c93a02 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:51.313411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbe20b-a3c3-4c65-a59e-365a46c93a02 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:51.313906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbe20b-a3c3-4c65-a59e-365a46c93a02 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:51.314803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbe20b-a3c3-4c65-a59e-365a46c93a02 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:51.318651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbe20b-a3c3-4c65-a59e-365a46c93a02 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:51.349169 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1865/3704] 10.222.0.39 () {60 vars in 1185 bytes} [Sun Aug 7 01:23:51 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:23:51.354055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b28dc-c099-4768-99d1-36357f62ec53 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:51.369650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b28dc-c099-4768-99d1-36357f62ec53 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:51.382781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f462875-d4e2-4f78-a3de-61dcdac9bd79 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad84d1561a5e4a55800ac43713d34f9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '576767169f70404d8961a3243207d75c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:51.383409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f462875-d4e2-4f78-a3de-61dcdac9bd79 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:51.385239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f462875-d4e2-4f78-a3de-61dcdac9bd79 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:51.385544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f462875-d4e2-4f78-a3de-61dcdac9bd79 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:51.386856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f462875-d4e2-4f78-a3de-61dcdac9bd79 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:51.392474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f462875-d4e2-4f78-a3de-61dcdac9bd79 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:51.429943 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1840/3705] 10.222.0.39 () {60 vars in 1185 bytes} [Sun Aug 7 01:23:51 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:23:51.433458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbe20b-a3c3-4c65-a59e-365a46c93a02 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:51.461451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbe20b-a3c3-4c65-a59e-365a46c93a02 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:51.472180 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02aa8fc-cb33-4171-86cb-d267feb80c32 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad84d1561a5e4a55800ac43713d34f9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '576767169f70404d8961a3243207d75c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:51.472817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02aa8fc-cb33-4171-86cb-d267feb80c32 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:51.473096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02aa8fc-cb33-4171-86cb-d267feb80c32 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:51.473367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02aa8fc-cb33-4171-86cb-d267feb80c32 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:51.476795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02aa8fc-cb33-4171-86cb-d267feb80c32 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:51.478593 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-c02aa8fc-cb33-4171-86cb-d267feb80c32 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:23:51.478593 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:23:51.478593 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:23:51.484593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02aa8fc-cb33-4171-86cb-d267feb80c32 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:51.503527 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1866/3706] 10.222.0.39 () {58 vars in 1164 bytes} [Sun Aug 7 01:23:51 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 536 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:23:51.508402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f462875-d4e2-4f78-a3de-61dcdac9bd79 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:51.538160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f462875-d4e2-4f78-a3de-61dcdac9bd79 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:51.557172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b86fbe-c984-4b82-93c5-a686917d797e tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad84d1561a5e4a55800ac43713d34f9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '576767169f70404d8961a3243207d75c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:51.557772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b86fbe-c984-4b82-93c5-a686917d797e tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:51.558125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b86fbe-c984-4b82-93c5-a686917d797e tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:51.558485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b86fbe-c984-4b82-93c5-a686917d797e tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/4a7f07b48e67464f97ec91084a877406` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:51.563255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b86fbe-c984-4b82-93c5-a686917d797e tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=4a7f07b48e67464f97ec91084a877406)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:51.565739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b86fbe-c984-4b82-93c5-a686917d797e tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:51.566097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-71b86fbe-c984-4b82-93c5-a686917d797e tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Invalidating token cache because consumer 4a7f07b48e67464f97ec91084a877406 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:23:51.566596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-71b86fbe-c984-4b82-93c5-a686917d797e tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:51.568280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-71b86fbe-c984-4b82-93c5-a686917d797e tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:51.608114 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-71b86fbe-c984-4b82-93c5-a686917d797e tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '4a7f07b48e67464f97ec91084a877406', 'request_id': 'req-71b86fbe-c984-4b82-93c5-a686917d797e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:51.627993 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1841/3707] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Aug 7 01:23:51 2022] DELETE /identity/v3/OS-OAUTH1/consumers/4a7f07b48e67464f97ec91084a877406 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:51.630150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02aa8fc-cb33-4171-86cb-d267feb80c32 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:51.632049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c02aa8fc-cb33-4171-86cb-d267feb80c32 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:51.655423 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02aa8fc-cb33-4171-86cb-d267feb80c32 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:51.670089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be061e13-8aca-4465-af89-1d78433b5520 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad84d1561a5e4a55800ac43713d34f9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '576767169f70404d8961a3243207d75c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:51.671243 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be061e13-8aca-4465-af89-1d78433b5520 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:51.671620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be061e13-8aca-4465-af89-1d78433b5520 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:51.672098 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be061e13-8aca-4465-af89-1d78433b5520 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/e5e1ee85692140d8a7c18d4279d0489b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:51.672791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be061e13-8aca-4465-af89-1d78433b5520 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=e5e1ee85692140d8a7c18d4279d0489b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:51.674508 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be061e13-8aca-4465-af89-1d78433b5520 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:51.676729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-be061e13-8aca-4465-af89-1d78433b5520 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Invalidating token cache because consumer e5e1ee85692140d8a7c18d4279d0489b has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:23:51.677271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-be061e13-8aca-4465-af89-1d78433b5520 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:51.683900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-be061e13-8aca-4465-af89-1d78433b5520 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:51.709393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-be061e13-8aca-4465-af89-1d78433b5520 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'e5e1ee85692140d8a7c18d4279d0489b', 'request_id': 'req-be061e13-8aca-4465-af89-1d78433b5520'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:51.737125 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1867/3708] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Aug 7 01:23:51 2022] DELETE /identity/v3/OS-OAUTH1/consumers/e5e1ee85692140d8a7c18d4279d0489b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:51.742435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b86fbe-c984-4b82-93c5-a686917d797e tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:51.758611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b86fbe-c984-4b82-93c5-a686917d797e tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:51.774245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7eb4bb-c3b7-4957-a210-4cdd0cfcc2e0 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad84d1561a5e4a55800ac43713d34f9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '576767169f70404d8961a3243207d75c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:51.775168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7eb4bb-c3b7-4957-a210-4cdd0cfcc2e0 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:51.775817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7eb4bb-c3b7-4957-a210-4cdd0cfcc2e0 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:51.776320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7eb4bb-c3b7-4957-a210-4cdd0cfcc2e0 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:51.777181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7eb4bb-c3b7-4957-a210-4cdd0cfcc2e0 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:51.781564 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7eb4bb-c3b7-4957-a210-4cdd0cfcc2e0 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:51.820702 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1842/3709] 10.222.0.39 () {60 vars in 1185 bytes} [Sun Aug 7 01:23:51 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:23:51.825016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be061e13-8aca-4465-af89-1d78433b5520 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:51.826928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-be061e13-8aca-4465-af89-1d78433b5520 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:51.842303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be061e13-8aca-4465-af89-1d78433b5520 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:51.848346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2674b1-59a8-4444-a46a-87b89cb0fd94 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad84d1561a5e4a55800ac43713d34f9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '576767169f70404d8961a3243207d75c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:51.849739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2674b1-59a8-4444-a46a-87b89cb0fd94 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:51.850323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2674b1-59a8-4444-a46a-87b89cb0fd94 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:51.851040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2674b1-59a8-4444-a46a-87b89cb0fd94 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/0b8ac18c9f6e45c98cd2df883b936247` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:51.852885 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2674b1-59a8-4444-a46a-87b89cb0fd94 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=0b8ac18c9f6e45c98cd2df883b936247)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:51.855262 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-ff2674b1-59a8-4444-a46a-87b89cb0fd94 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:23:51.855262 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:23:51.855262 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:23:51.856735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2674b1-59a8-4444-a46a-87b89cb0fd94 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:51.867079 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=86,keystone:INSERT=9,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:51.890365 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1868/3710] 10.222.0.39 () {60 vars in 1285 bytes} [Sun Aug 7 01:23:51 2022] PATCH /identity/v3/OS-OAUTH1/consumers/0b8ac18c9f6e45c98cd2df883b936247 => generated 220 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:23:51.894249 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7eb4bb-c3b7-4957-a210-4cdd0cfcc2e0 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:51.921039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7eb4bb-c3b7-4957-a210-4cdd0cfcc2e0 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:51.928004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73be81-758e-40ca-8709-53bb83681204 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad84d1561a5e4a55800ac43713d34f9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '576767169f70404d8961a3243207d75c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:51.929296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73be81-758e-40ca-8709-53bb83681204 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:51.929854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73be81-758e-40ca-8709-53bb83681204 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:51.930342 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73be81-758e-40ca-8709-53bb83681204 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/0b8ac18c9f6e45c98cd2df883b936247` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:51.931441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73be81-758e-40ca-8709-53bb83681204 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=0b8ac18c9f6e45c98cd2df883b936247)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:51.933706 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73be81-758e-40ca-8709-53bb83681204 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:51.945097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2674b1-59a8-4444-a46a-87b89cb0fd94 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:51.956232 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1843/3711] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Aug 7 01:23:51 2022] GET /identity/v3/OS-OAUTH1/consumers/0b8ac18c9f6e45c98cd2df883b936247 => generated 220 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:23:51.959858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2674b1-59a8-4444-a46a-87b89cb0fd94 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:51.966274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606478d4-24af-4d7e-8489-37d9846644f6 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad84d1561a5e4a55800ac43713d34f9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '576767169f70404d8961a3243207d75c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:51.969132 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606478d4-24af-4d7e-8489-37d9846644f6 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:51.971224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606478d4-24af-4d7e-8489-37d9846644f6 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:51.971757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606478d4-24af-4d7e-8489-37d9846644f6 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/0b8ac18c9f6e45c98cd2df883b936247` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:51.973460 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606478d4-24af-4d7e-8489-37d9846644f6 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=0b8ac18c9f6e45c98cd2df883b936247)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:51.975737 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606478d4-24af-4d7e-8489-37d9846644f6 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:51.977018 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-606478d4-24af-4d7e-8489-37d9846644f6 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Invalidating token cache because consumer 0b8ac18c9f6e45c98cd2df883b936247 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:23:51.978091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-606478d4-24af-4d7e-8489-37d9846644f6 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:51.979422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-606478d4-24af-4d7e-8489-37d9846644f6 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:52.003244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-606478d4-24af-4d7e-8489-37d9846644f6 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '0b8ac18c9f6e45c98cd2df883b936247', 'request_id': 'req-606478d4-24af-4d7e-8489-37d9846644f6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:52.045597 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1869/3712] 10.222.0.39 () {58 vars in 1266 bytes} [Sun Aug 7 01:23:51 2022] DELETE /identity/v3/OS-OAUTH1/consumers/0b8ac18c9f6e45c98cd2df883b936247 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:52.051490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73be81-758e-40ca-8709-53bb83681204 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:52.054251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8c73be81-758e-40ca-8709-53bb83681204 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:52.157478 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:52.187451 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73be81-758e-40ca-8709-53bb83681204 tempest-OAUTHConsumersV3Test-26510321 tempest-OAUTHConsumersV3Test-26510321-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:52.203428 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed03f01-319a-4bdd-9213-ce42a88a97c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:52.204289 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed03f01-319a-4bdd-9213-ce42a88a97c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:52.204390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed03f01-319a-4bdd-9213-ce42a88a97c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:52.204654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed03f01-319a-4bdd-9213-ce42a88a97c3 admin admin] PATH_INFO: `/v3/users/8d8d34fadfc84fa4bdcb233a5f7558ad` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:52.206452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed03f01-319a-4bdd-9213-ce42a88a97c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d8d34fadfc84fa4bdcb233a5f7558ad)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:52.210485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed03f01-319a-4bdd-9213-ce42a88a97c3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:52.318628 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8ed03f01-319a-4bdd-9213-ce42a88a97c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d8d34fadfc84fa4bdcb233a5f7558ad'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:52.340725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8ed03f01-319a-4bdd-9213-ce42a88a97c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d8d34fadfc84fa4bdcb233a5f7558ad'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:52.356857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8ed03f01-319a-4bdd-9213-ce42a88a97c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d8d34fadfc84fa4bdcb233a5f7558ad'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:52.357635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8ed03f01-319a-4bdd-9213-ce42a88a97c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d8d34fadfc84fa4bdcb233a5f7558ad'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:52.370077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8ed03f01-319a-4bdd-9213-ce42a88a97c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d8d34fadfc84fa4bdcb233a5f7558ad'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:52.378662 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1844/3713] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:23:52 2022] DELETE /identity/v3/users/8d8d34fadfc84fa4bdcb233a5f7558ad => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:52.382279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e531ce-c2c4-464d-a2a9-8b76b1d70bdc None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:52.383274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e531ce-c2c4-464d-a2a9-8b76b1d70bdc None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:52.383604 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e531ce-c2c4-464d-a2a9-8b76b1d70bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:52.408463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-91e531ce-c2c4-464d-a2a9-8b76b1d70bdc None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:52.411242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-91e531ce-c2c4-464d-a2a9-8b76b1d70bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:52.501842 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1870/3714] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:23:52.514977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed03f01-319a-4bdd-9213-ce42a88a97c3 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:52.518626 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8ed03f01-319a-4bdd-9213-ce42a88a97c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:52.676776 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed03f01-319a-4bdd-9213-ce42a88a97c3 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:52.686948 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb64bb-6ebe-4d7f-8b1c-0fdbfbb12742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:52.688635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb64bb-6ebe-4d7f-8b1c-0fdbfbb12742 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:52.691842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb64bb-6ebe-4d7f-8b1c-0fdbfbb12742 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:52.692390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb64bb-6ebe-4d7f-8b1c-0fdbfbb12742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:52.719700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb64bb-6ebe-4d7f-8b1c-0fdbfbb12742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:52.723726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb64bb-6ebe-4d7f-8b1c-0fdbfbb12742 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:52.757925 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1845/3715] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:23:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:23:54.409704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e531ce-c2c4-464d-a2a9-8b76b1d70bdc None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:54.411195 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-91e531ce-c2c4-464d-a2a9-8b76b1d70bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:54.438807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e531ce-c2c4-464d-a2a9-8b76b1d70bdc None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:54.447743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d592b-47ec-4c98-89da-8169275daaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:54.448540 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d592b-47ec-4c98-89da-8169275daaa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:54.448925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d592b-47ec-4c98-89da-8169275daaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:54.449296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d592b-47ec-4c98-89da-8169275daaa1 admin admin] PATH_INFO: `/v3/projects/e1225037c5f842edab597f7ec42f9d57` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:54.450936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d592b-47ec-4c98-89da-8169275daaa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1225037c5f842edab597f7ec42f9d57)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:54.453075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d592b-47ec-4c98-89da-8169275daaa1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:54.549787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-262d592b-47ec-4c98-89da-8169275daaa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1225037c5f842edab597f7ec42f9d57', 'request_id': 'req-262d592b-47ec-4c98-89da-8169275daaa1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:54.564422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-262d592b-47ec-4c98-89da-8169275daaa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1225037c5f842edab597f7ec42f9d57', 'request_id': 'req-262d592b-47ec-4c98-89da-8169275daaa1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:54.577301 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-262d592b-47ec-4c98-89da-8169275daaa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1225037c5f842edab597f7ec42f9d57', 'request_id': 'req-262d592b-47ec-4c98-89da-8169275daaa1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:54.607406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-262d592b-47ec-4c98-89da-8169275daaa1 admin admin] The token cache is being invalidate because project e1225037c5f842edab597f7ec42f9d57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:23:54.608187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-262d592b-47ec-4c98-89da-8169275daaa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:54.609670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-262d592b-47ec-4c98-89da-8169275daaa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:54.617232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb64bb-6ebe-4d7f-8b1c-0fdbfbb12742 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:54.618935 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1871/3716] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:23:54 2022] DELETE /identity/v3/projects/e1225037c5f842edab597f7ec42f9d57 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:54.637154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb64bb-6ebe-4d7f-8b1c-0fdbfbb12742 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:54.767546 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29a391-ee86-45d8-aede-fbfc8d98ab75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:54.768359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29a391-ee86-45d8-aede-fbfc8d98ab75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:54.768538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29a391-ee86-45d8-aede-fbfc8d98ab75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:54.768775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29a391-ee86-45d8-aede-fbfc8d98ab75 admin admin] PATH_INFO: `/v3/users/ad84d1561a5e4a55800ac43713d34f9e` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:54.769974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd29a391-ee86-45d8-aede-fbfc8d98ab75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad84d1561a5e4a55800ac43713d34f9e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:54.772076 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd29a391-ee86-45d8-aede-fbfc8d98ab75 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:54.805143 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:54.866099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dd29a391-ee86-45d8-aede-fbfc8d98ab75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad84d1561a5e4a55800ac43713d34f9e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:54.887113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dd29a391-ee86-45d8-aede-fbfc8d98ab75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad84d1561a5e4a55800ac43713d34f9e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:54.917694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dd29a391-ee86-45d8-aede-fbfc8d98ab75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad84d1561a5e4a55800ac43713d34f9e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:54.918733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dd29a391-ee86-45d8-aede-fbfc8d98ab75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad84d1561a5e4a55800ac43713d34f9e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:54.932764 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dd29a391-ee86-45d8-aede-fbfc8d98ab75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad84d1561a5e4a55800ac43713d34f9e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:54.941102 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1846/3717] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:23:54 2022] DELETE /identity/v3/users/ad84d1561a5e4a55800ac43713d34f9e => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:55.736203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d592b-47ec-4c98-89da-8169275daaa1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:55.737625 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-262d592b-47ec-4c98-89da-8169275daaa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:55.762965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d592b-47ec-4c98-89da-8169275daaa1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:55.876256 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:55.917730 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788466cf-0a77-4aa4-a686-305cfe1c1db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:55.918390 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788466cf-0a77-4aa4-a686-305cfe1c1db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:55.918671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788466cf-0a77-4aa4-a686-305cfe1c1db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:55.918944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788466cf-0a77-4aa4-a686-305cfe1c1db4 admin admin] PATH_INFO: `/v3/projects/576767169f70404d8961a3243207d75c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:55.920786 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788466cf-0a77-4aa4-a686-305cfe1c1db4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=576767169f70404d8961a3243207d75c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:55.922731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788466cf-0a77-4aa4-a686-305cfe1c1db4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:56.033197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-788466cf-0a77-4aa4-a686-305cfe1c1db4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '576767169f70404d8961a3243207d75c', 'request_id': 'req-788466cf-0a77-4aa4-a686-305cfe1c1db4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:56.048042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-788466cf-0a77-4aa4-a686-305cfe1c1db4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '576767169f70404d8961a3243207d75c', 'request_id': 'req-788466cf-0a77-4aa4-a686-305cfe1c1db4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:56.062780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-788466cf-0a77-4aa4-a686-305cfe1c1db4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '576767169f70404d8961a3243207d75c', 'request_id': 'req-788466cf-0a77-4aa4-a686-305cfe1c1db4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:56.087393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-788466cf-0a77-4aa4-a686-305cfe1c1db4 admin admin] The token cache is being invalidate because project 576767169f70404d8961a3243207d75c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:23:56.089929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-788466cf-0a77-4aa4-a686-305cfe1c1db4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:56.092155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-788466cf-0a77-4aa4-a686-305cfe1c1db4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:56.095361 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1872/3718] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:23:55 2022] DELETE /identity/v3/projects/576767169f70404d8961a3243207d75c => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:56.100179 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3ff69-50c8-49de-afef-dc96ffc7cbfe None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:56.101632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3ff69-50c8-49de-afef-dc96ffc7cbfe None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:56.102443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3ff69-50c8-49de-afef-dc96ffc7cbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:56.147218 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6ba3ff69-50c8-49de-afef-dc96ffc7cbfe None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:56.149840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6ba3ff69-50c8-49de-afef-dc96ffc7cbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:56.291679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb2fce-bae4-4601-9193-f36c7ce699c6 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:56.292024 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1847/3719] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:23:56.300314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb2fce-bae4-4601-9193-f36c7ce699c6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:56.300857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb2fce-bae4-4601-9193-f36c7ce699c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:56.373212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-97fb2fce-bae4-4601-9193-f36c7ce699c6 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:56.374805 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-97fb2fce-bae4-4601-9193-f36c7ce699c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:56.399910 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1873/3720] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:23:56.404294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3ff69-50c8-49de-afef-dc96ffc7cbfe None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:56.425208 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3ff69-50c8-49de-afef-dc96ffc7cbfe None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:56.445368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ce710-b776-4398-8306-a785f4368be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:56.446687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ce710-b776-4398-8306-a785f4368be8 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:56.447079 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ce710-b776-4398-8306-a785f4368be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:56.448933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ce710-b776-4398-8306-a785f4368be8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:56.449760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ce710-b776-4398-8306-a785f4368be8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:23:56.451823 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ce710-b776-4398-8306-a785f4368be8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:56.453764 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ce710-b776-4398-8306-a785f4368be8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:56.476420 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1848/3721] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:23:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:23:56.481854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb2fce-bae4-4601-9193-f36c7ce699c6 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:56.504084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb2fce-bae4-4601-9193-f36c7ce699c6 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:56.512369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a98d6-d77e-41be-9622-fc72bd0cced8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:56.513340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a98d6-d77e-41be-9622-fc72bd0cced8 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:56.514341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a98d6-d77e-41be-9622-fc72bd0cced8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:56.514800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a98d6-d77e-41be-9622-fc72bd0cced8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:56.515684 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3a98d6-d77e-41be-9622-fc72bd0cced8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:56.520815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3a98d6-d77e-41be-9622-fc72bd0cced8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:56.596957 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1874/3722] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:23:56 2022] POST /identity/v3/projects => generated 397 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:23:56.601417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ce710-b776-4398-8306-a785f4368be8 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:56.712636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ce710-b776-4398-8306-a785f4368be8 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:56.803468 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a98d6-d77e-41be-9622-fc72bd0cced8 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:56.805451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7e3a98d6-d77e-41be-9622-fc72bd0cced8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:56.817096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194b3b4-5577-4f48-a8d6-e2fa94d7d2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:56.817799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194b3b4-5577-4f48-a8d6-e2fa94d7d2cb admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:56.818147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194b3b4-5577-4f48-a8d6-e2fa94d7d2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:56.818706 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194b3b4-5577-4f48-a8d6-e2fa94d7d2cb admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:56.820157 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194b3b4-5577-4f48-a8d6-e2fa94d7d2cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:56.823016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194b3b4-5577-4f48-a8d6-e2fa94d7d2cb admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:56.836260 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:56.868768 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1849/3723] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:23:56 2022] POST /identity/v3/users => generated 299 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:23:56.873305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194b3b4-5577-4f48-a8d6-e2fa94d7d2cb admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:56.890438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194b3b4-5577-4f48-a8d6-e2fa94d7d2cb admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:56.900168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b89dc-4c11-442b-ae1a-3bd5875da8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:56.900892 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b89dc-4c11-442b-ae1a-3bd5875da8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:56.901359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b89dc-4c11-442b-ae1a-3bd5875da8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:56.902535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b89dc-4c11-442b-ae1a-3bd5875da8d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:56.903649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b89dc-4c11-442b-ae1a-3bd5875da8d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:56.905948 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b89dc-4c11-442b-ae1a-3bd5875da8d9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:56.929701 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1850/3724] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:23:56.933879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b89dc-4c11-442b-ae1a-3bd5875da8d9 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:56.967735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b89dc-4c11-442b-ae1a-3bd5875da8d9 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:56.995266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e1f76-ff14-4abf-a48c-407682493f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:56.995917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e1f76-ff14-4abf-a48c-407682493f82 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:56.996212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e1f76-ff14-4abf-a48c-407682493f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:56.996774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e1f76-ff14-4abf-a48c-407682493f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:56.998371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e1f76-ff14-4abf-a48c-407682493f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:57.007191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e1f76-ff14-4abf-a48c-407682493f82 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:57.020567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a98d6-d77e-41be-9622-fc72bd0cced8 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:57.026356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f65ff7-16b2-47bd-a31f-56626cf91307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:57.027263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f65ff7-16b2-47bd-a31f-56626cf91307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:57.027713 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f65ff7-16b2-47bd-a31f-56626cf91307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:57.028202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f65ff7-16b2-47bd-a31f-56626cf91307 admin admin] PATH_INFO: `/v3/users/07a75cbb3d8a4b4baa361b0444c2370e` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:57.030974 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1851/3725] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:23:57.032086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f65ff7-16b2-47bd-a31f-56626cf91307 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07a75cbb3d8a4b4baa361b0444c2370e)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:57.034373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f65ff7-16b2-47bd-a31f-56626cf91307 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:57.034946 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e1f76-ff14-4abf-a48c-407682493f82 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:57.062267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e1f76-ff14-4abf-a48c-407682493f82 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:57.077738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85643f05-448b-4100-afa9-733442b576ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:57.080940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85643f05-448b-4100-afa9-733442b576ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:57.081435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85643f05-448b-4100-afa9-733442b576ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:57.081828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85643f05-448b-4100-afa9-733442b576ee admin admin] PATH_INFO: `/v3/projects/0dfa69271ad543efbdd017a574cea6df/users/cbec43784bf5421ca3a8ddd77fec797a/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:57.110911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85643f05-448b-4100-afa9-733442b576ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dfa69271ad543efbdd017a574cea6df, user_id=cbec43784bf5421ca3a8ddd77fec797a, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:57.115159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85643f05-448b-4100-afa9-733442b576ee admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:57.121249 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:57.145213 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1852/3726] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:23:57 2022] PUT /identity/v3/projects/0dfa69271ad543efbdd017a574cea6df/users/cbec43784bf5421ca3a8ddd77fec797a/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:57.157766 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c59235-0416-43d5-8e81-c3ac637e418d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:57.158490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c59235-0416-43d5-8e81-c3ac637e418d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:57.158626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c0f65ff7-16b2-47bd-a31f-56626cf91307 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07a75cbb3d8a4b4baa361b0444c2370e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:57.160579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c59235-0416-43d5-8e81-c3ac637e418d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:57.184099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c0f65ff7-16b2-47bd-a31f-56626cf91307 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07a75cbb3d8a4b4baa361b0444c2370e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:57.207392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-87c59235-0416-43d5-8e81-c3ac637e418d None None] MFA Rules not processed for user `cbec43784bf5421ca3a8ddd77fec797a`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:57.210330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-87c59235-0416-43d5-8e81-c3ac637e418d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:57.217158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c0f65ff7-16b2-47bd-a31f-56626cf91307 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07a75cbb3d8a4b4baa361b0444c2370e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:57.221285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c0f65ff7-16b2-47bd-a31f-56626cf91307 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07a75cbb3d8a4b4baa361b0444c2370e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:57.242900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c0f65ff7-16b2-47bd-a31f-56626cf91307 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07a75cbb3d8a4b4baa361b0444c2370e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:57.252986 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1875/3727] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:23:56 2022] DELETE /identity/v3/users/07a75cbb3d8a4b4baa361b0444c2370e => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:57.380641 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1853/3728] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:23:57 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:23:57.384793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f65ff7-16b2-47bd-a31f-56626cf91307 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:57.386317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c0f65ff7-16b2-47bd-a31f-56626cf91307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:57.543817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f65ff7-16b2-47bd-a31f-56626cf91307 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:57.554477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1dfc9-c720-4e13-a1d1-08243d119580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:57.557420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1dfc9-c720-4e13-a1d1-08243d119580 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:57.557733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1dfc9-c720-4e13-a1d1-08243d119580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:57.557975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1dfc9-c720-4e13-a1d1-08243d119580 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:57.561416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1dfc9-c720-4e13-a1d1-08243d119580 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:57.563685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1dfc9-c720-4e13-a1d1-08243d119580 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:57.648801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c59235-0416-43d5-8e81-c3ac637e418d None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:57.649066 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1876/3729] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:23:57 2022] POST /identity/v3/projects => generated 395 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:23:57.767382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1dfc9-c720-4e13-a1d1-08243d119580 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:57.769497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2ea1dfc9-c720-4e13-a1d1-08243d119580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:57.813595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c59235-0416-43d5-8e81-c3ac637e418d None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:57.996804 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:58.044021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1dfc9-c720-4e13-a1d1-08243d119580 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:58.061594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782431c-c75a-483b-8e02-acc32896773e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:58.063159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782431c-c75a-483b-8e02-acc32896773e admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:58.063159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782431c-c75a-483b-8e02-acc32896773e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:58.063159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782431c-c75a-483b-8e02-acc32896773e admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:58.063471 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782431c-c75a-483b-8e02-acc32896773e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:58.065366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782431c-c75a-483b-8e02-acc32896773e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:58.075615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454f789-8250-4750-96d7-8538a3657173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:58.076324 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454f789-8250-4750-96d7-8538a3657173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:58.076605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454f789-8250-4750-96d7-8538a3657173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:58.076879 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454f789-8250-4750-96d7-8538a3657173 admin admin] PATH_INFO: `/v3/projects/a7056cca1edc4e60a51a98237d187857` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:58.082194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454f789-8250-4750-96d7-8538a3657173 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7056cca1edc4e60a51a98237d187857)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:58.084190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454f789-8250-4750-96d7-8538a3657173 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:58.163793 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1854/3730] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:23:57 2022] POST /identity/v3/users => generated 304 bytes in 513 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:23:58.164904 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782431c-c75a-483b-8e02-acc32896773e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:58.199202 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782431c-c75a-483b-8e02-acc32896773e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:58.212456 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e8c63-12dc-4426-ba79-97bc55b2c10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:58.213150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e8c63-12dc-4426-ba79-97bc55b2c10d admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:58.213361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e8c63-12dc-4426-ba79-97bc55b2c10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:58.213634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e8c63-12dc-4426-ba79-97bc55b2c10d admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:58.214299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e8c63-12dc-4426-ba79-97bc55b2c10d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:58.218315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e8c63-12dc-4426-ba79-97bc55b2c10d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:58.235606 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:58.265663 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1855/3731] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:23:58.275646 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e8c63-12dc-4426-ba79-97bc55b2c10d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:58.281397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a454f789-8250-4750-96d7-8538a3657173 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7056cca1edc4e60a51a98237d187857', 'request_id': 'req-a454f789-8250-4750-96d7-8538a3657173'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:58.308485 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a454f789-8250-4750-96d7-8538a3657173 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7056cca1edc4e60a51a98237d187857', 'request_id': 'req-a454f789-8250-4750-96d7-8538a3657173'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:58.310240 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e8c63-12dc-4426-ba79-97bc55b2c10d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:58.329794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a454f789-8250-4750-96d7-8538a3657173 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7056cca1edc4e60a51a98237d187857', 'request_id': 'req-a454f789-8250-4750-96d7-8538a3657173'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:58.373549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a454f789-8250-4750-96d7-8538a3657173 admin admin] The token cache is being invalidate because project a7056cca1edc4e60a51a98237d187857 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:23:58.374026 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a454f789-8250-4750-96d7-8538a3657173 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:58.380679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a454f789-8250-4750-96d7-8538a3657173 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:23:58.389645 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1877/3732] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:23:57 2022] DELETE /identity/v3/projects/a7056cca1edc4e60a51a98237d187857 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:58.392206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7ea60-c898-4cb1-914c-5c34cf012758 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:58.392710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7ea60-c898-4cb1-914c-5c34cf012758 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:58.393207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7ea60-c898-4cb1-914c-5c34cf012758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:58.470278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-70c7ea60-c898-4cb1-914c-5c34cf012758 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:58.473930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-70c7ea60-c898-4cb1-914c-5c34cf012758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:58.518062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4fc10-759c-4a9b-bd49-6051e3b6a9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:58.521652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4fc10-759c-4a9b-bd49-6051e3b6a9f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:58.523623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4fc10-759c-4a9b-bd49-6051e3b6a9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:58.524923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4fc10-759c-4a9b-bd49-6051e3b6a9f9 admin admin] PATH_INFO: `/v3/projects/3a5afd39189c4d20b02606104616910c/users/7f65c67a496d462a8b8787dd14041e43/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:58.580748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4fc10-759c-4a9b-bd49-6051e3b6a9f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a5afd39189c4d20b02606104616910c, user_id=7f65c67a496d462a8b8787dd14041e43, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:58.585036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4fc10-759c-4a9b-bd49-6051e3b6a9f9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:58.608809 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1856/3733] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:23:58 2022] PUT /identity/v3/projects/3a5afd39189c4d20b02606104616910c/users/7f65c67a496d462a8b8787dd14041e43/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:58.612939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4fc10-759c-4a9b-bd49-6051e3b6a9f9 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:58.615738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a9b4fc10-759c-4a9b-bd49-6051e3b6a9f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:58.676880 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1878/3734] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:23:58.679225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ecf42-41ca-40f9-aaf6-9d511bff1031 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:58.679525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ecf42-41ca-40f9-aaf6-9d511bff1031 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:58.679828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ecf42-41ca-40f9-aaf6-9d511bff1031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:58.721883 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5c6ecf42-41ca-40f9-aaf6-9d511bff1031 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:58.723152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5c6ecf42-41ca-40f9-aaf6-9d511bff1031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:58.838107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4fc10-759c-4a9b-bd49-6051e3b6a9f9 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:58.869931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8c55b-bba6-46f0-bfb1-cade5ccdcfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:58.870531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8c55b-bba6-46f0-bfb1-cade5ccdcfbf admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:58.870806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8c55b-bba6-46f0-bfb1-cade5ccdcfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:58.871071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f8c55b-bba6-46f0-bfb1-cade5ccdcfbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:58.871726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f8c55b-bba6-46f0-bfb1-cade5ccdcfbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:58.875192 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1879/3735] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:23:58.876067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f8c55b-bba6-46f0-bfb1-cade5ccdcfbf admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:58.879125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ecf42-41ca-40f9-aaf6-9d511bff1031 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:58.901848 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ecf42-41ca-40f9-aaf6-9d511bff1031 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:58.909004 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1857/3736] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:23:58.910673 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8c55b-bba6-46f0-bfb1-cade5ccdcfbf admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:58.920196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad0f82-6168-4ac9-bf79-ee807e17e575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:58.921024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad0f82-6168-4ac9-bf79-ee807e17e575 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:58.921154 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad0f82-6168-4ac9-bf79-ee807e17e575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:58.921360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad0f82-6168-4ac9-bf79-ee807e17e575 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:58.922028 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad0f82-6168-4ac9-bf79-ee807e17e575 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:23:58.922335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad0f82-6168-4ac9-bf79-ee807e17e575 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:58.922443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f8c55b-bba6-46f0-bfb1-cade5ccdcfbf admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:58.924000 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad0f82-6168-4ac9-bf79-ee807e17e575 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:58.929058 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cf809-87a0-4586-9b36-a51993f110a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:58.929729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cf809-87a0-4586-9b36-a51993f110a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:58.930001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cf809-87a0-4586-9b36-a51993f110a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:58.930304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cf809-87a0-4586-9b36-a51993f110a1 admin admin] PATH_INFO: `/v3/projects/3a5afd39189c4d20b02606104616910c/users/7f65c67a496d462a8b8787dd14041e43/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:58.932448 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9cf809-87a0-4586-9b36-a51993f110a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a5afd39189c4d20b02606104616910c, user_id=7f65c67a496d462a8b8787dd14041e43, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:58.935470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9cf809-87a0-4586-9b36-a51993f110a1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:58.963919 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1858/3737] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:23:58 2022] PUT /identity/v3/projects/3a5afd39189c4d20b02606104616910c/users/7f65c67a496d462a8b8787dd14041e43/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:23:58.978474 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1880/3738] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:23:58.992125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cf809-87a0-4586-9b36-a51993f110a1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:59.059223 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a7905-282a-44c7-b62a-266d19e3e8ed None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:59.060484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a7905-282a-44c7-b62a-266d19e3e8ed None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:59.060989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4a7905-282a-44c7-b62a-266d19e3e8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:59.104465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6c4a7905-282a-44c7-b62a-266d19e3e8ed None None] MFA Rules not processed for user `7f65c67a496d462a8b8787dd14041e43`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:59.105434 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:59.114583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6c4a7905-282a-44c7-b62a-266d19e3e8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:59.195141 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:59.279486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cf809-87a0-4586-9b36-a51993f110a1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:59.304648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f33b0-fd3e-4459-8f18-f9635cceb042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:59.306233 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f33b0-fd3e-4459-8f18-f9635cceb042 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:59.306686 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f33b0-fd3e-4459-8f18-f9635cceb042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:59.307133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f33b0-fd3e-4459-8f18-f9635cceb042 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:59.308004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f33b0-fd3e-4459-8f18-f9635cceb042 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:59.312620 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f33b0-fd3e-4459-8f18-f9635cceb042 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:59.328019 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1881/3739] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:23:59 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:23:59.329755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a7905-282a-44c7-b62a-266d19e3e8ed None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:59.332133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6c4a7905-282a-44c7-b62a-266d19e3e8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:59.418675 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1859/3740] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:23:58 2022] POST /identity/v3/projects => generated 379 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:23:59.419989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f33b0-fd3e-4459-8f18-f9635cceb042 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:59.486168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4a7905-282a-44c7-b62a-266d19e3e8ed None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:59.536491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f33b0-fd3e-4459-8f18-f9635cceb042 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:59.543599 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746abbe-41bf-4680-a6f5-fafe83d5e2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:59.544392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746abbe-41bf-4680-a6f5-fafe83d5e2a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:59.545543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746abbe-41bf-4680-a6f5-fafe83d5e2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:59.546002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746abbe-41bf-4680-a6f5-fafe83d5e2a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:59.546914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746abbe-41bf-4680-a6f5-fafe83d5e2a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:59.549746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746abbe-41bf-4680-a6f5-fafe83d5e2a4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:59.616477 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1860/3741] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:23:59 2022] POST /identity/v3/users => generated 290 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:23:59.617770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746abbe-41bf-4680-a6f5-fafe83d5e2a4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:59.631736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746abbe-41bf-4680-a6f5-fafe83d5e2a4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:59.638405 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24119a-4320-43d6-892c-a311e0372aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:59.639400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24119a-4320-43d6-892c-a311e0372aea admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:59.639814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24119a-4320-43d6-892c-a311e0372aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:59.640238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24119a-4320-43d6-892c-a311e0372aea admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:59.640597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cfe0c9-487a-4180-a226-e952ed3a892f tempest-ProjectsNegativeStaticTestJSON-1537815463 tempest-ProjectsNegativeStaticTestJSON-1537815463-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbec43784bf5421ca3a8ddd77fec797a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dfa69271ad543efbdd017a574cea6df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:59.641122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24119a-4320-43d6-892c-a311e0372aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:59.641586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfe0c9-487a-4180-a226-e952ed3a892f tempest-ProjectsNegativeStaticTestJSON-1537815463 tempest-ProjectsNegativeStaticTestJSON-1537815463-project] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:59.642023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfe0c9-487a-4180-a226-e952ed3a892f tempest-ProjectsNegativeStaticTestJSON-1537815463 tempest-ProjectsNegativeStaticTestJSON-1537815463-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:59.642465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfe0c9-487a-4180-a226-e952ed3a892f tempest-ProjectsNegativeStaticTestJSON-1537815463 tempest-ProjectsNegativeStaticTestJSON-1537815463-project] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:59.643248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cfe0c9-487a-4180-a226-e952ed3a892f tempest-ProjectsNegativeStaticTestJSON-1537815463 tempest-ProjectsNegativeStaticTestJSON-1537815463-project] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:59.643387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24119a-4320-43d6-892c-a311e0372aea admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:59.650018 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-70cfe0c9-487a-4180-a226-e952ed3a892f tempest-ProjectsNegativeStaticTestJSON-1537815463 tempest-ProjectsNegativeStaticTestJSON-1537815463-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Aug 07 01:23:59.650018 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:23:59.650018 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:23:59.650018 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:23:59.650018 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:23:59.650018 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:23:59.650018 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:23:59.650018 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:23:59.650018 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:23:59.650018 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:23:59.650018 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:23:59.650018 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:23:59.650018 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Aug 07 01:23:59.650018 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Aug 07 01:23:59.651109 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Aug 07 01:23:59.651109 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application enforcer_obj._enforce( Aug 07 01:23:59.651109 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Aug 07 01:23:59.651109 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Aug 07 01:23:59.651109 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:23:59.651109 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Aug 07 01:23:59.651109 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Aug 07 01:23:59.651109 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:23:59.667519 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1882/3743] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Aug 7 01:23:59 2022] POST /identity/v3/projects => generated 136 bytes in 339 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:23:59.667935 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1861/3743] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:23:59.673845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cfe0c9-487a-4180-a226-e952ed3a892f tempest-ProjectsNegativeStaticTestJSON-1537815463 tempest-ProjectsNegativeStaticTestJSON-1537815463-project] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:59.674455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24119a-4320-43d6-892c-a311e0372aea admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:59.700852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cfe0c9-487a-4180-a226-e952ed3a892f tempest-ProjectsNegativeStaticTestJSON-1537815463 tempest-ProjectsNegativeStaticTestJSON-1537815463-project] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:59.711292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb4525-07fe-4d82-813c-e93f7cb1136f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:59.712832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb4525-07fe-4d82-813c-e93f7cb1136f admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:59.713337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb4525-07fe-4d82-813c-e93f7cb1136f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:59.713781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb4525-07fe-4d82-813c-e93f7cb1136f admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:59.714650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb4525-07fe-4d82-813c-e93f7cb1136f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:59.719059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb4525-07fe-4d82-813c-e93f7cb1136f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:59.743503 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1883/3744] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:23:59.749369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb4525-07fe-4d82-813c-e93f7cb1136f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:59.762631 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb4525-07fe-4d82-813c-e93f7cb1136f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:59.769762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57b623-aa6d-4671-b1ab-991c801d585d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:59.771184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57b623-aa6d-4671-b1ab-991c801d585d admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:59.771580 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57b623-aa6d-4671-b1ab-991c801d585d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:59.772086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57b623-aa6d-4671-b1ab-991c801d585d admin admin] PATH_INFO: `/v3/projects/2e60e8cd3e6842ec82633393b0af52fd/users/dfaafe20889443e692f94fd4e4b8b023/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:59.799693 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57b623-aa6d-4671-b1ab-991c801d585d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e60e8cd3e6842ec82633393b0af52fd, user_id=dfaafe20889443e692f94fd4e4b8b023, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:59.802124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24119a-4320-43d6-892c-a311e0372aea admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:59.804774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57b623-aa6d-4671-b1ab-991c801d585d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:59.815356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97087782-3403-4ec9-95e6-742f6c6a9061 tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f65c67a496d462a8b8787dd14041e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5afd39189c4d20b02606104616910c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:23:59.816021 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97087782-3403-4ec9-95e6-742f6c6a9061 tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:59.816327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97087782-3403-4ec9-95e6-742f6c6a9061 tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:59.816679 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97087782-3403-4ec9-95e6-742f6c6a9061 tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:59.817366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97087782-3403-4ec9-95e6-742f6c6a9061 tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:23:59.821820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97087782-3403-4ec9-95e6-742f6c6a9061 tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:23:59.831347 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1884/3745] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:23:59 2022] PUT /identity/v3/projects/2e60e8cd3e6842ec82633393b0af52fd/users/dfaafe20889443e692f94fd4e4b8b023/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:23:59.833754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffd39a-9227-49f1-9ad9-250706c81d46 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:23:59.834172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffd39a-9227-49f1-9ad9-250706c81d46 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:23:59.834565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffd39a-9227-49f1-9ad9-250706c81d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:23:59.842411 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-97087782-3403-4ec9-95e6-742f6c6a9061 tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] Invalid input for field 'name': '' is too short Aug 07 01:23:59.842411 n-d-master-1 devstack@keystone.service[80493]: Failed validating 'minLength' in schema['properties']['name']: Aug 07 01:23:59.842411 n-d-master-1 devstack@keystone.service[80493]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 07 01:23:59.842411 n-d-master-1 devstack@keystone.service[80493]: On instance['name']: Aug 07 01:23:59.842411 n-d-master-1 devstack@keystone.service[80493]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 07 01:23:59.842411 n-d-master-1 devstack@keystone.service[80493]: Failed validating 'minLength' in schema['properties']['name']: Aug 07 01:23:59.842411 n-d-master-1 devstack@keystone.service[80493]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 07 01:23:59.842411 n-d-master-1 devstack@keystone.service[80493]: On instance['name']: Aug 07 01:23:59.842411 n-d-master-1 devstack@keystone.service[80493]: '' Aug 07 01:23:59.842411 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:23:59.842411 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 07 01:23:59.842411 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 07 01:23:59.842411 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:23:59.842411 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise error Aug 07 01:23:59.842411 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Aug 07 01:23:59.842411 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:23:59.842411 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 07 01:23:59.842411 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 07 01:23:59.842411 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:23:59.842411 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application On instance['name']: Aug 07 01:23:59.842411 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application '' Aug 07 01:23:59.842411 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:23:59.842411 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:23:59.844230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:23:59.844230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:23:59.844230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:23:59.844230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:23:59.844230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:23:59.844230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:23:59.844230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:23:59.844230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:23:59.844230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:23:59.844230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:23:59.844230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:23:59.844230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:23:59.844230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Aug 07 01:23:59.844230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Aug 07 01:23:59.844230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 07 01:23:59.844230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 07 01:23:59.844230 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 07 01:23:59.845434 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 07 01:23:59.845434 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 07 01:23:59.845434 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:23:59.845434 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 07 01:23:59.845434 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 07 01:23:59.845434 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:23:59.845434 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application On instance['name']: Aug 07 01:23:59.845434 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application '' Aug 07 01:23:59.845434 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:23:59.845434 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1862/3746] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Aug 7 01:23:59 2022] POST /identity/v3/projects => generated 283 bytes in 172 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 07 01:23:59.848795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97087782-3403-4ec9-95e6-742f6c6a9061 tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:23:59.869884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97087782-3403-4ec9-95e6-742f6c6a9061 tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:23:59.871257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c4ffd39a-9227-49f1-9ad9-250706c81d46 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:23:59.873415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c4ffd39a-9227-49f1-9ad9-250706c81d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:23:59.963626 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:59.984698 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:23:59.987823 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1885/3747] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:00.070315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89357649-8e2f-41c2-8e69-a386245cbcc5 tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f65c67a496d462a8b8787dd14041e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5afd39189c4d20b02606104616910c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:00.070751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89357649-8e2f-41c2-8e69-a386245cbcc5 tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:00.071810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89357649-8e2f-41c2-8e69-a386245cbcc5 tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:00.072118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89357649-8e2f-41c2-8e69-a386245cbcc5 tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:00.072768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89357649-8e2f-41c2-8e69-a386245cbcc5 tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:00.074654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89357649-8e2f-41c2-8e69-a386245cbcc5 tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:00.082530 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-89357649-8e2f-41c2-8e69-a386245cbcc5 tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 07 01:24:00.082530 n-d-master-1 devstack@keystone.service[80493]: Failed validating 'maxLength' in schema['properties']['name']: Aug 07 01:24:00.082530 n-d-master-1 devstack@keystone.service[80493]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 07 01:24:00.082530 n-d-master-1 devstack@keystone.service[80493]: On instance['name']: Aug 07 01:24:00.082530 n-d-master-1 devstack@keystone.service[80493]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 07 01:24:00.082530 n-d-master-1 devstack@keystone.service[80493]: Failed validating 'maxLength' in schema['properties']['name']: Aug 07 01:24:00.082530 n-d-master-1 devstack@keystone.service[80493]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 07 01:24:00.082530 n-d-master-1 devstack@keystone.service[80493]: On instance['name']: Aug 07 01:24:00.082530 n-d-master-1 devstack@keystone.service[80493]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 07 01:24:00.082530 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:24:00.082530 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 07 01:24:00.082530 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 07 01:24:00.082530 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:24:00.082530 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise error Aug 07 01:24:00.082530 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 07 01:24:00.082530 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:24:00.082530 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 07 01:24:00.082530 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 07 01:24:00.083786 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:24:00.083786 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application On instance['name']: Aug 07 01:24:00.083786 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 07 01:24:00.083786 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:24:00.083786 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:24:00.083786 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:24:00.083786 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:24:00.083786 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:24:00.083786 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:24:00.083786 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:24:00.083786 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:24:00.083786 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:24:00.083786 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:24:00.083786 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:24:00.083786 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:24:00.083786 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:24:00.083786 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:24:00.083786 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Aug 07 01:24:00.084885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Aug 07 01:24:00.084885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 07 01:24:00.084885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 07 01:24:00.084885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 07 01:24:00.084885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 07 01:24:00.084885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 07 01:24:00.084885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:24:00.084885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 07 01:24:00.084885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 07 01:24:00.084885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:24:00.084885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application On instance['name']: Aug 07 01:24:00.084885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 07 01:24:00.084885 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:24:00.084885 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1863/3748] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Aug 7 01:23:59 2022] POST /identity/v3/projects => generated 412 bytes in 236 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 07 01:24:00.089852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffd39a-9227-49f1-9ad9-250706c81d46 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:00.099132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89357649-8e2f-41c2-8e69-a386245cbcc5 tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:00.100992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-89357649-8e2f-41c2-8e69-a386245cbcc5 tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:00.104865 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ffd39a-9227-49f1-9ad9-250706c81d46 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:00.113815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e73c7d-453c-4d06-88d6-4b140a4d118f tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f65c67a496d462a8b8787dd14041e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5afd39189c4d20b02606104616910c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:00.115556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e73c7d-453c-4d06-88d6-4b140a4d118f tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:00.116102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e73c7d-453c-4d06-88d6-4b140a4d118f tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:00.116603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e73c7d-453c-4d06-88d6-4b140a4d118f tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] PATH_INFO: `/v3/projects/edb92ef786b84e8fb2fce1078b3b439a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:00.136157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e73c7d-453c-4d06-88d6-4b140a4d118f tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] RBAC: Authorizing `identity:delete_project(project_id=edb92ef786b84e8fb2fce1078b3b439a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:00.141206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e73c7d-453c-4d06-88d6-4b140a4d118f tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:00.170792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-91e73c7d-453c-4d06-88d6-4b140a4d118f tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] Could not find project: edb92ef786b84e8fb2fce1078b3b439a.: keystone.exception.ProjectNotFound: Could not find project: edb92ef786b84e8fb2fce1078b3b439a. Aug 07 01:24:00.170792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:24:00.170792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:24:00.170792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:24:00.170792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:24:00.170792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:24:00.170792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:24:00.170792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:24:00.170792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:24:00.170792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:24:00.170792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:24:00.170792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:24:00.170792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Aug 07 01:24:00.170792 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Aug 07 01:24:00.171806 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:24:00.171806 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:24:00.171806 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Aug 07 01:24:00.171806 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Aug 07 01:24:00.171806 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 01:24:00.171806 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 01:24:00.171806 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 01:24:00.171806 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 01:24:00.171806 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: edb92ef786b84e8fb2fce1078b3b439a. Aug 07 01:24:00.171806 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:24:00.179807 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1886/3749] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:24:00 2022] DELETE /identity/v3/projects/edb92ef786b84e8fb2fce1078b3b439a => generated 113 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:24:00.186421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e73c7d-453c-4d06-88d6-4b140a4d118f tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:00.229265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89357649-8e2f-41c2-8e69-a386245cbcc5 tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:00.233394 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c46cd-d979-44e9-89f9-63f2c70b8ddb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:00.234019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c46cd-d979-44e9-89f9-63f2c70b8ddb service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:00.234292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c46cd-d979-44e9-89f9-63f2c70b8ddb service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:00.234576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c46cd-d979-44e9-89f9-63f2c70b8ddb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:00.252047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c46cd-d979-44e9-89f9-63f2c70b8ddb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:00.253533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c46cd-d979-44e9-89f9-63f2c70b8ddb service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:00.275073 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1864/3750] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:24:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:24:00.358796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e73c7d-453c-4d06-88d6-4b140a4d118f tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:00.370540 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4760c50b-2057-4154-ad06-301167e29979 tempest-ProjectsNegativeStaticTestJSON-1537815463 tempest-ProjectsNegativeStaticTestJSON-1537815463-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbec43784bf5421ca3a8ddd77fec797a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0dfa69271ad543efbdd017a574cea6df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:00.371187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760c50b-2057-4154-ad06-301167e29979 tempest-ProjectsNegativeStaticTestJSON-1537815463 tempest-ProjectsNegativeStaticTestJSON-1537815463-project] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:00.371474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760c50b-2057-4154-ad06-301167e29979 tempest-ProjectsNegativeStaticTestJSON-1537815463 tempest-ProjectsNegativeStaticTestJSON-1537815463-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:00.371748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760c50b-2057-4154-ad06-301167e29979 tempest-ProjectsNegativeStaticTestJSON-1537815463 tempest-ProjectsNegativeStaticTestJSON-1537815463-project] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:00.372449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4760c50b-2057-4154-ad06-301167e29979 tempest-ProjectsNegativeStaticTestJSON-1537815463 tempest-ProjectsNegativeStaticTestJSON-1537815463-project] RBAC: Authorizing `identity:list_projects()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:00.378320 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-4760c50b-2057-4154-ad06-301167e29979 tempest-ProjectsNegativeStaticTestJSON-1537815463 tempest-ProjectsNegativeStaticTestJSON-1537815463-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Aug 07 01:24:00.378320 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:24:00.378320 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:24:00.378320 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:24:00.378320 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:24:00.378320 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:24:00.378320 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:24:00.378320 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:24:00.378320 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:24:00.378320 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:24:00.378320 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:24:00.378320 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:24:00.378320 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Aug 07 01:24:00.378320 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._list_projects() Aug 07 01:24:00.379404 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Aug 07 01:24:00.379404 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Aug 07 01:24:00.379404 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Aug 07 01:24:00.379404 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application enforcer_obj._enforce( Aug 07 01:24:00.379404 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Aug 07 01:24:00.379404 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Aug 07 01:24:00.379404 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:24:00.379404 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Aug 07 01:24:00.379404 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Aug 07 01:24:00.379404 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:24:00.385360 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1887/3751] 10.222.0.39 () {58 vars in 1131 bytes} [Sun Aug 7 01:24:00 2022] GET /identity/v3/projects => generated 135 bytes in 194 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:24:00.385441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c46cd-d979-44e9-89f9-63f2c70b8ddb service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:00.420468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c46cd-d979-44e9-89f9-63f2c70b8ddb service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:00.436508 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48bbe3-1360-47a0-95f0-719e6a85345f tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f65c67a496d462a8b8787dd14041e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5afd39189c4d20b02606104616910c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:00.437730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48bbe3-1360-47a0-95f0-719e6a85345f tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:00.438267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48bbe3-1360-47a0-95f0-719e6a85345f tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:00.438746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48bbe3-1360-47a0-95f0-719e6a85345f tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:00.439562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48bbe3-1360-47a0-95f0-719e6a85345f tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:00.442586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48bbe3-1360-47a0-95f0-719e6a85345f tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:00.446479 n-d-master-1 devstack@keystone.service[80493]: WARNING keystone.server.flask.common [None req-8a48bbe3-1360-47a0-95f0-719e6a85345f tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 07 01:24:00.536279 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1865/3752] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:24:00 2022] POST /identity/v3/projects => generated 358 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:00.537461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4760c50b-2057-4154-ad06-301167e29979 tempest-ProjectsNegativeStaticTestJSON-1537815463 tempest-ProjectsNegativeStaticTestJSON-1537815463-project] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:00.563700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4760c50b-2057-4154-ad06-301167e29979 tempest-ProjectsNegativeStaticTestJSON-1537815463 tempest-ProjectsNegativeStaticTestJSON-1537815463-project] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:00.741360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e0416-1ee4-4859-9eda-d76c7d333fee tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f65c67a496d462a8b8787dd14041e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5afd39189c4d20b02606104616910c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:00.742260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e0416-1ee4-4859-9eda-d76c7d333fee tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:00.743194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e0416-1ee4-4859-9eda-d76c7d333fee tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:00.743581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e0416-1ee4-4859-9eda-d76c7d333fee tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:00.749795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e0416-1ee4-4859-9eda-d76c7d333fee tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:00.754733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e0416-1ee4-4859-9eda-d76c7d333fee tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:00.809906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.sql.core [None req-576e0416-1ee4-4859-9eda-d76c7d333fee tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-892442950' for key 'project.ixu_project_name_domain_id'") Aug 07 01:24:00.809906 n-d-master-1 devstack@keystone.service[80492]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 07 01:24:00.809906 n-d-master-1 devstack@keystone.service[80492]: [parameters: {'id': '7c17d72bfda64bda8f86f0382d129836', 'name': 'tempest-project-dup-892442950', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 07 01:24:00.809906 n-d-master-1 devstack@keystone.service[80492]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80492) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 07 01:24:00.819226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-576e0416-1ee4-4859-9eda-d76c7d333fee tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-892442950, project id 7c17d72bfda64bda8f86f0382d129836.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-892442950, project id 7c17d72bfda64bda8f86f0382d129836. Aug 07 01:24:00.819226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:24:00.819226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 01:24:00.819226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 01:24:00.819226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 01:24:00.819226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 01:24:00.819226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 01:24:00.819226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 01:24:00.819226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 01:24:00.819226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application conn.query(q) Aug 07 01:24:00.819226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 01:24:00.819226 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 01:24:00.820318 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 01:24:00.820318 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application result.read() Aug 07 01:24:00.820318 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 01:24:00.820318 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 01:24:00.820318 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 01:24:00.820318 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 01:24:00.820318 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 01:24:00.820318 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 01:24:00.820318 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 01:24:00.820318 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 01:24:00.820318 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-892442950' for key 'project.ixu_project_name_domain_id'") Aug 07 01:24:00.820318 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:24:00.820318 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 07 01:24:00.820318 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:24:00.820318 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:24:00.820318 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 07 01:24:00.820318 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 07 01:24:00.822211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 07 01:24:00.822211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 07 01:24:00.822211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 01:24:00.822211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application next(self.gen) Aug 07 01:24:00.822211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 07 01:24:00.822211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application yield resource Aug 07 01:24:00.822211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 01:24:00.822211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application next(self.gen) Aug 07 01:24:00.822211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 07 01:24:00.822211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.session.rollback() Aug 07 01:24:00.822211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:24:00.822211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.force_reraise() Aug 07 01:24:00.822211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:24:00.822211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise self.value Aug 07 01:24:00.822211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 07 01:24:00.822211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 07 01:24:00.822211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 07 01:24:00.822211 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application session.commit() Aug 07 01:24:00.823598 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 07 01:24:00.823598 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 07 01:24:00.823598 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 07 01:24:00.823598 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._prepare_impl() Aug 07 01:24:00.823598 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 07 01:24:00.823598 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.session.flush() Aug 07 01:24:00.823598 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 07 01:24:00.823598 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._flush(objects) Aug 07 01:24:00.823598 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 07 01:24:00.823598 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 07 01:24:00.823598 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 07 01:24:00.823598 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application compat.raise_( Aug 07 01:24:00.823598 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 01:24:00.823598 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception Aug 07 01:24:00.823598 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 07 01:24:00.823598 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application flush_context.execute() Aug 07 01:24:00.823598 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 07 01:24:00.825240 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rec.execute(self) Aug 07 01:24:00.825240 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 07 01:24:00.825240 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 07 01:24:00.825240 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 07 01:24:00.825240 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 07 01:24:00.825240 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 07 01:24:00.825240 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 07 01:24:00.825240 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 07 01:24:00.825240 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 07 01:24:00.825240 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 07 01:24:00.825240 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 07 01:24:00.825240 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 07 01:24:00.825240 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 07 01:24:00.825240 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 07 01:24:00.825240 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 07 01:24:00.825240 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 07 01:24:00.826416 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 07 01:24:00.826416 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 01:24:00.826416 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception Aug 07 01:24:00.826416 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 01:24:00.826416 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 01:24:00.826416 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 01:24:00.826416 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 01:24:00.826416 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 01:24:00.826416 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 01:24:00.826416 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 01:24:00.826416 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application conn.query(q) Aug 07 01:24:00.826416 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 01:24:00.826416 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 01:24:00.826416 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 01:24:00.826416 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application result.read() Aug 07 01:24:00.826416 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 01:24:00.826416 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 01:24:00.830421 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 01:24:00.830421 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 01:24:00.830421 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 01:24:00.830421 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 01:24:00.830421 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 01:24:00.830421 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 01:24:00.830421 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-892442950' for key 'project.ixu_project_name_domain_id'") Aug 07 01:24:00.830421 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 07 01:24:00.830421 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [parameters: {'id': '7c17d72bfda64bda8f86f0382d129836', 'name': 'tempest-project-dup-892442950', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 07 01:24:00.830421 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 07 01:24:00.830421 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:24:00.830421 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:24:00.830421 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:24:00.830421 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:24:00.830421 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 07 01:24:00.833964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 07 01:24:00.833964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 07 01:24:00.833964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 07 01:24:00.833964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-892442950 at domain ID default. Aug 07 01:24:00.833964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:24:00.833964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:24:00.833964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:24:00.833964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:24:00.833964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:24:00.833964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:24:00.833964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:24:00.833964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:24:00.833964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:24:00.833964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:24:00.833964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:24:00.833964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:24:00.833964 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:24:00.836164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:24:00.836164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 07 01:24:00.836164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 07 01:24:00.836164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:24:00.836164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:24:00.836164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 07 01:24:00.836164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 07 01:24:00.836164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-892442950, project id 7c17d72bfda64bda8f86f0382d129836. Aug 07 01:24:00.836164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:24:00.836164 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1888/3753] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Aug 7 01:24:00 2022] POST /identity/v3/projects => generated 284 bytes in 296 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:24:00.838200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48bbe3-1360-47a0-95f0-719e6a85345f tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:00.855186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48bbe3-1360-47a0-95f0-719e6a85345f tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:00.869138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5434ce4-eda0-4e78-b03d-964aed0354a4 tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f65c67a496d462a8b8787dd14041e43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a5afd39189c4d20b02606104616910c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:00.869913 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5434ce4-eda0-4e78-b03d-964aed0354a4 tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:00.870320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5434ce4-eda0-4e78-b03d-964aed0354a4 tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:00.870667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5434ce4-eda0-4e78-b03d-964aed0354a4 tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] PATH_INFO: `/v3/projects/05d6818dce4a40c4bf172f1f24256651` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:00.871953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5434ce4-eda0-4e78-b03d-964aed0354a4 tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] RBAC: Authorizing `identity:delete_project(project_id=05d6818dce4a40c4bf172f1f24256651)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:00.874385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5434ce4-eda0-4e78-b03d-964aed0354a4 tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:00.976980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d5434ce4-eda0-4e78-b03d-964aed0354a4 tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05d6818dce4a40c4bf172f1f24256651', 'request_id': 'req-d5434ce4-eda0-4e78-b03d-964aed0354a4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:00.986080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d5434ce4-eda0-4e78-b03d-964aed0354a4 tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05d6818dce4a40c4bf172f1f24256651', 'request_id': 'req-d5434ce4-eda0-4e78-b03d-964aed0354a4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:01.004707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d5434ce4-eda0-4e78-b03d-964aed0354a4 tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05d6818dce4a40c4bf172f1f24256651', 'request_id': 'req-d5434ce4-eda0-4e78-b03d-964aed0354a4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:01.038502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d5434ce4-eda0-4e78-b03d-964aed0354a4 tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] The token cache is being invalidate because project 05d6818dce4a40c4bf172f1f24256651 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:01.038835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d5434ce4-eda0-4e78-b03d-964aed0354a4 tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:01.044427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d5434ce4-eda0-4e78-b03d-964aed0354a4 tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:01.046584 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1866/3754] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:24:00 2022] DELETE /identity/v3/projects/05d6818dce4a40c4bf172f1f24256651 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:01.052272 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e0416-1ee4-4859-9eda-d76c7d333fee tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:01.054354 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-576e0416-1ee4-4859-9eda-d76c7d333fee tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:01.152527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e0416-1ee4-4859-9eda-d76c7d333fee tempest-ProjectsNegativeStaticTestJSON-574734471 tempest-ProjectsNegativeStaticTestJSON-574734471-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:01.194435 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:01.255571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8cbb49-e4f5-4566-bce5-c86e22b5eeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:01.256285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cbb49-e4f5-4566-bce5-c86e22b5eeb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:01.256571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cbb49-e4f5-4566-bce5-c86e22b5eeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:01.256844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cbb49-e4f5-4566-bce5-c86e22b5eeb0 admin admin] PATH_INFO: `/v3/users/cbec43784bf5421ca3a8ddd77fec797a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:01.260233 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8cbb49-e4f5-4566-bce5-c86e22b5eeb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbec43784bf5421ca3a8ddd77fec797a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:01.262583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8cbb49-e4f5-4566-bce5-c86e22b5eeb0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:01.361526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7e8cbb49-e4f5-4566-bce5-c86e22b5eeb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbec43784bf5421ca3a8ddd77fec797a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:01.372406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7e8cbb49-e4f5-4566-bce5-c86e22b5eeb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbec43784bf5421ca3a8ddd77fec797a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:01.395141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7e8cbb49-e4f5-4566-bce5-c86e22b5eeb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbec43784bf5421ca3a8ddd77fec797a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:01.396457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7e8cbb49-e4f5-4566-bce5-c86e22b5eeb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbec43784bf5421ca3a8ddd77fec797a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:01.412034 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7e8cbb49-e4f5-4566-bce5-c86e22b5eeb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbec43784bf5421ca3a8ddd77fec797a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:01.426103 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1889/3755] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:24:01 2022] DELETE /identity/v3/users/cbec43784bf5421ca3a8ddd77fec797a => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:24:01.430798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efbb22-8a36-49a0-b455-47026727d0e6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:01.431280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efbb22-8a36-49a0-b455-47026727d0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:01.431280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2efbb22-8a36-49a0-b455-47026727d0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:01.458542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-a2efbb22-8a36-49a0-b455-47026727d0e6 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:01.460262 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a2efbb22-8a36-49a0-b455-47026727d0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:01.527998 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:01.598773 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1867/3756] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:24:01.646436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8cbb49-e4f5-4566-bce5-c86e22b5eeb0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:01.648722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7e8cbb49-e4f5-4566-bce5-c86e22b5eeb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:01.743931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8cbb49-e4f5-4566-bce5-c86e22b5eeb0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:01.756680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362cb88-79fa-4f83-8f50-4ac3a215fcac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:01.757331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362cb88-79fa-4f83-8f50-4ac3a215fcac service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:01.757782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362cb88-79fa-4f83-8f50-4ac3a215fcac service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:01.758063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362cb88-79fa-4f83-8f50-4ac3a215fcac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:01.784518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362cb88-79fa-4f83-8f50-4ac3a215fcac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:01.785932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362cb88-79fa-4f83-8f50-4ac3a215fcac service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:01.815546 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1890/3757] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:24:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:24:02.633683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efbb22-8a36-49a0-b455-47026727d0e6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:02.639072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a2efbb22-8a36-49a0-b455-47026727d0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:02.662505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2efbb22-8a36-49a0-b455-47026727d0e6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:02.675571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d1793-3910-405d-9f3e-1773b6aa81c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:02.681035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d1793-3910-405d-9f3e-1773b6aa81c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:02.681658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d1793-3910-405d-9f3e-1773b6aa81c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:02.682172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d1793-3910-405d-9f3e-1773b6aa81c1 admin admin] PATH_INFO: `/v3/projects/0dfa69271ad543efbdd017a574cea6df` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:02.687852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d1793-3910-405d-9f3e-1773b6aa81c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dfa69271ad543efbdd017a574cea6df)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:02.692834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d1793-3910-405d-9f3e-1773b6aa81c1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:02.847208 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7c6d1793-3910-405d-9f3e-1773b6aa81c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dfa69271ad543efbdd017a574cea6df', 'request_id': 'req-7c6d1793-3910-405d-9f3e-1773b6aa81c1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:02.880246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7c6d1793-3910-405d-9f3e-1773b6aa81c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dfa69271ad543efbdd017a574cea6df', 'request_id': 'req-7c6d1793-3910-405d-9f3e-1773b6aa81c1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:02.902111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7c6d1793-3910-405d-9f3e-1773b6aa81c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dfa69271ad543efbdd017a574cea6df', 'request_id': 'req-7c6d1793-3910-405d-9f3e-1773b6aa81c1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:02.938997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7c6d1793-3910-405d-9f3e-1773b6aa81c1 admin admin] The token cache is being invalidate because project 0dfa69271ad543efbdd017a574cea6df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:02.942998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7c6d1793-3910-405d-9f3e-1773b6aa81c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:02.944842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7c6d1793-3910-405d-9f3e-1773b6aa81c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:02.953926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362cb88-79fa-4f83-8f50-4ac3a215fcac service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:02.959340 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1868/3758] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:24:02 2022] DELETE /identity/v3/projects/0dfa69271ad543efbdd017a574cea6df => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:02.974866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362cb88-79fa-4f83-8f50-4ac3a215fcac service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:03.107485 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:03.121325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f06940-b348-456e-a14d-eac5448f4b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:03.122323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f06940-b348-456e-a14d-eac5448f4b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:03.122800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f06940-b348-456e-a14d-eac5448f4b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:03.123249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f06940-b348-456e-a14d-eac5448f4b67 admin admin] PATH_INFO: `/v3/users/7f65c67a496d462a8b8787dd14041e43` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:03.125793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f06940-b348-456e-a14d-eac5448f4b67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f65c67a496d462a8b8787dd14041e43)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:03.127851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f06940-b348-456e-a14d-eac5448f4b67 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:03.212007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f9f06940-b348-456e-a14d-eac5448f4b67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f65c67a496d462a8b8787dd14041e43'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:03.222068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f9f06940-b348-456e-a14d-eac5448f4b67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f65c67a496d462a8b8787dd14041e43'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:03.238643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f9f06940-b348-456e-a14d-eac5448f4b67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f65c67a496d462a8b8787dd14041e43'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:03.240990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f9f06940-b348-456e-a14d-eac5448f4b67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f65c67a496d462a8b8787dd14041e43'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:03.287456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f9f06940-b348-456e-a14d-eac5448f4b67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f65c67a496d462a8b8787dd14041e43'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:03.299436 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1891/3759] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:24:02 2022] DELETE /identity/v3/users/7f65c67a496d462a8b8787dd14041e43 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:03.895537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d1793-3910-405d-9f3e-1773b6aa81c1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:03.897550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7c6d1793-3910-405d-9f3e-1773b6aa81c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:03.914405 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d1793-3910-405d-9f3e-1773b6aa81c1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:03.985853 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e3389-9f45-491b-967d-363b83d843de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:03.986633 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e3389-9f45-491b-967d-363b83d843de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:03.987082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e3389-9f45-491b-967d-363b83d843de admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:03.987831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e3389-9f45-491b-967d-363b83d843de admin admin] PATH_INFO: `/v3/users/d60a6557665a43cda4a64a83c92e2998` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:03.989382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e3389-9f45-491b-967d-363b83d843de admin admin] RBAC: Authorizing `identity:delete_user(user_id=d60a6557665a43cda4a64a83c92e2998)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:03.991832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e3389-9f45-491b-967d-363b83d843de admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:04.033331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f06940-b348-456e-a14d-eac5448f4b67 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:04.035237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f9f06940-b348-456e-a14d-eac5448f4b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:04.075398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-856e3389-9f45-491b-967d-363b83d843de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd60a6557665a43cda4a64a83c92e2998'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:04.085875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-856e3389-9f45-491b-967d-363b83d843de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd60a6557665a43cda4a64a83c92e2998'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:04.087185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f06940-b348-456e-a14d-eac5448f4b67 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:04.095457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da8031-1454-4f7d-bebb-e5dfee674a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:04.096439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da8031-1454-4f7d-bebb-e5dfee674a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:04.096819 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da8031-1454-4f7d-bebb-e5dfee674a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:04.097597 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:04.098245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da8031-1454-4f7d-bebb-e5dfee674a59 admin admin] PATH_INFO: `/v3/projects/3a5afd39189c4d20b02606104616910c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:04.101858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da8031-1454-4f7d-bebb-e5dfee674a59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a5afd39189c4d20b02606104616910c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:04.105967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da8031-1454-4f7d-bebb-e5dfee674a59 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:04.110082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-856e3389-9f45-491b-967d-363b83d843de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd60a6557665a43cda4a64a83c92e2998'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:04.112250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-856e3389-9f45-491b-967d-363b83d843de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd60a6557665a43cda4a64a83c92e2998'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:04.125842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-856e3389-9f45-491b-967d-363b83d843de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd60a6557665a43cda4a64a83c92e2998'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:04.136992 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1869/3760] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:24:03 2022] DELETE /identity/v3/users/d60a6557665a43cda4a64a83c92e2998 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:04.185890 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a7da8031-1454-4f7d-bebb-e5dfee674a59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a5afd39189c4d20b02606104616910c', 'request_id': 'req-a7da8031-1454-4f7d-bebb-e5dfee674a59'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:04.204312 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a7da8031-1454-4f7d-bebb-e5dfee674a59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a5afd39189c4d20b02606104616910c', 'request_id': 'req-a7da8031-1454-4f7d-bebb-e5dfee674a59'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:04.211125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a7da8031-1454-4f7d-bebb-e5dfee674a59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a5afd39189c4d20b02606104616910c', 'request_id': 'req-a7da8031-1454-4f7d-bebb-e5dfee674a59'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:04.225776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a7da8031-1454-4f7d-bebb-e5dfee674a59 admin admin] The token cache is being invalidate because project 3a5afd39189c4d20b02606104616910c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:04.226067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a7da8031-1454-4f7d-bebb-e5dfee674a59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:04.226720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a7da8031-1454-4f7d-bebb-e5dfee674a59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:04.228314 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1892/3761] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:24:04 2022] DELETE /identity/v3/projects/3a5afd39189c4d20b02606104616910c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:24:04.234489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c0ba1-4d6b-45c3-9e74-27da08e413e7 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:04.234834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c0ba1-4d6b-45c3-9e74-27da08e413e7 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:04.235194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c0ba1-4d6b-45c3-9e74-27da08e413e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:04.260858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-8c4c0ba1-4d6b-45c3-9e74-27da08e413e7 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:04.262113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8c4c0ba1-4d6b-45c3-9e74-27da08e413e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:04.352541 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1870/3762] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:04.353779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a89016-3fe4-4ab5-b2bc-e50646a1195a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:04.354118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a89016-3fe4-4ab5-b2bc-e50646a1195a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:04.354548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a89016-3fe4-4ab5-b2bc-e50646a1195a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:04.388304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a2a89016-3fe4-4ab5-b2bc-e50646a1195a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:04.389749 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a2a89016-3fe4-4ab5-b2bc-e50646a1195a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:04.406344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c0ba1-4d6b-45c3-9e74-27da08e413e7 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:04.414723 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1893/3763] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:04.420431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c0ba1-4d6b-45c3-9e74-27da08e413e7 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:04.427595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21872c71-f8ec-42b1-9223-1a0ce34b6fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:04.428494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21872c71-f8ec-42b1-9223-1a0ce34b6fbd admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:04.428887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21872c71-f8ec-42b1-9223-1a0ce34b6fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:04.429262 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21872c71-f8ec-42b1-9223-1a0ce34b6fbd admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:04.430143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21872c71-f8ec-42b1-9223-1a0ce34b6fbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:24:04.430560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21872c71-f8ec-42b1-9223-1a0ce34b6fbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:04.432658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21872c71-f8ec-42b1-9223-1a0ce34b6fbd admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:04.456687 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1871/3764] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:24:04.457801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a89016-3fe4-4ab5-b2bc-e50646a1195a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:04.472367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a89016-3fe4-4ab5-b2bc-e50646a1195a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:04.479462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a481e4-d7ff-4c99-91a9-32e1cd799a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:04.480375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a481e4-d7ff-4c99-91a9-32e1cd799a89 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:04.480957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a481e4-d7ff-4c99-91a9-32e1cd799a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:04.481102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a481e4-d7ff-4c99-91a9-32e1cd799a89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:04.481859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a481e4-d7ff-4c99-91a9-32e1cd799a89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:04.484031 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a481e4-d7ff-4c99-91a9-32e1cd799a89 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:04.538247 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1894/3765] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:24:04 2022] POST /identity/v3/projects => generated 365 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:04.538409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21872c71-f8ec-42b1-9223-1a0ce34b6fbd admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:04.548828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21872c71-f8ec-42b1-9223-1a0ce34b6fbd admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:04.664088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfeb88-5687-4bc9-9ac8-a7a57af42ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:04.665027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfeb88-5687-4bc9-9ac8-a7a57af42ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:04.665497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfeb88-5687-4bc9-9ac8-a7a57af42ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:04.665924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfeb88-5687-4bc9-9ac8-a7a57af42ab9 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:04.666927 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfeb88-5687-4bc9-9ac8-a7a57af42ab9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:04.669183 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfeb88-5687-4bc9-9ac8-a7a57af42ab9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:04.698720 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1872/3766] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:24:04 2022] POST /identity/v3/users => generated 283 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:24:04.703722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a481e4-d7ff-4c99-91a9-32e1cd799a89 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:04.717630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a481e4-d7ff-4c99-91a9-32e1cd799a89 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:04.724651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b85536-76c9-4259-90e1-5f891b394c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:04.725453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b85536-76c9-4259-90e1-5f891b394c9b admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:04.726845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b85536-76c9-4259-90e1-5f891b394c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:04.727231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b85536-76c9-4259-90e1-5f891b394c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:04.728670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b85536-76c9-4259-90e1-5f891b394c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:04.730977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b85536-76c9-4259-90e1-5f891b394c9b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:04.748657 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1895/3767] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:04.749736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfeb88-5687-4bc9-9ac8-a7a57af42ab9 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:04.766763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfeb88-5687-4bc9-9ac8-a7a57af42ab9 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:04.772326 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb35215-0d0d-429d-960e-a38aeb28150b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:04.773208 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb35215-0d0d-429d-960e-a38aeb28150b admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:04.773549 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb35215-0d0d-429d-960e-a38aeb28150b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:04.774141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb35215-0d0d-429d-960e-a38aeb28150b admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:04.775158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb35215-0d0d-429d-960e-a38aeb28150b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:04.777242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb35215-0d0d-429d-960e-a38aeb28150b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:04.792622 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1873/3768] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:04.796784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b85536-76c9-4259-90e1-5f891b394c9b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:04.821982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b85536-76c9-4259-90e1-5f891b394c9b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:04.854411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80cdb5-b1b9-4a18-96e8-8c3f2c5418f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:04.858247 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80cdb5-b1b9-4a18-96e8-8c3f2c5418f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:04.858641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80cdb5-b1b9-4a18-96e8-8c3f2c5418f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:04.861149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80cdb5-b1b9-4a18-96e8-8c3f2c5418f8 admin admin] PATH_INFO: `/v3/projects/e1389822ae55456696cc536b3c4e4213/users/e46bc54b42b942129ba0730824d6f4a3/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:04.894521 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:04.903818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80cdb5-b1b9-4a18-96e8-8c3f2c5418f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1389822ae55456696cc536b3c4e4213, user_id=e46bc54b42b942129ba0730824d6f4a3, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:04.906795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80cdb5-b1b9-4a18-96e8-8c3f2c5418f8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:04.931878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb35215-0d0d-429d-960e-a38aeb28150b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:04.933918 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1896/3769] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:24:04 2022] PUT /identity/v3/projects/e1389822ae55456696cc536b3c4e4213/users/e46bc54b42b942129ba0730824d6f4a3/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:04.935625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9bb35215-0d0d-429d-960e-a38aeb28150b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:04.945816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8be40e-6a6c-4ce3-a362-3ae3b48bd4c3 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:04.946148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8be40e-6a6c-4ce3-a362-3ae3b48bd4c3 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:04.946359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8be40e-6a6c-4ce3-a362-3ae3b48bd4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:04.972020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb35215-0d0d-429d-960e-a38aeb28150b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:04.984090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6c8be40e-6a6c-4ce3-a362-3ae3b48bd4c3 None None] MFA Rules not processed for user `e46bc54b42b942129ba0730824d6f4a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:04.985562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6c8be40e-6a6c-4ce3-a362-3ae3b48bd4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:05.143271 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:05.149607 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1897/3770] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:24:05.157019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8be40e-6a6c-4ce3-a362-3ae3b48bd4c3 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:05.172786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d4583-4e93-49a8-bc09-6eb64ab5ae74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:05.175134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d4583-4e93-49a8-bc09-6eb64ab5ae74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:05.175558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d4583-4e93-49a8-bc09-6eb64ab5ae74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:05.176038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d4583-4e93-49a8-bc09-6eb64ab5ae74 admin admin] PATH_INFO: `/v3/projects/7e166fb219464337af5e274671580d80` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:05.178412 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d4583-4e93-49a8-bc09-6eb64ab5ae74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e166fb219464337af5e274671580d80)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:05.181676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d4583-4e93-49a8-bc09-6eb64ab5ae74 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:05.265167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6f1d4583-4e93-49a8-bc09-6eb64ab5ae74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e166fb219464337af5e274671580d80', 'request_id': 'req-6f1d4583-4e93-49a8-bc09-6eb64ab5ae74'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:05.285592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6f1d4583-4e93-49a8-bc09-6eb64ab5ae74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e166fb219464337af5e274671580d80', 'request_id': 'req-6f1d4583-4e93-49a8-bc09-6eb64ab5ae74'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:05.313851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6f1d4583-4e93-49a8-bc09-6eb64ab5ae74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e166fb219464337af5e274671580d80', 'request_id': 'req-6f1d4583-4e93-49a8-bc09-6eb64ab5ae74'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:05.352157 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6f1d4583-4e93-49a8-bc09-6eb64ab5ae74 admin admin] The token cache is being invalidate because project 7e166fb219464337af5e274671580d80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:05.353430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6f1d4583-4e93-49a8-bc09-6eb64ab5ae74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:05.355580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6f1d4583-4e93-49a8-bc09-6eb64ab5ae74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:05.356459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8be40e-6a6c-4ce3-a362-3ae3b48bd4c3 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:05.359749 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1874/3771] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:24:04 2022] DELETE /identity/v3/projects/7e166fb219464337af5e274671580d80 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:05.365846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde84a0-b390-482c-aab7-cfe66e98321c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:05.366130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde84a0-b390-482c-aab7-cfe66e98321c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:05.366403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde84a0-b390-482c-aab7-cfe66e98321c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:05.407082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-fdde84a0-b390-482c-aab7-cfe66e98321c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:05.408956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-fdde84a0-b390-482c-aab7-cfe66e98321c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:05.518027 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cd87d-b900-42ca-9061-c8028b43ff32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:05.524724 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cd87d-b900-42ca-9061-c8028b43ff32 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:05.525042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cd87d-b900-42ca-9061-c8028b43ff32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:05.525387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768cd87d-b900-42ca-9061-c8028b43ff32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:05.526303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768cd87d-b900-42ca-9061-c8028b43ff32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:05.531066 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768cd87d-b900-42ca-9061-c8028b43ff32 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:05.615050 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1898/3772] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:24:05 2022] POST /identity/v3/projects => generated 367 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:05.619934 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cd87d-b900-42ca-9061-c8028b43ff32 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:05.621032 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1875/3773] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:05.629902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c442d22-b168-4819-ba4e-11ddec464d5c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:05.630584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c442d22-b168-4819-ba4e-11ddec464d5c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:05.631082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c442d22-b168-4819-ba4e-11ddec464d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:05.632026 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-768cd87d-b900-42ca-9061-c8028b43ff32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:05.655358 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:05.674631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9c442d22-b168-4819-ba4e-11ddec464d5c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:05.676850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9c442d22-b168-4819-ba4e-11ddec464d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:05.798344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768cd87d-b900-42ca-9061-c8028b43ff32 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:05.808104 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1876/3774] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:24:05.812235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c442d22-b168-4819-ba4e-11ddec464d5c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:05.812467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d100c-336a-49bc-bf07-46248cb1797e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:05.813096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d100c-336a-49bc-bf07-46248cb1797e admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:05.816195 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d100c-336a-49bc-bf07-46248cb1797e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:05.816504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d100c-336a-49bc-bf07-46248cb1797e admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:05.817951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d100c-336a-49bc-bf07-46248cb1797e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:05.820009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d100c-336a-49bc-bf07-46248cb1797e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:05.835716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c442d22-b168-4819-ba4e-11ddec464d5c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:05.853131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3d4ba-fd5c-47e4-ad4d-aa08e1f1099c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:05.854186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3d4ba-fd5c-47e4-ad4d-aa08e1f1099c admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:05.854703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3d4ba-fd5c-47e4-ad4d-aa08e1f1099c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:05.855216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3d4ba-fd5c-47e4-ad4d-aa08e1f1099c admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:05.856639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3d4ba-fd5c-47e4-ad4d-aa08e1f1099c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:24:05.856873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3d4ba-fd5c-47e4-ad4d-aa08e1f1099c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:05.863203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3d4ba-fd5c-47e4-ad4d-aa08e1f1099c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:05.881391 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1899/3775] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:24:05 2022] POST /identity/v3/users => generated 290 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:05.882420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d100c-336a-49bc-bf07-46248cb1797e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:05.897055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d100c-336a-49bc-bf07-46248cb1797e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:05.900864 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1877/3776] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:24:05.907615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c15938-2005-4f70-8463-7dec2ae2d125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:05.908277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c15938-2005-4f70-8463-7dec2ae2d125 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:05.908782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c15938-2005-4f70-8463-7dec2ae2d125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:05.909065 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c15938-2005-4f70-8463-7dec2ae2d125 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:05.909722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c15938-2005-4f70-8463-7dec2ae2d125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:05.911380 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c15938-2005-4f70-8463-7dec2ae2d125 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:05.912101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3d4ba-fd5c-47e4-ad4d-aa08e1f1099c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:05.926371 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1900/3777] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:05.931137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c15938-2005-4f70-8463-7dec2ae2d125 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:05.942726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3d4ba-fd5c-47e4-ad4d-aa08e1f1099c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:05.953983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2d92d-cb32-4bce-8009-3ab005680eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:05.954684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2d92d-cb32-4bce-8009-3ab005680eeb admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:05.954966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2d92d-cb32-4bce-8009-3ab005680eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:05.955240 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea2d92d-cb32-4bce-8009-3ab005680eeb admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:05.955922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2d92d-cb32-4bce-8009-3ab005680eeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:05.957908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea2d92d-cb32-4bce-8009-3ab005680eeb admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:05.962166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c15938-2005-4f70-8463-7dec2ae2d125 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:05.967667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e556d-900b-43f7-8aa2-a15b730f21a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:05.968887 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e556d-900b-43f7-8aa2-a15b730f21a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:05.969240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e556d-900b-43f7-8aa2-a15b730f21a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:05.969709 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e556d-900b-43f7-8aa2-a15b730f21a6 admin admin] PATH_INFO: `/v3/projects/b72ce4d7c6cc494da25909e6dfc0560e/users/c3a19e9347fc47c5a8aec0fcae85e1ac/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:05.989240 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:06.002909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e556d-900b-43f7-8aa2-a15b730f21a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b72ce4d7c6cc494da25909e6dfc0560e, user_id=c3a19e9347fc47c5a8aec0fcae85e1ac, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:06.014368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e556d-900b-43f7-8aa2-a15b730f21a6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:06.057430 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1901/3778] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:24:05 2022] PUT /identity/v3/projects/b72ce4d7c6cc494da25909e6dfc0560e/users/c3a19e9347fc47c5a8aec0fcae85e1ac/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:06.061277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e556d-900b-43f7-8aa2-a15b730f21a6 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:06.064234 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1878/3779] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:24:05 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:06.064435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2d92d-cb32-4bce-8009-3ab005680eeb admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:06.225730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea2d92d-cb32-4bce-8009-3ab005680eeb admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:06.231953 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e556d-900b-43f7-8aa2-a15b730f21a6 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:06.240269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df3b0f-ab57-4888-b899-0cad07fb7df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:06.241268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df3b0f-ab57-4888-b899-0cad07fb7df2 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:06.241652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df3b0f-ab57-4888-b899-0cad07fb7df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:06.247462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e216b-ec4d-491e-82b0-3f19c29ca469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:06.248678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e216b-ec4d-491e-82b0-3f19c29ca469 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:06.249060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e216b-ec4d-491e-82b0-3f19c29ca469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:06.249400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e216b-ec4d-491e-82b0-3f19c29ca469 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:06.249602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df3b0f-ab57-4888-b899-0cad07fb7df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:06.250760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e216b-ec4d-491e-82b0-3f19c29ca469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:06.251666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df3b0f-ab57-4888-b899-0cad07fb7df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:06.253489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df3b0f-ab57-4888-b899-0cad07fb7df2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:06.253867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e216b-ec4d-491e-82b0-3f19c29ca469 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:06.275990 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1879/3780] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:06.277393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df3b0f-ab57-4888-b899-0cad07fb7df2 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:06.295352 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1902/3781] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:24:06 2022] POST /identity/v3/users => generated 290 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:06.296779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e216b-ec4d-491e-82b0-3f19c29ca469 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:06.315832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e216b-ec4d-491e-82b0-3f19c29ca469 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:06.317301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df3b0f-ab57-4888-b899-0cad07fb7df2 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:06.323576 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32efbf-4088-4093-8766-264fd794615e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:06.324782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32efbf-4088-4093-8766-264fd794615e admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:06.325129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32efbf-4088-4093-8766-264fd794615e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:06.325384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32efbf-4088-4093-8766-264fd794615e admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:06.327792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32efbf-4088-4093-8766-264fd794615e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:06.329400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6b373-6df5-404f-9e9e-6a9046522d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:06.329758 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32efbf-4088-4093-8766-264fd794615e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:06.333484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6b373-6df5-404f-9e9e-6a9046522d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:06.334459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6b373-6df5-404f-9e9e-6a9046522d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:06.334781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6b373-6df5-404f-9e9e-6a9046522d19 admin admin] PATH_INFO: `/v3/projects/b72ce4d7c6cc494da25909e6dfc0560e/users/c3a19e9347fc47c5a8aec0fcae85e1ac/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:06.350492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6b373-6df5-404f-9e9e-6a9046522d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b72ce4d7c6cc494da25909e6dfc0560e, user_id=c3a19e9347fc47c5a8aec0fcae85e1ac, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:06.351672 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1903/3782] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:06.353484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32efbf-4088-4093-8766-264fd794615e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:06.354699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6b373-6df5-404f-9e9e-6a9046522d19 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:06.366427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32efbf-4088-4093-8766-264fd794615e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:06.376729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d09be-a0c3-4032-a3b9-a3fdcf8ab26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:06.378204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d09be-a0c3-4032-a3b9-a3fdcf8ab26c admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:06.379043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d09be-a0c3-4032-a3b9-a3fdcf8ab26c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:06.379877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d09be-a0c3-4032-a3b9-a3fdcf8ab26c admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:06.381302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d09be-a0c3-4032-a3b9-a3fdcf8ab26c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:06.384079 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1880/3783] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:24:06 2022] PUT /identity/v3/projects/b72ce4d7c6cc494da25909e6dfc0560e/users/c3a19e9347fc47c5a8aec0fcae85e1ac/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:06.386372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d09be-a0c3-4032-a3b9-a3fdcf8ab26c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:06.393953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484a28d-b0e9-4f4f-9792-109572022f64 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:06.394378 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484a28d-b0e9-4f4f-9792-109572022f64 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:06.395056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484a28d-b0e9-4f4f-9792-109572022f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:06.416296 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1904/3784] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:06.418064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d09be-a0c3-4032-a3b9-a3fdcf8ab26c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:06.439411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d09be-a0c3-4032-a3b9-a3fdcf8ab26c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:06.462319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1484a28d-b0e9-4f4f-9792-109572022f64 None None] MFA Rules not processed for user `c3a19e9347fc47c5a8aec0fcae85e1ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:06.466529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1484a28d-b0e9-4f4f-9792-109572022f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:06.492331 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:06.611478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc439d7c-70bc-4743-b591-7ae3b2de6a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:06.612317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc439d7c-70bc-4743-b591-7ae3b2de6a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:06.612698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc439d7c-70bc-4743-b591-7ae3b2de6a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:06.615130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc439d7c-70bc-4743-b591-7ae3b2de6a22 admin admin] PATH_INFO: `/v3/projects/9ecc3d5efbe54d76ae9e6ed5f7633c1d/users/e379b67e2bb248b3ad25b92b2082b0fe/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:06.645602 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc439d7c-70bc-4743-b591-7ae3b2de6a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ecc3d5efbe54d76ae9e6ed5f7633c1d, user_id=e379b67e2bb248b3ad25b92b2082b0fe, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:06.648877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc439d7c-70bc-4743-b591-7ae3b2de6a22 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:06.678407 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1905/3785] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:24:06 2022] PUT /identity/v3/projects/9ecc3d5efbe54d76ae9e6ed5f7633c1d/users/e379b67e2bb248b3ad25b92b2082b0fe/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:06.684535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b04d6-fb65-462f-ba8a-96aa28716f71 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:06.685037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b04d6-fb65-462f-ba8a-96aa28716f71 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:06.685491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b04d6-fb65-462f-ba8a-96aa28716f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:06.704713 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1881/3786] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:24:06.709622 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484a28d-b0e9-4f4f-9792-109572022f64 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:06.733719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484a28d-b0e9-4f4f-9792-109572022f64 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:06.747262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-704b04d6-fb65-462f-ba8a-96aa28716f71 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:06.753785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-704b04d6-fb65-462f-ba8a-96aa28716f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:06.921882 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:06.929181 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1906/3787] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:06.947433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b04d6-fb65-462f-ba8a-96aa28716f71 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:06.949083 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-704b04d6-fb65-462f-ba8a-96aa28716f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:06.949905 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f4f65-dc4b-4d98-bd33-0c463146ffd6 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:06.952477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f4f65-dc4b-4d98-bd33-0c463146ffd6 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:06.952477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f4f65-dc4b-4d98-bd33-0c463146ffd6 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:06.953853 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f4f65-dc4b-4d98-bd33-0c463146ffd6 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:06.955615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f4f65-dc4b-4d98-bd33-0c463146ffd6 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:06.960964 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-779f4f65-dc4b-4d98-bd33-0c463146ffd6 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:06.960964 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:24:06.960964 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:24:06.962854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f4f65-dc4b-4d98-bd33-0c463146ffd6 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:07.010542 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1882/3788] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:24:06 2022] POST /identity/v3/roles => generated 234 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:07.026343 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f4f65-dc4b-4d98-bd33-0c463146ffd6 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:07.062777 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f4f65-dc4b-4d98-bd33-0c463146ffd6 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:07.082026 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae6c3b-a234-4671-abe5-63269b6ef03c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:07.082783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae6c3b-a234-4671-abe5-63269b6ef03c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:07.083434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae6c3b-a234-4671-abe5-63269b6ef03c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:07.083434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae6c3b-a234-4671-abe5-63269b6ef03c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:07.084321 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae6c3b-a234-4671-abe5-63269b6ef03c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:07.086854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae6c3b-a234-4671-abe5-63269b6ef03c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:07.124340 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1883/3789] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:24:07 2022] POST /identity/v3/roles => generated 235 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:07.125297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae6c3b-a234-4671-abe5-63269b6ef03c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:07.144153 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae6c3b-a234-4671-abe5-63269b6ef03c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:07.160945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c12148-8afb-47bf-afa1-0d2d211545e0 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:07.161584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c12148-8afb-47bf-afa1-0d2d211545e0 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:07.161866 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c12148-8afb-47bf-afa1-0d2d211545e0 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:07.162133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c12148-8afb-47bf-afa1-0d2d211545e0 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:07.162815 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c12148-8afb-47bf-afa1-0d2d211545e0 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:07.164488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c12148-8afb-47bf-afa1-0d2d211545e0 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:07.197992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b04d6-fb65-462f-ba8a-96aa28716f71 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:07.207209 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1884/3790] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:24:07 2022] POST /identity/v3/roles => generated 235 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:24:07.208077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c12148-8afb-47bf-afa1-0d2d211545e0 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:07.221740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f72777-efda-4fd0-b98d-e4404ff7fedf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:07.221740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f72777-efda-4fd0-b98d-e4404ff7fedf service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:07.221740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f72777-efda-4fd0-b98d-e4404ff7fedf service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:07.221740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f72777-efda-4fd0-b98d-e4404ff7fedf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:07.233118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c12148-8afb-47bf-afa1-0d2d211545e0 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:07.241838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f72777-efda-4fd0-b98d-e4404ff7fedf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:07.243818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f72777-efda-4fd0-b98d-e4404ff7fedf service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:07.249659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a581a953-dd64-4e0e-b493-3457ccd480ba tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:07.250342 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581a953-dd64-4e0e-b493-3457ccd480ba tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:07.250630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581a953-dd64-4e0e-b493-3457ccd480ba tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:07.250909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a581a953-dd64-4e0e-b493-3457ccd480ba tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:07.251591 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a581a953-dd64-4e0e-b493-3457ccd480ba tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:07.254089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a581a953-dd64-4e0e-b493-3457ccd480ba tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:07.267127 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1907/3791] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:24:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:24:07.296147 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1885/3792] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Aug 7 01:24:07 2022] POST /identity/v3/domains => generated 276 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:07.298018 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f72777-efda-4fd0-b98d-e4404ff7fedf service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:07.330527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f72777-efda-4fd0-b98d-e4404ff7fedf service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:07.415356 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:07.502818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2be094-ef16-4151-9a94-fb00a003dae2 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:07.503702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2be094-ef16-4151-9a94-fb00a003dae2 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:07.503846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2be094-ef16-4151-9a94-fb00a003dae2 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:07.504107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2be094-ef16-4151-9a94-fb00a003dae2 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:07.504702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2be094-ef16-4151-9a94-fb00a003dae2 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:07.510558 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2be094-ef16-4151-9a94-fb00a003dae2 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:07.599669 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1908/3793] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:24:07 2022] POST /identity/v3/projects => generated 399 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:07.605375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a581a953-dd64-4e0e-b493-3457ccd480ba tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:07.628255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a581a953-dd64-4e0e-b493-3457ccd480ba tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:07.752000 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915924dd-8b5d-4194-acd3-eefd8ebf73e3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:07.752955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915924dd-8b5d-4194-acd3-eefd8ebf73e3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:07.753542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915924dd-8b5d-4194-acd3-eefd8ebf73e3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:07.753984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915924dd-8b5d-4194-acd3-eefd8ebf73e3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/groups` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:07.755595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915924dd-8b5d-4194-acd3-eefd8ebf73e3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:07.756843 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-915924dd-8b5d-4194-acd3-eefd8ebf73e3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:07.756843 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:24:07.756843 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:24:07.758703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915924dd-8b5d-4194-acd3-eefd8ebf73e3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:07.785068 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1886/3794] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:24:07 2022] POST /identity/v3/groups => generated 301 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:07.788914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2be094-ef16-4151-9a94-fb00a003dae2 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:07.855353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2be094-ef16-4151-9a94-fb00a003dae2 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:07.865526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29577b-377a-4dc2-8da6-57e375e36a27 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:07.866465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29577b-377a-4dc2-8da6-57e375e36a27 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:07.866757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29577b-377a-4dc2-8da6-57e375e36a27 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:07.867088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29577b-377a-4dc2-8da6-57e375e36a27 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:07.868159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29577b-377a-4dc2-8da6-57e375e36a27 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:07.868838 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-8c29577b-377a-4dc2-8da6-57e375e36a27 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:07.868838 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:24:07.868838 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:24:07.870413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29577b-377a-4dc2-8da6-57e375e36a27 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:07.909991 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1909/3795] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:24:07 2022] POST /identity/v3/roles => generated 235 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:24:07.924465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915924dd-8b5d-4194-acd3-eefd8ebf73e3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:07.951665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915924dd-8b5d-4194-acd3-eefd8ebf73e3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:07.964802 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae123e-862c-4e20-b1cf-baf59ffd5f03 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:07.967114 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae123e-862c-4e20-b1cf-baf59ffd5f03 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:07.967641 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae123e-862c-4e20-b1cf-baf59ffd5f03 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:07.968148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae123e-862c-4e20-b1cf-baf59ffd5f03 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:07.971281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae123e-862c-4e20-b1cf-baf59ffd5f03 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:07.973571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae123e-862c-4e20-b1cf-baf59ffd5f03 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:08.031458 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1887/3796] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:24:07 2022] POST /identity/v3/users => generated 442 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:24:08.035255 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29577b-377a-4dc2-8da6-57e375e36a27 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:08.051461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29577b-377a-4dc2-8da6-57e375e36a27 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:08.061372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a4067-248d-4758-9cd1-f36c20eb77ae tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:08.062577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a4067-248d-4758-9cd1-f36c20eb77ae tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:08.062954 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a4067-248d-4758-9cd1-f36c20eb77ae tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:08.063287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a4067-248d-4758-9cd1-f36c20eb77ae tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:08.064452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a4067-248d-4758-9cd1-f36c20eb77ae tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:08.065553 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-384a4067-248d-4758-9cd1-f36c20eb77ae tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:08.065553 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:24:08.065553 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:24:08.066669 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a4067-248d-4758-9cd1-f36c20eb77ae tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:08.095662 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1910/3797] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:24:08 2022] POST /identity/v3/roles => generated 270 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:24:08.099951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae123e-862c-4e20-b1cf-baf59ffd5f03 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:08.114856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae123e-862c-4e20-b1cf-baf59ffd5f03 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:08.128782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bddae6-2671-4b3d-abf5-45b23f2edb99 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:08.129493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bddae6-2671-4b3d-abf5-45b23f2edb99 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:08.129776 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bddae6-2671-4b3d-abf5-45b23f2edb99 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:08.130058 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bddae6-2671-4b3d-abf5-45b23f2edb99 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/projects/ef724d39524643378e66c5c9b0b26a1b/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e/roles/ec4658d41f8d4763a48591be2e1c21e5` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:08.170241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bddae6-2671-4b3d-abf5-45b23f2edb99 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ef724d39524643378e66c5c9b0b26a1b, user_id=626eb5b1cb2a4cdeb1cc2fb80f591a7e, role_id=ec4658d41f8d4763a48591be2e1c21e5)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:08.173323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bddae6-2671-4b3d-abf5-45b23f2edb99 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:08.194253 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1888/3798] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:24:08 2022] PUT /identity/v3/projects/ef724d39524643378e66c5c9b0b26a1b/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e/roles/ec4658d41f8d4763a48591be2e1c21e5 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:08.198629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a4067-248d-4758-9cd1-f36c20eb77ae tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:08.212955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a4067-248d-4758-9cd1-f36c20eb77ae tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:08.337969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ebc6d-85a1-40fe-a3fa-ae9e62079463 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:08.339906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ebc6d-85a1-40fe-a3fa-ae9e62079463 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:08.340419 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ebc6d-85a1-40fe-a3fa-ae9e62079463 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:08.341958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ebc6d-85a1-40fe-a3fa-ae9e62079463 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:08.343411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ebc6d-85a1-40fe-a3fa-ae9e62079463 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Adding query filter params (scope.project.id=ef724d39524643378e66c5c9b0b26a1b, user.id=626eb5b1cb2a4cdeb1cc2fb80f591a7e) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:24:08.345039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ebc6d-85a1-40fe-a3fa-ae9e62079463 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:08.348224 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-c49ebc6d-85a1-40fe-a3fa-ae9e62079463 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:08.348224 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:24:08.348224 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:24:08.349823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ebc6d-85a1-40fe-a3fa-ae9e62079463 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:08.436357 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1911/3799] 10.222.0.39 () {58 vars in 1356 bytes} [Sun Aug 7 01:24:08 2022] GET /identity/v3/role_assignments?scope.project.id=ef724d39524643378e66c5c9b0b26a1b&user.id=626eb5b1cb2a4cdeb1cc2fb80f591a7e&effective => generated 228 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:24:08.440349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bddae6-2671-4b3d-abf5-45b23f2edb99 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:08.453487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bddae6-2671-4b3d-abf5-45b23f2edb99 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:08.469615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4c720-e92f-4339-81ff-c91854c5fa82 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:08.470458 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4c720-e92f-4339-81ff-c91854c5fa82 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:08.470851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4c720-e92f-4339-81ff-c91854c5fa82 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:08.471261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4c720-e92f-4339-81ff-c91854c5fa82 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/projects/ef724d39524643378e66c5c9b0b26a1b/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e/roles/ec4658d41f8d4763a48591be2e1c21e5` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:08.478601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4c720-e92f-4339-81ff-c91854c5fa82 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=ef724d39524643378e66c5c9b0b26a1b, user_id=626eb5b1cb2a4cdeb1cc2fb80f591a7e, role_id=ec4658d41f8d4763a48591be2e1c21e5)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:08.480240 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-05a4c720-e92f-4339-81ff-c91854c5fa82 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:08.480240 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:24:08.480240 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:24:08.482816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4c720-e92f-4339-81ff-c91854c5fa82 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:08.495250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-05a4c720-e92f-4339-81ff-c91854c5fa82 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invalidating the token cache because role ec4658d41f8d4763a48591be2e1c21e5 was removed from user 626eb5b1cb2a4cdeb1cc2fb80f591a7e on project ef724d39524643378e66c5c9b0b26a1b. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:08.495874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-05a4c720-e92f-4339-81ff-c91854c5fa82 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:08.496997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-05a4c720-e92f-4339-81ff-c91854c5fa82 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:08.536076 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1889/3800] 10.222.0.39 () {58 vars in 1467 bytes} [Sun Aug 7 01:24:08 2022] DELETE /identity/v3/projects/ef724d39524643378e66c5c9b0b26a1b/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e/roles/ec4658d41f8d4763a48591be2e1c21e5 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:08.540319 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ebc6d-85a1-40fe-a3fa-ae9e62079463 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:08.542324 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c49ebc6d-85a1-40fe-a3fa-ae9e62079463 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:08.571263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ebc6d-85a1-40fe-a3fa-ae9e62079463 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:08.782394 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:08.825989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b9e6b-26af-4789-bc9d-abc3da46b8c8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:08.826733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b9e6b-26af-4789-bc9d-abc3da46b8c8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:08.827087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b9e6b-26af-4789-bc9d-abc3da46b8c8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:08.828744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b9e6b-26af-4789-bc9d-abc3da46b8c8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/ec4658d41f8d4763a48591be2e1c21e5` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:08.829648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b9e6b-26af-4789-bc9d-abc3da46b8c8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=ec4658d41f8d4763a48591be2e1c21e5)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:08.832348 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-9b0b9e6b-26af-4789-bc9d-abc3da46b8c8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:08.832348 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:24:08.832348 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:24:08.837636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b9e6b-26af-4789-bc9d-abc3da46b8c8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:08.958274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9b0b9e6b-26af-4789-bc9d-abc3da46b8c8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invalidating the token cache because role ec4658d41f8d4763a48591be2e1c21e5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:08.960747 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9b0b9e6b-26af-4789-bc9d-abc3da46b8c8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:08.968002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9b0b9e6b-26af-4789-bc9d-abc3da46b8c8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:08.973108 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1912/3801] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:24:08 2022] DELETE /identity/v3/roles/ec4658d41f8d4763a48591be2e1c21e5 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:24:08.987430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4c720-e92f-4339-81ff-c91854c5fa82 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:09.008158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4c720-e92f-4339-81ff-c91854c5fa82 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:09.180532 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:INSERT=9,keystone:DELETE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:09.228757 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697b3f8-c384-43b7-b2cf-40f513e32a03 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:09.229456 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697b3f8-c384-43b7-b2cf-40f513e32a03 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:09.233627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697b3f8-c384-43b7-b2cf-40f513e32a03 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:09.234088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697b3f8-c384-43b7-b2cf-40f513e32a03 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/projects/ef724d39524643378e66c5c9b0b26a1b/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e/roles/b3dce7e63bcd404990e9477193ec382a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:09.239847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697b3f8-c384-43b7-b2cf-40f513e32a03 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ef724d39524643378e66c5c9b0b26a1b, user_id=626eb5b1cb2a4cdeb1cc2fb80f591a7e, role_id=b3dce7e63bcd404990e9477193ec382a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:09.247834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697b3f8-c384-43b7-b2cf-40f513e32a03 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:09.282262 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1890/3802] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:24:08 2022] PUT /identity/v3/projects/ef724d39524643378e66c5c9b0b26a1b/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e/roles/b3dce7e63bcd404990e9477193ec382a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:09.288040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b9e6b-26af-4789-bc9d-abc3da46b8c8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:09.290184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9b0b9e6b-26af-4789-bc9d-abc3da46b8c8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:09.324771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b9e6b-26af-4789-bc9d-abc3da46b8c8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:09.420824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5aa76-e405-44be-a9a3-45c8364bc3e4 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:09.421906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5aa76-e405-44be-a9a3-45c8364bc3e4 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:09.422221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5aa76-e405-44be-a9a3-45c8364bc3e4 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:09.422608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5aa76-e405-44be-a9a3-45c8364bc3e4 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/8511d75c05b3484185fc5acca098e3d7` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:09.424535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5aa76-e405-44be-a9a3-45c8364bc3e4 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b3dce7e63bcd404990e9477193ec382a, implied_role_id=8511d75c05b3484185fc5acca098e3d7)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:09.425805 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-59f5aa76-e405-44be-a9a3-45c8364bc3e4 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:09.425805 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:24:09.425805 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:24:09.427448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5aa76-e405-44be-a9a3-45c8364bc3e4 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:09.482164 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1913/3803] 10.222.0.39 () {60 vars in 1363 bytes} [Sun Aug 7 01:24:09 2022] PUT /identity/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/8511d75c05b3484185fc5acca098e3d7 => generated 520 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:09.484263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697b3f8-c384-43b7-b2cf-40f513e32a03 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:09.503378 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697b3f8-c384-43b7-b2cf-40f513e32a03 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:09.612844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be4cf0-4cca-44cd-abab-794e6998a26b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:09.613875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be4cf0-4cca-44cd-abab-794e6998a26b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:09.617980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be4cf0-4cca-44cd-abab-794e6998a26b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:09.618700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be4cf0-4cca-44cd-abab-794e6998a26b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:09.619330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be4cf0-4cca-44cd-abab-794e6998a26b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Adding query filter params (scope.project.id=ef724d39524643378e66c5c9b0b26a1b, user.id=626eb5b1cb2a4cdeb1cc2fb80f591a7e) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:24:09.619651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be4cf0-4cca-44cd-abab-794e6998a26b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:09.621242 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-c4be4cf0-4cca-44cd-abab-794e6998a26b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:09.621242 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:24:09.621242 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:24:09.621968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be4cf0-4cca-44cd-abab-794e6998a26b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:09.708532 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1891/3804] 10.222.0.39 () {58 vars in 1356 bytes} [Sun Aug 7 01:24:09 2022] GET /identity/v3/role_assignments?scope.project.id=ef724d39524643378e66c5c9b0b26a1b&user.id=626eb5b1cb2a4cdeb1cc2fb80f591a7e&effective => generated 1061 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:24:09.714834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5aa76-e405-44be-a9a3-45c8364bc3e4 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:09.735600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5aa76-e405-44be-a9a3-45c8364bc3e4 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:09.746455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea348e3f-0638-43f9-b07a-96049ae9ce24 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:09.748392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea348e3f-0638-43f9-b07a-96049ae9ce24 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:09.749173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea348e3f-0638-43f9-b07a-96049ae9ce24 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:09.749958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea348e3f-0638-43f9-b07a-96049ae9ce24 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/8511d75c05b3484185fc5acca098e3d7` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:09.753327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea348e3f-0638-43f9-b07a-96049ae9ce24 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b3dce7e63bcd404990e9477193ec382a, implied_role_id=8511d75c05b3484185fc5acca098e3d7)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:09.756454 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-ea348e3f-0638-43f9-b07a-96049ae9ce24 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:09.756454 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:24:09.756454 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:24:09.759617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea348e3f-0638-43f9-b07a-96049ae9ce24 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:09.787300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be4cf0-4cca-44cd-abab-794e6998a26b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:09.788341 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1914/3805] 10.222.0.39 () {58 vars in 1347 bytes} [Sun Aug 7 01:24:09 2022] DELETE /identity/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/8511d75c05b3484185fc5acca098e3d7 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:24:09.799473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be4cf0-4cca-44cd-abab-794e6998a26b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:09.886508 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280022f-44e3-4ba3-904d-4073d08239d7 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:09.887143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280022f-44e3-4ba3-904d-4073d08239d7 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:09.887428 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280022f-44e3-4ba3-904d-4073d08239d7 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:09.887708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280022f-44e3-4ba3-904d-4073d08239d7 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:09.888513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280022f-44e3-4ba3-904d-4073d08239d7 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Adding query filter params (scope.project.id=ef724d39524643378e66c5c9b0b26a1b, user.id=626eb5b1cb2a4cdeb1cc2fb80f591a7e) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:24:09.888818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280022f-44e3-4ba3-904d-4073d08239d7 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:09.890981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280022f-44e3-4ba3-904d-4073d08239d7 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:09.934037 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:09.955232 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1892/3806] 10.222.0.39 () {58 vars in 1356 bytes} [Sun Aug 7 01:24:09 2022] GET /identity/v3/role_assignments?scope.project.id=ef724d39524643378e66c5c9b0b26a1b&user.id=626eb5b1cb2a4cdeb1cc2fb80f591a7e&effective => generated 577 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:24:09.960679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea348e3f-0638-43f9-b07a-96049ae9ce24 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:09.979146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea348e3f-0638-43f9-b07a-96049ae9ce24 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:09.992935 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970bf90-ff2b-4a96-b5bd-d0b8beb0e69b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:09.993768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970bf90-ff2b-4a96-b5bd-d0b8beb0e69b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:09.994052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970bf90-ff2b-4a96-b5bd-d0b8beb0e69b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:09.994330 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970bf90-ff2b-4a96-b5bd-d0b8beb0e69b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/8511d75c05b3484185fc5acca098e3d7` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:10.002431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970bf90-ff2b-4a96-b5bd-d0b8beb0e69b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b3dce7e63bcd404990e9477193ec382a, implied_role_id=8511d75c05b3484185fc5acca098e3d7)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:10.004259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970bf90-ff2b-4a96-b5bd-d0b8beb0e69b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:10.040553 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-4970bf90-ff2b-4a96-b5bd-d0b8beb0e69b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] b3dce7e63bcd404990e9477193ec382a does not imply 8511d75c05b3484185fc5acca098e3d7.: keystone.exception.ImpliedRoleNotFound: b3dce7e63bcd404990e9477193ec382a does not imply 8511d75c05b3484185fc5acca098e3d7. Aug 07 01:24:10.040553 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:24:10.040553 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 07 01:24:10.040553 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = query.one() Aug 07 01:24:10.040553 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Aug 07 01:24:10.040553 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._iter().one() Aug 07 01:24:10.040553 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Aug 07 01:24:10.040553 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._only_one_row( Aug 07 01:24:10.040553 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 07 01:24:10.040553 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 07 01:24:10.040553 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 07 01:24:10.040553 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:24:10.040553 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:24:10.040553 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:24:10.040553 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:24:10.040553 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:24:10.041881 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:24:10.041881 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:24:10.041881 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:24:10.041881 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:24:10.041881 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:24:10.041881 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:24:10.041881 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:24:10.041881 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:24:10.041881 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:24:10.041881 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Aug 07 01:24:10.041881 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Aug 07 01:24:10.041881 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:24:10.041881 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:24:10.041881 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Aug 07 01:24:10.041881 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Aug 07 01:24:10.041881 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Aug 07 01:24:10.042981 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 07 01:24:10.042981 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 07 01:24:10.042981 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 07 01:24:10.042981 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: b3dce7e63bcd404990e9477193ec382a does not imply 8511d75c05b3484185fc5acca098e3d7. Aug 07 01:24:10.042981 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:24:10.042981 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1915/3807] 10.222.0.39 () {58 vars in 1347 bytes} [Sun Aug 7 01:24:09 2022] DELETE /identity/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/8511d75c05b3484185fc5acca098e3d7 => generated 137 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 07 01:24:10.048319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280022f-44e3-4ba3-904d-4073d08239d7 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:10.062249 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280022f-44e3-4ba3-904d-4073d08239d7 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:10.068251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd271dd-cd19-4a5f-8461-010dc97c0483 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:10.068996 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd271dd-cd19-4a5f-8461-010dc97c0483 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:10.069446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd271dd-cd19-4a5f-8461-010dc97c0483 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:10.069728 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd271dd-cd19-4a5f-8461-010dc97c0483 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/projects/ef724d39524643378e66c5c9b0b26a1b/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e/roles/b3dce7e63bcd404990e9477193ec382a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:10.072515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd271dd-cd19-4a5f-8461-010dc97c0483 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=ef724d39524643378e66c5c9b0b26a1b, user_id=626eb5b1cb2a4cdeb1cc2fb80f591a7e, role_id=b3dce7e63bcd404990e9477193ec382a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:10.075925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd271dd-cd19-4a5f-8461-010dc97c0483 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:10.084745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bdd271dd-cd19-4a5f-8461-010dc97c0483 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invalidating the token cache because role b3dce7e63bcd404990e9477193ec382a was removed from user 626eb5b1cb2a4cdeb1cc2fb80f591a7e on project ef724d39524643378e66c5c9b0b26a1b. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:10.085053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bdd271dd-cd19-4a5f-8461-010dc97c0483 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:10.085841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bdd271dd-cd19-4a5f-8461-010dc97c0483 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:10.107007 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1893/3808] 10.222.0.39 () {58 vars in 1467 bytes} [Sun Aug 7 01:24:10 2022] DELETE /identity/v3/projects/ef724d39524643378e66c5c9b0b26a1b/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e/roles/b3dce7e63bcd404990e9477193ec382a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:10.119591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970bf90-ff2b-4a96-b5bd-d0b8beb0e69b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:10.122179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4970bf90-ff2b-4a96-b5bd-d0b8beb0e69b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:10.145887 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970bf90-ff2b-4a96-b5bd-d0b8beb0e69b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:10.222324 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060ed1f-d935-4e9a-8ae1-7ea4bdf0cd02 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:10.223342 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060ed1f-d935-4e9a-8ae1-7ea4bdf0cd02 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:10.223950 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060ed1f-d935-4e9a-8ae1-7ea4bdf0cd02 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:10.224462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060ed1f-d935-4e9a-8ae1-7ea4bdf0cd02 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:10.225434 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060ed1f-d935-4e9a-8ae1-7ea4bdf0cd02 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:10.227666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e060ed1f-d935-4e9a-8ae1-7ea4bdf0cd02 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:10.263784 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1916/3809] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:24:10 2022] POST /identity/v3/roles => generated 272 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:24:10.264476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd271dd-cd19-4a5f-8461-010dc97c0483 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:10.286554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd271dd-cd19-4a5f-8461-010dc97c0483 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:10.295743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fab793-a8a7-4cd9-9a01-8c8cbe2ccc74 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:10.296400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fab793-a8a7-4cd9-9a01-8c8cbe2ccc74 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:10.296685 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fab793-a8a7-4cd9-9a01-8c8cbe2ccc74 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:10.296964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fab793-a8a7-4cd9-9a01-8c8cbe2ccc74 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:10.297649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fab793-a8a7-4cd9-9a01-8c8cbe2ccc74 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Adding query filter params (domain_id=1bf9df0161c04f6db42ef2fa591a8beb) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:24:10.298070 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fab793-a8a7-4cd9-9a01-8c8cbe2ccc74 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:10.299057 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-41fab793-a8a7-4cd9-9a01-8c8cbe2ccc74 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:10.299057 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:24:10.299057 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:24:10.304329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fab793-a8a7-4cd9-9a01-8c8cbe2ccc74 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:10.323006 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1894/3810] 10.222.0.39 () {58 vars in 1207 bytes} [Sun Aug 7 01:24:10 2022] GET /identity/v3/roles?domain_id=1bf9df0161c04f6db42ef2fa591a8beb => generated 409 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:24:10.324661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060ed1f-d935-4e9a-8ae1-7ea4bdf0cd02 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:10.342929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060ed1f-d935-4e9a-8ae1-7ea4bdf0cd02 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:10.362773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551de38-b2df-4184-a29f-211cdc4afd68 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:10.362773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551de38-b2df-4184-a29f-211cdc4afd68 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:10.362773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551de38-b2df-4184-a29f-211cdc4afd68 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:10.364177 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551de38-b2df-4184-a29f-211cdc4afd68 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/ac321a990b624b3184c3da20c0bf6ae1` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:10.365916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551de38-b2df-4184-a29f-211cdc4afd68 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=ac321a990b624b3184c3da20c0bf6ae1)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:10.371168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551de38-b2df-4184-a29f-211cdc4afd68 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:10.376547 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:10.471726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6551de38-b2df-4184-a29f-211cdc4afd68 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invalidating the token cache because role ac321a990b624b3184c3da20c0bf6ae1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:10.472437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6551de38-b2df-4184-a29f-211cdc4afd68 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:10.472905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6551de38-b2df-4184-a29f-211cdc4afd68 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:10.475017 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1917/3811] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:24:10 2022] DELETE /identity/v3/roles/ac321a990b624b3184c3da20c0bf6ae1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:10.479696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fab793-a8a7-4cd9-9a01-8c8cbe2ccc74 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:10.481580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-41fab793-a8a7-4cd9-9a01-8c8cbe2ccc74 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:10.506661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fab793-a8a7-4cd9-9a01-8c8cbe2ccc74 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:10.615549 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45bed8-eb20-420d-935e-89cfc3b7987e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:10.616361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45bed8-eb20-420d-935e-89cfc3b7987e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:10.616714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45bed8-eb20-420d-935e-89cfc3b7987e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:10.617284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45bed8-eb20-420d-935e-89cfc3b7987e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:10.618176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45bed8-eb20-420d-935e-89cfc3b7987e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Adding query filter params (domain_id=1bf9df0161c04f6db42ef2fa591a8beb) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:24:10.618485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45bed8-eb20-420d-935e-89cfc3b7987e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:10.620824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45bed8-eb20-420d-935e-89cfc3b7987e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:10.630141 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1895/3812] 10.222.0.39 () {58 vars in 1207 bytes} [Sun Aug 7 01:24:10 2022] GET /identity/v3/roles?domain_id=1bf9df0161c04f6db42ef2fa591a8beb => generated 148 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:24:10.634861 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551de38-b2df-4184-a29f-211cdc4afd68 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:10.646161 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551de38-b2df-4184-a29f-211cdc4afd68 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:10.653428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb8be4-73a5-42a6-8589-aecee8a5b9f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:10.654265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb8be4-73a5-42a6-8589-aecee8a5b9f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:10.654474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb8be4-73a5-42a6-8589-aecee8a5b9f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:10.654718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb8be4-73a5-42a6-8589-aecee8a5b9f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/ac321a990b624b3184c3da20c0bf6ae1` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:10.677330 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb8be4-73a5-42a6-8589-aecee8a5b9f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:24:10.684109 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-75eb8be4-73a5-42a6-8589-aecee8a5b9f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Could not find role: ac321a990b624b3184c3da20c0bf6ae1.: keystone.exception.RoleNotFound: Could not find role: ac321a990b624b3184c3da20c0bf6ae1. Aug 07 01:24:10.684109 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:24:10.684109 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:24:10.684109 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:24:10.684109 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:24:10.684109 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:24:10.684109 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:24:10.684109 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:24:10.684109 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:24:10.684109 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:24:10.684109 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:24:10.684109 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:24:10.684109 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Aug 07 01:24:10.684109 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Aug 07 01:24:10.685164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:24:10.685164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:24:10.685164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:24:10.685164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:24:10.685164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:24:10.685164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:24:10.685164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:24:10.685164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:24:10.685164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:24:10.685164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:24:10.685164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:24:10.685164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 01:24:10.685164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:24:10.685164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:24:10.685164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:24:10.685164 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:24:10.686132 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:24:10.686132 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:24:10.686132 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:24:10.686132 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:24:10.686132 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 07 01:24:10.686132 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 07 01:24:10.686132 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 07 01:24:10.686132 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 07 01:24:10.686132 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 07 01:24:10.686132 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 01:24:10.686132 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ac321a990b624b3184c3da20c0bf6ae1. Aug 07 01:24:10.686132 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:24:10.692675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45bed8-eb20-420d-935e-89cfc3b7987e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:10.695069 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1918/3813] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:24:10 2022] DELETE /identity/v3/roles/ac321a990b624b3184c3da20c0bf6ae1 => generated 110 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:24:10.705520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45bed8-eb20-420d-935e-89cfc3b7987e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:10.716310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b6d77-737a-46aa-af8a-90c95b2b83ea tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:10.716976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b6d77-737a-46aa-af8a-90c95b2b83ea tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:10.717255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b6d77-737a-46aa-af8a-90c95b2b83ea tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:10.717591 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b6d77-737a-46aa-af8a-90c95b2b83ea tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/domains/1bf9df0161c04f6db42ef2fa591a8beb/groups/90987c82007d4137a9bbb9ad29ed9dc7/roles/25c010d52a5e4f61ad19bae8ccddf54b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:10.732075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b6d77-737a-46aa-af8a-90c95b2b83ea tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=1bf9df0161c04f6db42ef2fa591a8beb, group_id=90987c82007d4137a9bbb9ad29ed9dc7, role_id=25c010d52a5e4f61ad19bae8ccddf54b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:10.735792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b6d77-737a-46aa-af8a-90c95b2b83ea tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:10.757478 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1896/3814] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:24:10 2022] PUT /identity/v3/domains/1bf9df0161c04f6db42ef2fa591a8beb/groups/90987c82007d4137a9bbb9ad29ed9dc7/roles/25c010d52a5e4f61ad19bae8ccddf54b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:24:10.762537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb8be4-73a5-42a6-8589-aecee8a5b9f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:10.777232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb8be4-73a5-42a6-8589-aecee8a5b9f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:10.896781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e3e04-a023-418e-9145-6fe80377c27e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:10.897096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e3e04-a023-418e-9145-6fe80377c27e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:10.897451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e3e04-a023-418e-9145-6fe80377c27e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:10.898061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e3e04-a023-418e-9145-6fe80377c27e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/domains/1bf9df0161c04f6db42ef2fa591a8beb/groups/90987c82007d4137a9bbb9ad29ed9dc7/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:10.900061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e3e04-a023-418e-9145-6fe80377c27e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=1bf9df0161c04f6db42ef2fa591a8beb, group_id=90987c82007d4137a9bbb9ad29ed9dc7)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:10.901562 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-346e3e04-a023-418e-9145-6fe80377c27e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:10.901562 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:24:10.901562 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:24:10.904019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e3e04-a023-418e-9145-6fe80377c27e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:10.922998 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1919/3815] 10.222.0.39 () {58 vars in 1365 bytes} [Sun Aug 7 01:24:10 2022] GET /identity/v3/domains/1bf9df0161c04f6db42ef2fa591a8beb/groups/90987c82007d4137a9bbb9ad29ed9dc7/roles => generated 410 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:24:10.924362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b6d77-737a-46aa-af8a-90c95b2b83ea tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:10.936949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b6d77-737a-46aa-af8a-90c95b2b83ea tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:10.943492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30192178-a3e0-4220-9a08-5414452399d8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:10.944408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30192178-a3e0-4220-9a08-5414452399d8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:10.945928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30192178-a3e0-4220-9a08-5414452399d8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:10.945928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30192178-a3e0-4220-9a08-5414452399d8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/domains/1bf9df0161c04f6db42ef2fa591a8beb/groups/90987c82007d4137a9bbb9ad29ed9dc7/roles/25c010d52a5e4f61ad19bae8ccddf54b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:10.948017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30192178-a3e0-4220-9a08-5414452399d8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=1bf9df0161c04f6db42ef2fa591a8beb, group_id=90987c82007d4137a9bbb9ad29ed9dc7, role_id=25c010d52a5e4f61ad19bae8ccddf54b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:10.949656 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-30192178-a3e0-4220-9a08-5414452399d8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:10.949656 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:24:10.949656 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:24:10.952214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30192178-a3e0-4220-9a08-5414452399d8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:10.959851 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1897/3816] 10.222.0.39 () {58 vars in 1465 bytes} [Sun Aug 7 01:24:10 2022] HEAD /identity/v3/domains/1bf9df0161c04f6db42ef2fa591a8beb/groups/90987c82007d4137a9bbb9ad29ed9dc7/roles/25c010d52a5e4f61ad19bae8ccddf54b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:10.964793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e3e04-a023-418e-9145-6fe80377c27e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:10.975877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e3e04-a023-418e-9145-6fe80377c27e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:10.987855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c362e-95f0-493f-ac87-10cd4b095824 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:10.988737 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c362e-95f0-493f-ac87-10cd4b095824 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:10.989117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c362e-95f0-493f-ac87-10cd4b095824 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:10.989548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c362e-95f0-493f-ac87-10cd4b095824 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/domains/1bf9df0161c04f6db42ef2fa591a8beb/groups/90987c82007d4137a9bbb9ad29ed9dc7/roles/25c010d52a5e4f61ad19bae8ccddf54b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:10.993731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c362e-95f0-493f-ac87-10cd4b095824 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=1bf9df0161c04f6db42ef2fa591a8beb, group_id=90987c82007d4137a9bbb9ad29ed9dc7, role_id=25c010d52a5e4f61ad19bae8ccddf54b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:10.994946 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-cd1c362e-95f0-493f-ac87-10cd4b095824 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:10.994946 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:24:10.994946 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:24:10.998491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c362e-95f0-493f-ac87-10cd4b095824 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:11.007378 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cd1c362e-95f0-493f-ac87-10cd4b095824 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invalidating the token cache because role 25c010d52a5e4f61ad19bae8ccddf54b was removed from group 90987c82007d4137a9bbb9ad29ed9dc7 on domain 1bf9df0161c04f6db42ef2fa591a8beb. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:11.007814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cd1c362e-95f0-493f-ac87-10cd4b095824 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:11.009518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cd1c362e-95f0-493f-ac87-10cd4b095824 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:11.043855 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1920/3817] 10.222.0.39 () {58 vars in 1467 bytes} [Sun Aug 7 01:24:10 2022] DELETE /identity/v3/domains/1bf9df0161c04f6db42ef2fa591a8beb/groups/90987c82007d4137a9bbb9ad29ed9dc7/roles/25c010d52a5e4f61ad19bae8ccddf54b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:11.050734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30192178-a3e0-4220-9a08-5414452399d8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:11.054736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-30192178-a3e0-4220-9a08-5414452399d8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:11.093129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30192178-a3e0-4220-9a08-5414452399d8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:11.183638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572ec0b-9fc8-4599-9458-75b5ab156131 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:11.184731 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572ec0b-9fc8-4599-9458-75b5ab156131 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:11.184731 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572ec0b-9fc8-4599-9458-75b5ab156131 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:11.184942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6572ec0b-9fc8-4599-9458-75b5ab156131 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/projects/ef724d39524643378e66c5c9b0b26a1b/groups/90987c82007d4137a9bbb9ad29ed9dc7/roles/25c010d52a5e4f61ad19bae8ccddf54b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:11.188030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572ec0b-9fc8-4599-9458-75b5ab156131 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ef724d39524643378e66c5c9b0b26a1b, group_id=90987c82007d4137a9bbb9ad29ed9dc7, role_id=25c010d52a5e4f61ad19bae8ccddf54b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:11.191834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6572ec0b-9fc8-4599-9458-75b5ab156131 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:11.216257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c362e-95f0-493f-ac87-10cd4b095824 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:11.217166 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1898/3818] 10.222.0.39 () {60 vars in 1486 bytes} [Sun Aug 7 01:24:11 2022] PUT /identity/v3/projects/ef724d39524643378e66c5c9b0b26a1b/groups/90987c82007d4137a9bbb9ad29ed9dc7/roles/25c010d52a5e4f61ad19bae8ccddf54b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:11.228837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c362e-95f0-493f-ac87-10cd4b095824 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:11.328328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53aefe-8762-417c-bbf0-396040998068 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:11.329043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53aefe-8762-417c-bbf0-396040998068 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:11.330857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53aefe-8762-417c-bbf0-396040998068 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:11.330857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53aefe-8762-417c-bbf0-396040998068 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/projects/ef724d39524643378e66c5c9b0b26a1b/groups/90987c82007d4137a9bbb9ad29ed9dc7/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:11.331562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53aefe-8762-417c-bbf0-396040998068 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:list_grants(project_id=ef724d39524643378e66c5c9b0b26a1b, group_id=90987c82007d4137a9bbb9ad29ed9dc7)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:11.334412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53aefe-8762-417c-bbf0-396040998068 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:11.358894 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572ec0b-9fc8-4599-9458-75b5ab156131 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:11.360707 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1921/3819] 10.222.0.39 () {58 vars in 1368 bytes} [Sun Aug 7 01:24:11 2022] GET /identity/v3/projects/ef724d39524643378e66c5c9b0b26a1b/groups/90987c82007d4137a9bbb9ad29ed9dc7/roles => generated 411 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:24:11.371947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6572ec0b-9fc8-4599-9458-75b5ab156131 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:11.380619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6ee4e-ff49-4f03-bd74-a741c87f48e8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:11.382172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6ee4e-ff49-4f03-bd74-a741c87f48e8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:11.382472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6ee4e-ff49-4f03-bd74-a741c87f48e8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:11.383291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6ee4e-ff49-4f03-bd74-a741c87f48e8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/groups/90987c82007d4137a9bbb9ad29ed9dc7/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:11.385173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6ee4e-ff49-4f03-bd74-a741c87f48e8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=90987c82007d4137a9bbb9ad29ed9dc7, user_id=626eb5b1cb2a4cdeb1cc2fb80f591a7e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:11.386406 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-cef6ee4e-ff49-4f03-bd74-a741c87f48e8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:11.386406 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:24:11.386406 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:24:11.387722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6ee4e-ff49-4f03-bd74-a741c87f48e8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:11.450568 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1899/3820] 10.222.0.39 () {60 vars in 1360 bytes} [Sun Aug 7 01:24:11 2022] PUT /identity/v3/groups/90987c82007d4137a9bbb9ad29ed9dc7/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:11.455244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d24b4f-3c1b-4525-89c0-c31c4f64aa91 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:11.455532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d24b4f-3c1b-4525-89c0-c31c4f64aa91 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:11.456113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d24b4f-3c1b-4525-89c0-c31c4f64aa91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:11.533024 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:11.550201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-20d24b4f-3c1b-4525-89c0-c31c4f64aa91 None None] MFA Rules not processed for user `626eb5b1cb2a4cdeb1cc2fb80f591a7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:11.560765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-20d24b4f-3c1b-4525-89c0-c31c4f64aa91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:11.895503 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6ee4e-ff49-4f03-bd74-a741c87f48e8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:11.896205 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1922/3821] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:11.904932 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:12.044676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6ee4e-ff49-4f03-bd74-a741c87f48e8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:12.062275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2740e8-2154-475a-a3e1-81715b23f645 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:12.063112 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2740e8-2154-475a-a3e1-81715b23f645 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:12.063271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2740e8-2154-475a-a3e1-81715b23f645 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:12.063551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2740e8-2154-475a-a3e1-81715b23f645 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/projects/ef724d39524643378e66c5c9b0b26a1b/groups/90987c82007d4137a9bbb9ad29ed9dc7/roles/25c010d52a5e4f61ad19bae8ccddf54b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:12.066496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2740e8-2154-475a-a3e1-81715b23f645 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:check_grant(project_id=ef724d39524643378e66c5c9b0b26a1b, group_id=90987c82007d4137a9bbb9ad29ed9dc7, role_id=25c010d52a5e4f61ad19bae8ccddf54b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:12.069506 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2740e8-2154-475a-a3e1-81715b23f645 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:12.081030 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1900/3822] 10.222.0.39 () {58 vars in 1468 bytes} [Sun Aug 7 01:24:11 2022] HEAD /identity/v3/projects/ef724d39524643378e66c5c9b0b26a1b/groups/90987c82007d4137a9bbb9ad29ed9dc7/roles/25c010d52a5e4f61ad19bae8ccddf54b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:12.085665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d24b4f-3c1b-4525-89c0-c31c4f64aa91 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:12.103663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d24b4f-3c1b-4525-89c0-c31c4f64aa91 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:12.111942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed366e-85ad-4c37-8c5f-167f098a588e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:12.113138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed366e-85ad-4c37-8c5f-167f098a588e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:12.113594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed366e-85ad-4c37-8c5f-167f098a588e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:12.113884 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed366e-85ad-4c37-8c5f-167f098a588e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/projects/ef724d39524643378e66c5c9b0b26a1b/groups/90987c82007d4137a9bbb9ad29ed9dc7/roles/25c010d52a5e4f61ad19bae8ccddf54b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:12.119257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed366e-85ad-4c37-8c5f-167f098a588e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=ef724d39524643378e66c5c9b0b26a1b, group_id=90987c82007d4137a9bbb9ad29ed9dc7, role_id=25c010d52a5e4f61ad19bae8ccddf54b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:12.125422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed366e-85ad-4c37-8c5f-167f098a588e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:12.138490 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-95ed366e-85ad-4c37-8c5f-167f098a588e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invalidating the token cache because role 25c010d52a5e4f61ad19bae8ccddf54b was removed from group 90987c82007d4137a9bbb9ad29ed9dc7 on project ef724d39524643378e66c5c9b0b26a1b. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:12.138780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-95ed366e-85ad-4c37-8c5f-167f098a588e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:12.139557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-95ed366e-85ad-4c37-8c5f-167f098a588e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:12.167796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2740e8-2154-475a-a3e1-81715b23f645 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:12.169236 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1923/3823] 10.222.0.39 () {58 vars in 1470 bytes} [Sun Aug 7 01:24:12 2022] DELETE /identity/v3/projects/ef724d39524643378e66c5c9b0b26a1b/groups/90987c82007d4137a9bbb9ad29ed9dc7/roles/25c010d52a5e4f61ad19bae8ccddf54b => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:12.170019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9e2740e8-2154-475a-a3e1-81715b23f645 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:12.189200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2740e8-2154-475a-a3e1-81715b23f645 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:12.327089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfecc23-fb89-490a-a69f-64a41a1eed2d tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:12.328395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfecc23-fb89-490a-a69f-64a41a1eed2d tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:12.328696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfecc23-fb89-490a-a69f-64a41a1eed2d tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:12.329107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfecc23-fb89-490a-a69f-64a41a1eed2d tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/groups/90987c82007d4137a9bbb9ad29ed9dc7/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:12.333108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfecc23-fb89-490a-a69f-64a41a1eed2d tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=90987c82007d4137a9bbb9ad29ed9dc7, user_id=626eb5b1cb2a4cdeb1cc2fb80f591a7e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:12.334160 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-7bfecc23-fb89-490a-a69f-64a41a1eed2d tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:12.334160 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:24:12.334160 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:24:12.335350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfecc23-fb89-490a-a69f-64a41a1eed2d tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:12.366721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7bfecc23-fb89-490a-a69f-64a41a1eed2d tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '626eb5b1cb2a4cdeb1cc2fb80f591a7e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:12.392546 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1901/3824] 10.222.0.39 () {58 vars in 1344 bytes} [Sun Aug 7 01:24:12 2022] DELETE /identity/v3/groups/90987c82007d4137a9bbb9ad29ed9dc7/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:12.393850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed366e-85ad-4c37-8c5f-167f098a588e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:12.412586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed366e-85ad-4c37-8c5f-167f098a588e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:12.557342 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba632874-39a1-4137-8915-b4d0da7e280a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:12.558978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba632874-39a1-4137-8915-b4d0da7e280a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:12.559416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba632874-39a1-4137-8915-b4d0da7e280a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:12.559843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba632874-39a1-4137-8915-b4d0da7e280a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/system/groups/90987c82007d4137a9bbb9ad29ed9dc7/roles/25c010d52a5e4f61ad19bae8ccddf54b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:12.569931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba632874-39a1-4137-8915-b4d0da7e280a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=90987c82007d4137a9bbb9ad29ed9dc7, role_id=25c010d52a5e4f61ad19bae8ccddf54b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:12.571536 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-ba632874-39a1-4137-8915-b4d0da7e280a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:12.571536 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:24:12.571536 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:24:12.577686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba632874-39a1-4137-8915-b4d0da7e280a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:12.604361 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1924/3825] 10.222.0.39 () {60 vars in 1381 bytes} [Sun Aug 7 01:24:12 2022] PUT /identity/v3/system/groups/90987c82007d4137a9bbb9ad29ed9dc7/roles/25c010d52a5e4f61ad19bae8ccddf54b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:12.608506 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfecc23-fb89-490a-a69f-64a41a1eed2d tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:12.630067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfecc23-fb89-490a-a69f-64a41a1eed2d tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:12.640033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3b19d-8829-4617-ad3a-c1b2dcdd3f3c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:12.645611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3b19d-8829-4617-ad3a-c1b2dcdd3f3c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:12.645611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3b19d-8829-4617-ad3a-c1b2dcdd3f3c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:12.645611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3b19d-8829-4617-ad3a-c1b2dcdd3f3c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/system/groups/90987c82007d4137a9bbb9ad29ed9dc7/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:12.645611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3b19d-8829-4617-ad3a-c1b2dcdd3f3c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=90987c82007d4137a9bbb9ad29ed9dc7)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:12.649136 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-98a3b19d-8829-4617-ad3a-c1b2dcdd3f3c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:12.649136 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:24:12.649136 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:24:12.653514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3b19d-8829-4617-ad3a-c1b2dcdd3f3c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:12.696465 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1902/3826] 10.222.0.39 () {58 vars in 1263 bytes} [Sun Aug 7 01:24:12 2022] GET /identity/v3/system/groups/90987c82007d4137a9bbb9ad29ed9dc7/roles => generated 376 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:24:12.697764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba632874-39a1-4137-8915-b4d0da7e280a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:12.714916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba632874-39a1-4137-8915-b4d0da7e280a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:12.728332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1fcc60-4ec7-43d3-85f2-fd358fe85d2a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:12.729533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fcc60-4ec7-43d3-85f2-fd358fe85d2a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:12.729983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fcc60-4ec7-43d3-85f2-fd358fe85d2a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:12.730401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fcc60-4ec7-43d3-85f2-fd358fe85d2a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/system/groups/90987c82007d4137a9bbb9ad29ed9dc7/roles/25c010d52a5e4f61ad19bae8ccddf54b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:12.733666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1fcc60-4ec7-43d3-85f2-fd358fe85d2a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=90987c82007d4137a9bbb9ad29ed9dc7, role_id=25c010d52a5e4f61ad19bae8ccddf54b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:12.735123 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-bc1fcc60-4ec7-43d3-85f2-fd358fe85d2a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:12.735123 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:24:12.735123 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:24:12.737334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1fcc60-4ec7-43d3-85f2-fd358fe85d2a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:12.749955 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1925/3827] 10.222.0.39 () {58 vars in 1363 bytes} [Sun Aug 7 01:24:12 2022] HEAD /identity/v3/system/groups/90987c82007d4137a9bbb9ad29ed9dc7/roles/25c010d52a5e4f61ad19bae8ccddf54b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:12.754104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3b19d-8829-4617-ad3a-c1b2dcdd3f3c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:12.771239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3b19d-8829-4617-ad3a-c1b2dcdd3f3c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:12.777046 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4d3c0-5cd9-475c-a6a8-d886a0648f21 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:12.777780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4d3c0-5cd9-475c-a6a8-d886a0648f21 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:12.778070 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4d3c0-5cd9-475c-a6a8-d886a0648f21 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:12.778352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4d3c0-5cd9-475c-a6a8-d886a0648f21 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/system/groups/90987c82007d4137a9bbb9ad29ed9dc7/roles/25c010d52a5e4f61ad19bae8ccddf54b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:12.782316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4d3c0-5cd9-475c-a6a8-d886a0648f21 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=90987c82007d4137a9bbb9ad29ed9dc7, role_id=25c010d52a5e4f61ad19bae8ccddf54b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:12.783383 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-efc4d3c0-5cd9-475c-a6a8-d886a0648f21 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:12.783383 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:24:12.783383 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:24:12.784700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4d3c0-5cd9-475c-a6a8-d886a0648f21 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:12.808479 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1903/3828] 10.222.0.39 () {58 vars in 1365 bytes} [Sun Aug 7 01:24:12 2022] DELETE /identity/v3/system/groups/90987c82007d4137a9bbb9ad29ed9dc7/roles/25c010d52a5e4f61ad19bae8ccddf54b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:12.809316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1fcc60-4ec7-43d3-85f2-fd358fe85d2a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:12.828607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1fcc60-4ec7-43d3-85f2-fd358fe85d2a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:12.842768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f67317-ebee-4245-9946-9914608130c5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:12.843473 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f67317-ebee-4245-9946-9914608130c5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:12.843758 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f67317-ebee-4245-9946-9914608130c5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:12.844064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f67317-ebee-4245-9946-9914608130c5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/domains/1bf9df0161c04f6db42ef2fa591a8beb/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e/roles/25c010d52a5e4f61ad19bae8ccddf54b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:12.846467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f67317-ebee-4245-9946-9914608130c5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=1bf9df0161c04f6db42ef2fa591a8beb, user_id=626eb5b1cb2a4cdeb1cc2fb80f591a7e, role_id=25c010d52a5e4f61ad19bae8ccddf54b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:12.849320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f67317-ebee-4245-9946-9914608130c5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:12.880967 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4d3c0-5cd9-475c-a6a8-d886a0648f21 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:12.889798 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1926/3829] 10.222.0.39 () {60 vars in 1480 bytes} [Sun Aug 7 01:24:12 2022] PUT /identity/v3/domains/1bf9df0161c04f6db42ef2fa591a8beb/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e/roles/25c010d52a5e4f61ad19bae8ccddf54b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:12.898240 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4d3c0-5cd9-475c-a6a8-d886a0648f21 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:13.048139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639e256-4740-41a0-b482-f1b819c9bd09 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:13.049014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639e256-4740-41a0-b482-f1b819c9bd09 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:13.049460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639e256-4740-41a0-b482-f1b819c9bd09 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:13.049869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639e256-4740-41a0-b482-f1b819c9bd09 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/domains/1bf9df0161c04f6db42ef2fa591a8beb/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:13.052438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639e256-4740-41a0-b482-f1b819c9bd09 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=1bf9df0161c04f6db42ef2fa591a8beb, user_id=626eb5b1cb2a4cdeb1cc2fb80f591a7e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:13.054316 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-3639e256-4740-41a0-b482-f1b819c9bd09 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:13.054316 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:24:13.054316 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:24:13.057061 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639e256-4740-41a0-b482-f1b819c9bd09 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:13.064804 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:13.082236 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1904/3830] 10.222.0.39 () {58 vars in 1362 bytes} [Sun Aug 7 01:24:12 2022] GET /identity/v3/domains/1bf9df0161c04f6db42ef2fa591a8beb/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e/roles => generated 409 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:24:13.086941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f67317-ebee-4245-9946-9914608130c5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:13.108469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f67317-ebee-4245-9946-9914608130c5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:13.116971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687325a-44ec-49c6-b343-1ac574195348 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:13.119847 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687325a-44ec-49c6-b343-1ac574195348 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:13.120344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687325a-44ec-49c6-b343-1ac574195348 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:13.120722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687325a-44ec-49c6-b343-1ac574195348 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/domains/1bf9df0161c04f6db42ef2fa591a8beb/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e/roles/25c010d52a5e4f61ad19bae8ccddf54b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:13.124958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687325a-44ec-49c6-b343-1ac574195348 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=1bf9df0161c04f6db42ef2fa591a8beb, user_id=626eb5b1cb2a4cdeb1cc2fb80f591a7e, role_id=25c010d52a5e4f61ad19bae8ccddf54b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:13.127202 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-7687325a-44ec-49c6-b343-1ac574195348 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:13.127202 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:24:13.127202 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:24:13.135471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687325a-44ec-49c6-b343-1ac574195348 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:13.174098 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1927/3831] 10.222.0.39 () {58 vars in 1462 bytes} [Sun Aug 7 01:24:13 2022] HEAD /identity/v3/domains/1bf9df0161c04f6db42ef2fa591a8beb/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e/roles/25c010d52a5e4f61ad19bae8ccddf54b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:24:13.178351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639e256-4740-41a0-b482-f1b819c9bd09 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:13.198934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639e256-4740-41a0-b482-f1b819c9bd09 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:13.216355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d3f6c-7bd6-46bc-ae43-5f4c47de853e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:13.217181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d3f6c-7bd6-46bc-ae43-5f4c47de853e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:13.217637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d3f6c-7bd6-46bc-ae43-5f4c47de853e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:13.218165 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d3f6c-7bd6-46bc-ae43-5f4c47de853e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/domains/1bf9df0161c04f6db42ef2fa591a8beb/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e/roles/25c010d52a5e4f61ad19bae8ccddf54b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:13.224017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d3f6c-7bd6-46bc-ae43-5f4c47de853e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=1bf9df0161c04f6db42ef2fa591a8beb, user_id=626eb5b1cb2a4cdeb1cc2fb80f591a7e, role_id=25c010d52a5e4f61ad19bae8ccddf54b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:13.230684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d3f6c-7bd6-46bc-ae43-5f4c47de853e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:13.252153 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-db7d3f6c-7bd6-46bc-ae43-5f4c47de853e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invalidating the token cache because role 25c010d52a5e4f61ad19bae8ccddf54b was removed from user 626eb5b1cb2a4cdeb1cc2fb80f591a7e on domain 1bf9df0161c04f6db42ef2fa591a8beb. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:13.252153 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-db7d3f6c-7bd6-46bc-ae43-5f4c47de853e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:13.265396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-db7d3f6c-7bd6-46bc-ae43-5f4c47de853e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:13.289576 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1905/3832] 10.222.0.39 () {58 vars in 1464 bytes} [Sun Aug 7 01:24:13 2022] DELETE /identity/v3/domains/1bf9df0161c04f6db42ef2fa591a8beb/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e/roles/25c010d52a5e4f61ad19bae8ccddf54b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:13.296718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687325a-44ec-49c6-b343-1ac574195348 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:13.300292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7687325a-44ec-49c6-b343-1ac574195348 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:13.318592 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687325a-44ec-49c6-b343-1ac574195348 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:13.358060 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:13.410905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf63d93-d556-4956-a846-bafc0b5cdc3a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:13.412038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf63d93-d556-4956-a846-bafc0b5cdc3a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:13.412542 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf63d93-d556-4956-a846-bafc0b5cdc3a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:13.413081 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf63d93-d556-4956-a846-bafc0b5cdc3a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/projects/ef724d39524643378e66c5c9b0b26a1b/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e/roles/25c010d52a5e4f61ad19bae8ccddf54b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:13.419901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf63d93-d556-4956-a846-bafc0b5cdc3a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ef724d39524643378e66c5c9b0b26a1b, user_id=626eb5b1cb2a4cdeb1cc2fb80f591a7e, role_id=25c010d52a5e4f61ad19bae8ccddf54b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:13.426857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf63d93-d556-4956-a846-bafc0b5cdc3a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:13.458916 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1928/3833] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:24:13 2022] PUT /identity/v3/projects/ef724d39524643378e66c5c9b0b26a1b/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e/roles/25c010d52a5e4f61ad19bae8ccddf54b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:24:13.463007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d3f6c-7bd6-46bc-ae43-5f4c47de853e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:13.482803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d3f6c-7bd6-46bc-ae43-5f4c47de853e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:13.590636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114bb11-92b7-4b50-b490-d4a945eb3945 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:13.591497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114bb11-92b7-4b50-b490-d4a945eb3945 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:13.591915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114bb11-92b7-4b50-b490-d4a945eb3945 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:13.592742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114bb11-92b7-4b50-b490-d4a945eb3945 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/projects/ef724d39524643378e66c5c9b0b26a1b/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:13.595940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114bb11-92b7-4b50-b490-d4a945eb3945 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:list_grants(project_id=ef724d39524643378e66c5c9b0b26a1b, user_id=626eb5b1cb2a4cdeb1cc2fb80f591a7e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:13.601124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114bb11-92b7-4b50-b490-d4a945eb3945 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:13.623354 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1906/3834] 10.222.0.39 () {58 vars in 1365 bytes} [Sun Aug 7 01:24:13 2022] GET /identity/v3/projects/ef724d39524643378e66c5c9b0b26a1b/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e/roles => generated 410 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:24:13.627385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf63d93-d556-4956-a846-bafc0b5cdc3a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:13.640737 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf63d93-d556-4956-a846-bafc0b5cdc3a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:13.646645 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180f695-ba59-4a53-9b9b-3453fbe15ffb tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:13.647331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180f695-ba59-4a53-9b9b-3453fbe15ffb tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:13.647616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180f695-ba59-4a53-9b9b-3453fbe15ffb tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:13.648192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180f695-ba59-4a53-9b9b-3453fbe15ffb tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/projects/ef724d39524643378e66c5c9b0b26a1b/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e/roles/25c010d52a5e4f61ad19bae8ccddf54b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:13.651061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180f695-ba59-4a53-9b9b-3453fbe15ffb tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:check_grant(project_id=ef724d39524643378e66c5c9b0b26a1b, user_id=626eb5b1cb2a4cdeb1cc2fb80f591a7e, role_id=25c010d52a5e4f61ad19bae8ccddf54b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:13.654253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180f695-ba59-4a53-9b9b-3453fbe15ffb tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:13.665785 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1929/3835] 10.222.0.39 () {58 vars in 1465 bytes} [Sun Aug 7 01:24:13 2022] HEAD /identity/v3/projects/ef724d39524643378e66c5c9b0b26a1b/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e/roles/25c010d52a5e4f61ad19bae8ccddf54b => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:13.670097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114bb11-92b7-4b50-b490-d4a945eb3945 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:13.681447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114bb11-92b7-4b50-b490-d4a945eb3945 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:13.686470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc111b2f-63ba-4b50-aa5c-b4f65257dcf2 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:13.687221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc111b2f-63ba-4b50-aa5c-b4f65257dcf2 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:13.687512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc111b2f-63ba-4b50-aa5c-b4f65257dcf2 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:13.687790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc111b2f-63ba-4b50-aa5c-b4f65257dcf2 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/projects/ef724d39524643378e66c5c9b0b26a1b/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e/roles/25c010d52a5e4f61ad19bae8ccddf54b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:13.690118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc111b2f-63ba-4b50-aa5c-b4f65257dcf2 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=ef724d39524643378e66c5c9b0b26a1b, user_id=626eb5b1cb2a4cdeb1cc2fb80f591a7e, role_id=25c010d52a5e4f61ad19bae8ccddf54b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:13.692876 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc111b2f-63ba-4b50-aa5c-b4f65257dcf2 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:13.702799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dc111b2f-63ba-4b50-aa5c-b4f65257dcf2 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invalidating the token cache because role 25c010d52a5e4f61ad19bae8ccddf54b was removed from user 626eb5b1cb2a4cdeb1cc2fb80f591a7e on project ef724d39524643378e66c5c9b0b26a1b. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:13.704225 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dc111b2f-63ba-4b50-aa5c-b4f65257dcf2 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:13.706097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dc111b2f-63ba-4b50-aa5c-b4f65257dcf2 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:13.736229 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1907/3836] 10.222.0.39 () {58 vars in 1467 bytes} [Sun Aug 7 01:24:13 2022] DELETE /identity/v3/projects/ef724d39524643378e66c5c9b0b26a1b/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e/roles/25c010d52a5e4f61ad19bae8ccddf54b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:13.744146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180f695-ba59-4a53-9b9b-3453fbe15ffb tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:13.746752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a180f695-ba59-4a53-9b9b-3453fbe15ffb tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:13.770087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180f695-ba59-4a53-9b9b-3453fbe15ffb tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:13.889764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a38afc-f69d-4d4b-ba58-57b675f40f7a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:13.890734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a38afc-f69d-4d4b-ba58-57b675f40f7a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:13.891301 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a38afc-f69d-4d4b-ba58-57b675f40f7a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:13.891741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a38afc-f69d-4d4b-ba58-57b675f40f7a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/system/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e/roles/25c010d52a5e4f61ad19bae8ccddf54b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:13.894128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a38afc-f69d-4d4b-ba58-57b675f40f7a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=626eb5b1cb2a4cdeb1cc2fb80f591a7e, role_id=25c010d52a5e4f61ad19bae8ccddf54b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:13.896198 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-71a38afc-f69d-4d4b-ba58-57b675f40f7a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:13.896198 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:24:13.896198 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:24:13.898291 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a38afc-f69d-4d4b-ba58-57b675f40f7a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:13.910092 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1930/3837] 10.222.0.39 () {60 vars in 1378 bytes} [Sun Aug 7 01:24:13 2022] PUT /identity/v3/system/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e/roles/25c010d52a5e4f61ad19bae8ccddf54b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:13.916101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc111b2f-63ba-4b50-aa5c-b4f65257dcf2 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:13.937376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc111b2f-63ba-4b50-aa5c-b4f65257dcf2 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:13.951116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f76263-2657-4b8d-acec-7599afe0fcf3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:13.953792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f76263-2657-4b8d-acec-7599afe0fcf3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:13.954084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f76263-2657-4b8d-acec-7599afe0fcf3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:13.955374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f76263-2657-4b8d-acec-7599afe0fcf3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/system/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:13.959377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f76263-2657-4b8d-acec-7599afe0fcf3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=626eb5b1cb2a4cdeb1cc2fb80f591a7e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:13.960452 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-e7f76263-2657-4b8d-acec-7599afe0fcf3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:13.960452 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:24:13.960452 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:24:13.962027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f76263-2657-4b8d-acec-7599afe0fcf3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:13.997721 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1908/3838] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Aug 7 01:24:13 2022] GET /identity/v3/system/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e/roles => generated 375 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:24:14.002015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a38afc-f69d-4d4b-ba58-57b675f40f7a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:14.014460 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a38afc-f69d-4d4b-ba58-57b675f40f7a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:14.020278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57577647-b397-4a11-8c7c-22cc32924c3e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:14.021388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57577647-b397-4a11-8c7c-22cc32924c3e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:14.021388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57577647-b397-4a11-8c7c-22cc32924c3e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:14.021608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57577647-b397-4a11-8c7c-22cc32924c3e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/system/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e/roles/25c010d52a5e4f61ad19bae8ccddf54b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:14.038920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57577647-b397-4a11-8c7c-22cc32924c3e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=626eb5b1cb2a4cdeb1cc2fb80f591a7e, role_id=25c010d52a5e4f61ad19bae8ccddf54b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:14.041373 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-57577647-b397-4a11-8c7c-22cc32924c3e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:14.041373 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:24:14.041373 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:24:14.044311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57577647-b397-4a11-8c7c-22cc32924c3e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:14.055181 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1931/3839] 10.222.0.39 () {58 vars in 1360 bytes} [Sun Aug 7 01:24:14 2022] HEAD /identity/v3/system/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e/roles/25c010d52a5e4f61ad19bae8ccddf54b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:14.059226 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f76263-2657-4b8d-acec-7599afe0fcf3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:14.074850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f76263-2657-4b8d-acec-7599afe0fcf3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:14.090247 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c88942-7210-4dd2-b8b2-c22c01e9d03c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:14.090928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c88942-7210-4dd2-b8b2-c22c01e9d03c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:14.092177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c88942-7210-4dd2-b8b2-c22c01e9d03c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:14.092177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c88942-7210-4dd2-b8b2-c22c01e9d03c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/system/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e/roles/25c010d52a5e4f61ad19bae8ccddf54b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:14.098027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c88942-7210-4dd2-b8b2-c22c01e9d03c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=626eb5b1cb2a4cdeb1cc2fb80f591a7e, role_id=25c010d52a5e4f61ad19bae8ccddf54b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:14.098984 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-21c88942-7210-4dd2-b8b2-c22c01e9d03c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:14.098984 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:24:14.098984 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:24:14.099968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c88942-7210-4dd2-b8b2-c22c01e9d03c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:14.111193 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1909/3840] 10.222.0.39 () {58 vars in 1362 bytes} [Sun Aug 7 01:24:14 2022] DELETE /identity/v3/system/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e/roles/25c010d52a5e4f61ad19bae8ccddf54b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:14.119842 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57577647-b397-4a11-8c7c-22cc32924c3e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:14.131531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57577647-b397-4a11-8c7c-22cc32924c3e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:14.139171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544480e8-9e53-4c5f-b4a6-ca81cf6fcdee tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:14.140205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544480e8-9e53-4c5f-b4a6-ca81cf6fcdee tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:14.140719 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544480e8-9e53-4c5f-b4a6-ca81cf6fcdee tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:14.141218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544480e8-9e53-4c5f-b4a6-ca81cf6fcdee tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:14.142133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544480e8-9e53-4c5f-b4a6-ca81cf6fcdee tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:14.144347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544480e8-9e53-4c5f-b4a6-ca81cf6fcdee tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:14.183025 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1932/3841] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:24:14 2022] POST /identity/v3/roles => generated 270 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:14.188266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c88942-7210-4dd2-b8b2-c22c01e9d03c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:14.204820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c88942-7210-4dd2-b8b2-c22c01e9d03c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:14.213376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83019f-fdbb-4267-be9e-5b7cb961fbe6 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:14.214247 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83019f-fdbb-4267-be9e-5b7cb961fbe6 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:14.214658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83019f-fdbb-4267-be9e-5b7cb961fbe6 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:14.215154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83019f-fdbb-4267-be9e-5b7cb961fbe6 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:14.215923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83019f-fdbb-4267-be9e-5b7cb961fbe6 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:14.218077 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-ed83019f-fdbb-4267-be9e-5b7cb961fbe6 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:14.218077 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:24:14.218077 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:24:14.219472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83019f-fdbb-4267-be9e-5b7cb961fbe6 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:14.272923 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1910/3842] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:24:14 2022] POST /identity/v3/roles => generated 269 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:14.278257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544480e8-9e53-4c5f-b4a6-ca81cf6fcdee tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:14.299729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544480e8-9e53-4c5f-b4a6-ca81cf6fcdee tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:14.318401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5ed33-eabd-4760-97c2-dd1bb6727fd0 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:14.319378 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5ed33-eabd-4760-97c2-dd1bb6727fd0 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:14.319817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5ed33-eabd-4760-97c2-dd1bb6727fd0 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:14.320317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5ed33-eabd-4760-97c2-dd1bb6727fd0 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/a813c8d7acbc47b7a67f887d96e56fed/implies/599f21c3d722430288303e6407124140` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:14.324422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5ed33-eabd-4760-97c2-dd1bb6727fd0 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=a813c8d7acbc47b7a67f887d96e56fed, implied_role_id=599f21c3d722430288303e6407124140)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:14.326282 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5ed33-eabd-4760-97c2-dd1bb6727fd0 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:14.378977 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1933/3843] 10.222.0.39 () {60 vars in 1363 bytes} [Sun Aug 7 01:24:14 2022] PUT /identity/v3/roles/a813c8d7acbc47b7a67f887d96e56fed/implies/599f21c3d722430288303e6407124140 => generated 530 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:14.381936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83019f-fdbb-4267-be9e-5b7cb961fbe6 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:14.410055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83019f-fdbb-4267-be9e-5b7cb961fbe6 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:14.582636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca1d22-c90f-4e84-abbf-c4679246432c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:14.583318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca1d22-c90f-4e84-abbf-c4679246432c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:14.583674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca1d22-c90f-4e84-abbf-c4679246432c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:14.584044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca1d22-c90f-4e84-abbf-c4679246432c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:14.584745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca1d22-c90f-4e84-abbf-c4679246432c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:14.587792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca1d22-c90f-4e84-abbf-c4679246432c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:14.648715 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1911/3844] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Aug 7 01:24:14 2022] POST /identity/v3/domains => generated 275 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:14.649613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5ed33-eabd-4760-97c2-dd1bb6727fd0 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:14.663423 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5ed33-eabd-4760-97c2-dd1bb6727fd0 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:14.828630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bbe75-1182-49d2-a31c-64a6cbabc6d3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:14.829476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bbe75-1182-49d2-a31c-64a6cbabc6d3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:14.829761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bbe75-1182-49d2-a31c-64a6cbabc6d3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:14.830191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bbe75-1182-49d2-a31c-64a6cbabc6d3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:14.830971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bbe75-1182-49d2-a31c-64a6cbabc6d3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:14.838161 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bbe75-1182-49d2-a31c-64a6cbabc6d3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:14.844975 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:14.878131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca1d22-c90f-4e84-abbf-c4679246432c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:14.889681 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1934/3845] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:24:14 2022] POST /identity/v3/roles => generated 269 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:14.893914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca1d22-c90f-4e84-abbf-c4679246432c tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:14.930090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2ec8c-8a03-4bf7-8110-e5ce771b2862 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:14.930808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2ec8c-8a03-4bf7-8110-e5ce771b2862 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:14.931099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2ec8c-8a03-4bf7-8110-e5ce771b2862 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:14.933644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2ec8c-8a03-4bf7-8110-e5ce771b2862 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/a813c8d7acbc47b7a67f887d96e56fed/implies/9cd6ca0452bb44c6859ac600b26de62c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:14.939650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2ec8c-8a03-4bf7-8110-e5ce771b2862 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=a813c8d7acbc47b7a67f887d96e56fed, implied_role_id=9cd6ca0452bb44c6859ac600b26de62c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:14.943015 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-3dd2ec8c-8a03-4bf7-8110-e5ce771b2862 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:14.943015 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:24:14.943015 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:24:14.943992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2ec8c-8a03-4bf7-8110-e5ce771b2862 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:14.951436 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:15.063420 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1912/3846] 10.222.0.39 () {60 vars in 1363 bytes} [Sun Aug 7 01:24:14 2022] PUT /identity/v3/roles/a813c8d7acbc47b7a67f887d96e56fed/implies/9cd6ca0452bb44c6859ac600b26de62c => generated 530 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:15.067790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bbe75-1182-49d2-a31c-64a6cbabc6d3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:15.096082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bbe75-1182-49d2-a31c-64a6cbabc6d3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:15.189872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2ec8c-8a03-4bf7-8110-e5ce771b2862 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:15.192590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3dd2ec8c-8a03-4bf7-8110-e5ce771b2862 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:15.373261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84bb0d-6b59-4345-a0f5-2eca4adf0378 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:15.373800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84bb0d-6b59-4345-a0f5-2eca4adf0378 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:15.374087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84bb0d-6b59-4345-a0f5-2eca4adf0378 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:15.374501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84bb0d-6b59-4345-a0f5-2eca4adf0378 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/a813c8d7acbc47b7a67f887d96e56fed/implies/25c010d52a5e4f61ad19bae8ccddf54b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:15.379052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b84bb0d-6b59-4345-a0f5-2eca4adf0378 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=a813c8d7acbc47b7a67f887d96e56fed, implied_role_id=25c010d52a5e4f61ad19bae8ccddf54b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:15.388571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b84bb0d-6b59-4345-a0f5-2eca4adf0378 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:15.471379 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1935/3847] 10.222.0.39 () {60 vars in 1363 bytes} [Sun Aug 7 01:24:15 2022] PUT /identity/v3/roles/a813c8d7acbc47b7a67f887d96e56fed/implies/25c010d52a5e4f61ad19bae8ccddf54b => generated 526 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:15.473098 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84bb0d-6b59-4345-a0f5-2eca4adf0378 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:15.491813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2ec8c-8a03-4bf7-8110-e5ce771b2862 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:15.656326 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d33bf-c1d5-4fcd-8548-d9293121b05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:15.657137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d33bf-c1d5-4fcd-8548-d9293121b05c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:15.657417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d33bf-c1d5-4fcd-8548-d9293121b05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:15.657747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d33bf-c1d5-4fcd-8548-d9293121b05c admin admin] PATH_INFO: `/v3/users/51ab58be25a94cd6a59634e7c7cad158` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:15.659413 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d33bf-c1d5-4fcd-8548-d9293121b05c admin admin] RBAC: Authorizing `identity:delete_user(user_id=51ab58be25a94cd6a59634e7c7cad158)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:15.665129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d33bf-c1d5-4fcd-8548-d9293121b05c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:15.676477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84bb0d-6b59-4345-a0f5-2eca4adf0378 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:15.689874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652339c-a67f-4fb8-9b9f-d4d8b19fefca tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:15.690577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652339c-a67f-4fb8-9b9f-d4d8b19fefca tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:15.692116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652339c-a67f-4fb8-9b9f-d4d8b19fefca tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:15.692422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652339c-a67f-4fb8-9b9f-d4d8b19fefca tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/25c010d52a5e4f61ad19bae8ccddf54b/implies/a813c8d7acbc47b7a67f887d96e56fed` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:15.713189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652339c-a67f-4fb8-9b9f-d4d8b19fefca tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=25c010d52a5e4f61ad19bae8ccddf54b, implied_role_id=a813c8d7acbc47b7a67f887d96e56fed)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:15.715607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652339c-a67f-4fb8-9b9f-d4d8b19fefca tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:15.755640 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-f652339c-a67f-4fb8-9b9f-d4d8b19fefca tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] a813c8d7acbc47b7a67f887d96e56fed cannot be an implied roles.: keystone.exception.InvalidImpliedRole: a813c8d7acbc47b7a67f887d96e56fed cannot be an implied roles. Aug 07 01:24:15.755640 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:24:15.755640 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:24:15.755640 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:24:15.755640 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:24:15.755640 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:24:15.755640 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:24:15.755640 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:24:15.755640 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:24:15.755640 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:24:15.755640 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:24:15.755640 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:24:15.755640 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Aug 07 01:24:15.755640 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Aug 07 01:24:15.756996 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:24:15.756996 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:24:15.756996 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Aug 07 01:24:15.756996 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Aug 07 01:24:15.756996 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: a813c8d7acbc47b7a67f887d96e56fed cannot be an implied roles. Aug 07 01:24:15.756996 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:24:15.764376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-216d33bf-c1d5-4fcd-8548-d9293121b05c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51ab58be25a94cd6a59634e7c7cad158'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:15.764674 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1936/3848] 10.222.0.39 () {60 vars in 1363 bytes} [Sun Aug 7 01:24:15 2022] PUT /identity/v3/roles/25c010d52a5e4f61ad19bae8ccddf54b/implies/a813c8d7acbc47b7a67f887d96e56fed => generated 116 bytes in 292 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:24:15.769181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652339c-a67f-4fb8-9b9f-d4d8b19fefca tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:15.784961 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-216d33bf-c1d5-4fcd-8548-d9293121b05c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51ab58be25a94cd6a59634e7c7cad158'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:15.796874 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:15.798107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652339c-a67f-4fb8-9b9f-d4d8b19fefca tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:15.811484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150bdb08-f536-4655-9f13-2ac511587f18 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:15.814312 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bdb08-f536-4655-9f13-2ac511587f18 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:15.816237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bdb08-f536-4655-9f13-2ac511587f18 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:15.816759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bdb08-f536-4655-9f13-2ac511587f18 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/a813c8d7acbc47b7a67f887d96e56fed/implies/25c010d52a5e4f61ad19bae8ccddf54b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:15.821406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150bdb08-f536-4655-9f13-2ac511587f18 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=a813c8d7acbc47b7a67f887d96e56fed, implied_role_id=25c010d52a5e4f61ad19bae8ccddf54b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:15.823367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150bdb08-f536-4655-9f13-2ac511587f18 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:15.824534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-216d33bf-c1d5-4fcd-8548-d9293121b05c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51ab58be25a94cd6a59634e7c7cad158'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:15.825439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-216d33bf-c1d5-4fcd-8548-d9293121b05c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51ab58be25a94cd6a59634e7c7cad158'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:15.842932 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1937/3849] 10.222.0.39 () {58 vars in 1347 bytes} [Sun Aug 7 01:24:15 2022] DELETE /identity/v3/roles/a813c8d7acbc47b7a67f887d96e56fed/implies/25c010d52a5e4f61ad19bae8ccddf54b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:15.847021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150bdb08-f536-4655-9f13-2ac511587f18 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:15.851200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-216d33bf-c1d5-4fcd-8548-d9293121b05c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51ab58be25a94cd6a59634e7c7cad158'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:15.866038 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1913/3850] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:24:15 2022] DELETE /identity/v3/users/51ab58be25a94cd6a59634e7c7cad158 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:24:16.011270 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:16.020904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150bdb08-f536-4655-9f13-2ac511587f18 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:16.144086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2119924-4bbb-486e-9c6d-a4ec126c197b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:16.147423 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2119924-4bbb-486e-9c6d-a4ec126c197b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:16.148222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2119924-4bbb-486e-9c6d-a4ec126c197b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:16.149074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2119924-4bbb-486e-9c6d-a4ec126c197b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/a813c8d7acbc47b7a67f887d96e56fed/implies/9cd6ca0452bb44c6859ac600b26de62c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:16.157734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2119924-4bbb-486e-9c6d-a4ec126c197b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=a813c8d7acbc47b7a67f887d96e56fed, implied_role_id=9cd6ca0452bb44c6859ac600b26de62c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:16.159121 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2119924-4bbb-486e-9c6d-a4ec126c197b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:16.181619 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1938/3851] 10.222.0.39 () {58 vars in 1347 bytes} [Sun Aug 7 01:24:15 2022] DELETE /identity/v3/roles/a813c8d7acbc47b7a67f887d96e56fed/implies/9cd6ca0452bb44c6859ac600b26de62c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:24:16.185330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d33bf-c1d5-4fcd-8548-d9293121b05c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:16.186907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-216d33bf-c1d5-4fcd-8548-d9293121b05c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:16.233727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d33bf-c1d5-4fcd-8548-d9293121b05c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:16.338224 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e5902-2884-441d-bb7a-2809e4b81a56 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:16.339389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e5902-2884-441d-bb7a-2809e4b81a56 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:16.340038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e5902-2884-441d-bb7a-2809e4b81a56 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:16.340536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e5902-2884-441d-bb7a-2809e4b81a56 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/9cd6ca0452bb44c6859ac600b26de62c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:16.343192 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e5902-2884-441d-bb7a-2809e4b81a56 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=9cd6ca0452bb44c6859ac600b26de62c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:16.344838 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-4e6e5902-2884-441d-bb7a-2809e4b81a56 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:16.344838 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:24:16.344838 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:24:16.346391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e5902-2884-441d-bb7a-2809e4b81a56 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:16.425722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4e6e5902-2884-441d-bb7a-2809e4b81a56 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invalidating the token cache because role 9cd6ca0452bb44c6859ac600b26de62c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:16.426072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4e6e5902-2884-441d-bb7a-2809e4b81a56 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:16.427099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4e6e5902-2884-441d-bb7a-2809e4b81a56 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:16.429982 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1914/3852] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:24:16 2022] DELETE /identity/v3/roles/9cd6ca0452bb44c6859ac600b26de62c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:16.434172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2119924-4bbb-486e-9c6d-a4ec126c197b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:16.436855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f2119924-4bbb-486e-9c6d-a4ec126c197b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:16.459334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2119924-4bbb-486e-9c6d-a4ec126c197b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:16.596418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020bf79-5c66-4661-83ef-f99e58ccb65f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:16.598218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020bf79-5c66-4661-83ef-f99e58ccb65f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:16.598512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020bf79-5c66-4661-83ef-f99e58ccb65f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:16.599923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020bf79-5c66-4661-83ef-f99e58ccb65f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/domains/0e3ce9e52383439fa8f90b97e8a757be` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:16.626871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020bf79-5c66-4661-83ef-f99e58ccb65f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0e3ce9e52383439fa8f90b97e8a757be)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:16.629004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020bf79-5c66-4661-83ef-f99e58ccb65f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:16.666537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5020bf79-5c66-4661-83ef-f99e58ccb65f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0e3ce9e52383439fa8f90b97e8a757be'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:16.667311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5020bf79-5c66-4661-83ef-f99e58ccb65f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0e3ce9e52383439fa8f90b97e8a757be'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:16.685077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e5902-2884-441d-bb7a-2809e4b81a56 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:16.687506 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4e6e5902-2884-441d-bb7a-2809e4b81a56 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:16.727762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5020bf79-5c66-4661-83ef-f99e58ccb65f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0e3ce9e52383439fa8f90b97e8a757be'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:16.728766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5020bf79-5c66-4661-83ef-f99e58ccb65f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0e3ce9e52383439fa8f90b97e8a757be'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:16.737424 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1939/3853] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:24:16 2022] PATCH /identity/v3/domains/0e3ce9e52383439fa8f90b97e8a757be => generated 276 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:24:16.745495 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020bf79-5c66-4661-83ef-f99e58ccb65f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:16.747017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5020bf79-5c66-4661-83ef-f99e58ccb65f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:16.819691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e5902-2884-441d-bb7a-2809e4b81a56 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:16.958698 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:16.978723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020bf79-5c66-4661-83ef-f99e58ccb65f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:16.983932 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:16.995923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292d060-a584-44dd-a9dc-7288318fa4f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:16.996651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292d060-a584-44dd-a9dc-7288318fa4f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:16.996948 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292d060-a584-44dd-a9dc-7288318fa4f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:16.997214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292d060-a584-44dd-a9dc-7288318fa4f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/domains/0e3ce9e52383439fa8f90b97e8a757be` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:17.013846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f866457-80ff-4f85-ab98-bb2d7d75d241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:17.014646 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f866457-80ff-4f85-ab98-bb2d7d75d241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:17.014937 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f866457-80ff-4f85-ab98-bb2d7d75d241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:17.015215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f866457-80ff-4f85-ab98-bb2d7d75d241 admin admin] PATH_INFO: `/v3/projects/791ad97e3c374d2d8494abc25b46a0bf` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:17.019407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f866457-80ff-4f85-ab98-bb2d7d75d241 admin admin] RBAC: Authorizing `identity:delete_project(project_id=791ad97e3c374d2d8494abc25b46a0bf)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:17.022436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f866457-80ff-4f85-ab98-bb2d7d75d241 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:17.058520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292d060-a584-44dd-a9dc-7288318fa4f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0e3ce9e52383439fa8f90b97e8a757be)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:17.061723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292d060-a584-44dd-a9dc-7288318fa4f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:17.126755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9f866457-80ff-4f85-ab98-bb2d7d75d241 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '791ad97e3c374d2d8494abc25b46a0bf', 'request_id': 'req-9f866457-80ff-4f85-ab98-bb2d7d75d241'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:17.146138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9f866457-80ff-4f85-ab98-bb2d7d75d241 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '791ad97e3c374d2d8494abc25b46a0bf', 'request_id': 'req-9f866457-80ff-4f85-ab98-bb2d7d75d241'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:17.158949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9f866457-80ff-4f85-ab98-bb2d7d75d241 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '791ad97e3c374d2d8494abc25b46a0bf', 'request_id': 'req-9f866457-80ff-4f85-ab98-bb2d7d75d241'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:17.167213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e292d060-a584-44dd-a9dc-7288318fa4f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0e3ce9e52383439fa8f90b97e8a757be'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:17.183587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9f866457-80ff-4f85-ab98-bb2d7d75d241 admin admin] The token cache is being invalidate because project 791ad97e3c374d2d8494abc25b46a0bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:17.184249 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9f866457-80ff-4f85-ab98-bb2d7d75d241 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:17.185496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9f866457-80ff-4f85-ab98-bb2d7d75d241 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:17.192051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e292d060-a584-44dd-a9dc-7288318fa4f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0e3ce9e52383439fa8f90b97e8a757be'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:17.193265 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1915/3854] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:24:16 2022] DELETE /identity/v3/projects/791ad97e3c374d2d8494abc25b46a0bf => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:24:17.196199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871696a-a398-4e59-80a8-449a85e5f685 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:17.196762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871696a-a398-4e59-80a8-449a85e5f685 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:17.197230 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871696a-a398-4e59-80a8-449a85e5f685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:17.277916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e292d060-a584-44dd-a9dc-7288318fa4f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e3ce9e52383439fa8f90b97e8a757be', 'request_id': 'req-e292d060-a584-44dd-a9dc-7288318fa4f5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:17.292719 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e292d060-a584-44dd-a9dc-7288318fa4f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e3ce9e52383439fa8f90b97e8a757be', 'request_id': 'req-e292d060-a584-44dd-a9dc-7288318fa4f5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:17.302698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e292d060-a584-44dd-a9dc-7288318fa4f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e3ce9e52383439fa8f90b97e8a757be', 'request_id': 'req-e292d060-a584-44dd-a9dc-7288318fa4f5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:17.331095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e292d060-a584-44dd-a9dc-7288318fa4f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] The token cache is being invalidate because project 0e3ce9e52383439fa8f90b97e8a757be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:17.331459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e292d060-a584-44dd-a9dc-7288318fa4f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:17.336470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e292d060-a584-44dd-a9dc-7288318fa4f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:17.350314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e292d060-a584-44dd-a9dc-7288318fa4f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0e3ce9e52383439fa8f90b97e8a757be', 'request_id': 'req-e292d060-a584-44dd-a9dc-7288318fa4f5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:17.361220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e292d060-a584-44dd-a9dc-7288318fa4f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0e3ce9e52383439fa8f90b97e8a757be', 'request_id': 'req-e292d060-a584-44dd-a9dc-7288318fa4f5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:17.362143 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e292d060-a584-44dd-a9dc-7288318fa4f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0e3ce9e52383439fa8f90b97e8a757be', 'request_id': 'req-e292d060-a584-44dd-a9dc-7288318fa4f5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:17.378476 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1940/3855] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:24:16 2022] DELETE /identity/v3/domains/0e3ce9e52383439fa8f90b97e8a757be => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:17.379846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292d060-a584-44dd-a9dc-7288318fa4f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:17.380457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0871696a-a398-4e59-80a8-449a85e5f685 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:17.381312 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e292d060-a584-44dd-a9dc-7288318fa4f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:17.381698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0871696a-a398-4e59-80a8-449a85e5f685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:17.512817 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1916/3856] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:17.521750 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ad591-431e-43a9-9def-d44a4f9d5ffd None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:17.521982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ad591-431e-43a9-9def-d44a4f9d5ffd None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:17.532217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ad591-431e-43a9-9def-d44a4f9d5ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:17.532751 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292d060-a584-44dd-a9dc-7288318fa4f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:17.539530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e5bca-cdb8-44c4-8902-e3e350637d4f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:17.540241 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e5bca-cdb8-44c4-8902-e3e350637d4f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:17.540526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e5bca-cdb8-44c4-8902-e3e350637d4f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:17.541253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e5bca-cdb8-44c4-8902-e3e350637d4f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/a813c8d7acbc47b7a67f887d96e56fed/implies/599f21c3d722430288303e6407124140` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:17.543359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e5bca-cdb8-44c4-8902-e3e350637d4f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=a813c8d7acbc47b7a67f887d96e56fed, implied_role_id=599f21c3d722430288303e6407124140)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:17.546267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e5bca-cdb8-44c4-8902-e3e350637d4f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:17.566761 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1941/3857] 10.222.0.39 () {58 vars in 1347 bytes} [Sun Aug 7 01:24:17 2022] DELETE /identity/v3/roles/a813c8d7acbc47b7a67f887d96e56fed/implies/599f21c3d722430288303e6407124140 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:24:17.568024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e5bca-cdb8-44c4-8902-e3e350637d4f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:17.573205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0c8ad591-431e-43a9-9def-d44a4f9d5ffd None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:17.577090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0c8ad591-431e-43a9-9def-d44a4f9d5ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:17.682132 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:17.708243 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:17.731344 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1917/3858] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:17.733339 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ad591-431e-43a9-9def-d44a4f9d5ffd None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:17.742977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e5bca-cdb8-44c4-8902-e3e350637d4f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:17.745937 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ad591-431e-43a9-9def-d44a4f9d5ffd None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:17.752319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9d3b9-b507-4b5a-b9f3-d12756dbc1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:17.753381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9d3b9-b507-4b5a-b9f3-d12756dbc1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:17.754238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9d3b9-b507-4b5a-b9f3-d12756dbc1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:17.754930 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9d3b9-b507-4b5a-b9f3-d12756dbc1f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:17.755928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9d3b9-b507-4b5a-b9f3-d12756dbc1f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:24:17.756245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9d3b9-b507-4b5a-b9f3-d12756dbc1f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:17.759803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9d3b9-b507-4b5a-b9f3-d12756dbc1f8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:17.760966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a801a0e-92cc-45fc-8534-1150f61e325b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:17.761425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a801a0e-92cc-45fc-8534-1150f61e325b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:17.761708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a801a0e-92cc-45fc-8534-1150f61e325b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:17.761983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a801a0e-92cc-45fc-8534-1150f61e325b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/599f21c3d722430288303e6407124140` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:17.765675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a801a0e-92cc-45fc-8534-1150f61e325b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=599f21c3d722430288303e6407124140)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:17.767611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a801a0e-92cc-45fc-8534-1150f61e325b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:17.782566 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1918/3859] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:24:17.783647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9d3b9-b507-4b5a-b9f3-d12756dbc1f8 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:17.797956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9d3b9-b507-4b5a-b9f3-d12756dbc1f8 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:17.808611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617f54a-45a1-48a4-aa0d-974ea59b2527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:17.809249 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617f54a-45a1-48a4-aa0d-974ea59b2527 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:17.809534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617f54a-45a1-48a4-aa0d-974ea59b2527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:17.809806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617f54a-45a1-48a4-aa0d-974ea59b2527 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:17.810452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617f54a-45a1-48a4-aa0d-974ea59b2527 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:17.812863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617f54a-45a1-48a4-aa0d-974ea59b2527 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:17.837242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5a801a0e-92cc-45fc-8534-1150f61e325b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invalidating the token cache because role 599f21c3d722430288303e6407124140 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:17.837476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5a801a0e-92cc-45fc-8534-1150f61e325b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:17.838250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5a801a0e-92cc-45fc-8534-1150f61e325b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:17.842280 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1942/3860] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:24:17 2022] DELETE /identity/v3/roles/599f21c3d722430288303e6407124140 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:17.848391 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a801a0e-92cc-45fc-8534-1150f61e325b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:17.849949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5a801a0e-92cc-45fc-8534-1150f61e325b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:17.886185 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1919/3861] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:24:17 2022] POST /identity/v3/projects => generated 389 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:17.893497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617f54a-45a1-48a4-aa0d-974ea59b2527 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:17.895924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6617f54a-45a1-48a4-aa0d-974ea59b2527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:17.937493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a801a0e-92cc-45fc-8534-1150f61e325b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:18.000203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617f54a-45a1-48a4-aa0d-974ea59b2527 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:18.006729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67d251-067f-43c0-981c-7155fa86dfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:18.007663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67d251-067f-43c0-981c-7155fa86dfb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:18.008048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67d251-067f-43c0-981c-7155fa86dfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:18.008455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67d251-067f-43c0-981c-7155fa86dfb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:18.008921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97250419-995c-42ea-8ea8-18dd603f6432 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:18.009243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67d251-067f-43c0-981c-7155fa86dfb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:18.009720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97250419-995c-42ea-8ea8-18dd603f6432 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:18.010072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97250419-995c-42ea-8ea8-18dd603f6432 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:18.010414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97250419-995c-42ea-8ea8-18dd603f6432 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/a813c8d7acbc47b7a67f887d96e56fed` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:18.011626 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67d251-067f-43c0-981c-7155fa86dfb7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:18.011767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97250419-995c-42ea-8ea8-18dd603f6432 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=a813c8d7acbc47b7a67f887d96e56fed)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:18.013677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97250419-995c-42ea-8ea8-18dd603f6432 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:18.055716 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1920/3862] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:24:17 2022] POST /identity/v3/users => generated 295 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:18.058400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67d251-067f-43c0-981c-7155fa86dfb7 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:18.073987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67d251-067f-43c0-981c-7155fa86dfb7 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:18.080845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab91a33-e15b-4fc9-bf5c-908cfe09c333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:18.081737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab91a33-e15b-4fc9-bf5c-908cfe09c333 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:18.082181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab91a33-e15b-4fc9-bf5c-908cfe09c333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:18.082459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab91a33-e15b-4fc9-bf5c-908cfe09c333 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:18.082724 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-97250419-995c-42ea-8ea8-18dd603f6432 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invalidating the token cache because role a813c8d7acbc47b7a67f887d96e56fed has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:18.083189 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab91a33-e15b-4fc9-bf5c-908cfe09c333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:18.083399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-97250419-995c-42ea-8ea8-18dd603f6432 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:18.085045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab91a33-e15b-4fc9-bf5c-908cfe09c333 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:18.085591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-97250419-995c-42ea-8ea8-18dd603f6432 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:18.097345 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1943/3863] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:24:17 2022] DELETE /identity/v3/roles/a813c8d7acbc47b7a67f887d96e56fed => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:18.101298 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1921/3864] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:18 2022] GET /identity/v3/roles => generated 2323 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:18.102716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97250419-995c-42ea-8ea8-18dd603f6432 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:18.104439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-97250419-995c-42ea-8ea8-18dd603f6432 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:18.107628 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab91a33-e15b-4fc9-bf5c-908cfe09c333 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:18.110387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0ab91a33-e15b-4fc9-bf5c-908cfe09c333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:18.121980 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:18.130554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab91a33-e15b-4fc9-bf5c-908cfe09c333 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:18.217215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a6ca3-acad-47d6-b661-e4265b53da72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:18.217858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a6ca3-acad-47d6-b661-e4265b53da72 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:18.218169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a6ca3-acad-47d6-b661-e4265b53da72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:18.218520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a6ca3-acad-47d6-b661-e4265b53da72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:18.219612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a6ca3-acad-47d6-b661-e4265b53da72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:18.222723 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a6ca3-acad-47d6-b661-e4265b53da72 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:18.243042 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1922/3865] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:18 2022] GET /identity/v3/roles => generated 2323 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:18.244400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a6ca3-acad-47d6-b661-e4265b53da72 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:18.253743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97250419-995c-42ea-8ea8-18dd603f6432 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:18.260576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a6ca3-acad-47d6-b661-e4265b53da72 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:18.287307 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e86c09-ed7b-48aa-8d8e-0343d4623387 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:18.288027 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e86c09-ed7b-48aa-8d8e-0343d4623387 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:18.288334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e86c09-ed7b-48aa-8d8e-0343d4623387 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:18.288632 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e86c09-ed7b-48aa-8d8e-0343d4623387 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/8511d75c05b3484185fc5acca098e3d7` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:18.290019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bafeae-2a84-47ab-96b7-7b26ad11910f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:18.291169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bafeae-2a84-47ab-96b7-7b26ad11910f admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:18.291450 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bafeae-2a84-47ab-96b7-7b26ad11910f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:18.291725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bafeae-2a84-47ab-96b7-7b26ad11910f admin admin] PATH_INFO: `/v3/projects/f5f3e59419be4d2b892f498e527cb2e8/users/106559a2b8754c54b1c41ba8cadd1a97/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:18.296214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e86c09-ed7b-48aa-8d8e-0343d4623387 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b3dce7e63bcd404990e9477193ec382a, implied_role_id=8511d75c05b3484185fc5acca098e3d7)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:18.306516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e86c09-ed7b-48aa-8d8e-0343d4623387 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:18.339551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bafeae-2a84-47ab-96b7-7b26ad11910f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5f3e59419be4d2b892f498e527cb2e8, user_id=106559a2b8754c54b1c41ba8cadd1a97, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:18.343504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bafeae-2a84-47ab-96b7-7b26ad11910f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:18.364645 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:18.370257 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1923/3866] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:24:18 2022] PUT /identity/v3/projects/f5f3e59419be4d2b892f498e527cb2e8/users/106559a2b8754c54b1c41ba8cadd1a97/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:18.375503 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8f15a-a688-4e42-a56a-7327d8b45224 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:18.375771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8f15a-a688-4e42-a56a-7327d8b45224 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:18.376210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8f15a-a688-4e42-a56a-7327d8b45224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:18.418899 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1944/3867] 10.222.0.39 () {60 vars in 1363 bytes} [Sun Aug 7 01:24:18 2022] PUT /identity/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/8511d75c05b3484185fc5acca098e3d7 => generated 520 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:24:18.422909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-92c8f15a-a688-4e42-a56a-7327d8b45224 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:18.423422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e86c09-ed7b-48aa-8d8e-0343d4623387 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:18.424519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-92c8f15a-a688-4e42-a56a-7327d8b45224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:18.586940 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1924/3868] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:24:18.606353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e86c09-ed7b-48aa-8d8e-0343d4623387 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:18.612171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d670f4-a21b-4d3a-820e-d6b4a928d845 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:18.612855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d670f4-a21b-4d3a-820e-d6b4a928d845 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:18.613140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d670f4-a21b-4d3a-820e-d6b4a928d845 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:18.613416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d670f4-a21b-4d3a-820e-d6b4a928d845 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/8511d75c05b3484185fc5acca098e3d7` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:18.616198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d670f4-a21b-4d3a-820e-d6b4a928d845 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=b3dce7e63bcd404990e9477193ec382a, implied_role_id=8511d75c05b3484185fc5acca098e3d7)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:18.617988 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-54d670f4-a21b-4d3a-820e-d6b4a928d845 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:18.617988 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:24:18.617988 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:24:18.619048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d670f4-a21b-4d3a-820e-d6b4a928d845 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:18.620855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d670f4-a21b-4d3a-820e-d6b4a928d845 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=b3dce7e63bcd404990e9477193ec382a, implied_role_id=8511d75c05b3484185fc5acca098e3d7)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:18.621869 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-54d670f4-a21b-4d3a-820e-d6b4a928d845 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:18.621869 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:24:18.621869 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:24:18.622644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d670f4-a21b-4d3a-820e-d6b4a928d845 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:18.636136 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1945/3869] 10.222.0.39 () {58 vars in 1345 bytes} [Sun Aug 7 01:24:18 2022] HEAD /identity/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/8511d75c05b3484185fc5acca098e3d7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:18.636325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8f15a-a688-4e42-a56a-7327d8b45224 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:18.653088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8f15a-a688-4e42-a56a-7327d8b45224 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:18.668457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f0030-a244-4003-856d-941fb0921be3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:18.669524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f0030-a244-4003-856d-941fb0921be3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:18.669524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f0030-a244-4003-856d-941fb0921be3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:18.669765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f0030-a244-4003-856d-941fb0921be3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/8511d75c05b3484185fc5acca098e3d7` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:18.675119 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f0030-a244-4003-856d-941fb0921be3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=b3dce7e63bcd404990e9477193ec382a, implied_role_id=8511d75c05b3484185fc5acca098e3d7)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:18.676266 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-8c8f0030-a244-4003-856d-941fb0921be3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:18.676266 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:24:18.676266 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:24:18.682849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f0030-a244-4003-856d-941fb0921be3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:18.684452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d670f4-a21b-4d3a-820e-d6b4a928d845 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:18.686982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-54d670f4-a21b-4d3a-820e-d6b4a928d845 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:18.702249 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1925/3870] 10.222.0.39 () {58 vars in 1344 bytes} [Sun Aug 7 01:24:18 2022] GET /identity/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/8511d75c05b3484185fc5acca098e3d7 => generated 520 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:24:18.711923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f0030-a244-4003-856d-941fb0921be3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:18.754774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f0030-a244-4003-856d-941fb0921be3 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:18.785602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66637a5-5b9f-4a27-ad7b-234e62737bca tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:18.786258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66637a5-5b9f-4a27-ad7b-234e62737bca tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:18.786555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66637a5-5b9f-4a27-ad7b-234e62737bca tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:18.786806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66637a5-5b9f-4a27-ad7b-234e62737bca tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/8511d75c05b3484185fc5acca098e3d7` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:18.797404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66637a5-5b9f-4a27-ad7b-234e62737bca tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b3dce7e63bcd404990e9477193ec382a, implied_role_id=8511d75c05b3484185fc5acca098e3d7)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:18.798452 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-f66637a5-5b9f-4a27-ad7b-234e62737bca tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:18.798452 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:24:18.798452 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:24:18.801043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66637a5-5b9f-4a27-ad7b-234e62737bca tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:18.827273 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1926/3871] 10.222.0.39 () {58 vars in 1347 bytes} [Sun Aug 7 01:24:18 2022] DELETE /identity/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/8511d75c05b3484185fc5acca098e3d7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:18.831147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66637a5-5b9f-4a27-ad7b-234e62737bca tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:18.948000 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d670f4-a21b-4d3a-820e-d6b4a928d845 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:18.963106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66637a5-5b9f-4a27-ad7b-234e62737bca tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:18.969619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17323d25-7c70-4d47-b1ba-5d3ba2f40c94 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:18.970300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17323d25-7c70-4d47-b1ba-5d3ba2f40c94 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:18.970904 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17323d25-7c70-4d47-b1ba-5d3ba2f40c94 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:18.971212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17323d25-7c70-4d47-b1ba-5d3ba2f40c94 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/8511d75c05b3484185fc5acca098e3d7` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:18.974982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17323d25-7c70-4d47-b1ba-5d3ba2f40c94 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=b3dce7e63bcd404990e9477193ec382a, implied_role_id=8511d75c05b3484185fc5acca098e3d7)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:18.977659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17323d25-7c70-4d47-b1ba-5d3ba2f40c94 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:18.997179 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-17323d25-7c70-4d47-b1ba-5d3ba2f40c94 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] b3dce7e63bcd404990e9477193ec382a does not imply 8511d75c05b3484185fc5acca098e3d7.: keystone.exception.ImpliedRoleNotFound: b3dce7e63bcd404990e9477193ec382a does not imply 8511d75c05b3484185fc5acca098e3d7. Aug 07 01:24:18.997179 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:24:18.997179 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 07 01:24:18.997179 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = query.one() Aug 07 01:24:18.997179 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Aug 07 01:24:18.997179 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._iter().one() Aug 07 01:24:18.997179 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Aug 07 01:24:18.997179 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._only_one_row( Aug 07 01:24:18.997179 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 07 01:24:18.997179 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 07 01:24:18.997179 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 07 01:24:18.997179 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:24:18.997179 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:24:18.997179 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:24:18.997179 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:24:18.997179 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:24:18.998397 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:24:18.998397 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:24:18.998397 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:24:18.998397 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:24:18.998397 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:24:18.998397 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:24:18.998397 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:24:18.998397 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:24:18.998397 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:24:18.998397 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Aug 07 01:24:18.998397 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Aug 07 01:24:18.998397 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Aug 07 01:24:18.998397 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Aug 07 01:24:18.998397 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Aug 07 01:24:18.998397 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 07 01:24:18.998397 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 07 01:24:19.000456 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 07 01:24:19.000456 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: b3dce7e63bcd404990e9477193ec382a does not imply 8511d75c05b3484185fc5acca098e3d7. Aug 07 01:24:19.000456 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:24:19.005776 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1927/3872] 10.222.0.39 () {58 vars in 1344 bytes} [Sun Aug 7 01:24:18 2022] GET /identity/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/8511d75c05b3484185fc5acca098e3d7 => generated 137 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 07 01:24:19.007576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17323d25-7c70-4d47-b1ba-5d3ba2f40c94 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:19.021357 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:19.033056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17323d25-7c70-4d47-b1ba-5d3ba2f40c94 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:19.042030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90481cb8-d5c4-434a-8642-1ae0680c64cc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:19.042699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90481cb8-d5c4-434a-8642-1ae0680c64cc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:19.042983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90481cb8-d5c4-434a-8642-1ae0680c64cc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:19.043267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90481cb8-d5c4-434a-8642-1ae0680c64cc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/8511d75c05b3484185fc5acca098e3d7` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:19.045166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90481cb8-d5c4-434a-8642-1ae0680c64cc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b3dce7e63bcd404990e9477193ec382a, implied_role_id=8511d75c05b3484185fc5acca098e3d7)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:19.050797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90481cb8-d5c4-434a-8642-1ae0680c64cc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:19.065387 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-90481cb8-d5c4-434a-8642-1ae0680c64cc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] b3dce7e63bcd404990e9477193ec382a does not imply 8511d75c05b3484185fc5acca098e3d7.: keystone.exception.ImpliedRoleNotFound: b3dce7e63bcd404990e9477193ec382a does not imply 8511d75c05b3484185fc5acca098e3d7. Aug 07 01:24:19.065387 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:24:19.065387 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Aug 07 01:24:19.065387 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = query.one() Aug 07 01:24:19.065387 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Aug 07 01:24:19.065387 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._iter().one() Aug 07 01:24:19.065387 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Aug 07 01:24:19.065387 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._only_one_row( Aug 07 01:24:19.065387 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 07 01:24:19.065387 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 07 01:24:19.065387 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 07 01:24:19.065387 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:24:19.065387 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:24:19.065387 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:24:19.065387 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:24:19.065387 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:24:19.066557 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:24:19.066557 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:24:19.066557 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:24:19.066557 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:24:19.066557 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:24:19.066557 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:24:19.066557 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:24:19.066557 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:24:19.066557 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:24:19.066557 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Aug 07 01:24:19.066557 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Aug 07 01:24:19.066557 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:24:19.066557 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:24:19.066557 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Aug 07 01:24:19.066557 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Aug 07 01:24:19.066557 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Aug 07 01:24:19.068065 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Aug 07 01:24:19.068065 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Aug 07 01:24:19.068065 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Aug 07 01:24:19.068065 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: b3dce7e63bcd404990e9477193ec382a does not imply 8511d75c05b3484185fc5acca098e3d7. Aug 07 01:24:19.068065 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:24:19.068065 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1928/3873] 10.222.0.39 () {58 vars in 1347 bytes} [Sun Aug 7 01:24:19 2022] DELETE /identity/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/8511d75c05b3484185fc5acca098e3d7 => generated 137 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:24:19.073704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90481cb8-d5c4-434a-8642-1ae0680c64cc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:19.085885 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f86fb-12d9-4a29-8aa1-6dd088ddc0a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:19.086508 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f86fb-12d9-4a29-8aa1-6dd088ddc0a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:19.086783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f86fb-12d9-4a29-8aa1-6dd088ddc0a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:19.087051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f86fb-12d9-4a29-8aa1-6dd088ddc0a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:19.089783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90481cb8-d5c4-434a-8642-1ae0680c64cc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:19.096194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5aef1-a9a9-4e50-8cc7-ec34296274b5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:19.098133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5aef1-a9a9-4e50-8cc7-ec34296274b5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:19.098589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5aef1-a9a9-4e50-8cc7-ec34296274b5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:19.099462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5aef1-a9a9-4e50-8cc7-ec34296274b5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/8511d75c05b3484185fc5acca098e3d7` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:19.104689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5aef1-a9a9-4e50-8cc7-ec34296274b5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b3dce7e63bcd404990e9477193ec382a, implied_role_id=8511d75c05b3484185fc5acca098e3d7)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:19.106573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5aef1-a9a9-4e50-8cc7-ec34296274b5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:19.165146 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1929/3874] 10.222.0.39 () {60 vars in 1363 bytes} [Sun Aug 7 01:24:19 2022] PUT /identity/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/8511d75c05b3484185fc5acca098e3d7 => generated 520 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:19.169515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5aef1-a9a9-4e50-8cc7-ec34296274b5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:19.227567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f86fb-12d9-4a29-8aa1-6dd088ddc0a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:19.229168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f86fb-12d9-4a29-8aa1-6dd088ddc0a0 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:19.250584 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1946/3875] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:24:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:24:19.293628 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:19.356167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5aef1-a9a9-4e50-8cc7-ec34296274b5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:19.364574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42d425-98f3-42be-9e2e-696ba4edb3bc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:19.366041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42d425-98f3-42be-9e2e-696ba4edb3bc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:19.368275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42d425-98f3-42be-9e2e-696ba4edb3bc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:19.368463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42d425-98f3-42be-9e2e-696ba4edb3bc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/058a3f3be2ee41f4a06d8f2cca7e148f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:19.371498 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42d425-98f3-42be-9e2e-696ba4edb3bc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b3dce7e63bcd404990e9477193ec382a, implied_role_id=058a3f3be2ee41f4a06d8f2cca7e148f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:19.374363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42d425-98f3-42be-9e2e-696ba4edb3bc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:19.424478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f86fb-12d9-4a29-8aa1-6dd088ddc0a0 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:19.451802 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1930/3876] 10.222.0.39 () {60 vars in 1363 bytes} [Sun Aug 7 01:24:19 2022] PUT /identity/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/058a3f3be2ee41f4a06d8f2cca7e148f => generated 520 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:19.457689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f86fb-12d9-4a29-8aa1-6dd088ddc0a0 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:19.591645 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f13eaa-404f-4eec-9c9f-ff72529fdf05 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:19.592531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f13eaa-404f-4eec-9c9f-ff72529fdf05 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:19.592977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f13eaa-404f-4eec-9c9f-ff72529fdf05 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:19.594178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f13eaa-404f-4eec-9c9f-ff72529fdf05 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/058a3f3be2ee41f4a06d8f2cca7e148f/implies/25c010d52a5e4f61ad19bae8ccddf54b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:19.596731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f13eaa-404f-4eec-9c9f-ff72529fdf05 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=058a3f3be2ee41f4a06d8f2cca7e148f, implied_role_id=25c010d52a5e4f61ad19bae8ccddf54b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:19.601129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f13eaa-404f-4eec-9c9f-ff72529fdf05 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:19.655875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42d425-98f3-42be-9e2e-696ba4edb3bc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:19.667834 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1947/3877] 10.222.0.39 () {60 vars in 1363 bytes} [Sun Aug 7 01:24:19 2022] PUT /identity/v3/roles/058a3f3be2ee41f4a06d8f2cca7e148f/implies/25c010d52a5e4f61ad19bae8ccddf54b => generated 521 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:24:19.670759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42d425-98f3-42be-9e2e-696ba4edb3bc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:19.858682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58648bf0-9e9a-4107-94da-994f77493adf tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:19.859309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58648bf0-9e9a-4107-94da-994f77493adf tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:19.859589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58648bf0-9e9a-4107-94da-994f77493adf tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:19.859859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58648bf0-9e9a-4107-94da-994f77493adf tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:19.861011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58648bf0-9e9a-4107-94da-994f77493adf tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:19.862194 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-58648bf0-9e9a-4107-94da-994f77493adf tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:19.862194 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:24:19.862194 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:24:19.863113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58648bf0-9e9a-4107-94da-994f77493adf tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:19.908050 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1931/3878] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Aug 7 01:24:19 2022] GET /identity/v3/role_inferences => generated 1607 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:19.912773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f13eaa-404f-4eec-9c9f-ff72529fdf05 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:19.935315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f13eaa-404f-4eec-9c9f-ff72529fdf05 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:19.946308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f43bf9-fc21-4e5f-b6db-350b8adf040a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:19.947626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f43bf9-fc21-4e5f-b6db-350b8adf040a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:19.948520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f43bf9-fc21-4e5f-b6db-350b8adf040a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:19.949761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f43bf9-fc21-4e5f-b6db-350b8adf040a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/058a3f3be2ee41f4a06d8f2cca7e148f/implies/25c010d52a5e4f61ad19bae8ccddf54b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:19.952008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f43bf9-fc21-4e5f-b6db-350b8adf040a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=058a3f3be2ee41f4a06d8f2cca7e148f, implied_role_id=25c010d52a5e4f61ad19bae8ccddf54b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:19.955124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f43bf9-fc21-4e5f-b6db-350b8adf040a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:19.971518 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1948/3879] 10.222.0.39 () {58 vars in 1347 bytes} [Sun Aug 7 01:24:19 2022] DELETE /identity/v3/roles/058a3f3be2ee41f4a06d8f2cca7e148f/implies/25c010d52a5e4f61ad19bae8ccddf54b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:19.975623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58648bf0-9e9a-4107-94da-994f77493adf tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:20.010084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58648bf0-9e9a-4107-94da-994f77493adf tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:20.144482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5f3ed-4000-46d5-a28f-427dc232ef0e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:20.145665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5f3ed-4000-46d5-a28f-427dc232ef0e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:20.145952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5f3ed-4000-46d5-a28f-427dc232ef0e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:20.146227 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f5f3ed-4000-46d5-a28f-427dc232ef0e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/058a3f3be2ee41f4a06d8f2cca7e148f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:20.150272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5f3ed-4000-46d5-a28f-427dc232ef0e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b3dce7e63bcd404990e9477193ec382a, implied_role_id=058a3f3be2ee41f4a06d8f2cca7e148f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:20.151996 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f5f3ed-4000-46d5-a28f-427dc232ef0e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:20.166332 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1932/3880] 10.222.0.39 () {58 vars in 1347 bytes} [Sun Aug 7 01:24:19 2022] DELETE /identity/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/058a3f3be2ee41f4a06d8f2cca7e148f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:20.170244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f43bf9-fc21-4e5f-b6db-350b8adf040a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:20.187168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f43bf9-fc21-4e5f-b6db-350b8adf040a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:20.325916 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:20.368705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82b718-26ab-43fe-bfe0-cb9022b9e1f8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:20.369545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82b718-26ab-43fe-bfe0-cb9022b9e1f8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:20.370017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82b718-26ab-43fe-bfe0-cb9022b9e1f8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:20.370573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82b718-26ab-43fe-bfe0-cb9022b9e1f8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/8511d75c05b3484185fc5acca098e3d7` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:20.374218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82b718-26ab-43fe-bfe0-cb9022b9e1f8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b3dce7e63bcd404990e9477193ec382a, implied_role_id=8511d75c05b3484185fc5acca098e3d7)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:20.376049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82b718-26ab-43fe-bfe0-cb9022b9e1f8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:20.393368 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1949/3881] 10.222.0.39 () {58 vars in 1347 bytes} [Sun Aug 7 01:24:20 2022] DELETE /identity/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/8511d75c05b3484185fc5acca098e3d7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:20.398672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5f3ed-4000-46d5-a28f-427dc232ef0e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:20.418781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f5f3ed-4000-46d5-a28f-427dc232ef0e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:20.529321 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:20.546870 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf5467-ca56-4dcf-861f-65eacba41a95 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:20.550083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf5467-ca56-4dcf-861f-65eacba41a95 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:20.550609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf5467-ca56-4dcf-861f-65eacba41a95 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:20.551727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf5467-ca56-4dcf-861f-65eacba41a95 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:20.554307 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf5467-ca56-4dcf-861f-65eacba41a95 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:20.556305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf5467-ca56-4dcf-861f-65eacba41a95 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:20.591693 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1933/3882] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:20 2022] GET /identity/v3/roles => generated 2323 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:20.596141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82b718-26ab-43fe-bfe0-cb9022b9e1f8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:20.612104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82b718-26ab-43fe-bfe0-cb9022b9e1f8 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:20.622053 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae3659-3a6d-492f-8fc4-b008382eba2d tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:20.623098 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae3659-3a6d-492f-8fc4-b008382eba2d tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:20.623591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae3659-3a6d-492f-8fc4-b008382eba2d tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:20.624243 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae3659-3a6d-492f-8fc4-b008382eba2d tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:20.625211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae3659-3a6d-492f-8fc4-b008382eba2d tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:20.627155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae3659-3a6d-492f-8fc4-b008382eba2d tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:20.663264 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1950/3883] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:24:20 2022] POST /identity/v3/roles => generated 235 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:20.667812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf5467-ca56-4dcf-861f-65eacba41a95 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:20.690267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf5467-ca56-4dcf-861f-65eacba41a95 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:20.703496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043fa10b-529c-42e2-81a9-71e1c1cb58d9 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:20.704274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fa10b-529c-42e2-81a9-71e1c1cb58d9 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:20.704786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fa10b-529c-42e2-81a9-71e1c1cb58d9 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:20.705007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fa10b-529c-42e2-81a9-71e1c1cb58d9 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/edbf736fd1534aefacbeb501bd90604c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:20.706819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043fa10b-529c-42e2-81a9-71e1c1cb58d9 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:update_role(role_id=edbf736fd1534aefacbeb501bd90604c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:20.707961 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-043fa10b-529c-42e2-81a9-71e1c1cb58d9 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:20.707961 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:24:20.707961 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:24:20.710885 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043fa10b-529c-42e2-81a9-71e1c1cb58d9 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:20.772990 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1934/3884] 10.222.0.39 () {60 vars in 1243 bytes} [Sun Aug 7 01:24:20 2022] PATCH /identity/v3/roles/edbf736fd1534aefacbeb501bd90604c => generated 238 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:24:20.776551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae3659-3a6d-492f-8fc4-b008382eba2d tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:20.791497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae3659-3a6d-492f-8fc4-b008382eba2d tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:20.798861 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc551052-f0aa-4390-9a65-5776cc71032e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:20.800246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc551052-f0aa-4390-9a65-5776cc71032e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:20.800515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc551052-f0aa-4390-9a65-5776cc71032e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:20.800963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc551052-f0aa-4390-9a65-5776cc71032e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/edbf736fd1534aefacbeb501bd90604c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:20.831107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc551052-f0aa-4390-9a65-5776cc71032e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:get_role(role_id=edbf736fd1534aefacbeb501bd90604c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:20.832206 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-dc551052-f0aa-4390-9a65-5776cc71032e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:20.832206 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:24:20.832206 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:24:20.833116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc551052-f0aa-4390-9a65-5776cc71032e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:20.835251 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1951/3885] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Aug 7 01:24:20 2022] GET /identity/v3/roles/edbf736fd1534aefacbeb501bd90604c => generated 238 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:24:20.839370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043fa10b-529c-42e2-81a9-71e1c1cb58d9 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:20.854026 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043fa10b-529c-42e2-81a9-71e1c1cb58d9 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:20.874043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5187db-17a5-46c8-97f7-1f0482d1856a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:20.874687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5187db-17a5-46c8-97f7-1f0482d1856a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:20.874974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5187db-17a5-46c8-97f7-1f0482d1856a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:20.875249 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5187db-17a5-46c8-97f7-1f0482d1856a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:20.875954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5187db-17a5-46c8-97f7-1f0482d1856a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:20.877597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5187db-17a5-46c8-97f7-1f0482d1856a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:20.892775 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1935/3886] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:20 2022] GET /identity/v3/roles => generated 2552 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:24:20.899683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc551052-f0aa-4390-9a65-5776cc71032e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:20.912494 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc551052-f0aa-4390-9a65-5776cc71032e tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:20.918217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905b756-ac5e-4b0c-a7e1-d00f7f5d7d5f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:20.918872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905b756-ac5e-4b0c-a7e1-d00f7f5d7d5f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:20.919197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905b756-ac5e-4b0c-a7e1-d00f7f5d7d5f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:20.919692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905b756-ac5e-4b0c-a7e1-d00f7f5d7d5f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/edbf736fd1534aefacbeb501bd90604c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:20.921718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905b756-ac5e-4b0c-a7e1-d00f7f5d7d5f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:delete_role(role_id=edbf736fd1534aefacbeb501bd90604c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:20.922942 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-3905b756-ac5e-4b0c-a7e1-d00f7f5d7d5f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:20.922942 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:24:20.922942 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:24:20.929287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905b756-ac5e-4b0c-a7e1-d00f7f5d7d5f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:21.036225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3905b756-ac5e-4b0c-a7e1-d00f7f5d7d5f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invalidating the token cache because role edbf736fd1534aefacbeb501bd90604c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:21.036834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3905b756-ac5e-4b0c-a7e1-d00f7f5d7d5f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:21.037418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3905b756-ac5e-4b0c-a7e1-d00f7f5d7d5f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:21.040131 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1952/3887] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:24:20 2022] DELETE /identity/v3/roles/edbf736fd1534aefacbeb501bd90604c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:21.046550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5187db-17a5-46c8-97f7-1f0482d1856a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:21.055092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-be5187db-17a5-46c8-97f7-1f0482d1856a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:21.091572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5187db-17a5-46c8-97f7-1f0482d1856a tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:21.186694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cd105-522c-4606-8402-4dfe3665fb49 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:21.187641 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cd105-522c-4606-8402-4dfe3665fb49 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:21.188110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cd105-522c-4606-8402-4dfe3665fb49 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:21.189171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cd105-522c-4606-8402-4dfe3665fb49 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/8511d75c05b3484185fc5acca098e3d7` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:21.191298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6cd105-522c-4606-8402-4dfe3665fb49 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b3dce7e63bcd404990e9477193ec382a, implied_role_id=8511d75c05b3484185fc5acca098e3d7)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:21.193420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6cd105-522c-4606-8402-4dfe3665fb49 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:21.263997 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1936/3888] 10.222.0.39 () {60 vars in 1363 bytes} [Sun Aug 7 01:24:21 2022] PUT /identity/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/8511d75c05b3484185fc5acca098e3d7 => generated 520 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:21.268102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905b756-ac5e-4b0c-a7e1-d00f7f5d7d5f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:21.309210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905b756-ac5e-4b0c-a7e1-d00f7f5d7d5f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:21.388661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cd105-522c-4606-8402-4dfe3665fb49 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:21.391737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-be6cd105-522c-4606-8402-4dfe3665fb49 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:21.403437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c0e37-0980-40dc-8adb-621232a65a82 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:21.404130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c0e37-0980-40dc-8adb-621232a65a82 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:21.404448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c0e37-0980-40dc-8adb-621232a65a82 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:21.404729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c0e37-0980-40dc-8adb-621232a65a82 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/058a3f3be2ee41f4a06d8f2cca7e148f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:21.406766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c0e37-0980-40dc-8adb-621232a65a82 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b3dce7e63bcd404990e9477193ec382a, implied_role_id=058a3f3be2ee41f4a06d8f2cca7e148f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:21.409868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c0e37-0980-40dc-8adb-621232a65a82 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:21.449188 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1953/3889] 10.222.0.39 () {60 vars in 1363 bytes} [Sun Aug 7 01:24:21 2022] PUT /identity/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/058a3f3be2ee41f4a06d8f2cca7e148f => generated 520 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:21.453236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c0e37-0980-40dc-8adb-621232a65a82 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:21.555564 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6cd105-522c-4606-8402-4dfe3665fb49 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:21.563614 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:21.579429 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c0e37-0980-40dc-8adb-621232a65a82 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:21.593941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e785fdb-992e-40cc-8ba3-84e17e6318c6 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:21.594885 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e785fdb-992e-40cc-8ba3-84e17e6318c6 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:21.595176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e785fdb-992e-40cc-8ba3-84e17e6318c6 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:21.595457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e785fdb-992e-40cc-8ba3-84e17e6318c6 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/058a3f3be2ee41f4a06d8f2cca7e148f/implies/25c010d52a5e4f61ad19bae8ccddf54b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:21.599911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e785fdb-992e-40cc-8ba3-84e17e6318c6 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=058a3f3be2ee41f4a06d8f2cca7e148f, implied_role_id=25c010d52a5e4f61ad19bae8ccddf54b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:21.605675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e785fdb-992e-40cc-8ba3-84e17e6318c6 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:21.652490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0d101-69f1-46ef-86b9-e898f054a2b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:21.653588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0d101-69f1-46ef-86b9-e898f054a2b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:21.653978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0d101-69f1-46ef-86b9-e898f054a2b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:21.654353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0d101-69f1-46ef-86b9-e898f054a2b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:21.656422 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1954/3890] 10.222.0.39 () {60 vars in 1363 bytes} [Sun Aug 7 01:24:21 2022] PUT /identity/v3/roles/058a3f3be2ee41f4a06d8f2cca7e148f/implies/25c010d52a5e4f61ad19bae8ccddf54b => generated 521 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:21.657778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127fdae-b7be-440c-941d-1670d1109eda None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:21.658066 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127fdae-b7be-440c-941d-1670d1109eda None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:21.658339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127fdae-b7be-440c-941d-1670d1109eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:21.661852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-55b0d101-69f1-46ef-86b9-e898f054a2b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:21.671387 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:21.711395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a127fdae-b7be-440c-941d-1670d1109eda None None] MFA Rules not processed for user `dfaafe20889443e692f94fd4e4b8b023`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:21.713574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a127fdae-b7be-440c-941d-1670d1109eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:21.834633 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0d101-69f1-46ef-86b9-e898f054a2b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:21.836217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0d101-69f1-46ef-86b9-e898f054a2b4 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:21.849906 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1937/3891] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:24:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:24:21.850879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0d101-69f1-46ef-86b9-e898f054a2b4 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:21.869879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0d101-69f1-46ef-86b9-e898f054a2b4 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:21.915943 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1955/3892] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:21.995323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61999c33-e2eb-42eb-9547-63e5c282ba4b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:21.997892 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61999c33-e2eb-42eb-9547-63e5c282ba4b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:21.998216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61999c33-e2eb-42eb-9547-63e5c282ba4b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:21.998498 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61999c33-e2eb-42eb-9547-63e5c282ba4b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/058a3f3be2ee41f4a06d8f2cca7e148f/implies` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:22.001920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61999c33-e2eb-42eb-9547-63e5c282ba4b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=058a3f3be2ee41f4a06d8f2cca7e148f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:22.002859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb563897-dbc0-463e-a620-1e5982b6c727 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:22.002981 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-61999c33-e2eb-42eb-9547-63e5c282ba4b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:22.002981 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:24:22.002981 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:24:22.003227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb563897-dbc0-463e-a620-1e5982b6c727 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:22.003455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb563897-dbc0-463e-a620-1e5982b6c727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:22.006691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61999c33-e2eb-42eb-9547-63e5c282ba4b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:22.021845 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1938/3893] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Aug 7 01:24:21 2022] GET /identity/v3/roles/058a3f3be2ee41f4a06d8f2cca7e148f/implies => generated 490 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:24:22.029588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-eb563897-dbc0-463e-a620-1e5982b6c727 None None] MFA Rules not processed for user `dfaafe20889443e692f94fd4e4b8b023`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:22.030200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61999c33-e2eb-42eb-9547-63e5c282ba4b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:22.030978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-eb563897-dbc0-463e-a620-1e5982b6c727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:22.055948 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1956/3894] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:22.062792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61999c33-e2eb-42eb-9547-63e5c282ba4b tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:22.065036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb563897-dbc0-463e-a620-1e5982b6c727 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:22.066803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-eb563897-dbc0-463e-a620-1e5982b6c727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:22.069581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1d422-cf5c-4e97-a7ac-79e82b3611b1 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:22.070806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1d422-cf5c-4e97-a7ac-79e82b3611b1 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:22.071197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1d422-cf5c-4e97-a7ac-79e82b3611b1 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:22.071606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1d422-cf5c-4e97-a7ac-79e82b3611b1 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:22.074027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1d422-cf5c-4e97-a7ac-79e82b3611b1 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=b3dce7e63bcd404990e9477193ec382a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:22.078345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1d422-cf5c-4e97-a7ac-79e82b3611b1 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:22.091076 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1939/3895] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Aug 7 01:24:22 2022] GET /identity/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies => generated 660 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:24:22.097409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1d422-cf5c-4e97-a7ac-79e82b3611b1 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:22.127417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1d422-cf5c-4e97-a7ac-79e82b3611b1 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:22.150843 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e0387-e3de-4cb1-ad2f-6317b3fe1ecc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:22.151976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e0387-e3de-4cb1-ad2f-6317b3fe1ecc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:22.152278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e0387-e3de-4cb1-ad2f-6317b3fe1ecc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:22.152550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e0387-e3de-4cb1-ad2f-6317b3fe1ecc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/058a3f3be2ee41f4a06d8f2cca7e148f/implies/25c010d52a5e4f61ad19bae8ccddf54b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:22.161838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e0387-e3de-4cb1-ad2f-6317b3fe1ecc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=058a3f3be2ee41f4a06d8f2cca7e148f, implied_role_id=25c010d52a5e4f61ad19bae8ccddf54b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:22.167822 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e0387-e3de-4cb1-ad2f-6317b3fe1ecc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:22.185676 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1940/3896] 10.222.0.39 () {58 vars in 1347 bytes} [Sun Aug 7 01:24:22 2022] DELETE /identity/v3/roles/058a3f3be2ee41f4a06d8f2cca7e148f/implies/25c010d52a5e4f61ad19bae8ccddf54b => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:22.190298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e0387-e3de-4cb1-ad2f-6317b3fe1ecc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:22.294375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb563897-dbc0-463e-a620-1e5982b6c727 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:22.424840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e0387-e3de-4cb1-ad2f-6317b3fe1ecc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:22.448502 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:22.454594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944813f2-4d15-4f2a-a41b-2dd2f18be732 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:22.460640 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944813f2-4d15-4f2a-a41b-2dd2f18be732 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:22.465668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944813f2-4d15-4f2a-a41b-2dd2f18be732 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:22.466342 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944813f2-4d15-4f2a-a41b-2dd2f18be732 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/058a3f3be2ee41f4a06d8f2cca7e148f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:22.474468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944813f2-4d15-4f2a-a41b-2dd2f18be732 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b3dce7e63bcd404990e9477193ec382a, implied_role_id=058a3f3be2ee41f4a06d8f2cca7e148f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:22.479204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944813f2-4d15-4f2a-a41b-2dd2f18be732 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:22.486000 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2454a-11ea-48f4-a501-8b90594c9162 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:22.488181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2454a-11ea-48f4-a501-8b90594c9162 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:22.489274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2454a-11ea-48f4-a501-8b90594c9162 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:22.489646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2454a-11ea-48f4-a501-8b90594c9162 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:22.495861 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1941/3897] 10.222.0.39 () {58 vars in 1347 bytes} [Sun Aug 7 01:24:22 2022] DELETE /identity/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/058a3f3be2ee41f4a06d8f2cca7e148f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:24:22.500012 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944813f2-4d15-4f2a-a41b-2dd2f18be732 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:22.554233 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:22.659111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2454a-11ea-48f4-a501-8b90594c9162 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:22.660684 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2454a-11ea-48f4-a501-8b90594c9162 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:22.678298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944813f2-4d15-4f2a-a41b-2dd2f18be732 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:22.688126 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1957/3898] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:24:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:24:22.690585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c5dda-b37e-4396-b059-304fcd4e22f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:22.691480 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c5dda-b37e-4396-b059-304fcd4e22f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:22.698644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c5dda-b37e-4396-b059-304fcd4e22f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:22.699178 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c5dda-b37e-4396-b059-304fcd4e22f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/8511d75c05b3484185fc5acca098e3d7` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:22.704535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c5dda-b37e-4396-b059-304fcd4e22f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=b3dce7e63bcd404990e9477193ec382a, implied_role_id=8511d75c05b3484185fc5acca098e3d7)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:22.709313 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c5dda-b37e-4396-b059-304fcd4e22f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:22.731522 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1942/3899] 10.222.0.39 () {58 vars in 1347 bytes} [Sun Aug 7 01:24:22 2022] DELETE /identity/v3/roles/b3dce7e63bcd404990e9477193ec382a/implies/8511d75c05b3484185fc5acca098e3d7 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:24:22.736529 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2454a-11ea-48f4-a501-8b90594c9162 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:22.752146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2454a-11ea-48f4-a501-8b90594c9162 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:22.895173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e338c-12d7-46ce-9752-4b7b4069cdb0 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:22.896106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e338c-12d7-46ce-9752-4b7b4069cdb0 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:22.896407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e338c-12d7-46ce-9752-4b7b4069cdb0 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:22.896686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e338c-12d7-46ce-9752-4b7b4069cdb0 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/domains/0e3ce9e52383439fa8f90b97e8a757be` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:22.911177 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e338c-12d7-46ce-9752-4b7b4069cdb0 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:24:22.933560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-f32e338c-12d7-46ce-9752-4b7b4069cdb0 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Could not find domain: 0e3ce9e52383439fa8f90b97e8a757be.: keystone.exception.DomainNotFound: Could not find domain: 0e3ce9e52383439fa8f90b97e8a757be. Aug 07 01:24:22.933560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:24:22.933560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 07 01:24:22.933560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 07 01:24:22.933560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 01:24:22.933560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 01:24:22.933560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 01:24:22.933560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 01:24:22.933560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0e3ce9e52383439fa8f90b97e8a757be. Aug 07 01:24:22.933560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:24:22.933560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:24:22.933560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:24:22.933560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:24:22.933560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:24:22.933560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:24:22.933560 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:24:22.934686 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:24:22.934686 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:24:22.934686 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:24:22.934686 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:24:22.934686 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:24:22.934686 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:24:22.934686 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:24:22.934686 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 07 01:24:22.934686 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 07 01:24:22.934686 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:24:22.934686 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:24:22.934686 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:24:22.934686 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:24:22.934686 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:24:22.934686 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:24:22.934686 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:24:22.939967 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:24:22.939967 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:24:22.939967 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:24:22.939967 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:24:22.939967 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 01:24:22.939967 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:24:22.939967 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:24:22.939967 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:24:22.939967 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:24:22.939967 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:24:22.939967 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:24:22.939967 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:24:22.939967 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:24:22.939967 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 07 01:24:22.939967 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:24:22.939967 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0e3ce9e52383439fa8f90b97e8a757be. Aug 07 01:24:22.939967 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:24:22.941369 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1958/3900] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:24:22 2022] PATCH /identity/v3/domains/0e3ce9e52383439fa8f90b97e8a757be => generated 112 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:24:22.941462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c5dda-b37e-4396-b059-304fcd4e22f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:22.954040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c5dda-b37e-4396-b059-304fcd4e22f5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:22.970564 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830631c1-f6b4-4a4a-8d4a-5db73479de09 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:22.971370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830631c1-f6b4-4a4a-8d4a-5db73479de09 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:22.971661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830631c1-f6b4-4a4a-8d4a-5db73479de09 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:22.971966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830631c1-f6b4-4a4a-8d4a-5db73479de09 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:22.973403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830631c1-f6b4-4a4a-8d4a-5db73479de09 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:delete_user(user_id=626eb5b1cb2a4cdeb1cc2fb80f591a7e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:22.978336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830631c1-f6b4-4a4a-8d4a-5db73479de09 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:23.083140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-830631c1-f6b4-4a4a-8d4a-5db73479de09 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '626eb5b1cb2a4cdeb1cc2fb80f591a7e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:23.103420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-830631c1-f6b4-4a4a-8d4a-5db73479de09 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '626eb5b1cb2a4cdeb1cc2fb80f591a7e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:23.149665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-830631c1-f6b4-4a4a-8d4a-5db73479de09 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '626eb5b1cb2a4cdeb1cc2fb80f591a7e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:23.151139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-830631c1-f6b4-4a4a-8d4a-5db73479de09 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '626eb5b1cb2a4cdeb1cc2fb80f591a7e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:23.169808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-830631c1-f6b4-4a4a-8d4a-5db73479de09 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '626eb5b1cb2a4cdeb1cc2fb80f591a7e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:23.204555 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1943/3901] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:24:22 2022] DELETE /identity/v3/users/626eb5b1cb2a4cdeb1cc2fb80f591a7e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:23.206385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e338c-12d7-46ce-9752-4b7b4069cdb0 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:23.208459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f32e338c-12d7-46ce-9752-4b7b4069cdb0 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:23.235148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e338c-12d7-46ce-9752-4b7b4069cdb0 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:23.412629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c12e7-1bc3-4b68-8785-e668e0c11b59 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:23.413716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c12e7-1bc3-4b68-8785-e668e0c11b59 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:23.415265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c12e7-1bc3-4b68-8785-e668e0c11b59 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:23.415729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c12e7-1bc3-4b68-8785-e668e0c11b59 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/25c010d52a5e4f61ad19bae8ccddf54b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:23.418224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c12e7-1bc3-4b68-8785-e668e0c11b59 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:delete_role(role_id=25c010d52a5e4f61ad19bae8ccddf54b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:23.420754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c12e7-1bc3-4b68-8785-e668e0c11b59 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:23.456361 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:23.474606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-152c12e7-1bc3-4b68-8785-e668e0c11b59 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invalidating the token cache because role 25c010d52a5e4f61ad19bae8ccddf54b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:23.475356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-152c12e7-1bc3-4b68-8785-e668e0c11b59 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:23.477417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-152c12e7-1bc3-4b68-8785-e668e0c11b59 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:23.480752 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1959/3902] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:24:23 2022] DELETE /identity/v3/roles/25c010d52a5e4f61ad19bae8ccddf54b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:23.484657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830631c1-f6b4-4a4a-8d4a-5db73479de09 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:23.504760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830631c1-f6b4-4a4a-8d4a-5db73479de09 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:23.625945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5520bfe-a01f-4b74-92da-2e89b4e219da tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:23.627014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5520bfe-a01f-4b74-92da-2e89b4e219da tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:23.628367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5520bfe-a01f-4b74-92da-2e89b4e219da tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:23.628656 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5520bfe-a01f-4b74-92da-2e89b4e219da tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/groups/90987c82007d4137a9bbb9ad29ed9dc7` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:23.630755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5520bfe-a01f-4b74-92da-2e89b4e219da tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:delete_group(group_id=90987c82007d4137a9bbb9ad29ed9dc7)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:23.631898 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-a5520bfe-a01f-4b74-92da-2e89b4e219da tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:23.631898 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:24:23.631898 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:24:23.634073 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5520bfe-a01f-4b74-92da-2e89b4e219da tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:23.701871 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:23.751534 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1944/3903] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Aug 7 01:24:23 2022] DELETE /identity/v3/groups/90987c82007d4137a9bbb9ad29ed9dc7 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:23.755402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c12e7-1bc3-4b68-8785-e668e0c11b59 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:23.757978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-152c12e7-1bc3-4b68-8785-e668e0c11b59 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:23.777079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c12e7-1bc3-4b68-8785-e668e0c11b59 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:23.933091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd5634-344d-4ecc-b1c7-22c2a69631d5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:23.933843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd5634-344d-4ecc-b1c7-22c2a69631d5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:23.935281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd5634-344d-4ecc-b1c7-22c2a69631d5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:23.935569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd5634-344d-4ecc-b1c7-22c2a69631d5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/projects/ef724d39524643378e66c5c9b0b26a1b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:23.938765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd5634-344d-4ecc-b1c7-22c2a69631d5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ef724d39524643378e66c5c9b0b26a1b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:23.944133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd5634-344d-4ecc-b1c7-22c2a69631d5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:24.071309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1ecd5634-344d-4ecc-b1c7-22c2a69631d5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef724d39524643378e66c5c9b0b26a1b', 'request_id': 'req-1ecd5634-344d-4ecc-b1c7-22c2a69631d5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:24.095519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1ecd5634-344d-4ecc-b1c7-22c2a69631d5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef724d39524643378e66c5c9b0b26a1b', 'request_id': 'req-1ecd5634-344d-4ecc-b1c7-22c2a69631d5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:24.107168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1ecd5634-344d-4ecc-b1c7-22c2a69631d5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef724d39524643378e66c5c9b0b26a1b', 'request_id': 'req-1ecd5634-344d-4ecc-b1c7-22c2a69631d5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:24.129773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1ecd5634-344d-4ecc-b1c7-22c2a69631d5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] The token cache is being invalidate because project ef724d39524643378e66c5c9b0b26a1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:24.130057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1ecd5634-344d-4ecc-b1c7-22c2a69631d5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:24.133733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1ecd5634-344d-4ecc-b1c7-22c2a69631d5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:24.141280 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1960/3904] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:24:23 2022] DELETE /identity/v3/projects/ef724d39524643378e66c5c9b0b26a1b => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:24.145671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5520bfe-a01f-4b74-92da-2e89b4e219da tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:24.147488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a5520bfe-a01f-4b74-92da-2e89b4e219da tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:24.177664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5520bfe-a01f-4b74-92da-2e89b4e219da tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:24.312690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883e6c5-f137-4d9f-ba9e-b3b2a4d900fc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:24.313376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883e6c5-f137-4d9f-ba9e-b3b2a4d900fc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:24.314035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883e6c5-f137-4d9f-ba9e-b3b2a4d900fc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:24.314353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883e6c5-f137-4d9f-ba9e-b3b2a4d900fc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/domains/1bf9df0161c04f6db42ef2fa591a8beb` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:24.315793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3883e6c5-f137-4d9f-ba9e-b3b2a4d900fc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1bf9df0161c04f6db42ef2fa591a8beb)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:24.318260 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3883e6c5-f137-4d9f-ba9e-b3b2a4d900fc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:24.374968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3883e6c5-f137-4d9f-ba9e-b3b2a4d900fc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1bf9df0161c04f6db42ef2fa591a8beb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:24.377029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3883e6c5-f137-4d9f-ba9e-b3b2a4d900fc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1bf9df0161c04f6db42ef2fa591a8beb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:24.436307 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3883e6c5-f137-4d9f-ba9e-b3b2a4d900fc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1bf9df0161c04f6db42ef2fa591a8beb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:24.438346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3883e6c5-f137-4d9f-ba9e-b3b2a4d900fc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1bf9df0161c04f6db42ef2fa591a8beb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:24.448606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd5634-344d-4ecc-b1c7-22c2a69631d5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:24.449195 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1945/3905] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:24:24 2022] PATCH /identity/v3/domains/1bf9df0161c04f6db42ef2fa591a8beb => generated 277 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:24:24.468955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd5634-344d-4ecc-b1c7-22c2a69631d5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:24.621023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9753f9d-5f2d-43dd-afb2-35d50bd997bc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:24.621739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9753f9d-5f2d-43dd-afb2-35d50bd997bc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:24.622291 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9753f9d-5f2d-43dd-afb2-35d50bd997bc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:24.623072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9753f9d-5f2d-43dd-afb2-35d50bd997bc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/domains/1bf9df0161c04f6db42ef2fa591a8beb` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:24.640714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9753f9d-5f2d-43dd-afb2-35d50bd997bc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1bf9df0161c04f6db42ef2fa591a8beb)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:24.642521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9753f9d-5f2d-43dd-afb2-35d50bd997bc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:24.676247 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:24.682547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f9753f9d-5f2d-43dd-afb2-35d50bd997bc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1bf9df0161c04f6db42ef2fa591a8beb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:24.705146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f9753f9d-5f2d-43dd-afb2-35d50bd997bc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1bf9df0161c04f6db42ef2fa591a8beb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:24.792404 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f9753f9d-5f2d-43dd-afb2-35d50bd997bc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bf9df0161c04f6db42ef2fa591a8beb', 'request_id': 'req-f9753f9d-5f2d-43dd-afb2-35d50bd997bc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:24.800564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f9753f9d-5f2d-43dd-afb2-35d50bd997bc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bf9df0161c04f6db42ef2fa591a8beb', 'request_id': 'req-f9753f9d-5f2d-43dd-afb2-35d50bd997bc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:24.818835 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f9753f9d-5f2d-43dd-afb2-35d50bd997bc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bf9df0161c04f6db42ef2fa591a8beb', 'request_id': 'req-f9753f9d-5f2d-43dd-afb2-35d50bd997bc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:24.857853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f9753f9d-5f2d-43dd-afb2-35d50bd997bc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] The token cache is being invalidate because project 1bf9df0161c04f6db42ef2fa591a8beb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:24.858005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f9753f9d-5f2d-43dd-afb2-35d50bd997bc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:24.861025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f9753f9d-5f2d-43dd-afb2-35d50bd997bc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:24.885611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f9753f9d-5f2d-43dd-afb2-35d50bd997bc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1bf9df0161c04f6db42ef2fa591a8beb', 'request_id': 'req-f9753f9d-5f2d-43dd-afb2-35d50bd997bc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:24.892793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f9753f9d-5f2d-43dd-afb2-35d50bd997bc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1bf9df0161c04f6db42ef2fa591a8beb', 'request_id': 'req-f9753f9d-5f2d-43dd-afb2-35d50bd997bc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:24.894607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f9753f9d-5f2d-43dd-afb2-35d50bd997bc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1bf9df0161c04f6db42ef2fa591a8beb', 'request_id': 'req-f9753f9d-5f2d-43dd-afb2-35d50bd997bc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:24.905295 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1961/3906] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:24:24 2022] DELETE /identity/v3/domains/1bf9df0161c04f6db42ef2fa591a8beb => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:24:24.909020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883e6c5-f137-4d9f-ba9e-b3b2a4d900fc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:24.910969 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3883e6c5-f137-4d9f-ba9e-b3b2a4d900fc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:24.935285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883e6c5-f137-4d9f-ba9e-b3b2a4d900fc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:25.077877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f264c51-4f92-4e4b-beee-548c31c0ed2f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:25.078550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f264c51-4f92-4e4b-beee-548c31c0ed2f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:25.081314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f264c51-4f92-4e4b-beee-548c31c0ed2f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:25.081688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f264c51-4f92-4e4b-beee-548c31c0ed2f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/058a3f3be2ee41f4a06d8f2cca7e148f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:25.085660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f264c51-4f92-4e4b-beee-548c31c0ed2f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:delete_role(role_id=058a3f3be2ee41f4a06d8f2cca7e148f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:25.087751 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-8f264c51-4f92-4e4b-beee-548c31c0ed2f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:24:25.087751 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:24:25.087751 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:24:25.091064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f264c51-4f92-4e4b-beee-548c31c0ed2f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:25.156100 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8f264c51-4f92-4e4b-beee-548c31c0ed2f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invalidating the token cache because role 058a3f3be2ee41f4a06d8f2cca7e148f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:25.156456 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8f264c51-4f92-4e4b-beee-548c31c0ed2f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:25.157111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8f264c51-4f92-4e4b-beee-548c31c0ed2f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:25.159274 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1946/3907] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:24:24 2022] DELETE /identity/v3/roles/058a3f3be2ee41f4a06d8f2cca7e148f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:24:25.163363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9753f9d-5f2d-43dd-afb2-35d50bd997bc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:25.164850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f9753f9d-5f2d-43dd-afb2-35d50bd997bc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:25.192930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9753f9d-5f2d-43dd-afb2-35d50bd997bc tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:25.364612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba2b27-b3f1-4a5e-8314-fd7b07fdf441 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:25.365399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba2b27-b3f1-4a5e-8314-fd7b07fdf441 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:25.367569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba2b27-b3f1-4a5e-8314-fd7b07fdf441 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:25.369098 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba2b27-b3f1-4a5e-8314-fd7b07fdf441 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/8511d75c05b3484185fc5acca098e3d7` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:25.373397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba2b27-b3f1-4a5e-8314-fd7b07fdf441 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8511d75c05b3484185fc5acca098e3d7)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:25.376571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba2b27-b3f1-4a5e-8314-fd7b07fdf441 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:25.506919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fdba2b27-b3f1-4a5e-8314-fd7b07fdf441 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invalidating the token cache because role 8511d75c05b3484185fc5acca098e3d7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:25.507639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fdba2b27-b3f1-4a5e-8314-fd7b07fdf441 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:25.508075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fdba2b27-b3f1-4a5e-8314-fd7b07fdf441 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:25.511954 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1962/3908] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:24:25 2022] DELETE /identity/v3/roles/8511d75c05b3484185fc5acca098e3d7 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:25.514659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f264c51-4f92-4e4b-beee-548c31c0ed2f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:25.517536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8f264c51-4f92-4e4b-beee-548c31c0ed2f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:25.545290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f264c51-4f92-4e4b-beee-548c31c0ed2f tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:25.590983 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:UPDATE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:25.723123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981557c5-3376-4cc1-9e6d-1fdb7c4926d5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a19e9347fc47c5a8aec0fcae85e1ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b72ce4d7c6cc494da25909e6dfc0560e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:25.723917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981557c5-3376-4cc1-9e6d-1fdb7c4926d5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:25.724285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981557c5-3376-4cc1-9e6d-1fdb7c4926d5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:25.724629 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981557c5-3376-4cc1-9e6d-1fdb7c4926d5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] PATH_INFO: `/v3/roles/b3dce7e63bcd404990e9477193ec382a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:25.726897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981557c5-3376-4cc1-9e6d-1fdb7c4926d5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b3dce7e63bcd404990e9477193ec382a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:25.732258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981557c5-3376-4cc1-9e6d-1fdb7c4926d5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:25.819583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-981557c5-3376-4cc1-9e6d-1fdb7c4926d5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invalidating the token cache because role b3dce7e63bcd404990e9477193ec382a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:25.820703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-981557c5-3376-4cc1-9e6d-1fdb7c4926d5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:25.821370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-981557c5-3376-4cc1-9e6d-1fdb7c4926d5 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:25.824951 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1947/3909] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:24:25 2022] DELETE /identity/v3/roles/b3dce7e63bcd404990e9477193ec382a => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:25.828382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba2b27-b3f1-4a5e-8314-fd7b07fdf441 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:25.830010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fdba2b27-b3f1-4a5e-8314-fd7b07fdf441 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:25.929839 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:26.052276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba2b27-b3f1-4a5e-8314-fd7b07fdf441 tempest-RolesV3TestJSON-1633417262 tempest-RolesV3TestJSON-1633417262-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:26.261945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b27f08-9197-4eba-8650-bf2e54bc4c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:26.262620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b27f08-9197-4eba-8650-bf2e54bc4c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:26.262905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b27f08-9197-4eba-8650-bf2e54bc4c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:26.263179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b27f08-9197-4eba-8650-bf2e54bc4c00 admin admin] PATH_INFO: `/v3/users/e46bc54b42b942129ba0730824d6f4a3` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:26.280773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b27f08-9197-4eba-8650-bf2e54bc4c00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e46bc54b42b942129ba0730824d6f4a3)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:26.282776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b27f08-9197-4eba-8650-bf2e54bc4c00 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:26.409256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-31b27f08-9197-4eba-8650-bf2e54bc4c00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e46bc54b42b942129ba0730824d6f4a3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:26.449665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-31b27f08-9197-4eba-8650-bf2e54bc4c00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e46bc54b42b942129ba0730824d6f4a3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:26.493722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-31b27f08-9197-4eba-8650-bf2e54bc4c00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e46bc54b42b942129ba0730824d6f4a3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:26.498450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-31b27f08-9197-4eba-8650-bf2e54bc4c00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e46bc54b42b942129ba0730824d6f4a3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:26.515619 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-31b27f08-9197-4eba-8650-bf2e54bc4c00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e46bc54b42b942129ba0730824d6f4a3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:26.523931 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1963/3910] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:24:25 2022] DELETE /identity/v3/users/e46bc54b42b942129ba0730824d6f4a3 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:26.530078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456bc71-d1d7-4132-8b60-9fc353180000 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:26.531975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456bc71-d1d7-4132-8b60-9fc353180000 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:26.532472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456bc71-d1d7-4132-8b60-9fc353180000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:26.581286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d456bc71-d1d7-4132-8b60-9fc353180000 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:26.583641 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d456bc71-d1d7-4132-8b60-9fc353180000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:26.846602 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1948/3911] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:26.879501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b27f08-9197-4eba-8650-bf2e54bc4c00 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:26.881615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-31b27f08-9197-4eba-8650-bf2e54bc4c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:27.049876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b27f08-9197-4eba-8650-bf2e54bc4c00 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:27.060205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade46534-417b-49b1-8db2-85c9e1e91525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:27.061374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade46534-417b-49b1-8db2-85c9e1e91525 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:27.061998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade46534-417b-49b1-8db2-85c9e1e91525 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:27.064521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade46534-417b-49b1-8db2-85c9e1e91525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:27.091582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade46534-417b-49b1-8db2-85c9e1e91525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:27.093094 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade46534-417b-49b1-8db2-85c9e1e91525 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:27.116872 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:27.145246 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1964/3912] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:24:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:24:27.685369 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456bc71-d1d7-4132-8b60-9fc353180000 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:27.686874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d456bc71-d1d7-4132-8b60-9fc353180000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:27.702239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456bc71-d1d7-4132-8b60-9fc353180000 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:27.718945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51886411-b19a-45d8-8cfa-965de49c9447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:27.719612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51886411-b19a-45d8-8cfa-965de49c9447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:27.719913 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51886411-b19a-45d8-8cfa-965de49c9447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:27.721621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51886411-b19a-45d8-8cfa-965de49c9447 admin admin] PATH_INFO: `/v3/users/2185c595c9df4719bdca76d8797c76e3` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:27.722899 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51886411-b19a-45d8-8cfa-965de49c9447 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2185c595c9df4719bdca76d8797c76e3)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:27.724922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51886411-b19a-45d8-8cfa-965de49c9447 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:27.877581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-51886411-b19a-45d8-8cfa-965de49c9447 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2185c595c9df4719bdca76d8797c76e3'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:27.904243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-51886411-b19a-45d8-8cfa-965de49c9447 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2185c595c9df4719bdca76d8797c76e3'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:27.940858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-51886411-b19a-45d8-8cfa-965de49c9447 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2185c595c9df4719bdca76d8797c76e3'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:27.942604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-51886411-b19a-45d8-8cfa-965de49c9447 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2185c595c9df4719bdca76d8797c76e3'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:27.946429 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:DELETE=12 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:27.964906 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-51886411-b19a-45d8-8cfa-965de49c9447 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2185c595c9df4719bdca76d8797c76e3'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:27.973073 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1949/3913] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:24:27 2022] DELETE /identity/v3/users/2185c595c9df4719bdca76d8797c76e3 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:28.208321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade46534-417b-49b1-8db2-85c9e1e91525 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:28.211256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ade46534-417b-49b1-8db2-85c9e1e91525 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:28.245772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade46534-417b-49b1-8db2-85c9e1e91525 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:28.363998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f1e67-9a6c-4b1e-9c02-9b5ca73217c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:28.364472 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f1e67-9a6c-4b1e-9c02-9b5ca73217c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:28.364755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f1e67-9a6c-4b1e-9c02-9b5ca73217c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:28.365031 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f1e67-9a6c-4b1e-9c02-9b5ca73217c4 admin admin] PATH_INFO: `/v3/projects/e1389822ae55456696cc536b3c4e4213` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:28.366582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f1e67-9a6c-4b1e-9c02-9b5ca73217c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1389822ae55456696cc536b3c4e4213)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:28.369984 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f1e67-9a6c-4b1e-9c02-9b5ca73217c4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:28.531266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b69f1e67-9a6c-4b1e-9c02-9b5ca73217c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1389822ae55456696cc536b3c4e4213', 'request_id': 'req-b69f1e67-9a6c-4b1e-9c02-9b5ca73217c4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:28.538128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b69f1e67-9a6c-4b1e-9c02-9b5ca73217c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1389822ae55456696cc536b3c4e4213', 'request_id': 'req-b69f1e67-9a6c-4b1e-9c02-9b5ca73217c4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:28.551391 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b69f1e67-9a6c-4b1e-9c02-9b5ca73217c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1389822ae55456696cc536b3c4e4213', 'request_id': 'req-b69f1e67-9a6c-4b1e-9c02-9b5ca73217c4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:28.571701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b69f1e67-9a6c-4b1e-9c02-9b5ca73217c4 admin admin] The token cache is being invalidate because project e1389822ae55456696cc536b3c4e4213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:28.572236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b69f1e67-9a6c-4b1e-9c02-9b5ca73217c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:28.573488 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b69f1e67-9a6c-4b1e-9c02-9b5ca73217c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:28.575413 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1965/3914] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:24:28 2022] DELETE /identity/v3/projects/e1389822ae55456696cc536b3c4e4213 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:28.579209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51886411-b19a-45d8-8cfa-965de49c9447 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:28.581250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-51886411-b19a-45d8-8cfa-965de49c9447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:28.601886 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51886411-b19a-45d8-8cfa-965de49c9447 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:28.745893 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3b693-92d7-48bd-beb0-4e234dcf4be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:28.748492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3b693-92d7-48bd-beb0-4e234dcf4be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:28.748988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3b693-92d7-48bd-beb0-4e234dcf4be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:28.749440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3b693-92d7-48bd-beb0-4e234dcf4be6 admin admin] PATH_INFO: `/v3/users/c3a19e9347fc47c5a8aec0fcae85e1ac` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:28.751147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3b693-92d7-48bd-beb0-4e234dcf4be6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3a19e9347fc47c5a8aec0fcae85e1ac)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:28.753323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3b693-92d7-48bd-beb0-4e234dcf4be6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:28.856953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cef3b693-92d7-48bd-beb0-4e234dcf4be6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3a19e9347fc47c5a8aec0fcae85e1ac'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:28.879321 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cef3b693-92d7-48bd-beb0-4e234dcf4be6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3a19e9347fc47c5a8aec0fcae85e1ac'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:28.909163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cef3b693-92d7-48bd-beb0-4e234dcf4be6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3a19e9347fc47c5a8aec0fcae85e1ac'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:28.911006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cef3b693-92d7-48bd-beb0-4e234dcf4be6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3a19e9347fc47c5a8aec0fcae85e1ac'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:28.924409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cef3b693-92d7-48bd-beb0-4e234dcf4be6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3a19e9347fc47c5a8aec0fcae85e1ac'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:28.936863 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1950/3915] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:24:28 2022] DELETE /identity/v3/users/c3a19e9347fc47c5a8aec0fcae85e1ac => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:29.198189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f1e67-9a6c-4b1e-9c02-9b5ca73217c4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:29.202787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b69f1e67-9a6c-4b1e-9c02-9b5ca73217c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:29.237366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f1e67-9a6c-4b1e-9c02-9b5ca73217c4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:29.356471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06bae6b-227b-4a02-848e-90c74d6774a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:29.357704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bae6b-227b-4a02-848e-90c74d6774a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:29.357964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bae6b-227b-4a02-848e-90c74d6774a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:29.358306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06bae6b-227b-4a02-848e-90c74d6774a9 admin admin] PATH_INFO: `/v3/projects/6a5267b6a8e34a4397cd94fae11283be` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:29.359602 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06bae6b-227b-4a02-848e-90c74d6774a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a5267b6a8e34a4397cd94fae11283be)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:29.362002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06bae6b-227b-4a02-848e-90c74d6774a9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:29.427062 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:29.463195 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d06bae6b-227b-4a02-848e-90c74d6774a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a5267b6a8e34a4397cd94fae11283be', 'request_id': 'req-d06bae6b-227b-4a02-848e-90c74d6774a9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:29.474179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d06bae6b-227b-4a02-848e-90c74d6774a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a5267b6a8e34a4397cd94fae11283be', 'request_id': 'req-d06bae6b-227b-4a02-848e-90c74d6774a9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:29.489447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d06bae6b-227b-4a02-848e-90c74d6774a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a5267b6a8e34a4397cd94fae11283be', 'request_id': 'req-d06bae6b-227b-4a02-848e-90c74d6774a9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:29.519904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d06bae6b-227b-4a02-848e-90c74d6774a9 admin admin] The token cache is being invalidate because project 6a5267b6a8e34a4397cd94fae11283be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:29.520541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d06bae6b-227b-4a02-848e-90c74d6774a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:29.521818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d06bae6b-227b-4a02-848e-90c74d6774a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:29.525097 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1966/3916] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:24:29 2022] DELETE /identity/v3/projects/6a5267b6a8e34a4397cd94fae11283be => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:29.530419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38e769-7187-49a4-95d2-8b498f705db6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:29.530729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38e769-7187-49a4-95d2-8b498f705db6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:29.531534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38e769-7187-49a4-95d2-8b498f705db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:29.567099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0c38e769-7187-49a4-95d2-8b498f705db6 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:29.568526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0c38e769-7187-49a4-95d2-8b498f705db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:29.651640 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1951/3917] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:29.654792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc795ebd-94a2-4e9b-9e76-3c763cfac0ba None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:29.655286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc795ebd-94a2-4e9b-9e76-3c763cfac0ba None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:29.655753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc795ebd-94a2-4e9b-9e76-3c763cfac0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:29.679822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-cc795ebd-94a2-4e9b-9e76-3c763cfac0ba None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:29.681127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-cc795ebd-94a2-4e9b-9e76-3c763cfac0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:29.700957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38e769-7187-49a4-95d2-8b498f705db6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:29.701688 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1967/3918] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:29.712332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38e769-7187-49a4-95d2-8b498f705db6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:29.719872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff20a24-2beb-4745-978a-2fd935aafcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:29.720886 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff20a24-2beb-4745-978a-2fd935aafcd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:29.722040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff20a24-2beb-4745-978a-2fd935aafcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:29.722488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff20a24-2beb-4745-978a-2fd935aafcd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:29.723338 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff20a24-2beb-4745-978a-2fd935aafcd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:24:29.723796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff20a24-2beb-4745-978a-2fd935aafcd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:29.727020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff20a24-2beb-4745-978a-2fd935aafcd6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:29.739177 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:29.748105 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1952/3919] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:24:29.753641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc795ebd-94a2-4e9b-9e76-3c763cfac0ba None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:29.765601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc795ebd-94a2-4e9b-9e76-3c763cfac0ba None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:29.770781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcef415-3879-455f-9d66-77f194c48a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:29.771401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcef415-3879-455f-9d66-77f194c48a54 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:29.771682 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcef415-3879-455f-9d66-77f194c48a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:29.771991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcef415-3879-455f-9d66-77f194c48a54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:29.773084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcef415-3879-455f-9d66-77f194c48a54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:29.775049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcef415-3879-455f-9d66-77f194c48a54 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:29.824230 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff20a24-2beb-4745-978a-2fd935aafcd6 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:29.825673 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1968/3920] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:24:29 2022] POST /identity/v3/projects => generated 379 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:29.843104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff20a24-2beb-4745-978a-2fd935aafcd6 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:29.975464 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a60899-0a7f-489b-882a-5bb20d9f04da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:29.976060 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a60899-0a7f-489b-882a-5bb20d9f04da admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:29.976342 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a60899-0a7f-489b-882a-5bb20d9f04da admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:29.976615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a60899-0a7f-489b-882a-5bb20d9f04da admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:29.977278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a60899-0a7f-489b-882a-5bb20d9f04da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:29.982134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a60899-0a7f-489b-882a-5bb20d9f04da admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:30.029999 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1953/3921] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:24:29 2022] POST /identity/v3/users => generated 290 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:24:30.035172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcef415-3879-455f-9d66-77f194c48a54 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:30.048988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcef415-3879-455f-9d66-77f194c48a54 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:30.057229 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd16481-df89-4439-a1f0-dc0e32d2609a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:30.057975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd16481-df89-4439-a1f0-dc0e32d2609a admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:30.058363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd16481-df89-4439-a1f0-dc0e32d2609a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:30.058810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd16481-df89-4439-a1f0-dc0e32d2609a admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:30.059736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd16481-df89-4439-a1f0-dc0e32d2609a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:30.061700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd16481-df89-4439-a1f0-dc0e32d2609a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:30.077177 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1969/3922] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:30.078320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a60899-0a7f-489b-882a-5bb20d9f04da admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:30.089667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a60899-0a7f-489b-882a-5bb20d9f04da admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:30.096259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94262fcf-57ec-410a-a385-8377294cffa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:30.096897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94262fcf-57ec-410a-a385-8377294cffa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:30.097559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94262fcf-57ec-410a-a385-8377294cffa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:30.097999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94262fcf-57ec-410a-a385-8377294cffa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:30.098689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94262fcf-57ec-410a-a385-8377294cffa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:30.100661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94262fcf-57ec-410a-a385-8377294cffa6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:30.115028 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1954/3923] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:24:30.119863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd16481-df89-4439-a1f0-dc0e32d2609a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:30.138145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd16481-df89-4439-a1f0-dc0e32d2609a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:30.165747 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a80a71-1c99-4d61-9157-8751fbca6ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:30.167521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a80a71-1c99-4d61-9157-8751fbca6ceb admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:30.167852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a80a71-1c99-4d61-9157-8751fbca6ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:30.168463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a80a71-1c99-4d61-9157-8751fbca6ceb admin admin] PATH_INFO: `/v3/projects/5506f7c95c1a46c5b3966597764b0111/users/d1f0c01c340940388b440932d51988ff/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:30.221969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a80a71-1c99-4d61-9157-8751fbca6ceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5506f7c95c1a46c5b3966597764b0111, user_id=d1f0c01c340940388b440932d51988ff, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:30.225828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a80a71-1c99-4d61-9157-8751fbca6ceb admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:30.260794 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1970/3924] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:24:30 2022] PUT /identity/v3/projects/5506f7c95c1a46c5b3966597764b0111/users/d1f0c01c340940388b440932d51988ff/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:30.266170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd0513-04c4-4ad0-84bd-3fb135f8a323 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:30.266559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd0513-04c4-4ad0-84bd-3fb135f8a323 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:30.267425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd0513-04c4-4ad0-84bd-3fb135f8a323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:30.294021 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3dcd0513-04c4-4ad0-84bd-3fb135f8a323 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:30.295821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3dcd0513-04c4-4ad0-84bd-3fb135f8a323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:30.427937 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1955/3925] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:30.461001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a80a71-1c99-4d61-9157-8751fbca6ceb admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:30.473187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-35a80a71-1c99-4d61-9157-8751fbca6ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:30.761502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a80a71-1c99-4d61-9157-8751fbca6ceb admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:30.787173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cda084-cbeb-4bac-9719-cd012e345da8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:30.787918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cda084-cbeb-4bac-9719-cd012e345da8 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:30.788224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cda084-cbeb-4bac-9719-cd012e345da8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:30.789655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cda084-cbeb-4bac-9719-cd012e345da8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:30.848789 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cda084-cbeb-4bac-9719-cd012e345da8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:30.854021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cda084-cbeb-4bac-9719-cd012e345da8 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:30.883994 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1971/3926] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:24:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:24:31.787965 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd0513-04c4-4ad0-84bd-3fb135f8a323 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:31.790042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3dcd0513-04c4-4ad0-84bd-3fb135f8a323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:31.813827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd0513-04c4-4ad0-84bd-3fb135f8a323 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:31.823799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcadb90-6220-413e-89b0-72f47d83fef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:31.824736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcadb90-6220-413e-89b0-72f47d83fef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:31.826122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcadb90-6220-413e-89b0-72f47d83fef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:31.826768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcadb90-6220-413e-89b0-72f47d83fef6 admin admin] PATH_INFO: `/v3/projects/b72ce4d7c6cc494da25909e6dfc0560e` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:31.828455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcadb90-6220-413e-89b0-72f47d83fef6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b72ce4d7c6cc494da25909e6dfc0560e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:31.830655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcadb90-6220-413e-89b0-72f47d83fef6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:31.945285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5fcadb90-6220-413e-89b0-72f47d83fef6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b72ce4d7c6cc494da25909e6dfc0560e', 'request_id': 'req-5fcadb90-6220-413e-89b0-72f47d83fef6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:31.962871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5fcadb90-6220-413e-89b0-72f47d83fef6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b72ce4d7c6cc494da25909e6dfc0560e', 'request_id': 'req-5fcadb90-6220-413e-89b0-72f47d83fef6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:31.972284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5fcadb90-6220-413e-89b0-72f47d83fef6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b72ce4d7c6cc494da25909e6dfc0560e', 'request_id': 'req-5fcadb90-6220-413e-89b0-72f47d83fef6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:31.984170 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:31.990598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5fcadb90-6220-413e-89b0-72f47d83fef6 admin admin] The token cache is being invalidate because project b72ce4d7c6cc494da25909e6dfc0560e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:31.991316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5fcadb90-6220-413e-89b0-72f47d83fef6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:31.992723 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5fcadb90-6220-413e-89b0-72f47d83fef6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:31.995500 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1956/3927] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:24:31 2022] DELETE /identity/v3/projects/b72ce4d7c6cc494da25909e6dfc0560e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:32.000271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d782d2-82b9-481e-b3e6-9cd10aeefdf7 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:32.002803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d782d2-82b9-481e-b3e6-9cd10aeefdf7 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:32.003271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d782d2-82b9-481e-b3e6-9cd10aeefdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:32.039815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c2d782d2-82b9-481e-b3e6-9cd10aeefdf7 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:32.052363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c2d782d2-82b9-481e-b3e6-9cd10aeefdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:32.185721 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:32.230115 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1972/3928] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:32.234542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22538ec5-e275-41a2-b884-1ee38293548a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:32.235112 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22538ec5-e275-41a2-b884-1ee38293548a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:32.235300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22538ec5-e275-41a2-b884-1ee38293548a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:32.294055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-22538ec5-e275-41a2-b884-1ee38293548a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:32.298158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-22538ec5-e275-41a2-b884-1ee38293548a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:32.333842 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1957/3929] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:32.338168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d782d2-82b9-481e-b3e6-9cd10aeefdf7 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:32.364093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d782d2-82b9-481e-b3e6-9cd10aeefdf7 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:32.395703 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ae5bb-dede-4a22-8734-0ff79a2f110f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:32.400786 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ae5bb-dede-4a22-8734-0ff79a2f110f admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:32.409599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ae5bb-dede-4a22-8734-0ff79a2f110f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:32.412649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ae5bb-dede-4a22-8734-0ff79a2f110f admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:32.413667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ae5bb-dede-4a22-8734-0ff79a2f110f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:24:32.415509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ae5bb-dede-4a22-8734-0ff79a2f110f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:32.424535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ae5bb-dede-4a22-8734-0ff79a2f110f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:32.477425 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1973/3930] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:24:32.478871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22538ec5-e275-41a2-b884-1ee38293548a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:32.494908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22538ec5-e275-41a2-b884-1ee38293548a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:32.506119 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f53fb5-3988-4244-8d60-372d2b96d87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:32.506747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f53fb5-3988-4244-8d60-372d2b96d87a admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:32.507056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f53fb5-3988-4244-8d60-372d2b96d87a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:32.508479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f53fb5-3988-4244-8d60-372d2b96d87a admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:32.508914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f53fb5-3988-4244-8d60-372d2b96d87a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:32.510864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f53fb5-3988-4244-8d60-372d2b96d87a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:32.567433 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1958/3931] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:24:32 2022] POST /identity/v3/projects => generated 379 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:32.568157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ae5bb-dede-4a22-8734-0ff79a2f110f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:32.598299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ae5bb-dede-4a22-8734-0ff79a2f110f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:32.745930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e286aea-cfd9-4955-9229-29440d64fc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:32.746646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e286aea-cfd9-4955-9229-29440d64fc29 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:32.746929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e286aea-cfd9-4955-9229-29440d64fc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:32.747377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e286aea-cfd9-4955-9229-29440d64fc29 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:32.748071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e286aea-cfd9-4955-9229-29440d64fc29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:32.750417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e286aea-cfd9-4955-9229-29440d64fc29 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:32.806148 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1974/3932] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:24:32 2022] POST /identity/v3/users => generated 290 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:32.810281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f53fb5-3988-4244-8d60-372d2b96d87a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:32.825434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f53fb5-3988-4244-8d60-372d2b96d87a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:32.832600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3d6ca-f19c-4063-90e9-dd2bc62ee91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:32.833448 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3d6ca-f19c-4063-90e9-dd2bc62ee91a admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:32.833837 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3d6ca-f19c-4063-90e9-dd2bc62ee91a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:32.834217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3d6ca-f19c-4063-90e9-dd2bc62ee91a admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:32.835122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3d6ca-f19c-4063-90e9-dd2bc62ee91a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:32.836982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3d6ca-f19c-4063-90e9-dd2bc62ee91a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:32.852800 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1959/3933] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:32.857221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e286aea-cfd9-4955-9229-29440d64fc29 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:32.876216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e286aea-cfd9-4955-9229-29440d64fc29 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:32.890616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da30e8-0917-4393-b94f-2cd44505f06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:32.891270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da30e8-0917-4393-b94f-2cd44505f06f admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:32.891749 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da30e8-0917-4393-b94f-2cd44505f06f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:32.892209 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da30e8-0917-4393-b94f-2cd44505f06f admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:32.893077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da30e8-0917-4393-b94f-2cd44505f06f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:32.895907 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da30e8-0917-4393-b94f-2cd44505f06f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:32.916176 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1975/3934] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:32.920400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3d6ca-f19c-4063-90e9-dd2bc62ee91a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:32.940553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3d6ca-f19c-4063-90e9-dd2bc62ee91a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:32.954181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7289db5-a3ca-4e54-bd78-96b510a813f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:32.955195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7289db5-a3ca-4e54-bd78-96b510a813f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:32.955580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7289db5-a3ca-4e54-bd78-96b510a813f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:32.956308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7289db5-a3ca-4e54-bd78-96b510a813f7 admin admin] PATH_INFO: `/v3/projects/21fded12d8164e91b7fe3c8d70ed7cfd/users/e99cfbb3ed8044dc8c88f5e761ecaa32/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:33.017429 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7289db5-a3ca-4e54-bd78-96b510a813f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21fded12d8164e91b7fe3c8d70ed7cfd, user_id=e99cfbb3ed8044dc8c88f5e761ecaa32, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:33.027683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7289db5-a3ca-4e54-bd78-96b510a813f7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:33.103931 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1960/3935] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:24:32 2022] PUT /identity/v3/projects/21fded12d8164e91b7fe3c8d70ed7cfd/users/e99cfbb3ed8044dc8c88f5e761ecaa32/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:33.111768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfe707-6f0e-4997-bb0b-1d654c5f41fe None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:33.112214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfe707-6f0e-4997-bb0b-1d654c5f41fe None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:33.112504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfe707-6f0e-4997-bb0b-1d654c5f41fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:33.132402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c05ff-a969-4acf-a924-421eb149798b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:33.132800 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c05ff-a969-4acf-a924-421eb149798b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:33.133173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c05ff-a969-4acf-a924-421eb149798b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:33.197912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6a1c05ff-a969-4acf-a924-421eb149798b None None] MFA Rules not processed for user `e379b67e2bb248b3ad25b92b2082b0fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:33.200325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c1dfe707-6f0e-4997-bb0b-1d654c5f41fe None None] MFA Rules not processed for user `e99cfbb3ed8044dc8c88f5e761ecaa32`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:33.201573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c1dfe707-6f0e-4997-bb0b-1d654c5f41fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:33.202733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6a1c05ff-a969-4acf-a924-421eb149798b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:33.403694 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1961/3936] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:33.403694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c05ff-a969-4acf-a924-421eb149798b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:33.405230 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6a1c05ff-a969-4acf-a924-421eb149798b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:33.495344 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1976/3937] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:33.496684 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfe707-6f0e-4997-bb0b-1d654c5f41fe None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:33.520346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfe707-6f0e-4997-bb0b-1d654c5f41fe None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:33.526644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c05ff-a969-4acf-a924-421eb149798b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:33.532281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0242c-0b56-4deb-b2dc-48108e98d715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:33.539585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0242c-0b56-4deb-b2dc-48108e98d715 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:33.540147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0242c-0b56-4deb-b2dc-48108e98d715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:33.540518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0242c-0b56-4deb-b2dc-48108e98d715 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:33.540687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4f2ff-9147-45f9-8082-283252222967 tempest-DefaultDomainTestJSON-1740361158 tempest-DefaultDomainTestJSON-1740361158-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e99cfbb3ed8044dc8c88f5e761ecaa32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fded12d8164e91b7fe3c8d70ed7cfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:33.541724 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4f2ff-9147-45f9-8082-283252222967 tempest-DefaultDomainTestJSON-1740361158 tempest-DefaultDomainTestJSON-1740361158-project] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:33.542169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4f2ff-9147-45f9-8082-283252222967 tempest-DefaultDomainTestJSON-1740361158 tempest-DefaultDomainTestJSON-1740361158-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:33.542605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4f2ff-9147-45f9-8082-283252222967 tempest-DefaultDomainTestJSON-1740361158 tempest-DefaultDomainTestJSON-1740361158-project] PATH_INFO: `/v3/domains/default` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:33.543992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0242c-0b56-4deb-b2dc-48108e98d715 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:33.546504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0242c-0b56-4deb-b2dc-48108e98d715 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:33.548506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4f2ff-9147-45f9-8082-283252222967 tempest-DefaultDomainTestJSON-1740361158 tempest-DefaultDomainTestJSON-1740361158-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:33.551610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4f2ff-9147-45f9-8082-283252222967 tempest-DefaultDomainTestJSON-1740361158 tempest-DefaultDomainTestJSON-1740361158-project] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:33.558340 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1977/3938] 10.222.0.39 () {58 vars in 1152 bytes} [Sun Aug 7 01:24:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:24:33.559685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4f2ff-9147-45f9-8082-283252222967 tempest-DefaultDomainTestJSON-1740361158 tempest-DefaultDomainTestJSON-1740361158-project] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:33.588514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4f2ff-9147-45f9-8082-283252222967 tempest-DefaultDomainTestJSON-1740361158 tempest-DefaultDomainTestJSON-1740361158-project] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:33.601310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80f02d-26f7-454a-a472-221d4521e39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:33.602043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80f02d-26f7-454a-a472-221d4521e39e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:33.602324 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80f02d-26f7-454a-a472-221d4521e39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:33.602596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80f02d-26f7-454a-a472-221d4521e39e admin admin] PATH_INFO: `/v3/users/e99cfbb3ed8044dc8c88f5e761ecaa32` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:33.604559 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80f02d-26f7-454a-a472-221d4521e39e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e99cfbb3ed8044dc8c88f5e761ecaa32)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:33.606854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80f02d-26f7-454a-a472-221d4521e39e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:33.622534 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1962/3939] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:24:33 2022] POST /identity/v3/projects => generated 379 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:33.624561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0242c-0b56-4deb-b2dc-48108e98d715 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:33.669052 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:33.718426 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:33.725970 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4a80f02d-26f7-454a-a472-221d4521e39e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e99cfbb3ed8044dc8c88f5e761ecaa32'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:33.743708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4a80f02d-26f7-454a-a472-221d4521e39e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e99cfbb3ed8044dc8c88f5e761ecaa32'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:33.769256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4a80f02d-26f7-454a-a472-221d4521e39e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e99cfbb3ed8044dc8c88f5e761ecaa32'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:33.770077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4a80f02d-26f7-454a-a472-221d4521e39e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e99cfbb3ed8044dc8c88f5e761ecaa32'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:33.786678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4a80f02d-26f7-454a-a472-221d4521e39e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e99cfbb3ed8044dc8c88f5e761ecaa32'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:33.801562 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1978/3940] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:24:33 2022] DELETE /identity/v3/users/e99cfbb3ed8044dc8c88f5e761ecaa32 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:33.801769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0242c-0b56-4deb-b2dc-48108e98d715 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:33.803518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fb0f1-36e2-4654-b083-ea43e5c71809 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:33.804855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fb0f1-36e2-4654-b083-ea43e5c71809 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:33.805208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8fb0f1-36e2-4654-b083-ea43e5c71809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:33.858636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1d8fb0f1-36e2-4654-b083-ea43e5c71809 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:33.864780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1d8fb0f1-36e2-4654-b083-ea43e5c71809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:33.971878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941bbe7b-20c5-4a69-86df-8cb4c65b3f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:33.974061 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bbe7b-20c5-4a69-86df-8cb4c65b3f12 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:33.974345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bbe7b-20c5-4a69-86df-8cb4c65b3f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:33.974621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bbe7b-20c5-4a69-86df-8cb4c65b3f12 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:33.975277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941bbe7b-20c5-4a69-86df-8cb4c65b3f12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:33.977813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941bbe7b-20c5-4a69-86df-8cb4c65b3f12 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:33.980546 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1979/3941] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:24:34.003996 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1963/3942] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:24:33 2022] POST /identity/v3/users => generated 296 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:34.008349 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fb0f1-36e2-4654-b083-ea43e5c71809 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:34.009947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1d8fb0f1-36e2-4654-b083-ea43e5c71809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:34.028680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8fb0f1-36e2-4654-b083-ea43e5c71809 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:34.035789 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349df77-c7a0-41c0-8003-aad463fa9c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:34.036656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349df77-c7a0-41c0-8003-aad463fa9c75 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:34.037627 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349df77-c7a0-41c0-8003-aad463fa9c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:34.039081 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349df77-c7a0-41c0-8003-aad463fa9c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:34.039388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349df77-c7a0-41c0-8003-aad463fa9c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:34.041446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1349df77-c7a0-41c0-8003-aad463fa9c75 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:34.059378 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1980/3943] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:34.064482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941bbe7b-20c5-4a69-86df-8cb4c65b3f12 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:34.082343 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941bbe7b-20c5-4a69-86df-8cb4c65b3f12 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:34.098256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8fd15-e68e-43c5-84e5-519db326a397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:34.099748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8fd15-e68e-43c5-84e5-519db326a397 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:34.113654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8fd15-e68e-43c5-84e5-519db326a397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:34.114292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8fd15-e68e-43c5-84e5-519db326a397 admin admin] PATH_INFO: `/v3/projects/12f2a54d02844f298a67df95bc9d2cc4/users/1b8bc98d6fe04713bbbc0628b8e527b9/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:34.118755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349df77-c7a0-41c0-8003-aad463fa9c75 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:34.120675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1349df77-c7a0-41c0-8003-aad463fa9c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:34.143117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8fd15-e68e-43c5-84e5-519db326a397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12f2a54d02844f298a67df95bc9d2cc4, user_id=1b8bc98d6fe04713bbbc0628b8e527b9, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:34.155443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8fd15-e68e-43c5-84e5-519db326a397 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:34.201526 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1964/3944] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:24:34 2022] PUT /identity/v3/projects/12f2a54d02844f298a67df95bc9d2cc4/users/1b8bc98d6fe04713bbbc0628b8e527b9/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:34.213772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8fd15-e68e-43c5-84e5-519db326a397 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:34.290542 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349df77-c7a0-41c0-8003-aad463fa9c75 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:34.349552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8fd15-e68e-43c5-84e5-519db326a397 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:34.414677 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd1461-fcaf-4cac-96a9-d940c0bfa0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:34.416604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd1461-fcaf-4cac-96a9-d940c0bfa0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:34.419614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd1461-fcaf-4cac-96a9-d940c0bfa0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:34.427762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18758b6-b3ad-4172-99f5-4fb8e31e29f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:34.428128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18758b6-b3ad-4172-99f5-4fb8e31e29f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:34.428498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18758b6-b3ad-4172-99f5-4fb8e31e29f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:34.428875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18758b6-b3ad-4172-99f5-4fb8e31e29f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:34.448821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd1461-fcaf-4cac-96a9-d940c0bfa0f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:34.451749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd1461-fcaf-4cac-96a9-d940c0bfa0f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:34.462691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd1461-fcaf-4cac-96a9-d940c0bfa0f8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:34.469739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18758b6-b3ad-4172-99f5-4fb8e31e29f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:34.471158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18758b6-b3ad-4172-99f5-4fb8e31e29f3 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:34.517883 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1981/3945] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:24:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:24:34.524025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbb98a-4da6-4a80-b2cd-1f7f386f4ea1 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:34.524316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbb98a-4da6-4a80-b2cd-1f7f386f4ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:34.524598 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbb98a-4da6-4a80-b2cd-1f7f386f4ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:34.529933 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1965/3946] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:34.533865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd1461-fcaf-4cac-96a9-d940c0bfa0f8 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:34.588258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd1461-fcaf-4cac-96a9-d940c0bfa0f8 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:34.589804 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:34.614887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebe26d-1db3-48a1-aeb5-251fe9a4d76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:34.617379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c9cbb98a-4da6-4a80-b2cd-1f7f386f4ea1 None None] MFA Rules not processed for user `106559a2b8754c54b1c41ba8cadd1a97`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:34.618734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c9cbb98a-4da6-4a80-b2cd-1f7f386f4ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:34.619519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebe26d-1db3-48a1-aeb5-251fe9a4d76c admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:34.621519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebe26d-1db3-48a1-aeb5-251fe9a4d76c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:34.621801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebe26d-1db3-48a1-aeb5-251fe9a4d76c admin admin] PATH_INFO: `/v3/projects/12f2a54d02844f298a67df95bc9d2cc4/users/1b8bc98d6fe04713bbbc0628b8e527b9/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:34.635191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ebe26d-1db3-48a1-aeb5-251fe9a4d76c admin admin] RBAC: Authorizing `identity:create_grant(project_id=12f2a54d02844f298a67df95bc9d2cc4, user_id=1b8bc98d6fe04713bbbc0628b8e527b9, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:34.645048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ebe26d-1db3-48a1-aeb5-251fe9a4d76c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:34.688649 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1966/3947] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:24:34 2022] PUT /identity/v3/projects/12f2a54d02844f298a67df95bc9d2cc4/users/1b8bc98d6fe04713bbbc0628b8e527b9/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:34.755587 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1982/3948] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:34.760473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebe26d-1db3-48a1-aeb5-251fe9a4d76c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:34.763373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-09ebe26d-1db3-48a1-aeb5-251fe9a4d76c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:34.790435 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:34.987688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebe26d-1db3-48a1-aeb5-251fe9a4d76c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:35.000776 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad9b99-ce18-42ee-b327-1a03e5805d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:35.001579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad9b99-ce18-42ee-b327-1a03e5805d62 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:35.002401 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad9b99-ce18-42ee-b327-1a03e5805d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:35.002401 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad9b99-ce18-42ee-b327-1a03e5805d62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:35.002953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad9b99-ce18-42ee-b327-1a03e5805d62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:35.005295 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad9b99-ce18-42ee-b327-1a03e5805d62 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:35.100284 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1967/3949] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:24:34 2022] POST /identity/v3/projects => generated 389 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:35.104795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbb98a-4da6-4a80-b2cd-1f7f386f4ea1 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:35.121197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbb98a-4da6-4a80-b2cd-1f7f386f4ea1 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:35.199346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b7df8-4a78-4ebb-9470-c3f7e56ff498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:35.200382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b7df8-4a78-4ebb-9470-c3f7e56ff498 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:35.200900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b7df8-4a78-4ebb-9470-c3f7e56ff498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:35.201363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b7df8-4a78-4ebb-9470-c3f7e56ff498 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:35.202196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b7df8-4a78-4ebb-9470-c3f7e56ff498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:35.205088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b7df8-4a78-4ebb-9470-c3f7e56ff498 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:35.241800 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1983/3950] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:24:35 2022] POST /identity/v3/users => generated 301 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:24:35.242644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad9b99-ce18-42ee-b327-1a03e5805d62 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:35.263045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad9b99-ce18-42ee-b327-1a03e5805d62 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:35.273264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9093be-3ee1-43af-a257-3adde0b40dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:35.274910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9093be-3ee1-43af-a257-3adde0b40dbc admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:35.275200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9093be-3ee1-43af-a257-3adde0b40dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:35.278313 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9093be-3ee1-43af-a257-3adde0b40dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:35.279184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9093be-3ee1-43af-a257-3adde0b40dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:35.283220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9093be-3ee1-43af-a257-3adde0b40dbc admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:35.315011 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1968/3951] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:35.320533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b7df8-4a78-4ebb-9470-c3f7e56ff498 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:35.330892 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b7df8-4a78-4ebb-9470-c3f7e56ff498 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:35.349960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80636d-9e8c-4ef9-ab70-bb30889b6da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:35.351417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80636d-9e8c-4ef9-ab70-bb30889b6da3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:35.351760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80636d-9e8c-4ef9-ab70-bb30889b6da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:35.352097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80636d-9e8c-4ef9-ab70-bb30889b6da3 admin admin] PATH_INFO: `/v3/projects/50b356beea2a4ca1af5f25d44889d5ac/users/8acd01b11fea4952b8832c62b874cac6/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:35.392765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80636d-9e8c-4ef9-ab70-bb30889b6da3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50b356beea2a4ca1af5f25d44889d5ac, user_id=8acd01b11fea4952b8832c62b874cac6, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:35.395664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80636d-9e8c-4ef9-ab70-bb30889b6da3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:35.423462 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1984/3952] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:24:35 2022] PUT /identity/v3/projects/50b356beea2a4ca1af5f25d44889d5ac/users/8acd01b11fea4952b8832c62b874cac6/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:35.428352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9093be-3ee1-43af-a257-3adde0b40dbc admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:35.473380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9093be-3ee1-43af-a257-3adde0b40dbc admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:35.541974 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80636d-9e8c-4ef9-ab70-bb30889b6da3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:35.667230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80636d-9e8c-4ef9-ab70-bb30889b6da3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:35.677731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc4d66-aa18-4901-bc84-2dfa165eafef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:35.679607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc4d66-aa18-4901-bc84-2dfa165eafef service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:35.679607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc4d66-aa18-4901-bc84-2dfa165eafef service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:35.679845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc4d66-aa18-4901-bc84-2dfa165eafef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:35.684850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-56dc4d66-aa18-4901-bc84-2dfa165eafef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:35.703460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b1e58-0d3b-49e7-9841-96fbee86386b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:35.704230 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b1e58-0d3b-49e7-9841-96fbee86386b admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:35.704617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b1e58-0d3b-49e7-9841-96fbee86386b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:35.711013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b1e58-0d3b-49e7-9841-96fbee86386b admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:35.711977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b1e58-0d3b-49e7-9841-96fbee86386b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:35.715127 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b1e58-0d3b-49e7-9841-96fbee86386b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:35.735174 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:35.753491 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1969/3953] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:35.754518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b1e58-0d3b-49e7-9841-96fbee86386b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:35.774321 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b1e58-0d3b-49e7-9841-96fbee86386b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:35.785688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9903bf-6613-4083-9043-0a8b4ce02e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:35.786485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9903bf-6613-4083-9043-0a8b4ce02e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:35.786858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9903bf-6613-4083-9043-0a8b4ce02e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:35.787146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9903bf-6613-4083-9043-0a8b4ce02e50 admin admin] PATH_INFO: `/v3/projects/50b356beea2a4ca1af5f25d44889d5ac/users/8acd01b11fea4952b8832c62b874cac6/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:35.792578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9903bf-6613-4083-9043-0a8b4ce02e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50b356beea2a4ca1af5f25d44889d5ac, user_id=8acd01b11fea4952b8832c62b874cac6, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:35.795430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9903bf-6613-4083-9043-0a8b4ce02e50 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:35.826827 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1970/3954] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:24:35 2022] PUT /identity/v3/projects/50b356beea2a4ca1af5f25d44889d5ac/users/8acd01b11fea4952b8832c62b874cac6/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:35.846577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc4d66-aa18-4901-bc84-2dfa165eafef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:35.848172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc4d66-aa18-4901-bc84-2dfa165eafef service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:35.874473 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1985/3955] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:24:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:24:37.087370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9903bf-6613-4083-9043-0a8b4ce02e50 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:37.091185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6c9903bf-6613-4083-9043-0a8b4ce02e50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:37.289303 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9903bf-6613-4083-9043-0a8b4ce02e50 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:37.300638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabf575-3b89-4345-88be-59c93042ad48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:37.301540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabf575-3b89-4345-88be-59c93042ad48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:37.302559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabf575-3b89-4345-88be-59c93042ad48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:37.303709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabf575-3b89-4345-88be-59c93042ad48 admin admin] PATH_INFO: `/v3/projects/21fded12d8164e91b7fe3c8d70ed7cfd` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:37.308334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabf575-3b89-4345-88be-59c93042ad48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21fded12d8164e91b7fe3c8d70ed7cfd)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:37.313974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabf575-3b89-4345-88be-59c93042ad48 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:37.338126 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:37.434246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-deabf575-3b89-4345-88be-59c93042ad48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21fded12d8164e91b7fe3c8d70ed7cfd', 'request_id': 'req-deabf575-3b89-4345-88be-59c93042ad48'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:37.442123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-deabf575-3b89-4345-88be-59c93042ad48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21fded12d8164e91b7fe3c8d70ed7cfd', 'request_id': 'req-deabf575-3b89-4345-88be-59c93042ad48'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:37.455620 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-deabf575-3b89-4345-88be-59c93042ad48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21fded12d8164e91b7fe3c8d70ed7cfd', 'request_id': 'req-deabf575-3b89-4345-88be-59c93042ad48'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:37.489761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-deabf575-3b89-4345-88be-59c93042ad48 admin admin] The token cache is being invalidate because project 21fded12d8164e91b7fe3c8d70ed7cfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:37.490056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-deabf575-3b89-4345-88be-59c93042ad48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:37.492089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-deabf575-3b89-4345-88be-59c93042ad48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:37.498595 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1971/3956] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:24:37 2022] DELETE /identity/v3/projects/21fded12d8164e91b7fe3c8d70ed7cfd => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:37.499173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b28f0-7cf6-4c90-a4d1-12300dac2f6d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:37.499587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b28f0-7cf6-4c90-a4d1-12300dac2f6d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:37.499724 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b28f0-7cf6-4c90-a4d1-12300dac2f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:37.596423 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-cd0b28f0-7cf6-4c90-a4d1-12300dac2f6d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:37.597777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-cd0b28f0-7cf6-4c90-a4d1-12300dac2f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:37.664424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabf575-3b89-4345-88be-59c93042ad48 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:37.670022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-deabf575-3b89-4345-88be-59c93042ad48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:37.756057 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1986/3957] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:24:37.763908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee2448-2c50-4858-aeef-f87ba3f05625 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:37.764439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee2448-2c50-4858-aeef-f87ba3f05625 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:37.765741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee2448-2c50-4858-aeef-f87ba3f05625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:37.808690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-8dee2448-2c50-4858-aeef-f87ba3f05625 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:37.812477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8dee2448-2c50-4858-aeef-f87ba3f05625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:37.823042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabf575-3b89-4345-88be-59c93042ad48 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:37.827572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b4517-d1c3-4b5d-834b-571354eaea5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:37.828289 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b4517-d1c3-4b5d-834b-571354eaea5d service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:37.828567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b4517-d1c3-4b5d-834b-571354eaea5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:37.828838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b4517-d1c3-4b5d-834b-571354eaea5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:37.830660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-fe7b4517-d1c3-4b5d-834b-571354eaea5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:37.833906 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1987/3958] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:24:37.838148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee2448-2c50-4858-aeef-f87ba3f05625 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:37.859969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee2448-2c50-4858-aeef-f87ba3f05625 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:37.878047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bc2c6-1702-486a-9a50-9242973d3b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:37.878777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bc2c6-1702-486a-9a50-9242973d3b52 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:37.879555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bc2c6-1702-486a-9a50-9242973d3b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:37.880032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bc2c6-1702-486a-9a50-9242973d3b52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:37.880967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406bc2c6-1702-486a-9a50-9242973d3b52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:24:37.881466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406bc2c6-1702-486a-9a50-9242973d3b52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:37.886970 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406bc2c6-1702-486a-9a50-9242973d3b52 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:37.921928 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1988/3959] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:24:37.927172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bc2c6-1702-486a-9a50-9242973d3b52 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:37.962880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bc2c6-1702-486a-9a50-9242973d3b52 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:37.976855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb725d95-4f6d-4954-898a-a6115f5a17cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:37.978924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb725d95-4f6d-4954-898a-a6115f5a17cc admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:37.980600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb725d95-4f6d-4954-898a-a6115f5a17cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:37.980915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb725d95-4f6d-4954-898a-a6115f5a17cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:37.981960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb725d95-4f6d-4954-898a-a6115f5a17cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:37.988322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb725d95-4f6d-4954-898a-a6115f5a17cc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:38.036832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b4517-d1c3-4b5d-834b-571354eaea5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:38.042056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b4517-d1c3-4b5d-834b-571354eaea5d service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:38.060314 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1989/3960] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:24:37 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:38.067988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb725d95-4f6d-4954-898a-a6115f5a17cc admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:38.082922 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1972/3961] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:24:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:24:38.156505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb725d95-4f6d-4954-898a-a6115f5a17cc admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:38.168695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad5c5c2-19a9-4164-9ee3-a18d323d02db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:38.169383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5c5c2-19a9-4164-9ee3-a18d323d02db admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:38.169665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5c5c2-19a9-4164-9ee3-a18d323d02db admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:38.170479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5c5c2-19a9-4164-9ee3-a18d323d02db admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:38.172278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad5c5c2-19a9-4164-9ee3-a18d323d02db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:38.175739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad5c5c2-19a9-4164-9ee3-a18d323d02db admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:38.189334 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:38.207421 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1990/3962] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:24:38 2022] POST /identity/v3/users => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:38.212062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b4517-d1c3-4b5d-834b-571354eaea5d service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:38.240906 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b4517-d1c3-4b5d-834b-571354eaea5d service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:38.249738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680129f-ccd3-4130-a8f7-e4b4de791f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:38.250946 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680129f-ccd3-4130-a8f7-e4b4de791f77 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:38.251334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680129f-ccd3-4130-a8f7-e4b4de791f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:38.254608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680129f-ccd3-4130-a8f7-e4b4de791f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:38.256075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680129f-ccd3-4130-a8f7-e4b4de791f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:38.259986 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680129f-ccd3-4130-a8f7-e4b4de791f77 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:38.287994 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1973/3963] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:38.292932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad5c5c2-19a9-4164-9ee3-a18d323d02db admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:38.311485 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad5c5c2-19a9-4164-9ee3-a18d323d02db admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:38.330369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b3e6c-d3f5-4f9e-9174-7479c93f2533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:38.330996 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b3e6c-d3f5-4f9e-9174-7479c93f2533 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:38.331273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b3e6c-d3f5-4f9e-9174-7479c93f2533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:38.331605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b3e6c-d3f5-4f9e-9174-7479c93f2533 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:38.332211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b3e6c-d3f5-4f9e-9174-7479c93f2533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:38.338547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b3e6c-d3f5-4f9e-9174-7479c93f2533 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:38.377094 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1991/3964] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:38.377810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680129f-ccd3-4130-a8f7-e4b4de791f77 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:38.393282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680129f-ccd3-4130-a8f7-e4b4de791f77 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:38.409032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1210dee-8201-4405-8af8-b4feed3e6eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:38.409032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1210dee-8201-4405-8af8-b4feed3e6eed admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:38.409032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1210dee-8201-4405-8af8-b4feed3e6eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:38.409032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1210dee-8201-4405-8af8-b4feed3e6eed admin admin] PATH_INFO: `/v3/projects/fe73aec30e0e4e868761820ded934038/users/1757418c3bf046ba82bce542f5de4ecb/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:38.453000 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1210dee-8201-4405-8af8-b4feed3e6eed admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe73aec30e0e4e868761820ded934038, user_id=1757418c3bf046ba82bce542f5de4ecb, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:38.461071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1210dee-8201-4405-8af8-b4feed3e6eed admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:38.483397 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:38.493828 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1974/3965] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:24:38 2022] PUT /identity/v3/projects/fe73aec30e0e4e868761820ded934038/users/1757418c3bf046ba82bce542f5de4ecb/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:38.510276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670719ed-e808-46ab-b1fe-a7f42ce478f6 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:38.511169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670719ed-e808-46ab-b1fe-a7f42ce478f6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:38.511597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670719ed-e808-46ab-b1fe-a7f42ce478f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:38.560958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-670719ed-e808-46ab-b1fe-a7f42ce478f6 None None] MFA Rules not processed for user `1757418c3bf046ba82bce542f5de4ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:38.573866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-670719ed-e808-46ab-b1fe-a7f42ce478f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:38.705269 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1992/3966] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:38.706028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1210dee-8201-4405-8af8-b4feed3e6eed admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:38.721467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1210dee-8201-4405-8af8-b4feed3e6eed admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:38.738096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabba8cc-38b8-4176-8bf0-3a879da9de8a tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757418c3bf046ba82bce542f5de4ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73aec30e0e4e868761820ded934038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:38.738866 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabba8cc-38b8-4176-8bf0-3a879da9de8a tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:38.739266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabba8cc-38b8-4176-8bf0-3a879da9de8a tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:38.740029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabba8cc-38b8-4176-8bf0-3a879da9de8a tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] PATH_INFO: `/v3/users/1757418c3bf046ba82bce542f5de4ecb/password` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:38.842379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dabba8cc-38b8-4176-8bf0-3a879da9de8a tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '1757418c3bf046ba82bce542f5de4ecb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:38.869915 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1975/3967] 10.222.0.39 () {60 vars in 1269 bytes} [Sun Aug 7 01:24:38 2022] POST /identity/v3/users/1757418c3bf046ba82bce542f5de4ecb/password => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:24:39.698683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b7cc4-fca8-4bb2-8baa-fa1061ff17e5 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:39.699543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b7cc4-fca8-4bb2-8baa-fa1061ff17e5 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:39.700022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b7cc4-fca8-4bb2-8baa-fa1061ff17e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:39.782444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-445b7cc4-fca8-4bb2-8baa-fa1061ff17e5 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:39.783700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-445b7cc4-fca8-4bb2-8baa-fa1061ff17e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:39.876506 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c3bb9-eae2-42e6-be22-081cca1cde03 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:39.878409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c3bb9-eae2-42e6-be22-081cca1cde03 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:39.879172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c3bb9-eae2-42e6-be22-081cca1cde03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:39.953852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e48c3bb9-eae2-42e6-be22-081cca1cde03 None None] MFA Rules not processed for user `1757418c3bf046ba82bce542f5de4ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:39.954067 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1993/3968] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:24:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:24:39.955610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e48c3bb9-eae2-42e6-be22-081cca1cde03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:39.966925 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1976/3969] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:39 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 01:24:39.972531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a97e94-03e8-4528-86a1-c198a953e600 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:39.973008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a97e94-03e8-4528-86a1-c198a953e600 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:39.976701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a97e94-03e8-4528-86a1-c198a953e600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:40.043698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c3bb9-eae2-42e6-be22-081cca1cde03 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:40.045389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e48c3bb9-eae2-42e6-be22-081cca1cde03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:40.050285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-80a97e94-03e8-4528-86a1-c198a953e600 None None] MFA Rules not processed for user `1757418c3bf046ba82bce542f5de4ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:40.055486 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-80a97e94-03e8-4528-86a1-c198a953e600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:40.080864 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1994/3970] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:40.082622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a97e94-03e8-4528-86a1-c198a953e600 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:40.113440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a97e94-03e8-4528-86a1-c198a953e600 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:40.118904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756c004-10a0-4f2f-9475-73c63fd782e3 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757418c3bf046ba82bce542f5de4ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73aec30e0e4e868761820ded934038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:40.122274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756c004-10a0-4f2f-9475-73c63fd782e3 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:40.122550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756c004-10a0-4f2f-9475-73c63fd782e3 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:40.122998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756c004-10a0-4f2f-9475-73c63fd782e3 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] PATH_INFO: `/v3/users/1757418c3bf046ba82bce542f5de4ecb/password` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:40.208390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c3bb9-eae2-42e6-be22-081cca1cde03 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:40.219458 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a7d3d-26e3-4955-b7ca-0f611558304e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:40.220112 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a7d3d-26e3-4955-b7ca-0f611558304e service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:40.220392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a7d3d-26e3-4955-b7ca-0f611558304e service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:40.220664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a7d3d-26e3-4955-b7ca-0f611558304e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:40.238692 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-0756c004-10a0-4f2f-9475-73c63fd782e3 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 07 01:24:40.238692 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:24:40.238692 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:24:40.238692 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:24:40.238692 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:24:40.238692 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:24:40.238692 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:24:40.238692 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:24:40.238692 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:24:40.238692 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:24:40.238692 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:24:40.238692 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:24:40.238692 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 07 01:24:40.239829 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 07 01:24:40.239829 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Aug 07 01:24:40.239829 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Aug 07 01:24:40.239829 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:24:40.239829 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:24:40.239829 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 01:24:40.239829 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 01:24:40.239829 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Aug 07 01:24:40.239829 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Aug 07 01:24:40.239829 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Aug 07 01:24:40.239829 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Aug 07 01:24:40.239829 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Aug 07 01:24:40.239829 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Aug 07 01:24:40.239829 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 07 01:24:40.239829 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:24:40.241211 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1995/3971] 10.222.0.39 () {60 vars in 1269 bytes} [Sun Aug 7 01:24:40 2022] POST /identity/v3/users/1757418c3bf046ba82bce542f5de4ecb/password => generated 188 bytes in 158 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 07 01:24:40.244778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756c004-10a0-4f2f-9475-73c63fd782e3 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:40.259834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a7d3d-26e3-4955-b7ca-0f611558304e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:40.261542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a7d3d-26e3-4955-b7ca-0f611558304e service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:40.273396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756c004-10a0-4f2f-9475-73c63fd782e3 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:40.290969 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1977/3972] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:24:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 07 01:24:40.291764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b708fa-a71e-4dac-821d-bbb8b23499a3 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757418c3bf046ba82bce542f5de4ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73aec30e0e4e868761820ded934038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:40.292425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b708fa-a71e-4dac-821d-bbb8b23499a3 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:40.292611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b708fa-a71e-4dac-821d-bbb8b23499a3 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:40.292891 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b708fa-a71e-4dac-821d-bbb8b23499a3 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] PATH_INFO: `/v3/users/1757418c3bf046ba82bce542f5de4ecb/password` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:40.417768 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-81b708fa-a71e-4dac-821d-bbb8b23499a3 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 07 01:24:40.417768 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:24:40.417768 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:24:40.417768 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:24:40.417768 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:24:40.417768 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:24:40.417768 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:24:40.417768 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:24:40.417768 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:24:40.417768 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:24:40.417768 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:24:40.417768 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:24:40.417768 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 07 01:24:40.418771 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 07 01:24:40.418771 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Aug 07 01:24:40.418771 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Aug 07 01:24:40.418771 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:24:40.418771 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:24:40.418771 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 01:24:40.418771 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 01:24:40.418771 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Aug 07 01:24:40.418771 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Aug 07 01:24:40.418771 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Aug 07 01:24:40.418771 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Aug 07 01:24:40.418771 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Aug 07 01:24:40.418771 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Aug 07 01:24:40.418771 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Aug 07 01:24:40.418771 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:24:40.425851 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1996/3973] 10.222.0.39 () {60 vars in 1269 bytes} [Sun Aug 7 01:24:40 2022] POST /identity/v3/users/1757418c3bf046ba82bce542f5de4ecb/password => generated 188 bytes in 181 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 07 01:24:40.427338 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a7d3d-26e3-4955-b7ca-0f611558304e service swift] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:40.448534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a7d3d-26e3-4955-b7ca-0f611558304e service swift] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:40.470068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e235164-8a27-47a5-b7d6-18d9f1f7c827 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757418c3bf046ba82bce542f5de4ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73aec30e0e4e868761820ded934038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:40.475246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e235164-8a27-47a5-b7d6-18d9f1f7c827 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:40.478176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e235164-8a27-47a5-b7d6-18d9f1f7c827 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:40.478446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e235164-8a27-47a5-b7d6-18d9f1f7c827 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] PATH_INFO: `/v3/users/1757418c3bf046ba82bce542f5de4ecb/password` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:40.594300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2e235164-8a27-47a5-b7d6-18d9f1f7c827 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '1757418c3bf046ba82bce542f5de4ecb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:40.613044 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1978/3974] 10.222.0.39 () {60 vars in 1269 bytes} [Sun Aug 7 01:24:40 2022] POST /identity/v3/users/1757418c3bf046ba82bce542f5de4ecb/password => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:24:41.618818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3aa4a-f15a-44bb-8688-5a78514284dd None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:41.619401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3aa4a-f15a-44bb-8688-5a78514284dd None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:41.619401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d3aa4a-f15a-44bb-8688-5a78514284dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:41.652890 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-83d3aa4a-f15a-44bb-8688-5a78514284dd None None] MFA Rules not processed for user `1757418c3bf046ba82bce542f5de4ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:41.654750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-83d3aa4a-f15a-44bb-8688-5a78514284dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:41.667862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d238a7-1103-450e-9f94-818807ef7f2c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:41.668437 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d238a7-1103-450e-9f94-818807ef7f2c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:41.668704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d238a7-1103-450e-9f94-818807ef7f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:41.672312 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1997/3975] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:41 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 01:24:41.702160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-81d238a7-1103-450e-9f94-818807ef7f2c None None] MFA Rules not processed for user `1757418c3bf046ba82bce542f5de4ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:41.706176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-81d238a7-1103-450e-9f94-818807ef7f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:41.727758 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3aa4a-f15a-44bb-8688-5a78514284dd None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:41.728315 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1979/3976] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:41.743517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d3aa4a-f15a-44bb-8688-5a78514284dd None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:41.771789 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad554e0-6e6a-49ef-8f77-52fa550a594e tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757418c3bf046ba82bce542f5de4ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73aec30e0e4e868761820ded934038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:41.773508 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad554e0-6e6a-49ef-8f77-52fa550a594e tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:41.773954 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad554e0-6e6a-49ef-8f77-52fa550a594e tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:41.774425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad554e0-6e6a-49ef-8f77-52fa550a594e tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] PATH_INFO: `/v3/users/1757418c3bf046ba82bce542f5de4ecb/password` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:42.052801 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:42.125840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0ad554e0-6e6a-49ef-8f77-52fa550a594e tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '1757418c3bf046ba82bce542f5de4ecb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:42.152105 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1998/3977] 10.222.0.39 () {60 vars in 1269 bytes} [Sun Aug 7 01:24:41 2022] POST /identity/v3/users/1757418c3bf046ba82bce542f5de4ecb/password => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:43.157228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43c14e-85b6-47f8-9317-044843245d43 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:43.158461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43c14e-85b6-47f8-9317-044843245d43 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:43.158961 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43c14e-85b6-47f8-9317-044843245d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:43.194689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-8c43c14e-85b6-47f8-9317-044843245d43 None None] MFA Rules not processed for user `1757418c3bf046ba82bce542f5de4ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:43.199558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8c43c14e-85b6-47f8-9317-044843245d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:43.207998 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1980/3978] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:43 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 01:24:43.213129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e8880-d729-44d2-9353-2ce8dac8efd4 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:43.213707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e8880-d729-44d2-9353-2ce8dac8efd4 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:43.213707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e8880-d729-44d2-9353-2ce8dac8efd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:43.276077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-bf9e8880-d729-44d2-9353-2ce8dac8efd4 None None] MFA Rules not processed for user `1757418c3bf046ba82bce542f5de4ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:43.277221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-bf9e8880-d729-44d2-9353-2ce8dac8efd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:43.331081 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 1999/3979] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:43.337114 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43c14e-85b6-47f8-9317-044843245d43 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:43.360219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43c14e-85b6-47f8-9317-044843245d43 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:43.370873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b4836-5bd4-4030-a8ce-862335bef7b3 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757418c3bf046ba82bce542f5de4ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73aec30e0e4e868761820ded934038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:43.372212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b4836-5bd4-4030-a8ce-862335bef7b3 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:43.372754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b4836-5bd4-4030-a8ce-862335bef7b3 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:43.373296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b4836-5bd4-4030-a8ce-862335bef7b3 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] PATH_INFO: `/v3/users/1757418c3bf046ba82bce542f5de4ecb/password` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:43.449717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ca1b4836-5bd4-4030-a8ce-862335bef7b3 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '1757418c3bf046ba82bce542f5de4ecb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:43.466855 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1981/3980] 10.222.0.39 () {60 vars in 1269 bytes} [Sun Aug 7 01:24:43 2022] POST /identity/v3/users/1757418c3bf046ba82bce542f5de4ecb/password => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:44.474247 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8645099-e0d5-4a95-abed-4a28f5ee6958 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:44.474715 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8645099-e0d5-4a95-abed-4a28f5ee6958 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:44.475144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8645099-e0d5-4a95-abed-4a28f5ee6958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:44.520604 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c8645099-e0d5-4a95-abed-4a28f5ee6958 None None] MFA Rules not processed for user `1757418c3bf046ba82bce542f5de4ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:44.523273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c8645099-e0d5-4a95-abed-4a28f5ee6958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:44.531233 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2000/3981] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:44 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 01:24:44.536050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9d92b-fc39-49b0-8b33-6028f8bd5b40 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:44.537684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9d92b-fc39-49b0-8b33-6028f8bd5b40 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:44.539049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9d92b-fc39-49b0-8b33-6028f8bd5b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:44.592539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-a9a9d92b-fc39-49b0-8b33-6028f8bd5b40 None None] MFA Rules not processed for user `1757418c3bf046ba82bce542f5de4ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:44.596039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a9a9d92b-fc39-49b0-8b33-6028f8bd5b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:44.659538 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1982/3982] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:44.664997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8645099-e0d5-4a95-abed-4a28f5ee6958 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:44.754887 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8645099-e0d5-4a95-abed-4a28f5ee6958 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:44.769514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfa890-a7e3-40a1-8253-dbd8616be6f9 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757418c3bf046ba82bce542f5de4ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73aec30e0e4e868761820ded934038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:44.771595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfa890-a7e3-40a1-8253-dbd8616be6f9 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:44.773566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfa890-a7e3-40a1-8253-dbd8616be6f9 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:44.774089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfa890-a7e3-40a1-8253-dbd8616be6f9 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] PATH_INFO: `/v3/users/1757418c3bf046ba82bce542f5de4ecb/password` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:44.948015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c7bfa890-a7e3-40a1-8253-dbd8616be6f9 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '1757418c3bf046ba82bce542f5de4ecb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:44.977665 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2001/3983] 10.222.0.39 () {60 vars in 1269 bytes} [Sun Aug 7 01:24:44 2022] POST /identity/v3/users/1757418c3bf046ba82bce542f5de4ecb/password => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:45.376116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9d92b-fc39-49b0-8b33-6028f8bd5b40 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:45.377751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a9a9d92b-fc39-49b0-8b33-6028f8bd5b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:45.444685 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=87,keystone:UPDATE=3,keystone:INSERT=6,keystone:DELETE=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:45.560146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9d92b-fc39-49b0-8b33-6028f8bd5b40 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:45.574301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2d986-c3ea-4284-8d84-42fbef9d4b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:45.574964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2d986-c3ea-4284-8d84-42fbef9d4b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:45.575241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2d986-c3ea-4284-8d84-42fbef9d4b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:45.575511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2d986-c3ea-4284-8d84-42fbef9d4b7e admin admin] PATH_INFO: `/v3/users/58a40e444e92495c917f58fbcec63c8c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:45.589415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a2d986-c3ea-4284-8d84-42fbef9d4b7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=58a40e444e92495c917f58fbcec63c8c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:45.591875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a2d986-c3ea-4284-8d84-42fbef9d4b7e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:45.734599 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e6a2d986-c3ea-4284-8d84-42fbef9d4b7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58a40e444e92495c917f58fbcec63c8c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:45.757732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e6a2d986-c3ea-4284-8d84-42fbef9d4b7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58a40e444e92495c917f58fbcec63c8c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:45.799090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e6a2d986-c3ea-4284-8d84-42fbef9d4b7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58a40e444e92495c917f58fbcec63c8c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:45.799978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e6a2d986-c3ea-4284-8d84-42fbef9d4b7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58a40e444e92495c917f58fbcec63c8c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:45.812516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e6a2d986-c3ea-4284-8d84-42fbef9d4b7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58a40e444e92495c917f58fbcec63c8c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:45.843686 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1983/3984] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:24:45 2022] DELETE /identity/v3/users/58a40e444e92495c917f58fbcec63c8c => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:24:45.983657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa956301-56f6-4394-b243-2870d5078e68 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:45.984424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa956301-56f6-4394-b243-2870d5078e68 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:45.984424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa956301-56f6-4394-b243-2870d5078e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:46.045204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-aa956301-56f6-4394-b243-2870d5078e68 None None] MFA Rules not processed for user `1757418c3bf046ba82bce542f5de4ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:46.046534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-aa956301-56f6-4394-b243-2870d5078e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:46.068810 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2002/3985] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:45 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 01:24:47.068308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cebd43-0850-4cf0-af67-1d5f57903c6c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:47.068892 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cebd43-0850-4cf0-af67-1d5f57903c6c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:47.068892 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cebd43-0850-4cf0-af67-1d5f57903c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:47.132764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa956301-56f6-4394-b243-2870d5078e68 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:47.135088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-aa956301-56f6-4394-b243-2870d5078e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:47.136267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b7cebd43-0850-4cf0-af67-1d5f57903c6c None None] MFA Rules not processed for user `1757418c3bf046ba82bce542f5de4ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:47.141619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b7cebd43-0850-4cf0-af67-1d5f57903c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:47.340247 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1984/3986] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:47.351766 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286c2e6-11be-4277-a74b-425c66cfe819 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:47.352188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286c2e6-11be-4277-a74b-425c66cfe819 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:47.352539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286c2e6-11be-4277-a74b-425c66cfe819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:47.396275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa956301-56f6-4394-b243-2870d5078e68 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:47.412521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5717b-a447-43f1-bd41-05954a205f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:47.414728 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5717b-a447-43f1-bd41-05954a205f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:47.416824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5717b-a447-43f1-bd41-05954a205f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:47.421283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5717b-a447-43f1-bd41-05954a205f19 admin admin] PATH_INFO: `/v3/projects/4e24336f2ab84adda758d98cbb785888` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:47.424753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5717b-a447-43f1-bd41-05954a205f19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e24336f2ab84adda758d98cbb785888)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:47.427041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-8286c2e6-11be-4277-a74b-425c66cfe819 None None] MFA Rules not processed for user `1757418c3bf046ba82bce542f5de4ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:47.428387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8286c2e6-11be-4277-a74b-425c66cfe819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:47.430773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5717b-a447-43f1-bd41-05954a205f19 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:47.449425 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1985/3987] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:47 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 01:24:47.450950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb024c-3af7-4ef8-aae4-d7157f006ea2 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:47.451302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb024c-3af7-4ef8-aae4-d7157f006ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:47.451642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb024c-3af7-4ef8-aae4-d7157f006ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:47.573243 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6da5717b-a447-43f1-bd41-05954a205f19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e24336f2ab84adda758d98cbb785888', 'request_id': 'req-6da5717b-a447-43f1-bd41-05954a205f19'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:47.589213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6da5717b-a447-43f1-bd41-05954a205f19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e24336f2ab84adda758d98cbb785888', 'request_id': 'req-6da5717b-a447-43f1-bd41-05954a205f19'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:47.609611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6da5717b-a447-43f1-bd41-05954a205f19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e24336f2ab84adda758d98cbb785888', 'request_id': 'req-6da5717b-a447-43f1-bd41-05954a205f19'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:47.645035 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6da5717b-a447-43f1-bd41-05954a205f19 admin admin] The token cache is being invalidate because project 4e24336f2ab84adda758d98cbb785888 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:24:47.645486 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6da5717b-a447-43f1-bd41-05954a205f19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:47.646496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6da5717b-a447-43f1-bd41-05954a205f19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:47.652779 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2003/3988] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:24:47 2022] DELETE /identity/v3/projects/4e24336f2ab84adda758d98cbb785888 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:47.654677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df5647-e8e1-499a-8153-1ea369a5fa19 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:47.654971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df5647-e8e1-499a-8153-1ea369a5fa19 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:47.655245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df5647-e8e1-499a-8153-1ea369a5fa19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:47.655600 n-d-master-1 devstack@keystone.service[80493]: WARNING keystone.server.flask.application [None req-4fdb024c-3af7-4ef8-aae4-d7157f006ea2 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.39: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 07 01:24:47.658036 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1986/3989] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:47 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 208 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 07 01:24:47.662535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848279a-59fe-47d5-b279-48344b4bf3b2 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:47.663102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848279a-59fe-47d5-b279-48344b4bf3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:47.663693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848279a-59fe-47d5-b279-48344b4bf3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:47.728468 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:47.729366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-36df5647-e8e1-499a-8153-1ea369a5fa19 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:47.733771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-36df5647-e8e1-499a-8153-1ea369a5fa19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:47.745326 n-d-master-1 devstack@keystone.service[80493]: WARNING keystone.server.flask.application [None req-3848279a-59fe-47d5-b279-48344b4bf3b2 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.39: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 07 01:24:47.747743 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=82,keystone:UPDATE=2,keystone:INSERT=5,keystone:DELETE=11 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:47.751400 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1987/3990] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:47 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 90 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Aug 07 01:24:47.755501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fe763-8134-4c67-bc5c-08e9fb6bd228 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:47.755796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fe763-8134-4c67-bc5c-08e9fb6bd228 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:47.757882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fe763-8134-4c67-bc5c-08e9fb6bd228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:47.815255 n-d-master-1 devstack@keystone.service[80493]: WARNING keystone.server.flask.application [None req-346fe763-8134-4c67-bc5c-08e9fb6bd228 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.39: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 07 01:24:47.826329 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1988/3991] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:47 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 72 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 07 01:24:47.902052 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2004/3992] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:24:47.910010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25e993-1923-4290-8146-f5c03547ed9c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:47.910365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25e993-1923-4290-8146-f5c03547ed9c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:47.910565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25e993-1923-4290-8146-f5c03547ed9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:47.935094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ac25e993-1923-4290-8146-f5c03547ed9c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:47.936380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ac25e993-1923-4290-8146-f5c03547ed9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:47.952404 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1989/3993] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:47.956850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df5647-e8e1-499a-8153-1ea369a5fa19 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:47.972225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df5647-e8e1-499a-8153-1ea369a5fa19 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:47.996724 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789adfb4-d057-4d95-82e8-827f30138180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:47.997612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789adfb4-d057-4d95-82e8-827f30138180 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:47.997977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789adfb4-d057-4d95-82e8-827f30138180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:47.998350 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789adfb4-d057-4d95-82e8-827f30138180 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:47.999155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789adfb4-d057-4d95-82e8-827f30138180 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:24:47.999549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789adfb4-d057-4d95-82e8-827f30138180 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:48.001310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789adfb4-d057-4d95-82e8-827f30138180 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:48.031965 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2005/3994] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:24:48.033287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25e993-1923-4290-8146-f5c03547ed9c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:48.055475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25e993-1923-4290-8146-f5c03547ed9c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:48.072789 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd097acd-b2f8-44be-83d1-185b393341ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:48.073533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd097acd-b2f8-44be-83d1-185b393341ac admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:48.073908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd097acd-b2f8-44be-83d1-185b393341ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:48.074270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd097acd-b2f8-44be-83d1-185b393341ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:48.075006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd097acd-b2f8-44be-83d1-185b393341ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:48.077069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd097acd-b2f8-44be-83d1-185b393341ac admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:48.154392 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1990/3995] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:24:48 2022] POST /identity/v3/projects => generated 365 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:48.156781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789adfb4-d057-4d95-82e8-827f30138180 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:48.172537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789adfb4-d057-4d95-82e8-827f30138180 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:48.321807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71569951-ea4d-47f3-ad08-601c8baa4ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:48.324501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71569951-ea4d-47f3-ad08-601c8baa4ebf admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:48.325882 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71569951-ea4d-47f3-ad08-601c8baa4ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:48.326272 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71569951-ea4d-47f3-ad08-601c8baa4ebf admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:48.331403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71569951-ea4d-47f3-ad08-601c8baa4ebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:48.341719 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71569951-ea4d-47f3-ad08-601c8baa4ebf admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:48.417130 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2006/3996] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:24:48 2022] POST /identity/v3/users => generated 283 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:24:48.423391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd097acd-b2f8-44be-83d1-185b393341ac admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:48.450124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd097acd-b2f8-44be-83d1-185b393341ac admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:48.463734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872828c-e005-4ec2-87e5-d9d8bff72b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:48.464936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872828c-e005-4ec2-87e5-d9d8bff72b47 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:48.465324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872828c-e005-4ec2-87e5-d9d8bff72b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:48.465696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872828c-e005-4ec2-87e5-d9d8bff72b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:48.466472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872828c-e005-4ec2-87e5-d9d8bff72b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:48.469562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872828c-e005-4ec2-87e5-d9d8bff72b47 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:48.494742 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1991/3997] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:48.498521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71569951-ea4d-47f3-ad08-601c8baa4ebf admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:48.515051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71569951-ea4d-47f3-ad08-601c8baa4ebf admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:48.528362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea8d68-a217-4d18-a106-44ff1ccc9466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:48.529135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea8d68-a217-4d18-a106-44ff1ccc9466 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:48.529685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea8d68-a217-4d18-a106-44ff1ccc9466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:48.530076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea8d68-a217-4d18-a106-44ff1ccc9466 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:48.530829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea8d68-a217-4d18-a106-44ff1ccc9466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:48.533277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea8d68-a217-4d18-a106-44ff1ccc9466 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:48.564374 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2007/3998] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:24:48.564895 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872828c-e005-4ec2-87e5-d9d8bff72b47 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:48.579008 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872828c-e005-4ec2-87e5-d9d8bff72b47 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:48.597657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6700337-dcd0-4f4c-877d-7db0b538b17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:48.598717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6700337-dcd0-4f4c-877d-7db0b538b17a admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:48.599226 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6700337-dcd0-4f4c-877d-7db0b538b17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:48.599706 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6700337-dcd0-4f4c-877d-7db0b538b17a admin admin] PATH_INFO: `/v3/projects/b7995a68f5a541aabda74c0b01f6aac9/users/a50140f86f00487b90d0503d4819234f/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:48.638550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6700337-dcd0-4f4c-877d-7db0b538b17a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7995a68f5a541aabda74c0b01f6aac9, user_id=a50140f86f00487b90d0503d4819234f, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:48.644818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6700337-dcd0-4f4c-877d-7db0b538b17a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:48.685273 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1992/3999] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:24:48 2022] PUT /identity/v3/projects/b7995a68f5a541aabda74c0b01f6aac9/users/a50140f86f00487b90d0503d4819234f/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:24:48.690062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85966eb-817e-4ff7-b496-542f73e3bdd9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:48.690524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85966eb-817e-4ff7-b496-542f73e3bdd9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:48.690892 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85966eb-817e-4ff7-b496-542f73e3bdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:48.746807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d85966eb-817e-4ff7-b496-542f73e3bdd9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:48.752764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d85966eb-817e-4ff7-b496-542f73e3bdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:48.915924 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2008/4000] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:48.970846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6700337-dcd0-4f4c-877d-7db0b538b17a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:48.973797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b6700337-dcd0-4f4c-877d-7db0b538b17a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:49.103011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6700337-dcd0-4f4c-877d-7db0b538b17a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:49.110971 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c623ad4-4769-42f4-b258-6f36bdeeafd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:49.111980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c623ad4-4769-42f4-b258-6f36bdeeafd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:49.113091 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c623ad4-4769-42f4-b258-6f36bdeeafd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:49.113091 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c623ad4-4769-42f4-b258-6f36bdeeafd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:49.136084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c623ad4-4769-42f4-b258-6f36bdeeafd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:49.138230 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c623ad4-4769-42f4-b258-6f36bdeeafd3 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:49.242145 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1993/4001] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:24:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:24:51.208299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae35cab-c4d6-4e33-80e2-afe514d428b9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:51.208768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae35cab-c4d6-4e33-80e2-afe514d428b9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:51.209022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae35cab-c4d6-4e33-80e2-afe514d428b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:51.305159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-4ae35cab-c4d6-4e33-80e2-afe514d428b9 None None] MFA Rules not processed for user `1b8bc98d6fe04713bbbc0628b8e527b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:51.310013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4ae35cab-c4d6-4e33-80e2-afe514d428b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:51.331114 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:51.542017 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2009/4002] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:51 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:51.554724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c623ad4-4769-42f4-b258-6f36bdeeafd3 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:51.558111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6c623ad4-4769-42f4-b258-6f36bdeeafd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:51.741577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c623ad4-4769-42f4-b258-6f36bdeeafd3 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:51.754361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c8de6-c6ba-4e4a-9546-76775fe65a12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:51.757304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c8de6-c6ba-4e4a-9546-76775fe65a12 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:51.757637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c8de6-c6ba-4e4a-9546-76775fe65a12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:51.757940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c8de6-c6ba-4e4a-9546-76775fe65a12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:51.765497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e52c8de6-c6ba-4e4a-9546-76775fe65a12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:51.915338 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:51.988322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c8de6-c6ba-4e4a-9546-76775fe65a12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:51.989870 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c8de6-c6ba-4e4a-9546-76775fe65a12 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:52.017332 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1994/4003] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:24:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:24:56.863795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf7a5f-5eee-4355-badf-2eec862beea6 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:56.864312 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf7a5f-5eee-4355-badf-2eec862beea6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:56.864412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf7a5f-5eee-4355-badf-2eec862beea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:56.953809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-84bf7a5f-5eee-4355-badf-2eec862beea6 None None] MFA Rules not processed for user `d1f0c01c340940388b440932d51988ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:56.955050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-84bf7a5f-5eee-4355-badf-2eec862beea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:57.176606 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2010/4004] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:57.178539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d87c61-0fda-4d61-a101-7a19ec215d88 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:57.183345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d87c61-0fda-4d61-a101-7a19ec215d88 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:57.183926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d87c61-0fda-4d61-a101-7a19ec215d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:57.291431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d3d87c61-0fda-4d61-a101-7a19ec215d88 None None] MFA Rules not processed for user `d1f0c01c340940388b440932d51988ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:57.301372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d3d87c61-0fda-4d61-a101-7a19ec215d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:57.350515 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1995/4005] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:57.361050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf7a5f-5eee-4355-badf-2eec862beea6 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:57.362513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-84bf7a5f-5eee-4355-badf-2eec862beea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:57.824162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf7a5f-5eee-4355-badf-2eec862beea6 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:57.859163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847fee7-acf4-4196-be5c-5f677829a351 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:57.860172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847fee7-acf4-4196-be5c-5f677829a351 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:57.861926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847fee7-acf4-4196-be5c-5f677829a351 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:57.863574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847fee7-acf4-4196-be5c-5f677829a351 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:57.922930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847fee7-acf4-4196-be5c-5f677829a351 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:57.930791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847fee7-acf4-4196-be5c-5f677829a351 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:58.061464 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2011/4006] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:24:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:24:58.829659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d5570-0f66-4973-8df0-727671f84068 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:58.830135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d5570-0f66-4973-8df0-727671f84068 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:58.830317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d5570-0f66-4973-8df0-727671f84068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:58.839947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa9e65-a1a1-47e4-8cf9-5d33d85ea54e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:58.840296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa9e65-a1a1-47e4-8cf9-5d33d85ea54e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:58.840575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa9e65-a1a1-47e4-8cf9-5d33d85ea54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:58.941505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-fb3d5570-0f66-4973-8df0-727671f84068 None None] MFA Rules not processed for user `8acd01b11fea4952b8832c62b874cac6`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:58.946092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-fb3d5570-0f66-4973-8df0-727671f84068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:58.989084 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:24:59.040638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3afa9e65-a1a1-47e4-8cf9-5d33d85ea54e None None] MFA Rules not processed for user `1757418c3bf046ba82bce542f5de4ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:24:59.042008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3afa9e65-a1a1-47e4-8cf9-5d33d85ea54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:59.077864 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2012/4007] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:58 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 01:24:59.094969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa9e65-a1a1-47e4-8cf9-5d33d85ea54e None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:59.101141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3afa9e65-a1a1-47e4-8cf9-5d33d85ea54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:59.114165 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1996/4008] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:24:58 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:24:59.127273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d5570-0f66-4973-8df0-727671f84068 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:59.131258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-fb3d5570-0f66-4973-8df0-727671f84068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:59.165988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d5570-0f66-4973-8df0-727671f84068 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:59.181302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c7e6b-c126-409e-951c-e28cff03263c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:59.182133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c7e6b-c126-409e-951c-e28cff03263c service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:59.182513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c7e6b-c126-409e-951c-e28cff03263c service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:59.183191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c7e6b-c126-409e-951c-e28cff03263c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:59.194377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c08c7e6b-c126-409e-951c-e28cff03263c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:59.246909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa9e65-a1a1-47e4-8cf9-5d33d85ea54e None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:59.263111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934efcaa-eb59-4075-8766-a1d6d441cad4 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757418c3bf046ba82bce542f5de4ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73aec30e0e4e868761820ded934038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:59.264126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934efcaa-eb59-4075-8766-a1d6d441cad4 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:59.264565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934efcaa-eb59-4075-8766-a1d6d441cad4 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:59.264996 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934efcaa-eb59-4075-8766-a1d6d441cad4 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] PATH_INFO: `/v3/users/1757418c3bf046ba82bce542f5de4ecb/password` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:59.408328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-934efcaa-eb59-4075-8766-a1d6d441cad4 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '1757418c3bf046ba82bce542f5de4ecb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:24:59.418418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c7e6b-c126-409e-951c-e28cff03263c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:59.420433 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2013/4009] 10.222.0.39 () {60 vars in 1269 bytes} [Sun Aug 7 01:24:59 2022] POST /identity/v3/users/1757418c3bf046ba82bce542f5de4ecb/password => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:24:59.425550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c7e6b-c126-409e-951c-e28cff03263c service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:24:59.457472 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1997/4010] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:24:59 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:24:59.889357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934efcaa-eb59-4075-8766-a1d6d441cad4 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:24:59.891625 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-934efcaa-eb59-4075-8766-a1d6d441cad4 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:24:59.929364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934efcaa-eb59-4075-8766-a1d6d441cad4 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:24:59.951087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048cae1-ce0d-4860-8f82-edbc4cd61eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:24:59.952778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048cae1-ce0d-4860-8f82-edbc4cd61eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:24:59.957364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048cae1-ce0d-4860-8f82-edbc4cd61eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:24:59.957931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048cae1-ce0d-4860-8f82-edbc4cd61eef admin admin] PATH_INFO: `/v3/users/45ed48709ab84fa4b5b341332a843ad8` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:24:59.961376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048cae1-ce0d-4860-8f82-edbc4cd61eef admin admin] RBAC: Authorizing `identity:delete_user(user_id=45ed48709ab84fa4b5b341332a843ad8)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:24:59.979476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048cae1-ce0d-4860-8f82-edbc4cd61eef admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:00.128063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5048cae1-ce0d-4860-8f82-edbc4cd61eef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45ed48709ab84fa4b5b341332a843ad8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:00.169914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5048cae1-ce0d-4860-8f82-edbc4cd61eef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45ed48709ab84fa4b5b341332a843ad8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:00.246007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5048cae1-ce0d-4860-8f82-edbc4cd61eef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45ed48709ab84fa4b5b341332a843ad8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:00.248246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5048cae1-ce0d-4860-8f82-edbc4cd61eef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45ed48709ab84fa4b5b341332a843ad8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:00.277569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5048cae1-ce0d-4860-8f82-edbc4cd61eef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45ed48709ab84fa4b5b341332a843ad8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:00.299601 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2014/4011] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:24:59 2022] DELETE /identity/v3/users/45ed48709ab84fa4b5b341332a843ad8 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:00.426455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89363045-0019-4cc8-9436-d9cc0c5578d9 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:00.427661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89363045-0019-4cc8-9436-d9cc0c5578d9 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:00.428801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89363045-0019-4cc8-9436-d9cc0c5578d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:00.489649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-89363045-0019-4cc8-9436-d9cc0c5578d9 None None] MFA Rules not processed for user `1757418c3bf046ba82bce542f5de4ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:00.491418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-89363045-0019-4cc8-9436-d9cc0c5578d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:00.512067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123686fc-13c6-4fd8-b154-e69ca71f9edd None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:00.512676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123686fc-13c6-4fd8-b154-e69ca71f9edd None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:00.513168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123686fc-13c6-4fd8-b154-e69ca71f9edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:00.514534 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1998/4012] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:25:00 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 01:25:00.525341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-123686fc-13c6-4fd8-b154-e69ca71f9edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:00.706306 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=84,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=12 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:00.838160 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-123686fc-13c6-4fd8-b154-e69ca71f9edd None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 07 01:25:00.838160 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:25:00.838160 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:25:00.838160 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:25:00.838160 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:25:00.838160 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:25:00.838160 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:25:00.838160 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:25:00.838160 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:25:00.838160 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:25:00.838160 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:25:00.838160 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:25:00.838160 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Aug 07 01:25:00.838160 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(*args, **kwargs) Aug 07 01:25:00.838160 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Aug 07 01:25:00.838160 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Aug 07 01:25:00.839488 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Aug 07 01:25:00.839488 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Aug 07 01:25:00.839488 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Aug 07 01:25:00.839488 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Aug 07 01:25:00.839488 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Aug 07 01:25:00.839488 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Aug 07 01:25:00.839488 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Aug 07 01:25:00.839488 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Aug 07 01:25:00.839488 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:25:00.839488 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:25:00.839488 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 07 01:25:00.839488 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 07 01:25:00.839488 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 07 01:25:00.839488 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 07 01:25:00.839488 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:25:00.839488 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:25:00.841301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 07 01:25:00.841301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 07 01:25:00.841301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:25:00.841301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:25:00.841301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 07 01:25:00.841301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 07 01:25:00.841301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:25:00.841301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:25:00.841301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 07 01:25:00.841301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 07 01:25:00.841301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 07 01:25:00.841301 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:25:00.848325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf720a1-62da-4075-9d2c-bded55c82a30 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:00.848790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf720a1-62da-4075-9d2c-bded55c82a30 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:00.849178 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf720a1-62da-4075-9d2c-bded55c82a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:00.850585 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2015/4013] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:25:00 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 07 01:25:00.963994 n-d-master-1 devstack@keystone.service[80493]: WARNING keystone.server.flask.application [None req-1cf720a1-62da-4075-9d2c-bded55c82a30 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.39: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 07 01:25:00.966786 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 1999/4014] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:25:00 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 120 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 07 01:25:00.972123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079f9ca-9fce-4a68-981c-246d52cc6b95 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:00.972415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079f9ca-9fce-4a68-981c-246d52cc6b95 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:00.972752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079f9ca-9fce-4a68-981c-246d52cc6b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:01.192212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5079f9ca-9fce-4a68-981c-246d52cc6b95 None None] MFA Rules not processed for user `1757418c3bf046ba82bce542f5de4ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:01.224959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5079f9ca-9fce-4a68-981c-246d52cc6b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:01.262258 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2016/4015] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:25:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:01.263754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf720a1-62da-4075-9d2c-bded55c82a30 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:01.284801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf720a1-62da-4075-9d2c-bded55c82a30 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:01.291677 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97796ac6-7f03-4ead-8644-930724d6723f tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757418c3bf046ba82bce542f5de4ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73aec30e0e4e868761820ded934038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:01.293489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97796ac6-7f03-4ead-8644-930724d6723f tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:01.293774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97796ac6-7f03-4ead-8644-930724d6723f tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:01.300490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97796ac6-7f03-4ead-8644-930724d6723f tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] PATH_INFO: `/v3/users/1757418c3bf046ba82bce542f5de4ecb/password` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:01.569147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-97796ac6-7f03-4ead-8644-930724d6723f tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '1757418c3bf046ba82bce542f5de4ecb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:01.595168 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:UPDATE=2,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:01.638218 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2000/4016] 10.222.0.39 () {60 vars in 1269 bytes} [Sun Aug 7 01:25:01 2022] POST /identity/v3/users/1757418c3bf046ba82bce542f5de4ecb/password => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:02.272072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079f9ca-9fce-4a68-981c-246d52cc6b95 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:02.274727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5079f9ca-9fce-4a68-981c-246d52cc6b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:02.606990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079f9ca-9fce-4a68-981c-246d52cc6b95 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:02.620776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f37d0-e726-4103-921b-18f8909649e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:02.628105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f37d0-e726-4103-921b-18f8909649e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:02.628593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f37d0-e726-4103-921b-18f8909649e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:02.629017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f37d0-e726-4103-921b-18f8909649e7 admin admin] PATH_INFO: `/v3/projects/1371b7aebfcf4088a02780393de8200f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:02.635827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f37d0-e726-4103-921b-18f8909649e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1371b7aebfcf4088a02780393de8200f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:02.638518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f37d0-e726-4103-921b-18f8909649e7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:02.642683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2ce50-56f8-410b-a938-95f695695f2c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:02.643259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2ce50-56f8-410b-a938-95f695695f2c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:02.643483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2ce50-56f8-410b-a938-95f695695f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:02.723017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-41a2ce50-56f8-410b-a938-95f695695f2c None None] MFA Rules not processed for user `1757418c3bf046ba82bce542f5de4ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:02.729344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-41a2ce50-56f8-410b-a938-95f695695f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:02.760586 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2001/4017] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:25:02 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 01:25:02.767803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ef45c-f610-45ee-9d5f-6f088914a874 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:02.769377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ef45c-f610-45ee-9d5f-6f088914a874 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:02.769930 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ef45c-f610-45ee-9d5f-6f088914a874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:02.890974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-895ef45c-f610-45ee-9d5f-6f088914a874 None None] MFA Rules not processed for user `1757418c3bf046ba82bce542f5de4ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:02.895325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-895ef45c-f610-45ee-9d5f-6f088914a874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:02.923740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e98f37d0-e726-4103-921b-18f8909649e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1371b7aebfcf4088a02780393de8200f', 'request_id': 'req-e98f37d0-e726-4103-921b-18f8909649e7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:02.941241 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e98f37d0-e726-4103-921b-18f8909649e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1371b7aebfcf4088a02780393de8200f', 'request_id': 'req-e98f37d0-e726-4103-921b-18f8909649e7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:02.961883 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e98f37d0-e726-4103-921b-18f8909649e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1371b7aebfcf4088a02780393de8200f', 'request_id': 'req-e98f37d0-e726-4103-921b-18f8909649e7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:03.004901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e98f37d0-e726-4103-921b-18f8909649e7 admin admin] The token cache is being invalidate because project 1371b7aebfcf4088a02780393de8200f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:25:03.005995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e98f37d0-e726-4103-921b-18f8909649e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:03.015376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e98f37d0-e726-4103-921b-18f8909649e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:03.021004 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2017/4018] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:25:02 2022] DELETE /identity/v3/projects/1371b7aebfcf4088a02780393de8200f => generated 0 bytes in 749 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:03.025991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f37d0-e726-4103-921b-18f8909649e7 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:03.027550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e98f37d0-e726-4103-921b-18f8909649e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:03.158852 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2002/4019] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:25:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:03.160221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ef45c-f610-45ee-9d5f-6f088914a874 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:03.193237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ef45c-f610-45ee-9d5f-6f088914a874 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:03.219703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78e40e-4dc6-40f2-adde-85e9e9175d26 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757418c3bf046ba82bce542f5de4ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73aec30e0e4e868761820ded934038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:03.220717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78e40e-4dc6-40f2-adde-85e9e9175d26 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:03.221885 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78e40e-4dc6-40f2-adde-85e9e9175d26 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:03.225099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78e40e-4dc6-40f2-adde-85e9e9175d26 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] PATH_INFO: `/v3/users/1757418c3bf046ba82bce542f5de4ecb/password` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:03.238629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f37d0-e726-4103-921b-18f8909649e7 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:03.248960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924aedfb-cdda-421f-a848-871ade5dd3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:03.256979 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924aedfb-cdda-421f-a848-871ade5dd3c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:03.257680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924aedfb-cdda-421f-a848-871ade5dd3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:03.258095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924aedfb-cdda-421f-a848-871ade5dd3c6 admin admin] PATH_INFO: `/v3/users/cd8929be3902460ea06f780dd43955d9` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:03.269681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924aedfb-cdda-421f-a848-871ade5dd3c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd8929be3902460ea06f780dd43955d9)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:03.274718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924aedfb-cdda-421f-a848-871ade5dd3c6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:03.295917 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:03.411162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-924aedfb-cdda-421f-a848-871ade5dd3c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd8929be3902460ea06f780dd43955d9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:03.441176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-924aedfb-cdda-421f-a848-871ade5dd3c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd8929be3902460ea06f780dd43955d9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:03.473811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6e78e40e-4dc6-40f2-adde-85e9e9175d26 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '1757418c3bf046ba82bce542f5de4ecb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:03.475757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-924aedfb-cdda-421f-a848-871ade5dd3c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd8929be3902460ea06f780dd43955d9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:03.477086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-924aedfb-cdda-421f-a848-871ade5dd3c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd8929be3902460ea06f780dd43955d9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:03.496463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-924aedfb-cdda-421f-a848-871ade5dd3c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd8929be3902460ea06f780dd43955d9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:03.513563 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2018/4020] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:25:03 2022] DELETE /identity/v3/users/cd8929be3902460ea06f780dd43955d9 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:03.520846 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2003/4021] 10.222.0.39 () {60 vars in 1269 bytes} [Sun Aug 7 01:25:03 2022] POST /identity/v3/users/1757418c3bf046ba82bce542f5de4ecb/password => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:04.528353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785605c-c131-43b9-a1ed-eb931c4799a2 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:04.532962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785605c-c131-43b9-a1ed-eb931c4799a2 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:04.533839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785605c-c131-43b9-a1ed-eb931c4799a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:04.548860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78e40e-4dc6-40f2-adde-85e9e9175d26 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:04.552597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6e78e40e-4dc6-40f2-adde-85e9e9175d26 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:04.585782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78e40e-4dc6-40f2-adde-85e9e9175d26 tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:04.656355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e785605c-c131-43b9-a1ed-eb931c4799a2 None None] MFA Rules not processed for user `1757418c3bf046ba82bce542f5de4ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:04.664905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e785605c-c131-43b9-a1ed-eb931c4799a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:04.684133 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2019/4022] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:25:04 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 01:25:04.694904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e407d4-8baf-4d4a-8dd8-cf45eb828ee9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:04.699026 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e407d4-8baf-4d4a-8dd8-cf45eb828ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:04.702356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e407d4-8baf-4d4a-8dd8-cf45eb828ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:04.847609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19ac28-921f-47a9-84ee-dbc7a8ff5f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:04.850802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-25e407d4-8baf-4d4a-8dd8-cf45eb828ee9 None None] MFA Rules not processed for user `1757418c3bf046ba82bce542f5de4ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:04.851101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19ac28-921f-47a9-84ee-dbc7a8ff5f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:04.851315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19ac28-921f-47a9-84ee-dbc7a8ff5f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:04.851761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19ac28-921f-47a9-84ee-dbc7a8ff5f08 admin admin] PATH_INFO: `/v3/projects/eb2a52526fc445dabfacf2e025652e89` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:04.857546 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19ac28-921f-47a9-84ee-dbc7a8ff5f08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb2a52526fc445dabfacf2e025652e89)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:04.866450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-25e407d4-8baf-4d4a-8dd8-cf45eb828ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:04.866792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19ac28-921f-47a9-84ee-dbc7a8ff5f08 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:05.093730 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2020/4023] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:25:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:05.098240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e407d4-8baf-4d4a-8dd8-cf45eb828ee9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:05.130203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e407d4-8baf-4d4a-8dd8-cf45eb828ee9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:05.202439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7a19ac28-921f-47a9-84ee-dbc7a8ff5f08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb2a52526fc445dabfacf2e025652e89', 'request_id': 'req-7a19ac28-921f-47a9-84ee-dbc7a8ff5f08'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:05.221992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7a19ac28-921f-47a9-84ee-dbc7a8ff5f08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb2a52526fc445dabfacf2e025652e89', 'request_id': 'req-7a19ac28-921f-47a9-84ee-dbc7a8ff5f08'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:05.269168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7a19ac28-921f-47a9-84ee-dbc7a8ff5f08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb2a52526fc445dabfacf2e025652e89', 'request_id': 'req-7a19ac28-921f-47a9-84ee-dbc7a8ff5f08'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:05.271324 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:05.309442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7a19ac28-921f-47a9-84ee-dbc7a8ff5f08 admin admin] The token cache is being invalidate because project eb2a52526fc445dabfacf2e025652e89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:25:05.309840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7a19ac28-921f-47a9-84ee-dbc7a8ff5f08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:05.310432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7a19ac28-921f-47a9-84ee-dbc7a8ff5f08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:05.312320 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2004/4024] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:25:04 2022] DELETE /identity/v3/projects/eb2a52526fc445dabfacf2e025652e89 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:25:05.325536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56f61f-73a4-46ce-9ca2-e297ac3f5030 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:05.325820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56f61f-73a4-46ce-9ca2-e297ac3f5030 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:05.326097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56f61f-73a4-46ce-9ca2-e297ac3f5030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:05.331580 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e47fda-6e19-41d5-9fcb-e10b5d36c95c tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1757418c3bf046ba82bce542f5de4ecb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe73aec30e0e4e868761820ded934038', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:05.332981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e47fda-6e19-41d5-9fcb-e10b5d36c95c tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:05.332981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e47fda-6e19-41d5-9fcb-e10b5d36c95c tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:05.333341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e47fda-6e19-41d5-9fcb-e10b5d36c95c tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] PATH_INFO: `/v3/users/1757418c3bf046ba82bce542f5de4ecb/password` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:05.376831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9f56f61f-73a4-46ce-9ca2-e297ac3f5030 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:05.379418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9f56f61f-73a4-46ce-9ca2-e297ac3f5030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:05.455957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-36e47fda-6e19-41d5-9fcb-e10b5d36c95c tempest-IdentityV3UsersTest-1643811028 tempest-IdentityV3UsersTest-1643811028-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '1757418c3bf046ba82bce542f5de4ecb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:05.464630 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:05.473981 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2021/4025] 10.222.0.39 () {60 vars in 1269 bytes} [Sun Aug 7 01:25:05 2022] POST /identity/v3/users/1757418c3bf046ba82bce542f5de4ecb/password => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:05.620577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb70a70-e562-4327-babc-c64fe3328b51 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:05.621413 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2005/4026] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:05.622034 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb70a70-e562-4327-babc-c64fe3328b51 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:05.622034 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb70a70-e562-4327-babc-c64fe3328b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:05.711427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-adb70a70-e562-4327-babc-c64fe3328b51 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:05.714760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-adb70a70-e562-4327-babc-c64fe3328b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:05.741307 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2022/4027] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:25:05.745871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56f61f-73a4-46ce-9ca2-e297ac3f5030 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:05.761627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56f61f-73a4-46ce-9ca2-e297ac3f5030 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:05.797235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd9364-1c6c-4d83-8066-ec11c6e6df8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:05.797879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd9364-1c6c-4d83-8066-ec11c6e6df8b admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:05.798159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd9364-1c6c-4d83-8066-ec11c6e6df8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:05.798432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd9364-1c6c-4d83-8066-ec11c6e6df8b admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:05.799124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd9364-1c6c-4d83-8066-ec11c6e6df8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:25:05.799431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd9364-1c6c-4d83-8066-ec11c6e6df8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:05.801259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd9364-1c6c-4d83-8066-ec11c6e6df8b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:05.855774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb70a70-e562-4327-babc-c64fe3328b51 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:05.864598 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2006/4028] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:25:05.873851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb70a70-e562-4327-babc-c64fe3328b51 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:05.887198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61edc2-00fa-4747-af9b-9768dd2df084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:05.888087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61edc2-00fa-4747-af9b-9768dd2df084 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:05.888494 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61edc2-00fa-4747-af9b-9768dd2df084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:05.892369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61edc2-00fa-4747-af9b-9768dd2df084 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:05.893282 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e61edc2-00fa-4747-af9b-9768dd2df084 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:05.895395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e61edc2-00fa-4747-af9b-9768dd2df084 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:05.982379 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2023/4029] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:25:05 2022] POST /identity/v3/projects => generated 403 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:25:05.982642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd9364-1c6c-4d83-8066-ec11c6e6df8b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:06.003369 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd9364-1c6c-4d83-8066-ec11c6e6df8b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:06.228763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93beec11-f79a-4cdb-8972-287ea3dc3248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:06.232169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93beec11-f79a-4cdb-8972-287ea3dc3248 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:06.232690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93beec11-f79a-4cdb-8972-287ea3dc3248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:06.233138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93beec11-f79a-4cdb-8972-287ea3dc3248 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:06.234663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93beec11-f79a-4cdb-8972-287ea3dc3248 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:06.243682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93beec11-f79a-4cdb-8972-287ea3dc3248 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:06.336969 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2007/4030] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:25:05 2022] POST /identity/v3/users => generated 302 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:25:06.340891 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61edc2-00fa-4747-af9b-9768dd2df084 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:06.359129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61edc2-00fa-4747-af9b-9768dd2df084 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:06.395662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e078afb-5cdf-4821-af84-4b16be8cf9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:06.397275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e078afb-5cdf-4821-af84-4b16be8cf9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:06.403928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e078afb-5cdf-4821-af84-4b16be8cf9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:06.404399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e078afb-5cdf-4821-af84-4b16be8cf9c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:06.408194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e078afb-5cdf-4821-af84-4b16be8cf9c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:06.418300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e078afb-5cdf-4821-af84-4b16be8cf9c3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:06.469931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93beec11-f79a-4cdb-8972-287ea3dc3248 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:06.484008 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2024/4031] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:25:06.485643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971648a-890f-412b-829b-d39770d047ab None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:06.486045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971648a-890f-412b-829b-d39770d047ab None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:06.486435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971648a-890f-412b-829b-d39770d047ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:06.488716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93beec11-f79a-4cdb-8972-287ea3dc3248 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:06.517137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed3643-248a-416e-b6d5-534b503b4b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:06.520149 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed3643-248a-416e-b6d5-534b503b4b57 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:06.524349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed3643-248a-416e-b6d5-534b503b4b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:06.524898 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed3643-248a-416e-b6d5-534b503b4b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:06.526986 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed3643-248a-416e-b6d5-534b503b4b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:06.538487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed3643-248a-416e-b6d5-534b503b4b57 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:06.586414 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2008/4032] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:25:06.591437 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed3643-248a-416e-b6d5-534b503b4b57 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:06.592449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a971648a-890f-412b-829b-d39770d047ab None None] MFA Rules not processed for user `1757418c3bf046ba82bce542f5de4ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:06.594471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a971648a-890f-412b-829b-d39770d047ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:06.626568 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2025/4033] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:25:06 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 01:25:06.627656 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed3643-248a-416e-b6d5-534b503b4b57 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:06.649629 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480532a-d0e7-42b5-83d8-b95d63b2869d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:06.650339 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480532a-d0e7-42b5-83d8-b95d63b2869d admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:06.650617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480532a-d0e7-42b5-83d8-b95d63b2869d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:06.650920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480532a-d0e7-42b5-83d8-b95d63b2869d admin admin] PATH_INFO: `/v3/projects/813f7f5e51dd45cdb96dbdc7d4929dcc/users/01f5d52a90024c6fb65e16ac74f0e567/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:06.708666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a480532a-d0e7-42b5-83d8-b95d63b2869d admin admin] RBAC: Authorizing `identity:create_grant(project_id=813f7f5e51dd45cdb96dbdc7d4929dcc, user_id=01f5d52a90024c6fb65e16ac74f0e567, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:06.725233 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a480532a-d0e7-42b5-83d8-b95d63b2869d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:06.767388 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2009/4034] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:25:06 2022] PUT /identity/v3/projects/813f7f5e51dd45cdb96dbdc7d4929dcc/users/01f5d52a90024c6fb65e16ac74f0e567/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:06.774443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9c34a-b57c-4e37-814d-f5a80ff02102 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:06.775129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9c34a-b57c-4e37-814d-f5a80ff02102 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:06.775643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9c34a-b57c-4e37-814d-f5a80ff02102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:06.816854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6da9c34a-b57c-4e37-814d-f5a80ff02102 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:06.819460 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6da9c34a-b57c-4e37-814d-f5a80ff02102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:06.920854 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2026/4035] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:06.960079 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480532a-d0e7-42b5-83d8-b95d63b2869d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:06.960079 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a480532a-d0e7-42b5-83d8-b95d63b2869d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:07.117292 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:07.207492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480532a-d0e7-42b5-83d8-b95d63b2869d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:07.213819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7810e-8bf6-46ce-9fc6-cf54c615ac4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:07.214507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7810e-8bf6-46ce-9fc6-cf54c615ac4c service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:07.214733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7810e-8bf6-46ce-9fc6-cf54c615ac4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:07.215003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7810e-8bf6-46ce-9fc6-cf54c615ac4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:07.226079 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7810e-8bf6-46ce-9fc6-cf54c615ac4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:07.228204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7810e-8bf6-46ce-9fc6-cf54c615ac4c service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:07.241257 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2010/4036] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:25:07.626926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f1fc2-d376-4c1a-a20b-073b0d5d8a51 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:07.628180 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f1fc2-d376-4c1a-a20b-073b0d5d8a51 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:07.628791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f1fc2-d376-4c1a-a20b-073b0d5d8a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:07.705664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-359f1fc2-d376-4c1a-a20b-073b0d5d8a51 None None] MFA Rules not processed for user `1757418c3bf046ba82bce542f5de4ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:07.711211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-359f1fc2-d376-4c1a-a20b-073b0d5d8a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:07.898642 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2027/4037] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:25:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:25:07.898888 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7810e-8bf6-46ce-9fc6-cf54c615ac4c service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:07.900204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e5b7810e-8bf6-46ce-9fc6-cf54c615ac4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:07.936970 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7810e-8bf6-46ce-9fc6-cf54c615ac4c service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:07.957310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12c3ba-681f-494c-ba7e-dbf33e1513e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:07.957898 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12c3ba-681f-494c-ba7e-dbf33e1513e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:07.958173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12c3ba-681f-494c-ba7e-dbf33e1513e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:07.958602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12c3ba-681f-494c-ba7e-dbf33e1513e7 admin admin] PATH_INFO: `/v3/users/1757418c3bf046ba82bce542f5de4ecb` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:07.971451 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12c3ba-681f-494c-ba7e-dbf33e1513e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1757418c3bf046ba82bce542f5de4ecb)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:07.973620 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12c3ba-681f-494c-ba7e-dbf33e1513e7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:08.228111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9a12c3ba-681f-494c-ba7e-dbf33e1513e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1757418c3bf046ba82bce542f5de4ecb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:08.260310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9a12c3ba-681f-494c-ba7e-dbf33e1513e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1757418c3bf046ba82bce542f5de4ecb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:08.366092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9a12c3ba-681f-494c-ba7e-dbf33e1513e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1757418c3bf046ba82bce542f5de4ecb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:08.378251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9a12c3ba-681f-494c-ba7e-dbf33e1513e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1757418c3bf046ba82bce542f5de4ecb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:08.405469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9a12c3ba-681f-494c-ba7e-dbf33e1513e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1757418c3bf046ba82bce542f5de4ecb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:08.436023 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2011/4038] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:25:07 2022] DELETE /identity/v3/users/1757418c3bf046ba82bce542f5de4ecb => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:08.440742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579671e8-b11a-4998-a711-9d2f7ce8b512 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:08.441028 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579671e8-b11a-4998-a711-9d2f7ce8b512 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:08.450174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579671e8-b11a-4998-a711-9d2f7ce8b512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:08.542430 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-579671e8-b11a-4998-a711-9d2f7ce8b512 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:08.542430 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-579671e8-b11a-4998-a711-9d2f7ce8b512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:08.811228 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:08.836631 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2028/4039] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:25:08.960093 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12c3ba-681f-494c-ba7e-dbf33e1513e7 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:08.969659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9a12c3ba-681f-494c-ba7e-dbf33e1513e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:09.107763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12c3ba-681f-494c-ba7e-dbf33e1513e7 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:09.117649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d3518-3a51-4229-957f-175652c0bfdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:09.118606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d3518-3a51-4229-957f-175652c0bfdb service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:09.119058 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d3518-3a51-4229-957f-175652c0bfdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:09.119534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d3518-3a51-4229-957f-175652c0bfdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:09.143968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15d3518-3a51-4229-957f-175652c0bfdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:09.145636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15d3518-3a51-4229-957f-175652c0bfdb service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:09.172702 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2012/4040] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:25:09.778588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316db40b-9038-47fb-9128-6e53a5350276 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:09.779256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316db40b-9038-47fb-9128-6e53a5350276 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:09.779755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316db40b-9038-47fb-9128-6e53a5350276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:09.865757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-316db40b-9038-47fb-9128-6e53a5350276 None None] MFA Rules not processed for user `a50140f86f00487b90d0503d4819234f`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:09.867979 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-316db40b-9038-47fb-9128-6e53a5350276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:10.089023 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2029/4041] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:25:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:10.209138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e78311-1c42-430e-96f9-19bcc49bfd07 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:10.209720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e78311-1c42-430e-96f9-19bcc49bfd07 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:10.209720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e78311-1c42-430e-96f9-19bcc49bfd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:10.248646 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-70e78311-1c42-430e-96f9-19bcc49bfd07 None None] MFA Rules not processed for user `a50140f86f00487b90d0503d4819234f`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:10.249917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-70e78311-1c42-430e-96f9-19bcc49bfd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:10.273089 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2013/4042] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:25:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:10.296217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316db40b-9038-47fb-9128-6e53a5350276 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:10.298493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-316db40b-9038-47fb-9128-6e53a5350276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:10.461624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e78311-1c42-430e-96f9-19bcc49bfd07 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:10.463199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-70e78311-1c42-430e-96f9-19bcc49bfd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:10.497122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e78311-1c42-430e-96f9-19bcc49bfd07 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:10.517821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc46af2-e4aa-4739-833a-5016d59e7fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:10.519447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc46af2-e4aa-4739-833a-5016d59e7fe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:10.521801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc46af2-e4aa-4739-833a-5016d59e7fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:10.522244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc46af2-e4aa-4739-833a-5016d59e7fe8 admin admin] PATH_INFO: `/v3/projects/fe73aec30e0e4e868761820ded934038` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:10.527124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc46af2-e4aa-4739-833a-5016d59e7fe8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe73aec30e0e4e868761820ded934038)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:10.532515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc46af2-e4aa-4739-833a-5016d59e7fe8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:10.558950 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316db40b-9038-47fb-9128-6e53a5350276 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:10.581706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc91fca-fd49-4793-ba18-299eae9794fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:10.582796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc91fca-fd49-4793-ba18-299eae9794fd service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:10.584277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc91fca-fd49-4793-ba18-299eae9794fd service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:10.584587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc91fca-fd49-4793-ba18-299eae9794fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:10.616779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc91fca-fd49-4793-ba18-299eae9794fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:10.632897 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc91fca-fd49-4793-ba18-299eae9794fd service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:10.670945 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2030/4043] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:25:10.706877 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:10.732561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ebc46af2-e4aa-4739-833a-5016d59e7fe8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe73aec30e0e4e868761820ded934038', 'request_id': 'req-ebc46af2-e4aa-4739-833a-5016d59e7fe8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:10.750671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ebc46af2-e4aa-4739-833a-5016d59e7fe8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe73aec30e0e4e868761820ded934038', 'request_id': 'req-ebc46af2-e4aa-4739-833a-5016d59e7fe8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:10.773835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ebc46af2-e4aa-4739-833a-5016d59e7fe8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe73aec30e0e4e868761820ded934038', 'request_id': 'req-ebc46af2-e4aa-4739-833a-5016d59e7fe8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:10.830402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ebc46af2-e4aa-4739-833a-5016d59e7fe8 admin admin] The token cache is being invalidate because project fe73aec30e0e4e868761820ded934038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:25:10.831245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ebc46af2-e4aa-4739-833a-5016d59e7fe8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:10.834492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ebc46af2-e4aa-4739-833a-5016d59e7fe8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:10.837635 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2014/4044] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:25:10 2022] DELETE /identity/v3/projects/fe73aec30e0e4e868761820ded934038 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:25:10.845088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262c6f8-dde1-435d-adaa-1d5a271141c1 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:10.845757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262c6f8-dde1-435d-adaa-1d5a271141c1 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:10.846345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262c6f8-dde1-435d-adaa-1d5a271141c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:10.980582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a262c6f8-dde1-435d-adaa-1d5a271141c1 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:10.982434 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a262c6f8-dde1-435d-adaa-1d5a271141c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:11.241408 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2031/4045] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:25:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:11.246707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0322077-4d17-4b35-bb51-c57eca043875 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:11.248206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0322077-4d17-4b35-bb51-c57eca043875 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:11.248206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0322077-4d17-4b35-bb51-c57eca043875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:11.324030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-f0322077-4d17-4b35-bb51-c57eca043875 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:11.325391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f0322077-4d17-4b35-bb51-c57eca043875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:11.359498 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2015/4046] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:11.363335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262c6f8-dde1-435d-adaa-1d5a271141c1 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:11.382708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262c6f8-dde1-435d-adaa-1d5a271141c1 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:11.415357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06c90b-403c-429e-a8cb-400ef9cd9281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:11.417950 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06c90b-403c-429e-a8cb-400ef9cd9281 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:11.418261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06c90b-403c-429e-a8cb-400ef9cd9281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:11.418579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06c90b-403c-429e-a8cb-400ef9cd9281 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:11.421493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06c90b-403c-429e-a8cb-400ef9cd9281 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:25:11.423908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06c90b-403c-429e-a8cb-400ef9cd9281 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:11.430756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d06c90b-403c-429e-a8cb-400ef9cd9281 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:11.517278 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2032/4047] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:25:11.522066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0322077-4d17-4b35-bb51-c57eca043875 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:11.550981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0322077-4d17-4b35-bb51-c57eca043875 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:11.564187 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196302a7-7706-4648-8e36-0165993a987d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:11.565613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196302a7-7706-4648-8e36-0165993a987d admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:11.565613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196302a7-7706-4648-8e36-0165993a987d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:11.565933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196302a7-7706-4648-8e36-0165993a987d admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:11.595033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196302a7-7706-4648-8e36-0165993a987d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:11.597958 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196302a7-7706-4648-8e36-0165993a987d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:11.717105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06c90b-403c-429e-a8cb-400ef9cd9281 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:11.719228 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2016/4048] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:25:11 2022] POST /identity/v3/projects => generated 395 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:25:11.724198 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:11.736676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06c90b-403c-429e-a8cb-400ef9cd9281 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:12.104433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e03a2b-817a-4b66-84aa-82cc1e379bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:12.108893 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e03a2b-817a-4b66-84aa-82cc1e379bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:12.111979 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e03a2b-817a-4b66-84aa-82cc1e379bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:12.113534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e03a2b-817a-4b66-84aa-82cc1e379bc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:12.121208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e03a2b-817a-4b66-84aa-82cc1e379bc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:12.127307 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e03a2b-817a-4b66-84aa-82cc1e379bc2 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:12.224597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196302a7-7706-4648-8e36-0165993a987d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:12.227330 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2033/4049] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:25:11 2022] POST /identity/v3/users => generated 304 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:25:12.264756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196302a7-7706-4648-8e36-0165993a987d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:12.292105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21626e54-667b-4c51-ae13-b63e1bc8c6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:12.295644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21626e54-667b-4c51-ae13-b63e1bc8c6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:12.296124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21626e54-667b-4c51-ae13-b63e1bc8c6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:12.297881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21626e54-667b-4c51-ae13-b63e1bc8c6e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:12.305179 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21626e54-667b-4c51-ae13-b63e1bc8c6e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:12.312286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21626e54-667b-4c51-ae13-b63e1bc8c6e3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:12.379934 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2017/4050] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:25:12.385837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e03a2b-817a-4b66-84aa-82cc1e379bc2 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:12.415476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e03a2b-817a-4b66-84aa-82cc1e379bc2 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:12.442918 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21626e54-667b-4c51-ae13-b63e1bc8c6e3 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:12.450847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-21626e54-667b-4c51-ae13-b63e1bc8c6e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:12.459613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1eef3-9f68-491c-b650-b119a9bcc1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:12.460135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1eef3-9f68-491c-b650-b119a9bcc1c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:12.470793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1eef3-9f68-491c-b650-b119a9bcc1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:12.482518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1eef3-9f68-491c-b650-b119a9bcc1c0 admin admin] PATH_INFO: `/v3/projects/7e48c538437a4a3d87ace49e8722732f/users/917da8e6011147ac88c27225c67b3edc/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:12.507070 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21626e54-667b-4c51-ae13-b63e1bc8c6e3 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:12.527646 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ded08f-a0cf-4f50-b4c1-701aca3e2272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:12.528995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ded08f-a0cf-4f50-b4c1-701aca3e2272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:12.532539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ded08f-a0cf-4f50-b4c1-701aca3e2272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:12.533096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ded08f-a0cf-4f50-b4c1-701aca3e2272 admin admin] PATH_INFO: `/v3/users/dfaafe20889443e692f94fd4e4b8b023` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:12.536817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ded08f-a0cf-4f50-b4c1-701aca3e2272 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfaafe20889443e692f94fd4e4b8b023)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:12.539572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ded08f-a0cf-4f50-b4c1-701aca3e2272 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:12.621331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1eef3-9f68-491c-b650-b119a9bcc1c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e48c538437a4a3d87ace49e8722732f, user_id=917da8e6011147ac88c27225c67b3edc, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:12.642962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1eef3-9f68-491c-b650-b119a9bcc1c0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:12.683605 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2034/4051] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:25:12 2022] PUT /identity/v3/projects/7e48c538437a4a3d87ace49e8722732f/users/917da8e6011147ac88c27225c67b3edc/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:12.693694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1eef3-9f68-491c-b650-b119a9bcc1c0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:12.700408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f6ded08f-a0cf-4f50-b4c1-701aca3e2272 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfaafe20889443e692f94fd4e4b8b023'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:12.729860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f6ded08f-a0cf-4f50-b4c1-701aca3e2272 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfaafe20889443e692f94fd4e4b8b023'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:12.829261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f6ded08f-a0cf-4f50-b4c1-701aca3e2272 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfaafe20889443e692f94fd4e4b8b023'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:12.835210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f6ded08f-a0cf-4f50-b4c1-701aca3e2272 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfaafe20889443e692f94fd4e4b8b023'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:12.848106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1eef3-9f68-491c-b650-b119a9bcc1c0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:12.864513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79262076-d13e-4b28-a685-653e7052f176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:12.865454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79262076-d13e-4b28-a685-653e7052f176 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:12.865579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79262076-d13e-4b28-a685-653e7052f176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:12.865837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79262076-d13e-4b28-a685-653e7052f176 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:12.866569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79262076-d13e-4b28-a685-653e7052f176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:12.868632 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79262076-d13e-4b28-a685-653e7052f176 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:12.876244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f6ded08f-a0cf-4f50-b4c1-701aca3e2272 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfaafe20889443e692f94fd4e4b8b023'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:12.889118 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2035/4052] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:25:12.890208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79262076-d13e-4b28-a685-653e7052f176 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:12.892086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-79262076-d13e-4b28-a685-653e7052f176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:12.900443 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2018/4053] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:25:12 2022] DELETE /identity/v3/users/dfaafe20889443e692f94fd4e4b8b023 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:12.916969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79262076-d13e-4b28-a685-653e7052f176 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:13.006863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf5477-d1e7-4632-8a5e-09f9ebfd3026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:13.007622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf5477-d1e7-4632-8a5e-09f9ebfd3026 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:13.007941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf5477-d1e7-4632-8a5e-09f9ebfd3026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:13.008326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf5477-d1e7-4632-8a5e-09f9ebfd3026 admin admin] PATH_INFO: `/v3/projects/7e48c538437a4a3d87ace49e8722732f/users/917da8e6011147ac88c27225c67b3edc/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:13.010691 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf5477-d1e7-4632-8a5e-09f9ebfd3026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e48c538437a4a3d87ace49e8722732f, user_id=917da8e6011147ac88c27225c67b3edc, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:13.015786 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf5477-d1e7-4632-8a5e-09f9ebfd3026 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:13.025402 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:13.045692 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2036/4054] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:25:12 2022] PUT /identity/v3/projects/7e48c538437a4a3d87ace49e8722732f/users/917da8e6011147ac88c27225c67b3edc/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:13.049648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ba576-e8be-4580-97df-cdb5cc359207 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:13.050034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ba576-e8be-4580-97df-cdb5cc359207 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:13.050250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ba576-e8be-4580-97df-cdb5cc359207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:13.152707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-4a3ba576-e8be-4580-97df-cdb5cc359207 None None] MFA Rules not processed for user `917da8e6011147ac88c27225c67b3edc`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:13.153411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4a3ba576-e8be-4580-97df-cdb5cc359207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:13.289717 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:13.394466 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2019/4055] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:25:13 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:13.395769 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf5477-d1e7-4632-8a5e-09f9ebfd3026 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:13.606092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf5477-d1e7-4632-8a5e-09f9ebfd3026 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:13.626916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f57bd1-5a8f-450f-9d5c-3b4790fe5d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:13.628056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f57bd1-5a8f-450f-9d5c-3b4790fe5d0d admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:13.628491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f57bd1-5a8f-450f-9d5c-3b4790fe5d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:13.628958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f57bd1-5a8f-450f-9d5c-3b4790fe5d0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:13.641780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f57bd1-5a8f-450f-9d5c-3b4790fe5d0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:13.646974 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f57bd1-5a8f-450f-9d5c-3b4790fe5d0d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:13.724781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ba576-e8be-4580-97df-cdb5cc359207 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:13.731902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4a3ba576-e8be-4580-97df-cdb5cc359207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:13.768281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ba576-e8be-4580-97df-cdb5cc359207 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:13.799573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee196b7-b527-44e5-8b3b-9cbe04ef0b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:13.800710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee196b7-b527-44e5-8b3b-9cbe04ef0b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:13.802550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee196b7-b527-44e5-8b3b-9cbe04ef0b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:13.803207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee196b7-b527-44e5-8b3b-9cbe04ef0b97 admin admin] PATH_INFO: `/v3/projects/2e60e8cd3e6842ec82633393b0af52fd` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:13.808403 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2037/4056] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:25:13 2022] POST /identity/v3/projects => generated 395 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:25:13.810760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f57bd1-5a8f-450f-9d5c-3b4790fe5d0d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:13.811613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee196b7-b527-44e5-8b3b-9cbe04ef0b97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e60e8cd3e6842ec82633393b0af52fd)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:13.817591 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee196b7-b527-44e5-8b3b-9cbe04ef0b97 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:14.051390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3ee196b7-b527-44e5-8b3b-9cbe04ef0b97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e60e8cd3e6842ec82633393b0af52fd', 'request_id': 'req-3ee196b7-b527-44e5-8b3b-9cbe04ef0b97'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:14.068585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f57bd1-5a8f-450f-9d5c-3b4790fe5d0d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:14.102643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3ee196b7-b527-44e5-8b3b-9cbe04ef0b97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e60e8cd3e6842ec82633393b0af52fd', 'request_id': 'req-3ee196b7-b527-44e5-8b3b-9cbe04ef0b97'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:14.153363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3ee196b7-b527-44e5-8b3b-9cbe04ef0b97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e60e8cd3e6842ec82633393b0af52fd', 'request_id': 'req-3ee196b7-b527-44e5-8b3b-9cbe04ef0b97'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:14.216713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3ee196b7-b527-44e5-8b3b-9cbe04ef0b97 admin admin] The token cache is being invalidate because project 2e60e8cd3e6842ec82633393b0af52fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:25:14.218020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3ee196b7-b527-44e5-8b3b-9cbe04ef0b97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:14.220275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3ee196b7-b527-44e5-8b3b-9cbe04ef0b97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:14.234649 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2020/4057] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:25:13 2022] DELETE /identity/v3/projects/2e60e8cd3e6842ec82633393b0af52fd => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:14.239151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36e5a1-9943-47df-bb3d-edffd41ce6b6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:14.240147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36e5a1-9943-47df-bb3d-edffd41ce6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:14.240831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36e5a1-9943-47df-bb3d-edffd41ce6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:14.320285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b6cb5-ac16-42d5-ac0d-a2206332bdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:14.321270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b6cb5-ac16-42d5-ac0d-a2206332bdf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:14.321968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b6cb5-ac16-42d5-ac0d-a2206332bdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:14.322355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b6cb5-ac16-42d5-ac0d-a2206332bdf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:14.323359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b6cb5-ac16-42d5-ac0d-a2206332bdf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:14.325411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-8f36e5a1-9943-47df-bb3d-edffd41ce6b6 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:14.326055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b6cb5-ac16-42d5-ac0d-a2206332bdf7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:14.328363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8f36e5a1-9943-47df-bb3d-edffd41ce6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:14.347407 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2021/4058] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:14.359589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157d83f-3ab7-460b-944d-1288b0c84c7e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:14.360294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157d83f-3ab7-460b-944d-1288b0c84c7e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:14.360873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157d83f-3ab7-460b-944d-1288b0c84c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:14.381999 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2038/4059] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:25:13 2022] POST /identity/v3/users => generated 298 bytes in 570 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:25:14.387229 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b6cb5-ac16-42d5-ac0d-a2206332bdf7 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:14.392453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-eb6b6cb5-ac16-42d5-ac0d-a2206332bdf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:14.409077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-5157d83f-3ab7-460b-944d-1288b0c84c7e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:14.414262 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5157d83f-3ab7-460b-944d-1288b0c84c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:14.419574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b6cb5-ac16-42d5-ac0d-a2206332bdf7 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:14.443863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02cad7-dd8c-4e26-872a-9cc1d2c08d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:14.444531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02cad7-dd8c-4e26-872a-9cc1d2c08d3b admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:14.444816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02cad7-dd8c-4e26-872a-9cc1d2c08d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:14.445094 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02cad7-dd8c-4e26-872a-9cc1d2c08d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:14.445772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02cad7-dd8c-4e26-872a-9cc1d2c08d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:14.446905 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2022/4060] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:14.452038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02cad7-dd8c-4e26-872a-9cc1d2c08d3b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:14.453790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157d83f-3ab7-460b-944d-1288b0c84c7e None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:14.468328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157d83f-3ab7-460b-944d-1288b0c84c7e None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:14.475114 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecdbcb8-e94f-4120-a21a-4df012bd6cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:14.483366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdbcb8-e94f-4120-a21a-4df012bd6cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:14.486891 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2039/4061] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:25:14.487669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdbcb8-e94f-4120-a21a-4df012bd6cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:14.488293 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdbcb8-e94f-4120-a21a-4df012bd6cd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:14.488647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02cad7-dd8c-4e26-872a-9cc1d2c08d3b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:14.490818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecdbcb8-e94f-4120-a21a-4df012bd6cd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:25:14.491368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecdbcb8-e94f-4120-a21a-4df012bd6cd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:14.494840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecdbcb8-e94f-4120-a21a-4df012bd6cd8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:14.505293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02cad7-dd8c-4e26-872a-9cc1d2c08d3b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:14.527974 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2023/4062] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:25:14.535842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecdbcb8-e94f-4120-a21a-4df012bd6cd8 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:14.557512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9265ca-4eb4-4d43-a83c-2168b09d7faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:14.558572 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9265ca-4eb4-4d43-a83c-2168b09d7faf admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:14.558997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9265ca-4eb4-4d43-a83c-2168b09d7faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:14.559368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9265ca-4eb4-4d43-a83c-2168b09d7faf admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:14.560654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9265ca-4eb4-4d43-a83c-2168b09d7faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:14.569284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9265ca-4eb4-4d43-a83c-2168b09d7faf admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:14.573689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecdbcb8-e94f-4120-a21a-4df012bd6cd8 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:14.590730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d445acc-4d8a-45ea-8525-d3ac8199989e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:14.592256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d445acc-4d8a-45ea-8525-d3ac8199989e admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:14.592848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d445acc-4d8a-45ea-8525-d3ac8199989e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:14.593343 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d445acc-4d8a-45ea-8525-d3ac8199989e admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:14.594231 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d445acc-4d8a-45ea-8525-d3ac8199989e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:14.596514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d445acc-4d8a-45ea-8525-d3ac8199989e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:14.599509 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:14.633336 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2040/4063] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:25:14.644171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9265ca-4eb4-4d43-a83c-2168b09d7faf admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:14.685801 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2024/4064] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:25:14 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:25:14.692534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d445acc-4d8a-45ea-8525-d3ac8199989e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:14.697591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9265ca-4eb4-4d43-a83c-2168b09d7faf admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:14.892301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d445acc-4d8a-45ea-8525-d3ac8199989e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:14.899122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cb478-c168-4592-80a4-b6bad43482d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:14.900011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cb478-c168-4592-80a4-b6bad43482d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:14.900790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cb478-c168-4592-80a4-b6bad43482d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:14.901296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cb478-c168-4592-80a4-b6bad43482d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:14.902080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3cb478-c168-4592-80a4-b6bad43482d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:14.904455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3cb478-c168-4592-80a4-b6bad43482d4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:14.940818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502461c-731f-46c9-9fe6-a183598fb2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:14.944188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502461c-731f-46c9-9fe6-a183598fb2bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:14.944940 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502461c-731f-46c9-9fe6-a183598fb2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:14.945267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502461c-731f-46c9-9fe6-a183598fb2bf admin admin] PATH_INFO: `/v3/projects/711e3306e2664d84b73268337dbf4854/users/d36cfce5cde740fba5c686e1377b39a6/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:14.955864 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2025/4065] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:25:14 2022] POST /identity/v3/users => generated 287 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:25:14.961650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cb478-c168-4592-80a4-b6bad43482d4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:14.984060 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cb478-c168-4592-80a4-b6bad43482d4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:14.990833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab67bb-200d-458e-81d4-36bafd5ff3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:14.992023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab67bb-200d-458e-81d4-36bafd5ff3bc admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:14.992023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab67bb-200d-458e-81d4-36bafd5ff3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:14.992239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab67bb-200d-458e-81d4-36bafd5ff3bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:14.993147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab67bb-200d-458e-81d4-36bafd5ff3bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:14.995013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab67bb-200d-458e-81d4-36bafd5ff3bc admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:14.999014 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:15.020213 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2026/4066] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:25:15.033461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab67bb-200d-458e-81d4-36bafd5ff3bc admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:15.053427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab67bb-200d-458e-81d4-36bafd5ff3bc admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:15.056286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502461c-731f-46c9-9fe6-a183598fb2bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=711e3306e2664d84b73268337dbf4854, user_id=d36cfce5cde740fba5c686e1377b39a6, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:15.061681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdbea0-e7ea-44aa-a461-14f71a855b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:15.062933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdbea0-e7ea-44aa-a461-14f71a855b17 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:15.063466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdbea0-e7ea-44aa-a461-14f71a855b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:15.064096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdbea0-e7ea-44aa-a461-14f71a855b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:15.065094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdbea0-e7ea-44aa-a461-14f71a855b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:15.067222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdbea0-e7ea-44aa-a461-14f71a855b17 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:15.086149 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2027/4067] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:25:15.089731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502461c-731f-46c9-9fe6-a183598fb2bf admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:15.092277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdbea0-e7ea-44aa-a461-14f71a855b17 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:15.112202 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdbea0-e7ea-44aa-a461-14f71a855b17 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:15.125398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c12a18-f84c-42ad-aa32-50f9d36aac4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:15.127089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c12a18-f84c-42ad-aa32-50f9d36aac4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:15.127460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c12a18-f84c-42ad-aa32-50f9d36aac4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:15.127790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c12a18-f84c-42ad-aa32-50f9d36aac4e admin admin] PATH_INFO: `/v3/projects/6826f9d4a91245a3982795ce6022141f/users/2a43de829b91441797cabd51581ad38a/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:15.137905 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2041/4068] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:25:14 2022] PUT /identity/v3/projects/711e3306e2664d84b73268337dbf4854/users/d36cfce5cde740fba5c686e1377b39a6/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:15.165582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8ef4d-0922-4b8a-bafa-6497c34c36cb None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:15.165890 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8ef4d-0922-4b8a-bafa-6497c34c36cb None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:15.170589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8ef4d-0922-4b8a-bafa-6497c34c36cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:15.198138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c12a18-f84c-42ad-aa32-50f9d36aac4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6826f9d4a91245a3982795ce6022141f, user_id=2a43de829b91441797cabd51581ad38a, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:15.203850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c12a18-f84c-42ad-aa32-50f9d36aac4e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:15.262255 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2028/4069] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:25:15 2022] PUT /identity/v3/projects/6826f9d4a91245a3982795ce6022141f/users/2a43de829b91441797cabd51581ad38a/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:15.265685 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc23ca-00c4-427b-a25d-a404f4afa10a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:15.266013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc23ca-00c4-427b-a25d-a404f4afa10a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:15.266497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc23ca-00c4-427b-a25d-a404f4afa10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:15.281442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-83f8ef4d-0922-4b8a-bafa-6497c34c36cb None None] MFA Rules not processed for user `d36cfce5cde740fba5c686e1377b39a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:15.283698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-83f8ef4d-0922-4b8a-bafa-6497c34c36cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:15.301432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-73fc23ca-00c4-427b-a25d-a404f4afa10a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:15.302839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-73fc23ca-00c4-427b-a25d-a404f4afa10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:15.468658 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2042/4070] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:25:15 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:15.548626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8ef4d-0922-4b8a-bafa-6497c34c36cb None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:15.556939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-83f8ef4d-0922-4b8a-bafa-6497c34c36cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:15.560550 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2029/4071] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:15.656987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc23ca-00c4-427b-a25d-a404f4afa10a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:15.660804 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-73fc23ca-00c4-427b-a25d-a404f4afa10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:15.688862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8ef4d-0922-4b8a-bafa-6497c34c36cb None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:15.695626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99cc4e4-d215-4043-8e54-b6e6e7937db1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:15.695913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cc4e4-d215-4043-8e54-b6e6e7937db1 service glance] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:15.696096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cc4e4-d215-4043-8e54-b6e6e7937db1 service glance] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:15.696523 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cc4e4-d215-4043-8e54-b6e6e7937db1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:15.700299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a99cc4e4-d215-4043-8e54-b6e6e7937db1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:15.772489 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:15.876798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc23ca-00c4-427b-a25d-a404f4afa10a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:15.895683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13162565-bae7-4c4b-9e4b-7e4d6a2f532f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:15.902116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13162565-bae7-4c4b-9e4b-7e4d6a2f532f service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:15.903562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13162565-bae7-4c4b-9e4b-7e4d6a2f532f service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:15.906406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13162565-bae7-4c4b-9e4b-7e4d6a2f532f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:15.918032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99cc4e4-d215-4043-8e54-b6e6e7937db1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:15.919653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99cc4e4-d215-4043-8e54-b6e6e7937db1 service glance] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:15.950118 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2043/4072] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:15 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:25:15.975474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13162565-bae7-4c4b-9e4b-7e4d6a2f532f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:15.985031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13162565-bae7-4c4b-9e4b-7e4d6a2f532f service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:16.017318 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2030/4073] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:25:16.859130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99cc4e4-d215-4043-8e54-b6e6e7937db1 service glance] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:16.864894 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a99cc4e4-d215-4043-8e54-b6e6e7937db1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:17.262060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99cc4e4-d215-4043-8e54-b6e6e7937db1 service glance] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:17.333484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ef857-7d03-44f2-bbc7-9fb3a11af03e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:17.337747 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ef857-7d03-44f2-bbc7-9fb3a11af03e service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:17.342798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ef857-7d03-44f2-bbc7-9fb3a11af03e service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:17.345126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ef857-7d03-44f2-bbc7-9fb3a11af03e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:17.360443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e12ef857-7d03-44f2-bbc7-9fb3a11af03e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:17.476712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ef857-7d03-44f2-bbc7-9fb3a11af03e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:17.490973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ef857-7d03-44f2-bbc7-9fb3a11af03e service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:17.580455 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2044/4074] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 722 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:25:18.642065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13162565-bae7-4c4b-9e4b-7e4d6a2f532f service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:18.658034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13162565-bae7-4c4b-9e4b-7e4d6a2f532f service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:18.702993 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d3c8a-1d78-46c2-b834-c1baf9810ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:18.703810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d3c8a-1d78-46c2-b834-c1baf9810ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:18.704118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d3c8a-1d78-46c2-b834-c1baf9810ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:18.704526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d3c8a-1d78-46c2-b834-c1baf9810ff7 admin admin] PATH_INFO: `/v3/users/917da8e6011147ac88c27225c67b3edc` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:18.722135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d3c8a-1d78-46c2-b834-c1baf9810ff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=917da8e6011147ac88c27225c67b3edc)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:18.741662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d3c8a-1d78-46c2-b834-c1baf9810ff7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:19.026164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-037d3c8a-1d78-46c2-b834-c1baf9810ff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '917da8e6011147ac88c27225c67b3edc'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:19.045296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-037d3c8a-1d78-46c2-b834-c1baf9810ff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '917da8e6011147ac88c27225c67b3edc'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:19.061318 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:19.091664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-037d3c8a-1d78-46c2-b834-c1baf9810ff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '917da8e6011147ac88c27225c67b3edc'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:19.094883 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-037d3c8a-1d78-46c2-b834-c1baf9810ff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '917da8e6011147ac88c27225c67b3edc'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:19.120888 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-037d3c8a-1d78-46c2-b834-c1baf9810ff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '917da8e6011147ac88c27225c67b3edc'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:19.137477 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2031/4075] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:25:18 2022] DELETE /identity/v3/users/917da8e6011147ac88c27225c67b3edc => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:19.142589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d04125-d481-4298-8dd9-40e0335a6a50 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:19.143642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d04125-d481-4298-8dd9-40e0335a6a50 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:19.144115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d04125-d481-4298-8dd9-40e0335a6a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:19.217053 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-74d04125-d481-4298-8dd9-40e0335a6a50 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:19.224273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-74d04125-d481-4298-8dd9-40e0335a6a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:19.504763 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2045/4076] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:19.553639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d3c8a-1d78-46c2-b834-c1baf9810ff7 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:19.555600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-037d3c8a-1d78-46c2-b834-c1baf9810ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:19.831933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d3c8a-1d78-46c2-b834-c1baf9810ff7 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:19.854497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91129a58-ffce-49c1-937f-2c09be9ee0dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:19.855478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91129a58-ffce-49c1-937f-2c09be9ee0dd service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:19.860098 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91129a58-ffce-49c1-937f-2c09be9ee0dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:19.862045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91129a58-ffce-49c1-937f-2c09be9ee0dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:19.940936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91129a58-ffce-49c1-937f-2c09be9ee0dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:19.950675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91129a58-ffce-49c1-937f-2c09be9ee0dd service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:20.009262 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2032/4077] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:25:21.315656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d04125-d481-4298-8dd9-40e0335a6a50 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:21.318763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-74d04125-d481-4298-8dd9-40e0335a6a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:21.562672 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:21.656642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d04125-d481-4298-8dd9-40e0335a6a50 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:21.675854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f631a-41f0-4754-82ee-d95a128b05d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:21.678698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f631a-41f0-4754-82ee-d95a128b05d2 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:21.680099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f631a-41f0-4754-82ee-d95a128b05d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:21.681172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f631a-41f0-4754-82ee-d95a128b05d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:21.695654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f04f631a-41f0-4754-82ee-d95a128b05d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:21.804152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f631a-41f0-4754-82ee-d95a128b05d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:21.812082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f631a-41f0-4754-82ee-d95a128b05d2 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:21.855798 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2046/4078] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:25:22.154291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91129a58-ffce-49c1-937f-2c09be9ee0dd service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:22.157860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-91129a58-ffce-49c1-937f-2c09be9ee0dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:22.270681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91129a58-ffce-49c1-937f-2c09be9ee0dd service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:22.306663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280052c-359e-4d7b-8421-b3b83447cdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:22.314472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280052c-359e-4d7b-8421-b3b83447cdea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:22.320332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280052c-359e-4d7b-8421-b3b83447cdea admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:22.321168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280052c-359e-4d7b-8421-b3b83447cdea admin admin] PATH_INFO: `/v3/projects/7e48c538437a4a3d87ace49e8722732f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:22.324622 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b280052c-359e-4d7b-8421-b3b83447cdea admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e48c538437a4a3d87ace49e8722732f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:22.340167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b280052c-359e-4d7b-8421-b3b83447cdea admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:22.580304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b280052c-359e-4d7b-8421-b3b83447cdea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e48c538437a4a3d87ace49e8722732f', 'request_id': 'req-b280052c-359e-4d7b-8421-b3b83447cdea'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:22.595706 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b280052c-359e-4d7b-8421-b3b83447cdea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e48c538437a4a3d87ace49e8722732f', 'request_id': 'req-b280052c-359e-4d7b-8421-b3b83447cdea'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:22.612246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b280052c-359e-4d7b-8421-b3b83447cdea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e48c538437a4a3d87ace49e8722732f', 'request_id': 'req-b280052c-359e-4d7b-8421-b3b83447cdea'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:22.644518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b280052c-359e-4d7b-8421-b3b83447cdea admin admin] The token cache is being invalidate because project 7e48c538437a4a3d87ace49e8722732f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:25:22.644767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b280052c-359e-4d7b-8421-b3b83447cdea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:22.649621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b280052c-359e-4d7b-8421-b3b83447cdea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:22.651407 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2033/4079] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:25:22 2022] DELETE /identity/v3/projects/7e48c538437a4a3d87ace49e8722732f => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:22.655641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f631a-41f0-4754-82ee-d95a128b05d2 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:22.685143 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f631a-41f0-4754-82ee-d95a128b05d2 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:23.150890 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaab566-6e99-4c33-8f4a-bcf3104f0063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:23.151552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaab566-6e99-4c33-8f4a-bcf3104f0063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:23.151831 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaab566-6e99-4c33-8f4a-bcf3104f0063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:23.152140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaab566-6e99-4c33-8f4a-bcf3104f0063 admin admin] PATH_INFO: `/v3/users/d36cfce5cde740fba5c686e1377b39a6` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:23.154374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaab566-6e99-4c33-8f4a-bcf3104f0063 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d36cfce5cde740fba5c686e1377b39a6)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:23.165994 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaab566-6e99-4c33-8f4a-bcf3104f0063 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:23.354578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bcaab566-6e99-4c33-8f4a-bcf3104f0063 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd36cfce5cde740fba5c686e1377b39a6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:23.382274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bcaab566-6e99-4c33-8f4a-bcf3104f0063 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd36cfce5cde740fba5c686e1377b39a6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:23.424597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bcaab566-6e99-4c33-8f4a-bcf3104f0063 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd36cfce5cde740fba5c686e1377b39a6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:23.431953 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bcaab566-6e99-4c33-8f4a-bcf3104f0063 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd36cfce5cde740fba5c686e1377b39a6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:23.446643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bcaab566-6e99-4c33-8f4a-bcf3104f0063 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd36cfce5cde740fba5c686e1377b39a6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:23.474642 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2047/4080] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:25:22 2022] DELETE /identity/v3/users/d36cfce5cde740fba5c686e1377b39a6 => generated 0 bytes in 819 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:24.070635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44f1d9-9700-4864-be0c-f754f82a1812 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:24.071477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44f1d9-9700-4864-be0c-f754f82a1812 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:24.072453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44f1d9-9700-4864-be0c-f754f82a1812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:24.183300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ab44f1d9-9700-4864-be0c-f754f82a1812 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:24.187211 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ab44f1d9-9700-4864-be0c-f754f82a1812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:24.488155 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2034/4081] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:25:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:24.520699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaab566-6e99-4c33-8f4a-bcf3104f0063 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:24.523279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-bcaab566-6e99-4c33-8f4a-bcf3104f0063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:24.704136 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:24.788190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaab566-6e99-4c33-8f4a-bcf3104f0063 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:24.821794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a23ec-1a33-4b30-a169-610b5855e681 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:24.822432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a23ec-1a33-4b30-a169-610b5855e681 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:24.823763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a23ec-1a33-4b30-a169-610b5855e681 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:24.824931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a23ec-1a33-4b30-a169-610b5855e681 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:24.863103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a23ec-1a33-4b30-a169-610b5855e681 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:24.870118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a23ec-1a33-4b30-a169-610b5855e681 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:24.899738 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2048/4082] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:25:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:25:25.209867 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44f1d9-9700-4864-be0c-f754f82a1812 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:25.214575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ab44f1d9-9700-4864-be0c-f754f82a1812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:25.274516 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:25.761796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44f1d9-9700-4864-be0c-f754f82a1812 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:25.804640 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265039bd-68ce-421b-ac76-962f102fd3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:25.807137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265039bd-68ce-421b-ac76-962f102fd3c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:25.809074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265039bd-68ce-421b-ac76-962f102fd3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:25.813205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265039bd-68ce-421b-ac76-962f102fd3c5 admin admin] PATH_INFO: `/v3/projects/711e3306e2664d84b73268337dbf4854` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:25.821389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265039bd-68ce-421b-ac76-962f102fd3c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=711e3306e2664d84b73268337dbf4854)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:25.829971 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265039bd-68ce-421b-ac76-962f102fd3c5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:26.107279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-265039bd-68ce-421b-ac76-962f102fd3c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '711e3306e2664d84b73268337dbf4854', 'request_id': 'req-265039bd-68ce-421b-ac76-962f102fd3c5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:26.129014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-265039bd-68ce-421b-ac76-962f102fd3c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '711e3306e2664d84b73268337dbf4854', 'request_id': 'req-265039bd-68ce-421b-ac76-962f102fd3c5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:26.147103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-265039bd-68ce-421b-ac76-962f102fd3c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '711e3306e2664d84b73268337dbf4854', 'request_id': 'req-265039bd-68ce-421b-ac76-962f102fd3c5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:26.177342 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-265039bd-68ce-421b-ac76-962f102fd3c5 admin admin] The token cache is being invalidate because project 711e3306e2664d84b73268337dbf4854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:25:26.177643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-265039bd-68ce-421b-ac76-962f102fd3c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:26.180724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-265039bd-68ce-421b-ac76-962f102fd3c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:26.190243 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2035/4083] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:25:25 2022] DELETE /identity/v3/projects/711e3306e2664d84b73268337dbf4854 => generated 0 bytes in 978 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:26.193199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc7767-e516-4caa-825f-8bfab650928b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:26.194301 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc7767-e516-4caa-825f-8bfab650928b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:26.194916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc7767-e516-4caa-825f-8bfab650928b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:26.249419 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2cfc7767-e516-4caa-825f-8bfab650928b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:26.259009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2cfc7767-e516-4caa-825f-8bfab650928b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:26.513251 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2049/4084] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:26.524557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f57bbe-cd8f-4404-8e2f-6b080c80d865 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:26.524988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f57bbe-cd8f-4404-8e2f-6b080c80d865 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:26.525428 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f57bbe-cd8f-4404-8e2f-6b080c80d865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:26.598252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-99f57bbe-cd8f-4404-8e2f-6b080c80d865 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:26.605211 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-99f57bbe-cd8f-4404-8e2f-6b080c80d865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:26.731625 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2036/4085] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:26.737074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc7767-e516-4caa-825f-8bfab650928b None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:26.773627 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc7767-e516-4caa-825f-8bfab650928b None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:26.789698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742614f-f917-4d51-bd92-fecee8c90a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:26.790491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742614f-f917-4d51-bd92-fecee8c90a13 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:26.794904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742614f-f917-4d51-bd92-fecee8c90a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:26.795736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742614f-f917-4d51-bd92-fecee8c90a13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:26.798175 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b742614f-f917-4d51-bd92-fecee8c90a13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:25:26.798656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b742614f-f917-4d51-bd92-fecee8c90a13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:26.800975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b742614f-f917-4d51-bd92-fecee8c90a13 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:26.856122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f57bbe-cd8f-4404-8e2f-6b080c80d865 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:26.861133 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2050/4086] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:25:26.870596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f57bbe-cd8f-4404-8e2f-6b080c80d865 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:26.891076 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81448e-529b-4ecc-bd31-06a3c205a377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:26.892890 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81448e-529b-4ecc-bd31-06a3c205a377 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:26.899372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81448e-529b-4ecc-bd31-06a3c205a377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:26.899897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81448e-529b-4ecc-bd31-06a3c205a377 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:26.901416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81448e-529b-4ecc-bd31-06a3c205a377 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:26.904501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81448e-529b-4ecc-bd31-06a3c205a377 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:26.995466 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2037/4087] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:25:26 2022] POST /identity/v3/projects => generated 371 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:25:26.999110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742614f-f917-4d51-bd92-fecee8c90a13 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:27.023004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742614f-f917-4d51-bd92-fecee8c90a13 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:27.046023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2a5bb-d80b-4f11-9e28-5d56884fe070 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:27.046291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2a5bb-d80b-4f11-9e28-5d56884fe070 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:27.046600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2a5bb-d80b-4f11-9e28-5d56884fe070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:27.147142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba457e-4705-4ed1-a972-d1c00dad25cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:27.148587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba457e-4705-4ed1-a972-d1c00dad25cc admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:27.149108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba457e-4705-4ed1-a972-d1c00dad25cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:27.149581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba457e-4705-4ed1-a972-d1c00dad25cc admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:27.150444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba457e-4705-4ed1-a972-d1c00dad25cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:27.152718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba457e-4705-4ed1-a972-d1c00dad25cc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:27.165602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-90c2a5bb-d80b-4f11-9e28-5d56884fe070 None None] MFA Rules not processed for user `01f5d52a90024c6fb65e16ac74f0e567`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:27.175685 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-90c2a5bb-d80b-4f11-9e28-5d56884fe070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:27.194605 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2051/4088] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:25:26 2022] POST /identity/v3/users => generated 286 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:25:27.201549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba457e-4705-4ed1-a972-d1c00dad25cc admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:27.237384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba457e-4705-4ed1-a972-d1c00dad25cc admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:27.260670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6890b-a2f7-482f-84c0-ebafad5e5f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:27.261965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6890b-a2f7-482f-84c0-ebafad5e5f3f admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:27.262424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6890b-a2f7-482f-84c0-ebafad5e5f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:27.263161 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6890b-a2f7-482f-84c0-ebafad5e5f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:27.264080 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6890b-a2f7-482f-84c0-ebafad5e5f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:27.267923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6890b-a2f7-482f-84c0-ebafad5e5f3f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:27.288920 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2052/4089] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:25:27.291028 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6890b-a2f7-482f-84c0-ebafad5e5f3f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:27.307262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6890b-a2f7-482f-84c0-ebafad5e5f3f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:27.327062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edca7d8-cad5-4b89-ac4d-a128f2ba74c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:27.328244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edca7d8-cad5-4b89-ac4d-a128f2ba74c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:27.328533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edca7d8-cad5-4b89-ac4d-a128f2ba74c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:27.328805 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edca7d8-cad5-4b89-ac4d-a128f2ba74c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:27.329545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edca7d8-cad5-4b89-ac4d-a128f2ba74c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:27.335712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edca7d8-cad5-4b89-ac4d-a128f2ba74c0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:27.362088 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2053/4090] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:25:27.363758 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edca7d8-cad5-4b89-ac4d-a128f2ba74c0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:27.367438 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:27.379537 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2038/4091] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:25:27 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:27.383044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2a5bb-d80b-4f11-9e28-5d56884fe070 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:27.387102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-90c2a5bb-d80b-4f11-9e28-5d56884fe070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:27.405659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edca7d8-cad5-4b89-ac4d-a128f2ba74c0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:27.421424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2a5bb-d80b-4f11-9e28-5d56884fe070 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:27.436879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd4a70-4b00-4e74-b6e8-5143fb7c1d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:27.438914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd4a70-4b00-4e74-b6e8-5143fb7c1d4f admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:27.439308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd4a70-4b00-4e74-b6e8-5143fb7c1d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:27.439684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd4a70-4b00-4e74-b6e8-5143fb7c1d4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:27.440707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dd4a70-4b00-4e74-b6e8-5143fb7c1d4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:27.451050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dd4a70-4b00-4e74-b6e8-5143fb7c1d4f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:27.454299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392f22d-8d18-44a1-a67a-d7514134d9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:27.455290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392f22d-8d18-44a1-a67a-d7514134d9ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:27.459338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392f22d-8d18-44a1-a67a-d7514134d9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:27.462636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392f22d-8d18-44a1-a67a-d7514134d9ea admin admin] PATH_INFO: `/v3/projects/3b11bcd11bf84c85ad4efe333f5530c6/users/fcfe13f8b0ac4c328a5f5c6f985b7c0b/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:27.517088 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2039/4092] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:25:27 2022] POST /identity/v3/projects => generated 405 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:25:27.519138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd4a70-4b00-4e74-b6e8-5143fb7c1d4f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:27.524253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-73dd4a70-4b00-4e74-b6e8-5143fb7c1d4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:27.554379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9392f22d-8d18-44a1-a67a-d7514134d9ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b11bcd11bf84c85ad4efe333f5530c6, user_id=fcfe13f8b0ac4c328a5f5c6f985b7c0b, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:27.565559 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9392f22d-8d18-44a1-a67a-d7514134d9ea admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:27.600789 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2054/4093] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:25:27 2022] PUT /identity/v3/projects/3b11bcd11bf84c85ad4efe333f5530c6/users/fcfe13f8b0ac4c328a5f5c6f985b7c0b/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:27.605904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392f22d-8d18-44a1-a67a-d7514134d9ea admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:27.666768 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:27.737198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd4a70-4b00-4e74-b6e8-5143fb7c1d4f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:27.936917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392f22d-8d18-44a1-a67a-d7514134d9ea admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:27.960659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e759f5-1d0e-4548-9a0f-96cf4f86ea15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:27.962762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e759f5-1d0e-4548-9a0f-96cf4f86ea15 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:27.963074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e759f5-1d0e-4548-9a0f-96cf4f86ea15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:27.963346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e759f5-1d0e-4548-9a0f-96cf4f86ea15 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:27.967916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e759f5-1d0e-4548-9a0f-96cf4f86ea15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:27.977366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e759f5-1d0e-4548-9a0f-96cf4f86ea15 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:27.979159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71fe66-b3a0-4a4d-911e-ce2288fdd48c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:27.980355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71fe66-b3a0-4a4d-911e-ce2288fdd48c service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:27.981941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71fe66-b3a0-4a4d-911e-ce2288fdd48c service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:27.984856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71fe66-b3a0-4a4d-911e-ce2288fdd48c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:28.000834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-fd71fe66-b3a0-4a4d-911e-ce2288fdd48c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:28.021342 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71fe66-b3a0-4a4d-911e-ce2288fdd48c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:28.027362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71fe66-b3a0-4a4d-911e-ce2288fdd48c service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:28.044658 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2055/4094] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:25:27 2022] POST /identity/v3/users => generated 309 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:25:28.045658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d59c05-1846-4272-ae7f-b59f1927c3a2 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:28.050698 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2040/4095] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:25:28.051566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71fe66-b3a0-4a4d-911e-ce2288fdd48c service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:28.054063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d59c05-1846-4272-ae7f-b59f1927c3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:28.055996 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d59c05-1846-4272-ae7f-b59f1927c3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:28.079269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71fe66-b3a0-4a4d-911e-ce2288fdd48c service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:28.097609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27becf43-af79-40ae-bc13-6edbac9cf571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:28.098107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27becf43-af79-40ae-bc13-6edbac9cf571 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:28.098394 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27becf43-af79-40ae-bc13-6edbac9cf571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:28.098699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27becf43-af79-40ae-bc13-6edbac9cf571 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:28.099371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27becf43-af79-40ae-bc13-6edbac9cf571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:28.101033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27becf43-af79-40ae-bc13-6edbac9cf571 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:28.127170 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2041/4096] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:25:28.132102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27becf43-af79-40ae-bc13-6edbac9cf571 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:28.146991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a3d59c05-1846-4272-ae7f-b59f1927c3a2 None None] MFA Rules not processed for user `fcfe13f8b0ac4c328a5f5c6f985b7c0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:28.153054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a3d59c05-1846-4272-ae7f-b59f1927c3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:28.163224 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27becf43-af79-40ae-bc13-6edbac9cf571 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:28.169164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470a84a-4c19-4887-9427-925196da888f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:28.169857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470a84a-4c19-4887-9427-925196da888f admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:28.170145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470a84a-4c19-4887-9427-925196da888f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:28.170418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470a84a-4c19-4887-9427-925196da888f admin admin] PATH_INFO: `/v3/projects/b6ec6817209b42119074914b2274edeb/users/f07ba5e6d34f4c6c9194c562174f3006/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:28.208671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470a84a-4c19-4887-9427-925196da888f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ec6817209b42119074914b2274edeb, user_id=f07ba5e6d34f4c6c9194c562174f3006, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:28.215523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470a84a-4c19-4887-9427-925196da888f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:28.247414 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2042/4097] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:25:28 2022] PUT /identity/v3/projects/b6ec6817209b42119074914b2274edeb/users/f07ba5e6d34f4c6c9194c562174f3006/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:28.251168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470a84a-4c19-4887-9427-925196da888f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:28.402863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470a84a-4c19-4887-9427-925196da888f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:28.406679 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2056/4098] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:25:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:28.421985 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1e7d3-dfea-4f77-ad28-d05366fcb45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:28.422927 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1e7d3-dfea-4f77-ad28-d05366fcb45b admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:28.423205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1e7d3-dfea-4f77-ad28-d05366fcb45b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:28.423476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1e7d3-dfea-4f77-ad28-d05366fcb45b admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:28.424791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1e7d3-dfea-4f77-ad28-d05366fcb45b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:28.427518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1e7d3-dfea-4f77-ad28-d05366fcb45b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:28.432109 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:28.450277 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2043/4099] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:25:28.454522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d59c05-1846-4272-ae7f-b59f1927c3a2 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:28.491275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d59c05-1846-4272-ae7f-b59f1927c3a2 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:28.506780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20505744-25c9-46dd-aa76-623586cf9ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:28.507860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20505744-25c9-46dd-aa76-623586cf9ae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:28.508441 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20505744-25c9-46dd-aa76-623586cf9ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:28.509916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20505744-25c9-46dd-aa76-623586cf9ae3 admin admin] PATH_INFO: `/v3/projects/b6ec6817209b42119074914b2274edeb/users/f07ba5e6d34f4c6c9194c562174f3006/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:28.513259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20505744-25c9-46dd-aa76-623586cf9ae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ec6817209b42119074914b2274edeb, user_id=f07ba5e6d34f4c6c9194c562174f3006, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:28.517967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20505744-25c9-46dd-aa76-623586cf9ae3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:28.544150 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2057/4100] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:25:28 2022] PUT /identity/v3/projects/b6ec6817209b42119074914b2274edeb/users/f07ba5e6d34f4c6c9194c562174f3006/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:31.468986 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1e7d3-dfea-4f77-ad28-d05366fcb45b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:31.662571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1e7d3-dfea-4f77-ad28-d05366fcb45b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:31.979666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf83bfa-8756-430f-8661-1b89387d6ffb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:31.995818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf83bfa-8756-430f-8661-1b89387d6ffb service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:31.996281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf83bfa-8756-430f-8661-1b89387d6ffb service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:31.996416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf83bfa-8756-430f-8661-1b89387d6ffb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:32.030692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8bf83bfa-8756-430f-8661-1b89387d6ffb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:32.127127 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf83bfa-8756-430f-8661-1b89387d6ffb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:32.133689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf83bfa-8756-430f-8661-1b89387d6ffb service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:32.180329 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2044/4101] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 711 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:25:33.376611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20505744-25c9-46dd-aa76-623586cf9ae3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:33.393842 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-20505744-25c9-46dd-aa76-623586cf9ae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:33.602882 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20505744-25c9-46dd-aa76-623586cf9ae3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:33.610169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a675cb-33f7-47f3-b684-8b89bb9186b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:33.611119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a675cb-33f7-47f3-b684-8b89bb9186b6 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:33.611642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a675cb-33f7-47f3-b684-8b89bb9186b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:33.612203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a675cb-33f7-47f3-b684-8b89bb9186b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:33.615780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-20a675cb-33f7-47f3-b684-8b89bb9186b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:33.669152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a675cb-33f7-47f3-b684-8b89bb9186b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:33.673091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a675cb-33f7-47f3-b684-8b89bb9186b6 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:33.707317 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2058/4102] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:25:42.154269 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=47 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:43.548241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf83bfa-8756-430f-8661-1b89387d6ffb service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:43.550700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8bf83bfa-8756-430f-8661-1b89387d6ffb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:43.692921 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=93,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:43.736016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf83bfa-8756-430f-8661-1b89387d6ffb service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:43.750274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f63e334-0aab-4f45-ba82-c2a1dd5007c0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:43.751736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63e334-0aab-4f45-ba82-c2a1dd5007c0 service glance] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:43.753206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63e334-0aab-4f45-ba82-c2a1dd5007c0 service glance] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:43.753492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f63e334-0aab-4f45-ba82-c2a1dd5007c0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:43.921358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63e334-0aab-4f45-ba82-c2a1dd5007c0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:43.925886 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f63e334-0aab-4f45-ba82-c2a1dd5007c0 service glance] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:43.943510 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2045/4103] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:25:43.971320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e85045-0e94-4286-8f3f-a2dce6c91068 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:43.971579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e85045-0e94-4286-8f3f-a2dce6c91068 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:43.972208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e85045-0e94-4286-8f3f-a2dce6c91068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:44.065535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e0e85045-0e94-4286-8f3f-a2dce6c91068 None None] MFA Rules not processed for user `f07ba5e6d34f4c6c9194c562174f3006`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:44.072560 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e0e85045-0e94-4286-8f3f-a2dce6c91068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:44.329461 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2059/4104] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:25:43 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:44.339603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c455b32-64e8-4eec-b4f7-3d9b38255557 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:44.339944 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c455b32-64e8-4eec-b4f7-3d9b38255557 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:44.340228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c455b32-64e8-4eec-b4f7-3d9b38255557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:44.362706 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-4c455b32-64e8-4eec-b4f7-3d9b38255557 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:44.365169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4c455b32-64e8-4eec-b4f7-3d9b38255557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:44.486984 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2046/4105] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:25:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:44.517753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e85045-0e94-4286-8f3f-a2dce6c91068 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:44.518395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d180662-d225-40ef-b752-1cbb192a6d78 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:44.518708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d180662-d225-40ef-b752-1cbb192a6d78 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:44.518972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d180662-d225-40ef-b752-1cbb192a6d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:44.522018 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e0e85045-0e94-4286-8f3f-a2dce6c91068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:44.565508 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1d180662-d225-40ef-b752-1cbb192a6d78 None None] MFA Rules not processed for user `2a43de829b91441797cabd51581ad38a`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:44.567939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1d180662-d225-40ef-b752-1cbb192a6d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:44.677708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e85045-0e94-4286-8f3f-a2dce6c91068 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:44.684976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c410a72-9548-422b-8af2-144b695fbd84 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:44.686382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c410a72-9548-422b-8af2-144b695fbd84 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:44.687059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c410a72-9548-422b-8af2-144b695fbd84 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:44.687599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c410a72-9548-422b-8af2-144b695fbd84 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:44.711417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c410a72-9548-422b-8af2-144b695fbd84 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:44.713920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c410a72-9548-422b-8af2-144b695fbd84 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:44.719609 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:44.741083 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2060/4106] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:25:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:25:44.746158 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2047/4107] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:25:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:44.762139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7bc73-12d1-4088-984b-00e05c8e7506 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:44.763432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7bc73-12d1-4088-984b-00e05c8e7506 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:44.763902 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7bc73-12d1-4088-984b-00e05c8e7506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:44.795417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ebe7bc73-12d1-4088-984b-00e05c8e7506 None None] MFA Rules not processed for user `2a43de829b91441797cabd51581ad38a`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:44.797465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ebe7bc73-12d1-4088-984b-00e05c8e7506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:44.810730 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2061/4108] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:25:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:44.824552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d180662-d225-40ef-b752-1cbb192a6d78 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:44.826910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1d180662-d225-40ef-b752-1cbb192a6d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:44.870565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d180662-d225-40ef-b752-1cbb192a6d78 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:44.883665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe17ccf-22b4-4ea9-9b7e-b1b77fe68621 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:44.884379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe17ccf-22b4-4ea9-9b7e-b1b77fe68621 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:44.884660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe17ccf-22b4-4ea9-9b7e-b1b77fe68621 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:44.884931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe17ccf-22b4-4ea9-9b7e-b1b77fe68621 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:44.902481 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe17ccf-22b4-4ea9-9b7e-b1b77fe68621 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:44.904130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe17ccf-22b4-4ea9-9b7e-b1b77fe68621 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:44.931116 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2048/4109] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:25:45.534422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba5ff9-3e50-48d2-b8c9-e33542e26ce0 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:45.534706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba5ff9-3e50-48d2-b8c9-e33542e26ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:45.534973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba5ff9-3e50-48d2-b8c9-e33542e26ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:45.575498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-baba5ff9-3e50-48d2-b8c9-e33542e26ce0 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:45.577033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-baba5ff9-3e50-48d2-b8c9-e33542e26ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:45.587137 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2062/4110] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:25:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:25:45.609181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe17ccf-22b4-4ea9-9b7e-b1b77fe68621 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:45.643476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe17ccf-22b4-4ea9-9b7e-b1b77fe68621 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:45.659128 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698bb49-5e5d-4c2f-903c-e92175f1c6cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:45.660032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698bb49-5e5d-4c2f-903c-e92175f1c6cf service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:45.660628 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698bb49-5e5d-4c2f-903c-e92175f1c6cf service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:45.661248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698bb49-5e5d-4c2f-903c-e92175f1c6cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:45.685350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698bb49-5e5d-4c2f-903c-e92175f1c6cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:45.691383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698bb49-5e5d-4c2f-903c-e92175f1c6cf service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:45.732415 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2049/4111] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:25:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:25:46.344933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e3104-00a0-4511-aaa0-e6b08eae3901 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:46.345529 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e3104-00a0-4511-aaa0-e6b08eae3901 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:46.345529 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e3104-00a0-4511-aaa0-e6b08eae3901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:46.421063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3b8e3104-00a0-4511-aaa0-e6b08eae3901 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:46.431514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3b8e3104-00a0-4511-aaa0-e6b08eae3901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:46.464997 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2063/4112] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:25:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:25:46.496305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698bb49-5e5d-4c2f-903c-e92175f1c6cf service swift] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:46.517237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698bb49-5e5d-4c2f-903c-e92175f1c6cf service swift] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:46.546945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b40e4a-44bc-4023-84b5-f0adf0bd6f5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:46.547583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b40e4a-44bc-4023-84b5-f0adf0bd6f5c service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:46.547864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b40e4a-44bc-4023-84b5-f0adf0bd6f5c service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:46.550232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b40e4a-44bc-4023-84b5-f0adf0bd6f5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:46.596301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b40e4a-44bc-4023-84b5-f0adf0bd6f5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:46.598093 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b40e4a-44bc-4023-84b5-f0adf0bd6f5c service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:46.638208 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2050/4113] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:25:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:25:47.587536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1117d6-c3dd-4896-aae4-b9ebb3600563 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:47.588212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1117d6-c3dd-4896-aae4-b9ebb3600563 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:47.588483 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1117d6-c3dd-4896-aae4-b9ebb3600563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:47.614158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-8d1117d6-c3dd-4896-aae4-b9ebb3600563 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:47.615444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8d1117d6-c3dd-4896-aae4-b9ebb3600563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:47.634565 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2064/4114] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:25:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:47.640542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b40e4a-44bc-4023-84b5-f0adf0bd6f5c service swift] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:47.677430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b40e4a-44bc-4023-84b5-f0adf0bd6f5c service swift] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:47.700827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16277f-c57d-4542-95b1-7e498fff1a66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:47.700827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16277f-c57d-4542-95b1-7e498fff1a66 service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:47.700827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16277f-c57d-4542-95b1-7e498fff1a66 service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:47.700827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16277f-c57d-4542-95b1-7e498fff1a66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:47.717810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef16277f-c57d-4542-95b1-7e498fff1a66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:47.719775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef16277f-c57d-4542-95b1-7e498fff1a66 service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:47.731858 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2051/4115] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:25:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:25:48.667058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3deb13-b105-45e5-9d18-b5ea1a34f71e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:48.668188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3deb13-b105-45e5-9d18-b5ea1a34f71e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:48.668770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3deb13-b105-45e5-9d18-b5ea1a34f71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:48.722116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2f3deb13-b105-45e5-9d18-b5ea1a34f71e None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:48.724873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2f3deb13-b105-45e5-9d18-b5ea1a34f71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:48.747150 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2065/4116] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:25:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:48.784920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16277f-c57d-4542-95b1-7e498fff1a66 service swift] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:48.813477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16277f-c57d-4542-95b1-7e498fff1a66 service swift] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:48.824606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eacbfbd-78f1-4de3-bf97-05aa2c69aff9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:48.826452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eacbfbd-78f1-4de3-bf97-05aa2c69aff9 service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:48.828372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eacbfbd-78f1-4de3-bf97-05aa2c69aff9 service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:48.831631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eacbfbd-78f1-4de3-bf97-05aa2c69aff9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:48.861271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eacbfbd-78f1-4de3-bf97-05aa2c69aff9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:48.865680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eacbfbd-78f1-4de3-bf97-05aa2c69aff9 service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:48.908872 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2052/4117] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:25:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:25:49.401037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91cc82-9612-4ca2-913c-5a893c297956 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:49.401573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91cc82-9612-4ca2-913c-5a893c297956 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:49.402141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91cc82-9612-4ca2-913c-5a893c297956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:49.471342 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3d91cc82-9612-4ca2-913c-5a893c297956 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:49.477468 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3d91cc82-9612-4ca2-913c-5a893c297956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:49.501733 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2066/4118] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:25:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:25:49.522648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eacbfbd-78f1-4de3-bf97-05aa2c69aff9 service swift] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:49.542778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eacbfbd-78f1-4de3-bf97-05aa2c69aff9 service swift] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:49.565356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec3601-e09d-40e4-b0a2-53d27b8d5f7d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:49.569879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec3601-e09d-40e4-b0a2-53d27b8d5f7d service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:49.570513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec3601-e09d-40e4-b0a2-53d27b8d5f7d service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:49.571031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec3601-e09d-40e4-b0a2-53d27b8d5f7d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:49.621999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec3601-e09d-40e4-b0a2-53d27b8d5f7d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:49.631285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec3601-e09d-40e4-b0a2-53d27b8d5f7d service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:49.678061 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2053/4119] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:25:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:25:52.442339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f0f98-c405-454d-90dc-aa96e1ebc858 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:52.443296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f0f98-c405-454d-90dc-aa96e1ebc858 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:52.443732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f0f98-c405-454d-90dc-aa96e1ebc858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:52.567951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-844f0f98-c405-454d-90dc-aa96e1ebc858 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:52.569849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-844f0f98-c405-454d-90dc-aa96e1ebc858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:52.639695 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2067/4120] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:25:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:52.704981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec3601-e09d-40e4-b0a2-53d27b8d5f7d service swift] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:52.734097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec3601-e09d-40e4-b0a2-53d27b8d5f7d service swift] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:52.776432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e0700-8618-4da9-889f-775133c296bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:52.777387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e0700-8618-4da9-889f-775133c296bb service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:52.777818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e0700-8618-4da9-889f-775133c296bb service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:52.778529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e0700-8618-4da9-889f-775133c296bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:52.804750 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e0700-8618-4da9-889f-775133c296bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:52.808985 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e0700-8618-4da9-889f-775133c296bb service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:52.839294 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2054/4121] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:25:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:25:53.386246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7034ff3-e0c0-4a85-8404-cd364d9be812 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:53.386446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7034ff3-e0c0-4a85-8404-cd364d9be812 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:53.386617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7034ff3-e0c0-4a85-8404-cd364d9be812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:53.464640 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e7034ff3-e0c0-4a85-8404-cd364d9be812 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:53.465783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e7034ff3-e0c0-4a85-8404-cd364d9be812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:53.521408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e0700-8618-4da9-889f-775133c296bb service swift] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:53.521730 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2068/4122] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:25:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:53.540841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e0700-8618-4da9-889f-775133c296bb service swift] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:53.571511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c9108-cd8e-45bf-aeb2-695e77d81085 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:53.572185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c9108-cd8e-45bf-aeb2-695e77d81085 service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:53.572749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c9108-cd8e-45bf-aeb2-695e77d81085 service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:53.573250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c9108-cd8e-45bf-aeb2-695e77d81085 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:53.629009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c9108-cd8e-45bf-aeb2-695e77d81085 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:53.638710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c9108-cd8e-45bf-aeb2-695e77d81085 service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:53.693228 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2055/4123] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:25:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:25:54.149834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a043b43-42ee-4eca-a079-31638d05ef28 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:54.150139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a043b43-42ee-4eca-a079-31638d05ef28 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:54.150404 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a043b43-42ee-4eca-a079-31638d05ef28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:54.219525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6a043b43-42ee-4eca-a079-31638d05ef28 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:54.231954 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6a043b43-42ee-4eca-a079-31638d05ef28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:54.272665 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2069/4124] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:25:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:25:54.286882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c9108-cd8e-45bf-aeb2-695e77d81085 service swift] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:54.306486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c9108-cd8e-45bf-aeb2-695e77d81085 service swift] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:54.321063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a13934-e46e-4395-ba8b-c3d8d0ea1de4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:54.321773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a13934-e46e-4395-ba8b-c3d8d0ea1de4 service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:54.322062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a13934-e46e-4395-ba8b-c3d8d0ea1de4 service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:54.326545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a13934-e46e-4395-ba8b-c3d8d0ea1de4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:54.347117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a13934-e46e-4395-ba8b-c3d8d0ea1de4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:54.351671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a13934-e46e-4395-ba8b-c3d8d0ea1de4 service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:54.399209 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2056/4125] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:25:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 07 01:25:54.758859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d4aa8-4ac7-4fcd-a388-578e93469033 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:54.759462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d4aa8-4ac7-4fcd-a388-578e93469033 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:54.759607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d4aa8-4ac7-4fcd-a388-578e93469033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:54.808068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a22d4aa8-4ac7-4fcd-a388-578e93469033 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:54.809372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a22d4aa8-4ac7-4fcd-a388-578e93469033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:54.837474 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2070/4126] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:25:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:25:54.854426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a13934-e46e-4395-ba8b-c3d8d0ea1de4 service swift] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:54.881011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a13934-e46e-4395-ba8b-c3d8d0ea1de4 service swift] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:54.909980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689059a-d9fa-4c7b-8be8-1d5571ba4c48 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:54.911467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689059a-d9fa-4c7b-8be8-1d5571ba4c48 service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:54.911863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689059a-d9fa-4c7b-8be8-1d5571ba4c48 service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:54.912915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689059a-d9fa-4c7b-8be8-1d5571ba4c48 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:54.935256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689059a-d9fa-4c7b-8be8-1d5571ba4c48 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:54.940529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689059a-d9fa-4c7b-8be8-1d5571ba4c48 service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:54.965599 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2057/4127] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:25:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:25:56.022282 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d4017-7650-4c0d-aa00-8ef90a245ec1 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:56.023123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d4017-7650-4c0d-aa00-8ef90a245ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:56.023123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d4017-7650-4c0d-aa00-8ef90a245ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:56.060975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-103d4017-7650-4c0d-aa00-8ef90a245ec1 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:56.062594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-103d4017-7650-4c0d-aa00-8ef90a245ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:56.086426 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2071/4128] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:25:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:56.130351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689059a-d9fa-4c7b-8be8-1d5571ba4c48 service swift] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:56.154040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689059a-d9fa-4c7b-8be8-1d5571ba4c48 service swift] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:56.195366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1675226-95c8-4a0a-9488-bdc01e77b37c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:56.196114 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1675226-95c8-4a0a-9488-bdc01e77b37c service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:56.196489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1675226-95c8-4a0a-9488-bdc01e77b37c service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:56.197851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1675226-95c8-4a0a-9488-bdc01e77b37c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:56.249526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1675226-95c8-4a0a-9488-bdc01e77b37c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:56.251135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1675226-95c8-4a0a-9488-bdc01e77b37c service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:56.295620 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2058/4129] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:25:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:25:57.282653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20447795-11f3-467b-8733-112f8a858b06 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:57.283238 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20447795-11f3-467b-8733-112f8a858b06 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:57.283536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20447795-11f3-467b-8733-112f8a858b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:57.295621 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:57.349269 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-20447795-11f3-467b-8733-112f8a858b06 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:57.359618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-20447795-11f3-467b-8733-112f8a858b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:57.413558 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2072/4130] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:25:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:57.441745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1675226-95c8-4a0a-9488-bdc01e77b37c service swift] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:57.478558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1675226-95c8-4a0a-9488-bdc01e77b37c service swift] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:57.506694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1089e57-ac97-4de5-93fa-a36e329094ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:57.507331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1089e57-ac97-4de5-93fa-a36e329094ef service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:57.507611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1089e57-ac97-4de5-93fa-a36e329094ef service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:57.507914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1089e57-ac97-4de5-93fa-a36e329094ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:57.547832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1089e57-ac97-4de5-93fa-a36e329094ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:57.549475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1089e57-ac97-4de5-93fa-a36e329094ef service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:57.612807 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2059/4131] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:25:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:25:58.143526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20447795-11f3-467b-8733-112f8a858b06 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:58.362972 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20447795-11f3-467b-8733-112f8a858b06 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:58.381132 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde22c2d-4d0b-4ef7-b5b9-ba3dfadab296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:58.381971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde22c2d-4d0b-4ef7-b5b9-ba3dfadab296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:58.383153 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde22c2d-4d0b-4ef7-b5b9-ba3dfadab296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:58.383682 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde22c2d-4d0b-4ef7-b5b9-ba3dfadab296 admin admin] PATH_INFO: `/v3/users/fcfe13f8b0ac4c328a5f5c6f985b7c0b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:58.385199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde22c2d-4d0b-4ef7-b5b9-ba3dfadab296 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcfe13f8b0ac4c328a5f5c6f985b7c0b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:58.389870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde22c2d-4d0b-4ef7-b5b9-ba3dfadab296 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:58.500268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cde22c2d-4d0b-4ef7-b5b9-ba3dfadab296 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcfe13f8b0ac4c328a5f5c6f985b7c0b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:58.523415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cde22c2d-4d0b-4ef7-b5b9-ba3dfadab296 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcfe13f8b0ac4c328a5f5c6f985b7c0b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:58.585502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cde22c2d-4d0b-4ef7-b5b9-ba3dfadab296 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcfe13f8b0ac4c328a5f5c6f985b7c0b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:58.587142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cde22c2d-4d0b-4ef7-b5b9-ba3dfadab296 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcfe13f8b0ac4c328a5f5c6f985b7c0b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:58.610275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cde22c2d-4d0b-4ef7-b5b9-ba3dfadab296 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcfe13f8b0ac4c328a5f5c6f985b7c0b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:25:58.630281 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2073/4132] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:25:58 2022] DELETE /identity/v3/users/fcfe13f8b0ac4c328a5f5c6f985b7c0b => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:25:58.634550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91f02c-67eb-457c-9307-642c872db91d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:58.635121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91f02c-67eb-457c-9307-642c872db91d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:58.635121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91f02c-67eb-457c-9307-642c872db91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:58.699913 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-fa91f02c-67eb-457c-9307-642c872db91d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:25:58.701543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-fa91f02c-67eb-457c-9307-642c872db91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:58.770755 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:25:58.791072 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2060/4133] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:25:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:25:58.829416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde22c2d-4d0b-4ef7-b5b9-ba3dfadab296 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:25:58.833234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-cde22c2d-4d0b-4ef7-b5b9-ba3dfadab296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:25:59.126507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde22c2d-4d0b-4ef7-b5b9-ba3dfadab296 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:25:59.142923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959806e-55df-4e21-bbd4-21eddf15500e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:25:59.145773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959806e-55df-4e21-bbd4-21eddf15500e service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:25:59.145941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959806e-55df-4e21-bbd4-21eddf15500e service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:25:59.146217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959806e-55df-4e21-bbd4-21eddf15500e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:25:59.177236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959806e-55df-4e21-bbd4-21eddf15500e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:25:59.179058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959806e-55df-4e21-bbd4-21eddf15500e service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:25:59.194181 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2074/4134] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:25:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:26:00.899403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91f02c-67eb-457c-9307-642c872db91d None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:00.901106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-fa91f02c-67eb-457c-9307-642c872db91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:00.922339 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91f02c-67eb-457c-9307-642c872db91d None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:00.932925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aedb33-1666-49e4-b46d-ba5153fa6078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:00.933573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aedb33-1666-49e4-b46d-ba5153fa6078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:00.933845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aedb33-1666-49e4-b46d-ba5153fa6078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:00.934117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aedb33-1666-49e4-b46d-ba5153fa6078 admin admin] PATH_INFO: `/v3/projects/3b11bcd11bf84c85ad4efe333f5530c6` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:00.941849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aedb33-1666-49e4-b46d-ba5153fa6078 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b11bcd11bf84c85ad4efe333f5530c6)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:00.944113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aedb33-1666-49e4-b46d-ba5153fa6078 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:01.101292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-74aedb33-1666-49e4-b46d-ba5153fa6078 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b11bcd11bf84c85ad4efe333f5530c6', 'request_id': 'req-74aedb33-1666-49e4-b46d-ba5153fa6078'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:01.122638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-74aedb33-1666-49e4-b46d-ba5153fa6078 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b11bcd11bf84c85ad4efe333f5530c6', 'request_id': 'req-74aedb33-1666-49e4-b46d-ba5153fa6078'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:01.145550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-74aedb33-1666-49e4-b46d-ba5153fa6078 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b11bcd11bf84c85ad4efe333f5530c6', 'request_id': 'req-74aedb33-1666-49e4-b46d-ba5153fa6078'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:01.164128 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-74aedb33-1666-49e4-b46d-ba5153fa6078 admin admin] The token cache is being invalidate because project 3b11bcd11bf84c85ad4efe333f5530c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:26:01.164481 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-74aedb33-1666-49e4-b46d-ba5153fa6078 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:01.165922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-74aedb33-1666-49e4-b46d-ba5153fa6078 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:01.173801 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2061/4135] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:26:00 2022] DELETE /identity/v3/projects/3b11bcd11bf84c85ad4efe333f5530c6 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:01.176283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95add26a-7c87-4db0-8718-b09f2e6b92bb None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:01.176759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95add26a-7c87-4db0-8718-b09f2e6b92bb None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:01.177099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95add26a-7c87-4db0-8718-b09f2e6b92bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:01.304428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-95add26a-7c87-4db0-8718-b09f2e6b92bb None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:01.307908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-95add26a-7c87-4db0-8718-b09f2e6b92bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:01.364446 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:01.385104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d410fd-1643-4a72-9c6b-1dcebe6a4f26 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:01.385644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d410fd-1643-4a72-9c6b-1dcebe6a4f26 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:01.386074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d410fd-1643-4a72-9c6b-1dcebe6a4f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:01.430867 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-13d410fd-1643-4a72-9c6b-1dcebe6a4f26 None None] MFA Rules not processed for user `d1f0c01c340940388b440932d51988ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:01.432118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-13d410fd-1643-4a72-9c6b-1dcebe6a4f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:01.505559 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2075/4136] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:01.518250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc46f2f-f457-494e-8aac-7276f5058fb2 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:01.518771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc46f2f-f457-494e-8aac-7276f5058fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:01.519980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc46f2f-f457-494e-8aac-7276f5058fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:01.572464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3cc46f2f-f457-494e-8aac-7276f5058fb2 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:01.575113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3cc46f2f-f457-494e-8aac-7276f5058fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:01.613908 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2076/4137] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:01.615419 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc46f2f-f457-494e-8aac-7276f5058fb2 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:01.637624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc46f2f-f457-494e-8aac-7276f5058fb2 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:01.650072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10a64b-2f6b-4117-82a5-dc740f46b606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:01.650763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10a64b-2f6b-4117-82a5-dc740f46b606 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:01.651045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10a64b-2f6b-4117-82a5-dc740f46b606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:01.651315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10a64b-2f6b-4117-82a5-dc740f46b606 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:01.654265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10a64b-2f6b-4117-82a5-dc740f46b606 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:26:01.654658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10a64b-2f6b-4117-82a5-dc740f46b606 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:01.666211 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2062/4138] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:01.670605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10a64b-2f6b-4117-82a5-dc740f46b606 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:01.717906 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d410fd-1643-4a72-9c6b-1dcebe6a4f26 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:01.719974 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2077/4139] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:26:01.738850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d410fd-1643-4a72-9c6b-1dcebe6a4f26 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:01.762477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05fa51-1f07-4b3d-9b7f-f6b044a14ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:01.764666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05fa51-1f07-4b3d-9b7f-f6b044a14ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:01.765187 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05fa51-1f07-4b3d-9b7f-f6b044a14ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:01.765618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05fa51-1f07-4b3d-9b7f-f6b044a14ce1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:01.766451 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05fa51-1f07-4b3d-9b7f-f6b044a14ce1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:01.768833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05fa51-1f07-4b3d-9b7f-f6b044a14ce1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:01.850464 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2063/4140] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:26:01 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:26:01.855684 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10a64b-2f6b-4117-82a5-dc740f46b606 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:01.877266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10a64b-2f6b-4117-82a5-dc740f46b606 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:01.914017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36064e56-092d-4d7c-af2c-dc9317496cb1 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:01.914571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36064e56-092d-4d7c-af2c-dc9317496cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:01.914571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36064e56-092d-4d7c-af2c-dc9317496cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:01.965482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-36064e56-092d-4d7c-af2c-dc9317496cb1 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:01.969524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-36064e56-092d-4d7c-af2c-dc9317496cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:02.049573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79522b7-3bc0-4041-b0e3-24db870ffd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:02.050282 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79522b7-3bc0-4041-b0e3-24db870ffd60 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:02.050690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79522b7-3bc0-4041-b0e3-24db870ffd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:02.051013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79522b7-3bc0-4041-b0e3-24db870ffd60 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:02.051683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79522b7-3bc0-4041-b0e3-24db870ffd60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:02.054898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79522b7-3bc0-4041-b0e3-24db870ffd60 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:02.119752 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2064/4141] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:26:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:26:02.121224 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36064e56-092d-4d7c-af2c-dc9317496cb1 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:02.123813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-36064e56-092d-4d7c-af2c-dc9317496cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:02.125245 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2078/4142] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:26:01 2022] POST /identity/v3/users => generated 293 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:26:02.126880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79522b7-3bc0-4041-b0e3-24db870ffd60 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:02.133072 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:02.156322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79522b7-3bc0-4041-b0e3-24db870ffd60 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:02.169579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d0544-21ff-41e4-a05b-df925c3ffefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:02.170502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d0544-21ff-41e4-a05b-df925c3ffefd admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:02.171225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d0544-21ff-41e4-a05b-df925c3ffefd admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:02.171503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d0544-21ff-41e4-a05b-df925c3ffefd admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:02.172538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d0544-21ff-41e4-a05b-df925c3ffefd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:02.174447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d0544-21ff-41e4-a05b-df925c3ffefd admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:02.244387 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2079/4143] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:26:02.245331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d0544-21ff-41e4-a05b-df925c3ffefd admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:02.269874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d0544-21ff-41e4-a05b-df925c3ffefd admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:02.280832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36064e56-092d-4d7c-af2c-dc9317496cb1 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:02.287154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdb7e7-de13-4335-a249-8bb4156a2a5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:02.288577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdb7e7-de13-4335-a249-8bb4156a2a5a service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:02.289089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdb7e7-de13-4335-a249-8bb4156a2a5a service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:02.289728 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdb7e7-de13-4335-a249-8bb4156a2a5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:02.301350 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e33298-871f-4767-873e-d3dd977e1681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:02.301986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e33298-871f-4767-873e-d3dd977e1681 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:02.302260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e33298-871f-4767-873e-d3dd977e1681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:02.302526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e33298-871f-4767-873e-d3dd977e1681 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:02.309446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e33298-871f-4767-873e-d3dd977e1681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:02.311269 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e33298-871f-4767-873e-d3dd977e1681 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:02.320868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bdb7e7-de13-4335-a249-8bb4156a2a5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:02.323522 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2080/4144] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:26:02.329984 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e33298-871f-4767-873e-d3dd977e1681 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:02.345112 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bdb7e7-de13-4335-a249-8bb4156a2a5a service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:02.350794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e33298-871f-4767-873e-d3dd977e1681 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:02.365669 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271afcbd-3131-4e8e-9e1b-bfc84e967429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:02.366516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271afcbd-3131-4e8e-9e1b-bfc84e967429 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:02.366894 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271afcbd-3131-4e8e-9e1b-bfc84e967429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:02.367221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271afcbd-3131-4e8e-9e1b-bfc84e967429 admin admin] PATH_INFO: `/v3/projects/bdcca9bc1cd141ee9dd9f9233851ed67/users/15a6057926254c4a891048d0c66ad522/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:02.386224 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2065/4145] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:26:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:26:02.412366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271afcbd-3131-4e8e-9e1b-bfc84e967429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdcca9bc1cd141ee9dd9f9233851ed67, user_id=15a6057926254c4a891048d0c66ad522, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:02.414636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271afcbd-3131-4e8e-9e1b-bfc84e967429 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:02.447503 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2081/4146] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:26:02 2022] PUT /identity/v3/projects/bdcca9bc1cd141ee9dd9f9233851ed67/users/15a6057926254c4a891048d0c66ad522/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:02.459771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2839b5-03e9-4396-84d0-63c83869407d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:02.460387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2839b5-03e9-4396-84d0-63c83869407d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:02.460387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2839b5-03e9-4396-84d0-63c83869407d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:02.537706 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-dc2839b5-03e9-4396-84d0-63c83869407d None None] MFA Rules not processed for user `15a6057926254c4a891048d0c66ad522`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:02.541096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-dc2839b5-03e9-4396-84d0-63c83869407d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:02.854985 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2066/4147] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:02.858537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271afcbd-3131-4e8e-9e1b-bfc84e967429 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:02.985025 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:03.096220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271afcbd-3131-4e8e-9e1b-bfc84e967429 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:03.128632 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326111f-4326-4b07-9b0b-f0449b1dce1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:03.129274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326111f-4326-4b07-9b0b-f0449b1dce1f admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:03.139545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326111f-4326-4b07-9b0b-f0449b1dce1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:03.139545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326111f-4326-4b07-9b0b-f0449b1dce1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:03.139545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326111f-4326-4b07-9b0b-f0449b1dce1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:03.152175 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326111f-4326-4b07-9b0b-f0449b1dce1f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:03.267391 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2082/4148] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:26:02 2022] POST /identity/v3/projects => generated 383 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:26:03.271167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2839b5-03e9-4396-84d0-63c83869407d None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:03.291680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2839b5-03e9-4396-84d0-63c83869407d None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:03.448847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5647a-ebe5-462d-a3c9-0f5eacca4ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:03.450993 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5647a-ebe5-462d-a3c9-0f5eacca4ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:03.451281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5647a-ebe5-462d-a3c9-0f5eacca4ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:03.451557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5647a-ebe5-462d-a3c9-0f5eacca4ef2 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:03.452248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5647a-ebe5-462d-a3c9-0f5eacca4ef2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:03.454460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5647a-ebe5-462d-a3c9-0f5eacca4ef2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:03.539051 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2067/4149] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:26:03 2022] POST /identity/v3/users => generated 298 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:26:03.541433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326111f-4326-4b07-9b0b-f0449b1dce1f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:03.569208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326111f-4326-4b07-9b0b-f0449b1dce1f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:03.591020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78c683-7fe1-417a-80c1-c2a6244de257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:03.599412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78c683-7fe1-417a-80c1-c2a6244de257 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:03.600074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78c683-7fe1-417a-80c1-c2a6244de257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:03.601685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78c683-7fe1-417a-80c1-c2a6244de257 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:03.602610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78c683-7fe1-417a-80c1-c2a6244de257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:03.609023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78c683-7fe1-417a-80c1-c2a6244de257 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:03.670708 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2083/4150] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:26:03.671919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5647a-ebe5-462d-a3c9-0f5eacca4ef2 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:03.691937 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5647a-ebe5-462d-a3c9-0f5eacca4ef2 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:03.725216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593acb1-e529-4eec-9de2-99f3bcae7438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:03.725905 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593acb1-e529-4eec-9de2-99f3bcae7438 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:03.726267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593acb1-e529-4eec-9de2-99f3bcae7438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:03.726611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593acb1-e529-4eec-9de2-99f3bcae7438 admin admin] PATH_INFO: `/v3/projects/df033df95be34445bc09a7e8c6b57855/users/38c0ae623c1f4e2ea5fba3afed0c9a1b/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:03.753177 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:03.784398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593acb1-e529-4eec-9de2-99f3bcae7438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df033df95be34445bc09a7e8c6b57855, user_id=38c0ae623c1f4e2ea5fba3afed0c9a1b, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:03.787719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593acb1-e529-4eec-9de2-99f3bcae7438 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:03.830019 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2068/4151] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:26:03 2022] PUT /identity/v3/projects/df033df95be34445bc09a7e8c6b57855/users/38c0ae623c1f4e2ea5fba3afed0c9a1b/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:03.834694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78c683-7fe1-417a-80c1-c2a6244de257 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:03.864519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78c683-7fe1-417a-80c1-c2a6244de257 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:04.094016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d8ed7-0f29-4838-9ac2-d302494e0bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:04.094595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d8ed7-0f29-4838-9ac2-d302494e0bee admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:04.094929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d8ed7-0f29-4838-9ac2-d302494e0bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:04.095322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d8ed7-0f29-4838-9ac2-d302494e0bee admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:04.097739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d8ed7-0f29-4838-9ac2-d302494e0bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:04.103639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d8ed7-0f29-4838-9ac2-d302494e0bee admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:04.133590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593acb1-e529-4eec-9de2-99f3bcae7438 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:04.136004 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2084/4152] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:26:04.163546 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593acb1-e529-4eec-9de2-99f3bcae7438 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:04.194409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2cb5b-f204-4bff-ad49-4d03278a4864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:04.195088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2cb5b-f204-4bff-ad49-4d03278a4864 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:04.195368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2cb5b-f204-4bff-ad49-4d03278a4864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:04.195640 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2cb5b-f204-4bff-ad49-4d03278a4864 admin admin] PATH_INFO: `/v3/projects/df033df95be34445bc09a7e8c6b57855/users/38c0ae623c1f4e2ea5fba3afed0c9a1b/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:04.198848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2cb5b-f204-4bff-ad49-4d03278a4864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df033df95be34445bc09a7e8c6b57855, user_id=38c0ae623c1f4e2ea5fba3afed0c9a1b, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:04.212630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2cb5b-f204-4bff-ad49-4d03278a4864 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:04.236486 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2069/4153] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:26:04 2022] PUT /identity/v3/projects/df033df95be34445bc09a7e8c6b57855/users/38c0ae623c1f4e2ea5fba3afed0c9a1b/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:04.250070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a11dc6-b135-420b-8f48-6bda9d6bdd32 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:04.250364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a11dc6-b135-420b-8f48-6bda9d6bdd32 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:04.250679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a11dc6-b135-420b-8f48-6bda9d6bdd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:04.315764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c2a11dc6-b135-420b-8f48-6bda9d6bdd32 None None] MFA Rules not processed for user `38c0ae623c1f4e2ea5fba3afed0c9a1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:04.322339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c2a11dc6-b135-420b-8f48-6bda9d6bdd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:04.515128 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2085/4154] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:04 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:04.638384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2cb5b-f204-4bff-ad49-4d03278a4864 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:04.641462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-66c2cb5b-f204-4bff-ad49-4d03278a4864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:04.899572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2cb5b-f204-4bff-ad49-4d03278a4864 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:04.929555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25456300-1601-476d-93b0-8a0b6c0810ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:04.930598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25456300-1601-476d-93b0-8a0b6c0810ee service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:04.931163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25456300-1601-476d-93b0-8a0b6c0810ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:04.931721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25456300-1601-476d-93b0-8a0b6c0810ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:05.124283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25456300-1601-476d-93b0-8a0b6c0810ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:05.125801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25456300-1601-476d-93b0-8a0b6c0810ee service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:05.148442 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2070/4155] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:26:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:26:06.902220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f40ae-b078-4b03-8d6f-5123201be63b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:06.903316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f40ae-b078-4b03-8d6f-5123201be63b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:06.903826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f40ae-b078-4b03-8d6f-5123201be63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:06.909694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25456300-1601-476d-93b0-8a0b6c0810ee service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:06.924351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25456300-1601-476d-93b0-8a0b6c0810ee service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:06.942530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a09f5b-af64-4374-bec2-9e9927501bd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:06.952990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-595f40ae-b078-4b03-8d6f-5123201be63b None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:06.954930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-595f40ae-b078-4b03-8d6f-5123201be63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:06.960138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a09f5b-af64-4374-bec2-9e9927501bd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:06.960521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a09f5b-af64-4374-bec2-9e9927501bd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:06.960805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a09f5b-af64-4374-bec2-9e9927501bd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:07.028846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a09f5b-af64-4374-bec2-9e9927501bd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:07.030422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a09f5b-af64-4374-bec2-9e9927501bd4 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:07.052461 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:07.085244 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2071/4156] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:26:06 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:26:07.139404 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2086/4157] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:26:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:26:07.151585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a09f5b-af64-4374-bec2-9e9927501bd4 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:07.378535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a09f5b-af64-4374-bec2-9e9927501bd4 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:07.394251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d63ae-9aa9-46ca-88bd-ed00b27971bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:07.395266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d63ae-9aa9-46ca-88bd-ed00b27971bd service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:07.395762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d63ae-9aa9-46ca-88bd-ed00b27971bd service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:07.396325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d63ae-9aa9-46ca-88bd-ed00b27971bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:07.410361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d63ae-9aa9-46ca-88bd-ed00b27971bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:07.413080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d63ae-9aa9-46ca-88bd-ed00b27971bd service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:07.425720 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2072/4158] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:26:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:26:12.289965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f40ae-b078-4b03-8d6f-5123201be63b None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:12.291678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-595f40ae-b078-4b03-8d6f-5123201be63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:12.400727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d63ae-9aa9-46ca-88bd-ed00b27971bd service swift] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:12.402346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3f8d63ae-9aa9-46ca-88bd-ed00b27971bd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:12.410354 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:12.583425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f40ae-b078-4b03-8d6f-5123201be63b None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:12.608057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a43a4-7cb4-4565-9d49-43dc8968ec84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:12.608877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a43a4-7cb4-4565-9d49-43dc8968ec84 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:12.609567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a43a4-7cb4-4565-9d49-43dc8968ec84 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:12.614062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a43a4-7cb4-4565-9d49-43dc8968ec84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:12.630692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-965a43a4-7cb4-4565-9d49-43dc8968ec84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:12.681721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d63ae-9aa9-46ca-88bd-ed00b27971bd service swift] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:12.685414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a43a4-7cb4-4565-9d49-43dc8968ec84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:12.693025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a43a4-7cb4-4565-9d49-43dc8968ec84 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:12.705705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0d011-2092-4e94-bf12-1890a92ef7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:12.706991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0d011-2092-4e94-bf12-1890a92ef7a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:12.706991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0d011-2092-4e94-bf12-1890a92ef7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:12.712089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0d011-2092-4e94-bf12-1890a92ef7a8 admin admin] PATH_INFO: `/v3/users/01f5d52a90024c6fb65e16ac74f0e567` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:12.715237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0d011-2092-4e94-bf12-1890a92ef7a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01f5d52a90024c6fb65e16ac74f0e567)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:12.717244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0d011-2092-4e94-bf12-1890a92ef7a8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:12.747160 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2087/4159] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:26:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:26:12.942129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7cb0d011-2092-4e94-bf12-1890a92ef7a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01f5d52a90024c6fb65e16ac74f0e567'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:12.973106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7cb0d011-2092-4e94-bf12-1890a92ef7a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01f5d52a90024c6fb65e16ac74f0e567'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:13.006834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7cb0d011-2092-4e94-bf12-1890a92ef7a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01f5d52a90024c6fb65e16ac74f0e567'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:13.009508 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7cb0d011-2092-4e94-bf12-1890a92ef7a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01f5d52a90024c6fb65e16ac74f0e567'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:13.034764 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7cb0d011-2092-4e94-bf12-1890a92ef7a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01f5d52a90024c6fb65e16ac74f0e567'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:13.050746 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2073/4160] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:26:12 2022] DELETE /identity/v3/users/01f5d52a90024c6fb65e16ac74f0e567 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:14.665066 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a43a4-7cb4-4565-9d49-43dc8968ec84 service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:14.687158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a43a4-7cb4-4565-9d49-43dc8968ec84 service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:14.889637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941badd3-f7cb-47fe-8a46-57eb1dae6fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:14.890345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941badd3-f7cb-47fe-8a46-57eb1dae6fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:14.890609 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941badd3-f7cb-47fe-8a46-57eb1dae6fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:14.890935 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941badd3-f7cb-47fe-8a46-57eb1dae6fa8 admin admin] PATH_INFO: `/v3/projects/813f7f5e51dd45cdb96dbdc7d4929dcc` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:14.892563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941badd3-f7cb-47fe-8a46-57eb1dae6fa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=813f7f5e51dd45cdb96dbdc7d4929dcc)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:14.894800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941badd3-f7cb-47fe-8a46-57eb1dae6fa8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:15.034069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-941badd3-f7cb-47fe-8a46-57eb1dae6fa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '813f7f5e51dd45cdb96dbdc7d4929dcc', 'request_id': 'req-941badd3-f7cb-47fe-8a46-57eb1dae6fa8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:15.053443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-941badd3-f7cb-47fe-8a46-57eb1dae6fa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '813f7f5e51dd45cdb96dbdc7d4929dcc', 'request_id': 'req-941badd3-f7cb-47fe-8a46-57eb1dae6fa8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:15.069200 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-941badd3-f7cb-47fe-8a46-57eb1dae6fa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '813f7f5e51dd45cdb96dbdc7d4929dcc', 'request_id': 'req-941badd3-f7cb-47fe-8a46-57eb1dae6fa8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:15.102849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-941badd3-f7cb-47fe-8a46-57eb1dae6fa8 admin admin] The token cache is being invalidate because project 813f7f5e51dd45cdb96dbdc7d4929dcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:26:15.103142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-941badd3-f7cb-47fe-8a46-57eb1dae6fa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:15.104889 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-941badd3-f7cb-47fe-8a46-57eb1dae6fa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:15.110807 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2088/4161] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:26:14 2022] DELETE /identity/v3/projects/813f7f5e51dd45cdb96dbdc7d4929dcc => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:15.114581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0d011-2092-4e94-bf12-1890a92ef7a8 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:15.116493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7cb0d011-2092-4e94-bf12-1890a92ef7a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:15.138033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0d011-2092-4e94-bf12-1890a92ef7a8 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:15.391064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadfc27e-125d-4a93-86e2-a4cd09f2ffaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:15.398636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfc27e-125d-4a93-86e2-a4cd09f2ffaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:15.399140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfc27e-125d-4a93-86e2-a4cd09f2ffaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:15.399433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfc27e-125d-4a93-86e2-a4cd09f2ffaa admin admin] PATH_INFO: `/v3/users/f07ba5e6d34f4c6c9194c562174f3006` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:15.403407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadfc27e-125d-4a93-86e2-a4cd09f2ffaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f07ba5e6d34f4c6c9194c562174f3006)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:15.413122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadfc27e-125d-4a93-86e2-a4cd09f2ffaa admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:15.503589 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:15.552544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aadfc27e-125d-4a93-86e2-a4cd09f2ffaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f07ba5e6d34f4c6c9194c562174f3006'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:15.573391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aadfc27e-125d-4a93-86e2-a4cd09f2ffaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f07ba5e6d34f4c6c9194c562174f3006'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:15.606559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aadfc27e-125d-4a93-86e2-a4cd09f2ffaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f07ba5e6d34f4c6c9194c562174f3006'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:15.608907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aadfc27e-125d-4a93-86e2-a4cd09f2ffaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f07ba5e6d34f4c6c9194c562174f3006'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:15.626151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aadfc27e-125d-4a93-86e2-a4cd09f2ffaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f07ba5e6d34f4c6c9194c562174f3006'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:15.645606 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2074/4162] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:26:15 2022] DELETE /identity/v3/users/f07ba5e6d34f4c6c9194c562174f3006 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:18.119781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941badd3-f7cb-47fe-8a46-57eb1dae6fa8 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:18.123674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-941badd3-f7cb-47fe-8a46-57eb1dae6fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:18.141511 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:18.191362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941badd3-f7cb-47fe-8a46-57eb1dae6fa8 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:18.434757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bf0bc-23bb-4964-aaa0-1e96b740ef7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:18.440557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bf0bc-23bb-4964-aaa0-1e96b740ef7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:18.440748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bf0bc-23bb-4964-aaa0-1e96b740ef7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:18.441017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bf0bc-23bb-4964-aaa0-1e96b740ef7f admin admin] PATH_INFO: `/v3/projects/b6ec6817209b42119074914b2274edeb` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:18.450895 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3bf0bc-23bb-4964-aaa0-1e96b740ef7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6ec6817209b42119074914b2274edeb)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:18.453181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3bf0bc-23bb-4964-aaa0-1e96b740ef7f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:18.587479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fe3bf0bc-23bb-4964-aaa0-1e96b740ef7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6ec6817209b42119074914b2274edeb', 'request_id': 'req-fe3bf0bc-23bb-4964-aaa0-1e96b740ef7f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:18.603266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fe3bf0bc-23bb-4964-aaa0-1e96b740ef7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6ec6817209b42119074914b2274edeb', 'request_id': 'req-fe3bf0bc-23bb-4964-aaa0-1e96b740ef7f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:18.628515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fe3bf0bc-23bb-4964-aaa0-1e96b740ef7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6ec6817209b42119074914b2274edeb', 'request_id': 'req-fe3bf0bc-23bb-4964-aaa0-1e96b740ef7f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:18.677500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fe3bf0bc-23bb-4964-aaa0-1e96b740ef7f admin admin] The token cache is being invalidate because project b6ec6817209b42119074914b2274edeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:26:18.677775 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fe3bf0bc-23bb-4964-aaa0-1e96b740ef7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:18.680281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fe3bf0bc-23bb-4964-aaa0-1e96b740ef7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:18.685113 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2089/4163] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:26:18 2022] DELETE /identity/v3/projects/b6ec6817209b42119074914b2274edeb => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:18.689918 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b1f55-5ad3-4b16-ae5a-3726852cf8e9 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:18.690470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b1f55-5ad3-4b16-ae5a-3726852cf8e9 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:18.690568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b1f55-5ad3-4b16-ae5a-3726852cf8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:18.750510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7b3b1f55-5ad3-4b16-ae5a-3726852cf8e9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:18.751808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7b3b1f55-5ad3-4b16-ae5a-3726852cf8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:19.012909 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2075/4164] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:19.022701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685204a-2b3d-4b02-9db5-f7bce2a06762 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:19.023020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685204a-2b3d-4b02-9db5-f7bce2a06762 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:19.023298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685204a-2b3d-4b02-9db5-f7bce2a06762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:19.088081 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2685204a-2b3d-4b02-9db5-f7bce2a06762 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:19.091667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2685204a-2b3d-4b02-9db5-f7bce2a06762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:19.139453 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2090/4165] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:19.144609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b1f55-5ad3-4b16-ae5a-3726852cf8e9 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:19.159961 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b1f55-5ad3-4b16-ae5a-3726852cf8e9 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:19.179745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1997cb-db50-4abd-ae8e-5f804fb7d6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:19.180864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1997cb-db50-4abd-ae8e-5f804fb7d6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:19.181873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1997cb-db50-4abd-ae8e-5f804fb7d6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:19.182453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1997cb-db50-4abd-ae8e-5f804fb7d6a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:19.183257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1997cb-db50-4abd-ae8e-5f804fb7d6a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:26:19.183565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1997cb-db50-4abd-ae8e-5f804fb7d6a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:19.186205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1997cb-db50-4abd-ae8e-5f804fb7d6a4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:19.214136 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2076/4166] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:26:19.216577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2685204a-2b3d-4b02-9db5-f7bce2a06762 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:19.238985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2685204a-2b3d-4b02-9db5-f7bce2a06762 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:19.286486 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f30a9-6cee-46a8-9795-a8b72a1cb9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:19.289265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f30a9-6cee-46a8-9795-a8b72a1cb9a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:19.289838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f30a9-6cee-46a8-9795-a8b72a1cb9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:19.290304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f30a9-6cee-46a8-9795-a8b72a1cb9a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:19.291178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f30a9-6cee-46a8-9795-a8b72a1cb9a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:19.294498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f30a9-6cee-46a8-9795-a8b72a1cb9a9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:19.395677 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2091/4167] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:26:19 2022] POST /identity/v3/projects => generated 357 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:26:19.403964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1997cb-db50-4abd-ae8e-5f804fb7d6a4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:19.456699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1997cb-db50-4abd-ae8e-5f804fb7d6a4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:19.625525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41b468-2ebe-4a6a-a803-1a36065eec7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:19.626167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41b468-2ebe-4a6a-a803-1a36065eec7b admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:19.627579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41b468-2ebe-4a6a-a803-1a36065eec7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:19.628829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41b468-2ebe-4a6a-a803-1a36065eec7b admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:19.632584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41b468-2ebe-4a6a-a803-1a36065eec7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:19.635380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41b468-2ebe-4a6a-a803-1a36065eec7b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:19.686368 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2077/4168] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:26:19 2022] POST /identity/v3/users => generated 279 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:26:19.693003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f30a9-6cee-46a8-9795-a8b72a1cb9a9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:19.709530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f30a9-6cee-46a8-9795-a8b72a1cb9a9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:19.738784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91fa1f-a83d-4ea4-89d4-2fe6064d937b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:19.739801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91fa1f-a83d-4ea4-89d4-2fe6064d937b admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:19.742170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91fa1f-a83d-4ea4-89d4-2fe6064d937b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:19.743060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91fa1f-a83d-4ea4-89d4-2fe6064d937b admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:19.743940 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91fa1f-a83d-4ea4-89d4-2fe6064d937b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:19.752050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91fa1f-a83d-4ea4-89d4-2fe6064d937b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:19.794187 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2092/4169] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:26:19.797550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41b468-2ebe-4a6a-a803-1a36065eec7b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:19.816917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41b468-2ebe-4a6a-a803-1a36065eec7b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:19.827591 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f672a-f1bf-45a6-a085-441e00500a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:19.828241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f672a-f1bf-45a6-a085-441e00500a23 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:19.830551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f672a-f1bf-45a6-a085-441e00500a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:19.831134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f672a-f1bf-45a6-a085-441e00500a23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:19.832246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f672a-f1bf-45a6-a085-441e00500a23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:19.837693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f672a-f1bf-45a6-a085-441e00500a23 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:19.890847 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2078/4170] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:26:19.895262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91fa1f-a83d-4ea4-89d4-2fe6064d937b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:19.912348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91fa1f-a83d-4ea4-89d4-2fe6064d937b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:19.922360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21147cc2-e61c-4d26-98a4-d44a3deaebb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:19.923586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21147cc2-e61c-4d26-98a4-d44a3deaebb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:19.924132 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21147cc2-e61c-4d26-98a4-d44a3deaebb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:19.925277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21147cc2-e61c-4d26-98a4-d44a3deaebb1 admin admin] PATH_INFO: `/v3/projects/de4bc771ef8e4c23b893a3cc1361f4d0/users/e0fa4e0bb5bf4c67b243d47347c17ed0/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:19.970544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21147cc2-e61c-4d26-98a4-d44a3deaebb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de4bc771ef8e4c23b893a3cc1361f4d0, user_id=e0fa4e0bb5bf4c67b243d47347c17ed0, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:19.986693 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21147cc2-e61c-4d26-98a4-d44a3deaebb1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:20.025666 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2093/4171] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:26:19 2022] PUT /identity/v3/projects/de4bc771ef8e4c23b893a3cc1361f4d0/users/e0fa4e0bb5bf4c67b243d47347c17ed0/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:20.038136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e024a4-3107-41ac-bdb2-b046f93caf13 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:20.038418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e024a4-3107-41ac-bdb2-b046f93caf13 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:20.038748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e024a4-3107-41ac-bdb2-b046f93caf13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:20.101720 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:20.137162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d7e024a4-3107-41ac-bdb2-b046f93caf13 None None] MFA Rules not processed for user `e0fa4e0bb5bf4c67b243d47347c17ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:20.138370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d7e024a4-3107-41ac-bdb2-b046f93caf13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:20.402492 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2079/4172] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:20 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:20.407082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21147cc2-e61c-4d26-98a4-d44a3deaebb1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:20.516112 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:20.602164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21147cc2-e61c-4d26-98a4-d44a3deaebb1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:20.608216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e419a74-1205-4197-948d-ad017820734e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:20.608857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e419a74-1205-4197-948d-ad017820734e admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:20.609133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e419a74-1205-4197-948d-ad017820734e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:20.609456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e419a74-1205-4197-948d-ad017820734e admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:20.610098 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e419a74-1205-4197-948d-ad017820734e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:20.612959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e419a74-1205-4197-948d-ad017820734e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:20.666054 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2094/4173] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:26:20 2022] POST /identity/v3/projects => generated 361 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:26:20.670324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e024a4-3107-41ac-bdb2-b046f93caf13 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:20.691974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e024a4-3107-41ac-bdb2-b046f93caf13 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:20.876690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7aeb2-e61f-43b4-b7b5-b15bdffee04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:20.877370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7aeb2-e61f-43b4-b7b5-b15bdffee04b admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:20.877733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7aeb2-e61f-43b4-b7b5-b15bdffee04b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:20.877931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7aeb2-e61f-43b4-b7b5-b15bdffee04b admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:20.878587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc7aeb2-e61f-43b4-b7b5-b15bdffee04b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:20.884955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc7aeb2-e61f-43b4-b7b5-b15bdffee04b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:20.947024 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2080/4174] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:26:20 2022] POST /identity/v3/users => generated 287 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:26:20.953867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e419a74-1205-4197-948d-ad017820734e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:20.980795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e419a74-1205-4197-948d-ad017820734e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:20.997085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744ef23-8c06-4a04-8163-4f19be40dac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:20.997947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744ef23-8c06-4a04-8163-4f19be40dac3 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:20.998390 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744ef23-8c06-4a04-8163-4f19be40dac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:20.998834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744ef23-8c06-4a04-8163-4f19be40dac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:21.000341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6744ef23-8c06-4a04-8163-4f19be40dac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:21.004513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6744ef23-8c06-4a04-8163-4f19be40dac3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:21.055768 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2095/4175] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:26:21.060465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7aeb2-e61f-43b4-b7b5-b15bdffee04b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:21.093195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7aeb2-e61f-43b4-b7b5-b15bdffee04b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:21.119375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2881a-9ebc-4b2c-a788-f7082c6b1bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:21.123382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2881a-9ebc-4b2c-a788-f7082c6b1bab admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:21.126327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2881a-9ebc-4b2c-a788-f7082c6b1bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:21.129877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2881a-9ebc-4b2c-a788-f7082c6b1bab admin admin] PATH_INFO: `/v3/projects/91a3dcd2c7554b97bf02f6742a20aaa9/users/87beeb4552d54c5a9cad7977b17bbeec/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:21.173619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2881a-9ebc-4b2c-a788-f7082c6b1bab admin admin] RBAC: Authorizing `identity:create_grant(project_id=91a3dcd2c7554b97bf02f6742a20aaa9, user_id=87beeb4552d54c5a9cad7977b17bbeec, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:21.183084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2881a-9ebc-4b2c-a788-f7082c6b1bab admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:21.232607 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2081/4176] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:26:21 2022] PUT /identity/v3/projects/91a3dcd2c7554b97bf02f6742a20aaa9/users/87beeb4552d54c5a9cad7977b17bbeec/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:21.237537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744ef23-8c06-4a04-8163-4f19be40dac3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:21.257020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744ef23-8c06-4a04-8163-4f19be40dac3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:21.427864 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308c882-ea9b-4b14-8ada-edd22efb93c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:21.428630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308c882-ea9b-4b14-8ada-edd22efb93c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:21.428780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308c882-ea9b-4b14-8ada-edd22efb93c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:21.429054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308c882-ea9b-4b14-8ada-edd22efb93c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:21.429706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308c882-ea9b-4b14-8ada-edd22efb93c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:21.436010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308c882-ea9b-4b14-8ada-edd22efb93c0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:21.476367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2881a-9ebc-4b2c-a788-f7082c6b1bab admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:21.484390 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2096/4177] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:26:21.489328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2881a-9ebc-4b2c-a788-f7082c6b1bab admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:21.514950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c105ab1-44ce-4799-ba89-1b5949a599fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:21.519716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c105ab1-44ce-4799-ba89-1b5949a599fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:21.523144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c105ab1-44ce-4799-ba89-1b5949a599fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:21.523429 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c105ab1-44ce-4799-ba89-1b5949a599fd admin admin] PATH_INFO: `/v3/projects/91a3dcd2c7554b97bf02f6742a20aaa9/users/87beeb4552d54c5a9cad7977b17bbeec/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:21.528110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c105ab1-44ce-4799-ba89-1b5949a599fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=91a3dcd2c7554b97bf02f6742a20aaa9, user_id=87beeb4552d54c5a9cad7977b17bbeec, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:21.534661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c105ab1-44ce-4799-ba89-1b5949a599fd admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:21.579441 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec50800-c2d5-417c-8ce0-567f7d405c46 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:21.579781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec50800-c2d5-417c-8ce0-567f7d405c46 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:21.580081 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec50800-c2d5-417c-8ce0-567f7d405c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:21.582916 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2082/4178] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:26:21 2022] PUT /identity/v3/projects/91a3dcd2c7554b97bf02f6742a20aaa9/users/87beeb4552d54c5a9cad7977b17bbeec/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:21.641851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-bec50800-c2d5-417c-8ce0-567f7d405c46 None None] MFA Rules not processed for user `87beeb4552d54c5a9cad7977b17bbeec`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:21.643106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-bec50800-c2d5-417c-8ce0-567f7d405c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:21.837843 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2097/4179] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:21 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:22.859542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c105ab1-44ce-4799-ba89-1b5949a599fd admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:22.862805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2c105ab1-44ce-4799-ba89-1b5949a599fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:23.146343 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:23.222936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c105ab1-44ce-4799-ba89-1b5949a599fd admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:23.254109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631dbfa-be60-4721-aec8-007087e17bcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:23.254751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631dbfa-be60-4721-aec8-007087e17bcc service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:23.255036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631dbfa-be60-4721-aec8-007087e17bcc service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:23.255310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631dbfa-be60-4721-aec8-007087e17bcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:23.294473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631dbfa-be60-4721-aec8-007087e17bcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:23.298276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631dbfa-be60-4721-aec8-007087e17bcc service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:23.339841 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2083/4180] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:26:22 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:26:26.748510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec50800-c2d5-417c-8ce0-567f7d405c46 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:26.851347 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:26.948886 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec50800-c2d5-417c-8ce0-567f7d405c46 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:26.962284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5af1a-bbe3-4b03-8d8b-0044061a3052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:26.963339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5af1a-bbe3-4b03-8d8b-0044061a3052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:26.963628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5af1a-bbe3-4b03-8d8b-0044061a3052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:26.963913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5af1a-bbe3-4b03-8d8b-0044061a3052 admin admin] PATH_INFO: `/v3/users/e0fa4e0bb5bf4c67b243d47347c17ed0` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:26.967797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5af1a-bbe3-4b03-8d8b-0044061a3052 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0fa4e0bb5bf4c67b243d47347c17ed0)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:26.969952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5af1a-bbe3-4b03-8d8b-0044061a3052 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:27.143838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4ec5af1a-bbe3-4b03-8d8b-0044061a3052 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0fa4e0bb5bf4c67b243d47347c17ed0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:27.164581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4ec5af1a-bbe3-4b03-8d8b-0044061a3052 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0fa4e0bb5bf4c67b243d47347c17ed0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:27.198781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4ec5af1a-bbe3-4b03-8d8b-0044061a3052 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0fa4e0bb5bf4c67b243d47347c17ed0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:27.200152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4ec5af1a-bbe3-4b03-8d8b-0044061a3052 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0fa4e0bb5bf4c67b243d47347c17ed0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:27.217692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4ec5af1a-bbe3-4b03-8d8b-0044061a3052 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0fa4e0bb5bf4c67b243d47347c17ed0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:27.229814 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2098/4181] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:26:26 2022] DELETE /identity/v3/users/e0fa4e0bb5bf4c67b243d47347c17ed0 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:27.233328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a456f8f-9e1f-4efd-a8d7-266cb4a798f5 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:27.233885 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a456f8f-9e1f-4efd-a8d7-266cb4a798f5 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:27.234212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a456f8f-9e1f-4efd-a8d7-266cb4a798f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:27.291142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-4a456f8f-9e1f-4efd-a8d7-266cb4a798f5 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:27.300611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4a456f8f-9e1f-4efd-a8d7-266cb4a798f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:27.469784 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2084/4182] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:26:27.485057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5af1a-bbe3-4b03-8d8b-0044061a3052 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:27.488428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4ec5af1a-bbe3-4b03-8d8b-0044061a3052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:27.646640 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd714468-2ab3-4765-91fe-1588ce4fa1c2 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:27.647140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd714468-2ab3-4765-91fe-1588ce4fa1c2 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:27.647615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd714468-2ab3-4765-91fe-1588ce4fa1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:27.692543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-dd714468-2ab3-4765-91fe-1588ce4fa1c2 None None] MFA Rules not processed for user `e379b67e2bb248b3ad25b92b2082b0fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:27.695619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-dd714468-2ab3-4765-91fe-1588ce4fa1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:27.699042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5af1a-bbe3-4b03-8d8b-0044061a3052 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:27.719623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba59c5-f5df-470c-a98f-ea110ca6e862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:27.723519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba59c5-f5df-470c-a98f-ea110ca6e862 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:27.723874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba59c5-f5df-470c-a98f-ea110ca6e862 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:27.725675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba59c5-f5df-470c-a98f-ea110ca6e862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:27.765655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba59c5-f5df-470c-a98f-ea110ca6e862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:27.770557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba59c5-f5df-470c-a98f-ea110ca6e862 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:27.809636 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2099/4183] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:26:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:26:27.940734 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2085/4184] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:27.946303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa482fc-4d69-4273-866e-10daec2296b5 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:27.947430 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa482fc-4d69-4273-866e-10daec2296b5 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:27.948187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa482fc-4d69-4273-866e-10daec2296b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:27.983931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0fa482fc-4d69-4273-866e-10daec2296b5 None None] MFA Rules not processed for user `e379b67e2bb248b3ad25b92b2082b0fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:27.990065 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0fa482fc-4d69-4273-866e-10daec2296b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:28.019131 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2100/4185] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:28.894977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd714468-2ab3-4765-91fe-1588ce4fa1c2 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:28.897584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-dd714468-2ab3-4765-91fe-1588ce4fa1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:28.934288 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd714468-2ab3-4765-91fe-1588ce4fa1c2 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:28.942873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96421754-96f9-4764-8a52-43e8eaa3b051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:28.943998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96421754-96f9-4764-8a52-43e8eaa3b051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:28.944644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96421754-96f9-4764-8a52-43e8eaa3b051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:28.945144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96421754-96f9-4764-8a52-43e8eaa3b051 admin admin] PATH_INFO: `/v3/projects/de4bc771ef8e4c23b893a3cc1361f4d0` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:28.947455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96421754-96f9-4764-8a52-43e8eaa3b051 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de4bc771ef8e4c23b893a3cc1361f4d0)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:28.984586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96421754-96f9-4764-8a52-43e8eaa3b051 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:29.091394 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-96421754-96f9-4764-8a52-43e8eaa3b051 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de4bc771ef8e4c23b893a3cc1361f4d0', 'request_id': 'req-96421754-96f9-4764-8a52-43e8eaa3b051'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:29.108711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-96421754-96f9-4764-8a52-43e8eaa3b051 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de4bc771ef8e4c23b893a3cc1361f4d0', 'request_id': 'req-96421754-96f9-4764-8a52-43e8eaa3b051'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:29.124349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-96421754-96f9-4764-8a52-43e8eaa3b051 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de4bc771ef8e4c23b893a3cc1361f4d0', 'request_id': 'req-96421754-96f9-4764-8a52-43e8eaa3b051'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:29.155193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-96421754-96f9-4764-8a52-43e8eaa3b051 admin admin] The token cache is being invalidate because project de4bc771ef8e4c23b893a3cc1361f4d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:26:29.155590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-96421754-96f9-4764-8a52-43e8eaa3b051 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:29.161161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-96421754-96f9-4764-8a52-43e8eaa3b051 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:29.166773 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2086/4186] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:26:28 2022] DELETE /identity/v3/projects/de4bc771ef8e4c23b893a3cc1361f4d0 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:29.171023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa482fc-4d69-4273-866e-10daec2296b5 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:29.188155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa482fc-4d69-4273-866e-10daec2296b5 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:29.316347 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:29.351025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d333a6-5c09-4dc4-993c-388211c9d307 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:29.351437 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d333a6-5c09-4dc4-993c-388211c9d307 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:29.352245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d333a6-5c09-4dc4-993c-388211c9d307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:29.366055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4b0bd-cc33-4e2e-9aa0-2610e8ba63cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:29.366880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4b0bd-cc33-4e2e-9aa0-2610e8ba63cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:29.367164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4b0bd-cc33-4e2e-9aa0-2610e8ba63cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:29.367441 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4b0bd-cc33-4e2e-9aa0-2610e8ba63cb admin admin] PATH_INFO: `/v3/users/87beeb4552d54c5a9cad7977b17bbeec` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:29.368919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4b0bd-cc33-4e2e-9aa0-2610e8ba63cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=87beeb4552d54c5a9cad7977b17bbeec)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:29.370861 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4b0bd-cc33-4e2e-9aa0-2610e8ba63cb admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:29.372305 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:29.398143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e6d333a6-5c09-4dc4-993c-388211c9d307 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:29.400761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e6d333a6-5c09-4dc4-993c-388211c9d307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:29.472734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-aee4b0bd-cc33-4e2e-9aa0-2610e8ba63cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87beeb4552d54c5a9cad7977b17bbeec'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:29.493887 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-aee4b0bd-cc33-4e2e-9aa0-2610e8ba63cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87beeb4552d54c5a9cad7977b17bbeec'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:29.536509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-aee4b0bd-cc33-4e2e-9aa0-2610e8ba63cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87beeb4552d54c5a9cad7977b17bbeec'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:29.538205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-aee4b0bd-cc33-4e2e-9aa0-2610e8ba63cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87beeb4552d54c5a9cad7977b17bbeec'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:29.551637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-aee4b0bd-cc33-4e2e-9aa0-2610e8ba63cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87beeb4552d54c5a9cad7977b17bbeec'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:29.560806 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2087/4187] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:26:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:26:29.562255 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2101/4188] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:26:29 2022] DELETE /identity/v3/users/87beeb4552d54c5a9cad7977b17bbeec => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:29.581491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d333a6-5c09-4dc4-993c-388211c9d307 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:29.604283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e6d333a6-5c09-4dc4-993c-388211c9d307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:29.859994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d333a6-5c09-4dc4-993c-388211c9d307 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:30.078637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d12d47-5ab4-49e7-b3fa-49b2297a0910 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:30.079434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d12d47-5ab4-49e7-b3fa-49b2297a0910 service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:30.080184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d12d47-5ab4-49e7-b3fa-49b2297a0910 service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:30.080184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d12d47-5ab4-49e7-b3fa-49b2297a0910 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:30.083928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d1d12d47-5ab4-49e7-b3fa-49b2297a0910 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:30.280275 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:30.306719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d12d47-5ab4-49e7-b3fa-49b2297a0910 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:30.317209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d12d47-5ab4-49e7-b3fa-49b2297a0910 service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:30.340783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4b0bd-cc33-4e2e-9aa0-2610e8ba63cb admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:30.342475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-aee4b0bd-cc33-4e2e-9aa0-2610e8ba63cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:30.364010 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2088/4189] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:26:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 788 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:26:30.469169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4b0bd-cc33-4e2e-9aa0-2610e8ba63cb admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:30.485114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39463b0-04d5-4ee0-af7f-4044c9bb4e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:30.485781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39463b0-04d5-4ee0-af7f-4044c9bb4e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:30.486057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39463b0-04d5-4ee0-af7f-4044c9bb4e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:30.486326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39463b0-04d5-4ee0-af7f-4044c9bb4e5b admin admin] PATH_INFO: `/v3/projects/91a3dcd2c7554b97bf02f6742a20aaa9` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:30.488512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39463b0-04d5-4ee0-af7f-4044c9bb4e5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=91a3dcd2c7554b97bf02f6742a20aaa9)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:30.497411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39463b0-04d5-4ee0-af7f-4044c9bb4e5b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:30.589987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d39463b0-04d5-4ee0-af7f-4044c9bb4e5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91a3dcd2c7554b97bf02f6742a20aaa9', 'request_id': 'req-d39463b0-04d5-4ee0-af7f-4044c9bb4e5b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:30.605393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d39463b0-04d5-4ee0-af7f-4044c9bb4e5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91a3dcd2c7554b97bf02f6742a20aaa9', 'request_id': 'req-d39463b0-04d5-4ee0-af7f-4044c9bb4e5b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:30.608279 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:30.622038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d39463b0-04d5-4ee0-af7f-4044c9bb4e5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91a3dcd2c7554b97bf02f6742a20aaa9', 'request_id': 'req-d39463b0-04d5-4ee0-af7f-4044c9bb4e5b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:30.657797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d39463b0-04d5-4ee0-af7f-4044c9bb4e5b admin admin] The token cache is being invalidate because project 91a3dcd2c7554b97bf02f6742a20aaa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:26:30.658201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d39463b0-04d5-4ee0-af7f-4044c9bb4e5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:30.659585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d39463b0-04d5-4ee0-af7f-4044c9bb4e5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:30.662877 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2102/4190] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:26:30 2022] DELETE /identity/v3/projects/91a3dcd2c7554b97bf02f6742a20aaa9 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:26:30.667684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7b7c9-c0e6-4585-a815-857153f594cc None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:30.668326 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7b7c9-c0e6-4585-a815-857153f594cc None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:30.668722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7b7c9-c0e6-4585-a815-857153f594cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:30.701269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c0a7b7c9-c0e6-4585-a815-857153f594cc None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:30.702809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c0a7b7c9-c0e6-4585-a815-857153f594cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:30.832916 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2089/4191] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:26:30.843315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcb645-8544-4c93-b8e4-8122d8ee2526 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:30.843872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcb645-8544-4c93-b8e4-8122d8ee2526 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:30.844771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcb645-8544-4c93-b8e4-8122d8ee2526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:30.894387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-09bcb645-8544-4c93-b8e4-8122d8ee2526 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:30.895747 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-09bcb645-8544-4c93-b8e4-8122d8ee2526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:30.935006 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2103/4192] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:30.939405 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7b7c9-c0e6-4585-a815-857153f594cc None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:30.961394 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7b7c9-c0e6-4585-a815-857153f594cc None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:30.975282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d368fd2-02bf-4cf7-bd28-f15e5b04d2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:30.975929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d368fd2-02bf-4cf7-bd28-f15e5b04d2bc admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:30.976218 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d368fd2-02bf-4cf7-bd28-f15e5b04d2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:30.976491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d368fd2-02bf-4cf7-bd28-f15e5b04d2bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:30.977168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d368fd2-02bf-4cf7-bd28-f15e5b04d2bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:26:30.977466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d368fd2-02bf-4cf7-bd28-f15e5b04d2bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:30.979113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d368fd2-02bf-4cf7-bd28-f15e5b04d2bc admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:31.011838 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2090/4193] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:26:31.016279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bcb645-8544-4c93-b8e4-8122d8ee2526 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:31.026762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bcb645-8544-4c93-b8e4-8122d8ee2526 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:31.041422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed904b4-3f55-4e57-becc-b6a9d3568091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:31.042268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed904b4-3f55-4e57-becc-b6a9d3568091 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:31.042554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed904b4-3f55-4e57-becc-b6a9d3568091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:31.042828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed904b4-3f55-4e57-becc-b6a9d3568091 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:31.043532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed904b4-3f55-4e57-becc-b6a9d3568091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:31.045552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed904b4-3f55-4e57-becc-b6a9d3568091 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:31.114389 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2104/4194] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:26:31 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:26:31.118517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d368fd2-02bf-4cf7-bd28-f15e5b04d2bc admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:31.135873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d368fd2-02bf-4cf7-bd28-f15e5b04d2bc admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:31.261975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc3e45-451d-41c6-949f-0218ba711036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:31.262604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc3e45-451d-41c6-949f-0218ba711036 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:31.262885 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc3e45-451d-41c6-949f-0218ba711036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:31.263159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc3e45-451d-41c6-949f-0218ba711036 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:31.263799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc3e45-451d-41c6-949f-0218ba711036 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:31.265813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc3e45-451d-41c6-949f-0218ba711036 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:31.320783 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2091/4195] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:26:31 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:26:31.321089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed904b4-3f55-4e57-becc-b6a9d3568091 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:31.343325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed904b4-3f55-4e57-becc-b6a9d3568091 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:31.355338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdd3f8-dffd-436c-a5ca-648b47913242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:31.357801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdd3f8-dffd-436c-a5ca-648b47913242 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:31.358726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdd3f8-dffd-436c-a5ca-648b47913242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:31.362472 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdd3f8-dffd-436c-a5ca-648b47913242 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:31.364133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cdd3f8-dffd-436c-a5ca-648b47913242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:31.367771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cdd3f8-dffd-436c-a5ca-648b47913242 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:31.385889 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2105/4196] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:26:31.389622 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc3e45-451d-41c6-949f-0218ba711036 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:31.403015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc3e45-451d-41c6-949f-0218ba711036 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:31.424683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f9748-820c-450a-a85a-aa78b409bcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:31.425708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f9748-820c-450a-a85a-aa78b409bcd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:31.426233 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f9748-820c-450a-a85a-aa78b409bcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:31.426681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f9748-820c-450a-a85a-aa78b409bcd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:31.428518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f9748-820c-450a-a85a-aa78b409bcd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:31.430991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f9748-820c-450a-a85a-aa78b409bcd8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:31.460863 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2092/4197] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:26:31 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:26:31.465927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdd3f8-dffd-436c-a5ca-648b47913242 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:31.503052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdd3f8-dffd-436c-a5ca-648b47913242 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:31.524240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b8ecd-6216-4cfb-959b-e89581de9d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:31.524932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b8ecd-6216-4cfb-959b-e89581de9d1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:31.525201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b8ecd-6216-4cfb-959b-e89581de9d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:31.525477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b8ecd-6216-4cfb-959b-e89581de9d1d admin admin] PATH_INFO: `/v3/projects/16a4e3bcd1364ee4a9cdc27d5d2feb87/users/f93483acb3114eabbbe6e2535ec5e28d/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:31.556728 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b8ecd-6216-4cfb-959b-e89581de9d1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=16a4e3bcd1364ee4a9cdc27d5d2feb87, user_id=f93483acb3114eabbbe6e2535ec5e28d, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:31.561255 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b8ecd-6216-4cfb-959b-e89581de9d1d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:31.592279 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2106/4198] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:26:31 2022] PUT /identity/v3/projects/16a4e3bcd1364ee4a9cdc27d5d2feb87/users/f93483acb3114eabbbe6e2535ec5e28d/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:31.603256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f93b6-e696-4a03-8757-53620786c497 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:31.603901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f93b6-e696-4a03-8757-53620786c497 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:31.604403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f93b6-e696-4a03-8757-53620786c497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:31.678636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-232f93b6-e696-4a03-8757-53620786c497 None None] MFA Rules not processed for user `f93483acb3114eabbbe6e2535ec5e28d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:31.683770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-232f93b6-e696-4a03-8757-53620786c497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:31.808530 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:31.837464 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2093/4199] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:31.902932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b8ecd-6216-4cfb-959b-e89581de9d1d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:32.060784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112ab4e-16ad-4848-aa8d-3ce0314a443c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:32.061744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112ab4e-16ad-4848-aa8d-3ce0314a443c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:32.062182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112ab4e-16ad-4848-aa8d-3ce0314a443c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:32.118667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d112ab4e-16ad-4848-aa8d-3ce0314a443c None None] MFA Rules not processed for user `106559a2b8754c54b1c41ba8cadd1a97`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:32.123195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d112ab4e-16ad-4848-aa8d-3ce0314a443c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:32.125980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b8ecd-6216-4cfb-959b-e89581de9d1d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:32.134674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de271d19-f1ee-4c71-8453-211a0a7e0a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:32.135698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de271d19-f1ee-4c71-8453-211a0a7e0a17 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:32.136451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de271d19-f1ee-4c71-8453-211a0a7e0a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:32.137048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de271d19-f1ee-4c71-8453-211a0a7e0a17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:32.138022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de271d19-f1ee-4c71-8453-211a0a7e0a17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:32.140157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de271d19-f1ee-4c71-8453-211a0a7e0a17 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:32.236081 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2107/4200] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:26:31 2022] POST /identity/v3/projects => generated 385 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:26:32.241745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de271d19-f1ee-4c71-8453-211a0a7e0a17 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:32.317758 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2094/4201] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:26:32.319232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a0528-ccb1-4868-8683-3de422a625b7 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:32.319521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a0528-ccb1-4868-8683-3de422a625b7 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:32.319798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a0528-ccb1-4868-8683-3de422a625b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:32.364924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-934a0528-ccb1-4868-8683-3de422a625b7 None None] MFA Rules not processed for user `106559a2b8754c54b1c41ba8cadd1a97`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:32.369991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-934a0528-ccb1-4868-8683-3de422a625b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:32.404095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de271d19-f1ee-4c71-8453-211a0a7e0a17 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:32.419340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420c6cc-4b13-46d8-9c88-b33357f03049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:32.420260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420c6cc-4b13-46d8-9c88-b33357f03049 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:32.420907 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420c6cc-4b13-46d8-9c88-b33357f03049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:32.422564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420c6cc-4b13-46d8-9c88-b33357f03049 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:32.424816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420c6cc-4b13-46d8-9c88-b33357f03049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:32.428948 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420c6cc-4b13-46d8-9c88-b33357f03049 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:32.464906 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:32.493080 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2108/4202] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:26:32 2022] POST /identity/v3/users => generated 299 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:26:32.496409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420c6cc-4b13-46d8-9c88-b33357f03049 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:32.553263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420c6cc-4b13-46d8-9c88-b33357f03049 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:32.591545 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2095/4203] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:32.593074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d29c0-97df-4d45-b1ed-60af69a7c81a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:32.595951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84d247-f19b-4400-8b91-230af356e372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:32.599099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d29c0-97df-4d45-b1ed-60af69a7c81a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:32.599425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d29c0-97df-4d45-b1ed-60af69a7c81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:32.603016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84d247-f19b-4400-8b91-230af356e372 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:32.603313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84d247-f19b-4400-8b91-230af356e372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:32.603586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84d247-f19b-4400-8b91-230af356e372 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:32.604286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d84d247-f19b-4400-8b91-230af356e372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:32.613857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d84d247-f19b-4400-8b91-230af356e372 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:32.668477 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2109/4204] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:26:32.687063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84d247-f19b-4400-8b91-230af356e372 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:32.701670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9e7d29c0-97df-4d45-b1ed-60af69a7c81a None None] MFA Rules not processed for user `a50140f86f00487b90d0503d4819234f`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:32.702908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9e7d29c0-97df-4d45-b1ed-60af69a7c81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:32.738434 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84d247-f19b-4400-8b91-230af356e372 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:32.763137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c5c1a-ea58-4a19-b61e-4b2171d379f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:32.764579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c5c1a-ea58-4a19-b61e-4b2171d379f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:32.769181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c5c1a-ea58-4a19-b61e-4b2171d379f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:32.771550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c5c1a-ea58-4a19-b61e-4b2171d379f5 admin admin] PATH_INFO: `/v3/projects/55fe5bee6469414ead637f1b13110bc4/users/42a901d7f7d245979923aaefe5bb9b81/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:32.842028 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c5c1a-ea58-4a19-b61e-4b2171d379f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55fe5bee6469414ead637f1b13110bc4, user_id=42a901d7f7d245979923aaefe5bb9b81, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:32.859369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c5c1a-ea58-4a19-b61e-4b2171d379f5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:32.900067 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2110/4205] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:26:32 2022] PUT /identity/v3/projects/55fe5bee6469414ead637f1b13110bc4/users/42a901d7f7d245979923aaefe5bb9b81/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:32.904557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c5c1a-ea58-4a19-b61e-4b2171d379f5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:33.074213 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2096/4206] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:33.089463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50398c8-52ef-413b-b748-3e48b6791f26 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:33.091138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50398c8-52ef-413b-b748-3e48b6791f26 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:33.092904 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50398c8-52ef-413b-b748-3e48b6791f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:33.135838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c5c1a-ea58-4a19-b61e-4b2171d379f5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:33.156298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b6a57-2f5d-40bb-ab9e-105e3c930297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:33.156939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b6a57-2f5d-40bb-ab9e-105e3c930297 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:33.157242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b6a57-2f5d-40bb-ab9e-105e3c930297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:33.157478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b6a57-2f5d-40bb-ab9e-105e3c930297 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:33.158138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b6a57-2f5d-40bb-ab9e-105e3c930297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:33.159844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b6a57-2f5d-40bb-ab9e-105e3c930297 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:33.176142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-a50398c8-52ef-413b-b748-3e48b6791f26 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:33.188004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a50398c8-52ef-413b-b748-3e48b6791f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:33.195698 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2111/4207] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:26:33.200446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b6a57-2f5d-40bb-ab9e-105e3c930297 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:33.237260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b6a57-2f5d-40bb-ab9e-105e3c930297 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:33.270690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87a1b3-95c6-44a9-9089-58d36805adbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:33.271391 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87a1b3-95c6-44a9-9089-58d36805adbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:33.271672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87a1b3-95c6-44a9-9089-58d36805adbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:33.271969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87a1b3-95c6-44a9-9089-58d36805adbe admin admin] PATH_INFO: `/v3/projects/55fe5bee6469414ead637f1b13110bc4/users/42a901d7f7d245979923aaefe5bb9b81/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:33.275254 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87a1b3-95c6-44a9-9089-58d36805adbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=55fe5bee6469414ead637f1b13110bc4, user_id=42a901d7f7d245979923aaefe5bb9b81, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:33.281246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87a1b3-95c6-44a9-9089-58d36805adbe admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:33.313432 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2112/4208] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:26:33 2022] PUT /identity/v3/projects/55fe5bee6469414ead637f1b13110bc4/users/42a901d7f7d245979923aaefe5bb9b81/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:33.328635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7ac26-8654-47aa-9dab-5b74f4922cb4 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:33.329432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7ac26-8654-47aa-9dab-5b74f4922cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:33.331692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7ac26-8654-47aa-9dab-5b74f4922cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:33.397540 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:33.430366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-94a7ac26-8654-47aa-9dab-5b74f4922cb4 None None] MFA Rules not processed for user `42a901d7f7d245979923aaefe5bb9b81`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:33.431833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-94a7ac26-8654-47aa-9dab-5b74f4922cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:33.480392 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2097/4209] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:26:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:26:33.483498 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50398c8-52ef-413b-b748-3e48b6791f26 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:33.486563 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a50398c8-52ef-413b-b748-3e48b6791f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:33.610739 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2113/4210] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:33.640391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50398c8-52ef-413b-b748-3e48b6791f26 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:33.740390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ac220-b788-42fa-af12-8aa53b1a034a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:33.741097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ac220-b788-42fa-af12-8aa53b1a034a service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:33.741992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ac220-b788-42fa-af12-8aa53b1a034a service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:33.742355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ac220-b788-42fa-af12-8aa53b1a034a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:33.839381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ac220-b788-42fa-af12-8aa53b1a034a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:33.841643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ac220-b788-42fa-af12-8aa53b1a034a service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:33.865217 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2098/4211] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:26:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 07 01:26:36.016039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7ac26-8654-47aa-9dab-5b74f4922cb4 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:36.017745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-94a7ac26-8654-47aa-9dab-5b74f4922cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:36.092072 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:36.154995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7ac26-8654-47aa-9dab-5b74f4922cb4 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:36.160329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77ee2a-c88b-430b-a80d-e3f91b9e1424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:36.160995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77ee2a-c88b-430b-a80d-e3f91b9e1424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:36.162332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77ee2a-c88b-430b-a80d-e3f91b9e1424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:36.162332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77ee2a-c88b-430b-a80d-e3f91b9e1424 admin admin] PATH_INFO: `/v3/users/15a6057926254c4a891048d0c66ad522` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:36.162886 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77ee2a-c88b-430b-a80d-e3f91b9e1424 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15a6057926254c4a891048d0c66ad522)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:36.165417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb77ee2a-c88b-430b-a80d-e3f91b9e1424 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:36.241352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fb77ee2a-c88b-430b-a80d-e3f91b9e1424 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15a6057926254c4a891048d0c66ad522'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:36.254550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fb77ee2a-c88b-430b-a80d-e3f91b9e1424 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15a6057926254c4a891048d0c66ad522'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:36.269954 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fb77ee2a-c88b-430b-a80d-e3f91b9e1424 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15a6057926254c4a891048d0c66ad522'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:36.270952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fb77ee2a-c88b-430b-a80d-e3f91b9e1424 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15a6057926254c4a891048d0c66ad522'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:36.281992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fb77ee2a-c88b-430b-a80d-e3f91b9e1424 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15a6057926254c4a891048d0c66ad522'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:36.290164 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2114/4212] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:26:36 2022] DELETE /identity/v3/users/15a6057926254c4a891048d0c66ad522 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:36.294700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bc722-bda7-4072-af74-87647d07027d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:36.295232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bc722-bda7-4072-af74-87647d07027d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:36.295232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bc722-bda7-4072-af74-87647d07027d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:36.327380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-628bc722-bda7-4072-af74-87647d07027d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:36.328819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-628bc722-bda7-4072-af74-87647d07027d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:36.362733 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:36.542031 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2099/4213] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:36.556144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77ee2a-c88b-430b-a80d-e3f91b9e1424 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:36.557588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fb77ee2a-c88b-430b-a80d-e3f91b9e1424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:36.639192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77ee2a-c88b-430b-a80d-e3f91b9e1424 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:36.648504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1414ec-4a89-49f1-a377-7f781d6ab2cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:36.651271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1414ec-4a89-49f1-a377-7f781d6ab2cf service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:36.651808 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1414ec-4a89-49f1-a377-7f781d6ab2cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:36.652209 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1414ec-4a89-49f1-a377-7f781d6ab2cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:36.678054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1414ec-4a89-49f1-a377-7f781d6ab2cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:36.680162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1414ec-4a89-49f1-a377-7f781d6ab2cf service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:36.704441 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2115/4214] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:26:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:26:36.914415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b784a-cb26-4c2c-a7ad-bfe7d44de2b4 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:36.914732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b784a-cb26-4c2c-a7ad-bfe7d44de2b4 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:36.915491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b784a-cb26-4c2c-a7ad-bfe7d44de2b4 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:36.917261 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2100/4215] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 01:26:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:26:36.933515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380d76c-e46e-468f-a43f-3e2b300f8eb4 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:36.933797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380d76c-e46e-468f-a43f-3e2b300f8eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:36.934074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380d76c-e46e-468f-a43f-3e2b300f8eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:36.952500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b784a-cb26-4c2c-a7ad-bfe7d44de2b4 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:36.957035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-024b784a-cb26-4c2c-a7ad-bfe7d44de2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:36.982971 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b784a-cb26-4c2c-a7ad-bfe7d44de2b4 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:36.989253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e878f1-c1b0-498d-b9ec-084d126a6bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:36.990111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e878f1-c1b0-498d-b9ec-084d126a6bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:36.990574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e878f1-c1b0-498d-b9ec-084d126a6bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:36.991113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e878f1-c1b0-498d-b9ec-084d126a6bff admin admin] PATH_INFO: `/v3/projects/bdcca9bc1cd141ee9dd9f9233851ed67` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:36.992564 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e878f1-c1b0-498d-b9ec-084d126a6bff admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdcca9bc1cd141ee9dd9f9233851ed67)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:36.995210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e878f1-c1b0-498d-b9ec-084d126a6bff admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:37.006443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b380d76c-e46e-468f-a43f-3e2b300f8eb4 None None] MFA Rules not processed for user `6c70d5a72d424db68de7c7b8257fe02c`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:37.008943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b380d76c-e46e-468f-a43f-3e2b300f8eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:37.063252 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:37.087779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a4e878f1-c1b0-498d-b9ec-084d126a6bff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdcca9bc1cd141ee9dd9f9233851ed67', 'request_id': 'req-a4e878f1-c1b0-498d-b9ec-084d126a6bff'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:37.105628 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a4e878f1-c1b0-498d-b9ec-084d126a6bff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdcca9bc1cd141ee9dd9f9233851ed67', 'request_id': 'req-a4e878f1-c1b0-498d-b9ec-084d126a6bff'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:37.118420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a4e878f1-c1b0-498d-b9ec-084d126a6bff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdcca9bc1cd141ee9dd9f9233851ed67', 'request_id': 'req-a4e878f1-c1b0-498d-b9ec-084d126a6bff'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:37.125941 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2116/4216] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 01:26:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:37.127537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380d76c-e46e-468f-a43f-3e2b300f8eb4 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:37.147670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380d76c-e46e-468f-a43f-3e2b300f8eb4 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:37.148187 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a4e878f1-c1b0-498d-b9ec-084d126a6bff admin admin] The token cache is being invalidate because project bdcca9bc1cd141ee9dd9f9233851ed67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:26:37.151172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a4e878f1-c1b0-498d-b9ec-084d126a6bff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:37.152459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a4e878f1-c1b0-498d-b9ec-084d126a6bff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:37.159503 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2101/4217] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:26:36 2022] DELETE /identity/v3/projects/bdcca9bc1cd141ee9dd9f9233851ed67 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:37.160609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e878f1-c1b0-498d-b9ec-084d126a6bff admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:37.162600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a4e878f1-c1b0-498d-b9ec-084d126a6bff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:37.311422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c3cb6-aab0-4fc7-85aa-0e3bb0ecdd3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:37.312681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c3cb6-aab0-4fc7-85aa-0e3bb0ecdd3e service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:37.312981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c3cb6-aab0-4fc7-85aa-0e3bb0ecdd3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:37.313957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c3cb6-aab0-4fc7-85aa-0e3bb0ecdd3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:37.318878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-131c3cb6-aab0-4fc7-85aa-0e3bb0ecdd3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:37.374046 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e878f1-c1b0-498d-b9ec-084d126a6bff admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:37.379929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd62746-e3d0-47c7-bdb1-bec6924a2ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:37.380606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd62746-e3d0-47c7-bdb1-bec6924a2ff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:37.380883 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd62746-e3d0-47c7-bdb1-bec6924a2ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:37.381156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd62746-e3d0-47c7-bdb1-bec6924a2ff5 admin admin] PATH_INFO: `/v3/users/38c0ae623c1f4e2ea5fba3afed0c9a1b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:37.382630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd62746-e3d0-47c7-bdb1-bec6924a2ff5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38c0ae623c1f4e2ea5fba3afed0c9a1b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:37.384960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd62746-e3d0-47c7-bdb1-bec6924a2ff5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:37.444219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c3cb6-aab0-4fc7-85aa-0e3bb0ecdd3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:37.445605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c3cb6-aab0-4fc7-85aa-0e3bb0ecdd3e service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:37.466048 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2117/4218] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:26:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:26:37.467047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c3cb6-aab0-4fc7-85aa-0e3bb0ecdd3e service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:37.469571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-131c3cb6-aab0-4fc7-85aa-0e3bb0ecdd3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:37.477182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9dd62746-e3d0-47c7-bdb1-bec6924a2ff5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38c0ae623c1f4e2ea5fba3afed0c9a1b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:37.488366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c3cb6-aab0-4fc7-85aa-0e3bb0ecdd3e service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:37.488593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9dd62746-e3d0-47c7-bdb1-bec6924a2ff5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38c0ae623c1f4e2ea5fba3afed0c9a1b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:37.490794 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:37.496229 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228b04a-8aec-445e-ab96-c18d6a8df856 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:37.496966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228b04a-8aec-445e-ab96-c18d6a8df856 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:37.497344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228b04a-8aec-445e-ab96-c18d6a8df856 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:37.497711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228b04a-8aec-445e-ab96-c18d6a8df856 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:37.499720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c228b04a-8aec-445e-ab96-c18d6a8df856 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:37.516621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9dd62746-e3d0-47c7-bdb1-bec6924a2ff5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38c0ae623c1f4e2ea5fba3afed0c9a1b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:37.520299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9dd62746-e3d0-47c7-bdb1-bec6924a2ff5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38c0ae623c1f4e2ea5fba3afed0c9a1b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:37.545691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9dd62746-e3d0-47c7-bdb1-bec6924a2ff5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38c0ae623c1f4e2ea5fba3afed0c9a1b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:37.557306 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2102/4219] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:26:37 2022] DELETE /identity/v3/users/38c0ae623c1f4e2ea5fba3afed0c9a1b => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:37.557306 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd62746-e3d0-47c7-bdb1-bec6924a2ff5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:37.557719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9dd62746-e3d0-47c7-bdb1-bec6924a2ff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:37.598728 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228b04a-8aec-445e-ab96-c18d6a8df856 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:37.600853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228b04a-8aec-445e-ab96-c18d6a8df856 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:37.626581 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2118/4220] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:26:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:26:37.630758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd62746-e3d0-47c7-bdb1-bec6924a2ff5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:37.652140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578246c-6d9e-49f0-a05a-204a24ae7bd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:37.653340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578246c-6d9e-49f0-a05a-204a24ae7bd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:37.653569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578246c-6d9e-49f0-a05a-204a24ae7bd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:37.653830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578246c-6d9e-49f0-a05a-204a24ae7bd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:37.657681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9578246c-6d9e-49f0-a05a-204a24ae7bd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:37.776141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578246c-6d9e-49f0-a05a-204a24ae7bd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:37.777959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578246c-6d9e-49f0-a05a-204a24ae7bd5 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:37.794662 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2103/4221] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:26:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:26:38.034091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228b04a-8aec-445e-ab96-c18d6a8df856 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:38.076172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228b04a-8aec-445e-ab96-c18d6a8df856 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:38.095021 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:38.324099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7dd51-0498-469d-adbf-b978c9403616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:38.325860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7dd51-0498-469d-adbf-b978c9403616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:38.326961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7dd51-0498-469d-adbf-b978c9403616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:38.328554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7dd51-0498-469d-adbf-b978c9403616 admin admin] PATH_INFO: `/v3/projects/df033df95be34445bc09a7e8c6b57855` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:38.332436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7dd51-0498-469d-adbf-b978c9403616 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df033df95be34445bc09a7e8c6b57855)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:38.335712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7dd51-0498-469d-adbf-b978c9403616 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:38.468064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cbd7dd51-0498-469d-adbf-b978c9403616 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df033df95be34445bc09a7e8c6b57855', 'request_id': 'req-cbd7dd51-0498-469d-adbf-b978c9403616'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:38.483992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cbd7dd51-0498-469d-adbf-b978c9403616 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df033df95be34445bc09a7e8c6b57855', 'request_id': 'req-cbd7dd51-0498-469d-adbf-b978c9403616'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:38.553708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cbd7dd51-0498-469d-adbf-b978c9403616 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df033df95be34445bc09a7e8c6b57855', 'request_id': 'req-cbd7dd51-0498-469d-adbf-b978c9403616'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:38.592977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cbd7dd51-0498-469d-adbf-b978c9403616 admin admin] The token cache is being invalidate because project df033df95be34445bc09a7e8c6b57855 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:26:38.593323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cbd7dd51-0498-469d-adbf-b978c9403616 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:38.594088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cbd7dd51-0498-469d-adbf-b978c9403616 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:38.604286 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2119/4222] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:26:38 2022] DELETE /identity/v3/projects/df033df95be34445bc09a7e8c6b57855 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:38.607196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43f6eb-38ab-4f83-8d99-5162ee4a779e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:38.607736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43f6eb-38ab-4f83-8d99-5162ee4a779e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:38.607874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43f6eb-38ab-4f83-8d99-5162ee4a779e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:38.624530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e25fe-7a9c-4412-a255-5c1a267e0fb7 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:38.625003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e25fe-7a9c-4412-a255-5c1a267e0fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:38.625412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e25fe-7a9c-4412-a255-5c1a267e0fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:38.670008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a11e25fe-7a9c-4412-a255-5c1a267e0fb7 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:38.672239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a11e25fe-7a9c-4412-a255-5c1a267e0fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:38.674331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3a43f6eb-38ab-4f83-8d99-5162ee4a779e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:38.675528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3a43f6eb-38ab-4f83-8d99-5162ee4a779e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:38.885164 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2104/4223] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:38.896606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e09d7c-2acf-426e-869e-734e8772b811 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:38.897767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e09d7c-2acf-426e-869e-734e8772b811 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:38.898473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e09d7c-2acf-426e-869e-734e8772b811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:38.908704 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2120/4224] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:26:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:38.933668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e25fe-7a9c-4412-a255-5c1a267e0fb7 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:38.935689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a11e25fe-7a9c-4412-a255-5c1a267e0fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:39.001394 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b4e09d7c-2acf-426e-869e-734e8772b811 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:39.004811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b4e09d7c-2acf-426e-869e-734e8772b811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:39.026524 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2105/4225] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:39.039790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e09d7c-2acf-426e-869e-734e8772b811 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:39.055510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e09d7c-2acf-426e-869e-734e8772b811 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:39.062038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41018c2f-7cb9-400b-a6fa-530c87363fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:39.062710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41018c2f-7cb9-400b-a6fa-530c87363fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:39.062997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41018c2f-7cb9-400b-a6fa-530c87363fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:39.063273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41018c2f-7cb9-400b-a6fa-530c87363fe2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:39.064028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41018c2f-7cb9-400b-a6fa-530c87363fe2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:26:39.064369 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41018c2f-7cb9-400b-a6fa-530c87363fe2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:39.066559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41018c2f-7cb9-400b-a6fa-530c87363fe2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:39.079466 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:39.086907 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:39.103627 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2106/4226] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:26:39.104932 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41018c2f-7cb9-400b-a6fa-530c87363fe2 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:39.110352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-41018c2f-7cb9-400b-a6fa-530c87363fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:39.134743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41018c2f-7cb9-400b-a6fa-530c87363fe2 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:39.145111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb51c6d5-eef0-49a0-b07b-ecf433d7da7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:39.146523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51c6d5-eef0-49a0-b07b-ecf433d7da7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:39.146877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51c6d5-eef0-49a0-b07b-ecf433d7da7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:39.147412 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb51c6d5-eef0-49a0-b07b-ecf433d7da7f admin admin] PATH_INFO: `/v3/users/f93483acb3114eabbbe6e2535ec5e28d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:39.149485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51c6d5-eef0-49a0-b07b-ecf433d7da7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f93483acb3114eabbbe6e2535ec5e28d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:39.155041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb51c6d5-eef0-49a0-b07b-ecf433d7da7f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:39.165409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e25fe-7a9c-4412-a255-5c1a267e0fb7 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:39.186021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd87628-b910-4d20-81ca-71444dc7c4c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:39.188347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd87628-b910-4d20-81ca-71444dc7c4c1 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:39.190271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd87628-b910-4d20-81ca-71444dc7c4c1 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:39.191262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd87628-b910-4d20-81ca-71444dc7c4c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:39.225981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd87628-b910-4d20-81ca-71444dc7c4c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:39.237957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd87628-b910-4d20-81ca-71444dc7c4c1 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:39.277432 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2121/4227] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:26:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 07 01:26:39.288525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd87628-b910-4d20-81ca-71444dc7c4c1 service swift] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:39.325400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd87628-b910-4d20-81ca-71444dc7c4c1 service swift] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:39.334604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cb51c6d5-eef0-49a0-b07b-ecf433d7da7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f93483acb3114eabbbe6e2535ec5e28d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:39.336694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35700e4e-9a1a-44dd-a0b7-a36eca0b1d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:39.337435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35700e4e-9a1a-44dd-a0b7-a36eca0b1d03 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:39.337650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35700e4e-9a1a-44dd-a0b7-a36eca0b1d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:39.337987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35700e4e-9a1a-44dd-a0b7-a36eca0b1d03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:39.338785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35700e4e-9a1a-44dd-a0b7-a36eca0b1d03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:39.344399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35700e4e-9a1a-44dd-a0b7-a36eca0b1d03 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:39.379602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cb51c6d5-eef0-49a0-b07b-ecf433d7da7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f93483acb3114eabbbe6e2535ec5e28d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:39.414556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cb51c6d5-eef0-49a0-b07b-ecf433d7da7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f93483acb3114eabbbe6e2535ec5e28d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:39.415601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cb51c6d5-eef0-49a0-b07b-ecf433d7da7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f93483acb3114eabbbe6e2535ec5e28d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:39.428586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cb51c6d5-eef0-49a0-b07b-ecf433d7da7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f93483acb3114eabbbe6e2535ec5e28d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:39.440683 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2107/4228] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:26:39 2022] DELETE /identity/v3/users/f93483acb3114eabbbe6e2535ec5e28d => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:39.445371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e986e88-a5e6-412c-bcff-da5fb525866d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:39.445683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e986e88-a5e6-412c-bcff-da5fb525866d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:39.445931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e986e88-a5e6-412c-bcff-da5fb525866d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:39.449332 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2122/4229] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:26:39 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:26:39.453245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35700e4e-9a1a-44dd-a0b7-a36eca0b1d03 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:39.455373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-35700e4e-9a1a-44dd-a0b7-a36eca0b1d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:39.479285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-4e986e88-a5e6-412c-bcff-da5fb525866d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:39.487297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4e986e88-a5e6-412c-bcff-da5fb525866d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:39.623665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35700e4e-9a1a-44dd-a0b7-a36eca0b1d03 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:39.641070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c478b7b-72e8-4d11-b56c-cba8dab706f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:39.644396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c478b7b-72e8-4d11-b56c-cba8dab706f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:39.644697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c478b7b-72e8-4d11-b56c-cba8dab706f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:39.644972 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c478b7b-72e8-4d11-b56c-cba8dab706f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:39.645645 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c478b7b-72e8-4d11-b56c-cba8dab706f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:39.649249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c478b7b-72e8-4d11-b56c-cba8dab706f5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:39.653171 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2108/4230] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:39.677311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e986e88-a5e6-412c-bcff-da5fb525866d None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:39.685116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4e986e88-a5e6-412c-bcff-da5fb525866d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:39.693072 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2123/4231] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:26:39 2022] POST /identity/v3/users => generated 288 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:26:39.696354 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c478b7b-72e8-4d11-b56c-cba8dab706f5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:39.715545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c478b7b-72e8-4d11-b56c-cba8dab706f5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:39.722175 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f02b0c-7957-4eac-9ff1-cf8cd6dec62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:39.723774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f02b0c-7957-4eac-9ff1-cf8cd6dec62d admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:39.724084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f02b0c-7957-4eac-9ff1-cf8cd6dec62d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:39.724352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f02b0c-7957-4eac-9ff1-cf8cd6dec62d admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:39.725127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f02b0c-7957-4eac-9ff1-cf8cd6dec62d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:39.727169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f02b0c-7957-4eac-9ff1-cf8cd6dec62d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:39.742150 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2124/4232] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:26:39.746150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f02b0c-7957-4eac-9ff1-cf8cd6dec62d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:39.761776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f02b0c-7957-4eac-9ff1-cf8cd6dec62d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:39.768667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610ddc9-a870-4594-aa4e-a7e059bb5ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:39.769287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610ddc9-a870-4594-aa4e-a7e059bb5ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:39.769565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610ddc9-a870-4594-aa4e-a7e059bb5ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:39.769836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3610ddc9-a870-4594-aa4e-a7e059bb5ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:39.770624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610ddc9-a870-4594-aa4e-a7e059bb5ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:39.772699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3610ddc9-a870-4594-aa4e-a7e059bb5ed3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:39.813785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e986e88-a5e6-412c-bcff-da5fb525866d None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:39.819815 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b7e49-92b2-4241-9b60-d79c1c935077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:39.820853 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b7e49-92b2-4241-9b60-d79c1c935077 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:39.821317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b7e49-92b2-4241-9b60-d79c1c935077 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:39.821749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b7e49-92b2-4241-9b60-d79c1c935077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:39.825022 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2125/4233] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:26:39.829309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610ddc9-a870-4594-aa4e-a7e059bb5ed3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:39.840510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b7e49-92b2-4241-9b60-d79c1c935077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:39.849094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b7e49-92b2-4241-9b60-d79c1c935077 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:39.850680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3610ddc9-a870-4594-aa4e-a7e059bb5ed3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:39.877028 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2109/4234] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:26:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:26:39.897882 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86dbb9d-7971-4b41-b6d7-07e42f28ee9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:39.899322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86dbb9d-7971-4b41-b6d7-07e42f28ee9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:39.899603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86dbb9d-7971-4b41-b6d7-07e42f28ee9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:39.900197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86dbb9d-7971-4b41-b6d7-07e42f28ee9b admin admin] PATH_INFO: `/v3/projects/68660550bcbe4c58bd0faeb27a591d60/users/eb8b8987ef78426689aa6ebf97072955/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:39.960703 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86dbb9d-7971-4b41-b6d7-07e42f28ee9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=68660550bcbe4c58bd0faeb27a591d60, user_id=eb8b8987ef78426689aa6ebf97072955, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:39.966380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417ffca-4471-4666-943c-0c031def9b61 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:39.966767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417ffca-4471-4666-943c-0c031def9b61 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:39.967143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417ffca-4471-4666-943c-0c031def9b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:39.973577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86dbb9d-7971-4b41-b6d7-07e42f28ee9b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:39.999769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-f417ffca-4471-4666-943c-0c031def9b61 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:40.001284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f417ffca-4471-4666-943c-0c031def9b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:40.012346 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2126/4235] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:26:39 2022] PUT /identity/v3/projects/68660550bcbe4c58bd0faeb27a591d60/users/eb8b8987ef78426689aa6ebf97072955/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:40.013750 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:40.019349 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1132d-f412-44f2-9e13-3cc15089f19c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:40.019922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1132d-f412-44f2-9e13-3cc15089f19c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:40.020225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a1132d-f412-44f2-9e13-3cc15089f19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:40.088579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-50a1132d-f412-44f2-9e13-3cc15089f19c None None] MFA Rules not processed for user `eb8b8987ef78426689aa6ebf97072955`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:40.096397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-50a1132d-f412-44f2-9e13-3cc15089f19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:40.117448 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2110/4236] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:26:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:40.118748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417ffca-4471-4666-943c-0c031def9b61 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:40.122778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f417ffca-4471-4666-943c-0c031def9b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:40.198465 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:40.250973 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2127/4237] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:40.253462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1132d-f412-44f2-9e13-3cc15089f19c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:40.282001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417ffca-4471-4666-943c-0c031def9b61 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:40.295040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ca0a3-5d9d-487c-a239-971ac98d210a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:40.296293 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ca0a3-5d9d-487c-a239-971ac98d210a service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:40.296818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ca0a3-5d9d-487c-a239-971ac98d210a service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:40.297938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ca0a3-5d9d-487c-a239-971ac98d210a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:40.320454 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ca0a3-5d9d-487c-a239-971ac98d210a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:40.323732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ca0a3-5d9d-487c-a239-971ac98d210a service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:40.344867 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2111/4238] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:26:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:26:40.384895 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a1132d-f412-44f2-9e13-3cc15089f19c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:40.401159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378ae46-f017-47e0-901e-6cd6de1a2a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:40.401847 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378ae46-f017-47e0-901e-6cd6de1a2a40 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:40.402125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378ae46-f017-47e0-901e-6cd6de1a2a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:40.402534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378ae46-f017-47e0-901e-6cd6de1a2a40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:40.403239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3378ae46-f017-47e0-901e-6cd6de1a2a40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:40.405254 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3378ae46-f017-47e0-901e-6cd6de1a2a40 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:40.465913 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2128/4239] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:26:40 2022] POST /identity/v3/projects => generated 373 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:26:40.468517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ca0a3-5d9d-487c-a239-971ac98d210a service swift] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:40.490060 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ca0a3-5d9d-487c-a239-971ac98d210a service swift] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:40.607339 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0748ad-15dc-487f-aca3-12106d1b116f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:40.608440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0748ad-15dc-487f-aca3-12106d1b116f admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:40.608978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0748ad-15dc-487f-aca3-12106d1b116f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:40.609367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0748ad-15dc-487f-aca3-12106d1b116f admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:40.610774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0748ad-15dc-487f-aca3-12106d1b116f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:40.628984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0748ad-15dc-487f-aca3-12106d1b116f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:40.662347 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2112/4240] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:26:40 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:26:40.666511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378ae46-f017-47e0-901e-6cd6de1a2a40 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:40.709356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378ae46-f017-47e0-901e-6cd6de1a2a40 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:40.724201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99bb2b-2f83-4baa-9d4b-5e005d094ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:40.726023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99bb2b-2f83-4baa-9d4b-5e005d094ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:40.726289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99bb2b-2f83-4baa-9d4b-5e005d094ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:40.726563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99bb2b-2f83-4baa-9d4b-5e005d094ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:40.728114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99bb2b-2f83-4baa-9d4b-5e005d094ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:40.729751 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99bb2b-2f83-4baa-9d4b-5e005d094ac6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:40.787667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0748ad-15dc-487f-aca3-12106d1b116f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:40.789459 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2129/4241] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:26:40.806436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0748ad-15dc-487f-aca3-12106d1b116f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:40.821576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ff9f7-75ff-42cd-b5e8-36f0e95737a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:40.822274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ff9f7-75ff-42cd-b5e8-36f0e95737a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:40.822611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ff9f7-75ff-42cd-b5e8-36f0e95737a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:40.822904 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ff9f7-75ff-42cd-b5e8-36f0e95737a1 admin admin] PATH_INFO: `/v3/projects/efbdce657e1247b7ae1fb682952933e4/users/c601fbda57c946aab5cadbf75b742f50/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:40.885632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ff9f7-75ff-42cd-b5e8-36f0e95737a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efbdce657e1247b7ae1fb682952933e4, user_id=c601fbda57c946aab5cadbf75b742f50, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:40.903491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ff9f7-75ff-42cd-b5e8-36f0e95737a1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:40.954073 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2113/4242] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:26:40 2022] PUT /identity/v3/projects/efbdce657e1247b7ae1fb682952933e4/users/c601fbda57c946aab5cadbf75b742f50/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:40.956588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99bb2b-2f83-4baa-9d4b-5e005d094ac6 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:40.975815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99bb2b-2f83-4baa-9d4b-5e005d094ac6 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:40.991240 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ff9f7-75ff-42cd-b5e8-36f0e95737a1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:40.994033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-973ff9f7-75ff-42cd-b5e8-36f0e95737a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:41.052170 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:41.175544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce25692-2ec4-4941-9a8d-dbef1c1ac3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:41.176875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce25692-2ec4-4941-9a8d-dbef1c1ac3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:41.177357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce25692-2ec4-4941-9a8d-dbef1c1ac3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:41.178167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce25692-2ec4-4941-9a8d-dbef1c1ac3d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:41.179840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce25692-2ec4-4941-9a8d-dbef1c1ac3d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:41.183596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce25692-2ec4-4941-9a8d-dbef1c1ac3d3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:41.197929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ff9f7-75ff-42cd-b5e8-36f0e95737a1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:41.206067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54162a-4474-4991-9a69-93022c537c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:41.212955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54162a-4474-4991-9a69-93022c537c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:41.213494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54162a-4474-4991-9a69-93022c537c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:41.213961 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54162a-4474-4991-9a69-93022c537c0d admin admin] PATH_INFO: `/v3/projects/16a4e3bcd1364ee4a9cdc27d5d2feb87` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:41.216631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54162a-4474-4991-9a69-93022c537c0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=16a4e3bcd1364ee4a9cdc27d5d2feb87)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:41.219675 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2130/4243] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:26:41.222245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54162a-4474-4991-9a69-93022c537c0d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:41.224736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce25692-2ec4-4941-9a8d-dbef1c1ac3d3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:41.296647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce25692-2ec4-4941-9a8d-dbef1c1ac3d3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:41.312779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330a4ae-6a02-4433-b281-21169b367fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:41.318063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330a4ae-6a02-4433-b281-21169b367fda admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:41.318654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330a4ae-6a02-4433-b281-21169b367fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:41.319130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330a4ae-6a02-4433-b281-21169b367fda admin admin] PATH_INFO: `/v3/projects/efbdce657e1247b7ae1fb682952933e4/users/c601fbda57c946aab5cadbf75b742f50/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:41.325368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330a4ae-6a02-4433-b281-21169b367fda admin admin] RBAC: Authorizing `identity:create_grant(project_id=efbdce657e1247b7ae1fb682952933e4, user_id=c601fbda57c946aab5cadbf75b742f50, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:41.334066 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330a4ae-6a02-4433-b281-21169b367fda admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:41.348297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1e54162a-4474-4991-9a69-93022c537c0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16a4e3bcd1364ee4a9cdc27d5d2feb87', 'request_id': 'req-1e54162a-4474-4991-9a69-93022c537c0d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:41.380443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1e54162a-4474-4991-9a69-93022c537c0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16a4e3bcd1364ee4a9cdc27d5d2feb87', 'request_id': 'req-1e54162a-4474-4991-9a69-93022c537c0d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:41.393273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1e54162a-4474-4991-9a69-93022c537c0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16a4e3bcd1364ee4a9cdc27d5d2feb87', 'request_id': 'req-1e54162a-4474-4991-9a69-93022c537c0d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:41.417028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1e54162a-4474-4991-9a69-93022c537c0d admin admin] The token cache is being invalidate because project 16a4e3bcd1364ee4a9cdc27d5d2feb87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:26:41.417615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1e54162a-4474-4991-9a69-93022c537c0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:41.418695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1e54162a-4474-4991-9a69-93022c537c0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:41.419711 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2131/4244] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:26:41 2022] PUT /identity/v3/projects/efbdce657e1247b7ae1fb682952933e4/users/c601fbda57c946aab5cadbf75b742f50/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:41.420824 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2114/4245] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:26:40 2022] DELETE /identity/v3/projects/16a4e3bcd1364ee4a9cdc27d5d2feb87 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:41.436089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330a4ae-6a02-4433-b281-21169b367fda admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:41.436762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ced71-897a-4de5-b13c-6c4c249ec01f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:41.437254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ced71-897a-4de5-b13c-6c4c249ec01f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:41.437731 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ced71-897a-4de5-b13c-6c4c249ec01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:41.438103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a330a4ae-6a02-4433-b281-21169b367fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:41.518008 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:41.543839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-4c3ced71-897a-4de5-b13c-6c4c249ec01f None None] MFA Rules not processed for user `c601fbda57c946aab5cadbf75b742f50`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:41.545395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4c3ced71-897a-4de5-b13c-6c4c249ec01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:41.620726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330a4ae-6a02-4433-b281-21169b367fda admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:41.631720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011ae19-e8b1-4033-8663-f07c230c24f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:41.633123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011ae19-e8b1-4033-8663-f07c230c24f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:41.633407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011ae19-e8b1-4033-8663-f07c230c24f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:41.634587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011ae19-e8b1-4033-8663-f07c230c24f5 admin admin] PATH_INFO: `/v3/users/42a901d7f7d245979923aaefe5bb9b81` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:41.639046 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011ae19-e8b1-4033-8663-f07c230c24f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42a901d7f7d245979923aaefe5bb9b81)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:41.643959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011ae19-e8b1-4033-8663-f07c230c24f5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:41.749120 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2115/4246] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:41.763283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f011ae19-e8b1-4033-8663-f07c230c24f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42a901d7f7d245979923aaefe5bb9b81'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:41.775698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f011ae19-e8b1-4033-8663-f07c230c24f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42a901d7f7d245979923aaefe5bb9b81'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:41.787508 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ced71-897a-4de5-b13c-6c4c249ec01f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:41.789991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4c3ced71-897a-4de5-b13c-6c4c249ec01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:41.875379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f011ae19-e8b1-4033-8663-f07c230c24f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42a901d7f7d245979923aaefe5bb9b81'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:41.876545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f011ae19-e8b1-4033-8663-f07c230c24f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42a901d7f7d245979923aaefe5bb9b81'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:41.899147 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f011ae19-e8b1-4033-8663-f07c230c24f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42a901d7f7d245979923aaefe5bb9b81'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:41.926300 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2132/4247] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:26:41 2022] DELETE /identity/v3/users/42a901d7f7d245979923aaefe5bb9b81 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:41.941617 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:42.005199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ced71-897a-4de5-b13c-6c4c249ec01f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:42.072991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b859603-c6ea-46b8-bb09-17157fc52409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:42.074134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b859603-c6ea-46b8-bb09-17157fc52409 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:42.074609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b859603-c6ea-46b8-bb09-17157fc52409 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:42.075101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b859603-c6ea-46b8-bb09-17157fc52409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:42.078486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1b859603-c6ea-46b8-bb09-17157fc52409 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:42.200032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b859603-c6ea-46b8-bb09-17157fc52409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:42.202495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b859603-c6ea-46b8-bb09-17157fc52409 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:42.214542 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2116/4248] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:26:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:26:44.647049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011ae19-e8b1-4033-8663-f07c230c24f5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:44.648855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f011ae19-e8b1-4033-8663-f07c230c24f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:44.743747 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011ae19-e8b1-4033-8663-f07c230c24f5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:44.748546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70765b-c859-4793-bd6f-de9fc755ee61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:44.749341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70765b-c859-4793-bd6f-de9fc755ee61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:44.749625 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70765b-c859-4793-bd6f-de9fc755ee61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:44.750039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70765b-c859-4793-bd6f-de9fc755ee61 admin admin] PATH_INFO: `/v3/projects/55fe5bee6469414ead637f1b13110bc4` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:44.752325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70765b-c859-4793-bd6f-de9fc755ee61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55fe5bee6469414ead637f1b13110bc4)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:44.754236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70765b-c859-4793-bd6f-de9fc755ee61 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:44.835784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8c70765b-c859-4793-bd6f-de9fc755ee61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55fe5bee6469414ead637f1b13110bc4', 'request_id': 'req-8c70765b-c859-4793-bd6f-de9fc755ee61'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:44.843063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8c70765b-c859-4793-bd6f-de9fc755ee61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55fe5bee6469414ead637f1b13110bc4', 'request_id': 'req-8c70765b-c859-4793-bd6f-de9fc755ee61'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:44.865074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8c70765b-c859-4793-bd6f-de9fc755ee61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55fe5bee6469414ead637f1b13110bc4', 'request_id': 'req-8c70765b-c859-4793-bd6f-de9fc755ee61'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:44.867523 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:44.895915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8c70765b-c859-4793-bd6f-de9fc755ee61 admin admin] The token cache is being invalidate because project 55fe5bee6469414ead637f1b13110bc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:26:44.896215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8c70765b-c859-4793-bd6f-de9fc755ee61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:44.898792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8c70765b-c859-4793-bd6f-de9fc755ee61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:44.901963 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2133/4249] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:26:44 2022] DELETE /identity/v3/projects/55fe5bee6469414ead637f1b13110bc4 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:44.907175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a78cd8-346a-4adb-b4c2-32356d99a416 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:44.907720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a78cd8-346a-4adb-b4c2-32356d99a416 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:44.910070 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a78cd8-346a-4adb-b4c2-32356d99a416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:45.000360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b8a78cd8-346a-4adb-b4c2-32356d99a416 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:45.002972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b8a78cd8-346a-4adb-b4c2-32356d99a416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:45.163473 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2117/4250] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:45.172308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb95e8-f535-442e-955f-2cf58f80c580 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:45.172750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb95e8-f535-442e-955f-2cf58f80c580 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:45.173124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb95e8-f535-442e-955f-2cf58f80c580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:45.205942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-27bb95e8-f535-442e-955f-2cf58f80c580 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:45.207391 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-27bb95e8-f535-442e-955f-2cf58f80c580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:45.219757 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2134/4251] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:45.221416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a78cd8-346a-4adb-b4c2-32356d99a416 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:45.234909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a78cd8-346a-4adb-b4c2-32356d99a416 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:45.244386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17025ccb-0ae2-4e32-8721-6af985386f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:45.245172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17025ccb-0ae2-4e32-8721-6af985386f3b admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:45.245544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17025ccb-0ae2-4e32-8721-6af985386f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:45.245912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17025ccb-0ae2-4e32-8721-6af985386f3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:45.246974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17025ccb-0ae2-4e32-8721-6af985386f3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:26:45.248133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17025ccb-0ae2-4e32-8721-6af985386f3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:45.250120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17025ccb-0ae2-4e32-8721-6af985386f3b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:45.290420 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2118/4252] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:26:45.291382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb95e8-f535-442e-955f-2cf58f80c580 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:45.302628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb95e8-f535-442e-955f-2cf58f80c580 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:45.307708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbfaf6-1a1c-4b28-a653-00f8c5880111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:45.308500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbfaf6-1a1c-4b28-a653-00f8c5880111 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:45.309044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbfaf6-1a1c-4b28-a653-00f8c5880111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:45.309697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbfaf6-1a1c-4b28-a653-00f8c5880111 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:45.310466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecbfaf6-1a1c-4b28-a653-00f8c5880111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:45.312767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecbfaf6-1a1c-4b28-a653-00f8c5880111 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:45.368102 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2135/4253] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:26:45 2022] POST /identity/v3/projects => generated 389 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:26:45.369888 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17025ccb-0ae2-4e32-8721-6af985386f3b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:45.397762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17025ccb-0ae2-4e32-8721-6af985386f3b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:45.438450 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:45.480925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7eb882-a5e9-4f05-9829-7803261e1fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:45.481615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7eb882-a5e9-4f05-9829-7803261e1fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:45.482050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7eb882-a5e9-4f05-9829-7803261e1fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:45.482405 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7eb882-a5e9-4f05-9829-7803261e1fd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:45.483617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7eb882-a5e9-4f05-9829-7803261e1fd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:45.485810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7eb882-a5e9-4f05-9829-7803261e1fd4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:45.517982 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2119/4254] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:26:45 2022] POST /identity/v3/users => generated 295 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:26:45.523151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbfaf6-1a1c-4b28-a653-00f8c5880111 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:45.565281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbfaf6-1a1c-4b28-a653-00f8c5880111 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:45.573573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903db59c-9056-4ef6-955c-b68e75285d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:45.574451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903db59c-9056-4ef6-955c-b68e75285d2c admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:45.574833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903db59c-9056-4ef6-955c-b68e75285d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:45.575266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903db59c-9056-4ef6-955c-b68e75285d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:45.576446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903db59c-9056-4ef6-955c-b68e75285d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:45.578289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903db59c-9056-4ef6-955c-b68e75285d2c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:45.595964 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2136/4255] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:26:45.597720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7eb882-a5e9-4f05-9829-7803261e1fd4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:45.615839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7eb882-a5e9-4f05-9829-7803261e1fd4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:45.632049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8cdff-4e9d-44ff-a0ee-fee7d7feebac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:45.633081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8cdff-4e9d-44ff-a0ee-fee7d7feebac admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:45.633461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8cdff-4e9d-44ff-a0ee-fee7d7feebac admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:45.634864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8cdff-4e9d-44ff-a0ee-fee7d7feebac admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:45.636775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8cdff-4e9d-44ff-a0ee-fee7d7feebac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:45.642982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8cdff-4e9d-44ff-a0ee-fee7d7feebac admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:45.679789 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2120/4256] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:26:45.681914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903db59c-9056-4ef6-955c-b68e75285d2c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:45.700848 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903db59c-9056-4ef6-955c-b68e75285d2c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:45.722273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396730e-63ae-4680-b8e6-a32a3b4a02be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:45.723274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396730e-63ae-4680-b8e6-a32a3b4a02be admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:45.723712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396730e-63ae-4680-b8e6-a32a3b4a02be admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:45.724162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396730e-63ae-4680-b8e6-a32a3b4a02be admin admin] PATH_INFO: `/v3/projects/b9ebcefdd8004224bc74ba41ff415c55/users/d55c781844014bf49b73dfee7377a164/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:45.749287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396730e-63ae-4680-b8e6-a32a3b4a02be admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ebcefdd8004224bc74ba41ff415c55, user_id=d55c781844014bf49b73dfee7377a164, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:45.752717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396730e-63ae-4680-b8e6-a32a3b4a02be admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:45.773161 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2137/4257] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:26:45 2022] PUT /identity/v3/projects/b9ebcefdd8004224bc74ba41ff415c55/users/d55c781844014bf49b73dfee7377a164/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:45.784926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a772e-666b-445a-a082-a5df2804f1f5 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:45.785481 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a772e-666b-445a-a082-a5df2804f1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:45.785859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a772e-666b-445a-a082-a5df2804f1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:45.826877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-588a772e-666b-445a-a082-a5df2804f1f5 None None] MFA Rules not processed for user `d55c781844014bf49b73dfee7377a164`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:45.828366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-588a772e-666b-445a-a082-a5df2804f1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:45.920661 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2121/4258] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:45.926974 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396730e-63ae-4680-b8e6-a32a3b4a02be admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:46.034850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396730e-63ae-4680-b8e6-a32a3b4a02be admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:46.042148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6972ec-2684-406c-a9e3-78bb49f8ee82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:46.043807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6972ec-2684-406c-a9e3-78bb49f8ee82 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:46.044259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6972ec-2684-406c-a9e3-78bb49f8ee82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:46.044688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6972ec-2684-406c-a9e3-78bb49f8ee82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:46.045457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6972ec-2684-406c-a9e3-78bb49f8ee82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:46.049565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6972ec-2684-406c-a9e3-78bb49f8ee82 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:46.106961 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2138/4259] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:26:45 2022] POST /identity/v3/projects => generated 391 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:26:46.110820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a772e-666b-445a-a082-a5df2804f1f5 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:46.146024 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a772e-666b-445a-a082-a5df2804f1f5 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:46.271084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fedc43-e7e0-4042-b272-e6f93edd98b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:46.272014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fedc43-e7e0-4042-b272-e6f93edd98b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:46.272634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fedc43-e7e0-4042-b272-e6f93edd98b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:46.272913 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fedc43-e7e0-4042-b272-e6f93edd98b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:46.273880 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fedc43-e7e0-4042-b272-e6f93edd98b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:46.277028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fedc43-e7e0-4042-b272-e6f93edd98b4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:46.313717 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2122/4260] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:26:46 2022] POST /identity/v3/users => generated 302 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:26:46.318553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6972ec-2684-406c-a9e3-78bb49f8ee82 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:46.334700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6972ec-2684-406c-a9e3-78bb49f8ee82 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:46.340376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3593f-8434-43d9-9e1a-b680333631be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:46.341005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3593f-8434-43d9-9e1a-b680333631be admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:46.341281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3593f-8434-43d9-9e1a-b680333631be admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:46.341552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3593f-8434-43d9-9e1a-b680333631be admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:46.342534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3593f-8434-43d9-9e1a-b680333631be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:46.344357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3593f-8434-43d9-9e1a-b680333631be admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:46.358310 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2139/4261] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:26:46.363268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fedc43-e7e0-4042-b272-e6f93edd98b4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:46.378727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fedc43-e7e0-4042-b272-e6f93edd98b4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:46.387756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fae78-cc8e-422b-aa12-c3392449cb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:46.389698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fae78-cc8e-422b-aa12-c3392449cb25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:46.390261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fae78-cc8e-422b-aa12-c3392449cb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:46.390735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fae78-cc8e-422b-aa12-c3392449cb25 admin admin] PATH_INFO: `/v3/projects/e2a2e0d9cf7b4804ad7bafb86fdd9ca9/users/870c2ea125b44045a36db19234c95dab/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:46.419363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1fae78-cc8e-422b-aa12-c3392449cb25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2a2e0d9cf7b4804ad7bafb86fdd9ca9, user_id=870c2ea125b44045a36db19234c95dab, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:46.422745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1fae78-cc8e-422b-aa12-c3392449cb25 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:46.428133 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:46.448601 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2123/4262] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:26:46 2022] PUT /identity/v3/projects/e2a2e0d9cf7b4804ad7bafb86fdd9ca9/users/870c2ea125b44045a36db19234c95dab/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:46.452810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3593f-8434-43d9-9e1a-b680333631be admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:46.491112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3593f-8434-43d9-9e1a-b680333631be admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:46.653122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6cbf7-cec5-4e94-abcc-a14f79dd687e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:46.653777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6cbf7-cec5-4e94-abcc-a14f79dd687e admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:46.654056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6cbf7-cec5-4e94-abcc-a14f79dd687e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:46.654320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6cbf7-cec5-4e94-abcc-a14f79dd687e admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:46.655000 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6cbf7-cec5-4e94-abcc-a14f79dd687e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:46.657167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6cbf7-cec5-4e94-abcc-a14f79dd687e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:46.672276 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:46.687762 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2140/4263] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:26:46.692030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fae78-cc8e-422b-aa12-c3392449cb25 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:46.707699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fae78-cc8e-422b-aa12-c3392449cb25 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:46.725921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ccbd0-db0f-4d60-b4ba-47ad5cb7fb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:46.726838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ccbd0-db0f-4d60-b4ba-47ad5cb7fb5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:46.727241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ccbd0-db0f-4d60-b4ba-47ad5cb7fb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:46.727709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ccbd0-db0f-4d60-b4ba-47ad5cb7fb5b admin admin] PATH_INFO: `/v3/projects/e2a2e0d9cf7b4804ad7bafb86fdd9ca9/users/870c2ea125b44045a36db19234c95dab/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:46.731362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ccbd0-db0f-4d60-b4ba-47ad5cb7fb5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2a2e0d9cf7b4804ad7bafb86fdd9ca9, user_id=870c2ea125b44045a36db19234c95dab, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:46.734743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ccbd0-db0f-4d60-b4ba-47ad5cb7fb5b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:46.750720 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2124/4264] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:26:46 2022] PUT /identity/v3/projects/e2a2e0d9cf7b4804ad7bafb86fdd9ca9/users/870c2ea125b44045a36db19234c95dab/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:46.761576 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352bcdc-8ee8-4d56-b984-c59a42f8f87e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:46.761858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352bcdc-8ee8-4d56-b984-c59a42f8f87e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:46.762129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352bcdc-8ee8-4d56-b984-c59a42f8f87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:46.828298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1352bcdc-8ee8-4d56-b984-c59a42f8f87e None None] MFA Rules not processed for user `870c2ea125b44045a36db19234c95dab`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:46.828730 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1352bcdc-8ee8-4d56-b984-c59a42f8f87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:47.007267 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2141/4265] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:46 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:26:47.020508 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ccbd0-db0f-4d60-b4ba-47ad5cb7fb5b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:47.022693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c94ccbd0-db0f-4d60-b4ba-47ad5cb7fb5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:47.106647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352bcdc-8ee8-4d56-b984-c59a42f8f87e None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:47.108182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1352bcdc-8ee8-4d56-b984-c59a42f8f87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:47.242501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ccbd0-db0f-4d60-b4ba-47ad5cb7fb5b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:47.258104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352bcdc-8ee8-4d56-b984-c59a42f8f87e None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:47.258738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828dec4b-071f-49ee-85a5-a432ebfa1969 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:47.259370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dec4b-071f-49ee-85a5-a432ebfa1969 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:47.261041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dec4b-071f-49ee-85a5-a432ebfa1969 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:47.261348 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dec4b-071f-49ee-85a5-a432ebfa1969 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:47.276129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e94ff3-2ee1-4490-b998-fb2e49511873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:47.276889 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e94ff3-2ee1-4490-b998-fb2e49511873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:47.277169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e94ff3-2ee1-4490-b998-fb2e49511873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:47.277445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e94ff3-2ee1-4490-b998-fb2e49511873 admin admin] PATH_INFO: `/v3/users/eb8b8987ef78426689aa6ebf97072955` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:47.285146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e94ff3-2ee1-4490-b998-fb2e49511873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb8b8987ef78426689aa6ebf97072955)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:47.287151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e94ff3-2ee1-4490-b998-fb2e49511873 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:47.352017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828dec4b-071f-49ee-85a5-a432ebfa1969 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:47.354384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828dec4b-071f-49ee-85a5-a432ebfa1969 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:47.367475 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2125/4266] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:26:47 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:26:47.379692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-57e94ff3-2ee1-4490-b998-fb2e49511873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb8b8987ef78426689aa6ebf97072955'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:47.391308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-57e94ff3-2ee1-4490-b998-fb2e49511873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb8b8987ef78426689aa6ebf97072955'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:47.410393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-57e94ff3-2ee1-4490-b998-fb2e49511873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb8b8987ef78426689aa6ebf97072955'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:47.411244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-57e94ff3-2ee1-4490-b998-fb2e49511873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb8b8987ef78426689aa6ebf97072955'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:47.421464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-57e94ff3-2ee1-4490-b998-fb2e49511873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb8b8987ef78426689aa6ebf97072955'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:47.434196 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2142/4267] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:26:47 2022] DELETE /identity/v3/users/eb8b8987ef78426689aa6ebf97072955 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:26:47.438562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6375b-66fc-480e-96cc-a90d75086393 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:47.438851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6375b-66fc-480e-96cc-a90d75086393 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:47.439173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6375b-66fc-480e-96cc-a90d75086393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:47.463344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-95b6375b-66fc-480e-96cc-a90d75086393 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:47.464765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-95b6375b-66fc-480e-96cc-a90d75086393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:47.588167 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2126/4268] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:47.691159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e94ff3-2ee1-4490-b998-fb2e49511873 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:47.693305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-57e94ff3-2ee1-4490-b998-fb2e49511873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:47.709588 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:47.821024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e94ff3-2ee1-4490-b998-fb2e49511873 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:47.833479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee1913-7a15-499f-81dc-8f5d323a6553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:47.836967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee1913-7a15-499f-81dc-8f5d323a6553 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:47.837479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee1913-7a15-499f-81dc-8f5d323a6553 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:47.838016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee1913-7a15-499f-81dc-8f5d323a6553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:47.853676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee1913-7a15-499f-81dc-8f5d323a6553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:47.855988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee1913-7a15-499f-81dc-8f5d323a6553 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:47.884417 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2143/4269] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:26:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:26:49.101276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6375b-66fc-480e-96cc-a90d75086393 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:49.102840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-95b6375b-66fc-480e-96cc-a90d75086393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:49.190011 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:49.191012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee1913-7a15-499f-81dc-8f5d323a6553 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:49.192859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4eee1913-7a15-499f-81dc-8f5d323a6553 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:49.228346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee1913-7a15-499f-81dc-8f5d323a6553 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:49.253331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a182a59-76bf-45e4-8e9f-aa77b8a5ad50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:49.254027 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a182a59-76bf-45e4-8e9f-aa77b8a5ad50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:49.254302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a182a59-76bf-45e4-8e9f-aa77b8a5ad50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:49.254576 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a182a59-76bf-45e4-8e9f-aa77b8a5ad50 admin admin] PATH_INFO: `/v3/projects/68660550bcbe4c58bd0faeb27a591d60` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:49.258173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a182a59-76bf-45e4-8e9f-aa77b8a5ad50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68660550bcbe4c58bd0faeb27a591d60)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:49.263927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a182a59-76bf-45e4-8e9f-aa77b8a5ad50 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:49.365805 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1a182a59-76bf-45e4-8e9f-aa77b8a5ad50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68660550bcbe4c58bd0faeb27a591d60', 'request_id': 'req-1a182a59-76bf-45e4-8e9f-aa77b8a5ad50'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:49.369012 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6375b-66fc-480e-96cc-a90d75086393 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:49.374328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1a182a59-76bf-45e4-8e9f-aa77b8a5ad50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68660550bcbe4c58bd0faeb27a591d60', 'request_id': 'req-1a182a59-76bf-45e4-8e9f-aa77b8a5ad50'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:49.393699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1a182a59-76bf-45e4-8e9f-aa77b8a5ad50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68660550bcbe4c58bd0faeb27a591d60', 'request_id': 'req-1a182a59-76bf-45e4-8e9f-aa77b8a5ad50'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:49.421487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1a182a59-76bf-45e4-8e9f-aa77b8a5ad50 admin admin] The token cache is being invalidate because project 68660550bcbe4c58bd0faeb27a591d60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:26:49.422066 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1a182a59-76bf-45e4-8e9f-aa77b8a5ad50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:49.425355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1a182a59-76bf-45e4-8e9f-aa77b8a5ad50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:49.430079 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2144/4270] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:26:49 2022] DELETE /identity/v3/projects/68660550bcbe4c58bd0faeb27a591d60 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:49.437326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a182a59-76bf-45e4-8e9f-aa77b8a5ad50 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:49.439944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1a182a59-76bf-45e4-8e9f-aa77b8a5ad50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:49.492773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe8789-92b6-41ae-b15f-5e35ab91623d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:49.493650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe8789-92b6-41ae-b15f-5e35ab91623d service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:49.494034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe8789-92b6-41ae-b15f-5e35ab91623d service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:49.494412 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe8789-92b6-41ae-b15f-5e35ab91623d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:49.496446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9ebe8789-92b6-41ae-b15f-5e35ab91623d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:49.549853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a182a59-76bf-45e4-8e9f-aa77b8a5ad50 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:49.555574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a22b3-9959-4ca9-b276-e36fa41a97ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:49.556180 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a22b3-9959-4ca9-b276-e36fa41a97ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:49.556458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a22b3-9959-4ca9-b276-e36fa41a97ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:49.556731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a22b3-9959-4ca9-b276-e36fa41a97ab admin admin] PATH_INFO: `/v3/users/c601fbda57c946aab5cadbf75b742f50` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:49.557934 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a22b3-9959-4ca9-b276-e36fa41a97ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=c601fbda57c946aab5cadbf75b742f50)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:49.560334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a22b3-9959-4ca9-b276-e36fa41a97ab admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:49.618718 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:49.634212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe8789-92b6-41ae-b15f-5e35ab91623d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:49.637808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe8789-92b6-41ae-b15f-5e35ab91623d service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:49.650270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-712a22b3-9959-4ca9-b276-e36fa41a97ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c601fbda57c946aab5cadbf75b742f50'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:49.663285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-712a22b3-9959-4ca9-b276-e36fa41a97ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c601fbda57c946aab5cadbf75b742f50'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:49.669134 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2127/4271] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:26:49 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:26:49.679339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-712a22b3-9959-4ca9-b276-e36fa41a97ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c601fbda57c946aab5cadbf75b742f50'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:49.680138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-712a22b3-9959-4ca9-b276-e36fa41a97ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c601fbda57c946aab5cadbf75b742f50'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:49.690720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-712a22b3-9959-4ca9-b276-e36fa41a97ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c601fbda57c946aab5cadbf75b742f50'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:49.698758 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2145/4272] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:26:49 2022] DELETE /identity/v3/users/c601fbda57c946aab5cadbf75b742f50 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:52.122816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe8789-92b6-41ae-b15f-5e35ab91623d service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:52.146667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe8789-92b6-41ae-b15f-5e35ab91623d service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:52.270898 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:52.304787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43bc35-a2f1-47c1-b079-eb010eba01ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:52.305450 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43bc35-a2f1-47c1-b079-eb010eba01ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:52.305757 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43bc35-a2f1-47c1-b079-eb010eba01ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:52.306029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43bc35-a2f1-47c1-b079-eb010eba01ce admin admin] PATH_INFO: `/v3/projects/efbdce657e1247b7ae1fb682952933e4` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:52.309302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43bc35-a2f1-47c1-b079-eb010eba01ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=efbdce657e1247b7ae1fb682952933e4)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:52.311398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43bc35-a2f1-47c1-b079-eb010eba01ce admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:52.443205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4c43bc35-a2f1-47c1-b079-eb010eba01ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efbdce657e1247b7ae1fb682952933e4', 'request_id': 'req-4c43bc35-a2f1-47c1-b079-eb010eba01ce'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:52.452312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4c43bc35-a2f1-47c1-b079-eb010eba01ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efbdce657e1247b7ae1fb682952933e4', 'request_id': 'req-4c43bc35-a2f1-47c1-b079-eb010eba01ce'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:52.464976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4c43bc35-a2f1-47c1-b079-eb010eba01ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efbdce657e1247b7ae1fb682952933e4', 'request_id': 'req-4c43bc35-a2f1-47c1-b079-eb010eba01ce'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:52.495017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4c43bc35-a2f1-47c1-b079-eb010eba01ce admin admin] The token cache is being invalidate because project efbdce657e1247b7ae1fb682952933e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:26:52.495374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4c43bc35-a2f1-47c1-b079-eb010eba01ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:52.496257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4c43bc35-a2f1-47c1-b079-eb010eba01ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:52.502422 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2128/4273] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:26:52 2022] DELETE /identity/v3/projects/efbdce657e1247b7ae1fb682952933e4 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:52.507754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfecdda-0534-45b4-8d87-bcde4ec58754 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:52.507754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfecdda-0534-45b4-8d87-bcde4ec58754 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:52.507754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfecdda-0534-45b4-8d87-bcde4ec58754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:52.539445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-8bfecdda-0534-45b4-8d87-bcde4ec58754 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:52.540797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8bfecdda-0534-45b4-8d87-bcde4ec58754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:52.687275 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2146/4274] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:52.695488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713f358-fb21-41aa-83c8-752140134910 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:52.695774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713f358-fb21-41aa-83c8-752140134910 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:52.696093 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713f358-fb21-41aa-83c8-752140134910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:52.736430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9713f358-fb21-41aa-83c8-752140134910 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:52.737660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9713f358-fb21-41aa-83c8-752140134910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:52.751010 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2129/4275] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:26:52.755717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfecdda-0534-45b4-8d87-bcde4ec58754 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:52.775779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfecdda-0534-45b4-8d87-bcde4ec58754 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:52.781781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d86a9d-f21e-4051-8ee9-7879063f2ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:52.782413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d86a9d-f21e-4051-8ee9-7879063f2ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:52.783242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d86a9d-f21e-4051-8ee9-7879063f2ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:52.783511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d86a9d-f21e-4051-8ee9-7879063f2ac4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:52.784244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d86a9d-f21e-4051-8ee9-7879063f2ac4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:26:52.784539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d86a9d-f21e-4051-8ee9-7879063f2ac4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:52.786169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d86a9d-f21e-4051-8ee9-7879063f2ac4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:52.829970 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2147/4276] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:26:52.832268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713f358-fb21-41aa-83c8-752140134910 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:52.845068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713f358-fb21-41aa-83c8-752140134910 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:52.877309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac0b64-39be-4b64-9f0e-cecb3ef3250d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:52.885763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac0b64-39be-4b64-9f0e-cecb3ef3250d admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:52.886844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac0b64-39be-4b64-9f0e-cecb3ef3250d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:52.887308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac0b64-39be-4b64-9f0e-cecb3ef3250d admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:52.890906 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac0b64-39be-4b64-9f0e-cecb3ef3250d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:52.901401 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcac0b64-39be-4b64-9f0e-cecb3ef3250d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:53.029546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d86a9d-f21e-4051-8ee9-7879063f2ac4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:53.043068 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2130/4277] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:26:52 2022] POST /identity/v3/projects => generated 371 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:26:53.047061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d86a9d-f21e-4051-8ee9-7879063f2ac4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:53.201218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819a9fe-a59d-42dd-9f35-083535d0d061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:53.205238 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819a9fe-a59d-42dd-9f35-083535d0d061 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:53.205836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819a9fe-a59d-42dd-9f35-083535d0d061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:53.206597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819a9fe-a59d-42dd-9f35-083535d0d061 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:53.207572 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819a9fe-a59d-42dd-9f35-083535d0d061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:53.210465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819a9fe-a59d-42dd-9f35-083535d0d061 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:53.265740 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2148/4278] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:26:53 2022] POST /identity/v3/users => generated 286 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:26:53.270225 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac0b64-39be-4b64-9f0e-cecb3ef3250d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:53.305925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac0b64-39be-4b64-9f0e-cecb3ef3250d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:53.322742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ff6f6-5445-4fa2-a23d-4692dd344b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:53.324200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ff6f6-5445-4fa2-a23d-4692dd344b68 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:53.326054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ff6f6-5445-4fa2-a23d-4692dd344b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:53.328131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ff6f6-5445-4fa2-a23d-4692dd344b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:53.333879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ff6f6-5445-4fa2-a23d-4692dd344b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:53.338970 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ff6f6-5445-4fa2-a23d-4692dd344b68 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:53.363823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819a9fe-a59d-42dd-9f35-083535d0d061 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:53.373929 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2131/4279] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:26:53.380639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819a9fe-a59d-42dd-9f35-083535d0d061 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:53.396023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d4bba-9072-4ab6-9833-93c8d8804222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:53.396950 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d4bba-9072-4ab6-9833-93c8d8804222 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:53.397760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d4bba-9072-4ab6-9833-93c8d8804222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:53.398266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d4bba-9072-4ab6-9833-93c8d8804222 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:53.409706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d4bba-9072-4ab6-9833-93c8d8804222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:53.415633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d4bba-9072-4ab6-9833-93c8d8804222 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:53.436606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ff6f6-5445-4fa2-a23d-4692dd344b68 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:53.447258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ff6f6-5445-4fa2-a23d-4692dd344b68 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:53.447982 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2149/4280] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:26:53.453052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca32aa-ad46-494f-b6aa-e10821f360f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:53.453818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca32aa-ad46-494f-b6aa-e10821f360f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:53.454171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca32aa-ad46-494f-b6aa-e10821f360f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:53.455057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca32aa-ad46-494f-b6aa-e10821f360f6 admin admin] PATH_INFO: `/v3/projects/cbe41c4eda3a4315b4874684910400f8/users/e057e89940774d948bf906cc697f2094/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:53.472420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca32aa-ad46-494f-b6aa-e10821f360f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbe41c4eda3a4315b4874684910400f8, user_id=e057e89940774d948bf906cc697f2094, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:53.476655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca32aa-ad46-494f-b6aa-e10821f360f6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:53.507351 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2132/4281] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:26:53 2022] PUT /identity/v3/projects/cbe41c4eda3a4315b4874684910400f8/users/e057e89940774d948bf906cc697f2094/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:53.516578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263acc78-9a3a-4ec2-aa72-b5a269ab32e8 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:53.517727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263acc78-9a3a-4ec2-aa72-b5a269ab32e8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:53.517727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263acc78-9a3a-4ec2-aa72-b5a269ab32e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:53.564064 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:53.573923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-263acc78-9a3a-4ec2-aa72-b5a269ab32e8 None None] MFA Rules not processed for user `e057e89940774d948bf906cc697f2094`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:53.581836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-263acc78-9a3a-4ec2-aa72-b5a269ab32e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:53.687520 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2150/4282] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:53.689436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca32aa-ad46-494f-b6aa-e10821f360f6 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:53.800627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca32aa-ad46-494f-b6aa-e10821f360f6 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:53.805505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc47f14-ae82-4821-9391-e83ae601d2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:53.806123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc47f14-ae82-4821-9391-e83ae601d2c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:53.806401 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc47f14-ae82-4821-9391-e83ae601d2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:53.806672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc47f14-ae82-4821-9391-e83ae601d2c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:53.807309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc47f14-ae82-4821-9391-e83ae601d2c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:53.809235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc47f14-ae82-4821-9391-e83ae601d2c3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:53.849416 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2133/4283] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:26:53 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:26:53.853367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263acc78-9a3a-4ec2-aa72-b5a269ab32e8 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:53.877526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263acc78-9a3a-4ec2-aa72-b5a269ab32e8 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:54.030351 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332e924-f4b8-46d5-b5d1-3d92d40b5963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:54.031100 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332e924-f4b8-46d5-b5d1-3d92d40b5963 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:54.031244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332e924-f4b8-46d5-b5d1-3d92d40b5963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:54.031509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332e924-f4b8-46d5-b5d1-3d92d40b5963 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:54.032290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332e924-f4b8-46d5-b5d1-3d92d40b5963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:54.034436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332e924-f4b8-46d5-b5d1-3d92d40b5963 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:54.072023 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2151/4284] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:26:53 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:26:54.087972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc47f14-ae82-4821-9391-e83ae601d2c3 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:54.093800 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:54.105489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc47f14-ae82-4821-9391-e83ae601d2c3 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:54.112940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029f359-c8a4-45cc-a675-58b706399bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:54.113738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029f359-c8a4-45cc-a675-58b706399bde admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:54.114121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029f359-c8a4-45cc-a675-58b706399bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:54.114502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029f359-c8a4-45cc-a675-58b706399bde admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:54.115430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029f359-c8a4-45cc-a675-58b706399bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:54.119281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3029f359-c8a4-45cc-a675-58b706399bde admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:54.140676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332e924-f4b8-46d5-b5d1-3d92d40b5963 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:54.148640 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2134/4285] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:26:54.153649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332e924-f4b8-46d5-b5d1-3d92d40b5963 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:54.159958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c891c96-1ff0-4c86-ace7-eaffae8f3339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:54.161989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c891c96-1ff0-4c86-ace7-eaffae8f3339 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:54.163072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c891c96-1ff0-4c86-ace7-eaffae8f3339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:54.163327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c891c96-1ff0-4c86-ace7-eaffae8f3339 admin admin] PATH_INFO: `/v3/projects/7ef831d13cbb4a9c986722d28a6bfd43/users/025aa419ff37440c9d38412f8c59ff84/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:54.185683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c891c96-1ff0-4c86-ace7-eaffae8f3339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ef831d13cbb4a9c986722d28a6bfd43, user_id=025aa419ff37440c9d38412f8c59ff84, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:54.188831 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c891c96-1ff0-4c86-ace7-eaffae8f3339 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:54.212985 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2152/4286] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:26:54 2022] PUT /identity/v3/projects/7ef831d13cbb4a9c986722d28a6bfd43/users/025aa419ff37440c9d38412f8c59ff84/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:26:54.216739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029f359-c8a4-45cc-a675-58b706399bde admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:54.233280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029f359-c8a4-45cc-a675-58b706399bde admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:54.356105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f1192-e81f-4b4c-9b85-e23a99a77b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:54.356767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f1192-e81f-4b4c-9b85-e23a99a77b66 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:54.357029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f1192-e81f-4b4c-9b85-e23a99a77b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:54.357250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f1192-e81f-4b4c-9b85-e23a99a77b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:54.357897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f1192-e81f-4b4c-9b85-e23a99a77b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:54.359494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f1192-e81f-4b4c-9b85-e23a99a77b66 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:54.406224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c891c96-1ff0-4c86-ace7-eaffae8f3339 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:54.408493 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2135/4287] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:26:54.428463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c891c96-1ff0-4c86-ace7-eaffae8f3339 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:54.442756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4615c-292d-4e96-948b-80f5f5d31022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:54.444039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4615c-292d-4e96-948b-80f5f5d31022 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:54.445868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4615c-292d-4e96-948b-80f5f5d31022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:54.450197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4615c-292d-4e96-948b-80f5f5d31022 admin admin] PATH_INFO: `/v3/projects/7ef831d13cbb4a9c986722d28a6bfd43/users/025aa419ff37440c9d38412f8c59ff84/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:54.455601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4615c-292d-4e96-948b-80f5f5d31022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ef831d13cbb4a9c986722d28a6bfd43, user_id=025aa419ff37440c9d38412f8c59ff84, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:54.462291 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4615c-292d-4e96-948b-80f5f5d31022 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:54.515816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5365f7e-8541-466b-8346-61576fd4cde4 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:54.516561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5365f7e-8541-466b-8346-61576fd4cde4 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:54.516959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5365f7e-8541-466b-8346-61576fd4cde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:54.538971 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2153/4288] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:26:54 2022] PUT /identity/v3/projects/7ef831d13cbb4a9c986722d28a6bfd43/users/025aa419ff37440c9d38412f8c59ff84/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:26:54.620351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-f5365f7e-8541-466b-8346-61576fd4cde4 None None] MFA Rules not processed for user `025aa419ff37440c9d38412f8c59ff84`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:54.621639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f5365f7e-8541-466b-8346-61576fd4cde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:54.799817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4615c-292d-4e96-948b-80f5f5d31022 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:54.808312 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2136/4289] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:54.811319 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4615c-292d-4e96-948b-80f5f5d31022 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:54.821936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a47b6-116b-45c1-be33-9c355ed5aba8 tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025aa419ff37440c9d38412f8c59ff84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ef831d13cbb4a9c986722d28a6bfd43', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:54.822575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a47b6-116b-45c1-be33-9c355ed5aba8 tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:54.822859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a47b6-116b-45c1-be33-9c355ed5aba8 tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:54.823134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2a47b6-116b-45c1-be33-9c355ed5aba8 tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:54.823808 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a47b6-116b-45c1-be33-9c355ed5aba8 tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:26:54.824145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a47b6-116b-45c1-be33-9c355ed5aba8 tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:54.825796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2a47b6-116b-45c1-be33-9c355ed5aba8 tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:54.858295 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5365f7e-8541-466b-8346-61576fd4cde4 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:54.869719 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2154/4290] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:26:54.872075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5365f7e-8541-466b-8346-61576fd4cde4 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:54.884467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3e7be-76c9-43f5-8e4c-cf4c978088ed tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025aa419ff37440c9d38412f8c59ff84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ef831d13cbb4a9c986722d28a6bfd43', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:54.885260 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3e7be-76c9-43f5-8e4c-cf4c978088ed tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:54.885409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3e7be-76c9-43f5-8e4c-cf4c978088ed tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:54.885656 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3e7be-76c9-43f5-8e4c-cf4c978088ed tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:54.886342 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3e7be-76c9-43f5-8e4c-cf4c978088ed tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:54.893125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3e7be-76c9-43f5-8e4c-cf4c978088ed tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:54.977923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a47b6-116b-45c1-be33-9c355ed5aba8 tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:54.987712 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2137/4291] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:26:54 2022] POST /identity/v3/projects => generated 350 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:26:54.998544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2a47b6-116b-45c1-be33-9c355ed5aba8 tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:55.113573 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:55.185037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88046f-131b-4637-906f-c56fcce5db60 tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025aa419ff37440c9d38412f8c59ff84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ef831d13cbb4a9c986722d28a6bfd43', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:55.185673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88046f-131b-4637-906f-c56fcce5db60 tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:55.185953 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88046f-131b-4637-906f-c56fcce5db60 tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:55.186226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88046f-131b-4637-906f-c56fcce5db60 tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:55.186897 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88046f-131b-4637-906f-c56fcce5db60 tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:26:55.187203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88046f-131b-4637-906f-c56fcce5db60 tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:55.197146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88046f-131b-4637-906f-c56fcce5db60 tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:55.230041 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2155/4292] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:26:55.328201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3e7be-76c9-43f5-8e4c-cf4c978088ed tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:55.330690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-27a3e7be-76c9-43f5-8e4c-cf4c978088ed tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:55.446911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3e7be-76c9-43f5-8e4c-cf4c978088ed tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:55.457917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983d973-4bfc-4d28-b3e0-5f15647544cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:55.459018 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983d973-4bfc-4d28-b3e0-5f15647544cd service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:55.460471 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983d973-4bfc-4d28-b3e0-5f15647544cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:55.461169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983d973-4bfc-4d28-b3e0-5f15647544cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:55.472459 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:55.478450 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4983d973-4bfc-4d28-b3e0-5f15647544cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:55.480375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4983d973-4bfc-4d28-b3e0-5f15647544cd service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:55.498505 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2138/4293] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:26:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:26:56.060256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b372374-c715-474e-bf6c-5d3fce67e167 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:56.061146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b372374-c715-474e-bf6c-5d3fce67e167 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:56.061608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b372374-c715-474e-bf6c-5d3fce67e167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:56.103626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0b372374-c715-474e-bf6c-5d3fce67e167 None None] MFA Rules not processed for user `ef29bd35cca547c39d76c54058d32979`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:26:56.105295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0b372374-c715-474e-bf6c-5d3fce67e167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:56.236734 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2156/4294] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:26:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:26:59.338333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983d973-4bfc-4d28-b3e0-5f15647544cd service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:59.339900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4983d973-4bfc-4d28-b3e0-5f15647544cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:59.359186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983d973-4bfc-4d28-b3e0-5f15647544cd service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:59.367012 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b4e23-1894-46e4-b8f6-9dd9cb9cb34c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:59.368416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b4e23-1894-46e4-b8f6-9dd9cb9cb34c service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:59.368970 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b4e23-1894-46e4-b8f6-9dd9cb9cb34c service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:59.369398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b4e23-1894-46e4-b8f6-9dd9cb9cb34c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:59.372516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-528b4e23-1894-46e4-b8f6-9dd9cb9cb34c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:59.393099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b4e23-1894-46e4-b8f6-9dd9cb9cb34c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:59.394884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b4e23-1894-46e4-b8f6-9dd9cb9cb34c service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:59.408329 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2139/4295] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:26:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:26:59.642648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b372374-c715-474e-bf6c-5d3fce67e167 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:26:59.644679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0b372374-c715-474e-bf6c-5d3fce67e167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:26:59.775713 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b372374-c715-474e-bf6c-5d3fce67e167 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:26:59.783791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2dab62-da42-420a-b0fc-fc3c1a16fbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:26:59.785189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2dab62-da42-420a-b0fc-fc3c1a16fbb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:26:59.786020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2dab62-da42-420a-b0fc-fc3c1a16fbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:26:59.786498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2dab62-da42-420a-b0fc-fc3c1a16fbb2 admin admin] PATH_INFO: `/v3/users/2a43de829b91441797cabd51581ad38a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:26:59.788114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2dab62-da42-420a-b0fc-fc3c1a16fbb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a43de829b91441797cabd51581ad38a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:26:59.790696 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2dab62-da42-420a-b0fc-fc3c1a16fbb2 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:26:59.856340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dc2dab62-da42-420a-b0fc-fc3c1a16fbb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a43de829b91441797cabd51581ad38a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:59.865876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dc2dab62-da42-420a-b0fc-fc3c1a16fbb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a43de829b91441797cabd51581ad38a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:59.882630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dc2dab62-da42-420a-b0fc-fc3c1a16fbb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a43de829b91441797cabd51581ad38a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:59.883647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dc2dab62-da42-420a-b0fc-fc3c1a16fbb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a43de829b91441797cabd51581ad38a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:59.893552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dc2dab62-da42-420a-b0fc-fc3c1a16fbb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a43de829b91441797cabd51581ad38a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:26:59.898159 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:26:59.904800 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2157/4296] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:26:59 2022] DELETE /identity/v3/users/2a43de829b91441797cabd51581ad38a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:00.344197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b4e23-1894-46e4-b8f6-9dd9cb9cb34c service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:00.347167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-528b4e23-1894-46e4-b8f6-9dd9cb9cb34c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:00.371314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2dab62-da42-420a-b0fc-fc3c1a16fbb2 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:00.372877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dc2dab62-da42-420a-b0fc-fc3c1a16fbb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:00.542414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2dab62-da42-420a-b0fc-fc3c1a16fbb2 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:00.552296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e53126-daf7-4960-a5dc-ae5df9f4c87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:00.553410 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e53126-daf7-4960-a5dc-ae5df9f4c87b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:00.554012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e53126-daf7-4960-a5dc-ae5df9f4c87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:00.554816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e53126-daf7-4960-a5dc-ae5df9f4c87b admin admin] PATH_INFO: `/v3/projects/6826f9d4a91245a3982795ce6022141f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:00.558198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e53126-daf7-4960-a5dc-ae5df9f4c87b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6826f9d4a91245a3982795ce6022141f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:00.561400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e53126-daf7-4960-a5dc-ae5df9f4c87b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:00.570401 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b4e23-1894-46e4-b8f6-9dd9cb9cb34c service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:00.659227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c2e53126-daf7-4960-a5dc-ae5df9f4c87b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6826f9d4a91245a3982795ce6022141f', 'request_id': 'req-c2e53126-daf7-4960-a5dc-ae5df9f4c87b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:00.667260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c2e53126-daf7-4960-a5dc-ae5df9f4c87b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6826f9d4a91245a3982795ce6022141f', 'request_id': 'req-c2e53126-daf7-4960-a5dc-ae5df9f4c87b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:00.678046 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c2e53126-daf7-4960-a5dc-ae5df9f4c87b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6826f9d4a91245a3982795ce6022141f', 'request_id': 'req-c2e53126-daf7-4960-a5dc-ae5df9f4c87b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:00.690107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a39d21-6bd5-4568-be88-a007036b8e39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:00.690827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a39d21-6bd5-4568-be88-a007036b8e39 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:00.691135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a39d21-6bd5-4568-be88-a007036b8e39 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:00.691750 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a39d21-6bd5-4568-be88-a007036b8e39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:00.694664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d7a39d21-6bd5-4568-be88-a007036b8e39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:00.700705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c2e53126-daf7-4960-a5dc-ae5df9f4c87b admin admin] The token cache is being invalidate because project 6826f9d4a91245a3982795ce6022141f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:27:00.701844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c2e53126-daf7-4960-a5dc-ae5df9f4c87b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:00.703037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c2e53126-daf7-4960-a5dc-ae5df9f4c87b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:00.705426 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2158/4297] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:00 2022] DELETE /identity/v3/projects/6826f9d4a91245a3982795ce6022141f => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:00.710593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9592ad-c732-4ea1-83c6-693defae587c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:00.711474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9592ad-c732-4ea1-83c6-693defae587c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:00.712247 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9592ad-c732-4ea1-83c6-693defae587c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:00.719420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a39d21-6bd5-4568-be88-a007036b8e39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:00.722278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a39d21-6bd5-4568-be88-a007036b8e39 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:00.740949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9f9592ad-c732-4ea1-83c6-693defae587c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:00.743576 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2140/4298] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:00.760895 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9f9592ad-c732-4ea1-83c6-693defae587c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:00.864715 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2159/4299] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:27:00.870172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0258e3-2924-4484-9f49-9131183451b6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:00.870500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0258e3-2924-4484-9f49-9131183451b6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:00.870662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0258e3-2924-4484-9f49-9131183451b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:00.900604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2d0258e3-2924-4484-9f49-9131183451b6 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:00.902269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2d0258e3-2924-4484-9f49-9131183451b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:00.918200 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2141/4300] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:00.919411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9592ad-c732-4ea1-83c6-693defae587c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:00.934429 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9592ad-c732-4ea1-83c6-693defae587c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:00.944813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf7fb8-a6af-42e4-b84a-24fe0891e066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:00.945913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf7fb8-a6af-42e4-b84a-24fe0891e066 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:00.949139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf7fb8-a6af-42e4-b84a-24fe0891e066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:00.950475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdf7fb8-a6af-42e4-b84a-24fe0891e066 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:00.968574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdf7fb8-a6af-42e4-b84a-24fe0891e066 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:27:00.968574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdf7fb8-a6af-42e4-b84a-24fe0891e066 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:00.968574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdf7fb8-a6af-42e4-b84a-24fe0891e066 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:00.990038 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2160/4301] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:27:00.995146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0258e3-2924-4484-9f49-9131183451b6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:01.008547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0258e3-2924-4484-9f49-9131183451b6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:01.014630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb6a2b-d68b-4e5d-8e2b-3baaca40e3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:01.015554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb6a2b-d68b-4e5d-8e2b-3baaca40e3a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:01.016064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb6a2b-d68b-4e5d-8e2b-3baaca40e3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:01.017275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb6a2b-d68b-4e5d-8e2b-3baaca40e3a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:01.018159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb6a2b-d68b-4e5d-8e2b-3baaca40e3a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:01.021066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb6a2b-d68b-4e5d-8e2b-3baaca40e3a4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:01.067278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf7fb8-a6af-42e4-b84a-24fe0891e066 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:01.067469 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2142/4302] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:27:00 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:01.086914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdf7fb8-a6af-42e4-b84a-24fe0891e066 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:01.125415 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:01.233697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ebbe3-5b6d-4c86-80f0-9e2267932b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:01.234393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ebbe3-5b6d-4c86-80f0-9e2267932b70 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:01.234667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ebbe3-5b6d-4c86-80f0-9e2267932b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:01.234874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211ebbe3-5b6d-4c86-80f0-9e2267932b70 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:01.235738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ebbe3-5b6d-4c86-80f0-9e2267932b70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:01.237908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211ebbe3-5b6d-4c86-80f0-9e2267932b70 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:01.262466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb6a2b-d68b-4e5d-8e2b-3baaca40e3a4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:01.265887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9cfb6a2b-d68b-4e5d-8e2b-3baaca40e3a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:01.295413 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2161/4303] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:27:01 2022] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:01.299306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ebbe3-5b6d-4c86-80f0-9e2267932b70 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:01.325230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211ebbe3-5b6d-4c86-80f0-9e2267932b70 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:01.348117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f5751-ee36-4004-84e4-9c3dd8a607a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:01.348796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f5751-ee36-4004-84e4-9c3dd8a607a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:01.349051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f5751-ee36-4004-84e4-9c3dd8a607a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:01.351578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f5751-ee36-4004-84e4-9c3dd8a607a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:01.351578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f5751-ee36-4004-84e4-9c3dd8a607a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:01.353132 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f5751-ee36-4004-84e4-9c3dd8a607a6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:01.364222 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:01.378219 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2162/4304] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:27:01.379360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f5751-ee36-4004-84e4-9c3dd8a607a6 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:01.403290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f5751-ee36-4004-84e4-9c3dd8a607a6 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:01.413285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a75dc-cbd5-426b-9297-03856e57bf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:01.413910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a75dc-cbd5-426b-9297-03856e57bf82 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:01.414332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a75dc-cbd5-426b-9297-03856e57bf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:01.414619 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a75dc-cbd5-426b-9297-03856e57bf82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:01.415270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a75dc-cbd5-426b-9297-03856e57bf82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:01.416905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a75dc-cbd5-426b-9297-03856e57bf82 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:01.446990 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2163/4305] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:27:01.448727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a75dc-cbd5-426b-9297-03856e57bf82 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:01.450402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb6a2b-d68b-4e5d-8e2b-3baaca40e3a4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:01.465214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9e2c3-9c7d-4a41-b08c-db5c291ee34d tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '025aa419ff37440c9d38412f8c59ff84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ef831d13cbb4a9c986722d28a6bfd43', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:01.466364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9e2c3-9c7d-4a41-b08c-db5c291ee34d tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:01.466890 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9e2c3-9c7d-4a41-b08c-db5c291ee34d tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:01.467382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9e2c3-9c7d-4a41-b08c-db5c291ee34d tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] PATH_INFO: `/v3/projects/bcfce07eefcd4e0eade35d8ed4d7d301` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:01.467854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a75dc-cbd5-426b-9297-03856e57bf82 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:01.471138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9e2c3-9c7d-4a41-b08c-db5c291ee34d tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bcfce07eefcd4e0eade35d8ed4d7d301)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:01.474894 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9e2c3-9c7d-4a41-b08c-db5c291ee34d tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:01.498436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dacad67-1929-4ec6-b9ca-56098de706aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:01.499113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacad67-1929-4ec6-b9ca-56098de706aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:01.499388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacad67-1929-4ec6-b9ca-56098de706aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:01.499660 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacad67-1929-4ec6-b9ca-56098de706aa admin admin] PATH_INFO: `/v3/projects/38b7f4c69d5542a88fa2870354d507ce/users/8a2c261b4e794705a8725b3b7126bd73/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:01.537397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dacad67-1929-4ec6-b9ca-56098de706aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=38b7f4c69d5542a88fa2870354d507ce, user_id=8a2c261b4e794705a8725b3b7126bd73, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:01.540134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dacad67-1929-4ec6-b9ca-56098de706aa admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:01.564846 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2164/4306] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:27:01 2022] PUT /identity/v3/projects/38b7f4c69d5542a88fa2870354d507ce/users/8a2c261b4e794705a8725b3b7126bd73/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:01.569779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468eb78-5bb1-4940-a021-d8a54b26c675 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:01.570061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468eb78-5bb1-4940-a021-d8a54b26c675 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:01.570350 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468eb78-5bb1-4940-a021-d8a54b26c675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:01.630132 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c468eb78-5bb1-4940-a021-d8a54b26c675 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:01.631032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c468eb78-5bb1-4940-a021-d8a54b26c675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:01.633239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e5e9e2c3-9c7d-4a41-b08c-db5c291ee34d tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcfce07eefcd4e0eade35d8ed4d7d301', 'request_id': 'req-e5e9e2c3-9c7d-4a41-b08c-db5c291ee34d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:01.655300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e5e9e2c3-9c7d-4a41-b08c-db5c291ee34d tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcfce07eefcd4e0eade35d8ed4d7d301', 'request_id': 'req-e5e9e2c3-9c7d-4a41-b08c-db5c291ee34d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:01.672031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e5e9e2c3-9c7d-4a41-b08c-db5c291ee34d tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcfce07eefcd4e0eade35d8ed4d7d301', 'request_id': 'req-e5e9e2c3-9c7d-4a41-b08c-db5c291ee34d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:01.702266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e5e9e2c3-9c7d-4a41-b08c-db5c291ee34d tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] The token cache is being invalidate because project bcfce07eefcd4e0eade35d8ed4d7d301 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:27:01.702596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e5e9e2c3-9c7d-4a41-b08c-db5c291ee34d tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:01.707444 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e5e9e2c3-9c7d-4a41-b08c-db5c291ee34d tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:01.714040 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2143/4307] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:01 2022] DELETE /identity/v3/projects/bcfce07eefcd4e0eade35d8ed4d7d301 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:01.722328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9e2c3-9c7d-4a41-b08c-db5c291ee34d tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:01.726686 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e5e9e2c3-9c7d-4a41-b08c-db5c291ee34d tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:01.770454 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2165/4308] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:01.817372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468eb78-5bb1-4940-a021-d8a54b26c675 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:01.819264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c468eb78-5bb1-4940-a021-d8a54b26c675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:01.883571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9e2c3-9c7d-4a41-b08c-db5c291ee34d tempest-QuotasNegativeTest-1011589506 tempest-QuotasNegativeTest-1011589506-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:01.890652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65aecf3-68ef-45cf-8d64-d9885e3a7edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:01.891780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65aecf3-68ef-45cf-8d64-d9885e3a7edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:01.893589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65aecf3-68ef-45cf-8d64-d9885e3a7edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:01.894005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65aecf3-68ef-45cf-8d64-d9885e3a7edc admin admin] PATH_INFO: `/v3/users/e057e89940774d948bf906cc697f2094` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:01.895617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65aecf3-68ef-45cf-8d64-d9885e3a7edc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e057e89940774d948bf906cc697f2094)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:01.899412 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65aecf3-68ef-45cf-8d64-d9885e3a7edc admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:01.940219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468eb78-5bb1-4940-a021-d8a54b26c675 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:01.950673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390ecb6-650d-4e01-9ced-d2621a93434a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:01.951897 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390ecb6-650d-4e01-9ced-d2621a93434a service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:01.951897 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390ecb6-650d-4e01-9ced-d2621a93434a service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:01.951897 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390ecb6-650d-4e01-9ced-d2621a93434a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:01.970608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390ecb6-650d-4e01-9ced-d2621a93434a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:01.972473 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390ecb6-650d-4e01-9ced-d2621a93434a service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:01.992314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c65aecf3-68ef-45cf-8d64-d9885e3a7edc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e057e89940774d948bf906cc697f2094'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:01.993647 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2166/4309] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:27:02.010736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c65aecf3-68ef-45cf-8d64-d9885e3a7edc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e057e89940774d948bf906cc697f2094'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:02.022492 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:02.031442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c65aecf3-68ef-45cf-8d64-d9885e3a7edc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e057e89940774d948bf906cc697f2094'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:02.033296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c65aecf3-68ef-45cf-8d64-d9885e3a7edc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e057e89940774d948bf906cc697f2094'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:02.046699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c65aecf3-68ef-45cf-8d64-d9885e3a7edc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e057e89940774d948bf906cc697f2094'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:02.056440 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2144/4310] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:27:01 2022] DELETE /identity/v3/users/e057e89940774d948bf906cc697f2094 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:02.061843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35377b-75ad-4c0d-adf1-a886e512df2e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:02.062218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35377b-75ad-4c0d-adf1-a886e512df2e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:02.062557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35377b-75ad-4c0d-adf1-a886e512df2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:02.072928 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:02.092767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0a35377b-75ad-4c0d-adf1-a886e512df2e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:02.095612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0a35377b-75ad-4c0d-adf1-a886e512df2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:02.187430 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2167/4311] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:27:02.223839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65aecf3-68ef-45cf-8d64-d9885e3a7edc admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:02.225350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c65aecf3-68ef-45cf-8d64-d9885e3a7edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:02.348569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65aecf3-68ef-45cf-8d64-d9885e3a7edc admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:02.353616 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599ccd8-8746-4e2c-bba1-8900d92377a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:02.354427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599ccd8-8746-4e2c-bba1-8900d92377a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:02.354569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599ccd8-8746-4e2c-bba1-8900d92377a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:02.355234 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b599ccd8-8746-4e2c-bba1-8900d92377a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:02.367098 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b599ccd8-8746-4e2c-bba1-8900d92377a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:02.368650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b599ccd8-8746-4e2c-bba1-8900d92377a0 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:02.383312 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2145/4312] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:03.677985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35377b-75ad-4c0d-adf1-a886e512df2e None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:03.679478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0a35377b-75ad-4c0d-adf1-a886e512df2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:03.698085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35377b-75ad-4c0d-adf1-a886e512df2e None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:03.719602 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cd9e2-2593-413a-bfb0-09b3fcec7a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:03.720301 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cd9e2-2593-413a-bfb0-09b3fcec7a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:03.720583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cd9e2-2593-413a-bfb0-09b3fcec7a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:03.720858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79cd9e2-2593-413a-bfb0-09b3fcec7a54 admin admin] PATH_INFO: `/v3/projects/cbe41c4eda3a4315b4874684910400f8` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:03.722131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79cd9e2-2593-413a-bfb0-09b3fcec7a54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbe41c4eda3a4315b4874684910400f8)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:03.724094 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79cd9e2-2593-413a-bfb0-09b3fcec7a54 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:03.857020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f79cd9e2-2593-413a-bfb0-09b3fcec7a54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbe41c4eda3a4315b4874684910400f8', 'request_id': 'req-f79cd9e2-2593-413a-bfb0-09b3fcec7a54'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:03.878673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f79cd9e2-2593-413a-bfb0-09b3fcec7a54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbe41c4eda3a4315b4874684910400f8', 'request_id': 'req-f79cd9e2-2593-413a-bfb0-09b3fcec7a54'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:03.886326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f79cd9e2-2593-413a-bfb0-09b3fcec7a54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbe41c4eda3a4315b4874684910400f8', 'request_id': 'req-f79cd9e2-2593-413a-bfb0-09b3fcec7a54'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:03.911304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f79cd9e2-2593-413a-bfb0-09b3fcec7a54 admin admin] The token cache is being invalidate because project cbe41c4eda3a4315b4874684910400f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:27:03.911658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f79cd9e2-2593-413a-bfb0-09b3fcec7a54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:03.912262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f79cd9e2-2593-413a-bfb0-09b3fcec7a54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:03.914041 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2168/4313] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:03 2022] DELETE /identity/v3/projects/cbe41c4eda3a4315b4874684910400f8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:03.917862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599ccd8-8746-4e2c-bba1-8900d92377a0 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:03.936840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b599ccd8-8746-4e2c-bba1-8900d92377a0 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:04.058882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4482c-e953-4e05-a2a8-20ee88484643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:04.059969 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4482c-e953-4e05-a2a8-20ee88484643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:04.060502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4482c-e953-4e05-a2a8-20ee88484643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:04.061019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4482c-e953-4e05-a2a8-20ee88484643 admin admin] PATH_INFO: `/v3/users/025aa419ff37440c9d38412f8c59ff84` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:04.063126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4482c-e953-4e05-a2a8-20ee88484643 admin admin] RBAC: Authorizing `identity:delete_user(user_id=025aa419ff37440c9d38412f8c59ff84)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:04.065430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4482c-e953-4e05-a2a8-20ee88484643 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:04.208312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-39c4482c-e953-4e05-a2a8-20ee88484643 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '025aa419ff37440c9d38412f8c59ff84'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:04.238734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-39c4482c-e953-4e05-a2a8-20ee88484643 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '025aa419ff37440c9d38412f8c59ff84'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:04.288765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-39c4482c-e953-4e05-a2a8-20ee88484643 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '025aa419ff37440c9d38412f8c59ff84'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:04.289548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-39c4482c-e953-4e05-a2a8-20ee88484643 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '025aa419ff37440c9d38412f8c59ff84'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:04.311108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-39c4482c-e953-4e05-a2a8-20ee88484643 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '025aa419ff37440c9d38412f8c59ff84'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:04.319007 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2146/4314] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:27:03 2022] DELETE /identity/v3/users/025aa419ff37440c9d38412f8c59ff84 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:06.523781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cd9e2-2593-413a-bfb0-09b3fcec7a54 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:06.526611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f79cd9e2-2593-413a-bfb0-09b3fcec7a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:06.554263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79cd9e2-2593-413a-bfb0-09b3fcec7a54 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:06.706967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a1b17-8e1a-431f-b870-8c072a71fe88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:06.707641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a1b17-8e1a-431f-b870-8c072a71fe88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:06.711156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a1b17-8e1a-431f-b870-8c072a71fe88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:06.711809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a1b17-8e1a-431f-b870-8c072a71fe88 admin admin] PATH_INFO: `/v3/projects/7ef831d13cbb4a9c986722d28a6bfd43` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:06.715768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a1b17-8e1a-431f-b870-8c072a71fe88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ef831d13cbb4a9c986722d28a6bfd43)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:06.718018 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a1b17-8e1a-431f-b870-8c072a71fe88 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:06.793402 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:06.826854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b36a1b17-8e1a-431f-b870-8c072a71fe88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ef831d13cbb4a9c986722d28a6bfd43', 'request_id': 'req-b36a1b17-8e1a-431f-b870-8c072a71fe88'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:06.836086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b36a1b17-8e1a-431f-b870-8c072a71fe88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ef831d13cbb4a9c986722d28a6bfd43', 'request_id': 'req-b36a1b17-8e1a-431f-b870-8c072a71fe88'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:06.847849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b36a1b17-8e1a-431f-b870-8c072a71fe88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ef831d13cbb4a9c986722d28a6bfd43', 'request_id': 'req-b36a1b17-8e1a-431f-b870-8c072a71fe88'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:06.881936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b36a1b17-8e1a-431f-b870-8c072a71fe88 admin admin] The token cache is being invalidate because project 7ef831d13cbb4a9c986722d28a6bfd43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:27:06.882228 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b36a1b17-8e1a-431f-b870-8c072a71fe88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:06.882903 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b36a1b17-8e1a-431f-b870-8c072a71fe88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:06.885206 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2169/4315] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:06 2022] DELETE /identity/v3/projects/7ef831d13cbb4a9c986722d28a6bfd43 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:06.889797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18430181-1c44-453f-a665-4208deb285e5 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:06.890315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18430181-1c44-453f-a665-4208deb285e5 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:06.890315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18430181-1c44-453f-a665-4208deb285e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:06.919544 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:06.937047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-18430181-1c44-453f-a665-4208deb285e5 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:06.942738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-18430181-1c44-453f-a665-4208deb285e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:07.138984 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2147/4316] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:27:07.147284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4928c7-9db2-409b-9720-302e805b0908 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:07.147568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4928c7-9db2-409b-9720-302e805b0908 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:07.147838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4928c7-9db2-409b-9720-302e805b0908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:07.189234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6e4928c7-9db2-409b-9720-302e805b0908 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:07.191262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6e4928c7-9db2-409b-9720-302e805b0908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:07.214933 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2170/4317] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:07.218895 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18430181-1c44-453f-a665-4208deb285e5 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:07.238985 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18430181-1c44-453f-a665-4208deb285e5 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:07.245582 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baeb550-78b9-463c-bb7b-5b5898d26bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:07.246670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baeb550-78b9-463c-bb7b-5b5898d26bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:07.247114 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baeb550-78b9-463c-bb7b-5b5898d26bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:07.247569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baeb550-78b9-463c-bb7b-5b5898d26bb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:07.248615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baeb550-78b9-463c-bb7b-5b5898d26bb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:27:07.249125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baeb550-78b9-463c-bb7b-5b5898d26bb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:07.251624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baeb550-78b9-463c-bb7b-5b5898d26bb5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:07.267746 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2148/4318] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:27:07.271939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4928c7-9db2-409b-9720-302e805b0908 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:07.292552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4928c7-9db2-409b-9720-302e805b0908 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:07.305601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a44ac-c82b-42c5-b022-dadec7f528a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:07.306558 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a44ac-c82b-42c5-b022-dadec7f528a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:07.308123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a44ac-c82b-42c5-b022-dadec7f528a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:07.309228 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a44ac-c82b-42c5-b022-dadec7f528a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:07.310085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a44ac-c82b-42c5-b022-dadec7f528a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:07.314110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a44ac-c82b-42c5-b022-dadec7f528a9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:07.427334 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2171/4319] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:27:07 2022] POST /identity/v3/projects => generated 381 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:07.431351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baeb550-78b9-463c-bb7b-5b5898d26bb5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:07.447064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baeb550-78b9-463c-bb7b-5b5898d26bb5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:07.557954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db6f0c-2d7e-4ab2-9cd2-adc90a992217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:07.558575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db6f0c-2d7e-4ab2-9cd2-adc90a992217 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:07.558814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db6f0c-2d7e-4ab2-9cd2-adc90a992217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:07.559043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db6f0c-2d7e-4ab2-9cd2-adc90a992217 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:07.559979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db6f0c-2d7e-4ab2-9cd2-adc90a992217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:07.561650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db6f0c-2d7e-4ab2-9cd2-adc90a992217 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:07.607969 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2149/4320] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:27:07 2022] POST /identity/v3/users => generated 291 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:07.612041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a44ac-c82b-42c5-b022-dadec7f528a9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:07.630334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a44ac-c82b-42c5-b022-dadec7f528a9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:07.644375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618cc2a7-28b2-45a4-a650-b74fdec2c461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:07.648706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618cc2a7-28b2-45a4-a650-b74fdec2c461 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:07.649076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618cc2a7-28b2-45a4-a650-b74fdec2c461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:07.649575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618cc2a7-28b2-45a4-a650-b74fdec2c461 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:07.651771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618cc2a7-28b2-45a4-a650-b74fdec2c461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:07.653506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618cc2a7-28b2-45a4-a650-b74fdec2c461 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:07.675152 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2172/4321] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:07.679403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db6f0c-2d7e-4ab2-9cd2-adc90a992217 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:07.694016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db6f0c-2d7e-4ab2-9cd2-adc90a992217 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:07.709248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bff372-93b7-4cc7-a4bb-b9bda13e7084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:07.710338 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bff372-93b7-4cc7-a4bb-b9bda13e7084 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:07.710695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bff372-93b7-4cc7-a4bb-b9bda13e7084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:07.711037 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bff372-93b7-4cc7-a4bb-b9bda13e7084 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:07.712727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bff372-93b7-4cc7-a4bb-b9bda13e7084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:07.716100 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bff372-93b7-4cc7-a4bb-b9bda13e7084 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:07.746767 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2150/4322] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:07.748745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618cc2a7-28b2-45a4-a650-b74fdec2c461 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:07.767622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618cc2a7-28b2-45a4-a650-b74fdec2c461 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:07.785971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c319e04-c9e9-4135-98a8-46f2a39c3453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:07.788368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c319e04-c9e9-4135-98a8-46f2a39c3453 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:07.788953 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c319e04-c9e9-4135-98a8-46f2a39c3453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:07.789783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c319e04-c9e9-4135-98a8-46f2a39c3453 admin admin] PATH_INFO: `/v3/projects/d9754c8c80514c1499a078397c622ad0/users/6eaade0fc02945fda550254c91fa449d/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:07.834875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c319e04-c9e9-4135-98a8-46f2a39c3453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9754c8c80514c1499a078397c622ad0, user_id=6eaade0fc02945fda550254c91fa449d, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:07.842792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c319e04-c9e9-4135-98a8-46f2a39c3453 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:07.873781 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2173/4323] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:27:07 2022] PUT /identity/v3/projects/d9754c8c80514c1499a078397c622ad0/users/6eaade0fc02945fda550254c91fa449d/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:07.884558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24d7c1-45ed-43fa-b951-2a470f23fc61 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:07.889256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24d7c1-45ed-43fa-b951-2a470f23fc61 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:07.889731 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24d7c1-45ed-43fa-b951-2a470f23fc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:07.966066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9d24d7c1-45ed-43fa-b951-2a470f23fc61 None None] MFA Rules not processed for user `6eaade0fc02945fda550254c91fa449d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:07.968209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9d24d7c1-45ed-43fa-b951-2a470f23fc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:08.077647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c319e04-c9e9-4135-98a8-46f2a39c3453 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:08.083388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8c319e04-c9e9-4135-98a8-46f2a39c3453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:08.207025 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2151/4324] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:08.279758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24d7c1-45ed-43fa-b951-2a470f23fc61 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:08.281531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9d24d7c1-45ed-43fa-b951-2a470f23fc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:08.288960 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:08.403766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c319e04-c9e9-4135-98a8-46f2a39c3453 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:08.437019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874c7b7-efb3-4f12-942e-658309ceb2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:08.437849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874c7b7-efb3-4f12-942e-658309ceb2dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:08.438805 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874c7b7-efb3-4f12-942e-658309ceb2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:08.439458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874c7b7-efb3-4f12-942e-658309ceb2dd admin admin] PATH_INFO: `/v3/users/d55c781844014bf49b73dfee7377a164` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:08.443992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874c7b7-efb3-4f12-942e-658309ceb2dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d55c781844014bf49b73dfee7377a164)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:08.446437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874c7b7-efb3-4f12-942e-658309ceb2dd admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:08.509806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24d7c1-45ed-43fa-b951-2a470f23fc61 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:08.514689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2990e1-82e7-4014-b547-b698a9c4b029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:08.515917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2990e1-82e7-4014-b547-b698a9c4b029 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:08.517453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2990e1-82e7-4014-b547-b698a9c4b029 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:08.518594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2990e1-82e7-4014-b547-b698a9c4b029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:08.537519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2990e1-82e7-4014-b547-b698a9c4b029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:08.543640 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2990e1-82e7-4014-b547-b698a9c4b029 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:08.586595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a874c7b7-efb3-4f12-942e-658309ceb2dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd55c781844014bf49b73dfee7377a164'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:08.596759 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2152/4325] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:08.605180 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a874c7b7-efb3-4f12-942e-658309ceb2dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd55c781844014bf49b73dfee7377a164'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:08.611701 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:08.642710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a874c7b7-efb3-4f12-942e-658309ceb2dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd55c781844014bf49b73dfee7377a164'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:08.644502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a874c7b7-efb3-4f12-942e-658309ceb2dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd55c781844014bf49b73dfee7377a164'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:08.663325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a874c7b7-efb3-4f12-942e-658309ceb2dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd55c781844014bf49b73dfee7377a164'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:08.678040 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2174/4326] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:27:08 2022] DELETE /identity/v3/users/d55c781844014bf49b73dfee7377a164 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:08.682555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d98739-e0c2-4955-9c3d-52642da93775 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:08.682949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d98739-e0c2-4955-9c3d-52642da93775 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:08.683422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d98739-e0c2-4955-9c3d-52642da93775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:08.706699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-67d98739-e0c2-4955-9c3d-52642da93775 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:08.708718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-67d98739-e0c2-4955-9c3d-52642da93775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:08.796612 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2153/4327] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:08.841656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874c7b7-efb3-4f12-942e-658309ceb2dd admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:08.844102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a874c7b7-efb3-4f12-942e-658309ceb2dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:08.982856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874c7b7-efb3-4f12-942e-658309ceb2dd admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:08.990740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662eb42-5588-4bbe-8d75-74a0c5298e4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:08.991678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662eb42-5588-4bbe-8d75-74a0c5298e4a service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:08.992922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662eb42-5588-4bbe-8d75-74a0c5298e4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:08.994110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662eb42-5588-4bbe-8d75-74a0c5298e4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:09.009314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662eb42-5588-4bbe-8d75-74a0c5298e4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:09.011657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662eb42-5588-4bbe-8d75-74a0c5298e4a service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:09.029270 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2175/4328] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:10.755164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d98739-e0c2-4955-9c3d-52642da93775 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:10.757485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-67d98739-e0c2-4955-9c3d-52642da93775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:10.812116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d98739-e0c2-4955-9c3d-52642da93775 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:10.835142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b69b2-1d6e-459d-9543-1c0e319e4c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:10.836259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b69b2-1d6e-459d-9543-1c0e319e4c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:10.836758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b69b2-1d6e-459d-9543-1c0e319e4c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:10.837443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201b69b2-1d6e-459d-9543-1c0e319e4c56 admin admin] PATH_INFO: `/v3/projects/b9ebcefdd8004224bc74ba41ff415c55` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:10.841203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b69b2-1d6e-459d-9543-1c0e319e4c56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9ebcefdd8004224bc74ba41ff415c55)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:10.845906 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201b69b2-1d6e-459d-9543-1c0e319e4c56 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:10.940217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-201b69b2-1d6e-459d-9543-1c0e319e4c56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9ebcefdd8004224bc74ba41ff415c55', 'request_id': 'req-201b69b2-1d6e-459d-9543-1c0e319e4c56'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:10.968721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-201b69b2-1d6e-459d-9543-1c0e319e4c56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9ebcefdd8004224bc74ba41ff415c55', 'request_id': 'req-201b69b2-1d6e-459d-9543-1c0e319e4c56'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:10.987403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-201b69b2-1d6e-459d-9543-1c0e319e4c56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9ebcefdd8004224bc74ba41ff415c55', 'request_id': 'req-201b69b2-1d6e-459d-9543-1c0e319e4c56'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:11.028478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-201b69b2-1d6e-459d-9543-1c0e319e4c56 admin admin] The token cache is being invalidate because project b9ebcefdd8004224bc74ba41ff415c55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:27:11.031569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-201b69b2-1d6e-459d-9543-1c0e319e4c56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:11.041719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-201b69b2-1d6e-459d-9543-1c0e319e4c56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:11.044652 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2154/4329] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:10 2022] DELETE /identity/v3/projects/b9ebcefdd8004224bc74ba41ff415c55 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:11.054796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662eb42-5588-4bbe-8d75-74a0c5298e4a service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:11.104848 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662eb42-5588-4bbe-8d75-74a0c5298e4a service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:11.242537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f452c5-258e-474e-94da-c6da0c662b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:11.245371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f452c5-258e-474e-94da-c6da0c662b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:11.245774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f452c5-258e-474e-94da-c6da0c662b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:11.246017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f452c5-258e-474e-94da-c6da0c662b0a admin admin] PATH_INFO: `/v3/users/870c2ea125b44045a36db19234c95dab` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:11.249967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f452c5-258e-474e-94da-c6da0c662b0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=870c2ea125b44045a36db19234c95dab)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:11.257790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f452c5-258e-474e-94da-c6da0c662b0a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:11.368205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-42f452c5-258e-474e-94da-c6da0c662b0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '870c2ea125b44045a36db19234c95dab'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:11.389752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-42f452c5-258e-474e-94da-c6da0c662b0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '870c2ea125b44045a36db19234c95dab'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:11.426715 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-42f452c5-258e-474e-94da-c6da0c662b0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '870c2ea125b44045a36db19234c95dab'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:11.427973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-42f452c5-258e-474e-94da-c6da0c662b0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '870c2ea125b44045a36db19234c95dab'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:11.436855 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:11.447007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-42f452c5-258e-474e-94da-c6da0c662b0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '870c2ea125b44045a36db19234c95dab'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:11.459754 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2176/4330] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:27:11 2022] DELETE /identity/v3/users/870c2ea125b44045a36db19234c95dab => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:13.196476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b69b2-1d6e-459d-9543-1c0e319e4c56 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:13.197991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-201b69b2-1d6e-459d-9543-1c0e319e4c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:13.224150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201b69b2-1d6e-459d-9543-1c0e319e4c56 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:13.340573 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:13.430962 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04950706-ff03-4eb5-833a-c463e623a146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:13.432116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04950706-ff03-4eb5-833a-c463e623a146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:13.432662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04950706-ff03-4eb5-833a-c463e623a146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:13.433163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04950706-ff03-4eb5-833a-c463e623a146 admin admin] PATH_INFO: `/v3/projects/e2a2e0d9cf7b4804ad7bafb86fdd9ca9` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:13.436234 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04950706-ff03-4eb5-833a-c463e623a146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2a2e0d9cf7b4804ad7bafb86fdd9ca9)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:13.443711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04950706-ff03-4eb5-833a-c463e623a146 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:13.597265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-04950706-ff03-4eb5-833a-c463e623a146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2a2e0d9cf7b4804ad7bafb86fdd9ca9', 'request_id': 'req-04950706-ff03-4eb5-833a-c463e623a146'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:13.626400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-04950706-ff03-4eb5-833a-c463e623a146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2a2e0d9cf7b4804ad7bafb86fdd9ca9', 'request_id': 'req-04950706-ff03-4eb5-833a-c463e623a146'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:13.647937 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-04950706-ff03-4eb5-833a-c463e623a146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2a2e0d9cf7b4804ad7bafb86fdd9ca9', 'request_id': 'req-04950706-ff03-4eb5-833a-c463e623a146'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:13.689233 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-04950706-ff03-4eb5-833a-c463e623a146 admin admin] The token cache is being invalidate because project e2a2e0d9cf7b4804ad7bafb86fdd9ca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:27:13.689774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-04950706-ff03-4eb5-833a-c463e623a146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:13.691256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-04950706-ff03-4eb5-833a-c463e623a146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:13.700077 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2155/4331] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:13 2022] DELETE /identity/v3/projects/e2a2e0d9cf7b4804ad7bafb86fdd9ca9 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:13.702169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b8390-29af-4136-a44a-97b5169d45f9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:13.703121 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b8390-29af-4136-a44a-97b5169d45f9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:13.703121 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b8390-29af-4136-a44a-97b5169d45f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:13.779430 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a89b8390-29af-4136-a44a-97b5169d45f9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:13.783750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a89b8390-29af-4136-a44a-97b5169d45f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:14.075510 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2177/4332] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:14.089979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b465704-c09b-4ef1-9484-2b446cf53c88 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:14.090478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b465704-c09b-4ef1-9484-2b446cf53c88 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:14.090989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b465704-c09b-4ef1-9484-2b446cf53c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:14.247650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-5b465704-c09b-4ef1-9484-2b446cf53c88 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:14.252301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5b465704-c09b-4ef1-9484-2b446cf53c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:14.278170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b8390-29af-4136-a44a-97b5169d45f9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:14.294736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89b8390-29af-4136-a44a-97b5169d45f9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:14.295462 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2156/4333] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:14.311022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5d7d3-3969-4584-aab7-0f932b711e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:14.311708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5d7d3-3969-4584-aab7-0f932b711e52 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:14.312027 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5d7d3-3969-4584-aab7-0f932b711e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:14.314500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5d7d3-3969-4584-aab7-0f932b711e52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:14.315404 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5d7d3-3969-4584-aab7-0f932b711e52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:27:14.315704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5d7d3-3969-4584-aab7-0f932b711e52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:14.322073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5d7d3-3969-4584-aab7-0f932b711e52 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:14.368577 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2178/4334] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:27:14.370385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b465704-c09b-4ef1-9484-2b446cf53c88 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:14.390291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b465704-c09b-4ef1-9484-2b446cf53c88 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:14.398699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef2610-bd44-4ee9-af1b-27c07c66c38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:14.399068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef2610-bd44-4ee9-af1b-27c07c66c38b admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:14.399342 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef2610-bd44-4ee9-af1b-27c07c66c38b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:14.399727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef2610-bd44-4ee9-af1b-27c07c66c38b admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:14.401031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef2610-bd44-4ee9-af1b-27c07c66c38b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:14.403008 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef2610-bd44-4ee9-af1b-27c07c66c38b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:14.453372 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2157/4335] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:27:14 2022] POST /identity/v3/projects => generated 373 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:27:14.454223 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5d7d3-3969-4584-aab7-0f932b711e52 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:14.474204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5d7d3-3969-4584-aab7-0f932b711e52 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:14.629340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e594d9-ff9f-4971-8ca1-86966020b3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:14.630978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e594d9-ff9f-4971-8ca1-86966020b3df admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:14.631306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e594d9-ff9f-4971-8ca1-86966020b3df admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:14.631701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e594d9-ff9f-4971-8ca1-86966020b3df admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:14.632712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e594d9-ff9f-4971-8ca1-86966020b3df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:14.637173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e594d9-ff9f-4971-8ca1-86966020b3df admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:14.724209 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2179/4336] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:27:14 2022] POST /identity/v3/users => generated 287 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:14.732804 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef2610-bd44-4ee9-af1b-27c07c66c38b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:14.749901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef2610-bd44-4ee9-af1b-27c07c66c38b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:14.759382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da2410-fd9f-4cfe-b137-f17d72f3cb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:14.760512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da2410-fd9f-4cfe-b137-f17d72f3cb2d admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:14.761101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da2410-fd9f-4cfe-b137-f17d72f3cb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:14.761607 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da2410-fd9f-4cfe-b137-f17d72f3cb2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:14.762708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da2410-fd9f-4cfe-b137-f17d72f3cb2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:14.765453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da2410-fd9f-4cfe-b137-f17d72f3cb2d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:14.782508 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2158/4337] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:14.787089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e594d9-ff9f-4971-8ca1-86966020b3df admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:14.800715 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e594d9-ff9f-4971-8ca1-86966020b3df admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:14.808304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd8b4a-ee7a-478d-9ff4-6815889f2834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:14.808982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd8b4a-ee7a-478d-9ff4-6815889f2834 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:14.809318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd8b4a-ee7a-478d-9ff4-6815889f2834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:14.809595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd8b4a-ee7a-478d-9ff4-6815889f2834 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:14.810313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd8b4a-ee7a-478d-9ff4-6815889f2834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:14.812443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd8b4a-ee7a-478d-9ff4-6815889f2834 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:14.847956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da2410-fd9f-4cfe-b137-f17d72f3cb2d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:14.848658 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2180/4338] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:14.883062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da2410-fd9f-4cfe-b137-f17d72f3cb2d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:14.907138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bdecf-633f-4ea0-b3bf-650bf5f77af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:14.911736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bdecf-633f-4ea0-b3bf-650bf5f77af2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:14.912663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bdecf-633f-4ea0-b3bf-650bf5f77af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:14.913403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966bdecf-633f-4ea0-b3bf-650bf5f77af2 admin admin] PATH_INFO: `/v3/projects/be8103cff8eb43849f7e3e3cbde2a3c1/users/a52d30705cf141909b494e394c0d4e7f/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:14.945000 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966bdecf-633f-4ea0-b3bf-650bf5f77af2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be8103cff8eb43849f7e3e3cbde2a3c1, user_id=a52d30705cf141909b494e394c0d4e7f, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:14.950395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966bdecf-633f-4ea0-b3bf-650bf5f77af2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:15.032917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75205e35-cea1-42b0-a5e5-7105d4f0e1f1 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:15.033327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75205e35-cea1-42b0-a5e5-7105d4f0e1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:15.033605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75205e35-cea1-42b0-a5e5-7105d4f0e1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:15.037468 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2159/4339] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:27:14 2022] PUT /identity/v3/projects/be8103cff8eb43849f7e3e3cbde2a3c1/users/a52d30705cf141909b494e394c0d4e7f/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:27:15.097515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-75205e35-cea1-42b0-a5e5-7105d4f0e1f1 None None] MFA Rules not processed for user `a52d30705cf141909b494e394c0d4e7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:15.100532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-75205e35-cea1-42b0-a5e5-7105d4f0e1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:15.185800 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:15.243073 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2181/4340] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:16.627333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bdecf-633f-4ea0-b3bf-650bf5f77af2 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:16.630612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-966bdecf-633f-4ea0-b3bf-650bf5f77af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:16.814332 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:16.861464 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966bdecf-633f-4ea0-b3bf-650bf5f77af2 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:16.868891 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fbb72-96f9-4a77-bba7-ac8962efdb33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:16.870730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fbb72-96f9-4a77-bba7-ac8962efdb33 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:16.870730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fbb72-96f9-4a77-bba7-ac8962efdb33 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:16.870730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fbb72-96f9-4a77-bba7-ac8962efdb33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:16.896399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fbb72-96f9-4a77-bba7-ac8962efdb33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:16.898382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fbb72-96f9-4a77-bba7-ac8962efdb33 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:16.930838 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2160/4341] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:18.727723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75205e35-cea1-42b0-a5e5-7105d4f0e1f1 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:18.939274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75205e35-cea1-42b0-a5e5-7105d4f0e1f1 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:18.967978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fa562-801a-49fe-8d40-9df33307061c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:18.967978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fa562-801a-49fe-8d40-9df33307061c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:18.967978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fa562-801a-49fe-8d40-9df33307061c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:18.967978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fa562-801a-49fe-8d40-9df33307061c admin admin] PATH_INFO: `/v3/users/a52d30705cf141909b494e394c0d4e7f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:18.968910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8fa562-801a-49fe-8d40-9df33307061c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a52d30705cf141909b494e394c0d4e7f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:18.970899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8fa562-801a-49fe-8d40-9df33307061c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:19.079316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ff8fa562-801a-49fe-8d40-9df33307061c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a52d30705cf141909b494e394c0d4e7f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:19.090485 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ff8fa562-801a-49fe-8d40-9df33307061c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a52d30705cf141909b494e394c0d4e7f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:19.108070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ff8fa562-801a-49fe-8d40-9df33307061c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a52d30705cf141909b494e394c0d4e7f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:19.109109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ff8fa562-801a-49fe-8d40-9df33307061c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a52d30705cf141909b494e394c0d4e7f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:19.120298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ff8fa562-801a-49fe-8d40-9df33307061c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a52d30705cf141909b494e394c0d4e7f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:19.135743 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2182/4342] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:27:18 2022] DELETE /identity/v3/users/a52d30705cf141909b494e394c0d4e7f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:19.136404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccf6a4-68e6-4e42-8070-1b463fecc034 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:19.137346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccf6a4-68e6-4e42-8070-1b463fecc034 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:19.137788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccf6a4-68e6-4e42-8070-1b463fecc034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:19.163764 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-51ccf6a4-68e6-4e42-8070-1b463fecc034 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:19.166744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-51ccf6a4-68e6-4e42-8070-1b463fecc034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:19.279092 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2161/4343] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:27:19.356368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fa562-801a-49fe-8d40-9df33307061c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:19.358542 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ff8fa562-801a-49fe-8d40-9df33307061c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:19.507598 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fa562-801a-49fe-8d40-9df33307061c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:19.513957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6bbaf-9425-495d-9ab8-15b12c7a1ab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:19.515176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6bbaf-9425-495d-9ab8-15b12c7a1ab8 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:19.516531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6bbaf-9425-495d-9ab8-15b12c7a1ab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:19.517296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6bbaf-9425-495d-9ab8-15b12c7a1ab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:19.534356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c6bbaf-9425-495d-9ab8-15b12c7a1ab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:19.538289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c6bbaf-9425-495d-9ab8-15b12c7a1ab8 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:19.565958 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2183/4344] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:21.252090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ccf6a4-68e6-4e42-8070-1b463fecc034 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:21.253931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-51ccf6a4-68e6-4e42-8070-1b463fecc034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:21.277267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ccf6a4-68e6-4e42-8070-1b463fecc034 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:21.294539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd951d0-369a-47ed-b77c-c818c7c5940c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:21.295402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd951d0-369a-47ed-b77c-c818c7c5940c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:21.295686 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd951d0-369a-47ed-b77c-c818c7c5940c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:21.296062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd951d0-369a-47ed-b77c-c818c7c5940c admin admin] PATH_INFO: `/v3/projects/be8103cff8eb43849f7e3e3cbde2a3c1` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:21.301131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd951d0-369a-47ed-b77c-c818c7c5940c admin admin] RBAC: Authorizing `identity:delete_project(project_id=be8103cff8eb43849f7e3e3cbde2a3c1)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:21.303244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd951d0-369a-47ed-b77c-c818c7c5940c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:21.369845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d97d7-fae3-4f1a-883b-1b2a40631d64 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:21.372149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d97d7-fae3-4f1a-883b-1b2a40631d64 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:21.372882 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d97d7-fae3-4f1a-883b-1b2a40631d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:21.457400 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:21.494282 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-573d97d7-fae3-4f1a-883b-1b2a40631d64 None None] MFA Rules not processed for user `8a2c261b4e794705a8725b3b7126bd73`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:21.495185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cbd951d0-369a-47ed-b77c-c818c7c5940c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be8103cff8eb43849f7e3e3cbde2a3c1', 'request_id': 'req-cbd951d0-369a-47ed-b77c-c818c7c5940c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:21.495935 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-573d97d7-fae3-4f1a-883b-1b2a40631d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:21.530276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cbd951d0-369a-47ed-b77c-c818c7c5940c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be8103cff8eb43849f7e3e3cbde2a3c1', 'request_id': 'req-cbd951d0-369a-47ed-b77c-c818c7c5940c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:21.550931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cbd951d0-369a-47ed-b77c-c818c7c5940c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be8103cff8eb43849f7e3e3cbde2a3c1', 'request_id': 'req-cbd951d0-369a-47ed-b77c-c818c7c5940c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:21.582409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cbd951d0-369a-47ed-b77c-c818c7c5940c admin admin] The token cache is being invalidate because project be8103cff8eb43849f7e3e3cbde2a3c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:27:21.588183 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cbd951d0-369a-47ed-b77c-c818c7c5940c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:21.591541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cbd951d0-369a-47ed-b77c-c818c7c5940c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:21.599117 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2162/4345] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:21 2022] DELETE /identity/v3/projects/be8103cff8eb43849f7e3e3cbde2a3c1 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:21.604867 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab597c2-9a2d-4522-a0af-93273ccaf03f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:21.605568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab597c2-9a2d-4522-a0af-93273ccaf03f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:21.606067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab597c2-9a2d-4522-a0af-93273ccaf03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:21.656742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-cab597c2-9a2d-4522-a0af-93273ccaf03f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:21.658446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cab597c2-9a2d-4522-a0af-93273ccaf03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:21.785489 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2184/4346] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:21.807503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297af17e-dcfc-412e-b772-8b6d4e0c893a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:21.808047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297af17e-dcfc-412e-b772-8b6d4e0c893a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:21.808549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297af17e-dcfc-412e-b772-8b6d4e0c893a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:21.858431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-297af17e-dcfc-412e-b772-8b6d4e0c893a None None] MFA Rules not processed for user `8a2c261b4e794705a8725b3b7126bd73`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:21.860157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-297af17e-dcfc-412e-b772-8b6d4e0c893a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:21.874331 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2163/4347] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:27:21.876689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315d9fb-8e7f-4d77-ab9e-e2efe36a5d37 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:21.876927 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315d9fb-8e7f-4d77-ab9e-e2efe36a5d37 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:21.879616 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2185/4348] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:27:21.880664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315d9fb-8e7f-4d77-ab9e-e2efe36a5d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:21.898602 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:21.930760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0315d9fb-8e7f-4d77-ab9e-e2efe36a5d37 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:21.936796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0315d9fb-8e7f-4d77-ab9e-e2efe36a5d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:21.972594 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2164/4349] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:21.977519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297af17e-dcfc-412e-b772-8b6d4e0c893a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:22.001713 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297af17e-dcfc-412e-b772-8b6d4e0c893a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:22.019296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa566a-0ee9-48db-888a-21aa9513085c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:22.020026 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa566a-0ee9-48db-888a-21aa9513085c admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:22.020522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa566a-0ee9-48db-888a-21aa9513085c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:22.021377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aa566a-0ee9-48db-888a-21aa9513085c admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:22.022605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa566a-0ee9-48db-888a-21aa9513085c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:27:22.023166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa566a-0ee9-48db-888a-21aa9513085c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:22.025217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aa566a-0ee9-48db-888a-21aa9513085c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:22.061740 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2186/4350] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:27:22.066879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315d9fb-8e7f-4d77-ab9e-e2efe36a5d37 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:22.086479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315d9fb-8e7f-4d77-ab9e-e2efe36a5d37 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:22.093110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4245665-e9d4-4a33-bd18-0a5298053ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:22.094520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4245665-e9d4-4a33-bd18-0a5298053ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:22.094880 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4245665-e9d4-4a33-bd18-0a5298053ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:22.095275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4245665-e9d4-4a33-bd18-0a5298053ea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:22.095985 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4245665-e9d4-4a33-bd18-0a5298053ea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:22.098120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4245665-e9d4-4a33-bd18-0a5298053ea6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:22.199907 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2165/4351] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:27:22 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:22.206157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa566a-0ee9-48db-888a-21aa9513085c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:22.238530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aa566a-0ee9-48db-888a-21aa9513085c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:22.420722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4245665-e9d4-4a33-bd18-0a5298053ea6 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:22.425590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c4245665-e9d4-4a33-bd18-0a5298053ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:22.463565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cfcd0-f900-4041-b8b0-616995fcd761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:22.466339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cfcd0-f900-4041-b8b0-616995fcd761 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:22.467173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cfcd0-f900-4041-b8b0-616995fcd761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:22.467318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cfcd0-f900-4041-b8b0-616995fcd761 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:22.475274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919cfcd0-f900-4041-b8b0-616995fcd761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:22.494207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919cfcd0-f900-4041-b8b0-616995fcd761 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:22.581871 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2187/4352] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:27:22 2022] POST /identity/v3/users => generated 287 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:22.584372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cfcd0-f900-4041-b8b0-616995fcd761 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:22.655313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cfcd0-f900-4041-b8b0-616995fcd761 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:22.676402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c857489-979f-4b31-b578-034887ffa5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:22.686197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c857489-979f-4b31-b578-034887ffa5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:22.688382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c857489-979f-4b31-b578-034887ffa5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:22.690504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c857489-979f-4b31-b578-034887ffa5b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:22.695066 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c857489-979f-4b31-b578-034887ffa5b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:22.710790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c857489-979f-4b31-b578-034887ffa5b1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:22.736440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4245665-e9d4-4a33-bd18-0a5298053ea6 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:22.741417 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2188/4353] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:22.745890 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c857489-979f-4b31-b578-034887ffa5b1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:22.748281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2d47a-6bbe-4110-b512-d5dbdcd181dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:22.749841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2d47a-6bbe-4110-b512-d5dbdcd181dc service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:22.750905 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2d47a-6bbe-4110-b512-d5dbdcd181dc service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:22.751404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2d47a-6bbe-4110-b512-d5dbdcd181dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:22.764364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c857489-979f-4b31-b578-034887ffa5b1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:22.775178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ac090-53f6-4f9d-beae-62e74af7f34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:22.777361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ac090-53f6-4f9d-beae-62e74af7f34d admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:22.778600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ac090-53f6-4f9d-beae-62e74af7f34d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:22.779435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ac090-53f6-4f9d-beae-62e74af7f34d admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:22.780985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ac090-53f6-4f9d-beae-62e74af7f34d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:22.785100 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ac090-53f6-4f9d-beae-62e74af7f34d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:22.809323 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2189/4354] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:22.814420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ac090-53f6-4f9d-beae-62e74af7f34d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:22.842655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ac090-53f6-4f9d-beae-62e74af7f34d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:22.859207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345bd064-958a-4914-8a75-5f03ac52afcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:22.861129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bd064-958a-4914-8a75-5f03ac52afcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:22.861792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bd064-958a-4914-8a75-5f03ac52afcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:22.862304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bd064-958a-4914-8a75-5f03ac52afcd admin admin] PATH_INFO: `/v3/projects/dbfccb8c7dd548d89a6bd79f2e4a7a80/users/2d663f0a7c484595bf4377b7e3507438/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:22.913519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345bd064-958a-4914-8a75-5f03ac52afcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbfccb8c7dd548d89a6bd79f2e4a7a80, user_id=2d663f0a7c484595bf4377b7e3507438, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:22.917292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345bd064-958a-4914-8a75-5f03ac52afcd admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:22.933564 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2d47a-6bbe-4110-b512-d5dbdcd181dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:22.940560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2d47a-6bbe-4110-b512-d5dbdcd181dc service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:22.951541 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2190/4355] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:27:22 2022] PUT /identity/v3/projects/dbfccb8c7dd548d89a6bd79f2e4a7a80/users/2d663f0a7c484595bf4377b7e3507438/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:22.962600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987cb75-c981-4091-b49f-33f1b7f62ee6 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:22.963314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987cb75-c981-4091-b49f-33f1b7f62ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:22.964128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987cb75-c981-4091-b49f-33f1b7f62ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:22.981347 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2166/4356] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:27:23.036539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f987cb75-c981-4091-b49f-33f1b7f62ee6 None None] MFA Rules not processed for user `2d663f0a7c484595bf4377b7e3507438`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:23.040124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f987cb75-c981-4091-b49f-33f1b7f62ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:23.078908 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:23.200276 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2191/4357] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:27:24.327111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2d47a-6bbe-4110-b512-d5dbdcd181dc service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:24.329984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e5d2d47a-6bbe-4110-b512-d5dbdcd181dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:24.384124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2d47a-6bbe-4110-b512-d5dbdcd181dc service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:24.529595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62edbca2-d372-4fba-a992-527639a6b296 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:24.531567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edbca2-d372-4fba-a992-527639a6b296 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:24.532329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edbca2-d372-4fba-a992-527639a6b296 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:24.533053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edbca2-d372-4fba-a992-527639a6b296 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:24.552104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62edbca2-d372-4fba-a992-527639a6b296 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:24.555424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62edbca2-d372-4fba-a992-527639a6b296 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:24.562050 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:24.616307 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2167/4358] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:29.969493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987cb75-c981-4091-b49f-33f1b7f62ee6 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:30.182409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987cb75-c981-4091-b49f-33f1b7f62ee6 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:30.203668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f0194-2383-4ce4-9662-a40ec91a3808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:30.204362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f0194-2383-4ce4-9662-a40ec91a3808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:30.204646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f0194-2383-4ce4-9662-a40ec91a3808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:30.204918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f0194-2383-4ce4-9662-a40ec91a3808 admin admin] PATH_INFO: `/v3/users/2d663f0a7c484595bf4377b7e3507438` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:30.219953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a63be3-7b79-40df-a4ac-7709c1216102 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:30.220522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a63be3-7b79-40df-a4ac-7709c1216102 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:30.220522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a63be3-7b79-40df-a4ac-7709c1216102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:30.243513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f0194-2383-4ce4-9662-a40ec91a3808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d663f0a7c484595bf4377b7e3507438)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:30.254670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f0194-2383-4ce4-9662-a40ec91a3808 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:30.277569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-34a63be3-7b79-40df-a4ac-7709c1216102 None None] MFA Rules not processed for user `d1f0c01c340940388b440932d51988ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:30.278824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-34a63be3-7b79-40df-a4ac-7709c1216102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:30.433603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7a4f0194-2383-4ce4-9662-a40ec91a3808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d663f0a7c484595bf4377b7e3507438'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:30.451749 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7a4f0194-2383-4ce4-9662-a40ec91a3808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d663f0a7c484595bf4377b7e3507438'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:30.496384 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2168/4359] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:27:30.496971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7a4f0194-2383-4ce4-9662-a40ec91a3808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d663f0a7c484595bf4377b7e3507438'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:30.501983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7a4f0194-2383-4ce4-9662-a40ec91a3808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d663f0a7c484595bf4377b7e3507438'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:30.519558 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7a4f0194-2383-4ce4-9662-a40ec91a3808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d663f0a7c484595bf4377b7e3507438'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:30.535691 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2192/4360] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:27:29 2022] DELETE /identity/v3/users/2d663f0a7c484595bf4377b7e3507438 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:30.545697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0a6eb-74ff-4be0-86b5-815a75da1c16 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:30.546076 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0a6eb-74ff-4be0-86b5-815a75da1c16 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:30.546474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0a6eb-74ff-4be0-86b5-815a75da1c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:30.583296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-a4a0a6eb-74ff-4be0-86b5-815a75da1c16 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:30.584674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a4a0a6eb-74ff-4be0-86b5-815a75da1c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:30.777962 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2169/4361] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:31.313444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f0194-2383-4ce4-9662-a40ec91a3808 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:31.314966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7a4f0194-2383-4ce4-9662-a40ec91a3808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:31.428863 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:31.482319 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f0194-2383-4ce4-9662-a40ec91a3808 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:31.489970 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acab40-420f-49a4-9b3d-19ed81c26f65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:31.490606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acab40-420f-49a4-9b3d-19ed81c26f65 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:31.490884 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acab40-420f-49a4-9b3d-19ed81c26f65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:31.491157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acab40-420f-49a4-9b3d-19ed81c26f65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:31.513651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2acab40-420f-49a4-9b3d-19ed81c26f65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:31.519215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2acab40-420f-49a4-9b3d-19ed81c26f65 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:31.547297 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2193/4362] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:33.207239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ed756-a634-46f4-9494-0d405323d940 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:33.207799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ed756-a634-46f4-9494-0d405323d940 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:33.207799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ed756-a634-46f4-9494-0d405323d940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:33.253515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7c7ed756-a634-46f4-9494-0d405323d940 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:33.255337 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7c7ed756-a634-46f4-9494-0d405323d940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:33.365472 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2170/4363] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:27:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:33.391814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acab40-420f-49a4-9b3d-19ed81c26f65 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:33.395306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b2acab40-420f-49a4-9b3d-19ed81c26f65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:33.515266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acab40-420f-49a4-9b3d-19ed81c26f65 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:33.529058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963bb394-d95a-4d40-90ec-74c146bdc69a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:33.533926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bb394-d95a-4d40-90ec-74c146bdc69a service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:33.534724 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bb394-d95a-4d40-90ec-74c146bdc69a service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:33.535357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bb394-d95a-4d40-90ec-74c146bdc69a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:33.552520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963bb394-d95a-4d40-90ec-74c146bdc69a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:33.556225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963bb394-d95a-4d40-90ec-74c146bdc69a service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:33.582950 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2194/4364] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:27:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:27:35.551735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ed756-a634-46f4-9494-0d405323d940 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:35.553986 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7c7ed756-a634-46f4-9494-0d405323d940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:35.620329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ed756-a634-46f4-9494-0d405323d940 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:35.654409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26554219-7589-4d96-a778-13972cd3035d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:35.658156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26554219-7589-4d96-a778-13972cd3035d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:35.660362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26554219-7589-4d96-a778-13972cd3035d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:35.661425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26554219-7589-4d96-a778-13972cd3035d admin admin] PATH_INFO: `/v3/projects/dbfccb8c7dd548d89a6bd79f2e4a7a80` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:35.667298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26554219-7589-4d96-a778-13972cd3035d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbfccb8c7dd548d89a6bd79f2e4a7a80)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:35.678803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26554219-7589-4d96-a778-13972cd3035d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:35.845116 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:35.884175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-26554219-7589-4d96-a778-13972cd3035d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbfccb8c7dd548d89a6bd79f2e4a7a80', 'request_id': 'req-26554219-7589-4d96-a778-13972cd3035d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:35.911472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-26554219-7589-4d96-a778-13972cd3035d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbfccb8c7dd548d89a6bd79f2e4a7a80', 'request_id': 'req-26554219-7589-4d96-a778-13972cd3035d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:35.921140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-26554219-7589-4d96-a778-13972cd3035d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbfccb8c7dd548d89a6bd79f2e4a7a80', 'request_id': 'req-26554219-7589-4d96-a778-13972cd3035d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:35.987403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-26554219-7589-4d96-a778-13972cd3035d admin admin] The token cache is being invalidate because project dbfccb8c7dd548d89a6bd79f2e4a7a80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:27:35.987403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-26554219-7589-4d96-a778-13972cd3035d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:35.991003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-26554219-7589-4d96-a778-13972cd3035d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:36.001483 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2171/4365] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:35 2022] DELETE /identity/v3/projects/dbfccb8c7dd548d89a6bd79f2e4a7a80 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:36.010396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ac4c6-9a6c-4fdf-a7e7-eba2c609bb11 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:36.011840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ac4c6-9a6c-4fdf-a7e7-eba2c609bb11 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:36.012723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ac4c6-9a6c-4fdf-a7e7-eba2c609bb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:36.060080 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-202ac4c6-9a6c-4fdf-a7e7-eba2c609bb11 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:36.061982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-202ac4c6-9a6c-4fdf-a7e7-eba2c609bb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:36.323093 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2195/4366] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:36.325766 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1509f89-756b-4bc8-b753-42da0c1c90f8 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:36.326501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1509f89-756b-4bc8-b753-42da0c1c90f8 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:36.327016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1509f89-756b-4bc8-b753-42da0c1c90f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:36.368380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b1509f89-756b-4bc8-b753-42da0c1c90f8 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:36.371122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b1509f89-756b-4bc8-b753-42da0c1c90f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:36.390780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ac4c6-9a6c-4fdf-a7e7-eba2c609bb11 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:36.393117 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2172/4367] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:36.408015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ac4c6-9a6c-4fdf-a7e7-eba2c609bb11 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:36.415780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982142f-2b1c-4d51-a62f-25a8adf9e2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:36.417144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982142f-2b1c-4d51-a62f-25a8adf9e2ff admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:36.418293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982142f-2b1c-4d51-a62f-25a8adf9e2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:36.418869 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982142f-2b1c-4d51-a62f-25a8adf9e2ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:36.421078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3982142f-2b1c-4d51-a62f-25a8adf9e2ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:27:36.422294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3982142f-2b1c-4d51-a62f-25a8adf9e2ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:36.424707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3982142f-2b1c-4d51-a62f-25a8adf9e2ff admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:36.450798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1509f89-756b-4bc8-b753-42da0c1c90f8 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:36.458382 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2196/4368] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:27:36.472637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1509f89-756b-4bc8-b753-42da0c1c90f8 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:36.519619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0bbb5-58d4-4937-bf7f-86a9a4723f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:36.522661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0bbb5-58d4-4937-bf7f-86a9a4723f56 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:36.523207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0bbb5-58d4-4937-bf7f-86a9a4723f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:36.527161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0bbb5-58d4-4937-bf7f-86a9a4723f56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:36.528795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0bbb5-58d4-4937-bf7f-86a9a4723f56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:36.552801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0bbb5-58d4-4937-bf7f-86a9a4723f56 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:36.735030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982142f-2b1c-4d51-a62f-25a8adf9e2ff admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:36.744215 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2173/4369] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:27:36 2022] POST /identity/v3/projects => generated 397 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:27:36.761311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982142f-2b1c-4d51-a62f-25a8adf9e2ff admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:37.104431 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:37.138270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58adcd4-7173-42ad-a573-e0bee76f89c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:37.138971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58adcd4-7173-42ad-a573-e0bee76f89c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:37.139183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58adcd4-7173-42ad-a573-e0bee76f89c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:37.139460 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58adcd4-7173-42ad-a573-e0bee76f89c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:37.141198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58adcd4-7173-42ad-a573-e0bee76f89c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:37.143145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58adcd4-7173-42ad-a573-e0bee76f89c9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:37.226341 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2197/4370] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:27:36 2022] POST /identity/v3/users => generated 299 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:37.233159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0bbb5-58d4-4937-bf7f-86a9a4723f56 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:37.278976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0bbb5-58d4-4937-bf7f-86a9a4723f56 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:37.304297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af63c0-c4e9-43ef-acc3-8277f4aad536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:37.306509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af63c0-c4e9-43ef-acc3-8277f4aad536 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:37.310440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af63c0-c4e9-43ef-acc3-8277f4aad536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:37.310758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af63c0-c4e9-43ef-acc3-8277f4aad536 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:37.316020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af63c0-c4e9-43ef-acc3-8277f4aad536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:37.326566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af63c0-c4e9-43ef-acc3-8277f4aad536 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:37.379515 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2174/4371] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:37.391647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58adcd4-7173-42ad-a573-e0bee76f89c9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:37.425801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58adcd4-7173-42ad-a573-e0bee76f89c9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:37.447381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518d60c-9021-4d7f-9c31-4a9634960f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:37.451551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518d60c-9021-4d7f-9c31-4a9634960f85 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:37.452452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518d60c-9021-4d7f-9c31-4a9634960f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:37.454859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518d60c-9021-4d7f-9c31-4a9634960f85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:37.456896 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518d60c-9021-4d7f-9c31-4a9634960f85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:37.463025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518d60c-9021-4d7f-9c31-4a9634960f85 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:37.559312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af63c0-c4e9-43ef-acc3-8277f4aad536 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:37.559940 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2198/4372] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:37.578081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af63c0-c4e9-43ef-acc3-8277f4aad536 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:37.594870 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb865b-7aa3-461b-8473-31ce6316cfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:37.596012 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb865b-7aa3-461b-8473-31ce6316cfe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:37.596514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb865b-7aa3-461b-8473-31ce6316cfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:37.597006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb865b-7aa3-461b-8473-31ce6316cfe6 admin admin] PATH_INFO: `/v3/projects/d5fd4266d58342919c303da9f76d55bb/users/af9ab9e997454898b8d1b5945deeec02/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:37.654579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb865b-7aa3-461b-8473-31ce6316cfe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5fd4266d58342919c303da9f76d55bb, user_id=af9ab9e997454898b8d1b5945deeec02, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:37.657742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb865b-7aa3-461b-8473-31ce6316cfe6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:37.689123 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2175/4373] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:27:37 2022] PUT /identity/v3/projects/d5fd4266d58342919c303da9f76d55bb/users/af9ab9e997454898b8d1b5945deeec02/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:37.706691 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5922d-98d5-4746-886f-c7b4a4af4cfc None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:37.707120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5922d-98d5-4746-886f-c7b4a4af4cfc None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:37.707321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5922d-98d5-4746-886f-c7b4a4af4cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:37.793677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b4c5922d-98d5-4746-886f-c7b4a4af4cfc None None] MFA Rules not processed for user `af9ab9e997454898b8d1b5945deeec02`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:37.799028 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b4c5922d-98d5-4746-886f-c7b4a4af4cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:38.052250 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2199/4374] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:37 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:38.063507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d1e52-48f2-4722-9565-d6f8da65313d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:38.065289 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d1e52-48f2-4722-9565-d6f8da65313d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:38.065811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d1e52-48f2-4722-9565-d6f8da65313d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:38.125713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-241d1e52-48f2-4722-9565-d6f8da65313d None None] MFA Rules not processed for user `af9ab9e997454898b8d1b5945deeec02`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:38.127445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-241d1e52-48f2-4722-9565-d6f8da65313d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:38.135578 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2176/4375] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:38 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:38.665771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5922d-98d5-4746-886f-c7b4a4af4cfc None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:38.667539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b4c5922d-98d5-4746-886f-c7b4a4af4cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:39.009053 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5922d-98d5-4746-886f-c7b4a4af4cfc None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:39.038418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e7c10-660d-482e-aed4-75b31390ca44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:39.039221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e7c10-660d-482e-aed4-75b31390ca44 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:39.039611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e7c10-660d-482e-aed4-75b31390ca44 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:39.039743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e7c10-660d-482e-aed4-75b31390ca44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:39.084892 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e7c10-660d-482e-aed4-75b31390ca44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:39.087574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e7c10-660d-482e-aed4-75b31390ca44 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:39.129879 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2200/4376] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:38 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:39.192528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68021155-be59-4fdb-80fa-6c99a304fa43 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:39.193156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68021155-be59-4fdb-80fa-6c99a304fa43 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:39.193368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68021155-be59-4fdb-80fa-6c99a304fa43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:39.233408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-68021155-be59-4fdb-80fa-6c99a304fa43 None None] MFA Rules not processed for user `af9ab9e997454898b8d1b5945deeec02`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:39.246062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-68021155-be59-4fdb-80fa-6c99a304fa43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:39.294094 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2177/4377] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:39 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:39.850372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e5fc1-e94c-4a61-8bf5-048e5715a240 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:39.851286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e5fc1-e94c-4a61-8bf5-048e5715a240 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:39.851761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e5fc1-e94c-4a61-8bf5-048e5715a240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:39.886918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d52e5fc1-e94c-4a61-8bf5-048e5715a240 None None] MFA Rules not processed for user `af9ab9e997454898b8d1b5945deeec02`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:39.896165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d52e5fc1-e94c-4a61-8bf5-048e5715a240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:39.918924 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2201/4378] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:39 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:40.497806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd5328-4b5e-4502-9ff2-7322209086d8 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:40.498781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd5328-4b5e-4502-9ff2-7322209086d8 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:40.500235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd5328-4b5e-4502-9ff2-7322209086d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:40.534976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3bcd5328-4b5e-4502-9ff2-7322209086d8 None None] MFA Rules not processed for user `af9ab9e997454898b8d1b5945deeec02`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:40.536811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3bcd5328-4b5e-4502-9ff2-7322209086d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:40.562911 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2178/4379] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:40 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:40.676394 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044e3ce-c56e-4e7b-a5f0-eb8047b85555 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:40.676748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044e3ce-c56e-4e7b-a5f0-eb8047b85555 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:40.677127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044e3ce-c56e-4e7b-a5f0-eb8047b85555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:40.711259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1044e3ce-c56e-4e7b-a5f0-eb8047b85555 None None] MFA Rules not processed for user `af9ab9e997454898b8d1b5945deeec02`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:40.714689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1044e3ce-c56e-4e7b-a5f0-eb8047b85555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:40.730308 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2202/4380] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:40 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:40.766244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd5328-4b5e-4502-9ff2-7322209086d8 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:40.984714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd5328-4b5e-4502-9ff2-7322209086d8 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:41.001046 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9f2fe-2adf-4f58-a2b6-2f662945922e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:41.001726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9f2fe-2adf-4f58-a2b6-2f662945922e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:41.002006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9f2fe-2adf-4f58-a2b6-2f662945922e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:41.002282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9f2fe-2adf-4f58-a2b6-2f662945922e admin admin] PATH_INFO: `/v3/users/af9ab9e997454898b8d1b5945deeec02` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:41.004771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9f2fe-2adf-4f58-a2b6-2f662945922e admin admin] RBAC: Authorizing `identity:delete_user(user_id=af9ab9e997454898b8d1b5945deeec02)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:41.006753 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9f2fe-2adf-4f58-a2b6-2f662945922e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:41.122954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4eb9f2fe-2adf-4f58-a2b6-2f662945922e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af9ab9e997454898b8d1b5945deeec02'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:41.126749 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:41.142055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4eb9f2fe-2adf-4f58-a2b6-2f662945922e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af9ab9e997454898b8d1b5945deeec02'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:41.165744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4eb9f2fe-2adf-4f58-a2b6-2f662945922e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af9ab9e997454898b8d1b5945deeec02'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:41.166745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4eb9f2fe-2adf-4f58-a2b6-2f662945922e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af9ab9e997454898b8d1b5945deeec02'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:41.178763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4eb9f2fe-2adf-4f58-a2b6-2f662945922e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af9ab9e997454898b8d1b5945deeec02'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:41.186313 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2179/4381] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:27:40 2022] DELETE /identity/v3/users/af9ab9e997454898b8d1b5945deeec02 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:41.190560 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b21745-054e-4a84-8d49-6e064c099471 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:41.191055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b21745-054e-4a84-8d49-6e064c099471 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:41.191176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b21745-054e-4a84-8d49-6e064c099471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:41.222983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-70b21745-054e-4a84-8d49-6e064c099471 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:41.225055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-70b21745-054e-4a84-8d49-6e064c099471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:41.291614 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:41.345042 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2203/4382] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:41.411853 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9f2fe-2adf-4f58-a2b6-2f662945922e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:41.414797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4eb9f2fe-2adf-4f58-a2b6-2f662945922e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:41.586982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9f2fe-2adf-4f58-a2b6-2f662945922e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:41.592202 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c714f-9d19-4f41-9e6e-626833167dcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:41.594257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c714f-9d19-4f41-9e6e-626833167dcd service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:41.594733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c714f-9d19-4f41-9e6e-626833167dcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:41.595315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c714f-9d19-4f41-9e6e-626833167dcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:41.621263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c714f-9d19-4f41-9e6e-626833167dcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:41.622760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c714f-9d19-4f41-9e6e-626833167dcd service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:41.656279 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2180/4383] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:44.039511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b21745-054e-4a84-8d49-6e064c099471 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:44.042231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-70b21745-054e-4a84-8d49-6e064c099471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:44.058107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b21745-054e-4a84-8d49-6e064c099471 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:44.064850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d68c4-ee69-4374-ab7e-76351750b24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:44.066117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d68c4-ee69-4374-ab7e-76351750b24b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:44.066573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d68c4-ee69-4374-ab7e-76351750b24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:44.067017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d68c4-ee69-4374-ab7e-76351750b24b admin admin] PATH_INFO: `/v3/projects/d5fd4266d58342919c303da9f76d55bb` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:44.078167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d68c4-ee69-4374-ab7e-76351750b24b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5fd4266d58342919c303da9f76d55bb)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:44.080375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d68c4-ee69-4374-ab7e-76351750b24b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:44.261954 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-143d68c4-ee69-4374-ab7e-76351750b24b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5fd4266d58342919c303da9f76d55bb', 'request_id': 'req-143d68c4-ee69-4374-ab7e-76351750b24b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:44.270670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-143d68c4-ee69-4374-ab7e-76351750b24b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5fd4266d58342919c303da9f76d55bb', 'request_id': 'req-143d68c4-ee69-4374-ab7e-76351750b24b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:44.278331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-143d68c4-ee69-4374-ab7e-76351750b24b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5fd4266d58342919c303da9f76d55bb', 'request_id': 'req-143d68c4-ee69-4374-ab7e-76351750b24b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:44.302780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-143d68c4-ee69-4374-ab7e-76351750b24b admin admin] The token cache is being invalidate because project d5fd4266d58342919c303da9f76d55bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:27:44.303122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-143d68c4-ee69-4374-ab7e-76351750b24b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:44.304313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-143d68c4-ee69-4374-ab7e-76351750b24b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:44.307496 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2204/4384] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:44 2022] DELETE /identity/v3/projects/d5fd4266d58342919c303da9f76d55bb => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:44.313721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f4135-cd31-44b1-840b-f36fa12491b2 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:44.314225 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f4135-cd31-44b1-840b-f36fa12491b2 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:44.314337 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f4135-cd31-44b1-840b-f36fa12491b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:44.353236 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-5f3f4135-cd31-44b1-840b-f36fa12491b2 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:44.355287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5f3f4135-cd31-44b1-840b-f36fa12491b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:44.502011 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2181/4385] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:44.582483 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5a2e4-f00d-4a50-89f1-805eeb83ed6c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:44.582763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5a2e4-f00d-4a50-89f1-805eeb83ed6c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:44.583211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5a2e4-f00d-4a50-89f1-805eeb83ed6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:44.625942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-7db5a2e4-f00d-4a50-89f1-805eeb83ed6c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:44.627472 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7db5a2e4-f00d-4a50-89f1-805eeb83ed6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:44.656591 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2205/4386] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:44.660356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f4135-cd31-44b1-840b-f36fa12491b2 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:44.682881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f4135-cd31-44b1-840b-f36fa12491b2 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:44.689238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48ac03-6e03-4fa0-af05-8a79f6579eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:44.690476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48ac03-6e03-4fa0-af05-8a79f6579eca admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:44.691196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48ac03-6e03-4fa0-af05-8a79f6579eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:44.691874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48ac03-6e03-4fa0-af05-8a79f6579eca admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:44.693287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48ac03-6e03-4fa0-af05-8a79f6579eca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:27:44.693846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48ac03-6e03-4fa0-af05-8a79f6579eca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:44.696214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad48ac03-6e03-4fa0-af05-8a79f6579eca admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:44.742616 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2182/4387] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:27:44.747060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5a2e4-f00d-4a50-89f1-805eeb83ed6c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:44.762810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5a2e4-f00d-4a50-89f1-805eeb83ed6c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:44.769554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9314c-bf51-4d88-a649-d21af9ae4b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:44.770583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9314c-bf51-4d88-a649-d21af9ae4b7c admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:44.771107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9314c-bf51-4d88-a649-d21af9ae4b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:44.771629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9314c-bf51-4d88-a649-d21af9ae4b7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:44.773242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9314c-bf51-4d88-a649-d21af9ae4b7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:44.776464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9314c-bf51-4d88-a649-d21af9ae4b7c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:44.878522 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2206/4388] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:27:44 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:44.880671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48ac03-6e03-4fa0-af05-8a79f6579eca admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:44.899905 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48ac03-6e03-4fa0-af05-8a79f6579eca admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:44.984599 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:45.005256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3155c6-c4e1-4dcb-96f9-83db643788b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:45.010407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3155c6-c4e1-4dcb-96f9-83db643788b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:45.011015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3155c6-c4e1-4dcb-96f9-83db643788b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:45.011414 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3155c6-c4e1-4dcb-96f9-83db643788b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:45.013002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3155c6-c4e1-4dcb-96f9-83db643788b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:45.016696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3155c6-c4e1-4dcb-96f9-83db643788b2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:45.083710 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2183/4389] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:27:44 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:45.085217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9314c-bf51-4d88-a649-d21af9ae4b7c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:45.124507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9314c-bf51-4d88-a649-d21af9ae4b7c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:45.145412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c40a4b-e8fa-4ab1-a02e-c63c51975a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:45.150246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c40a4b-e8fa-4ab1-a02e-c63c51975a39 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:45.152801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c40a4b-e8fa-4ab1-a02e-c63c51975a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:45.153287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c40a4b-e8fa-4ab1-a02e-c63c51975a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:45.159078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c40a4b-e8fa-4ab1-a02e-c63c51975a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:45.169923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c40a4b-e8fa-4ab1-a02e-c63c51975a39 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:45.194994 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2207/4390] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:45.199517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3155c6-c4e1-4dcb-96f9-83db643788b2 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:45.237517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3155c6-c4e1-4dcb-96f9-83db643788b2 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:45.266762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997be30-db21-450d-a32c-609e5d41e7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:45.267400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997be30-db21-450d-a32c-609e5d41e7cc admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:45.267697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997be30-db21-450d-a32c-609e5d41e7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:45.268012 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997be30-db21-450d-a32c-609e5d41e7cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:45.268848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5997be30-db21-450d-a32c-609e5d41e7cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:45.270466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5997be30-db21-450d-a32c-609e5d41e7cc admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:45.303853 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2184/4391] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:45.307828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c40a4b-e8fa-4ab1-a02e-c63c51975a39 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:45.324113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c40a4b-e8fa-4ab1-a02e-c63c51975a39 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:45.339589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b2ac9-1705-4fde-993a-ec511a322336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:45.340722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b2ac9-1705-4fde-993a-ec511a322336 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:45.342197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b2ac9-1705-4fde-993a-ec511a322336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:45.343302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b2ac9-1705-4fde-993a-ec511a322336 admin admin] PATH_INFO: `/v3/projects/d8face435f3549b5adbadf2f94707712/users/845cd61b22924fd3a915186a6093ac12/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:45.386873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b2ac9-1705-4fde-993a-ec511a322336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8face435f3549b5adbadf2f94707712, user_id=845cd61b22924fd3a915186a6093ac12, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:45.392601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b2ac9-1705-4fde-993a-ec511a322336 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:45.421663 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2208/4392] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:27:45 2022] PUT /identity/v3/projects/d8face435f3549b5adbadf2f94707712/users/845cd61b22924fd3a915186a6093ac12/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:45.428202 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957e08f-b4ff-457d-82e8-5bfc8233c8a9 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:45.428614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957e08f-b4ff-457d-82e8-5bfc8233c8a9 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:45.428731 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957e08f-b4ff-457d-82e8-5bfc8233c8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:45.471670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d957e08f-b4ff-457d-82e8-5bfc8233c8a9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:45.475118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d957e08f-b4ff-457d-82e8-5bfc8233c8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:45.662629 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2185/4393] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:27:45.674531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b2ac9-1705-4fde-993a-ec511a322336 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:45.676341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-106b2ac9-1705-4fde-993a-ec511a322336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:45.828681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b2ac9-1705-4fde-993a-ec511a322336 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:45.853751 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6eefc-3a3c-49e0-8cc2-d6ccdd27f29d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:45.854628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6eefc-3a3c-49e0-8cc2-d6ccdd27f29d service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:45.861140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6eefc-3a3c-49e0-8cc2-d6ccdd27f29d service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:45.861538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6eefc-3a3c-49e0-8cc2-d6ccdd27f29d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:45.898392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6eefc-3a3c-49e0-8cc2-d6ccdd27f29d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:45.900057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6eefc-3a3c-49e0-8cc2-d6ccdd27f29d service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:45.908526 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:45.924288 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2209/4394] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:46.449428 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957e08f-b4ff-457d-82e8-5bfc8233c8a9 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:46.451585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d957e08f-b4ff-457d-82e8-5bfc8233c8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:46.473099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957e08f-b4ff-457d-82e8-5bfc8233c8a9 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:46.479147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045151c-8d99-4fc1-a449-1d51f0e7130f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:46.479966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045151c-8d99-4fc1-a449-1d51f0e7130f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:46.480491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045151c-8d99-4fc1-a449-1d51f0e7130f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:46.480988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045151c-8d99-4fc1-a449-1d51f0e7130f admin admin] PATH_INFO: `/v3/users/6eaade0fc02945fda550254c91fa449d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:46.482146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045151c-8d99-4fc1-a449-1d51f0e7130f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eaade0fc02945fda550254c91fa449d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:46.484150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045151c-8d99-4fc1-a449-1d51f0e7130f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:46.552252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a045151c-8d99-4fc1-a449-1d51f0e7130f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eaade0fc02945fda550254c91fa449d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:46.561003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a045151c-8d99-4fc1-a449-1d51f0e7130f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eaade0fc02945fda550254c91fa449d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:46.577561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a045151c-8d99-4fc1-a449-1d51f0e7130f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eaade0fc02945fda550254c91fa449d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:46.578739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a045151c-8d99-4fc1-a449-1d51f0e7130f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eaade0fc02945fda550254c91fa449d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:46.590663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a045151c-8d99-4fc1-a449-1d51f0e7130f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eaade0fc02945fda550254c91fa449d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:46.599479 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2186/4395] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:27:46 2022] DELETE /identity/v3/users/6eaade0fc02945fda550254c91fa449d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:46.603737 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d1cd2-b3af-435f-bc9d-679f6e0de491 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:46.605268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d1cd2-b3af-435f-bc9d-679f6e0de491 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:46.605268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d1cd2-b3af-435f-bc9d-679f6e0de491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:46.643489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-775d1cd2-b3af-435f-bc9d-679f6e0de491 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:46.644768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-775d1cd2-b3af-435f-bc9d-679f6e0de491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:46.753128 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2210/4396] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:46.779761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045151c-8d99-4fc1-a449-1d51f0e7130f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:46.782568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a045151c-8d99-4fc1-a449-1d51f0e7130f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:46.910982 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:46.940745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045151c-8d99-4fc1-a449-1d51f0e7130f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:46.952698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95253991-9bc7-4eae-b9c1-51028616ea62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:46.954132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95253991-9bc7-4eae-b9c1-51028616ea62 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:46.955227 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95253991-9bc7-4eae-b9c1-51028616ea62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:46.956012 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95253991-9bc7-4eae-b9c1-51028616ea62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:46.996424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95253991-9bc7-4eae-b9c1-51028616ea62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:46.998533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95253991-9bc7-4eae-b9c1-51028616ea62 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:47.019440 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2187/4397] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:47.361399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d1cd2-b3af-435f-bc9d-679f6e0de491 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:47.363946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-775d1cd2-b3af-435f-bc9d-679f6e0de491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:47.409258 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d1cd2-b3af-435f-bc9d-679f6e0de491 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:47.423990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482cd27-a323-43c3-b376-4e05a1a529c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:47.426091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482cd27-a323-43c3-b376-4e05a1a529c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:47.429571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482cd27-a323-43c3-b376-4e05a1a529c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:47.430816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482cd27-a323-43c3-b376-4e05a1a529c4 admin admin] PATH_INFO: `/v3/projects/d9754c8c80514c1499a078397c622ad0` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:47.433429 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482cd27-a323-43c3-b376-4e05a1a529c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9754c8c80514c1499a078397c622ad0)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:47.458225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482cd27-a323-43c3-b376-4e05a1a529c4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:47.560543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b482cd27-a323-43c3-b376-4e05a1a529c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9754c8c80514c1499a078397c622ad0', 'request_id': 'req-b482cd27-a323-43c3-b376-4e05a1a529c4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:47.567744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b482cd27-a323-43c3-b376-4e05a1a529c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9754c8c80514c1499a078397c622ad0', 'request_id': 'req-b482cd27-a323-43c3-b376-4e05a1a529c4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:47.575538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b482cd27-a323-43c3-b376-4e05a1a529c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9754c8c80514c1499a078397c622ad0', 'request_id': 'req-b482cd27-a323-43c3-b376-4e05a1a529c4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:47.601986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b482cd27-a323-43c3-b376-4e05a1a529c4 admin admin] The token cache is being invalidate because project d9754c8c80514c1499a078397c622ad0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:27:47.602371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b482cd27-a323-43c3-b376-4e05a1a529c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:47.603229 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b482cd27-a323-43c3-b376-4e05a1a529c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:27:47.605792 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2211/4398] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:27:47 2022] DELETE /identity/v3/projects/d9754c8c80514c1499a078397c622ad0 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:47.610981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a644ece-bcc1-435b-b163-d117fe6ffdf0 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:47.611545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a644ece-bcc1-435b-b163-d117fe6ffdf0 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:47.611545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a644ece-bcc1-435b-b163-d117fe6ffdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:47.664964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0a644ece-bcc1-435b-b163-d117fe6ffdf0 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:47.664964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0a644ece-bcc1-435b-b163-d117fe6ffdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:47.761128 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2188/4399] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:47.762248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242a15f-54e9-4995-873f-344079fcadcc None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:47.762537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242a15f-54e9-4995-873f-344079fcadcc None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:47.762813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242a15f-54e9-4995-873f-344079fcadcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:47.805058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3242a15f-54e9-4995-873f-344079fcadcc None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:47.810075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3242a15f-54e9-4995-873f-344079fcadcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:47.837750 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2212/4400] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:27:47.843656 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a644ece-bcc1-435b-b163-d117fe6ffdf0 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:47.859479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a644ece-bcc1-435b-b163-d117fe6ffdf0 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:47.869854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afbf50-24b9-4363-8378-9c0c21e67cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:47.870800 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afbf50-24b9-4363-8378-9c0c21e67cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:47.871281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afbf50-24b9-4363-8378-9c0c21e67cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:47.871941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afbf50-24b9-4363-8378-9c0c21e67cf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:47.872816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78afbf50-24b9-4363-8378-9c0c21e67cf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:27:47.873344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78afbf50-24b9-4363-8378-9c0c21e67cf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:47.880195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78afbf50-24b9-4363-8378-9c0c21e67cf5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:47.913053 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2189/4401] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:27:47.917714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242a15f-54e9-4995-873f-344079fcadcc None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:47.954736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242a15f-54e9-4995-873f-344079fcadcc None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:47.967399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc84cd0-c0c7-426a-9d87-717992fe3743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:47.968092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc84cd0-c0c7-426a-9d87-717992fe3743 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:47.968558 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc84cd0-c0c7-426a-9d87-717992fe3743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:47.969013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc84cd0-c0c7-426a-9d87-717992fe3743 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:47.969815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc84cd0-c0c7-426a-9d87-717992fe3743 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:47.975172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc84cd0-c0c7-426a-9d87-717992fe3743 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:48.037215 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2213/4402] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:27:47 2022] POST /identity/v3/projects => generated 369 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:48.041088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afbf50-24b9-4363-8378-9c0c21e67cf5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:48.057280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afbf50-24b9-4363-8378-9c0c21e67cf5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:48.226440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d0676-6e7c-44fe-86ad-aa44ee40ca73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:48.238575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d0676-6e7c-44fe-86ad-aa44ee40ca73 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:48.239028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d0676-6e7c-44fe-86ad-aa44ee40ca73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:48.239591 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d0676-6e7c-44fe-86ad-aa44ee40ca73 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:48.244583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d0676-6e7c-44fe-86ad-aa44ee40ca73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:48.252695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d0676-6e7c-44fe-86ad-aa44ee40ca73 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:48.356828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc84cd0-c0c7-426a-9d87-717992fe3743 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:48.359717 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2190/4403] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:27:48 2022] POST /identity/v3/users => generated 285 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:27:48.392875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc84cd0-c0c7-426a-9d87-717992fe3743 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:48.408633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f564160-30b0-453f-bb8f-3a6d4367cd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:48.409703 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f564160-30b0-453f-bb8f-3a6d4367cd6a admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:48.409992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f564160-30b0-453f-bb8f-3a6d4367cd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:48.410903 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f564160-30b0-453f-bb8f-3a6d4367cd6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:48.411927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f564160-30b0-453f-bb8f-3a6d4367cd6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:48.414347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f564160-30b0-453f-bb8f-3a6d4367cd6a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:48.436691 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2214/4404] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:27:48.444792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d0676-6e7c-44fe-86ad-aa44ee40ca73 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:48.461672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d0676-6e7c-44fe-86ad-aa44ee40ca73 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:48.471221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e85e5a-57bb-44ac-bdb2-b608d5fff275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:48.472958 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e85e5a-57bb-44ac-bdb2-b608d5fff275 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:48.473417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e85e5a-57bb-44ac-bdb2-b608d5fff275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:48.473680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e85e5a-57bb-44ac-bdb2-b608d5fff275 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:48.474357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e85e5a-57bb-44ac-bdb2-b608d5fff275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:48.476199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e85e5a-57bb-44ac-bdb2-b608d5fff275 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:48.494683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f564160-30b0-453f-bb8f-3a6d4367cd6a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:48.500359 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2191/4405] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:27:48.507095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f564160-30b0-453f-bb8f-3a6d4367cd6a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:48.513009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0c3d2-aaa6-4dd8-a2ea-0f3e07dfef03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:48.514420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0c3d2-aaa6-4dd8-a2ea-0f3e07dfef03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:48.514811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0c3d2-aaa6-4dd8-a2ea-0f3e07dfef03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:48.515089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0c3d2-aaa6-4dd8-a2ea-0f3e07dfef03 admin admin] PATH_INFO: `/v3/projects/2c0cacea92894660ad2e962703818605/users/7469bd15acf54016877551b6514de3a8/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:48.538569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0c3d2-aaa6-4dd8-a2ea-0f3e07dfef03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c0cacea92894660ad2e962703818605, user_id=7469bd15acf54016877551b6514de3a8, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:48.544230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0c3d2-aaa6-4dd8-a2ea-0f3e07dfef03 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:48.593088 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2215/4406] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:27:48 2022] PUT /identity/v3/projects/2c0cacea92894660ad2e962703818605/users/7469bd15acf54016877551b6514de3a8/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:27:48.608406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8525b2-bd8a-4fd3-bba4-1251db1bfd91 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:48.609207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8525b2-bd8a-4fd3-bba4-1251db1bfd91 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:48.609486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8525b2-bd8a-4fd3-bba4-1251db1bfd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:48.684134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-eb8525b2-bd8a-4fd3-bba4-1251db1bfd91 None None] MFA Rules not processed for user `7469bd15acf54016877551b6514de3a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:48.685544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-eb8525b2-bd8a-4fd3-bba4-1251db1bfd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:48.691452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893b425-7ccd-4956-b1c6-1dc43f4e5d60 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:48.692055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893b425-7ccd-4956-b1c6-1dc43f4e5d60 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:48.692055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893b425-7ccd-4956-b1c6-1dc43f4e5d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:48.731605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3893b425-7ccd-4956-b1c6-1dc43f4e5d60 None None] MFA Rules not processed for user `8a2c261b4e794705a8725b3b7126bd73`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:48.733375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3893b425-7ccd-4956-b1c6-1dc43f4e5d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:48.755081 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:48.764117 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:48.789819 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2192/4407] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:48.819209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8525b2-bd8a-4fd3-bba4-1251db1bfd91 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:48.823327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-eb8525b2-bd8a-4fd3-bba4-1251db1bfd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:48.847064 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2216/4408] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:27:48.935665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8525b2-bd8a-4fd3-bba4-1251db1bfd91 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:48.940876 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433fd98a-4574-489c-8f8b-e678493385e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:48.941617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fd98a-4574-489c-8f8b-e678493385e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:48.941962 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fd98a-4574-489c-8f8b-e678493385e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:48.942303 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433fd98a-4574-489c-8f8b-e678493385e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:48.966786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433fd98a-4574-489c-8f8b-e678493385e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:48.972742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433fd98a-4574-489c-8f8b-e678493385e4 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:49.005295 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2193/4409] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:27:49.972295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893b425-7ccd-4956-b1c6-1dc43f4e5d60 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:49.974586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3893b425-7ccd-4956-b1c6-1dc43f4e5d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:50.013736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893b425-7ccd-4956-b1c6-1dc43f4e5d60 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:50.021916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027a2a3-9ed6-4c01-9832-3713c8074646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:50.025552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027a2a3-9ed6-4c01-9832-3713c8074646 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:50.026176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027a2a3-9ed6-4c01-9832-3713c8074646 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:50.026672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027a2a3-9ed6-4c01-9832-3713c8074646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:50.032677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b027a2a3-9ed6-4c01-9832-3713c8074646 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:50.063384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027a2a3-9ed6-4c01-9832-3713c8074646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:50.066791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027a2a3-9ed6-4c01-9832-3713c8074646 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:50.090390 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2217/4410] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:54.196421 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14f9fb-3c0e-4109-ae86-ff311cbf9d9c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:54.197849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14f9fb-3c0e-4109-ae86-ff311cbf9d9c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:54.198476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14f9fb-3c0e-4109-ae86-ff311cbf9d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:54.220578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-5e14f9fb-3c0e-4109-ae86-ff311cbf9d9c None None] MFA Rules not processed for user `ef29bd35cca547c39d76c54058d32979`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:54.222385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5e14f9fb-3c0e-4109-ae86-ff311cbf9d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:54.365906 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2194/4411] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:55.524852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d20cb0-a1a2-45ed-a8a7-f88fea7d9397 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:55.526420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d20cb0-a1a2-45ed-a8a7-f88fea7d9397 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:55.526868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d20cb0-a1a2-45ed-a8a7-f88fea7d9397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:55.561629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e1d20cb0-a1a2-45ed-a8a7-f88fea7d9397 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:55.563024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e1d20cb0-a1a2-45ed-a8a7-f88fea7d9397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:55.640127 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2218/4412] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:27:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:55.656555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14f9fb-3c0e-4109-ae86-ff311cbf9d9c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:55.659252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5e14f9fb-3c0e-4109-ae86-ff311cbf9d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:55.752975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14f9fb-3c0e-4109-ae86-ff311cbf9d9c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:55.762375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9ef53-0cae-4a88-bb84-2ce705b6fccb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:55.763040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9ef53-0cae-4a88-bb84-2ce705b6fccb service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:55.763414 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9ef53-0cae-4a88-bb84-2ce705b6fccb service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:55.764747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9ef53-0cae-4a88-bb84-2ce705b6fccb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:55.776082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9ef53-0cae-4a88-bb84-2ce705b6fccb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:55.780648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9ef53-0cae-4a88-bb84-2ce705b6fccb service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:55.796334 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2195/4413] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:27:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:27:56.988361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ddbf5-c73a-4dd8-9742-fef22db71b05 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:56.989218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ddbf5-c73a-4dd8-9742-fef22db71b05 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:56.989678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ddbf5-c73a-4dd8-9742-fef22db71b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:57.064559 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-580ddbf5-c73a-4dd8-9742-fef22db71b05 None None] MFA Rules not processed for user `a50140f86f00487b90d0503d4819234f`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:27:57.066109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-580ddbf5-c73a-4dd8-9742-fef22db71b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:57.228350 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2219/4414] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:27:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:27:57.816169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9ef53-0cae-4a88-bb84-2ce705b6fccb service swift] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:57.818954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7ef9ef53-0cae-4a88-bb84-2ce705b6fccb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:57.890317 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:27:58.136838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9ef53-0cae-4a88-bb84-2ce705b6fccb service swift] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:58.149877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd4769-c978-4d88-95fa-c300dee45a61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:58.150852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd4769-c978-4d88-95fa-c300dee45a61 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:58.151445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd4769-c978-4d88-95fa-c300dee45a61 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:58.151955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd4769-c978-4d88-95fa-c300dee45a61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:58.155455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c0bd4769-c978-4d88-95fa-c300dee45a61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:58.187771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd4769-c978-4d88-95fa-c300dee45a61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:58.190121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd4769-c978-4d88-95fa-c300dee45a61 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:58.215598 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2196/4415] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:27:59.662806 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ddbf5-c73a-4dd8-9742-fef22db71b05 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:27:59.689262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ddbf5-c73a-4dd8-9742-fef22db71b05 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:27:59.695269 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ab194-fd92-4636-81ea-61e4c3a98c6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:27:59.696316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ab194-fd92-4636-81ea-61e4c3a98c6f service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:27:59.696859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ab194-fd92-4636-81ea-61e4c3a98c6f service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:27:59.697434 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ab194-fd92-4636-81ea-61e4c3a98c6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:27:59.700779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-621ab194-fd92-4636-81ea-61e4c3a98c6f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:27:59.720282 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ab194-fd92-4636-81ea-61e4c3a98c6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:27:59.720800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ab194-fd92-4636-81ea-61e4c3a98c6f service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:27:59.736601 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2220/4416] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:27:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:28:03.346130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92260ea-a590-4a75-9410-d26d420d382c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:03.346650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92260ea-a590-4a75-9410-d26d420d382c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:03.347248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92260ea-a590-4a75-9410-d26d420d382c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:03.384254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b92260ea-a590-4a75-9410-d26d420d382c None None] MFA Rules not processed for user `d1f0c01c340940388b440932d51988ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:28:03.385690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b92260ea-a590-4a75-9410-d26d420d382c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:03.480506 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2197/4417] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:28:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:28:03.863556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902171d9-e3a2-4afd-aff5-a6f41af98baf None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:03.864444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902171d9-e3a2-4afd-aff5-a6f41af98baf None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:03.864444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902171d9-e3a2-4afd-aff5-a6f41af98baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:03.968964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-902171d9-e3a2-4afd-aff5-a6f41af98baf None None] MFA Rules not processed for user `845cd61b22924fd3a915186a6093ac12`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:28:03.968964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-902171d9-e3a2-4afd-aff5-a6f41af98baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:04.041352 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:04.100481 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2221/4418] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:28:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:28:04.111091 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197533d-aaab-4828-b91f-cab106722b81 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:04.111653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197533d-aaab-4828-b91f-cab106722b81 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:04.112197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197533d-aaab-4828-b91f-cab106722b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:04.153900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-4197533d-aaab-4828-b91f-cab106722b81 None None] MFA Rules not processed for user `845cd61b22924fd3a915186a6093ac12`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:28:04.159088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4197533d-aaab-4828-b91f-cab106722b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:04.184999 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2198/4419] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:28:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:28:04.737178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902171d9-e3a2-4afd-aff5-a6f41af98baf None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:28:04.738888 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-902171d9-e3a2-4afd-aff5-a6f41af98baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:04.997905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902171d9-e3a2-4afd-aff5-a6f41af98baf None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:28:05.008503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b81c4-6f2f-496a-a7e8-81d6fbc6c5e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:28:05.009469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b81c4-6f2f-496a-a7e8-81d6fbc6c5e4 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:05.010001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b81c4-6f2f-496a-a7e8-81d6fbc6c5e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:05.010478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b81c4-6f2f-496a-a7e8-81d6fbc6c5e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:05.028517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b81c4-6f2f-496a-a7e8-81d6fbc6c5e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:28:05.030855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9b81c4-6f2f-496a-a7e8-81d6fbc6c5e4 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:28:05.105765 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2222/4420] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:28:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:28:14.131269 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=58 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:15.042640 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=57 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:15.705492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197533d-aaab-4828-b91f-cab106722b81 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:28:15.707799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4197533d-aaab-4828-b91f-cab106722b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:15.741385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197533d-aaab-4828-b91f-cab106722b81 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:28:15.749645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62a40c-cb96-4870-92c0-e7878f91c919 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:28:15.750284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62a40c-cb96-4870-92c0-e7878f91c919 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:15.750563 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62a40c-cb96-4870-92c0-e7878f91c919 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:15.750838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62a40c-cb96-4870-92c0-e7878f91c919 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:15.752837 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ef62a40c-cb96-4870-92c0-e7878f91c919 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:15.770496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef62a40c-cb96-4870-92c0-e7878f91c919 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:28:15.772420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef62a40c-cb96-4870-92c0-e7878f91c919 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:28:15.805176 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2199/4421] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:28:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:28:16.034200 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b81c4-6f2f-496a-a7e8-81d6fbc6c5e4 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:28:16.036284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9e9b81c4-6f2f-496a-a7e8-81d6fbc6c5e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:16.071737 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b81c4-6f2f-496a-a7e8-81d6fbc6c5e4 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:28:16.109660 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef28227-d06f-453f-aa01-6c8a41cf53fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:28:16.110369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef28227-d06f-453f-aa01-6c8a41cf53fe service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:16.110886 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef28227-d06f-453f-aa01-6c8a41cf53fe service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:16.111353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef28227-d06f-453f-aa01-6c8a41cf53fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:16.115359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-cef28227-d06f-453f-aa01-6c8a41cf53fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:16.161849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef28227-d06f-453f-aa01-6c8a41cf53fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:28:16.163477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef28227-d06f-453f-aa01-6c8a41cf53fe service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:28:16.202402 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2223/4422] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:28:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:28:25.781142 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:26.183117 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:33.785277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae8ff7-14fb-4a94-8da2-e5b190fcb9cb None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:33.785826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae8ff7-14fb-4a94-8da2-e5b190fcb9cb None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:33.786007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae8ff7-14fb-4a94-8da2-e5b190fcb9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:33.820251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-38ae8ff7-14fb-4a94-8da2-e5b190fcb9cb None None] MFA Rules not processed for user `8a2c261b4e794705a8725b3b7126bd73`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:28:33.821900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-38ae8ff7-14fb-4a94-8da2-e5b190fcb9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:33.830912 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2200/4423] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:28:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:28:37.471145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10d76c-83cc-4b72-9fc7-8065b7cb90cc None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:37.472146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10d76c-83cc-4b72-9fc7-8065b7cb90cc None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:37.472146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10d76c-83cc-4b72-9fc7-8065b7cb90cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:37.498481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-8d10d76c-83cc-4b72-9fc7-8065b7cb90cc None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:28:37.499634 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8d10d76c-83cc-4b72-9fc7-8065b7cb90cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:37.512612 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2224/4424] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:28:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:28:37.565122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae8ff7-14fb-4a94-8da2-e5b190fcb9cb None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:28:37.588066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae8ff7-14fb-4a94-8da2-e5b190fcb9cb None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:28:37.597445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8c750-3c38-41db-9d87-2eb90dd46977 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:28:37.598713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8c750-3c38-41db-9d87-2eb90dd46977 service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:37.599065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8c750-3c38-41db-9d87-2eb90dd46977 service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:37.599592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8c750-3c38-41db-9d87-2eb90dd46977 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:37.625484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8c750-3c38-41db-9d87-2eb90dd46977 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:28:37.628246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8c750-3c38-41db-9d87-2eb90dd46977 service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:28:37.660616 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2201/4425] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:28:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:28:37.967221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba4398-a0bc-44e1-a380-1949abd2b25c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:37.967693 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba4398-a0bc-44e1-a380-1949abd2b25c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:37.968160 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba4398-a0bc-44e1-a380-1949abd2b25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:37.999988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-88ba4398-a0bc-44e1-a380-1949abd2b25c None None] MFA Rules not processed for user `8a2c261b4e794705a8725b3b7126bd73`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:28:38.002219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-88ba4398-a0bc-44e1-a380-1949abd2b25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:38.020205 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2225/4426] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:28:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:28:38.885750 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13766719-227b-42cc-813e-54078ec21f57 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:38.886363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13766719-227b-42cc-813e-54078ec21f57 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:38.886363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13766719-227b-42cc-813e-54078ec21f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:38.939962 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-13766719-227b-42cc-813e-54078ec21f57 None None] MFA Rules not processed for user `d1f0c01c340940388b440932d51988ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:28:38.944231 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-13766719-227b-42cc-813e-54078ec21f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:38.989341 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2202/4427] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:28:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:28:41.865521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c09247-03cb-484b-b72a-ae977520c4c7 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:41.866443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c09247-03cb-484b-b72a-ae977520c4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:41.866961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c09247-03cb-484b-b72a-ae977520c4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:41.909715 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-85c09247-03cb-484b-b72a-ae977520c4c7 None None] MFA Rules not processed for user `8a2c261b4e794705a8725b3b7126bd73`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:28:41.912067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-85c09247-03cb-484b-b72a-ae977520c4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:41.937570 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2226/4428] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:28:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:28:43.275585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cb90b-ff48-4088-b367-f4b28f3a5e1c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:43.276704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cb90b-ff48-4088-b367-f4b28f3a5e1c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:43.277160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7cb90b-ff48-4088-b367-f4b28f3a5e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:43.360069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6e7cb90b-ff48-4088-b367-f4b28f3a5e1c None None] MFA Rules not processed for user `8a2c261b4e794705a8725b3b7126bd73`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:28:43.363758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6e7cb90b-ff48-4088-b367-f4b28f3a5e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:43.385072 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2203/4429] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:28:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:28:45.322174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75721b5-f29e-449c-bcfe-bb969b24379c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:45.322643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75721b5-f29e-449c-bcfe-bb969b24379c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:45.322643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75721b5-f29e-449c-bcfe-bb969b24379c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:45.380660 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c75721b5-f29e-449c-bcfe-bb969b24379c None None] MFA Rules not processed for user `8a2c261b4e794705a8725b3b7126bd73`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:28:45.387977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c75721b5-f29e-449c-bcfe-bb969b24379c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:45.418440 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2227/4430] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:28:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:28:47.528272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab650c-8ab4-4ea7-9f98-220c229de116 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:47.528867 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab650c-8ab4-4ea7-9f98-220c229de116 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:47.528867 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab650c-8ab4-4ea7-9f98-220c229de116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:47.580206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-03ab650c-8ab4-4ea7-9f98-220c229de116 None None] MFA Rules not processed for user `8a2c261b4e794705a8725b3b7126bd73`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:28:47.581701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-03ab650c-8ab4-4ea7-9f98-220c229de116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:47.616387 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2204/4431] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:28:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:28:49.216150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11da6e3-e23d-496a-9fbd-cf66796ddfbd None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:49.216723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11da6e3-e23d-496a-9fbd-cf66796ddfbd None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:49.216918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11da6e3-e23d-496a-9fbd-cf66796ddfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:49.273041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d11da6e3-e23d-496a-9fbd-cf66796ddfbd None None] MFA Rules not processed for user `8a2c261b4e794705a8725b3b7126bd73`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:28:49.274267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d11da6e3-e23d-496a-9fbd-cf66796ddfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:49.301388 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2228/4432] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:28:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:28:50.649079 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a37513-3c4c-40b7-af36-334c4d8d7f0a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:50.650087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a37513-3c4c-40b7-af36-334c4d8d7f0a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:50.650598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a37513-3c4c-40b7-af36-334c4d8d7f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:50.677023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-43a37513-3c4c-40b7-af36-334c4d8d7f0a None None] MFA Rules not processed for user `8a2c261b4e794705a8725b3b7126bd73`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:28:50.678240 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-43a37513-3c4c-40b7-af36-334c4d8d7f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:50.703684 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2205/4433] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:28:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:28:51.899955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bee13-718c-4cb5-a391-c0068824080b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:51.900520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bee13-718c-4cb5-a391-c0068824080b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:51.900520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8bee13-718c-4cb5-a391-c0068824080b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:51.934319 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1b8bee13-718c-4cb5-a391-c0068824080b None None] MFA Rules not processed for user `8a2c261b4e794705a8725b3b7126bd73`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:28:51.935544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1b8bee13-718c-4cb5-a391-c0068824080b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:51.948782 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2229/4434] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:28:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:28:53.766866 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b0d35-16ba-4b29-8ba4-e5e864d05896 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:53.768030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b0d35-16ba-4b29-8ba4-e5e864d05896 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:53.768869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b0d35-16ba-4b29-8ba4-e5e864d05896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:53.817566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1f1b0d35-16ba-4b29-8ba4-e5e864d05896 None None] MFA Rules not processed for user `8a2c261b4e794705a8725b3b7126bd73`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:28:53.821397 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1f1b0d35-16ba-4b29-8ba4-e5e864d05896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:53.849779 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2206/4435] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:28:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:28:57.293304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6544e0c-efac-4645-8fb5-c00bc2e99e37 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:57.294265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6544e0c-efac-4645-8fb5-c00bc2e99e37 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:57.294746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6544e0c-efac-4645-8fb5-c00bc2e99e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:57.325260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f6544e0c-efac-4645-8fb5-c00bc2e99e37 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:28:57.327200 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f6544e0c-efac-4645-8fb5-c00bc2e99e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:57.350304 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2230/4436] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:28:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:28:57.360343 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b0d35-16ba-4b29-8ba4-e5e864d05896 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:28:57.369044 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=25 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:28:57.381854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b0d35-16ba-4b29-8ba4-e5e864d05896 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:28:57.390610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaaddf1-5141-48db-bb19-f6d1931f162b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:28:57.392022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaddf1-5141-48db-bb19-f6d1931f162b service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:57.392490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaddf1-5141-48db-bb19-f6d1931f162b service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:57.393040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaddf1-5141-48db-bb19-f6d1931f162b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:57.412807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaaddf1-5141-48db-bb19-f6d1931f162b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:28:57.417406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaaddf1-5141-48db-bb19-f6d1931f162b service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:28:57.447667 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2207/4437] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:28:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:28:58.492467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945bebc-f9bd-4471-8f47-3d7620da8e1f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:28:58.493337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945bebc-f9bd-4471-8f47-3d7620da8e1f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:28:58.493337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945bebc-f9bd-4471-8f47-3d7620da8e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:28:58.529685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f945bebc-f9bd-4471-8f47-3d7620da8e1f None None] MFA Rules not processed for user `a50140f86f00487b90d0503d4819234f`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:28:58.530947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f945bebc-f9bd-4471-8f47-3d7620da8e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:28:58.539831 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2231/4438] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:28:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:29:00.831409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3c9b5-48fe-4cc2-a84d-5c9d37de4859 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:00.832320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3c9b5-48fe-4cc2-a84d-5c9d37de4859 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:00.832775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3c9b5-48fe-4cc2-a84d-5c9d37de4859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:00.855360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3bb3c9b5-48fe-4cc2-a84d-5c9d37de4859 None None] MFA Rules not processed for user `8a2c261b4e794705a8725b3b7126bd73`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:29:00.856842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3bb3c9b5-48fe-4cc2-a84d-5c9d37de4859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:00.871189 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2208/4439] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:29:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:29:01.669927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6c95a-1aec-4b72-afd8-3780f141a3a8 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:01.670844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6c95a-1aec-4b72-afd8-3780f141a3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:01.671292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6c95a-1aec-4b72-afd8-3780f141a3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:01.699298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6df6c95a-1aec-4b72-afd8-3780f141a3a8 None None] MFA Rules not processed for user `8a2c261b4e794705a8725b3b7126bd73`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:29:01.700886 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6df6c95a-1aec-4b72-afd8-3780f141a3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:01.713381 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2232/4440] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:29:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:29:09.018371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ccb41-44e8-4bcc-9d93-8c44469a101d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:09.019276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ccb41-44e8-4bcc-9d93-8c44469a101d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:09.019821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ccb41-44e8-4bcc-9d93-8c44469a101d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:09.048146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-269ccb41-44e8-4bcc-9d93-8c44469a101d None None] MFA Rules not processed for user `845cd61b22924fd3a915186a6093ac12`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:29:09.049633 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-269ccb41-44e8-4bcc-9d93-8c44469a101d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:09.081707 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2209/4441] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:29:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:29:11.698593 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=27 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:13.750831 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983de39-9b74-4d65-9aad-3aa5ca23ea53 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:13.752008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983de39-9b74-4d65-9aad-3aa5ca23ea53 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:13.752475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983de39-9b74-4d65-9aad-3aa5ca23ea53 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:13.755382 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2233/4442] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:29:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:29:13.764931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fcb1d-94f2-4dc7-90f6-4fe75bbe5ba1 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:13.765422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fcb1d-94f2-4dc7-90f6-4fe75bbe5ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:13.765535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fcb1d-94f2-4dc7-90f6-4fe75bbe5ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:13.828636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-951fcb1d-94f2-4dc7-90f6-4fe75bbe5ba1 None None] MFA Rules not processed for user `b219e01934fa477fbaa053cca586f01b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:29:13.830568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-951fcb1d-94f2-4dc7-90f6-4fe75bbe5ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:13.851187 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2210/4443] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:29:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:29:13.862193 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983de39-9b74-4d65-9aad-3aa5ca23ea53 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:13.902938 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983de39-9b74-4d65-9aad-3aa5ca23ea53 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:13.912523 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a1fc8-4239-4036-b4c2-859fa22eb1eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:13.913434 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a1fc8-4239-4036-b4c2-859fa22eb1eb service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:13.913946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a1fc8-4239-4036-b4c2-859fa22eb1eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:13.914436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a1fc8-4239-4036-b4c2-859fa22eb1eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:13.933527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a1fc8-4239-4036-b4c2-859fa22eb1eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:13.936498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a1fc8-4239-4036-b4c2-859fa22eb1eb service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:13.971846 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2234/4444] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:29:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:29:15.686220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1f460-8c52-464c-8560-7aa84f493bcb None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:15.687069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1f460-8c52-464c-8560-7aa84f493bcb None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:15.687258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1f460-8c52-464c-8560-7aa84f493bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:15.712323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-42d1f460-8c52-464c-8560-7aa84f493bcb None None] MFA Rules not processed for user `8a2c261b4e794705a8725b3b7126bd73`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:29:15.714988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-42d1f460-8c52-464c-8560-7aa84f493bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:15.728572 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2211/4445] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:29:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:29:23.944155 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:24.414979 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a1fc8-4239-4036-b4c2-859fa22eb1eb service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:24.528474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a1fc8-4239-4036-b4c2-859fa22eb1eb service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:24.534208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd6af3-b1c5-4d3d-869e-319075b43ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:24.534958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd6af3-b1c5-4d3d-869e-319075b43ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:24.535300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd6af3-b1c5-4d3d-869e-319075b43ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:24.535636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd6af3-b1c5-4d3d-869e-319075b43ead admin admin] PATH_INFO: `/v3/users/7469bd15acf54016877551b6514de3a8` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:24.536990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd6af3-b1c5-4d3d-869e-319075b43ead admin admin] RBAC: Authorizing `identity:delete_user(user_id=7469bd15acf54016877551b6514de3a8)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:24.539111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd6af3-b1c5-4d3d-869e-319075b43ead admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:24.602755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-24bd6af3-b1c5-4d3d-869e-319075b43ead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7469bd15acf54016877551b6514de3a8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:24.610935 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-24bd6af3-b1c5-4d3d-869e-319075b43ead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7469bd15acf54016877551b6514de3a8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:24.640583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-24bd6af3-b1c5-4d3d-869e-319075b43ead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7469bd15acf54016877551b6514de3a8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:24.641366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-24bd6af3-b1c5-4d3d-869e-319075b43ead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7469bd15acf54016877551b6514de3a8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:24.656999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-24bd6af3-b1c5-4d3d-869e-319075b43ead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7469bd15acf54016877551b6514de3a8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:24.665969 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2235/4446] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:29:24 2022] DELETE /identity/v3/users/7469bd15acf54016877551b6514de3a8 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:29:24.672088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bd371-20cb-47b2-b38f-22fe4d394a90 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:24.674009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bd371-20cb-47b2-b38f-22fe4d394a90 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:24.674488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bd371-20cb-47b2-b38f-22fe4d394a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:24.701607 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c76bd371-20cb-47b2-b38f-22fe4d394a90 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:29:24.703655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c76bd371-20cb-47b2-b38f-22fe4d394a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:24.788136 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2212/4447] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:29:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:29:24.797461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd6af3-b1c5-4d3d-869e-319075b43ead admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:24.800231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-24bd6af3-b1c5-4d3d-869e-319075b43ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:24.929772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd6af3-b1c5-4d3d-869e-319075b43ead admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:24.942185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31eca2-540b-4e54-932e-4d4b2a6115a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:24.942760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31eca2-540b-4e54-932e-4d4b2a6115a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:24.943297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31eca2-540b-4e54-932e-4d4b2a6115a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:24.943871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31eca2-540b-4e54-932e-4d4b2a6115a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:24.967940 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31eca2-540b-4e54-932e-4d4b2a6115a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:24.969144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31eca2-540b-4e54-932e-4d4b2a6115a0 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:25.006366 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2236/4448] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:29:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:29:25.403384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bd371-20cb-47b2-b38f-22fe4d394a90 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:25.405009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c76bd371-20cb-47b2-b38f-22fe4d394a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:25.429559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bd371-20cb-47b2-b38f-22fe4d394a90 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:25.440264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a17f7a-5181-475c-8bbe-34583d678ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:25.441731 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a17f7a-5181-475c-8bbe-34583d678ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:25.443018 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a17f7a-5181-475c-8bbe-34583d678ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:25.443902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a17f7a-5181-475c-8bbe-34583d678ea8 admin admin] PATH_INFO: `/v3/projects/2c0cacea92894660ad2e962703818605` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:25.446660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a17f7a-5181-475c-8bbe-34583d678ea8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c0cacea92894660ad2e962703818605)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:25.456847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a17f7a-5181-475c-8bbe-34583d678ea8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:25.539160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-52a17f7a-5181-475c-8bbe-34583d678ea8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c0cacea92894660ad2e962703818605', 'request_id': 'req-52a17f7a-5181-475c-8bbe-34583d678ea8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:25.551272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-52a17f7a-5181-475c-8bbe-34583d678ea8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c0cacea92894660ad2e962703818605', 'request_id': 'req-52a17f7a-5181-475c-8bbe-34583d678ea8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:25.560755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-52a17f7a-5181-475c-8bbe-34583d678ea8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c0cacea92894660ad2e962703818605', 'request_id': 'req-52a17f7a-5181-475c-8bbe-34583d678ea8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:25.583008 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-52a17f7a-5181-475c-8bbe-34583d678ea8 admin admin] The token cache is being invalidate because project 2c0cacea92894660ad2e962703818605 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:29:25.583452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-52a17f7a-5181-475c-8bbe-34583d678ea8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:25.584210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-52a17f7a-5181-475c-8bbe-34583d678ea8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:25.586060 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2213/4449] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:29:25 2022] DELETE /identity/v3/projects/2c0cacea92894660ad2e962703818605 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:29:25.591154 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5a7c7-cd41-4f59-9278-7d4e62cb3ebe None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:25.591445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5a7c7-cd41-4f59-9278-7d4e62cb3ebe None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:25.592478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5a7c7-cd41-4f59-9278-7d4e62cb3ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:25.651250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-07a5a7c7-cd41-4f59-9278-7d4e62cb3ebe None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:29:25.651908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-07a5a7c7-cd41-4f59-9278-7d4e62cb3ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:25.693400 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:25.766104 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2237/4450] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:29:25.775190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60634306-565e-48c6-a9c4-a77fc96e87eb None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:25.776777 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60634306-565e-48c6-a9c4-a77fc96e87eb None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:25.777252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60634306-565e-48c6-a9c4-a77fc96e87eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:25.814045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-60634306-565e-48c6-a9c4-a77fc96e87eb None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:29:25.815857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-60634306-565e-48c6-a9c4-a77fc96e87eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:25.834189 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2214/4451] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:29:25.835519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5a7c7-cd41-4f59-9278-7d4e62cb3ebe None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:25.849100 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5a7c7-cd41-4f59-9278-7d4e62cb3ebe None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:25.856499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745229d-6628-473c-a6a2-2a27d772246f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:25.857929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745229d-6628-473c-a6a2-2a27d772246f admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:25.858615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745229d-6628-473c-a6a2-2a27d772246f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:25.859279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745229d-6628-473c-a6a2-2a27d772246f admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:25.860364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3745229d-6628-473c-a6a2-2a27d772246f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:29:25.861047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3745229d-6628-473c-a6a2-2a27d772246f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:25.863313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3745229d-6628-473c-a6a2-2a27d772246f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:25.890763 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2238/4452] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:29:25.894884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60634306-565e-48c6-a9c4-a77fc96e87eb None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:25.908818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60634306-565e-48c6-a9c4-a77fc96e87eb None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:25.920850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683dc29-55dd-4835-a366-959aa5ff9681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:25.922589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683dc29-55dd-4835-a366-959aa5ff9681 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:25.923122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683dc29-55dd-4835-a366-959aa5ff9681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:25.924198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683dc29-55dd-4835-a366-959aa5ff9681 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:25.925057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8683dc29-55dd-4835-a366-959aa5ff9681 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:25.926991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8683dc29-55dd-4835-a366-959aa5ff9681 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:25.980815 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2215/4453] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:29:25 2022] POST /identity/v3/projects => generated 357 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:29:25.985411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745229d-6628-473c-a6a2-2a27d772246f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:26.000060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3745229d-6628-473c-a6a2-2a27d772246f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:26.096436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df03d5-b845-443a-a98f-23517c20e986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:26.097678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df03d5-b845-443a-a98f-23517c20e986 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:26.098196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df03d5-b845-443a-a98f-23517c20e986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:26.098702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df03d5-b845-443a-a98f-23517c20e986 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:26.099719 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df03d5-b845-443a-a98f-23517c20e986 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:26.102823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df03d5-b845-443a-a98f-23517c20e986 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:26.154152 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2239/4454] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:29:25 2022] POST /identity/v3/users => generated 279 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:29:26.156227 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683dc29-55dd-4835-a366-959aa5ff9681 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:26.167431 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:26.176109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683dc29-55dd-4835-a366-959aa5ff9681 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:26.183370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824fb407-aea9-4fc8-af20-dbba38a7ea46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:26.184502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fb407-aea9-4fc8-af20-dbba38a7ea46 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:26.185104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fb407-aea9-4fc8-af20-dbba38a7ea46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:26.185692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fb407-aea9-4fc8-af20-dbba38a7ea46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:26.186729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824fb407-aea9-4fc8-af20-dbba38a7ea46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:26.189245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824fb407-aea9-4fc8-af20-dbba38a7ea46 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:26.209565 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2216/4455] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:29:26.210830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df03d5-b845-443a-a98f-23517c20e986 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:26.227752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df03d5-b845-443a-a98f-23517c20e986 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:26.238457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e85545-dd2d-4f18-ae74-efd8e52e27b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:26.239515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e85545-dd2d-4f18-ae74-efd8e52e27b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:26.240099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e85545-dd2d-4f18-ae74-efd8e52e27b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:26.242262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e85545-dd2d-4f18-ae74-efd8e52e27b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:26.246012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e85545-dd2d-4f18-ae74-efd8e52e27b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:26.249386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e85545-dd2d-4f18-ae74-efd8e52e27b1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:26.272751 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2240/4456] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:29:26.277652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824fb407-aea9-4fc8-af20-dbba38a7ea46 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:26.289946 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824fb407-aea9-4fc8-af20-dbba38a7ea46 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:26.297479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3348c-7546-448e-bd31-832c60feb143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:26.298586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3348c-7546-448e-bd31-832c60feb143 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:26.299143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3348c-7546-448e-bd31-832c60feb143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:26.299649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3348c-7546-448e-bd31-832c60feb143 admin admin] PATH_INFO: `/v3/projects/98d9907b8e17409c825da6cf693c15ca/users/6c34ed44a89c49dcb4fe2a2a11da45cd/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:26.320771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3348c-7546-448e-bd31-832c60feb143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d9907b8e17409c825da6cf693c15ca, user_id=6c34ed44a89c49dcb4fe2a2a11da45cd, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:26.324150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3348c-7546-448e-bd31-832c60feb143 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:26.349011 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2217/4457] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:29:26 2022] PUT /identity/v3/projects/98d9907b8e17409c825da6cf693c15ca/users/6c34ed44a89c49dcb4fe2a2a11da45cd/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:29:26.362482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad05c9-17c3-4af5-a35a-3a5f91627526 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:26.362749 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad05c9-17c3-4af5-a35a-3a5f91627526 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:26.363031 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad05c9-17c3-4af5-a35a-3a5f91627526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:26.398283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-26ad05c9-17c3-4af5-a35a-3a5f91627526 None None] MFA Rules not processed for user `6c34ed44a89c49dcb4fe2a2a11da45cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:29:26.399714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-26ad05c9-17c3-4af5-a35a-3a5f91627526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:26.501044 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2241/4458] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:29:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:29:26.511544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3348c-7546-448e-bd31-832c60feb143 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:26.513465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-61e3348c-7546-448e-bd31-832c60feb143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:26.596527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3348c-7546-448e-bd31-832c60feb143 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:26.600631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7c315-e806-49c6-9abc-cac6f788e9c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:26.601374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7c315-e806-49c6-9abc-cac6f788e9c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:26.601759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7c315-e806-49c6-9abc-cac6f788e9c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:26.602165 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7c315-e806-49c6-9abc-cac6f788e9c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:26.612163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7c315-e806-49c6-9abc-cac6f788e9c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:26.613848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7c315-e806-49c6-9abc-cac6f788e9c1 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:26.624255 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2218/4459] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:29:26 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:29:26.944729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad05c9-17c3-4af5-a35a-3a5f91627526 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:26.946787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-26ad05c9-17c3-4af5-a35a-3a5f91627526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:26.987523 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:27.050908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad05c9-17c3-4af5-a35a-3a5f91627526 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:27.058008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955bc5e4-7fad-43db-96ab-812ab9e9eaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:27.058690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bc5e4-7fad-43db-96ab-812ab9e9eaac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:27.058963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bc5e4-7fad-43db-96ab-812ab9e9eaac admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:27.059283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bc5e4-7fad-43db-96ab-812ab9e9eaac admin admin] PATH_INFO: `/v3/users/a50140f86f00487b90d0503d4819234f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:27.061107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955bc5e4-7fad-43db-96ab-812ab9e9eaac admin admin] RBAC: Authorizing `identity:delete_user(user_id=a50140f86f00487b90d0503d4819234f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:27.064121 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955bc5e4-7fad-43db-96ab-812ab9e9eaac admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:27.146017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-955bc5e4-7fad-43db-96ab-812ab9e9eaac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a50140f86f00487b90d0503d4819234f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:27.159765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-955bc5e4-7fad-43db-96ab-812ab9e9eaac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a50140f86f00487b90d0503d4819234f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:27.183269 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-955bc5e4-7fad-43db-96ab-812ab9e9eaac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a50140f86f00487b90d0503d4819234f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:27.184223 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-955bc5e4-7fad-43db-96ab-812ab9e9eaac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a50140f86f00487b90d0503d4819234f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:27.201295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-955bc5e4-7fad-43db-96ab-812ab9e9eaac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a50140f86f00487b90d0503d4819234f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:27.212266 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2242/4460] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:29:26 2022] DELETE /identity/v3/users/a50140f86f00487b90d0503d4819234f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:29:27.446999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12771a40-c670-4e24-af18-1607f21a29e7 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:27.447553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12771a40-c670-4e24-af18-1607f21a29e7 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:27.447789 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12771a40-c670-4e24-af18-1607f21a29e7 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:27.449587 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2219/4461] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:29:27.454687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c978c-b939-48db-9c28-27deabf344e1 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:27.455322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c978c-b939-48db-9c28-27deabf344e1 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:27.455322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c978c-b939-48db-9c28-27deabf344e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:27.482122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5d7c978c-b939-48db-9c28-27deabf344e1 None None] MFA Rules not processed for user `b219e01934fa477fbaa053cca586f01b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:29:27.483473 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5d7c978c-b939-48db-9c28-27deabf344e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:27.553048 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2243/4462] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:29:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:29:27.561156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12771a40-c670-4e24-af18-1607f21a29e7 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:27.564639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-12771a40-c670-4e24-af18-1607f21a29e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:27.590385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12771a40-c670-4e24-af18-1607f21a29e7 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:27.607422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feaacf0-f5ec-4859-b9d4-273d64120c0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:27.609013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feaacf0-f5ec-4859-b9d4-273d64120c0c service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:27.609850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feaacf0-f5ec-4859-b9d4-273d64120c0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:27.610844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feaacf0-f5ec-4859-b9d4-273d64120c0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:27.649202 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feaacf0-f5ec-4859-b9d4-273d64120c0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:27.657379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feaacf0-f5ec-4859-b9d4-273d64120c0c service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:27.685582 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2220/4463] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:29:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:29:27.705515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c978c-b939-48db-9c28-27deabf344e1 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:27.707455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5d7c978c-b939-48db-9c28-27deabf344e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:27.791994 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:27.814759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c978c-b939-48db-9c28-27deabf344e1 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:27.821385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c2086f-aeca-4d3a-a1dc-c7b2ff0c3077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:27.822396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2086f-aeca-4d3a-a1dc-c7b2ff0c3077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:27.822749 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2086f-aeca-4d3a-a1dc-c7b2ff0c3077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:27.822904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c2086f-aeca-4d3a-a1dc-c7b2ff0c3077 admin admin] PATH_INFO: `/v3/projects/b7995a68f5a541aabda74c0b01f6aac9` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:27.824263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2086f-aeca-4d3a-a1dc-c7b2ff0c3077 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7995a68f5a541aabda74c0b01f6aac9)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:27.826658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c2086f-aeca-4d3a-a1dc-c7b2ff0c3077 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:27.885662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-04c2086f-aeca-4d3a-a1dc-c7b2ff0c3077 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7995a68f5a541aabda74c0b01f6aac9', 'request_id': 'req-04c2086f-aeca-4d3a-a1dc-c7b2ff0c3077'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:27.892141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-04c2086f-aeca-4d3a-a1dc-c7b2ff0c3077 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7995a68f5a541aabda74c0b01f6aac9', 'request_id': 'req-04c2086f-aeca-4d3a-a1dc-c7b2ff0c3077'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:27.898965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-04c2086f-aeca-4d3a-a1dc-c7b2ff0c3077 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7995a68f5a541aabda74c0b01f6aac9', 'request_id': 'req-04c2086f-aeca-4d3a-a1dc-c7b2ff0c3077'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:27.912674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-04c2086f-aeca-4d3a-a1dc-c7b2ff0c3077 admin admin] The token cache is being invalidate because project b7995a68f5a541aabda74c0b01f6aac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:29:27.913052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-04c2086f-aeca-4d3a-a1dc-c7b2ff0c3077 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:27.913639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-04c2086f-aeca-4d3a-a1dc-c7b2ff0c3077 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:27.915403 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2244/4464] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:29:27 2022] DELETE /identity/v3/projects/b7995a68f5a541aabda74c0b01f6aac9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:29:27.920701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17a6c5-3371-4901-a1e0-9994b196994c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:27.920988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17a6c5-3371-4901-a1e0-9994b196994c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:27.921263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17a6c5-3371-4901-a1e0-9994b196994c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:27.941564 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-af17a6c5-3371-4901-a1e0-9994b196994c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:29:27.942877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-af17a6c5-3371-4901-a1e0-9994b196994c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:28.011616 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2221/4465] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:29:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:29:28.018862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd2616-3ff1-47b1-8aed-300a5045c748 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:28.019480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd2616-3ff1-47b1-8aed-300a5045c748 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:28.019480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd2616-3ff1-47b1-8aed-300a5045c748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:28.043680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-49fd2616-3ff1-47b1-8aed-300a5045c748 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:29:28.044909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-49fd2616-3ff1-47b1-8aed-300a5045c748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:28.058328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17a6c5-3371-4901-a1e0-9994b196994c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:28.059975 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2245/4466] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:29:28.070152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17a6c5-3371-4901-a1e0-9994b196994c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:28.078273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eef2b2-6ee2-4201-9293-d470be234775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:28.079537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eef2b2-6ee2-4201-9293-d470be234775 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:28.079814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eef2b2-6ee2-4201-9293-d470be234775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:28.080117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eef2b2-6ee2-4201-9293-d470be234775 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:28.080778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eef2b2-6ee2-4201-9293-d470be234775 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:29:28.081316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eef2b2-6ee2-4201-9293-d470be234775 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:28.082909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eef2b2-6ee2-4201-9293-d470be234775 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:28.096830 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2222/4467] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:29:28.101359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd2616-3ff1-47b1-8aed-300a5045c748 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:28.113835 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd2616-3ff1-47b1-8aed-300a5045c748 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:28.121338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17574c-e8d5-4f6e-b94a-5172754aa8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:28.121965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17574c-e8d5-4f6e-b94a-5172754aa8b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:28.122248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17574c-e8d5-4f6e-b94a-5172754aa8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:28.122740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17574c-e8d5-4f6e-b94a-5172754aa8b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:28.123698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17574c-e8d5-4f6e-b94a-5172754aa8b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:28.126111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17574c-e8d5-4f6e-b94a-5172754aa8b3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:28.163734 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2246/4468] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:29:28 2022] POST /identity/v3/projects => generated 393 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:29:28.168048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eef2b2-6ee2-4201-9293-d470be234775 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:28.179687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eef2b2-6ee2-4201-9293-d470be234775 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:28.242172 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:28.259541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f17cb-f776-4e02-9979-d2e1d8545e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:28.260771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f17cb-f776-4e02-9979-d2e1d8545e7d admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:28.261045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f17cb-f776-4e02-9979-d2e1d8545e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:28.261940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f17cb-f776-4e02-9979-d2e1d8545e7d admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:28.262170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f17cb-f776-4e02-9979-d2e1d8545e7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:28.264508 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f17cb-f776-4e02-9979-d2e1d8545e7d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:28.291302 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2223/4469] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:29:28 2022] POST /identity/v3/users => generated 297 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:29:28.295524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17574c-e8d5-4f6e-b94a-5172754aa8b3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:28.308183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17574c-e8d5-4f6e-b94a-5172754aa8b3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:28.314067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb13c7-bb40-4fea-84c8-b5fdb0edb367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:28.314691 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb13c7-bb40-4fea-84c8-b5fdb0edb367 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:28.314968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb13c7-bb40-4fea-84c8-b5fdb0edb367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:28.315521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb13c7-bb40-4fea-84c8-b5fdb0edb367 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:28.316398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb13c7-bb40-4fea-84c8-b5fdb0edb367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:28.318474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb13c7-bb40-4fea-84c8-b5fdb0edb367 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:28.331325 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2247/4470] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:29:28.335742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f17cb-f776-4e02-9979-d2e1d8545e7d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:28.353047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f17cb-f776-4e02-9979-d2e1d8545e7d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:28.358534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc63b78-8e5e-4e36-b7b3-6be240988cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:28.359170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc63b78-8e5e-4e36-b7b3-6be240988cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:28.359454 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc63b78-8e5e-4e36-b7b3-6be240988cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:28.359721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc63b78-8e5e-4e36-b7b3-6be240988cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:28.360416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc63b78-8e5e-4e36-b7b3-6be240988cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:28.362040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc63b78-8e5e-4e36-b7b3-6be240988cf1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:28.384862 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2224/4471] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:29:28.389911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb13c7-bb40-4fea-84c8-b5fdb0edb367 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:28.410426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb13c7-bb40-4fea-84c8-b5fdb0edb367 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:28.416509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf38cd-79b1-47ef-bd39-765baae4220c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:28.417489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf38cd-79b1-47ef-bd39-765baae4220c admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:28.418021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf38cd-79b1-47ef-bd39-765baae4220c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:28.418582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf38cd-79b1-47ef-bd39-765baae4220c admin admin] PATH_INFO: `/v3/projects/a0120724da79436895adbcdcf83cc299/users/1b0db36c74b44fe08f33edc325a290f2/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:28.439526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf38cd-79b1-47ef-bd39-765baae4220c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0120724da79436895adbcdcf83cc299, user_id=1b0db36c74b44fe08f33edc325a290f2, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:28.442847 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf38cd-79b1-47ef-bd39-765baae4220c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:28.467295 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2248/4472] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:29:28 2022] PUT /identity/v3/projects/a0120724da79436895adbcdcf83cc299/users/1b0db36c74b44fe08f33edc325a290f2/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:29:28.478308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5b5df-96e7-4f2e-b430-aafc71452fd6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:28.478969 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5b5df-96e7-4f2e-b430-aafc71452fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:28.479070 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5b5df-96e7-4f2e-b430-aafc71452fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:28.516746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-5ce5b5df-96e7-4f2e-b430-aafc71452fd6 None None] MFA Rules not processed for user `1b0db36c74b44fe08f33edc325a290f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:29:28.517984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5ce5b5df-96e7-4f2e-b430-aafc71452fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:28.603025 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2225/4473] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:29:28 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:29:28.612822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf38cd-79b1-47ef-bd39-765baae4220c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:28.615454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-43cf38cd-79b1-47ef-bd39-765baae4220c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:28.742687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf38cd-79b1-47ef-bd39-765baae4220c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:28.750439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb87e5-559a-47de-83b2-0e12582e6065 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:28.750691 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb87e5-559a-47de-83b2-0e12582e6065 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:28.750933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb87e5-559a-47de-83b2-0e12582e6065 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:28.751209 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb87e5-559a-47de-83b2-0e12582e6065 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:28.760926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb87e5-559a-47de-83b2-0e12582e6065 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:28.763778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb87e5-559a-47de-83b2-0e12582e6065 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:28.768801 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:28.781286 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2249/4474] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:29:28 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:29:29.068878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5b5df-96e7-4f2e-b430-aafc71452fd6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:29.137056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5b5df-96e7-4f2e-b430-aafc71452fd6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:29.142243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4c4c8-6fdd-4b16-b10a-f0474e2c04b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:29.142893 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4c4c8-6fdd-4b16-b10a-f0474e2c04b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:29.144088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4c4c8-6fdd-4b16-b10a-f0474e2c04b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:29.144088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4c4c8-6fdd-4b16-b10a-f0474e2c04b0 admin admin] PATH_INFO: `/v3/users/1b0db36c74b44fe08f33edc325a290f2` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:29.144605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4c4c8-6fdd-4b16-b10a-f0474e2c04b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b0db36c74b44fe08f33edc325a290f2)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:29.146924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4c4c8-6fdd-4b16-b10a-f0474e2c04b0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:29.223698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bfc4c4c8-6fdd-4b16-b10a-f0474e2c04b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b0db36c74b44fe08f33edc325a290f2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:29.252301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bfc4c4c8-6fdd-4b16-b10a-f0474e2c04b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b0db36c74b44fe08f33edc325a290f2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:29.253809 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:29.277762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bfc4c4c8-6fdd-4b16-b10a-f0474e2c04b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b0db36c74b44fe08f33edc325a290f2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:29.279443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bfc4c4c8-6fdd-4b16-b10a-f0474e2c04b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b0db36c74b44fe08f33edc325a290f2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:29.292997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bfc4c4c8-6fdd-4b16-b10a-f0474e2c04b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b0db36c74b44fe08f33edc325a290f2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:29.303128 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2226/4475] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:29:29 2022] DELETE /identity/v3/users/1b0db36c74b44fe08f33edc325a290f2 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:29:29.308428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960ddb7-4e20-4eb6-94fe-bc8cea290cb1 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:29.310023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960ddb7-4e20-4eb6-94fe-bc8cea290cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:29.310845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960ddb7-4e20-4eb6-94fe-bc8cea290cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:29.335292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6960ddb7-4e20-4eb6-94fe-bc8cea290cb1 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:29:29.337597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6960ddb7-4e20-4eb6-94fe-bc8cea290cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:29.413144 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2250/4476] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:29:29.424826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4c4c8-6fdd-4b16-b10a-f0474e2c04b0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:29.426484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bfc4c4c8-6fdd-4b16-b10a-f0474e2c04b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:29.537250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4c4c8-6fdd-4b16-b10a-f0474e2c04b0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:29.567588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923d0db-f60d-4218-b580-415bac48f084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:29.568333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923d0db-f60d-4218-b580-415bac48f084 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:29.568691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923d0db-f60d-4218-b580-415bac48f084 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:29.568912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923d0db-f60d-4218-b580-415bac48f084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:29.591740 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923d0db-f60d-4218-b580-415bac48f084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:29.593251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923d0db-f60d-4218-b580-415bac48f084 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:29.620100 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2227/4477] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:29:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:29:30.022720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960ddb7-4e20-4eb6-94fe-bc8cea290cb1 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:30.024838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6960ddb7-4e20-4eb6-94fe-bc8cea290cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:30.077841 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960ddb7-4e20-4eb6-94fe-bc8cea290cb1 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:30.094007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0d7c9-750a-47e0-942b-5f94af794df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:30.094764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0d7c9-750a-47e0-942b-5f94af794df4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:30.095045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0d7c9-750a-47e0-942b-5f94af794df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:30.095489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0d7c9-750a-47e0-942b-5f94af794df4 admin admin] PATH_INFO: `/v3/projects/a0120724da79436895adbcdcf83cc299` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:30.096616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc0d7c9-750a-47e0-942b-5f94af794df4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0120724da79436895adbcdcf83cc299)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:30.098605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc0d7c9-750a-47e0-942b-5f94af794df4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:30.189792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fcc0d7c9-750a-47e0-942b-5f94af794df4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0120724da79436895adbcdcf83cc299', 'request_id': 'req-fcc0d7c9-750a-47e0-942b-5f94af794df4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:30.199844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fcc0d7c9-750a-47e0-942b-5f94af794df4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0120724da79436895adbcdcf83cc299', 'request_id': 'req-fcc0d7c9-750a-47e0-942b-5f94af794df4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:30.220481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fcc0d7c9-750a-47e0-942b-5f94af794df4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0120724da79436895adbcdcf83cc299', 'request_id': 'req-fcc0d7c9-750a-47e0-942b-5f94af794df4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:30.241632 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fcc0d7c9-750a-47e0-942b-5f94af794df4 admin admin] The token cache is being invalidate because project a0120724da79436895adbcdcf83cc299 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:29:30.242017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fcc0d7c9-750a-47e0-942b-5f94af794df4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:30.242692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fcc0d7c9-750a-47e0-942b-5f94af794df4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:30.247696 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2251/4478] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:29:30 2022] DELETE /identity/v3/projects/a0120724da79436895adbcdcf83cc299 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:29:30.249885 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8edd4-e6c0-4547-adda-b10058e11196 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:30.250173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8edd4-e6c0-4547-adda-b10058e11196 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:30.250469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8edd4-e6c0-4547-adda-b10058e11196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:30.295835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3bf8edd4-e6c0-4547-adda-b10058e11196 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:29:30.301395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3bf8edd4-e6c0-4547-adda-b10058e11196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:30.451226 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2228/4479] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:29:30.460358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23abf1-687a-4bb8-b9d2-5870c09fdeb0 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:30.460892 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23abf1-687a-4bb8-b9d2-5870c09fdeb0 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:30.460892 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23abf1-687a-4bb8-b9d2-5870c09fdeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:30.482326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5e23abf1-687a-4bb8-b9d2-5870c09fdeb0 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:29:30.483674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5e23abf1-687a-4bb8-b9d2-5870c09fdeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:30.496816 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2252/4480] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:29:30.501694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8edd4-e6c0-4547-adda-b10058e11196 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:30.517147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8edd4-e6c0-4547-adda-b10058e11196 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:30.522252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea200e-de63-43ce-b1d4-337215b9b5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:30.523783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea200e-de63-43ce-b1d4-337215b9b5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:30.524352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea200e-de63-43ce-b1d4-337215b9b5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:30.524838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea200e-de63-43ce-b1d4-337215b9b5c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:30.526007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea200e-de63-43ce-b1d4-337215b9b5c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:29:30.526763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea200e-de63-43ce-b1d4-337215b9b5c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:30.528607 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea200e-de63-43ce-b1d4-337215b9b5c8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:30.547213 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2229/4481] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:29:30.551695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23abf1-687a-4bb8-b9d2-5870c09fdeb0 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:30.578617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23abf1-687a-4bb8-b9d2-5870c09fdeb0 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:30.594398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62ecb9-a868-4e93-bb4a-d2e33c3125de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:30.600092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62ecb9-a868-4e93-bb4a-d2e33c3125de admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:30.600285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62ecb9-a868-4e93-bb4a-d2e33c3125de admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:30.600565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62ecb9-a868-4e93-bb4a-d2e33c3125de admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:30.601218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62ecb9-a868-4e93-bb4a-d2e33c3125de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:30.603168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62ecb9-a868-4e93-bb4a-d2e33c3125de admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:30.680913 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2253/4482] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:29:30 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:29:30.682425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea200e-de63-43ce-b1d4-337215b9b5c8 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:30.693723 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea200e-de63-43ce-b1d4-337215b9b5c8 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:30.781917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61cb12-1df7-48c6-9de2-ab5c5e32a0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:30.782559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61cb12-1df7-48c6-9de2-ab5c5e32a0a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:30.782825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61cb12-1df7-48c6-9de2-ab5c5e32a0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:30.783098 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61cb12-1df7-48c6-9de2-ab5c5e32a0a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:30.783733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61cb12-1df7-48c6-9de2-ab5c5e32a0a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:30.785743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61cb12-1df7-48c6-9de2-ab5c5e32a0a3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:30.809517 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:30.842440 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2230/4483] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:29:30 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:29:30.846270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62ecb9-a868-4e93-bb4a-d2e33c3125de admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:30.873014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62ecb9-a868-4e93-bb4a-d2e33c3125de admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:30.880264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a6a57-1baa-49a7-9519-b22850c22612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:30.881007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a6a57-1baa-49a7-9519-b22850c22612 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:30.881326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a6a57-1baa-49a7-9519-b22850c22612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:30.881603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a6a57-1baa-49a7-9519-b22850c22612 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:30.883832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a6a57-1baa-49a7-9519-b22850c22612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:30.887473 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a6a57-1baa-49a7-9519-b22850c22612 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:30.904516 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2254/4484] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:29:30.908481 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61cb12-1df7-48c6-9de2-ab5c5e32a0a3 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:30.927912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61cb12-1df7-48c6-9de2-ab5c5e32a0a3 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:30.934911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9bb42c-cbbe-4cb2-829d-ef64d3112ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:30.935636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bb42c-cbbe-4cb2-829d-ef64d3112ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:30.936020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bb42c-cbbe-4cb2-829d-ef64d3112ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:30.936357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9bb42c-cbbe-4cb2-829d-ef64d3112ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:30.937593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9bb42c-cbbe-4cb2-829d-ef64d3112ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:30.940390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9bb42c-cbbe-4cb2-829d-ef64d3112ed0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:30.984915 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2231/4485] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:29:30.990144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a6a57-1baa-49a7-9519-b22850c22612 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:31.006286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a6a57-1baa-49a7-9519-b22850c22612 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:31.017165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff70d76-8e81-4339-8cba-d14c340c8043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:31.018044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff70d76-8e81-4339-8cba-d14c340c8043 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:31.019339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff70d76-8e81-4339-8cba-d14c340c8043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:31.019739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff70d76-8e81-4339-8cba-d14c340c8043 admin admin] PATH_INFO: `/v3/projects/81506548c3b44b50839cbaa818db1f00/users/12e5f4dc85b34ab6947f58d305531b39/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:31.094956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff70d76-8e81-4339-8cba-d14c340c8043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81506548c3b44b50839cbaa818db1f00, user_id=12e5f4dc85b34ab6947f58d305531b39, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:31.105815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff70d76-8e81-4339-8cba-d14c340c8043 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:31.153324 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2255/4486] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:29:30 2022] PUT /identity/v3/projects/81506548c3b44b50839cbaa818db1f00/users/12e5f4dc85b34ab6947f58d305531b39/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:29:31.163926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bd48e-095c-4eae-8077-7acebf1a535a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:31.164207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bd48e-095c-4eae-8077-7acebf1a535a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:31.164557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bd48e-095c-4eae-8077-7acebf1a535a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:31.282270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e54bd48e-095c-4eae-8077-7acebf1a535a None None] MFA Rules not processed for user `12e5f4dc85b34ab6947f58d305531b39`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:29:31.284753 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e54bd48e-095c-4eae-8077-7acebf1a535a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:31.472453 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2232/4487] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:29:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:29:31.479288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff70d76-8e81-4339-8cba-d14c340c8043 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:31.481868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3ff70d76-8e81-4339-8cba-d14c340c8043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:31.532661 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:31.659273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff70d76-8e81-4339-8cba-d14c340c8043 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:31.668047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec507c-c4ab-4554-9f0c-1a7f62255e94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:31.669068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec507c-c4ab-4554-9f0c-1a7f62255e94 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:31.669540 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec507c-c4ab-4554-9f0c-1a7f62255e94 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:31.669821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec507c-c4ab-4554-9f0c-1a7f62255e94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:31.682695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec507c-c4ab-4554-9f0c-1a7f62255e94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:31.686083 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec507c-c4ab-4554-9f0c-1a7f62255e94 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:31.705759 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2256/4488] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:29:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:29:34.611004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bd48e-095c-4eae-8077-7acebf1a535a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:34.697492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bd48e-095c-4eae-8077-7acebf1a535a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:34.702827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b76e39-da12-4ef4-bc1e-098b1a414426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:34.703639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b76e39-da12-4ef4-bc1e-098b1a414426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:34.704031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b76e39-da12-4ef4-bc1e-098b1a414426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:34.704422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b76e39-da12-4ef4-bc1e-098b1a414426 admin admin] PATH_INFO: `/v3/users/12e5f4dc85b34ab6947f58d305531b39` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:34.705734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b76e39-da12-4ef4-bc1e-098b1a414426 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12e5f4dc85b34ab6947f58d305531b39)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:34.708064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b76e39-da12-4ef4-bc1e-098b1a414426 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:34.768783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-41b76e39-da12-4ef4-bc1e-098b1a414426 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12e5f4dc85b34ab6947f58d305531b39'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:34.780254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-41b76e39-da12-4ef4-bc1e-098b1a414426 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12e5f4dc85b34ab6947f58d305531b39'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:34.800067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-41b76e39-da12-4ef4-bc1e-098b1a414426 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12e5f4dc85b34ab6947f58d305531b39'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:34.800830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-41b76e39-da12-4ef4-bc1e-098b1a414426 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12e5f4dc85b34ab6947f58d305531b39'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:34.802612 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:INSERT=1,keystone:SELECT=90,keystone:DELETE=9 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:34.814602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-41b76e39-da12-4ef4-bc1e-098b1a414426 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12e5f4dc85b34ab6947f58d305531b39'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:34.834678 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2233/4489] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:29:34 2022] DELETE /identity/v3/users/12e5f4dc85b34ab6947f58d305531b39 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:29:34.841367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7810b-bf05-4422-a02e-a43db0503ef9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:34.842434 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7810b-bf05-4422-a02e-a43db0503ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:34.842875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7810b-bf05-4422-a02e-a43db0503ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:34.897680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6cc7810b-bf05-4422-a02e-a43db0503ef9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:29:34.899196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6cc7810b-bf05-4422-a02e-a43db0503ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:35.023048 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2257/4490] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:29:35.027362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921de4e-5870-46d5-8b0b-189e0ebb9ac0 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:35.027362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921de4e-5870-46d5-8b0b-189e0ebb9ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:35.028356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921de4e-5870-46d5-8b0b-189e0ebb9ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:35.038063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7810b-bf05-4422-a02e-a43db0503ef9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:35.043854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6cc7810b-bf05-4422-a02e-a43db0503ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:35.057866 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-f921de4e-5870-46d5-8b0b-189e0ebb9ac0 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:29:35.059402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f921de4e-5870-46d5-8b0b-189e0ebb9ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:35.143183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7810b-bf05-4422-a02e-a43db0503ef9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:35.150188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611f1a4-5792-4419-93c7-9c1bee509e11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:35.151032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611f1a4-5792-4419-93c7-9c1bee509e11 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:35.151346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611f1a4-5792-4419-93c7-9c1bee509e11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:35.151762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611f1a4-5792-4419-93c7-9c1bee509e11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:35.159778 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2234/4491] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:29:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:29:35.167623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611f1a4-5792-4419-93c7-9c1bee509e11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:35.169038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611f1a4-5792-4419-93c7-9c1bee509e11 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:35.172280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921de4e-5870-46d5-8b0b-189e0ebb9ac0 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:35.174069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f921de4e-5870-46d5-8b0b-189e0ebb9ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:35.180754 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2258/4492] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:29:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:29:35.286456 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921de4e-5870-46d5-8b0b-189e0ebb9ac0 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:35.295756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45fd06-0a47-4bf6-a14d-76421e4a6fcb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:35.298208 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45fd06-0a47-4bf6-a14d-76421e4a6fcb service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:35.298642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45fd06-0a47-4bf6-a14d-76421e4a6fcb service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:35.299030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45fd06-0a47-4bf6-a14d-76421e4a6fcb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:35.311134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45fd06-0a47-4bf6-a14d-76421e4a6fcb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:35.312892 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45fd06-0a47-4bf6-a14d-76421e4a6fcb service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:35.325241 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2235/4493] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:29:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 07 01:29:36.168739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611f1a4-5792-4419-93c7-9c1bee509e11 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:36.170883 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1611f1a4-5792-4419-93c7-9c1bee509e11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:36.186965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611f1a4-5792-4419-93c7-9c1bee509e11 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:36.192069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4717b-1b94-40fb-8072-1cf8569ff278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:36.193009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4717b-1b94-40fb-8072-1cf8569ff278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:36.193582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4717b-1b94-40fb-8072-1cf8569ff278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:36.194058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4717b-1b94-40fb-8072-1cf8569ff278 admin admin] PATH_INFO: `/v3/projects/81506548c3b44b50839cbaa818db1f00` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:36.195489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4717b-1b94-40fb-8072-1cf8569ff278 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81506548c3b44b50839cbaa818db1f00)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:36.197768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4717b-1b94-40fb-8072-1cf8569ff278 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:36.263791 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:36.273856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3ae4717b-1b94-40fb-8072-1cf8569ff278 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81506548c3b44b50839cbaa818db1f00', 'request_id': 'req-3ae4717b-1b94-40fb-8072-1cf8569ff278'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:36.287988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3ae4717b-1b94-40fb-8072-1cf8569ff278 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81506548c3b44b50839cbaa818db1f00', 'request_id': 'req-3ae4717b-1b94-40fb-8072-1cf8569ff278'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:36.307142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3ae4717b-1b94-40fb-8072-1cf8569ff278 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81506548c3b44b50839cbaa818db1f00', 'request_id': 'req-3ae4717b-1b94-40fb-8072-1cf8569ff278'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:36.326509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3ae4717b-1b94-40fb-8072-1cf8569ff278 admin admin] The token cache is being invalidate because project 81506548c3b44b50839cbaa818db1f00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:29:36.327038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3ae4717b-1b94-40fb-8072-1cf8569ff278 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:36.327802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3ae4717b-1b94-40fb-8072-1cf8569ff278 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:29:36.330225 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2259/4494] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:29:36 2022] DELETE /identity/v3/projects/81506548c3b44b50839cbaa818db1f00 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:29:36.334810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485cdd7-f0f6-488b-87f5-c8cb0843a665 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:36.335960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485cdd7-f0f6-488b-87f5-c8cb0843a665 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:36.336378 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485cdd7-f0f6-488b-87f5-c8cb0843a665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:36.346108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4717b-1b94-40fb-8072-1cf8569ff278 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:36.350903 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3ae4717b-1b94-40fb-8072-1cf8569ff278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:36.383797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9485cdd7-f0f6-488b-87f5-c8cb0843a665 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:29:36.387216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9485cdd7-f0f6-488b-87f5-c8cb0843a665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:36.477336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4717b-1b94-40fb-8072-1cf8569ff278 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:36.489728 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5c86b-2a40-4053-b163-65df4a14f85a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:36.490372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5c86b-2a40-4053-b163-65df4a14f85a service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:36.490645 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5c86b-2a40-4053-b163-65df4a14f85a service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:36.490911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5c86b-2a40-4053-b163-65df4a14f85a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:36.493375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-09b5c86b-2a40-4053-b163-65df4a14f85a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:36.559465 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2236/4495] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:29:36.568938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1004a6-657c-4b44-b989-78ffd11908b6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:36.569274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1004a6-657c-4b44-b989-78ffd11908b6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:36.569676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1004a6-657c-4b44-b989-78ffd11908b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:36.621690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9d1004a6-657c-4b44-b989-78ffd11908b6 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:29:36.622830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9d1004a6-657c-4b44-b989-78ffd11908b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:36.636029 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5c86b-2a40-4053-b163-65df4a14f85a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:36.637892 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5c86b-2a40-4053-b163-65df4a14f85a service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:36.644828 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2237/4496] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:29:36.648920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1004a6-657c-4b44-b989-78ffd11908b6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:36.679984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1004a6-657c-4b44-b989-78ffd11908b6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:36.686141 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2260/4497] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:29:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:29:36.691201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ab8a8-5b2b-4355-a8a7-969f625450ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:36.692152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ab8a8-5b2b-4355-a8a7-969f625450ed admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:36.692517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ab8a8-5b2b-4355-a8a7-969f625450ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:36.692852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ab8a8-5b2b-4355-a8a7-969f625450ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:36.693619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ab8a8-5b2b-4355-a8a7-969f625450ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:29:36.694008 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ab8a8-5b2b-4355-a8a7-969f625450ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:36.695803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ab8a8-5b2b-4355-a8a7-969f625450ed admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:36.727926 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2238/4498] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:29:36.734211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5c86b-2a40-4053-b163-65df4a14f85a service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:36.746799 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5c86b-2a40-4053-b163-65df4a14f85a service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:36.753418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049a34e-af3b-4a4f-bc27-80c4b3b47260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:36.753726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049a34e-af3b-4a4f-bc27-80c4b3b47260 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:36.753995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049a34e-af3b-4a4f-bc27-80c4b3b47260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:36.754268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049a34e-af3b-4a4f-bc27-80c4b3b47260 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:36.754920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049a34e-af3b-4a4f-bc27-80c4b3b47260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:36.757527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049a34e-af3b-4a4f-bc27-80c4b3b47260 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:36.797596 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2261/4499] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:29:36 2022] POST /identity/v3/projects => generated 391 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:29:36.797767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ab8a8-5b2b-4355-a8a7-969f625450ed admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:36.808781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ab8a8-5b2b-4355-a8a7-969f625450ed admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:36.837207 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:36.932010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e970896-a4b7-483e-8969-f2f204997a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:36.933697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e970896-a4b7-483e-8969-f2f204997a57 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:36.933987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e970896-a4b7-483e-8969-f2f204997a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:36.934264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e970896-a4b7-483e-8969-f2f204997a57 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:36.934923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e970896-a4b7-483e-8969-f2f204997a57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:36.937055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e970896-a4b7-483e-8969-f2f204997a57 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:36.991638 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2239/4500] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:29:36 2022] POST /identity/v3/users => generated 296 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:29:36.995834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049a34e-af3b-4a4f-bc27-80c4b3b47260 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:37.014097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049a34e-af3b-4a4f-bc27-80c4b3b47260 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:37.033156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f62e35-6226-4fd2-8d1c-5931f7d8aeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:37.034676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f62e35-6226-4fd2-8d1c-5931f7d8aeff admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:37.034962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f62e35-6226-4fd2-8d1c-5931f7d8aeff admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:37.035240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f62e35-6226-4fd2-8d1c-5931f7d8aeff admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:37.035939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f62e35-6226-4fd2-8d1c-5931f7d8aeff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:37.037608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f62e35-6226-4fd2-8d1c-5931f7d8aeff admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:37.066719 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2262/4501] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:29:37.067746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e970896-a4b7-483e-8969-f2f204997a57 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:37.092277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e970896-a4b7-483e-8969-f2f204997a57 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:37.097396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc03446-5498-43ad-9af3-811257862113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:37.098016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc03446-5498-43ad-9af3-811257862113 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:37.098294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc03446-5498-43ad-9af3-811257862113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:37.098572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc03446-5498-43ad-9af3-811257862113 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:37.099229 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc03446-5498-43ad-9af3-811257862113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:37.100871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc03446-5498-43ad-9af3-811257862113 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:37.115622 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2240/4502] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:29:37.119542 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f62e35-6226-4fd2-8d1c-5931f7d8aeff admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:37.136092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f62e35-6226-4fd2-8d1c-5931f7d8aeff admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:37.142157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d985e6-16c2-4ad9-84ef-32b7de601f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:37.143287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d985e6-16c2-4ad9-84ef-32b7de601f6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:37.143287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d985e6-16c2-4ad9-84ef-32b7de601f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:37.143680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d985e6-16c2-4ad9-84ef-32b7de601f6a admin admin] PATH_INFO: `/v3/projects/2cbe49718bfe40c5b0f9587413635a2e/users/12d82ae0bf5f46668b0ff0e38ad77674/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:37.163903 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d985e6-16c2-4ad9-84ef-32b7de601f6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cbe49718bfe40c5b0f9587413635a2e, user_id=12d82ae0bf5f46668b0ff0e38ad77674, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:37.165027 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d985e6-16c2-4ad9-84ef-32b7de601f6a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:37.207526 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2263/4503] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:29:37 2022] PUT /identity/v3/projects/2cbe49718bfe40c5b0f9587413635a2e/users/12d82ae0bf5f46668b0ff0e38ad77674/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:29:37.212689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbad94-f8c5-4b34-aced-d5e8ea8b8f4f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:37.213089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbad94-f8c5-4b34-aced-d5e8ea8b8f4f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:37.213465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbad94-f8c5-4b34-aced-d5e8ea8b8f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:37.247307 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-cdbbad94-f8c5-4b34-aced-d5e8ea8b8f4f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:29:37.254061 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cdbbad94-f8c5-4b34-aced-d5e8ea8b8f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:37.360470 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2241/4504] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:29:37.386912 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d985e6-16c2-4ad9-84ef-32b7de601f6a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:37.389940 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-18d985e6-16c2-4ad9-84ef-32b7de601f6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:37.412379 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:37.519586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d985e6-16c2-4ad9-84ef-32b7de601f6a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:37.525892 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb450f09-b69a-439e-8608-4e72eb32f192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:37.526844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb450f09-b69a-439e-8608-4e72eb32f192 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:37.527262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb450f09-b69a-439e-8608-4e72eb32f192 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:37.527697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb450f09-b69a-439e-8608-4e72eb32f192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:37.540341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb450f09-b69a-439e-8608-4e72eb32f192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:37.549109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb450f09-b69a-439e-8608-4e72eb32f192 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:37.574992 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2264/4505] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:29:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:29:38.140522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbad94-f8c5-4b34-aced-d5e8ea8b8f4f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:38.157195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbad94-f8c5-4b34-aced-d5e8ea8b8f4f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:38.178198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865e674-6f6d-48f8-b356-bc413dc97e4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:38.178869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865e674-6f6d-48f8-b356-bc413dc97e4b service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:38.179404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865e674-6f6d-48f8-b356-bc413dc97e4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:38.179510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865e674-6f6d-48f8-b356-bc413dc97e4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:38.184917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7865e674-6f6d-48f8-b356-bc413dc97e4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:38.346811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865e674-6f6d-48f8-b356-bc413dc97e4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:38.348501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865e674-6f6d-48f8-b356-bc413dc97e4b service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:38.375289 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2242/4506] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:29:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:29:41.851618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef3f7f-9490-4912-a3b9-9ff7d0140138 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:41.852242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef3f7f-9490-4912-a3b9-9ff7d0140138 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:41.852242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef3f7f-9490-4912-a3b9-9ff7d0140138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:41.917234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-35ef3f7f-9490-4912-a3b9-9ff7d0140138 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:29:41.918476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-35ef3f7f-9490-4912-a3b9-9ff7d0140138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:42.075249 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2265/4507] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:29:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:29:42.089820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865e674-6f6d-48f8-b356-bc413dc97e4b service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:42.091273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7865e674-6f6d-48f8-b356-bc413dc97e4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:42.116066 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:29:42.264300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865e674-6f6d-48f8-b356-bc413dc97e4b service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:42.272781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecca11d-7a9f-4ef7-bf73-1ff37b460751 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:42.278625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecca11d-7a9f-4ef7-bf73-1ff37b460751 service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:42.279244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecca11d-7a9f-4ef7-bf73-1ff37b460751 service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:42.279532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecca11d-7a9f-4ef7-bf73-1ff37b460751 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:42.293448 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecca11d-7a9f-4ef7-bf73-1ff37b460751 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:42.298377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecca11d-7a9f-4ef7-bf73-1ff37b460751 service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:42.334361 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2243/4508] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:29:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:29:49.930285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aabf1c-e099-4eb6-9968-531166d76def None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:49.930892 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aabf1c-e099-4eb6-9968-531166d76def None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:49.930892 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aabf1c-e099-4eb6-9968-531166d76def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:50.030825 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-28aabf1c-e099-4eb6-9968-531166d76def None None] MFA Rules not processed for user `12d82ae0bf5f46668b0ff0e38ad77674`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:29:50.032343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-28aabf1c-e099-4eb6-9968-531166d76def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:50.446514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd8c91-dcda-4f41-8476-3f07bffaea5b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:50.447041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd8c91-dcda-4f41-8476-3f07bffaea5b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:50.447041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd8c91-dcda-4f41-8476-3f07bffaea5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:50.465108 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2266/4509] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:29:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 535 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:29:50.506715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9fcd8c91-dcda-4f41-8476-3f07bffaea5b None None] MFA Rules not processed for user `12d82ae0bf5f46668b0ff0e38ad77674`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:29:50.510085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9fcd8c91-dcda-4f41-8476-3f07bffaea5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:50.541625 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2244/4510] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:29:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:29:50.548151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aabf1c-e099-4eb6-9968-531166d76def None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:50.550240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-28aabf1c-e099-4eb6-9968-531166d76def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:50.587390 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aabf1c-e099-4eb6-9968-531166d76def None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:50.604486 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb2855-dc68-462b-85a6-4568fcc0b8ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:50.606008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb2855-dc68-462b-85a6-4568fcc0b8ee service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:50.607496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb2855-dc68-462b-85a6-4568fcc0b8ee service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:50.607998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb2855-dc68-462b-85a6-4568fcc0b8ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:50.620127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb2855-dc68-462b-85a6-4568fcc0b8ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:50.623740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb2855-dc68-462b-85a6-4568fcc0b8ee service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:50.642167 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2267/4511] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:29:50 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:29:58.142234 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd8c91-dcda-4f41-8476-3f07bffaea5b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:58.163441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd8c91-dcda-4f41-8476-3f07bffaea5b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:58.189182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8210d9b-5dbd-44d9-a881-93c3e5fa93eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:58.194292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8210d9b-5dbd-44d9-a881-93c3e5fa93eb service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:58.195621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8210d9b-5dbd-44d9-a881-93c3e5fa93eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:58.196890 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8210d9b-5dbd-44d9-a881-93c3e5fa93eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:58.208422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e8210d9b-5dbd-44d9-a881-93c3e5fa93eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:58.364606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8210d9b-5dbd-44d9-a881-93c3e5fa93eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:58.367470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8210d9b-5dbd-44d9-a881-93c3e5fa93eb service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:58.397123 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2245/4512] 10.222.0.39 () {60 vars in 1396 bytes} [Sun Aug 7 01:29:58 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3256 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:29:59.417611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31e5a2-7977-47dc-aa5a-ce5765a3df3f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:59.417611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31e5a2-7977-47dc-aa5a-ce5765a3df3f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:59.418606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31e5a2-7977-47dc-aa5a-ce5765a3df3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:59.472938 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-db31e5a2-7977-47dc-aa5a-ce5765a3df3f None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:29:59.476582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-db31e5a2-7977-47dc-aa5a-ce5765a3df3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:29:59.499402 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2268/4513] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:29:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:29:59.511142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8210d9b-5dbd-44d9-a881-93c3e5fa93eb service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:29:59.534278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8210d9b-5dbd-44d9-a881-93c3e5fa93eb service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:29:59.548102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d1256-ef2e-415d-b0ce-b1a543d86b2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:29:59.549116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d1256-ef2e-415d-b0ce-b1a543d86b2b service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:29:59.549570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d1256-ef2e-415d-b0ce-b1a543d86b2b service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:29:59.549988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d1256-ef2e-415d-b0ce-b1a543d86b2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:29:59.571835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d1256-ef2e-415d-b0ce-b1a543d86b2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:29:59.576819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d1256-ef2e-415d-b0ce-b1a543d86b2b service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:29:59.588641 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2246/4514] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:29:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:30:01.944468 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31e5a2-7977-47dc-aa5a-ce5765a3df3f None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:01.947198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-db31e5a2-7977-47dc-aa5a-ce5765a3df3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:02.011004 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:02.082642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31e5a2-7977-47dc-aa5a-ce5765a3df3f None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:02.089816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b195599-9efb-4911-aec4-c70e2780d3de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:02.090518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b195599-9efb-4911-aec4-c70e2780d3de service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:02.090785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b195599-9efb-4911-aec4-c70e2780d3de service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:02.091058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b195599-9efb-4911-aec4-c70e2780d3de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:02.093818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3b195599-9efb-4911-aec4-c70e2780d3de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:02.111839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b195599-9efb-4911-aec4-c70e2780d3de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:02.113572 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b195599-9efb-4911-aec4-c70e2780d3de service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:02.128169 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2269/4515] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:30:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:30:02.467331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b163d-5034-4397-a089-4c045535933b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:02.467874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b163d-5034-4397-a089-4c045535933b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:02.467874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b163d-5034-4397-a089-4c045535933b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:02.491585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-529b163d-5034-4397-a089-4c045535933b None None] MFA Rules not processed for user `d1f0c01c340940388b440932d51988ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:30:02.493540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-529b163d-5034-4397-a089-4c045535933b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:02.523002 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2247/4516] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:30:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:30:12.121985 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=18 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:12.485230 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=67 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:13.283747 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b195599-9efb-4911-aec4-c70e2780d3de service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:13.285302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3b195599-9efb-4911-aec4-c70e2780d3de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:13.399808 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b195599-9efb-4911-aec4-c70e2780d3de service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:13.405823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a715a-c3b4-4150-80a9-1708842c36af service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:13.406451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a715a-c3b4-4150-80a9-1708842c36af service glance] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:13.406808 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a715a-c3b4-4150-80a9-1708842c36af service glance] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:13.407259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a715a-c3b4-4150-80a9-1708842c36af service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:13.410403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fd1a715a-c3b4-4150-80a9-1708842c36af service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:13.427855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a715a-c3b4-4150-80a9-1708842c36af service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:13.429811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a715a-c3b4-4150-80a9-1708842c36af service glance] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:13.460163 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2270/4517] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:30:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:30:13.540592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b163d-5034-4397-a089-4c045535933b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:13.555965 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b163d-5034-4397-a089-4c045535933b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:13.562323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd1b9e-b2f8-4aa7-a3da-efc065b54dfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:13.563099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd1b9e-b2f8-4aa7-a3da-efc065b54dfa service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:13.563355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd1b9e-b2f8-4aa7-a3da-efc065b54dfa service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:13.563613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfd1b9e-b2f8-4aa7-a3da-efc065b54dfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:13.565616 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4bfd1b9e-b2f8-4aa7-a3da-efc065b54dfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:13.581286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd1b9e-b2f8-4aa7-a3da-efc065b54dfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:13.582758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfd1b9e-b2f8-4aa7-a3da-efc065b54dfa service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:13.595573 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2248/4518] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:30:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:30:15.805986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e971f6-9bab-4ee8-858b-b643ee02bde9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:15.806526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e971f6-9bab-4ee8-858b-b643ee02bde9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:15.806771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e971f6-9bab-4ee8-858b-b643ee02bde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:15.855944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-91e971f6-9bab-4ee8-858b-b643ee02bde9 None None] MFA Rules not processed for user `ef29bd35cca547c39d76c54058d32979`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:30:15.858074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-91e971f6-9bab-4ee8-858b-b643ee02bde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:15.965732 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2271/4519] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:30:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:30:17.239497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd1b9e-b2f8-4aa7-a3da-efc065b54dfa service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:17.288544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfd1b9e-b2f8-4aa7-a3da-efc065b54dfa service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:17.308237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82b07b-aa6b-48bc-b6cf-d1a4731cf68a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:17.309129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82b07b-aa6b-48bc-b6cf-d1a4731cf68a service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:17.309548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82b07b-aa6b-48bc-b6cf-d1a4731cf68a service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:17.309956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82b07b-aa6b-48bc-b6cf-d1a4731cf68a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:17.313711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ca82b07b-aa6b-48bc-b6cf-d1a4731cf68a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:17.345284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca82b07b-aa6b-48bc-b6cf-d1a4731cf68a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:17.346523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca82b07b-aa6b-48bc-b6cf-d1a4731cf68a service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:17.368192 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2249/4520] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:30:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:30:18.743339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fa94d-6b9a-417a-8eaa-21238f26fefd None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:18.744135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fa94d-6b9a-417a-8eaa-21238f26fefd None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:18.744242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fa94d-6b9a-417a-8eaa-21238f26fefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:18.776208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-388fa94d-6b9a-417a-8eaa-21238f26fefd None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:30:18.777440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-388fa94d-6b9a-417a-8eaa-21238f26fefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:18.796079 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2272/4521] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:30:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:30:18.810106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82b07b-aa6b-48bc-b6cf-d1a4731cf68a service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:18.822846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82b07b-aa6b-48bc-b6cf-d1a4731cf68a service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:18.827926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee0410-c4b3-4178-b6b2-d43c599fc3ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:18.828587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee0410-c4b3-4178-b6b2-d43c599fc3ac service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:18.828925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee0410-c4b3-4178-b6b2-d43c599fc3ac service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:18.829257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee0410-c4b3-4178-b6b2-d43c599fc3ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:18.838717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee0410-c4b3-4178-b6b2-d43c599fc3ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:18.840478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee0410-c4b3-4178-b6b2-d43c599fc3ac service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:18.849220 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2250/4522] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:30:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 07 01:30:24.596945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388fa94d-6b9a-417a-8eaa-21238f26fefd None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:24.623268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388fa94d-6b9a-417a-8eaa-21238f26fefd None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:24.634624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9873993-1837-40fd-9372-6c8caf98b6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:24.635517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9873993-1837-40fd-9372-6c8caf98b6e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:24.636565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9873993-1837-40fd-9372-6c8caf98b6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:24.638610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9873993-1837-40fd-9372-6c8caf98b6e9 admin admin] PATH_INFO: `/v3/users/12d82ae0bf5f46668b0ff0e38ad77674` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:24.640328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9873993-1837-40fd-9372-6c8caf98b6e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12d82ae0bf5f46668b0ff0e38ad77674)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:24.647250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9873993-1837-40fd-9372-6c8caf98b6e9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:24.780565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e9873993-1837-40fd-9372-6c8caf98b6e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12d82ae0bf5f46668b0ff0e38ad77674'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:30:24.790122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e9873993-1837-40fd-9372-6c8caf98b6e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12d82ae0bf5f46668b0ff0e38ad77674'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:30:24.806509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e9873993-1837-40fd-9372-6c8caf98b6e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12d82ae0bf5f46668b0ff0e38ad77674'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:30:24.807318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e9873993-1837-40fd-9372-6c8caf98b6e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12d82ae0bf5f46668b0ff0e38ad77674'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:30:24.820481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e9873993-1837-40fd-9372-6c8caf98b6e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12d82ae0bf5f46668b0ff0e38ad77674'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:30:24.850555 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2273/4523] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:30:24 2022] DELETE /identity/v3/users/12d82ae0bf5f46668b0ff0e38ad77674 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:30:25.566408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee0410-c4b3-4178-b6b2-d43c599fc3ac service swift] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:25.589245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee0410-c4b3-4178-b6b2-d43c599fc3ac service swift] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:25.780571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685182b-39d0-4ac7-a9c2-414ec7de6856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:25.782232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685182b-39d0-4ac7-a9c2-414ec7de6856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:25.782232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685182b-39d0-4ac7-a9c2-414ec7de6856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:25.782232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685182b-39d0-4ac7-a9c2-414ec7de6856 admin admin] PATH_INFO: `/v3/projects/2cbe49718bfe40c5b0f9587413635a2e` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:25.789391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685182b-39d0-4ac7-a9c2-414ec7de6856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cbe49718bfe40c5b0f9587413635a2e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:25.791693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685182b-39d0-4ac7-a9c2-414ec7de6856 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:25.931279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f685182b-39d0-4ac7-a9c2-414ec7de6856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cbe49718bfe40c5b0f9587413635a2e', 'request_id': 'req-f685182b-39d0-4ac7-a9c2-414ec7de6856'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:30:25.941656 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f685182b-39d0-4ac7-a9c2-414ec7de6856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cbe49718bfe40c5b0f9587413635a2e', 'request_id': 'req-f685182b-39d0-4ac7-a9c2-414ec7de6856'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:30:25.956816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f685182b-39d0-4ac7-a9c2-414ec7de6856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cbe49718bfe40c5b0f9587413635a2e', 'request_id': 'req-f685182b-39d0-4ac7-a9c2-414ec7de6856'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:30:26.007077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f685182b-39d0-4ac7-a9c2-414ec7de6856 admin admin] The token cache is being invalidate because project 2cbe49718bfe40c5b0f9587413635a2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:30:26.012469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f685182b-39d0-4ac7-a9c2-414ec7de6856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:30:26.013642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f685182b-39d0-4ac7-a9c2-414ec7de6856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:30:26.017290 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2251/4524] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:30:25 2022] DELETE /identity/v3/projects/2cbe49718bfe40c5b0f9587413635a2e => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:30:26.022039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a93a4-0afc-4b9b-9779-9c1aa2b77393 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:26.023084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a93a4-0afc-4b9b-9779-9c1aa2b77393 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:26.023529 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a93a4-0afc-4b9b-9779-9c1aa2b77393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:26.049752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-4c1a93a4-0afc-4b9b-9779-9c1aa2b77393 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:30:26.051459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4c1a93a4-0afc-4b9b-9779-9c1aa2b77393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:26.063142 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:26.185513 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2274/4525] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:30:26.187241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff234ab-9c49-4da2-a37d-84e82dee9cab None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:26.187664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff234ab-9c49-4da2-a37d-84e82dee9cab None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:26.188037 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff234ab-9c49-4da2-a37d-84e82dee9cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:26.220034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2ff234ab-9c49-4da2-a37d-84e82dee9cab None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:30:26.221456 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2ff234ab-9c49-4da2-a37d-84e82dee9cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:26.236162 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2252/4526] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:30:26.237377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a93a4-0afc-4b9b-9779-9c1aa2b77393 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:26.256462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a93a4-0afc-4b9b-9779-9c1aa2b77393 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:26.271663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a79e44-43c8-4b50-b94d-3e5c5a38520e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:26.272716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a79e44-43c8-4b50-b94d-3e5c5a38520e admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:26.273785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a79e44-43c8-4b50-b94d-3e5c5a38520e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:26.274215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a79e44-43c8-4b50-b94d-3e5c5a38520e admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:26.275056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a79e44-43c8-4b50-b94d-3e5c5a38520e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:30:26.275784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a79e44-43c8-4b50-b94d-3e5c5a38520e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:26.277944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a79e44-43c8-4b50-b94d-3e5c5a38520e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:26.301324 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2275/4527] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:30:26.302875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff234ab-9c49-4da2-a37d-84e82dee9cab None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:26.313882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff234ab-9c49-4da2-a37d-84e82dee9cab None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:26.326123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287ba51-3cdd-4e05-902c-889eee703ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:26.327368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287ba51-3cdd-4e05-902c-889eee703ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:26.327666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287ba51-3cdd-4e05-902c-889eee703ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:26.327964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287ba51-3cdd-4e05-902c-889eee703ad7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:26.328951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6287ba51-3cdd-4e05-902c-889eee703ad7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:26.331332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6287ba51-3cdd-4e05-902c-889eee703ad7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:26.390851 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2253/4528] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:30:26 2022] POST /identity/v3/projects => generated 385 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:30:26.395412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a79e44-43c8-4b50-b94d-3e5c5a38520e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:26.417377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a79e44-43c8-4b50-b94d-3e5c5a38520e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:26.587249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783329b-7a27-44ba-81ad-a886dd27a269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:26.590129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783329b-7a27-44ba-81ad-a886dd27a269 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:26.590462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783329b-7a27-44ba-81ad-a886dd27a269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:26.590773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783329b-7a27-44ba-81ad-a886dd27a269 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:26.591510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783329b-7a27-44ba-81ad-a886dd27a269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:26.593604 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783329b-7a27-44ba-81ad-a886dd27a269 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:26.648597 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2276/4529] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:30:26 2022] POST /identity/v3/users => generated 293 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:30:26.649570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287ba51-3cdd-4e05-902c-889eee703ad7 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:26.666308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287ba51-3cdd-4e05-902c-889eee703ad7 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:26.674769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea90913-65d3-4b05-9dd3-df10af49b23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:26.676287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea90913-65d3-4b05-9dd3-df10af49b23c admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:26.676805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea90913-65d3-4b05-9dd3-df10af49b23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:26.677759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea90913-65d3-4b05-9dd3-df10af49b23c admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:26.678714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea90913-65d3-4b05-9dd3-df10af49b23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:26.680632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea90913-65d3-4b05-9dd3-df10af49b23c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:26.694341 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2254/4530] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:30:26.698197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783329b-7a27-44ba-81ad-a886dd27a269 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:26.713076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783329b-7a27-44ba-81ad-a886dd27a269 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:26.720006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c418c55-1f11-4495-9d53-3af8a5bb9ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:26.720864 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c418c55-1f11-4495-9d53-3af8a5bb9ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:26.721133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c418c55-1f11-4495-9d53-3af8a5bb9ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:26.721412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c418c55-1f11-4495-9d53-3af8a5bb9ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:26.722165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c418c55-1f11-4495-9d53-3af8a5bb9ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:26.724243 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c418c55-1f11-4495-9d53-3af8a5bb9ec7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:26.746815 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2277/4531] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:30:26.750704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea90913-65d3-4b05-9dd3-df10af49b23c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:26.763090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea90913-65d3-4b05-9dd3-df10af49b23c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:26.773769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b7bde-8334-44ff-8a44-0939b8a7d6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:26.775374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b7bde-8334-44ff-8a44-0939b8a7d6a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:26.775666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b7bde-8334-44ff-8a44-0939b8a7d6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:26.776180 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b7bde-8334-44ff-8a44-0939b8a7d6a7 admin admin] PATH_INFO: `/v3/projects/5f88662ebb674ad99a4d36651dee967a/users/474a78f0b2784e01b3d2a6ff6694b8bb/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:26.789639 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:26.799032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b7bde-8334-44ff-8a44-0939b8a7d6a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f88662ebb674ad99a4d36651dee967a, user_id=474a78f0b2784e01b3d2a6ff6694b8bb, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:26.803126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b7bde-8334-44ff-8a44-0939b8a7d6a7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:26.827867 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2255/4532] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:30:26 2022] PUT /identity/v3/projects/5f88662ebb674ad99a4d36651dee967a/users/474a78f0b2784e01b3d2a6ff6694b8bb/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:30:26.835368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93d405-ba37-4991-b85d-c875c83793fd None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:26.836330 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93d405-ba37-4991-b85d-c875c83793fd None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:26.836910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93d405-ba37-4991-b85d-c875c83793fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:26.874111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-bc93d405-ba37-4991-b85d-c875c83793fd None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:30:26.890871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-bc93d405-ba37-4991-b85d-c875c83793fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:27.040324 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2278/4533] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:30:27.061842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b7bde-8334-44ff-8a44-0939b8a7d6a7 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:27.066475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-449b7bde-8334-44ff-8a44-0939b8a7d6a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:27.237806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b7bde-8334-44ff-8a44-0939b8a7d6a7 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:27.243608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce14146-f161-4285-8da9-13125cadcb0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:27.244354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce14146-f161-4285-8da9-13125cadcb0f service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:27.244770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce14146-f161-4285-8da9-13125cadcb0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:27.245411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce14146-f161-4285-8da9-13125cadcb0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:27.264299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce14146-f161-4285-8da9-13125cadcb0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:27.266060 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce14146-f161-4285-8da9-13125cadcb0f service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:27.279466 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2256/4534] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:30:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:30:29.663362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93d405-ba37-4991-b85d-c875c83793fd None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:29.665764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-bc93d405-ba37-4991-b85d-c875c83793fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:29.704553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93d405-ba37-4991-b85d-c875c83793fd None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:29.712088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518f4bd-8921-40e8-a29a-39c2932bd709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:29.712755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518f4bd-8921-40e8-a29a-39c2932bd709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:29.713335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518f4bd-8921-40e8-a29a-39c2932bd709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:29.713612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518f4bd-8921-40e8-a29a-39c2932bd709 admin admin] PATH_INFO: `/v3/users/845cd61b22924fd3a915186a6093ac12` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:29.715042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d518f4bd-8921-40e8-a29a-39c2932bd709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=845cd61b22924fd3a915186a6093ac12)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:29.717175 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d518f4bd-8921-40e8-a29a-39c2932bd709 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:29.734128 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:29.778894 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d518f4bd-8921-40e8-a29a-39c2932bd709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '845cd61b22924fd3a915186a6093ac12'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:30:29.792772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d518f4bd-8921-40e8-a29a-39c2932bd709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '845cd61b22924fd3a915186a6093ac12'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:30:29.807053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefde8f-0127-4ac7-a4c0-49e8e0950b96 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:29.807606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefde8f-0127-4ac7-a4c0-49e8e0950b96 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:29.808321 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefde8f-0127-4ac7-a4c0-49e8e0950b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:29.810545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d518f4bd-8921-40e8-a29a-39c2932bd709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '845cd61b22924fd3a915186a6093ac12'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:30:29.811263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d518f4bd-8921-40e8-a29a-39c2932bd709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '845cd61b22924fd3a915186a6093ac12'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:30:29.821850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d518f4bd-8921-40e8-a29a-39c2932bd709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '845cd61b22924fd3a915186a6093ac12'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:30:29.834177 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2279/4535] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:30:29 2022] DELETE /identity/v3/users/845cd61b22924fd3a915186a6093ac12 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:30:29.869409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-aaefde8f-0127-4ac7-a4c0-49e8e0950b96 None None] MFA Rules not processed for user `474a78f0b2784e01b3d2a6ff6694b8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:30:29.872411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-aaefde8f-0127-4ac7-a4c0-49e8e0950b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:29.992862 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2257/4536] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:30:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:30:30.004221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b712a6-8a63-43f1-9c6c-cece92b8582f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:30.004900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b712a6-8a63-43f1-9c6c-cece92b8582f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:30.005672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b712a6-8a63-43f1-9c6c-cece92b8582f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:30.031723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-67b712a6-8a63-43f1-9c6c-cece92b8582f None None] MFA Rules not processed for user `474a78f0b2784e01b3d2a6ff6694b8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:30:30.034733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-67b712a6-8a63-43f1-9c6c-cece92b8582f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:30.056586 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2280/4537] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:30:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:30:30.062949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e7180-4a8f-402b-b740-cf19f3a40f39 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:30.063316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e7180-4a8f-402b-b740-cf19f3a40f39 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:30.063631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e7180-4a8f-402b-b740-cf19f3a40f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:30.088816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-857e7180-4a8f-402b-b740-cf19f3a40f39 None None] MFA Rules not processed for user `474a78f0b2784e01b3d2a6ff6694b8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:30:30.090956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-857e7180-4a8f-402b-b740-cf19f3a40f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:30.111346 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2258/4538] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:30:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:30:30.121410 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b712a6-8a63-43f1-9c6c-cece92b8582f None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:30.123545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-67b712a6-8a63-43f1-9c6c-cece92b8582f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:30.285504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b712a6-8a63-43f1-9c6c-cece92b8582f None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:30.294213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c59b3-f41d-4f15-bd10-2e2a3da9c4e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:30.294851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c59b3-f41d-4f15-bd10-2e2a3da9c4e6 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:30.295131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c59b3-f41d-4f15-bd10-2e2a3da9c4e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:30.295963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c59b3-f41d-4f15-bd10-2e2a3da9c4e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:30.310548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c59b3-f41d-4f15-bd10-2e2a3da9c4e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:30.312996 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c59b3-f41d-4f15-bd10-2e2a3da9c4e6 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:30.339558 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2281/4539] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:30:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:30:30.386061 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e7180-4a8f-402b-b740-cf19f3a40f39 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:30.387567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-857e7180-4a8f-402b-b740-cf19f3a40f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:30.540731 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e7180-4a8f-402b-b740-cf19f3a40f39 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:30.547245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2850b8e-887e-46c0-822c-9592a98db007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:30.548608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2850b8e-887e-46c0-822c-9592a98db007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:30.549209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2850b8e-887e-46c0-822c-9592a98db007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:30.549908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2850b8e-887e-46c0-822c-9592a98db007 admin admin] PATH_INFO: `/v3/projects/d8face435f3549b5adbadf2f94707712` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:30.551520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2850b8e-887e-46c0-822c-9592a98db007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8face435f3549b5adbadf2f94707712)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:30.553991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2850b8e-887e-46c0-822c-9592a98db007 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:30.579339 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:30.637132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a2850b8e-887e-46c0-822c-9592a98db007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8face435f3549b5adbadf2f94707712', 'request_id': 'req-a2850b8e-887e-46c0-822c-9592a98db007'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:30:30.648316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a2850b8e-887e-46c0-822c-9592a98db007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8face435f3549b5adbadf2f94707712', 'request_id': 'req-a2850b8e-887e-46c0-822c-9592a98db007'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:30:30.658476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a2850b8e-887e-46c0-822c-9592a98db007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8face435f3549b5adbadf2f94707712', 'request_id': 'req-a2850b8e-887e-46c0-822c-9592a98db007'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:30:30.684206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a2850b8e-887e-46c0-822c-9592a98db007 admin admin] The token cache is being invalidate because project d8face435f3549b5adbadf2f94707712 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:30:30.684651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a2850b8e-887e-46c0-822c-9592a98db007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:30:30.685728 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a2850b8e-887e-46c0-822c-9592a98db007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:30:30.689030 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2259/4540] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:30:30 2022] DELETE /identity/v3/projects/d8face435f3549b5adbadf2f94707712 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:30:30.695058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7173a4-d666-4e59-a147-6c5ee7c0fa85 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:30.695601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7173a4-d666-4e59-a147-6c5ee7c0fa85 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:30.695601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7173a4-d666-4e59-a147-6c5ee7c0fa85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:30.730384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-bb7173a4-d666-4e59-a147-6c5ee7c0fa85 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:30:30.744146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-bb7173a4-d666-4e59-a147-6c5ee7c0fa85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:30.869283 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2282/4541] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:30:30.870598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d6e65-130c-4bdc-a303-c82d5a7ae552 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:30.871024 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d6e65-130c-4bdc-a303-c82d5a7ae552 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:30.871196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d6e65-130c-4bdc-a303-c82d5a7ae552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:30.908908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-8a9d6e65-130c-4bdc-a303-c82d5a7ae552 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:30:30.911099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8a9d6e65-130c-4bdc-a303-c82d5a7ae552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:30.930083 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2260/4542] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:30:30.932863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7173a4-d666-4e59-a147-6c5ee7c0fa85 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:30.959042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7173a4-d666-4e59-a147-6c5ee7c0fa85 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:30.999201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adb289-8214-4167-b552-25786414e1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:31.000337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adb289-8214-4167-b552-25786414e1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:31.000816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adb289-8214-4167-b552-25786414e1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:31.001295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9adb289-8214-4167-b552-25786414e1a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:31.002214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adb289-8214-4167-b552-25786414e1a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:30:31.002742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adb289-8214-4167-b552-25786414e1a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:31.005444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9adb289-8214-4167-b552-25786414e1a8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:31.017767 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:31.044326 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2283/4543] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:30:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:30:31.058386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d6e65-130c-4bdc-a303-c82d5a7ae552 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:31.101502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d6e65-130c-4bdc-a303-c82d5a7ae552 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:31.107846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf235c38-c6b4-4560-a889-88adb8367e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:31.109067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf235c38-c6b4-4560-a889-88adb8367e52 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:31.109067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf235c38-c6b4-4560-a889-88adb8367e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:31.109285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf235c38-c6b4-4560-a889-88adb8367e52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:31.109956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf235c38-c6b4-4560-a889-88adb8367e52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:31.112393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf235c38-c6b4-4560-a889-88adb8367e52 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:31.224097 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2261/4544] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:30:31 2022] POST /identity/v3/projects => generated 403 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:30:31.228338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adb289-8214-4167-b552-25786414e1a8 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:31.243213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9adb289-8214-4167-b552-25786414e1a8 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:31.393218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb5f67-ef68-48ac-8543-0a395aee3eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:31.393218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb5f67-ef68-48ac-8543-0a395aee3eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:31.393712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb5f67-ef68-48ac-8543-0a395aee3eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:31.394112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb5f67-ef68-48ac-8543-0a395aee3eb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:31.394887 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb5f67-ef68-48ac-8543-0a395aee3eb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:31.398020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb5f67-ef68-48ac-8543-0a395aee3eb5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:31.439227 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2284/4545] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:30:31 2022] POST /identity/v3/users => generated 302 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:30:31.444870 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf235c38-c6b4-4560-a889-88adb8367e52 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:31.458930 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf235c38-c6b4-4560-a889-88adb8367e52 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:31.464851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15339ae1-e8c8-4e9b-aaea-4f302ecdbce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:31.465877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15339ae1-e8c8-4e9b-aaea-4f302ecdbce0 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:31.467296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15339ae1-e8c8-4e9b-aaea-4f302ecdbce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:31.467760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15339ae1-e8c8-4e9b-aaea-4f302ecdbce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:31.468763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15339ae1-e8c8-4e9b-aaea-4f302ecdbce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:31.470605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15339ae1-e8c8-4e9b-aaea-4f302ecdbce0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:31.487752 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2262/4546] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:30:31.492363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb5f67-ef68-48ac-8543-0a395aee3eb5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:31.516562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb5f67-ef68-48ac-8543-0a395aee3eb5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:31.543387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae00a9-1208-4b39-a610-8815c70c13c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:31.547721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae00a9-1208-4b39-a610-8815c70c13c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:31.551536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae00a9-1208-4b39-a610-8815c70c13c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:31.551536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae00a9-1208-4b39-a610-8815c70c13c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:31.552494 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae00a9-1208-4b39-a610-8815c70c13c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:31.556710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae00a9-1208-4b39-a610-8815c70c13c1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:31.593615 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2285/4547] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:30:31 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:30:31.597840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15339ae1-e8c8-4e9b-aaea-4f302ecdbce0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:31.612220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15339ae1-e8c8-4e9b-aaea-4f302ecdbce0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:31.630052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7e527-3b9e-4571-8954-bde1b173aaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:31.630982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7e527-3b9e-4571-8954-bde1b173aaf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:31.631412 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7e527-3b9e-4571-8954-bde1b173aaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:31.632552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7e527-3b9e-4571-8954-bde1b173aaf5 admin admin] PATH_INFO: `/v3/projects/ec14c7253bf944819d3b6e203ea4b9ae/users/8f2c4d9c50fe4c08b3619994e94470c6/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:31.672437 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7e527-3b9e-4571-8954-bde1b173aaf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec14c7253bf944819d3b6e203ea4b9ae, user_id=8f2c4d9c50fe4c08b3619994e94470c6, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:31.676520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7e527-3b9e-4571-8954-bde1b173aaf5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:31.716049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93f025-0670-426a-92f0-e223ff8e8330 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:31.716049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93f025-0670-426a-92f0-e223ff8e8330 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:31.716622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93f025-0670-426a-92f0-e223ff8e8330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:31.719115 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2263/4548] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:30:31 2022] PUT /identity/v3/projects/ec14c7253bf944819d3b6e203ea4b9ae/users/8f2c4d9c50fe4c08b3619994e94470c6/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:30:31.743946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-db93f025-0670-426a-92f0-e223ff8e8330 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:30:31.745558 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-db93f025-0670-426a-92f0-e223ff8e8330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:31.845219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955d03b-25b6-455a-a654-3302609b5bdf None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:31.845219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955d03b-25b6-455a-a654-3302609b5bdf None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:31.845219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955d03b-25b6-455a-a654-3302609b5bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:31.897946 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2286/4549] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:30:31.904859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93f025-0670-426a-92f0-e223ff8e8330 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:31.906347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-db93f025-0670-426a-92f0-e223ff8e8330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:31.908876 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2955d03b-25b6-455a-a654-3302609b5bdf None None] MFA Rules not processed for user `474a78f0b2784e01b3d2a6ff6694b8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:30:31.910760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2955d03b-25b6-455a-a654-3302609b5bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:32.152650 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2264/4550] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:30:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:30:32.163095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93f025-0670-426a-92f0-e223ff8e8330 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:32.179976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7466fa-565e-4731-9859-e40c3d3c872e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:32.180971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7466fa-565e-4731-9859-e40c3d3c872e service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:32.182704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7466fa-565e-4731-9859-e40c3d3c872e service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:32.182704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7466fa-565e-4731-9859-e40c3d3c872e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:32.195199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955d03b-25b6-455a-a654-3302609b5bdf None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:32.215453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7466fa-565e-4731-9859-e40c3d3c872e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:32.218581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7466fa-565e-4731-9859-e40c3d3c872e service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:32.221982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955d03b-25b6-455a-a654-3302609b5bdf None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:32.243352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae8667-cd0a-4fb3-9ddc-7715749f1ee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:32.246634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae8667-cd0a-4fb3-9ddc-7715749f1ee6 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:32.247324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae8667-cd0a-4fb3-9ddc-7715749f1ee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:32.247812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae8667-cd0a-4fb3-9ddc-7715749f1ee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:32.257495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a9ae8667-cd0a-4fb3-9ddc-7715749f1ee6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:32.274893 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2287/4551] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:30:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:30:32.322490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae8667-cd0a-4fb3-9ddc-7715749f1ee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:32.324407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae8667-cd0a-4fb3-9ddc-7715749f1ee6 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:32.374433 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2265/4552] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:30:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:30:35.165351 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98e975-0518-4fc8-bf06-0d173cf51964 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:35.165866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98e975-0518-4fc8-bf06-0d173cf51964 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:35.166210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98e975-0518-4fc8-bf06-0d173cf51964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:35.228886 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-df98e975-0518-4fc8-bf06-0d173cf51964 None None] MFA Rules not processed for user `474a78f0b2784e01b3d2a6ff6694b8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:30:35.254925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-df98e975-0518-4fc8-bf06-0d173cf51964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:35.311040 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2288/4553] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:30:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:30:37.380289 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae8667-cd0a-4fb3-9ddc-7715749f1ee6 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:37.382119 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a9ae8667-cd0a-4fb3-9ddc-7715749f1ee6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:37.400707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae8667-cd0a-4fb3-9ddc-7715749f1ee6 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:37.414316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4690b2-2b5a-4242-b335-fb1c6e502194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:37.415208 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4690b2-2b5a-4242-b335-fb1c6e502194 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:37.415659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4690b2-2b5a-4242-b335-fb1c6e502194 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:37.416134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4690b2-2b5a-4242-b335-fb1c6e502194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:37.426461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ba4690b2-2b5a-4242-b335-fb1c6e502194 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:37.473089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4690b2-2b5a-4242-b335-fb1c6e502194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:37.477983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4690b2-2b5a-4242-b335-fb1c6e502194 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:37.514501 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2266/4554] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:30:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:30:38.848595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98e975-0518-4fc8-bf06-0d173cf51964 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:38.850028 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-df98e975-0518-4fc8-bf06-0d173cf51964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:38.893776 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:39.177551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98e975-0518-4fc8-bf06-0d173cf51964 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:39.207826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2074e6d-f8f8-4a2e-ab19-74348ba3b0e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:39.207826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2074e6d-f8f8-4a2e-ab19-74348ba3b0e2 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:39.209968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2074e6d-f8f8-4a2e-ab19-74348ba3b0e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:39.210346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2074e6d-f8f8-4a2e-ab19-74348ba3b0e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:39.216462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a2074e6d-f8f8-4a2e-ab19-74348ba3b0e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:39.267574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2074e6d-f8f8-4a2e-ab19-74348ba3b0e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:39.271795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2074e6d-f8f8-4a2e-ab19-74348ba3b0e2 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:39.348385 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2289/4555] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:30:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:30:41.627060 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc8793-b559-44c9-afac-59b809776a41 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:41.627639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc8793-b559-44c9-afac-59b809776a41 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:41.628462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc8793-b559-44c9-afac-59b809776a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:41.679337 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-12dc8793-b559-44c9-afac-59b809776a41 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:30:41.681060 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-12dc8793-b559-44c9-afac-59b809776a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:41.727983 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:41.953524 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2267/4556] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:30:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:30:41.987583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2074e6d-f8f8-4a2e-ab19-74348ba3b0e2 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:41.990204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a2074e6d-f8f8-4a2e-ab19-74348ba3b0e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:42.109596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2074e6d-f8f8-4a2e-ab19-74348ba3b0e2 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:42.123259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ee2a1-2779-4937-853e-77002363dedd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:42.124511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ee2a1-2779-4937-853e-77002363dedd service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:42.125671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ee2a1-2779-4937-853e-77002363dedd service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:42.125671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ee2a1-2779-4937-853e-77002363dedd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:42.155109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ee2a1-2779-4937-853e-77002363dedd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:42.159812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ee2a1-2779-4937-853e-77002363dedd service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:42.181071 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2290/4557] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:30:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:30:48.973370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc8793-b559-44c9-afac-59b809776a41 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:48.975633 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-12dc8793-b559-44c9-afac-59b809776a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:49.016304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc8793-b559-44c9-afac-59b809776a41 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:49.033315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff19ac-8d0f-4e41-a0f8-376cf85cf56f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:49.034143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff19ac-8d0f-4e41-a0f8-376cf85cf56f service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:49.034286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff19ac-8d0f-4e41-a0f8-376cf85cf56f service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:49.034601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff19ac-8d0f-4e41-a0f8-376cf85cf56f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:49.036516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-41ff19ac-8d0f-4e41-a0f8-376cf85cf56f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:49.051570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff19ac-8d0f-4e41-a0f8-376cf85cf56f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:49.053795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff19ac-8d0f-4e41-a0f8-376cf85cf56f service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:49.066990 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2268/4558] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:30:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:30:51.629241 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6335d5-1b60-46f4-9ae4-0bb97f69eaa6 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:51.629803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6335d5-1b60-46f4-9ae4-0bb97f69eaa6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:51.629803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6335d5-1b60-46f4-9ae4-0bb97f69eaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:51.663847 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1a6335d5-1b60-46f4-9ae4-0bb97f69eaa6 None None] MFA Rules not processed for user `ef29bd35cca547c39d76c54058d32979`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:30:51.665524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1a6335d5-1b60-46f4-9ae4-0bb97f69eaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:51.794091 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2291/4559] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:30:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:30:53.145281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed65c4-a702-49c7-801b-39f1243bf7c7 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:53.145281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed65c4-a702-49c7-801b-39f1243bf7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:53.145281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed65c4-a702-49c7-801b-39f1243bf7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:53.208408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d0ed65c4-a702-49c7-801b-39f1243bf7c7 None None] MFA Rules not processed for user `8f2c4d9c50fe4c08b3619994e94470c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:30:53.219228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d0ed65c4-a702-49c7-801b-39f1243bf7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:53.415986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6335d5-1b60-46f4-9ae4-0bb97f69eaa6 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:53.417196 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2269/4560] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:30:53 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:30:53.448803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6335d5-1b60-46f4-9ae4-0bb97f69eaa6 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:53.471794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662d194-631f-4a66-b46e-372ab3d193d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:53.472557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662d194-631f-4a66-b46e-372ab3d193d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:53.473030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662d194-631f-4a66-b46e-372ab3d193d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:53.474267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662d194-631f-4a66-b46e-372ab3d193d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:53.475337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662d194-631f-4a66-b46e-372ab3d193d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:53.481457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662d194-631f-4a66-b46e-372ab3d193d8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:53.548828 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2292/4561] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:30:53 2022] POST /identity/v3/projects => generated 403 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:30:53.553893 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed65c4-a702-49c7-801b-39f1243bf7c7 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:53.571755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed65c4-a702-49c7-801b-39f1243bf7c7 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:53.760733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308e1ec-ea00-4b04-8aeb-11ee5cde437d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:53.763980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308e1ec-ea00-4b04-8aeb-11ee5cde437d admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:53.764497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308e1ec-ea00-4b04-8aeb-11ee5cde437d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:53.765456 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308e1ec-ea00-4b04-8aeb-11ee5cde437d admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:53.768034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308e1ec-ea00-4b04-8aeb-11ee5cde437d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:53.775536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308e1ec-ea00-4b04-8aeb-11ee5cde437d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:53.880128 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2270/4562] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:30:53 2022] POST /identity/v3/users => generated 302 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:30:53.887408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662d194-631f-4a66-b46e-372ab3d193d8 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:53.915104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662d194-631f-4a66-b46e-372ab3d193d8 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:53.936119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f3294-3019-4fb0-89dc-0296c694ebd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:53.936756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f3294-3019-4fb0-89dc-0296c694ebd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:53.937036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f3294-3019-4fb0-89dc-0296c694ebd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:53.937306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f3294-3019-4fb0-89dc-0296c694ebd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:53.937993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f3294-3019-4fb0-89dc-0296c694ebd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:53.939739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f3294-3019-4fb0-89dc-0296c694ebd0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:53.959525 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:53.984927 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2293/4563] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:30:53.989854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308e1ec-ea00-4b04-8aeb-11ee5cde437d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:54.006855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308e1ec-ea00-4b04-8aeb-11ee5cde437d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:54.033588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca00006-6f1c-4981-9fb8-436889bfccc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:54.034462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca00006-6f1c-4981-9fb8-436889bfccc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:54.034921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca00006-6f1c-4981-9fb8-436889bfccc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:54.035334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca00006-6f1c-4981-9fb8-436889bfccc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:54.036165 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca00006-6f1c-4981-9fb8-436889bfccc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:54.041113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca00006-6f1c-4981-9fb8-436889bfccc5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:54.078958 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2271/4564] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:30:54.079972 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f3294-3019-4fb0-89dc-0296c694ebd0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:30:54.104728 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f3294-3019-4fb0-89dc-0296c694ebd0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:30:54.116511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a715cb5-de8b-4517-83c9-7a999aab369e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:30:54.117324 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a715cb5-de8b-4517-83c9-7a999aab369e admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:54.117705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a715cb5-de8b-4517-83c9-7a999aab369e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:54.117872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a715cb5-de8b-4517-83c9-7a999aab369e admin admin] PATH_INFO: `/v3/projects/3340c6539459423b8d0dc6d92bb16d21/users/16e2dae4260e4f00bca7e6f928f118ec/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:54.172511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a715cb5-de8b-4517-83c9-7a999aab369e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3340c6539459423b8d0dc6d92bb16d21, user_id=16e2dae4260e4f00bca7e6f928f118ec, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:30:54.178841 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a715cb5-de8b-4517-83c9-7a999aab369e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:30:54.203022 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2294/4565] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:30:54 2022] PUT /identity/v3/projects/3340c6539459423b8d0dc6d92bb16d21/users/16e2dae4260e4f00bca7e6f928f118ec/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:30:55.283685 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c071a-0f62-46d6-89cb-6981513d334f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:30:55.284265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c071a-0f62-46d6-89cb-6981513d334f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:30:55.284369 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c071a-0f62-46d6-89cb-6981513d334f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:30:55.330447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-843c071a-0f62-46d6-89cb-6981513d334f None None] MFA Rules not processed for user `d1f0c01c340940388b440932d51988ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:30:55.330447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-843c071a-0f62-46d6-89cb-6981513d334f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:30:55.350968 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:30:55.503386 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2272/4566] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:30:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:31:04.195992 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:05.487225 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=17 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:06.720224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5dd6a4-3779-480c-aeb4-951a4d7ac4c9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:06.720735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5dd6a4-3779-480c-aeb4-951a4d7ac4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:06.720829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5dd6a4-3779-480c-aeb4-951a4d7ac4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:06.788925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1c5dd6a4-3779-480c-aeb4-951a4d7ac4c9 None None] MFA Rules not processed for user `16e2dae4260e4f00bca7e6f928f118ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:31:06.790173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1c5dd6a4-3779-480c-aeb4-951a4d7ac4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:31:06.950458 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2295/4567] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:31:06 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:31:06.961281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1907d7-2469-4acf-af34-1140f4228303 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:06.962263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1907d7-2469-4acf-af34-1140f4228303 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:06.962763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1907d7-2469-4acf-af34-1140f4228303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:07.032865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-bd1907d7-2469-4acf-af34-1140f4228303 None None] MFA Rules not processed for user `8f2c4d9c50fe4c08b3619994e94470c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:31:07.034145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bd1907d7-2469-4acf-af34-1140f4228303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:31:07.187616 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2273/4568] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:31:06 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:31:07.269079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5dd6a4-3779-480c-aeb4-951a4d7ac4c9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:31:07.431549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5dd6a4-3779-480c-aeb4-951a4d7ac4c9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:31:07.445530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fcd901-c892-403e-8317-b1db6c670cda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:31:07.446431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcd901-c892-403e-8317-b1db6c670cda service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:07.446868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcd901-c892-403e-8317-b1db6c670cda service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:07.447155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcd901-c892-403e-8317-b1db6c670cda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:07.469748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fcd901-c892-403e-8317-b1db6c670cda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:31:07.471641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fcd901-c892-403e-8317-b1db6c670cda service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:31:07.505328 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2296/4569] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:31:07 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:31:16.291662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1907d7-2469-4acf-af34-1140f4228303 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:31:16.312518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1907d7-2469-4acf-af34-1140f4228303 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:31:16.322687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674e3eb-7383-47dc-85ac-9e983112e312 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:31:16.323395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674e3eb-7383-47dc-85ac-9e983112e312 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:16.323912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674e3eb-7383-47dc-85ac-9e983112e312 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:16.324306 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674e3eb-7383-47dc-85ac-9e983112e312 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:16.326557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5674e3eb-7383-47dc-85ac-9e983112e312 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:31:16.418088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674e3eb-7383-47dc-85ac-9e983112e312 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:31:16.419903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674e3eb-7383-47dc-85ac-9e983112e312 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:31:16.449324 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2274/4570] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:31:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:31:17.487322 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=66 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:26.430060 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=53 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:27.517392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a28e9f-33e8-4ecc-994f-6469c1e30dbf None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:27.518001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a28e9f-33e8-4ecc-994f-6469c1e30dbf None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:27.518001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a28e9f-33e8-4ecc-994f-6469c1e30dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:27.677729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-89a28e9f-33e8-4ecc-994f-6469c1e30dbf None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:31:27.694075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-89a28e9f-33e8-4ecc-994f-6469c1e30dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:31:27.809768 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2297/4571] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:31:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:31:27.822628 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674e3eb-7383-47dc-85ac-9e983112e312 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:31:27.914616 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674e3eb-7383-47dc-85ac-9e983112e312 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:31:27.920793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329f135-6df5-4ba8-9cdb-9621698b665a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:31:27.921705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329f135-6df5-4ba8-9cdb-9621698b665a service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:27.922109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329f135-6df5-4ba8-9cdb-9621698b665a service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:27.922516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329f135-6df5-4ba8-9cdb-9621698b665a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:27.935080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329f135-6df5-4ba8-9cdb-9621698b665a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:31:27.937139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329f135-6df5-4ba8-9cdb-9621698b665a service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:31:28.002682 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2275/4572] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:31:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:31:29.331305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a28e9f-33e8-4ecc-994f-6469c1e30dbf None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:31:29.358504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a28e9f-33e8-4ecc-994f-6469c1e30dbf None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:31:29.375803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc4abe-9034-4ca5-b0ee-2f3d99874375 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:31:29.381840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc4abe-9034-4ca5-b0ee-2f3d99874375 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:29.383154 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc4abe-9034-4ca5-b0ee-2f3d99874375 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:29.383518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc4abe-9034-4ca5-b0ee-2f3d99874375 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:29.397923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc4abe-9034-4ca5-b0ee-2f3d99874375 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:31:29.399544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc4abe-9034-4ca5-b0ee-2f3d99874375 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:31:29.418965 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2298/4573] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:31:29 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:31:30.037977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329f135-6df5-4ba8-9cdb-9621698b665a service swift] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:31:30.057049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329f135-6df5-4ba8-9cdb-9621698b665a service swift] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:31:30.070399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18399968-1a87-4ce2-bed2-8c3c5dba1c51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:31:30.072764 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18399968-1a87-4ce2-bed2-8c3c5dba1c51 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:30.073298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18399968-1a87-4ce2-bed2-8c3c5dba1c51 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:30.073822 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18399968-1a87-4ce2-bed2-8c3c5dba1c51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:30.079016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-18399968-1a87-4ce2-bed2-8c3c5dba1c51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:31:30.229572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18399968-1a87-4ce2-bed2-8c3c5dba1c51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:31:30.231483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18399968-1a87-4ce2-bed2-8c3c5dba1c51 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:31:30.268774 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2276/4574] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:31:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:31:39.405893 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=46 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:40.259491 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=64 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:42.770943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc4abe-9034-4ca5-b0ee-2f3d99874375 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:31:42.858895 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc4abe-9034-4ca5-b0ee-2f3d99874375 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:31:42.864495 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cda66b-2fea-44aa-ba10-beb68c1952f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:31:42.865858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cda66b-2fea-44aa-ba10-beb68c1952f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:42.866526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cda66b-2fea-44aa-ba10-beb68c1952f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:42.867034 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cda66b-2fea-44aa-ba10-beb68c1952f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:42.869237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-16cda66b-2fea-44aa-ba10-beb68c1952f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:31:43.061498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cda66b-2fea-44aa-ba10-beb68c1952f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:31:43.063964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cda66b-2fea-44aa-ba10-beb68c1952f2 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:31:43.079490 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2299/4575] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:31:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:31:44.156751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18399968-1a87-4ce2-bed2-8c3c5dba1c51 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:31:44.158962 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-18399968-1a87-4ce2-bed2-8c3c5dba1c51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:31:44.427390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18399968-1a87-4ce2-bed2-8c3c5dba1c51 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:31:44.442888 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ed087-090d-42ca-8c37-7b6b354afdda service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:31:44.461040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ed087-090d-42ca-8c37-7b6b354afdda service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:44.461823 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ed087-090d-42ca-8c37-7b6b354afdda service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:44.462235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ed087-090d-42ca-8c37-7b6b354afdda service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:44.465048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ba9ed087-090d-42ca-8c37-7b6b354afdda service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:31:44.495800 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ed087-090d-42ca-8c37-7b6b354afdda service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:31:44.499526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ed087-090d-42ca-8c37-7b6b354afdda service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:31:44.571519 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2277/4576] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:31:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:31:45.812765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cda66b-2fea-44aa-ba10-beb68c1952f2 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:31:45.814276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-16cda66b-2fea-44aa-ba10-beb68c1952f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:31:45.841222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cda66b-2fea-44aa-ba10-beb68c1952f2 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:31:45.854732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf214818-26dc-469a-ab91-0542b8ae7f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:31:45.855783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf214818-26dc-469a-ab91-0542b8ae7f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:45.856352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf214818-26dc-469a-ab91-0542b8ae7f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:45.856830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf214818-26dc-469a-ab91-0542b8ae7f1f admin admin] PATH_INFO: `/v3/users/8a2c261b4e794705a8725b3b7126bd73` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:45.858260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf214818-26dc-469a-ab91-0542b8ae7f1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a2c261b4e794705a8725b3b7126bd73)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:31:45.860477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf214818-26dc-469a-ab91-0542b8ae7f1f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:31:45.962441 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bf214818-26dc-469a-ab91-0542b8ae7f1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a2c261b4e794705a8725b3b7126bd73'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:31:45.972820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bf214818-26dc-469a-ab91-0542b8ae7f1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a2c261b4e794705a8725b3b7126bd73'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:31:45.988734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bf214818-26dc-469a-ab91-0542b8ae7f1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a2c261b4e794705a8725b3b7126bd73'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:31:45.989778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bf214818-26dc-469a-ab91-0542b8ae7f1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a2c261b4e794705a8725b3b7126bd73'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:31:46.017798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bf214818-26dc-469a-ab91-0542b8ae7f1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a2c261b4e794705a8725b3b7126bd73'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:31:46.067709 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2300/4577] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:31:45 2022] DELETE /identity/v3/users/8a2c261b4e794705a8725b3b7126bd73 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:31:47.307923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ed087-090d-42ca-8c37-7b6b354afdda service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:31:47.327687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ed087-090d-42ca-8c37-7b6b354afdda service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:31:47.489449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d1cbd-35f3-4758-8e07-6f69a99df5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:31:47.490458 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d1cbd-35f3-4758-8e07-6f69a99df5c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:47.494741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d1cbd-35f3-4758-8e07-6f69a99df5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:47.495251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d1cbd-35f3-4758-8e07-6f69a99df5c9 admin admin] PATH_INFO: `/v3/projects/38b7f4c69d5542a88fa2870354d507ce` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:47.496947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d1cbd-35f3-4758-8e07-6f69a99df5c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38b7f4c69d5542a88fa2870354d507ce)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:31:47.500463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d1cbd-35f3-4758-8e07-6f69a99df5c9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:31:47.605168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fe7d1cbd-35f3-4758-8e07-6f69a99df5c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38b7f4c69d5542a88fa2870354d507ce', 'request_id': 'req-fe7d1cbd-35f3-4758-8e07-6f69a99df5c9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:31:47.621411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fe7d1cbd-35f3-4758-8e07-6f69a99df5c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38b7f4c69d5542a88fa2870354d507ce', 'request_id': 'req-fe7d1cbd-35f3-4758-8e07-6f69a99df5c9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:31:47.630695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fe7d1cbd-35f3-4758-8e07-6f69a99df5c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38b7f4c69d5542a88fa2870354d507ce', 'request_id': 'req-fe7d1cbd-35f3-4758-8e07-6f69a99df5c9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:31:47.665519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fe7d1cbd-35f3-4758-8e07-6f69a99df5c9 admin admin] The token cache is being invalidate because project 38b7f4c69d5542a88fa2870354d507ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:31:47.665829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fe7d1cbd-35f3-4758-8e07-6f69a99df5c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:31:47.667256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fe7d1cbd-35f3-4758-8e07-6f69a99df5c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:31:47.669450 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2278/4578] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:31:47 2022] DELETE /identity/v3/projects/38b7f4c69d5542a88fa2870354d507ce => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:31:47.675044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59720d4e-1c28-4413-abda-e6c137d60826 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:47.676060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59720d4e-1c28-4413-abda-e6c137d60826 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:47.676609 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59720d4e-1c28-4413-abda-e6c137d60826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:47.717106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-59720d4e-1c28-4413-abda-e6c137d60826 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:31:47.721470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-59720d4e-1c28-4413-abda-e6c137d60826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:31:47.774021 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:47.907334 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2301/4579] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:31:47.916018 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0616f3-e040-41c6-878a-8d24d8ec3a40 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:47.916304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0616f3-e040-41c6-878a-8d24d8ec3a40 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:47.916584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0616f3-e040-41c6-878a-8d24d8ec3a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:47.960328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9b0616f3-e040-41c6-878a-8d24d8ec3a40 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:31:47.962501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9b0616f3-e040-41c6-878a-8d24d8ec3a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:31:47.989376 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2279/4580] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:31:47.994359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59720d4e-1c28-4413-abda-e6c137d60826 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:31:48.011207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59720d4e-1c28-4413-abda-e6c137d60826 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:31:48.025226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21814ad-c41d-4844-bcc3-ab8a08456b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:31:48.026089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21814ad-c41d-4844-bcc3-ab8a08456b36 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:48.028518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21814ad-c41d-4844-bcc3-ab8a08456b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:48.028956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21814ad-c41d-4844-bcc3-ab8a08456b36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:48.029754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21814ad-c41d-4844-bcc3-ab8a08456b36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:31:48.031846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21814ad-c41d-4844-bcc3-ab8a08456b36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:31:48.037576 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21814ad-c41d-4844-bcc3-ab8a08456b36 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:31:48.071938 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2302/4581] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:31:48.073489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0616f3-e040-41c6-878a-8d24d8ec3a40 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:31:48.084153 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0616f3-e040-41c6-878a-8d24d8ec3a40 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:31:48.097880 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc19fd-3f29-4438-9747-8652cf5df8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:31:48.099936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc19fd-3f29-4438-9747-8652cf5df8ef admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:48.100431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc19fd-3f29-4438-9747-8652cf5df8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:48.100893 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc19fd-3f29-4438-9747-8652cf5df8ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:48.103048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc19fd-3f29-4438-9747-8652cf5df8ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:31:48.105346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc19fd-3f29-4438-9747-8652cf5df8ef admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:31:48.137674 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:48.192221 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2280/4582] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:31:48 2022] POST /identity/v3/projects => generated 361 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:31:48.192969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21814ad-c41d-4844-bcc3-ab8a08456b36 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:31:48.215577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21814ad-c41d-4844-bcc3-ab8a08456b36 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:31:48.412384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8165b-aecf-47df-9b4e-b808fe1741ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:31:48.413114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8165b-aecf-47df-9b4e-b808fe1741ab admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:48.413417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8165b-aecf-47df-9b4e-b808fe1741ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:48.413692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8165b-aecf-47df-9b4e-b808fe1741ab admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:48.414493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8165b-aecf-47df-9b4e-b808fe1741ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:31:48.416839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8165b-aecf-47df-9b4e-b808fe1741ab admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:31:48.466884 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2303/4583] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:31:48 2022] POST /identity/v3/users => generated 281 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:31:48.471819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc19fd-3f29-4438-9747-8652cf5df8ef admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:31:48.489500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc19fd-3f29-4438-9747-8652cf5df8ef admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:31:48.511130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2cb227-eab5-4e7b-9305-c7cded2b898e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:31:48.511830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cb227-eab5-4e7b-9305-c7cded2b898e admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:48.512136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cb227-eab5-4e7b-9305-c7cded2b898e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:48.512406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cb227-eab5-4e7b-9305-c7cded2b898e admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:48.513072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2cb227-eab5-4e7b-9305-c7cded2b898e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:31:48.521764 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2cb227-eab5-4e7b-9305-c7cded2b898e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:31:48.557404 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2281/4584] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:31:48.561690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8165b-aecf-47df-9b4e-b808fe1741ab admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:31:48.592381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8165b-aecf-47df-9b4e-b808fe1741ab admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:31:48.604821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f35f6a-3e3e-4547-9c81-646db20ec7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:31:48.605453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f35f6a-3e3e-4547-9c81-646db20ec7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:48.607919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f35f6a-3e3e-4547-9c81-646db20ec7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:48.608206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f35f6a-3e3e-4547-9c81-646db20ec7e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:48.608888 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f35f6a-3e3e-4547-9c81-646db20ec7e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:31:48.615638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f35f6a-3e3e-4547-9c81-646db20ec7e8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:31:48.645828 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2304/4585] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:31:48.649767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2cb227-eab5-4e7b-9305-c7cded2b898e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:31:48.668429 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2cb227-eab5-4e7b-9305-c7cded2b898e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:31:48.681595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bef4fa-abc0-465d-be07-a36f8b06fbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:31:48.681595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bef4fa-abc0-465d-be07-a36f8b06fbcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:48.681921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bef4fa-abc0-465d-be07-a36f8b06fbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:48.682126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bef4fa-abc0-465d-be07-a36f8b06fbcc admin admin] PATH_INFO: `/v3/projects/669859ebafe34fde91f84fa2f13690fa/users/c8375210725242d2bdcf0710b9652908/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:48.715239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bef4fa-abc0-465d-be07-a36f8b06fbcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=669859ebafe34fde91f84fa2f13690fa, user_id=c8375210725242d2bdcf0710b9652908, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:31:48.718787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bef4fa-abc0-465d-be07-a36f8b06fbcc admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:31:48.768399 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2282/4586] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:31:48 2022] PUT /identity/v3/projects/669859ebafe34fde91f84fa2f13690fa/users/c8375210725242d2bdcf0710b9652908/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:31:48.783066 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8cebb-fc79-4d34-8916-707c34fb7213 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:48.783605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8cebb-fc79-4d34-8916-707c34fb7213 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:48.783836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d8cebb-fc79-4d34-8916-707c34fb7213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:48.854807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-22d8cebb-fc79-4d34-8916-707c34fb7213 None None] MFA Rules not processed for user `c8375210725242d2bdcf0710b9652908`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:31:48.861038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-22d8cebb-fc79-4d34-8916-707c34fb7213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:31:49.101889 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2305/4587] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:31:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:31:49.142861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bef4fa-abc0-465d-be07-a36f8b06fbcc admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:31:49.295243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bef4fa-abc0-465d-be07-a36f8b06fbcc admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:31:49.302769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f10a5-4ab7-45f5-91a5-ffad6e2cc694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:31:49.303428 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f10a5-4ab7-45f5-91a5-ffad6e2cc694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:49.303703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f10a5-4ab7-45f5-91a5-ffad6e2cc694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:49.303995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f10a5-4ab7-45f5-91a5-ffad6e2cc694 admin admin] PATH_INFO: `/v3/users/c8375210725242d2bdcf0710b9652908` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:49.309362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f10a5-4ab7-45f5-91a5-ffad6e2cc694 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8375210725242d2bdcf0710b9652908)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:31:49.314107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f10a5-4ab7-45f5-91a5-ffad6e2cc694 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:31:49.413894 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fb7f10a5-4ab7-45f5-91a5-ffad6e2cc694 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8375210725242d2bdcf0710b9652908'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:31:49.438775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fb7f10a5-4ab7-45f5-91a5-ffad6e2cc694 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8375210725242d2bdcf0710b9652908'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:31:49.488771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fb7f10a5-4ab7-45f5-91a5-ffad6e2cc694 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8375210725242d2bdcf0710b9652908'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:31:49.496751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fb7f10a5-4ab7-45f5-91a5-ffad6e2cc694 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8375210725242d2bdcf0710b9652908'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:31:49.517225 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fb7f10a5-4ab7-45f5-91a5-ffad6e2cc694 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8375210725242d2bdcf0710b9652908'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:31:49.540933 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2283/4588] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:31:49 2022] DELETE /identity/v3/users/c8375210725242d2bdcf0710b9652908 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:31:49.545909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823c4fc-035a-46d4-b44f-d02147be237b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:49.546684 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823c4fc-035a-46d4-b44f-d02147be237b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:49.547137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823c4fc-035a-46d4-b44f-d02147be237b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:49.604174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0823c4fc-035a-46d4-b44f-d02147be237b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:31:49.605485 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0823c4fc-035a-46d4-b44f-d02147be237b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:31:49.674740 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:49.888667 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2306/4589] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:31:49.954870 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f10a5-4ab7-45f5-91a5-ffad6e2cc694 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:31:49.957056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-fb7f10a5-4ab7-45f5-91a5-ffad6e2cc694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:31:50.123499 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:50.217197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f10a5-4ab7-45f5-91a5-ffad6e2cc694 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:31:50.230343 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139272ea-be6e-477e-b660-534b881b9b8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:31:50.231779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139272ea-be6e-477e-b660-534b881b9b8d service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:50.233171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139272ea-be6e-477e-b660-534b881b9b8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:50.233847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139272ea-be6e-477e-b660-534b881b9b8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:50.261228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139272ea-be6e-477e-b660-534b881b9b8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:31:50.263190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139272ea-be6e-477e-b660-534b881b9b8d service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:31:50.287733 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2284/4590] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:31:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:31:53.155411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823c4fc-035a-46d4-b44f-d02147be237b None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:31:53.157722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0823c4fc-035a-46d4-b44f-d02147be237b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:31:53.239710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823c4fc-035a-46d4-b44f-d02147be237b None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:31:53.248159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29555b5-d9f8-414d-bda2-7db34e672f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:31:53.249638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29555b5-d9f8-414d-bda2-7db34e672f93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:53.250114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29555b5-d9f8-414d-bda2-7db34e672f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:53.250543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29555b5-d9f8-414d-bda2-7db34e672f93 admin admin] PATH_INFO: `/v3/projects/669859ebafe34fde91f84fa2f13690fa` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:53.252241 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29555b5-d9f8-414d-bda2-7db34e672f93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=669859ebafe34fde91f84fa2f13690fa)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:31:53.255718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29555b5-d9f8-414d-bda2-7db34e672f93 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:31:53.371532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a29555b5-d9f8-414d-bda2-7db34e672f93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '669859ebafe34fde91f84fa2f13690fa', 'request_id': 'req-a29555b5-d9f8-414d-bda2-7db34e672f93'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:31:53.389452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a29555b5-d9f8-414d-bda2-7db34e672f93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '669859ebafe34fde91f84fa2f13690fa', 'request_id': 'req-a29555b5-d9f8-414d-bda2-7db34e672f93'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:31:53.398054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a29555b5-d9f8-414d-bda2-7db34e672f93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '669859ebafe34fde91f84fa2f13690fa', 'request_id': 'req-a29555b5-d9f8-414d-bda2-7db34e672f93'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:31:53.427241 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a29555b5-d9f8-414d-bda2-7db34e672f93 admin admin] The token cache is being invalidate because project 669859ebafe34fde91f84fa2f13690fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:31:53.427841 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a29555b5-d9f8-414d-bda2-7db34e672f93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:31:53.429066 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a29555b5-d9f8-414d-bda2-7db34e672f93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:31:53.432133 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2307/4591] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:31:53 2022] DELETE /identity/v3/projects/669859ebafe34fde91f84fa2f13690fa => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:31:53.439533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5a569-e89e-4777-bb8a-4187604e6300 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:53.440105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5a569-e89e-4777-bb8a-4187604e6300 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:53.440183 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5a569-e89e-4777-bb8a-4187604e6300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:53.484276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6ea5a569-e89e-4777-bb8a-4187604e6300 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:31:53.496406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6ea5a569-e89e-4777-bb8a-4187604e6300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:31:53.604349 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2285/4592] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:31:53.613098 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ad177-32fe-4378-8492-099fae30fc76 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:53.613382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ad177-32fe-4378-8492-099fae30fc76 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:53.613662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ad177-32fe-4378-8492-099fae30fc76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:53.660359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-923ad177-32fe-4378-8492-099fae30fc76 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:31:53.661587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-923ad177-32fe-4378-8492-099fae30fc76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:31:53.681350 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2308/4593] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:31:53.685692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5a569-e89e-4777-bb8a-4187604e6300 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:31:53.697861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5a569-e89e-4777-bb8a-4187604e6300 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:31:53.703092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8353b68-fa83-4d95-9266-be26894e3302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:31:53.704066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8353b68-fa83-4d95-9266-be26894e3302 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:53.704554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8353b68-fa83-4d95-9266-be26894e3302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:53.705003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8353b68-fa83-4d95-9266-be26894e3302 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:53.706233 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8353b68-fa83-4d95-9266-be26894e3302 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:31:53.706741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8353b68-fa83-4d95-9266-be26894e3302 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:31:53.708630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8353b68-fa83-4d95-9266-be26894e3302 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:31:53.725596 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2286/4594] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:31:53.730326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ad177-32fe-4378-8492-099fae30fc76 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:31:53.743048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ad177-32fe-4378-8492-099fae30fc76 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:31:53.748929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e7183-9308-423c-abab-b237fd25afdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:31:53.750196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e7183-9308-423c-abab-b237fd25afdc admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:53.750351 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e7183-9308-423c-abab-b237fd25afdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:53.753460 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e7183-9308-423c-abab-b237fd25afdc admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:53.754383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e7183-9308-423c-abab-b237fd25afdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:31:53.756954 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e7183-9308-423c-abab-b237fd25afdc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:31:53.800439 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2309/4595] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:31:53 2022] POST /identity/v3/projects => generated 387 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:31:53.801942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8353b68-fa83-4d95-9266-be26894e3302 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:31:53.846704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8353b68-fa83-4d95-9266-be26894e3302 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:31:54.003400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af032743-1d71-45fc-a070-914ca019ce39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:31:54.004396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af032743-1d71-45fc-a070-914ca019ce39 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:54.004396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af032743-1d71-45fc-a070-914ca019ce39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:54.004596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af032743-1d71-45fc-a070-914ca019ce39 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:54.005215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af032743-1d71-45fc-a070-914ca019ce39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:31:54.007250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af032743-1d71-45fc-a070-914ca019ce39 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:31:54.062875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e7183-9308-423c-abab-b237fd25afdc admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:31:54.089223 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2287/4596] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:31:53 2022] POST /identity/v3/users => generated 294 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:31:54.092043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e7183-9308-423c-abab-b237fd25afdc admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:31:54.102230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19caca-a3aa-46aa-9618-a1b7ff06c10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:31:54.103397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19caca-a3aa-46aa-9618-a1b7ff06c10c admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:54.104323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19caca-a3aa-46aa-9618-a1b7ff06c10c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:54.104901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19caca-a3aa-46aa-9618-a1b7ff06c10c admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:54.106564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19caca-a3aa-46aa-9618-a1b7ff06c10c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:31:54.109338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19caca-a3aa-46aa-9618-a1b7ff06c10c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:31:54.130573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af032743-1d71-45fc-a070-914ca019ce39 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:31:54.142360 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2310/4597] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:31:54.145465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af032743-1d71-45fc-a070-914ca019ce39 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:31:54.151301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c00bf1-8bd5-42b4-a150-0ec5fdff6255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:31:54.152150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c00bf1-8bd5-42b4-a150-0ec5fdff6255 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:54.152568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c00bf1-8bd5-42b4-a150-0ec5fdff6255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:54.152985 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c00bf1-8bd5-42b4-a150-0ec5fdff6255 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:54.153839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c00bf1-8bd5-42b4-a150-0ec5fdff6255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:31:54.157263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c00bf1-8bd5-42b4-a150-0ec5fdff6255 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:31:54.178285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19caca-a3aa-46aa-9618-a1b7ff06c10c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:31:54.189632 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2288/4598] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:31:54.191762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19caca-a3aa-46aa-9618-a1b7ff06c10c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:31:54.197375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc9fd7-24b2-4465-a5d0-1c396b44e06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:31:54.198219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc9fd7-24b2-4465-a5d0-1c396b44e06d admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:54.198602 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc9fd7-24b2-4465-a5d0-1c396b44e06d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:54.198976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc9fd7-24b2-4465-a5d0-1c396b44e06d admin admin] PATH_INFO: `/v3/projects/284c227cd03a4c1294ed40d7b1594d56/users/bed65a4d62184f52af3d2dd322eeec47/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:54.238881 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc9fd7-24b2-4465-a5d0-1c396b44e06d admin admin] RBAC: Authorizing `identity:create_grant(project_id=284c227cd03a4c1294ed40d7b1594d56, user_id=bed65a4d62184f52af3d2dd322eeec47, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:31:54.258661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc9fd7-24b2-4465-a5d0-1c396b44e06d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:31:54.311390 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2311/4599] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:31:54 2022] PUT /identity/v3/projects/284c227cd03a4c1294ed40d7b1594d56/users/bed65a4d62184f52af3d2dd322eeec47/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:31:54.316968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edaff3-6cb0-4d0f-a9e4-52ba6d04705d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:54.317445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edaff3-6cb0-4d0f-a9e4-52ba6d04705d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:54.317850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47edaff3-6cb0-4d0f-a9e4-52ba6d04705d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:54.360627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-47edaff3-6cb0-4d0f-a9e4-52ba6d04705d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:31:54.363943 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-47edaff3-6cb0-4d0f-a9e4-52ba6d04705d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:31:54.494150 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:54.523626 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2289/4600] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:31:54.562143 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc9fd7-24b2-4465-a5d0-1c396b44e06d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:31:54.563898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2cbc9fd7-24b2-4465-a5d0-1c396b44e06d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:31:54.653246 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:31:54.723936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc9fd7-24b2-4465-a5d0-1c396b44e06d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:31:54.726996 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631225f-a1e3-4eec-a629-0475e40c9b96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:31:54.727981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631225f-a1e3-4eec-a629-0475e40c9b96 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:54.728497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631225f-a1e3-4eec-a629-0475e40c9b96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:54.728972 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631225f-a1e3-4eec-a629-0475e40c9b96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:54.748124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631225f-a1e3-4eec-a629-0475e40c9b96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:31:54.749577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631225f-a1e3-4eec-a629-0475e40c9b96 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:31:54.765571 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2312/4601] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:31:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:31:59.916391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47edaff3-6cb0-4d0f-a9e4-52ba6d04705d None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:31:59.919485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-47edaff3-6cb0-4d0f-a9e4-52ba6d04705d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:31:59.949612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47edaff3-6cb0-4d0f-a9e4-52ba6d04705d None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:31:59.955374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b65f2-9b1c-414b-a090-1efec48b9428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:31:59.960469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b65f2-9b1c-414b-a090-1efec48b9428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:31:59.961423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b65f2-9b1c-414b-a090-1efec48b9428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:31:59.962031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b65f2-9b1c-414b-a090-1efec48b9428 admin admin] PATH_INFO: `/v3/users/d1f0c01c340940388b440932d51988ff` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:31:59.963934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b65f2-9b1c-414b-a090-1efec48b9428 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1f0c01c340940388b440932d51988ff)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:31:59.993486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b65f2-9b1c-414b-a090-1efec48b9428 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:00.137351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-275b65f2-9b1c-414b-a090-1efec48b9428 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1f0c01c340940388b440932d51988ff'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:00.194379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-275b65f2-9b1c-414b-a090-1efec48b9428 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1f0c01c340940388b440932d51988ff'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:00.228411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-275b65f2-9b1c-414b-a090-1efec48b9428 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1f0c01c340940388b440932d51988ff'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:00.229181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-275b65f2-9b1c-414b-a090-1efec48b9428 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1f0c01c340940388b440932d51988ff'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:00.244544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-275b65f2-9b1c-414b-a090-1efec48b9428 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1f0c01c340940388b440932d51988ff'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:00.255311 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2290/4602] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:31:59 2022] DELETE /identity/v3/users/d1f0c01c340940388b440932d51988ff => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:01.016547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631225f-a1e3-4eec-a629-0475e40c9b96 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:01.033875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631225f-a1e3-4eec-a629-0475e40c9b96 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:01.188895 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2049790-926a-4827-889b-685acf6b4d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:01.189551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2049790-926a-4827-889b-685acf6b4d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:01.189898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2049790-926a-4827-889b-685acf6b4d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:01.190676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2049790-926a-4827-889b-685acf6b4d83 admin admin] PATH_INFO: `/v3/projects/5506f7c95c1a46c5b3966597764b0111` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:01.192817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2049790-926a-4827-889b-685acf6b4d83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5506f7c95c1a46c5b3966597764b0111)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:01.194822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2049790-926a-4827-889b-685acf6b4d83 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:01.304607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e2049790-926a-4827-889b-685acf6b4d83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5506f7c95c1a46c5b3966597764b0111', 'request_id': 'req-e2049790-926a-4827-889b-685acf6b4d83'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:01.312388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e2049790-926a-4827-889b-685acf6b4d83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5506f7c95c1a46c5b3966597764b0111', 'request_id': 'req-e2049790-926a-4827-889b-685acf6b4d83'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:01.320896 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e2049790-926a-4827-889b-685acf6b4d83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5506f7c95c1a46c5b3966597764b0111', 'request_id': 'req-e2049790-926a-4827-889b-685acf6b4d83'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:01.345563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e2049790-926a-4827-889b-685acf6b4d83 admin admin] The token cache is being invalidate because project 5506f7c95c1a46c5b3966597764b0111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:32:01.345983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e2049790-926a-4827-889b-685acf6b4d83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:01.346644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e2049790-926a-4827-889b-685acf6b4d83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:01.356202 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2313/4603] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:32:01 2022] DELETE /identity/v3/projects/5506f7c95c1a46c5b3966597764b0111 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:01.358147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8043cb-313a-4e24-b534-3e23ea72a925 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:01.358826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8043cb-313a-4e24-b534-3e23ea72a925 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:01.358826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8043cb-313a-4e24-b534-3e23ea72a925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:01.388629 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9f8043cb-313a-4e24-b534-3e23ea72a925 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:01.390968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9f8043cb-313a-4e24-b534-3e23ea72a925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:01.496677 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2291/4604] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:01.498609 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7d460-4f46-4159-a7f6-d0a8be77ceee None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:01.498970 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7d460-4f46-4159-a7f6-d0a8be77ceee None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:01.499317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7d460-4f46-4159-a7f6-d0a8be77ceee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:01.547217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-8bd7d460-4f46-4159-a7f6-d0a8be77ceee None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:01.550281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8bd7d460-4f46-4159-a7f6-d0a8be77ceee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:01.585914 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2314/4605] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:01.589156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8043cb-313a-4e24-b534-3e23ea72a925 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:01.606830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8043cb-313a-4e24-b534-3e23ea72a925 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:01.626576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59457cca-80fb-4598-a23f-6e1b77a38324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:01.628985 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59457cca-80fb-4598-a23f-6e1b77a38324 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:01.629503 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59457cca-80fb-4598-a23f-6e1b77a38324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:01.630596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59457cca-80fb-4598-a23f-6e1b77a38324 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:01.632027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59457cca-80fb-4598-a23f-6e1b77a38324 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:32:01.632027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59457cca-80fb-4598-a23f-6e1b77a38324 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:01.636641 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59457cca-80fb-4598-a23f-6e1b77a38324 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:01.659940 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2292/4606] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:32:01.662844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7d460-4f46-4159-a7f6-d0a8be77ceee None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:01.678611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7d460-4f46-4159-a7f6-d0a8be77ceee None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:01.713590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655b131-2ce9-4b1e-82c9-464d8c58b5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:01.714259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655b131-2ce9-4b1e-82c9-464d8c58b5a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:01.714689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655b131-2ce9-4b1e-82c9-464d8c58b5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:01.714933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655b131-2ce9-4b1e-82c9-464d8c58b5a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:01.715945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655b131-2ce9-4b1e-82c9-464d8c58b5a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:01.718029 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655b131-2ce9-4b1e-82c9-464d8c58b5a5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:01.780130 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2315/4607] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:32:01 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:32:01.784544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59457cca-80fb-4598-a23f-6e1b77a38324 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:01.803269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59457cca-80fb-4598-a23f-6e1b77a38324 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:01.887380 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:01.983395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236e79c-0b89-4f0b-92fb-8a505d829f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:01.984485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236e79c-0b89-4f0b-92fb-8a505d829f89 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:01.984894 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236e79c-0b89-4f0b-92fb-8a505d829f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:01.985215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e236e79c-0b89-4f0b-92fb-8a505d829f89 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:01.985931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236e79c-0b89-4f0b-92fb-8a505d829f89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:01.988115 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e236e79c-0b89-4f0b-92fb-8a505d829f89 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:02.029894 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2293/4608] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:32:01 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:32:02.030835 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655b131-2ce9-4b1e-82c9-464d8c58b5a5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:02.048650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655b131-2ce9-4b1e-82c9-464d8c58b5a5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:02.069666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c40e73-9599-410f-9c8a-36f4e520cbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:02.070357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c40e73-9599-410f-9c8a-36f4e520cbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:02.070614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c40e73-9599-410f-9c8a-36f4e520cbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:02.070891 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c40e73-9599-410f-9c8a-36f4e520cbe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:02.071562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c40e73-9599-410f-9c8a-36f4e520cbe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:02.073239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c40e73-9599-410f-9c8a-36f4e520cbe6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:02.109355 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2316/4609] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:32:02.114657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236e79c-0b89-4f0b-92fb-8a505d829f89 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:02.126901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e236e79c-0b89-4f0b-92fb-8a505d829f89 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:02.135370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c0722-9e92-4965-bf39-f84deed22c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:02.136150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c0722-9e92-4965-bf39-f84deed22c86 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:02.136499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c0722-9e92-4965-bf39-f84deed22c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:02.136838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c0722-9e92-4965-bf39-f84deed22c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:02.138341 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c0722-9e92-4965-bf39-f84deed22c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:02.140147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c0722-9e92-4965-bf39-f84deed22c86 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:02.162998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c40e73-9599-410f-9c8a-36f4e520cbe6 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:02.171289 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2294/4610] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:32:02.178082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c40e73-9599-410f-9c8a-36f4e520cbe6 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:02.188866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e9617-60c6-4b10-a374-c51b43d6e3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:02.189580 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e9617-60c6-4b10-a374-c51b43d6e3d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:02.190764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e9617-60c6-4b10-a374-c51b43d6e3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:02.191111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e9617-60c6-4b10-a374-c51b43d6e3d4 admin admin] PATH_INFO: `/v3/projects/60a99f19652f46448fc31190d760d018/users/12296a0f9a404953802832c9a8d248b6/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:02.228901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e9617-60c6-4b10-a374-c51b43d6e3d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60a99f19652f46448fc31190d760d018, user_id=12296a0f9a404953802832c9a8d248b6, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:02.232102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e9617-60c6-4b10-a374-c51b43d6e3d4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:02.261377 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2317/4611] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:32:02 2022] PUT /identity/v3/projects/60a99f19652f46448fc31190d760d018/users/12296a0f9a404953802832c9a8d248b6/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:02.268188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4651e-c1cf-449f-bf50-725b4c14c884 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:02.269350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4651e-c1cf-449f-bf50-725b4c14c884 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:02.270040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4651e-c1cf-449f-bf50-725b4c14c884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:02.392725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-17c4651e-c1cf-449f-bf50-725b4c14c884 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:02.400657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-17c4651e-c1cf-449f-bf50-725b4c14c884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:02.655239 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2295/4612] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:02.746960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e9617-60c6-4b10-a374-c51b43d6e3d4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:02.749031 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a53e9617-60c6-4b10-a374-c51b43d6e3d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:02.775250 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:02.896812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e9617-60c6-4b10-a374-c51b43d6e3d4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:02.914263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db224d-5202-4e83-a20c-b43b4334a3cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:02.914907 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db224d-5202-4e83-a20c-b43b4334a3cc service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:02.915186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db224d-5202-4e83-a20c-b43b4334a3cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:02.915459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db224d-5202-4e83-a20c-b43b4334a3cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:02.946445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db224d-5202-4e83-a20c-b43b4334a3cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:02.947850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db224d-5202-4e83-a20c-b43b4334a3cc service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:03.001729 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2318/4613] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:32:07.775201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4651e-c1cf-449f-bf50-725b4c14c884 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:07.778459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-17c4651e-c1cf-449f-bf50-725b4c14c884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:07.798615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4651e-c1cf-449f-bf50-725b4c14c884 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:07.812889 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cabf1-a539-4966-a11e-d757d17cd4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:07.813554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cabf1-a539-4966-a11e-d757d17cd4d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:07.813835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cabf1-a539-4966-a11e-d757d17cd4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:07.814111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cabf1-a539-4966-a11e-d757d17cd4d9 admin admin] PATH_INFO: `/v3/users/474a78f0b2784e01b3d2a6ff6694b8bb` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:07.818475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cabf1-a539-4966-a11e-d757d17cd4d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=474a78f0b2784e01b3d2a6ff6694b8bb)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:07.821320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cabf1-a539-4966-a11e-d757d17cd4d9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:07.955438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-718cabf1-a539-4966-a11e-d757d17cd4d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '474a78f0b2784e01b3d2a6ff6694b8bb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:07.976886 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-718cabf1-a539-4966-a11e-d757d17cd4d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '474a78f0b2784e01b3d2a6ff6694b8bb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:08.019819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-718cabf1-a539-4966-a11e-d757d17cd4d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '474a78f0b2784e01b3d2a6ff6694b8bb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:08.020873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-718cabf1-a539-4966-a11e-d757d17cd4d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '474a78f0b2784e01b3d2a6ff6694b8bb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:08.048351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-718cabf1-a539-4966-a11e-d757d17cd4d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '474a78f0b2784e01b3d2a6ff6694b8bb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:08.064075 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2296/4614] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:32:07 2022] DELETE /identity/v3/users/474a78f0b2784e01b3d2a6ff6694b8bb => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:08.435185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cb763-b8a7-43cf-8134-580ef3010b6e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:08.436104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cb763-b8a7-43cf-8134-580ef3010b6e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:08.436564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1cb763-b8a7-43cf-8134-580ef3010b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:08.504424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3b1cb763-b8a7-43cf-8134-580ef3010b6e None None] MFA Rules not processed for user `bed65a4d62184f52af3d2dd322eeec47`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:08.505688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3b1cb763-b8a7-43cf-8134-580ef3010b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:08.581924 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2319/4615] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:08.602680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cabf1-a539-4966-a11e-d757d17cd4d9 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:08.605251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-718cabf1-a539-4966-a11e-d757d17cd4d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:08.719121 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:08.833487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cabf1-a539-4966-a11e-d757d17cd4d9 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:08.841961 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85923ba9-743b-4636-9941-9dc8da01aaa1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:08.842596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85923ba9-743b-4636-9941-9dc8da01aaa1 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:08.842879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85923ba9-743b-4636-9941-9dc8da01aaa1 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:08.843157 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85923ba9-743b-4636-9941-9dc8da01aaa1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:08.863271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85923ba9-743b-4636-9941-9dc8da01aaa1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:08.865208 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85923ba9-743b-4636-9941-9dc8da01aaa1 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:08.892168 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2297/4616] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:08 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:32:08.975356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1cb763-b8a7-43cf-8134-580ef3010b6e None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:08.978850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3b1cb763-b8a7-43cf-8134-580ef3010b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:09.175497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1cb763-b8a7-43cf-8134-580ef3010b6e None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:09.188832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44e4f7-469a-4aa8-85e2-6dd777190014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:09.189658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44e4f7-469a-4aa8-85e2-6dd777190014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:09.190040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44e4f7-469a-4aa8-85e2-6dd777190014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:09.191030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44e4f7-469a-4aa8-85e2-6dd777190014 admin admin] PATH_INFO: `/v3/users/8f2c4d9c50fe4c08b3619994e94470c6` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:09.191932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44e4f7-469a-4aa8-85e2-6dd777190014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f2c4d9c50fe4c08b3619994e94470c6)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:09.194513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44e4f7-469a-4aa8-85e2-6dd777190014 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:09.252351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85923ba9-743b-4636-9941-9dc8da01aaa1 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:09.255436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-85923ba9-743b-4636-9941-9dc8da01aaa1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:09.285000 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:09.288916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85923ba9-743b-4636-9941-9dc8da01aaa1 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:09.299777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ff44e4f7-469a-4aa8-85e2-6dd777190014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f2c4d9c50fe4c08b3619994e94470c6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:09.301127 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d61ed5-e54d-4224-9262-33d9bab00be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:09.302019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d61ed5-e54d-4224-9262-33d9bab00be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:09.302365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d61ed5-e54d-4224-9262-33d9bab00be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:09.302709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d61ed5-e54d-4224-9262-33d9bab00be0 admin admin] PATH_INFO: `/v3/projects/5f88662ebb674ad99a4d36651dee967a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:09.305866 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d61ed5-e54d-4224-9262-33d9bab00be0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f88662ebb674ad99a4d36651dee967a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:09.309439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ff44e4f7-469a-4aa8-85e2-6dd777190014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f2c4d9c50fe4c08b3619994e94470c6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:09.309614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d61ed5-e54d-4224-9262-33d9bab00be0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:09.342150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ff44e4f7-469a-4aa8-85e2-6dd777190014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f2c4d9c50fe4c08b3619994e94470c6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:09.343025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ff44e4f7-469a-4aa8-85e2-6dd777190014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f2c4d9c50fe4c08b3619994e94470c6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:09.367500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ff44e4f7-469a-4aa8-85e2-6dd777190014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f2c4d9c50fe4c08b3619994e94470c6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:09.377335 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2320/4617] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:32:08 2022] DELETE /identity/v3/users/8f2c4d9c50fe4c08b3619994e94470c6 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:09.433471 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e4d61ed5-e54d-4224-9262-33d9bab00be0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f88662ebb674ad99a4d36651dee967a', 'request_id': 'req-e4d61ed5-e54d-4224-9262-33d9bab00be0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:09.440997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e4d61ed5-e54d-4224-9262-33d9bab00be0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f88662ebb674ad99a4d36651dee967a', 'request_id': 'req-e4d61ed5-e54d-4224-9262-33d9bab00be0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:09.451113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e4d61ed5-e54d-4224-9262-33d9bab00be0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f88662ebb674ad99a4d36651dee967a', 'request_id': 'req-e4d61ed5-e54d-4224-9262-33d9bab00be0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:09.474659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e4d61ed5-e54d-4224-9262-33d9bab00be0 admin admin] The token cache is being invalidate because project 5f88662ebb674ad99a4d36651dee967a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:32:09.475205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e4d61ed5-e54d-4224-9262-33d9bab00be0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:09.479582 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e4d61ed5-e54d-4224-9262-33d9bab00be0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:09.481756 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2298/4618] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:32:09 2022] DELETE /identity/v3/projects/5f88662ebb674ad99a4d36651dee967a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:09.488472 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7aca8-87c4-4c5b-9625-d12d9be980da None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:09.489553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7aca8-87c4-4c5b-9625-d12d9be980da None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:09.490037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7aca8-87c4-4c5b-9625-d12d9be980da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:09.530403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-87f7aca8-87c4-4c5b-9625-d12d9be980da None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:09.531872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-87f7aca8-87c4-4c5b-9625-d12d9be980da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:09.694520 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2321/4619] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:09.702237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b47be1-4bd3-4a7a-a8b2-c06be470df90 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:09.702699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b47be1-4bd3-4a7a-a8b2-c06be470df90 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:09.703014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b47be1-4bd3-4a7a-a8b2-c06be470df90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:09.747221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d1b47be1-4bd3-4a7a-a8b2-c06be470df90 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:09.748572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d1b47be1-4bd3-4a7a-a8b2-c06be470df90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:09.794549 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2299/4620] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:09.803087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7aca8-87c4-4c5b-9625-d12d9be980da None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:09.823591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7aca8-87c4-4c5b-9625-d12d9be980da None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:09.835902 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffebf220-a488-4470-9034-82f19f84d2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:09.836543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebf220-a488-4470-9034-82f19f84d2ff admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:09.836817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebf220-a488-4470-9034-82f19f84d2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:09.837089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebf220-a488-4470-9034-82f19f84d2ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:09.840804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffebf220-a488-4470-9034-82f19f84d2ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:32:09.841121 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffebf220-a488-4470-9034-82f19f84d2ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:09.847767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffebf220-a488-4470-9034-82f19f84d2ff admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:09.878267 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2322/4621] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:32:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:32:09.883557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b47be1-4bd3-4a7a-a8b2-c06be470df90 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:09.917681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b47be1-4bd3-4a7a-a8b2-c06be470df90 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:09.931106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec26b2e-a806-4a9f-b1a3-d692e4ba8267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:09.931714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec26b2e-a806-4a9f-b1a3-d692e4ba8267 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:09.932023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec26b2e-a806-4a9f-b1a3-d692e4ba8267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:09.932297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec26b2e-a806-4a9f-b1a3-d692e4ba8267 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:09.932949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec26b2e-a806-4a9f-b1a3-d692e4ba8267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:09.942811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec26b2e-a806-4a9f-b1a3-d692e4ba8267 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:10.034004 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2300/4622] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:32:09 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:32:10.039039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffebf220-a488-4470-9034-82f19f84d2ff admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:10.059335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffebf220-a488-4470-9034-82f19f84d2ff admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:10.231993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1348a74b-3955-4a76-af78-5bc2aa64ceba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:10.232565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348a74b-3955-4a76-af78-5bc2aa64ceba admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:10.232853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348a74b-3955-4a76-af78-5bc2aa64ceba admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:10.233128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1348a74b-3955-4a76-af78-5bc2aa64ceba admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:10.233770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1348a74b-3955-4a76-af78-5bc2aa64ceba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:10.235777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1348a74b-3955-4a76-af78-5bc2aa64ceba admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:10.279769 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2323/4623] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:32:10 2022] POST /identity/v3/users => generated 289 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:32:10.285227 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec26b2e-a806-4a9f-b1a3-d692e4ba8267 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:10.303645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec26b2e-a806-4a9f-b1a3-d692e4ba8267 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:10.318297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81360b7b-eaf2-4c03-9d18-303349cd6d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:10.319109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81360b7b-eaf2-4c03-9d18-303349cd6d1d admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:10.320465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81360b7b-eaf2-4c03-9d18-303349cd6d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:10.320882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81360b7b-eaf2-4c03-9d18-303349cd6d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:10.331229 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81360b7b-eaf2-4c03-9d18-303349cd6d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:10.334515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81360b7b-eaf2-4c03-9d18-303349cd6d1d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:10.363614 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2301/4624] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:32:10.368058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1348a74b-3955-4a76-af78-5bc2aa64ceba admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:10.391605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1348a74b-3955-4a76-af78-5bc2aa64ceba admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:10.411510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a625d-b8bf-4dfb-9684-94d4c68ea1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:10.416887 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a625d-b8bf-4dfb-9684-94d4c68ea1eb admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:10.417766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a625d-b8bf-4dfb-9684-94d4c68ea1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:10.418238 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a625d-b8bf-4dfb-9684-94d4c68ea1eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:10.419242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a625d-b8bf-4dfb-9684-94d4c68ea1eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:10.422828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a625d-b8bf-4dfb-9684-94d4c68ea1eb admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:10.442260 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2324/4625] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:32:10.446644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81360b7b-eaf2-4c03-9d18-303349cd6d1d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:10.468885 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81360b7b-eaf2-4c03-9d18-303349cd6d1d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:10.481901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf9e0f-936b-4762-94d6-a1437e8f0225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:10.483030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf9e0f-936b-4762-94d6-a1437e8f0225 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:10.484189 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf9e0f-936b-4762-94d6-a1437e8f0225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:10.484654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf9e0f-936b-4762-94d6-a1437e8f0225 admin admin] PATH_INFO: `/v3/projects/3a1d54252c734d47954009cc5aa6f974/users/19818a0199054900ba2991c3f8712430/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:10.522604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf9e0f-936b-4762-94d6-a1437e8f0225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a1d54252c734d47954009cc5aa6f974, user_id=19818a0199054900ba2991c3f8712430, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:10.525759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf9e0f-936b-4762-94d6-a1437e8f0225 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:10.553754 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2302/4626] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:32:10 2022] PUT /identity/v3/projects/3a1d54252c734d47954009cc5aa6f974/users/19818a0199054900ba2991c3f8712430/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:10.566843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c697f4-b3f9-4bc7-afbc-a1c2a3b63d70 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:10.567393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c697f4-b3f9-4bc7-afbc-a1c2a3b63d70 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:10.567620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c697f4-b3f9-4bc7-afbc-a1c2a3b63d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:10.645354 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d5c697f4-b3f9-4bc7-afbc-a1c2a3b63d70 None None] MFA Rules not processed for user `19818a0199054900ba2991c3f8712430`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:10.648180 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d5c697f4-b3f9-4bc7-afbc-a1c2a3b63d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:10.692762 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:10.879986 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf9e0f-936b-4762-94d6-a1437e8f0225 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:10.886726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8ddf9e0f-936b-4762-94d6-a1437e8f0225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:10.899356 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2325/4627] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:32:10.905913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776cb2e-76a1-4f62-89a5-751d289d6e8a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:10.906753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776cb2e-76a1-4f62-89a5-751d289d6e8a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:10.907352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776cb2e-76a1-4f62-89a5-751d289d6e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:10.966273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9776cb2e-76a1-4f62-89a5-751d289d6e8a None None] MFA Rules not processed for user `19818a0199054900ba2991c3f8712430`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:10.970362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9776cb2e-76a1-4f62-89a5-751d289d6e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:10.992835 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2326/4628] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:11.002970 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:11.011017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776cb2e-76a1-4f62-89a5-751d289d6e8a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:11.013258 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9776cb2e-76a1-4f62-89a5-751d289d6e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:11.072112 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf9e0f-936b-4762-94d6-a1437e8f0225 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:11.090235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6861921-f609-4c63-b97b-45d64f550ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:11.091099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6861921-f609-4c63-b97b-45d64f550ac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:11.091522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6861921-f609-4c63-b97b-45d64f550ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:11.091932 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6861921-f609-4c63-b97b-45d64f550ac5 admin admin] PATH_INFO: `/v3/projects/ec14c7253bf944819d3b6e203ea4b9ae` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:11.094999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6861921-f609-4c63-b97b-45d64f550ac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec14c7253bf944819d3b6e203ea4b9ae)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:11.097849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6861921-f609-4c63-b97b-45d64f550ac5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:11.227810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776cb2e-76a1-4f62-89a5-751d289d6e8a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:11.233261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a6861921-f609-4c63-b97b-45d64f550ac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec14c7253bf944819d3b6e203ea4b9ae', 'request_id': 'req-a6861921-f609-4c63-b97b-45d64f550ac5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:11.257106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a6861921-f609-4c63-b97b-45d64f550ac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec14c7253bf944819d3b6e203ea4b9ae', 'request_id': 'req-a6861921-f609-4c63-b97b-45d64f550ac5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:11.278214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a6861921-f609-4c63-b97b-45d64f550ac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec14c7253bf944819d3b6e203ea4b9ae', 'request_id': 'req-a6861921-f609-4c63-b97b-45d64f550ac5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:11.317523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a6861921-f609-4c63-b97b-45d64f550ac5 admin admin] The token cache is being invalidate because project ec14c7253bf944819d3b6e203ea4b9ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:32:11.317523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a6861921-f609-4c63-b97b-45d64f550ac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:11.317523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a6861921-f609-4c63-b97b-45d64f550ac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:11.326502 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2303/4629] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:32:10 2022] DELETE /identity/v3/projects/ec14c7253bf944819d3b6e203ea4b9ae => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:11.330864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6861921-f609-4c63-b97b-45d64f550ac5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:11.334478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a6861921-f609-4c63-b97b-45d64f550ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:11.419783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6305610-053e-4204-86a2-d66767218ca7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:11.421402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6305610-053e-4204-86a2-d66767218ca7 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:11.421797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6305610-053e-4204-86a2-d66767218ca7 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:11.426785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6305610-053e-4204-86a2-d66767218ca7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:11.430815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a6305610-053e-4204-86a2-d66767218ca7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:11.499722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6861921-f609-4c63-b97b-45d64f550ac5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:11.519305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f741d-2b60-4ad5-a016-bb6f0b8a1e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:11.520924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f741d-2b60-4ad5-a016-bb6f0b8a1e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:11.521331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f741d-2b60-4ad5-a016-bb6f0b8a1e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:11.523306 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f741d-2b60-4ad5-a016-bb6f0b8a1e49 admin admin] PATH_INFO: `/v3/users/16e2dae4260e4f00bca7e6f928f118ec` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:11.526845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f741d-2b60-4ad5-a016-bb6f0b8a1e49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16e2dae4260e4f00bca7e6f928f118ec)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:11.530517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f741d-2b60-4ad5-a016-bb6f0b8a1e49 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:11.545250 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:11.586138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6305610-053e-4204-86a2-d66767218ca7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:11.591311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6305610-053e-4204-86a2-d66767218ca7 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:11.625570 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2327/4630] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:32:11.648712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c54f741d-2b60-4ad5-a016-bb6f0b8a1e49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16e2dae4260e4f00bca7e6f928f118ec'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:11.670882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c54f741d-2b60-4ad5-a016-bb6f0b8a1e49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16e2dae4260e4f00bca7e6f928f118ec'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:11.809801 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:11.821339 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c54f741d-2b60-4ad5-a016-bb6f0b8a1e49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16e2dae4260e4f00bca7e6f928f118ec'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:11.824344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c54f741d-2b60-4ad5-a016-bb6f0b8a1e49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16e2dae4260e4f00bca7e6f928f118ec'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:11.844492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c54f741d-2b60-4ad5-a016-bb6f0b8a1e49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16e2dae4260e4f00bca7e6f928f118ec'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:11.863145 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2304/4631] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:32:11 2022] DELETE /identity/v3/users/16e2dae4260e4f00bca7e6f928f118ec => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:13.328239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6305610-053e-4204-86a2-d66767218ca7 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:13.396292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6305610-053e-4204-86a2-d66767218ca7 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:13.530538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71beebcb-3e18-4ab4-9af8-b65b3d148e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:13.531463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71beebcb-3e18-4ab4-9af8-b65b3d148e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:13.537170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71beebcb-3e18-4ab4-9af8-b65b3d148e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:13.545905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71beebcb-3e18-4ab4-9af8-b65b3d148e61 admin admin] PATH_INFO: `/v3/projects/3340c6539459423b8d0dc6d92bb16d21` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:13.547732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71beebcb-3e18-4ab4-9af8-b65b3d148e61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3340c6539459423b8d0dc6d92bb16d21)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:13.550073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71beebcb-3e18-4ab4-9af8-b65b3d148e61 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:13.665590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-71beebcb-3e18-4ab4-9af8-b65b3d148e61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3340c6539459423b8d0dc6d92bb16d21', 'request_id': 'req-71beebcb-3e18-4ab4-9af8-b65b3d148e61'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:13.676288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-71beebcb-3e18-4ab4-9af8-b65b3d148e61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3340c6539459423b8d0dc6d92bb16d21', 'request_id': 'req-71beebcb-3e18-4ab4-9af8-b65b3d148e61'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:13.691934 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-71beebcb-3e18-4ab4-9af8-b65b3d148e61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3340c6539459423b8d0dc6d92bb16d21', 'request_id': 'req-71beebcb-3e18-4ab4-9af8-b65b3d148e61'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:13.729615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-71beebcb-3e18-4ab4-9af8-b65b3d148e61 admin admin] The token cache is being invalidate because project 3340c6539459423b8d0dc6d92bb16d21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:32:13.729915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-71beebcb-3e18-4ab4-9af8-b65b3d148e61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:13.731384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-71beebcb-3e18-4ab4-9af8-b65b3d148e61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:13.733349 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2328/4632] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:32:13 2022] DELETE /identity/v3/projects/3340c6539459423b8d0dc6d92bb16d21 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:13.739257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67ac67-2e3a-422f-954f-34a2ddc43217 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:13.739952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67ac67-2e3a-422f-954f-34a2ddc43217 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:13.739952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67ac67-2e3a-422f-954f-34a2ddc43217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:13.791168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-db67ac67-2e3a-422f-954f-34a2ddc43217 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:13.804627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-db67ac67-2e3a-422f-954f-34a2ddc43217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:14.039327 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2305/4633] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:14.047414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed28663-58da-449a-bbf0-00393b3a8529 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:14.048155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed28663-58da-449a-bbf0-00393b3a8529 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:14.048679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed28663-58da-449a-bbf0-00393b3a8529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:14.091542 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-eed28663-58da-449a-bbf0-00393b3a8529 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:14.093723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-eed28663-58da-449a-bbf0-00393b3a8529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:14.121350 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2329/4634] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:14.125735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67ac67-2e3a-422f-954f-34a2ddc43217 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:14.154715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67ac67-2e3a-422f-954f-34a2ddc43217 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:14.179462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fee0eb-dd84-4b9e-8161-4cdb441f6161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:14.180136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fee0eb-dd84-4b9e-8161-4cdb441f6161 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:14.180415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fee0eb-dd84-4b9e-8161-4cdb441f6161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:14.180687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fee0eb-dd84-4b9e-8161-4cdb441f6161 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:14.181373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fee0eb-dd84-4b9e-8161-4cdb441f6161 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:32:14.181677 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fee0eb-dd84-4b9e-8161-4cdb441f6161 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:14.187344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fee0eb-dd84-4b9e-8161-4cdb441f6161 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:14.235619 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2306/4635] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:32:14.236651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed28663-58da-449a-bbf0-00393b3a8529 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:14.262615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed28663-58da-449a-bbf0-00393b3a8529 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:14.284285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf72b4-a77b-437e-8644-6c418ced21f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:14.284974 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf72b4-a77b-437e-8644-6c418ced21f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:14.285296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf72b4-a77b-437e-8644-6c418ced21f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:14.285577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf72b4-a77b-437e-8644-6c418ced21f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:14.286216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf72b4-a77b-437e-8644-6c418ced21f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:14.288424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf72b4-a77b-437e-8644-6c418ced21f0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:14.408261 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2330/4636] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:32:14 2022] POST /identity/v3/projects => generated 365 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:32:14.412449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fee0eb-dd84-4b9e-8161-4cdb441f6161 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:14.438801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fee0eb-dd84-4b9e-8161-4cdb441f6161 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:14.806148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420be0b-a1c9-4abf-ab2b-73bd019e282a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:14.806891 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420be0b-a1c9-4abf-ab2b-73bd019e282a admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:14.807249 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420be0b-a1c9-4abf-ab2b-73bd019e282a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:14.816506 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420be0b-a1c9-4abf-ab2b-73bd019e282a admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:14.817258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420be0b-a1c9-4abf-ab2b-73bd019e282a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:14.819326 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420be0b-a1c9-4abf-ab2b-73bd019e282a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:14.893206 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2307/4637] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:32:14 2022] POST /identity/v3/users => generated 283 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:32:14.897373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf72b4-a77b-437e-8644-6c418ced21f0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:14.935573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf72b4-a77b-437e-8644-6c418ced21f0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:14.959309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0791f9e-8b65-4182-a700-3edd810a2368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:14.960393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0791f9e-8b65-4182-a700-3edd810a2368 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:14.960946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0791f9e-8b65-4182-a700-3edd810a2368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:14.961589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0791f9e-8b65-4182-a700-3edd810a2368 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:14.972824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0791f9e-8b65-4182-a700-3edd810a2368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:14.974501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0791f9e-8b65-4182-a700-3edd810a2368 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:15.022432 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2331/4638] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:32:15.027528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420be0b-a1c9-4abf-ab2b-73bd019e282a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:15.060807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420be0b-a1c9-4abf-ab2b-73bd019e282a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:15.102189 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c42172-53b2-4743-9749-97da8dddc72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:15.104360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c42172-53b2-4743-9749-97da8dddc72c admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:15.105681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c42172-53b2-4743-9749-97da8dddc72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:15.106218 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c42172-53b2-4743-9749-97da8dddc72c admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:15.107940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c42172-53b2-4743-9749-97da8dddc72c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:15.117680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c42172-53b2-4743-9749-97da8dddc72c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:15.150355 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2308/4639] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:32:15.154463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0791f9e-8b65-4182-a700-3edd810a2368 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:15.176762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0791f9e-8b65-4182-a700-3edd810a2368 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:15.203050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc50cc-f483-418b-a72c-c23f875ff5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:15.207871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc50cc-f483-418b-a72c-c23f875ff5a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:15.208177 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc50cc-f483-418b-a72c-c23f875ff5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:15.208457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc50cc-f483-418b-a72c-c23f875ff5a9 admin admin] PATH_INFO: `/v3/projects/cc2e01ef7bf24c1e920beed5c3ea5cc4/users/5c8e279ad95d4f8e9241da4cd97ae682/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:15.258542 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc50cc-f483-418b-a72c-c23f875ff5a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc2e01ef7bf24c1e920beed5c3ea5cc4, user_id=5c8e279ad95d4f8e9241da4cd97ae682, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:15.261579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc50cc-f483-418b-a72c-c23f875ff5a9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:15.308246 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2332/4640] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:32:15 2022] PUT /identity/v3/projects/cc2e01ef7bf24c1e920beed5c3ea5cc4/users/5c8e279ad95d4f8e9241da4cd97ae682/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:15.310039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c97c48-a9ae-4677-b19f-36b86e962ab9 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:15.310321 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c97c48-a9ae-4677-b19f-36b86e962ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:15.310596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c97c48-a9ae-4677-b19f-36b86e962ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:15.379053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-94c97c48-a9ae-4677-b19f-36b86e962ab9 None None] MFA Rules not processed for user `5c8e279ad95d4f8e9241da4cd97ae682`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:15.380336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-94c97c48-a9ae-4677-b19f-36b86e962ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:15.449783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d158fda-bb2e-4a8c-9317-9b52a7c034c4 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:15.450349 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d158fda-bb2e-4a8c-9317-9b52a7c034c4 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:15.450731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d158fda-bb2e-4a8c-9317-9b52a7c034c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:15.512665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-7d158fda-bb2e-4a8c-9317-9b52a7c034c4 None None] MFA Rules not processed for user `bed65a4d62184f52af3d2dd322eeec47`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:15.515620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7d158fda-bb2e-4a8c-9317-9b52a7c034c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:15.535225 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:15.538668 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:15.624260 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2309/4641] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:15.644417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c97c48-a9ae-4677-b19f-36b86e962ab9 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:15.646786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-94c97c48-a9ae-4677-b19f-36b86e962ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:15.672780 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2333/4642] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:15.878088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c97c48-a9ae-4677-b19f-36b86e962ab9 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:15.885218 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdeae1-7fc8-434b-b58b-277aaf811e13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:15.885973 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdeae1-7fc8-434b-b58b-277aaf811e13 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:15.886253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdeae1-7fc8-434b-b58b-277aaf811e13 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:15.887175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdeae1-7fc8-434b-b58b-277aaf811e13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:15.902798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cdeae1-7fc8-434b-b58b-277aaf811e13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:15.904606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cdeae1-7fc8-434b-b58b-277aaf811e13 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:15.917282 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2310/4643] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:32:15.936598 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aeef27-e449-468c-95a9-b80e923eca1b None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:15.937179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aeef27-e449-468c-95a9-b80e923eca1b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:15.937625 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aeef27-e449-468c-95a9-b80e923eca1b None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:15.940452 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2334/4644] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:32:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:32:15.946998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdeae1-7fc8-434b-b58b-277aaf811e13 service nova] Authenticating service token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:32:15.980857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdeae1-7fc8-434b-b58b-277aaf811e13 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:16.002240 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdeae1-7fc8-434b-b58b-277aaf811e13 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:16.014458 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaefafe-c79b-4e2c-9d7d-33d7eedb60c9 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c8e279ad95d4f8e9241da4cd97ae682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc2e01ef7bf24c1e920beed5c3ea5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:16.017215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaefafe-c79b-4e2c-9d7d-33d7eedb60c9 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:16.018397 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaefafe-c79b-4e2c-9d7d-33d7eedb60c9 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:16.019368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaefafe-c79b-4e2c-9d7d-33d7eedb60c9 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] PATH_INFO: `/v3/projects/cc2e01ef7bf24c1e920beed5c3ea5cc4` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:16.027753 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaefafe-c79b-4e2c-9d7d-33d7eedb60c9 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] RBAC: Authorizing `identity:get_project(project_id=cc2e01ef7bf24c1e920beed5c3ea5cc4)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:16.032500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaefafe-c79b-4e2c-9d7d-33d7eedb60c9 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:16.036612 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2311/4645] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:32:15 2022] GET /identity/v3/projects/cc2e01ef7bf24c1e920beed5c3ea5cc4 => generated 365 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:32:16.125445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d723816-3f5c-492c-99c8-6f13690881ad None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:16.125995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d723816-3f5c-492c-99c8-6f13690881ad None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:16.126430 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d723816-3f5c-492c-99c8-6f13690881ad None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:16.128874 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2335/4646] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:32:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:32:16.148817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaefafe-c79b-4e2c-9d7d-33d7eedb60c9 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] Authenticating service token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:32:16.150990 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-abaefafe-c79b-4e2c-9d7d-33d7eedb60c9 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:16.177435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaefafe-c79b-4e2c-9d7d-33d7eedb60c9 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:16.191115 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaefafe-c79b-4e2c-9d7d-33d7eedb60c9 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:16.197378 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfcdc1-0bd2-4336-a767-29cce23f7746 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c8e279ad95d4f8e9241da4cd97ae682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc2e01ef7bf24c1e920beed5c3ea5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:16.198182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfcdc1-0bd2-4336-a767-29cce23f7746 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:16.198467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfcdc1-0bd2-4336-a767-29cce23f7746 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:16.198745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfcdc1-0bd2-4336-a767-29cce23f7746 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] PATH_INFO: `/v3/projects/cc2e01ef7bf24c1e920beed5c3ea5cc4` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:16.200022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dfcdc1-0bd2-4336-a767-29cce23f7746 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] RBAC: Authorizing `identity:get_project(project_id=cc2e01ef7bf24c1e920beed5c3ea5cc4)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:16.202478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dfcdc1-0bd2-4336-a767-29cce23f7746 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:16.205376 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2312/4647] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:32:16 2022] GET /identity/v3/projects/cc2e01ef7bf24c1e920beed5c3ea5cc4 => generated 365 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:32:16.477191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8299a51-57c9-424c-820b-6142b5da66d6 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:16.479935 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8299a51-57c9-424c-820b-6142b5da66d6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:16.480397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8299a51-57c9-424c-820b-6142b5da66d6 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:16.482312 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2336/4648] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:32:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:32:16.493796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfcdc1-0bd2-4336-a767-29cce23f7746 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] Authenticating service token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:32:16.531540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfcdc1-0bd2-4336-a767-29cce23f7746 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:16.532560 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8299a51-57c9-424c-820b-6142b5da66d6 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:16.535521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b8299a51-57c9-424c-820b-6142b5da66d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:16.552993 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfcdc1-0bd2-4336-a767-29cce23f7746 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:16.563242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c210fd-93e7-4573-94ea-446fe8e4c422 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c8e279ad95d4f8e9241da4cd97ae682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc2e01ef7bf24c1e920beed5c3ea5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:16.564500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c210fd-93e7-4573-94ea-446fe8e4c422 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:16.565163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c210fd-93e7-4573-94ea-446fe8e4c422 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:16.565443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c210fd-93e7-4573-94ea-446fe8e4c422 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] PATH_INFO: `/v3/projects/cc2e01ef7bf24c1e920beed5c3ea5cc4` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:16.567212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c210fd-93e7-4573-94ea-446fe8e4c422 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] RBAC: Authorizing `identity:get_project(project_id=cc2e01ef7bf24c1e920beed5c3ea5cc4)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:16.571804 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c210fd-93e7-4573-94ea-446fe8e4c422 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:16.574335 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2313/4649] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:32:16 2022] GET /identity/v3/projects/cc2e01ef7bf24c1e920beed5c3ea5cc4 => generated 365 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:32:16.615419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c11f1a-f70e-4735-a305-d49304f3f72b None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:16.615700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c11f1a-f70e-4735-a305-d49304f3f72b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:16.616011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c11f1a-f70e-4735-a305-d49304f3f72b None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:16.617690 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2314/4650] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:32:16.630023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c11f1a-f70e-4735-a305-d49304f3f72b None None] Authenticating service token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:32:16.661881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c11f1a-f70e-4735-a305-d49304f3f72b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:16.681188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8299a51-57c9-424c-820b-6142b5da66d6 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:16.682984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c11f1a-f70e-4735-a305-d49304f3f72b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:16.685293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2c5ad-4339-47d1-8b28-9057dd12309b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:16.685918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2c5ad-4339-47d1-8b28-9057dd12309b service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:16.686289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2c5ad-4339-47d1-8b28-9057dd12309b service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:16.686575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2c5ad-4339-47d1-8b28-9057dd12309b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:16.690731 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0af00-0392-49cb-8157-fb5460a46a14 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c8e279ad95d4f8e9241da4cd97ae682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc2e01ef7bf24c1e920beed5c3ea5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:16.691831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0af00-0392-49cb-8157-fb5460a46a14 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:16.692231 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0af00-0392-49cb-8157-fb5460a46a14 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:16.692508 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0af00-0392-49cb-8157-fb5460a46a14 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] PATH_INFO: `/v3/projects/cc2e01ef7bf24c1e920beed5c3ea5cc4` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:16.696859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d4c2c5ad-4339-47d1-8b28-9057dd12309b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:16.704056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0af00-0392-49cb-8157-fb5460a46a14 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] RBAC: Authorizing `identity:get_project(project_id=cc2e01ef7bf24c1e920beed5c3ea5cc4)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:16.712193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0af00-0392-49cb-8157-fb5460a46a14 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:16.714427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2c5ad-4339-47d1-8b28-9057dd12309b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:16.716989 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2315/4651] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:32:16 2022] GET /identity/v3/projects/cc2e01ef7bf24c1e920beed5c3ea5cc4 => generated 365 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:32:16.727425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2c5ad-4339-47d1-8b28-9057dd12309b service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:16.767930 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2337/4652] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:32:17.859190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c738a9-0172-4359-a796-6c96c0259e59 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:17.859657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c738a9-0172-4359-a796-6c96c0259e59 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:17.859748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c738a9-0172-4359-a796-6c96c0259e59 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:17.861774 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2316/4653] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:32:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:32:17.876161 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2c5ad-4339-47d1-8b28-9057dd12309b service neutron] Authenticating service token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 01:32:17.895174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2c5ad-4339-47d1-8b28-9057dd12309b service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:17.910508 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2c5ad-4339-47d1-8b28-9057dd12309b service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:17.915124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2c2c7-3c33-496e-a598-d3497d74ecf3 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c8e279ad95d4f8e9241da4cd97ae682', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc2e01ef7bf24c1e920beed5c3ea5cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:17.915778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2c2c7-3c33-496e-a598-d3497d74ecf3 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:17.916096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2c2c7-3c33-496e-a598-d3497d74ecf3 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:17.916905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2c2c7-3c33-496e-a598-d3497d74ecf3 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] PATH_INFO: `/v3/projects/cc2e01ef7bf24c1e920beed5c3ea5cc4` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:17.918120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2c2c7-3c33-496e-a598-d3497d74ecf3 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] RBAC: Authorizing `identity:get_project(project_id=cc2e01ef7bf24c1e920beed5c3ea5cc4)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:17.933842 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2c2c7-3c33-496e-a598-d3497d74ecf3 tempest-QuotasTestJSON-1059396157 tempest-QuotasTestJSON-1059396157-project] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:17.955356 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2338/4654] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 01:32:17 2022] GET /identity/v3/projects/cc2e01ef7bf24c1e920beed5c3ea5cc4 => generated 365 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:32:18.004821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c738a9-0172-4359-a796-6c96c0259e59 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:18.180851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c738a9-0172-4359-a796-6c96c0259e59 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:18.210238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60740ca5-5f1d-4c4a-96bd-402e2391fe54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:18.211308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60740ca5-5f1d-4c4a-96bd-402e2391fe54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:18.211655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60740ca5-5f1d-4c4a-96bd-402e2391fe54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:18.211959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60740ca5-5f1d-4c4a-96bd-402e2391fe54 admin admin] PATH_INFO: `/v3/users/5c8e279ad95d4f8e9241da4cd97ae682` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:18.214317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60740ca5-5f1d-4c4a-96bd-402e2391fe54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c8e279ad95d4f8e9241da4cd97ae682)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:18.219916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60740ca5-5f1d-4c4a-96bd-402e2391fe54 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:18.331045 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:18.359945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-60740ca5-5f1d-4c4a-96bd-402e2391fe54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c8e279ad95d4f8e9241da4cd97ae682'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:18.387648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-60740ca5-5f1d-4c4a-96bd-402e2391fe54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c8e279ad95d4f8e9241da4cd97ae682'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:18.450264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-60740ca5-5f1d-4c4a-96bd-402e2391fe54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c8e279ad95d4f8e9241da4cd97ae682'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:18.454005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-60740ca5-5f1d-4c4a-96bd-402e2391fe54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c8e279ad95d4f8e9241da4cd97ae682'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:18.486095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-60740ca5-5f1d-4c4a-96bd-402e2391fe54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c8e279ad95d4f8e9241da4cd97ae682'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:18.497956 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2317/4655] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:32:18 2022] DELETE /identity/v3/users/5c8e279ad95d4f8e9241da4cd97ae682 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:18.500123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1306162-f29c-4653-9f32-3573cd0332d3 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:18.500466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1306162-f29c-4653-9f32-3573cd0332d3 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:18.500845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1306162-f29c-4653-9f32-3573cd0332d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:18.539325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d1306162-f29c-4653-9f32-3573cd0332d3 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:18.540892 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d1306162-f29c-4653-9f32-3573cd0332d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:18.775343 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2339/4656] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:18.809709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60740ca5-5f1d-4c4a-96bd-402e2391fe54 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:18.811469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-60740ca5-5f1d-4c4a-96bd-402e2391fe54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:19.109210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60740ca5-5f1d-4c4a-96bd-402e2391fe54 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:19.128089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62e8f2-acdd-409f-b932-17ceab9970e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:19.128763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62e8f2-acdd-409f-b932-17ceab9970e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:19.129045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62e8f2-acdd-409f-b932-17ceab9970e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:19.131463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62e8f2-acdd-409f-b932-17ceab9970e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:19.160020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62e8f2-acdd-409f-b932-17ceab9970e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:19.163026 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62e8f2-acdd-409f-b932-17ceab9970e4 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:19.192594 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2318/4657] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:32:21.645587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a609d7f-7c06-490c-b07e-7b8544d63742 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:21.646116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a609d7f-7c06-490c-b07e-7b8544d63742 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:21.646116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a609d7f-7c06-490c-b07e-7b8544d63742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:21.681479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9a609d7f-7c06-490c-b07e-7b8544d63742 None None] MFA Rules not processed for user `12296a0f9a404953802832c9a8d248b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:21.682990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9a609d7f-7c06-490c-b07e-7b8544d63742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:21.738633 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:21.796281 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2340/4658] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:32:22.201327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62e8f2-acdd-409f-b932-17ceab9970e4 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:22.203427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0f62e8f2-acdd-409f-b932-17ceab9970e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:22.231331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62e8f2-acdd-409f-b932-17ceab9970e4 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:22.244675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0516ef-73d6-4c5e-b368-33cdbc28f770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:22.245460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0516ef-73d6-4c5e-b368-33cdbc28f770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:22.245951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0516ef-73d6-4c5e-b368-33cdbc28f770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:22.246397 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0516ef-73d6-4c5e-b368-33cdbc28f770 admin admin] PATH_INFO: `/v3/projects/cc2e01ef7bf24c1e920beed5c3ea5cc4` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:22.253165 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0516ef-73d6-4c5e-b368-33cdbc28f770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc2e01ef7bf24c1e920beed5c3ea5cc4)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:22.255396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0516ef-73d6-4c5e-b368-33cdbc28f770 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:22.369853 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8e0516ef-73d6-4c5e-b368-33cdbc28f770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc2e01ef7bf24c1e920beed5c3ea5cc4', 'request_id': 'req-8e0516ef-73d6-4c5e-b368-33cdbc28f770'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:22.384304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8e0516ef-73d6-4c5e-b368-33cdbc28f770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc2e01ef7bf24c1e920beed5c3ea5cc4', 'request_id': 'req-8e0516ef-73d6-4c5e-b368-33cdbc28f770'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:22.416697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8e0516ef-73d6-4c5e-b368-33cdbc28f770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc2e01ef7bf24c1e920beed5c3ea5cc4', 'request_id': 'req-8e0516ef-73d6-4c5e-b368-33cdbc28f770'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:22.446474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8e0516ef-73d6-4c5e-b368-33cdbc28f770 admin admin] The token cache is being invalidate because project cc2e01ef7bf24c1e920beed5c3ea5cc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:32:22.446836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8e0516ef-73d6-4c5e-b368-33cdbc28f770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:22.448023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8e0516ef-73d6-4c5e-b368-33cdbc28f770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:22.453452 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2319/4659] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:32:22 2022] DELETE /identity/v3/projects/cc2e01ef7bf24c1e920beed5c3ea5cc4 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:22.463754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f559b0-3848-4e48-9ed2-b9eec84db1aa None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:22.464057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f559b0-3848-4e48-9ed2-b9eec84db1aa None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:22.464334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f559b0-3848-4e48-9ed2-b9eec84db1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:22.520989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-04f559b0-3848-4e48-9ed2-b9eec84db1aa None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:22.522553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-04f559b0-3848-4e48-9ed2-b9eec84db1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:22.694530 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2341/4660] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:22.708706 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ff2e9-a76e-40b5-b9d5-8b1cdd85cbf6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:22.709247 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ff2e9-a76e-40b5-b9d5-8b1cdd85cbf6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:22.709680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ff2e9-a76e-40b5-b9d5-8b1cdd85cbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:22.744269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-289ff2e9-a76e-40b5-b9d5-8b1cdd85cbf6 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:22.745776 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-289ff2e9-a76e-40b5-b9d5-8b1cdd85cbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:22.764552 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2320/4661] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:22.771496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f559b0-3848-4e48-9ed2-b9eec84db1aa None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:22.781884 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f559b0-3848-4e48-9ed2-b9eec84db1aa None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:22.801366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100de46a-fd8d-4514-9253-52b4fc25f8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:22.802650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100de46a-fd8d-4514-9253-52b4fc25f8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:22.803268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100de46a-fd8d-4514-9253-52b4fc25f8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:22.803937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100de46a-fd8d-4514-9253-52b4fc25f8e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:22.805259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100de46a-fd8d-4514-9253-52b4fc25f8e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:32:22.806060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100de46a-fd8d-4514-9253-52b4fc25f8e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:22.808376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100de46a-fd8d-4514-9253-52b4fc25f8e6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:22.865712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ff2e9-a76e-40b5-b9d5-8b1cdd85cbf6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:22.870780 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2342/4662] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:32:22.886105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ff2e9-a76e-40b5-b9d5-8b1cdd85cbf6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:22.900695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d1717-e26a-45e2-a5d1-431f4dad4ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:22.908926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d1717-e26a-45e2-a5d1-431f4dad4ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:22.909984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d1717-e26a-45e2-a5d1-431f4dad4ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:22.911255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d1717-e26a-45e2-a5d1-431f4dad4ca1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:22.912419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d1717-e26a-45e2-a5d1-431f4dad4ca1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:22.920163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d1717-e26a-45e2-a5d1-431f4dad4ca1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:22.975475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100de46a-fd8d-4514-9253-52b4fc25f8e6 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:22.978872 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2321/4663] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:32:22 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:32:23.002418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100de46a-fd8d-4514-9253-52b4fc25f8e6 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:23.186630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbefd5-b253-4640-967d-f4e89da8d87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:23.195164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbefd5-b253-4640-967d-f4e89da8d87b admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:23.195514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbefd5-b253-4640-967d-f4e89da8d87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:23.195716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbefd5-b253-4640-967d-f4e89da8d87b admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:23.196698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbefd5-b253-4640-967d-f4e89da8d87b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:23.198838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbefd5-b253-4640-967d-f4e89da8d87b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:23.272988 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2343/4664] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:32:22 2022] POST /identity/v3/users => generated 293 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:32:23.279618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d1717-e26a-45e2-a5d1-431f4dad4ca1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:23.300839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d1717-e26a-45e2-a5d1-431f4dad4ca1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:23.331326 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3e27e-edf6-4e97-addc-fe7a04ffbda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:23.334978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3e27e-edf6-4e97-addc-fe7a04ffbda5 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:23.335448 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3e27e-edf6-4e97-addc-fe7a04ffbda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:23.336008 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3e27e-edf6-4e97-addc-fe7a04ffbda5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:23.353630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3e27e-edf6-4e97-addc-fe7a04ffbda5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:23.358433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3e27e-edf6-4e97-addc-fe7a04ffbda5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:23.386390 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:23.407247 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2322/4665] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:32:23.412174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbefd5-b253-4640-967d-f4e89da8d87b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:23.430024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbefd5-b253-4640-967d-f4e89da8d87b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:23.444119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8ef47-707a-479a-9244-ecc646d078d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:23.444756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8ef47-707a-479a-9244-ecc646d078d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:23.445035 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8ef47-707a-479a-9244-ecc646d078d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:23.445310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8ef47-707a-479a-9244-ecc646d078d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:23.445969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8ef47-707a-479a-9244-ecc646d078d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:23.448045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8ef47-707a-479a-9244-ecc646d078d4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:23.481336 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2344/4666] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:32:23.485296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3e27e-edf6-4e97-addc-fe7a04ffbda5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:23.510317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3e27e-edf6-4e97-addc-fe7a04ffbda5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:23.525613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbf9a8-3b0b-4ba5-a1d6-5242d30858a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:23.526298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbf9a8-3b0b-4ba5-a1d6-5242d30858a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:23.526569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbf9a8-3b0b-4ba5-a1d6-5242d30858a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:23.526842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbf9a8-3b0b-4ba5-a1d6-5242d30858a5 admin admin] PATH_INFO: `/v3/projects/b630a4c3bb824b90b4c1898a92b47aa7/users/d556a8ae0d524894a93203ce3f70d420/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:23.608574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbf9a8-3b0b-4ba5-a1d6-5242d30858a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b630a4c3bb824b90b4c1898a92b47aa7, user_id=d556a8ae0d524894a93203ce3f70d420, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:23.623175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbf9a8-3b0b-4ba5-a1d6-5242d30858a5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:23.651859 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2323/4667] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:32:23 2022] PUT /identity/v3/projects/b630a4c3bb824b90b4c1898a92b47aa7/users/d556a8ae0d524894a93203ce3f70d420/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:23.658357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd0159-ee28-45de-a5d0-527bf38a191e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:23.659069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd0159-ee28-45de-a5d0-527bf38a191e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:23.659637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd0159-ee28-45de-a5d0-527bf38a191e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:23.741830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e5fd0159-ee28-45de-a5d0-527bf38a191e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:23.744060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e5fd0159-ee28-45de-a5d0-527bf38a191e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:23.971806 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:24.058674 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2345/4668] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:24.122098 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbf9a8-3b0b-4ba5-a1d6-5242d30858a5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:24.124158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e2cbf9a8-3b0b-4ba5-a1d6-5242d30858a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:24.252047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbf9a8-3b0b-4ba5-a1d6-5242d30858a5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:24.264791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c74f2-7f92-468d-9c9c-5615b11fe899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:24.265444 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c74f2-7f92-468d-9c9c-5615b11fe899 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:24.265728 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c74f2-7f92-468d-9c9c-5615b11fe899 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:24.266005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c74f2-7f92-468d-9c9c-5615b11fe899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:24.286601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c74f2-7f92-468d-9c9c-5615b11fe899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:24.288247 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c74f2-7f92-468d-9c9c-5615b11fe899 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:24.314268 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2324/4669] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:32:25.722337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd0159-ee28-45de-a5d0-527bf38a191e None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:25.726613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e5fd0159-ee28-45de-a5d0-527bf38a191e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:25.747072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd0159-ee28-45de-a5d0-527bf38a191e None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:25.760607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b146b2-dd60-417d-8f93-60a7025b6396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:25.761574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b146b2-dd60-417d-8f93-60a7025b6396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:25.762139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b146b2-dd60-417d-8f93-60a7025b6396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:25.762511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b146b2-dd60-417d-8f93-60a7025b6396 admin admin] PATH_INFO: `/v3/users/19818a0199054900ba2991c3f8712430` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:25.764920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b146b2-dd60-417d-8f93-60a7025b6396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19818a0199054900ba2991c3f8712430)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:25.773846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b146b2-dd60-417d-8f93-60a7025b6396 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:25.869701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73b146b2-dd60-417d-8f93-60a7025b6396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19818a0199054900ba2991c3f8712430'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:25.890030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73b146b2-dd60-417d-8f93-60a7025b6396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19818a0199054900ba2991c3f8712430'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:25.929176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73b146b2-dd60-417d-8f93-60a7025b6396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19818a0199054900ba2991c3f8712430'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:25.932105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73b146b2-dd60-417d-8f93-60a7025b6396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19818a0199054900ba2991c3f8712430'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:25.950467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73b146b2-dd60-417d-8f93-60a7025b6396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19818a0199054900ba2991c3f8712430'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:25.963037 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2346/4670] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:32:25 2022] DELETE /identity/v3/users/19818a0199054900ba2991c3f8712430 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:25.967865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308f8f7-dd86-4259-84cf-5570eef449f0 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:25.969309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308f8f7-dd86-4259-84cf-5570eef449f0 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:25.969923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308f8f7-dd86-4259-84cf-5570eef449f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:26.013895 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b308f8f7-dd86-4259-84cf-5570eef449f0 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:26.022832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b308f8f7-dd86-4259-84cf-5570eef449f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:26.214139 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2325/4671] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:26.342236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b146b2-dd60-417d-8f93-60a7025b6396 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:26.344352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-73b146b2-dd60-417d-8f93-60a7025b6396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:26.516963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b146b2-dd60-417d-8f93-60a7025b6396 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:26.524926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e05a37-9e9f-4b68-80a5-41c715eeeff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:26.525892 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e05a37-9e9f-4b68-80a5-41c715eeeff7 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:26.526269 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e05a37-9e9f-4b68-80a5-41c715eeeff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:26.526734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e05a37-9e9f-4b68-80a5-41c715eeeff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:26.546935 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e05a37-9e9f-4b68-80a5-41c715eeeff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:26.549734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e05a37-9e9f-4b68-80a5-41c715eeeff7 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:26.571718 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2347/4672] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:32:28.823563 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308f8f7-dd86-4259-84cf-5570eef449f0 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:28.825636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b308f8f7-dd86-4259-84cf-5570eef449f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:28.847485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308f8f7-dd86-4259-84cf-5570eef449f0 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:28.869677 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0732e-764b-4f91-b74a-796900d68c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:28.870542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0732e-764b-4f91-b74a-796900d68c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:28.870823 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0732e-764b-4f91-b74a-796900d68c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:28.871324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0732e-764b-4f91-b74a-796900d68c71 admin admin] PATH_INFO: `/v3/projects/3a1d54252c734d47954009cc5aa6f974` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:28.873704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf0732e-764b-4f91-b74a-796900d68c71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a1d54252c734d47954009cc5aa6f974)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:28.878086 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf0732e-764b-4f91-b74a-796900d68c71 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:29.005334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5bf0732e-764b-4f91-b74a-796900d68c71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a1d54252c734d47954009cc5aa6f974', 'request_id': 'req-5bf0732e-764b-4f91-b74a-796900d68c71'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:29.014568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5bf0732e-764b-4f91-b74a-796900d68c71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a1d54252c734d47954009cc5aa6f974', 'request_id': 'req-5bf0732e-764b-4f91-b74a-796900d68c71'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:29.027784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5bf0732e-764b-4f91-b74a-796900d68c71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a1d54252c734d47954009cc5aa6f974', 'request_id': 'req-5bf0732e-764b-4f91-b74a-796900d68c71'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:29.070780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5bf0732e-764b-4f91-b74a-796900d68c71 admin admin] The token cache is being invalidate because project 3a1d54252c734d47954009cc5aa6f974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:32:29.071472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5bf0732e-764b-4f91-b74a-796900d68c71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:29.072420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5bf0732e-764b-4f91-b74a-796900d68c71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:29.074267 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2326/4673] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:32:28 2022] DELETE /identity/v3/projects/3a1d54252c734d47954009cc5aa6f974 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:29.080156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb7ccf-dc71-443a-8ec5-5b8a11a28372 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:29.080725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb7ccf-dc71-443a-8ec5-5b8a11a28372 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:29.080725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb7ccf-dc71-443a-8ec5-5b8a11a28372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:29.135289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3ccb7ccf-dc71-443a-8ec5-5b8a11a28372 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:29.137134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3ccb7ccf-dc71-443a-8ec5-5b8a11a28372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:29.254845 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:29.288723 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2348/4674] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:29.305246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32c8bd-2f88-470e-bc67-a6cefa0a369e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:29.308616 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32c8bd-2f88-470e-bc67-a6cefa0a369e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:29.309168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32c8bd-2f88-470e-bc67-a6cefa0a369e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:29.376438 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:29.408979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2d32c8bd-2f88-470e-bc67-a6cefa0a369e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:29.413849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2d32c8bd-2f88-470e-bc67-a6cefa0a369e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:29.435786 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2327/4675] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:29.440731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb7ccf-dc71-443a-8ec5-5b8a11a28372 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:29.460802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb7ccf-dc71-443a-8ec5-5b8a11a28372 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:29.495312 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4610812-b324-459f-a054-f3244c34c77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:29.496328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4610812-b324-459f-a054-f3244c34c77a admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:29.496766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4610812-b324-459f-a054-f3244c34c77a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:29.497351 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4610812-b324-459f-a054-f3244c34c77a admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:29.499154 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4610812-b324-459f-a054-f3244c34c77a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:32:29.499534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4610812-b324-459f-a054-f3244c34c77a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:29.502373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4610812-b324-459f-a054-f3244c34c77a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:29.533313 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2349/4676] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:32:29.537786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32c8bd-2f88-470e-bc67-a6cefa0a369e None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:29.568445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32c8bd-2f88-470e-bc67-a6cefa0a369e None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:29.574832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de62793-69e5-4d38-854f-0325f20f49fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:29.575469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de62793-69e5-4d38-854f-0325f20f49fd admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:29.575752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de62793-69e5-4d38-854f-0325f20f49fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:29.576064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de62793-69e5-4d38-854f-0325f20f49fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:29.576726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de62793-69e5-4d38-854f-0325f20f49fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:29.580421 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de62793-69e5-4d38-854f-0325f20f49fd admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:29.638443 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2328/4677] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:32:29 2022] POST /identity/v3/projects => generated 393 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:32:29.642644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4610812-b324-459f-a054-f3244c34c77a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:29.661327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4610812-b324-459f-a054-f3244c34c77a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:29.829466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc87e8f-2c7e-468d-8512-f267dd00e61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:29.831540 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc87e8f-2c7e-468d-8512-f267dd00e61f admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:29.832940 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc87e8f-2c7e-468d-8512-f267dd00e61f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:29.835549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc87e8f-2c7e-468d-8512-f267dd00e61f admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:29.836718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc87e8f-2c7e-468d-8512-f267dd00e61f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:29.851347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc87e8f-2c7e-468d-8512-f267dd00e61f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:29.930297 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2350/4678] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:32:29 2022] POST /identity/v3/users => generated 297 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:32:29.934364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de62793-69e5-4d38-854f-0325f20f49fd admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:29.983207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de62793-69e5-4d38-854f-0325f20f49fd admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:30.012463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c0938-486d-4fc0-aca5-5b0680b072ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:30.017141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c0938-486d-4fc0-aca5-5b0680b072ca admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:30.018940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c0938-486d-4fc0-aca5-5b0680b072ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:30.023269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c0938-486d-4fc0-aca5-5b0680b072ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:30.026097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c0938-486d-4fc0-aca5-5b0680b072ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:30.030464 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c0938-486d-4fc0-aca5-5b0680b072ca admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:30.075152 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2329/4679] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:32:29 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:32:30.079702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc87e8f-2c7e-468d-8512-f267dd00e61f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:30.100717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc87e8f-2c7e-468d-8512-f267dd00e61f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:30.117062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b2cf7-bd1e-4b82-a7f9-7a356414a2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:30.117697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b2cf7-bd1e-4b82-a7f9-7a356414a2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:30.117972 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b2cf7-bd1e-4b82-a7f9-7a356414a2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:30.118242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b2cf7-bd1e-4b82-a7f9-7a356414a2b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:30.119368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b2cf7-bd1e-4b82-a7f9-7a356414a2b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:30.122217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b2cf7-bd1e-4b82-a7f9-7a356414a2b2 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:30.158092 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2351/4680] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:32:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:32:30.162387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c0938-486d-4fc0-aca5-5b0680b072ca admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:30.186459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c0938-486d-4fc0-aca5-5b0680b072ca admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:30.205525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a3dcd-23f3-4edf-80df-e9204d7e7402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:30.206573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a3dcd-23f3-4edf-80df-e9204d7e7402 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:30.207141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a3dcd-23f3-4edf-80df-e9204d7e7402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:30.207654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a3dcd-23f3-4edf-80df-e9204d7e7402 admin admin] PATH_INFO: `/v3/projects/307db42ddfad40db8c2efe752c185a84/users/1b06d31773ee4b9389ee2ea8a12f0f29/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:30.246344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a3dcd-23f3-4edf-80df-e9204d7e7402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=307db42ddfad40db8c2efe752c185a84, user_id=1b06d31773ee4b9389ee2ea8a12f0f29, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:30.249853 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a3dcd-23f3-4edf-80df-e9204d7e7402 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:30.270929 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2330/4681] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:32:30 2022] PUT /identity/v3/projects/307db42ddfad40db8c2efe752c185a84/users/1b06d31773ee4b9389ee2ea8a12f0f29/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:30.277052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21909dc0-4bf9-48f0-a6ba-f0d3f2cf8b99 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:30.277803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21909dc0-4bf9-48f0-a6ba-f0d3f2cf8b99 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:30.278308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21909dc0-4bf9-48f0-a6ba-f0d3f2cf8b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:30.312406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-21909dc0-4bf9-48f0-a6ba-f0d3f2cf8b99 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:30.313868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-21909dc0-4bf9-48f0-a6ba-f0d3f2cf8b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:30.494505 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2352/4682] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:30.624030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a3dcd-23f3-4edf-80df-e9204d7e7402 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:30.627088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-db6a3dcd-23f3-4edf-80df-e9204d7e7402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:30.851673 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a3dcd-23f3-4edf-80df-e9204d7e7402 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:30.868684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c086e-d83f-4cef-9be3-99c290f8478a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:30.869441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c086e-d83f-4cef-9be3-99c290f8478a service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:30.869800 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c086e-d83f-4cef-9be3-99c290f8478a service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:30.870152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c086e-d83f-4cef-9be3-99c290f8478a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:30.900156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c086e-d83f-4cef-9be3-99c290f8478a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:30.902162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c086e-d83f-4cef-9be3-99c290f8478a service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:30.936618 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2331/4683] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:32:34.523548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21909dc0-4bf9-48f0-a6ba-f0d3f2cf8b99 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:34.525973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-21909dc0-4bf9-48f0-a6ba-f0d3f2cf8b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:34.569373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21909dc0-4bf9-48f0-a6ba-f0d3f2cf8b99 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:34.604924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b5ab2-a17e-48b3-8484-4d09fdd07570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:34.605690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b5ab2-a17e-48b3-8484-4d09fdd07570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:34.605976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b5ab2-a17e-48b3-8484-4d09fdd07570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:34.606237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0b5ab2-a17e-48b3-8484-4d09fdd07570 admin admin] PATH_INFO: `/v3/users/6c34ed44a89c49dcb4fe2a2a11da45cd` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:34.613789 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b5ab2-a17e-48b3-8484-4d09fdd07570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c34ed44a89c49dcb4fe2a2a11da45cd)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:34.620419 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0b5ab2-a17e-48b3-8484-4d09fdd07570 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:34.818594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5a0b5ab2-a17e-48b3-8484-4d09fdd07570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c34ed44a89c49dcb4fe2a2a11da45cd'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:34.844883 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5a0b5ab2-a17e-48b3-8484-4d09fdd07570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c34ed44a89c49dcb4fe2a2a11da45cd'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:34.854597 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:34.864508 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5a0b5ab2-a17e-48b3-8484-4d09fdd07570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c34ed44a89c49dcb4fe2a2a11da45cd'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:34.865753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5a0b5ab2-a17e-48b3-8484-4d09fdd07570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c34ed44a89c49dcb4fe2a2a11da45cd'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:34.897789 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5a0b5ab2-a17e-48b3-8484-4d09fdd07570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c34ed44a89c49dcb4fe2a2a11da45cd'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:34.913308 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2353/4684] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:32:34 2022] DELETE /identity/v3/users/6c34ed44a89c49dcb4fe2a2a11da45cd => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:34.917373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23c163-f03e-4bc2-a188-9af39a652dac None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:34.917875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23c163-f03e-4bc2-a188-9af39a652dac None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:34.918245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23c163-f03e-4bc2-a188-9af39a652dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:34.960287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-4d23c163-f03e-4bc2-a188-9af39a652dac None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:34.975043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4d23c163-f03e-4bc2-a188-9af39a652dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:35.179453 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2332/4685] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:35.224107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b5ab2-a17e-48b3-8484-4d09fdd07570 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:35.225717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5a0b5ab2-a17e-48b3-8484-4d09fdd07570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:35.359658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0b5ab2-a17e-48b3-8484-4d09fdd07570 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:35.365957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214ce13-1026-44f6-b1a2-a3763f17018e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:35.368563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214ce13-1026-44f6-b1a2-a3763f17018e service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:35.369047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214ce13-1026-44f6-b1a2-a3763f17018e service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:35.369917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214ce13-1026-44f6-b1a2-a3763f17018e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:35.382137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214ce13-1026-44f6-b1a2-a3763f17018e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:35.384253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214ce13-1026-44f6-b1a2-a3763f17018e service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:35.402918 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2354/4686] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:32:36.135834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23c163-f03e-4bc2-a188-9af39a652dac None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:36.137437 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4d23c163-f03e-4bc2-a188-9af39a652dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:36.164394 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23c163-f03e-4bc2-a188-9af39a652dac None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:36.181568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687d988-30d4-467f-9d23-02bbb73c5a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:36.182520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687d988-30d4-467f-9d23-02bbb73c5a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:36.182967 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687d988-30d4-467f-9d23-02bbb73c5a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:36.183393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687d988-30d4-467f-9d23-02bbb73c5a81 admin admin] PATH_INFO: `/v3/projects/98d9907b8e17409c825da6cf693c15ca` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:36.184771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687d988-30d4-467f-9d23-02bbb73c5a81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98d9907b8e17409c825da6cf693c15ca)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:36.187842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687d988-30d4-467f-9d23-02bbb73c5a81 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:36.284888 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:36.304233 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e687d988-30d4-467f-9d23-02bbb73c5a81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98d9907b8e17409c825da6cf693c15ca', 'request_id': 'req-e687d988-30d4-467f-9d23-02bbb73c5a81'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:36.310608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e687d988-30d4-467f-9d23-02bbb73c5a81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98d9907b8e17409c825da6cf693c15ca', 'request_id': 'req-e687d988-30d4-467f-9d23-02bbb73c5a81'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:36.333105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e687d988-30d4-467f-9d23-02bbb73c5a81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98d9907b8e17409c825da6cf693c15ca', 'request_id': 'req-e687d988-30d4-467f-9d23-02bbb73c5a81'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:36.350278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e687d988-30d4-467f-9d23-02bbb73c5a81 admin admin] The token cache is being invalidate because project 98d9907b8e17409c825da6cf693c15ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:32:36.350866 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e687d988-30d4-467f-9d23-02bbb73c5a81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:36.353495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e687d988-30d4-467f-9d23-02bbb73c5a81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:36.356897 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2333/4687] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:32:36 2022] DELETE /identity/v3/projects/98d9907b8e17409c825da6cf693c15ca => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:36.363122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fd3f5-ecaa-431b-9fb6-91c8df6c28bf None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:36.363675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fd3f5-ecaa-431b-9fb6-91c8df6c28bf None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:36.363675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2fd3f5-ecaa-431b-9fb6-91c8df6c28bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:36.404617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ca2fd3f5-ecaa-431b-9fb6-91c8df6c28bf None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:36.408616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ca2fd3f5-ecaa-431b-9fb6-91c8df6c28bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:36.568837 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2355/4688] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:36.576848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f9315-fcac-46c8-be1c-80e513d78f60 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:36.577134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f9315-fcac-46c8-be1c-80e513d78f60 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:36.577415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f9315-fcac-46c8-be1c-80e513d78f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:36.615710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-8a0f9315-fcac-46c8-be1c-80e513d78f60 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:36.622746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8a0f9315-fcac-46c8-be1c-80e513d78f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:36.645536 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2334/4689] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:36.649780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fd3f5-ecaa-431b-9fb6-91c8df6c28bf None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:36.667477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2fd3f5-ecaa-431b-9fb6-91c8df6c28bf None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:36.673738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8533d21-9dea-4b45-a44f-6ba1a599ef55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:36.674459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8533d21-9dea-4b45-a44f-6ba1a599ef55 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:36.674813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8533d21-9dea-4b45-a44f-6ba1a599ef55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:36.675332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8533d21-9dea-4b45-a44f-6ba1a599ef55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:36.676610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8533d21-9dea-4b45-a44f-6ba1a599ef55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:32:36.676610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8533d21-9dea-4b45-a44f-6ba1a599ef55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:36.678365 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8533d21-9dea-4b45-a44f-6ba1a599ef55 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:36.700841 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2356/4690] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:32:36.706680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f9315-fcac-46c8-be1c-80e513d78f60 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:36.721135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f9315-fcac-46c8-be1c-80e513d78f60 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:36.732488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73eee3f-ef0c-425f-8630-a12433aa6745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:36.733554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73eee3f-ef0c-425f-8630-a12433aa6745 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:36.736419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73eee3f-ef0c-425f-8630-a12433aa6745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:36.736744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73eee3f-ef0c-425f-8630-a12433aa6745 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:36.737701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73eee3f-ef0c-425f-8630-a12433aa6745 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:36.739721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73eee3f-ef0c-425f-8630-a12433aa6745 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:36.817852 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2335/4691] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:32:36 2022] POST /identity/v3/projects => generated 389 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:32:36.818928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8533d21-9dea-4b45-a44f-6ba1a599ef55 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:36.838475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8533d21-9dea-4b45-a44f-6ba1a599ef55 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:37.028125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ae6ea-12d5-4610-a17b-d93133fed9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:37.028752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ae6ea-12d5-4610-a17b-d93133fed9a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:37.029021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ae6ea-12d5-4610-a17b-d93133fed9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:37.029462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ae6ea-12d5-4610-a17b-d93133fed9a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:37.030236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ae6ea-12d5-4610-a17b-d93133fed9a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:37.032404 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ae6ea-12d5-4610-a17b-d93133fed9a9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:37.070433 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:37.091253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73eee3f-ef0c-425f-8630-a12433aa6745 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:37.091696 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2357/4692] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:32:36 2022] POST /identity/v3/users => generated 295 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:32:37.109220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73eee3f-ef0c-425f-8630-a12433aa6745 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:37.118003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af619f7-efcf-478c-b44f-465840e53065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:37.119030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af619f7-efcf-478c-b44f-465840e53065 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:37.119600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af619f7-efcf-478c-b44f-465840e53065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:37.120140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af619f7-efcf-478c-b44f-465840e53065 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:37.124974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af619f7-efcf-478c-b44f-465840e53065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:37.129249 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af619f7-efcf-478c-b44f-465840e53065 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:37.153101 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2336/4693] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:32:37.157002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ae6ea-12d5-4610-a17b-d93133fed9a9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:37.174406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ae6ea-12d5-4610-a17b-d93133fed9a9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:37.185986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96ec6c-52b1-4199-b0e2-522f8e83683b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:37.186629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96ec6c-52b1-4199-b0e2-522f8e83683b admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:37.186916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96ec6c-52b1-4199-b0e2-522f8e83683b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:37.187232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96ec6c-52b1-4199-b0e2-522f8e83683b admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:37.188606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e96ec6c-52b1-4199-b0e2-522f8e83683b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:37.195314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e96ec6c-52b1-4199-b0e2-522f8e83683b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:37.210508 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2358/4694] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:32:37.214931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af619f7-efcf-478c-b44f-465840e53065 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:37.233305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af619f7-efcf-478c-b44f-465840e53065 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:37.249276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aaa8a5-2dba-4483-9b17-e3ef1ce79351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:37.251825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aaa8a5-2dba-4483-9b17-e3ef1ce79351 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:37.254872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aaa8a5-2dba-4483-9b17-e3ef1ce79351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:37.255684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aaa8a5-2dba-4483-9b17-e3ef1ce79351 admin admin] PATH_INFO: `/v3/projects/029a9ff751924841b6f073e21b6a6f88/users/447a7c5b61364d3fa5199e7e21e84c50/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:37.299618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aaa8a5-2dba-4483-9b17-e3ef1ce79351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=029a9ff751924841b6f073e21b6a6f88, user_id=447a7c5b61364d3fa5199e7e21e84c50, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:37.305075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aaa8a5-2dba-4483-9b17-e3ef1ce79351 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:37.346625 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2337/4695] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:32:37 2022] PUT /identity/v3/projects/029a9ff751924841b6f073e21b6a6f88/users/447a7c5b61364d3fa5199e7e21e84c50/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:32:37.359617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67e970-4fac-4258-91c5-f38e429d6268 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:37.360698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67e970-4fac-4258-91c5-f38e429d6268 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:37.361086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67e970-4fac-4258-91c5-f38e429d6268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:37.427862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-7a67e970-4fac-4258-91c5-f38e429d6268 None None] MFA Rules not processed for user `447a7c5b61364d3fa5199e7e21e84c50`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:37.429642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7a67e970-4fac-4258-91c5-f38e429d6268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:37.620000 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2359/4696] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:37.621975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aaa8a5-2dba-4483-9b17-e3ef1ce79351 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:37.770216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aaa8a5-2dba-4483-9b17-e3ef1ce79351 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:37.783574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa521ca-d58d-49aa-8d6e-532544c9b92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:37.784432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa521ca-d58d-49aa-8d6e-532544c9b92c admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:37.784957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa521ca-d58d-49aa-8d6e-532544c9b92c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:37.786004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa521ca-d58d-49aa-8d6e-532544c9b92c admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:37.787028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa521ca-d58d-49aa-8d6e-532544c9b92c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:37.790868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa521ca-d58d-49aa-8d6e-532544c9b92c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:37.861572 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2338/4697] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:32:37 2022] POST /identity/v3/projects => generated 387 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:32:37.866188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67e970-4fac-4258-91c5-f38e429d6268 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:37.883296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67e970-4fac-4258-91c5-f38e429d6268 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:38.133738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa521ca-d58d-49aa-8d6e-532544c9b92c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:38.137443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0aa521ca-d58d-49aa-8d6e-532544c9b92c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:38.221128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048eb8c-7321-433f-b681-fd34fe7b3ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:38.222144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048eb8c-7321-433f-b681-fd34fe7b3ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:38.222687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048eb8c-7321-433f-b681-fd34fe7b3ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:38.223285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048eb8c-7321-433f-b681-fd34fe7b3ec1 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:38.224182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048eb8c-7321-433f-b681-fd34fe7b3ec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:38.226393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048eb8c-7321-433f-b681-fd34fe7b3ec1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:38.266041 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2360/4698] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:32:37 2022] POST /identity/v3/users => generated 300 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:32:38.270214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048eb8c-7321-433f-b681-fd34fe7b3ec1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:38.296752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048eb8c-7321-433f-b681-fd34fe7b3ec1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:38.311044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f87d7-4b06-470c-8acd-8feaab0d29fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:38.311782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f87d7-4b06-470c-8acd-8feaab0d29fd admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:38.312100 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f87d7-4b06-470c-8acd-8feaab0d29fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:38.312481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f87d7-4b06-470c-8acd-8feaab0d29fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:38.314584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f87d7-4b06-470c-8acd-8feaab0d29fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:38.316398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f87d7-4b06-470c-8acd-8feaab0d29fd admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:38.349810 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2361/4699] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:32:38.351060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f87d7-4b06-470c-8acd-8feaab0d29fd admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:38.356389 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:38.373048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f87d7-4b06-470c-8acd-8feaab0d29fd admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:38.388143 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903d804-f78f-43f4-a802-1e29422dd664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:38.389084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903d804-f78f-43f4-a802-1e29422dd664 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:38.389517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903d804-f78f-43f4-a802-1e29422dd664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:38.389965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903d804-f78f-43f4-a802-1e29422dd664 admin admin] PATH_INFO: `/v3/projects/37702540f53440c4a99367868024bbe8/users/e3b975201904473382556fbbfc5e039e/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:38.404995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa521ca-d58d-49aa-8d6e-532544c9b92c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:38.410079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4903d804-f78f-43f4-a802-1e29422dd664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37702540f53440c4a99367868024bbe8, user_id=e3b975201904473382556fbbfc5e039e, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:38.413119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4903d804-f78f-43f4-a802-1e29422dd664 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:38.422397 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845325f-966c-42a3-abfb-7c1a704827d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:38.423346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845325f-966c-42a3-abfb-7c1a704827d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:38.423736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845325f-966c-42a3-abfb-7c1a704827d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:38.427100 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845325f-966c-42a3-abfb-7c1a704827d8 admin admin] PATH_INFO: `/v3/users/12296a0f9a404953802832c9a8d248b6` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:38.429029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845325f-966c-42a3-abfb-7c1a704827d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12296a0f9a404953802832c9a8d248b6)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:38.438379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845325f-966c-42a3-abfb-7c1a704827d8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:38.448809 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2362/4700] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:32:38 2022] PUT /identity/v3/projects/37702540f53440c4a99367868024bbe8/users/e3b975201904473382556fbbfc5e039e/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:38.452609 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903d804-f78f-43f4-a802-1e29422dd664 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:38.501242 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:38.541565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903d804-f78f-43f4-a802-1e29422dd664 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:38.547282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8845325f-966c-42a3-abfb-7c1a704827d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12296a0f9a404953802832c9a8d248b6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:38.548891 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1786c4cc-461b-49de-af25-53d51843490e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:38.549706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786c4cc-461b-49de-af25-53d51843490e admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:38.550321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786c4cc-461b-49de-af25-53d51843490e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:38.550854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786c4cc-461b-49de-af25-53d51843490e admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:38.551675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1786c4cc-461b-49de-af25-53d51843490e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:38.553705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1786c4cc-461b-49de-af25-53d51843490e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:38.566474 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2363/4701] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:32:38.571535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1786c4cc-461b-49de-af25-53d51843490e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:38.572473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8845325f-966c-42a3-abfb-7c1a704827d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12296a0f9a404953802832c9a8d248b6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:38.584370 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1786c4cc-461b-49de-af25-53d51843490e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:38.591630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53a4d7-3dd4-4a13-a6c1-2e8877ff61d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:38.592606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53a4d7-3dd4-4a13-a6c1-2e8877ff61d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:38.593212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53a4d7-3dd4-4a13-a6c1-2e8877ff61d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:38.593818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53a4d7-3dd4-4a13-a6c1-2e8877ff61d7 admin admin] PATH_INFO: `/v3/projects/37702540f53440c4a99367868024bbe8/users/e3b975201904473382556fbbfc5e039e/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:38.596620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c53a4d7-3dd4-4a13-a6c1-2e8877ff61d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37702540f53440c4a99367868024bbe8, user_id=e3b975201904473382556fbbfc5e039e, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:38.624128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c53a4d7-3dd4-4a13-a6c1-2e8877ff61d7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:38.624945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8845325f-966c-42a3-abfb-7c1a704827d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12296a0f9a404953802832c9a8d248b6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:38.626889 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8845325f-966c-42a3-abfb-7c1a704827d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12296a0f9a404953802832c9a8d248b6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:38.642132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8845325f-966c-42a3-abfb-7c1a704827d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12296a0f9a404953802832c9a8d248b6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:38.656642 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2339/4702] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:32:38 2022] DELETE /identity/v3/users/12296a0f9a404953802832c9a8d248b6 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:38.667166 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2364/4703] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:32:38 2022] PUT /identity/v3/projects/37702540f53440c4a99367868024bbe8/users/e3b975201904473382556fbbfc5e039e/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:38.667346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867ce95-379c-4643-bd06-0edaac30b691 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:38.667346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867ce95-379c-4643-bd06-0edaac30b691 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:38.667583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867ce95-379c-4643-bd06-0edaac30b691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:38.712849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-4867ce95-379c-4643-bd06-0edaac30b691 None None] MFA Rules not processed for user `e3b975201904473382556fbbfc5e039e`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:38.715754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4867ce95-379c-4643-bd06-0edaac30b691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:38.878046 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4beb706-e699-4681-8ad2-0d1b862b3be0 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:38.878335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4beb706-e699-4681-8ad2-0d1b862b3be0 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:38.878612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4beb706-e699-4681-8ad2-0d1b862b3be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:38.917706 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2340/4704] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:38 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:38.929560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867ce95-379c-4643-bd06-0edaac30b691 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:38.933948 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4867ce95-379c-4643-bd06-0edaac30b691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:38.945349 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a4beb706-e699-4681-8ad2-0d1b862b3be0 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:38.946587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a4beb706-e699-4681-8ad2-0d1b862b3be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:39.136740 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:39.159863 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2365/4705] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:32:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:39.249185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867ce95-379c-4643-bd06-0edaac30b691 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:39.253770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4beb706-e699-4681-8ad2-0d1b862b3be0 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:39.255454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a4beb706-e699-4681-8ad2-0d1b862b3be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:39.274674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa6112-28a0-44d5-8183-5fcc8f5153b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:39.275529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa6112-28a0-44d5-8183-5fcc8f5153b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:39.275947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa6112-28a0-44d5-8183-5fcc8f5153b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:39.276337 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa6112-28a0-44d5-8183-5fcc8f5153b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:39.311933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa6112-28a0-44d5-8183-5fcc8f5153b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:39.317399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa6112-28a0-44d5-8183-5fcc8f5153b9 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:39.366255 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2341/4706] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:38 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:32:39.409711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa6112-28a0-44d5-8183-5fcc8f5153b9 service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:39.411519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2eaa6112-28a0-44d5-8183-5fcc8f5153b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:39.544313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4beb706-e699-4681-8ad2-0d1b862b3be0 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:39.567862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedafa2-9b51-4e6e-91ed-5fc1f5b4e6ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:39.568530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedafa2-9b51-4e6e-91ed-5fc1f5b4e6ba service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:39.568810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedafa2-9b51-4e6e-91ed-5fc1f5b4e6ba service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:39.573399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedafa2-9b51-4e6e-91ed-5fc1f5b4e6ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:39.616375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedafa2-9b51-4e6e-91ed-5fc1f5b4e6ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:39.616375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedafa2-9b51-4e6e-91ed-5fc1f5b4e6ba service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:39.629904 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa6112-28a0-44d5-8183-5fcc8f5153b9 service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:39.634998 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2366/4707] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:32:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:32:39.639906 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8061ac-cac2-421a-84e2-db0496c95eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:39.641224 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8061ac-cac2-421a-84e2-db0496c95eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:39.641942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8061ac-cac2-421a-84e2-db0496c95eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:39.642488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8061ac-cac2-421a-84e2-db0496c95eed admin admin] PATH_INFO: `/v3/projects/60a99f19652f46448fc31190d760d018` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:39.646345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8061ac-cac2-421a-84e2-db0496c95eed admin admin] RBAC: Authorizing `identity:delete_project(project_id=60a99f19652f46448fc31190d760d018)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:39.650735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8061ac-cac2-421a-84e2-db0496c95eed admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:39.768863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5f8061ac-cac2-421a-84e2-db0496c95eed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60a99f19652f46448fc31190d760d018', 'request_id': 'req-5f8061ac-cac2-421a-84e2-db0496c95eed'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:39.787906 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5f8061ac-cac2-421a-84e2-db0496c95eed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60a99f19652f46448fc31190d760d018', 'request_id': 'req-5f8061ac-cac2-421a-84e2-db0496c95eed'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:39.797205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedafa2-9b51-4e6e-91ed-5fc1f5b4e6ba service swift] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:39.799203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-baedafa2-9b51-4e6e-91ed-5fc1f5b4e6ba service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:39.809802 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5f8061ac-cac2-421a-84e2-db0496c95eed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60a99f19652f46448fc31190d760d018', 'request_id': 'req-5f8061ac-cac2-421a-84e2-db0496c95eed'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:39.838140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedafa2-9b51-4e6e-91ed-5fc1f5b4e6ba service swift] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:39.850807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5f8061ac-cac2-421a-84e2-db0496c95eed admin admin] The token cache is being invalidate because project 60a99f19652f46448fc31190d760d018 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:32:39.856805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5f8061ac-cac2-421a-84e2-db0496c95eed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:39.863825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5f8061ac-cac2-421a-84e2-db0496c95eed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:39.870130 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2342/4708] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:32:39 2022] DELETE /identity/v3/projects/60a99f19652f46448fc31190d760d018 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:39.876161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769193d5-80b0-4bbb-bfef-cf9e1df2bff1 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:39.876733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769193d5-80b0-4bbb-bfef-cf9e1df2bff1 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:39.877751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769193d5-80b0-4bbb-bfef-cf9e1df2bff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:39.958937 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-769193d5-80b0-4bbb-bfef-cf9e1df2bff1 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:39.975877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-769193d5-80b0-4bbb-bfef-cf9e1df2bff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:39.998879 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:40.097591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ceea68-ac3b-4930-8d77-602a6d931162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:40.100612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ceea68-ac3b-4930-8d77-602a6d931162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:40.104705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ceea68-ac3b-4930-8d77-602a6d931162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:40.105183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ceea68-ac3b-4930-8d77-602a6d931162 admin admin] PATH_INFO: `/v3/users/447a7c5b61364d3fa5199e7e21e84c50` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:40.109151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ceea68-ac3b-4930-8d77-602a6d931162 admin admin] RBAC: Authorizing `identity:delete_user(user_id=447a7c5b61364d3fa5199e7e21e84c50)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:40.116760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ceea68-ac3b-4930-8d77-602a6d931162 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:40.221145 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2343/4709] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:40.223900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23e97f-c1c8-4a33-ab62-0ccaa4cc976f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:40.224162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23e97f-c1c8-4a33-ab62-0ccaa4cc976f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:40.225935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23e97f-c1c8-4a33-ab62-0ccaa4cc976f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:40.255669 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-79ceea68-ac3b-4930-8d77-602a6d931162 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '447a7c5b61364d3fa5199e7e21e84c50'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:40.276189 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:40.277043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-79ceea68-ac3b-4930-8d77-602a6d931162 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '447a7c5b61364d3fa5199e7e21e84c50'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:40.317308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-79ceea68-ac3b-4930-8d77-602a6d931162 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '447a7c5b61364d3fa5199e7e21e84c50'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:40.319750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-79ceea68-ac3b-4930-8d77-602a6d931162 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '447a7c5b61364d3fa5199e7e21e84c50'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:40.323682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ec23e97f-c1c8-4a33-ab62-0ccaa4cc976f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:40.326476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ec23e97f-c1c8-4a33-ab62-0ccaa4cc976f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:40.336969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-79ceea68-ac3b-4930-8d77-602a6d931162 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '447a7c5b61364d3fa5199e7e21e84c50'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:40.355390 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2367/4710] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:32:39 2022] DELETE /identity/v3/users/447a7c5b61364d3fa5199e7e21e84c50 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:40.361351 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81ac6e-e5e8-4f34-bf5d-4c7a120d69a6 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:40.361351 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81ac6e-e5e8-4f34-bf5d-4c7a120d69a6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:40.362543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81ac6e-e5e8-4f34-bf5d-4c7a120d69a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:40.367066 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2344/4711] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:40.368509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23e97f-c1c8-4a33-ab62-0ccaa4cc976f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:40.401426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23e97f-c1c8-4a33-ab62-0ccaa4cc976f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:40.427845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-fd81ac6e-e5e8-4f34-bf5d-4c7a120d69a6 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:40.435392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fd81ac6e-e5e8-4f34-bf5d-4c7a120d69a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:40.561923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e9e31-d5b8-4993-9dfa-2e6864938aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:40.563329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e9e31-d5b8-4993-9dfa-2e6864938aed admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:40.563694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e9e31-d5b8-4993-9dfa-2e6864938aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:40.564131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e9e31-d5b8-4993-9dfa-2e6864938aed admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:40.564889 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e9e31-d5b8-4993-9dfa-2e6864938aed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:32:40.565262 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e9e31-d5b8-4993-9dfa-2e6864938aed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:40.567139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e9e31-d5b8-4993-9dfa-2e6864938aed admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:40.606467 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2345/4712] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:32:40.607847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e9e31-d5b8-4993-9dfa-2e6864938aed admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:40.615071 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2368/4713] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:40.624332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e9e31-d5b8-4993-9dfa-2e6864938aed admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:40.633103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef9102-eb50-4246-a6ca-def5a2ea4306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:40.633822 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef9102-eb50-4246-a6ca-def5a2ea4306 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:40.634239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef9102-eb50-4246-a6ca-def5a2ea4306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:40.634440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef9102-eb50-4246-a6ca-def5a2ea4306 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:40.635523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef9102-eb50-4246-a6ca-def5a2ea4306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:40.639174 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef9102-eb50-4246-a6ca-def5a2ea4306 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:40.718389 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2346/4714] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:32:40 2022] POST /identity/v3/projects => generated 401 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:32:40.723689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81ac6e-e5e8-4f34-bf5d-4c7a120d69a6 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:40.735740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd81ac6e-e5e8-4f34-bf5d-4c7a120d69a6 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:40.799745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef9102-eb50-4246-a6ca-def5a2ea4306 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:40.799745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-96ef9102-eb50-4246-a6ca-def5a2ea4306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:40.917628 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:40.928320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef6214-18d6-4544-8c2b-f22077167800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:40.928954 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef6214-18d6-4544-8c2b-f22077167800 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:40.932103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef6214-18d6-4544-8c2b-f22077167800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:40.932707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef6214-18d6-4544-8c2b-f22077167800 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:40.934138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef6214-18d6-4544-8c2b-f22077167800 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:40.939505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef6214-18d6-4544-8c2b-f22077167800 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:40.955579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef9102-eb50-4246-a6ca-def5a2ea4306 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:40.992504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e2f43-840f-436e-acb9-5d8a74eba445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:40.993747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e2f43-840f-436e-acb9-5d8a74eba445 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:40.994191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e2f43-840f-436e-acb9-5d8a74eba445 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:40.999305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e2f43-840f-436e-acb9-5d8a74eba445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:41.001706 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2369/4715] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:32:40 2022] POST /identity/v3/users => generated 301 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:32:41.007304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef6214-18d6-4544-8c2b-f22077167800 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:41.020818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e2f43-840f-436e-acb9-5d8a74eba445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:41.023761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e2f43-840f-436e-acb9-5d8a74eba445 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:41.046287 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2347/4716] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:32:41.059914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef6214-18d6-4544-8c2b-f22077167800 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:41.072006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a546cfd-9409-4363-bbde-a3612e82ad33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:41.072715 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a546cfd-9409-4363-bbde-a3612e82ad33 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:41.072997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a546cfd-9409-4363-bbde-a3612e82ad33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:41.073272 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a546cfd-9409-4363-bbde-a3612e82ad33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:41.073949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a546cfd-9409-4363-bbde-a3612e82ad33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:41.078130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a546cfd-9409-4363-bbde-a3612e82ad33 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:41.108157 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e2f43-840f-436e-acb9-5d8a74eba445 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:41.108513 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2370/4717] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:32:41.123755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e2f43-840f-436e-acb9-5d8a74eba445 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:41.139767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf36a39-3d90-46d6-8064-45520084eb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:41.140737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf36a39-3d90-46d6-8064-45520084eb26 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:41.141235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf36a39-3d90-46d6-8064-45520084eb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:41.141682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf36a39-3d90-46d6-8064-45520084eb26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:41.142516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf36a39-3d90-46d6-8064-45520084eb26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:41.145540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf36a39-3d90-46d6-8064-45520084eb26 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:41.172867 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2348/4718] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:32:41.176960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a546cfd-9409-4363-bbde-a3612e82ad33 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:41.192465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a546cfd-9409-4363-bbde-a3612e82ad33 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:41.204997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c66cd0-b033-4508-aac2-44693608f3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:41.210040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c66cd0-b033-4508-aac2-44693608f3b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:41.210365 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c66cd0-b033-4508-aac2-44693608f3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:41.210648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c66cd0-b033-4508-aac2-44693608f3b5 admin admin] PATH_INFO: `/v3/projects/1b80c20539a44d44afc0b1de4e1e713c/users/b9607192d2a1497891e075da329c8f46/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:41.256050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c66cd0-b033-4508-aac2-44693608f3b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b80c20539a44d44afc0b1de4e1e713c, user_id=b9607192d2a1497891e075da329c8f46, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:41.261567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c66cd0-b033-4508-aac2-44693608f3b5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:41.292220 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2371/4719] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:32:41 2022] PUT /identity/v3/projects/1b80c20539a44d44afc0b1de4e1e713c/users/b9607192d2a1497891e075da329c8f46/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:41.303716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297e707-ab9b-4ff0-88dc-713d2a6f87ae None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:41.304050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297e707-ab9b-4ff0-88dc-713d2a6f87ae None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:41.304340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297e707-ab9b-4ff0-88dc-713d2a6f87ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:41.379981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6297e707-ab9b-4ff0-88dc-713d2a6f87ae None None] MFA Rules not processed for user `b9607192d2a1497891e075da329c8f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:41.381326 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6297e707-ab9b-4ff0-88dc-713d2a6f87ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:41.505290 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:41.551257 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2349/4720] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:41 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:41.566671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c66cd0-b033-4508-aac2-44693608f3b5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:41.728981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c66cd0-b033-4508-aac2-44693608f3b5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:41.746226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba97ece-bfea-4ebe-b9d5-ec7eb0ca04b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:41.751235 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba97ece-bfea-4ebe-b9d5-ec7eb0ca04b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:41.751516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba97ece-bfea-4ebe-b9d5-ec7eb0ca04b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:41.751800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba97ece-bfea-4ebe-b9d5-ec7eb0ca04b1 admin admin] PATH_INFO: `/v3/users/b9607192d2a1497891e075da329c8f46` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:41.760216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba97ece-bfea-4ebe-b9d5-ec7eb0ca04b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9607192d2a1497891e075da329c8f46)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:41.774389 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba97ece-bfea-4ebe-b9d5-ec7eb0ca04b1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:41.942933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4ba97ece-bfea-4ebe-b9d5-ec7eb0ca04b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9607192d2a1497891e075da329c8f46'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:41.975780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4ba97ece-bfea-4ebe-b9d5-ec7eb0ca04b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9607192d2a1497891e075da329c8f46'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:42.045241 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4ba97ece-bfea-4ebe-b9d5-ec7eb0ca04b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9607192d2a1497891e075da329c8f46'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:42.048115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4ba97ece-bfea-4ebe-b9d5-ec7eb0ca04b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9607192d2a1497891e075da329c8f46'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:42.076540 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4ba97ece-bfea-4ebe-b9d5-ec7eb0ca04b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9607192d2a1497891e075da329c8f46'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:42.097342 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2372/4721] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:32:41 2022] DELETE /identity/v3/users/b9607192d2a1497891e075da329c8f46 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:42.107059 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2baf1-b4cf-410c-a947-760e515acc0b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:42.107449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2baf1-b4cf-410c-a947-760e515acc0b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:42.107858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2baf1-b4cf-410c-a947-760e515acc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:42.159932 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-a2e2baf1-b4cf-410c-a947-760e515acc0b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:42.162696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a2e2baf1-b4cf-410c-a947-760e515acc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:42.350814 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2350/4722] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:42.373170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba97ece-bfea-4ebe-b9d5-ec7eb0ca04b1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:42.374871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4ba97ece-bfea-4ebe-b9d5-ec7eb0ca04b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:42.458672 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:42.531182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba97ece-bfea-4ebe-b9d5-ec7eb0ca04b1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:42.543522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46591dc4-e126-4308-9ad5-35b24d264436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:42.544185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46591dc4-e126-4308-9ad5-35b24d264436 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:42.544468 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46591dc4-e126-4308-9ad5-35b24d264436 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:42.544738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46591dc4-e126-4308-9ad5-35b24d264436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:42.566472 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46591dc4-e126-4308-9ad5-35b24d264436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:42.568081 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46591dc4-e126-4308-9ad5-35b24d264436 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:42.598033 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2373/4723] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:32:43.435590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2baf1-b4cf-410c-a947-760e515acc0b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:43.437037 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a2e2baf1-b4cf-410c-a947-760e515acc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:43.558619 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8b6a5-4958-4e9a-ba6a-12e96b203cd8 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:43.560603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8b6a5-4958-4e9a-ba6a-12e96b203cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:43.561125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8b6a5-4958-4e9a-ba6a-12e96b203cd8 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:43.565191 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2374/4724] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 01:32:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:32:43.573614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372037bc-79d7-4112-9b2b-bac71f1dec63 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:43.574153 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372037bc-79d7-4112-9b2b-bac71f1dec63 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:43.574594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372037bc-79d7-4112-9b2b-bac71f1dec63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:43.687696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2baf1-b4cf-410c-a947-760e515acc0b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:43.698500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-372037bc-79d7-4112-9b2b-bac71f1dec63 None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:43.701548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e98161-78f5-4899-836e-e77ec6373990 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:43.702372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e98161-78f5-4899-836e-e77ec6373990 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:43.702604 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-372037bc-79d7-4112-9b2b-bac71f1dec63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:43.702725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e98161-78f5-4899-836e-e77ec6373990 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:43.702910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e98161-78f5-4899-836e-e77ec6373990 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:43.705748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-60e98161-78f5-4899-836e-e77ec6373990 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:43.744544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e98161-78f5-4899-836e-e77ec6373990 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:43.746538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e98161-78f5-4899-836e-e77ec6373990 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:43.783053 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2351/4725] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:32:43.945371 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2375/4726] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:32:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:32:43.988087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e98161-78f5-4899-836e-e77ec6373990 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:43.990503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372037bc-79d7-4112-9b2b-bac71f1dec63 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:43.994225 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-60e98161-78f5-4899-836e-e77ec6373990 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:43.995927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-372037bc-79d7-4112-9b2b-bac71f1dec63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:44.042040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e98161-78f5-4899-836e-e77ec6373990 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:44.043666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372037bc-79d7-4112-9b2b-bac71f1dec63 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:44.059192 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dc32af-a4bf-4bca-9d2a-533f378ff835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:44.059863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc32af-a4bf-4bca-9d2a-533f378ff835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:44.060929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176c6b5-e3d7-42ab-ae30-2dc270defa6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:44.061555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176c6b5-e3d7-42ab-ae30-2dc270defa6f service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:44.061832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176c6b5-e3d7-42ab-ae30-2dc270defa6f service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:44.062102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176c6b5-e3d7-42ab-ae30-2dc270defa6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:44.062860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc32af-a4bf-4bca-9d2a-533f378ff835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:44.063198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc32af-a4bf-4bca-9d2a-533f378ff835 admin admin] PATH_INFO: `/v3/projects/1b80c20539a44d44afc0b1de4e1e713c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:44.064834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc32af-a4bf-4bca-9d2a-533f378ff835 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b80c20539a44d44afc0b1de4e1e713c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:44.066792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dc32af-a4bf-4bca-9d2a-533f378ff835 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:44.087032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d176c6b5-e3d7-42ab-ae30-2dc270defa6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:44.088714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d176c6b5-e3d7-42ab-ae30-2dc270defa6f service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:44.126362 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2376/4727] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:32:44.200735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f9dc32af-a4bf-4bca-9d2a-533f378ff835 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b80c20539a44d44afc0b1de4e1e713c', 'request_id': 'req-f9dc32af-a4bf-4bca-9d2a-533f378ff835'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:44.215387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f9dc32af-a4bf-4bca-9d2a-533f378ff835 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b80c20539a44d44afc0b1de4e1e713c', 'request_id': 'req-f9dc32af-a4bf-4bca-9d2a-533f378ff835'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:44.227287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f9dc32af-a4bf-4bca-9d2a-533f378ff835 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b80c20539a44d44afc0b1de4e1e713c', 'request_id': 'req-f9dc32af-a4bf-4bca-9d2a-533f378ff835'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:44.249743 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:44.258510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f9dc32af-a4bf-4bca-9d2a-533f378ff835 admin admin] The token cache is being invalidate because project 1b80c20539a44d44afc0b1de4e1e713c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:32:44.260007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f9dc32af-a4bf-4bca-9d2a-533f378ff835 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:44.262624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f9dc32af-a4bf-4bca-9d2a-533f378ff835 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:44.266103 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2352/4728] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:32:43 2022] DELETE /identity/v3/projects/1b80c20539a44d44afc0b1de4e1e713c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:44.273807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcaa169-f7a5-4274-8e3d-021ccc921c1e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:44.274232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcaa169-f7a5-4274-8e3d-021ccc921c1e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:44.274506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcaa169-f7a5-4274-8e3d-021ccc921c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:44.323953 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5bcaa169-f7a5-4274-8e3d-021ccc921c1e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:44.328708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5bcaa169-f7a5-4274-8e3d-021ccc921c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:44.556317 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2377/4729] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:44.646090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8b170-2581-449a-87a8-2eda9b297cca None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:44.647410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8b170-2581-449a-87a8-2eda9b297cca None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:44.647975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8b170-2581-449a-87a8-2eda9b297cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:44.675215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-4ac8b170-2581-449a-87a8-2eda9b297cca None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:44.677670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4ac8b170-2581-449a-87a8-2eda9b297cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:44.695812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcaa169-f7a5-4274-8e3d-021ccc921c1e None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:44.721724 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2353/4730] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:44.729053 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcaa169-f7a5-4274-8e3d-021ccc921c1e None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:44.747049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f1814-375f-4125-9084-69ad5701b9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:44.749504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f1814-375f-4125-9084-69ad5701b9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:44.749793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f1814-375f-4125-9084-69ad5701b9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:44.750725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f1814-375f-4125-9084-69ad5701b9b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:44.751534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f1814-375f-4125-9084-69ad5701b9b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:32:44.751977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f1814-375f-4125-9084-69ad5701b9b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:44.753642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f1814-375f-4125-9084-69ad5701b9b1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:44.788107 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2378/4731] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:32:44.793651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8b170-2581-449a-87a8-2eda9b297cca None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:44.815490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8b170-2581-449a-87a8-2eda9b297cca None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:44.826959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f23b0-7012-4a6b-b5e8-bfda1c2fd193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:44.829398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f23b0-7012-4a6b-b5e8-bfda1c2fd193 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:44.832842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f23b0-7012-4a6b-b5e8-bfda1c2fd193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:44.833254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f23b0-7012-4a6b-b5e8-bfda1c2fd193 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:44.835734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f23b0-7012-4a6b-b5e8-bfda1c2fd193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:44.841655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f23b0-7012-4a6b-b5e8-bfda1c2fd193 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:44.917928 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2354/4732] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:32:44 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:32:44.922614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f1814-375f-4125-9084-69ad5701b9b1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:44.952845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f1814-375f-4125-9084-69ad5701b9b1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:45.062955 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:45.135428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62358df9-e0b4-4d3f-8bab-f725609ce826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:45.136402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62358df9-e0b4-4d3f-8bab-f725609ce826 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:45.136837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62358df9-e0b4-4d3f-8bab-f725609ce826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:45.137456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62358df9-e0b4-4d3f-8bab-f725609ce826 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:45.138274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62358df9-e0b4-4d3f-8bab-f725609ce826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:45.141793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62358df9-e0b4-4d3f-8bab-f725609ce826 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:45.179721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f23b0-7012-4a6b-b5e8-bfda1c2fd193 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:45.189419 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2379/4733] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:32:44 2022] POST /identity/v3/users => generated 283 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:32:45.198264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f23b0-7012-4a6b-b5e8-bfda1c2fd193 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:45.216095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8740d3e-e4a8-430e-b271-80f62c08d7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:45.217143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8740d3e-e4a8-430e-b271-80f62c08d7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:45.217642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8740d3e-e4a8-430e-b271-80f62c08d7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:45.218125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8740d3e-e4a8-430e-b271-80f62c08d7d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:45.219959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8740d3e-e4a8-430e-b271-80f62c08d7d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:45.222044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8740d3e-e4a8-430e-b271-80f62c08d7d4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:45.258405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62358df9-e0b4-4d3f-8bab-f725609ce826 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:45.270053 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2355/4734] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:32:45.273056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62358df9-e0b4-4d3f-8bab-f725609ce826 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:45.286249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28387d96-2232-4850-88bd-983a7bdaa4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:45.287032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28387d96-2232-4850-88bd-983a7bdaa4db admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:45.287417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28387d96-2232-4850-88bd-983a7bdaa4db admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:45.287792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28387d96-2232-4850-88bd-983a7bdaa4db admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:45.289005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28387d96-2232-4850-88bd-983a7bdaa4db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:45.291168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28387d96-2232-4850-88bd-983a7bdaa4db admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:45.316886 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8740d3e-e4a8-430e-b271-80f62c08d7d4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:45.327535 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2380/4735] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:32:45.330857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8740d3e-e4a8-430e-b271-80f62c08d7d4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:45.339810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32513b-334d-4983-a7bd-fd7444e7517a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:45.340902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32513b-334d-4983-a7bd-fd7444e7517a admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:45.341421 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32513b-334d-4983-a7bd-fd7444e7517a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:45.341956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32513b-334d-4983-a7bd-fd7444e7517a admin admin] PATH_INFO: `/v3/projects/1b24d3fe668d487090e284f38db5407d/users/8f88c01a2ba943418371acc0144b4c28/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:45.376973 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d32513b-334d-4983-a7bd-fd7444e7517a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b24d3fe668d487090e284f38db5407d, user_id=8f88c01a2ba943418371acc0144b4c28, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:45.385715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d32513b-334d-4983-a7bd-fd7444e7517a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:45.414866 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2356/4736] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:32:45 2022] PUT /identity/v3/projects/1b24d3fe668d487090e284f38db5407d/users/8f88c01a2ba943418371acc0144b4c28/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:32:45.421251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b083b-0ef6-4426-ae7f-5ab0ff7e492d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:45.421709 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b083b-0ef6-4426-ae7f-5ab0ff7e492d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:45.422341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b083b-0ef6-4426-ae7f-5ab0ff7e492d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:45.460634 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-7d7b083b-0ef6-4426-ae7f-5ab0ff7e492d None None] MFA Rules not processed for user `8f88c01a2ba943418371acc0144b4c28`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:45.462648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7d7b083b-0ef6-4426-ae7f-5ab0ff7e492d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:45.566809 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2381/4737] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:45.573669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32513b-334d-4983-a7bd-fd7444e7517a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:45.577441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6d32513b-334d-4983-a7bd-fd7444e7517a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:45.683556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32513b-334d-4983-a7bd-fd7444e7517a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:45.689977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b39f2-bc88-4d22-a5c5-d0bfe5a1b653 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:45.690948 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b39f2-bc88-4d22-a5c5-d0bfe5a1b653 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:45.691774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b39f2-bc88-4d22-a5c5-d0bfe5a1b653 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:45.692245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b39f2-bc88-4d22-a5c5-d0bfe5a1b653 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:45.696727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b083b-0ef6-4426-ae7f-5ab0ff7e492d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:45.698702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7d7b083b-0ef6-4426-ae7f-5ab0ff7e492d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:45.724110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b39f2-bc88-4d22-a5c5-d0bfe5a1b653 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:45.726618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b39f2-bc88-4d22-a5c5-d0bfe5a1b653 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:45.774726 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2357/4738] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:32:45.921966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b083b-0ef6-4426-ae7f-5ab0ff7e492d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:45.944049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9248499-0b65-4a62-9044-2c3572e628fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:45.944603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9248499-0b65-4a62-9044-2c3572e628fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:45.944876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9248499-0b65-4a62-9044-2c3572e628fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:45.945142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9248499-0b65-4a62-9044-2c3572e628fe admin admin] PATH_INFO: `/v3/projects/029a9ff751924841b6f073e21b6a6f88` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:45.948300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9248499-0b65-4a62-9044-2c3572e628fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=029a9ff751924841b6f073e21b6a6f88)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:45.953818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9248499-0b65-4a62-9044-2c3572e628fe admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:46.087491 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:46.097063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b9248499-0b65-4a62-9044-2c3572e628fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '029a9ff751924841b6f073e21b6a6f88', 'request_id': 'req-b9248499-0b65-4a62-9044-2c3572e628fe'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:46.108252 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b9248499-0b65-4a62-9044-2c3572e628fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '029a9ff751924841b6f073e21b6a6f88', 'request_id': 'req-b9248499-0b65-4a62-9044-2c3572e628fe'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:46.125512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b9248499-0b65-4a62-9044-2c3572e628fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '029a9ff751924841b6f073e21b6a6f88', 'request_id': 'req-b9248499-0b65-4a62-9044-2c3572e628fe'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:46.149047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b9248499-0b65-4a62-9044-2c3572e628fe admin admin] The token cache is being invalidate because project 029a9ff751924841b6f073e21b6a6f88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:32:46.149342 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b9248499-0b65-4a62-9044-2c3572e628fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:46.150432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b9248499-0b65-4a62-9044-2c3572e628fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:46.155036 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2382/4739] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:32:45 2022] DELETE /identity/v3/projects/029a9ff751924841b6f073e21b6a6f88 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:46.156370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b39f2-bc88-4d22-a5c5-d0bfe5a1b653 service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:46.174189 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b39f2-bc88-4d22-a5c5-d0bfe5a1b653 service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:46.291142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46773cc-2752-4f28-973e-54e62fa3e9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:46.292312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46773cc-2752-4f28-973e-54e62fa3e9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:46.293884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46773cc-2752-4f28-973e-54e62fa3e9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:46.294341 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46773cc-2752-4f28-973e-54e62fa3e9bb admin admin] PATH_INFO: `/v3/users/e3b975201904473382556fbbfc5e039e` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:46.301289 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46773cc-2752-4f28-973e-54e62fa3e9bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3b975201904473382556fbbfc5e039e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:46.305890 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46773cc-2752-4f28-973e-54e62fa3e9bb admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:46.477724 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:46.501734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b46773cc-2752-4f28-973e-54e62fa3e9bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3b975201904473382556fbbfc5e039e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:46.541337 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b46773cc-2752-4f28-973e-54e62fa3e9bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3b975201904473382556fbbfc5e039e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:46.590995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b46773cc-2752-4f28-973e-54e62fa3e9bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3b975201904473382556fbbfc5e039e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:46.596039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b46773cc-2752-4f28-973e-54e62fa3e9bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3b975201904473382556fbbfc5e039e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:46.633603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b46773cc-2752-4f28-973e-54e62fa3e9bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3b975201904473382556fbbfc5e039e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:46.662300 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2358/4740] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:32:46 2022] DELETE /identity/v3/users/e3b975201904473382556fbbfc5e039e => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:47.875091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e40047-8254-40e7-bf0f-2d28285247a8 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:47.875939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e40047-8254-40e7-bf0f-2d28285247a8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:47.876362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e40047-8254-40e7-bf0f-2d28285247a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:47.980033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d8e40047-8254-40e7-bf0f-2d28285247a8 None None] MFA Rules not processed for user `1b06d31773ee4b9389ee2ea8a12f0f29`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:47.986595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d8e40047-8254-40e7-bf0f-2d28285247a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:48.190174 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125d323-6450-489e-9676-c34f29f845e7 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:48.190715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125d323-6450-489e-9676-c34f29f845e7 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:48.190715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125d323-6450-489e-9676-c34f29f845e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:48.191175 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2383/4741] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:48.235848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0125d323-6450-489e-9676-c34f29f845e7 None None] MFA Rules not processed for user `1b06d31773ee4b9389ee2ea8a12f0f29`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:48.244318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0125d323-6450-489e-9676-c34f29f845e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:48.264440 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2359/4742] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:32:48.276869 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e40047-8254-40e7-bf0f-2d28285247a8 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:48.278298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d8e40047-8254-40e7-bf0f-2d28285247a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:48.334615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125d323-6450-489e-9676-c34f29f845e7 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:48.336492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0125d323-6450-489e-9676-c34f29f845e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:48.455620 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0125d323-6450-489e-9676-c34f29f845e7 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:48.460910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe28532-0ce9-4f6a-b38a-6a69434b460c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:48.461684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe28532-0ce9-4f6a-b38a-6a69434b460c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:48.461970 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe28532-0ce9-4f6a-b38a-6a69434b460c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:48.462420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe28532-0ce9-4f6a-b38a-6a69434b460c admin admin] PATH_INFO: `/v3/projects/37702540f53440c4a99367868024bbe8` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:48.463630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe28532-0ce9-4f6a-b38a-6a69434b460c admin admin] RBAC: Authorizing `identity:delete_project(project_id=37702540f53440c4a99367868024bbe8)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:48.465926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe28532-0ce9-4f6a-b38a-6a69434b460c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:48.549197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e40047-8254-40e7-bf0f-2d28285247a8 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:48.570656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c73ecc-3a5d-4885-ae5e-bee3160973fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:48.572492 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c73ecc-3a5d-4885-ae5e-bee3160973fe service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:48.573599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c73ecc-3a5d-4885-ae5e-bee3160973fe service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:48.576209 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c73ecc-3a5d-4885-ae5e-bee3160973fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:48.599759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c73ecc-3a5d-4885-ae5e-bee3160973fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:48.602280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4fe28532-0ce9-4f6a-b38a-6a69434b460c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37702540f53440c4a99367868024bbe8', 'request_id': 'req-4fe28532-0ce9-4f6a-b38a-6a69434b460c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:48.604877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c73ecc-3a5d-4885-ae5e-bee3160973fe service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:48.624630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4fe28532-0ce9-4f6a-b38a-6a69434b460c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37702540f53440c4a99367868024bbe8', 'request_id': 'req-4fe28532-0ce9-4f6a-b38a-6a69434b460c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:48.673057 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2384/4743] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:48 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:32:48.680952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4fe28532-0ce9-4f6a-b38a-6a69434b460c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37702540f53440c4a99367868024bbe8', 'request_id': 'req-4fe28532-0ce9-4f6a-b38a-6a69434b460c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:48.711862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4fe28532-0ce9-4f6a-b38a-6a69434b460c admin admin] The token cache is being invalidate because project 37702540f53440c4a99367868024bbe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:32:48.712191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4fe28532-0ce9-4f6a-b38a-6a69434b460c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:48.713082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4fe28532-0ce9-4f6a-b38a-6a69434b460c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:48.715811 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2360/4744] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:32:48 2022] DELETE /identity/v3/projects/37702540f53440c4a99367868024bbe8 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:48.720815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271e996-4017-463a-8174-c9672ec812f2 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:48.721104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271e996-4017-463a-8174-c9672ec812f2 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:48.721390 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271e996-4017-463a-8174-c9672ec812f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:48.787510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0271e996-4017-463a-8174-c9672ec812f2 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:48.793107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0271e996-4017-463a-8174-c9672ec812f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:48.950522 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:49.023248 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2385/4745] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:49.033006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc8e8d-f518-494f-894e-58d5d1588f1d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:49.033284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc8e8d-f518-494f-894e-58d5d1588f1d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:49.033666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc8e8d-f518-494f-894e-58d5d1588f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:49.084712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1cbc8e8d-f518-494f-894e-58d5d1588f1d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:49.088823 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1cbc8e8d-f518-494f-894e-58d5d1588f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:49.108587 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2361/4746] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:49.111636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271e996-4017-463a-8174-c9672ec812f2 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:49.126793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271e996-4017-463a-8174-c9672ec812f2 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:49.157339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a906ce-3df2-4b94-8365-22574739374b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:49.158029 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a906ce-3df2-4b94-8365-22574739374b admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:49.158330 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a906ce-3df2-4b94-8365-22574739374b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:49.158613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a906ce-3df2-4b94-8365-22574739374b admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:49.172687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a906ce-3df2-4b94-8365-22574739374b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:32:49.173017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a906ce-3df2-4b94-8365-22574739374b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:49.174797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a906ce-3df2-4b94-8365-22574739374b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:49.219326 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2386/4747] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:32:49.220671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc8e8d-f518-494f-894e-58d5d1588f1d None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:49.236929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc8e8d-f518-494f-894e-58d5d1588f1d None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:49.253624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eff569-54e8-445c-b164-a7fe2243332d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:49.254690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eff569-54e8-445c-b164-a7fe2243332d admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:49.255617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eff569-54e8-445c-b164-a7fe2243332d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:49.256209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eff569-54e8-445c-b164-a7fe2243332d admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:49.257109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eff569-54e8-445c-b164-a7fe2243332d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:49.262799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eff569-54e8-445c-b164-a7fe2243332d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:49.365906 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2362/4748] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:32:49 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:32:49.368274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a906ce-3df2-4b94-8365-22574739374b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:49.385288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a906ce-3df2-4b94-8365-22574739374b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:49.484345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9a4f3-9c0d-477f-9858-e5f33685757b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:49.485195 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9a4f3-9c0d-477f-9858-e5f33685757b admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:49.485513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9a4f3-9c0d-477f-9858-e5f33685757b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:49.485810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9a4f3-9c0d-477f-9858-e5f33685757b admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:49.486514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb9a4f3-9c0d-477f-9858-e5f33685757b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:49.488762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb9a4f3-9c0d-477f-9858-e5f33685757b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:49.526918 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2387/4749] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:32:49 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:32:49.528169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eff569-54e8-445c-b164-a7fe2243332d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:49.546305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eff569-54e8-445c-b164-a7fe2243332d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:49.562949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa303918-46a0-4628-8e9d-d9e81f13b223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:49.563172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa303918-46a0-4628-8e9d-d9e81f13b223 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:49.563449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa303918-46a0-4628-8e9d-d9e81f13b223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:49.563743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa303918-46a0-4628-8e9d-d9e81f13b223 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:49.564639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa303918-46a0-4628-8e9d-d9e81f13b223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:49.566290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa303918-46a0-4628-8e9d-d9e81f13b223 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:49.595998 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2363/4750] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:32:49.600309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9a4f3-9c0d-477f-9858-e5f33685757b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:49.620165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9a4f3-9c0d-477f-9858-e5f33685757b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:49.627560 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc93188c-1e93-4b6b-9418-b7904e541f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:49.628234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93188c-1e93-4b6b-9418-b7904e541f32 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:49.628490 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93188c-1e93-4b6b-9418-b7904e541f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:49.628763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc93188c-1e93-4b6b-9418-b7904e541f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:49.629421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93188c-1e93-4b6b-9418-b7904e541f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:49.631050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc93188c-1e93-4b6b-9418-b7904e541f32 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:49.651024 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2388/4751] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:32:49.651674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa303918-46a0-4628-8e9d-d9e81f13b223 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:49.657943 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:49.677807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa303918-46a0-4628-8e9d-d9e81f13b223 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:49.690464 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeefd9c-775c-4ec0-bf12-0612c7eea19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:49.691161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeefd9c-775c-4ec0-bf12-0612c7eea19e admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:49.691460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeefd9c-775c-4ec0-bf12-0612c7eea19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:49.691695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeefd9c-775c-4ec0-bf12-0612c7eea19e admin admin] PATH_INFO: `/v3/projects/c087737e2eb04bd798f02b1aa15f4267/users/2463b241e8fb4414a77b21ea0b26585f/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:49.720741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeefd9c-775c-4ec0-bf12-0612c7eea19e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c087737e2eb04bd798f02b1aa15f4267, user_id=2463b241e8fb4414a77b21ea0b26585f, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:49.726333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeefd9c-775c-4ec0-bf12-0612c7eea19e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:49.761239 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2364/4752] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:32:49 2022] PUT /identity/v3/projects/c087737e2eb04bd798f02b1aa15f4267/users/2463b241e8fb4414a77b21ea0b26585f/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:32:49.774617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ce7a6-918a-406c-a0fb-d7417d26eb48 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:49.774978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ce7a6-918a-406c-a0fb-d7417d26eb48 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:49.775776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ce7a6-918a-406c-a0fb-d7417d26eb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:49.868505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e30ce7a6-918a-406c-a0fb-d7417d26eb48 None None] MFA Rules not processed for user `2463b241e8fb4414a77b21ea0b26585f`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:49.869961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e30ce7a6-918a-406c-a0fb-d7417d26eb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:50.113827 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2389/4753] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:50.117469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeefd9c-775c-4ec0-bf12-0612c7eea19e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:50.264811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeefd9c-775c-4ec0-bf12-0612c7eea19e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:50.279811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b892e-90af-4e81-89ef-cfa6b95c0c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:50.282564 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b892e-90af-4e81-89ef-cfa6b95c0c06 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:50.282845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b892e-90af-4e81-89ef-cfa6b95c0c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:50.283118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b892e-90af-4e81-89ef-cfa6b95c0c06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:50.283786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b892e-90af-4e81-89ef-cfa6b95c0c06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:50.290164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041b892e-90af-4e81-89ef-cfa6b95c0c06 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:50.372447 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2365/4754] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:32:50 2022] POST /identity/v3/projects => generated 385 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:32:50.375069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ce7a6-918a-406c-a0fb-d7417d26eb48 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:50.390591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ce7a6-918a-406c-a0fb-d7417d26eb48 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:50.486591 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:50.530407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8b942-a3d9-4559-b530-5614b9a1f5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:50.532780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8b942-a3d9-4559-b530-5614b9a1f5c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:50.533186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8b942-a3d9-4559-b530-5614b9a1f5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:50.533576 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8b942-a3d9-4559-b530-5614b9a1f5c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:50.534854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8b942-a3d9-4559-b530-5614b9a1f5c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:50.537266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8b942-a3d9-4559-b530-5614b9a1f5c4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:50.584480 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b892e-90af-4e81-89ef-cfa6b95c0c06 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:50.597530 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2390/4755] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:32:50 2022] POST /identity/v3/users => generated 299 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:32:50.598314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041b892e-90af-4e81-89ef-cfa6b95c0c06 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:50.605257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41e3b1-222a-4ce7-9a67-ac657a98284d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:50.606287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41e3b1-222a-4ce7-9a67-ac657a98284d admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:50.606671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41e3b1-222a-4ce7-9a67-ac657a98284d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:50.607131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41e3b1-222a-4ce7-9a67-ac657a98284d admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:50.607933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41e3b1-222a-4ce7-9a67-ac657a98284d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:50.610560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41e3b1-222a-4ce7-9a67-ac657a98284d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:50.631039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8b942-a3d9-4559-b530-5614b9a1f5c4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:50.636136 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2366/4756] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:32:50.650326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8b942-a3d9-4559-b530-5614b9a1f5c4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:50.663037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54253582-5b52-4721-a1c6-691ccb3d1b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:50.664700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54253582-5b52-4721-a1c6-691ccb3d1b03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:50.665312 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54253582-5b52-4721-a1c6-691ccb3d1b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:50.665941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54253582-5b52-4721-a1c6-691ccb3d1b03 admin admin] PATH_INFO: `/v3/projects/e42e856c71644e3f9f398d342b105b0d/users/6e4e59e704694830847b5c5457db80d2/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:50.735179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54253582-5b52-4721-a1c6-691ccb3d1b03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e42e856c71644e3f9f398d342b105b0d, user_id=6e4e59e704694830847b5c5457db80d2, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:50.739719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41e3b1-222a-4ce7-9a67-ac657a98284d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:50.742176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54253582-5b52-4721-a1c6-691ccb3d1b03 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:50.743682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4e41e3b1-222a-4ce7-9a67-ac657a98284d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:50.772634 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2391/4757] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:32:50 2022] PUT /identity/v3/projects/e42e856c71644e3f9f398d342b105b0d/users/6e4e59e704694830847b5c5457db80d2/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:50.777377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54253582-5b52-4721-a1c6-691ccb3d1b03 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:50.911970 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41e3b1-222a-4ce7-9a67-ac657a98284d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:50.918826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54253582-5b52-4721-a1c6-691ccb3d1b03 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:50.925071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b626fa8-1265-4a46-918c-13f202e907a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:50.925859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b626fa8-1265-4a46-918c-13f202e907a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:50.926250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b626fa8-1265-4a46-918c-13f202e907a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:50.926635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b626fa8-1265-4a46-918c-13f202e907a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:50.927643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b626fa8-1265-4a46-918c-13f202e907a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:50.929746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b626fa8-1265-4a46-918c-13f202e907a6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:50.945297 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2392/4758] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:32:50.956489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b626fa8-1265-4a46-918c-13f202e907a6 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:50.986446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b626fa8-1265-4a46-918c-13f202e907a6 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:51.010314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7669d-e9d8-4e49-b245-eee169ec2c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:51.011216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7669d-e9d8-4e49-b245-eee169ec2c06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:51.011638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7669d-e9d8-4e49-b245-eee169ec2c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:51.012183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7669d-e9d8-4e49-b245-eee169ec2c06 admin admin] PATH_INFO: `/v3/projects/e42e856c71644e3f9f398d342b105b0d/users/6e4e59e704694830847b5c5457db80d2/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:51.018155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7669d-e9d8-4e49-b245-eee169ec2c06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e42e856c71644e3f9f398d342b105b0d, user_id=6e4e59e704694830847b5c5457db80d2, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:51.027096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334da49-6d63-4291-9a44-57c9dccf8751 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:51.027855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334da49-6d63-4291-9a44-57c9dccf8751 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:51.028164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334da49-6d63-4291-9a44-57c9dccf8751 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:51.028431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334da49-6d63-4291-9a44-57c9dccf8751 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:51.030192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7669d-e9d8-4e49-b245-eee169ec2c06 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:51.030337 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9334da49-6d63-4291-9a44-57c9dccf8751 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:51.052037 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9334da49-6d63-4291-9a44-57c9dccf8751 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:51.057817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9334da49-6d63-4291-9a44-57c9dccf8751 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:51.071591 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2393/4759] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:32:50 2022] PUT /identity/v3/projects/e42e856c71644e3f9f398d342b105b0d/users/6e4e59e704694830847b5c5457db80d2/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:51.074885 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6738b19-e1f5-4f8b-be1a-b61d56b62b8e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:51.074885 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6738b19-e1f5-4f8b-be1a-b61d56b62b8e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:51.074885 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6738b19-e1f5-4f8b-be1a-b61d56b62b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:51.083537 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2367/4760] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:32:51.184007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f6738b19-e1f5-4f8b-be1a-b61d56b62b8e None None] MFA Rules not processed for user `6e4e59e704694830847b5c5457db80d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:51.191757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f6738b19-e1f5-4f8b-be1a-b61d56b62b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:51.341266 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2394/4761] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:51 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:51.349966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334da49-6d63-4291-9a44-57c9dccf8751 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:51.351377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9334da49-6d63-4291-9a44-57c9dccf8751 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:51.389130 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:51.503694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334da49-6d63-4291-9a44-57c9dccf8751 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:51.658972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29e309-727a-4efb-b8c8-06ac48ca56a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:51.660278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29e309-727a-4efb-b8c8-06ac48ca56a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:51.661714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29e309-727a-4efb-b8c8-06ac48ca56a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:51.669459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29e309-727a-4efb-b8c8-06ac48ca56a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:51.687287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c8c90-7e6a-4e95-811c-4a52d4714ee4 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:51.687621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c8c90-7e6a-4e95-811c-4a52d4714ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:51.688055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c8c90-7e6a-4e95-811c-4a52d4714ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:51.696733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29e309-727a-4efb-b8c8-06ac48ca56a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:51.701840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29e309-727a-4efb-b8c8-06ac48ca56a6 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:51.739622 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2368/4762] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:51 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:32:51.792447 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:51.816034 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-317c8c90-7e6a-4e95-811c-4a52d4714ee4 None None] MFA Rules not processed for user `d556a8ae0d524894a93203ce3f70d420`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:51.817364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-317c8c90-7e6a-4e95-811c-4a52d4714ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:52.040957 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2395/4763] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:52.104262 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29e309-727a-4efb-b8c8-06ac48ca56a6 service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:52.108106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3c29e309-727a-4efb-b8c8-06ac48ca56a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:52.337093 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29e309-727a-4efb-b8c8-06ac48ca56a6 service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:52.352404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a5a900-b049-4062-a14d-8ebfbad9f0cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:52.353847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5a900-b049-4062-a14d-8ebfbad9f0cc service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:52.354384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5a900-b049-4062-a14d-8ebfbad9f0cc service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:52.354871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5a900-b049-4062-a14d-8ebfbad9f0cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:52.370758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a5a900-b049-4062-a14d-8ebfbad9f0cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:52.380923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a5a900-b049-4062-a14d-8ebfbad9f0cc service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:52.400963 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2369/4764] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:32:53.222519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c8c90-7e6a-4e95-811c-4a52d4714ee4 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:53.355212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c8c90-7e6a-4e95-811c-4a52d4714ee4 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:53.362788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876389a-a921-4015-a549-a44d8464fada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:53.363692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876389a-a921-4015-a549-a44d8464fada admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:53.364133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876389a-a921-4015-a549-a44d8464fada admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:53.364470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876389a-a921-4015-a549-a44d8464fada admin admin] PATH_INFO: `/v3/users/2463b241e8fb4414a77b21ea0b26585f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:53.366886 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876389a-a921-4015-a549-a44d8464fada admin admin] RBAC: Authorizing `identity:delete_user(user_id=2463b241e8fb4414a77b21ea0b26585f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:53.369585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876389a-a921-4015-a549-a44d8464fada admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:53.478766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1876389a-a921-4015-a549-a44d8464fada admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2463b241e8fb4414a77b21ea0b26585f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:53.501550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1876389a-a921-4015-a549-a44d8464fada admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2463b241e8fb4414a77b21ea0b26585f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:53.527528 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1876389a-a921-4015-a549-a44d8464fada admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2463b241e8fb4414a77b21ea0b26585f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:53.529292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1876389a-a921-4015-a549-a44d8464fada admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2463b241e8fb4414a77b21ea0b26585f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:53.547353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1876389a-a921-4015-a549-a44d8464fada admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2463b241e8fb4414a77b21ea0b26585f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:53.558594 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2396/4765] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:32:53 2022] DELETE /identity/v3/users/2463b241e8fb4414a77b21ea0b26585f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:53.564235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c718d-34fc-4a7b-aa96-612cb21a8303 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:53.565299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c718d-34fc-4a7b-aa96-612cb21a8303 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:53.565727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c718d-34fc-4a7b-aa96-612cb21a8303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:53.635630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3a4c718d-34fc-4a7b-aa96-612cb21a8303 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:53.638896 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3a4c718d-34fc-4a7b-aa96-612cb21a8303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:53.780626 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:53.810444 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2370/4766] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:53.829823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876389a-a921-4015-a549-a44d8464fada admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:53.831876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1876389a-a921-4015-a549-a44d8464fada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:53.894672 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:54.002127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876389a-a921-4015-a549-a44d8464fada admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:54.022986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adbc53-a537-4805-94d3-f02460822a31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:54.022986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adbc53-a537-4805-94d3-f02460822a31 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:54.022986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adbc53-a537-4805-94d3-f02460822a31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:54.022986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adbc53-a537-4805-94d3-f02460822a31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:54.035004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3adbc53-a537-4805-94d3-f02460822a31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:54.036995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3adbc53-a537-4805-94d3-f02460822a31 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:54.053348 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2397/4767] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:32:54.997623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c718d-34fc-4a7b-aa96-612cb21a8303 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:54.999523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3a4c718d-34fc-4a7b-aa96-612cb21a8303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:55.038642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c718d-34fc-4a7b-aa96-612cb21a8303 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:55.056026 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18fd33-7fb4-44fe-a2b5-68c52a34ba12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:55.056666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18fd33-7fb4-44fe-a2b5-68c52a34ba12 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:55.056944 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18fd33-7fb4-44fe-a2b5-68c52a34ba12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:55.057212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18fd33-7fb4-44fe-a2b5-68c52a34ba12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:55.068847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-fa18fd33-7fb4-44fe-a2b5-68c52a34ba12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:55.090581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18fd33-7fb4-44fe-a2b5-68c52a34ba12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:55.092275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18fd33-7fb4-44fe-a2b5-68c52a34ba12 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:55.111500 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2371/4768] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:32:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:32:55.851608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adbc53-a537-4805-94d3-f02460822a31 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:55.853619 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e3adbc53-a537-4805-94d3-f02460822a31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:55.885376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adbc53-a537-4805-94d3-f02460822a31 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:55.900042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc7cf5-60b0-453d-9d5b-bb5f69581e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:55.900708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc7cf5-60b0-453d-9d5b-bb5f69581e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:55.900988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc7cf5-60b0-453d-9d5b-bb5f69581e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:55.901260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc7cf5-60b0-453d-9d5b-bb5f69581e8a admin admin] PATH_INFO: `/v3/projects/c087737e2eb04bd798f02b1aa15f4267` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:55.903619 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc7cf5-60b0-453d-9d5b-bb5f69581e8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c087737e2eb04bd798f02b1aa15f4267)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:55.905621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc7cf5-60b0-453d-9d5b-bb5f69581e8a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:56.087401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a4dc7cf5-60b0-453d-9d5b-bb5f69581e8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c087737e2eb04bd798f02b1aa15f4267', 'request_id': 'req-a4dc7cf5-60b0-453d-9d5b-bb5f69581e8a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:56.134283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a4dc7cf5-60b0-453d-9d5b-bb5f69581e8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c087737e2eb04bd798f02b1aa15f4267', 'request_id': 'req-a4dc7cf5-60b0-453d-9d5b-bb5f69581e8a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:56.153621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a4dc7cf5-60b0-453d-9d5b-bb5f69581e8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c087737e2eb04bd798f02b1aa15f4267', 'request_id': 'req-a4dc7cf5-60b0-453d-9d5b-bb5f69581e8a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:56.186106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a4dc7cf5-60b0-453d-9d5b-bb5f69581e8a admin admin] The token cache is being invalidate because project c087737e2eb04bd798f02b1aa15f4267 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:32:56.186353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a4dc7cf5-60b0-453d-9d5b-bb5f69581e8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:56.188095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a4dc7cf5-60b0-453d-9d5b-bb5f69581e8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:56.191028 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2398/4769] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:32:55 2022] DELETE /identity/v3/projects/c087737e2eb04bd798f02b1aa15f4267 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:56.195192 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18fd33-7fb4-44fe-a2b5-68c52a34ba12 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:56.214183 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18fd33-7fb4-44fe-a2b5-68c52a34ba12 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:56.399335 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b0fc4-33de-474e-8b9b-fe8796c1e42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:56.400424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b0fc4-33de-474e-8b9b-fe8796c1e42b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:56.401022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b0fc4-33de-474e-8b9b-fe8796c1e42b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:56.401450 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b0fc4-33de-474e-8b9b-fe8796c1e42b admin admin] PATH_INFO: `/v3/users/6e4e59e704694830847b5c5457db80d2` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:56.403594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b0fc4-33de-474e-8b9b-fe8796c1e42b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e4e59e704694830847b5c5457db80d2)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:56.406498 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b0fc4-33de-474e-8b9b-fe8796c1e42b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:56.552133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ae3b0fc4-33de-474e-8b9b-fe8796c1e42b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e4e59e704694830847b5c5457db80d2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:56.566228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ae3b0fc4-33de-474e-8b9b-fe8796c1e42b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e4e59e704694830847b5c5457db80d2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:56.632668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ae3b0fc4-33de-474e-8b9b-fe8796c1e42b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e4e59e704694830847b5c5457db80d2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:56.633418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ae3b0fc4-33de-474e-8b9b-fe8796c1e42b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e4e59e704694830847b5c5457db80d2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:56.645758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ae3b0fc4-33de-474e-8b9b-fe8796c1e42b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e4e59e704694830847b5c5457db80d2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:56.656435 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2372/4770] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:32:56 2022] DELETE /identity/v3/users/6e4e59e704694830847b5c5457db80d2 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:58.072395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc7cf5-60b0-453d-9d5b-bb5f69581e8a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:58.073976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a4dc7cf5-60b0-453d-9d5b-bb5f69581e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:58.129558 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc7cf5-60b0-453d-9d5b-bb5f69581e8a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:58.235186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047635a-05e7-469a-b676-90cfca91c559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:58.236150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047635a-05e7-469a-b676-90cfca91c559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:58.236830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047635a-05e7-469a-b676-90cfca91c559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:58.237260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047635a-05e7-469a-b676-90cfca91c559 admin admin] PATH_INFO: `/v3/projects/e42e856c71644e3f9f398d342b105b0d` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:58.240467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047635a-05e7-469a-b676-90cfca91c559 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e42e856c71644e3f9f398d342b105b0d)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:58.243113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047635a-05e7-469a-b676-90cfca91c559 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:58.319450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6047635a-05e7-469a-b676-90cfca91c559 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e42e856c71644e3f9f398d342b105b0d', 'request_id': 'req-6047635a-05e7-469a-b676-90cfca91c559'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:58.321571 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:58.332638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6047635a-05e7-469a-b676-90cfca91c559 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e42e856c71644e3f9f398d342b105b0d', 'request_id': 'req-6047635a-05e7-469a-b676-90cfca91c559'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:58.340423 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6047635a-05e7-469a-b676-90cfca91c559 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e42e856c71644e3f9f398d342b105b0d', 'request_id': 'req-6047635a-05e7-469a-b676-90cfca91c559'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:58.364895 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6047635a-05e7-469a-b676-90cfca91c559 admin admin] The token cache is being invalidate because project e42e856c71644e3f9f398d342b105b0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:32:58.365304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6047635a-05e7-469a-b676-90cfca91c559 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:58.368733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6047635a-05e7-469a-b676-90cfca91c559 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:32:58.375208 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2399/4771] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:32:58 2022] DELETE /identity/v3/projects/e42e856c71644e3f9f398d342b105b0d => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:58.380694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4859e2a-90f5-46ef-82eb-30ad8b493efe None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:58.381214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4859e2a-90f5-46ef-82eb-30ad8b493efe None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:58.381214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4859e2a-90f5-46ef-82eb-30ad8b493efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:58.412579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-f4859e2a-90f5-46ef-82eb-30ad8b493efe None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:58.414169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f4859e2a-90f5-46ef-82eb-30ad8b493efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:58.559105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5266cb-4665-4733-ae42-d0194cc19fea None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:58.559779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5266cb-4665-4733-ae42-d0194cc19fea None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:58.560238 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5266cb-4665-4733-ae42-d0194cc19fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:58.568002 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2373/4772] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:58.576652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb0def-abe8-4c30-b189-120b7d5c4c3f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:58.577067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb0def-abe8-4c30-b189-120b7d5c4c3f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:58.577446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb0def-abe8-4c30-b189-120b7d5c4c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:58.601619 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:58.625707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5b5266cb-4665-4733-ae42-d0194cc19fea None None] MFA Rules not processed for user `d556a8ae0d524894a93203ce3f70d420`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:58.632226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5b5266cb-4665-4733-ae42-d0194cc19fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:58.635481 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-8afb0def-abe8-4c30-b189-120b7d5c4c3f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:58.636951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8afb0def-abe8-4c30-b189-120b7d5c4c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:58.656524 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2374/4773] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:32:58.660857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb0def-abe8-4c30-b189-120b7d5c4c3f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:58.700315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb0def-abe8-4c30-b189-120b7d5c4c3f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:58.730283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edbefd-93c6-4bd1-aee0-24e303930b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:58.731317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edbefd-93c6-4bd1-aee0-24e303930b39 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:58.731678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edbefd-93c6-4bd1-aee0-24e303930b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:58.732088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edbefd-93c6-4bd1-aee0-24e303930b39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:58.732931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edbefd-93c6-4bd1-aee0-24e303930b39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:32:58.733356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edbefd-93c6-4bd1-aee0-24e303930b39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:58.743366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edbefd-93c6-4bd1-aee0-24e303930b39 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:58.788512 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2375/4774] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:32:58.792715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edbefd-93c6-4bd1-aee0-24e303930b39 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:58.816650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edbefd-93c6-4bd1-aee0-24e303930b39 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:58.822611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc11569-bcf9-4f77-9983-adad38f07dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:58.823526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc11569-bcf9-4f77-9983-adad38f07dfc admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:58.824077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc11569-bcf9-4f77-9983-adad38f07dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:58.828817 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2400/4775] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:58.832383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc11569-bcf9-4f77-9983-adad38f07dfc admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:58.833361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc11569-bcf9-4f77-9983-adad38f07dfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:58.837696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc11569-bcf9-4f77-9983-adad38f07dfc admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:58.913506 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2376/4776] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:32:58 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:32:58.917571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5266cb-4665-4733-ae42-d0194cc19fea None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:58.964019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5266cb-4665-4733-ae42-d0194cc19fea None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:59.155372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ddbdf-2904-4026-95f1-d7e4651a62d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:59.157615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ddbdf-2904-4026-95f1-d7e4651a62d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:59.158126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ddbdf-2904-4026-95f1-d7e4651a62d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:59.158888 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ddbdf-2904-4026-95f1-d7e4651a62d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:59.159781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ddbdf-2904-4026-95f1-d7e4651a62d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:59.162759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ddbdf-2904-4026-95f1-d7e4651a62d4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:59.207614 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2401/4777] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:32:58 2022] POST /identity/v3/users => generated 292 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:32:59.209963 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc11569-bcf9-4f77-9983-adad38f07dfc admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:59.252792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc11569-bcf9-4f77-9983-adad38f07dfc admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:59.268033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d98a5-efe3-4410-be5f-bdfe85194de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:59.269460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d98a5-efe3-4410-be5f-bdfe85194de4 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:59.269851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d98a5-efe3-4410-be5f-bdfe85194de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:59.270248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d98a5-efe3-4410-be5f-bdfe85194de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:59.271516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d98a5-efe3-4410-be5f-bdfe85194de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:59.277465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d98a5-efe3-4410-be5f-bdfe85194de4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:59.298492 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2377/4778] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:32:59.302397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ddbdf-2904-4026-95f1-d7e4651a62d4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:59.317722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ddbdf-2904-4026-95f1-d7e4651a62d4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:59.334185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db4f03-f056-4fe6-8c33-94e80670dc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:59.334832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db4f03-f056-4fe6-8c33-94e80670dc27 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:59.335111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db4f03-f056-4fe6-8c33-94e80670dc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:59.340073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db4f03-f056-4fe6-8c33-94e80670dc27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:59.341586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db4f03-f056-4fe6-8c33-94e80670dc27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:59.352744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db4f03-f056-4fe6-8c33-94e80670dc27 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:59.389827 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2402/4779] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:32:59.394419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d98a5-efe3-4410-be5f-bdfe85194de4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:59.413483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d98a5-efe3-4410-be5f-bdfe85194de4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:59.429826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f1bf9-afab-4b8d-825e-68772bd71156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:59.430617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f1bf9-afab-4b8d-825e-68772bd71156 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:59.430983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f1bf9-afab-4b8d-825e-68772bd71156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:59.431326 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f1bf9-afab-4b8d-825e-68772bd71156 admin admin] PATH_INFO: `/v3/projects/c06b75f6934b4ca8a992631fde6169a7/users/daf312822d804cb59f9228cde33f8228/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:59.475442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f1bf9-afab-4b8d-825e-68772bd71156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c06b75f6934b4ca8a992631fde6169a7, user_id=daf312822d804cb59f9228cde33f8228, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:59.478332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f1bf9-afab-4b8d-825e-68772bd71156 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:32:59.505933 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2378/4780] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:32:59 2022] PUT /identity/v3/projects/c06b75f6934b4ca8a992631fde6169a7/users/daf312822d804cb59f9228cde33f8228/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:32:59.522042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d3c10-fd5c-4afd-a23a-612a4252a7a7 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:59.522343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d3c10-fd5c-4afd-a23a-612a4252a7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:59.523242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d3c10-fd5c-4afd-a23a-612a4252a7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:59.588685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-4d1d3c10-fd5c-4afd-a23a-612a4252a7a7 None None] MFA Rules not processed for user `daf312822d804cb59f9228cde33f8228`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:32:59.590251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4d1d3c10-fd5c-4afd-a23a-612a4252a7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:32:59.695329 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:32:59.730857 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2403/4781] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:32:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:32:59.731369 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f1bf9-afab-4b8d-825e-68772bd71156 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:32:59.883940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f1bf9-afab-4b8d-825e-68772bd71156 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:32:59.906957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f7561-3ba4-4ef9-861e-8a761bb26f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:32:59.907659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f7561-3ba4-4ef9-861e-8a761bb26f65 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:32:59.907979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f7561-3ba4-4ef9-861e-8a761bb26f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:32:59.908260 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f7561-3ba4-4ef9-861e-8a761bb26f65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:32:59.908931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f7561-3ba4-4ef9-861e-8a761bb26f65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:32:59.921516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f7561-3ba4-4ef9-861e-8a761bb26f65 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:00.065768 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2379/4782] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:32:59 2022] POST /identity/v3/projects => generated 383 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:33:00.067051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d3c10-fd5c-4afd-a23a-612a4252a7a7 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:00.091342 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d3c10-fd5c-4afd-a23a-612a4252a7a7 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:00.310146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f97eb6-f4ce-4ec6-a03b-b439410ad7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:00.311622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f97eb6-f4ce-4ec6-a03b-b439410ad7ae admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:00.313225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f97eb6-f4ce-4ec6-a03b-b439410ad7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:00.313713 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f97eb6-f4ce-4ec6-a03b-b439410ad7ae admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:00.314522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f97eb6-f4ce-4ec6-a03b-b439410ad7ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:00.322985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f97eb6-f4ce-4ec6-a03b-b439410ad7ae admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:00.375848 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2404/4783] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:33:00 2022] POST /identity/v3/users => generated 298 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:00.380320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f7561-3ba4-4ef9-861e-8a761bb26f65 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:00.396062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f7561-3ba4-4ef9-861e-8a761bb26f65 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:00.405219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2486f69-49a0-4777-91c1-4fd62f875f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:00.406340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2486f69-49a0-4777-91c1-4fd62f875f34 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:00.407578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2486f69-49a0-4777-91c1-4fd62f875f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:00.408445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2486f69-49a0-4777-91c1-4fd62f875f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:00.409801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2486f69-49a0-4777-91c1-4fd62f875f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:00.414386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2486f69-49a0-4777-91c1-4fd62f875f34 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:00.437654 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2380/4784] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:00.442421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f97eb6-f4ce-4ec6-a03b-b439410ad7ae admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:00.458081 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f97eb6-f4ce-4ec6-a03b-b439410ad7ae admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:00.466750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418d3f0-6eed-47ec-8539-1edbd145a323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:00.468836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418d3f0-6eed-47ec-8539-1edbd145a323 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:00.469562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418d3f0-6eed-47ec-8539-1edbd145a323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:00.470070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418d3f0-6eed-47ec-8539-1edbd145a323 admin admin] PATH_INFO: `/v3/projects/43e8e945a8944094835af386f56aa53f/users/938be7398dd24bac97226e7938bf5338/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:00.495442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418d3f0-6eed-47ec-8539-1edbd145a323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43e8e945a8944094835af386f56aa53f, user_id=938be7398dd24bac97226e7938bf5338, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:00.501986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418d3f0-6eed-47ec-8539-1edbd145a323 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:00.525728 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2405/4785] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:33:00 2022] PUT /identity/v3/projects/43e8e945a8944094835af386f56aa53f/users/938be7398dd24bac97226e7938bf5338/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:33:00.529629 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2486f69-49a0-4777-91c1-4fd62f875f34 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:00.548353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2486f69-49a0-4777-91c1-4fd62f875f34 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:00.741248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418d3f0-6eed-47ec-8539-1edbd145a323 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:00.743360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6418d3f0-6eed-47ec-8539-1edbd145a323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:00.748701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6fa7f7-5fc1-4c49-9eb3-f1970375b643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:00.750358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fa7f7-5fc1-4c49-9eb3-f1970375b643 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:00.751149 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fa7f7-5fc1-4c49-9eb3-f1970375b643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:00.760110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fa7f7-5fc1-4c49-9eb3-f1970375b643 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:00.761003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6fa7f7-5fc1-4c49-9eb3-f1970375b643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:00.768972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6fa7f7-5fc1-4c49-9eb3-f1970375b643 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:00.779489 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:00.819058 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2381/4786] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:00.820984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6fa7f7-5fc1-4c49-9eb3-f1970375b643 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:00.862280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6fa7f7-5fc1-4c49-9eb3-f1970375b643 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:00.876816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418d3f0-6eed-47ec-8539-1edbd145a323 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:00.880499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2cb70-e1d4-4c7d-9af6-e4d716a195be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:00.881210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2cb70-e1d4-4c7d-9af6-e4d716a195be admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:00.881780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2cb70-e1d4-4c7d-9af6-e4d716a195be admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:00.882064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2cb70-e1d4-4c7d-9af6-e4d716a195be admin admin] PATH_INFO: `/v3/projects/43e8e945a8944094835af386f56aa53f/users/938be7398dd24bac97226e7938bf5338/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:00.884460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2cb70-e1d4-4c7d-9af6-e4d716a195be admin admin] RBAC: Authorizing `identity:create_grant(project_id=43e8e945a8944094835af386f56aa53f, user_id=938be7398dd24bac97226e7938bf5338, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:00.887482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b2cb70-e1d4-4c7d-9af6-e4d716a195be admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:00.888769 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad5a5d-2807-4633-9a19-c9c964ac55fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:00.894119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad5a5d-2807-4633-9a19-c9c964ac55fa service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:00.894615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad5a5d-2807-4633-9a19-c9c964ac55fa service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:00.895052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad5a5d-2807-4633-9a19-c9c964ac55fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:00.900785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-94ad5a5d-2807-4633-9a19-c9c964ac55fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:00.914612 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2382/4787] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:33:00 2022] PUT /identity/v3/projects/43e8e945a8944094835af386f56aa53f/users/938be7398dd24bac97226e7938bf5338/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:00.924704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1210fad-84df-4eaa-bcab-3bff37297e4b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:00.924989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1210fad-84df-4eaa-bcab-3bff37297e4b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:00.925274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1210fad-84df-4eaa-bcab-3bff37297e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:00.932505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad5a5d-2807-4633-9a19-c9c964ac55fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:00.936235 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad5a5d-2807-4633-9a19-c9c964ac55fa service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:00.983002 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2406/4788] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:33:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:33:00.996943 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c1210fad-84df-4eaa-bcab-3bff37297e4b None None] MFA Rules not processed for user `938be7398dd24bac97226e7938bf5338`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:01.000460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c1210fad-84df-4eaa-bcab-3bff37297e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:01.188825 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2383/4789] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:00 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:33:01.203256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad5a5d-2807-4633-9a19-c9c964ac55fa service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:01.208668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-94ad5a5d-2807-4633-9a19-c9c964ac55fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:01.348200 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:01.355436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad5a5d-2807-4633-9a19-c9c964ac55fa service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:01.420087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2767613-a581-4677-825b-7f74fb2b8461 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:01.420705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2767613-a581-4677-825b-7f74fb2b8461 service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:01.420984 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2767613-a581-4677-825b-7f74fb2b8461 service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:01.422416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2767613-a581-4677-825b-7f74fb2b8461 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:01.502022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2767613-a581-4677-825b-7f74fb2b8461 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:01.505092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2767613-a581-4677-825b-7f74fb2b8461 service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:01.532003 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2407/4790] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:33:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:33:02.529565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1210fad-84df-4eaa-bcab-3bff37297e4b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:02.673080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1210fad-84df-4eaa-bcab-3bff37297e4b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:02.687738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ec46d-9f3b-4e82-9bac-f4897009db40 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:02.688752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ec46d-9f3b-4e82-9bac-f4897009db40 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:02.690456 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ec46d-9f3b-4e82-9bac-f4897009db40 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:02.691003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ec46d-9f3b-4e82-9bac-f4897009db40 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:02.694122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-869ec46d-9f3b-4e82-9bac-f4897009db40 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:02.730175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ec46d-9f3b-4e82-9bac-f4897009db40 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:02.734939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ec46d-9f3b-4e82-9bac-f4897009db40 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:02.764853 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2384/4791] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:33:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:33:11.511263 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=47 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:12.752975 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=73,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:13.146423 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2767613-a581-4677-825b-7f74fb2b8461 service cinder] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:13.149315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f2767613-a581-4677-825b-7f74fb2b8461 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:13.373800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2767613-a581-4677-825b-7f74fb2b8461 service cinder] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:13.389476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3320399-347a-4984-87b0-f990c24c6000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:13.390166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3320399-347a-4984-87b0-f990c24c6000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:13.390649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3320399-347a-4984-87b0-f990c24c6000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:13.390932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3320399-347a-4984-87b0-f990c24c6000 admin admin] PATH_INFO: `/v3/users/8f88c01a2ba943418371acc0144b4c28` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:13.396800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3320399-347a-4984-87b0-f990c24c6000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f88c01a2ba943418371acc0144b4c28)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:13.399431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3320399-347a-4984-87b0-f990c24c6000 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:13.476780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b3320399-347a-4984-87b0-f990c24c6000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f88c01a2ba943418371acc0144b4c28'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:13.498199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b3320399-347a-4984-87b0-f990c24c6000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f88c01a2ba943418371acc0144b4c28'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:13.532517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b3320399-347a-4984-87b0-f990c24c6000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f88c01a2ba943418371acc0144b4c28'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:13.534560 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b3320399-347a-4984-87b0-f990c24c6000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f88c01a2ba943418371acc0144b4c28'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:13.586070 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff546af1-f41a-4354-aecc-76f365b9d22f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:13.586365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff546af1-f41a-4354-aecc-76f365b9d22f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:13.586746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff546af1-f41a-4354-aecc-76f365b9d22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:13.594778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b3320399-347a-4984-87b0-f990c24c6000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f88c01a2ba943418371acc0144b4c28'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:13.612260 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2408/4792] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:33:13 2022] DELETE /identity/v3/users/8f88c01a2ba943418371acc0144b4c28 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:13.617805 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abb939-8dc5-424b-889c-8320c72da059 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:13.618058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abb939-8dc5-424b-889c-8320c72da059 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:13.618507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abb939-8dc5-424b-889c-8320c72da059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:13.647303 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ff546af1-f41a-4354-aecc-76f365b9d22f None None] MFA Rules not processed for user `1b06d31773ee4b9389ee2ea8a12f0f29`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:13.653953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ff546af1-f41a-4354-aecc-76f365b9d22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:13.696716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-18abb939-8dc5-424b-889c-8320c72da059 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:13.702110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-18abb939-8dc5-424b-889c-8320c72da059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:13.888817 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2409/4793] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:13.906650 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2385/4794] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:33:13.954171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abb939-8dc5-424b-889c-8320c72da059 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:13.955722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-18abb939-8dc5-424b-889c-8320c72da059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:14.000127 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:14.034162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bfdfe-2012-4322-8448-6ebcd61db7f4 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:14.034461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bfdfe-2012-4322-8448-6ebcd61db7f4 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:14.034734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bfdfe-2012-4322-8448-6ebcd61db7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:14.096166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abb939-8dc5-424b-889c-8320c72da059 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:14.109211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2e9d0-6d1a-4b63-9728-2e27ce569479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:14.111104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2e9d0-6d1a-4b63-9728-2e27ce569479 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:14.111104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2e9d0-6d1a-4b63-9728-2e27ce569479 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:14.112932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2e9d0-6d1a-4b63-9728-2e27ce569479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:14.118423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-151bfdfe-2012-4322-8448-6ebcd61db7f4 None None] MFA Rules not processed for user `1b06d31773ee4b9389ee2ea8a12f0f29`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:14.119956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-151bfdfe-2012-4322-8448-6ebcd61db7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:14.141509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2e9d0-6d1a-4b63-9728-2e27ce569479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:14.143399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2e9d0-6d1a-4b63-9728-2e27ce569479 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:14.145095 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2386/4795] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:14.168033 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2410/4796] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:33:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:33:14.195115 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcef112-21dd-4ea4-8235-588977a350e0 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:14.196060 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcef112-21dd-4ea4-8235-588977a350e0 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:14.196569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcef112-21dd-4ea4-8235-588977a350e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:14.288806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-8fcef112-21dd-4ea4-8235-588977a350e0 None None] MFA Rules not processed for user `1b06d31773ee4b9389ee2ea8a12f0f29`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:14.299375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8fcef112-21dd-4ea4-8235-588977a350e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:14.326634 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2387/4797] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:14.365674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482016c-2725-491b-acd6-354abbb6113d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:14.365963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482016c-2725-491b-acd6-354abbb6113d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:14.366241 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482016c-2725-491b-acd6-354abbb6113d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:14.438289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a482016c-2725-491b-acd6-354abbb6113d None None] MFA Rules not processed for user `1b06d31773ee4b9389ee2ea8a12f0f29`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:14.439577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a482016c-2725-491b-acd6-354abbb6113d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:14.482065 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2411/4798] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:14.545286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde351c-4112-4d8a-a052-270c6f50e00b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:14.545890 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde351c-4112-4d8a-a052-270c6f50e00b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:14.546324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde351c-4112-4d8a-a052-270c6f50e00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:14.597739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6dde351c-4112-4d8a-a052-270c6f50e00b None None] MFA Rules not processed for user `1b06d31773ee4b9389ee2ea8a12f0f29`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:14.599520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6dde351c-4112-4d8a-a052-270c6f50e00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:14.626190 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2388/4799] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:15.637655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482016c-2725-491b-acd6-354abbb6113d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:15.640808 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a482016c-2725-491b-acd6-354abbb6113d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:15.682045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482016c-2725-491b-acd6-354abbb6113d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:15.719556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8688c-5800-4067-af79-58f0b1996c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:15.720555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8688c-5800-4067-af79-58f0b1996c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:15.721004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8688c-5800-4067-af79-58f0b1996c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:15.721434 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8688c-5800-4067-af79-58f0b1996c89 admin admin] PATH_INFO: `/v3/projects/1b24d3fe668d487090e284f38db5407d` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:15.725384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8688c-5800-4067-af79-58f0b1996c89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b24d3fe668d487090e284f38db5407d)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:15.731694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8688c-5800-4067-af79-58f0b1996c89 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:15.897756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bbc8688c-5800-4067-af79-58f0b1996c89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b24d3fe668d487090e284f38db5407d', 'request_id': 'req-bbc8688c-5800-4067-af79-58f0b1996c89'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:15.919163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bbc8688c-5800-4067-af79-58f0b1996c89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b24d3fe668d487090e284f38db5407d', 'request_id': 'req-bbc8688c-5800-4067-af79-58f0b1996c89'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:15.942033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bbc8688c-5800-4067-af79-58f0b1996c89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b24d3fe668d487090e284f38db5407d', 'request_id': 'req-bbc8688c-5800-4067-af79-58f0b1996c89'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:16.013288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bbc8688c-5800-4067-af79-58f0b1996c89 admin admin] The token cache is being invalidate because project 1b24d3fe668d487090e284f38db5407d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:33:16.013613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bbc8688c-5800-4067-af79-58f0b1996c89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:16.016383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bbc8688c-5800-4067-af79-58f0b1996c89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:16.020273 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2412/4800] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:33:15 2022] DELETE /identity/v3/projects/1b24d3fe668d487090e284f38db5407d => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:16.027850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7ffea-80eb-4065-b5d8-6e4d93a3c7d2 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:16.028443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7ffea-80eb-4065-b5d8-6e4d93a3c7d2 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:16.028551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7ffea-80eb-4065-b5d8-6e4d93a3c7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:16.068887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-fff7ffea-80eb-4065-b5d8-6e4d93a3c7d2 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:16.070347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-fff7ffea-80eb-4065-b5d8-6e4d93a3c7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:16.086958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8688c-5800-4067-af79-58f0b1996c89 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:16.088471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-bbc8688c-5800-4067-af79-58f0b1996c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:16.250513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8688c-5800-4067-af79-58f0b1996c89 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:16.267162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b10316-5e3c-43b1-83fc-fcf8a55a2389 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:16.268650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b10316-5e3c-43b1-83fc-fcf8a55a2389 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:16.268932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b10316-5e3c-43b1-83fc-fcf8a55a2389 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:16.269247 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b10316-5e3c-43b1-83fc-fcf8a55a2389 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:16.271700 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2389/4801] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:16.276102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-36b10316-5e3c-43b1-83fc-fcf8a55a2389 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:16.288942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d3464-7532-420b-80f3-65b952091f7a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:16.289234 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d3464-7532-420b-80f3-65b952091f7a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:16.290347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d3464-7532-420b-80f3-65b952091f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:16.341547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-988d3464-7532-420b-80f3-65b952091f7a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:16.346618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-988d3464-7532-420b-80f3-65b952091f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:16.365493 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2390/4802] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:16.370492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d3464-7532-420b-80f3-65b952091f7a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:16.384398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d3464-7532-420b-80f3-65b952091f7a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:16.393590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e0d4a-6a74-4075-b386-acd49cbf6246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:16.394409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e0d4a-6a74-4075-b386-acd49cbf6246 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:16.394819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e0d4a-6a74-4075-b386-acd49cbf6246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:16.395096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e0d4a-6a74-4075-b386-acd49cbf6246 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:16.395991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e0d4a-6a74-4075-b386-acd49cbf6246 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:33:16.396417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e0d4a-6a74-4075-b386-acd49cbf6246 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:16.398304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e0d4a-6a74-4075-b386-acd49cbf6246 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:16.416713 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2391/4803] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:33:16.421783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e0d4a-6a74-4075-b386-acd49cbf6246 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:16.467015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e0d4a-6a74-4075-b386-acd49cbf6246 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:16.483800 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4cc2d-88de-4048-8f7e-4bb58e6b46ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:16.486337 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4cc2d-88de-4048-8f7e-4bb58e6b46ac admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:16.486618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4cc2d-88de-4048-8f7e-4bb58e6b46ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:16.488329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4cc2d-88de-4048-8f7e-4bb58e6b46ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:16.492442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4cc2d-88de-4048-8f7e-4bb58e6b46ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:16.494279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4cc2d-88de-4048-8f7e-4bb58e6b46ac admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:16.500772 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:16.576125 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2392/4804] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:33:16 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:16.583194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4cc2d-88de-4048-8f7e-4bb58e6b46ac admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:16.598382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b10316-5e3c-43b1-83fc-fcf8a55a2389 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:16.600120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b10316-5e3c-43b1-83fc-fcf8a55a2389 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:16.640370 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2413/4805] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:33:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:33:16.711916 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:16.752514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4cc2d-88de-4048-8f7e-4bb58e6b46ac admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:16.762305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f071e91-582a-46cd-95cb-84c408b917e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:16.762936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f071e91-582a-46cd-95cb-84c408b917e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:16.763207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f071e91-582a-46cd-95cb-84c408b917e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:16.763475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f071e91-582a-46cd-95cb-84c408b917e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:16.764750 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f071e91-582a-46cd-95cb-84c408b917e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:16.766706 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f071e91-582a-46cd-95cb-84c408b917e8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:16.822547 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2393/4806] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:33:16 2022] POST /identity/v3/users => generated 288 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:16.824246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b10316-5e3c-43b1-83fc-fcf8a55a2389 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:16.841016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b10316-5e3c-43b1-83fc-fcf8a55a2389 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:16.853478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aacd07-5a08-49b5-8edb-2873e09b6a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:16.854275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aacd07-5a08-49b5-8edb-2873e09b6a5e admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:16.854755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aacd07-5a08-49b5-8edb-2873e09b6a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:16.855153 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aacd07-5a08-49b5-8edb-2873e09b6a5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:16.856068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aacd07-5a08-49b5-8edb-2873e09b6a5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:16.857931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aacd07-5a08-49b5-8edb-2873e09b6a5e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:16.884568 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2414/4807] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:16.886219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f071e91-582a-46cd-95cb-84c408b917e8 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:16.900938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f071e91-582a-46cd-95cb-84c408b917e8 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:16.916461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651767f6-e468-4385-ad4e-0156ef4c0adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:16.917257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651767f6-e468-4385-ad4e-0156ef4c0adc admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:16.918030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651767f6-e468-4385-ad4e-0156ef4c0adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:16.918030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651767f6-e468-4385-ad4e-0156ef4c0adc admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:16.918771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651767f6-e468-4385-ad4e-0156ef4c0adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:16.921074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651767f6-e468-4385-ad4e-0156ef4c0adc admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:16.953257 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2394/4808] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:16.954548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aacd07-5a08-49b5-8edb-2873e09b6a5e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:16.965778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aacd07-5a08-49b5-8edb-2873e09b6a5e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:16.990673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8964b9-67cb-43df-9f38-151b4cfbdb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:16.993127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8964b9-67cb-43df-9f38-151b4cfbdb56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:16.993599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8964b9-67cb-43df-9f38-151b4cfbdb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:16.994028 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8964b9-67cb-43df-9f38-151b4cfbdb56 admin admin] PATH_INFO: `/v3/projects/73bd644fa2c94a5682453ac41a2d86cc/users/57fcbcb874c049dc9aaee54c16e07890/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:17.044230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8964b9-67cb-43df-9f38-151b4cfbdb56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73bd644fa2c94a5682453ac41a2d86cc, user_id=57fcbcb874c049dc9aaee54c16e07890, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:17.051314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8964b9-67cb-43df-9f38-151b4cfbdb56 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:17.081098 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2415/4809] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:33:16 2022] PUT /identity/v3/projects/73bd644fa2c94a5682453ac41a2d86cc/users/57fcbcb874c049dc9aaee54c16e07890/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:17.092499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f16a1-2ba5-4552-bb75-2b327569f53e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:17.093083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f16a1-2ba5-4552-bb75-2b327569f53e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:17.093083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f16a1-2ba5-4552-bb75-2b327569f53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:17.205378 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ec6f16a1-2ba5-4552-bb75-2b327569f53e None None] MFA Rules not processed for user `57fcbcb874c049dc9aaee54c16e07890`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:17.206968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ec6f16a1-2ba5-4552-bb75-2b327569f53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:17.382000 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2395/4810] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:17.384345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8964b9-67cb-43df-9f38-151b4cfbdb56 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:17.611925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8964b9-67cb-43df-9f38-151b4cfbdb56 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:17.631587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2116a88-2d96-451e-b72c-a12d0373e338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:17.632341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2116a88-2d96-451e-b72c-a12d0373e338 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:17.632616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2116a88-2d96-451e-b72c-a12d0373e338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:17.633044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2116a88-2d96-451e-b72c-a12d0373e338 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:17.633725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2116a88-2d96-451e-b72c-a12d0373e338 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:17.636135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2116a88-2d96-451e-b72c-a12d0373e338 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:17.716839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f16a1-2ba5-4552-bb75-2b327569f53e None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:17.729415 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2416/4811] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:33:17 2022] POST /identity/v3/projects => generated 375 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:17.733679 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f16a1-2ba5-4552-bb75-2b327569f53e None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:17.864784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34130a-18d3-4ae9-ba6c-fa86838b420d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:17.865583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34130a-18d3-4ae9-ba6c-fa86838b420d admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:17.865861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34130a-18d3-4ae9-ba6c-fa86838b420d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:17.866139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34130a-18d3-4ae9-ba6c-fa86838b420d admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:17.866851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34130a-18d3-4ae9-ba6c-fa86838b420d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:17.868954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e34130a-18d3-4ae9-ba6c-fa86838b420d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:17.910694 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2396/4812] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:33:17 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:33:17.915616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2116a88-2d96-451e-b72c-a12d0373e338 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:17.938287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2116a88-2d96-451e-b72c-a12d0373e338 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:17.951129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454d744-9ac6-401e-88f2-185b8226cf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:17.954033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454d744-9ac6-401e-88f2-185b8226cf13 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:17.954889 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454d744-9ac6-401e-88f2-185b8226cf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:17.955363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454d744-9ac6-401e-88f2-185b8226cf13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:17.957928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454d744-9ac6-401e-88f2-185b8226cf13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:17.961777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454d744-9ac6-401e-88f2-185b8226cf13 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:17.988452 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2417/4813] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:17.988830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34130a-18d3-4ae9-ba6c-fa86838b420d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:18.010377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e34130a-18d3-4ae9-ba6c-fa86838b420d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:18.021736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad4e4d-76dd-47fe-adb5-deaceb72f2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:18.022451 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad4e4d-76dd-47fe-adb5-deaceb72f2ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:18.022797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad4e4d-76dd-47fe-adb5-deaceb72f2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:18.023127 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad4e4d-76dd-47fe-adb5-deaceb72f2ce admin admin] PATH_INFO: `/v3/projects/e00b3946cbbc4f9eae1cfec6b93e4e71/users/040395c33c6b4b39a463f8320c78e927/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:18.073300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad4e4d-76dd-47fe-adb5-deaceb72f2ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=e00b3946cbbc4f9eae1cfec6b93e4e71, user_id=040395c33c6b4b39a463f8320c78e927, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:18.076362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad4e4d-76dd-47fe-adb5-deaceb72f2ce admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:18.100637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454d744-9ac6-401e-88f2-185b8226cf13 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:18.129061 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2397/4814] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:33:17 2022] PUT /identity/v3/projects/e00b3946cbbc4f9eae1cfec6b93e4e71/users/040395c33c6b4b39a463f8320c78e927/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:33:18.133448 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad4e4d-76dd-47fe-adb5-deaceb72f2ce admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:18.182530 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:18.259671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454d744-9ac6-401e-88f2-185b8226cf13 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:18.293191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad4e4d-76dd-47fe-adb5-deaceb72f2ce admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:18.300437 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:18.316855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6e8a7-bb09-4bf4-bc05-852859d57de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:18.317733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6e8a7-bb09-4bf4-bc05-852859d57de0 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:18.318170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6e8a7-bb09-4bf4-bc05-852859d57de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:18.318595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6e8a7-bb09-4bf4-bc05-852859d57de0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:18.319408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6e8a7-bb09-4bf4-bc05-852859d57de0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:18.321841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f6e8a7-bb09-4bf4-bc05-852859d57de0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:18.352666 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2398/4815] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:18 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:18.357494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6e8a7-bb09-4bf4-bc05-852859d57de0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:18.370319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6e8a7-bb09-4bf4-bc05-852859d57de0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:18.383766 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d9f39-6678-468e-b844-67fa2b70c4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:18.384554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d9f39-6678-468e-b844-67fa2b70c4f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:18.384836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d9f39-6678-468e-b844-67fa2b70c4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:18.385116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d9f39-6678-468e-b844-67fa2b70c4f4 admin admin] PATH_INFO: `/v3/projects/e00b3946cbbc4f9eae1cfec6b93e4e71/users/040395c33c6b4b39a463f8320c78e927/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:18.388811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d9f39-6678-468e-b844-67fa2b70c4f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e00b3946cbbc4f9eae1cfec6b93e4e71, user_id=040395c33c6b4b39a463f8320c78e927, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:18.397206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d9f39-6678-468e-b844-67fa2b70c4f4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:18.417840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ecbb8-9983-4d27-8266-6db167162e83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:18.419027 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ecbb8-9983-4d27-8266-6db167162e83 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:18.419027 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ecbb8-9983-4d27-8266-6db167162e83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:18.419314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ecbb8-9983-4d27-8266-6db167162e83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:18.467947 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2399/4816] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:33:18 2022] PUT /identity/v3/projects/e00b3946cbbc4f9eae1cfec6b93e4e71/users/040395c33c6b4b39a463f8320c78e927/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:18.472266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84524245-1282-4af7-885b-4f1b39488476 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:18.473213 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84524245-1282-4af7-885b-4f1b39488476 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:18.473529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84524245-1282-4af7-885b-4f1b39488476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:18.476357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-044ecbb8-9983-4d27-8266-6db167162e83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:18.536171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ecbb8-9983-4d27-8266-6db167162e83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:18.548073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ecbb8-9983-4d27-8266-6db167162e83 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:18.567470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-84524245-1282-4af7-885b-4f1b39488476 None None] MFA Rules not processed for user `040395c33c6b4b39a463f8320c78e927`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:18.570859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-84524245-1282-4af7-885b-4f1b39488476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:18.577563 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2418/4817] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:33:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:33:18.774590 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2400/4818] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:18.789590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ecbb8-9983-4d27-8266-6db167162e83 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:18.917951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ecbb8-9983-4d27-8266-6db167162e83 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:18.924837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454aead4-48a5-4e47-aa57-1a9dcc52a7f0 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '040395c33c6b4b39a463f8320c78e927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e00b3946cbbc4f9eae1cfec6b93e4e71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:18.925486 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454aead4-48a5-4e47-aa57-1a9dcc52a7f0 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:18.925768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454aead4-48a5-4e47-aa57-1a9dcc52a7f0 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:18.926047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454aead4-48a5-4e47-aa57-1a9dcc52a7f0 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:18.926777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454aead4-48a5-4e47-aa57-1a9dcc52a7f0 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:18.929561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454aead4-48a5-4e47-aa57-1a9dcc52a7f0 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:18.987251 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2419/4819] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Aug 7 01:33:18 2022] POST /identity/v3/domains => generated 246 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:18.991761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84524245-1282-4af7-885b-4f1b39488476 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:19.003257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84524245-1282-4af7-885b-4f1b39488476 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:19.118948 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1194d-b5ac-4e10-b04c-63ea1ebba605 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '040395c33c6b4b39a463f8320c78e927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e00b3946cbbc4f9eae1cfec6b93e4e71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:19.120094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1194d-b5ac-4e10-b04c-63ea1ebba605 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:19.120559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1194d-b5ac-4e10-b04c-63ea1ebba605 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:19.120989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1194d-b5ac-4e10-b04c-63ea1ebba605 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:19.121873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1194d-b5ac-4e10-b04c-63ea1ebba605 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:19.126224 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1194d-b5ac-4e10-b04c-63ea1ebba605 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:19.219974 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2401/4820] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:33:18 2022] POST /identity/v3/projects => generated 409 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:19.224239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454aead4-48a5-4e47-aa57-1a9dcc52a7f0 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:19.258325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454aead4-48a5-4e47-aa57-1a9dcc52a7f0 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:19.435762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafa2e2-07a9-45b0-84ed-0a2f13dae983 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '040395c33c6b4b39a463f8320c78e927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e00b3946cbbc4f9eae1cfec6b93e4e71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:19.436758 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafa2e2-07a9-45b0-84ed-0a2f13dae983 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:19.437045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafa2e2-07a9-45b0-84ed-0a2f13dae983 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:19.438530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafa2e2-07a9-45b0-84ed-0a2f13dae983 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:19.439199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafa2e2-07a9-45b0-84ed-0a2f13dae983 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:19.442187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafa2e2-07a9-45b0-84ed-0a2f13dae983 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:19.500809 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2420/4821] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:33:19 2022] POST /identity/v3/users => generated 348 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:19.502210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1194d-b5ac-4e10-b04c-63ea1ebba605 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:19.519308 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:19.534276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1194d-b5ac-4e10-b04c-63ea1ebba605 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:19.549622 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159061e7-d92a-435e-a076-fcf6dfeefaf7 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '040395c33c6b4b39a463f8320c78e927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e00b3946cbbc4f9eae1cfec6b93e4e71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:19.550266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159061e7-d92a-435e-a076-fcf6dfeefaf7 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:19.550546 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159061e7-d92a-435e-a076-fcf6dfeefaf7 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:19.554398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159061e7-d92a-435e-a076-fcf6dfeefaf7 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:19.555145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159061e7-d92a-435e-a076-fcf6dfeefaf7 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:19.565080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159061e7-d92a-435e-a076-fcf6dfeefaf7 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:19.600373 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2402/4822] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:19.605895 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafa2e2-07a9-45b0-84ed-0a2f13dae983 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:19.626429 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafa2e2-07a9-45b0-84ed-0a2f13dae983 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:19.640547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2eba9-a4b3-4edb-b2a8-80d0851cd001 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '040395c33c6b4b39a463f8320c78e927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e00b3946cbbc4f9eae1cfec6b93e4e71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:19.644009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2eba9-a4b3-4edb-b2a8-80d0851cd001 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:19.644009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2eba9-a4b3-4edb-b2a8-80d0851cd001 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:19.644009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2eba9-a4b3-4edb-b2a8-80d0851cd001 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] PATH_INFO: `/v3/projects/2f94feeb396e4e0699daab4b11fac3d3/users/5a47a9259dcc4a8d9a38ae1ba1ef00fb/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:19.691793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2eba9-a4b3-4edb-b2a8-80d0851cd001 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2f94feeb396e4e0699daab4b11fac3d3, user_id=5a47a9259dcc4a8d9a38ae1ba1ef00fb, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:19.701913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2eba9-a4b3-4edb-b2a8-80d0851cd001 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:19.748457 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2421/4823] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:33:19 2022] PUT /identity/v3/projects/2f94feeb396e4e0699daab4b11fac3d3/users/5a47a9259dcc4a8d9a38ae1ba1ef00fb/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:19.753634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9cbb2-03da-454f-b99f-043e15b02e6e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:19.753947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9cbb2-03da-454f-b99f-043e15b02e6e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:19.754219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9cbb2-03da-454f-b99f-043e15b02e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:19.910855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-4ce9cbb2-03da-454f-b99f-043e15b02e6e None None] MFA Rules not processed for user `5a47a9259dcc4a8d9a38ae1ba1ef00fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:19.912472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4ce9cbb2-03da-454f-b99f-043e15b02e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:19.936271 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2403/4824] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:19.953065 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e126d4c-225d-4d79-93d4-84237508dcab None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:19.954212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e126d4c-225d-4d79-93d4-84237508dcab None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:19.954751 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e126d4c-225d-4d79-93d4-84237508dcab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:20.004339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9e126d4c-225d-4d79-93d4-84237508dcab None None] MFA Rules not processed for user `5a47a9259dcc4a8d9a38ae1ba1ef00fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:20.006753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9e126d4c-225d-4d79-93d4-84237508dcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:20.018439 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2422/4825] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:33:20.023184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9cbb2-03da-454f-b99f-043e15b02e6e None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:20.039720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9cbb2-03da-454f-b99f-043e15b02e6e None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:20.063069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c0de8-4761-43c8-ad76-1bd749769f02 tempest-test_project-251606285 tempest-user-1402238071] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a47a9259dcc4a8d9a38ae1ba1ef00fb', 'user_domain_id': '5bc26c87ce2249af8fe4a734d94cf257', 'system_scope': None, 'project_id': '2f94feeb396e4e0699daab4b11fac3d3', 'project_domain_id': '5bc26c87ce2249af8fe4a734d94cf257', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:20.063712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c0de8-4761-43c8-ad76-1bd749769f02 tempest-test_project-251606285 tempest-user-1402238071] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:20.064077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c0de8-4761-43c8-ad76-1bd749769f02 tempest-test_project-251606285 tempest-user-1402238071] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:20.064355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c0de8-4761-43c8-ad76-1bd749769f02 tempest-test_project-251606285 tempest-user-1402238071] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:20.079136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c0de8-4761-43c8-ad76-1bd749769f02 tempest-test_project-251606285 tempest-user-1402238071] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:20.081037 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c0de8-4761-43c8-ad76-1bd749769f02 tempest-test_project-251606285 tempest-user-1402238071] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:20.095458 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2404/4826] 10.222.0.39 () {56 vars in 1284 bytes} [Sun Aug 7 01:33:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:33:20.103076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e126d4c-225d-4d79-93d4-84237508dcab None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:20.146164 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:20.305161 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e126d4c-225d-4d79-93d4-84237508dcab None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:20.321873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2319c6a-d506-4333-b03c-bb6189ef121e tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '040395c33c6b4b39a463f8320c78e927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e00b3946cbbc4f9eae1cfec6b93e4e71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:20.322584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2319c6a-d506-4333-b03c-bb6189ef121e tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:20.323037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2319c6a-d506-4333-b03c-bb6189ef121e tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:20.323373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2319c6a-d506-4333-b03c-bb6189ef121e tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] PATH_INFO: `/v3/users/5a47a9259dcc4a8d9a38ae1ba1ef00fb` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:20.325166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2319c6a-d506-4333-b03c-bb6189ef121e tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5a47a9259dcc4a8d9a38ae1ba1ef00fb)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:20.328654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2319c6a-d506-4333-b03c-bb6189ef121e tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:20.459104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e2319c6a-d506-4333-b03c-bb6189ef121e tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a47a9259dcc4a8d9a38ae1ba1ef00fb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:20.500042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e2319c6a-d506-4333-b03c-bb6189ef121e tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a47a9259dcc4a8d9a38ae1ba1ef00fb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:20.528025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c0de8-4761-43c8-ad76-1bd749769f02 tempest-test_project-251606285 tempest-user-1402238071] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:20.531036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-523c0de8-4761-43c8-ad76-1bd749769f02 tempest-test_project-251606285 tempest-user-1402238071] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:20.570683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e2319c6a-d506-4333-b03c-bb6189ef121e tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a47a9259dcc4a8d9a38ae1ba1ef00fb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:20.575873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e2319c6a-d506-4333-b03c-bb6189ef121e tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a47a9259dcc4a8d9a38ae1ba1ef00fb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:20.624772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e2319c6a-d506-4333-b03c-bb6189ef121e tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a47a9259dcc4a8d9a38ae1ba1ef00fb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:20.651978 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2423/4827] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:33:20 2022] DELETE /identity/v3/users/5a47a9259dcc4a8d9a38ae1ba1ef00fb => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:20.658617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2319c6a-d506-4333-b03c-bb6189ef121e tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:20.661305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e2319c6a-d506-4333-b03c-bb6189ef121e tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:20.880618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c0de8-4761-43c8-ad76-1bd749769f02 tempest-test_project-251606285 tempest-user-1402238071] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:20.885792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2319c6a-d506-4333-b03c-bb6189ef121e tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:20.901876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed3016-889a-412f-b681-68564c568565 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '040395c33c6b4b39a463f8320c78e927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e00b3946cbbc4f9eae1cfec6b93e4e71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:20.906444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed3016-889a-412f-b681-68564c568565 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:20.906966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed3016-889a-412f-b681-68564c568565 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:20.907672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed3016-889a-412f-b681-68564c568565 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] PATH_INFO: `/v3/projects/2f94feeb396e4e0699daab4b11fac3d3` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:20.913003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed3016-889a-412f-b681-68564c568565 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2f94feeb396e4e0699daab4b11fac3d3)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:20.917308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed3016-889a-412f-b681-68564c568565 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:21.018562 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:21.044619 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:21.065516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f8ed3016-889a-412f-b681-68564c568565 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f94feeb396e4e0699daab4b11fac3d3', 'request_id': 'req-f8ed3016-889a-412f-b681-68564c568565'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:21.067202 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7337cb4-9a57-46b6-bc6a-7c20775ac061 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:21.068714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7337cb4-9a57-46b6-bc6a-7c20775ac061 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:21.071095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7337cb4-9a57-46b6-bc6a-7c20775ac061 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:21.071846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7337cb4-9a57-46b6-bc6a-7c20775ac061 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:21.080226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f8ed3016-889a-412f-b681-68564c568565 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f94feeb396e4e0699daab4b11fac3d3', 'request_id': 'req-f8ed3016-889a-412f-b681-68564c568565'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:21.080798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e7337cb4-9a57-46b6-bc6a-7c20775ac061 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:21.094522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f8ed3016-889a-412f-b681-68564c568565 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f94feeb396e4e0699daab4b11fac3d3', 'request_id': 'req-f8ed3016-889a-412f-b681-68564c568565'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:21.112359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7337cb4-9a57-46b6-bc6a-7c20775ac061 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:21.119239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f8ed3016-889a-412f-b681-68564c568565 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] The token cache is being invalidate because project 2f94feeb396e4e0699daab4b11fac3d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:33:21.119681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f8ed3016-889a-412f-b681-68564c568565 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:21.121406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f8ed3016-889a-412f-b681-68564c568565 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:21.122283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7337cb4-9a57-46b6-bc6a-7c20775ac061 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:21.131998 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2424/4828] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:33:20 2022] DELETE /identity/v3/projects/2f94feeb396e4e0699daab4b11fac3d3 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:33:21.131998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed3016-889a-412f-b681-68564c568565 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:21.134949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f8ed3016-889a-412f-b681-68564c568565 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:21.140850 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2405/4829] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:33:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:33:21.142212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7337cb4-9a57-46b6-bc6a-7c20775ac061 service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:21.161949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7337cb4-9a57-46b6-bc6a-7c20775ac061 service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:21.294350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b4163-3c6d-4ec7-b9e9-5d1e6e7353f2 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '040395c33c6b4b39a463f8320c78e927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e00b3946cbbc4f9eae1cfec6b93e4e71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:21.295091 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b4163-3c6d-4ec7-b9e9-5d1e6e7353f2 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:21.296109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b4163-3c6d-4ec7-b9e9-5d1e6e7353f2 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:21.296393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b4163-3c6d-4ec7-b9e9-5d1e6e7353f2 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] PATH_INFO: `/v3/domains/5bc26c87ce2249af8fe4a734d94cf257` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:21.300990 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b4163-3c6d-4ec7-b9e9-5d1e6e7353f2 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5bc26c87ce2249af8fe4a734d94cf257)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:21.302644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b4163-3c6d-4ec7-b9e9-5d1e6e7353f2 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:21.343283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-412b4163-3c6d-4ec7-b9e9-5d1e6e7353f2 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5bc26c87ce2249af8fe4a734d94cf257'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:21.343994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-412b4163-3c6d-4ec7-b9e9-5d1e6e7353f2 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5bc26c87ce2249af8fe4a734d94cf257'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:21.350677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed3016-889a-412f-b681-68564c568565 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:21.391386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-412b4163-3c6d-4ec7-b9e9-5d1e6e7353f2 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5bc26c87ce2249af8fe4a734d94cf257'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:21.393400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-412b4163-3c6d-4ec7-b9e9-5d1e6e7353f2 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5bc26c87ce2249af8fe4a734d94cf257'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:21.406081 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2406/4830] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:33:21 2022] PATCH /identity/v3/domains/5bc26c87ce2249af8fe4a734d94cf257 => generated 247 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:33:21.410252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b4163-3c6d-4ec7-b9e9-5d1e6e7353f2 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:21.415473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-412b4163-3c6d-4ec7-b9e9-5d1e6e7353f2 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:21.490461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39228fb3-24b1-4828-bd1d-cea1efb95049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:21.491516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39228fb3-24b1-4828-bd1d-cea1efb95049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:21.494011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39228fb3-24b1-4828-bd1d-cea1efb95049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:21.494860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39228fb3-24b1-4828-bd1d-cea1efb95049 admin admin] PATH_INFO: `/v3/users/e379b67e2bb248b3ad25b92b2082b0fe` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:21.496471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39228fb3-24b1-4828-bd1d-cea1efb95049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e379b67e2bb248b3ad25b92b2082b0fe)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:21.509990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39228fb3-24b1-4828-bd1d-cea1efb95049 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:21.525705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b4163-3c6d-4ec7-b9e9-5d1e6e7353f2 tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:21.542177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a60b43-9654-4b22-9cf9-4883f921827c tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '040395c33c6b4b39a463f8320c78e927', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e00b3946cbbc4f9eae1cfec6b93e4e71', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:21.542860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a60b43-9654-4b22-9cf9-4883f921827c tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:21.543124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a60b43-9654-4b22-9cf9-4883f921827c tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:21.543377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a60b43-9654-4b22-9cf9-4883f921827c tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] PATH_INFO: `/v3/domains/5bc26c87ce2249af8fe4a734d94cf257` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:21.578280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a60b43-9654-4b22-9cf9-4883f921827c tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5bc26c87ce2249af8fe4a734d94cf257)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:21.587640 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a60b43-9654-4b22-9cf9-4883f921827c tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:21.663186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b7a60b43-9654-4b22-9cf9-4883f921827c tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5bc26c87ce2249af8fe4a734d94cf257'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:21.682862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-39228fb3-24b1-4828-bd1d-cea1efb95049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e379b67e2bb248b3ad25b92b2082b0fe'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:21.709783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-39228fb3-24b1-4828-bd1d-cea1efb95049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e379b67e2bb248b3ad25b92b2082b0fe'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:21.714340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b7a60b43-9654-4b22-9cf9-4883f921827c tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5bc26c87ce2249af8fe4a734d94cf257'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:21.738710 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:21.747632 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-39228fb3-24b1-4828-bd1d-cea1efb95049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e379b67e2bb248b3ad25b92b2082b0fe'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:21.749114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-39228fb3-24b1-4828-bd1d-cea1efb95049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e379b67e2bb248b3ad25b92b2082b0fe'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:21.751859 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:21.768062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-39228fb3-24b1-4828-bd1d-cea1efb95049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e379b67e2bb248b3ad25b92b2082b0fe'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:21.786834 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2425/4831] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:33:21 2022] DELETE /identity/v3/users/e379b67e2bb248b3ad25b92b2082b0fe => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:21.810089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b7a60b43-9654-4b22-9cf9-4883f921827c tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bc26c87ce2249af8fe4a734d94cf257', 'request_id': 'req-b7a60b43-9654-4b22-9cf9-4883f921827c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:21.820171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b7a60b43-9654-4b22-9cf9-4883f921827c tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bc26c87ce2249af8fe4a734d94cf257', 'request_id': 'req-b7a60b43-9654-4b22-9cf9-4883f921827c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:21.829555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b7a60b43-9654-4b22-9cf9-4883f921827c tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bc26c87ce2249af8fe4a734d94cf257', 'request_id': 'req-b7a60b43-9654-4b22-9cf9-4883f921827c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:21.866327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b7a60b43-9654-4b22-9cf9-4883f921827c tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] The token cache is being invalidate because project 5bc26c87ce2249af8fe4a734d94cf257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:33:21.867697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b7a60b43-9654-4b22-9cf9-4883f921827c tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:21.868779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b7a60b43-9654-4b22-9cf9-4883f921827c tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:21.905394 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b7a60b43-9654-4b22-9cf9-4883f921827c tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5bc26c87ce2249af8fe4a734d94cf257', 'request_id': 'req-b7a60b43-9654-4b22-9cf9-4883f921827c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:21.907207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b7a60b43-9654-4b22-9cf9-4883f921827c tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5bc26c87ce2249af8fe4a734d94cf257', 'request_id': 'req-b7a60b43-9654-4b22-9cf9-4883f921827c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:21.913627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b7a60b43-9654-4b22-9cf9-4883f921827c tempest-TestDefaultProjectId-381330143 tempest-TestDefaultProjectId-381330143-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5bc26c87ce2249af8fe4a734d94cf257', 'request_id': 'req-b7a60b43-9654-4b22-9cf9-4883f921827c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:21.925876 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2407/4832] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:33:21 2022] DELETE /identity/v3/domains/5bc26c87ce2249af8fe4a734d94cf257 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:33:21.934222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39228fb3-24b1-4828-bd1d-cea1efb95049 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:21.936618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-39228fb3-24b1-4828-bd1d-cea1efb95049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:22.049387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39228fb3-24b1-4828-bd1d-cea1efb95049 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:22.062770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad36b2-31df-482f-a39c-7a9041b26013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:22.063821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad36b2-31df-482f-a39c-7a9041b26013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:22.064330 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad36b2-31df-482f-a39c-7a9041b26013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:22.064791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad36b2-31df-482f-a39c-7a9041b26013 admin admin] PATH_INFO: `/v3/users/57fcbcb874c049dc9aaee54c16e07890` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:22.070790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad36b2-31df-482f-a39c-7a9041b26013 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57fcbcb874c049dc9aaee54c16e07890)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:22.073223 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad36b2-31df-482f-a39c-7a9041b26013 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:22.212592 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-27ad36b2-31df-482f-a39c-7a9041b26013 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57fcbcb874c049dc9aaee54c16e07890'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:22.234041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-27ad36b2-31df-482f-a39c-7a9041b26013 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57fcbcb874c049dc9aaee54c16e07890'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:22.274071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-27ad36b2-31df-482f-a39c-7a9041b26013 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57fcbcb874c049dc9aaee54c16e07890'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:22.277385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-27ad36b2-31df-482f-a39c-7a9041b26013 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57fcbcb874c049dc9aaee54c16e07890'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:22.311658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-27ad36b2-31df-482f-a39c-7a9041b26013 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57fcbcb874c049dc9aaee54c16e07890'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:22.324360 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2426/4833] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:33:21 2022] DELETE /identity/v3/users/57fcbcb874c049dc9aaee54c16e07890 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:22.325613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9eae9-f975-4575-91aa-1a156f80cbaf None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:22.325904 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9eae9-f975-4575-91aa-1a156f80cbaf None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:22.326232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9eae9-f975-4575-91aa-1a156f80cbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:22.363259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-4bc9eae9-f975-4575-91aa-1a156f80cbaf None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:22.365744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4bc9eae9-f975-4575-91aa-1a156f80cbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:22.572563 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2408/4834] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:33:22.593865 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad36b2-31df-482f-a39c-7a9041b26013 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:22.597058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-27ad36b2-31df-482f-a39c-7a9041b26013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:22.732315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad36b2-31df-482f-a39c-7a9041b26013 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:22.747943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745681e1-29d5-4734-ba91-959e76c3f720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:22.749464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745681e1-29d5-4734-ba91-959e76c3f720 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:22.750001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745681e1-29d5-4734-ba91-959e76c3f720 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:22.750533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745681e1-29d5-4734-ba91-959e76c3f720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:22.763775 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745681e1-29d5-4734-ba91-959e76c3f720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:22.766494 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745681e1-29d5-4734-ba91-959e76c3f720 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:22.779068 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2427/4835] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:33:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:33:23.180282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9eae9-f975-4575-91aa-1a156f80cbaf None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:23.182858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4bc9eae9-f975-4575-91aa-1a156f80cbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:23.212790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9eae9-f975-4575-91aa-1a156f80cbaf None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:23.222891 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745681e1-29d5-4734-ba91-959e76c3f720 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:23.224644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-745681e1-29d5-4734-ba91-959e76c3f720 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:23.253757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745681e1-29d5-4734-ba91-959e76c3f720 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:23.261576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f78167-6382-4775-9b7a-a750e5614a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:23.262756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f78167-6382-4775-9b7a-a750e5614a29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:23.263554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f78167-6382-4775-9b7a-a750e5614a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:23.264274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f78167-6382-4775-9b7a-a750e5614a29 admin admin] PATH_INFO: `/v3/projects/9ecc3d5efbe54d76ae9e6ed5f7633c1d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:23.266999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f78167-6382-4775-9b7a-a750e5614a29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ecc3d5efbe54d76ae9e6ed5f7633c1d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:23.269575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b95d42-10c1-41bd-a28b-1c789c540d40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:23.270385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b95d42-10c1-41bd-a28b-1c789c540d40 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:23.271268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f78167-6382-4775-9b7a-a750e5614a29 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:23.271819 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b95d42-10c1-41bd-a28b-1c789c540d40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:23.272297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b95d42-10c1-41bd-a28b-1c789c540d40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:23.284320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-37b95d42-10c1-41bd-a28b-1c789c540d40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:23.355745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b95d42-10c1-41bd-a28b-1c789c540d40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:23.359413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b95d42-10c1-41bd-a28b-1c789c540d40 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:23.397648 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:23.423387 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2428/4836] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:33:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:33:23.463852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-27f78167-6382-4775-9b7a-a750e5614a29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'request_id': 'req-27f78167-6382-4775-9b7a-a750e5614a29'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:23.484422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-27f78167-6382-4775-9b7a-a750e5614a29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'request_id': 'req-27f78167-6382-4775-9b7a-a750e5614a29'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:23.500745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-27f78167-6382-4775-9b7a-a750e5614a29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ecc3d5efbe54d76ae9e6ed5f7633c1d', 'request_id': 'req-27f78167-6382-4775-9b7a-a750e5614a29'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:23.537455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-27f78167-6382-4775-9b7a-a750e5614a29 admin admin] The token cache is being invalidate because project 9ecc3d5efbe54d76ae9e6ed5f7633c1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:33:23.538052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-27f78167-6382-4775-9b7a-a750e5614a29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:23.540560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-27f78167-6382-4775-9b7a-a750e5614a29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:23.544490 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2409/4837] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:33:23 2022] DELETE /identity/v3/projects/9ecc3d5efbe54d76ae9e6ed5f7633c1d => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:23.549131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b95d42-10c1-41bd-a28b-1c789c540d40 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:23.567926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b95d42-10c1-41bd-a28b-1c789c540d40 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:23.758271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be3924-6b19-4d8c-8272-218a81a9ec10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:23.759454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be3924-6b19-4d8c-8272-218a81a9ec10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:23.760063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be3924-6b19-4d8c-8272-218a81a9ec10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:23.767245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be3924-6b19-4d8c-8272-218a81a9ec10 admin admin] PATH_INFO: `/v3/users/1b8bc98d6fe04713bbbc0628b8e527b9` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:23.773223 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be3924-6b19-4d8c-8272-218a81a9ec10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b8bc98d6fe04713bbbc0628b8e527b9)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:23.780393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be3924-6b19-4d8c-8272-218a81a9ec10 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:23.945112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-15be3924-6b19-4d8c-8272-218a81a9ec10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b8bc98d6fe04713bbbc0628b8e527b9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:23.967965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-15be3924-6b19-4d8c-8272-218a81a9ec10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b8bc98d6fe04713bbbc0628b8e527b9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:24.019011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-15be3924-6b19-4d8c-8272-218a81a9ec10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b8bc98d6fe04713bbbc0628b8e527b9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:24.019927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-15be3924-6b19-4d8c-8272-218a81a9ec10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b8bc98d6fe04713bbbc0628b8e527b9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:24.035804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-15be3924-6b19-4d8c-8272-218a81a9ec10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b8bc98d6fe04713bbbc0628b8e527b9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:24.053668 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2429/4838] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:33:23 2022] DELETE /identity/v3/users/1b8bc98d6fe04713bbbc0628b8e527b9 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:25.313000 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f78167-6382-4775-9b7a-a750e5614a29 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:25.315171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-27f78167-6382-4775-9b7a-a750e5614a29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:25.354066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f78167-6382-4775-9b7a-a750e5614a29 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:25.361785 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:25.414341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be3924-6b19-4d8c-8272-218a81a9ec10 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:25.417079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-15be3924-6b19-4d8c-8272-218a81a9ec10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:25.502203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd070cf8-6084-4eb1-87c5-39ada90894f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:25.503389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd070cf8-6084-4eb1-87c5-39ada90894f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:25.503916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd070cf8-6084-4eb1-87c5-39ada90894f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:25.504712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd070cf8-6084-4eb1-87c5-39ada90894f4 admin admin] PATH_INFO: `/v3/projects/12f2a54d02844f298a67df95bc9d2cc4` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:25.506523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd070cf8-6084-4eb1-87c5-39ada90894f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12f2a54d02844f298a67df95bc9d2cc4)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:25.512065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd070cf8-6084-4eb1-87c5-39ada90894f4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:25.590586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be3924-6b19-4d8c-8272-218a81a9ec10 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:25.605130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476be6a0-0fbf-46d3-96ee-882369a5d3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:25.605792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476be6a0-0fbf-46d3-96ee-882369a5d3e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:25.606451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476be6a0-0fbf-46d3-96ee-882369a5d3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:25.607191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476be6a0-0fbf-46d3-96ee-882369a5d3e7 admin admin] PATH_INFO: `/v3/projects/73bd644fa2c94a5682453ac41a2d86cc` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:25.610721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476be6a0-0fbf-46d3-96ee-882369a5d3e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73bd644fa2c94a5682453ac41a2d86cc)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:25.620487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476be6a0-0fbf-46d3-96ee-882369a5d3e7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:25.636604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bd070cf8-6084-4eb1-87c5-39ada90894f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12f2a54d02844f298a67df95bc9d2cc4', 'request_id': 'req-bd070cf8-6084-4eb1-87c5-39ada90894f4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:25.648136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bd070cf8-6084-4eb1-87c5-39ada90894f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12f2a54d02844f298a67df95bc9d2cc4', 'request_id': 'req-bd070cf8-6084-4eb1-87c5-39ada90894f4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:25.652965 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:25.656912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bd070cf8-6084-4eb1-87c5-39ada90894f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12f2a54d02844f298a67df95bc9d2cc4', 'request_id': 'req-bd070cf8-6084-4eb1-87c5-39ada90894f4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:25.683359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bd070cf8-6084-4eb1-87c5-39ada90894f4 admin admin] The token cache is being invalidate because project 12f2a54d02844f298a67df95bc9d2cc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:33:25.684052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bd070cf8-6084-4eb1-87c5-39ada90894f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:25.696935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bd070cf8-6084-4eb1-87c5-39ada90894f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:25.700409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-476be6a0-0fbf-46d3-96ee-882369a5d3e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73bd644fa2c94a5682453ac41a2d86cc', 'request_id': 'req-476be6a0-0fbf-46d3-96ee-882369a5d3e7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:25.707353 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2410/4839] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:33:25 2022] DELETE /identity/v3/projects/12f2a54d02844f298a67df95bc9d2cc4 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:25.710377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd070cf8-6084-4eb1-87c5-39ada90894f4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:25.712138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bd070cf8-6084-4eb1-87c5-39ada90894f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:25.716003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-476be6a0-0fbf-46d3-96ee-882369a5d3e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73bd644fa2c94a5682453ac41a2d86cc', 'request_id': 'req-476be6a0-0fbf-46d3-96ee-882369a5d3e7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:25.727734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-476be6a0-0fbf-46d3-96ee-882369a5d3e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73bd644fa2c94a5682453ac41a2d86cc', 'request_id': 'req-476be6a0-0fbf-46d3-96ee-882369a5d3e7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:25.749330 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-476be6a0-0fbf-46d3-96ee-882369a5d3e7 admin admin] The token cache is being invalidate because project 73bd644fa2c94a5682453ac41a2d86cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:33:25.750614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-476be6a0-0fbf-46d3-96ee-882369a5d3e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:25.751599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-476be6a0-0fbf-46d3-96ee-882369a5d3e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:25.756204 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2430/4840] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:33:25 2022] DELETE /identity/v3/projects/73bd644fa2c94a5682453ac41a2d86cc => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:25.760863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6764f0-2906-499f-ac46-ecbfba779904 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:25.761400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6764f0-2906-499f-ac46-ecbfba779904 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:25.761811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6764f0-2906-499f-ac46-ecbfba779904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:25.789704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3c6764f0-2906-499f-ac46-ecbfba779904 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:25.792157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3c6764f0-2906-499f-ac46-ecbfba779904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:25.858215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd070cf8-6084-4eb1-87c5-39ada90894f4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:25.925183 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2431/4841] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:25.925183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6764f0-2906-499f-ac46-ecbfba779904 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:25.929896 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3c6764f0-2906-499f-ac46-ecbfba779904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:25.943176 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:25.972968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6764f0-2906-499f-ac46-ecbfba779904 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:25.996903 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00a90d-195d-4030-8bd5-07ece4da225a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:25.998727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00a90d-195d-4030-8bd5-07ece4da225a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:25.998727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00a90d-195d-4030-8bd5-07ece4da225a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:25.999005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00a90d-195d-4030-8bd5-07ece4da225a admin admin] PATH_INFO: `/v3/users/040395c33c6b4b39a463f8320c78e927` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:26.012261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00a90d-195d-4030-8bd5-07ece4da225a admin admin] RBAC: Authorizing `identity:delete_user(user_id=040395c33c6b4b39a463f8320c78e927)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:26.018565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00a90d-195d-4030-8bd5-07ece4da225a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:26.020736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47f021-d96d-4ccf-8d3d-c5a7b5bbdd55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:26.021769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47f021-d96d-4ccf-8d3d-c5a7b5bbdd55 service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:26.022118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47f021-d96d-4ccf-8d3d-c5a7b5bbdd55 service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:26.022586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47f021-d96d-4ccf-8d3d-c5a7b5bbdd55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:26.026376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3b47f021-d96d-4ccf-8d3d-c5a7b5bbdd55 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:26.122366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9b00a90d-195d-4030-8bd5-07ece4da225a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '040395c33c6b4b39a463f8320c78e927'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:26.134718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9b00a90d-195d-4030-8bd5-07ece4da225a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '040395c33c6b4b39a463f8320c78e927'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:26.153905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9b00a90d-195d-4030-8bd5-07ece4da225a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '040395c33c6b4b39a463f8320c78e927'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:26.154798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9b00a90d-195d-4030-8bd5-07ece4da225a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '040395c33c6b4b39a463f8320c78e927'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:26.166673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9b00a90d-195d-4030-8bd5-07ece4da225a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '040395c33c6b4b39a463f8320c78e927'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:26.178303 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2432/4842] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:33:25 2022] DELETE /identity/v3/users/040395c33c6b4b39a463f8320c78e927 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:26.181489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fb2fc-db44-4df9-a3ae-997f9ad696e9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:26.182013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fb2fc-db44-4df9-a3ae-997f9ad696e9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:26.182485 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fb2fc-db44-4df9-a3ae-997f9ad696e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:26.214117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6f7fb2fc-db44-4df9-a3ae-997f9ad696e9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:26.215385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6f7fb2fc-db44-4df9-a3ae-997f9ad696e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:26.217391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47f021-d96d-4ccf-8d3d-c5a7b5bbdd55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:26.221110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47f021-d96d-4ccf-8d3d-c5a7b5bbdd55 service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:26.237407 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:26.270616 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2411/4843] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:33:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:33:26.351647 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2433/4844] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:26.357247 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47f021-d96d-4ccf-8d3d-c5a7b5bbdd55 service swift] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:26.360763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3b47f021-d96d-4ccf-8d3d-c5a7b5bbdd55 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:26.440015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47f021-d96d-4ccf-8d3d-c5a7b5bbdd55 service swift] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:26.467537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e673519-f99e-4a21-b24b-8c4d1927ba0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:26.468500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e673519-f99e-4a21-b24b-8c4d1927ba0c admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:26.469221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e673519-f99e-4a21-b24b-8c4d1927ba0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:26.469926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e673519-f99e-4a21-b24b-8c4d1927ba0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:26.470805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e673519-f99e-4a21-b24b-8c4d1927ba0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:33:26.472374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e673519-f99e-4a21-b24b-8c4d1927ba0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:26.478531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e673519-f99e-4a21-b24b-8c4d1927ba0c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:26.512355 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2412/4845] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:33:26.517664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7fb2fc-db44-4df9-a3ae-997f9ad696e9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:26.539032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7fb2fc-db44-4df9-a3ae-997f9ad696e9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:26.546030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35391c2-a612-43aa-8e7b-54b4e918448b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:26.547291 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35391c2-a612-43aa-8e7b-54b4e918448b admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:26.547728 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35391c2-a612-43aa-8e7b-54b4e918448b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:26.548175 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35391c2-a612-43aa-8e7b-54b4e918448b admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:26.548987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35391c2-a612-43aa-8e7b-54b4e918448b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:26.553220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35391c2-a612-43aa-8e7b-54b4e918448b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:26.684919 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2434/4846] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:33:26 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:26.691423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e673519-f99e-4a21-b24b-8c4d1927ba0c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:26.722525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e673519-f99e-4a21-b24b-8c4d1927ba0c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:26.874168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0b30b-3e4a-4001-a6f1-7ccbfbe33f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:26.875267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0b30b-3e4a-4001-a6f1-7ccbfbe33f7a admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:26.877261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0b30b-3e4a-4001-a6f1-7ccbfbe33f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:26.879781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0b30b-3e4a-4001-a6f1-7ccbfbe33f7a admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:26.880690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0b30b-3e4a-4001-a6f1-7ccbfbe33f7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:26.887515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0b30b-3e4a-4001-a6f1-7ccbfbe33f7a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:26.940680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35391c2-a612-43aa-8e7b-54b4e918448b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:26.948375 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2413/4847] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:33:26 2022] POST /identity/v3/users => generated 290 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:26.956036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35391c2-a612-43aa-8e7b-54b4e918448b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:26.986485 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a8250-2f25-4825-9416-cbde75d4cc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:26.987151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a8250-2f25-4825-9416-cbde75d4cc26 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:26.987562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a8250-2f25-4825-9416-cbde75d4cc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:26.988005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a8250-2f25-4825-9416-cbde75d4cc26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:26.988862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a8250-2f25-4825-9416-cbde75d4cc26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:26.991680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a8250-2f25-4825-9416-cbde75d4cc26 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:27.042253 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2435/4848] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:27.048512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0b30b-3e4a-4001-a6f1-7ccbfbe33f7a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:27.065290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0b30b-3e4a-4001-a6f1-7ccbfbe33f7a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:27.085209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b683b-c269-4692-b35f-27f77fc115ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:27.086190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b683b-c269-4692-b35f-27f77fc115ac admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:27.087122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b683b-c269-4692-b35f-27f77fc115ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:27.095238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b683b-c269-4692-b35f-27f77fc115ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:27.096456 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b683b-c269-4692-b35f-27f77fc115ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:27.114125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b683b-c269-4692-b35f-27f77fc115ac admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:27.148391 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a8250-2f25-4825-9416-cbde75d4cc26 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:27.181279 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2414/4849] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:27.182839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a8250-2f25-4825-9416-cbde75d4cc26 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:27.206091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b11b630-dbab-4f5e-9124-80e89d02b7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:27.206639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11b630-dbab-4f5e-9124-80e89d02b7c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:27.208389 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11b630-dbab-4f5e-9124-80e89d02b7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:27.209690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b11b630-dbab-4f5e-9124-80e89d02b7c3 admin admin] PATH_INFO: `/v3/projects/5a300727d7874d83970c301327780abc/users/5f0ed400a2cb48cbbc9fa5bae0e2b1c2/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:27.268099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b11b630-dbab-4f5e-9124-80e89d02b7c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a300727d7874d83970c301327780abc, user_id=5f0ed400a2cb48cbbc9fa5bae0e2b1c2, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:27.281150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b11b630-dbab-4f5e-9124-80e89d02b7c3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:27.340008 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c062b0-447c-49eb-bf08-102d135c487a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:27.340620 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c062b0-447c-49eb-bf08-102d135c487a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:27.341006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c062b0-447c-49eb-bf08-102d135c487a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:27.345860 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2436/4850] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:33:27 2022] PUT /identity/v3/projects/5a300727d7874d83970c301327780abc/users/5f0ed400a2cb48cbbc9fa5bae0e2b1c2/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:27.392637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c3c062b0-447c-49eb-bf08-102d135c487a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:27.394895 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c3c062b0-447c-49eb-bf08-102d135c487a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:27.569432 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:27.619541 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2415/4851] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:27.648973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b11b630-dbab-4f5e-9124-80e89d02b7c3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:27.652350 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6b11b630-dbab-4f5e-9124-80e89d02b7c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:27.801630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b11b630-dbab-4f5e-9124-80e89d02b7c3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:27.806406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e61b2-e7d2-48d5-a3bf-507063665b96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:27.807503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e61b2-e7d2-48d5-a3bf-507063665b96 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:27.808039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e61b2-e7d2-48d5-a3bf-507063665b96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:27.808472 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e61b2-e7d2-48d5-a3bf-507063665b96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:27.821782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e61b2-e7d2-48d5-a3bf-507063665b96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:27.823688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e61b2-e7d2-48d5-a3bf-507063665b96 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:27.836523 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2437/4852] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:33:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:33:28.065245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c062b0-447c-49eb-bf08-102d135c487a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:28.072658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c3c062b0-447c-49eb-bf08-102d135c487a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:28.121398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c062b0-447c-49eb-bf08-102d135c487a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:28.201432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b772a6f-07f4-4726-aa32-749e638ae56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:28.204492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b772a6f-07f4-4726-aa32-749e638ae56d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:28.209309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b772a6f-07f4-4726-aa32-749e638ae56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:28.211095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b772a6f-07f4-4726-aa32-749e638ae56d admin admin] PATH_INFO: `/v3/projects/e00b3946cbbc4f9eae1cfec6b93e4e71` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:28.216658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b772a6f-07f4-4726-aa32-749e638ae56d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e00b3946cbbc4f9eae1cfec6b93e4e71)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:28.224274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b772a6f-07f4-4726-aa32-749e638ae56d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:28.407579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6b772a6f-07f4-4726-aa32-749e638ae56d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e00b3946cbbc4f9eae1cfec6b93e4e71', 'request_id': 'req-6b772a6f-07f4-4726-aa32-749e638ae56d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:28.433620 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6b772a6f-07f4-4726-aa32-749e638ae56d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e00b3946cbbc4f9eae1cfec6b93e4e71', 'request_id': 'req-6b772a6f-07f4-4726-aa32-749e638ae56d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:28.464128 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6b772a6f-07f4-4726-aa32-749e638ae56d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e00b3946cbbc4f9eae1cfec6b93e4e71', 'request_id': 'req-6b772a6f-07f4-4726-aa32-749e638ae56d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:28.522250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6b772a6f-07f4-4726-aa32-749e638ae56d admin admin] The token cache is being invalidate because project e00b3946cbbc4f9eae1cfec6b93e4e71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:33:28.522767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6b772a6f-07f4-4726-aa32-749e638ae56d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:28.524835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6b772a6f-07f4-4726-aa32-749e638ae56d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:28.532335 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2416/4853] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:33:28 2022] DELETE /identity/v3/projects/e00b3946cbbc4f9eae1cfec6b93e4e71 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:28.542320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c451349-ca06-48f6-b9ed-7dd5a3e4d3cb None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:28.543289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c451349-ca06-48f6-b9ed-7dd5a3e4d3cb None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:28.543728 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c451349-ca06-48f6-b9ed-7dd5a3e4d3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:28.623816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0c451349-ca06-48f6-b9ed-7dd5a3e4d3cb None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:28.626268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0c451349-ca06-48f6-b9ed-7dd5a3e4d3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:28.825157 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2438/4854] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:28.831196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88f9e8-a8e9-4072-9f33-a8cfc60f8169 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:28.831672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88f9e8-a8e9-4072-9f33-a8cfc60f8169 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:28.832244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88f9e8-a8e9-4072-9f33-a8cfc60f8169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:28.880292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2a88f9e8-a8e9-4072-9f33-a8cfc60f8169 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:28.881728 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2a88f9e8-a8e9-4072-9f33-a8cfc60f8169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:28.897354 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2417/4855] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:28.901859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c451349-ca06-48f6-b9ed-7dd5a3e4d3cb None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:28.914124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c451349-ca06-48f6-b9ed-7dd5a3e4d3cb None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:28.931069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5823a7e-4bb5-4a54-a6c2-98e0c823daa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:28.931069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5823a7e-4bb5-4a54-a6c2-98e0c823daa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:28.931069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5823a7e-4bb5-4a54-a6c2-98e0c823daa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:28.931686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5823a7e-4bb5-4a54-a6c2-98e0c823daa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:28.932764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5823a7e-4bb5-4a54-a6c2-98e0c823daa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:33:28.933610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5823a7e-4bb5-4a54-a6c2-98e0c823daa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:28.934846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5823a7e-4bb5-4a54-a6c2-98e0c823daa4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:28.947286 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:28.970675 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2439/4856] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:33:28.974901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88f9e8-a8e9-4072-9f33-a8cfc60f8169 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:28.989039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88f9e8-a8e9-4072-9f33-a8cfc60f8169 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:28.999429 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7188ed0-fe41-45bd-96d1-e6a0962ffa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:29.000474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7188ed0-fe41-45bd-96d1-e6a0962ffa8c admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:29.005933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7188ed0-fe41-45bd-96d1-e6a0962ffa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:29.006184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7188ed0-fe41-45bd-96d1-e6a0962ffa8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:29.006738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7188ed0-fe41-45bd-96d1-e6a0962ffa8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:29.008946 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7188ed0-fe41-45bd-96d1-e6a0962ffa8c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:29.080552 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2418/4857] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:33:28 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:29.084972 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5823a7e-4bb5-4a54-a6c2-98e0c823daa4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:29.097596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5823a7e-4bb5-4a54-a6c2-98e0c823daa4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:29.236726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081c0fc-4833-411f-aad2-075c0678be9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:29.237863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081c0fc-4833-411f-aad2-075c0678be9d admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:29.238291 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081c0fc-4833-411f-aad2-075c0678be9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:29.238679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081c0fc-4833-411f-aad2-075c0678be9d admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:29.239741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d081c0fc-4833-411f-aad2-075c0678be9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:29.241956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d081c0fc-4833-411f-aad2-075c0678be9d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:29.302496 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2440/4858] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:33:29 2022] POST /identity/v3/users => generated 287 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:33:29.304628 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7188ed0-fe41-45bd-96d1-e6a0962ffa8c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:29.330652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7188ed0-fe41-45bd-96d1-e6a0962ffa8c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:29.348465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b9abf-b503-44c2-9eeb-dd0170ff8f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:29.349361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b9abf-b503-44c2-9eeb-dd0170ff8f6b admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:29.349807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b9abf-b503-44c2-9eeb-dd0170ff8f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:29.350242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b9abf-b503-44c2-9eeb-dd0170ff8f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:29.351084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b9abf-b503-44c2-9eeb-dd0170ff8f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:29.352970 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b9abf-b503-44c2-9eeb-dd0170ff8f6b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:29.382639 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2419/4859] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:29.386967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081c0fc-4833-411f-aad2-075c0678be9d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:29.407050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081c0fc-4833-411f-aad2-075c0678be9d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:29.414461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c13f1-a1e5-4b2e-b4ac-70d74c8425f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:29.420244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c13f1-a1e5-4b2e-b4ac-70d74c8425f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:29.421976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c13f1-a1e5-4b2e-b4ac-70d74c8425f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:29.422542 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c13f1-a1e5-4b2e-b4ac-70d74c8425f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:29.424130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c13f1-a1e5-4b2e-b4ac-70d74c8425f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:29.426374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c13f1-a1e5-4b2e-b4ac-70d74c8425f2 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:29.447792 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2441/4860] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:33:29.449561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b9abf-b503-44c2-9eeb-dd0170ff8f6b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:29.473428 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b9abf-b503-44c2-9eeb-dd0170ff8f6b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:29.492668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28dd58f-f49f-48ac-9d6e-789b33362b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:29.493470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28dd58f-f49f-48ac-9d6e-789b33362b8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:29.493618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28dd58f-f49f-48ac-9d6e-789b33362b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:29.493900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28dd58f-f49f-48ac-9d6e-789b33362b8d admin admin] PATH_INFO: `/v3/projects/e48faf30a0064cbe8234f9004844d816/users/f2ad3613218248c6aeaa3878a5759b21/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:29.532809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28dd58f-f49f-48ac-9d6e-789b33362b8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e48faf30a0064cbe8234f9004844d816, user_id=f2ad3613218248c6aeaa3878a5759b21, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:29.552129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28dd58f-f49f-48ac-9d6e-789b33362b8d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:29.596664 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2420/4861] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:33:29 2022] PUT /identity/v3/projects/e48faf30a0064cbe8234f9004844d816/users/f2ad3613218248c6aeaa3878a5759b21/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:29.608584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8de84e-c8e2-49af-b8c3-25ecf552d7df None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:29.608584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8de84e-c8e2-49af-b8c3-25ecf552d7df None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:29.608584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8de84e-c8e2-49af-b8c3-25ecf552d7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:29.666013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5a8de84e-c8e2-49af-b8c3-25ecf552d7df None None] MFA Rules not processed for user `f2ad3613218248c6aeaa3878a5759b21`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:29.667685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5a8de84e-c8e2-49af-b8c3-25ecf552d7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:29.829306 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2442/4862] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:29.834520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28dd58f-f49f-48ac-9d6e-789b33362b8d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:30.109191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28dd58f-f49f-48ac-9d6e-789b33362b8d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:30.126060 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acb951-96f9-45d1-8fa0-21917e46300c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:30.126748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acb951-96f9-45d1-8fa0-21917e46300c admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:30.127587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acb951-96f9-45d1-8fa0-21917e46300c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:30.127587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acb951-96f9-45d1-8fa0-21917e46300c admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:30.128039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67acb951-96f9-45d1-8fa0-21917e46300c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:30.130053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67acb951-96f9-45d1-8fa0-21917e46300c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:30.163132 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:30.233137 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2421/4863] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:33:29 2022] POST /identity/v3/projects => generated 373 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:30.234679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8de84e-c8e2-49af-b8c3-25ecf552d7df None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:30.252574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8de84e-c8e2-49af-b8c3-25ecf552d7df None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:30.414479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb4a2b-25e8-4b37-86c9-2aed8afc82f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:30.415196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb4a2b-25e8-4b37-86c9-2aed8afc82f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:30.416096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb4a2b-25e8-4b37-86c9-2aed8afc82f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:30.420860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb4a2b-25e8-4b37-86c9-2aed8afc82f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:30.421203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb4a2b-25e8-4b37-86c9-2aed8afc82f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:30.423621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb4a2b-25e8-4b37-86c9-2aed8afc82f1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:30.446651 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:30.477771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acb951-96f9-45d1-8fa0-21917e46300c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:30.478715 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2443/4864] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:33:30 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:30.504203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acb951-96f9-45d1-8fa0-21917e46300c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:30.535109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4587a97-36e6-492a-ace9-e495aadea2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:30.535956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4587a97-36e6-492a-ace9-e495aadea2bb admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:30.536666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4587a97-36e6-492a-ace9-e495aadea2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:30.537178 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4587a97-36e6-492a-ace9-e495aadea2bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:30.538109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4587a97-36e6-492a-ace9-e495aadea2bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:30.540169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4587a97-36e6-492a-ace9-e495aadea2bb admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:30.565046 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2422/4865] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:33:30.569524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb4a2b-25e8-4b37-86c9-2aed8afc82f1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:30.583215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb4a2b-25e8-4b37-86c9-2aed8afc82f1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:30.595696 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ffe7c-fb70-4a98-9bd0-4eac67d25c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:30.596452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ffe7c-fb70-4a98-9bd0-4eac67d25c2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:30.596733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ffe7c-fb70-4a98-9bd0-4eac67d25c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:30.597010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ffe7c-fb70-4a98-9bd0-4eac67d25c2e admin admin] PATH_INFO: `/v3/projects/e89f2043ef354d01826042578d239b6a/users/6824973065b54fba85daaf2d5338fb7b/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:30.633781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ffe7c-fb70-4a98-9bd0-4eac67d25c2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e89f2043ef354d01826042578d239b6a, user_id=6824973065b54fba85daaf2d5338fb7b, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:30.640885 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ffe7c-fb70-4a98-9bd0-4eac67d25c2e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:30.678494 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2444/4866] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:33:30 2022] PUT /identity/v3/projects/e89f2043ef354d01826042578d239b6a/users/6824973065b54fba85daaf2d5338fb7b/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:33:30.682987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4587a97-36e6-492a-ace9-e495aadea2bb admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:30.703939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4587a97-36e6-492a-ace9-e495aadea2bb admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:30.836485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06aed27-94f7-4129-a154-ea5a2e3d2557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:30.837522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06aed27-94f7-4129-a154-ea5a2e3d2557 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:30.838038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06aed27-94f7-4129-a154-ea5a2e3d2557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:30.838556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06aed27-94f7-4129-a154-ea5a2e3d2557 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:30.839455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06aed27-94f7-4129-a154-ea5a2e3d2557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:30.841919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06aed27-94f7-4129-a154-ea5a2e3d2557 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:30.853938 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2423/4867] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:30.858164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ffe7c-fb70-4a98-9bd0-4eac67d25c2e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:30.869590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ffe7c-fb70-4a98-9bd0-4eac67d25c2e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:30.892937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be60847f-06ce-498b-aad6-19443678213b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:30.893627 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60847f-06ce-498b-aad6-19443678213b admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:30.893905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60847f-06ce-498b-aad6-19443678213b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:30.894175 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60847f-06ce-498b-aad6-19443678213b admin admin] PATH_INFO: `/v3/projects/e89f2043ef354d01826042578d239b6a/users/6824973065b54fba85daaf2d5338fb7b/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:30.899141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be60847f-06ce-498b-aad6-19443678213b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e89f2043ef354d01826042578d239b6a, user_id=6824973065b54fba85daaf2d5338fb7b, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:30.915797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be60847f-06ce-498b-aad6-19443678213b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:30.954527 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2445/4868] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:33:30 2022] PUT /identity/v3/projects/e89f2043ef354d01826042578d239b6a/users/6824973065b54fba85daaf2d5338fb7b/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:30.973195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2070a-f148-4897-9426-eff57f8cc883 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:30.973878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2070a-f148-4897-9426-eff57f8cc883 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:30.974398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c2070a-f148-4897-9426-eff57f8cc883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:31.051018 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-35c2070a-f148-4897-9426-eff57f8cc883 None None] MFA Rules not processed for user `6824973065b54fba85daaf2d5338fb7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:31.053573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-35c2070a-f148-4897-9426-eff57f8cc883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:31.320377 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2424/4869] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:33:31.325511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be60847f-06ce-498b-aad6-19443678213b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:31.355580 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be60847f-06ce-498b-aad6-19443678213b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:31.377347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2070a-f148-4897-9426-eff57f8cc883 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:31.378869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-35c2070a-f148-4897-9426-eff57f8cc883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:31.400904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de616141-d62d-439a-b480-2eacc297b741 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6824973065b54fba85daaf2d5338fb7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e89f2043ef354d01826042578d239b6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:31.403823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de616141-d62d-439a-b480-2eacc297b741 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:31.406230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de616141-d62d-439a-b480-2eacc297b741 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:31.408287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de616141-d62d-439a-b480-2eacc297b741 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:31.413223 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de616141-d62d-439a-b480-2eacc297b741 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:31.418550 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-de616141-d62d-439a-b480-2eacc297b741 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:33:31.418550 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:33:31.418550 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:33:31.421726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de616141-d62d-439a-b480-2eacc297b741 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:31.487062 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2446/4870] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:33:31 2022] POST /identity/v3/services => generated 288 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:31.494410 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de616141-d62d-439a-b480-2eacc297b741 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:31.561845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de616141-d62d-439a-b480-2eacc297b741 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:31.578395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a938b5-2deb-4f89-9b80-b43d0e03fa7d tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6824973065b54fba85daaf2d5338fb7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e89f2043ef354d01826042578d239b6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:31.579046 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a938b5-2deb-4f89-9b80-b43d0e03fa7d tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:31.579330 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a938b5-2deb-4f89-9b80-b43d0e03fa7d tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:31.579605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a938b5-2deb-4f89-9b80-b43d0e03fa7d tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:31.580435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a938b5-2deb-4f89-9b80-b43d0e03fa7d tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:31.581364 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-71a938b5-2deb-4f89-9b80-b43d0e03fa7d tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:33:31.581364 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:33:31.581364 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:33:31.582286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a938b5-2deb-4f89-9b80-b43d0e03fa7d tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:31.604923 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2447/4871] 10.222.0.39 () {60 vars in 1213 bytes} [Sun Aug 7 01:33:31 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:31.609749 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a938b5-2deb-4f89-9b80-b43d0e03fa7d tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:31.611399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c2070a-f148-4897-9426-eff57f8cc883 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:31.622296 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:31.635653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a938b5-2deb-4f89-9b80-b43d0e03fa7d tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:31.659246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd895e63-d757-4f88-854d-5538fea116cd tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6824973065b54fba85daaf2d5338fb7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e89f2043ef354d01826042578d239b6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:31.660163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd895e63-d757-4f88-854d-5538fea116cd tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:31.660822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd895e63-d757-4f88-854d-5538fea116cd tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:31.661103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd895e63-d757-4f88-854d-5538fea116cd tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:31.661813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd895e63-d757-4f88-854d-5538fea116cd tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:31.663858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd895e63-d757-4f88-854d-5538fea116cd tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:31.700218 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395c936-b220-4d63-b2aa-7767cd499c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:31.703436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395c936-b220-4d63-b2aa-7767cd499c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:31.703766 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395c936-b220-4d63-b2aa-7767cd499c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:31.707365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395c936-b220-4d63-b2aa-7767cd499c01 admin admin] PATH_INFO: `/v3/users/1b06d31773ee4b9389ee2ea8a12f0f29` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:31.712126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395c936-b220-4d63-b2aa-7767cd499c01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b06d31773ee4b9389ee2ea8a12f0f29)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:31.716835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395c936-b220-4d63-b2aa-7767cd499c01 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:31.719212 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2448/4872] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:33:31 2022] POST /identity/v3/services => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:33:31.731670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd895e63-d757-4f88-854d-5538fea116cd tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:31.796307 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd895e63-d757-4f88-854d-5538fea116cd tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:31.820667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94f313-abe7-40ae-8a36-316fa601e0c6 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6824973065b54fba85daaf2d5338fb7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e89f2043ef354d01826042578d239b6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:31.823852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94f313-abe7-40ae-8a36-316fa601e0c6 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:31.828321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94f313-abe7-40ae-8a36-316fa601e0c6 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:31.829782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94f313-abe7-40ae-8a36-316fa601e0c6 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:31.836310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94f313-abe7-40ae-8a36-316fa601e0c6 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:31.845202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94f313-abe7-40ae-8a36-316fa601e0c6 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:31.871544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8395c936-b220-4d63-b2aa-7767cd499c01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b06d31773ee4b9389ee2ea8a12f0f29'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:31.889581 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2449/4873] 10.222.0.39 () {60 vars in 1213 bytes} [Sun Aug 7 01:33:31 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:31.899180 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94f313-abe7-40ae-8a36-316fa601e0c6 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:31.903341 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8395c936-b220-4d63-b2aa-7767cd499c01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b06d31773ee4b9389ee2ea8a12f0f29'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:31.959199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8395c936-b220-4d63-b2aa-7767cd499c01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b06d31773ee4b9389ee2ea8a12f0f29'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:31.967920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94f313-abe7-40ae-8a36-316fa601e0c6 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:31.968268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8395c936-b220-4d63-b2aa-7767cd499c01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b06d31773ee4b9389ee2ea8a12f0f29'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:32.002195 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb958032-8402-4622-b599-30b2bbb92ed8 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6824973065b54fba85daaf2d5338fb7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e89f2043ef354d01826042578d239b6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:32.009631 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb958032-8402-4622-b599-30b2bbb92ed8 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:32.010149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb958032-8402-4622-b599-30b2bbb92ed8 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:32.010395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8395c936-b220-4d63-b2aa-7767cd499c01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b06d31773ee4b9389ee2ea8a12f0f29'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:32.013982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb958032-8402-4622-b599-30b2bbb92ed8 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:32.019107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb958032-8402-4622-b599-30b2bbb92ed8 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:32.022914 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-bb958032-8402-4622-b599-30b2bbb92ed8 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:33:32.022914 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:33:32.022914 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:33:32.024544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb958032-8402-4622-b599-30b2bbb92ed8 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:32.057716 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2425/4874] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:33:31 2022] DELETE /identity/v3/users/1b06d31773ee4b9389ee2ea8a12f0f29 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:33:32.068772 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2450/4875] 10.222.0.39 () {58 vars in 1191 bytes} [Sun Aug 7 01:33:31 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 766 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:33:32.070836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395c936-b220-4d63-b2aa-7767cd499c01 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:32.073335 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8395c936-b220-4d63-b2aa-7767cd499c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:32.317124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395c936-b220-4d63-b2aa-7767cd499c01 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:32.353117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebca29-dc4c-46a2-a2cf-6fba42a6aa44 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6824973065b54fba85daaf2d5338fb7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e89f2043ef354d01826042578d239b6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:32.357653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebca29-dc4c-46a2-a2cf-6fba42a6aa44 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:32.358149 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebca29-dc4c-46a2-a2cf-6fba42a6aa44 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:32.358632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bebca29-dc4c-46a2-a2cf-6fba42a6aa44 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/1f21e62202bb4f5b9b1522cb2a85fb5c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:32.359554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bebca29-dc4c-46a2-a2cf-6fba42a6aa44 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=1f21e62202bb4f5b9b1522cb2a85fb5c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:32.368139 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-9bebca29-dc4c-46a2-a2cf-6fba42a6aa44 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:33:32.368139 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:33:32.368139 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:33:32.369302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bebca29-dc4c-46a2-a2cf-6fba42a6aa44 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:32.387326 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2426/4876] 10.222.0.39 () {58 vars in 1290 bytes} [Sun Aug 7 01:33:32 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/1f21e62202bb4f5b9b1522cb2a85fb5c => generated 334 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:33:32.397048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb958032-8402-4622-b599-30b2bbb92ed8 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:32.420722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb958032-8402-4622-b599-30b2bbb92ed8 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:32.439117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e137d0-2946-4c25-8c7a-02c090cefb21 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6824973065b54fba85daaf2d5338fb7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e89f2043ef354d01826042578d239b6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:32.440473 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e137d0-2946-4c25-8c7a-02c090cefb21 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:32.441205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e137d0-2946-4c25-8c7a-02c090cefb21 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:32.447461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e137d0-2946-4c25-8c7a-02c090cefb21 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/1f21e62202bb4f5b9b1522cb2a85fb5c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:32.448628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e137d0-2946-4c25-8c7a-02c090cefb21 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=1f21e62202bb4f5b9b1522cb2a85fb5c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:32.450413 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-a8e137d0-2946-4c25-8c7a-02c090cefb21 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:33:32.450413 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:33:32.450413 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:33:32.452054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e137d0-2946-4c25-8c7a-02c090cefb21 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:32.472030 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2451/4877] 10.222.0.39 () {58 vars in 1291 bytes} [Sun Aug 7 01:33:32 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/1f21e62202bb4f5b9b1522cb2a85fb5c => generated 0 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 07 01:33:32.476466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebca29-dc4c-46a2-a2cf-6fba42a6aa44 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:32.506747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bebca29-dc4c-46a2-a2cf-6fba42a6aa44 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:32.534150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50568311-936a-48b6-ae3e-cbfee442a92d tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6824973065b54fba85daaf2d5338fb7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e89f2043ef354d01826042578d239b6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:32.534922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50568311-936a-48b6-ae3e-cbfee442a92d tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:32.535350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50568311-936a-48b6-ae3e-cbfee442a92d tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:32.535830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50568311-936a-48b6-ae3e-cbfee442a92d tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/1f21e62202bb4f5b9b1522cb2a85fb5c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:32.536496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50568311-936a-48b6-ae3e-cbfee442a92d tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=1f21e62202bb4f5b9b1522cb2a85fb5c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:32.537560 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-50568311-936a-48b6-ae3e-cbfee442a92d tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:33:32.537560 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:33:32.537560 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:33:32.538479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50568311-936a-48b6-ae3e-cbfee442a92d tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:32.583383 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2427/4878] 10.222.0.39 () {58 vars in 1293 bytes} [Sun Aug 7 01:33:32 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/1f21e62202bb4f5b9b1522cb2a85fb5c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:33:32.589516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e137d0-2946-4c25-8c7a-02c090cefb21 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:32.617624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e137d0-2946-4c25-8c7a-02c090cefb21 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:32.641240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9834b5-b8a6-45e4-bb3a-7d8f3ef2792e tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6824973065b54fba85daaf2d5338fb7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e89f2043ef354d01826042578d239b6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:32.643093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9834b5-b8a6-45e4-bb3a-7d8f3ef2792e tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:32.643817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9834b5-b8a6-45e4-bb3a-7d8f3ef2792e tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:32.644563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9834b5-b8a6-45e4-bb3a-7d8f3ef2792e tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:32.645980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9834b5-b8a6-45e4-bb3a-7d8f3ef2792e tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:32.655559 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9834b5-b8a6-45e4-bb3a-7d8f3ef2792e tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:32.672392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50568311-936a-48b6-ae3e-cbfee442a92d tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:32.674986 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2452/4879] 10.222.0.39 () {58 vars in 1191 bytes} [Sun Aug 7 01:33:32 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 451 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:33:32.721429 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50568311-936a-48b6-ae3e-cbfee442a92d tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:32.751538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14310d25-1a0d-47a5-ae23-615ad9cc0414 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6824973065b54fba85daaf2d5338fb7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e89f2043ef354d01826042578d239b6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:32.751538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14310d25-1a0d-47a5-ae23-615ad9cc0414 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:32.751538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14310d25-1a0d-47a5-ae23-615ad9cc0414 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:32.751947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14310d25-1a0d-47a5-ae23-615ad9cc0414 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/1f21e62202bb4f5b9b1522cb2a85fb5c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:32.766113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14310d25-1a0d-47a5-ae23-615ad9cc0414 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=1f21e62202bb4f5b9b1522cb2a85fb5c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:32.769603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14310d25-1a0d-47a5-ae23-615ad9cc0414 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:32.839597 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-14310d25-1a0d-47a5-ae23-615ad9cc0414 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Could not find Endpoint Group: 1f21e62202bb4f5b9b1522cb2a85fb5c.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 1f21e62202bb4f5b9b1522cb2a85fb5c. Aug 07 01:33:32.839597 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:33:32.839597 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:33:32.839597 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:33:32.839597 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:33:32.839597 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:33:32.839597 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:33:32.839597 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:33:32.839597 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:33:32.839597 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:33:32.839597 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:33:32.839597 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:33:32.839597 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Aug 07 01:33:32.839597 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Aug 07 01:33:32.842448 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Aug 07 01:33:32.842448 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Aug 07 01:33:32.842448 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Aug 07 01:33:32.842448 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Aug 07 01:33:32.842448 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 1f21e62202bb4f5b9b1522cb2a85fb5c. Aug 07 01:33:32.842448 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:33:32.847357 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2428/4880] 10.222.0.39 () {58 vars in 1293 bytes} [Sun Aug 7 01:33:32 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/1f21e62202bb4f5b9b1522cb2a85fb5c => generated 120 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:33:32.855040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9834b5-b8a6-45e4-bb3a-7d8f3ef2792e tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:32.883172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9834b5-b8a6-45e4-bb3a-7d8f3ef2792e tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:32.886333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14310d25-1a0d-47a5-ae23-615ad9cc0414 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:32.890241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-14310d25-1a0d-47a5-ae23-615ad9cc0414 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:32.898788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7f12e-b6e1-4854-b6ec-66daeabc1a22 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6824973065b54fba85daaf2d5338fb7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e89f2043ef354d01826042578d239b6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:32.900321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7f12e-b6e1-4854-b6ec-66daeabc1a22 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:32.902776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7f12e-b6e1-4854-b6ec-66daeabc1a22 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:32.903326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7f12e-b6e1-4854-b6ec-66daeabc1a22 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] PATH_INFO: `/v3/services/01026232574c4d5fbad5815447cc6f25` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:32.904753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7f12e-b6e1-4854-b6ec-66daeabc1a22 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorizing `identity:delete_service(service_id=01026232574c4d5fbad5815447cc6f25)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:32.926450 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-2ce7f12e-b6e1-4854-b6ec-66daeabc1a22 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:33:32.926450 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:33:32.926450 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:33:32.933189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7f12e-b6e1-4854-b6ec-66daeabc1a22 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:32.993694 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2453/4881] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:33:32 2022] DELETE /identity/v3/services/01026232574c4d5fbad5815447cc6f25 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:33.004672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7f12e-b6e1-4854-b6ec-66daeabc1a22 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:33.043198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7f12e-b6e1-4854-b6ec-66daeabc1a22 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:33.049844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3ba2e-1ac3-4d21-94a5-62579f224550 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6824973065b54fba85daaf2d5338fb7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e89f2043ef354d01826042578d239b6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:33.051072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3ba2e-1ac3-4d21-94a5-62579f224550 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:33.051637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3ba2e-1ac3-4d21-94a5-62579f224550 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:33.052180 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3ba2e-1ac3-4d21-94a5-62579f224550 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:33.053416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3ba2e-1ac3-4d21-94a5-62579f224550 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:33.056049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3ba2e-1ac3-4d21-94a5-62579f224550 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:33.116683 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2454/4882] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:33:33 2022] POST /identity/v3/services => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:33.117982 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:33.120076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3ba2e-1ac3-4d21-94a5-62579f224550 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:33.200050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3ba2e-1ac3-4d21-94a5-62579f224550 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:33.205433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14310d25-1a0d-47a5-ae23-615ad9cc0414 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:33.213765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d02fb7-8b26-4691-8b3c-cd41ec2a5fb6 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6824973065b54fba85daaf2d5338fb7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e89f2043ef354d01826042578d239b6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:33.217921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d02fb7-8b26-4691-8b3c-cd41ec2a5fb6 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:33.218325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d02fb7-8b26-4691-8b3c-cd41ec2a5fb6 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:33.218741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d02fb7-8b26-4691-8b3c-cd41ec2a5fb6 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:33.225796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d02fb7-8b26-4691-8b3c-cd41ec2a5fb6 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:33.228078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d02fb7-8b26-4691-8b3c-cd41ec2a5fb6 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:33.271666 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2455/4883] 10.222.0.39 () {60 vars in 1213 bytes} [Sun Aug 7 01:33:33 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:33.276100 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d02fb7-8b26-4691-8b3c-cd41ec2a5fb6 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:33.291613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72d817-095b-4b9c-80bb-480c9d69c490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:33.292562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72d817-095b-4b9c-80bb-480c9d69c490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:33.299304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72d817-095b-4b9c-80bb-480c9d69c490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:33.299969 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72d817-095b-4b9c-80bb-480c9d69c490 admin admin] PATH_INFO: `/v3/users/ef29bd35cca547c39d76c54058d32979` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:33.308267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72d817-095b-4b9c-80bb-480c9d69c490 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef29bd35cca547c39d76c54058d32979)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:33.348625 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d02fb7-8b26-4691-8b3c-cd41ec2a5fb6 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:33.351116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72d817-095b-4b9c-80bb-480c9d69c490 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:33.361536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621d6b4-446f-4a6f-9d0c-b6bea10536f8 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6824973065b54fba85daaf2d5338fb7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e89f2043ef354d01826042578d239b6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:33.362382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621d6b4-446f-4a6f-9d0c-b6bea10536f8 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:33.362810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621d6b4-446f-4a6f-9d0c-b6bea10536f8 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:33.363281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621d6b4-446f-4a6f-9d0c-b6bea10536f8 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:33.365293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621d6b4-446f-4a6f-9d0c-b6bea10536f8 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:33.367495 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621d6b4-446f-4a6f-9d0c-b6bea10536f8 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:33.454979 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2456/4884] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:33:33 2022] POST /identity/v3/services => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:33:33.458276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621d6b4-446f-4a6f-9d0c-b6bea10536f8 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:33.530495 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:INSERT=10,keystone:SELECT=88,keystone:DELETE=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:33.546950 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621d6b4-446f-4a6f-9d0c-b6bea10536f8 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:33.558592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1e72d817-095b-4b9c-80bb-480c9d69c490 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef29bd35cca547c39d76c54058d32979'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:33.562558 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23213a-4be9-4b19-8e3b-bcc0fd6ef4ee tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6824973065b54fba85daaf2d5338fb7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e89f2043ef354d01826042578d239b6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:33.563755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23213a-4be9-4b19-8e3b-bcc0fd6ef4ee tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:33.566588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23213a-4be9-4b19-8e3b-bcc0fd6ef4ee tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:33.567200 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23213a-4be9-4b19-8e3b-bcc0fd6ef4ee tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/f6107fd9919e460dbee1e24760ef3053` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:33.570482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23213a-4be9-4b19-8e3b-bcc0fd6ef4ee tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=f6107fd9919e460dbee1e24760ef3053)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:33.572171 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-2f23213a-4be9-4b19-8e3b-bcc0fd6ef4ee tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:33:33.572171 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:33:33.572171 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:33:33.574964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23213a-4be9-4b19-8e3b-bcc0fd6ef4ee tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:33.581836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1e72d817-095b-4b9c-80bb-480c9d69c490 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef29bd35cca547c39d76c54058d32979'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:33.603500 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2457/4885] 10.222.0.39 () {60 vars in 1313 bytes} [Sun Aug 7 01:33:33 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/f6107fd9919e460dbee1e24760ef3053 => generated 332 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:33:33.608552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23213a-4be9-4b19-8e3b-bcc0fd6ef4ee tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:33.623587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1e72d817-095b-4b9c-80bb-480c9d69c490 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef29bd35cca547c39d76c54058d32979'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:33.627048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1e72d817-095b-4b9c-80bb-480c9d69c490 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef29bd35cca547c39d76c54058d32979'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:33.632463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23213a-4be9-4b19-8e3b-bcc0fd6ef4ee tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:33.644662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af41e90-293d-4152-9dc8-2ab7e98143c2 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6824973065b54fba85daaf2d5338fb7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e89f2043ef354d01826042578d239b6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:33.647671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1e72d817-095b-4b9c-80bb-480c9d69c490 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef29bd35cca547c39d76c54058d32979'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:33.648455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af41e90-293d-4152-9dc8-2ab7e98143c2 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:33.648821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af41e90-293d-4152-9dc8-2ab7e98143c2 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:33.649172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af41e90-293d-4152-9dc8-2ab7e98143c2 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] PATH_INFO: `/v3/services/c6cb3401de3a45fc9cc033eea19d0ef1` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:33.649888 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af41e90-293d-4152-9dc8-2ab7e98143c2 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorizing `identity:delete_service(service_id=c6cb3401de3a45fc9cc033eea19d0ef1)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:33.652004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af41e90-293d-4152-9dc8-2ab7e98143c2 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:33.666472 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2429/4886] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:33:32 2022] DELETE /identity/v3/users/ef29bd35cca547c39d76c54058d32979 => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:33.745891 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2458/4887] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:33:33 2022] DELETE /identity/v3/services/c6cb3401de3a45fc9cc033eea19d0ef1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:33.751867 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72d817-095b-4b9c-80bb-480c9d69c490 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:33.755437 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1e72d817-095b-4b9c-80bb-480c9d69c490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:33.885183 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72d817-095b-4b9c-80bb-480c9d69c490 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:33.924459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce4e85-1693-4b6f-abaa-a291e5277324 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6824973065b54fba85daaf2d5338fb7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e89f2043ef354d01826042578d239b6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:33.928592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce4e85-1693-4b6f-abaa-a291e5277324 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:33.929195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce4e85-1693-4b6f-abaa-a291e5277324 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:33.929579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce4e85-1693-4b6f-abaa-a291e5277324 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/f6107fd9919e460dbee1e24760ef3053` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:33.930396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce4e85-1693-4b6f-abaa-a291e5277324 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=f6107fd9919e460dbee1e24760ef3053)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:33.933290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce4e85-1693-4b6f-abaa-a291e5277324 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:33.953831 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af41e90-293d-4152-9dc8-2ab7e98143c2 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:33.956118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5af41e90-293d-4152-9dc8-2ab7e98143c2 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:33.957649 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2430/4888] 10.222.0.39 () {58 vars in 1293 bytes} [Sun Aug 7 01:33:33 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/f6107fd9919e460dbee1e24760ef3053 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:33:33.962009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce4e85-1693-4b6f-abaa-a291e5277324 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:33.976774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce4e85-1693-4b6f-abaa-a291e5277324 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:33.983256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e9484-d905-4047-bb95-b4059e082ac0 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6824973065b54fba85daaf2d5338fb7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e89f2043ef354d01826042578d239b6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:33.984290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e9484-d905-4047-bb95-b4059e082ac0 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:33.984831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e9484-d905-4047-bb95-b4059e082ac0 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:33.985305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e9484-d905-4047-bb95-b4059e082ac0 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] PATH_INFO: `/v3/services/38c5d1dbda52408ab749c55123aa5f04` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:33.986132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e9484-d905-4047-bb95-b4059e082ac0 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorizing `identity:delete_service(service_id=38c5d1dbda52408ab749c55123aa5f04)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:33.987441 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-483e9484-d905-4047-bb95-b4059e082ac0 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:33:33.987441 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:33:33.987441 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:33:33.990754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e9484-d905-4047-bb95-b4059e082ac0 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:34.030085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af41e90-293d-4152-9dc8-2ab7e98143c2 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:34.062125 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2431/4889] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:33:33 2022] DELETE /identity/v3/services/38c5d1dbda52408ab749c55123aa5f04 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:34.062125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e9484-d905-4047-bb95-b4059e082ac0 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:34.124793 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:34.157990 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e9484-d905-4047-bb95-b4059e082ac0 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:34.181073 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e5e84-2b10-4c71-9dc1-c10f4ac3e133 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6824973065b54fba85daaf2d5338fb7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e89f2043ef354d01826042578d239b6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:34.183438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e5e84-2b10-4c71-9dc1-c10f4ac3e133 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:34.185423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e5e84-2b10-4c71-9dc1-c10f4ac3e133 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:34.186639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e5e84-2b10-4c71-9dc1-c10f4ac3e133 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/48e7935a4a2d4cc2bebf12befa825797` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:34.189030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e5e84-2b10-4c71-9dc1-c10f4ac3e133 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=48e7935a4a2d4cc2bebf12befa825797)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:34.193473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341e5e84-2b10-4c71-9dc1-c10f4ac3e133 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:34.210411 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2432/4890] 10.222.0.39 () {58 vars in 1293 bytes} [Sun Aug 7 01:33:34 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/48e7935a4a2d4cc2bebf12befa825797 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:34.215238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e5e84-2b10-4c71-9dc1-c10f4ac3e133 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:34.251078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e5e84-2b10-4c71-9dc1-c10f4ac3e133 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:34.267179 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9690e0d-936f-4edc-9c09-66759b504c10 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6824973065b54fba85daaf2d5338fb7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e89f2043ef354d01826042578d239b6a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:34.268140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9690e0d-936f-4edc-9c09-66759b504c10 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:34.268420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9690e0d-936f-4edc-9c09-66759b504c10 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:34.268693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9690e0d-936f-4edc-9c09-66759b504c10 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] PATH_INFO: `/v3/services/2eefb601ccf240d5a36547f5459c773e` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:34.269294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9690e0d-936f-4edc-9c09-66759b504c10 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorizing `identity:delete_service(service_id=2eefb601ccf240d5a36547f5459c773e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:34.271030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9690e0d-936f-4edc-9c09-66759b504c10 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:34.316743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8822d-7b89-4999-b50a-2dbc2e44b13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:34.320008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8822d-7b89-4999-b50a-2dbc2e44b13a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:34.320216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8822d-7b89-4999-b50a-2dbc2e44b13a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:34.320769 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8822d-7b89-4999-b50a-2dbc2e44b13a admin admin] PATH_INFO: `/v3/projects/307db42ddfad40db8c2efe752c185a84` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:34.324972 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8822d-7b89-4999-b50a-2dbc2e44b13a admin admin] RBAC: Authorizing `identity:delete_project(project_id=307db42ddfad40db8c2efe752c185a84)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:34.328337 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2433/4891] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:33:34 2022] DELETE /identity/v3/services/2eefb601ccf240d5a36547f5459c773e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:34.329304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9690e0d-936f-4edc-9c09-66759b504c10 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:34.329747 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8822d-7b89-4999-b50a-2dbc2e44b13a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:34.331542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e9690e0d-936f-4edc-9c09-66759b504c10 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:34.394156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9690e0d-936f-4edc-9c09-66759b504c10 tempest-EndPointGroupsTest-2137849613 tempest-EndPointGroupsTest-2137849613-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:34.426498 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca8a4b-45da-45ba-a7d7-b7c617ca85c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:34.427287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca8a4b-45da-45ba-a7d7-b7c617ca85c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:34.427505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca8a4b-45da-45ba-a7d7-b7c617ca85c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:34.427806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca8a4b-45da-45ba-a7d7-b7c617ca85c0 admin admin] PATH_INFO: `/v3/users/f2ad3613218248c6aeaa3878a5759b21` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:34.429598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca8a4b-45da-45ba-a7d7-b7c617ca85c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2ad3613218248c6aeaa3878a5759b21)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:34.431960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca8a4b-45da-45ba-a7d7-b7c617ca85c0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:34.473354 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dca8822d-7b89-4999-b50a-2dbc2e44b13a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '307db42ddfad40db8c2efe752c185a84', 'request_id': 'req-dca8822d-7b89-4999-b50a-2dbc2e44b13a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:34.483816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dca8822d-7b89-4999-b50a-2dbc2e44b13a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '307db42ddfad40db8c2efe752c185a84', 'request_id': 'req-dca8822d-7b89-4999-b50a-2dbc2e44b13a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:34.502556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dca8822d-7b89-4999-b50a-2dbc2e44b13a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '307db42ddfad40db8c2efe752c185a84', 'request_id': 'req-dca8822d-7b89-4999-b50a-2dbc2e44b13a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:34.537230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dca8822d-7b89-4999-b50a-2dbc2e44b13a admin admin] The token cache is being invalidate because project 307db42ddfad40db8c2efe752c185a84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:33:34.537603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dca8822d-7b89-4999-b50a-2dbc2e44b13a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:34.538382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dca8822d-7b89-4999-b50a-2dbc2e44b13a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:34.545260 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2459/4892] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:33:33 2022] DELETE /identity/v3/projects/307db42ddfad40db8c2efe752c185a84 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:34.545260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8822d-7b89-4999-b50a-2dbc2e44b13a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:34.550991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dca8822d-7b89-4999-b50a-2dbc2e44b13a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:34.597176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4aca8a4b-45da-45ba-a7d7-b7c617ca85c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2ad3613218248c6aeaa3878a5759b21'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:34.618630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4aca8a4b-45da-45ba-a7d7-b7c617ca85c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2ad3613218248c6aeaa3878a5759b21'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:34.656284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4aca8a4b-45da-45ba-a7d7-b7c617ca85c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2ad3613218248c6aeaa3878a5759b21'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:34.657443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4aca8a4b-45da-45ba-a7d7-b7c617ca85c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2ad3613218248c6aeaa3878a5759b21'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:34.668473 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:UPDATE=1,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:34.672625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4aca8a4b-45da-45ba-a7d7-b7c617ca85c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2ad3613218248c6aeaa3878a5759b21'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:34.702450 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2434/4893] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:33:34 2022] DELETE /identity/v3/users/f2ad3613218248c6aeaa3878a5759b21 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:34.710418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8822d-7b89-4999-b50a-2dbc2e44b13a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:34.711625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5591b-382e-4cc2-a112-342baf620c20 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:34.717118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5591b-382e-4cc2-a112-342baf620c20 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:34.717583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5591b-382e-4cc2-a112-342baf620c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:34.774113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-79a5591b-382e-4cc2-a112-342baf620c20 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:34.790259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-79a5591b-382e-4cc2-a112-342baf620c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:34.863618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8ebbe-1224-44ec-a3f7-9d0676e07c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:34.870093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8ebbe-1224-44ec-a3f7-9d0676e07c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:34.870651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8ebbe-1224-44ec-a3f7-9d0676e07c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:34.873366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8ebbe-1224-44ec-a3f7-9d0676e07c37 admin admin] PATH_INFO: `/v3/projects/939fea7fa6ea4deda8d4fbef70a4e510` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:34.876502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8ebbe-1224-44ec-a3f7-9d0676e07c37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=939fea7fa6ea4deda8d4fbef70a4e510)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:34.879285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8ebbe-1224-44ec-a3f7-9d0676e07c37 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:34.917550 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2435/4894] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:34.918907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995a04a-99c0-4601-88cd-9b9bf852975f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:34.919197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995a04a-99c0-4601-88cd-9b9bf852975f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:34.920030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995a04a-99c0-4601-88cd-9b9bf852975f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:34.974530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3995a04a-99c0-4601-88cd-9b9bf852975f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:34.991504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3995a04a-99c0-4601-88cd-9b9bf852975f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:35.024352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-66c8ebbe-1224-44ec-a3f7-9d0676e07c37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '939fea7fa6ea4deda8d4fbef70a4e510', 'request_id': 'req-66c8ebbe-1224-44ec-a3f7-9d0676e07c37'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:35.044906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-66c8ebbe-1224-44ec-a3f7-9d0676e07c37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '939fea7fa6ea4deda8d4fbef70a4e510', 'request_id': 'req-66c8ebbe-1224-44ec-a3f7-9d0676e07c37'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:35.053538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-66c8ebbe-1224-44ec-a3f7-9d0676e07c37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '939fea7fa6ea4deda8d4fbef70a4e510', 'request_id': 'req-66c8ebbe-1224-44ec-a3f7-9d0676e07c37'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:35.058271 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:35.098511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-66c8ebbe-1224-44ec-a3f7-9d0676e07c37 admin admin] The token cache is being invalidate because project 939fea7fa6ea4deda8d4fbef70a4e510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:33:35.098956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-66c8ebbe-1224-44ec-a3f7-9d0676e07c37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:35.099968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-66c8ebbe-1224-44ec-a3f7-9d0676e07c37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:35.105349 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2460/4895] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:33:34 2022] DELETE /identity/v3/projects/939fea7fa6ea4deda8d4fbef70a4e510 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:35.107606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f4a6-22dc-4bb7-8e8b-5bac3fd81771 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:35.108354 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f4a6-22dc-4bb7-8e8b-5bac3fd81771 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:35.108354 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f4a6-22dc-4bb7-8e8b-5bac3fd81771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:35.170412 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2436/4896] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:35.185804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-eb65f4a6-22dc-4bb7-8e8b-5bac3fd81771 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:35.188887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72730a-e116-4060-9f6d-6b83e487e4d7 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:35.189172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72730a-e116-4060-9f6d-6b83e487e4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:35.189347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72730a-e116-4060-9f6d-6b83e487e4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:35.191029 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-eb65f4a6-22dc-4bb7-8e8b-5bac3fd81771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:35.218266 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2461/4897] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:35.218266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65f4a6-22dc-4bb7-8e8b-5bac3fd81771 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:35.222541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-eb65f4a6-22dc-4bb7-8e8b-5bac3fd81771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:35.249400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-4e72730a-e116-4060-9f6d-6b83e487e4d7 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:35.250647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4e72730a-e116-4060-9f6d-6b83e487e4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:35.276047 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2437/4898] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:35.277062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72730a-e116-4060-9f6d-6b83e487e4d7 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:35.299979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72730a-e116-4060-9f6d-6b83e487e4d7 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:35.325275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc824c-b878-42c1-97e8-9da12669c475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:35.327507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc824c-b878-42c1-97e8-9da12669c475 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:35.330404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc824c-b878-42c1-97e8-9da12669c475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:35.330773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc824c-b878-42c1-97e8-9da12669c475 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:35.335272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc824c-b878-42c1-97e8-9da12669c475 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:33:35.335633 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc824c-b878-42c1-97e8-9da12669c475 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:35.338842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc824c-b878-42c1-97e8-9da12669c475 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:35.389028 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2438/4899] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:33:35.393950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1a799-74e7-422b-85d0-a9d35b145ce1 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:35.394236 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1a799-74e7-422b-85d0-a9d35b145ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:35.395830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1a799-74e7-422b-85d0-a9d35b145ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:35.438634 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65f4a6-22dc-4bb7-8e8b-5bac3fd81771 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:35.445898 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-95a1a799-74e7-422b-85d0-a9d35b145ce1 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:35.448557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed346376-a54b-4739-b2a2-2cd807e91999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:35.449181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed346376-a54b-4739-b2a2-2cd807e91999 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:35.449454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed346376-a54b-4739-b2a2-2cd807e91999 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:35.451208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed346376-a54b-4739-b2a2-2cd807e91999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:35.451796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-95a1a799-74e7-422b-85d0-a9d35b145ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:35.472969 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2439/4900] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:35.472969 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1a799-74e7-422b-85d0-a9d35b145ce1 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:35.473601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed346376-a54b-4739-b2a2-2cd807e91999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:35.479045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed346376-a54b-4739-b2a2-2cd807e91999 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:35.495555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1a799-74e7-422b-85d0-a9d35b145ce1 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:35.501077 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2462/4901] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:33:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:33:35.502857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed346376-a54b-4739-b2a2-2cd807e91999 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:35.509917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0aa16-48b3-42e8-a32f-220f998f7160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:35.510545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0aa16-48b3-42e8-a32f-220f998f7160 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:35.510822 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0aa16-48b3-42e8-a32f-220f998f7160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:35.511085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0aa16-48b3-42e8-a32f-220f998f7160 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:35.511723 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0aa16-48b3-42e8-a32f-220f998f7160 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:35.515999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0aa16-48b3-42e8-a32f-220f998f7160 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:35.520943 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:35.528955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed346376-a54b-4739-b2a2-2cd807e91999 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:35.544704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1cb3c8-3120-4e6e-a1be-e0e6729a008a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:35.545472 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cb3c8-3120-4e6e-a1be-e0e6729a008a admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:35.545825 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cb3c8-3120-4e6e-a1be-e0e6729a008a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:35.546096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cb3c8-3120-4e6e-a1be-e0e6729a008a admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:35.546810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1cb3c8-3120-4e6e-a1be-e0e6729a008a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:33:35.547161 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1cb3c8-3120-4e6e-a1be-e0e6729a008a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:35.553550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1cb3c8-3120-4e6e-a1be-e0e6729a008a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:35.575162 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2463/4902] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:33:35.576995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1cb3c8-3120-4e6e-a1be-e0e6729a008a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:35.584205 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2440/4903] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:33:35 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:35.587725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0aa16-48b3-42e8-a32f-220f998f7160 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:35.596016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1cb3c8-3120-4e6e-a1be-e0e6729a008a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:35.737176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb23a8-a4c8-4cf9-9d57-de898f573dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:35.737821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb23a8-a4c8-4cf9-9d57-de898f573dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:35.738099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb23a8-a4c8-4cf9-9d57-de898f573dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:35.738373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb23a8-a4c8-4cf9-9d57-de898f573dc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:35.739014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb23a8-a4c8-4cf9-9d57-de898f573dc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:35.741381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cb23a8-a4c8-4cf9-9d57-de898f573dc3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:35.796630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0aa16-48b3-42e8-a32f-220f998f7160 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:35.803692 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2464/4904] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:33:35 2022] POST /identity/v3/projects => generated 395 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:35.809020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb23a8-a4c8-4cf9-9d57-de898f573dc3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:35.812096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc539a-02a2-4cc7-ba0c-b87ca10d0bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:35.812733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc539a-02a2-4cc7-ba0c-b87ca10d0bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:35.813731 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc539a-02a2-4cc7-ba0c-b87ca10d0bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:35.814015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dc539a-02a2-4cc7-ba0c-b87ca10d0bc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:35.814671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc539a-02a2-4cc7-ba0c-b87ca10d0bc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:35.817038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dc539a-02a2-4cc7-ba0c-b87ca10d0bc7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:35.872893 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2441/4905] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:33:35 2022] POST /identity/v3/users => generated 287 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:35.877700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc539a-02a2-4cc7-ba0c-b87ca10d0bc7 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:35.898185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dc539a-02a2-4cc7-ba0c-b87ca10d0bc7 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:35.974165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb23a8-a4c8-4cf9-9d57-de898f573dc3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:35.989393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0503b-ae03-4fef-a76e-4ebd05d2b445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:35.990299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0503b-ae03-4fef-a76e-4ebd05d2b445 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:35.990827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0503b-ae03-4fef-a76e-4ebd05d2b445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:35.991288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0503b-ae03-4fef-a76e-4ebd05d2b445 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:35.992207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0503b-ae03-4fef-a76e-4ebd05d2b445 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:35.999012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0503b-ae03-4fef-a76e-4ebd05d2b445 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:36.005038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e83e1e-2f0d-400b-8d43-c63120a048cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:36.005807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e83e1e-2f0d-400b-8d43-c63120a048cd admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:36.006233 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e83e1e-2f0d-400b-8d43-c63120a048cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:36.006609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e83e1e-2f0d-400b-8d43-c63120a048cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:36.007483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e83e1e-2f0d-400b-8d43-c63120a048cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:36.009443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e83e1e-2f0d-400b-8d43-c63120a048cd admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:36.036658 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2442/4906] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:36.038615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e83e1e-2f0d-400b-8d43-c63120a048cd admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:36.053901 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2465/4907] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:33:35 2022] POST /identity/v3/users => generated 298 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:36.054313 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e83e1e-2f0d-400b-8d43-c63120a048cd admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:36.054911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0503b-ae03-4fef-a76e-4ebd05d2b445 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:36.065260 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f2ea0-79c6-4f2b-8429-e710a85db879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:36.066083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f2ea0-79c6-4f2b-8429-e710a85db879 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:36.066468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f2ea0-79c6-4f2b-8429-e710a85db879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:36.066840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f2ea0-79c6-4f2b-8429-e710a85db879 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:36.067664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f2ea0-79c6-4f2b-8429-e710a85db879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:36.069531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f2ea0-79c6-4f2b-8429-e710a85db879 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:36.071504 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:36.076555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0503b-ae03-4fef-a76e-4ebd05d2b445 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:36.093731 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2443/4908] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:36.094747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f2ea0-79c6-4f2b-8429-e710a85db879 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:36.095536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120feb2-6617-4340-a86e-4be8e3fd93a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:36.096353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120feb2-6617-4340-a86e-4be8e3fd93a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:36.096682 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120feb2-6617-4340-a86e-4be8e3fd93a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:36.097030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0120feb2-6617-4340-a86e-4be8e3fd93a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:36.097832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120feb2-6617-4340-a86e-4be8e3fd93a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:36.099489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0120feb2-6617-4340-a86e-4be8e3fd93a2 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:36.113504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f2ea0-79c6-4f2b-8429-e710a85db879 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:36.117352 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2466/4909] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:36.118412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120feb2-6617-4340-a86e-4be8e3fd93a2 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:36.127803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc62548-0027-418b-a640-a0a88b84320b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:36.129006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc62548-0027-418b-a640-a0a88b84320b admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:36.130169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc62548-0027-418b-a640-a0a88b84320b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:36.130169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc62548-0027-418b-a640-a0a88b84320b admin admin] PATH_INFO: `/v3/projects/859b28071c284ab292ba507e96df8d3f/users/0a3d46fd03134a16becae95c52ea0b55/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:36.130530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0120feb2-6617-4340-a86e-4be8e3fd93a2 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:36.142816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c0f13-4888-4872-9807-ffdef2d89c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:36.143464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c0f13-4888-4872-9807-ffdef2d89c43 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:36.143744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c0f13-4888-4872-9807-ffdef2d89c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:36.144042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c0f13-4888-4872-9807-ffdef2d89c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:36.144706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c0f13-4888-4872-9807-ffdef2d89c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:36.146344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c0f13-4888-4872-9807-ffdef2d89c43 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:36.175767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc62548-0027-418b-a640-a0a88b84320b admin admin] RBAC: Authorizing `identity:create_grant(project_id=859b28071c284ab292ba507e96df8d3f, user_id=0a3d46fd03134a16becae95c52ea0b55, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:36.178686 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc62548-0027-418b-a640-a0a88b84320b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:36.179652 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2467/4910] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:36.180679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c0f13-4888-4872-9807-ffdef2d89c43 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:36.201427 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2444/4911] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:33:36 2022] PUT /identity/v3/projects/859b28071c284ab292ba507e96df8d3f/users/0a3d46fd03134a16becae95c52ea0b55/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:36.211813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a21eb-2b51-480c-a4e7-7375a583acfb None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:36.212550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a21eb-2b51-480c-a4e7-7375a583acfb None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:36.212820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a21eb-2b51-480c-a4e7-7375a583acfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:36.222354 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c0f13-4888-4872-9807-ffdef2d89c43 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:36.267517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-593a21eb-2b51-480c-a4e7-7375a583acfb None None] MFA Rules not processed for user `0a3d46fd03134a16becae95c52ea0b55`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:36.269286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-593a21eb-2b51-480c-a4e7-7375a583acfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:36.360835 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:36.464622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc91cf-496c-41db-b2df-b24817f0ec6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:36.467043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc91cf-496c-41db-b2df-b24817f0ec6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:36.467173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc91cf-496c-41db-b2df-b24817f0ec6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:36.467448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc91cf-496c-41db-b2df-b24817f0ec6b admin admin] PATH_INFO: `/v3/projects/64c8da97f8334f7da1cd25716cc7da0d/users/6b33e07001cb4a2db36fec14bded07f5/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:36.477648 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2445/4912] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:36.479101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6b3cf-f818-45c3-b7fa-e1dd6c368410 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:36.481598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6b3cf-f818-45c3-b7fa-e1dd6c368410 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:36.482518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6b3cf-f818-45c3-b7fa-e1dd6c368410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:36.504235 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc91cf-496c-41db-b2df-b24817f0ec6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=64c8da97f8334f7da1cd25716cc7da0d, user_id=6b33e07001cb4a2db36fec14bded07f5, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:36.508382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc91cf-496c-41db-b2df-b24817f0ec6b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:36.529154 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2468/4913] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:33:36 2022] PUT /identity/v3/projects/64c8da97f8334f7da1cd25716cc7da0d/users/6b33e07001cb4a2db36fec14bded07f5/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:36.532290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-56d6b3cf-f818-45c3-b7fa-e1dd6c368410 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:36.534339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef667ab-ddb4-4b3b-81f9-75f612ee5b5c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:36.534636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef667ab-ddb4-4b3b-81f9-75f612ee5b5c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:36.534948 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef667ab-ddb4-4b3b-81f9-75f612ee5b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:36.536469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-56d6b3cf-f818-45c3-b7fa-e1dd6c368410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:36.558032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0ef667ab-ddb4-4b3b-81f9-75f612ee5b5c None None] MFA Rules not processed for user `0a3d46fd03134a16becae95c52ea0b55`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:36.559275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0ef667ab-ddb4-4b3b-81f9-75f612ee5b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:36.662250 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2469/4914] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:36.671716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d343351-62a0-42d1-b1eb-03187f8579d1 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:36.672112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d343351-62a0-42d1-b1eb-03187f8579d1 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:36.672403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d343351-62a0-42d1-b1eb-03187f8579d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:36.690886 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2446/4915] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:33:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:36.691781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6b3cf-f818-45c3-b7fa-e1dd6c368410 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:36.696359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-56d6b3cf-f818-45c3-b7fa-e1dd6c368410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:36.718743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9d343351-62a0-42d1-b1eb-03187f8579d1 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:36.720019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9d343351-62a0-42d1-b1eb-03187f8579d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:36.845305 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:36.923450 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6b3cf-f818-45c3-b7fa-e1dd6c368410 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:36.938345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab1042-dfb4-4a29-bf06-823966ae3d8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:36.939005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab1042-dfb4-4a29-bf06-823966ae3d8f service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:36.939372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab1042-dfb4-4a29-bf06-823966ae3d8f service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:36.939503 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2470/4916] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:36.939602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab1042-dfb4-4a29-bf06-823966ae3d8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:36.941944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d343351-62a0-42d1-b1eb-03187f8579d1 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:36.949186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9d343351-62a0-42d1-b1eb-03187f8579d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:36.968885 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab1042-dfb4-4a29-bf06-823966ae3d8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:36.970844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab1042-dfb4-4a29-bf06-823966ae3d8f service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:36.987709 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2447/4917] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:33:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:33:36.988439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab1042-dfb4-4a29-bf06-823966ae3d8f service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:36.995859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-53ab1042-dfb4-4a29-bf06-823966ae3d8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:37.140001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab1042-dfb4-4a29-bf06-823966ae3d8f service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:37.147785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3edd8-a36e-40a5-be3b-680d9804e516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:37.148539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d343351-62a0-42d1-b1eb-03187f8579d1 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:37.151173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3edd8-a36e-40a5-be3b-680d9804e516 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:37.151539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3edd8-a36e-40a5-be3b-680d9804e516 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:37.153078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3edd8-a36e-40a5-be3b-680d9804e516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:37.163405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf68884-667f-4f60-b747-1ff4b79d9392 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:37.165845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf68884-667f-4f60-b747-1ff4b79d9392 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:37.166567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf68884-667f-4f60-b747-1ff4b79d9392 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:37.168184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf68884-667f-4f60-b747-1ff4b79d9392 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:37.181283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3edd8-a36e-40a5-be3b-680d9804e516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:37.193243 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:37.194568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3edd8-a36e-40a5-be3b-680d9804e516 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:37.220454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf68884-667f-4f60-b747-1ff4b79d9392 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:37.222514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf68884-667f-4f60-b747-1ff4b79d9392 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:37.230213 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2448/4918] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:33:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:33:37.236310 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2471/4919] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:33:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:33:38.544928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3edd8-a36e-40a5-be3b-680d9804e516 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:38.545953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a2c3edd8-a36e-40a5-be3b-680d9804e516 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:38.598574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3edd8-a36e-40a5-be3b-680d9804e516 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:38.629294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9faefa9-9285-4a2d-b07d-f6e775480f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:38.632096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9faefa9-9285-4a2d-b07d-f6e775480f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:38.633271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9faefa9-9285-4a2d-b07d-f6e775480f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:38.634949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9faefa9-9285-4a2d-b07d-f6e775480f4f admin admin] PATH_INFO: `/v3/projects/e48faf30a0064cbe8234f9004844d816` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:38.646420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9faefa9-9285-4a2d-b07d-f6e775480f4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e48faf30a0064cbe8234f9004844d816)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:38.649820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9faefa9-9285-4a2d-b07d-f6e775480f4f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:38.862352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c9faefa9-9285-4a2d-b07d-f6e775480f4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e48faf30a0064cbe8234f9004844d816', 'request_id': 'req-c9faefa9-9285-4a2d-b07d-f6e775480f4f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:38.890414 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c9faefa9-9285-4a2d-b07d-f6e775480f4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e48faf30a0064cbe8234f9004844d816', 'request_id': 'req-c9faefa9-9285-4a2d-b07d-f6e775480f4f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:38.930110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c9faefa9-9285-4a2d-b07d-f6e775480f4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e48faf30a0064cbe8234f9004844d816', 'request_id': 'req-c9faefa9-9285-4a2d-b07d-f6e775480f4f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:38.968478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c9faefa9-9285-4a2d-b07d-f6e775480f4f admin admin] The token cache is being invalidate because project e48faf30a0064cbe8234f9004844d816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:33:38.969145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c9faefa9-9285-4a2d-b07d-f6e775480f4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:38.976549 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c9faefa9-9285-4a2d-b07d-f6e775480f4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:38.983551 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2449/4920] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:33:38 2022] DELETE /identity/v3/projects/e48faf30a0064cbe8234f9004844d816 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:38.987473 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf68884-667f-4f60-b747-1ff4b79d9392 service swift] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:39.009373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf68884-667f-4f60-b747-1ff4b79d9392 service swift] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:39.112134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764e729-cfd8-4c9e-8e2d-d5d5cd4d7be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:39.114556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764e729-cfd8-4c9e-8e2d-d5d5cd4d7be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:39.115338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764e729-cfd8-4c9e-8e2d-d5d5cd4d7be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:39.117314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764e729-cfd8-4c9e-8e2d-d5d5cd4d7be9 admin admin] PATH_INFO: `/v3/users/6824973065b54fba85daaf2d5338fb7b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:39.120145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764e729-cfd8-4c9e-8e2d-d5d5cd4d7be9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6824973065b54fba85daaf2d5338fb7b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:39.128558 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764e729-cfd8-4c9e-8e2d-d5d5cd4d7be9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:39.282693 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a764e729-cfd8-4c9e-8e2d-d5d5cd4d7be9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6824973065b54fba85daaf2d5338fb7b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:39.296669 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a764e729-cfd8-4c9e-8e2d-d5d5cd4d7be9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6824973065b54fba85daaf2d5338fb7b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:39.330547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a764e729-cfd8-4c9e-8e2d-d5d5cd4d7be9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6824973065b54fba85daaf2d5338fb7b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:39.331315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a764e729-cfd8-4c9e-8e2d-d5d5cd4d7be9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6824973065b54fba85daaf2d5338fb7b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:39.343420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a764e729-cfd8-4c9e-8e2d-d5d5cd4d7be9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6824973065b54fba85daaf2d5338fb7b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:39.353123 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2472/4921] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:33:38 2022] DELETE /identity/v3/users/6824973065b54fba85daaf2d5338fb7b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:42.328505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9faefa9-9285-4a2d-b07d-f6e775480f4f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:42.332066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c9faefa9-9285-4a2d-b07d-f6e775480f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:42.359061 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9faefa9-9285-4a2d-b07d-f6e775480f4f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:42.533641 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46032456-e688-4bd9-9d75-90d657455853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:42.534309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46032456-e688-4bd9-9d75-90d657455853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:42.534592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46032456-e688-4bd9-9d75-90d657455853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:42.534927 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46032456-e688-4bd9-9d75-90d657455853 admin admin] PATH_INFO: `/v3/projects/e89f2043ef354d01826042578d239b6a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:42.537038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46032456-e688-4bd9-9d75-90d657455853 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e89f2043ef354d01826042578d239b6a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:42.539003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46032456-e688-4bd9-9d75-90d657455853 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:42.545943 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:42.655284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-46032456-e688-4bd9-9d75-90d657455853 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e89f2043ef354d01826042578d239b6a', 'request_id': 'req-46032456-e688-4bd9-9d75-90d657455853'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:42.662934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-46032456-e688-4bd9-9d75-90d657455853 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e89f2043ef354d01826042578d239b6a', 'request_id': 'req-46032456-e688-4bd9-9d75-90d657455853'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:42.675797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-46032456-e688-4bd9-9d75-90d657455853 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e89f2043ef354d01826042578d239b6a', 'request_id': 'req-46032456-e688-4bd9-9d75-90d657455853'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:42.714848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-46032456-e688-4bd9-9d75-90d657455853 admin admin] The token cache is being invalidate because project e89f2043ef354d01826042578d239b6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:33:42.715120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-46032456-e688-4bd9-9d75-90d657455853 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:42.719539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-46032456-e688-4bd9-9d75-90d657455853 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:42.732300 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2450/4922] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:33:42 2022] DELETE /identity/v3/projects/e89f2043ef354d01826042578d239b6a => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:42.737340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c632d4e-d810-428c-9665-ce3d1e262aad None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:42.738221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c632d4e-d810-428c-9665-ce3d1e262aad None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:42.738653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c632d4e-d810-428c-9665-ce3d1e262aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:42.827976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1c632d4e-d810-428c-9665-ce3d1e262aad None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:42.829681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1c632d4e-d810-428c-9665-ce3d1e262aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:43.065217 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2473/4923] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:43.066824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53615c83-91b6-4c57-8bce-64a04e95ea44 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:43.067291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53615c83-91b6-4c57-8bce-64a04e95ea44 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:43.067778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53615c83-91b6-4c57-8bce-64a04e95ea44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:43.126543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-53615c83-91b6-4c57-8bce-64a04e95ea44 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:43.127818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-53615c83-91b6-4c57-8bce-64a04e95ea44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:43.162595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c632d4e-d810-428c-9665-ce3d1e262aad None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:43.170091 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2451/4924] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:43.183685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c632d4e-d810-428c-9665-ce3d1e262aad None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:43.215186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a1759-6779-4d00-9854-724ff1855c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:43.229956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a1759-6779-4d00-9854-724ff1855c8f admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:43.232817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a1759-6779-4d00-9854-724ff1855c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:43.233286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a1759-6779-4d00-9854-724ff1855c8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:43.235567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a1759-6779-4d00-9854-724ff1855c8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:33:43.238502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a1759-6779-4d00-9854-724ff1855c8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:43.255392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a1759-6779-4d00-9854-724ff1855c8f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:43.312311 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:43.319807 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2474/4925] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:33:43.323411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53615c83-91b6-4c57-8bce-64a04e95ea44 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:43.349360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53615c83-91b6-4c57-8bce-64a04e95ea44 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:43.368638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488d58e-e970-4b3c-9e6e-601f96c36930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:43.375331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488d58e-e970-4b3c-9e6e-601f96c36930 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:43.375942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488d58e-e970-4b3c-9e6e-601f96c36930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:43.378103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488d58e-e970-4b3c-9e6e-601f96c36930 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:43.379243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488d58e-e970-4b3c-9e6e-601f96c36930 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:43.384564 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488d58e-e970-4b3c-9e6e-601f96c36930 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:43.509501 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2452/4926] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:33:43 2022] POST /identity/v3/projects => generated 365 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:43.512244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a1759-6779-4d00-9854-724ff1855c8f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:43.529049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a1759-6779-4d00-9854-724ff1855c8f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:43.716667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d9a36-068c-4444-8d51-dccb29367fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:43.717593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d9a36-068c-4444-8d51-dccb29367fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:43.718056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d9a36-068c-4444-8d51-dccb29367fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:43.718500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d9a36-068c-4444-8d51-dccb29367fe7 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:43.719307 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d9a36-068c-4444-8d51-dccb29367fe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:43.721629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d9a36-068c-4444-8d51-dccb29367fe7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:43.782552 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2475/4927] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:33:43 2022] POST /identity/v3/users => generated 283 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:33:43.787286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488d58e-e970-4b3c-9e6e-601f96c36930 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:43.804636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488d58e-e970-4b3c-9e6e-601f96c36930 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:43.821382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45883734-04f0-40a5-ba8a-c37caea9b78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:43.822407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45883734-04f0-40a5-ba8a-c37caea9b78a admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:43.822952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45883734-04f0-40a5-ba8a-c37caea9b78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:43.824337 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45883734-04f0-40a5-ba8a-c37caea9b78a admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:43.827111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45883734-04f0-40a5-ba8a-c37caea9b78a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:43.834471 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45883734-04f0-40a5-ba8a-c37caea9b78a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:43.861949 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2453/4928] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:43.862592 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d9a36-068c-4444-8d51-dccb29367fe7 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:43.888452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d9a36-068c-4444-8d51-dccb29367fe7 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:43.914959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db4038-2401-474f-b1e9-cfa5da454016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:43.915911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db4038-2401-474f-b1e9-cfa5da454016 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:43.916384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db4038-2401-474f-b1e9-cfa5da454016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:43.916834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db4038-2401-474f-b1e9-cfa5da454016 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:43.920969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db4038-2401-474f-b1e9-cfa5da454016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:43.931477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db4038-2401-474f-b1e9-cfa5da454016 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:43.964089 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2476/4929] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:43 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:33:43.968925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45883734-04f0-40a5-ba8a-c37caea9b78a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:43.988410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45883734-04f0-40a5-ba8a-c37caea9b78a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:44.003252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab65fc-4f08-4d66-bc42-c5b20efe121d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:44.003854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab65fc-4f08-4d66-bc42-c5b20efe121d admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:44.004162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab65fc-4f08-4d66-bc42-c5b20efe121d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:44.004442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab65fc-4f08-4d66-bc42-c5b20efe121d admin admin] PATH_INFO: `/v3/projects/b7b25205f2cb48488133f1d7340d2cd2/users/df12ef43527c4d5d9dab4ab12c6c098b/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:44.073494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab65fc-4f08-4d66-bc42-c5b20efe121d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7b25205f2cb48488133f1d7340d2cd2, user_id=df12ef43527c4d5d9dab4ab12c6c098b, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:44.076751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ab65fc-4f08-4d66-bc42-c5b20efe121d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:44.117817 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2454/4930] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:33:43 2022] PUT /identity/v3/projects/b7b25205f2cb48488133f1d7340d2cd2/users/df12ef43527c4d5d9dab4ab12c6c098b/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:44.125920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845562e-9d0a-45cc-b2f9-a36170011f49 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:44.125920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845562e-9d0a-45cc-b2f9-a36170011f49 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:44.125920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845562e-9d0a-45cc-b2f9-a36170011f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:44.212584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-8845562e-9d0a-45cc-b2f9-a36170011f49 None None] MFA Rules not processed for user `df12ef43527c4d5d9dab4ab12c6c098b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:44.213863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8845562e-9d0a-45cc-b2f9-a36170011f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:44.451869 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2477/4931] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:44.457799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab65fc-4f08-4d66-bc42-c5b20efe121d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:44.625422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ab65fc-4f08-4d66-bc42-c5b20efe121d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:44.634596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17253d53-2285-496a-a512-e52ab9ddbde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:44.636760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17253d53-2285-496a-a512-e52ab9ddbde3 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:44.637214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17253d53-2285-496a-a512-e52ab9ddbde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:44.638705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17253d53-2285-496a-a512-e52ab9ddbde3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:44.640049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17253d53-2285-496a-a512-e52ab9ddbde3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:44.645405 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17253d53-2285-496a-a512-e52ab9ddbde3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:44.735384 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2455/4932] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:33:44 2022] POST /identity/v3/projects => generated 365 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:44.739928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845562e-9d0a-45cc-b2f9-a36170011f49 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:44.755816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6e6c4-7f7a-40e7-acb2-b027ea000b24 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:44.756344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6e6c4-7f7a-40e7-acb2-b027ea000b24 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:44.774348 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6e6c4-7f7a-40e7-acb2-b027ea000b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:44.775963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845562e-9d0a-45cc-b2f9-a36170011f49 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:44.846745 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:44.881929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-37c6e6c4-7f7a-40e7-acb2-b027ea000b24 None None] MFA Rules not processed for user `5f0ed400a2cb48cbbc9fa5bae0e2b1c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:44.909082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-37c6e6c4-7f7a-40e7-acb2-b027ea000b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:44.994940 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa8a50-509d-4561-9287-f8a928c71898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:45.003582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa8a50-509d-4561-9287-f8a928c71898 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:45.005436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa8a50-509d-4561-9287-f8a928c71898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:45.005884 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa8a50-509d-4561-9287-f8a928c71898 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:45.006739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa8a50-509d-4561-9287-f8a928c71898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:45.010858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa8a50-509d-4561-9287-f8a928c71898 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:45.057937 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:45.073862 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2478/4933] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:33:44 2022] POST /identity/v3/users => generated 289 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:45.080736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa8a50-509d-4561-9287-f8a928c71898 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:45.147635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa8a50-509d-4561-9287-f8a928c71898 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:45.170109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb85c9-9a2e-4270-9cc4-87987cd2d23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:45.177537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb85c9-9a2e-4270-9cc4-87987cd2d23f admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:45.178000 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb85c9-9a2e-4270-9cc4-87987cd2d23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:45.178441 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb85c9-9a2e-4270-9cc4-87987cd2d23f admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:45.179320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb85c9-9a2e-4270-9cc4-87987cd2d23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:45.181590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb85c9-9a2e-4270-9cc4-87987cd2d23f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:45.218136 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2456/4934] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:45.227015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46309649-3968-4869-97e7-255b79eaaa01 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:45.232037 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46309649-3968-4869-97e7-255b79eaaa01 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:45.234336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46309649-3968-4869-97e7-255b79eaaa01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:45.267248 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2479/4935] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:45.285003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb85c9-9a2e-4270-9cc4-87987cd2d23f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:45.315644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb85c9-9a2e-4270-9cc4-87987cd2d23f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:45.324617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763658a-9422-4ff1-a781-decf96c19b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:45.325990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763658a-9422-4ff1-a781-decf96c19b0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:45.326310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763658a-9422-4ff1-a781-decf96c19b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:45.326586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763658a-9422-4ff1-a781-decf96c19b0c admin admin] PATH_INFO: `/v3/projects/e374ba5a0b4548849df59087227dd5bc/users/3885b69268564c0a92ea581aaaa17a0b/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:45.355254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-46309649-3968-4869-97e7-255b79eaaa01 None None] MFA Rules not processed for user `5f0ed400a2cb48cbbc9fa5bae0e2b1c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:45.368408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-46309649-3968-4869-97e7-255b79eaaa01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:45.414710 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2457/4936] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:45.420225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763658a-9422-4ff1-a781-decf96c19b0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e374ba5a0b4548849df59087227dd5bc, user_id=3885b69268564c0a92ea581aaaa17a0b, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:45.422665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46309649-3968-4869-97e7-255b79eaaa01 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:45.424673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763658a-9422-4ff1-a781-decf96c19b0c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:45.425704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-46309649-3968-4869-97e7-255b79eaaa01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:45.491541 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2480/4937] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:33:45 2022] PUT /identity/v3/projects/e374ba5a0b4548849df59087227dd5bc/users/3885b69268564c0a92ea581aaaa17a0b/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:45.493577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763658a-9422-4ff1-a781-decf96c19b0c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:45.672483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46309649-3968-4869-97e7-255b79eaaa01 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:45.677056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763658a-9422-4ff1-a781-decf96c19b0c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:45.696683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d027c-7d2b-40be-bdf9-7799846c6a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:45.697327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d027c-7d2b-40be-bdf9-7799846c6a5d admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:45.697601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d027c-7d2b-40be-bdf9-7799846c6a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:45.697867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d027c-7d2b-40be-bdf9-7799846c6a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:45.698522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d027c-7d2b-40be-bdf9-7799846c6a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:45.702356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d027c-7d2b-40be-bdf9-7799846c6a5d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:45.729696 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2481/4938] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:33:45.732258 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d027c-7d2b-40be-bdf9-7799846c6a5d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:45.753967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d027c-7d2b-40be-bdf9-7799846c6a5d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:45.779324 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001947b9-61a8-4223-8f20-1edd64ceb849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:45.784854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001947b9-61a8-4223-8f20-1edd64ceb849 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:45.785095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001947b9-61a8-4223-8f20-1edd64ceb849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:45.785378 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001947b9-61a8-4223-8f20-1edd64ceb849 admin admin] PATH_INFO: `/v3/projects/e374ba5a0b4548849df59087227dd5bc/users/3885b69268564c0a92ea581aaaa17a0b/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:45.799290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001947b9-61a8-4223-8f20-1edd64ceb849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e374ba5a0b4548849df59087227dd5bc, user_id=3885b69268564c0a92ea581aaaa17a0b, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:45.802040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001947b9-61a8-4223-8f20-1edd64ceb849 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:45.854023 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2482/4939] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:33:45 2022] PUT /identity/v3/projects/e374ba5a0b4548849df59087227dd5bc/users/3885b69268564c0a92ea581aaaa17a0b/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:45.865340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28790af-0b17-4f2e-82f1-7e05072d2e0e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:45.865621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28790af-0b17-4f2e-82f1-7e05072d2e0e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:45.866077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28790af-0b17-4f2e-82f1-7e05072d2e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:45.925015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdc813-7942-4f29-8174-21c6b0c9e6c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:45.925651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdc813-7942-4f29-8174-21c6b0c9e6c8 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:45.925931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdc813-7942-4f29-8174-21c6b0c9e6c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:45.926202 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdc813-7942-4f29-8174-21c6b0c9e6c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:45.984621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f28790af-0b17-4f2e-82f1-7e05072d2e0e None None] MFA Rules not processed for user `3885b69268564c0a92ea581aaaa17a0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:45.989038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f28790af-0b17-4f2e-82f1-7e05072d2e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:46.036954 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:46.124019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fdc813-7942-4f29-8174-21c6b0c9e6c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:46.129262 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fdc813-7942-4f29-8174-21c6b0c9e6c8 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:46.168871 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2458/4940] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:33:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 746 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:33:46.209582 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2483/4941] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:45 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:46.214301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdc813-7942-4f29-8174-21c6b0c9e6c8 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:46.359680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdc813-7942-4f29-8174-21c6b0c9e6c8 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:46.379357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2445714-cb32-4d24-8521-1c28bb269f21 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3885b69268564c0a92ea581aaaa17a0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e374ba5a0b4548849df59087227dd5bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:46.380963 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2445714-cb32-4d24-8521-1c28bb269f21 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:46.381409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2445714-cb32-4d24-8521-1c28bb269f21 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:46.381865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2445714-cb32-4d24-8521-1c28bb269f21 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:46.382988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2445714-cb32-4d24-8521-1c28bb269f21 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:46.385426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2445714-cb32-4d24-8521-1c28bb269f21 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:46.429062 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2459/4942] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Aug 7 01:33:46 2022] POST /identity/v3/domains => generated 277 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:46.431613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28790af-0b17-4f2e-82f1-7e05072d2e0e None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:46.462555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28790af-0b17-4f2e-82f1-7e05072d2e0e None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:46.582708 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:46.684137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc5c37-87ef-479e-9fe0-91960f48c258 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3885b69268564c0a92ea581aaaa17a0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e374ba5a0b4548849df59087227dd5bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:46.685317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc5c37-87ef-479e-9fe0-91960f48c258 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:46.685602 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc5c37-87ef-479e-9fe0-91960f48c258 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:46.685878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc5c37-87ef-479e-9fe0-91960f48c258 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:46.686535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc5c37-87ef-479e-9fe0-91960f48c258 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:46.698906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc5c37-87ef-479e-9fe0-91960f48c258 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:46.829631 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2484/4943] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:33:46 2022] POST /identity/v3/users => generated 347 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:46.831303 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2445714-cb32-4d24-8521-1c28bb269f21 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:46.849592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2445714-cb32-4d24-8521-1c28bb269f21 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:46.877215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169adf8-3784-461d-bcd2-2212c209fb2f tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3885b69268564c0a92ea581aaaa17a0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e374ba5a0b4548849df59087227dd5bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:46.891565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169adf8-3784-461d-bcd2-2212c209fb2f tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:46.892009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169adf8-3784-461d-bcd2-2212c209fb2f tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:46.892304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169adf8-3784-461d-bcd2-2212c209fb2f tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:46.893257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169adf8-3784-461d-bcd2-2212c209fb2f tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:46.895169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169adf8-3784-461d-bcd2-2212c209fb2f tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:47.003355 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2460/4944] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:33:46 2022] POST /identity/v3/users => generated 323 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:47.006110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc5c37-87ef-479e-9fe0-91960f48c258 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:47.025304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc5c37-87ef-479e-9fe0-91960f48c258 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:47.046128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d1393-0535-42a4-9fa0-d0176f7bfc32 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3885b69268564c0a92ea581aaaa17a0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e374ba5a0b4548849df59087227dd5bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:47.046804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d1393-0535-42a4-9fa0-d0176f7bfc32 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:47.047085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d1393-0535-42a4-9fa0-d0176f7bfc32 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:47.047358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d1393-0535-42a4-9fa0-d0176f7bfc32 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] PATH_INFO: `/v3/users/4a7b7fae4f36408ea2aa153018437f99` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:47.086738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d1393-0535-42a4-9fa0-d0176f7bfc32 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: Authorizing `identity:get_user(user_id=4a7b7fae4f36408ea2aa153018437f99)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:47.088947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d1393-0535-42a4-9fa0-d0176f7bfc32 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:47.092943 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2485/4945] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Aug 7 01:33:47 2022] GET /identity/v3/users/4a7b7fae4f36408ea2aa153018437f99 => generated 347 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:33:47.098968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169adf8-3784-461d-bcd2-2212c209fb2f tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:47.132868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169adf8-3784-461d-bcd2-2212c209fb2f tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:47.165343 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8092f-38fd-4d01-b685-64a862e50323 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3885b69268564c0a92ea581aaaa17a0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e374ba5a0b4548849df59087227dd5bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:47.172062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8092f-38fd-4d01-b685-64a862e50323 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:47.174644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8092f-38fd-4d01-b685-64a862e50323 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:47.175024 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8092f-38fd-4d01-b685-64a862e50323 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:47.184380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8092f-38fd-4d01-b685-64a862e50323 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: Adding query filter params (domain_id=34d15078017b4e02ba016b3c1c394096) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:33:47.187418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8092f-38fd-4d01-b685-64a862e50323 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:47.190587 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-fad8092f-38fd-4d01-b685-64a862e50323 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:33:47.190587 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:33:47.190587 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:33:47.206653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8092f-38fd-4d01-b685-64a862e50323 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:47.306366 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2461/4946] 10.222.0.39 () {58 vars in 1207 bytes} [Sun Aug 7 01:33:47 2022] GET /identity/v3/users?domain_id=34d15078017b4e02ba016b3c1c394096 => generated 484 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:33:47.307916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d1393-0535-42a4-9fa0-d0176f7bfc32 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:47.321263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d1393-0535-42a4-9fa0-d0176f7bfc32 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:47.332126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeccb68-d256-45ff-97cb-077284d8461f tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3885b69268564c0a92ea581aaaa17a0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e374ba5a0b4548849df59087227dd5bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:47.332895 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeccb68-d256-45ff-97cb-077284d8461f tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:47.333630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeccb68-d256-45ff-97cb-077284d8461f tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:47.334456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeccb68-d256-45ff-97cb-077284d8461f tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:47.338589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeccb68-d256-45ff-97cb-077284d8461f tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:47.339555 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-8eeccb68-d256-45ff-97cb-077284d8461f tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:33:47.339555 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:33:47.339555 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:33:47.349616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeccb68-d256-45ff-97cb-077284d8461f tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:47.443062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8092f-38fd-4d01-b685-64a862e50323 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:47.446898 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2486/4947] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:47 2022] GET /identity/v3/users => generated 8890 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:47.487469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8092f-38fd-4d01-b685-64a862e50323 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:47.500755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec5bbd-ac6c-4449-912e-5d02c27180be tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3885b69268564c0a92ea581aaaa17a0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e374ba5a0b4548849df59087227dd5bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:47.501539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec5bbd-ac6c-4449-912e-5d02c27180be tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:47.501921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec5bbd-ac6c-4449-912e-5d02c27180be tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:47.502297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec5bbd-ac6c-4449-912e-5d02c27180be tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:47.503325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec5bbd-ac6c-4449-912e-5d02c27180be tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: Adding query filter params (name=tempest-test_user-1089019275) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:33:47.503726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec5bbd-ac6c-4449-912e-5d02c27180be tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:47.505976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec5bbd-ac6c-4449-912e-5d02c27180be tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:47.607504 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2462/4948] 10.222.0.39 () {58 vars in 1189 bytes} [Sun Aug 7 01:33:47 2022] GET /identity/v3/users?name=tempest-test_user-1089019275 => generated 475 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:33:47.612613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeccb68-d256-45ff-97cb-077284d8461f tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:47.635546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeccb68-d256-45ff-97cb-077284d8461f tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:47.650596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb4da7-3b73-4fa5-8bac-02add32ab820 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3885b69268564c0a92ea581aaaa17a0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e374ba5a0b4548849df59087227dd5bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:47.652270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb4da7-3b73-4fa5-8bac-02add32ab820 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:47.660742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb4da7-3b73-4fa5-8bac-02add32ab820 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:47.661538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb4da7-3b73-4fa5-8bac-02add32ab820 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:47.662567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb4da7-3b73-4fa5-8bac-02add32ab820 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:33:47.663124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb4da7-3b73-4fa5-8bac-02add32ab820 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:47.673862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb4da7-3b73-4fa5-8bac-02add32ab820 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:47.755105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec5bbd-ac6c-4449-912e-5d02c27180be tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:47.762323 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2487/4949] 10.222.0.39 () {58 vars in 1149 bytes} [Sun Aug 7 01:33:47 2022] GET /identity/v3/users?enabled=False => generated 431 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:33:47.768408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec5bbd-ac6c-4449-912e-5d02c27180be tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:47.792702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744d64b-6750-4a5a-b032-6dfd793754c2 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3885b69268564c0a92ea581aaaa17a0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e374ba5a0b4548849df59087227dd5bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:47.793528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744d64b-6750-4a5a-b032-6dfd793754c2 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:47.794499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744d64b-6750-4a5a-b032-6dfd793754c2 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:47.794747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744d64b-6750-4a5a-b032-6dfd793754c2 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] PATH_INFO: `/v3/users/5867766c1dba4a2da0e6986dee2970c9` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:47.822780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e744d64b-6750-4a5a-b032-6dfd793754c2 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5867766c1dba4a2da0e6986dee2970c9)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:47.830667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e744d64b-6750-4a5a-b032-6dfd793754c2 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:47.995670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e744d64b-6750-4a5a-b032-6dfd793754c2 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5867766c1dba4a2da0e6986dee2970c9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:48.014007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e744d64b-6750-4a5a-b032-6dfd793754c2 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5867766c1dba4a2da0e6986dee2970c9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:48.024994 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:48.051706 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e744d64b-6750-4a5a-b032-6dfd793754c2 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5867766c1dba4a2da0e6986dee2970c9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:48.052869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e744d64b-6750-4a5a-b032-6dfd793754c2 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5867766c1dba4a2da0e6986dee2970c9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:48.077010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e744d64b-6750-4a5a-b032-6dfd793754c2 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5867766c1dba4a2da0e6986dee2970c9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:48.088072 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2463/4950] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:33:47 2022] DELETE /identity/v3/users/5867766c1dba4a2da0e6986dee2970c9 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:48.092589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb4da7-3b73-4fa5-8bac-02add32ab820 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:48.094463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9fbb4da7-3b73-4fa5-8bac-02add32ab820 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:48.134668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb4da7-3b73-4fa5-8bac-02add32ab820 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:48.320823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb46bc-b671-4c72-a2e1-7aefe9b3662a tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3885b69268564c0a92ea581aaaa17a0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e374ba5a0b4548849df59087227dd5bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:48.323269 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb46bc-b671-4c72-a2e1-7aefe9b3662a tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:48.323755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb46bc-b671-4c72-a2e1-7aefe9b3662a tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:48.325338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb46bc-b671-4c72-a2e1-7aefe9b3662a tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] PATH_INFO: `/v3/users/4a7b7fae4f36408ea2aa153018437f99` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:48.327966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb46bc-b671-4c72-a2e1-7aefe9b3662a tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4a7b7fae4f36408ea2aa153018437f99)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:48.334504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb46bc-b671-4c72-a2e1-7aefe9b3662a tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:48.505015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-87cb46bc-b671-4c72-a2e1-7aefe9b3662a tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a7b7fae4f36408ea2aa153018437f99'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:48.558532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-87cb46bc-b671-4c72-a2e1-7aefe9b3662a tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a7b7fae4f36408ea2aa153018437f99'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:48.592968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-87cb46bc-b671-4c72-a2e1-7aefe9b3662a tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a7b7fae4f36408ea2aa153018437f99'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:48.593804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-87cb46bc-b671-4c72-a2e1-7aefe9b3662a tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a7b7fae4f36408ea2aa153018437f99'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:48.596866 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:48.607207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-87cb46bc-b671-4c72-a2e1-7aefe9b3662a tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a7b7fae4f36408ea2aa153018437f99'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:48.623154 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2488/4951] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:33:48 2022] DELETE /identity/v3/users/4a7b7fae4f36408ea2aa153018437f99 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:48.627118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744d64b-6750-4a5a-b032-6dfd793754c2 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:48.648365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744d64b-6750-4a5a-b032-6dfd793754c2 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:48.933692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db815f-48df-452e-8f6b-f8a6e5e4dc4f tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3885b69268564c0a92ea581aaaa17a0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e374ba5a0b4548849df59087227dd5bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:48.935130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db815f-48df-452e-8f6b-f8a6e5e4dc4f tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:48.938556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db815f-48df-452e-8f6b-f8a6e5e4dc4f tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:48.940046 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db815f-48df-452e-8f6b-f8a6e5e4dc4f tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] PATH_INFO: `/v3/domains/34d15078017b4e02ba016b3c1c394096` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:48.948293 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db815f-48df-452e-8f6b-f8a6e5e4dc4f tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=34d15078017b4e02ba016b3c1c394096)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:48.953558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db815f-48df-452e-8f6b-f8a6e5e4dc4f tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:49.045676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-84db815f-48df-452e-8f6b-f8a6e5e4dc4f tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '34d15078017b4e02ba016b3c1c394096'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:49.046613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-84db815f-48df-452e-8f6b-f8a6e5e4dc4f tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '34d15078017b4e02ba016b3c1c394096'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:49.140593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-84db815f-48df-452e-8f6b-f8a6e5e4dc4f tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '34d15078017b4e02ba016b3c1c394096'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:49.143909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-84db815f-48df-452e-8f6b-f8a6e5e4dc4f tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '34d15078017b4e02ba016b3c1c394096'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:49.152772 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2464/4952] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:33:48 2022] PATCH /identity/v3/domains/34d15078017b4e02ba016b3c1c394096 => generated 278 bytes in 523 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:33:49.154569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb46bc-b671-4c72-a2e1-7aefe9b3662a tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:49.156225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-87cb46bc-b671-4c72-a2e1-7aefe9b3662a tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:49.192208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb46bc-b671-4c72-a2e1-7aefe9b3662a tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:49.335751 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d08f90-8161-422d-bb82-7978f783cdf3 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3885b69268564c0a92ea581aaaa17a0b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e374ba5a0b4548849df59087227dd5bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:49.337382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d08f90-8161-422d-bb82-7978f783cdf3 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:49.337668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d08f90-8161-422d-bb82-7978f783cdf3 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:49.337949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d08f90-8161-422d-bb82-7978f783cdf3 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] PATH_INFO: `/v3/domains/34d15078017b4e02ba016b3c1c394096` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:49.383482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d08f90-8161-422d-bb82-7978f783cdf3 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=34d15078017b4e02ba016b3c1c394096)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:49.384982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d08f90-8161-422d-bb82-7978f783cdf3 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:49.506648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-40d08f90-8161-422d-bb82-7978f783cdf3 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '34d15078017b4e02ba016b3c1c394096'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:49.537339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-40d08f90-8161-422d-bb82-7978f783cdf3 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '34d15078017b4e02ba016b3c1c394096'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:49.637023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-40d08f90-8161-422d-bb82-7978f783cdf3 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34d15078017b4e02ba016b3c1c394096', 'request_id': 'req-40d08f90-8161-422d-bb82-7978f783cdf3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:49.646038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-40d08f90-8161-422d-bb82-7978f783cdf3 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34d15078017b4e02ba016b3c1c394096', 'request_id': 'req-40d08f90-8161-422d-bb82-7978f783cdf3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:49.673963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-40d08f90-8161-422d-bb82-7978f783cdf3 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34d15078017b4e02ba016b3c1c394096', 'request_id': 'req-40d08f90-8161-422d-bb82-7978f783cdf3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:49.730718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-40d08f90-8161-422d-bb82-7978f783cdf3 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] The token cache is being invalidate because project 34d15078017b4e02ba016b3c1c394096 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:33:49.739665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-40d08f90-8161-422d-bb82-7978f783cdf3 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:49.741305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-40d08f90-8161-422d-bb82-7978f783cdf3 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:49.795352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-40d08f90-8161-422d-bb82-7978f783cdf3 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '34d15078017b4e02ba016b3c1c394096', 'request_id': 'req-40d08f90-8161-422d-bb82-7978f783cdf3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:49.803569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-40d08f90-8161-422d-bb82-7978f783cdf3 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '34d15078017b4e02ba016b3c1c394096', 'request_id': 'req-40d08f90-8161-422d-bb82-7978f783cdf3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:49.805431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-40d08f90-8161-422d-bb82-7978f783cdf3 tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '34d15078017b4e02ba016b3c1c394096', 'request_id': 'req-40d08f90-8161-422d-bb82-7978f783cdf3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:49.830810 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2489/4953] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:33:49 2022] DELETE /identity/v3/domains/34d15078017b4e02ba016b3c1c394096 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:49.834702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db815f-48df-452e-8f6b-f8a6e5e4dc4f tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:49.836949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-84db815f-48df-452e-8f6b-f8a6e5e4dc4f tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:50.154811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db815f-48df-452e-8f6b-f8a6e5e4dc4f tempest-UsersV3TestJSON-506058456 tempest-UsersV3TestJSON-506058456-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:50.407371 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:50.441818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13f3cc-5955-4938-a095-55166bac9c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:50.442619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13f3cc-5955-4938-a095-55166bac9c2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:50.443486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13f3cc-5955-4938-a095-55166bac9c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:50.443486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13f3cc-5955-4938-a095-55166bac9c2f admin admin] PATH_INFO: `/v3/users/df12ef43527c4d5d9dab4ab12c6c098b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:50.444940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13f3cc-5955-4938-a095-55166bac9c2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=df12ef43527c4d5d9dab4ab12c6c098b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:50.449458 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13f3cc-5955-4938-a095-55166bac9c2f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:50.654165 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dd13f3cc-5955-4938-a095-55166bac9c2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df12ef43527c4d5d9dab4ab12c6c098b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:50.688337 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dd13f3cc-5955-4938-a095-55166bac9c2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df12ef43527c4d5d9dab4ab12c6c098b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:50.730610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dd13f3cc-5955-4938-a095-55166bac9c2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df12ef43527c4d5d9dab4ab12c6c098b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:50.734420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dd13f3cc-5955-4938-a095-55166bac9c2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df12ef43527c4d5d9dab4ab12c6c098b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:50.760121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dd13f3cc-5955-4938-a095-55166bac9c2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df12ef43527c4d5d9dab4ab12c6c098b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:50.778414 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2465/4954] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:33:49 2022] DELETE /identity/v3/users/df12ef43527c4d5d9dab4ab12c6c098b => generated 0 bytes in 944 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:50.782727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8a275-5a02-4fa0-a7d8-05b1b5fbd1ec None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:50.783412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8a275-5a02-4fa0-a7d8-05b1b5fbd1ec None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:50.783412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8a275-5a02-4fa0-a7d8-05b1b5fbd1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:50.860139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1cf8a275-5a02-4fa0-a7d8-05b1b5fbd1ec None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:50.866189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1cf8a275-5a02-4fa0-a7d8-05b1b5fbd1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:51.003021 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:51.190959 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2490/4955] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:51.199559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13f3cc-5955-4938-a095-55166bac9c2f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:51.201196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-dd13f3cc-5955-4938-a095-55166bac9c2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:51.405006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13f3cc-5955-4938-a095-55166bac9c2f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:51.416666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ebaf69-ce0d-4176-aaf9-6b72a3b2e16d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:51.417509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebaf69-ce0d-4176-aaf9-6b72a3b2e16d service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:51.417796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebaf69-ce0d-4176-aaf9-6b72a3b2e16d service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:51.418190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebaf69-ce0d-4176-aaf9-6b72a3b2e16d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:51.443724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ebaf69-ce0d-4176-aaf9-6b72a3b2e16d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:51.445363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ebaf69-ce0d-4176-aaf9-6b72a3b2e16d service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:51.458485 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2466/4956] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:33:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:33:52.755562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8a275-5a02-4fa0-a7d8-05b1b5fbd1ec None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:52.757058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1cf8a275-5a02-4fa0-a7d8-05b1b5fbd1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:52.783916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8a275-5a02-4fa0-a7d8-05b1b5fbd1ec None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:52.815058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcce5d-65bd-4d51-b31c-548eb5c601b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:52.816447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcce5d-65bd-4d51-b31c-548eb5c601b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:52.817963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcce5d-65bd-4d51-b31c-548eb5c601b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:52.820449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bcce5d-65bd-4d51-b31c-548eb5c601b1 admin admin] PATH_INFO: `/v3/projects/b7b25205f2cb48488133f1d7340d2cd2` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:52.823477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bcce5d-65bd-4d51-b31c-548eb5c601b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7b25205f2cb48488133f1d7340d2cd2)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:52.828004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bcce5d-65bd-4d51-b31c-548eb5c601b1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:52.957065 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-41bcce5d-65bd-4d51-b31c-548eb5c601b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7b25205f2cb48488133f1d7340d2cd2', 'request_id': 'req-41bcce5d-65bd-4d51-b31c-548eb5c601b1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:52.988641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-41bcce5d-65bd-4d51-b31c-548eb5c601b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7b25205f2cb48488133f1d7340d2cd2', 'request_id': 'req-41bcce5d-65bd-4d51-b31c-548eb5c601b1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:52.998799 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-41bcce5d-65bd-4d51-b31c-548eb5c601b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7b25205f2cb48488133f1d7340d2cd2', 'request_id': 'req-41bcce5d-65bd-4d51-b31c-548eb5c601b1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:53.031857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-41bcce5d-65bd-4d51-b31c-548eb5c601b1 admin admin] The token cache is being invalidate because project b7b25205f2cb48488133f1d7340d2cd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:33:53.032383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-41bcce5d-65bd-4d51-b31c-548eb5c601b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:53.034796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-41bcce5d-65bd-4d51-b31c-548eb5c601b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:53.039412 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2491/4957] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:33:52 2022] DELETE /identity/v3/projects/b7b25205f2cb48488133f1d7340d2cd2 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:53.043092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ebaf69-ce0d-4176-aaf9-6b72a3b2e16d service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:53.057826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ebaf69-ce0d-4176-aaf9-6b72a3b2e16d service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:53.459595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f4286-5dd3-47d6-8da1-a20ade1e35d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:53.467588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f4286-5dd3-47d6-8da1-a20ade1e35d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:53.468028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f4286-5dd3-47d6-8da1-a20ade1e35d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:53.468346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f4286-5dd3-47d6-8da1-a20ade1e35d8 admin admin] PATH_INFO: `/v3/users/3885b69268564c0a92ea581aaaa17a0b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:53.472935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f4286-5dd3-47d6-8da1-a20ade1e35d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3885b69268564c0a92ea581aaaa17a0b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:53.476549 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f4286-5dd3-47d6-8da1-a20ade1e35d8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:53.528588 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:53.738924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-387f4286-5dd3-47d6-8da1-a20ade1e35d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3885b69268564c0a92ea581aaaa17a0b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:53.752810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-387f4286-5dd3-47d6-8da1-a20ade1e35d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3885b69268564c0a92ea581aaaa17a0b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:53.800606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-387f4286-5dd3-47d6-8da1-a20ade1e35d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3885b69268564c0a92ea581aaaa17a0b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:53.806901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-387f4286-5dd3-47d6-8da1-a20ade1e35d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3885b69268564c0a92ea581aaaa17a0b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:53.834136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-387f4286-5dd3-47d6-8da1-a20ade1e35d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3885b69268564c0a92ea581aaaa17a0b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:53.868978 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2467/4958] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:33:53 2022] DELETE /identity/v3/users/3885b69268564c0a92ea581aaaa17a0b => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:54.532817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcce5d-65bd-4d51-b31c-548eb5c601b1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:54.535327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-41bcce5d-65bd-4d51-b31c-548eb5c601b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:54.561129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bcce5d-65bd-4d51-b31c-548eb5c601b1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:54.823299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae2f52-bc1d-43f3-adfa-6d785878d085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:54.824131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae2f52-bc1d-43f3-adfa-6d785878d085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:54.824272 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae2f52-bc1d-43f3-adfa-6d785878d085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:54.824610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae2f52-bc1d-43f3-adfa-6d785878d085 admin admin] PATH_INFO: `/v3/projects/e374ba5a0b4548849df59087227dd5bc` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:54.831311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae2f52-bc1d-43f3-adfa-6d785878d085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e374ba5a0b4548849df59087227dd5bc)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:54.841256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae2f52-bc1d-43f3-adfa-6d785878d085 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:55.013369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-02ae2f52-bc1d-43f3-adfa-6d785878d085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e374ba5a0b4548849df59087227dd5bc', 'request_id': 'req-02ae2f52-bc1d-43f3-adfa-6d785878d085'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:55.024144 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:55.027008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-02ae2f52-bc1d-43f3-adfa-6d785878d085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e374ba5a0b4548849df59087227dd5bc', 'request_id': 'req-02ae2f52-bc1d-43f3-adfa-6d785878d085'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:55.039278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-02ae2f52-bc1d-43f3-adfa-6d785878d085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e374ba5a0b4548849df59087227dd5bc', 'request_id': 'req-02ae2f52-bc1d-43f3-adfa-6d785878d085'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:55.065263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-02ae2f52-bc1d-43f3-adfa-6d785878d085 admin admin] The token cache is being invalidate because project e374ba5a0b4548849df59087227dd5bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:33:55.065945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-02ae2f52-bc1d-43f3-adfa-6d785878d085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:55.068019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-02ae2f52-bc1d-43f3-adfa-6d785878d085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:55.072552 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2492/4959] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:33:54 2022] DELETE /identity/v3/projects/e374ba5a0b4548849df59087227dd5bc => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:55.077576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59c6d4-121e-4096-8430-a0ff5a60aa56 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:55.078436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59c6d4-121e-4096-8430-a0ff5a60aa56 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:55.078880 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59c6d4-121e-4096-8430-a0ff5a60aa56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:55.121575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6c59c6d4-121e-4096-8430-a0ff5a60aa56 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:55.125001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6c59c6d4-121e-4096-8430-a0ff5a60aa56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:55.307681 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2468/4960] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:55.315344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23ebe9-cacc-4055-824a-46424a0332f0 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:55.315690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23ebe9-cacc-4055-824a-46424a0332f0 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:55.316013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23ebe9-cacc-4055-824a-46424a0332f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:55.361063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1b23ebe9-cacc-4055-824a-46424a0332f0 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:55.365686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1b23ebe9-cacc-4055-824a-46424a0332f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:55.386337 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2493/4961] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:55.391198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59c6d4-121e-4096-8430-a0ff5a60aa56 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:55.409283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59c6d4-121e-4096-8430-a0ff5a60aa56 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:55.433467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b37407-2d44-4dec-a8be-1cf796fc901e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:55.433467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b37407-2d44-4dec-a8be-1cf796fc901e admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:55.433467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b37407-2d44-4dec-a8be-1cf796fc901e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:55.433467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b37407-2d44-4dec-a8be-1cf796fc901e admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:55.434558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b37407-2d44-4dec-a8be-1cf796fc901e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:33:55.434558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b37407-2d44-4dec-a8be-1cf796fc901e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:55.434748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23ebe9-cacc-4055-824a-46424a0332f0 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:55.434857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b37407-2d44-4dec-a8be-1cf796fc901e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:55.437412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1b23ebe9-cacc-4055-824a-46424a0332f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:55.467772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23ebe9-cacc-4055-824a-46424a0332f0 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:55.473321 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2469/4962] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:33:55.477029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b37407-2d44-4dec-a8be-1cf796fc901e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:55.493940 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7181a-9b00-4356-bc69-40249074431d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:55.494596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7181a-9b00-4356-bc69-40249074431d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:55.494872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7181a-9b00-4356-bc69-40249074431d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:55.495141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7181a-9b00-4356-bc69-40249074431d admin admin] PATH_INFO: `/v3/users/106559a2b8754c54b1c41ba8cadd1a97` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:55.504310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7181a-9b00-4356-bc69-40249074431d admin admin] RBAC: Authorizing `identity:delete_user(user_id=106559a2b8754c54b1c41ba8cadd1a97)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:55.506318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7181a-9b00-4356-bc69-40249074431d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:55.516105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b37407-2d44-4dec-a8be-1cf796fc901e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:55.527610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9695ef-f70b-42b1-bc9d-3bb3b3178161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:55.528656 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9695ef-f70b-42b1-bc9d-3bb3b3178161 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:55.529164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9695ef-f70b-42b1-bc9d-3bb3b3178161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:55.529657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9695ef-f70b-42b1-bc9d-3bb3b3178161 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:55.530520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9695ef-f70b-42b1-bc9d-3bb3b3178161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:55.532736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9695ef-f70b-42b1-bc9d-3bb3b3178161 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:55.624395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bef7181a-9b00-4356-bc69-40249074431d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '106559a2b8754c54b1c41ba8cadd1a97'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:55.642023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bef7181a-9b00-4356-bc69-40249074431d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '106559a2b8754c54b1c41ba8cadd1a97'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:55.643919 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2470/4963] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:33:55 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:55.647609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9695ef-f70b-42b1-bc9d-3bb3b3178161 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:55.682746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bef7181a-9b00-4356-bc69-40249074431d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '106559a2b8754c54b1c41ba8cadd1a97'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:55.684369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bef7181a-9b00-4356-bc69-40249074431d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '106559a2b8754c54b1c41ba8cadd1a97'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:55.706300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bef7181a-9b00-4356-bc69-40249074431d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '106559a2b8754c54b1c41ba8cadd1a97'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:55.723916 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2494/4964] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:33:55 2022] DELETE /identity/v3/users/106559a2b8754c54b1c41ba8cadd1a97 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:55.882920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9695ef-f70b-42b1-bc9d-3bb3b3178161 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:55.911589 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:56.220959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7181a-9b00-4356-bc69-40249074431d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:56.231310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f17d7d-898e-44eb-b204-8bd973e1f9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:56.237544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-bef7181a-9b00-4356-bc69-40249074431d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:56.238993 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f17d7d-898e-44eb-b204-8bd973e1f9a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:56.240206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f17d7d-898e-44eb-b204-8bd973e1f9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:56.240600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f17d7d-898e-44eb-b204-8bd973e1f9a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:56.242000 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f17d7d-898e-44eb-b204-8bd973e1f9a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:56.246202 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f17d7d-898e-44eb-b204-8bd973e1f9a2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:56.299566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7181a-9b00-4356-bc69-40249074431d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:56.315539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0c0db-df5f-48cc-b15c-15ca1582c5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:56.317398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0c0db-df5f-48cc-b15c-15ca1582c5e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:56.318322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0c0db-df5f-48cc-b15c-15ca1582c5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:56.319526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0c0db-df5f-48cc-b15c-15ca1582c5e0 admin admin] PATH_INFO: `/v3/projects/f5f3e59419be4d2b892f498e527cb2e8` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:56.325552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0c0db-df5f-48cc-b15c-15ca1582c5e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5f3e59419be4d2b892f498e527cb2e8)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:56.331721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0c0db-df5f-48cc-b15c-15ca1582c5e0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:56.348076 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2471/4965] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:33:55 2022] POST /identity/v3/users => generated 293 bytes in 699 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:56.350173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f17d7d-898e-44eb-b204-8bd973e1f9a2 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:56.354642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-93f17d7d-898e-44eb-b204-8bd973e1f9a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:56.448173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f17d7d-898e-44eb-b204-8bd973e1f9a2 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:56.477555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-57c0c0db-df5f-48cc-b15c-15ca1582c5e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5f3e59419be4d2b892f498e527cb2e8', 'request_id': 'req-57c0c0db-df5f-48cc-b15c-15ca1582c5e0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:56.497290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-57c0c0db-df5f-48cc-b15c-15ca1582c5e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5f3e59419be4d2b892f498e527cb2e8', 'request_id': 'req-57c0c0db-df5f-48cc-b15c-15ca1582c5e0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:56.511496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-57c0c0db-df5f-48cc-b15c-15ca1582c5e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5f3e59419be4d2b892f498e527cb2e8', 'request_id': 'req-57c0c0db-df5f-48cc-b15c-15ca1582c5e0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:56.552076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-57c0c0db-df5f-48cc-b15c-15ca1582c5e0 admin admin] The token cache is being invalidate because project f5f3e59419be4d2b892f498e527cb2e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:33:56.552295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-57c0c0db-df5f-48cc-b15c-15ca1582c5e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:56.555807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-57c0c0db-df5f-48cc-b15c-15ca1582c5e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:56.564782 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2495/4966] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:33:56 2022] DELETE /identity/v3/projects/f5f3e59419be4d2b892f498e527cb2e8 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:56.566525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0c0db-df5f-48cc-b15c-15ca1582c5e0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:56.573863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-57c0c0db-df5f-48cc-b15c-15ca1582c5e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:56.627078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f1ada-21a8-428f-b0a5-453500f3bb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:56.628260 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f1ada-21a8-428f-b0a5-453500f3bb47 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:56.628773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f1ada-21a8-428f-b0a5-453500f3bb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:56.629276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f1ada-21a8-428f-b0a5-453500f3bb47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:56.630143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f1ada-21a8-428f-b0a5-453500f3bb47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:56.632000 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f1ada-21a8-428f-b0a5-453500f3bb47 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:56.655684 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2472/4967] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:56.657407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f1ada-21a8-428f-b0a5-453500f3bb47 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:56.660310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-860f1ada-21a8-428f-b0a5-453500f3bb47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:56.692371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f1ada-21a8-428f-b0a5-453500f3bb47 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:56.706264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94408604-3351-4721-9b87-4dbc073c0b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:56.706903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94408604-3351-4721-9b87-4dbc073c0b7d admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:56.707218 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94408604-3351-4721-9b87-4dbc073c0b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:56.708230 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=79,keystone:INSERT=3,keystone:DELETE=18 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:56.708972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94408604-3351-4721-9b87-4dbc073c0b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:56.710252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94408604-3351-4721-9b87-4dbc073c0b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:56.712156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94408604-3351-4721-9b87-4dbc073c0b7d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:56.734479 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2473/4968] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:56.738065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94408604-3351-4721-9b87-4dbc073c0b7d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:56.756299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94408604-3351-4721-9b87-4dbc073c0b7d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:56.775118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445a7dc-f1b1-433f-9701-55c905dfbeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:56.775998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445a7dc-f1b1-433f-9701-55c905dfbeec admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:56.778256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445a7dc-f1b1-433f-9701-55c905dfbeec admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:56.778633 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445a7dc-f1b1-433f-9701-55c905dfbeec admin admin] PATH_INFO: `/v3/projects/6ed33bc461694997ba92b9c0872146c2/users/1658259e93cf4726888f7bb67487b371/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:56.781365 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0c0db-df5f-48cc-b15c-15ca1582c5e0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:56.798392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a8552-4446-44c5-a9b6-698cd26fa7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:56.799058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a8552-4446-44c5-a9b6-698cd26fa7b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:56.799341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a8552-4446-44c5-a9b6-698cd26fa7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:56.799618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a8552-4446-44c5-a9b6-698cd26fa7b3 admin admin] PATH_INFO: `/v3/users/8acd01b11fea4952b8832c62b874cac6` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:56.801489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a8552-4446-44c5-a9b6-698cd26fa7b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8acd01b11fea4952b8832c62b874cac6)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:56.803568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a8552-4446-44c5-a9b6-698cd26fa7b3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:56.803713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445a7dc-f1b1-433f-9701-55c905dfbeec admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed33bc461694997ba92b9c0872146c2, user_id=1658259e93cf4726888f7bb67487b371, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:56.806931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445a7dc-f1b1-433f-9701-55c905dfbeec admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:56.842964 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2474/4969] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:33:56 2022] PUT /identity/v3/projects/6ed33bc461694997ba92b9c0872146c2/users/1658259e93cf4726888f7bb67487b371/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:56.857684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26e0f6-bd8e-4f91-8715-2fbe7eb2cc78 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:56.858021 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26e0f6-bd8e-4f91-8715-2fbe7eb2cc78 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:56.861045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26e0f6-bd8e-4f91-8715-2fbe7eb2cc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:56.924953 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d57a8552-4446-44c5-a9b6-698cd26fa7b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8acd01b11fea4952b8832c62b874cac6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:56.939593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d57a8552-4446-44c5-a9b6-698cd26fa7b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8acd01b11fea4952b8832c62b874cac6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:56.969841 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d57a8552-4446-44c5-a9b6-698cd26fa7b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8acd01b11fea4952b8832c62b874cac6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:56.970779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d57a8552-4446-44c5-a9b6-698cd26fa7b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8acd01b11fea4952b8832c62b874cac6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:56.990900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d57a8552-4446-44c5-a9b6-698cd26fa7b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8acd01b11fea4952b8832c62b874cac6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:57.002798 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2496/4970] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:33:56 2022] DELETE /identity/v3/users/8acd01b11fea4952b8832c62b874cac6 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:57.017725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7f26e0f6-bd8e-4f91-8715-2fbe7eb2cc78 None None] MFA Rules not processed for user `1658259e93cf4726888f7bb67487b371`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:57.026564 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7f26e0f6-bd8e-4f91-8715-2fbe7eb2cc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:57.120141 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:57.286810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a8552-4446-44c5-a9b6-698cd26fa7b3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:57.288257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d57a8552-4446-44c5-a9b6-698cd26fa7b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:57.294190 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2475/4971] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:57.298346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26e0f6-bd8e-4f91-8715-2fbe7eb2cc78 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:57.300328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7f26e0f6-bd8e-4f91-8715-2fbe7eb2cc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:57.461849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26e0f6-bd8e-4f91-8715-2fbe7eb2cc78 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:57.477923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86054a-44e8-4c0d-9216-1dbb8415241e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:57.478650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86054a-44e8-4c0d-9216-1dbb8415241e admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:57.479006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86054a-44e8-4c0d-9216-1dbb8415241e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:57.479354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86054a-44e8-4c0d-9216-1dbb8415241e admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:57.480162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86054a-44e8-4c0d-9216-1dbb8415241e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:57.482473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86054a-44e8-4c0d-9216-1dbb8415241e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:57.511323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a8552-4446-44c5-a9b6-698cd26fa7b3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:57.535686 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2476/4972] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:33:57 2022] POST /identity/v3/projects => generated 381 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:33:57.542940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86054a-44e8-4c0d-9216-1dbb8415241e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:57.546354 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6121ff-6fe9-4488-aa44-64e79cedfdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:57.548293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6121ff-6fe9-4488-aa44-64e79cedfdb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:57.548574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6121ff-6fe9-4488-aa44-64e79cedfdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:57.551015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6121ff-6fe9-4488-aa44-64e79cedfdb0 admin admin] PATH_INFO: `/v3/projects/50b356beea2a4ca1af5f25d44889d5ac` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:57.554448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6121ff-6fe9-4488-aa44-64e79cedfdb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50b356beea2a4ca1af5f25d44889d5ac)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:57.558600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6121ff-6fe9-4488-aa44-64e79cedfdb0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:57.637702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86054a-44e8-4c0d-9216-1dbb8415241e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:57.646512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2036169-541d-4ba7-98e9-885502f7d586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:57.647552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2036169-541d-4ba7-98e9-885502f7d586 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:57.648046 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2036169-541d-4ba7-98e9-885502f7d586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:57.648675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2036169-541d-4ba7-98e9-885502f7d586 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:57.649530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2036169-541d-4ba7-98e9-885502f7d586 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:57.652050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2036169-541d-4ba7-98e9-885502f7d586 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:57.678466 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:57.701519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cf6121ff-6fe9-4488-aa44-64e79cedfdb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50b356beea2a4ca1af5f25d44889d5ac', 'request_id': 'req-cf6121ff-6fe9-4488-aa44-64e79cedfdb0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:57.708473 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2477/4973] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:33:57 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:57.710970 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2036169-541d-4ba7-98e9-885502f7d586 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:57.720513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cf6121ff-6fe9-4488-aa44-64e79cedfdb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50b356beea2a4ca1af5f25d44889d5ac', 'request_id': 'req-cf6121ff-6fe9-4488-aa44-64e79cedfdb0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:57.744843 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2036169-541d-4ba7-98e9-885502f7d586 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:57.792595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cf6121ff-6fe9-4488-aa44-64e79cedfdb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50b356beea2a4ca1af5f25d44889d5ac', 'request_id': 'req-cf6121ff-6fe9-4488-aa44-64e79cedfdb0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:57.827518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cf6121ff-6fe9-4488-aa44-64e79cedfdb0 admin admin] The token cache is being invalidate because project 50b356beea2a4ca1af5f25d44889d5ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:33:57.827814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cf6121ff-6fe9-4488-aa44-64e79cedfdb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:57.836421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cf6121ff-6fe9-4488-aa44-64e79cedfdb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:57.838845 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2497/4974] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:33:57 2022] DELETE /identity/v3/projects/50b356beea2a4ca1af5f25d44889d5ac => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:33:57.844232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd165d1-925f-41f0-a991-c80efd34e580 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:57.844578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd165d1-925f-41f0-a991-c80efd34e580 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:57.844978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd165d1-925f-41f0-a991-c80efd34e580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:57.854599 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:57.908329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-abd165d1-925f-41f0-a991-c80efd34e580 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:57.930427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18996038-d873-492e-8140-cb24cc187ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:57.930427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18996038-d873-492e-8140-cb24cc187ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:57.930427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18996038-d873-492e-8140-cb24cc187ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:57.930427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18996038-d873-492e-8140-cb24cc187ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:57.931113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18996038-d873-492e-8140-cb24cc187ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:57.932223 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-abd165d1-925f-41f0-a991-c80efd34e580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:57.932822 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18996038-d873-492e-8140-cb24cc187ec2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:57.959488 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2478/4975] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:57.962338 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18996038-d873-492e-8140-cb24cc187ec2 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:57.967568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-18996038-d873-492e-8140-cb24cc187ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:57.984798 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2498/4976] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:33:57.989878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc3630-cb53-4cbe-bdd4-79475bc8c212 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:57.990166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc3630-cb53-4cbe-bdd4-79475bc8c212 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:57.990437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc3630-cb53-4cbe-bdd4-79475bc8c212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:57.997953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18996038-d873-492e-8140-cb24cc187ec2 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:58.017502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee09185-9d44-4efc-9cf5-09c6c736ea7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:58.018489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee09185-9d44-4efc-9cf5-09c6c736ea7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:58.018901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee09185-9d44-4efc-9cf5-09c6c736ea7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:58.019305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee09185-9d44-4efc-9cf5-09c6c736ea7d admin admin] PATH_INFO: `/v3/projects/f1cb257ee50d4ee0952e0adf7d043797/users/815ab98cd8d345e1b5bf5d32c5643d62/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:58.053420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee09185-9d44-4efc-9cf5-09c6c736ea7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1cb257ee50d4ee0952e0adf7d043797, user_id=815ab98cd8d345e1b5bf5d32c5643d62, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:58.056712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee09185-9d44-4efc-9cf5-09c6c736ea7d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:58.087235 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2479/4977] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:33:57 2022] PUT /identity/v3/projects/f1cb257ee50d4ee0952e0adf7d043797/users/815ab98cd8d345e1b5bf5d32c5643d62/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:58.092600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee09185-9d44-4efc-9cf5-09c6c736ea7d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:58.102181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-7efc3630-cb53-4cbe-bdd4-79475bc8c212 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:58.109614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7efc3630-cb53-4cbe-bdd4-79475bc8c212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:58.238217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee09185-9d44-4efc-9cf5-09c6c736ea7d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:58.251215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90fd35-ce26-43bb-b34d-c8a1d64c0c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:58.252224 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90fd35-ce26-43bb-b34d-c8a1d64c0c95 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:58.254936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90fd35-ce26-43bb-b34d-c8a1d64c0c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:58.255650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90fd35-ce26-43bb-b34d-c8a1d64c0c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:58.256510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90fd35-ce26-43bb-b34d-c8a1d64c0c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:58.259530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90fd35-ce26-43bb-b34d-c8a1d64c0c95 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:58.298858 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2480/4978] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:33:58.305082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90fd35-ce26-43bb-b34d-c8a1d64c0c95 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:58.333873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90fd35-ce26-43bb-b34d-c8a1d64c0c95 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:58.348611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562cd6e5-51b6-499b-8c0b-4bc05756278e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:58.351392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cd6e5-51b6-499b-8c0b-4bc05756278e admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:58.358343 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cd6e5-51b6-499b-8c0b-4bc05756278e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:58.358943 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cd6e5-51b6-499b-8c0b-4bc05756278e admin admin] PATH_INFO: `/v3/projects/f1cb257ee50d4ee0952e0adf7d043797/users/815ab98cd8d345e1b5bf5d32c5643d62/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:58.359746 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2499/4979] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:58.369486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562cd6e5-51b6-499b-8c0b-4bc05756278e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1cb257ee50d4ee0952e0adf7d043797, user_id=815ab98cd8d345e1b5bf5d32c5643d62, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:58.370043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc3630-cb53-4cbe-bdd4-79475bc8c212 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:58.377501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562cd6e5-51b6-499b-8c0b-4bc05756278e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:58.419100 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc3630-cb53-4cbe-bdd4-79475bc8c212 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:58.435242 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2481/4980] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:33:58 2022] PUT /identity/v3/projects/f1cb257ee50d4ee0952e0adf7d043797/users/815ab98cd8d345e1b5bf5d32c5643d62/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:58.447986 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f609a7-c803-4af4-a142-c1f166d4510b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:58.448356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f609a7-c803-4af4-a142-c1f166d4510b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:58.448777 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f609a7-c803-4af4-a142-c1f166d4510b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:58.534305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-57f609a7-c803-4af4-a142-c1f166d4510b None None] MFA Rules not processed for user `815ab98cd8d345e1b5bf5d32c5643d62`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:58.535668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-57f609a7-c803-4af4-a142-c1f166d4510b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:58.582988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf8469-c7c3-4bcf-9513-3eac24be2abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:58.583925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf8469-c7c3-4bcf-9513-3eac24be2abb admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:58.585266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf8469-c7c3-4bcf-9513-3eac24be2abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:58.585767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf8469-c7c3-4bcf-9513-3eac24be2abb admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:58.586687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf8469-c7c3-4bcf-9513-3eac24be2abb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:33:58.587361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf8469-c7c3-4bcf-9513-3eac24be2abb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:58.591062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf8469-c7c3-4bcf-9513-3eac24be2abb admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:58.616993 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2500/4981] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:33:58.621722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf8469-c7c3-4bcf-9513-3eac24be2abb admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:58.647499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf8469-c7c3-4bcf-9513-3eac24be2abb admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:58.660665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16349239-7141-454d-88b1-39ceb3bb2c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:58.663056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16349239-7141-454d-88b1-39ceb3bb2c07 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:58.664382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16349239-7141-454d-88b1-39ceb3bb2c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:58.664808 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16349239-7141-454d-88b1-39ceb3bb2c07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:58.665934 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16349239-7141-454d-88b1-39ceb3bb2c07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:58.674128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16349239-7141-454d-88b1-39ceb3bb2c07 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:58.707400 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2482/4982] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:58 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:33:58.712315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f609a7-c803-4af4-a142-c1f166d4510b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:58.732379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f609a7-c803-4af4-a142-c1f166d4510b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:58.745860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363144b4-1fc7-4d52-bed6-59db1a0a9700 tempest-ProjectsNegativeTestJSON-16956148 tempest-ProjectsNegativeTestJSON-16956148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '815ab98cd8d345e1b5bf5d32c5643d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1cb257ee50d4ee0952e0adf7d043797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:58.747606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363144b4-1fc7-4d52-bed6-59db1a0a9700 tempest-ProjectsNegativeTestJSON-16956148 tempest-ProjectsNegativeTestJSON-16956148-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:58.749544 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2501/4983] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:33:58 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:58.752189 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363144b4-1fc7-4d52-bed6-59db1a0a9700 tempest-ProjectsNegativeTestJSON-16956148 tempest-ProjectsNegativeTestJSON-16956148-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:58.752573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363144b4-1fc7-4d52-bed6-59db1a0a9700 tempest-ProjectsNegativeTestJSON-16956148 tempest-ProjectsNegativeTestJSON-16956148-project-admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:58.753194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16349239-7141-454d-88b1-39ceb3bb2c07 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:58.754430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363144b4-1fc7-4d52-bed6-59db1a0a9700 tempest-ProjectsNegativeTestJSON-16956148 tempest-ProjectsNegativeTestJSON-16956148-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:58.757696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363144b4-1fc7-4d52-bed6-59db1a0a9700 tempest-ProjectsNegativeTestJSON-16956148 tempest-ProjectsNegativeTestJSON-16956148-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:58.828549 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:58.870879 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2483/4984] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:33:58 2022] POST /identity/v3/projects => generated 359 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:33:58.880248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363144b4-1fc7-4d52-bed6-59db1a0a9700 tempest-ProjectsNegativeTestJSON-16956148 tempest-ProjectsNegativeTestJSON-16956148-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:58.882527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-363144b4-1fc7-4d52-bed6-59db1a0a9700 tempest-ProjectsNegativeTestJSON-16956148 tempest-ProjectsNegativeTestJSON-16956148-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:58.898728 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:58.993608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16349239-7141-454d-88b1-39ceb3bb2c07 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:59.037642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363144b4-1fc7-4d52-bed6-59db1a0a9700 tempest-ProjectsNegativeTestJSON-16956148 tempest-ProjectsNegativeTestJSON-16956148-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:59.052838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d979e10-0389-4c3e-be9f-995184b3e8b9 tempest-ProjectsNegativeTestJSON-1725089407 tempest-ProjectsNegativeTestJSON-1725089407-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1658259e93cf4726888f7bb67487b371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ed33bc461694997ba92b9c0872146c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:59.053760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d979e10-0389-4c3e-be9f-995184b3e8b9 tempest-ProjectsNegativeTestJSON-1725089407 tempest-ProjectsNegativeTestJSON-1725089407-project] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:59.054230 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d979e10-0389-4c3e-be9f-995184b3e8b9 tempest-ProjectsNegativeTestJSON-1725089407 tempest-ProjectsNegativeTestJSON-1725089407-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:59.054683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d979e10-0389-4c3e-be9f-995184b3e8b9 tempest-ProjectsNegativeTestJSON-1725089407 tempest-ProjectsNegativeTestJSON-1725089407-project] PATH_INFO: `/v3/projects/606c8b1c81754decb0bc59cc10020a35` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:59.060771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d979e10-0389-4c3e-be9f-995184b3e8b9 tempest-ProjectsNegativeTestJSON-1725089407 tempest-ProjectsNegativeTestJSON-1725089407-project] RBAC: Authorizing `identity:delete_project(project_id=606c8b1c81754decb0bc59cc10020a35)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:59.077352 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-3d979e10-0389-4c3e-be9f-995184b3e8b9 tempest-ProjectsNegativeTestJSON-1725089407 tempest-ProjectsNegativeTestJSON-1725089407-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Aug 07 01:33:59.077352 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:33:59.077352 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:33:59.077352 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:33:59.077352 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:33:59.077352 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:33:59.077352 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:33:59.077352 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:33:59.077352 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:33:59.077352 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:33:59.077352 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:33:59.077352 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:33:59.077352 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Aug 07 01:33:59.077352 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Aug 07 01:33:59.078456 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Aug 07 01:33:59.078456 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application enforcer_obj._enforce( Aug 07 01:33:59.078456 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Aug 07 01:33:59.078456 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Aug 07 01:33:59.078456 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 07 01:33:59.078456 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Aug 07 01:33:59.078456 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Aug 07 01:33:59.078456 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:33:59.083675 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2484/4985] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:33:58 2022] DELETE /identity/v3/projects/606c8b1c81754decb0bc59cc10020a35 => generated 136 bytes in 204 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:33:59.086147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d979e10-0389-4c3e-be9f-995184b3e8b9 tempest-ProjectsNegativeTestJSON-1725089407 tempest-ProjectsNegativeTestJSON-1725089407-project] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:59.139062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e38d5-2957-43ef-b796-70a1f86f7f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:59.140023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e38d5-2957-43ef-b796-70a1f86f7f79 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:59.140433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e38d5-2957-43ef-b796-70a1f86f7f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:59.140815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e38d5-2957-43ef-b796-70a1f86f7f79 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:59.147923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e38d5-2957-43ef-b796-70a1f86f7f79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:59.150331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e38d5-2957-43ef-b796-70a1f86f7f79 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:59.192040 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2502/4986] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:33:58 2022] POST /identity/v3/users => generated 290 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:33:59.207920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e38d5-2957-43ef-b796-70a1f86f7f79 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:59.217866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e38d5-2957-43ef-b796-70a1f86f7f79 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:59.226062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9d5fd-1295-4e01-9ad0-2b161d43a3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:59.226857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9d5fd-1295-4e01-9ad0-2b161d43a3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:59.227254 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9d5fd-1295-4e01-9ad0-2b161d43a3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:59.227644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9d5fd-1295-4e01-9ad0-2b161d43a3b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:59.228987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9d5fd-1295-4e01-9ad0-2b161d43a3b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:59.231507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9d5fd-1295-4e01-9ad0-2b161d43a3b1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:59.254058 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2503/4987] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:59.258778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9d5fd-1295-4e01-9ad0-2b161d43a3b1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:59.272976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9d5fd-1295-4e01-9ad0-2b161d43a3b1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:59.279322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db062fed-cc73-4ce7-bc23-c69d83e7210d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:59.280316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db062fed-cc73-4ce7-bc23-c69d83e7210d admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:59.280862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db062fed-cc73-4ce7-bc23-c69d83e7210d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:59.281404 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db062fed-cc73-4ce7-bc23-c69d83e7210d admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:59.282291 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db062fed-cc73-4ce7-bc23-c69d83e7210d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:59.284574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db062fed-cc73-4ce7-bc23-c69d83e7210d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:59.315341 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2504/4988] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:33:59.317787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db062fed-cc73-4ce7-bc23-c69d83e7210d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:59.341676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d979e10-0389-4c3e-be9f-995184b3e8b9 tempest-ProjectsNegativeTestJSON-1725089407 tempest-ProjectsNegativeTestJSON-1725089407-project] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:59.385507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db062fed-cc73-4ce7-bc23-c69d83e7210d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:59.388606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9c4eb-c34b-4ee2-ae87-65ef7f1250c4 tempest-ProjectsNegativeTestJSON-16956148 tempest-ProjectsNegativeTestJSON-16956148-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '815ab98cd8d345e1b5bf5d32c5643d62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1cb257ee50d4ee0952e0adf7d043797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:59.390806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9c4eb-c34b-4ee2-ae87-65ef7f1250c4 tempest-ProjectsNegativeTestJSON-16956148 tempest-ProjectsNegativeTestJSON-16956148-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:59.392192 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9c4eb-c34b-4ee2-ae87-65ef7f1250c4 tempest-ProjectsNegativeTestJSON-16956148 tempest-ProjectsNegativeTestJSON-16956148-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:59.393238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9c4eb-c34b-4ee2-ae87-65ef7f1250c4 tempest-ProjectsNegativeTestJSON-16956148 tempest-ProjectsNegativeTestJSON-16956148-project-admin] PATH_INFO: `/v3/projects/606c8b1c81754decb0bc59cc10020a35` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:59.398692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9c4eb-c34b-4ee2-ae87-65ef7f1250c4 tempest-ProjectsNegativeTestJSON-16956148 tempest-ProjectsNegativeTestJSON-16956148-project-admin] RBAC: Authorizing `identity:delete_project(project_id=606c8b1c81754decb0bc59cc10020a35)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:59.401984 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc3182-f546-40ce-b811-9e42bfeca3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:59.403783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9c4eb-c34b-4ee2-ae87-65ef7f1250c4 tempest-ProjectsNegativeTestJSON-16956148 tempest-ProjectsNegativeTestJSON-16956148-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:59.404648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc3182-f546-40ce-b811-9e42bfeca3c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:59.406760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc3182-f546-40ce-b811-9e42bfeca3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:59.407474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc3182-f546-40ce-b811-9e42bfeca3c4 admin admin] PATH_INFO: `/v3/projects/9a871883160d4b9483b7009fbe485690/users/063427be95f64488bfa71df1f90e1400/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:59.442413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc3182-f546-40ce-b811-9e42bfeca3c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a871883160d4b9483b7009fbe485690, user_id=063427be95f64488bfa71df1f90e1400, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:59.446973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc3182-f546-40ce-b811-9e42bfeca3c4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:59.479055 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2505/4989] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:33:59 2022] PUT /identity/v3/projects/9a871883160d4b9483b7009fbe485690/users/063427be95f64488bfa71df1f90e1400/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:59.484954 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f12eda-5506-4486-bc3c-c20264f42de0 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:59.486331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f12eda-5506-4486-bc3c-c20264f42de0 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:59.487995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f12eda-5506-4486-bc3c-c20264f42de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:59.518896 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-89f9c4eb-c34b-4ee2-ae87-65ef7f1250c4 tempest-ProjectsNegativeTestJSON-16956148 tempest-ProjectsNegativeTestJSON-16956148-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '606c8b1c81754decb0bc59cc10020a35', 'request_id': 'req-89f9c4eb-c34b-4ee2-ae87-65ef7f1250c4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:59.535430 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-17f12eda-5506-4486-bc3c-c20264f42de0 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:33:59.536608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-89f9c4eb-c34b-4ee2-ae87-65ef7f1250c4 tempest-ProjectsNegativeTestJSON-16956148 tempest-ProjectsNegativeTestJSON-16956148-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '606c8b1c81754decb0bc59cc10020a35', 'request_id': 'req-89f9c4eb-c34b-4ee2-ae87-65ef7f1250c4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:59.540140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-17f12eda-5506-4486-bc3c-c20264f42de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:59.555850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-89f9c4eb-c34b-4ee2-ae87-65ef7f1250c4 tempest-ProjectsNegativeTestJSON-16956148 tempest-ProjectsNegativeTestJSON-16956148-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '606c8b1c81754decb0bc59cc10020a35', 'request_id': 'req-89f9c4eb-c34b-4ee2-ae87-65ef7f1250c4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:59.582510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-89f9c4eb-c34b-4ee2-ae87-65ef7f1250c4 tempest-ProjectsNegativeTestJSON-16956148 tempest-ProjectsNegativeTestJSON-16956148-project-admin] The token cache is being invalidate because project 606c8b1c81754decb0bc59cc10020a35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:33:59.584167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-89f9c4eb-c34b-4ee2-ae87-65ef7f1250c4 tempest-ProjectsNegativeTestJSON-16956148 tempest-ProjectsNegativeTestJSON-16956148-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:59.585760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-89f9c4eb-c34b-4ee2-ae87-65ef7f1250c4 tempest-ProjectsNegativeTestJSON-16956148 tempest-ProjectsNegativeTestJSON-16956148-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:59.593781 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2485/4990] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:33:59 2022] DELETE /identity/v3/projects/606c8b1c81754decb0bc59cc10020a35 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:33:59.595329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9c4eb-c34b-4ee2-ae87-65ef7f1250c4 tempest-ProjectsNegativeTestJSON-16956148 tempest-ProjectsNegativeTestJSON-16956148-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:59.598003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-89f9c4eb-c34b-4ee2-ae87-65ef7f1250c4 tempest-ProjectsNegativeTestJSON-16956148 tempest-ProjectsNegativeTestJSON-16956148-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:59.686232 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2506/4991] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:33:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:33:59.691456 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:59.698290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f12eda-5506-4486-bc3c-c20264f42de0 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:33:59.704021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-17f12eda-5506-4486-bc3c-c20264f42de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:33:59.758415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9c4eb-c34b-4ee2-ae87-65ef7f1250c4 tempest-ProjectsNegativeTestJSON-16956148 tempest-ProjectsNegativeTestJSON-16956148-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:59.765194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f18edd2-99cc-4fae-8d7c-d549066868b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:33:59.766092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18edd2-99cc-4fae-8d7c-d549066868b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:33:59.766541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18edd2-99cc-4fae-8d7c-d549066868b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:33:59.766972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f18edd2-99cc-4fae-8d7c-d549066868b2 admin admin] PATH_INFO: `/v3/users/1658259e93cf4726888f7bb67487b371` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:33:59.769206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f18edd2-99cc-4fae-8d7c-d549066868b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1658259e93cf4726888f7bb67487b371)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:33:59.771842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f18edd2-99cc-4fae-8d7c-d549066868b2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:33:59.802696 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:33:59.947741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8f18edd2-99cc-4fae-8d7c-d549066868b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1658259e93cf4726888f7bb67487b371'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:33:59.976706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f12eda-5506-4486-bc3c-c20264f42de0 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:33:59.983401 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8f18edd2-99cc-4fae-8d7c-d549066868b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1658259e93cf4726888f7bb67487b371'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:00.011262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fb4b1-bd37-48f8-b146-6db7129d27cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:00.012524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fb4b1-bd37-48f8-b146-6db7129d27cb service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:00.013683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fb4b1-bd37-48f8-b146-6db7129d27cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:00.014231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fb4b1-bd37-48f8-b146-6db7129d27cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:00.065329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8f18edd2-99cc-4fae-8d7c-d549066868b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1658259e93cf4726888f7bb67487b371'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:00.066209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8f18edd2-99cc-4fae-8d7c-d549066868b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1658259e93cf4726888f7bb67487b371'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:00.069778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020fb4b1-bd37-48f8-b146-6db7129d27cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:00.071451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020fb4b1-bd37-48f8-b146-6db7129d27cb service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:00.081268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8f18edd2-99cc-4fae-8d7c-d549066868b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1658259e93cf4726888f7bb67487b371'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:00.101619 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2507/4992] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:33:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:34:00.103400 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2486/4993] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:33:59 2022] DELETE /identity/v3/users/1658259e93cf4726888f7bb67487b371 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:00.109196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763b598-c7ec-4277-8369-4dbc45e27905 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:00.109539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763b598-c7ec-4277-8369-4dbc45e27905 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:00.109872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763b598-c7ec-4277-8369-4dbc45e27905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:00.141268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3763b598-c7ec-4277-8369-4dbc45e27905 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:00.143075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3763b598-c7ec-4277-8369-4dbc45e27905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:00.289995 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2508/4994] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:00.321757 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede612e5-8b05-41e9-a76e-003a22df86f9 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:00.322050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede612e5-8b05-41e9-a76e-003a22df86f9 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:00.322329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede612e5-8b05-41e9-a76e-003a22df86f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:00.337777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763b598-c7ec-4277-8369-4dbc45e27905 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:00.339308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3763b598-c7ec-4277-8369-4dbc45e27905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:00.459953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ede612e5-8b05-41e9-a76e-003a22df86f9 None None] MFA Rules not processed for user `6b33e07001cb4a2db36fec14bded07f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:00.461957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ede612e5-8b05-41e9-a76e-003a22df86f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:00.601429 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763b598-c7ec-4277-8369-4dbc45e27905 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:00.612501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cff4fe-9a0c-48e0-a1fc-665dbe3a7e5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:00.613134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cff4fe-9a0c-48e0-a1fc-665dbe3a7e5b service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:00.613599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cff4fe-9a0c-48e0-a1fc-665dbe3a7e5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:00.613881 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cff4fe-9a0c-48e0-a1fc-665dbe3a7e5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:00.644134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cff4fe-9a0c-48e0-a1fc-665dbe3a7e5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:00.652427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cff4fe-9a0c-48e0-a1fc-665dbe3a7e5b service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:00.677236 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2509/4995] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:34:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:34:00.699987 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2487/4996] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:00 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:00.709454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd03e0a-532f-4cfa-a9ad-b8dd62fddeff None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:00.709783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd03e0a-532f-4cfa-a9ad-b8dd62fddeff None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:00.710371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd03e0a-532f-4cfa-a9ad-b8dd62fddeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:00.773149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-7fd03e0a-532f-4cfa-a9ad-b8dd62fddeff None None] MFA Rules not processed for user `6b33e07001cb4a2db36fec14bded07f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:00.781151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7fd03e0a-532f-4cfa-a9ad-b8dd62fddeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:00.817219 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2510/4997] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:00 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:00.877662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede612e5-8b05-41e9-a76e-003a22df86f9 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:00.879429 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ede612e5-8b05-41e9-a76e-003a22df86f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:01.093918 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:01.206474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede612e5-8b05-41e9-a76e-003a22df86f9 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:01.225778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68314c-7e57-432d-add6-4302b9556875 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:01.226319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68314c-7e57-432d-add6-4302b9556875 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:01.226596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68314c-7e57-432d-add6-4302b9556875 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:01.226865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68314c-7e57-432d-add6-4302b9556875 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:01.257274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68314c-7e57-432d-add6-4302b9556875 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:01.258910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68314c-7e57-432d-add6-4302b9556875 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:01.301928 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2488/4998] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:34:00 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:34:02.004200 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd03e0a-532f-4cfa-a9ad-b8dd62fddeff None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:02.006818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7fd03e0a-532f-4cfa-a9ad-b8dd62fddeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:02.084467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd03e0a-532f-4cfa-a9ad-b8dd62fddeff None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:02.107287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19150710-d3af-4c37-babb-836692af1c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:02.108384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19150710-d3af-4c37-babb-836692af1c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:02.108875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19150710-d3af-4c37-babb-836692af1c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:02.109316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19150710-d3af-4c37-babb-836692af1c99 admin admin] PATH_INFO: `/v3/projects/6ed33bc461694997ba92b9c0872146c2` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:02.111292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19150710-d3af-4c37-babb-836692af1c99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ed33bc461694997ba92b9c0872146c2)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:02.117242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19150710-d3af-4c37-babb-836692af1c99 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:02.333862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-19150710-d3af-4c37-babb-836692af1c99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ed33bc461694997ba92b9c0872146c2', 'request_id': 'req-19150710-d3af-4c37-babb-836692af1c99'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:02.356207 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:02.359465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-19150710-d3af-4c37-babb-836692af1c99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ed33bc461694997ba92b9c0872146c2', 'request_id': 'req-19150710-d3af-4c37-babb-836692af1c99'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:02.380774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-19150710-d3af-4c37-babb-836692af1c99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ed33bc461694997ba92b9c0872146c2', 'request_id': 'req-19150710-d3af-4c37-babb-836692af1c99'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:02.410230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-19150710-d3af-4c37-babb-836692af1c99 admin admin] The token cache is being invalidate because project 6ed33bc461694997ba92b9c0872146c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:02.410811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-19150710-d3af-4c37-babb-836692af1c99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:02.417525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-19150710-d3af-4c37-babb-836692af1c99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:02.422466 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2511/4999] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:02 2022] DELETE /identity/v3/projects/6ed33bc461694997ba92b9c0872146c2 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:02.423575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68314c-7e57-432d-add6-4302b9556875 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:02.439525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68314c-7e57-432d-add6-4302b9556875 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:02.751306 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6eedc8-ebc9-4eb5-b5d0-c54792bdaef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:02.751978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6eedc8-ebc9-4eb5-b5d0-c54792bdaef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:02.752260 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6eedc8-ebc9-4eb5-b5d0-c54792bdaef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:02.752537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6eedc8-ebc9-4eb5-b5d0-c54792bdaef5 admin admin] PATH_INFO: `/v3/users/815ab98cd8d345e1b5bf5d32c5643d62` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:02.763629 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6eedc8-ebc9-4eb5-b5d0-c54792bdaef5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=815ab98cd8d345e1b5bf5d32c5643d62)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:02.776409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6eedc8-ebc9-4eb5-b5d0-c54792bdaef5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:02.965954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2a6eedc8-ebc9-4eb5-b5d0-c54792bdaef5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '815ab98cd8d345e1b5bf5d32c5643d62'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:03.004321 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2a6eedc8-ebc9-4eb5-b5d0-c54792bdaef5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '815ab98cd8d345e1b5bf5d32c5643d62'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:03.067436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2a6eedc8-ebc9-4eb5-b5d0-c54792bdaef5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '815ab98cd8d345e1b5bf5d32c5643d62'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:03.068223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2a6eedc8-ebc9-4eb5-b5d0-c54792bdaef5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '815ab98cd8d345e1b5bf5d32c5643d62'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:03.093397 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2a6eedc8-ebc9-4eb5-b5d0-c54792bdaef5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '815ab98cd8d345e1b5bf5d32c5643d62'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:03.109024 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2489/5000] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:34:02 2022] DELETE /identity/v3/users/815ab98cd8d345e1b5bf5d32c5643d62 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:04.385976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19150710-d3af-4c37-babb-836692af1c99 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:04.388615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-19150710-d3af-4c37-babb-836692af1c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:04.434269 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19150710-d3af-4c37-babb-836692af1c99 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:04.601108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3997e-6ec2-4d7c-917e-8102b7d594ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:04.601773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3997e-6ec2-4d7c-917e-8102b7d594ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:04.602048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3997e-6ec2-4d7c-917e-8102b7d594ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:04.604202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3997e-6ec2-4d7c-917e-8102b7d594ad admin admin] PATH_INFO: `/v3/projects/f1cb257ee50d4ee0952e0adf7d043797` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:04.606179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3997e-6ec2-4d7c-917e-8102b7d594ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1cb257ee50d4ee0952e0adf7d043797)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:04.609508 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3997e-6ec2-4d7c-917e-8102b7d594ad admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:04.728375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cdb3997e-6ec2-4d7c-917e-8102b7d594ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1cb257ee50d4ee0952e0adf7d043797', 'request_id': 'req-cdb3997e-6ec2-4d7c-917e-8102b7d594ad'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:04.767647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cdb3997e-6ec2-4d7c-917e-8102b7d594ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1cb257ee50d4ee0952e0adf7d043797', 'request_id': 'req-cdb3997e-6ec2-4d7c-917e-8102b7d594ad'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:04.776452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cdb3997e-6ec2-4d7c-917e-8102b7d594ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1cb257ee50d4ee0952e0adf7d043797', 'request_id': 'req-cdb3997e-6ec2-4d7c-917e-8102b7d594ad'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:04.837059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cdb3997e-6ec2-4d7c-917e-8102b7d594ad admin admin] The token cache is being invalidate because project f1cb257ee50d4ee0952e0adf7d043797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:04.837354 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cdb3997e-6ec2-4d7c-917e-8102b7d594ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:04.844220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cdb3997e-6ec2-4d7c-917e-8102b7d594ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:04.849666 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2512/5001] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:04 2022] DELETE /identity/v3/projects/f1cb257ee50d4ee0952e0adf7d043797 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:04.856310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7674bd3-d7f8-468c-89c6-529cb2292844 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:04.856936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7674bd3-d7f8-468c-89c6-529cb2292844 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:04.856936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7674bd3-d7f8-468c-89c6-529cb2292844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:04.937317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-f7674bd3-d7f8-468c-89c6-529cb2292844 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:04.950709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f7674bd3-d7f8-468c-89c6-529cb2292844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:05.094629 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:05.172500 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2490/5002] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:34:05.177692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6e5fc-2187-44bc-a740-81e68cfda952 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:05.177975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6e5fc-2187-44bc-a740-81e68cfda952 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:05.178252 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6e5fc-2187-44bc-a740-81e68cfda952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:05.215355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-78c6e5fc-2187-44bc-a740-81e68cfda952 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:05.216790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-78c6e5fc-2187-44bc-a740-81e68cfda952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:05.239549 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7674bd3-d7f8-468c-89c6-529cb2292844 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:05.258023 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2513/5003] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:05.262880 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7674bd3-d7f8-468c-89c6-529cb2292844 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:05.274310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd59317-f3a5-4337-98d5-08ef891b640c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:05.275038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd59317-f3a5-4337-98d5-08ef891b640c admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:05.275318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd59317-f3a5-4337-98d5-08ef891b640c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:05.275640 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd59317-f3a5-4337-98d5-08ef891b640c admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:05.277647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd59317-f3a5-4337-98d5-08ef891b640c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:34:05.277956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd59317-f3a5-4337-98d5-08ef891b640c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:05.280637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd59317-f3a5-4337-98d5-08ef891b640c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:05.317032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6e5fc-2187-44bc-a740-81e68cfda952 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:05.323453 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2491/5004] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:34:05.328723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6e5fc-2187-44bc-a740-81e68cfda952 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:05.345063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d2fe5e-0c8b-454d-be99-23fdd8db1359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:05.345491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2fe5e-0c8b-454d-be99-23fdd8db1359 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:05.345758 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2fe5e-0c8b-454d-be99-23fdd8db1359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:05.346083 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2fe5e-0c8b-454d-be99-23fdd8db1359 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:05.346882 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d2fe5e-0c8b-454d-be99-23fdd8db1359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:05.349813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d2fe5e-0c8b-454d-be99-23fdd8db1359 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:05.411586 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2514/5005] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:34:05 2022] POST /identity/v3/projects => generated 367 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:05.415968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd59317-f3a5-4337-98d5-08ef891b640c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:05.467652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd59317-f3a5-4337-98d5-08ef891b640c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:05.691632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9f4a7-2360-4c2a-bae9-c3d4beb38147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:05.692304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9f4a7-2360-4c2a-bae9-c3d4beb38147 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:05.692587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9f4a7-2360-4c2a-bae9-c3d4beb38147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:05.692861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9f4a7-2360-4c2a-bae9-c3d4beb38147 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:05.693501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9f4a7-2360-4c2a-bae9-c3d4beb38147 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:05.707983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9f4a7-2360-4c2a-bae9-c3d4beb38147 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:05.785237 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2492/5006] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:34:05 2022] POST /identity/v3/users => generated 284 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:05.789589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d2fe5e-0c8b-454d-be99-23fdd8db1359 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:05.856440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d2fe5e-0c8b-454d-be99-23fdd8db1359 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:05.877980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23809d86-1a66-45d9-8a48-2f93b1215750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:05.879176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23809d86-1a66-45d9-8a48-2f93b1215750 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:05.879467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23809d86-1a66-45d9-8a48-2f93b1215750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:05.881915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23809d86-1a66-45d9-8a48-2f93b1215750 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:05.882714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23809d86-1a66-45d9-8a48-2f93b1215750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:05.897556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23809d86-1a66-45d9-8a48-2f93b1215750 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:05.931397 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2515/5007] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:34:05.932931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9f4a7-2360-4c2a-bae9-c3d4beb38147 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:05.952071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9f4a7-2360-4c2a-bae9-c3d4beb38147 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:05.972896 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70a1e4-bd89-4a57-8bd6-e7be809eecb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:05.973544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70a1e4-bd89-4a57-8bd6-e7be809eecb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:05.973828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70a1e4-bd89-4a57-8bd6-e7be809eecb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:05.974097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70a1e4-bd89-4a57-8bd6-e7be809eecb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:05.974778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70a1e4-bd89-4a57-8bd6-e7be809eecb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:05.976477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70a1e4-bd89-4a57-8bd6-e7be809eecb9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:06.019714 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2493/5008] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:06.020988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23809d86-1a66-45d9-8a48-2f93b1215750 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:06.043229 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23809d86-1a66-45d9-8a48-2f93b1215750 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:06.064190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00a7af-35f8-4f82-a48f-74c9d73d1f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:06.064927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00a7af-35f8-4f82-a48f-74c9d73d1f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:06.065210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00a7af-35f8-4f82-a48f-74c9d73d1f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:06.065490 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00a7af-35f8-4f82-a48f-74c9d73d1f21 admin admin] PATH_INFO: `/v3/projects/6a2c63ca22dd4eff8795f2b3fc7f1eb1/users/9b45211127154a289c42e8cd4a0c1751/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:06.119734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00a7af-35f8-4f82-a48f-74c9d73d1f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a2c63ca22dd4eff8795f2b3fc7f1eb1, user_id=9b45211127154a289c42e8cd4a0c1751, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:06.123467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00a7af-35f8-4f82-a48f-74c9d73d1f21 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:06.159113 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2516/5009] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:34:06 2022] PUT /identity/v3/projects/6a2c63ca22dd4eff8795f2b3fc7f1eb1/users/9b45211127154a289c42e8cd4a0c1751/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:06.188147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8e70b-ec12-477d-8794-a8ee60bfdf6f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:06.188147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8e70b-ec12-477d-8794-a8ee60bfdf6f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:06.188147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8e70b-ec12-477d-8794-a8ee60bfdf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:06.332868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1cc8e70b-ec12-477d-8794-a8ee60bfdf6f None None] MFA Rules not processed for user `9b45211127154a289c42e8cd4a0c1751`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:06.345217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1cc8e70b-ec12-477d-8794-a8ee60bfdf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:06.658999 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2494/5010] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:06.663507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00a7af-35f8-4f82-a48f-74c9d73d1f21 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:06.671516 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:06.682689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00a7af-35f8-4f82-a48f-74c9d73d1f21 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:06.711095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f143fc-8ef8-4b85-88f7-6b34666e61af tempest-TestApiDiscovery-352012840 tempest-TestApiDiscovery-352012840-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b45211127154a289c42e8cd4a0c1751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a2c63ca22dd4eff8795f2b3fc7f1eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:06.711975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f143fc-8ef8-4b85-88f7-6b34666e61af tempest-TestApiDiscovery-352012840 tempest-TestApiDiscovery-352012840-project] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:06.718930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f143fc-8ef8-4b85-88f7-6b34666e61af tempest-TestApiDiscovery-352012840 tempest-TestApiDiscovery-352012840-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:06.719448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f143fc-8ef8-4b85-88f7-6b34666e61af tempest-TestApiDiscovery-352012840 tempest-TestApiDiscovery-352012840-project] PATH_INFO: `/v3` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:06.721426 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2517/5011] 10.222.0.39 () {58 vars in 1104 bytes} [Sun Aug 7 01:34:06 2022] GET /identity/v3 => generated 255 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:34:06.725948 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8e70b-ec12-477d-8794-a8ee60bfdf6f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:06.735643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8e70b-ec12-477d-8794-a8ee60bfdf6f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:06.750898 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3345cf-d01a-464c-8370-ce8c3893af47 tempest-TestApiDiscovery-352012840 tempest-TestApiDiscovery-352012840-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b45211127154a289c42e8cd4a0c1751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a2c63ca22dd4eff8795f2b3fc7f1eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:06.755504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3345cf-d01a-464c-8370-ce8c3893af47 tempest-TestApiDiscovery-352012840 tempest-TestApiDiscovery-352012840-project] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:06.755789 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3345cf-d01a-464c-8370-ce8c3893af47 tempest-TestApiDiscovery-352012840 tempest-TestApiDiscovery-352012840-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:06.756081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3345cf-d01a-464c-8370-ce8c3893af47 tempest-TestApiDiscovery-352012840 tempest-TestApiDiscovery-352012840-project] PATH_INFO: `/v3` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:06.761282 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2495/5012] 10.222.0.39 () {58 vars in 1104 bytes} [Sun Aug 7 01:34:06 2022] GET /identity/v3 => generated 255 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:34:06.767751 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f143fc-8ef8-4b85-88f7-6b34666e61af tempest-TestApiDiscovery-352012840 tempest-TestApiDiscovery-352012840-project] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:06.778891 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f143fc-8ef8-4b85-88f7-6b34666e61af tempest-TestApiDiscovery-352012840 tempest-TestApiDiscovery-352012840-project] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:06.798192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7b5de-3e86-49c4-83f0-64427dec2af6 tempest-TestApiDiscovery-352012840 tempest-TestApiDiscovery-352012840-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b45211127154a289c42e8cd4a0c1751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6a2c63ca22dd4eff8795f2b3fc7f1eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:06.799605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7b5de-3e86-49c4-83f0-64427dec2af6 tempest-TestApiDiscovery-352012840 tempest-TestApiDiscovery-352012840-project] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:06.799909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7b5de-3e86-49c4-83f0-64427dec2af6 tempest-TestApiDiscovery-352012840 tempest-TestApiDiscovery-352012840-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:06.800184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7b5de-3e86-49c4-83f0-64427dec2af6 tempest-TestApiDiscovery-352012840 tempest-TestApiDiscovery-352012840-project] PATH_INFO: `/v3` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:06.817645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca474bd-30d4-4962-9b3d-d93362a8cd9e None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:06.817902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca474bd-30d4-4962-9b3d-d93362a8cd9e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:06.818164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca474bd-30d4-4962-9b3d-d93362a8cd9e None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:06.819591 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2496/5013] 10.222.0.39 () {56 vars in 895 bytes} [Sun Aug 7 01:34:06 2022] GET /identity/ => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 07 01:34:06.824605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244ae37-6753-45b2-9555-71c5634249b5 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:06.824887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244ae37-6753-45b2-9555-71c5634249b5 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:06.825156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244ae37-6753-45b2-9555-71c5634249b5 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:06.826711 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2497/5014] 10.222.0.39 () {56 vars in 895 bytes} [Sun Aug 7 01:34:06 2022] GET /identity/ => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:34:06.831252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244ae37-6753-45b2-9555-71c5634249b5 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:06.833536 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2518/5015] 10.222.0.39 () {58 vars in 1104 bytes} [Sun Aug 7 01:34:06 2022] GET /identity/v3 => generated 255 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:34:06.940081 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:07.151098 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7244ae37-6753-45b2-9555-71c5634249b5 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:07.180873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e4464-f8b8-4bd8-95b3-4a2f0469bacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:07.181649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e4464-f8b8-4bd8-95b3-4a2f0469bacc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:07.182897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e4464-f8b8-4bd8-95b3-4a2f0469bacc admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:07.182897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e4464-f8b8-4bd8-95b3-4a2f0469bacc admin admin] PATH_INFO: `/v3/users/9b45211127154a289c42e8cd4a0c1751` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:07.184596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e4464-f8b8-4bd8-95b3-4a2f0469bacc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b45211127154a289c42e8cd4a0c1751)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:07.189419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e4464-f8b8-4bd8-95b3-4a2f0469bacc admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:07.350318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bc8e4464-f8b8-4bd8-95b3-4a2f0469bacc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b45211127154a289c42e8cd4a0c1751'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:07.369411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bc8e4464-f8b8-4bd8-95b3-4a2f0469bacc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b45211127154a289c42e8cd4a0c1751'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:07.400568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bc8e4464-f8b8-4bd8-95b3-4a2f0469bacc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b45211127154a289c42e8cd4a0c1751'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:07.401833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bc8e4464-f8b8-4bd8-95b3-4a2f0469bacc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b45211127154a289c42e8cd4a0c1751'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:07.417637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bc8e4464-f8b8-4bd8-95b3-4a2f0469bacc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b45211127154a289c42e8cd4a0c1751'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:07.436557 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2498/5016] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:34:06 2022] DELETE /identity/v3/users/9b45211127154a289c42e8cd4a0c1751 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:07.441253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa28bcb-0d30-4df7-8871-40c6334d5d3f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:07.441593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa28bcb-0d30-4df7-8871-40c6334d5d3f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:07.441879 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa28bcb-0d30-4df7-8871-40c6334d5d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:07.477737 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-dfa28bcb-0d30-4df7-8871-40c6334d5d3f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:07.478963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dfa28bcb-0d30-4df7-8871-40c6334d5d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:07.616523 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2519/5017] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:07.686392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e4464-f8b8-4bd8-95b3-4a2f0469bacc admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:07.687927 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bc8e4464-f8b8-4bd8-95b3-4a2f0469bacc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:07.924166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e4464-f8b8-4bd8-95b3-4a2f0469bacc admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:07.947634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed2148-dc9d-4fec-b5f0-896be707040a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:07.948325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed2148-dc9d-4fec-b5f0-896be707040a service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:07.948611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed2148-dc9d-4fec-b5f0-896be707040a service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:07.949521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed2148-dc9d-4fec-b5f0-896be707040a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:07.990101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed2148-dc9d-4fec-b5f0-896be707040a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:07.991631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed2148-dc9d-4fec-b5f0-896be707040a service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:08.034220 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2499/5018] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:34:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:34:10.899579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa28bcb-0d30-4df7-8871-40c6334d5d3f None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:10.901141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dfa28bcb-0d30-4df7-8871-40c6334d5d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:10.930138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa28bcb-0d30-4df7-8871-40c6334d5d3f None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:10.947416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dc370-6d11-485a-b26a-97b3c8a467eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:10.951410 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dc370-6d11-485a-b26a-97b3c8a467eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:10.951695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dc370-6d11-485a-b26a-97b3c8a467eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:10.952168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dc370-6d11-485a-b26a-97b3c8a467eb admin admin] PATH_INFO: `/v3/projects/6a2c63ca22dd4eff8795f2b3fc7f1eb1` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:10.953772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8dc370-6d11-485a-b26a-97b3c8a467eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a2c63ca22dd4eff8795f2b3fc7f1eb1)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:10.959766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8dc370-6d11-485a-b26a-97b3c8a467eb admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:11.165227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2b8dc370-6d11-485a-b26a-97b3c8a467eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a2c63ca22dd4eff8795f2b3fc7f1eb1', 'request_id': 'req-2b8dc370-6d11-485a-b26a-97b3c8a467eb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:11.186118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2b8dc370-6d11-485a-b26a-97b3c8a467eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a2c63ca22dd4eff8795f2b3fc7f1eb1', 'request_id': 'req-2b8dc370-6d11-485a-b26a-97b3c8a467eb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:11.219378 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2b8dc370-6d11-485a-b26a-97b3c8a467eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a2c63ca22dd4eff8795f2b3fc7f1eb1', 'request_id': 'req-2b8dc370-6d11-485a-b26a-97b3c8a467eb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:11.270511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2b8dc370-6d11-485a-b26a-97b3c8a467eb admin admin] The token cache is being invalidate because project 6a2c63ca22dd4eff8795f2b3fc7f1eb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:11.270661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2b8dc370-6d11-485a-b26a-97b3c8a467eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:11.271298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2b8dc370-6d11-485a-b26a-97b3c8a467eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:11.276207 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2520/5019] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:10 2022] DELETE /identity/v3/projects/6a2c63ca22dd4eff8795f2b3fc7f1eb1 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:11.277846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400ad40-834a-45c8-93b6-fcf9c8a455b9 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:11.278331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400ad40-834a-45c8-93b6-fcf9c8a455b9 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:11.278430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400ad40-834a-45c8-93b6-fcf9c8a455b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:11.300955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d400ad40-834a-45c8-93b6-fcf9c8a455b9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:11.302182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d400ad40-834a-45c8-93b6-fcf9c8a455b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:11.377256 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:11.478854 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2500/5020] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:34:11.488170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32531e8f-8708-4343-bb53-1e9c417cf388 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:11.488457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32531e8f-8708-4343-bb53-1e9c417cf388 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:11.488735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32531e8f-8708-4343-bb53-1e9c417cf388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:11.531098 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-32531e8f-8708-4343-bb53-1e9c417cf388 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:11.532385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-32531e8f-8708-4343-bb53-1e9c417cf388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:11.547277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400ad40-834a-45c8-93b6-fcf9c8a455b9 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:11.554796 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2521/5021] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:11.560767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400ad40-834a-45c8-93b6-fcf9c8a455b9 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:11.567850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9dce20-94f0-4679-bd33-925db3b3bfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:11.568654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9dce20-94f0-4679-bd33-925db3b3bfe8 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:11.569033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9dce20-94f0-4679-bd33-925db3b3bfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:11.569407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9dce20-94f0-4679-bd33-925db3b3bfe8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:11.570180 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9dce20-94f0-4679-bd33-925db3b3bfe8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:34:11.570736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9dce20-94f0-4679-bd33-925db3b3bfe8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:11.573267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9dce20-94f0-4679-bd33-925db3b3bfe8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:11.599600 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2501/5022] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:34:11.603324 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32531e8f-8708-4343-bb53-1e9c417cf388 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:11.615787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32531e8f-8708-4343-bb53-1e9c417cf388 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:11.623174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddc9e3-cdae-401e-b4d6-64d99310ed58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:11.623802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddc9e3-cdae-401e-b4d6-64d99310ed58 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:11.624130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddc9e3-cdae-401e-b4d6-64d99310ed58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:11.624381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddc9e3-cdae-401e-b4d6-64d99310ed58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:11.638179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ddc9e3-cdae-401e-b4d6-64d99310ed58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:11.640471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ddc9e3-cdae-401e-b4d6-64d99310ed58 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:11.675737 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2522/5023] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:34:11 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:11.680440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9dce20-94f0-4679-bd33-925db3b3bfe8 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:11.696933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9dce20-94f0-4679-bd33-925db3b3bfe8 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:11.817087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e436c4-3f74-4d45-97d4-e9f6ae4ee4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:11.836787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e436c4-3f74-4d45-97d4-e9f6ae4ee4d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:11.837276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e436c4-3f74-4d45-97d4-e9f6ae4ee4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:11.837909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e436c4-3f74-4d45-97d4-e9f6ae4ee4d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:11.891245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e436c4-3f74-4d45-97d4-e9f6ae4ee4d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:11.899691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e436c4-3f74-4d45-97d4-e9f6ae4ee4d9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:11.988742 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2502/5024] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:34:11 2022] POST /identity/v3/users => generated 287 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:11.989092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddc9e3-cdae-401e-b4d6-64d99310ed58 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:12.003123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddc9e3-cdae-401e-b4d6-64d99310ed58 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:12.018621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9157a2f-0dc9-42ee-8fdc-9ab778bc25bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:12.020855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9157a2f-0dc9-42ee-8fdc-9ab778bc25bb admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:12.022840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9157a2f-0dc9-42ee-8fdc-9ab778bc25bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:12.023317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9157a2f-0dc9-42ee-8fdc-9ab778bc25bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:12.024770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9157a2f-0dc9-42ee-8fdc-9ab778bc25bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:12.027751 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9157a2f-0dc9-42ee-8fdc-9ab778bc25bb admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:12.056622 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e436c4-3f74-4d45-97d4-e9f6ae4ee4d9 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:12.057433 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2523/5025] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:12.075394 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e436c4-3f74-4d45-97d4-e9f6ae4ee4d9 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:12.102089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7113f-ea0c-4393-a97f-5499e757ac1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:12.104299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7113f-ea0c-4393-a97f-5499e757ac1c admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:12.107657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7113f-ea0c-4393-a97f-5499e757ac1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:12.108384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7113f-ea0c-4393-a97f-5499e757ac1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:12.109275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7113f-ea0c-4393-a97f-5499e757ac1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:12.113120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7113f-ea0c-4393-a97f-5499e757ac1c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:12.142979 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2503/5026] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:34:12.147544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9157a2f-0dc9-42ee-8fdc-9ab778bc25bb admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:12.158593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9157a2f-0dc9-42ee-8fdc-9ab778bc25bb admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:12.172830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1d6d9-93b8-4326-928d-509df22ee4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:12.176232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1d6d9-93b8-4326-928d-509df22ee4e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:12.176883 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1d6d9-93b8-4326-928d-509df22ee4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:12.177528 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1d6d9-93b8-4326-928d-509df22ee4e1 admin admin] PATH_INFO: `/v3/projects/0cbbf29564fe48f589783de672d0d7f5/users/932d9cbd93ef4b788922c85e60c40636/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:12.256623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b1d6d9-93b8-4326-928d-509df22ee4e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cbbf29564fe48f589783de672d0d7f5, user_id=932d9cbd93ef4b788922c85e60c40636, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:12.260111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b1d6d9-93b8-4326-928d-509df22ee4e1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:12.301357 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2524/5027] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:34:12 2022] PUT /identity/v3/projects/0cbbf29564fe48f589783de672d0d7f5/users/932d9cbd93ef4b788922c85e60c40636/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:34:12.314007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e99d3-1538-437a-b0ad-5ff64e82d979 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:12.314709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e99d3-1538-437a-b0ad-5ff64e82d979 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:12.315211 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e99d3-1538-437a-b0ad-5ff64e82d979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:12.359026 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1e7e99d3-1538-437a-b0ad-5ff64e82d979 None None] MFA Rules not processed for user `932d9cbd93ef4b788922c85e60c40636`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:12.360856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1e7e99d3-1538-437a-b0ad-5ff64e82d979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:12.459105 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2504/5028] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:12.463691 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1d6d9-93b8-4326-928d-509df22ee4e1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:12.478969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1d6d9-93b8-4326-928d-509df22ee4e1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:12.496444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f3f82-830a-4537-88d8-51b641cb98db tempest-IdentityCatalogTest-147882250 tempest-IdentityCatalogTest-147882250-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '932d9cbd93ef4b788922c85e60c40636', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cbbf29564fe48f589783de672d0d7f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:12.497410 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f3f82-830a-4537-88d8-51b641cb98db tempest-IdentityCatalogTest-147882250 tempest-IdentityCatalogTest-147882250-project] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:12.497851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f3f82-830a-4537-88d8-51b641cb98db tempest-IdentityCatalogTest-147882250 tempest-IdentityCatalogTest-147882250-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:12.498284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f3f82-830a-4537-88d8-51b641cb98db tempest-IdentityCatalogTest-147882250 tempest-IdentityCatalogTest-147882250-project] PATH_INFO: `/v3/auth/catalog` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:12.499197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f3f82-830a-4537-88d8-51b641cb98db tempest-IdentityCatalogTest-147882250 tempest-IdentityCatalogTest-147882250-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:12.500861 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f3f82-830a-4537-88d8-51b641cb98db tempest-IdentityCatalogTest-147882250 tempest-IdentityCatalogTest-147882250-project] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:12.505456 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2525/5029] 10.222.0.39 () {58 vars in 1143 bytes} [Sun Aug 7 01:34:12 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:12.509989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e99d3-1538-437a-b0ad-5ff64e82d979 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:12.597328 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:12.644138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e99d3-1538-437a-b0ad-5ff64e82d979 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:12.650097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30584fb-ed71-434c-a121-e178344df937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:12.651060 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30584fb-ed71-434c-a121-e178344df937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:12.651496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30584fb-ed71-434c-a121-e178344df937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:12.652188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30584fb-ed71-434c-a121-e178344df937 admin admin] PATH_INFO: `/v3/users/932d9cbd93ef4b788922c85e60c40636` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:12.654167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30584fb-ed71-434c-a121-e178344df937 admin admin] RBAC: Authorizing `identity:delete_user(user_id=932d9cbd93ef4b788922c85e60c40636)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:12.657397 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30584fb-ed71-434c-a121-e178344df937 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:12.748429 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c30584fb-ed71-434c-a121-e178344df937 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '932d9cbd93ef4b788922c85e60c40636'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:12.765762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c30584fb-ed71-434c-a121-e178344df937 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '932d9cbd93ef4b788922c85e60c40636'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:12.787071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c30584fb-ed71-434c-a121-e178344df937 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '932d9cbd93ef4b788922c85e60c40636'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:12.788029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c30584fb-ed71-434c-a121-e178344df937 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '932d9cbd93ef4b788922c85e60c40636'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:12.798656 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c30584fb-ed71-434c-a121-e178344df937 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '932d9cbd93ef4b788922c85e60c40636'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:12.807571 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2505/5030] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:34:12 2022] DELETE /identity/v3/users/932d9cbd93ef4b788922c85e60c40636 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:12.813437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b773fd0-1eb7-4d9b-8ed6-7cad6bab55b9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:12.813799 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b773fd0-1eb7-4d9b-8ed6-7cad6bab55b9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:12.814441 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b773fd0-1eb7-4d9b-8ed6-7cad6bab55b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:12.853198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-4b773fd0-1eb7-4d9b-8ed6-7cad6bab55b9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:12.856497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4b773fd0-1eb7-4d9b-8ed6-7cad6bab55b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:12.880412 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:13.056900 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2526/5031] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:13.090189 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30584fb-ed71-434c-a121-e178344df937 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:13.097926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c30584fb-ed71-434c-a121-e178344df937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:13.268805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30584fb-ed71-434c-a121-e178344df937 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:13.275406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32182c-c048-4ecd-bee0-877e24646bf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:13.276086 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32182c-c048-4ecd-bee0-877e24646bf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:13.276373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32182c-c048-4ecd-bee0-877e24646bf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:13.277182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32182c-c048-4ecd-bee0-877e24646bf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:13.305088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32182c-c048-4ecd-bee0-877e24646bf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:13.306587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32182c-c048-4ecd-bee0-877e24646bf1 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:13.330749 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2506/5032] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:34:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:34:15.044393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b773fd0-1eb7-4d9b-8ed6-7cad6bab55b9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:15.045897 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4b773fd0-1eb7-4d9b-8ed6-7cad6bab55b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:15.072939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b773fd0-1eb7-4d9b-8ed6-7cad6bab55b9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:15.097670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44437509-a67d-446a-b78c-80ae5e7d1c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:15.098333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44437509-a67d-446a-b78c-80ae5e7d1c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:15.098607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44437509-a67d-446a-b78c-80ae5e7d1c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:15.098878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44437509-a67d-446a-b78c-80ae5e7d1c69 admin admin] PATH_INFO: `/v3/projects/0cbbf29564fe48f589783de672d0d7f5` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:15.101742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44437509-a67d-446a-b78c-80ae5e7d1c69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cbbf29564fe48f589783de672d0d7f5)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:15.103703 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44437509-a67d-446a-b78c-80ae5e7d1c69 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:15.232260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-44437509-a67d-446a-b78c-80ae5e7d1c69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cbbf29564fe48f589783de672d0d7f5', 'request_id': 'req-44437509-a67d-446a-b78c-80ae5e7d1c69'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:15.247126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-44437509-a67d-446a-b78c-80ae5e7d1c69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cbbf29564fe48f589783de672d0d7f5', 'request_id': 'req-44437509-a67d-446a-b78c-80ae5e7d1c69'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:15.264635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-44437509-a67d-446a-b78c-80ae5e7d1c69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cbbf29564fe48f589783de672d0d7f5', 'request_id': 'req-44437509-a67d-446a-b78c-80ae5e7d1c69'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:15.293743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-44437509-a67d-446a-b78c-80ae5e7d1c69 admin admin] The token cache is being invalidate because project 0cbbf29564fe48f589783de672d0d7f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:15.294592 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-44437509-a67d-446a-b78c-80ae5e7d1c69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:15.295586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-44437509-a67d-446a-b78c-80ae5e7d1c69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:15.297433 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2527/5033] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:15 2022] DELETE /identity/v3/projects/0cbbf29564fe48f589783de672d0d7f5 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:15.308408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f1b50-fa46-485c-9923-eba1f013fda8 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:15.308881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f1b50-fa46-485c-9923-eba1f013fda8 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:15.308980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f1b50-fa46-485c-9923-eba1f013fda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:15.409022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-327f1b50-fa46-485c-9923-eba1f013fda8 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:15.410623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-327f1b50-fa46-485c-9923-eba1f013fda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:15.535703 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:15.621288 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2507/5034] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:15.629918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a27e2c-06b6-4c15-b059-a5b946c98234 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:15.630436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a27e2c-06b6-4c15-b059-a5b946c98234 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:15.630866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a27e2c-06b6-4c15-b059-a5b946c98234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:15.732949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-17a27e2c-06b6-4c15-b059-a5b946c98234 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:15.738044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-17a27e2c-06b6-4c15-b059-a5b946c98234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:15.765136 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2528/5035] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:15.768403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f1b50-fa46-485c-9923-eba1f013fda8 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:15.790196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f1b50-fa46-485c-9923-eba1f013fda8 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:15.807105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafff01-fdf6-436a-bfb2-59ea7d148941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:15.807105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafff01-fdf6-436a-bfb2-59ea7d148941 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:15.807105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafff01-fdf6-436a-bfb2-59ea7d148941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:15.807105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafff01-fdf6-436a-bfb2-59ea7d148941 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:15.807417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edafff01-fdf6-436a-bfb2-59ea7d148941 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:34:15.807417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edafff01-fdf6-436a-bfb2-59ea7d148941 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:15.825026 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edafff01-fdf6-436a-bfb2-59ea7d148941 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:15.854032 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2508/5036] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:34:15.858584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a27e2c-06b6-4c15-b059-a5b946c98234 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:15.870585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a27e2c-06b6-4c15-b059-a5b946c98234 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:15.880121 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f7a29-4343-4bf5-a1ed-d2c5e56a12b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:15.880759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f7a29-4343-4bf5-a1ed-d2c5e56a12b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:15.881038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f7a29-4343-4bf5-a1ed-d2c5e56a12b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:15.881304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f7a29-4343-4bf5-a1ed-d2c5e56a12b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:15.882199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f7a29-4343-4bf5-a1ed-d2c5e56a12b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:15.884392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f7a29-4343-4bf5-a1ed-d2c5e56a12b4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:15.931031 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2529/5037] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:34:15 2022] POST /identity/v3/projects => generated 387 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:15.935667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafff01-fdf6-436a-bfb2-59ea7d148941 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:15.959989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafff01-fdf6-436a-bfb2-59ea7d148941 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:16.070293 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1a86f-5edc-4410-8bf3-e2ebc3b7d33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:16.104203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1a86f-5edc-4410-8bf3-e2ebc3b7d33d admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:16.104507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1a86f-5edc-4410-8bf3-e2ebc3b7d33d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:16.105720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1a86f-5edc-4410-8bf3-e2ebc3b7d33d admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:16.107958 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb1a86f-5edc-4410-8bf3-e2ebc3b7d33d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:16.113532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb1a86f-5edc-4410-8bf3-e2ebc3b7d33d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:16.156550 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2509/5038] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:34:15 2022] POST /identity/v3/users => generated 300 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:16.161341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f7a29-4343-4bf5-a1ed-d2c5e56a12b4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:16.181665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f7a29-4343-4bf5-a1ed-d2c5e56a12b4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:16.190776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274fe43-b326-498e-a900-bcd94ea4a03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:16.192108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274fe43-b326-498e-a900-bcd94ea4a03e admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:16.192544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274fe43-b326-498e-a900-bcd94ea4a03e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:16.192965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274fe43-b326-498e-a900-bcd94ea4a03e admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:16.194020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274fe43-b326-498e-a900-bcd94ea4a03e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:16.196058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274fe43-b326-498e-a900-bcd94ea4a03e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:16.210983 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2530/5039] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:34:16.216318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1a86f-5edc-4410-8bf3-e2ebc3b7d33d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:16.272547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1a86f-5edc-4410-8bf3-e2ebc3b7d33d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:16.286089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954ec72-23fc-4be7-aaaf-f0e6a7ab557d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:16.286988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954ec72-23fc-4be7-aaaf-f0e6a7ab557d admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:16.287897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954ec72-23fc-4be7-aaaf-f0e6a7ab557d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:16.288468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954ec72-23fc-4be7-aaaf-f0e6a7ab557d admin admin] PATH_INFO: `/v3/projects/a9abdc69565041339d5edf123a79d2e0/users/f288c13436204791990bb573becb9b48/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:16.328531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954ec72-23fc-4be7-aaaf-f0e6a7ab557d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9abdc69565041339d5edf123a79d2e0, user_id=f288c13436204791990bb573becb9b48, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:16.334253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954ec72-23fc-4be7-aaaf-f0e6a7ab557d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:16.366923 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2510/5040] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:34:16 2022] PUT /identity/v3/projects/a9abdc69565041339d5edf123a79d2e0/users/f288c13436204791990bb573becb9b48/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:16.369898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274fe43-b326-498e-a900-bcd94ea4a03e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:16.386562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274fe43-b326-498e-a900-bcd94ea4a03e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:16.505905 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:16.529372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb7aae3-8410-4496-935f-591262e68482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:16.530482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7aae3-8410-4496-935f-591262e68482 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:16.530934 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7aae3-8410-4496-935f-591262e68482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:16.531425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb7aae3-8410-4496-935f-591262e68482 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:16.532396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7aae3-8410-4496-935f-591262e68482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:16.534722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb7aae3-8410-4496-935f-591262e68482 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:16.556633 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2531/5041] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:16.561318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954ec72-23fc-4be7-aaaf-f0e6a7ab557d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:16.579028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954ec72-23fc-4be7-aaaf-f0e6a7ab557d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:16.599494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6076d4-77e9-45f8-b21a-a7b35e78c06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:16.601086 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6076d4-77e9-45f8-b21a-a7b35e78c06a admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:16.601694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6076d4-77e9-45f8-b21a-a7b35e78c06a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:16.602130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6076d4-77e9-45f8-b21a-a7b35e78c06a admin admin] PATH_INFO: `/v3/projects/a9abdc69565041339d5edf123a79d2e0/users/f288c13436204791990bb573becb9b48/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:16.606778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6076d4-77e9-45f8-b21a-a7b35e78c06a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9abdc69565041339d5edf123a79d2e0, user_id=f288c13436204791990bb573becb9b48, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:16.617810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6076d4-77e9-45f8-b21a-a7b35e78c06a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:16.660912 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2511/5042] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:34:16 2022] PUT /identity/v3/projects/a9abdc69565041339d5edf123a79d2e0/users/f288c13436204791990bb573becb9b48/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:34:16.663726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4dea3-04a9-4060-98d5-31e0969ab05b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:16.664045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4dea3-04a9-4060-98d5-31e0969ab05b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:16.664318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4dea3-04a9-4060-98d5-31e0969ab05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:16.714273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffc9ca-f247-4d42-8a02-e82ad6f35942 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:16.714562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffc9ca-f247-4d42-8a02-e82ad6f35942 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:16.714849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffc9ca-f247-4d42-8a02-e82ad6f35942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:16.752847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-a5ffc9ca-f247-4d42-8a02-e82ad6f35942 None None] MFA Rules not processed for user `063427be95f64488bfa71df1f90e1400`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:16.754570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a5ffc9ca-f247-4d42-8a02-e82ad6f35942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:16.764046 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5df4dea3-04a9-4060-98d5-31e0969ab05b None None] MFA Rules not processed for user `f288c13436204791990bb573becb9b48`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:16.766210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5df4dea3-04a9-4060-98d5-31e0969ab05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:16.880579 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2532/5043] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:16 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:16.887060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4dea3-04a9-4060-98d5-31e0969ab05b None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:16.899854 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2512/5044] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:16.901547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffc9ca-f247-4d42-8a02-e82ad6f35942 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:16.909636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a5ffc9ca-f247-4d42-8a02-e82ad6f35942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:16.919858 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:17.011911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4dea3-04a9-4060-98d5-31e0969ab05b None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:17.020968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954e3f6-e10a-4c74-864d-1afb89795560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:17.037223 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954e3f6-e10a-4c74-864d-1afb89795560 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:17.037579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954e3f6-e10a-4c74-864d-1afb89795560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:17.037880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954e3f6-e10a-4c74-864d-1afb89795560 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:17.042276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6954e3f6-e10a-4c74-864d-1afb89795560 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:17.059962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6954e3f6-e10a-4c74-864d-1afb89795560 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:17.131253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffc9ca-f247-4d42-8a02-e82ad6f35942 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:17.147734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826a9af-0db2-42e8-a3a4-6fc2feb8ff83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:17.148581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826a9af-0db2-42e8-a3a4-6fc2feb8ff83 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:17.148856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826a9af-0db2-42e8-a3a4-6fc2feb8ff83 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:17.149124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826a9af-0db2-42e8-a3a4-6fc2feb8ff83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:17.165242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826a9af-0db2-42e8-a3a4-6fc2feb8ff83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:17.167220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826a9af-0db2-42e8-a3a4-6fc2feb8ff83 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:17.169051 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2533/5045] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:34:16 2022] POST /identity/v3/projects => generated 387 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:17.174264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954e3f6-e10a-4c74-864d-1afb89795560 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:17.182552 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2513/5046] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:34:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:34:17.323225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954e3f6-e10a-4c74-864d-1afb89795560 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:17.341061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff9abd-5f4a-42b6-8b4e-1f3adef30a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:17.344377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff9abd-5f4a-42b6-8b4e-1f3adef30a5d admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:17.345173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff9abd-5f4a-42b6-8b4e-1f3adef30a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:17.346356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff9abd-5f4a-42b6-8b4e-1f3adef30a5d admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:17.349184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff9abd-5f4a-42b6-8b4e-1f3adef30a5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:17.355725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff9abd-5f4a-42b6-8b4e-1f3adef30a5d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:17.380480 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:17.421156 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2534/5047] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:34:17 2022] POST /identity/v3/users => generated 294 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:17.424843 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826a9af-0db2-42e8-a3a4-6fc2feb8ff83 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:17.445659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826a9af-0db2-42e8-a3a4-6fc2feb8ff83 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:17.451156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77741dea-796b-4396-aac1-c3faabd74769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:17.452036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77741dea-796b-4396-aac1-c3faabd74769 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:17.452411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77741dea-796b-4396-aac1-c3faabd74769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:17.452794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77741dea-796b-4396-aac1-c3faabd74769 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:17.453565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77741dea-796b-4396-aac1-c3faabd74769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:17.456028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77741dea-796b-4396-aac1-c3faabd74769 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:17.475928 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2514/5048] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:17.479157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff9abd-5f4a-42b6-8b4e-1f3adef30a5d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:17.493571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff9abd-5f4a-42b6-8b4e-1f3adef30a5d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:17.533885 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fc280-b2e4-4590-bc91-383efcca03c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:17.533885 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fc280-b2e4-4590-bc91-383efcca03c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:17.533885 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fc280-b2e4-4590-bc91-383efcca03c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:17.533885 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fc280-b2e4-4590-bc91-383efcca03c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:17.534708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4fc280-b2e4-4590-bc91-383efcca03c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:17.534708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4fc280-b2e4-4590-bc91-383efcca03c0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:17.567796 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2535/5049] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:17.570587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77741dea-796b-4396-aac1-c3faabd74769 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:17.585672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77741dea-796b-4396-aac1-c3faabd74769 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:17.608783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955c28e-17c2-4bac-bfb6-b4b8f2448b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:17.609461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955c28e-17c2-4bac-bfb6-b4b8f2448b41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:17.609769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955c28e-17c2-4bac-bfb6-b4b8f2448b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:17.610008 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955c28e-17c2-4bac-bfb6-b4b8f2448b41 admin admin] PATH_INFO: `/v3/projects/7eab33cd433e4886a78b8bfe8d933ffe/users/0b1796b699104bf3890d62f2b4161919/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:17.646872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955c28e-17c2-4bac-bfb6-b4b8f2448b41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eab33cd433e4886a78b8bfe8d933ffe, user_id=0b1796b699104bf3890d62f2b4161919, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:17.650158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955c28e-17c2-4bac-bfb6-b4b8f2448b41 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:17.689746 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2515/5050] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:34:17 2022] PUT /identity/v3/projects/7eab33cd433e4886a78b8bfe8d933ffe/users/0b1796b699104bf3890d62f2b4161919/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:17.701183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b36578-f7d7-43e8-b4f4-ef6e0839f96d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:17.701531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b36578-f7d7-43e8-b4f4-ef6e0839f96d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:17.701707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b36578-f7d7-43e8-b4f4-ef6e0839f96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:17.779297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b5b36578-f7d7-43e8-b4f4-ef6e0839f96d None None] MFA Rules not processed for user `0b1796b699104bf3890d62f2b4161919`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:17.780810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b5b36578-f7d7-43e8-b4f4-ef6e0839f96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:18.014088 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2536/5051] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:18.031197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955c28e-17c2-4bac-bfb6-b4b8f2448b41 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:18.034351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4955c28e-17c2-4bac-bfb6-b4b8f2448b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:18.205746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955c28e-17c2-4bac-bfb6-b4b8f2448b41 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:18.218210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d97ba-2a76-4521-84e1-11adc8be4a45 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:18.219169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d97ba-2a76-4521-84e1-11adc8be4a45 service glance] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:18.219649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d97ba-2a76-4521-84e1-11adc8be4a45 service glance] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:18.220186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d97ba-2a76-4521-84e1-11adc8be4a45 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:18.299725 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:18.346145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d97ba-2a76-4521-84e1-11adc8be4a45 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:18.348483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d97ba-2a76-4521-84e1-11adc8be4a45 service glance] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:18.362010 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2516/5052] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:34:18 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:34:19.832389 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b36578-f7d7-43e8-b4f4-ef6e0839f96d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:19.938607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b36578-f7d7-43e8-b4f4-ef6e0839f96d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:19.950863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9018b-90a4-40c7-afa1-b02c71cbf552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:19.951531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9018b-90a4-40c7-afa1-b02c71cbf552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:19.956192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9018b-90a4-40c7-afa1-b02c71cbf552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:19.956556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9018b-90a4-40c7-afa1-b02c71cbf552 admin admin] PATH_INFO: `/v3/users/f288c13436204791990bb573becb9b48` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:19.959366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9018b-90a4-40c7-afa1-b02c71cbf552 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f288c13436204791990bb573becb9b48)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:19.967188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9018b-90a4-40c7-afa1-b02c71cbf552 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:20.078672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-07a9018b-90a4-40c7-afa1-b02c71cbf552 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f288c13436204791990bb573becb9b48'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:20.099276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-07a9018b-90a4-40c7-afa1-b02c71cbf552 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f288c13436204791990bb573becb9b48'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:20.122774 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:20.133017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-07a9018b-90a4-40c7-afa1-b02c71cbf552 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f288c13436204791990bb573becb9b48'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:20.134000 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-07a9018b-90a4-40c7-afa1-b02c71cbf552 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f288c13436204791990bb573becb9b48'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:20.146934 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-07a9018b-90a4-40c7-afa1-b02c71cbf552 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f288c13436204791990bb573becb9b48'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:20.157451 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2537/5053] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:34:19 2022] DELETE /identity/v3/users/f288c13436204791990bb573becb9b48 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:20.162449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63064f13-73e2-4954-b2ea-d1688ea0f2dc None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:20.163012 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63064f13-73e2-4954-b2ea-d1688ea0f2dc None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:20.163012 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63064f13-73e2-4954-b2ea-d1688ea0f2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:20.239527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-63064f13-73e2-4954-b2ea-d1688ea0f2dc None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:20.241113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-63064f13-73e2-4954-b2ea-d1688ea0f2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:20.435316 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2517/5054] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:20.501563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9018b-90a4-40c7-afa1-b02c71cbf552 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:20.505999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-07a9018b-90a4-40c7-afa1-b02c71cbf552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:20.527974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63064f13-73e2-4954-b2ea-d1688ea0f2dc None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:20.529499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-63064f13-73e2-4954-b2ea-d1688ea0f2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:20.739866 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63064f13-73e2-4954-b2ea-d1688ea0f2dc None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:20.754001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172d216-89e0-41f3-9cc5-347445d8045b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:20.754600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172d216-89e0-41f3-9cc5-347445d8045b service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:20.754884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172d216-89e0-41f3-9cc5-347445d8045b service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:20.755778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172d216-89e0-41f3-9cc5-347445d8045b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:20.760305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7172d216-89e0-41f3-9cc5-347445d8045b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:20.769755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9018b-90a4-40c7-afa1-b02c71cbf552 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:20.790231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1bf88e-7dec-4c47-bbce-108e0cca1214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:20.790615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bf88e-7dec-4c47-bbce-108e0cca1214 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:20.790962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bf88e-7dec-4c47-bbce-108e0cca1214 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:20.791305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bf88e-7dec-4c47-bbce-108e0cca1214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:20.818568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1bf88e-7dec-4c47-bbce-108e0cca1214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:20.834615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1bf88e-7dec-4c47-bbce-108e0cca1214 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:20.870017 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2538/5055] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:34:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:34:20.892968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1bf88e-7dec-4c47-bbce-108e0cca1214 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:20.898205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-aa1bf88e-7dec-4c47-bbce-108e0cca1214 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:20.926109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1bf88e-7dec-4c47-bbce-108e0cca1214 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:20.938375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9860ee7-7c52-4f80-a896-94b359517db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:20.939060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9860ee7-7c52-4f80-a896-94b359517db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:20.939341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9860ee7-7c52-4f80-a896-94b359517db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:20.939641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9860ee7-7c52-4f80-a896-94b359517db4 admin admin] PATH_INFO: `/v3/users/0a3d46fd03134a16becae95c52ea0b55` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:20.941684 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9860ee7-7c52-4f80-a896-94b359517db4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a3d46fd03134a16becae95c52ea0b55)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:20.943638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9860ee7-7c52-4f80-a896-94b359517db4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:20.987761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172d216-89e0-41f3-9cc5-347445d8045b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:20.989806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172d216-89e0-41f3-9cc5-347445d8045b service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:21.020452 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2518/5056] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:34:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:34:21.043708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e9860ee7-7c52-4f80-a896-94b359517db4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a3d46fd03134a16becae95c52ea0b55'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:21.057600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e9860ee7-7c52-4f80-a896-94b359517db4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a3d46fd03134a16becae95c52ea0b55'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:21.084548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e9860ee7-7c52-4f80-a896-94b359517db4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a3d46fd03134a16becae95c52ea0b55'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:21.085694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e9860ee7-7c52-4f80-a896-94b359517db4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a3d46fd03134a16becae95c52ea0b55'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:21.103742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e9860ee7-7c52-4f80-a896-94b359517db4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a3d46fd03134a16becae95c52ea0b55'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:21.123484 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2539/5057] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:34:20 2022] DELETE /identity/v3/users/0a3d46fd03134a16becae95c52ea0b55 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:21.128019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cc3d3-9ee5-4595-a1f3-be0b6cc7daa6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:21.128368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cc3d3-9ee5-4595-a1f3-be0b6cc7daa6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:21.128597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cc3d3-9ee5-4595-a1f3-be0b6cc7daa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:21.145872 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:21.153925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-982cc3d3-9ee5-4595-a1f3-be0b6cc7daa6 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:21.155148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-982cc3d3-9ee5-4595-a1f3-be0b6cc7daa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:21.239973 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2519/5058] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:21.252003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9860ee7-7c52-4f80-a896-94b359517db4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:21.253576 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e9860ee7-7c52-4f80-a896-94b359517db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:21.348399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9860ee7-7c52-4f80-a896-94b359517db4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:21.353364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807af08-7569-4715-bfa8-97c901fad847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:21.355378 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807af08-7569-4715-bfa8-97c901fad847 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:21.356007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807af08-7569-4715-bfa8-97c901fad847 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:21.356234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807af08-7569-4715-bfa8-97c901fad847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:21.371321 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:21.376894 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807af08-7569-4715-bfa8-97c901fad847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:21.380348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807af08-7569-4715-bfa8-97c901fad847 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:21.414806 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2540/5059] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:34:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:34:22.445781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cc3d3-9ee5-4595-a1f3-be0b6cc7daa6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:22.447941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-982cc3d3-9ee5-4595-a1f3-be0b6cc7daa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:22.474216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cc3d3-9ee5-4595-a1f3-be0b6cc7daa6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:22.503210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757ed95-1e42-4b05-9bc3-76fb21b3e304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:22.504315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757ed95-1e42-4b05-9bc3-76fb21b3e304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:22.504978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757ed95-1e42-4b05-9bc3-76fb21b3e304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:22.505355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757ed95-1e42-4b05-9bc3-76fb21b3e304 admin admin] PATH_INFO: `/v3/projects/a9abdc69565041339d5edf123a79d2e0` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:22.508626 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757ed95-1e42-4b05-9bc3-76fb21b3e304 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9abdc69565041339d5edf123a79d2e0)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:22.510742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757ed95-1e42-4b05-9bc3-76fb21b3e304 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:22.674816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4757ed95-1e42-4b05-9bc3-76fb21b3e304 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9abdc69565041339d5edf123a79d2e0', 'request_id': 'req-4757ed95-1e42-4b05-9bc3-76fb21b3e304'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:22.688650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4757ed95-1e42-4b05-9bc3-76fb21b3e304 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9abdc69565041339d5edf123a79d2e0', 'request_id': 'req-4757ed95-1e42-4b05-9bc3-76fb21b3e304'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:22.705050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4757ed95-1e42-4b05-9bc3-76fb21b3e304 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9abdc69565041339d5edf123a79d2e0', 'request_id': 'req-4757ed95-1e42-4b05-9bc3-76fb21b3e304'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:22.726152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4757ed95-1e42-4b05-9bc3-76fb21b3e304 admin admin] The token cache is being invalidate because project a9abdc69565041339d5edf123a79d2e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:22.726704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4757ed95-1e42-4b05-9bc3-76fb21b3e304 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:22.727588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4757ed95-1e42-4b05-9bc3-76fb21b3e304 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:22.730215 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2520/5060] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:22 2022] DELETE /identity/v3/projects/a9abdc69565041339d5edf123a79d2e0 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:22.735065 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807af08-7569-4715-bfa8-97c901fad847 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:22.756373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807af08-7569-4715-bfa8-97c901fad847 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:22.765292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f29d07-ef23-496a-b9ad-20247f218ae6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:22.765578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f29d07-ef23-496a-b9ad-20247f218ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:22.765857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f29d07-ef23-496a-b9ad-20247f218ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:22.791439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b4f29d07-ef23-496a-b9ad-20247f218ae6 None None] MFA Rules not processed for user `5f0ed400a2cb48cbbc9fa5bae0e2b1c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:22.793849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b4f29d07-ef23-496a-b9ad-20247f218ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:22.853986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2363ed-ea33-4e2c-ac09-c7cf472aeb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:22.855503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2363ed-ea33-4e2c-ac09-c7cf472aeb59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:22.855934 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2363ed-ea33-4e2c-ac09-c7cf472aeb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:22.856267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2363ed-ea33-4e2c-ac09-c7cf472aeb59 admin admin] PATH_INFO: `/v3/users/0b1796b699104bf3890d62f2b4161919` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:22.857507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2363ed-ea33-4e2c-ac09-c7cf472aeb59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b1796b699104bf3890d62f2b4161919)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:22.860365 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2363ed-ea33-4e2c-ac09-c7cf472aeb59 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:22.881248 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2521/5061] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:22.970155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2b2363ed-ea33-4e2c-ac09-c7cf472aeb59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b1796b699104bf3890d62f2b4161919'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:22.996554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2b2363ed-ea33-4e2c-ac09-c7cf472aeb59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b1796b699104bf3890d62f2b4161919'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:23.015054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2b2363ed-ea33-4e2c-ac09-c7cf472aeb59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b1796b699104bf3890d62f2b4161919'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:23.016575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2b2363ed-ea33-4e2c-ac09-c7cf472aeb59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b1796b699104bf3890d62f2b4161919'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:23.033651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2b2363ed-ea33-4e2c-ac09-c7cf472aeb59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b1796b699104bf3890d62f2b4161919'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:23.047854 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2541/5062] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:34:22 2022] DELETE /identity/v3/users/0b1796b699104bf3890d62f2b4161919 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:23.312316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f29d07-ef23-496a-b9ad-20247f218ae6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:23.314279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b4f29d07-ef23-496a-b9ad-20247f218ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:23.356799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f29d07-ef23-496a-b9ad-20247f218ae6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:23.437978 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:23.505390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a877bd-544e-4cf6-8e53-c920fa9fc90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:23.506520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a877bd-544e-4cf6-8e53-c920fa9fc90e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:23.506802 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a877bd-544e-4cf6-8e53-c920fa9fc90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:23.507074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a877bd-544e-4cf6-8e53-c920fa9fc90e admin admin] PATH_INFO: `/v3/projects/859b28071c284ab292ba507e96df8d3f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:23.512668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a877bd-544e-4cf6-8e53-c920fa9fc90e admin admin] RBAC: Authorizing `identity:delete_project(project_id=859b28071c284ab292ba507e96df8d3f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:23.514391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a877bd-544e-4cf6-8e53-c920fa9fc90e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:23.600967 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b5a877bd-544e-4cf6-8e53-c920fa9fc90e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '859b28071c284ab292ba507e96df8d3f', 'request_id': 'req-b5a877bd-544e-4cf6-8e53-c920fa9fc90e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:23.607897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b5a877bd-544e-4cf6-8e53-c920fa9fc90e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '859b28071c284ab292ba507e96df8d3f', 'request_id': 'req-b5a877bd-544e-4cf6-8e53-c920fa9fc90e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:23.616299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b5a877bd-544e-4cf6-8e53-c920fa9fc90e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '859b28071c284ab292ba507e96df8d3f', 'request_id': 'req-b5a877bd-544e-4cf6-8e53-c920fa9fc90e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:23.634070 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b5a877bd-544e-4cf6-8e53-c920fa9fc90e admin admin] The token cache is being invalidate because project 859b28071c284ab292ba507e96df8d3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:23.634512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b5a877bd-544e-4cf6-8e53-c920fa9fc90e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:23.636439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b5a877bd-544e-4cf6-8e53-c920fa9fc90e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:23.642562 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2522/5063] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:23 2022] DELETE /identity/v3/projects/859b28071c284ab292ba507e96df8d3f => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:23.643773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e95174-c6ef-4660-910b-9aec500e0ec9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:23.644198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e95174-c6ef-4660-910b-9aec500e0ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:23.644570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e95174-c6ef-4660-910b-9aec500e0ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:23.742764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-71e95174-c6ef-4660-910b-9aec500e0ec9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:23.744077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-71e95174-c6ef-4660-910b-9aec500e0ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:23.831952 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:23.871509 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2542/5064] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:34:23.874519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b2341-13e0-40cb-80dd-dd4c36e85ddf None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:23.875054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b2341-13e0-40cb-80dd-dd4c36e85ddf None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:23.875586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b2341-13e0-40cb-80dd-dd4c36e85ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:23.940838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-540b2341-13e0-40cb-80dd-dd4c36e85ddf None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:23.942414 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-540b2341-13e0-40cb-80dd-dd4c36e85ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:23.973829 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2523/5065] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:23.977293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e95174-c6ef-4660-910b-9aec500e0ec9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:24.007143 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e95174-c6ef-4660-910b-9aec500e0ec9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:24.019329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025f411-7122-4d49-8f10-a51ecf6c30b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:24.024226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025f411-7122-4d49-8f10-a51ecf6c30b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:24.024714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025f411-7122-4d49-8f10-a51ecf6c30b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:24.025333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025f411-7122-4d49-8f10-a51ecf6c30b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:24.026255 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025f411-7122-4d49-8f10-a51ecf6c30b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:34:24.026714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025f411-7122-4d49-8f10-a51ecf6c30b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:24.028729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025f411-7122-4d49-8f10-a51ecf6c30b1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:24.074920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b2341-13e0-40cb-80dd-dd4c36e85ddf None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:24.076258 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2543/5066] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:34:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:34:24.091526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b2341-13e0-40cb-80dd-dd4c36e85ddf None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:24.131003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf3807-a37e-4503-8634-3749ea6d7c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:24.131637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf3807-a37e-4503-8634-3749ea6d7c84 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:24.131933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf3807-a37e-4503-8634-3749ea6d7c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:24.132213 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf3807-a37e-4503-8634-3749ea6d7c84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:24.132852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf3807-a37e-4503-8634-3749ea6d7c84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:24.134769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf3807-a37e-4503-8634-3749ea6d7c84 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:24.244408 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2524/5067] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:34:24 2022] POST /identity/v3/projects => generated 387 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:34:24.245621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025f411-7122-4d49-8f10-a51ecf6c30b1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:24.263947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025f411-7122-4d49-8f10-a51ecf6c30b1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:24.451812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167104a8-b717-4109-970c-9e8c06a7bca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:24.458136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167104a8-b717-4109-970c-9e8c06a7bca3 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:24.460574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167104a8-b717-4109-970c-9e8c06a7bca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:24.461248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167104a8-b717-4109-970c-9e8c06a7bca3 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:24.462378 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167104a8-b717-4109-970c-9e8c06a7bca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:24.474226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167104a8-b717-4109-970c-9e8c06a7bca3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:24.542789 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf3807-a37e-4503-8634-3749ea6d7c84 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:24.548517 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2544/5068] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:34:24 2022] POST /identity/v3/users => generated 294 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:34:24.553686 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf3807-a37e-4503-8634-3749ea6d7c84 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:24.559526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2946ab-0eea-48f7-abfd-9cd868fddd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:24.560575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2946ab-0eea-48f7-abfd-9cd868fddd6f admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:24.561117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2946ab-0eea-48f7-abfd-9cd868fddd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:24.561555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2946ab-0eea-48f7-abfd-9cd868fddd6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:24.562363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2946ab-0eea-48f7-abfd-9cd868fddd6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:24.564594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2946ab-0eea-48f7-abfd-9cd868fddd6f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:24.581362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167104a8-b717-4109-970c-9e8c06a7bca3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:24.581863 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2525/5069] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:24.605318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167104a8-b717-4109-970c-9e8c06a7bca3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:24.624205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4a9c4-aa75-4b6b-993b-a473a5bd249f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:24.624860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4a9c4-aa75-4b6b-993b-a473a5bd249f admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:24.625137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4a9c4-aa75-4b6b-993b-a473a5bd249f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:24.625407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4a9c4-aa75-4b6b-993b-a473a5bd249f admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:24.626068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4a9c4-aa75-4b6b-993b-a473a5bd249f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:24.627727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4a9c4-aa75-4b6b-993b-a473a5bd249f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:24.680490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2946ab-0eea-48f7-abfd-9cd868fddd6f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:24.686854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-dc2946ab-0eea-48f7-abfd-9cd868fddd6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:24.692746 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2545/5070] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:24.693673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4a9c4-aa75-4b6b-993b-a473a5bd249f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:24.721551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4a9c4-aa75-4b6b-993b-a473a5bd249f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:24.728339 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2946ab-0eea-48f7-abfd-9cd868fddd6f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:24.757713 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034d399-26cc-43e1-b7d6-4f080c053c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:24.758402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034d399-26cc-43e1-b7d6-4f080c053c1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:24.758680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034d399-26cc-43e1-b7d6-4f080c053c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:24.758952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034d399-26cc-43e1-b7d6-4f080c053c1c admin admin] PATH_INFO: `/v3/projects/e05503a9d18e4b21b0988a0b03c57f5b/users/1eff192966e3494da2b7a64c2a89539a/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:24.768147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6ec17-1fe7-420b-b654-038752d38599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:24.768822 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6ec17-1fe7-420b-b654-038752d38599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:24.769104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6ec17-1fe7-420b-b654-038752d38599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:24.769379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6ec17-1fe7-420b-b654-038752d38599 admin admin] PATH_INFO: `/v3/projects/7eab33cd433e4886a78b8bfe8d933ffe` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:24.778313 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6ec17-1fe7-420b-b654-038752d38599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eab33cd433e4886a78b8bfe8d933ffe)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:24.780314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6ec17-1fe7-420b-b654-038752d38599 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:24.872965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034d399-26cc-43e1-b7d6-4f080c053c1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e05503a9d18e4b21b0988a0b03c57f5b, user_id=1eff192966e3494da2b7a64c2a89539a, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:24.875624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034d399-26cc-43e1-b7d6-4f080c053c1c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:24.935488 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2546/5071] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:34:24 2022] PUT /identity/v3/projects/e05503a9d18e4b21b0988a0b03c57f5b/users/1eff192966e3494da2b7a64c2a89539a/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:24.968018 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f462b7c-1669-4a49-99f4-6b0526e49573 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:24.981977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f462b7c-1669-4a49-99f4-6b0526e49573 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:24.982579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f462b7c-1669-4a49-99f4-6b0526e49573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:25.006794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bcb6ec17-1fe7-420b-b654-038752d38599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eab33cd433e4886a78b8bfe8d933ffe', 'request_id': 'req-bcb6ec17-1fe7-420b-b654-038752d38599'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:25.021167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bcb6ec17-1fe7-420b-b654-038752d38599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eab33cd433e4886a78b8bfe8d933ffe', 'request_id': 'req-bcb6ec17-1fe7-420b-b654-038752d38599'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:25.038855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bcb6ec17-1fe7-420b-b654-038752d38599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eab33cd433e4886a78b8bfe8d933ffe', 'request_id': 'req-bcb6ec17-1fe7-420b-b654-038752d38599'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:25.059841 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:25.091027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bcb6ec17-1fe7-420b-b654-038752d38599 admin admin] The token cache is being invalidate because project 7eab33cd433e4886a78b8bfe8d933ffe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:25.091321 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bcb6ec17-1fe7-420b-b654-038752d38599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:25.101172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2f462b7c-1669-4a49-99f4-6b0526e49573 None None] MFA Rules not processed for user `1eff192966e3494da2b7a64c2a89539a`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:25.105543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2f462b7c-1669-4a49-99f4-6b0526e49573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:25.110116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bcb6ec17-1fe7-420b-b654-038752d38599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:25.118188 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2526/5072] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:24 2022] DELETE /identity/v3/projects/7eab33cd433e4886a78b8bfe8d933ffe => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:25.120511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb9d08-e042-4d13-91f4-0bfc2915fb6a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:25.120977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb9d08-e042-4d13-91f4-0bfc2915fb6a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:25.121630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb9d08-e042-4d13-91f4-0bfc2915fb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:25.222910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-82fb9d08-e042-4d13-91f4-0bfc2915fb6a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:25.236385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-82fb9d08-e042-4d13-91f4-0bfc2915fb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:25.365630 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2547/5073] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:25.369451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f462b7c-1669-4a49-99f4-6b0526e49573 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:25.372004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2f462b7c-1669-4a49-99f4-6b0526e49573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:25.438145 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:25.467788 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2527/5074] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:25.477100 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ee2d6-ff57-4ddc-a1e3-515460f1a3f5 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:25.477562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ee2d6-ff57-4ddc-a1e3-515460f1a3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:25.477993 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ee2d6-ff57-4ddc-a1e3-515460f1a3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:25.537349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0c8ee2d6-ff57-4ddc-a1e3-515460f1a3f5 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:25.539636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0c8ee2d6-ff57-4ddc-a1e3-515460f1a3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:25.553427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f462b7c-1669-4a49-99f4-6b0526e49573 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:25.565676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99771c6f-3014-4f4f-838a-6c32f093a210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:25.566608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99771c6f-3014-4f4f-838a-6c32f093a210 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:25.566986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99771c6f-3014-4f4f-838a-6c32f093a210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:25.567640 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99771c6f-3014-4f4f-838a-6c32f093a210 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:25.568533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99771c6f-3014-4f4f-838a-6c32f093a210 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:25.569671 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2528/5075] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:25.573836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99771c6f-3014-4f4f-838a-6c32f093a210 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:25.575256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ee2d6-ff57-4ddc-a1e3-515460f1a3f5 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:25.610538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ee2d6-ff57-4ddc-a1e3-515460f1a3f5 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:25.632937 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d2cbe-523e-477e-b530-d061032ceb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:25.633645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d2cbe-523e-477e-b530-d061032ceb6f admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:25.633922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d2cbe-523e-477e-b530-d061032ceb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:25.634375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d2cbe-523e-477e-b530-d061032ceb6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:25.635245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d2cbe-523e-477e-b530-d061032ceb6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:34:25.636379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d2cbe-523e-477e-b530-d061032ceb6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:25.638373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d2cbe-523e-477e-b530-d061032ceb6f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:25.677886 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2548/5076] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:34:25 2022] POST /identity/v3/projects => generated 387 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:25.682112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99771c6f-3014-4f4f-838a-6c32f093a210 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:25.695356 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2529/5077] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:34:25.696043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d2cbe-523e-477e-b530-d061032ceb6f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:25.745628 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d2cbe-523e-477e-b530-d061032ceb6f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:25.850619 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99771c6f-3014-4f4f-838a-6c32f093a210 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:25.881704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb697591-0f8d-4a83-bf87-06cb02313374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:25.882395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb697591-0f8d-4a83-bf87-06cb02313374 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:25.882690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb697591-0f8d-4a83-bf87-06cb02313374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:25.882989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb697591-0f8d-4a83-bf87-06cb02313374 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:25.884128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb697591-0f8d-4a83-bf87-06cb02313374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:25.886127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb697591-0f8d-4a83-bf87-06cb02313374 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:25.949310 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2549/5078] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:34:25 2022] POST /identity/v3/users => generated 300 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:25.957420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb697591-0f8d-4a83-bf87-06cb02313374 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:25.986890 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb697591-0f8d-4a83-bf87-06cb02313374 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:25.992906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9631402-96d9-43d8-916c-4d534d6e1239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:25.994639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9631402-96d9-43d8-916c-4d534d6e1239 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:25.995725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9631402-96d9-43d8-916c-4d534d6e1239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:25.996215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9631402-96d9-43d8-916c-4d534d6e1239 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:25.997059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9631402-96d9-43d8-916c-4d534d6e1239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:25.999169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9631402-96d9-43d8-916c-4d534d6e1239 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:26.012463 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2550/5079] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:26.017860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9631402-96d9-43d8-916c-4d534d6e1239 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:26.029629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9631402-96d9-43d8-916c-4d534d6e1239 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:26.035287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debba394-6f6c-4816-a5da-ebdfdc350c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:26.036538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debba394-6f6c-4816-a5da-ebdfdc350c22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:26.037232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debba394-6f6c-4816-a5da-ebdfdc350c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:26.037805 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debba394-6f6c-4816-a5da-ebdfdc350c22 admin admin] PATH_INFO: `/v3/projects/2ea03881325c425cb422d0d4fe00eb50/users/4c3e5b23f2e64bed8503bbf7ab3c7226/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:26.059376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debba394-6f6c-4816-a5da-ebdfdc350c22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea03881325c425cb422d0d4fe00eb50, user_id=4c3e5b23f2e64bed8503bbf7ab3c7226, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:26.062846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debba394-6f6c-4816-a5da-ebdfdc350c22 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:26.084333 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2551/5080] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:34:26 2022] PUT /identity/v3/projects/2ea03881325c425cb422d0d4fe00eb50/users/4c3e5b23f2e64bed8503bbf7ab3c7226/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:26.098555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee9036-9892-4cae-bf8b-12e0ae7268e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:26.099134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee9036-9892-4cae-bf8b-12e0ae7268e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:26.099369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debba394-6f6c-4816-a5da-ebdfdc350c22 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:26.099485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee9036-9892-4cae-bf8b-12e0ae7268e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:26.099674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee9036-9892-4cae-bf8b-12e0ae7268e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:26.100364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee9036-9892-4cae-bf8b-12e0ae7268e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:26.102454 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee9036-9892-4cae-bf8b-12e0ae7268e5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:26.169075 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2530/5081] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:34:25 2022] POST /identity/v3/projects => generated 385 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:26.173101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee9036-9892-4cae-bf8b-12e0ae7268e5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:26.209303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debba394-6f6c-4816-a5da-ebdfdc350c22 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:26.216378 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:26.289536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854cf9b-435d-47b5-87ae-da50f57eb657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:26.290466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854cf9b-435d-47b5-87ae-da50f57eb657 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:26.290948 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854cf9b-435d-47b5-87ae-da50f57eb657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:26.291418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854cf9b-435d-47b5-87ae-da50f57eb657 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:26.293356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854cf9b-435d-47b5-87ae-da50f57eb657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:26.295340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854cf9b-435d-47b5-87ae-da50f57eb657 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:26.312158 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2552/5082] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:26.314085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2d7d9-9507-4c8a-a7fe-8c417fcfec35 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:26.315078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2d7d9-9507-4c8a-a7fe-8c417fcfec35 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:26.315787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2d7d9-9507-4c8a-a7fe-8c417fcfec35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:26.346481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-dca2d7d9-9507-4c8a-a7fe-8c417fcfec35 None None] MFA Rules not processed for user `d556a8ae0d524894a93203ce3f70d420`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:26.348572 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dca2d7d9-9507-4c8a-a7fe-8c417fcfec35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:26.381112 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee9036-9892-4cae-bf8b-12e0ae7268e5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:26.405617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce60429-4cd1-4d24-9c2a-0cbd62fc9243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:26.406227 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce60429-4cd1-4d24-9c2a-0cbd62fc9243 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:26.406517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce60429-4cd1-4d24-9c2a-0cbd62fc9243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:26.406787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce60429-4cd1-4d24-9c2a-0cbd62fc9243 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:26.407424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce60429-4cd1-4d24-9c2a-0cbd62fc9243 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:26.411280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce60429-4cd1-4d24-9c2a-0cbd62fc9243 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:26.445466 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2553/5083] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:26.450337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2d7d9-9507-4c8a-a7fe-8c417fcfec35 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:26.462144 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:26.477816 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2531/5084] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:34:26 2022] POST /identity/v3/users => generated 293 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:26.478953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce60429-4cd1-4d24-9c2a-0cbd62fc9243 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:26.482421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2d7d9-9507-4c8a-a7fe-8c417fcfec35 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:26.495940 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28f028-9558-4275-bf06-50ab46b33452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:26.497463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28f028-9558-4275-bf06-50ab46b33452 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:26.498399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28f028-9558-4275-bf06-50ab46b33452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:26.499268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28f028-9558-4275-bf06-50ab46b33452 admin admin] PATH_INFO: `/v3/projects/2ea03881325c425cb422d0d4fe00eb50/users/4c3e5b23f2e64bed8503bbf7ab3c7226/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:26.500109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce60429-4cd1-4d24-9c2a-0cbd62fc9243 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:26.506618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28f028-9558-4275-bf06-50ab46b33452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea03881325c425cb422d0d4fe00eb50, user_id=4c3e5b23f2e64bed8503bbf7ab3c7226, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:26.514248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28f028-9558-4275-bf06-50ab46b33452 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:26.517835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c4e1e-3f9b-47bb-bb63-73a86caddf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:26.518702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c4e1e-3f9b-47bb-bb63-73a86caddf71 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:26.519126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c4e1e-3f9b-47bb-bb63-73a86caddf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:26.519555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c4e1e-3f9b-47bb-bb63-73a86caddf71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:26.520400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c4e1e-3f9b-47bb-bb63-73a86caddf71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:26.522849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c4e1e-3f9b-47bb-bb63-73a86caddf71 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:26.543856 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2554/5085] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:34:26 2022] PUT /identity/v3/projects/2ea03881325c425cb422d0d4fe00eb50/users/4c3e5b23f2e64bed8503bbf7ab3c7226/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:26.556626 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2532/5086] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:26.559992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955283a-88b0-4277-8e01-66012ee45b0c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:26.560821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955283a-88b0-4277-8e01-66012ee45b0c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:26.561113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955283a-88b0-4277-8e01-66012ee45b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:26.561345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c4e1e-3f9b-47bb-bb63-73a86caddf71 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:26.580850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c4e1e-3f9b-47bb-bb63-73a86caddf71 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:26.724484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3955283a-88b0-4277-8e01-66012ee45b0c None None] MFA Rules not processed for user `4c3e5b23f2e64bed8503bbf7ab3c7226`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:26.727022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3955283a-88b0-4277-8e01-66012ee45b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:26.732881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9e493-b085-4345-8848-8aac07c35b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:26.733519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9e493-b085-4345-8848-8aac07c35b5a admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:26.733792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9e493-b085-4345-8848-8aac07c35b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:26.734063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9e493-b085-4345-8848-8aac07c35b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:26.734724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9e493-b085-4345-8848-8aac07c35b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:26.736420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9e493-b085-4345-8848-8aac07c35b5a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:26.758320 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2533/5087] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:26.759724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9e493-b085-4345-8848-8aac07c35b5a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:26.786677 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9e493-b085-4345-8848-8aac07c35b5a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:26.803614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d566b-92aa-4a95-80ef-8f1c6efb64fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:26.804580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d566b-92aa-4a95-80ef-8f1c6efb64fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:26.805044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d566b-92aa-4a95-80ef-8f1c6efb64fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:26.805471 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d566b-92aa-4a95-80ef-8f1c6efb64fa admin admin] PATH_INFO: `/v3/projects/f5742c47b19344ba811ab98d6a5eb047/users/afeda3135cdd4a5eb8f5a4d3254fc724/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:26.847632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d566b-92aa-4a95-80ef-8f1c6efb64fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5742c47b19344ba811ab98d6a5eb047, user_id=afeda3135cdd4a5eb8f5a4d3254fc724, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:26.850699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d566b-92aa-4a95-80ef-8f1c6efb64fa admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:26.875945 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2534/5088] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:34:26 2022] PUT /identity/v3/projects/f5742c47b19344ba811ab98d6a5eb047/users/afeda3135cdd4a5eb8f5a4d3254fc724/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:26.886533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61565bdc-b507-4ba4-9bb7-71ed0033ade7 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:26.887088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61565bdc-b507-4ba4-9bb7-71ed0033ade7 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:26.887517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61565bdc-b507-4ba4-9bb7-71ed0033ade7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:26.945486 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2555/5089] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:26 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:26.949559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-61565bdc-b507-4ba4-9bb7-71ed0033ade7 None None] MFA Rules not processed for user `afeda3135cdd4a5eb8f5a4d3254fc724`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:26.949868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955283a-88b0-4277-8e01-66012ee45b0c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:26.960788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-61565bdc-b507-4ba4-9bb7-71ed0033ade7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:26.991189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955283a-88b0-4277-8e01-66012ee45b0c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:27.002962 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:27.074788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b21b2-131f-4f0d-88f5-02b00b139469 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c3e5b23f2e64bed8503bbf7ab3c7226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea03881325c425cb422d0d4fe00eb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:27.075873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b21b2-131f-4f0d-88f5-02b00b139469 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:27.076785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b21b2-131f-4f0d-88f5-02b00b139469 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:27.094506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b21b2-131f-4f0d-88f5-02b00b139469 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] PATH_INFO: `/v3/projects/e05503a9d18e4b21b0988a0b03c57f5b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:27.097051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b21b2-131f-4f0d-88f5-02b00b139469 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: Authorizing `identity:get_project(project_id=e05503a9d18e4b21b0988a0b03c57f5b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:27.103712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b21b2-131f-4f0d-88f5-02b00b139469 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:27.110063 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2556/5090] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:34:26 2022] GET /identity/v3/projects/e05503a9d18e4b21b0988a0b03c57f5b => generated 387 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:34:27.114395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b21b2-131f-4f0d-88f5-02b00b139469 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:27.141106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b21b2-131f-4f0d-88f5-02b00b139469 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:27.151110 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2535/5091] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:27.156030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61565bdc-b507-4ba4-9bb7-71ed0033ade7 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:27.168850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea12f3-6505-4288-96b9-d72e77bc166d tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c3e5b23f2e64bed8503bbf7ab3c7226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea03881325c425cb422d0d4fe00eb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:27.175657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea12f3-6505-4288-96b9-d72e77bc166d tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:27.177418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea12f3-6505-4288-96b9-d72e77bc166d tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:27.177881 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea12f3-6505-4288-96b9-d72e77bc166d tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:27.179823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea12f3-6505-4288-96b9-d72e77bc166d tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:27.187836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea12f3-6505-4288-96b9-d72e77bc166d tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:27.259335 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:27.269847 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2557/5092] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Aug 7 01:34:27 2022] POST /identity/v3/projects => generated 338 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:27.272477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea12f3-6505-4288-96b9-d72e77bc166d tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:27.301550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61565bdc-b507-4ba4-9bb7-71ed0033ade7 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:27.448285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea12f3-6505-4288-96b9-d72e77bc166d tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:27.460123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6e3f8-a112-471a-80cd-caa589c53870 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c3e5b23f2e64bed8503bbf7ab3c7226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea03881325c425cb422d0d4fe00eb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:27.462854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6e3f8-a112-471a-80cd-caa589c53870 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:27.462854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6e3f8-a112-471a-80cd-caa589c53870 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:27.462854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6e3f8-a112-471a-80cd-caa589c53870 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:27.465280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6e3f8-a112-471a-80cd-caa589c53870 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:27.469886 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6e3f8-a112-471a-80cd-caa589c53870 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:27.495618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1dc26-016f-4983-a6ba-1249e4a3d13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:27.496444 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1dc26-016f-4983-a6ba-1249e4a3d13c admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:27.496854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1dc26-016f-4983-a6ba-1249e4a3d13c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:27.497818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1dc26-016f-4983-a6ba-1249e4a3d13c admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:27.498599 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1dc26-016f-4983-a6ba-1249e4a3d13c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:27.501120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1dc26-016f-4983-a6ba-1249e4a3d13c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:27.531928 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2558/5093] 10.222.0.39 () {58 vars in 1131 bytes} [Sun Aug 7 01:34:27 2022] GET /identity/v3/projects => generated 6609 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:27.537470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6e3f8-a112-471a-80cd-caa589c53870 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:27.554752 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2536/5094] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:34:27 2022] POST /identity/v3/projects => generated 385 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:34:27.558915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1dc26-016f-4983-a6ba-1249e4a3d13c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:27.569123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6e3f8-a112-471a-80cd-caa589c53870 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:27.716135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1dc26-016f-4983-a6ba-1249e4a3d13c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:27.723308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6244a7-b9de-4a9a-8a3e-9a7e174e981e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:27.724446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cad260-404f-47b1-a891-60dcfbd40cc6 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c3e5b23f2e64bed8503bbf7ab3c7226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea03881325c425cb422d0d4fe00eb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:27.724758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6244a7-b9de-4a9a-8a3e-9a7e174e981e admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:27.725471 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6244a7-b9de-4a9a-8a3e-9a7e174e981e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:27.725595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cad260-404f-47b1-a891-60dcfbd40cc6 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:27.726004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6244a7-b9de-4a9a-8a3e-9a7e174e981e admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:27.727506 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6244a7-b9de-4a9a-8a3e-9a7e174e981e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:27.728088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cad260-404f-47b1-a891-60dcfbd40cc6 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:27.728485 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cad260-404f-47b1-a891-60dcfbd40cc6 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] PATH_INFO: `/v3/projects/e05503a9d18e4b21b0988a0b03c57f5b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:27.731309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cad260-404f-47b1-a891-60dcfbd40cc6 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: Authorizing `identity:get_project(project_id=e05503a9d18e4b21b0988a0b03c57f5b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:27.733239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6244a7-b9de-4a9a-8a3e-9a7e174e981e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:27.737997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cad260-404f-47b1-a891-60dcfbd40cc6 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:27.742233 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2559/5095] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:34:27 2022] GET /identity/v3/projects/e05503a9d18e4b21b0988a0b03c57f5b => generated 387 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:34:27.745802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cad260-404f-47b1-a891-60dcfbd40cc6 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:27.775189 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2537/5096] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:34:27 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:34:27.783056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cad260-404f-47b1-a891-60dcfbd40cc6 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:27.787203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6244a7-b9de-4a9a-8a3e-9a7e174e981e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:27.798221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383f956-9cd1-4e00-8b3b-9b96edcfd01e tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c3e5b23f2e64bed8503bbf7ab3c7226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea03881325c425cb422d0d4fe00eb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:27.800291 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383f956-9cd1-4e00-8b3b-9b96edcfd01e tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:27.802111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383f956-9cd1-4e00-8b3b-9b96edcfd01e tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:27.802507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383f956-9cd1-4e00-8b3b-9b96edcfd01e tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] PATH_INFO: `/v3/projects/abcbe2c541b14c66a392251e23aa6592` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:27.807570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383f956-9cd1-4e00-8b3b-9b96edcfd01e tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: Authorizing `identity:get_project(project_id=abcbe2c541b14c66a392251e23aa6592)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:27.809916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383f956-9cd1-4e00-8b3b-9b96edcfd01e tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:27.814935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6244a7-b9de-4a9a-8a3e-9a7e174e981e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:27.816353 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2560/5097] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:34:27 2022] GET /identity/v3/projects/abcbe2c541b14c66a392251e23aa6592 => generated 338 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:34:27.821024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383f956-9cd1-4e00-8b3b-9b96edcfd01e tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:27.823833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe73bc-6f9c-461b-99cc-7f98687a78af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:27.824675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe73bc-6f9c-461b-99cc-7f98687a78af admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:27.825054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe73bc-6f9c-461b-99cc-7f98687a78af admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:27.825520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe73bc-6f9c-461b-99cc-7f98687a78af admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:27.826384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe73bc-6f9c-461b-99cc-7f98687a78af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:27.829603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe73bc-6f9c-461b-99cc-7f98687a78af admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:27.834172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383f956-9cd1-4e00-8b3b-9b96edcfd01e tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:27.839725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb12bd8-9a71-4b12-bea0-cc90ca1af72c tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c3e5b23f2e64bed8503bbf7ab3c7226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea03881325c425cb422d0d4fe00eb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:27.840486 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb12bd8-9a71-4b12-bea0-cc90ca1af72c tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:27.840798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb12bd8-9a71-4b12-bea0-cc90ca1af72c tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:27.841128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb12bd8-9a71-4b12-bea0-cc90ca1af72c tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:27.841824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb12bd8-9a71-4b12-bea0-cc90ca1af72c tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:27.843760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb12bd8-9a71-4b12-bea0-cc90ca1af72c tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:27.888055 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2538/5098] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:27.890048 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2561/5099] 10.222.0.39 () {58 vars in 1131 bytes} [Sun Aug 7 01:34:27 2022] GET /identity/v3/projects => generated 6982 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:34:27.891604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe73bc-6f9c-461b-99cc-7f98687a78af admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:27.895368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb12bd8-9a71-4b12-bea0-cc90ca1af72c tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:27.913302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe73bc-6f9c-461b-99cc-7f98687a78af admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:27.925589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23c413-c29e-4efa-a95b-19b62721fdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:27.930331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23c413-c29e-4efa-a95b-19b62721fdf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:27.930930 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23c413-c29e-4efa-a95b-19b62721fdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:27.931439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23c413-c29e-4efa-a95b-19b62721fdf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:27.933004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23c413-c29e-4efa-a95b-19b62721fdf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:27.935559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23c413-c29e-4efa-a95b-19b62721fdf6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:27.954804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb12bd8-9a71-4b12-bea0-cc90ca1af72c tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:27.974903 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2539/5100] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:34:27.979852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23c413-c29e-4efa-a95b-19b62721fdf6 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:27.980649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cfe2f-23a0-4e2a-b505-a4e784e55c83 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c3e5b23f2e64bed8503bbf7ab3c7226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea03881325c425cb422d0d4fe00eb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:27.986672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cfe2f-23a0-4e2a-b505-a4e784e55c83 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:27.987127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cfe2f-23a0-4e2a-b505-a4e784e55c83 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:27.987514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cfe2f-23a0-4e2a-b505-a4e784e55c83 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:27.988596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cfe2f-23a0-4e2a-b505-a4e784e55c83 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:34:27.989030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cfe2f-23a0-4e2a-b505-a4e784e55c83 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:27.996502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cfe2f-23a0-4e2a-b505-a4e784e55c83 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:28.005101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23c413-c29e-4efa-a95b-19b62721fdf6 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:28.019668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995d411-15cd-429a-ac46-3bd47286933e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:28.021990 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995d411-15cd-429a-ac46-3bd47286933e admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:28.022511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995d411-15cd-429a-ac46-3bd47286933e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:28.022994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995d411-15cd-429a-ac46-3bd47286933e admin admin] PATH_INFO: `/v3/projects/4d9d8c43ea624461a6996dee616670c9/users/0a054306a2a94ab8ab0aefcff7338133/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:28.055800 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:28.080618 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2562/5101] 10.222.0.39 () {58 vars in 1166 bytes} [Sun Aug 7 01:34:27 2022] GET /identity/v3/projects?domain_id=default => generated 6651 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:28.085850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cfe2f-23a0-4e2a-b505-a4e784e55c83 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:28.099841 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cfe2f-23a0-4e2a-b505-a4e784e55c83 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:28.101643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995d411-15cd-429a-ac46-3bd47286933e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d9d8c43ea624461a6996dee616670c9, user_id=0a054306a2a94ab8ab0aefcff7338133, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:28.104820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995d411-15cd-429a-ac46-3bd47286933e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:28.108003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664ccc5-ebcb-4c24-94f3-e4fb1d97ff54 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c3e5b23f2e64bed8503bbf7ab3c7226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea03881325c425cb422d0d4fe00eb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:28.108714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664ccc5-ebcb-4c24-94f3-e4fb1d97ff54 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:28.109202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664ccc5-ebcb-4c24-94f3-e4fb1d97ff54 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:28.109362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664ccc5-ebcb-4c24-94f3-e4fb1d97ff54 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:28.111262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664ccc5-ebcb-4c24-94f3-e4fb1d97ff54 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:28.114038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664ccc5-ebcb-4c24-94f3-e4fb1d97ff54 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:28.143040 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2563/5102] 10.222.0.39 () {58 vars in 1131 bytes} [Sun Aug 7 01:34:28 2022] GET /identity/v3/projects => generated 6982 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:28.149435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664ccc5-ebcb-4c24-94f3-e4fb1d97ff54 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:28.149788 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2540/5103] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:34:27 2022] PUT /identity/v3/projects/4d9d8c43ea624461a6996dee616670c9/users/0a054306a2a94ab8ab0aefcff7338133/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:28.171773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe584c-69d7-4fef-a0c5-b8305bbc8335 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:28.172089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe584c-69d7-4fef-a0c5-b8305bbc8335 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:28.172364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe584c-69d7-4fef-a0c5-b8305bbc8335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:28.178808 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664ccc5-ebcb-4c24-94f3-e4fb1d97ff54 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:28.267810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056f46f-1004-4ca9-9a08-005b5363b0d0 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c3e5b23f2e64bed8503bbf7ab3c7226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea03881325c425cb422d0d4fe00eb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:28.269189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056f46f-1004-4ca9-9a08-005b5363b0d0 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:28.269658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056f46f-1004-4ca9-9a08-005b5363b0d0 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:28.270139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056f46f-1004-4ca9-9a08-005b5363b0d0 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:28.271282 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9056f46f-1004-4ca9-9a08-005b5363b0d0 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:34:28.271787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9056f46f-1004-4ca9-9a08-005b5363b0d0 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:28.275331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9056f46f-1004-4ca9-9a08-005b5363b0d0 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:28.314462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ccbe584c-69d7-4fef-a0c5-b8305bbc8335 None None] MFA Rules not processed for user `0a054306a2a94ab8ab0aefcff7338133`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:28.315876 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ccbe584c-69d7-4fef-a0c5-b8305bbc8335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:28.322574 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2564/5104] 10.222.0.39 () {58 vars in 1166 bytes} [Sun Aug 7 01:34:28 2022] GET /identity/v3/projects?domain_id=default => generated 6651 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:28.333534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056f46f-1004-4ca9-9a08-005b5363b0d0 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:28.344287 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:28.366625 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056f46f-1004-4ca9-9a08-005b5363b0d0 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:28.375768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac408f-7bd4-419a-ad1f-b1d78b125987 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c3e5b23f2e64bed8503bbf7ab3c7226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea03881325c425cb422d0d4fe00eb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:28.376756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac408f-7bd4-419a-ad1f-b1d78b125987 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:28.377044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac408f-7bd4-419a-ad1f-b1d78b125987 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:28.377322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac408f-7bd4-419a-ad1f-b1d78b125987 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:28.378202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac408f-7bd4-419a-ad1f-b1d78b125987 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:28.380628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac408f-7bd4-419a-ad1f-b1d78b125987 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:28.407922 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2565/5105] 10.222.0.39 () {58 vars in 1131 bytes} [Sun Aug 7 01:34:28 2022] GET /identity/v3/projects => generated 6982 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:28.413492 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac408f-7bd4-419a-ad1f-b1d78b125987 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:28.450550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac408f-7bd4-419a-ad1f-b1d78b125987 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:28.473183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0d705-a6f6-492b-bf47-d2fb611d3c26 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c3e5b23f2e64bed8503bbf7ab3c7226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea03881325c425cb422d0d4fe00eb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:28.475271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0d705-a6f6-492b-bf47-d2fb611d3c26 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:28.475683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0d705-a6f6-492b-bf47-d2fb611d3c26 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:28.478626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0d705-a6f6-492b-bf47-d2fb611d3c26 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:28.482459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0d705-a6f6-492b-bf47-d2fb611d3c26 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-776429344) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:34:28.483182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0d705-a6f6-492b-bf47-d2fb611d3c26 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:28.489827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0d705-a6f6-492b-bf47-d2fb611d3c26 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:28.537971 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2566/5106] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:34:28 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-776429344 => generated 534 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:34:28.540888 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0d705-a6f6-492b-bf47-d2fb611d3c26 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:28.552410 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2541/5107] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:28.562904 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe584c-69d7-4fef-a0c5-b8305bbc8335 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:28.564926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ccbe584c-69d7-4fef-a0c5-b8305bbc8335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:28.573189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0d705-a6f6-492b-bf47-d2fb611d3c26 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:28.591746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17c2ff-7669-42f4-91aa-a6c283edc916 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c3e5b23f2e64bed8503bbf7ab3c7226', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2ea03881325c425cb422d0d4fe00eb50', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:28.595623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17c2ff-7669-42f4-91aa-a6c283edc916 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:28.596273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17c2ff-7669-42f4-91aa-a6c283edc916 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:28.596558 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17c2ff-7669-42f4-91aa-a6c283edc916 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] PATH_INFO: `/v3/projects/abcbe2c541b14c66a392251e23aa6592` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:28.602639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17c2ff-7669-42f4-91aa-a6c283edc916 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: Authorizing `identity:delete_project(project_id=abcbe2c541b14c66a392251e23aa6592)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:28.608025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17c2ff-7669-42f4-91aa-a6c283edc916 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:28.696150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe584c-69d7-4fef-a0c5-b8305bbc8335 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:28.706714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861c329-429c-468f-87df-75b969641230 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:28.710002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861c329-429c-468f-87df-75b969641230 service glance] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:28.710321 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861c329-429c-468f-87df-75b969641230 service glance] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:28.710601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861c329-429c-468f-87df-75b969641230 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:28.726969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-af17c2ff-7669-42f4-91aa-a6c283edc916 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abcbe2c541b14c66a392251e23aa6592', 'request_id': 'req-af17c2ff-7669-42f4-91aa-a6c283edc916'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:28.738017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-af17c2ff-7669-42f4-91aa-a6c283edc916 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abcbe2c541b14c66a392251e23aa6592', 'request_id': 'req-af17c2ff-7669-42f4-91aa-a6c283edc916'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:28.758668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-af17c2ff-7669-42f4-91aa-a6c283edc916 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abcbe2c541b14c66a392251e23aa6592', 'request_id': 'req-af17c2ff-7669-42f4-91aa-a6c283edc916'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:28.778340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-af17c2ff-7669-42f4-91aa-a6c283edc916 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] The token cache is being invalidate because project abcbe2c541b14c66a392251e23aa6592 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:28.779447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-af17c2ff-7669-42f4-91aa-a6c283edc916 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:28.780768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-af17c2ff-7669-42f4-91aa-a6c283edc916 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:28.783796 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2567/5108] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:28 2022] DELETE /identity/v3/projects/abcbe2c541b14c66a392251e23aa6592 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:28.790832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17c2ff-7669-42f4-91aa-a6c283edc916 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:28.794258 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-af17c2ff-7669-42f4-91aa-a6c283edc916 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:28.861383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861c329-429c-468f-87df-75b969641230 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:28.863032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861c329-429c-468f-87df-75b969641230 service glance] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:28.897117 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2542/5109] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:34:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:34:28.957573 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:29.024734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17c2ff-7669-42f4-91aa-a6c283edc916 tempest-ListProjectsStaticTestJSON-795559425 tempest-ListProjectsStaticTestJSON-795559425-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:29.034898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5aec3-ff8c-4b19-be81-4912d3cbcea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:29.038171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5aec3-ff8c-4b19-be81-4912d3cbcea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:29.038887 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5aec3-ff8c-4b19-be81-4912d3cbcea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:29.041073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5aec3-ff8c-4b19-be81-4912d3cbcea5 admin admin] PATH_INFO: `/v3/users/1eff192966e3494da2b7a64c2a89539a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:29.045069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5aec3-ff8c-4b19-be81-4912d3cbcea5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eff192966e3494da2b7a64c2a89539a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:29.052062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5aec3-ff8c-4b19-be81-4912d3cbcea5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:29.234344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-03a5aec3-ff8c-4b19-be81-4912d3cbcea5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eff192966e3494da2b7a64c2a89539a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:29.243011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861c329-429c-468f-87df-75b969641230 service glance] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:29.246975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-03a5aec3-ff8c-4b19-be81-4912d3cbcea5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eff192966e3494da2b7a64c2a89539a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:29.257433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861c329-429c-468f-87df-75b969641230 service glance] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:29.277343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-03a5aec3-ff8c-4b19-be81-4912d3cbcea5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eff192966e3494da2b7a64c2a89539a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:29.278364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-03a5aec3-ff8c-4b19-be81-4912d3cbcea5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eff192966e3494da2b7a64c2a89539a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:29.295058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-03a5aec3-ff8c-4b19-be81-4912d3cbcea5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eff192966e3494da2b7a64c2a89539a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:29.313624 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2568/5110] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:34:28 2022] DELETE /identity/v3/users/1eff192966e3494da2b7a64c2a89539a => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:29.315112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330966a-9c71-43c0-a89b-282341397d28 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:29.315509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330966a-9c71-43c0-a89b-282341397d28 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:29.315922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330966a-9c71-43c0-a89b-282341397d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:29.406084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f23f6d-b8b1-48d4-b3d9-7cf77679ae2f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:29.411727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f23f6d-b8b1-48d4-b3d9-7cf77679ae2f service glance] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:29.412140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f23f6d-b8b1-48d4-b3d9-7cf77679ae2f service glance] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:29.412409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f23f6d-b8b1-48d4-b3d9-7cf77679ae2f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:29.414975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d9f23f6d-b8b1-48d4-b3d9-7cf77679ae2f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:29.417798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1330966a-9c71-43c0-a89b-282341397d28 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:29.418339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1330966a-9c71-43c0-a89b-282341397d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:29.504907 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:29.618468 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2569/5111] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:29.634769 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330966a-9c71-43c0-a89b-282341397d28 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:29.636880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1330966a-9c71-43c0-a89b-282341397d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:29.693797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f23f6d-b8b1-48d4-b3d9-7cf77679ae2f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:29.698703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f23f6d-b8b1-48d4-b3d9-7cf77679ae2f service glance] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:29.740738 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2543/5112] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:34:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:34:29.798454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330966a-9c71-43c0-a89b-282341397d28 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:29.818773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e29dd7-f753-4171-93a7-691d39de4f85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:29.819606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e29dd7-f753-4171-93a7-691d39de4f85 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:29.819909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e29dd7-f753-4171-93a7-691d39de4f85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:29.820190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e29dd7-f753-4171-93a7-691d39de4f85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:29.853173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e29dd7-f753-4171-93a7-691d39de4f85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:29.855260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e29dd7-f753-4171-93a7-691d39de4f85 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:29.879656 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:29.896242 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2570/5113] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:34:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:34:30.637524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f23f6d-b8b1-48d4-b3d9-7cf77679ae2f service glance] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:30.639798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d9f23f6d-b8b1-48d4-b3d9-7cf77679ae2f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:30.665107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f23f6d-b8b1-48d4-b3d9-7cf77679ae2f service glance] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:30.672369 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e95c97-bef3-4aa1-87bd-55c6042a2e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:30.679664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e95c97-bef3-4aa1-87bd-55c6042a2e38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:30.680367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e95c97-bef3-4aa1-87bd-55c6042a2e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:30.681677 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e95c97-bef3-4aa1-87bd-55c6042a2e38 admin admin] PATH_INFO: `/v3/users/afeda3135cdd4a5eb8f5a4d3254fc724` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:30.683305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e95c97-bef3-4aa1-87bd-55c6042a2e38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afeda3135cdd4a5eb8f5a4d3254fc724)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:30.686416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e95c97-bef3-4aa1-87bd-55c6042a2e38 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:30.888504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-82e95c97-bef3-4aa1-87bd-55c6042a2e38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afeda3135cdd4a5eb8f5a4d3254fc724'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:30.910540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-82e95c97-bef3-4aa1-87bd-55c6042a2e38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afeda3135cdd4a5eb8f5a4d3254fc724'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:30.960282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-82e95c97-bef3-4aa1-87bd-55c6042a2e38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afeda3135cdd4a5eb8f5a4d3254fc724'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:30.964436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-82e95c97-bef3-4aa1-87bd-55c6042a2e38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afeda3135cdd4a5eb8f5a4d3254fc724'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:30.992203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-82e95c97-bef3-4aa1-87bd-55c6042a2e38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afeda3135cdd4a5eb8f5a4d3254fc724'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:31.011700 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2544/5114] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:34:30 2022] DELETE /identity/v3/users/afeda3135cdd4a5eb8f5a4d3254fc724 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:31.016503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ed948-6993-4139-9b66-c58c3c114e2d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:31.017274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ed948-6993-4139-9b66-c58c3c114e2d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:31.017637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ed948-6993-4139-9b66-c58c3c114e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:31.079902 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-664ed948-6993-4139-9b66-c58c3c114e2d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:31.081176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-664ed948-6993-4139-9b66-c58c3c114e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:31.174792 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2571/5115] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:31.230883 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e95c97-bef3-4aa1-87bd-55c6042a2e38 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:31.233289 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-82e95c97-bef3-4aa1-87bd-55c6042a2e38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:31.416637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e95c97-bef3-4aa1-87bd-55c6042a2e38 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:31.422320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfd3d0-b993-486e-900b-3d54a2ce3590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:31.423779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfd3d0-b993-486e-900b-3d54a2ce3590 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:31.424209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfd3d0-b993-486e-900b-3d54a2ce3590 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:31.424571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfd3d0-b993-486e-900b-3d54a2ce3590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:31.509320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfd3d0-b993-486e-900b-3d54a2ce3590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:31.524555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfd3d0-b993-486e-900b-3d54a2ce3590 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:31.585149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ed948-6993-4139-9b66-c58c3c114e2d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:31.595023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-664ed948-6993-4139-9b66-c58c3c114e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:31.620995 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2545/5116] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:34:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:34:31.650398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ed948-6993-4139-9b66-c58c3c114e2d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:31.697182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0e023-3471-442b-9205-54aacee5ae65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:31.698252 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0e023-3471-442b-9205-54aacee5ae65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:31.698711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0e023-3471-442b-9205-54aacee5ae65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:31.699162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0e023-3471-442b-9205-54aacee5ae65 admin admin] PATH_INFO: `/v3/users/063427be95f64488bfa71df1f90e1400` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:31.702677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0e023-3471-442b-9205-54aacee5ae65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=063427be95f64488bfa71df1f90e1400)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:31.710361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0e023-3471-442b-9205-54aacee5ae65 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:31.857161 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e1b0e023-3471-442b-9205-54aacee5ae65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '063427be95f64488bfa71df1f90e1400'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:31.884863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e1b0e023-3471-442b-9205-54aacee5ae65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '063427be95f64488bfa71df1f90e1400'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:31.946292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e1b0e023-3471-442b-9205-54aacee5ae65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '063427be95f64488bfa71df1f90e1400'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:31.947792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e1b0e023-3471-442b-9205-54aacee5ae65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '063427be95f64488bfa71df1f90e1400'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:31.970467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e1b0e023-3471-442b-9205-54aacee5ae65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '063427be95f64488bfa71df1f90e1400'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:31.987602 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2572/5117] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:34:31 2022] DELETE /identity/v3/users/063427be95f64488bfa71df1f90e1400 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:32.166826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfd3d0-b993-486e-900b-3d54a2ce3590 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:32.169590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e6cfd3d0-b993-486e-900b-3d54a2ce3590 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:32.197349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfd3d0-b993-486e-900b-3d54a2ce3590 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:32.295841 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:32.346276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9fdc2-6190-41ac-a944-d484a927ce4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:32.359292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9fdc2-6190-41ac-a944-d484a927ce4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:32.359803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9fdc2-6190-41ac-a944-d484a927ce4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:32.360219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9fdc2-6190-41ac-a944-d484a927ce4e admin admin] PATH_INFO: `/v3/projects/e05503a9d18e4b21b0988a0b03c57f5b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:32.362116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9fdc2-6190-41ac-a944-d484a927ce4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e05503a9d18e4b21b0988a0b03c57f5b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:32.380572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9fdc2-6190-41ac-a944-d484a927ce4e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:32.599575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-87d9fdc2-6190-41ac-a944-d484a927ce4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e05503a9d18e4b21b0988a0b03c57f5b', 'request_id': 'req-87d9fdc2-6190-41ac-a944-d484a927ce4e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:32.619168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-87d9fdc2-6190-41ac-a944-d484a927ce4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e05503a9d18e4b21b0988a0b03c57f5b', 'request_id': 'req-87d9fdc2-6190-41ac-a944-d484a927ce4e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:32.636633 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-87d9fdc2-6190-41ac-a944-d484a927ce4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e05503a9d18e4b21b0988a0b03c57f5b', 'request_id': 'req-87d9fdc2-6190-41ac-a944-d484a927ce4e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:32.664659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-87d9fdc2-6190-41ac-a944-d484a927ce4e admin admin] The token cache is being invalidate because project e05503a9d18e4b21b0988a0b03c57f5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:32.665257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-87d9fdc2-6190-41ac-a944-d484a927ce4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:32.666840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-87d9fdc2-6190-41ac-a944-d484a927ce4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:32.671523 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2546/5118] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:32 2022] DELETE /identity/v3/projects/e05503a9d18e4b21b0988a0b03c57f5b => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:32.676140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0e023-3471-442b-9205-54aacee5ae65 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:32.678262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e1b0e023-3471-442b-9205-54aacee5ae65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:32.741404 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0e023-3471-442b-9205-54aacee5ae65 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:32.753602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9fdc2-6190-41ac-a944-d484a927ce4e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:32.758214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-87d9fdc2-6190-41ac-a944-d484a927ce4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:32.917959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9fdc2-6190-41ac-a944-d484a927ce4e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:32.924869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3457396-62ef-4c45-a0e3-b0011c1432a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:32.928114 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3457396-62ef-4c45-a0e3-b0011c1432a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:32.928737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3457396-62ef-4c45-a0e3-b0011c1432a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:32.929333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3457396-62ef-4c45-a0e3-b0011c1432a0 admin admin] PATH_INFO: `/v3/projects/f5742c47b19344ba811ab98d6a5eb047` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:32.932701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3457396-62ef-4c45-a0e3-b0011c1432a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5742c47b19344ba811ab98d6a5eb047)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:32.936236 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3457396-62ef-4c45-a0e3-b0011c1432a0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:32.971452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803ccec-fe73-4e08-befc-3470f5e40603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:32.972599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803ccec-fe73-4e08-befc-3470f5e40603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:32.974555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803ccec-fe73-4e08-befc-3470f5e40603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:32.977512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803ccec-fe73-4e08-befc-3470f5e40603 admin admin] PATH_INFO: `/v3/users/4c3e5b23f2e64bed8503bbf7ab3c7226` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:32.980042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803ccec-fe73-4e08-befc-3470f5e40603 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c3e5b23f2e64bed8503bbf7ab3c7226)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:32.988207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803ccec-fe73-4e08-befc-3470f5e40603 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:33.005747 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:33.059545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c3457396-62ef-4c45-a0e3-b0011c1432a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5742c47b19344ba811ab98d6a5eb047', 'request_id': 'req-c3457396-62ef-4c45-a0e3-b0011c1432a0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:33.080166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c3457396-62ef-4c45-a0e3-b0011c1432a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5742c47b19344ba811ab98d6a5eb047', 'request_id': 'req-c3457396-62ef-4c45-a0e3-b0011c1432a0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:33.097604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c3457396-62ef-4c45-a0e3-b0011c1432a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5742c47b19344ba811ab98d6a5eb047', 'request_id': 'req-c3457396-62ef-4c45-a0e3-b0011c1432a0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:33.104616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7803ccec-fe73-4e08-befc-3470f5e40603 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c3e5b23f2e64bed8503bbf7ab3c7226'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:33.105535 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:33.118463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c3457396-62ef-4c45-a0e3-b0011c1432a0 admin admin] The token cache is being invalidate because project f5742c47b19344ba811ab98d6a5eb047 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:33.118762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c3457396-62ef-4c45-a0e3-b0011c1432a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:33.120422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c3457396-62ef-4c45-a0e3-b0011c1432a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:33.123563 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2547/5119] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:32 2022] DELETE /identity/v3/projects/f5742c47b19344ba811ab98d6a5eb047 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:33.127551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3457396-62ef-4c45-a0e3-b0011c1432a0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:33.128876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7803ccec-fe73-4e08-befc-3470f5e40603 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c3e5b23f2e64bed8503bbf7ab3c7226'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:33.129584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c3457396-62ef-4c45-a0e3-b0011c1432a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:33.165766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7803ccec-fe73-4e08-befc-3470f5e40603 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c3e5b23f2e64bed8503bbf7ab3c7226'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:33.167336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7803ccec-fe73-4e08-befc-3470f5e40603 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c3e5b23f2e64bed8503bbf7ab3c7226'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:33.183155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7803ccec-fe73-4e08-befc-3470f5e40603 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c3e5b23f2e64bed8503bbf7ab3c7226'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:33.195400 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2573/5120] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:34:32 2022] DELETE /identity/v3/users/4c3e5b23f2e64bed8503bbf7ab3c7226 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:33.276933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3457396-62ef-4c45-a0e3-b0011c1432a0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:33.374665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b26ca8-c437-42e0-8edd-ce94be57bec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:33.375382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b26ca8-c437-42e0-8edd-ce94be57bec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:33.375668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b26ca8-c437-42e0-8edd-ce94be57bec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:33.376077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b26ca8-c437-42e0-8edd-ce94be57bec0 admin admin] PATH_INFO: `/v3/users/0a054306a2a94ab8ab0aefcff7338133` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:33.377735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b26ca8-c437-42e0-8edd-ce94be57bec0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a054306a2a94ab8ab0aefcff7338133)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:33.384914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b26ca8-c437-42e0-8edd-ce94be57bec0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:33.467259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b2b26ca8-c437-42e0-8edd-ce94be57bec0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a054306a2a94ab8ab0aefcff7338133'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:33.490786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b2b26ca8-c437-42e0-8edd-ce94be57bec0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a054306a2a94ab8ab0aefcff7338133'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:33.527143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b2b26ca8-c437-42e0-8edd-ce94be57bec0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a054306a2a94ab8ab0aefcff7338133'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:33.528650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b2b26ca8-c437-42e0-8edd-ce94be57bec0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a054306a2a94ab8ab0aefcff7338133'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:33.546165 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b2b26ca8-c437-42e0-8edd-ce94be57bec0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a054306a2a94ab8ab0aefcff7338133'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:33.557555 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2548/5121] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:34:33 2022] DELETE /identity/v3/users/0a054306a2a94ab8ab0aefcff7338133 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:34:34.147922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803ccec-fe73-4e08-befc-3470f5e40603 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:34.150102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7803ccec-fe73-4e08-befc-3470f5e40603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:34.173847 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803ccec-fe73-4e08-befc-3470f5e40603 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:34.277375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b26ca8-c437-42e0-8edd-ce94be57bec0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:34.279848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b2b26ca8-c437-42e0-8edd-ce94be57bec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:34.334236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d5305-4fca-4c91-a88e-fba18cd3ea67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:34.335774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d5305-4fca-4c91-a88e-fba18cd3ea67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:34.336088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d5305-4fca-4c91-a88e-fba18cd3ea67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:34.336541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d5305-4fca-4c91-a88e-fba18cd3ea67 admin admin] PATH_INFO: `/v3/projects/2ea03881325c425cb422d0d4fe00eb50` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:34.339060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d5305-4fca-4c91-a88e-fba18cd3ea67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ea03881325c425cb422d0d4fe00eb50)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:34.341046 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d5305-4fca-4c91-a88e-fba18cd3ea67 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:34.349509 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:34.453171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b26ca8-c437-42e0-8edd-ce94be57bec0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:34.527049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-287d5305-4fca-4c91-a88e-fba18cd3ea67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ea03881325c425cb422d0d4fe00eb50', 'request_id': 'req-287d5305-4fca-4c91-a88e-fba18cd3ea67'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:34.542744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-287d5305-4fca-4c91-a88e-fba18cd3ea67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ea03881325c425cb422d0d4fe00eb50', 'request_id': 'req-287d5305-4fca-4c91-a88e-fba18cd3ea67'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:34.548709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9c8d6-f536-4c4c-aaa2-fc5e98193938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:34.549534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9c8d6-f536-4c4c-aaa2-fc5e98193938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:34.549825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9c8d6-f536-4c4c-aaa2-fc5e98193938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:34.550105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9c8d6-f536-4c4c-aaa2-fc5e98193938 admin admin] PATH_INFO: `/v3/projects/9a871883160d4b9483b7009fbe485690` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:34.550396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-287d5305-4fca-4c91-a88e-fba18cd3ea67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ea03881325c425cb422d0d4fe00eb50', 'request_id': 'req-287d5305-4fca-4c91-a88e-fba18cd3ea67'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:34.551435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9c8d6-f536-4c4c-aaa2-fc5e98193938 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a871883160d4b9483b7009fbe485690)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:34.553548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9c8d6-f536-4c4c-aaa2-fc5e98193938 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:34.580052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-287d5305-4fca-4c91-a88e-fba18cd3ea67 admin admin] The token cache is being invalidate because project 2ea03881325c425cb422d0d4fe00eb50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:34.580788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-287d5305-4fca-4c91-a88e-fba18cd3ea67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:34.582530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-287d5305-4fca-4c91-a88e-fba18cd3ea67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:34.584865 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2574/5122] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:34 2022] DELETE /identity/v3/projects/2ea03881325c425cb422d0d4fe00eb50 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:34.586629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d5305-4fca-4c91-a88e-fba18cd3ea67 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:34.591854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-287d5305-4fca-4c91-a88e-fba18cd3ea67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:34.613249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d5305-4fca-4c91-a88e-fba18cd3ea67 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:34.620320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5206ddb-197c-4e2a-8ba1-064f6892cb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:34.621292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5206ddb-197c-4e2a-8ba1-064f6892cb34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:34.621770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5206ddb-197c-4e2a-8ba1-064f6892cb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:34.622188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5206ddb-197c-4e2a-8ba1-064f6892cb34 admin admin] PATH_INFO: `/v3/projects/4d9d8c43ea624461a6996dee616670c9` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:34.623643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5206ddb-197c-4e2a-8ba1-064f6892cb34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d9d8c43ea624461a6996dee616670c9)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:34.626349 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5206ddb-197c-4e2a-8ba1-064f6892cb34 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:34.667268 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:34.676506 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ecd9c8d6-f536-4c4c-aaa2-fc5e98193938 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a871883160d4b9483b7009fbe485690', 'request_id': 'req-ecd9c8d6-f536-4c4c-aaa2-fc5e98193938'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:34.699294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ecd9c8d6-f536-4c4c-aaa2-fc5e98193938 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a871883160d4b9483b7009fbe485690', 'request_id': 'req-ecd9c8d6-f536-4c4c-aaa2-fc5e98193938'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:34.707942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ecd9c8d6-f536-4c4c-aaa2-fc5e98193938 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a871883160d4b9483b7009fbe485690', 'request_id': 'req-ecd9c8d6-f536-4c4c-aaa2-fc5e98193938'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:34.728275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ecd9c8d6-f536-4c4c-aaa2-fc5e98193938 admin admin] The token cache is being invalidate because project 9a871883160d4b9483b7009fbe485690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:34.728601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ecd9c8d6-f536-4c4c-aaa2-fc5e98193938 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:34.729907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ecd9c8d6-f536-4c4c-aaa2-fc5e98193938 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:34.733860 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2549/5123] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:34 2022] DELETE /identity/v3/projects/9a871883160d4b9483b7009fbe485690 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:34:34.734040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c5206ddb-197c-4e2a-8ba1-064f6892cb34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d9d8c43ea624461a6996dee616670c9', 'request_id': 'req-c5206ddb-197c-4e2a-8ba1-064f6892cb34'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:34.734902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a993d3-90cb-4d37-b767-576b3e5a986a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:34.735184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a993d3-90cb-4d37-b767-576b3e5a986a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:34.736922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a993d3-90cb-4d37-b767-576b3e5a986a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:34.742646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c5206ddb-197c-4e2a-8ba1-064f6892cb34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d9d8c43ea624461a6996dee616670c9', 'request_id': 'req-c5206ddb-197c-4e2a-8ba1-064f6892cb34'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:34.750638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c5206ddb-197c-4e2a-8ba1-064f6892cb34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d9d8c43ea624461a6996dee616670c9', 'request_id': 'req-c5206ddb-197c-4e2a-8ba1-064f6892cb34'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:34.770999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c5206ddb-197c-4e2a-8ba1-064f6892cb34 admin admin] The token cache is being invalidate because project 4d9d8c43ea624461a6996dee616670c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:34.771421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c5206ddb-197c-4e2a-8ba1-064f6892cb34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:34.780667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c5206ddb-197c-4e2a-8ba1-064f6892cb34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:34.787245 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2575/5124] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:34 2022] DELETE /identity/v3/projects/4d9d8c43ea624461a6996dee616670c9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:34.789485 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b500c-ee96-4421-b17b-a246753fd6db None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:34.789945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b500c-ee96-4421-b17b-a246753fd6db None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:34.790369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b500c-ee96-4421-b17b-a246753fd6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:34.801193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d8a993d3-90cb-4d37-b767-576b3e5a986a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:34.803257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d8a993d3-90cb-4d37-b767-576b3e5a986a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:34.818865 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f40b500c-ee96-4421-b17b-a246753fd6db None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:34.820712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f40b500c-ee96-4421-b17b-a246753fd6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:34.868121 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:34.896774 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2550/5125] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:34.898630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f7e5d-f0af-4de8-a8de-a90584ecd9d7 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:34.899007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f7e5d-f0af-4de8-a8de-a90584ecd9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:34.899381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f7e5d-f0af-4de8-a8de-a90584ecd9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:34.913461 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2576/5126] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:34.915129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53021ba3-36bb-44b8-91bd-a6424cd02877 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:34.915493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53021ba3-36bb-44b8-91bd-a6424cd02877 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:34.916064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53021ba3-36bb-44b8-91bd-a6424cd02877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:34.925293 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2a6f7e5d-f0af-4de8-a8de-a90584ecd9d7 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:34.926714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2a6f7e5d-f0af-4de8-a8de-a90584ecd9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:34.937259 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2551/5127] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:34.944323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27413c-7e8e-44ac-a24e-b7300165d44a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:34.944323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27413c-7e8e-44ac-a24e-b7300165d44a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:34.944323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27413c-7e8e-44ac-a24e-b7300165d44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:34.944615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-53021ba3-36bb-44b8-91bd-a6424cd02877 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:34.944615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-53021ba3-36bb-44b8-91bd-a6424cd02877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:34.950775 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2577/5128] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:34.955120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212f229-60b4-4b75-a40e-26953107182f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:34.955120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212f229-60b4-4b75-a40e-26953107182f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:34.955120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212f229-60b4-4b75-a40e-26953107182f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:34.972962 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-5e27413c-7e8e-44ac-a24e-b7300165d44a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:34.976565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e212f229-60b4-4b75-a40e-26953107182f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:34.981513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5e27413c-7e8e-44ac-a24e-b7300165d44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:34.981714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e212f229-60b4-4b75-a40e-26953107182f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:34.990920 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2578/5129] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:34.994918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212f229-60b4-4b75-a40e-26953107182f None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:34.996276 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2552/5130] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:34.999397 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27413c-7e8e-44ac-a24e-b7300165d44a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:35.012106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212f229-60b4-4b75-a40e-26953107182f None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:35.013780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27413c-7e8e-44ac-a24e-b7300165d44a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:35.019937 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed00af-d7df-4d46-967d-520a37f45950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:35.020485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed00af-d7df-4d46-967d-520a37f45950 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:35.020658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed00af-d7df-4d46-967d-520a37f45950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:35.021003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ed00af-d7df-4d46-967d-520a37f45950 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:35.021776 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed00af-d7df-4d46-967d-520a37f45950 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:34:35.022159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed00af-d7df-4d46-967d-520a37f45950 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:35.022607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9209aff-85a4-4d7f-b597-efeeca7702ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:35.023428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9209aff-85a4-4d7f-b597-efeeca7702ba admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:35.023999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9209aff-85a4-4d7f-b597-efeeca7702ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:35.024551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9209aff-85a4-4d7f-b597-efeeca7702ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:35.024711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ed00af-d7df-4d46-967d-520a37f45950 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:35.026230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9209aff-85a4-4d7f-b597-efeeca7702ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:34:35.026743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9209aff-85a4-4d7f-b597-efeeca7702ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:35.029079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9209aff-85a4-4d7f-b597-efeeca7702ba admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:35.049313 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2553/5131] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:34:35.051995 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2579/5132] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:34:35.053797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed00af-d7df-4d46-967d-520a37f45950 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:35.054945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9209aff-85a4-4d7f-b597-efeeca7702ba admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:35.070068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9209aff-85a4-4d7f-b597-efeeca7702ba admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:35.078623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ed00af-d7df-4d46-967d-520a37f45950 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:35.082886 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031f9d8-b000-45bb-8b88-fe7b967abd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:35.084365 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031f9d8-b000-45bb-8b88-fe7b967abd7b admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:35.084856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031f9d8-b000-45bb-8b88-fe7b967abd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:35.085444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031f9d8-b000-45bb-8b88-fe7b967abd7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:35.087272 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031f9d8-b000-45bb-8b88-fe7b967abd7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:35.096897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c70253-88ca-400f-ba02-a389d598fe37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:35.097629 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c70253-88ca-400f-ba02-a389d598fe37 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:35.097986 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c70253-88ca-400f-ba02-a389d598fe37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:35.098388 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c70253-88ca-400f-ba02-a389d598fe37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:35.099231 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c70253-88ca-400f-ba02-a389d598fe37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:34:35.100440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031f9d8-b000-45bb-8b88-fe7b967abd7b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:35.103083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c70253-88ca-400f-ba02-a389d598fe37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:35.106881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c70253-88ca-400f-ba02-a389d598fe37 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:35.123981 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2554/5133] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:34:35.125016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c70253-88ca-400f-ba02-a389d598fe37 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:35.150646 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c70253-88ca-400f-ba02-a389d598fe37 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:35.157100 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ead1a-8b4e-4e7e-aebc-6948522ba7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:35.157902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ead1a-8b4e-4e7e-aebc-6948522ba7bd admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:35.158288 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ead1a-8b4e-4e7e-aebc-6948522ba7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:35.158695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ead1a-8b4e-4e7e-aebc-6948522ba7bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:35.159527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ead1a-8b4e-4e7e-aebc-6948522ba7bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:35.162148 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2580/5134] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:34:35 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:35.162685 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ead1a-8b4e-4e7e-aebc-6948522ba7bd admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:35.165862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031f9d8-b000-45bb-8b88-fe7b967abd7b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:35.207499 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2555/5135] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:34:35 2022] POST /identity/v3/projects => generated 369 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:35.209457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ead1a-8b4e-4e7e-aebc-6948522ba7bd admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:35.289248 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:35.299146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031f9d8-b000-45bb-8b88-fe7b967abd7b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:35.385780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ead1a-8b4e-4e7e-aebc-6948522ba7bd admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:35.402111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951285d0-f5e6-4879-a6cb-70efad3f151c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:35.403199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951285d0-f5e6-4879-a6cb-70efad3f151c admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:35.403704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951285d0-f5e6-4879-a6cb-70efad3f151c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:35.404254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951285d0-f5e6-4879-a6cb-70efad3f151c admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:35.405367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951285d0-f5e6-4879-a6cb-70efad3f151c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:35.408780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951285d0-f5e6-4879-a6cb-70efad3f151c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:35.434782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805ecc3-373b-4cdf-9f96-34979c3e662d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:35.436769 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805ecc3-373b-4cdf-9f96-34979c3e662d admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:35.437245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805ecc3-373b-4cdf-9f96-34979c3e662d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:35.437541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805ecc3-373b-4cdf-9f96-34979c3e662d admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:35.438253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805ecc3-373b-4cdf-9f96-34979c3e662d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:35.441548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805ecc3-373b-4cdf-9f96-34979c3e662d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:35.444119 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2556/5136] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:34:35 2022] POST /identity/v3/users => generated 285 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:35.445417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951285d0-f5e6-4879-a6cb-70efad3f151c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:35.457697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951285d0-f5e6-4879-a6cb-70efad3f151c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:35.463771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d80f5-b81f-4f0f-8131-d81dda8e326c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:35.464796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d80f5-b81f-4f0f-8131-d81dda8e326c admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:35.465322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d80f5-b81f-4f0f-8131-d81dda8e326c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:35.465884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d80f5-b81f-4f0f-8131-d81dda8e326c admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:35.466785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d80f5-b81f-4f0f-8131-d81dda8e326c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:35.470910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d80f5-b81f-4f0f-8131-d81dda8e326c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:35.491636 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2581/5137] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:34:35 2022] POST /identity/v3/projects => generated 373 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:35.492116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805ecc3-373b-4cdf-9f96-34979c3e662d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:35.518299 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2557/5138] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:34:35 2022] POST /identity/v3/users => generated 285 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:35.519525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d80f5-b81f-4f0f-8131-d81dda8e326c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:35.535594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d80f5-b81f-4f0f-8131-d81dda8e326c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:35.577450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805ecc3-373b-4cdf-9f96-34979c3e662d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:35.595476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c999e5-f062-41a0-bbbd-09e5b387be61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:35.596426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c999e5-f062-41a0-bbbd-09e5b387be61 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:35.596850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c999e5-f062-41a0-bbbd-09e5b387be61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:35.597340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c999e5-f062-41a0-bbbd-09e5b387be61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:35.598139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c999e5-f062-41a0-bbbd-09e5b387be61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:35.599978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c999e5-f062-41a0-bbbd-09e5b387be61 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:35.603191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24095e-bcfa-4300-bb33-9b7a346229fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:35.604039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24095e-bcfa-4300-bb33-9b7a346229fd admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:35.604427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24095e-bcfa-4300-bb33-9b7a346229fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:35.604805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e24095e-bcfa-4300-bb33-9b7a346229fd admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:35.605784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24095e-bcfa-4300-bb33-9b7a346229fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:35.608299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e24095e-bcfa-4300-bb33-9b7a346229fd admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:35.615012 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2582/5139] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:35.616634 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c999e5-f062-41a0-bbbd-09e5b387be61 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:35.630127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c999e5-f062-41a0-bbbd-09e5b387be61 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:35.639733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c44d4-e73f-410a-b97a-a498284808bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:35.641435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c44d4-e73f-410a-b97a-a498284808bb admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:35.642963 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:35.643768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c44d4-e73f-410a-b97a-a498284808bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:35.644220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c44d4-e73f-410a-b97a-a498284808bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:35.645045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c44d4-e73f-410a-b97a-a498284808bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:35.649122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c44d4-e73f-410a-b97a-a498284808bb admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:35.650447 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2558/5140] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:34:35 2022] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:35.653393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24095e-bcfa-4300-bb33-9b7a346229fd admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:35.665484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e24095e-bcfa-4300-bb33-9b7a346229fd admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:35.665857 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2583/5141] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:35.666883 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c44d4-e73f-410a-b97a-a498284808bb admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:35.671566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e46aa2-4b16-4740-bb4c-233859731e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:35.672688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e46aa2-4b16-4740-bb4c-233859731e30 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:35.673075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e46aa2-4b16-4740-bb4c-233859731e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:35.673461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e46aa2-4b16-4740-bb4c-233859731e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:35.674390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e46aa2-4b16-4740-bb4c-233859731e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:35.678104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e46aa2-4b16-4740-bb4c-233859731e30 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:35.679833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c44d4-e73f-410a-b97a-a498284808bb admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:35.685829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69484b93-6cc9-46ba-8e4a-216845811a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:35.687081 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69484b93-6cc9-46ba-8e4a-216845811a20 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:35.687683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69484b93-6cc9-46ba-8e4a-216845811a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:35.688087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69484b93-6cc9-46ba-8e4a-216845811a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:35.688746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69484b93-6cc9-46ba-8e4a-216845811a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:35.690563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69484b93-6cc9-46ba-8e4a-216845811a20 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:35.699014 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2559/5142] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:35.702396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e46aa2-4b16-4740-bb4c-233859731e30 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:35.715711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e46aa2-4b16-4740-bb4c-233859731e30 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:35.721799 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2584/5143] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:35.722685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69484b93-6cc9-46ba-8e4a-216845811a20 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:35.723064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022fdd1-3d3c-428d-ac22-786b10922b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:35.724354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022fdd1-3d3c-428d-ac22-786b10922b35 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:35.724354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022fdd1-3d3c-428d-ac22-786b10922b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:35.724910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022fdd1-3d3c-428d-ac22-786b10922b35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:35.725552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022fdd1-3d3c-428d-ac22-786b10922b35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:35.727391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022fdd1-3d3c-428d-ac22-786b10922b35 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:35.739829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69484b93-6cc9-46ba-8e4a-216845811a20 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:35.746210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8e89c-05e7-4c1e-aa49-c2a59bc22386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:35.746880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8e89c-05e7-4c1e-aa49-c2a59bc22386 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:35.747161 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8e89c-05e7-4c1e-aa49-c2a59bc22386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:35.747433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8e89c-05e7-4c1e-aa49-c2a59bc22386 admin admin] PATH_INFO: `/v3/projects/954a7cd67b8547268c760f5d69eb5c6f/users/97343cc16285429a811ef4f9ed06750f/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:35.749847 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2560/5144] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:35.750872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022fdd1-3d3c-428d-ac22-786b10922b35 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:35.769454 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022fdd1-3d3c-428d-ac22-786b10922b35 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:35.776264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8e89c-05e7-4c1e-aa49-c2a59bc22386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=954a7cd67b8547268c760f5d69eb5c6f, user_id=97343cc16285429a811ef4f9ed06750f, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:35.776696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94fc57-6719-43fb-8108-e3ecf938f3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:35.777399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94fc57-6719-43fb-8108-e3ecf938f3ff admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:35.777823 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94fc57-6719-43fb-8108-e3ecf938f3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:35.778163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94fc57-6719-43fb-8108-e3ecf938f3ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:35.778933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94fc57-6719-43fb-8108-e3ecf938f3ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:35.780638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94fc57-6719-43fb-8108-e3ecf938f3ff admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:35.781269 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8e89c-05e7-4c1e-aa49-c2a59bc22386 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:35.802825 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2585/5145] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:34:35 2022] PUT /identity/v3/projects/954a7cd67b8547268c760f5d69eb5c6f/users/97343cc16285429a811ef4f9ed06750f/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:35.805080 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8e89c-05e7-4c1e-aa49-c2a59bc22386 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:35.809328 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2561/5146] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:35.814545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94fc57-6719-43fb-8108-e3ecf938f3ff admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:35.842016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94fc57-6719-43fb-8108-e3ecf938f3ff admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:35.881182 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:35.920118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8e89c-05e7-4c1e-aa49-c2a59bc22386 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:35.927668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc880e8-77db-4d70-b16f-843c7ab10c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:35.929164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc880e8-77db-4d70-b16f-843c7ab10c98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:35.929936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc880e8-77db-4d70-b16f-843c7ab10c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:35.929936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc880e8-77db-4d70-b16f-843c7ab10c98 admin admin] PATH_INFO: `/v3/projects/8da40b6c050e4a20b547401b076b9832/users/8374f06be683460595da832d19fd6a46/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:35.949284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc880e8-77db-4d70-b16f-843c7ab10c98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8da40b6c050e4a20b547401b076b9832, user_id=8374f06be683460595da832d19fd6a46, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:35.952180 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc880e8-77db-4d70-b16f-843c7ab10c98 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:35.972278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3ab6a-6235-4722-a776-25d74ab2b5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:35.972965 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3ab6a-6235-4722-a776-25d74ab2b5b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:35.975503 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3ab6a-6235-4722-a776-25d74ab2b5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:35.975794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3ab6a-6235-4722-a776-25d74ab2b5b5 admin admin] PATH_INFO: `/v3/projects/5bc9ff987bb541d6a11324aaca07182d/users/0344a81c981b434689ac476b815b8f02/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:35.992841 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2586/5147] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:34:35 2022] PUT /identity/v3/projects/8da40b6c050e4a20b547401b076b9832/users/8374f06be683460595da832d19fd6a46/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:36.000466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3ab6a-6235-4722-a776-25d74ab2b5b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bc9ff987bb541d6a11324aaca07182d, user_id=0344a81c981b434689ac476b815b8f02, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:36.003217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3ab6a-6235-4722-a776-25d74ab2b5b5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:36.009538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b9846-2aae-4b53-8f71-a4ce0369c5e0 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:36.010316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b9846-2aae-4b53-8f71-a4ce0369c5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:36.010600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b9846-2aae-4b53-8f71-a4ce0369c5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:36.031972 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2562/5148] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:34:35 2022] PUT /identity/v3/projects/5bc9ff987bb541d6a11324aaca07182d/users/0344a81c981b434689ac476b815b8f02/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:36.034316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5073975-ee0c-4fee-a0f3-22f9a5900797 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:36.034630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5073975-ee0c-4fee-a0f3-22f9a5900797 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:36.035061 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5073975-ee0c-4fee-a0f3-22f9a5900797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:36.091035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-a5073975-ee0c-4fee-a0f3-22f9a5900797 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:36.092402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c62b9846-2aae-4b53-8f71-a4ce0369c5e0 None None] MFA Rules not processed for user `97343cc16285429a811ef4f9ed06750f`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:36.093842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a5073975-ee0c-4fee-a0f3-22f9a5900797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:36.096329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c62b9846-2aae-4b53-8f71-a4ce0369c5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:36.190743 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2563/5149] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:36.194756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b102a2-0f48-4031-8dfa-a2b12f0f4f59 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:36.196891 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b102a2-0f48-4031-8dfa-a2b12f0f4f59 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:36.198054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b102a2-0f48-4031-8dfa-a2b12f0f4f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:36.206266 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2587/5150] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:36.206266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b9846-2aae-4b53-8f71-a4ce0369c5e0 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:36.206266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c62b9846-2aae-4b53-8f71-a4ce0369c5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:36.248193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-09b102a2-0f48-4031-8dfa-a2b12f0f4f59 None None] MFA Rules not processed for user `8374f06be683460595da832d19fd6a46`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:36.249652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-09b102a2-0f48-4031-8dfa-a2b12f0f4f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:36.298311 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:36.320895 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b9846-2aae-4b53-8f71-a4ce0369c5e0 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:36.326416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236742e-4ee0-47a1-b9c0-b00c1347ae8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:36.327365 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236742e-4ee0-47a1-b9c0-b00c1347ae8c service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:36.328042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236742e-4ee0-47a1-b9c0-b00c1347ae8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:36.328585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236742e-4ee0-47a1-b9c0-b00c1347ae8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:36.348367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236742e-4ee0-47a1-b9c0-b00c1347ae8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:36.350437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236742e-4ee0-47a1-b9c0-b00c1347ae8c service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:36.368810 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2588/5151] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:34:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:34:36.370022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236742e-4ee0-47a1-b9c0-b00c1347ae8c service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:36.381731 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2564/5152] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:36.384707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b102a2-0f48-4031-8dfa-a2b12f0f4f59 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:36.388680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236742e-4ee0-47a1-b9c0-b00c1347ae8c service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:36.406925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54be072-f8b9-4465-a035-eefcec13c493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:36.411608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54be072-f8b9-4465-a035-eefcec13c493 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:36.416399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54be072-f8b9-4465-a035-eefcec13c493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:36.416748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54be072-f8b9-4465-a035-eefcec13c493 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:36.417445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54be072-f8b9-4465-a035-eefcec13c493 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:36.427586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b102a2-0f48-4031-8dfa-a2b12f0f4f59 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:36.428564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54be072-f8b9-4465-a035-eefcec13c493 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:36.442418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60ce21-5dd5-4da7-9c27-7a7574a9f317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:36.443046 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60ce21-5dd5-4da7-9c27-7a7574a9f317 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:36.443329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60ce21-5dd5-4da7-9c27-7a7574a9f317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:36.443613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60ce21-5dd5-4da7-9c27-7a7574a9f317 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:36.444275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60ce21-5dd5-4da7-9c27-7a7574a9f317 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:36.448859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60ce21-5dd5-4da7-9c27-7a7574a9f317 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:36.515726 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2589/5153] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:34:36 2022] POST /identity/v3/projects => generated 367 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:36.515726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54be072-f8b9-4465-a035-eefcec13c493 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:36.518347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e54be072-f8b9-4465-a035-eefcec13c493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:36.551076 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2565/5154] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:34:36 2022] POST /identity/v3/projects => generated 369 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:36.552109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60ce21-5dd5-4da7-9c27-7a7574a9f317 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:36.578243 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:36.644814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54be072-f8b9-4465-a035-eefcec13c493 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:36.732937 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60ce21-5dd5-4da7-9c27-7a7574a9f317 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:36.747566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2377cd9-1bc5-4972-9d7e-6a8d2b207103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:36.748818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2377cd9-1bc5-4972-9d7e-6a8d2b207103 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:36.749773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2377cd9-1bc5-4972-9d7e-6a8d2b207103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:36.750046 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2377cd9-1bc5-4972-9d7e-6a8d2b207103 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:36.750691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2377cd9-1bc5-4972-9d7e-6a8d2b207103 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:36.757067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2377cd9-1bc5-4972-9d7e-6a8d2b207103 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:36.766363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed852ec5-8015-4885-a96a-551bc9813c2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:36.767322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed852ec5-8015-4885-a96a-551bc9813c2e service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:36.776363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed852ec5-8015-4885-a96a-551bc9813c2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:36.776888 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed852ec5-8015-4885-a96a-551bc9813c2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:36.781234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ed852ec5-8015-4885-a96a-551bc9813c2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:36.809220 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2566/5155] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:34:36 2022] POST /identity/v3/users => generated 290 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:36.809220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2377cd9-1bc5-4972-9d7e-6a8d2b207103 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:36.837485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2377cd9-1bc5-4972-9d7e-6a8d2b207103 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:36.861426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ea3c0-3fa6-46b6-9ee9-67305250920d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:36.862879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ea3c0-3fa6-46b6-9ee9-67305250920d admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:36.863911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ea3c0-3fa6-46b6-9ee9-67305250920d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:36.864918 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ea3c0-3fa6-46b6-9ee9-67305250920d admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:36.865610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ea3c0-3fa6-46b6-9ee9-67305250920d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:36.868757 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ea3c0-3fa6-46b6-9ee9-67305250920d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:36.918622 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2567/5156] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:34:36 2022] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:36.919544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ea3c0-3fa6-46b6-9ee9-67305250920d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:36.931553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ea3c0-3fa6-46b6-9ee9-67305250920d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:36.933411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed852ec5-8015-4885-a96a-551bc9813c2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:36.937865 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed852ec5-8015-4885-a96a-551bc9813c2e service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:36.939400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41d421-594d-4d64-a791-73fd0d40ea97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:36.940637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41d421-594d-4d64-a791-73fd0d40ea97 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:36.940637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41d421-594d-4d64-a791-73fd0d40ea97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:36.941089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41d421-594d-4d64-a791-73fd0d40ea97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:36.941875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41d421-594d-4d64-a791-73fd0d40ea97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:36.944274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41d421-594d-4d64-a791-73fd0d40ea97 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:36.978252 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2568/5157] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:36.980110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41d421-594d-4d64-a791-73fd0d40ea97 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:37.003368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41d421-594d-4d64-a791-73fd0d40ea97 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:37.012994 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2590/5158] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:34:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:34:37.014623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed852ec5-8015-4885-a96a-551bc9813c2e service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:37.014766 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f613c-4a0b-4cd2-a1c0-0b07ab660162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:37.015630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f613c-4a0b-4cd2-a1c0-0b07ab660162 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:37.016279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f613c-4a0b-4cd2-a1c0-0b07ab660162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:37.016941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f613c-4a0b-4cd2-a1c0-0b07ab660162 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:37.018592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f613c-4a0b-4cd2-a1c0-0b07ab660162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:37.031231 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f613c-4a0b-4cd2-a1c0-0b07ab660162 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:37.055234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed852ec5-8015-4885-a96a-551bc9813c2e service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:37.061597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616d890-a762-426d-ba0a-d42632a96abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:37.062339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616d890-a762-426d-ba0a-d42632a96abc admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:37.063047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616d890-a762-426d-ba0a-d42632a96abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:37.063338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616d890-a762-426d-ba0a-d42632a96abc admin admin] PATH_INFO: `/v3/projects/bd2b628e3bdf4a74b24d710a9b107eb0/users/5a2748cd33ef49199c6d7c0c4f93565a/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:37.083020 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2569/5159] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:37.084555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f613c-4a0b-4cd2-a1c0-0b07ab660162 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:37.085131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f616d890-a762-426d-ba0a-d42632a96abc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd2b628e3bdf4a74b24d710a9b107eb0, user_id=5a2748cd33ef49199c6d7c0c4f93565a, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:37.092794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f616d890-a762-426d-ba0a-d42632a96abc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:37.116048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f613c-4a0b-4cd2-a1c0-0b07ab660162 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:37.129259 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2591/5160] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:34:37 2022] PUT /identity/v3/projects/bd2b628e3bdf4a74b24d710a9b107eb0/users/5a2748cd33ef49199c6d7c0c4f93565a/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:37.130302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616d890-a762-426d-ba0a-d42632a96abc admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:37.317451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616d890-a762-426d-ba0a-d42632a96abc admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:37.323922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933521da-ba50-4991-a000-c6e80fe32d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:37.324758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933521da-ba50-4991-a000-c6e80fe32d89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:37.325214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933521da-ba50-4991-a000-c6e80fe32d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:37.325484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933521da-ba50-4991-a000-c6e80fe32d89 admin admin] PATH_INFO: `/v3/projects/3fef4a0db5ac421ba232dc44564745f0/users/bbd921ebcfe743b39efdb04b2e1d49a7/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:37.332641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417ac05-89b7-451c-a7c6-c21296ad8e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:37.336137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417ac05-89b7-451c-a7c6-c21296ad8e1e admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:37.336503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417ac05-89b7-451c-a7c6-c21296ad8e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:37.337218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417ac05-89b7-451c-a7c6-c21296ad8e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:37.348750 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:37.353467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933521da-ba50-4991-a000-c6e80fe32d89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fef4a0db5ac421ba232dc44564745f0, user_id=bbd921ebcfe743b39efdb04b2e1d49a7, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:37.356155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417ac05-89b7-451c-a7c6-c21296ad8e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:37.357662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933521da-ba50-4991-a000-c6e80fe32d89 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:37.359763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417ac05-89b7-451c-a7c6-c21296ad8e1e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:37.384613 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2570/5161] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:34:37 2022] PUT /identity/v3/projects/3fef4a0db5ac421ba232dc44564745f0/users/bbd921ebcfe743b39efdb04b2e1d49a7/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:37.391287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933521da-ba50-4991-a000-c6e80fe32d89 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:37.402075 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2592/5162] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:37.413190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417ac05-89b7-451c-a7c6-c21296ad8e1e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:37.429804 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:37.451578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417ac05-89b7-451c-a7c6-c21296ad8e1e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:37.523627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933521da-ba50-4991-a000-c6e80fe32d89 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:37.532531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da8ed6-28b9-4faa-8d5c-6cb6f3b76d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:37.533744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da8ed6-28b9-4faa-8d5c-6cb6f3b76d32 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:37.533744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da8ed6-28b9-4faa-8d5c-6cb6f3b76d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:37.533969 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da8ed6-28b9-4faa-8d5c-6cb6f3b76d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:37.535382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da8ed6-28b9-4faa-8d5c-6cb6f3b76d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:37.539820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da8ed6-28b9-4faa-8d5c-6cb6f3b76d32 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:37.558278 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2571/5163] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:37.562719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da8ed6-28b9-4faa-8d5c-6cb6f3b76d32 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:37.582421 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da8ed6-28b9-4faa-8d5c-6cb6f3b76d32 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:37.591542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20923a46-28c7-40d3-ac7c-e630a7754548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:37.592553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20923a46-28c7-40d3-ac7c-e630a7754548 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:37.593318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20923a46-28c7-40d3-ac7c-e630a7754548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:37.593759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20923a46-28c7-40d3-ac7c-e630a7754548 admin admin] PATH_INFO: `/v3/projects/3fef4a0db5ac421ba232dc44564745f0/users/bbd921ebcfe743b39efdb04b2e1d49a7/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:37.597125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20923a46-28c7-40d3-ac7c-e630a7754548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fef4a0db5ac421ba232dc44564745f0, user_id=bbd921ebcfe743b39efdb04b2e1d49a7, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:37.600436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20923a46-28c7-40d3-ac7c-e630a7754548 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:37.615097 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2572/5164] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:34:37 2022] PUT /identity/v3/projects/3fef4a0db5ac421ba232dc44564745f0/users/bbd921ebcfe743b39efdb04b2e1d49a7/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:37.625804 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604fe03-eded-4620-8ff8-30068405ee2b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:37.626188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604fe03-eded-4620-8ff8-30068405ee2b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:37.626560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604fe03-eded-4620-8ff8-30068405ee2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:37.640612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc8d7e-395f-4b7a-9d3a-511fbf7da9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:37.641480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc8d7e-395f-4b7a-9d3a-511fbf7da9ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:37.642158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc8d7e-395f-4b7a-9d3a-511fbf7da9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:37.642604 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc8d7e-395f-4b7a-9d3a-511fbf7da9ec admin admin] PATH_INFO: `/v3/projects/bd2b628e3bdf4a74b24d710a9b107eb0/users/5a2748cd33ef49199c6d7c0c4f93565a/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:37.645103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc8d7e-395f-4b7a-9d3a-511fbf7da9ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd2b628e3bdf4a74b24d710a9b107eb0, user_id=5a2748cd33ef49199c6d7c0c4f93565a, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:37.648871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc8d7e-395f-4b7a-9d3a-511fbf7da9ec admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:37.674552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-8604fe03-eded-4620-8ff8-30068405ee2b None None] MFA Rules not processed for user `bbd921ebcfe743b39efdb04b2e1d49a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:37.675728 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2593/5165] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:34:37 2022] PUT /identity/v3/projects/bd2b628e3bdf4a74b24d710a9b107eb0/users/5a2748cd33ef49199c6d7c0c4f93565a/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:37.676727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8604fe03-eded-4620-8ff8-30068405ee2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:37.692802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f644f6a-9e83-486d-8260-f1dbee465cd2 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:37.693295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f644f6a-9e83-486d-8260-f1dbee465cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:37.693779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f644f6a-9e83-486d-8260-f1dbee465cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:37.744005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2f644f6a-9e83-486d-8260-f1dbee465cd2 None None] MFA Rules not processed for user `5a2748cd33ef49199c6d7c0c4f93565a`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:37.745541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2f644f6a-9e83-486d-8260-f1dbee465cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:37.873864 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2594/5166] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:37.906925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f644f6a-9e83-486d-8260-f1dbee465cd2 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:37.907223 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2573/5167] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:37 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:34:37.925405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f644f6a-9e83-486d-8260-f1dbee465cd2 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:37.934999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ebcef-006b-4e6e-bc3f-54dd4e9df64e tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:37.934999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ebcef-006b-4e6e-bc3f-54dd4e9df64e tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:37.934999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ebcef-006b-4e6e-bc3f-54dd4e9df64e tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:37.935424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ebcef-006b-4e6e-bc3f-54dd4e9df64e tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:37.936785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ebcef-006b-4e6e-bc3f-54dd4e9df64e tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:37.938650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ebcef-006b-4e6e-bc3f-54dd4e9df64e tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:37.939183 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604fe03-eded-4620-8ff8-30068405ee2b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:38.001160 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2595/5168] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:34:37 2022] POST /identity/v3/projects => generated 359 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:38.003964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ebcef-006b-4e6e-bc3f-54dd4e9df64e tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:38.055540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604fe03-eded-4620-8ff8-30068405ee2b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:38.080682 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:38.121415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ebcef-006b-4e6e-bc3f-54dd4e9df64e tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:38.127814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad6ee6-3566-4baf-a020-50c769daa89b tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:38.128674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad6ee6-3566-4baf-a020-50c769daa89b tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:38.128963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad6ee6-3566-4baf-a020-50c769daa89b tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:38.129383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad6ee6-3566-4baf-a020-50c769daa89b tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:38.130412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad6ee6-3566-4baf-a020-50c769daa89b tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:38.133075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad6ee6-3566-4baf-a020-50c769daa89b tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:38.141560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b5ce9-b354-4225-adb0-e1de03a1400d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:38.142816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b5ce9-b354-4225-adb0-e1de03a1400d service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:38.143114 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b5ce9-b354-4225-adb0-e1de03a1400d service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:38.143486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b5ce9-b354-4225-adb0-e1de03a1400d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:38.144819 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:38.168705 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2596/5169] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:34:38 2022] POST /identity/v3/users => generated 416 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:38.173310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad6ee6-3566-4baf-a020-50c769daa89b tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:38.187578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad6ee6-3566-4baf-a020-50c769daa89b tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:38.193784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021365d-cb46-4353-8967-b6fd6acd8d36 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:38.194605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021365d-cb46-4353-8967-b6fd6acd8d36 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:38.195106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021365d-cb46-4353-8967-b6fd6acd8d36 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:38.196006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021365d-cb46-4353-8967-b6fd6acd8d36 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/users/b336877a26e94b059f875e8dcb2a297f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:38.220777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021365d-cb46-4353-8967-b6fd6acd8d36 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:get_user(user_id=b336877a26e94b059f875e8dcb2a297f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:38.224150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021365d-cb46-4353-8967-b6fd6acd8d36 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:38.226404 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2597/5170] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Aug 7 01:34:38 2022] GET /identity/v3/users/b336877a26e94b059f875e8dcb2a297f => generated 416 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:34:38.232334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021365d-cb46-4353-8967-b6fd6acd8d36 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:38.244945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b5ce9-b354-4225-adb0-e1de03a1400d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:38.245982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021365d-cb46-4353-8967-b6fd6acd8d36 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:38.246838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b5ce9-b354-4225-adb0-e1de03a1400d service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:38.254831 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858dc79-4063-4e39-943a-14cdadca30fd tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:38.256112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858dc79-4063-4e39-943a-14cdadca30fd tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:38.256694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858dc79-4063-4e39-943a-14cdadca30fd tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:38.257113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858dc79-4063-4e39-943a-14cdadca30fd tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/users/b336877a26e94b059f875e8dcb2a297f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:38.259309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c858dc79-4063-4e39-943a-14cdadca30fd tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b336877a26e94b059f875e8dcb2a297f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:38.262828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c858dc79-4063-4e39-943a-14cdadca30fd tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:38.269022 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2574/5171] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:34:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:34:38.331985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c858dc79-4063-4e39-943a-14cdadca30fd tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b336877a26e94b059f875e8dcb2a297f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:38.341257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c858dc79-4063-4e39-943a-14cdadca30fd tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b336877a26e94b059f875e8dcb2a297f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:38.359550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c858dc79-4063-4e39-943a-14cdadca30fd tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b336877a26e94b059f875e8dcb2a297f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:38.360548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c858dc79-4063-4e39-943a-14cdadca30fd tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b336877a26e94b059f875e8dcb2a297f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:38.371603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c858dc79-4063-4e39-943a-14cdadca30fd tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b336877a26e94b059f875e8dcb2a297f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:38.382450 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2598/5172] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:34:38 2022] DELETE /identity/v3/users/b336877a26e94b059f875e8dcb2a297f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:38.386506 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b5ce9-b354-4225-adb0-e1de03a1400d service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:38.399543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b5ce9-b354-4225-adb0-e1de03a1400d service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:38.504237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9ce43-3a7b-4f2b-92e0-c886cb17d46d tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:38.505004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9ce43-3a7b-4f2b-92e0-c886cb17d46d tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:38.505358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9ce43-3a7b-4f2b-92e0-c886cb17d46d tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:38.505702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9ce43-3a7b-4f2b-92e0-c886cb17d46d tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects/0beaa5f6cabd431b90e4770c4781069a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:38.507319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9ce43-3a7b-4f2b-92e0-c886cb17d46d tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0beaa5f6cabd431b90e4770c4781069a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:38.509443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9ce43-3a7b-4f2b-92e0-c886cb17d46d tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:38.608364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c1f9ce43-3a7b-4f2b-92e0-c886cb17d46d tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0beaa5f6cabd431b90e4770c4781069a', 'request_id': 'req-c1f9ce43-3a7b-4f2b-92e0-c886cb17d46d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:38.615659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c1f9ce43-3a7b-4f2b-92e0-c886cb17d46d tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0beaa5f6cabd431b90e4770c4781069a', 'request_id': 'req-c1f9ce43-3a7b-4f2b-92e0-c886cb17d46d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:38.624486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c1f9ce43-3a7b-4f2b-92e0-c886cb17d46d tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0beaa5f6cabd431b90e4770c4781069a', 'request_id': 'req-c1f9ce43-3a7b-4f2b-92e0-c886cb17d46d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:38.629805 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:38.648397 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c1f9ce43-3a7b-4f2b-92e0-c886cb17d46d tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] The token cache is being invalidate because project 0beaa5f6cabd431b90e4770c4781069a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:38.648397 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c1f9ce43-3a7b-4f2b-92e0-c886cb17d46d tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:38.649142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c1f9ce43-3a7b-4f2b-92e0-c886cb17d46d tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:38.655960 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2575/5173] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:38 2022] DELETE /identity/v3/projects/0beaa5f6cabd431b90e4770c4781069a => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:38.660710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858dc79-4063-4e39-943a-14cdadca30fd tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:38.662625 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c858dc79-4063-4e39-943a-14cdadca30fd tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:38.684650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858dc79-4063-4e39-943a-14cdadca30fd tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:38.807408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b70cd-8ca2-420a-9fd4-eb2866fa72cf tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:38.808715 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b70cd-8ca2-420a-9fd4-eb2866fa72cf tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:38.811072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b70cd-8ca2-420a-9fd4-eb2866fa72cf tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:38.811437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b70cd-8ca2-420a-9fd4-eb2866fa72cf tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:38.817609 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b70cd-8ca2-420a-9fd4-eb2866fa72cf tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:38.819638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b70cd-8ca2-420a-9fd4-eb2866fa72cf tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:38.847344 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2599/5174] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:34:38 2022] POST /identity/v3/projects => generated 349 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:38.848211 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9ce43-3a7b-4f2b-92e0-c886cb17d46d tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:38.850143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c1f9ce43-3a7b-4f2b-92e0-c886cb17d46d tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:38.856976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b70cd-8ca2-420a-9fd4-eb2866fa72cf tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:38.859493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d27b70cd-8ca2-420a-9fd4-eb2866fa72cf tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:38.868406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9ce43-3a7b-4f2b-92e0-c886cb17d46d tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:38.944516 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:INSERT=5,keystone:SELECT=85,keystone:DELETE=10 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:38.989009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b70cd-8ca2-420a-9fd4-eb2866fa72cf tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:38.995988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e7537-5f11-4370-ace6-7119bce10ebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:38.998428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e7537-5f11-4370-ace6-7119bce10ebe service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:38.998999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e7537-5f11-4370-ace6-7119bce10ebe service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:38.999585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e7537-5f11-4370-ace6-7119bce10ebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:39.003941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-780e7537-5f11-4370-ace6-7119bce10ebe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:39.050423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0952d-80c9-4df7-a65b-f61357c4f580 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:39.051265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0952d-80c9-4df7-a65b-f61357c4f580 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:39.051633 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0952d-80c9-4df7-a65b-f61357c4f580 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:39.052001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0952d-80c9-4df7-a65b-f61357c4f580 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:39.053225 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0952d-80c9-4df7-a65b-f61357c4f580 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:34:39.053538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0952d-80c9-4df7-a65b-f61357c4f580 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:39.054588 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-0af0952d-80c9-4df7-a65b-f61357c4f580 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:34:39.054588 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:34:39.054588 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:34:39.055835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0952d-80c9-4df7-a65b-f61357c4f580 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:39.089040 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2576/5175] 10.222.0.39 () {58 vars in 1160 bytes} [Sun Aug 7 01:34:38 2022] GET /identity/v3/projects?is_domain=True => generated 1021 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:34:39.091735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0952d-80c9-4df7-a65b-f61357c4f580 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:39.116243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0952d-80c9-4df7-a65b-f61357c4f580 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:39.122492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66de17e-f734-423c-b528-6549169c60ee tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:39.123517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66de17e-f734-423c-b528-6549169c60ee tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:39.124055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66de17e-f734-423c-b528-6549169c60ee tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:39.124563 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66de17e-f734-423c-b528-6549169c60ee tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:39.125427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66de17e-f734-423c-b528-6549169c60ee tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:39.127384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66de17e-f734-423c-b528-6549169c60ee tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:39.156450 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2577/5176] 10.222.0.39 () {58 vars in 1128 bytes} [Sun Aug 7 01:34:39 2022] GET /identity/v3/domains => generated 830 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:34:39.161977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e7537-5f11-4370-ace6-7119bce10ebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:39.165352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66de17e-f734-423c-b528-6549169c60ee tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:39.167002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e7537-5f11-4370-ace6-7119bce10ebe service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:39.197255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66de17e-f734-423c-b528-6549169c60ee tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:39.206337 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2600/5177] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:34:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:34:39.217682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3e9f0-7707-49ac-a7dc-e8ec26409dcc tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:39.220703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3e9f0-7707-49ac-a7dc-e8ec26409dcc tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:39.221822 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3e9f0-7707-49ac-a7dc-e8ec26409dcc tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:39.223786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3e9f0-7707-49ac-a7dc-e8ec26409dcc tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects/b19acc8d6f344f7590ed9e3385f594f4` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:39.226478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3e9f0-7707-49ac-a7dc-e8ec26409dcc tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:update_project(project_id=b19acc8d6f344f7590ed9e3385f594f4)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:39.229862 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-11e3e9f0-7707-49ac-a7dc-e8ec26409dcc tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:34:39.229862 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:34:39.229862 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:34:39.232824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3e9f0-7707-49ac-a7dc-e8ec26409dcc tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:39.256190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-11e3e9f0-7707-49ac-a7dc-e8ec26409dcc tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b19acc8d6f344f7590ed9e3385f594f4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:39.257862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-11e3e9f0-7707-49ac-a7dc-e8ec26409dcc tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b19acc8d6f344f7590ed9e3385f594f4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:39.311830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-11e3e9f0-7707-49ac-a7dc-e8ec26409dcc tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b19acc8d6f344f7590ed9e3385f594f4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:39.312858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-11e3e9f0-7707-49ac-a7dc-e8ec26409dcc tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b19acc8d6f344f7590ed9e3385f594f4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:39.315933 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2578/5178] 10.222.0.39 () {60 vars in 1252 bytes} [Sun Aug 7 01:34:39 2022] PATCH /identity/v3/projects/b19acc8d6f344f7590ed9e3385f594f4 => generated 363 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:34:39.319941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e7537-5f11-4370-ace6-7119bce10ebe service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:39.333107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e7537-5f11-4370-ace6-7119bce10ebe service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:39.425301 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4904d4e-9023-45fc-ab62-e7e07e2dce76 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:39.425955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4904d4e-9023-45fc-ab62-e7e07e2dce76 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:39.426232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4904d4e-9023-45fc-ab62-e7e07e2dce76 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:39.426504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4904d4e-9023-45fc-ab62-e7e07e2dce76 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects/b19acc8d6f344f7590ed9e3385f594f4` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:39.442595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4904d4e-9023-45fc-ab62-e7e07e2dce76 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b19acc8d6f344f7590ed9e3385f594f4)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:39.445583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4904d4e-9023-45fc-ab62-e7e07e2dce76 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:39.525696 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b4904d4e-9023-45fc-ab62-e7e07e2dce76 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b19acc8d6f344f7590ed9e3385f594f4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:39.563779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b4904d4e-9023-45fc-ab62-e7e07e2dce76 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b19acc8d6f344f7590ed9e3385f594f4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:39.660836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b4904d4e-9023-45fc-ab62-e7e07e2dce76 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b19acc8d6f344f7590ed9e3385f594f4', 'request_id': 'req-b4904d4e-9023-45fc-ab62-e7e07e2dce76'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:39.662505 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:39.676915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b4904d4e-9023-45fc-ab62-e7e07e2dce76 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b19acc8d6f344f7590ed9e3385f594f4', 'request_id': 'req-b4904d4e-9023-45fc-ab62-e7e07e2dce76'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:39.688553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b4904d4e-9023-45fc-ab62-e7e07e2dce76 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b19acc8d6f344f7590ed9e3385f594f4', 'request_id': 'req-b4904d4e-9023-45fc-ab62-e7e07e2dce76'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:39.708403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b4904d4e-9023-45fc-ab62-e7e07e2dce76 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] The token cache is being invalidate because project b19acc8d6f344f7590ed9e3385f594f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:39.708985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b4904d4e-9023-45fc-ab62-e7e07e2dce76 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:39.711778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b4904d4e-9023-45fc-ab62-e7e07e2dce76 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:39.725753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b4904d4e-9023-45fc-ab62-e7e07e2dce76 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b19acc8d6f344f7590ed9e3385f594f4', 'request_id': 'req-b4904d4e-9023-45fc-ab62-e7e07e2dce76'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:39.731205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b4904d4e-9023-45fc-ab62-e7e07e2dce76 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b19acc8d6f344f7590ed9e3385f594f4', 'request_id': 'req-b4904d4e-9023-45fc-ab62-e7e07e2dce76'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:39.733195 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b4904d4e-9023-45fc-ab62-e7e07e2dce76 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b19acc8d6f344f7590ed9e3385f594f4', 'request_id': 'req-b4904d4e-9023-45fc-ab62-e7e07e2dce76'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:39.753139 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2601/5179] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:39 2022] DELETE /identity/v3/projects/b19acc8d6f344f7590ed9e3385f594f4 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:39.757156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3e9f0-7707-49ac-a7dc-e8ec26409dcc tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:39.757156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-11e3e9f0-7707-49ac-a7dc-e8ec26409dcc tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:39.794799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3e9f0-7707-49ac-a7dc-e8ec26409dcc tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:39.906695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cdde4-dba2-4ca4-b921-32fbd9ee7294 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:39.910119 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cdde4-dba2-4ca4-b921-32fbd9ee7294 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:39.911853 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cdde4-dba2-4ca4-b921-32fbd9ee7294 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:39.912395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cdde4-dba2-4ca4-b921-32fbd9ee7294 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:39.916836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cdde4-dba2-4ca4-b921-32fbd9ee7294 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:39.921390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cdde4-dba2-4ca4-b921-32fbd9ee7294 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:39.991943 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2579/5180] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:34:39 2022] POST /identity/v3/projects => generated 358 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:34:39.995794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4904d4e-9023-45fc-ab62-e7e07e2dce76 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:39.997252 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b4904d4e-9023-45fc-ab62-e7e07e2dce76 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:40.011118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4904d4e-9023-45fc-ab62-e7e07e2dce76 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:40.111812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2b187-dd8f-435d-9f68-bafeb6e65149 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:40.112518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2b187-dd8f-435d-9f68-bafeb6e65149 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:40.112946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2b187-dd8f-435d-9f68-bafeb6e65149 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:40.113581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2b187-dd8f-435d-9f68-bafeb6e65149 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects/d40441500d954e0da252c9846234030d` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:40.114948 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2b187-dd8f-435d-9f68-bafeb6e65149 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:get_project(project_id=d40441500d954e0da252c9846234030d)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:40.118206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2b187-dd8f-435d-9f68-bafeb6e65149 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:40.121963 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2602/5181] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:34:39 2022] GET /identity/v3/projects/d40441500d954e0da252c9846234030d => generated 358 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:34:40.127069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cdde4-dba2-4ca4-b921-32fbd9ee7294 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:40.142151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cdde4-dba2-4ca4-b921-32fbd9ee7294 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:40.147584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f39bc0-99be-42de-9df2-77df389fb167 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:40.148633 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f39bc0-99be-42de-9df2-77df389fb167 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:40.149035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f39bc0-99be-42de-9df2-77df389fb167 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:40.149525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f39bc0-99be-42de-9df2-77df389fb167 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects/d40441500d954e0da252c9846234030d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:40.150996 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f39bc0-99be-42de-9df2-77df389fb167 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d40441500d954e0da252c9846234030d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:40.153405 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f39bc0-99be-42de-9df2-77df389fb167 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:40.189744 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:40.247805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-08f39bc0-99be-42de-9df2-77df389fb167 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd40441500d954e0da252c9846234030d', 'request_id': 'req-08f39bc0-99be-42de-9df2-77df389fb167'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:40.273380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-08f39bc0-99be-42de-9df2-77df389fb167 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd40441500d954e0da252c9846234030d', 'request_id': 'req-08f39bc0-99be-42de-9df2-77df389fb167'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:40.285842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-08f39bc0-99be-42de-9df2-77df389fb167 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd40441500d954e0da252c9846234030d', 'request_id': 'req-08f39bc0-99be-42de-9df2-77df389fb167'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:40.319648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-08f39bc0-99be-42de-9df2-77df389fb167 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] The token cache is being invalidate because project d40441500d954e0da252c9846234030d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:40.320537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-08f39bc0-99be-42de-9df2-77df389fb167 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:40.321351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-08f39bc0-99be-42de-9df2-77df389fb167 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:40.325398 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2580/5182] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:40 2022] DELETE /identity/v3/projects/d40441500d954e0da252c9846234030d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:40.330048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2b187-dd8f-435d-9f68-bafeb6e65149 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:40.333423 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-53e2b187-dd8f-435d-9f68-bafeb6e65149 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:40.355529 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2b187-dd8f-435d-9f68-bafeb6e65149 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:40.440168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d14be8-d7d9-4a9f-99d7-621facc38077 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:40.440922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d14be8-d7d9-4a9f-99d7-621facc38077 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:40.441573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d14be8-d7d9-4a9f-99d7-621facc38077 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:40.442096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d14be8-d7d9-4a9f-99d7-621facc38077 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:40.443221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d14be8-d7d9-4a9f-99d7-621facc38077 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:40.446256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d14be8-d7d9-4a9f-99d7-621facc38077 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:40.500445 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2603/5183] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:34:40 2022] POST /identity/v3/projects => generated 361 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:34:40.504724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f39bc0-99be-42de-9df2-77df389fb167 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:40.524531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f39bc0-99be-42de-9df2-77df389fb167 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:40.613535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44ca16-f25d-4fca-a5c7-29c9a37713b7 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:40.614303 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44ca16-f25d-4fca-a5c7-29c9a37713b7 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:40.614705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44ca16-f25d-4fca-a5c7-29c9a37713b7 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:40.615036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44ca16-f25d-4fca-a5c7-29c9a37713b7 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects/b9dd08e6783d45a3b5032409062aae42` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:40.616726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44ca16-f25d-4fca-a5c7-29c9a37713b7 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:get_project(project_id=b9dd08e6783d45a3b5032409062aae42)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:40.623645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44ca16-f25d-4fca-a5c7-29c9a37713b7 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:40.629323 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2581/5184] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:34:40 2022] GET /identity/v3/projects/b9dd08e6783d45a3b5032409062aae42 => generated 361 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:34:40.634010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d14be8-d7d9-4a9f-99d7-621facc38077 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:40.655492 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d14be8-d7d9-4a9f-99d7-621facc38077 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:40.661852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9132d2-8265-4890-abe1-f9de20c7addf tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:40.662511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9132d2-8265-4890-abe1-f9de20c7addf tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:40.662989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9132d2-8265-4890-abe1-f9de20c7addf tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:40.663454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9132d2-8265-4890-abe1-f9de20c7addf tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects/b9dd08e6783d45a3b5032409062aae42` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:40.664611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9132d2-8265-4890-abe1-f9de20c7addf tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b9dd08e6783d45a3b5032409062aae42)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:40.667100 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9132d2-8265-4890-abe1-f9de20c7addf tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:40.740082 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:40.757017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fd9132d2-8265-4890-abe1-f9de20c7addf tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9dd08e6783d45a3b5032409062aae42', 'request_id': 'req-fd9132d2-8265-4890-abe1-f9de20c7addf'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:40.765598 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fd9132d2-8265-4890-abe1-f9de20c7addf tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9dd08e6783d45a3b5032409062aae42', 'request_id': 'req-fd9132d2-8265-4890-abe1-f9de20c7addf'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:40.773869 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fd9132d2-8265-4890-abe1-f9de20c7addf tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9dd08e6783d45a3b5032409062aae42', 'request_id': 'req-fd9132d2-8265-4890-abe1-f9de20c7addf'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:40.800908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fd9132d2-8265-4890-abe1-f9de20c7addf tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] The token cache is being invalidate because project b9dd08e6783d45a3b5032409062aae42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:40.800908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fd9132d2-8265-4890-abe1-f9de20c7addf tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:40.801345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fd9132d2-8265-4890-abe1-f9de20c7addf tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:40.803153 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2604/5185] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:40 2022] DELETE /identity/v3/projects/b9dd08e6783d45a3b5032409062aae42 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:40.808601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44ca16-f25d-4fca-a5c7-29c9a37713b7 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:40.810842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4b44ca16-f25d-4fca-a5c7-29c9a37713b7 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:40.825154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44ca16-f25d-4fca-a5c7-29c9a37713b7 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:40.924504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3fd45-2474-40f4-8a37-844e27de5ac9 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:40.925269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3fd45-2474-40f4-8a37-844e27de5ac9 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:40.925557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3fd45-2474-40f4-8a37-844e27de5ac9 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:40.925827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e3fd45-2474-40f4-8a37-844e27de5ac9 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:40.927347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e3fd45-2474-40f4-8a37-844e27de5ac9 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:40.931117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e3fd45-2474-40f4-8a37-844e27de5ac9 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:41.011589 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2582/5186] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Aug 7 01:34:40 2022] POST /identity/v3/projects => generated 346 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:41.015030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9132d2-8265-4890-abe1-f9de20c7addf tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:41.028656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9132d2-8265-4890-abe1-f9de20c7addf tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:41.050748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3fd45-2474-40f4-8a37-844e27de5ac9 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:41.052989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-55e3fd45-2474-40f4-8a37-844e27de5ac9 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:41.145831 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:41.146980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0eecef-4bad-4af7-969d-9b18dd3c81a8 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:41.147855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0eecef-4bad-4af7-969d-9b18dd3c81a8 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:41.148263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0eecef-4bad-4af7-969d-9b18dd3c81a8 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:41.149057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0eecef-4bad-4af7-969d-9b18dd3c81a8 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects/fb3d67848b6b4f3f860646c3d2c119cc` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:41.155335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0eecef-4bad-4af7-969d-9b18dd3c81a8 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:get_project(project_id=fb3d67848b6b4f3f860646c3d2c119cc)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:41.161267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0eecef-4bad-4af7-969d-9b18dd3c81a8 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:41.161638 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2605/5187] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:34:41 2022] GET /identity/v3/projects/fb3d67848b6b4f3f860646c3d2c119cc => generated 346 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:34:41.167530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0eecef-4bad-4af7-969d-9b18dd3c81a8 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:41.186524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0eecef-4bad-4af7-969d-9b18dd3c81a8 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:41.192959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab920e9e-97a1-453f-9295-fddf2a171a0b tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:41.194389 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab920e9e-97a1-453f-9295-fddf2a171a0b tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:41.194943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab920e9e-97a1-453f-9295-fddf2a171a0b tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:41.195298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab920e9e-97a1-453f-9295-fddf2a171a0b tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects/fb3d67848b6b4f3f860646c3d2c119cc` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:41.198396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab920e9e-97a1-453f-9295-fddf2a171a0b tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fb3d67848b6b4f3f860646c3d2c119cc)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:41.201224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab920e9e-97a1-453f-9295-fddf2a171a0b tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:41.229799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e3fd45-2474-40f4-8a37-844e27de5ac9 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:41.234179 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0848d-c907-4bda-b7d4-0de4528d37d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:41.235021 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0848d-c907-4bda-b7d4-0de4528d37d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:41.235487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0848d-c907-4bda-b7d4-0de4528d37d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:41.236144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0848d-c907-4bda-b7d4-0de4528d37d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:41.248848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-41f0848d-c907-4bda-b7d4-0de4528d37d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:41.284675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ab920e9e-97a1-453f-9295-fddf2a171a0b tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb3d67848b6b4f3f860646c3d2c119cc', 'request_id': 'req-ab920e9e-97a1-453f-9295-fddf2a171a0b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:41.294798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ab920e9e-97a1-453f-9295-fddf2a171a0b tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb3d67848b6b4f3f860646c3d2c119cc', 'request_id': 'req-ab920e9e-97a1-453f-9295-fddf2a171a0b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:41.305566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ab920e9e-97a1-453f-9295-fddf2a171a0b tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb3d67848b6b4f3f860646c3d2c119cc', 'request_id': 'req-ab920e9e-97a1-453f-9295-fddf2a171a0b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:41.327392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ab920e9e-97a1-453f-9295-fddf2a171a0b tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] The token cache is being invalidate because project fb3d67848b6b4f3f860646c3d2c119cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:41.327689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ab920e9e-97a1-453f-9295-fddf2a171a0b tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:41.328444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ab920e9e-97a1-453f-9295-fddf2a171a0b tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:41.334288 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2606/5188] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:41 2022] DELETE /identity/v3/projects/fb3d67848b6b4f3f860646c3d2c119cc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:41.335502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab920e9e-97a1-453f-9295-fddf2a171a0b tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:41.337557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ab920e9e-97a1-453f-9295-fddf2a171a0b tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:41.385129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0848d-c907-4bda-b7d4-0de4528d37d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:41.387314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0848d-c907-4bda-b7d4-0de4528d37d9 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:41.420416 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2583/5189] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:34:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:34:41.421754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0848d-c907-4bda-b7d4-0de4528d37d9 service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:41.423610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-41f0848d-c907-4bda-b7d4-0de4528d37d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:41.446814 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:41.460232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab920e9e-97a1-453f-9295-fddf2a171a0b tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:41.476761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0856f6-029b-4da5-8064-78a8a5519df0 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:41.477566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0856f6-029b-4da5-8064-78a8a5519df0 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:41.478028 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0856f6-029b-4da5-8064-78a8a5519df0 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:41.478925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0856f6-029b-4da5-8064-78a8a5519df0 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:41.480657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0856f6-029b-4da5-8064-78a8a5519df0 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:41.488298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0856f6-029b-4da5-8064-78a8a5519df0 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:41.523976 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2607/5190] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Aug 7 01:34:41 2022] POST /identity/v3/domains => generated 276 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:34:41.527029 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0856f6-029b-4da5-8064-78a8a5519df0 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:41.583513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0848d-c907-4bda-b7d4-0de4528d37d9 service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:41.668136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0856f6-029b-4da5-8064-78a8a5519df0 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:41.684198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018609c-7138-4bb2-add9-3a5687428434 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:41.684846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018609c-7138-4bb2-add9-3a5687428434 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:41.685130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018609c-7138-4bb2-add9-3a5687428434 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:41.685407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018609c-7138-4bb2-add9-3a5687428434 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:41.686182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018609c-7138-4bb2-add9-3a5687428434 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:41.689039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018609c-7138-4bb2-add9-3a5687428434 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:41.690438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88ba51-99bf-4391-b0a3-dfc18faf6310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:41.691382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88ba51-99bf-4391-b0a3-dfc18faf6310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:41.691382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88ba51-99bf-4391-b0a3-dfc18faf6310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:41.691601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88ba51-99bf-4391-b0a3-dfc18faf6310 admin admin] PATH_INFO: `/v3/users/97343cc16285429a811ef4f9ed06750f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:41.694702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88ba51-99bf-4391-b0a3-dfc18faf6310 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97343cc16285429a811ef4f9ed06750f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:41.697514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88ba51-99bf-4391-b0a3-dfc18faf6310 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:41.738312 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:41.779149 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2608/5191] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:34:41 2022] POST /identity/v3/projects => generated 404 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:41.780711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018609c-7138-4bb2-add9-3a5687428434 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:41.799676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1c88ba51-99bf-4391-b0a3-dfc18faf6310 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97343cc16285429a811ef4f9ed06750f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:41.829681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1c88ba51-99bf-4391-b0a3-dfc18faf6310 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97343cc16285429a811ef4f9ed06750f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:41.845852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1c88ba51-99bf-4391-b0a3-dfc18faf6310 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97343cc16285429a811ef4f9ed06750f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:41.847340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1c88ba51-99bf-4391-b0a3-dfc18faf6310 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97343cc16285429a811ef4f9ed06750f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:41.864227 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1c88ba51-99bf-4391-b0a3-dfc18faf6310 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97343cc16285429a811ef4f9ed06750f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:41.902256 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2584/5192] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:34:41 2022] DELETE /identity/v3/users/97343cc16285429a811ef4f9ed06750f => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:41.906609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fe465-62a1-488b-8a5f-2729e465e16c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:41.906913 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fe465-62a1-488b-8a5f-2729e465e16c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:41.907169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fe465-62a1-488b-8a5f-2729e465e16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:41.920281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018609c-7138-4bb2-add9-3a5687428434 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:41.979685 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3b1fe465-62a1-488b-8a5f-2729e465e16c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:41.981194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3b1fe465-62a1-488b-8a5f-2729e465e16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:42.066372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5dbd8-0dfd-46ce-b8df-41e743b6ea26 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:42.067027 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5dbd8-0dfd-46ce-b8df-41e743b6ea26 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:42.067555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5dbd8-0dfd-46ce-b8df-41e743b6ea26 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:42.067810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5dbd8-0dfd-46ce-b8df-41e743b6ea26 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects/60a5e7862ce44fb79d27d5fb784cb2f6` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:42.069276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5dbd8-0dfd-46ce-b8df-41e743b6ea26 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:get_project(project_id=60a5e7862ce44fb79d27d5fb784cb2f6)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:42.071788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5dbd8-0dfd-46ce-b8df-41e743b6ea26 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:42.078331 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2609/5193] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:34:41 2022] GET /identity/v3/projects/60a5e7862ce44fb79d27d5fb784cb2f6 => generated 404 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:34:42.081165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5dbd8-0dfd-46ce-b8df-41e743b6ea26 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:42.083876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1ef5dbd8-0dfd-46ce-b8df-41e743b6ea26 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:42.100126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5dbd8-0dfd-46ce-b8df-41e743b6ea26 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:42.109825 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2585/5194] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:42.114460 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827552d-3ccf-4592-89a1-390fa511aca7 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:42.115364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827552d-3ccf-4592-89a1-390fa511aca7 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:42.115645 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827552d-3ccf-4592-89a1-390fa511aca7 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:42.115935 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827552d-3ccf-4592-89a1-390fa511aca7 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects/60a5e7862ce44fb79d27d5fb784cb2f6` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:42.117397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827552d-3ccf-4592-89a1-390fa511aca7 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:delete_project(project_id=60a5e7862ce44fb79d27d5fb784cb2f6)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:42.121426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827552d-3ccf-4592-89a1-390fa511aca7 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:42.121612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fe465-62a1-488b-8a5f-2729e465e16c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:42.123090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3b1fe465-62a1-488b-8a5f-2729e465e16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:42.138814 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:42.216219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6827552d-3ccf-4592-89a1-390fa511aca7 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60a5e7862ce44fb79d27d5fb784cb2f6', 'request_id': 'req-6827552d-3ccf-4592-89a1-390fa511aca7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:42.220994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fe465-62a1-488b-8a5f-2729e465e16c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:42.222880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6827552d-3ccf-4592-89a1-390fa511aca7 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60a5e7862ce44fb79d27d5fb784cb2f6', 'request_id': 'req-6827552d-3ccf-4592-89a1-390fa511aca7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:42.230596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6827552d-3ccf-4592-89a1-390fa511aca7 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60a5e7862ce44fb79d27d5fb784cb2f6', 'request_id': 'req-6827552d-3ccf-4592-89a1-390fa511aca7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:42.250135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6827552d-3ccf-4592-89a1-390fa511aca7 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] The token cache is being invalidate because project 60a5e7862ce44fb79d27d5fb784cb2f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:42.250135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6827552d-3ccf-4592-89a1-390fa511aca7 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:42.251530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6827552d-3ccf-4592-89a1-390fa511aca7 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:42.256684 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2610/5195] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:42 2022] DELETE /identity/v3/projects/60a5e7862ce44fb79d27d5fb784cb2f6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:42.257699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827552d-3ccf-4592-89a1-390fa511aca7 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:42.259386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6827552d-3ccf-4592-89a1-390fa511aca7 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:42.330062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5037e6-5bf3-4f2f-b1da-6c240d407e1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:42.330704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5037e6-5bf3-4f2f-b1da-6c240d407e1c service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:42.330985 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5037e6-5bf3-4f2f-b1da-6c240d407e1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:42.331260 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5037e6-5bf3-4f2f-b1da-6c240d407e1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:42.336002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0d5037e6-5bf3-4f2f-b1da-6c240d407e1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:42.363294 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:42.390014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827552d-3ccf-4592-89a1-390fa511aca7 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:42.399453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bf568-340a-4040-8ccb-686bde8847de tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:42.400180 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bf568-340a-4040-8ccb-686bde8847de tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:42.400477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bf568-340a-4040-8ccb-686bde8847de tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:42.400775 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bf568-340a-4040-8ccb-686bde8847de tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/domains/6e266b0a31544a6ea018dfd7caf521ba` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:42.406745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3bf568-340a-4040-8ccb-686bde8847de tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6e266b0a31544a6ea018dfd7caf521ba)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:42.408588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3bf568-340a-4040-8ccb-686bde8847de tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:42.450677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9c3bf568-340a-4040-8ccb-686bde8847de tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6e266b0a31544a6ea018dfd7caf521ba'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:42.451087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9c3bf568-340a-4040-8ccb-686bde8847de tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6e266b0a31544a6ea018dfd7caf521ba'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:42.472007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5037e6-5bf3-4f2f-b1da-6c240d407e1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:42.473594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5037e6-5bf3-4f2f-b1da-6c240d407e1c service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:42.487353 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2586/5196] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:34:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:34:42.490455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9c3bf568-340a-4040-8ccb-686bde8847de tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6e266b0a31544a6ea018dfd7caf521ba'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:42.491483 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9c3bf568-340a-4040-8ccb-686bde8847de tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6e266b0a31544a6ea018dfd7caf521ba'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:42.496358 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2611/5197] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:34:42 2022] PATCH /identity/v3/domains/6e266b0a31544a6ea018dfd7caf521ba => generated 277 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:34:42.500385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5037e6-5bf3-4f2f-b1da-6c240d407e1c service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:42.517164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5037e6-5bf3-4f2f-b1da-6c240d407e1c service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:42.626631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f95a6b-9f9c-4cd9-84ab-4a448d3d2120 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:42.626631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f95a6b-9f9c-4cd9-84ab-4a448d3d2120 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:42.627004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f95a6b-9f9c-4cd9-84ab-4a448d3d2120 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:42.627239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f95a6b-9f9c-4cd9-84ab-4a448d3d2120 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/domains/6e266b0a31544a6ea018dfd7caf521ba` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:42.643781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f95a6b-9f9c-4cd9-84ab-4a448d3d2120 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6e266b0a31544a6ea018dfd7caf521ba)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:42.650166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f95a6b-9f9c-4cd9-84ab-4a448d3d2120 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:42.672099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859b2ba-971e-4a52-a340-b09be6ba3e2c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:42.672456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859b2ba-971e-4a52-a340-b09be6ba3e2c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:42.672678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859b2ba-971e-4a52-a340-b09be6ba3e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:42.713423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-42f95a6b-9f9c-4cd9-84ab-4a448d3d2120 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6e266b0a31544a6ea018dfd7caf521ba'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:42.746528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-42f95a6b-9f9c-4cd9-84ab-4a448d3d2120 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6e266b0a31544a6ea018dfd7caf521ba'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:42.777127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0859b2ba-971e-4a52-a340-b09be6ba3e2c None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:42.782003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0859b2ba-971e-4a52-a340-b09be6ba3e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:42.912378 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-42f95a6b-9f9c-4cd9-84ab-4a448d3d2120 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e266b0a31544a6ea018dfd7caf521ba', 'request_id': 'req-42f95a6b-9f9c-4cd9-84ab-4a448d3d2120'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:42.937698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-42f95a6b-9f9c-4cd9-84ab-4a448d3d2120 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e266b0a31544a6ea018dfd7caf521ba', 'request_id': 'req-42f95a6b-9f9c-4cd9-84ab-4a448d3d2120'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:42.940451 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:42.957444 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-42f95a6b-9f9c-4cd9-84ab-4a448d3d2120 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e266b0a31544a6ea018dfd7caf521ba', 'request_id': 'req-42f95a6b-9f9c-4cd9-84ab-4a448d3d2120'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:42.969910 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2612/5198] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:34:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:34:43.003732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-42f95a6b-9f9c-4cd9-84ab-4a448d3d2120 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] The token cache is being invalidate because project 6e266b0a31544a6ea018dfd7caf521ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:43.004197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-42f95a6b-9f9c-4cd9-84ab-4a448d3d2120 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:43.008967 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-42f95a6b-9f9c-4cd9-84ab-4a448d3d2120 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:43.015243 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:43.037307 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859b2ba-971e-4a52-a340-b09be6ba3e2c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:43.038865 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0859b2ba-971e-4a52-a340-b09be6ba3e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:43.044623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-42f95a6b-9f9c-4cd9-84ab-4a448d3d2120 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6e266b0a31544a6ea018dfd7caf521ba', 'request_id': 'req-42f95a6b-9f9c-4cd9-84ab-4a448d3d2120'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:43.047047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-42f95a6b-9f9c-4cd9-84ab-4a448d3d2120 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6e266b0a31544a6ea018dfd7caf521ba', 'request_id': 'req-42f95a6b-9f9c-4cd9-84ab-4a448d3d2120'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:43.056623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-42f95a6b-9f9c-4cd9-84ab-4a448d3d2120 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6e266b0a31544a6ea018dfd7caf521ba', 'request_id': 'req-42f95a6b-9f9c-4cd9-84ab-4a448d3d2120'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:43.069323 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2587/5199] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:34:42 2022] DELETE /identity/v3/domains/6e266b0a31544a6ea018dfd7caf521ba => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:43.077466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f95a6b-9f9c-4cd9-84ab-4a448d3d2120 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:43.080484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-42f95a6b-9f9c-4cd9-84ab-4a448d3d2120 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:43.213656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859b2ba-971e-4a52-a340-b09be6ba3e2c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:43.222923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f95a6b-9f9c-4cd9-84ab-4a448d3d2120 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:43.230317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da572f-75c3-4e04-8ef4-98baa4ba9aeb tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:43.231322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da572f-75c3-4e04-8ef4-98baa4ba9aeb tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:43.232626 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da572f-75c3-4e04-8ef4-98baa4ba9aeb tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:43.233037 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da572f-75c3-4e04-8ef4-98baa4ba9aeb tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:43.234445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da572f-75c3-4e04-8ef4-98baa4ba9aeb tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:43.237694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da572f-75c3-4e04-8ef4-98baa4ba9aeb tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:43.274348 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2588/5200] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Aug 7 01:34:43 2022] POST /identity/v3/domains => generated 276 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:43.276833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da572f-75c3-4e04-8ef4-98baa4ba9aeb tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:43.279070 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-68da572f-75c3-4e04-8ef4-98baa4ba9aeb tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:43.344128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917ca63-0175-46af-b8c1-5972b55ab294 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:43.346928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917ca63-0175-46af-b8c1-5972b55ab294 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:43.347251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917ca63-0175-46af-b8c1-5972b55ab294 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:43.347524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917ca63-0175-46af-b8c1-5972b55ab294 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:43.356318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a917ca63-0175-46af-b8c1-5972b55ab294 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:43.504677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917ca63-0175-46af-b8c1-5972b55ab294 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:43.506315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917ca63-0175-46af-b8c1-5972b55ab294 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:43.515931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da572f-75c3-4e04-8ef4-98baa4ba9aeb tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:43.530603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962fb4c-f261-4360-841a-4f9ffe813803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:43.531257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962fb4c-f261-4360-841a-4f9ffe813803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:43.531529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962fb4c-f261-4360-841a-4f9ffe813803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:43.531855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962fb4c-f261-4360-841a-4f9ffe813803 admin admin] PATH_INFO: `/v3/projects/954a7cd67b8547268c760f5d69eb5c6f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:43.533515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c962fb4c-f261-4360-841a-4f9ffe813803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=954a7cd67b8547268c760f5d69eb5c6f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:43.535498 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c962fb4c-f261-4360-841a-4f9ffe813803 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:43.540291 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2613/5201] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:34:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:34:43.541750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917ca63-0175-46af-b8c1-5972b55ab294 service swift] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:43.592547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917ca63-0175-46af-b8c1-5972b55ab294 service swift] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:43.717227 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c962fb4c-f261-4360-841a-4f9ffe813803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '954a7cd67b8547268c760f5d69eb5c6f', 'request_id': 'req-c962fb4c-f261-4360-841a-4f9ffe813803'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:43.745208 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c962fb4c-f261-4360-841a-4f9ffe813803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '954a7cd67b8547268c760f5d69eb5c6f', 'request_id': 'req-c962fb4c-f261-4360-841a-4f9ffe813803'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:43.772254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c962fb4c-f261-4360-841a-4f9ffe813803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '954a7cd67b8547268c760f5d69eb5c6f', 'request_id': 'req-c962fb4c-f261-4360-841a-4f9ffe813803'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:43.799383 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:43.814882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c962fb4c-f261-4360-841a-4f9ffe813803 admin admin] The token cache is being invalidate because project 954a7cd67b8547268c760f5d69eb5c6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:43.823937 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c962fb4c-f261-4360-841a-4f9ffe813803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:43.823937 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c962fb4c-f261-4360-841a-4f9ffe813803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:43.827021 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2589/5202] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:43 2022] DELETE /identity/v3/projects/954a7cd67b8547268c760f5d69eb5c6f => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:43.848964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962fb4c-f261-4360-841a-4f9ffe813803 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:43.854366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c962fb4c-f261-4360-841a-4f9ffe813803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:43.889739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b6b51-308d-40f4-8aa7-cf53878deae2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:43.893323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b6b51-308d-40f4-8aa7-cf53878deae2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:43.893702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b6b51-308d-40f4-8aa7-cf53878deae2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:43.893964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b6b51-308d-40f4-8aa7-cf53878deae2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:43.894630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b6b51-308d-40f4-8aa7-cf53878deae2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:43.899638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b6b51-308d-40f4-8aa7-cf53878deae2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:43.903770 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:44.084881 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2614/5203] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:34:43 2022] POST /identity/v3/projects => generated 410 bytes in 541 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:44.086466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b6b51-308d-40f4-8aa7-cf53878deae2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:44.093741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-465b6b51-308d-40f4-8aa7-cf53878deae2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:44.148205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962fb4c-f261-4360-841a-4f9ffe813803 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:44.249819 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b6b51-308d-40f4-8aa7-cf53878deae2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:44.255590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab906c1a-d513-40ef-a808-e73b21406708 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:44.256556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab906c1a-d513-40ef-a808-e73b21406708 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:44.257065 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab906c1a-d513-40ef-a808-e73b21406708 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:44.257539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab906c1a-d513-40ef-a808-e73b21406708 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:44.258443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab906c1a-d513-40ef-a808-e73b21406708 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:44.261948 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab906c1a-d513-40ef-a808-e73b21406708 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:44.279080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18cb885-352f-4d3c-9a86-6dc62b73bd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:44.279931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cb885-352f-4d3c-9a86-6dc62b73bd14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:44.280211 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cb885-352f-4d3c-9a86-6dc62b73bd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:44.280486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cb885-352f-4d3c-9a86-6dc62b73bd14 admin admin] PATH_INFO: `/v3/users/5a2748cd33ef49199c6d7c0c4f93565a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:44.283243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18cb885-352f-4d3c-9a86-6dc62b73bd14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a2748cd33ef49199c6d7c0c4f93565a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:44.285392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18cb885-352f-4d3c-9a86-6dc62b73bd14 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:44.314698 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2615/5204] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:34:44 2022] POST /identity/v3/projects => generated 403 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:44.318387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab906c1a-d513-40ef-a808-e73b21406708 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:44.411838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e18cb885-352f-4d3c-9a86-6dc62b73bd14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a2748cd33ef49199c6d7c0c4f93565a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:44.428588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e18cb885-352f-4d3c-9a86-6dc62b73bd14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a2748cd33ef49199c6d7c0c4f93565a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:44.472096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e18cb885-352f-4d3c-9a86-6dc62b73bd14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a2748cd33ef49199c6d7c0c4f93565a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:44.473182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e18cb885-352f-4d3c-9a86-6dc62b73bd14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a2748cd33ef49199c6d7c0c4f93565a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:44.486935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e18cb885-352f-4d3c-9a86-6dc62b73bd14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a2748cd33ef49199c6d7c0c4f93565a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:44.496882 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2590/5205] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:34:43 2022] DELETE /identity/v3/users/5a2748cd33ef49199c6d7c0c4f93565a => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:44.514680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab906c1a-d513-40ef-a808-e73b21406708 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:44.583971 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:44.609201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7feb6-d523-4f4e-ae63-1160def12368 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:44.609201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7feb6-d523-4f4e-ae63-1160def12368 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:44.609201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7feb6-d523-4f4e-ae63-1160def12368 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:44.609730 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7feb6-d523-4f4e-ae63-1160def12368 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects/0d7c34f3a1894819ad15e92ff02c26c5` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:44.611517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7feb6-d523-4f4e-ae63-1160def12368 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0d7c34f3a1894819ad15e92ff02c26c5)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:44.613763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7feb6-d523-4f4e-ae63-1160def12368 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:44.704865 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-90d7feb6-d523-4f4e-ae63-1160def12368 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d7c34f3a1894819ad15e92ff02c26c5', 'request_id': 'req-90d7feb6-d523-4f4e-ae63-1160def12368'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:44.731819 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-90d7feb6-d523-4f4e-ae63-1160def12368 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d7c34f3a1894819ad15e92ff02c26c5', 'request_id': 'req-90d7feb6-d523-4f4e-ae63-1160def12368'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:44.754634 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-90d7feb6-d523-4f4e-ae63-1160def12368 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d7c34f3a1894819ad15e92ff02c26c5', 'request_id': 'req-90d7feb6-d523-4f4e-ae63-1160def12368'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:44.800916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-90d7feb6-d523-4f4e-ae63-1160def12368 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] The token cache is being invalidate because project 0d7c34f3a1894819ad15e92ff02c26c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:44.801742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-90d7feb6-d523-4f4e-ae63-1160def12368 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:44.802868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-90d7feb6-d523-4f4e-ae63-1160def12368 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:44.805239 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2616/5206] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:44 2022] DELETE /identity/v3/projects/0d7c34f3a1894819ad15e92ff02c26c5 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:44.810257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18cb885-352f-4d3c-9a86-6dc62b73bd14 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:44.812542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e18cb885-352f-4d3c-9a86-6dc62b73bd14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:44.839536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18cb885-352f-4d3c-9a86-6dc62b73bd14 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:44.908217 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:44.951365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2b06b-a0b5-411b-889d-82e5c8cfe8c2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:44.952067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2b06b-a0b5-411b-889d-82e5c8cfe8c2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:44.952348 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2b06b-a0b5-411b-889d-82e5c8cfe8c2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:44.952981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2b06b-a0b5-411b-889d-82e5c8cfe8c2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects/17dfbee634eb4aa2a034f8c8fa54e89c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:44.954907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2b06b-a0b5-411b-889d-82e5c8cfe8c2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:delete_project(project_id=17dfbee634eb4aa2a034f8c8fa54e89c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:44.958716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2b06b-a0b5-411b-889d-82e5c8cfe8c2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:45.091033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-11c2b06b-a0b5-411b-889d-82e5c8cfe8c2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17dfbee634eb4aa2a034f8c8fa54e89c', 'request_id': 'req-11c2b06b-a0b5-411b-889d-82e5c8cfe8c2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:45.098097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-11c2b06b-a0b5-411b-889d-82e5c8cfe8c2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17dfbee634eb4aa2a034f8c8fa54e89c', 'request_id': 'req-11c2b06b-a0b5-411b-889d-82e5c8cfe8c2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:45.105222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-11c2b06b-a0b5-411b-889d-82e5c8cfe8c2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17dfbee634eb4aa2a034f8c8fa54e89c', 'request_id': 'req-11c2b06b-a0b5-411b-889d-82e5c8cfe8c2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:45.164669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-11c2b06b-a0b5-411b-889d-82e5c8cfe8c2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] The token cache is being invalidate because project 17dfbee634eb4aa2a034f8c8fa54e89c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:45.165316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-11c2b06b-a0b5-411b-889d-82e5c8cfe8c2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:45.168696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-11c2b06b-a0b5-411b-889d-82e5c8cfe8c2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:45.171710 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2591/5207] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:44 2022] DELETE /identity/v3/projects/17dfbee634eb4aa2a034f8c8fa54e89c => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:34:45.176237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7feb6-d523-4f4e-ae63-1160def12368 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:45.177691 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-90d7feb6-d523-4f4e-ae63-1160def12368 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:45.203526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7feb6-d523-4f4e-ae63-1160def12368 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:45.320303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8abc37-a48c-40e4-b961-d02d39f7dc2c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:45.321137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8abc37-a48c-40e4-b961-d02d39f7dc2c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:45.321394 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8abc37-a48c-40e4-b961-d02d39f7dc2c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:45.322433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8abc37-a48c-40e4-b961-d02d39f7dc2c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/domains/edc0e8a439c045659358925c0e23050f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:45.323770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8abc37-a48c-40e4-b961-d02d39f7dc2c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=edc0e8a439c045659358925c0e23050f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:45.327013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8abc37-a48c-40e4-b961-d02d39f7dc2c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:45.374871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2a8abc37-a48c-40e4-b961-d02d39f7dc2c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'edc0e8a439c045659358925c0e23050f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:45.376177 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2a8abc37-a48c-40e4-b961-d02d39f7dc2c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'edc0e8a439c045659358925c0e23050f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:45.441593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2a8abc37-a48c-40e4-b961-d02d39f7dc2c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'edc0e8a439c045659358925c0e23050f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:45.443494 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2a8abc37-a48c-40e4-b961-d02d39f7dc2c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'edc0e8a439c045659358925c0e23050f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:45.447966 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2617/5208] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:34:45 2022] PATCH /identity/v3/domains/edc0e8a439c045659358925c0e23050f => generated 277 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:34:45.455262 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2b06b-a0b5-411b-889d-82e5c8cfe8c2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:45.457572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-11c2b06b-a0b5-411b-889d-82e5c8cfe8c2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:45.492934 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8abc37-a48c-40e4-b961-d02d39f7dc2c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:45.499792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2a8abc37-a48c-40e4-b961-d02d39f7dc2c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:45.517880 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2b06b-a0b5-411b-889d-82e5c8cfe8c2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:45.722019 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:45.756953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef727b-f051-444a-976e-eb941c40c242 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:45.757621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef727b-f051-444a-976e-eb941c40c242 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:45.758008 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef727b-f051-444a-976e-eb941c40c242 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:45.758933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef727b-f051-444a-976e-eb941c40c242 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/domains/edc0e8a439c045659358925c0e23050f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:45.787036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8abc37-a48c-40e4-b961-d02d39f7dc2c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:45.789722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef727b-f051-444a-976e-eb941c40c242 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=edc0e8a439c045659358925c0e23050f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:45.792032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef727b-f051-444a-976e-eb941c40c242 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:45.796432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b961c7b-0627-418a-a377-c08884957d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:45.797178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b961c7b-0627-418a-a377-c08884957d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:45.798137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b961c7b-0627-418a-a377-c08884957d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:45.798137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b961c7b-0627-418a-a377-c08884957d02 admin admin] PATH_INFO: `/v3/projects/bd2b628e3bdf4a74b24d710a9b107eb0` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:45.805140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b961c7b-0627-418a-a377-c08884957d02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd2b628e3bdf4a74b24d710a9b107eb0)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:45.807926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b961c7b-0627-418a-a377-c08884957d02 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:45.881479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bcef727b-f051-444a-976e-eb941c40c242 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'edc0e8a439c045659358925c0e23050f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:45.917887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bcef727b-f051-444a-976e-eb941c40c242 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'edc0e8a439c045659358925c0e23050f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:45.948656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7b961c7b-0627-418a-a377-c08884957d02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd2b628e3bdf4a74b24d710a9b107eb0', 'request_id': 'req-7b961c7b-0627-418a-a377-c08884957d02'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:45.966288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7b961c7b-0627-418a-a377-c08884957d02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd2b628e3bdf4a74b24d710a9b107eb0', 'request_id': 'req-7b961c7b-0627-418a-a377-c08884957d02'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:45.992169 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:46.003211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7b961c7b-0627-418a-a377-c08884957d02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd2b628e3bdf4a74b24d710a9b107eb0', 'request_id': 'req-7b961c7b-0627-418a-a377-c08884957d02'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:46.027703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bcef727b-f051-444a-976e-eb941c40c242 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edc0e8a439c045659358925c0e23050f', 'request_id': 'req-bcef727b-f051-444a-976e-eb941c40c242'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:46.046927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7b961c7b-0627-418a-a377-c08884957d02 admin admin] The token cache is being invalidate because project bd2b628e3bdf4a74b24d710a9b107eb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:46.047518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7b961c7b-0627-418a-a377-c08884957d02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:46.048530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7b961c7b-0627-418a-a377-c08884957d02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:46.051338 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bcef727b-f051-444a-976e-eb941c40c242 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edc0e8a439c045659358925c0e23050f', 'request_id': 'req-bcef727b-f051-444a-976e-eb941c40c242'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:46.073582 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2618/5209] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:45 2022] DELETE /identity/v3/projects/bd2b628e3bdf4a74b24d710a9b107eb0 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:46.074870 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bcef727b-f051-444a-976e-eb941c40c242 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edc0e8a439c045659358925c0e23050f', 'request_id': 'req-bcef727b-f051-444a-976e-eb941c40c242'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:46.079616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966b215-01bb-419c-b8af-570ce50c5e9f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:46.080100 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966b215-01bb-419c-b8af-570ce50c5e9f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:46.080651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966b215-01bb-419c-b8af-570ce50c5e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:46.097026 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bcef727b-f051-444a-976e-eb941c40c242 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] The token cache is being invalidate because project edc0e8a439c045659358925c0e23050f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:46.097381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bcef727b-f051-444a-976e-eb941c40c242 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:46.109695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bcef727b-f051-444a-976e-eb941c40c242 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:46.146314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bcef727b-f051-444a-976e-eb941c40c242 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'edc0e8a439c045659358925c0e23050f', 'request_id': 'req-bcef727b-f051-444a-976e-eb941c40c242'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:46.147274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bcef727b-f051-444a-976e-eb941c40c242 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'edc0e8a439c045659358925c0e23050f', 'request_id': 'req-bcef727b-f051-444a-976e-eb941c40c242'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:46.165950 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1966b215-01bb-419c-b8af-570ce50c5e9f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:46.167239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1966b215-01bb-419c-b8af-570ce50c5e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:46.170917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bcef727b-f051-444a-976e-eb941c40c242 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'edc0e8a439c045659358925c0e23050f', 'request_id': 'req-bcef727b-f051-444a-976e-eb941c40c242'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:46.198351 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2592/5210] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:34:45 2022] DELETE /identity/v3/domains/edc0e8a439c045659358925c0e23050f => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:46.200257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef727b-f051-444a-976e-eb941c40c242 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:46.212244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bcef727b-f051-444a-976e-eb941c40c242 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:46.373156 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2619/5211] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:34:46.383849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a244d5-6405-40ed-8272-ec80905a0868 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:46.384193 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a244d5-6405-40ed-8272-ec80905a0868 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:46.384594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a244d5-6405-40ed-8272-ec80905a0868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:46.393973 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef727b-f051-444a-976e-eb941c40c242 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:46.406312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0a7df-e3a8-4a5c-8ad2-534ed51d9210 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:46.406991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0a7df-e3a8-4a5c-8ad2-534ed51d9210 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:46.407376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0a7df-e3a8-4a5c-8ad2-534ed51d9210 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:46.410059 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0a7df-e3a8-4a5c-8ad2-534ed51d9210 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:46.413344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0a7df-e3a8-4a5c-8ad2-534ed51d9210 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:46.420123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0a7df-e3a8-4a5c-8ad2-534ed51d9210 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:46.445386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-40a244d5-6405-40ed-8272-ec80905a0868 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:46.451083 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-40a244d5-6405-40ed-8272-ec80905a0868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:46.477151 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2620/5212] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:46.478651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a244d5-6405-40ed-8272-ec80905a0868 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:46.504232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a244d5-6405-40ed-8272-ec80905a0868 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:46.560548 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2593/5213] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:34:46 2022] POST /identity/v3/projects => generated 377 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:34:46.563768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0a7df-e3a8-4a5c-8ad2-534ed51d9210 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:46.742591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1c27a-b3ec-45d1-9689-ef6d0b60e5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:46.743413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1c27a-b3ec-45d1-9689-ef6d0b60e5dc admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:46.743723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1c27a-b3ec-45d1-9689-ef6d0b60e5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:46.745144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1c27a-b3ec-45d1-9689-ef6d0b60e5dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:46.745837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c1c27a-b3ec-45d1-9689-ef6d0b60e5dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:34:46.746142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c1c27a-b3ec-45d1-9689-ef6d0b60e5dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:46.750173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c1c27a-b3ec-45d1-9689-ef6d0b60e5dc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:46.773748 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:46.774280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0a7df-e3a8-4a5c-8ad2-534ed51d9210 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:46.782004 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2621/5214] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:34:46.787905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1c27a-b3ec-45d1-9689-ef6d0b60e5dc admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:46.789499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a54862-cd17-4ce8-abca-3b04499a2970 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:46.790940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a54862-cd17-4ce8-abca-3b04499a2970 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:46.791243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a54862-cd17-4ce8-abca-3b04499a2970 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:46.791518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a54862-cd17-4ce8-abca-3b04499a2970 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects/313d29e5aad44ac384f2dbb45e5e4d52` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:46.795936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a54862-cd17-4ce8-abca-3b04499a2970 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:get_project(project_id=313d29e5aad44ac384f2dbb45e5e4d52)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:46.799450 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a54862-cd17-4ce8-abca-3b04499a2970 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:46.807040 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2594/5215] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:34:46 2022] GET /identity/v3/projects/313d29e5aad44ac384f2dbb45e5e4d52 => generated 377 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:34:46.813283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c1c27a-b3ec-45d1-9689-ef6d0b60e5dc admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:46.814385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a54862-cd17-4ce8-abca-3b04499a2970 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:46.824615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b1bd7-29b3-40df-a9b7-5ed1b83d18a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:46.826217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b1bd7-29b3-40df-a9b7-5ed1b83d18a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:46.827018 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b1bd7-29b3-40df-a9b7-5ed1b83d18a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:46.827660 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b1bd7-29b3-40df-a9b7-5ed1b83d18a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:46.828608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b1bd7-29b3-40df-a9b7-5ed1b83d18a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:46.832109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b1bd7-29b3-40df-a9b7-5ed1b83d18a5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:46.837358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a54862-cd17-4ce8-abca-3b04499a2970 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:46.843667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac18bb-f38a-41b4-bb76-3e4b5acf8a45 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:46.844373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac18bb-f38a-41b4-bb76-3e4b5acf8a45 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:46.844651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac18bb-f38a-41b4-bb76-3e4b5acf8a45 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:46.844921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac18bb-f38a-41b4-bb76-3e4b5acf8a45 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:46.845825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac18bb-f38a-41b4-bb76-3e4b5acf8a45 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:46.847752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac18bb-f38a-41b4-bb76-3e4b5acf8a45 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:46.890522 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2622/5216] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:34:46 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:46.893505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b1bd7-29b3-40df-a9b7-5ed1b83d18a5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:46.899942 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2595/5217] 10.222.0.39 () {58 vars in 1131 bytes} [Sun Aug 7 01:34:46 2022] GET /identity/v3/projects => generated 6233 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:46.904423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac18bb-f38a-41b4-bb76-3e4b5acf8a45 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:46.916559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac18bb-f38a-41b4-bb76-3e4b5acf8a45 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:46.930029 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:47.004090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b1bd7-29b3-40df-a9b7-5ed1b83d18a5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:47.009863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9265d6-214a-422e-aae3-94f45aca6e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:47.010865 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9265d6-214a-422e-aae3-94f45aca6e51 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:47.011829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9265d6-214a-422e-aae3-94f45aca6e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:47.012361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9265d6-214a-422e-aae3-94f45aca6e51 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:47.013358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9265d6-214a-422e-aae3-94f45aca6e51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:47.015954 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9265d6-214a-422e-aae3-94f45aca6e51 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:47.054742 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2623/5218] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:34:46 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:47.058846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9265d6-214a-422e-aae3-94f45aca6e51 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:47.096412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9265d6-214a-422e-aae3-94f45aca6e51 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:47.106327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d1b05-0daf-44b4-bb9d-463fd6135468 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:47.107241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d1b05-0daf-44b4-bb9d-463fd6135468 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:47.107683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d1b05-0daf-44b4-bb9d-463fd6135468 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:47.108028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d1b05-0daf-44b4-bb9d-463fd6135468 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects/313d29e5aad44ac384f2dbb45e5e4d52` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:47.119526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d1b05-0daf-44b4-bb9d-463fd6135468 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:delete_project(project_id=313d29e5aad44ac384f2dbb45e5e4d52)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:47.126472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d1b05-0daf-44b4-bb9d-463fd6135468 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:47.131282 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a7ae6-9efe-407b-9c59-5012299cc340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:47.139041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a7ae6-9efe-407b-9c59-5012299cc340 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:47.141321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a7ae6-9efe-407b-9c59-5012299cc340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:47.142090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a7ae6-9efe-407b-9c59-5012299cc340 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:47.143002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a7ae6-9efe-407b-9c59-5012299cc340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:47.149124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a7ae6-9efe-407b-9c59-5012299cc340 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:47.183231 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2624/5219] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:47.187011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a7ae6-9efe-407b-9c59-5012299cc340 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:47.214724 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a7ae6-9efe-407b-9c59-5012299cc340 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:47.235242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c8a45-b998-40f7-9f01-72b3f7de0c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:47.236129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c8a45-b998-40f7-9f01-72b3f7de0c85 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:47.238802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c8a45-b998-40f7-9f01-72b3f7de0c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:47.239366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c8a45-b998-40f7-9f01-72b3f7de0c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:47.242431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c8a45-b998-40f7-9f01-72b3f7de0c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:47.248129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c8a45-b998-40f7-9f01-72b3f7de0c85 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:47.294269 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2625/5220] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:34:47.301863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c8a45-b998-40f7-9f01-72b3f7de0c85 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:47.332505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-800d1b05-0daf-44b4-bb9d-463fd6135468 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '313d29e5aad44ac384f2dbb45e5e4d52', 'request_id': 'req-800d1b05-0daf-44b4-bb9d-463fd6135468'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:47.343756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c8a45-b998-40f7-9f01-72b3f7de0c85 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:47.364997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-800d1b05-0daf-44b4-bb9d-463fd6135468 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '313d29e5aad44ac384f2dbb45e5e4d52', 'request_id': 'req-800d1b05-0daf-44b4-bb9d-463fd6135468'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:47.384197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-800d1b05-0daf-44b4-bb9d-463fd6135468 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '313d29e5aad44ac384f2dbb45e5e4d52', 'request_id': 'req-800d1b05-0daf-44b4-bb9d-463fd6135468'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:47.430649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-800d1b05-0daf-44b4-bb9d-463fd6135468 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] The token cache is being invalidate because project 313d29e5aad44ac384f2dbb45e5e4d52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:47.431314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-800d1b05-0daf-44b4-bb9d-463fd6135468 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:47.434321 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-800d1b05-0daf-44b4-bb9d-463fd6135468 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:47.446097 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2596/5221] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:46 2022] DELETE /identity/v3/projects/313d29e5aad44ac384f2dbb45e5e4d52 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:47.449009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d1b05-0daf-44b4-bb9d-463fd6135468 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:47.452739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-800d1b05-0daf-44b4-bb9d-463fd6135468 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:47.517417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ae9d7-9acd-4e2e-bc3e-e8191b4e591f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:47.518593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ae9d7-9acd-4e2e-bc3e-e8191b4e591f admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:47.519094 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ae9d7-9acd-4e2e-bc3e-e8191b4e591f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:47.519582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ae9d7-9acd-4e2e-bc3e-e8191b4e591f admin admin] PATH_INFO: `/v3/projects/dacf93fa0779444883eb42b6e7cf80de/users/af7fe770adc741bb80e090080974b81b/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:47.584230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ae9d7-9acd-4e2e-bc3e-e8191b4e591f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dacf93fa0779444883eb42b6e7cf80de, user_id=af7fe770adc741bb80e090080974b81b, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:47.590434 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ae9d7-9acd-4e2e-bc3e-e8191b4e591f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:47.635940 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2626/5222] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:34:47 2022] PUT /identity/v3/projects/dacf93fa0779444883eb42b6e7cf80de/users/af7fe770adc741bb80e090080974b81b/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:47.648999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b151b4-4aa3-46c5-a351-a319ad156b0c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:47.649363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b151b4-4aa3-46c5-a351-a319ad156b0c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:47.649546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b151b4-4aa3-46c5-a351-a319ad156b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:47.732895 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d1b05-0daf-44b4-bb9d-463fd6135468 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:47.753775 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f7b151b4-4aa3-46c5-a351-a319ad156b0c None None] MFA Rules not processed for user `af7fe770adc741bb80e090080974b81b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:47.760666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f7b151b4-4aa3-46c5-a351-a319ad156b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:47.800551 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:47.912569 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:47.945664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abcdac-5f38-446b-a416-f7401999676c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:47.946441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abcdac-5f38-446b-a416-f7401999676c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:47.947344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abcdac-5f38-446b-a416-f7401999676c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:47.947773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abcdac-5f38-446b-a416-f7401999676c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:47.948567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04abcdac-5f38-446b-a416-f7401999676c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:47.950561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04abcdac-5f38-446b-a416-f7401999676c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:48.015709 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2597/5223] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Aug 7 01:34:47 2022] POST /identity/v3/projects => generated 347 bytes in 569 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:48.019844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abcdac-5f38-446b-a416-f7401999676c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:48.023980 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2627/5224] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:48.032988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b151b4-4aa3-46c5-a351-a319ad156b0c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:48.034606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f7b151b4-4aa3-46c5-a351-a319ad156b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:48.182773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b151b4-4aa3-46c5-a351-a319ad156b0c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:48.207693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abcdac-5f38-446b-a416-f7401999676c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:48.215422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47534065-e765-48fe-9bba-aad257977c4c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:48.217365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47534065-e765-48fe-9bba-aad257977c4c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:48.217694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47534065-e765-48fe-9bba-aad257977c4c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:48.217974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47534065-e765-48fe-9bba-aad257977c4c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects/efc9e07a240b4e5690f54a26eb75b682` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:48.220631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47534065-e765-48fe-9bba-aad257977c4c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:update_project(project_id=efc9e07a240b4e5690f54a26eb75b682)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:48.225255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47534065-e765-48fe-9bba-aad257977c4c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:48.294163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32317eeb-f874-4a32-b966-2c79c619f634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:48.295695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32317eeb-f874-4a32-b966-2c79c619f634 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:48.298532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32317eeb-f874-4a32-b966-2c79c619f634 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:48.299244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32317eeb-f874-4a32-b966-2c79c619f634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:48.342451 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2598/5225] 10.222.0.39 () {60 vars in 1252 bytes} [Sun Aug 7 01:34:48 2022] PATCH /identity/v3/projects/efc9e07a240b4e5690f54a26eb75b682 => generated 360 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:34:48.346739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47534065-e765-48fe-9bba-aad257977c4c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:48.374929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47534065-e765-48fe-9bba-aad257977c4c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:48.389047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6a25f-75f4-4331-a762-d74d0e9e4e2c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:48.390211 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6a25f-75f4-4331-a762-d74d0e9e4e2c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:48.390768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6a25f-75f4-4331-a762-d74d0e9e4e2c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:48.391354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6a25f-75f4-4331-a762-d74d0e9e4e2c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects/efc9e07a240b4e5690f54a26eb75b682` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:48.411849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6a25f-75f4-4331-a762-d74d0e9e4e2c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:get_project(project_id=efc9e07a240b4e5690f54a26eb75b682)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:48.414274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6a25f-75f4-4331-a762-d74d0e9e4e2c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:48.422342 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2599/5226] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:34:48 2022] GET /identity/v3/projects/efc9e07a240b4e5690f54a26eb75b682 => generated 347 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:34:48.426675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6a25f-75f4-4331-a762-d74d0e9e4e2c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:48.470054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6a25f-75f4-4331-a762-d74d0e9e4e2c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:48.491751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184af29-47cd-470c-bb03-56dcb0bec96e tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:48.494332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184af29-47cd-470c-bb03-56dcb0bec96e tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:48.496077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184af29-47cd-470c-bb03-56dcb0bec96e tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:48.500122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184af29-47cd-470c-bb03-56dcb0bec96e tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects/efc9e07a240b4e5690f54a26eb75b682` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:48.504842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184af29-47cd-470c-bb03-56dcb0bec96e tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:delete_project(project_id=efc9e07a240b4e5690f54a26eb75b682)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:48.523909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184af29-47cd-470c-bb03-56dcb0bec96e tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:48.573755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32317eeb-f874-4a32-b966-2c79c619f634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:48.579492 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32317eeb-f874-4a32-b966-2c79c619f634 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:48.599721 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2628/5227] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:34:48 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:34:48.736683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b184af29-47cd-470c-bb03-56dcb0bec96e tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efc9e07a240b4e5690f54a26eb75b682', 'request_id': 'req-b184af29-47cd-470c-bb03-56dcb0bec96e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:48.749911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b184af29-47cd-470c-bb03-56dcb0bec96e tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efc9e07a240b4e5690f54a26eb75b682', 'request_id': 'req-b184af29-47cd-470c-bb03-56dcb0bec96e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:48.767011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b184af29-47cd-470c-bb03-56dcb0bec96e tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efc9e07a240b4e5690f54a26eb75b682', 'request_id': 'req-b184af29-47cd-470c-bb03-56dcb0bec96e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:48.802980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b184af29-47cd-470c-bb03-56dcb0bec96e tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] The token cache is being invalidate because project efc9e07a240b4e5690f54a26eb75b682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:48.803523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b184af29-47cd-470c-bb03-56dcb0bec96e tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:48.809364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b184af29-47cd-470c-bb03-56dcb0bec96e tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:48.821085 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2600/5228] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:48 2022] DELETE /identity/v3/projects/efc9e07a240b4e5690f54a26eb75b682 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:48.829004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32317eeb-f874-4a32-b966-2c79c619f634 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:48.857267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32317eeb-f874-4a32-b966-2c79c619f634 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:48.957821 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:49.097682 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ee7c4-004e-43c7-b0c8-92c1c5fc8dd2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:49.098268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ee7c4-004e-43c7-b0c8-92c1c5fc8dd2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:49.101376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ee7c4-004e-43c7-b0c8-92c1c5fc8dd2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:49.101778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ee7c4-004e-43c7-b0c8-92c1c5fc8dd2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:49.102500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ee7c4-004e-43c7-b0c8-92c1c5fc8dd2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:49.106667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ee7c4-004e-43c7-b0c8-92c1c5fc8dd2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:49.200764 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2629/5229] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:34:48 2022] POST /identity/v3/projects => generated 361 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:34:49.202462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184af29-47cd-470c-bb03-56dcb0bec96e tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:49.204160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b184af29-47cd-470c-bb03-56dcb0bec96e tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:49.230522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184af29-47cd-470c-bb03-56dcb0bec96e tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:49.278336 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:UPDATE=1,keystone:DELETE=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:49.386252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb58eb-a211-4075-94d4-8b9303b784d1 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:49.387763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb58eb-a211-4075-94d4-8b9303b784d1 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:49.388313 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb58eb-a211-4075-94d4-8b9303b784d1 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:49.388776 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb58eb-a211-4075-94d4-8b9303b784d1 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects/e033bea01b5545548106ba206cecabff` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:49.390326 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb58eb-a211-4075-94d4-8b9303b784d1 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:update_project(project_id=e033bea01b5545548106ba206cecabff)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:49.392800 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb58eb-a211-4075-94d4-8b9303b784d1 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:49.500077 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2601/5230] 10.222.0.39 () {60 vars in 1252 bytes} [Sun Aug 7 01:34:49 2022] PATCH /identity/v3/projects/e033bea01b5545548106ba206cecabff => generated 373 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:34:49.505868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ee7c4-004e-43c7-b0c8-92c1c5fc8dd2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:49.557653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ee7c4-004e-43c7-b0c8-92c1c5fc8dd2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:49.590940 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614c4c0-2e9a-47e6-8c34-308e76bb7026 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:49.599907 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614c4c0-2e9a-47e6-8c34-308e76bb7026 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:49.603430 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614c4c0-2e9a-47e6-8c34-308e76bb7026 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:49.603755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614c4c0-2e9a-47e6-8c34-308e76bb7026 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects/e033bea01b5545548106ba206cecabff` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:49.691630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614c4c0-2e9a-47e6-8c34-308e76bb7026 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:get_project(project_id=e033bea01b5545548106ba206cecabff)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:49.704097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614c4c0-2e9a-47e6-8c34-308e76bb7026 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:49.717300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb58eb-a211-4075-94d4-8b9303b784d1 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:49.718136 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2630/5231] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:34:49 2022] GET /identity/v3/projects/e033bea01b5545548106ba206cecabff => generated 360 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:34:49.730709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb58eb-a211-4075-94d4-8b9303b784d1 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:49.742512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74db6a0-048e-4ae4-bb03-ec3d2f77f208 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:49.743408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74db6a0-048e-4ae4-bb03-ec3d2f77f208 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:49.743679 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74db6a0-048e-4ae4-bb03-ec3d2f77f208 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:49.744001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74db6a0-048e-4ae4-bb03-ec3d2f77f208 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects/e033bea01b5545548106ba206cecabff` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:49.747231 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74db6a0-048e-4ae4-bb03-ec3d2f77f208 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e033bea01b5545548106ba206cecabff)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:49.750359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74db6a0-048e-4ae4-bb03-ec3d2f77f208 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:49.826327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f74db6a0-048e-4ae4-bb03-ec3d2f77f208 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e033bea01b5545548106ba206cecabff', 'request_id': 'req-f74db6a0-048e-4ae4-bb03-ec3d2f77f208'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:49.835478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f74db6a0-048e-4ae4-bb03-ec3d2f77f208 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e033bea01b5545548106ba206cecabff', 'request_id': 'req-f74db6a0-048e-4ae4-bb03-ec3d2f77f208'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:49.846456 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f74db6a0-048e-4ae4-bb03-ec3d2f77f208 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e033bea01b5545548106ba206cecabff', 'request_id': 'req-f74db6a0-048e-4ae4-bb03-ec3d2f77f208'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:49.896712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f74db6a0-048e-4ae4-bb03-ec3d2f77f208 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] The token cache is being invalidate because project e033bea01b5545548106ba206cecabff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:49.898839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f74db6a0-048e-4ae4-bb03-ec3d2f77f208 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:49.902825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f74db6a0-048e-4ae4-bb03-ec3d2f77f208 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:49.919004 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2602/5232] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:49 2022] DELETE /identity/v3/projects/e033bea01b5545548106ba206cecabff => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:34:49.921912 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614c4c0-2e9a-47e6-8c34-308e76bb7026 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:49.925052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1614c4c0-2e9a-47e6-8c34-308e76bb7026 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:49.956141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614c4c0-2e9a-47e6-8c34-308e76bb7026 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:50.149342 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd8df7-5f66-48a9-9602-7cdeaed53000 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:50.150492 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd8df7-5f66-48a9-9602-7cdeaed53000 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:50.150779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd8df7-5f66-48a9-9602-7cdeaed53000 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:50.151032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd8df7-5f66-48a9-9602-7cdeaed53000 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:50.151653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd8df7-5f66-48a9-9602-7cdeaed53000 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:50.153602 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd8df7-5f66-48a9-9602-7cdeaed53000 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:50.223984 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2631/5233] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:34:49 2022] POST /identity/v3/projects => generated 355 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:34:50.225239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74db6a0-048e-4ae4-bb03-ec3d2f77f208 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:50.241085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74db6a0-048e-4ae4-bb03-ec3d2f77f208 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:50.402122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe29315-5d4e-4c69-8896-fd50078856cb tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:50.404861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe29315-5d4e-4c69-8896-fd50078856cb tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:50.405157 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe29315-5d4e-4c69-8896-fd50078856cb tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:50.405352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe29315-5d4e-4c69-8896-fd50078856cb tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects/0779f18fa33d48018ec3aef4a95f417b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:50.410761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe29315-5d4e-4c69-8896-fd50078856cb tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:update_project(project_id=0779f18fa33d48018ec3aef4a95f417b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:50.415779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe29315-5d4e-4c69-8896-fd50078856cb tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:50.465177 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:50.519970 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2603/5234] 10.222.0.39 () {60 vars in 1252 bytes} [Sun Aug 7 01:34:50 2022] PATCH /identity/v3/projects/0779f18fa33d48018ec3aef4a95f417b => generated 368 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:34:50.522294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd8df7-5f66-48a9-9602-7cdeaed53000 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:50.545679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd8df7-5f66-48a9-9602-7cdeaed53000 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:50.564722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be716682-ab73-41f7-95b4-37cda6e3596c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:50.565642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be716682-ab73-41f7-95b4-37cda6e3596c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:50.566007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be716682-ab73-41f7-95b4-37cda6e3596c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:50.566810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be716682-ab73-41f7-95b4-37cda6e3596c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects/0779f18fa33d48018ec3aef4a95f417b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:50.628695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be716682-ab73-41f7-95b4-37cda6e3596c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:get_project(project_id=0779f18fa33d48018ec3aef4a95f417b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:50.643124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be716682-ab73-41f7-95b4-37cda6e3596c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:50.664930 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2632/5235] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:34:50 2022] GET /identity/v3/projects/0779f18fa33d48018ec3aef4a95f417b => generated 355 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:34:50.666267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe29315-5d4e-4c69-8896-fd50078856cb tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:50.687040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe29315-5d4e-4c69-8896-fd50078856cb tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:50.712727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfcc011-3df9-4b2e-a246-2b9f9e4273b2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:50.713522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfcc011-3df9-4b2e-a246-2b9f9e4273b2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:50.713873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfcc011-3df9-4b2e-a246-2b9f9e4273b2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:50.714809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfcc011-3df9-4b2e-a246-2b9f9e4273b2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/projects/0779f18fa33d48018ec3aef4a95f417b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:50.720744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfcc011-3df9-4b2e-a246-2b9f9e4273b2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0779f18fa33d48018ec3aef4a95f417b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:50.723633 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfcc011-3df9-4b2e-a246-2b9f9e4273b2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:50.839074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9dfcc011-3df9-4b2e-a246-2b9f9e4273b2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0779f18fa33d48018ec3aef4a95f417b', 'request_id': 'req-9dfcc011-3df9-4b2e-a246-2b9f9e4273b2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:50.851954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9dfcc011-3df9-4b2e-a246-2b9f9e4273b2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0779f18fa33d48018ec3aef4a95f417b', 'request_id': 'req-9dfcc011-3df9-4b2e-a246-2b9f9e4273b2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:50.860333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9dfcc011-3df9-4b2e-a246-2b9f9e4273b2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0779f18fa33d48018ec3aef4a95f417b', 'request_id': 'req-9dfcc011-3df9-4b2e-a246-2b9f9e4273b2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:50.891674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9dfcc011-3df9-4b2e-a246-2b9f9e4273b2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] The token cache is being invalidate because project 0779f18fa33d48018ec3aef4a95f417b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:50.892282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9dfcc011-3df9-4b2e-a246-2b9f9e4273b2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:50.892978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9dfcc011-3df9-4b2e-a246-2b9f9e4273b2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:50.899552 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2604/5236] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:50 2022] DELETE /identity/v3/projects/0779f18fa33d48018ec3aef4a95f417b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:50.901464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be716682-ab73-41f7-95b4-37cda6e3596c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:50.904108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-be716682-ab73-41f7-95b4-37cda6e3596c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:50.923951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be716682-ab73-41f7-95b4-37cda6e3596c tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:51.222019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c552f-26a7-4ab9-9c80-ee2ae2094e06 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:51.224965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c552f-26a7-4ab9-9c80-ee2ae2094e06 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:51.224965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c552f-26a7-4ab9-9c80-ee2ae2094e06 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:51.225237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c552f-26a7-4ab9-9c80-ee2ae2094e06 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/domains/edc0e8a439c045659358925c0e23050f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:51.257239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98c552f-26a7-4ab9-9c80-ee2ae2094e06 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:34:51.262660 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-d98c552f-26a7-4ab9-9c80-ee2ae2094e06 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Could not find domain: edc0e8a439c045659358925c0e23050f.: keystone.exception.DomainNotFound: Could not find domain: edc0e8a439c045659358925c0e23050f. Aug 07 01:34:51.262660 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:34:51.262660 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 07 01:34:51.262660 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 07 01:34:51.262660 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 01:34:51.262660 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 01:34:51.262660 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 01:34:51.262660 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 01:34:51.262660 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: edc0e8a439c045659358925c0e23050f. Aug 07 01:34:51.262660 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:34:51.262660 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:34:51.262660 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:34:51.262660 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:34:51.262660 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:34:51.262660 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:34:51.262660 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:34:51.264037 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:34:51.264037 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:34:51.264037 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:34:51.264037 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:34:51.264037 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:34:51.264037 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:34:51.264037 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:34:51.264037 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 07 01:34:51.264037 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 07 01:34:51.264037 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:34:51.264037 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:34:51.264037 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:34:51.264037 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:34:51.264037 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:34:51.264037 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:34:51.264037 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:34:51.265201 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:34:51.265201 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:34:51.265201 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:34:51.265201 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:34:51.265201 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 01:34:51.265201 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:34:51.265201 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:34:51.265201 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:34:51.265201 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:34:51.265201 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:34:51.265201 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:34:51.265201 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:34:51.265201 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:34:51.265201 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 07 01:34:51.265201 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:34:51.265201 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: edc0e8a439c045659358925c0e23050f. Aug 07 01:34:51.265201 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:34:51.287654 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2633/5237] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:34:50 2022] PATCH /identity/v3/domains/edc0e8a439c045659358925c0e23050f => generated 112 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:34:51.289659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfcc011-3df9-4b2e-a246-2b9f9e4273b2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:51.301688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfcc011-3df9-4b2e-a246-2b9f9e4273b2 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:51.329376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da6059-eaf1-4778-9b64-b0453b6cdcb5 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbd921ebcfe743b39efdb04b2e1d49a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fef4a0db5ac421ba232dc44564745f0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:51.329857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da6059-eaf1-4778-9b64-b0453b6cdcb5 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:51.330144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da6059-eaf1-4778-9b64-b0453b6cdcb5 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:51.330422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da6059-eaf1-4778-9b64-b0453b6cdcb5 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] PATH_INFO: `/v3/domains/6e266b0a31544a6ea018dfd7caf521ba` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:51.347994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da6059-eaf1-4778-9b64-b0453b6cdcb5 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:34:51.389194 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-52da6059-eaf1-4778-9b64-b0453b6cdcb5 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Could not find domain: 6e266b0a31544a6ea018dfd7caf521ba.: keystone.exception.DomainNotFound: Could not find domain: 6e266b0a31544a6ea018dfd7caf521ba. Aug 07 01:34:51.389194 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:34:51.389194 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 07 01:34:51.389194 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 07 01:34:51.389194 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 01:34:51.389194 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 01:34:51.389194 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 01:34:51.389194 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 01:34:51.389194 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 6e266b0a31544a6ea018dfd7caf521ba. Aug 07 01:34:51.389194 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:34:51.389194 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:34:51.389194 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:34:51.389194 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:34:51.389194 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:34:51.389194 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:34:51.389194 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:34:51.390483 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:34:51.390483 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:34:51.390483 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:34:51.390483 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:34:51.390483 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:34:51.390483 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:34:51.390483 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:34:51.390483 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 07 01:34:51.390483 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 07 01:34:51.390483 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:34:51.390483 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:34:51.390483 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:34:51.390483 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:34:51.390483 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:34:51.390483 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:34:51.390483 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:34:51.391970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:34:51.391970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:34:51.391970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:34:51.391970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:34:51.391970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 01:34:51.391970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:34:51.391970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:34:51.391970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:34:51.391970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:34:51.391970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:34:51.391970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:34:51.391970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:34:51.391970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:34:51.391970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 07 01:34:51.391970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:34:51.391970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 6e266b0a31544a6ea018dfd7caf521ba. Aug 07 01:34:51.391970 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:34:51.393076 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2605/5238] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:34:51 2022] PATCH /identity/v3/domains/6e266b0a31544a6ea018dfd7caf521ba => generated 112 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 07 01:34:51.397004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c552f-26a7-4ab9-9c80-ee2ae2094e06 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:51.402469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d98c552f-26a7-4ab9-9c80-ee2ae2094e06 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:51.472097 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:51.575192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c552f-26a7-4ab9-9c80-ee2ae2094e06 tempest-ProjectsTestJSON-1117863003 tempest-ProjectsTestJSON-1117863003-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:51.580980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879c7ca-7a69-4f7d-a1d3-66a632a41bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:51.581630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879c7ca-7a69-4f7d-a1d3-66a632a41bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:51.581911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879c7ca-7a69-4f7d-a1d3-66a632a41bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:51.582187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879c7ca-7a69-4f7d-a1d3-66a632a41bd9 admin admin] PATH_INFO: `/v3/users/8374f06be683460595da832d19fd6a46` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:51.583548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879c7ca-7a69-4f7d-a1d3-66a632a41bd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8374f06be683460595da832d19fd6a46)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:51.585783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879c7ca-7a69-4f7d-a1d3-66a632a41bd9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:51.670948 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3879c7ca-7a69-4f7d-a1d3-66a632a41bd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8374f06be683460595da832d19fd6a46'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:51.680444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3879c7ca-7a69-4f7d-a1d3-66a632a41bd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8374f06be683460595da832d19fd6a46'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:51.704523 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3879c7ca-7a69-4f7d-a1d3-66a632a41bd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8374f06be683460595da832d19fd6a46'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:51.705741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3879c7ca-7a69-4f7d-a1d3-66a632a41bd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8374f06be683460595da832d19fd6a46'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:51.722713 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3879c7ca-7a69-4f7d-a1d3-66a632a41bd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8374f06be683460595da832d19fd6a46'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:51.751316 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2634/5239] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:34:51 2022] DELETE /identity/v3/users/8374f06be683460595da832d19fd6a46 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:51.772066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4eec5-cac4-4850-9801-73954ac3b28a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:51.772688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4eec5-cac4-4850-9801-73954ac3b28a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:51.772827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4eec5-cac4-4850-9801-73954ac3b28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:51.808701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-17f4eec5-cac4-4850-9801-73954ac3b28a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:51.813872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-17f4eec5-cac4-4850-9801-73954ac3b28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:51.967435 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2606/5240] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:52.004707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879c7ca-7a69-4f7d-a1d3-66a632a41bd9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:52.006223 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3879c7ca-7a69-4f7d-a1d3-66a632a41bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:52.211252 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879c7ca-7a69-4f7d-a1d3-66a632a41bd9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:52.219189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848b999-c3a2-46e2-a104-dd89d3b830b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:52.220368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848b999-c3a2-46e2-a104-dd89d3b830b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:52.221341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848b999-c3a2-46e2-a104-dd89d3b830b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:52.221846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848b999-c3a2-46e2-a104-dd89d3b830b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:52.244783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848b999-c3a2-46e2-a104-dd89d3b830b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:52.248950 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848b999-c3a2-46e2-a104-dd89d3b830b1 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:52.267738 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2635/5241] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:34:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:34:54.940308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4eec5-cac4-4850-9801-73954ac3b28a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:54.941856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-17f4eec5-cac4-4850-9801-73954ac3b28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:54.971330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4eec5-cac4-4850-9801-73954ac3b28a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:55.005618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a795e14-92b6-49a8-9301-3d5627feb30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:55.006407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a795e14-92b6-49a8-9301-3d5627feb30e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:55.006979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a795e14-92b6-49a8-9301-3d5627feb30e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:55.007342 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a795e14-92b6-49a8-9301-3d5627feb30e admin admin] PATH_INFO: `/v3/projects/8da40b6c050e4a20b547401b076b9832` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:55.010604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a795e14-92b6-49a8-9301-3d5627feb30e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8da40b6c050e4a20b547401b076b9832)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:55.012651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a795e14-92b6-49a8-9301-3d5627feb30e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:55.182832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1a795e14-92b6-49a8-9301-3d5627feb30e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8da40b6c050e4a20b547401b076b9832', 'request_id': 'req-1a795e14-92b6-49a8-9301-3d5627feb30e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:55.204556 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=85,keystone:UPDATE=1,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:55.211300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1a795e14-92b6-49a8-9301-3d5627feb30e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8da40b6c050e4a20b547401b076b9832', 'request_id': 'req-1a795e14-92b6-49a8-9301-3d5627feb30e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:55.225565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1a795e14-92b6-49a8-9301-3d5627feb30e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8da40b6c050e4a20b547401b076b9832', 'request_id': 'req-1a795e14-92b6-49a8-9301-3d5627feb30e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:55.255412 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1a795e14-92b6-49a8-9301-3d5627feb30e admin admin] The token cache is being invalidate because project 8da40b6c050e4a20b547401b076b9832 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:34:55.255604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1a795e14-92b6-49a8-9301-3d5627feb30e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:55.260655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1a795e14-92b6-49a8-9301-3d5627feb30e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:55.262721 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2607/5242] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:54 2022] DELETE /identity/v3/projects/8da40b6c050e4a20b547401b076b9832 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:55.267166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848b999-c3a2-46e2-a104-dd89d3b830b1 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:55.285827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848b999-c3a2-46e2-a104-dd89d3b830b1 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:55.371342 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:34:55.432660 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc579e-7fb4-4893-a759-666205e52c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:55.433607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc579e-7fb4-4893-a759-666205e52c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:55.434063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc579e-7fb4-4893-a759-666205e52c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:55.434502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc579e-7fb4-4893-a759-666205e52c27 admin admin] PATH_INFO: `/v3/users/bbd921ebcfe743b39efdb04b2e1d49a7` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:55.436547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc579e-7fb4-4893-a759-666205e52c27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbd921ebcfe743b39efdb04b2e1d49a7)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:55.444313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc579e-7fb4-4893-a759-666205e52c27 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:34:55.567337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-39dc579e-7fb4-4893-a759-666205e52c27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbd921ebcfe743b39efdb04b2e1d49a7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:55.599798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-39dc579e-7fb4-4893-a759-666205e52c27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbd921ebcfe743b39efdb04b2e1d49a7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:55.650986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-39dc579e-7fb4-4893-a759-666205e52c27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbd921ebcfe743b39efdb04b2e1d49a7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:55.654104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-39dc579e-7fb4-4893-a759-666205e52c27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbd921ebcfe743b39efdb04b2e1d49a7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:55.676039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-39dc579e-7fb4-4893-a759-666205e52c27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbd921ebcfe743b39efdb04b2e1d49a7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:34:55.690014 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2636/5243] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:34:55 2022] DELETE /identity/v3/users/bbd921ebcfe743b39efdb04b2e1d49a7 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:34:59.567411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617a2f4-2c00-49db-b790-46bc1ae30782 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:59.568079 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617a2f4-2c00-49db-b790-46bc1ae30782 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:59.568079 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617a2f4-2c00-49db-b790-46bc1ae30782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:59.637767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7617a2f4-2c00-49db-b790-46bc1ae30782 None None] MFA Rules not processed for user `0344a81c981b434689ac476b815b8f02`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:34:59.642331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7617a2f4-2c00-49db-b790-46bc1ae30782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:59.695422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc579e-7fb4-4893-a759-666205e52c27 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:34:59.697582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-39dc579e-7fb4-4893-a759-666205e52c27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:34:59.845834 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2608/5244] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:34:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:34:59.875386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc579e-7fb4-4893-a759-666205e52c27 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:34:59.880802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d65e4d-d621-4f67-ba09-719f218de5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:34:59.881951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d65e4d-d621-4f67-ba09-719f218de5ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:34:59.882333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d65e4d-d621-4f67-ba09-719f218de5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:34:59.882718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d65e4d-d621-4f67-ba09-719f218de5ca admin admin] PATH_INFO: `/v3/projects/3fef4a0db5ac421ba232dc44564745f0` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:34:59.884641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d65e4d-d621-4f67-ba09-719f218de5ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fef4a0db5ac421ba232dc44564745f0)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:34:59.886713 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d65e4d-d621-4f67-ba09-719f218de5ca admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:00.021930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e9d65e4d-d621-4f67-ba09-719f218de5ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fef4a0db5ac421ba232dc44564745f0', 'request_id': 'req-e9d65e4d-d621-4f67-ba09-719f218de5ca'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:00.028928 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:00.037911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e9d65e4d-d621-4f67-ba09-719f218de5ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fef4a0db5ac421ba232dc44564745f0', 'request_id': 'req-e9d65e4d-d621-4f67-ba09-719f218de5ca'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:00.047866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e9d65e4d-d621-4f67-ba09-719f218de5ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fef4a0db5ac421ba232dc44564745f0', 'request_id': 'req-e9d65e4d-d621-4f67-ba09-719f218de5ca'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:00.078845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e9d65e4d-d621-4f67-ba09-719f218de5ca admin admin] The token cache is being invalidate because project 3fef4a0db5ac421ba232dc44564745f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:35:00.079915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e9d65e4d-d621-4f67-ba09-719f218de5ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:00.080266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e9d65e4d-d621-4f67-ba09-719f218de5ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:00.086895 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2637/5245] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:34:59 2022] DELETE /identity/v3/projects/3fef4a0db5ac421ba232dc44564745f0 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:35:00.088616 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215928a-1b27-4ae3-b03f-55364ffcb93e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:00.088901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215928a-1b27-4ae3-b03f-55364ffcb93e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:00.089171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215928a-1b27-4ae3-b03f-55364ffcb93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:00.132499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-f215928a-1b27-4ae3-b03f-55364ffcb93e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:00.136627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f215928a-1b27-4ae3-b03f-55364ffcb93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:00.297842 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d65e4d-d621-4f67-ba09-719f218de5ca admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:00.299552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e9d65e4d-d621-4f67-ba09-719f218de5ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:00.314262 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2609/5246] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:00.322374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e228de-9f91-44fb-a5f2-fa734fbb888c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:00.322926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e228de-9f91-44fb-a5f2-fa734fbb888c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:00.323365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e228de-9f91-44fb-a5f2-fa734fbb888c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:00.368353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-88e228de-9f91-44fb-a5f2-fa734fbb888c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:00.370418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-88e228de-9f91-44fb-a5f2-fa734fbb888c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:00.414748 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2610/5247] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:35:00.427515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e228de-9f91-44fb-a5f2-fa734fbb888c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:00.463241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e228de-9f91-44fb-a5f2-fa734fbb888c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:00.478903 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d65e4d-d621-4f67-ba09-719f218de5ca admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:00.482394 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a72ae-fcdd-4477-bfb9-5ee025902ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:00.483030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a72ae-fcdd-4477-bfb9-5ee025902ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:00.483308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a72ae-fcdd-4477-bfb9-5ee025902ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:00.483581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a72ae-fcdd-4477-bfb9-5ee025902ec0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:00.484278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a72ae-fcdd-4477-bfb9-5ee025902ec0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:35:00.484663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a72ae-fcdd-4477-bfb9-5ee025902ec0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:00.491640 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75e251-a2de-4138-a026-9812fa211d6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:00.493607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75e251-a2de-4138-a026-9812fa211d6e service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:00.494276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a72ae-fcdd-4477-bfb9-5ee025902ec0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:00.494972 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75e251-a2de-4138-a026-9812fa211d6e service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:00.495359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75e251-a2de-4138-a026-9812fa211d6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:00.497665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4c75e251-a2de-4138-a026-9812fa211d6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:00.550222 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2611/5248] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:35:00.551177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a72ae-fcdd-4477-bfb9-5ee025902ec0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:00.595118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a72ae-fcdd-4477-bfb9-5ee025902ec0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:00.608757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75e251-a2de-4138-a026-9812fa211d6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:00.611132 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c75e251-a2de-4138-a026-9812fa211d6e service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:00.627680 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2638/5249] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:35:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:35:00.630668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712b0f7-4e16-493a-be67-9dd4e021b524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:00.631300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712b0f7-4e16-493a-be67-9dd4e021b524 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:00.631577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712b0f7-4e16-493a-be67-9dd4e021b524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:00.633957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712b0f7-4e16-493a-be67-9dd4e021b524 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:00.635269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712b0f7-4e16-493a-be67-9dd4e021b524 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:00.640834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712b0f7-4e16-493a-be67-9dd4e021b524 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:00.747972 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2612/5250] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:35:00 2022] POST /identity/v3/projects => generated 387 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:35:00.749262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75e251-a2de-4138-a026-9812fa211d6e service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:00.765818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75e251-a2de-4138-a026-9812fa211d6e service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:00.877458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295b7e4-f89a-4a7b-a991-895fd67637e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:00.878605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295b7e4-f89a-4a7b-a991-895fd67637e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:00.879137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295b7e4-f89a-4a7b-a991-895fd67637e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:00.879651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295b7e4-f89a-4a7b-a991-895fd67637e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:00.880560 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295b7e4-f89a-4a7b-a991-895fd67637e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:00.883122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295b7e4-f89a-4a7b-a991-895fd67637e4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:00.921170 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2639/5251] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:35:00 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:35:00.922004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712b0f7-4e16-493a-be67-9dd4e021b524 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:00.936532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712b0f7-4e16-493a-be67-9dd4e021b524 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:00.949356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26144cbd-e279-405b-8c34-c5879f16b81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:00.950206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26144cbd-e279-405b-8c34-c5879f16b81f admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:00.950515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26144cbd-e279-405b-8c34-c5879f16b81f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:00.950782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26144cbd-e279-405b-8c34-c5879f16b81f admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:00.951392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26144cbd-e279-405b-8c34-c5879f16b81f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:00.953039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26144cbd-e279-405b-8c34-c5879f16b81f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:00.996730 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2613/5252] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:35:00 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:35:01.001245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295b7e4-f89a-4a7b-a991-895fd67637e4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:01.022653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295b7e4-f89a-4a7b-a991-895fd67637e4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:01.031823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c2b47-d481-4366-a2b8-ec7b6346e6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:01.033267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c2b47-d481-4366-a2b8-ec7b6346e6f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:01.033653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c2b47-d481-4366-a2b8-ec7b6346e6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:01.034038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c2b47-d481-4366-a2b8-ec7b6346e6f8 admin admin] PATH_INFO: `/v3/projects/c5608f9fff5e4c488412bd9c70176a8b/users/3f7dcc007db641d5b9477545ce5f1256/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:01.039331 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:01.259644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c2b47-d481-4366-a2b8-ec7b6346e6f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5608f9fff5e4c488412bd9c70176a8b, user_id=3f7dcc007db641d5b9477545ce5f1256, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:01.259644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c2b47-d481-4366-a2b8-ec7b6346e6f8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:01.261365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26144cbd-e279-405b-8c34-c5879f16b81f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:01.262458 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2640/5253] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:35:01 2022] PUT /identity/v3/projects/c5608f9fff5e4c488412bd9c70176a8b/users/3f7dcc007db641d5b9477545ce5f1256/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:35:01.262753 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26144cbd-e279-405b-8c34-c5879f16b81f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:01.313488 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:01.463466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487ac5c-30fa-4e20-a488-4988b098c0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:01.467695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487ac5c-30fa-4e20-a488-4988b098c0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:01.469647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487ac5c-30fa-4e20-a488-4988b098c0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:01.471096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487ac5c-30fa-4e20-a488-4988b098c0d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:01.471741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487ac5c-30fa-4e20-a488-4988b098c0d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:01.488851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487ac5c-30fa-4e20-a488-4988b098c0d0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:01.515941 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2614/5254] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:35:01 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:35:01.521904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c2b47-d481-4366-a2b8-ec7b6346e6f8 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:01.540931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c2b47-d481-4366-a2b8-ec7b6346e6f8 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:01.556876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05ae20-2ba9-49f0-ad33-24674a6bd8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:01.558981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05ae20-2ba9-49f0-ad33-24674a6bd8bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:01.559269 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05ae20-2ba9-49f0-ad33-24674a6bd8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:01.559552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05ae20-2ba9-49f0-ad33-24674a6bd8bc admin admin] PATH_INFO: `/v3/projects/c5608f9fff5e4c488412bd9c70176a8b/users/3f7dcc007db641d5b9477545ce5f1256/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:01.568425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05ae20-2ba9-49f0-ad33-24674a6bd8bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5608f9fff5e4c488412bd9c70176a8b, user_id=3f7dcc007db641d5b9477545ce5f1256, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:01.575071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05ae20-2ba9-49f0-ad33-24674a6bd8bc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:01.616574 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2641/5255] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:35:01 2022] PUT /identity/v3/projects/c5608f9fff5e4c488412bd9c70176a8b/users/3f7dcc007db641d5b9477545ce5f1256/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:35:01.621386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0574a75-b97b-4ffb-ad75-dcd9b8239ec1 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:01.622198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0574a75-b97b-4ffb-ad75-dcd9b8239ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:01.622680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0574a75-b97b-4ffb-ad75-dcd9b8239ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:01.724930 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e0574a75-b97b-4ffb-ad75-dcd9b8239ec1 None None] MFA Rules not processed for user `3f7dcc007db641d5b9477545ce5f1256`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:01.726527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e0574a75-b97b-4ffb-ad75-dcd9b8239ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:01.921307 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2615/5256] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:01 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:01.924463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05ae20-2ba9-49f0-ad33-24674a6bd8bc admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:02.070029 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05ae20-2ba9-49f0-ad33-24674a6bd8bc admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:02.087276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe465ef3-d540-4554-8e11-7319b424aad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:02.088012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe465ef3-d540-4554-8e11-7319b424aad9 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:02.088507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe465ef3-d540-4554-8e11-7319b424aad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:02.088937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe465ef3-d540-4554-8e11-7319b424aad9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:02.089964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe465ef3-d540-4554-8e11-7319b424aad9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:02.092236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe465ef3-d540-4554-8e11-7319b424aad9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:02.161835 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2642/5257] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:35:01 2022] POST /identity/v3/projects => generated 385 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:35:02.162737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0574a75-b97b-4ffb-ad75-dcd9b8239ec1 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:02.181062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0574a75-b97b-4ffb-ad75-dcd9b8239ec1 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:02.451773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d367e-1783-4824-9ebd-51413726020b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:02.452745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d367e-1783-4824-9ebd-51413726020b admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:02.453569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d367e-1783-4824-9ebd-51413726020b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:02.454007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d367e-1783-4824-9ebd-51413726020b admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:02.454924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d367e-1783-4824-9ebd-51413726020b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:02.474245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d367e-1783-4824-9ebd-51413726020b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:02.521690 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2616/5258] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:35:02 2022] POST /identity/v3/users => generated 293 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:35:02.528065 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe465ef3-d540-4554-8e11-7319b424aad9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:02.542796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe465ef3-d540-4554-8e11-7319b424aad9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:02.550130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f927e-b581-416b-974c-c53102c91176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:02.551593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f927e-b581-416b-974c-c53102c91176 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:02.552132 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f927e-b581-416b-974c-c53102c91176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:02.552748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f927e-b581-416b-974c-c53102c91176 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:02.553757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9f927e-b581-416b-974c-c53102c91176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:02.555831 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9f927e-b581-416b-974c-c53102c91176 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:02.577111 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2643/5259] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:35:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:35:02.578257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d367e-1783-4824-9ebd-51413726020b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:02.594535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d367e-1783-4824-9ebd-51413726020b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:02.607176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba7461-9984-4c53-893b-077203bb9f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:02.607176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba7461-9984-4c53-893b-077203bb9f89 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:02.607176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba7461-9984-4c53-893b-077203bb9f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:02.607176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba7461-9984-4c53-893b-077203bb9f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:02.607685 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba7461-9984-4c53-893b-077203bb9f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:02.609278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba7461-9984-4c53-893b-077203bb9f89 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:02.636510 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2617/5260] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:35:02 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:35:02.638543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f927e-b581-416b-974c-c53102c91176 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:02.661833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f927e-b581-416b-974c-c53102c91176 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:02.680088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278ddf6-498f-468b-bc16-4fd6b0206e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:02.681436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278ddf6-498f-468b-bc16-4fd6b0206e39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:02.681778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278ddf6-498f-468b-bc16-4fd6b0206e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:02.684235 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278ddf6-498f-468b-bc16-4fd6b0206e39 admin admin] PATH_INFO: `/v3/projects/5379b43ad7d64da58793949ccd01e6ff/users/cdf20b99ae1b42b283f64f3fae19ab01/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:02.719720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278ddf6-498f-468b-bc16-4fd6b0206e39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5379b43ad7d64da58793949ccd01e6ff, user_id=cdf20b99ae1b42b283f64f3fae19ab01, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:02.729283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278ddf6-498f-468b-bc16-4fd6b0206e39 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:02.752065 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2644/5261] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:35:02 2022] PUT /identity/v3/projects/5379b43ad7d64da58793949ccd01e6ff/users/cdf20b99ae1b42b283f64f3fae19ab01/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:35:02.763472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df89cb3-e209-44ed-8bd0-81fe07b620a5 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:02.763850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df89cb3-e209-44ed-8bd0-81fe07b620a5 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:02.764223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df89cb3-e209-44ed-8bd0-81fe07b620a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:02.820402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1df89cb3-e209-44ed-8bd0-81fe07b620a5 None None] MFA Rules not processed for user `cdf20b99ae1b42b283f64f3fae19ab01`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:02.821863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1df89cb3-e209-44ed-8bd0-81fe07b620a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:02.834076 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:02.914385 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2618/5262] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:02.921867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278ddf6-498f-468b-bc16-4fd6b0206e39 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:02.923537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1278ddf6-498f-468b-bc16-4fd6b0206e39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:03.068779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278ddf6-498f-468b-bc16-4fd6b0206e39 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:03.081350 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f43d0f-3ee1-4313-8fba-58a36a91899a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:03.083347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f43d0f-3ee1-4313-8fba-58a36a91899a service glance] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:03.086643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f43d0f-3ee1-4313-8fba-58a36a91899a service glance] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:03.087601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f43d0f-3ee1-4313-8fba-58a36a91899a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:03.217513 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:03.338236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f43d0f-3ee1-4313-8fba-58a36a91899a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:03.342197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f43d0f-3ee1-4313-8fba-58a36a91899a service glance] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:03.373930 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2645/5263] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:35:02 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:35:03.452399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92036b-57a6-4b90-8f62-3ac5466bcf9e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:03.452823 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92036b-57a6-4b90-8f62-3ac5466bcf9e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:03.453369 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92036b-57a6-4b90-8f62-3ac5466bcf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:03.497897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2f92036b-57a6-4b90-8f62-3ac5466bcf9e None None] MFA Rules not processed for user `0344a81c981b434689ac476b815b8f02`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:03.505093 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2f92036b-57a6-4b90-8f62-3ac5466bcf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:03.702923 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2619/5264] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:03.970161 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f43d0f-3ee1-4313-8fba-58a36a91899a service glance] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:04.083437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f43d0f-3ee1-4313-8fba-58a36a91899a service glance] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:04.089771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9cb1d-a913-4304-9c23-acf934a0c2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:04.091514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9cb1d-a913-4304-9c23-acf934a0c2a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:04.092070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9cb1d-a913-4304-9c23-acf934a0c2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:04.093133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9cb1d-a913-4304-9c23-acf934a0c2a5 admin admin] PATH_INFO: `/v3/users/3f7dcc007db641d5b9477545ce5f1256` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:04.094610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f9cb1d-a913-4304-9c23-acf934a0c2a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f7dcc007db641d5b9477545ce5f1256)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:04.096943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f9cb1d-a913-4304-9c23-acf934a0c2a5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:04.184805 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-46f9cb1d-a913-4304-9c23-acf934a0c2a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f7dcc007db641d5b9477545ce5f1256'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:04.210825 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-46f9cb1d-a913-4304-9c23-acf934a0c2a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f7dcc007db641d5b9477545ce5f1256'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:04.226685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-46f9cb1d-a913-4304-9c23-acf934a0c2a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f7dcc007db641d5b9477545ce5f1256'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:04.227735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-46f9cb1d-a913-4304-9c23-acf934a0c2a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f7dcc007db641d5b9477545ce5f1256'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:04.239765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-46f9cb1d-a913-4304-9c23-acf934a0c2a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f7dcc007db641d5b9477545ce5f1256'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:04.252421 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2646/5265] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:35:03 2022] DELETE /identity/v3/users/3f7dcc007db641d5b9477545ce5f1256 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:35:04.254052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0e054-125e-463d-a393-2c341b96ab11 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:04.254345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0e054-125e-463d-a393-2c341b96ab11 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:04.254622 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0e054-125e-463d-a393-2c341b96ab11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:04.283407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0dd0e054-125e-463d-a393-2c341b96ab11 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:04.284850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0dd0e054-125e-463d-a393-2c341b96ab11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:04.424382 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2620/5266] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:35:04.456105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9cb1d-a913-4304-9c23-acf934a0c2a5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:04.458942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-46f9cb1d-a913-4304-9c23-acf934a0c2a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:04.677452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9cb1d-a913-4304-9c23-acf934a0c2a5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:04.681795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38152989-e4aa-4afe-96ae-a8bbacaca803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:04.682407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38152989-e4aa-4afe-96ae-a8bbacaca803 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:04.682839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38152989-e4aa-4afe-96ae-a8bbacaca803 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:04.683155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38152989-e4aa-4afe-96ae-a8bbacaca803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:04.691049 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:04.695263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38152989-e4aa-4afe-96ae-a8bbacaca803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:04.697843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38152989-e4aa-4afe-96ae-a8bbacaca803 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:04.711317 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2647/5267] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:35:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:35:05.528382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0e054-125e-463d-a393-2c341b96ab11 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:05.531166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0dd0e054-125e-463d-a393-2c341b96ab11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:05.549069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0e054-125e-463d-a393-2c341b96ab11 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:05.556400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d849bf0-9bfa-48fb-b59c-2b0da00eb719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:05.563043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d849bf0-9bfa-48fb-b59c-2b0da00eb719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:05.563443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d849bf0-9bfa-48fb-b59c-2b0da00eb719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:05.563772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d849bf0-9bfa-48fb-b59c-2b0da00eb719 admin admin] PATH_INFO: `/v3/projects/c5608f9fff5e4c488412bd9c70176a8b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:05.566538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d849bf0-9bfa-48fb-b59c-2b0da00eb719 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5608f9fff5e4c488412bd9c70176a8b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:05.569765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d849bf0-9bfa-48fb-b59c-2b0da00eb719 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:05.647721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4d849bf0-9bfa-48fb-b59c-2b0da00eb719 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5608f9fff5e4c488412bd9c70176a8b', 'request_id': 'req-4d849bf0-9bfa-48fb-b59c-2b0da00eb719'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:05.658279 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:05.669354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4d849bf0-9bfa-48fb-b59c-2b0da00eb719 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5608f9fff5e4c488412bd9c70176a8b', 'request_id': 'req-4d849bf0-9bfa-48fb-b59c-2b0da00eb719'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:05.685045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4d849bf0-9bfa-48fb-b59c-2b0da00eb719 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5608f9fff5e4c488412bd9c70176a8b', 'request_id': 'req-4d849bf0-9bfa-48fb-b59c-2b0da00eb719'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:05.715692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4d849bf0-9bfa-48fb-b59c-2b0da00eb719 admin admin] The token cache is being invalidate because project c5608f9fff5e4c488412bd9c70176a8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:35:05.716271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4d849bf0-9bfa-48fb-b59c-2b0da00eb719 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:05.717351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4d849bf0-9bfa-48fb-b59c-2b0da00eb719 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:05.720748 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2621/5268] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:35:05 2022] DELETE /identity/v3/projects/c5608f9fff5e4c488412bd9c70176a8b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:35:05.724889 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38152989-e4aa-4afe-96ae-a8bbacaca803 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:05.742238 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38152989-e4aa-4afe-96ae-a8bbacaca803 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:05.827927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75276fa-b321-4985-8230-d25ca80efafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:05.828824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75276fa-b321-4985-8230-d25ca80efafb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:05.829264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75276fa-b321-4985-8230-d25ca80efafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:05.829692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75276fa-b321-4985-8230-d25ca80efafb admin admin] PATH_INFO: `/v3/users/cdf20b99ae1b42b283f64f3fae19ab01` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:05.831057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75276fa-b321-4985-8230-d25ca80efafb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdf20b99ae1b42b283f64f3fae19ab01)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:05.833527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75276fa-b321-4985-8230-d25ca80efafb admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:05.936935 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f75276fa-b321-4985-8230-d25ca80efafb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdf20b99ae1b42b283f64f3fae19ab01'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:05.962319 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f75276fa-b321-4985-8230-d25ca80efafb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdf20b99ae1b42b283f64f3fae19ab01'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:05.981461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f75276fa-b321-4985-8230-d25ca80efafb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdf20b99ae1b42b283f64f3fae19ab01'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:05.982241 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f75276fa-b321-4985-8230-d25ca80efafb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdf20b99ae1b42b283f64f3fae19ab01'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:05.997902 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f75276fa-b321-4985-8230-d25ca80efafb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdf20b99ae1b42b283f64f3fae19ab01'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:06.008968 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2648/5269] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:35:05 2022] DELETE /identity/v3/users/cdf20b99ae1b42b283f64f3fae19ab01 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:35:07.066050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d849bf0-9bfa-48fb-b59c-2b0da00eb719 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:07.078506 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4d849bf0-9bfa-48fb-b59c-2b0da00eb719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:07.106010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d849bf0-9bfa-48fb-b59c-2b0da00eb719 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:07.400210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd02a2-e3f6-45a1-ba93-54680e5a2e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:07.402234 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd02a2-e3f6-45a1-ba93-54680e5a2e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:07.403606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd02a2-e3f6-45a1-ba93-54680e5a2e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:07.405035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd02a2-e3f6-45a1-ba93-54680e5a2e79 admin admin] PATH_INFO: `/v3/projects/5379b43ad7d64da58793949ccd01e6ff` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:07.410662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd02a2-e3f6-45a1-ba93-54680e5a2e79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5379b43ad7d64da58793949ccd01e6ff)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:07.417345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd02a2-e3f6-45a1-ba93-54680e5a2e79 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:07.486691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c9fd02a2-e3f6-45a1-ba93-54680e5a2e79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5379b43ad7d64da58793949ccd01e6ff', 'request_id': 'req-c9fd02a2-e3f6-45a1-ba93-54680e5a2e79'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:07.494301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c9fd02a2-e3f6-45a1-ba93-54680e5a2e79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5379b43ad7d64da58793949ccd01e6ff', 'request_id': 'req-c9fd02a2-e3f6-45a1-ba93-54680e5a2e79'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:07.504243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c9fd02a2-e3f6-45a1-ba93-54680e5a2e79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5379b43ad7d64da58793949ccd01e6ff', 'request_id': 'req-c9fd02a2-e3f6-45a1-ba93-54680e5a2e79'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:07.524239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c9fd02a2-e3f6-45a1-ba93-54680e5a2e79 admin admin] The token cache is being invalidate because project 5379b43ad7d64da58793949ccd01e6ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:35:07.525015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c9fd02a2-e3f6-45a1-ba93-54680e5a2e79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:07.526005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c9fd02a2-e3f6-45a1-ba93-54680e5a2e79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:07.528342 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2622/5270] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:35:07 2022] DELETE /identity/v3/projects/5379b43ad7d64da58793949ccd01e6ff => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:35:07.535392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c119ef-06a4-42e8-9c03-b68e18bb8920 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:07.537991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c119ef-06a4-42e8-9c03-b68e18bb8920 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:07.538707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c119ef-06a4-42e8-9c03-b68e18bb8920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:07.593629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-17c119ef-06a4-42e8-9c03-b68e18bb8920 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:07.598847 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-17c119ef-06a4-42e8-9c03-b68e18bb8920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:07.769210 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2649/5271] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:07.778268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d048fc6-44dd-4a2a-86ab-8e9bf8ba76d5 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:07.778507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d048fc6-44dd-4a2a-86ab-8e9bf8ba76d5 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:07.780744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d048fc6-44dd-4a2a-86ab-8e9bf8ba76d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:07.822081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-4d048fc6-44dd-4a2a-86ab-8e9bf8ba76d5 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:07.823769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4d048fc6-44dd-4a2a-86ab-8e9bf8ba76d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:07.837234 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2623/5272] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:07.838752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c119ef-06a4-42e8-9c03-b68e18bb8920 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:07.860278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c119ef-06a4-42e8-9c03-b68e18bb8920 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:07.879251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747d46b-9f30-4d33-acb4-fc49bed2b893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:07.881236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747d46b-9f30-4d33-acb4-fc49bed2b893 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:07.883760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747d46b-9f30-4d33-acb4-fc49bed2b893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:07.884237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747d46b-9f30-4d33-acb4-fc49bed2b893 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:07.885441 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747d46b-9f30-4d33-acb4-fc49bed2b893 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:35:07.885975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747d46b-9f30-4d33-acb4-fc49bed2b893 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:07.896801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747d46b-9f30-4d33-acb4-fc49bed2b893 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:07.933014 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:07.945598 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2650/5273] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:35:07.947721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d048fc6-44dd-4a2a-86ab-8e9bf8ba76d5 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:07.984927 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d048fc6-44dd-4a2a-86ab-8e9bf8ba76d5 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:08.002779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9bd23-c183-47b4-a8bc-454cb6e7b59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:08.003407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9bd23-c183-47b4-a8bc-454cb6e7b59b admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:08.003680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9bd23-c183-47b4-a8bc-454cb6e7b59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:08.003994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9bd23-c183-47b4-a8bc-454cb6e7b59b admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:08.004626 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9bd23-c183-47b4-a8bc-454cb6e7b59b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:08.006571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9bd23-c183-47b4-a8bc-454cb6e7b59b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:08.081871 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2624/5274] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:35:07 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:35:08.082910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747d46b-9f30-4d33-acb4-fc49bed2b893 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:08.096288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747d46b-9f30-4d33-acb4-fc49bed2b893 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:08.239538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bb645-02a8-45c4-b396-f28dac58de7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:08.240415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bb645-02a8-45c4-b396-f28dac58de7c admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:08.240823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bb645-02a8-45c4-b396-f28dac58de7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:08.241191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bb645-02a8-45c4-b396-f28dac58de7c admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:08.241939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795bb645-02a8-45c4-b396-f28dac58de7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:08.244792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795bb645-02a8-45c4-b396-f28dac58de7c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:08.284046 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2651/5275] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:35:08 2022] POST /identity/v3/users => generated 290 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:35:08.288016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9bd23-c183-47b4-a8bc-454cb6e7b59b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:08.326847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9bd23-c183-47b4-a8bc-454cb6e7b59b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:08.358932 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346147a-acdf-4308-9dd0-76ff24b1989d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:08.359839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346147a-acdf-4308-9dd0-76ff24b1989d admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:08.360605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346147a-acdf-4308-9dd0-76ff24b1989d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:08.360979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346147a-acdf-4308-9dd0-76ff24b1989d admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:08.361818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346147a-acdf-4308-9dd0-76ff24b1989d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:08.363717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346147a-acdf-4308-9dd0-76ff24b1989d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:08.382885 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2625/5276] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:35:08.386897 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bb645-02a8-45c4-b396-f28dac58de7c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:08.407953 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bb645-02a8-45c4-b396-f28dac58de7c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:08.417334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730729c-4510-4c20-96f7-48c12eefc2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:08.418169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730729c-4510-4c20-96f7-48c12eefc2ff admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:08.418288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730729c-4510-4c20-96f7-48c12eefc2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:08.418470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730729c-4510-4c20-96f7-48c12eefc2ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:08.419119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730729c-4510-4c20-96f7-48c12eefc2ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:08.421006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730729c-4510-4c20-96f7-48c12eefc2ff admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:08.434760 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2652/5277] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:35:08.439092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346147a-acdf-4308-9dd0-76ff24b1989d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:08.476304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346147a-acdf-4308-9dd0-76ff24b1989d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:08.482561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ead701-3150-44dd-8e0d-395075b76ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:08.483539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ead701-3150-44dd-8e0d-395075b76ba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:08.483840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ead701-3150-44dd-8e0d-395075b76ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:08.484295 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ead701-3150-44dd-8e0d-395075b76ba9 admin admin] PATH_INFO: `/v3/projects/091a58942293402b84adbf9b82a2af8b/users/2415436169674557b1599e265154eace/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:08.503306 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ead701-3150-44dd-8e0d-395075b76ba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=091a58942293402b84adbf9b82a2af8b, user_id=2415436169674557b1599e265154eace, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:08.506779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ead701-3150-44dd-8e0d-395075b76ba9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:08.529833 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2626/5278] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:35:08 2022] PUT /identity/v3/projects/091a58942293402b84adbf9b82a2af8b/users/2415436169674557b1599e265154eace/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:35:08.540697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebb6cb-e96d-4e56-8c26-16154b4bee27 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:08.541290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebb6cb-e96d-4e56-8c26-16154b4bee27 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:08.541290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebb6cb-e96d-4e56-8c26-16154b4bee27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:08.603920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f3ebb6cb-e96d-4e56-8c26-16154b4bee27 None None] MFA Rules not processed for user `2415436169674557b1599e265154eace`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:08.605427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f3ebb6cb-e96d-4e56-8c26-16154b4bee27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:08.685223 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2653/5279] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:35:08.698428 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ead701-3150-44dd-8e0d-395075b76ba9 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:08.709597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-27ead701-3150-44dd-8e0d-395075b76ba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:08.726523 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:08.857687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ead701-3150-44dd-8e0d-395075b76ba9 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:08.863153 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a80aaa-1125-476d-b96e-ec2e600cd98a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:08.864261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a80aaa-1125-476d-b96e-ec2e600cd98a service glance] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:08.864807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a80aaa-1125-476d-b96e-ec2e600cd98a service glance] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:08.865315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a80aaa-1125-476d-b96e-ec2e600cd98a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:08.877931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a80aaa-1125-476d-b96e-ec2e600cd98a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:08.879875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a80aaa-1125-476d-b96e-ec2e600cd98a service glance] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:08.895822 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2627/5280] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:35:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:35:09.236445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebb6cb-e96d-4e56-8c26-16154b4bee27 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:09.424990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebb6cb-e96d-4e56-8c26-16154b4bee27 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:09.430966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e083dfc-d4c3-49a6-a0f3-149d911fcac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:09.432012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e083dfc-d4c3-49a6-a0f3-149d911fcac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:09.432538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e083dfc-d4c3-49a6-a0f3-149d911fcac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:09.433026 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e083dfc-d4c3-49a6-a0f3-149d911fcac4 admin admin] PATH_INFO: `/v3/users/2415436169674557b1599e265154eace` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:09.434775 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e083dfc-d4c3-49a6-a0f3-149d911fcac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2415436169674557b1599e265154eace)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:09.437066 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e083dfc-d4c3-49a6-a0f3-149d911fcac4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:09.453307 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:09.508248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5e083dfc-d4c3-49a6-a0f3-149d911fcac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2415436169674557b1599e265154eace'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:09.524586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5e083dfc-d4c3-49a6-a0f3-149d911fcac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2415436169674557b1599e265154eace'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:09.560258 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5e083dfc-d4c3-49a6-a0f3-149d911fcac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2415436169674557b1599e265154eace'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:09.562356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5e083dfc-d4c3-49a6-a0f3-149d911fcac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2415436169674557b1599e265154eace'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:09.574853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5e083dfc-d4c3-49a6-a0f3-149d911fcac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2415436169674557b1599e265154eace'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:09.588668 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2654/5281] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:35:09 2022] DELETE /identity/v3/users/2415436169674557b1599e265154eace => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:35:09.594724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86551173-20db-4201-9a10-8e5a393e2dfc None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:09.595668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86551173-20db-4201-9a10-8e5a393e2dfc None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:09.596013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86551173-20db-4201-9a10-8e5a393e2dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:09.626978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-86551173-20db-4201-9a10-8e5a393e2dfc None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:09.628354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-86551173-20db-4201-9a10-8e5a393e2dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:09.768446 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2628/5282] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:09.790956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e083dfc-d4c3-49a6-a0f3-149d911fcac4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:09.792704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5e083dfc-d4c3-49a6-a0f3-149d911fcac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:09.970541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e083dfc-d4c3-49a6-a0f3-149d911fcac4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:09.980470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e86bc1-4c48-42a6-854f-78023cc2dc20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:09.981790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e86bc1-4c48-42a6-854f-78023cc2dc20 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:09.984205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e86bc1-4c48-42a6-854f-78023cc2dc20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:09.984205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e86bc1-4c48-42a6-854f-78023cc2dc20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:10.044307 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e86bc1-4c48-42a6-854f-78023cc2dc20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:10.045976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e86bc1-4c48-42a6-854f-78023cc2dc20 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:10.072100 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2655/5283] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:35:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:35:10.121610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2adcd-98cd-4a11-b702-ecf48df39cd6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:10.121904 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2adcd-98cd-4a11-b702-ecf48df39cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:10.122183 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2adcd-98cd-4a11-b702-ecf48df39cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:10.147138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3fd2adcd-98cd-4a11-b702-ecf48df39cd6 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:10.149093 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3fd2adcd-98cd-4a11-b702-ecf48df39cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:10.261208 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2629/5284] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:35:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:10.284752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e86bc1-4c48-42a6-854f-78023cc2dc20 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:10.286625 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-68e86bc1-4c48-42a6-854f-78023cc2dc20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:10.480051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e86bc1-4c48-42a6-854f-78023cc2dc20 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:10.492867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc4201-5e27-4bb1-995f-34cc1c761ef4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:10.495280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc4201-5e27-4bb1-995f-34cc1c761ef4 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:10.496290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc4201-5e27-4bb1-995f-34cc1c761ef4 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:10.496916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc4201-5e27-4bb1-995f-34cc1c761ef4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:10.549056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc4201-5e27-4bb1-995f-34cc1c761ef4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:10.554655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc4201-5e27-4bb1-995f-34cc1c761ef4 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:10.573299 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2656/5285] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:35:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:35:11.349173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2adcd-98cd-4a11-b702-ecf48df39cd6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:11.351554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3fd2adcd-98cd-4a11-b702-ecf48df39cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:11.381111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2adcd-98cd-4a11-b702-ecf48df39cd6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:11.400230 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264505e5-5576-4529-806c-bda16df9e3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:11.400705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264505e5-5576-4529-806c-bda16df9e3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:11.401165 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264505e5-5576-4529-806c-bda16df9e3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:11.401434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264505e5-5576-4529-806c-bda16df9e3b4 admin admin] PATH_INFO: `/v3/projects/091a58942293402b84adbf9b82a2af8b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:11.412939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264505e5-5576-4529-806c-bda16df9e3b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=091a58942293402b84adbf9b82a2af8b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:11.415766 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264505e5-5576-4529-806c-bda16df9e3b4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:11.511599 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-264505e5-5576-4529-806c-bda16df9e3b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '091a58942293402b84adbf9b82a2af8b', 'request_id': 'req-264505e5-5576-4529-806c-bda16df9e3b4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:11.514059 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:11.521478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-264505e5-5576-4529-806c-bda16df9e3b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '091a58942293402b84adbf9b82a2af8b', 'request_id': 'req-264505e5-5576-4529-806c-bda16df9e3b4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:11.531484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-264505e5-5576-4529-806c-bda16df9e3b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '091a58942293402b84adbf9b82a2af8b', 'request_id': 'req-264505e5-5576-4529-806c-bda16df9e3b4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:11.554044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-264505e5-5576-4529-806c-bda16df9e3b4 admin admin] The token cache is being invalidate because project 091a58942293402b84adbf9b82a2af8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:35:11.554903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-264505e5-5576-4529-806c-bda16df9e3b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:11.556046 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-264505e5-5576-4529-806c-bda16df9e3b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:11.565370 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2630/5286] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:35:11 2022] DELETE /identity/v3/projects/091a58942293402b84adbf9b82a2af8b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:35:11.572964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43bc73-4528-4cf6-afc7-7d6f01280e17 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:11.573782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43bc73-4528-4cf6-afc7-7d6f01280e17 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:11.574794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43bc73-4528-4cf6-afc7-7d6f01280e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:11.604928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2d43bc73-4528-4cf6-afc7-7d6f01280e17 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:11.606347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2d43bc73-4528-4cf6-afc7-7d6f01280e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:11.638271 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:11.725847 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2657/5287] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:11.735148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235369e-727d-43b6-aa47-db2c14174554 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:11.736152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235369e-727d-43b6-aa47-db2c14174554 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:11.737005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235369e-727d-43b6-aa47-db2c14174554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:11.783139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2235369e-727d-43b6-aa47-db2c14174554 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:11.786926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2235369e-727d-43b6-aa47-db2c14174554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:11.830405 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2631/5288] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:11.830994 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43bc73-4528-4cf6-afc7-7d6f01280e17 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:11.853169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43bc73-4528-4cf6-afc7-7d6f01280e17 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:11.861267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a332d-d123-4d10-ab6b-909f241cb16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:11.861979 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a332d-d123-4d10-ab6b-909f241cb16c admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:11.862529 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a332d-d123-4d10-ab6b-909f241cb16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:11.862884 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a332d-d123-4d10-ab6b-909f241cb16c admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:11.863625 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a332d-d123-4d10-ab6b-909f241cb16c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:35:11.864024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a332d-d123-4d10-ab6b-909f241cb16c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:11.865763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a332d-d123-4d10-ab6b-909f241cb16c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:11.926642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235369e-727d-43b6-aa47-db2c14174554 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:11.939924 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2658/5289] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:35:11.991654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235369e-727d-43b6-aa47-db2c14174554 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:12.004220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df76ed7-afef-4efa-8d80-65a7a9590ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:12.004929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df76ed7-afef-4efa-8d80-65a7a9590ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:12.005211 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df76ed7-afef-4efa-8d80-65a7a9590ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:12.005512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df76ed7-afef-4efa-8d80-65a7a9590ba4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:12.006624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df76ed7-afef-4efa-8d80-65a7a9590ba4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:12.009588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df76ed7-afef-4efa-8d80-65a7a9590ba4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:12.075792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a332d-d123-4d10-ab6b-909f241cb16c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:12.076419 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2632/5290] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:35:11 2022] POST /identity/v3/projects => generated 381 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:35:12.093157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a332d-d123-4d10-ab6b-909f241cb16c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:12.291144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938125c-bcc9-4e93-9a1b-1f1cb771f91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:12.292179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938125c-bcc9-4e93-9a1b-1f1cb771f91c admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:12.292612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938125c-bcc9-4e93-9a1b-1f1cb771f91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:12.292986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938125c-bcc9-4e93-9a1b-1f1cb771f91c admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:12.293779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938125c-bcc9-4e93-9a1b-1f1cb771f91c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:12.300999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938125c-bcc9-4e93-9a1b-1f1cb771f91c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:12.355283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df76ed7-afef-4efa-8d80-65a7a9590ba4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:12.357864 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2659/5291] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:35:12 2022] POST /identity/v3/users => generated 291 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:35:12.366708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df76ed7-afef-4efa-8d80-65a7a9590ba4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:12.372101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2de98-bcfa-4c9e-ba36-ac23cce0a77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:12.373012 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2de98-bcfa-4c9e-ba36-ac23cce0a77a admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:12.373488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2de98-bcfa-4c9e-ba36-ac23cce0a77a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:12.373938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2de98-bcfa-4c9e-ba36-ac23cce0a77a admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:12.375227 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2de98-bcfa-4c9e-ba36-ac23cce0a77a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:12.377303 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2de98-bcfa-4c9e-ba36-ac23cce0a77a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:12.394893 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2633/5292] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:35:12.409070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938125c-bcc9-4e93-9a1b-1f1cb771f91c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:12.446320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938125c-bcc9-4e93-9a1b-1f1cb771f91c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:12.466533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad50bd6-cd14-41c7-a765-44feffc2336f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:12.467264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad50bd6-cd14-41c7-a765-44feffc2336f admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:12.467609 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad50bd6-cd14-41c7-a765-44feffc2336f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:12.468057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad50bd6-cd14-41c7-a765-44feffc2336f admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:12.468793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad50bd6-cd14-41c7-a765-44feffc2336f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:12.470526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad50bd6-cd14-41c7-a765-44feffc2336f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:12.491388 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2de98-bcfa-4c9e-ba36-ac23cce0a77a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:12.499427 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2660/5293] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:35:12.515143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2de98-bcfa-4c9e-ba36-ac23cce0a77a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:12.530873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9055a7-f17e-4ba1-a9e4-cb106cfecc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:12.533682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9055a7-f17e-4ba1-a9e4-cb106cfecc7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:12.534253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9055a7-f17e-4ba1-a9e4-cb106cfecc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:12.534686 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9055a7-f17e-4ba1-a9e4-cb106cfecc7a admin admin] PATH_INFO: `/v3/projects/39b4d97b564340d3a20802dc40f0f801/users/c6bc29ad3036467099b1fafa51c20eef/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:12.577279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9055a7-f17e-4ba1-a9e4-cb106cfecc7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b4d97b564340d3a20802dc40f0f801, user_id=c6bc29ad3036467099b1fafa51c20eef, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:12.580175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9055a7-f17e-4ba1-a9e4-cb106cfecc7a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:12.614741 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2634/5294] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:35:12 2022] PUT /identity/v3/projects/39b4d97b564340d3a20802dc40f0f801/users/c6bc29ad3036467099b1fafa51c20eef/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:35:12.625963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b1d09-67c3-4a10-8da7-7ef739ca6d67 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:12.626451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b1d09-67c3-4a10-8da7-7ef739ca6d67 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:12.626772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b1d09-67c3-4a10-8da7-7ef739ca6d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:12.717082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-830b1d09-67c3-4a10-8da7-7ef739ca6d67 None None] MFA Rules not processed for user `c6bc29ad3036467099b1fafa51c20eef`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:12.718511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-830b1d09-67c3-4a10-8da7-7ef739ca6d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:12.868612 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2661/5295] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:12.873077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9055a7-f17e-4ba1-a9e4-cb106cfecc7a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:12.999376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9055a7-f17e-4ba1-a9e4-cb106cfecc7a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:13.004433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ffbf8b-70ae-438c-b79d-7de95efd49dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:13.005169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffbf8b-70ae-438c-b79d-7de95efd49dc admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:13.005655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffbf8b-70ae-438c-b79d-7de95efd49dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:13.005953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffbf8b-70ae-438c-b79d-7de95efd49dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:13.006691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ffbf8b-70ae-438c-b79d-7de95efd49dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:13.009328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ffbf8b-70ae-438c-b79d-7de95efd49dc admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:13.071259 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2635/5296] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:35:12 2022] POST /identity/v3/projects => generated 383 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:35:13.072455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b1d09-67c3-4a10-8da7-7ef739ca6d67 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:13.087369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b1d09-67c3-4a10-8da7-7ef739ca6d67 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:13.123557 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:13.244130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283d23f-e0d7-401a-aa9b-5e0df33d69bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:13.244858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283d23f-e0d7-401a-aa9b-5e0df33d69bc admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:13.245210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283d23f-e0d7-401a-aa9b-5e0df33d69bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:13.245554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283d23f-e0d7-401a-aa9b-5e0df33d69bc admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:13.246416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283d23f-e0d7-401a-aa9b-5e0df33d69bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:13.249396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283d23f-e0d7-401a-aa9b-5e0df33d69bc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:13.283679 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2662/5297] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:35:13 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:35:13.285239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ffbf8b-70ae-438c-b79d-7de95efd49dc admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:13.299936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ffbf8b-70ae-438c-b79d-7de95efd49dc admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:13.306291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed84297-7ba4-4066-9f3b-e38ac4492c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:13.307111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed84297-7ba4-4066-9f3b-e38ac4492c58 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:13.307600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed84297-7ba4-4066-9f3b-e38ac4492c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:13.308068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed84297-7ba4-4066-9f3b-e38ac4492c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:13.309088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed84297-7ba4-4066-9f3b-e38ac4492c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:13.313051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed84297-7ba4-4066-9f3b-e38ac4492c58 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:13.360007 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2636/5298] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:35:13.365021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283d23f-e0d7-401a-aa9b-5e0df33d69bc admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:13.377520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283d23f-e0d7-401a-aa9b-5e0df33d69bc admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:13.388745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8797c80-5e2c-4c65-b23f-f6758c2d5c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:13.392085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8797c80-5e2c-4c65-b23f-f6758c2d5c9f admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:13.392584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8797c80-5e2c-4c65-b23f-f6758c2d5c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:13.393093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8797c80-5e2c-4c65-b23f-f6758c2d5c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:13.394148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8797c80-5e2c-4c65-b23f-f6758c2d5c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:13.411428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8797c80-5e2c-4c65-b23f-f6758c2d5c9f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:13.458055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed84297-7ba4-4066-9f3b-e38ac4492c58 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:13.467496 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2663/5299] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:35:13.472647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed84297-7ba4-4066-9f3b-e38ac4492c58 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:13.489095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd751a-cbb2-46be-aa0c-de6198866712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:13.490117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd751a-cbb2-46be-aa0c-de6198866712 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:13.491039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd751a-cbb2-46be-aa0c-de6198866712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:13.491494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd751a-cbb2-46be-aa0c-de6198866712 admin admin] PATH_INFO: `/v3/projects/2d3f605c26e646a8bc80f5bcacb60d1c/users/570def341b4145e4aec339b2ae250712/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:13.514856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd751a-cbb2-46be-aa0c-de6198866712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d3f605c26e646a8bc80f5bcacb60d1c, user_id=570def341b4145e4aec339b2ae250712, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:13.519092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd751a-cbb2-46be-aa0c-de6198866712 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:13.574181 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2637/5300] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:35:13 2022] PUT /identity/v3/projects/2d3f605c26e646a8bc80f5bcacb60d1c/users/570def341b4145e4aec339b2ae250712/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:35:13.585022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11ac33-ab42-47a5-b461-41406c750806 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:13.585413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11ac33-ab42-47a5-b461-41406c750806 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:13.585740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c11ac33-ab42-47a5-b461-41406c750806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:13.637374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-4c11ac33-ab42-47a5-b461-41406c750806 None None] MFA Rules not processed for user `570def341b4145e4aec339b2ae250712`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:13.639746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4c11ac33-ab42-47a5-b461-41406c750806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:13.736645 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2664/5301] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:13.741198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd751a-cbb2-46be-aa0c-de6198866712 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:13.794207 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:13.840647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd751a-cbb2-46be-aa0c-de6198866712 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:13.845680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eae141-2807-4e46-b256-c0b2669d3974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:13.846298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eae141-2807-4e46-b256-c0b2669d3974 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:13.846573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eae141-2807-4e46-b256-c0b2669d3974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:13.846841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eae141-2807-4e46-b256-c0b2669d3974 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:13.847662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eae141-2807-4e46-b256-c0b2669d3974 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:13.850404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eae141-2807-4e46-b256-c0b2669d3974 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:13.886967 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2638/5302] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:35:13 2022] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:35:13.891550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11ac33-ab42-47a5-b461-41406c750806 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:13.927126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c11ac33-ab42-47a5-b461-41406c750806 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:14.046705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17cc8b-11f6-4882-8379-bbb10394a622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:14.047212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17cc8b-11f6-4882-8379-bbb10394a622 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:14.050044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17cc8b-11f6-4882-8379-bbb10394a622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:14.050437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17cc8b-11f6-4882-8379-bbb10394a622 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:14.051351 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17cc8b-11f6-4882-8379-bbb10394a622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:14.053899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17cc8b-11f6-4882-8379-bbb10394a622 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:14.085389 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2665/5303] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:35:13 2022] POST /identity/v3/users => generated 297 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:35:14.089691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eae141-2807-4e46-b256-c0b2669d3974 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:14.122813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eae141-2807-4e46-b256-c0b2669d3974 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:14.153725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edea09-625d-4626-aa1f-50e19173cd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:14.155653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edea09-625d-4626-aa1f-50e19173cd1d admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:14.156471 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edea09-625d-4626-aa1f-50e19173cd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:14.157816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edea09-625d-4626-aa1f-50e19173cd1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:14.158789 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33edea09-625d-4626-aa1f-50e19173cd1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:14.160718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33edea09-625d-4626-aa1f-50e19173cd1d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:14.191828 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2639/5304] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:35:14.192586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17cc8b-11f6-4882-8379-bbb10394a622 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:14.220490 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17cc8b-11f6-4882-8379-bbb10394a622 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:14.234600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08395d29-8442-4c50-a1e2-bf8e592b06d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:14.235847 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08395d29-8442-4c50-a1e2-bf8e592b06d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:14.235847 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08395d29-8442-4c50-a1e2-bf8e592b06d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:14.236127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08395d29-8442-4c50-a1e2-bf8e592b06d5 admin admin] PATH_INFO: `/v3/projects/c00fc6ca107b4c59bafa68adc5e915fa/users/8a5a60c51b0247ceae361bce323f5f58/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:14.267298 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:14.293055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08395d29-8442-4c50-a1e2-bf8e592b06d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c00fc6ca107b4c59bafa68adc5e915fa, user_id=8a5a60c51b0247ceae361bce323f5f58, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:14.301004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08395d29-8442-4c50-a1e2-bf8e592b06d5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:14.336456 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2666/5305] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:35:14 2022] PUT /identity/v3/projects/c00fc6ca107b4c59bafa68adc5e915fa/users/8a5a60c51b0247ceae361bce323f5f58/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:35:14.340753 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edea09-625d-4626-aa1f-50e19173cd1d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:14.357201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edea09-625d-4626-aa1f-50e19173cd1d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:14.509469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192d44f-3499-4736-9c5d-9454a2de525a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:14.510251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192d44f-3499-4736-9c5d-9454a2de525a admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:14.510634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192d44f-3499-4736-9c5d-9454a2de525a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:14.511351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192d44f-3499-4736-9c5d-9454a2de525a admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:14.512937 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a192d44f-3499-4736-9c5d-9454a2de525a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:14.518622 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a192d44f-3499-4736-9c5d-9454a2de525a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:14.543929 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2640/5306] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:35:14 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:35:14.547937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08395d29-8442-4c50-a1e2-bf8e592b06d5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:14.571134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08395d29-8442-4c50-a1e2-bf8e592b06d5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:14.582087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469f7fd-8830-4ae5-9278-a3a9e5c4423b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:14.582782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469f7fd-8830-4ae5-9278-a3a9e5c4423b admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:14.583062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469f7fd-8830-4ae5-9278-a3a9e5c4423b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:14.583338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469f7fd-8830-4ae5-9278-a3a9e5c4423b admin admin] PATH_INFO: `/v3/projects/c00fc6ca107b4c59bafa68adc5e915fa/users/8a5a60c51b0247ceae361bce323f5f58/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:14.593173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469f7fd-8830-4ae5-9278-a3a9e5c4423b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c00fc6ca107b4c59bafa68adc5e915fa, user_id=8a5a60c51b0247ceae361bce323f5f58, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:14.597525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469f7fd-8830-4ae5-9278-a3a9e5c4423b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:14.610622 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2667/5307] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:35:14 2022] PUT /identity/v3/projects/c00fc6ca107b4c59bafa68adc5e915fa/users/8a5a60c51b0247ceae361bce323f5f58/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:35:14.621649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650ce4f-123e-4023-8759-b5b630ef37b4 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:14.622042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650ce4f-123e-4023-8759-b5b630ef37b4 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:14.622438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650ce4f-123e-4023-8759-b5b630ef37b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:14.675117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1650ce4f-123e-4023-8759-b5b630ef37b4 None None] MFA Rules not processed for user `8a5a60c51b0247ceae361bce323f5f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:14.677367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1650ce4f-123e-4023-8759-b5b630ef37b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:14.934226 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2641/5308] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:14 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:14.989662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469f7fd-8830-4ae5-9278-a3a9e5c4423b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:14.993422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7469f7fd-8830-4ae5-9278-a3a9e5c4423b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:15.127284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469f7fd-8830-4ae5-9278-a3a9e5c4423b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:15.136919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73dc8ba-bc73-48e0-9b3f-b51be699af19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:15.137557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73dc8ba-bc73-48e0-9b3f-b51be699af19 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:15.137948 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73dc8ba-bc73-48e0-9b3f-b51be699af19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:15.138243 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73dc8ba-bc73-48e0-9b3f-b51be699af19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:15.269741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73dc8ba-bc73-48e0-9b3f-b51be699af19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:15.271447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73dc8ba-bc73-48e0-9b3f-b51be699af19 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:15.282749 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2668/5309] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:35:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:35:18.189199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650ce4f-123e-4023-8759-b5b630ef37b4 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:18.190733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1650ce4f-123e-4023-8759-b5b630ef37b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:18.232670 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:18.372209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650ce4f-123e-4023-8759-b5b630ef37b4 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:18.377532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba641b1-fcf2-4505-a9ca-e11232ba33d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:18.378469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba641b1-fcf2-4505-a9ca-e11232ba33d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:18.378922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba641b1-fcf2-4505-a9ca-e11232ba33d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:18.379377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba641b1-fcf2-4505-a9ca-e11232ba33d1 admin admin] PATH_INFO: `/v3/users/5f0ed400a2cb48cbbc9fa5bae0e2b1c2` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:18.381088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba641b1-fcf2-4505-a9ca-e11232ba33d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f0ed400a2cb48cbbc9fa5bae0e2b1c2)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:18.383100 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba641b1-fcf2-4505-a9ca-e11232ba33d1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:18.468665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0ba641b1-fcf2-4505-a9ca-e11232ba33d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:18.491722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0ba641b1-fcf2-4505-a9ca-e11232ba33d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:18.535106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0ba641b1-fcf2-4505-a9ca-e11232ba33d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:18.536431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0ba641b1-fcf2-4505-a9ca-e11232ba33d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:18.556204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0ba641b1-fcf2-4505-a9ca-e11232ba33d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f0ed400a2cb48cbbc9fa5bae0e2b1c2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:18.572763 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2642/5310] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:35:18 2022] DELETE /identity/v3/users/5f0ed400a2cb48cbbc9fa5bae0e2b1c2 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:35:19.199292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73dc8ba-bc73-48e0-9b3f-b51be699af19 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:19.242932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73dc8ba-bc73-48e0-9b3f-b51be699af19 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:19.404103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80ac89-09f2-454b-a206-7412f1886ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:19.404825 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80ac89-09f2-454b-a206-7412f1886ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:19.405102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80ac89-09f2-454b-a206-7412f1886ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:19.405377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80ac89-09f2-454b-a206-7412f1886ee6 admin admin] PATH_INFO: `/v3/projects/5a300727d7874d83970c301327780abc` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:19.409045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80ac89-09f2-454b-a206-7412f1886ee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a300727d7874d83970c301327780abc)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:19.413824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80ac89-09f2-454b-a206-7412f1886ee6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:19.501281 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:19.529322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-eb80ac89-09f2-454b-a206-7412f1886ee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a300727d7874d83970c301327780abc', 'request_id': 'req-eb80ac89-09f2-454b-a206-7412f1886ee6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:19.540757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-eb80ac89-09f2-454b-a206-7412f1886ee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a300727d7874d83970c301327780abc', 'request_id': 'req-eb80ac89-09f2-454b-a206-7412f1886ee6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:19.555492 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-eb80ac89-09f2-454b-a206-7412f1886ee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a300727d7874d83970c301327780abc', 'request_id': 'req-eb80ac89-09f2-454b-a206-7412f1886ee6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:19.578444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-eb80ac89-09f2-454b-a206-7412f1886ee6 admin admin] The token cache is being invalidate because project 5a300727d7874d83970c301327780abc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:35:19.579668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-eb80ac89-09f2-454b-a206-7412f1886ee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:19.580679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-eb80ac89-09f2-454b-a206-7412f1886ee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:19.583309 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2669/5311] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:35:19 2022] DELETE /identity/v3/projects/5a300727d7874d83970c301327780abc => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:35:19.588882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14da95-e97e-4547-ac43-3f488dbb212c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:19.589334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14da95-e97e-4547-ac43-3f488dbb212c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:19.589656 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14da95-e97e-4547-ac43-3f488dbb212c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:19.620305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-5a14da95-e97e-4547-ac43-3f488dbb212c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:19.621606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5a14da95-e97e-4547-ac43-3f488dbb212c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:19.759193 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2643/5312] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:19.767778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b6c08-99d2-4ca2-b4fe-255ad6f21e76 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:19.768090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b6c08-99d2-4ca2-b4fe-255ad6f21e76 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:19.768362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b6c08-99d2-4ca2-b4fe-255ad6f21e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:19.814187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-044b6c08-99d2-4ca2-b4fe-255ad6f21e76 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:19.815587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-044b6c08-99d2-4ca2-b4fe-255ad6f21e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:19.829644 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2670/5313] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:19.830033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14da95-e97e-4547-ac43-3f488dbb212c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:19.853200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14da95-e97e-4547-ac43-3f488dbb212c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:19.860621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748add7b-10fe-4b7b-8d0b-1658d3d96de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:19.861816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748add7b-10fe-4b7b-8d0b-1658d3d96de9 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:19.862326 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748add7b-10fe-4b7b-8d0b-1658d3d96de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:19.862786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748add7b-10fe-4b7b-8d0b-1658d3d96de9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:19.864374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748add7b-10fe-4b7b-8d0b-1658d3d96de9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:35:19.864857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748add7b-10fe-4b7b-8d0b-1658d3d96de9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:19.867408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748add7b-10fe-4b7b-8d0b-1658d3d96de9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:19.885096 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2644/5314] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:35:19.889172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b6c08-99d2-4ca2-b4fe-255ad6f21e76 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:19.905060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b6c08-99d2-4ca2-b4fe-255ad6f21e76 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:19.911091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6a333-3797-4d51-904a-d8f209674fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:19.911729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6a333-3797-4d51-904a-d8f209674fad admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:19.912026 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6a333-3797-4d51-904a-d8f209674fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:19.912303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6a333-3797-4d51-904a-d8f209674fad admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:19.913178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6a333-3797-4d51-904a-d8f209674fad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:19.916575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6a333-3797-4d51-904a-d8f209674fad admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:19.965255 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2671/5315] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:35:19 2022] POST /identity/v3/projects => generated 381 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:35:19.967110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748add7b-10fe-4b7b-8d0b-1658d3d96de9 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:19.980374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748add7b-10fe-4b7b-8d0b-1658d3d96de9 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:20.017214 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:20.069457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be86a3b-b024-470f-a13f-7c9be7bb88a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:20.071109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be86a3b-b024-470f-a13f-7c9be7bb88a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:20.071472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be86a3b-b024-470f-a13f-7c9be7bb88a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:20.071768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be86a3b-b024-470f-a13f-7c9be7bb88a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:20.073618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be86a3b-b024-470f-a13f-7c9be7bb88a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:20.075764 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be86a3b-b024-470f-a13f-7c9be7bb88a1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:20.142061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6a333-3797-4d51-904a-d8f209674fad admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:20.148089 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2645/5316] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:35:19 2022] POST /identity/v3/users => generated 291 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:35:20.155682 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6a333-3797-4d51-904a-d8f209674fad admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:20.160798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e5dbc-1e70-4c28-ae8f-811b61ea8510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:20.161720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e5dbc-1e70-4c28-ae8f-811b61ea8510 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:20.162092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e5dbc-1e70-4c28-ae8f-811b61ea8510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:20.162464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e5dbc-1e70-4c28-ae8f-811b61ea8510 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:20.163479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e5dbc-1e70-4c28-ae8f-811b61ea8510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:20.165676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e5dbc-1e70-4c28-ae8f-811b61ea8510 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:20.183775 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2672/5317] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:35:20.187355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be86a3b-b024-470f-a13f-7c9be7bb88a1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:20.215327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be86a3b-b024-470f-a13f-7c9be7bb88a1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:20.229675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfdc1b9-e859-47ac-bbbd-46a422ab23a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:20.230312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdc1b9-e859-47ac-bbbd-46a422ab23a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:20.230584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdc1b9-e859-47ac-bbbd-46a422ab23a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:20.230848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdc1b9-e859-47ac-bbbd-46a422ab23a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:20.231655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfdc1b9-e859-47ac-bbbd-46a422ab23a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:20.233340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfdc1b9-e859-47ac-bbbd-46a422ab23a2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:20.264578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e5dbc-1e70-4c28-ae8f-811b61ea8510 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:20.265178 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2646/5318] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:35:20 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:35:20.278408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e5dbc-1e70-4c28-ae8f-811b61ea8510 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:20.284139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2b1cd-6d63-4184-8cab-4ea4bb3662d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:20.285007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2b1cd-6d63-4184-8cab-4ea4bb3662d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:20.286433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2b1cd-6d63-4184-8cab-4ea4bb3662d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:20.287139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2b1cd-6d63-4184-8cab-4ea4bb3662d7 admin admin] PATH_INFO: `/v3/projects/610bac63014f490db55c2cdbb89bc46a/users/2dd25a3a76ca4b399ddaf730a1d96878/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:20.309020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2b1cd-6d63-4184-8cab-4ea4bb3662d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=610bac63014f490db55c2cdbb89bc46a, user_id=2dd25a3a76ca4b399ddaf730a1d96878, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:20.313512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2b1cd-6d63-4184-8cab-4ea4bb3662d7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:20.332822 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2673/5319] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:35:20 2022] PUT /identity/v3/projects/610bac63014f490db55c2cdbb89bc46a/users/2dd25a3a76ca4b399ddaf730a1d96878/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:35:20.338761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abb5a2-7e45-4d4e-a771-b8c0af1ff915 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:20.339163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abb5a2-7e45-4d4e-a771-b8c0af1ff915 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:20.339574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abb5a2-7e45-4d4e-a771-b8c0af1ff915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:20.365546 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d9abb5a2-7e45-4d4e-a771-b8c0af1ff915 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:20.366875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d9abb5a2-7e45-4d4e-a771-b8c0af1ff915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:20.476543 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2647/5320] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:20.515556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2b1cd-6d63-4184-8cab-4ea4bb3662d7 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:20.518188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f8a2b1cd-6d63-4184-8cab-4ea4bb3662d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:20.681811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2b1cd-6d63-4184-8cab-4ea4bb3662d7 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:20.691861 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed45fa-65a7-4247-8783-e4b95bc4ac1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:20.693224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed45fa-65a7-4247-8783-e4b95bc4ac1a service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:20.695994 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed45fa-65a7-4247-8783-e4b95bc4ac1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:20.696357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed45fa-65a7-4247-8783-e4b95bc4ac1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:20.724126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed45fa-65a7-4247-8783-e4b95bc4ac1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:20.728874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed45fa-65a7-4247-8783-e4b95bc4ac1a service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:20.760837 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2674/5321] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:35:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:35:28.234684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abb5a2-7e45-4d4e-a771-b8c0af1ff915 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:28.237556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d9abb5a2-7e45-4d4e-a771-b8c0af1ff915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:28.470022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abb5a2-7e45-4d4e-a771-b8c0af1ff915 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:28.490496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58aa71-22d7-4d9e-baaf-ec7eeb54553a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:28.492105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58aa71-22d7-4d9e-baaf-ec7eeb54553a service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:28.493394 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58aa71-22d7-4d9e-baaf-ec7eeb54553a service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:28.493981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58aa71-22d7-4d9e-baaf-ec7eeb54553a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:28.503444 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9f58aa71-22d7-4d9e-baaf-ec7eeb54553a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:28.641724 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:28.691859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f58aa71-22d7-4d9e-baaf-ec7eeb54553a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:28.693873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f58aa71-22d7-4d9e-baaf-ec7eeb54553a service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:28.713656 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2648/5322] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:35:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 736 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:35:30.748106 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=65,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:32.363562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed45fa-65a7-4247-8783-e4b95bc4ac1a service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:32.365221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-03ed45fa-65a7-4247-8783-e4b95bc4ac1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:32.404233 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed45fa-65a7-4247-8783-e4b95bc4ac1a service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:32.423208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6cfa4-2164-41bc-84af-4c313c134d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:32.425780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6cfa4-2164-41bc-84af-4c313c134d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:32.438514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6cfa4-2164-41bc-84af-4c313c134d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:32.438901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6cfa4-2164-41bc-84af-4c313c134d02 admin admin] PATH_INFO: `/v3/users/af7fe770adc741bb80e090080974b81b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:32.441566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6cfa4-2164-41bc-84af-4c313c134d02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af7fe770adc741bb80e090080974b81b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:32.444431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6cfa4-2164-41bc-84af-4c313c134d02 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:32.542154 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73f6cfa4-2164-41bc-84af-4c313c134d02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af7fe770adc741bb80e090080974b81b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:32.550371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73f6cfa4-2164-41bc-84af-4c313c134d02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af7fe770adc741bb80e090080974b81b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:32.593744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73f6cfa4-2164-41bc-84af-4c313c134d02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af7fe770adc741bb80e090080974b81b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:32.601698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73f6cfa4-2164-41bc-84af-4c313c134d02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af7fe770adc741bb80e090080974b81b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:32.621566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73f6cfa4-2164-41bc-84af-4c313c134d02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af7fe770adc741bb80e090080974b81b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:32.656770 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2675/5323] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:35:32 2022] DELETE /identity/v3/users/af7fe770adc741bb80e090080974b81b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:35:32.661068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce18d32-5444-45a6-a1d7-f1f927f52776 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:32.662044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce18d32-5444-45a6-a1d7-f1f927f52776 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:32.662506 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce18d32-5444-45a6-a1d7-f1f927f52776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:32.723198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-dce18d32-5444-45a6-a1d7-f1f927f52776 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:32.723676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-dce18d32-5444-45a6-a1d7-f1f927f52776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:32.944914 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2649/5324] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:32.992102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6cfa4-2164-41bc-84af-4c313c134d02 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:32.993722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-73f6cfa4-2164-41bc-84af-4c313c134d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:33.144698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6cfa4-2164-41bc-84af-4c313c134d02 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:33.151836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28360d3-b211-4411-ac47-f69047f4aa0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:33.157065 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28360d3-b211-4411-ac47-f69047f4aa0b service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:33.157434 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28360d3-b211-4411-ac47-f69047f4aa0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:33.161033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28360d3-b211-4411-ac47-f69047f4aa0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:33.203635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28360d3-b211-4411-ac47-f69047f4aa0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:33.206225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28360d3-b211-4411-ac47-f69047f4aa0b service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:33.262968 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2676/5325] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:35:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:35:33.893708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce18d32-5444-45a6-a1d7-f1f927f52776 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:33.895000 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-dce18d32-5444-45a6-a1d7-f1f927f52776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:33.918558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce18d32-5444-45a6-a1d7-f1f927f52776 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:33.933589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b34409-a25c-46c4-99a0-4423521a48a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:33.934254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b34409-a25c-46c4-99a0-4423521a48a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:33.934520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b34409-a25c-46c4-99a0-4423521a48a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:33.934794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b34409-a25c-46c4-99a0-4423521a48a8 admin admin] PATH_INFO: `/v3/projects/dacf93fa0779444883eb42b6e7cf80de` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:33.936319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b34409-a25c-46c4-99a0-4423521a48a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dacf93fa0779444883eb42b6e7cf80de)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:33.938434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b34409-a25c-46c4-99a0-4423521a48a8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:34.092562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-21b34409-a25c-46c4-99a0-4423521a48a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dacf93fa0779444883eb42b6e7cf80de', 'request_id': 'req-21b34409-a25c-46c4-99a0-4423521a48a8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:34.105976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-21b34409-a25c-46c4-99a0-4423521a48a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dacf93fa0779444883eb42b6e7cf80de', 'request_id': 'req-21b34409-a25c-46c4-99a0-4423521a48a8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:34.121499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-21b34409-a25c-46c4-99a0-4423521a48a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dacf93fa0779444883eb42b6e7cf80de', 'request_id': 'req-21b34409-a25c-46c4-99a0-4423521a48a8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:34.149054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-21b34409-a25c-46c4-99a0-4423521a48a8 admin admin] The token cache is being invalidate because project dacf93fa0779444883eb42b6e7cf80de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:35:34.149358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-21b34409-a25c-46c4-99a0-4423521a48a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:34.150099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-21b34409-a25c-46c4-99a0-4423521a48a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:34.152305 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2650/5326] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:35:33 2022] DELETE /identity/v3/projects/dacf93fa0779444883eb42b6e7cf80de => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:35:34.157180 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8ec2b-06a5-4fa6-b914-724dac20268d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:34.158237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8ec2b-06a5-4fa6-b914-724dac20268d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:34.158678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8ec2b-06a5-4fa6-b914-724dac20268d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:34.202698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-bea8ec2b-06a5-4fa6-b914-724dac20268d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:34.203994 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-bea8ec2b-06a5-4fa6-b914-724dac20268d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:34.384167 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2677/5327] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:34.479822 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0180fc-8f82-42db-ab27-094512d7ce9b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:34.480531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0180fc-8f82-42db-ab27-094512d7ce9b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:34.481028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0180fc-8f82-42db-ab27-094512d7ce9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:34.505070 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-5e0180fc-8f82-42db-ab27-094512d7ce9b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:34.506606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5e0180fc-8f82-42db-ab27-094512d7ce9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:34.519732 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2651/5328] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:34.520821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8ec2b-06a5-4fa6-b914-724dac20268d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:34.532951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8ec2b-06a5-4fa6-b914-724dac20268d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:34.544824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d0fc6-a98f-4527-859b-2ed7f1a01525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:34.545814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d0fc6-a98f-4527-859b-2ed7f1a01525 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:34.546260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d0fc6-a98f-4527-859b-2ed7f1a01525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:34.546685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d0fc6-a98f-4527-859b-2ed7f1a01525 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:34.547550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d0fc6-a98f-4527-859b-2ed7f1a01525 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:35:34.548140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d0fc6-a98f-4527-859b-2ed7f1a01525 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:34.552068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d0fc6-a98f-4527-859b-2ed7f1a01525 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:34.587918 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2678/5329] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:35:34.592911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0180fc-8f82-42db-ab27-094512d7ce9b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:34.607705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0180fc-8f82-42db-ab27-094512d7ce9b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:34.619218 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b042e-0737-4024-bb89-f54bea9b4089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:34.622781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b042e-0737-4024-bb89-f54bea9b4089 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:34.623422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b042e-0737-4024-bb89-f54bea9b4089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:34.644374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b042e-0737-4024-bb89-f54bea9b4089 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:34.645174 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b042e-0737-4024-bb89-f54bea9b4089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:34.654302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b042e-0737-4024-bb89-f54bea9b4089 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:34.711171 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2652/5330] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:35:34 2022] POST /identity/v3/projects => generated 391 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:35:34.716353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d0fc6-a98f-4527-859b-2ed7f1a01525 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:34.723750 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:34.732707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d0fc6-a98f-4527-859b-2ed7f1a01525 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:34.907243 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa7431-1a6e-436b-a25d-95a75f1b6d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:34.908224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa7431-1a6e-436b-a25d-95a75f1b6d8e admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:34.908665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa7431-1a6e-436b-a25d-95a75f1b6d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:34.909091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa7431-1a6e-436b-a25d-95a75f1b6d8e admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:34.909905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa7431-1a6e-436b-a25d-95a75f1b6d8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:34.914262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa7431-1a6e-436b-a25d-95a75f1b6d8e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:34.978277 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2679/5331] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:35:34 2022] POST /identity/v3/users => generated 296 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:35:34.979860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b042e-0737-4024-bb89-f54bea9b4089 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:34.991433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b042e-0737-4024-bb89-f54bea9b4089 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:35.014228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4038b7-c12d-4c80-ade1-5258dfe737d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:35.015219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4038b7-c12d-4c80-ade1-5258dfe737d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:35.016050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4038b7-c12d-4c80-ade1-5258dfe737d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:35.016612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4038b7-c12d-4c80-ade1-5258dfe737d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:35.017468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4038b7-c12d-4c80-ade1-5258dfe737d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:35.025460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4038b7-c12d-4c80-ade1-5258dfe737d9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:35.051933 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2653/5332] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:35:35.058259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa7431-1a6e-436b-a25d-95a75f1b6d8e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:35.074394 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa7431-1a6e-436b-a25d-95a75f1b6d8e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:35.092256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6f3da-ce3a-4be6-9835-b7a60bfa0220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:35.093388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6f3da-ce3a-4be6-9835-b7a60bfa0220 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:35.095938 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6f3da-ce3a-4be6-9835-b7a60bfa0220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:35.096348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6f3da-ce3a-4be6-9835-b7a60bfa0220 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:35.097163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6f3da-ce3a-4be6-9835-b7a60bfa0220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:35.098922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6f3da-ce3a-4be6-9835-b7a60bfa0220 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:35.135944 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2680/5333] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:35:35.136460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4038b7-c12d-4c80-ade1-5258dfe737d9 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:35.152290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4038b7-c12d-4c80-ade1-5258dfe737d9 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:35.166869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73423c-9045-49c8-9d17-552a719a4ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:35.167741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73423c-9045-49c8-9d17-552a719a4ab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:35.168404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73423c-9045-49c8-9d17-552a719a4ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:35.168683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73423c-9045-49c8-9d17-552a719a4ab0 admin admin] PATH_INFO: `/v3/projects/47d9e108c24b4afe960bfc3c9bd61b85/users/4826e4103815474cbee3cd380f7eacf9/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:35.222847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73423c-9045-49c8-9d17-552a719a4ab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47d9e108c24b4afe960bfc3c9bd61b85, user_id=4826e4103815474cbee3cd380f7eacf9, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:35.226788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73423c-9045-49c8-9d17-552a719a4ab0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:35.270706 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2654/5334] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:35:35 2022] PUT /identity/v3/projects/47d9e108c24b4afe960bfc3c9bd61b85/users/4826e4103815474cbee3cd380f7eacf9/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:35:35.272586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047c77f-e133-40bd-8503-2ce2e3ce6268 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:35.273054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047c77f-e133-40bd-8503-2ce2e3ce6268 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:35.273140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047c77f-e133-40bd-8503-2ce2e3ce6268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:35.337692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f047c77f-e133-40bd-8503-2ce2e3ce6268 None None] MFA Rules not processed for user `4826e4103815474cbee3cd380f7eacf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:35.338997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f047c77f-e133-40bd-8503-2ce2e3ce6268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:35.501878 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2681/5335] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:35 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:35.714922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73423c-9045-49c8-9d17-552a719a4ab0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:35.716924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6f73423c-9045-49c8-9d17-552a719a4ab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:35.722544 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:35.870279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73423c-9045-49c8-9d17-552a719a4ab0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:35.883525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e206ae-21de-489a-ac5b-8f02ec6a8692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:35.884198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e206ae-21de-489a-ac5b-8f02ec6a8692 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:35.884478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e206ae-21de-489a-ac5b-8f02ec6a8692 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:35.884745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e206ae-21de-489a-ac5b-8f02ec6a8692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:35.904522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e206ae-21de-489a-ac5b-8f02ec6a8692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:35.906246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e206ae-21de-489a-ac5b-8f02ec6a8692 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:35.931267 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2655/5336] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:35:35 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:35:36.163060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047c77f-e133-40bd-8503-2ce2e3ce6268 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:36.167674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f047c77f-e133-40bd-8503-2ce2e3ce6268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:36.198783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047c77f-e133-40bd-8503-2ce2e3ce6268 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:36.224977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a283311-f4a9-4e2c-ae4a-05e5c58d0e71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:36.226387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a283311-f4a9-4e2c-ae4a-05e5c58d0e71 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:36.226695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a283311-f4a9-4e2c-ae4a-05e5c58d0e71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:36.227032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a283311-f4a9-4e2c-ae4a-05e5c58d0e71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:36.234196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3a283311-f4a9-4e2c-ae4a-05e5c58d0e71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:36.502762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a283311-f4a9-4e2c-ae4a-05e5c58d0e71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:36.509093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a283311-f4a9-4e2c-ae4a-05e5c58d0e71 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:36.550194 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2682/5337] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:35:36 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:35:40.177011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e206ae-21de-489a-ac5b-8f02ec6a8692 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:40.206413 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e206ae-21de-489a-ac5b-8f02ec6a8692 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:40.223599 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff272fa-7c66-40de-bb89-37fa77e25c3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:40.224566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff272fa-7c66-40de-bb89-37fa77e25c3d service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:40.225069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff272fa-7c66-40de-bb89-37fa77e25c3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:40.226106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff272fa-7c66-40de-bb89-37fa77e25c3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:40.228305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bff272fa-7c66-40de-bb89-37fa77e25c3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:40.240626 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff272fa-7c66-40de-bb89-37fa77e25c3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:40.243228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff272fa-7c66-40de-bb89-37fa77e25c3d service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:40.255763 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2656/5338] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:35:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:35:43.746218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09aed5f-f5cb-4736-9bea-2198a541f146 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:43.747115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09aed5f-f5cb-4736-9bea-2198a541f146 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:43.747550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09aed5f-f5cb-4736-9bea-2198a541f146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:43.762349 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:43.814099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f09aed5f-f5cb-4736-9bea-2198a541f146 None None] MFA Rules not processed for user `2dd25a3a76ca4b399ddaf730a1d96878`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:43.815477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f09aed5f-f5cb-4736-9bea-2198a541f146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:44.018998 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2683/5339] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:44.030505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88b427-e13e-4c20-bfcc-d488e539fab8 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:44.031417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88b427-e13e-4c20-bfcc-d488e539fab8 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:44.031852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d88b427-e13e-4c20-bfcc-d488e539fab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:44.059351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-4d88b427-e13e-4c20-bfcc-d488e539fab8 None None] MFA Rules not processed for user `2dd25a3a76ca4b399ddaf730a1d96878`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:44.060955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4d88b427-e13e-4c20-bfcc-d488e539fab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:44.078964 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2657/5340] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:44.091467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09aed5f-f5cb-4736-9bea-2198a541f146 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:44.093583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f09aed5f-f5cb-4736-9bea-2198a541f146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:44.289477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09aed5f-f5cb-4736-9bea-2198a541f146 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:44.296705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e4fc1-1150-42cf-a82c-e871177f4db3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:44.297336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e4fc1-1150-42cf-a82c-e871177f4db3 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:44.297611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e4fc1-1150-42cf-a82c-e871177f4db3 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:44.297880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e4fc1-1150-42cf-a82c-e871177f4db3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:44.324612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e4fc1-1150-42cf-a82c-e871177f4db3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:44.326313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e4fc1-1150-42cf-a82c-e871177f4db3 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:44.338878 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2684/5341] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:35:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:35:44.374354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88b427-e13e-4c20-bfcc-d488e539fab8 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:44.387544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d88b427-e13e-4c20-bfcc-d488e539fab8 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:44.393531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e920c-0698-43cc-bd02-70610a02c80c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:44.394736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e920c-0698-43cc-bd02-70610a02c80c service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:44.395269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e920c-0698-43cc-bd02-70610a02c80c service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:44.395703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e920c-0698-43cc-bd02-70610a02c80c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:44.413849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cf8e920c-0698-43cc-bd02-70610a02c80c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:44.520550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e920c-0698-43cc-bd02-70610a02c80c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:44.522595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e920c-0698-43cc-bd02-70610a02c80c service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:44.543164 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2658/5342] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:35:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:35:47.273428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e4fc1-1150-42cf-a82c-e871177f4db3 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:47.275791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b75e4fc1-1150-42cf-a82c-e871177f4db3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:47.504420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e4fc1-1150-42cf-a82c-e871177f4db3 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:47.516995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e59949a-9abc-4340-af1f-0057679f852e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:47.518874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59949a-9abc-4340-af1f-0057679f852e service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:47.519170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59949a-9abc-4340-af1f-0057679f852e service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:47.519500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e59949a-9abc-4340-af1f-0057679f852e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:47.525144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0e59949a-9abc-4340-af1f-0057679f852e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:47.566013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e59949a-9abc-4340-af1f-0057679f852e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:47.569757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e59949a-9abc-4340-af1f-0057679f852e service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:47.589194 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:47.615599 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2685/5343] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:35:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:35:47.683080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e920c-0698-43cc-bd02-70610a02c80c service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:47.685607 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cf8e920c-0698-43cc-bd02-70610a02c80c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:47.872614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e920c-0698-43cc-bd02-70610a02c80c service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:47.888561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fadab7-8654-4326-ad1c-42442efe64b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:47.889223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fadab7-8654-4326-ad1c-42442efe64b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:47.889512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fadab7-8654-4326-ad1c-42442efe64b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:47.889755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fadab7-8654-4326-ad1c-42442efe64b9 admin admin] PATH_INFO: `/v3/users/0344a81c981b434689ac476b815b8f02` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:47.899464 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fadab7-8654-4326-ad1c-42442efe64b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0344a81c981b434689ac476b815b8f02)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:47.908036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fadab7-8654-4326-ad1c-42442efe64b9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:47.993205 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:48.060328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d8fadab7-8654-4326-ad1c-42442efe64b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0344a81c981b434689ac476b815b8f02'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:48.083765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d8fadab7-8654-4326-ad1c-42442efe64b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0344a81c981b434689ac476b815b8f02'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:48.144344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d8fadab7-8654-4326-ad1c-42442efe64b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0344a81c981b434689ac476b815b8f02'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:48.147304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d8fadab7-8654-4326-ad1c-42442efe64b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0344a81c981b434689ac476b815b8f02'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:48.166293 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d8fadab7-8654-4326-ad1c-42442efe64b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0344a81c981b434689ac476b815b8f02'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:48.183266 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2659/5344] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:35:47 2022] DELETE /identity/v3/users/0344a81c981b434689ac476b815b8f02 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:35:49.226671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e59949a-9abc-4340-af1f-0057679f852e service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:49.262077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e59949a-9abc-4340-af1f-0057679f852e service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:49.406562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0fbc2-599c-4ecc-a76a-0f3270860815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:49.407221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0fbc2-599c-4ecc-a76a-0f3270860815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:49.407499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0fbc2-599c-4ecc-a76a-0f3270860815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:49.407787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0fbc2-599c-4ecc-a76a-0f3270860815 admin admin] PATH_INFO: `/v3/projects/5bc9ff987bb541d6a11324aaca07182d` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:49.409167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0fbc2-599c-4ecc-a76a-0f3270860815 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bc9ff987bb541d6a11324aaca07182d)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:49.411032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0fbc2-599c-4ecc-a76a-0f3270860815 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:49.518425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-abb0fbc2-599c-4ecc-a76a-0f3270860815 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bc9ff987bb541d6a11324aaca07182d', 'request_id': 'req-abb0fbc2-599c-4ecc-a76a-0f3270860815'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:49.533977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-abb0fbc2-599c-4ecc-a76a-0f3270860815 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bc9ff987bb541d6a11324aaca07182d', 'request_id': 'req-abb0fbc2-599c-4ecc-a76a-0f3270860815'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:49.544983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-abb0fbc2-599c-4ecc-a76a-0f3270860815 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bc9ff987bb541d6a11324aaca07182d', 'request_id': 'req-abb0fbc2-599c-4ecc-a76a-0f3270860815'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:49.572789 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-abb0fbc2-599c-4ecc-a76a-0f3270860815 admin admin] The token cache is being invalidate because project 5bc9ff987bb541d6a11324aaca07182d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:35:49.573079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-abb0fbc2-599c-4ecc-a76a-0f3270860815 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:49.574613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-abb0fbc2-599c-4ecc-a76a-0f3270860815 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:49.581403 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2686/5345] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:35:49 2022] DELETE /identity/v3/projects/5bc9ff987bb541d6a11324aaca07182d => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:35:49.583198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b940a8-0bc8-4138-b192-a12b52b24b86 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:49.583673 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b940a8-0bc8-4138-b192-a12b52b24b86 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:49.583800 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b940a8-0bc8-4138-b192-a12b52b24b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:49.614881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-20b940a8-0bc8-4138-b192-a12b52b24b86 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:49.616610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-20b940a8-0bc8-4138-b192-a12b52b24b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:49.783765 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2660/5346] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:49.785128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171ddcf-983f-45aa-9a98-d019fd8600ba None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:49.785606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171ddcf-983f-45aa-9a98-d019fd8600ba None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:49.786023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171ddcf-983f-45aa-9a98-d019fd8600ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:49.840361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9171ddcf-983f-45aa-9a98-d019fd8600ba None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:49.843295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9171ddcf-983f-45aa-9a98-d019fd8600ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:49.866582 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2687/5347] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:49.868730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b940a8-0bc8-4138-b192-a12b52b24b86 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:49.882872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b940a8-0bc8-4138-b192-a12b52b24b86 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:49.894710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61daf44-bd25-4942-8d6a-4a57ef351b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:49.898682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61daf44-bd25-4942-8d6a-4a57ef351b66 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:49.900541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61daf44-bd25-4942-8d6a-4a57ef351b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:49.901110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61daf44-bd25-4942-8d6a-4a57ef351b66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:49.903544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61daf44-bd25-4942-8d6a-4a57ef351b66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:35:49.904014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61daf44-bd25-4942-8d6a-4a57ef351b66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:49.905981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61daf44-bd25-4942-8d6a-4a57ef351b66 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:49.947011 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2661/5348] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:35:49.948489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171ddcf-983f-45aa-9a98-d019fd8600ba None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:49.979398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171ddcf-983f-45aa-9a98-d019fd8600ba None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:49.979398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec3e80-2b66-417c-82e5-6bdbaf5f479c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:49.979398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec3e80-2b66-417c-82e5-6bdbaf5f479c admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:49.979398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec3e80-2b66-417c-82e5-6bdbaf5f479c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:49.979914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec3e80-2b66-417c-82e5-6bdbaf5f479c admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:49.981105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec3e80-2b66-417c-82e5-6bdbaf5f479c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:49.984154 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec3e80-2b66-417c-82e5-6bdbaf5f479c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:50.034244 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2688/5349] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:35:49 2022] POST /identity/v3/projects => generated 393 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:35:50.038944 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61daf44-bd25-4942-8d6a-4a57ef351b66 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:50.052881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61daf44-bd25-4942-8d6a-4a57ef351b66 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:50.188217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4343ba8-c58b-48d1-be44-1a3b808c1c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:50.188977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4343ba8-c58b-48d1-be44-1a3b808c1c65 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:50.189866 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4343ba8-c58b-48d1-be44-1a3b808c1c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:50.190155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4343ba8-c58b-48d1-be44-1a3b808c1c65 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:50.199317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4343ba8-c58b-48d1-be44-1a3b808c1c65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:50.201799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4343ba8-c58b-48d1-be44-1a3b808c1c65 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:50.245565 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2662/5350] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:35:50 2022] POST /identity/v3/users => generated 297 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:35:50.249803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec3e80-2b66-417c-82e5-6bdbaf5f479c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:50.267408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec3e80-2b66-417c-82e5-6bdbaf5f479c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:50.284740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495dc1c5-0452-48d7-86cc-ead25074baac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:50.288819 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495dc1c5-0452-48d7-86cc-ead25074baac admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:50.289045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495dc1c5-0452-48d7-86cc-ead25074baac admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:50.289237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495dc1c5-0452-48d7-86cc-ead25074baac admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:50.290524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495dc1c5-0452-48d7-86cc-ead25074baac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:50.295505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495dc1c5-0452-48d7-86cc-ead25074baac admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:50.319367 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2689/5351] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:35:50.323920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4343ba8-c58b-48d1-be44-1a3b808c1c65 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:50.352364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4343ba8-c58b-48d1-be44-1a3b808c1c65 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:50.359210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4082b-78fb-4039-ab81-e6b4d2830c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:50.359842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4082b-78fb-4039-ab81-e6b4d2830c48 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:50.360184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4082b-78fb-4039-ab81-e6b4d2830c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:50.360406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4082b-78fb-4039-ab81-e6b4d2830c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:50.361068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4082b-78fb-4039-ab81-e6b4d2830c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:50.362679 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4082b-78fb-4039-ab81-e6b4d2830c48 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:50.402760 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2663/5352] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:35:50 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:35:50.406459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495dc1c5-0452-48d7-86cc-ead25074baac admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:50.427274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495dc1c5-0452-48d7-86cc-ead25074baac admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:50.434041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c8002-1cdf-4217-9818-ad621717c4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:50.434724 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c8002-1cdf-4217-9818-ad621717c4f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:50.435055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c8002-1cdf-4217-9818-ad621717c4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:50.435328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c8002-1cdf-4217-9818-ad621717c4f9 admin admin] PATH_INFO: `/v3/projects/70f17360f0c84562bd99b006b659736e/users/2f5acf7da18b43f89e24760744cfdb49/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:50.476241 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c8002-1cdf-4217-9818-ad621717c4f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f17360f0c84562bd99b006b659736e, user_id=2f5acf7da18b43f89e24760744cfdb49, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:50.479494 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c8002-1cdf-4217-9818-ad621717c4f9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:50.527955 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2690/5353] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:35:50 2022] PUT /identity/v3/projects/70f17360f0c84562bd99b006b659736e/users/2f5acf7da18b43f89e24760744cfdb49/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:35:50.530827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd39ee7-d8d8-4b20-8463-888126885b94 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:50.531112 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd39ee7-d8d8-4b20-8463-888126885b94 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:50.531383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd39ee7-d8d8-4b20-8463-888126885b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:50.583497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0bd39ee7-d8d8-4b20-8463-888126885b94 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:50.584812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0bd39ee7-d8d8-4b20-8463-888126885b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:50.603397 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:50.737210 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2664/5354] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:50.752207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c8002-1cdf-4217-9818-ad621717c4f9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:50.755122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-565c8002-1cdf-4217-9818-ad621717c4f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:50.830744 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:50.908819 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c8002-1cdf-4217-9818-ad621717c4f9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:50.920494 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fa826-3a46-41c6-a4a2-12fbbe7ae092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:50.921519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fa826-3a46-41c6-a4a2-12fbbe7ae092 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:50.922029 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fa826-3a46-41c6-a4a2-12fbbe7ae092 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:50.922643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fa826-3a46-41c6-a4a2-12fbbe7ae092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:50.945172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fa826-3a46-41c6-a4a2-12fbbe7ae092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:50.947088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fa826-3a46-41c6-a4a2-12fbbe7ae092 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:50.975265 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2691/5355] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:35:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:35:54.135549 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd39ee7-d8d8-4b20-8463-888126885b94 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:54.137515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0bd39ee7-d8d8-4b20-8463-888126885b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:54.175611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd39ee7-d8d8-4b20-8463-888126885b94 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:54.185915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e3240-d185-48c8-9806-d55a0966674e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:54.186580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e3240-d185-48c8-9806-d55a0966674e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:54.186856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e3240-d185-48c8-9806-d55a0966674e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:54.187501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e3240-d185-48c8-9806-d55a0966674e admin admin] PATH_INFO: `/v3/users/6b33e07001cb4a2db36fec14bded07f5` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:54.194567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e3240-d185-48c8-9806-d55a0966674e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b33e07001cb4a2db36fec14bded07f5)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:54.197475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e3240-d185-48c8-9806-d55a0966674e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:54.351594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9e1e3240-d185-48c8-9806-d55a0966674e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b33e07001cb4a2db36fec14bded07f5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:54.373371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9e1e3240-d185-48c8-9806-d55a0966674e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b33e07001cb4a2db36fec14bded07f5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:54.397325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9e1e3240-d185-48c8-9806-d55a0966674e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b33e07001cb4a2db36fec14bded07f5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:54.402078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9e1e3240-d185-48c8-9806-d55a0966674e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b33e07001cb4a2db36fec14bded07f5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:54.415688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9e1e3240-d185-48c8-9806-d55a0966674e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b33e07001cb4a2db36fec14bded07f5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:54.432580 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2665/5356] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:35:54 2022] DELETE /identity/v3/users/6b33e07001cb4a2db36fec14bded07f5 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:35:55.949057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fa826-3a46-41c6-a4a2-12fbbe7ae092 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:55.950599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8a4fa826-3a46-41c6-a4a2-12fbbe7ae092 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:55.971141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fa826-3a46-41c6-a4a2-12fbbe7ae092 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:56.136021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c19e5-6fc9-4f7e-b236-6135ec0916cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:56.136965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c19e5-6fc9-4f7e-b236-6135ec0916cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:56.137407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c19e5-6fc9-4f7e-b236-6135ec0916cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:56.137837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c19e5-6fc9-4f7e-b236-6135ec0916cd admin admin] PATH_INFO: `/v3/users/4826e4103815474cbee3cd380f7eacf9` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:56.141146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c19e5-6fc9-4f7e-b236-6135ec0916cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4826e4103815474cbee3cd380f7eacf9)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:56.143961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c19e5-6fc9-4f7e-b236-6135ec0916cd admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:56.209907 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-631c19e5-6fc9-4f7e-b236-6135ec0916cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4826e4103815474cbee3cd380f7eacf9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:56.219011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-631c19e5-6fc9-4f7e-b236-6135ec0916cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4826e4103815474cbee3cd380f7eacf9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:56.234621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-631c19e5-6fc9-4f7e-b236-6135ec0916cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4826e4103815474cbee3cd380f7eacf9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:56.235941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-631c19e5-6fc9-4f7e-b236-6135ec0916cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4826e4103815474cbee3cd380f7eacf9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:56.247457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-631c19e5-6fc9-4f7e-b236-6135ec0916cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4826e4103815474cbee3cd380f7eacf9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:56.257748 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2692/5357] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:35:55 2022] DELETE /identity/v3/users/4826e4103815474cbee3cd380f7eacf9 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:35:56.266735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2714b8-b820-4e89-ba08-0027e09ee206 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:56.266735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2714b8-b820-4e89-ba08-0027e09ee206 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:56.267261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2714b8-b820-4e89-ba08-0027e09ee206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:56.314545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0a2714b8-b820-4e89-ba08-0027e09ee206 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:56.318200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0a2714b8-b820-4e89-ba08-0027e09ee206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:56.507404 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2666/5358] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:56.523407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c19e5-6fc9-4f7e-b236-6135ec0916cd admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:56.525011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-631c19e5-6fc9-4f7e-b236-6135ec0916cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:56.678005 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:56.691967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c19e5-6fc9-4f7e-b236-6135ec0916cd admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:56.702980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44acf49a-0d3e-40c9-b8ed-0cbed554c06f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:56.703735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acf49a-0d3e-40c9-b8ed-0cbed554c06f service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:56.704121 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acf49a-0d3e-40c9-b8ed-0cbed554c06f service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:56.704380 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acf49a-0d3e-40c9-b8ed-0cbed554c06f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:56.733785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44acf49a-0d3e-40c9-b8ed-0cbed554c06f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:56.738062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44acf49a-0d3e-40c9-b8ed-0cbed554c06f service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:56.759819 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2693/5359] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:35:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:35:56.816486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2714b8-b820-4e89-ba08-0027e09ee206 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:56.818099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0a2714b8-b820-4e89-ba08-0027e09ee206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:56.840069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2714b8-b820-4e89-ba08-0027e09ee206 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:56.852643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b27d4-3273-43bc-863a-08f675b36a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:56.853301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b27d4-3273-43bc-863a-08f675b36a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:56.853575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b27d4-3273-43bc-863a-08f675b36a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:56.853844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b27d4-3273-43bc-863a-08f675b36a55 admin admin] PATH_INFO: `/v3/projects/64c8da97f8334f7da1cd25716cc7da0d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:56.857109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b27d4-3273-43bc-863a-08f675b36a55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64c8da97f8334f7da1cd25716cc7da0d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:56.859204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b27d4-3273-43bc-863a-08f675b36a55 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:56.912850 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:56.982327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ab9b27d4-3273-43bc-863a-08f675b36a55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64c8da97f8334f7da1cd25716cc7da0d', 'request_id': 'req-ab9b27d4-3273-43bc-863a-08f675b36a55'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:57.018934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ab9b27d4-3273-43bc-863a-08f675b36a55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64c8da97f8334f7da1cd25716cc7da0d', 'request_id': 'req-ab9b27d4-3273-43bc-863a-08f675b36a55'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:57.047328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ab9b27d4-3273-43bc-863a-08f675b36a55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64c8da97f8334f7da1cd25716cc7da0d', 'request_id': 'req-ab9b27d4-3273-43bc-863a-08f675b36a55'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:57.074391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ab9b27d4-3273-43bc-863a-08f675b36a55 admin admin] The token cache is being invalidate because project 64c8da97f8334f7da1cd25716cc7da0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:35:57.074689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ab9b27d4-3273-43bc-863a-08f675b36a55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:57.077572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ab9b27d4-3273-43bc-863a-08f675b36a55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:57.085506 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2667/5360] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:35:56 2022] DELETE /identity/v3/projects/64c8da97f8334f7da1cd25716cc7da0d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:35:57.087106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962eabc-56e0-40eb-80b1-b49dacb0b37c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:57.087562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962eabc-56e0-40eb-80b1-b49dacb0b37c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:57.087661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962eabc-56e0-40eb-80b1-b49dacb0b37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:57.148947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3962eabc-56e0-40eb-80b1-b49dacb0b37c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:57.150164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3962eabc-56e0-40eb-80b1-b49dacb0b37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:57.325859 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2694/5361] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:57.329942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f0e75-9cef-4159-85d1-c02e76405f4a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:57.331083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f0e75-9cef-4159-85d1-c02e76405f4a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:57.332319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f0e75-9cef-4159-85d1-c02e76405f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:57.385137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e24f0e75-9cef-4159-85d1-c02e76405f4a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:57.389114 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e24f0e75-9cef-4159-85d1-c02e76405f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:57.413869 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2668/5362] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:57.415112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962eabc-56e0-40eb-80b1-b49dacb0b37c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:57.429796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962eabc-56e0-40eb-80b1-b49dacb0b37c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:57.481752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc761934-2f6a-4a65-8a4e-8b61e15bb0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:57.482422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc761934-2f6a-4a65-8a4e-8b61e15bb0ab admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:57.482726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc761934-2f6a-4a65-8a4e-8b61e15bb0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:57.483501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc761934-2f6a-4a65-8a4e-8b61e15bb0ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:57.497578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc761934-2f6a-4a65-8a4e-8b61e15bb0ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:35:57.497928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc761934-2f6a-4a65-8a4e-8b61e15bb0ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:57.499735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc761934-2f6a-4a65-8a4e-8b61e15bb0ab admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:57.537438 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2695/5363] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:35:57.538604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f0e75-9cef-4159-85d1-c02e76405f4a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:57.555755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f0e75-9cef-4159-85d1-c02e76405f4a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:57.567275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f35d4b-320d-428d-9391-cf0d69e1fafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:57.567822 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f35d4b-320d-428d-9391-cf0d69e1fafa admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:57.568709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f35d4b-320d-428d-9391-cf0d69e1fafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:57.568984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f35d4b-320d-428d-9391-cf0d69e1fafa admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:57.569636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f35d4b-320d-428d-9391-cf0d69e1fafa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:57.575635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f35d4b-320d-428d-9391-cf0d69e1fafa admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:57.642881 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2669/5364] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:35:57 2022] POST /identity/v3/projects => generated 369 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:35:57.644102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc761934-2f6a-4a65-8a4e-8b61e15bb0ab admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:57.658739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc761934-2f6a-4a65-8a4e-8b61e15bb0ab admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:57.813522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b9952-ce3c-4671-9448-a5137ae2beed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:57.814334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b9952-ce3c-4671-9448-a5137ae2beed admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:57.814577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b9952-ce3c-4671-9448-a5137ae2beed admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:57.814846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b9952-ce3c-4671-9448-a5137ae2beed admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:57.818320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b9952-ce3c-4671-9448-a5137ae2beed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:57.821822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b9952-ce3c-4671-9448-a5137ae2beed admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:57.913148 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2696/5365] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:35:57 2022] POST /identity/v3/users => generated 285 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:35:57.915961 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f35d4b-320d-428d-9391-cf0d69e1fafa admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:57.935164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f35d4b-320d-428d-9391-cf0d69e1fafa admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:57.958235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4529f85-4592-4cd9-afd1-2a2739ab983f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:57.960246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4529f85-4592-4cd9-afd1-2a2739ab983f admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:57.960523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4529f85-4592-4cd9-afd1-2a2739ab983f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:57.960792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4529f85-4592-4cd9-afd1-2a2739ab983f admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:57.963348 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4529f85-4592-4cd9-afd1-2a2739ab983f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:57.972584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4529f85-4592-4cd9-afd1-2a2739ab983f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:58.056440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b9952-ce3c-4671-9448-a5137ae2beed admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:58.069760 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2670/5366] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:35:58.079777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b9952-ce3c-4671-9448-a5137ae2beed admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:58.098916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c34e33-1c1d-4e6d-ae89-0205fa68f513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:58.100655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c34e33-1c1d-4e6d-ae89-0205fa68f513 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:58.100931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c34e33-1c1d-4e6d-ae89-0205fa68f513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:58.101198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c34e33-1c1d-4e6d-ae89-0205fa68f513 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:58.105816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c34e33-1c1d-4e6d-ae89-0205fa68f513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:58.107475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c34e33-1c1d-4e6d-ae89-0205fa68f513 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:58.148917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4529f85-4592-4cd9-afd1-2a2739ab983f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:58.149354 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2697/5367] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:35:58.165637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4529f85-4592-4cd9-afd1-2a2739ab983f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:58.173181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a326101-641d-456c-b2dd-784b8bce0968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:58.174300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a326101-641d-456c-b2dd-784b8bce0968 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:58.174584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a326101-641d-456c-b2dd-784b8bce0968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:58.176889 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a326101-641d-456c-b2dd-784b8bce0968 admin admin] PATH_INFO: `/v3/projects/f3e3bf9d373e43bea6c02b31d2e2e2ed/users/1e08144123ad4d3e93e6b6fbe2acf03a/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:58.251265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a326101-641d-456c-b2dd-784b8bce0968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3e3bf9d373e43bea6c02b31d2e2e2ed, user_id=1e08144123ad4d3e93e6b6fbe2acf03a, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:58.254358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a326101-641d-456c-b2dd-784b8bce0968 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:58.293635 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2671/5368] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:35:58 2022] PUT /identity/v3/projects/f3e3bf9d373e43bea6c02b31d2e2e2ed/users/1e08144123ad4d3e93e6b6fbe2acf03a/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:35:58.303926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f1113-6d21-4db8-8b96-38feec7ed3ba None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:58.304463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f1113-6d21-4db8-8b96-38feec7ed3ba None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:58.304917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f1113-6d21-4db8-8b96-38feec7ed3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:58.413613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6f7f1113-6d21-4db8-8b96-38feec7ed3ba None None] MFA Rules not processed for user `1e08144123ad4d3e93e6b6fbe2acf03a`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:58.418271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6f7f1113-6d21-4db8-8b96-38feec7ed3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:58.510395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a326101-641d-456c-b2dd-784b8bce0968 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:58.512957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1a326101-641d-456c-b2dd-784b8bce0968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:58.582030 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:58.633031 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2698/5369] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:58.708827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960d679-dbdf-43d0-beec-5aa1451f4631 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:58.708827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960d679-dbdf-43d0-beec-5aa1451f4631 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:58.708827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960d679-dbdf-43d0-beec-5aa1451f4631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:58.819970 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-8960d679-dbdf-43d0-beec-5aa1451f4631 None None] MFA Rules not processed for user `1e08144123ad4d3e93e6b6fbe2acf03a`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:58.826740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8960d679-dbdf-43d0-beec-5aa1451f4631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:58.853875 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2699/5370] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:58.856840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960d679-dbdf-43d0-beec-5aa1451f4631 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:58.859543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8960d679-dbdf-43d0-beec-5aa1451f4631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:58.872524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a326101-641d-456c-b2dd-784b8bce0968 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:58.918455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d774c71-dd23-4cca-989d-97fb66021eeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:58.921279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d774c71-dd23-4cca-989d-97fb66021eeb service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:58.923420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d774c71-dd23-4cca-989d-97fb66021eeb service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:58.928130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d774c71-dd23-4cca-989d-97fb66021eeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:58.939740 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5d774c71-dd23-4cca-989d-97fb66021eeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:59.003660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d774c71-dd23-4cca-989d-97fb66021eeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:59.005948 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d774c71-dd23-4cca-989d-97fb66021eeb service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:59.050278 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2672/5371] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:35:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:35:59.051486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d774c71-dd23-4cca-989d-97fb66021eeb service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:59.057181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5d774c71-dd23-4cca-989d-97fb66021eeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:59.125744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960d679-dbdf-43d0-beec-5aa1451f4631 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:59.131699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d774c71-dd23-4cca-989d-97fb66021eeb service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:59.145727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85d53b-c8e8-4ce4-9f56-594215ee6569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:59.146802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85d53b-c8e8-4ce4-9f56-594215ee6569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:59.147242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85d53b-c8e8-4ce4-9f56-594215ee6569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:59.148063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85d53b-c8e8-4ce4-9f56-594215ee6569 admin admin] PATH_INFO: `/v3/projects/47d9e108c24b4afe960bfc3c9bd61b85` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:59.149474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85d53b-c8e8-4ce4-9f56-594215ee6569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47d9e108c24b4afe960bfc3c9bd61b85)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:59.153072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb650d4-6b5e-4abc-94b5-829d34ac7591 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:59.153459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff85d53b-c8e8-4ce4-9f56-594215ee6569 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:59.155201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb650d4-6b5e-4abc-94b5-829d34ac7591 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:59.156225 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb650d4-6b5e-4abc-94b5-829d34ac7591 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:59.157734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb650d4-6b5e-4abc-94b5-829d34ac7591 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:59.189806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb650d4-6b5e-4abc-94b5-829d34ac7591 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:59.191675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb650d4-6b5e-4abc-94b5-829d34ac7591 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:59.215405 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2673/5372] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:35:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:35:59.291680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ff85d53b-c8e8-4ce4-9f56-594215ee6569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47d9e108c24b4afe960bfc3c9bd61b85', 'request_id': 'req-ff85d53b-c8e8-4ce4-9f56-594215ee6569'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:59.317623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ff85d53b-c8e8-4ce4-9f56-594215ee6569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47d9e108c24b4afe960bfc3c9bd61b85', 'request_id': 'req-ff85d53b-c8e8-4ce4-9f56-594215ee6569'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:59.332171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ff85d53b-c8e8-4ce4-9f56-594215ee6569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47d9e108c24b4afe960bfc3c9bd61b85', 'request_id': 'req-ff85d53b-c8e8-4ce4-9f56-594215ee6569'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:59.383619 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ff85d53b-c8e8-4ce4-9f56-594215ee6569 admin admin] The token cache is being invalidate because project 47d9e108c24b4afe960bfc3c9bd61b85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:35:59.386037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ff85d53b-c8e8-4ce4-9f56-594215ee6569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:59.390100 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ff85d53b-c8e8-4ce4-9f56-594215ee6569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:35:59.397771 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2700/5373] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:35:58 2022] DELETE /identity/v3/projects/47d9e108c24b4afe960bfc3c9bd61b85 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:35:59.403241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594cc75-d2ae-4293-b051-c776b5f102b5 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:59.403526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594cc75-d2ae-4293-b051-c776b5f102b5 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:59.403836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594cc75-d2ae-4293-b051-c776b5f102b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:59.429283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b594cc75-d2ae-4293-b051-c776b5f102b5 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:59.430807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b594cc75-d2ae-4293-b051-c776b5f102b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:59.453287 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:35:59.743913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61864d26-d53d-44ee-bc9a-8968ce714b5b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:59.744372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61864d26-d53d-44ee-bc9a-8968ce714b5b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:59.744859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61864d26-d53d-44ee-bc9a-8968ce714b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:59.750523 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2674/5374] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:59.841647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-61864d26-d53d-44ee-bc9a-8968ce714b5b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:35:59.841647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-61864d26-d53d-44ee-bc9a-8968ce714b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:35:59.862809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594cc75-d2ae-4293-b051-c776b5f102b5 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:59.871021 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2701/5375] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:35:59.879071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594cc75-d2ae-4293-b051-c776b5f102b5 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:59.898651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e079a-148b-4ca6-873b-afb3d2b5fd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:59.899371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e079a-148b-4ca6-873b-afb3d2b5fd93 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:59.899721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e079a-148b-4ca6-873b-afb3d2b5fd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:59.900095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e079a-148b-4ca6-873b-afb3d2b5fd93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:59.900829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e079a-148b-4ca6-873b-afb3d2b5fd93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:35:59.901197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e079a-148b-4ca6-873b-afb3d2b5fd93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:59.904719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e079a-148b-4ca6-873b-afb3d2b5fd93 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:35:59.938568 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2675/5376] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:35:59.941136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61864d26-d53d-44ee-bc9a-8968ce714b5b None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:35:59.953551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61864d26-d53d-44ee-bc9a-8968ce714b5b None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:35:59.968388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fbd49-8431-4d33-a62b-1911f1e1a7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:35:59.972073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fbd49-8431-4d33-a62b-1911f1e1a7ab admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:35:59.972527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fbd49-8431-4d33-a62b-1911f1e1a7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:35:59.972920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fbd49-8431-4d33-a62b-1911f1e1a7ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:35:59.973753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025fbd49-8431-4d33-a62b-1911f1e1a7ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:35:59.976722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025fbd49-8431-4d33-a62b-1911f1e1a7ab admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:00.074561 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2702/5377] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:35:59 2022] POST /identity/v3/projects => generated 359 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:36:00.078913 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e079a-148b-4ca6-873b-afb3d2b5fd93 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:00.095831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e079a-148b-4ca6-873b-afb3d2b5fd93 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:00.273559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5dde7-5778-46f4-83cb-2d1dbf55ffd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:00.274194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5dde7-5778-46f4-83cb-2d1dbf55ffd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:00.274479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5dde7-5778-46f4-83cb-2d1dbf55ffd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:00.274758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5dde7-5778-46f4-83cb-2d1dbf55ffd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:00.275400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab5dde7-5778-46f4-83cb-2d1dbf55ffd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:00.280392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab5dde7-5778-46f4-83cb-2d1dbf55ffd5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:00.348467 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2676/5378] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:36:00 2022] POST /identity/v3/users => generated 280 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:36:00.354179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fbd49-8431-4d33-a62b-1911f1e1a7ab admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:00.368449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fbd49-8431-4d33-a62b-1911f1e1a7ab admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:00.394235 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb11f2-6989-4c54-bc7d-1e1aadf05fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:00.395234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb11f2-6989-4c54-bc7d-1e1aadf05fca admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:00.395737 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb11f2-6989-4c54-bc7d-1e1aadf05fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:00.396278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb11f2-6989-4c54-bc7d-1e1aadf05fca admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:00.404530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb11f2-6989-4c54-bc7d-1e1aadf05fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:00.408554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb11f2-6989-4c54-bc7d-1e1aadf05fca admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:00.440912 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2703/5379] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:36:00.445587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5dde7-5778-46f4-83cb-2d1dbf55ffd5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:00.459419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5dde7-5778-46f4-83cb-2d1dbf55ffd5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:00.477201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d498d-4bd5-4e7c-8bed-908ca4caab90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:00.478142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d498d-4bd5-4e7c-8bed-908ca4caab90 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:00.481320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d498d-4bd5-4e7c-8bed-908ca4caab90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:00.481930 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d498d-4bd5-4e7c-8bed-908ca4caab90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:00.482801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d498d-4bd5-4e7c-8bed-908ca4caab90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:00.486928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d498d-4bd5-4e7c-8bed-908ca4caab90 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:00.517034 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2677/5380] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:36:00.519406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb11f2-6989-4c54-bc7d-1e1aadf05fca admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:00.534429 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb11f2-6989-4c54-bc7d-1e1aadf05fca admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:00.550913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9530c-4977-4c34-bc7a-e871cd4a43ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:00.559453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9530c-4977-4c34-bc7a-e871cd4a43ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:00.560053 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9530c-4977-4c34-bc7a-e871cd4a43ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:00.560681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9530c-4977-4c34-bc7a-e871cd4a43ef admin admin] PATH_INFO: `/v3/projects/8c0af125606d432c998a323fc81ed3ff/users/f901858b1ab7459cb514bc65c679b58f/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:00.619934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925ed4e-c8a1-409e-bd55-7202e1c6223c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:00.620701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925ed4e-c8a1-409e-bd55-7202e1c6223c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:00.621193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d925ed4e-c8a1-409e-bd55-7202e1c6223c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:00.650503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9530c-4977-4c34-bc7a-e871cd4a43ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c0af125606d432c998a323fc81ed3ff, user_id=f901858b1ab7459cb514bc65c679b58f, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:00.653800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9530c-4977-4c34-bc7a-e871cd4a43ef admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:00.657327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d925ed4e-c8a1-409e-bd55-7202e1c6223c None None] MFA Rules not processed for user `1e08144123ad4d3e93e6b6fbe2acf03a`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:36:00.658863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d925ed4e-c8a1-409e-bd55-7202e1c6223c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:00.703047 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2704/5381] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:36:00 2022] PUT /identity/v3/projects/8c0af125606d432c998a323fc81ed3ff/users/f901858b1ab7459cb514bc65c679b58f/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:00.726537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8821511-0aa9-429f-aca9-f4e24daf7268 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:00.726902 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8821511-0aa9-429f-aca9-f4e24daf7268 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:00.727135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8821511-0aa9-429f-aca9-f4e24daf7268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:00.769250 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:00.811780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d8821511-0aa9-429f-aca9-f4e24daf7268 None None] MFA Rules not processed for user `f901858b1ab7459cb514bc65c679b58f`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:36:00.816284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d8821511-0aa9-429f-aca9-f4e24daf7268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:00.866952 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2678/5382] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:36:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:36:01.095043 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2705/5383] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:36:00 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:36:01.234981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925ed4e-c8a1-409e-bd55-7202e1c6223c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:01.242011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d925ed4e-c8a1-409e-bd55-7202e1c6223c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:01.382840 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:01.585690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d925ed4e-c8a1-409e-bd55-7202e1c6223c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:01.826165 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac72d0-73a7-485b-9902-f630e0020ce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:01.826871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac72d0-73a7-485b-9902-f630e0020ce6 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:01.827071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac72d0-73a7-485b-9902-f630e0020ce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:01.827344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac72d0-73a7-485b-9902-f630e0020ce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:01.892020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac72d0-73a7-485b-9902-f630e0020ce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:01.897506 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac72d0-73a7-485b-9902-f630e0020ce6 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:01.927451 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2679/5384] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:36:01 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:36:03.660159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8821511-0aa9-429f-aca9-f4e24daf7268 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:03.661020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d8821511-0aa9-429f-aca9-f4e24daf7268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:03.682943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8821511-0aa9-429f-aca9-f4e24daf7268 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:03.692036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2803b-6b0b-4195-8999-d69ed69ac098 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:03.693193 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2803b-6b0b-4195-8999-d69ed69ac098 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:03.693508 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2803b-6b0b-4195-8999-d69ed69ac098 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:03.693751 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2803b-6b0b-4195-8999-d69ed69ac098 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:03.700341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dea2803b-6b0b-4195-8999-d69ed69ac098 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:03.725602 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2803b-6b0b-4195-8999-d69ed69ac098 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:03.727813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2803b-6b0b-4195-8999-d69ed69ac098 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:03.748107 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2706/5385] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:36:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:36:05.564131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1688f48-68ae-4bc0-86a7-fe1918335590 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:05.565560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1688f48-68ae-4bc0-86a7-fe1918335590 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:05.566143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1688f48-68ae-4bc0-86a7-fe1918335590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:05.632714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c1688f48-68ae-4bc0-86a7-fe1918335590 None None] MFA Rules not processed for user `2f5acf7da18b43f89e24760744cfdb49`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:36:05.633937 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c1688f48-68ae-4bc0-86a7-fe1918335590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:05.792137 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2680/5386] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:36:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:36:05.802610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa9c63-8b22-48e1-88e1-6d0f92e23c12 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:05.803108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa9c63-8b22-48e1-88e1-6d0f92e23c12 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:05.803217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa9c63-8b22-48e1-88e1-6d0f92e23c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:05.864224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1daa9c63-8b22-48e1-88e1-6d0f92e23c12 None None] MFA Rules not processed for user `2f5acf7da18b43f89e24760744cfdb49`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:36:05.866260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1daa9c63-8b22-48e1-88e1-6d0f92e23c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:05.876132 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2707/5387] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:36:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:36:05.889648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1688f48-68ae-4bc0-86a7-fe1918335590 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:05.891779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c1688f48-68ae-4bc0-86a7-fe1918335590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:06.082963 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1688f48-68ae-4bc0-86a7-fe1918335590 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:06.099731 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85216031-8246-4d1b-9b3b-245395833a8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:06.100748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85216031-8246-4d1b-9b3b-245395833a8b service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:06.101134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85216031-8246-4d1b-9b3b-245395833a8b service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:06.101511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85216031-8246-4d1b-9b3b-245395833a8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:06.124259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85216031-8246-4d1b-9b3b-245395833a8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:06.126063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85216031-8246-4d1b-9b3b-245395833a8b service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:06.134742 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:06.150422 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2681/5388] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:36:05 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:36:08.153159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa9c63-8b22-48e1-88e1-6d0f92e23c12 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:08.154708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1daa9c63-8b22-48e1-88e1-6d0f92e23c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:08.194226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa9c63-8b22-48e1-88e1-6d0f92e23c12 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:08.220511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1daff0-d42c-402e-8398-4ff2ee921c77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:08.222229 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1daff0-d42c-402e-8398-4ff2ee921c77 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:08.222825 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1daff0-d42c-402e-8398-4ff2ee921c77 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:08.223317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1daff0-d42c-402e-8398-4ff2ee921c77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:08.225695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5d1daff0-d42c-402e-8398-4ff2ee921c77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:08.242566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1daff0-d42c-402e-8398-4ff2ee921c77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:08.245970 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1daff0-d42c-402e-8398-4ff2ee921c77 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:08.262347 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2708/5389] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:36:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:36:10.178434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcf6a7-7889-400e-8bee-acf94eedeb3a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:10.178949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcf6a7-7889-400e-8bee-acf94eedeb3a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:10.179133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcf6a7-7889-400e-8bee-acf94eedeb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:10.249604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1edcf6a7-7889-400e-8bee-acf94eedeb3a None None] MFA Rules not processed for user `2f5acf7da18b43f89e24760744cfdb49`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:36:10.255640 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1edcf6a7-7889-400e-8bee-acf94eedeb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:10.274406 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2682/5390] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:36:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:36:11.052944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41c592-f9bc-454d-84b8-43f42b20c14f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:11.053876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41c592-f9bc-454d-84b8-43f42b20c14f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:11.054692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41c592-f9bc-454d-84b8-43f42b20c14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:11.094993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-8b41c592-f9bc-454d-84b8-43f42b20c14f None None] MFA Rules not processed for user `d556a8ae0d524894a93203ce3f70d420`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:36:11.097756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8b41c592-f9bc-454d-84b8-43f42b20c14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:11.268609 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2709/5391] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:36:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:36:12.339304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edcf6a7-7889-400e-8bee-acf94eedeb3a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:12.341154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1edcf6a7-7889-400e-8bee-acf94eedeb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:12.511945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edcf6a7-7889-400e-8bee-acf94eedeb3a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:12.520837 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc861f6-27f9-4e90-a5f0-023aa2d26075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:12.523495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc861f6-27f9-4e90-a5f0-023aa2d26075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:12.523767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc861f6-27f9-4e90-a5f0-023aa2d26075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:12.524195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc861f6-27f9-4e90-a5f0-023aa2d26075 admin admin] PATH_INFO: `/v3/users/c6bc29ad3036467099b1fafa51c20eef` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:12.525658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc861f6-27f9-4e90-a5f0-023aa2d26075 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6bc29ad3036467099b1fafa51c20eef)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:12.529286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc861f6-27f9-4e90-a5f0-023aa2d26075 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:12.633615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9fc861f6-27f9-4e90-a5f0-023aa2d26075 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6bc29ad3036467099b1fafa51c20eef'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:12.655447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9fc861f6-27f9-4e90-a5f0-023aa2d26075 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6bc29ad3036467099b1fafa51c20eef'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:12.718909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9fc861f6-27f9-4e90-a5f0-023aa2d26075 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6bc29ad3036467099b1fafa51c20eef'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:12.726694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9fc861f6-27f9-4e90-a5f0-023aa2d26075 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6bc29ad3036467099b1fafa51c20eef'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:12.748330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9fc861f6-27f9-4e90-a5f0-023aa2d26075 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6bc29ad3036467099b1fafa51c20eef'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:12.760417 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2683/5392] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:36:12 2022] DELETE /identity/v3/users/c6bc29ad3036467099b1fafa51c20eef => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:12.764669 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2c9eb-eff3-4296-a5c8-560d734edf10 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:12.765824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2c9eb-eff3-4296-a5c8-560d734edf10 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:12.766316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2c9eb-eff3-4296-a5c8-560d734edf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:12.837058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c5d2c9eb-eff3-4296-a5c8-560d734edf10 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:36:12.838470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c5d2c9eb-eff3-4296-a5c8-560d734edf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:12.986029 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2710/5393] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:36:12.996481 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc861f6-27f9-4e90-a5f0-023aa2d26075 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:12.999868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9fc861f6-27f9-4e90-a5f0-023aa2d26075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:13.179110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc861f6-27f9-4e90-a5f0-023aa2d26075 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:13.183913 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811e95b-d5d9-4ec5-b35f-bf66f5a68c63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:13.184723 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811e95b-d5d9-4ec5-b35f-bf66f5a68c63 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:13.185322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811e95b-d5d9-4ec5-b35f-bf66f5a68c63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:13.185831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811e95b-d5d9-4ec5-b35f-bf66f5a68c63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:13.201729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811e95b-d5d9-4ec5-b35f-bf66f5a68c63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:13.204510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811e95b-d5d9-4ec5-b35f-bf66f5a68c63 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:13.220021 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2684/5394] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:36:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:36:13.805452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2c9eb-eff3-4296-a5c8-560d734edf10 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:13.807208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c5d2c9eb-eff3-4296-a5c8-560d734edf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:13.831048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2c9eb-eff3-4296-a5c8-560d734edf10 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:13.852302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65763333-ed1c-4d8e-9921-e7882f278cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:13.852970 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65763333-ed1c-4d8e-9921-e7882f278cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:13.853248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65763333-ed1c-4d8e-9921-e7882f278cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:13.853516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65763333-ed1c-4d8e-9921-e7882f278cce admin admin] PATH_INFO: `/v3/projects/39b4d97b564340d3a20802dc40f0f801` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:13.856361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65763333-ed1c-4d8e-9921-e7882f278cce admin admin] RBAC: Authorizing `identity:delete_project(project_id=39b4d97b564340d3a20802dc40f0f801)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:13.858534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65763333-ed1c-4d8e-9921-e7882f278cce admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:13.877309 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:13.993858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-65763333-ed1c-4d8e-9921-e7882f278cce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39b4d97b564340d3a20802dc40f0f801', 'request_id': 'req-65763333-ed1c-4d8e-9921-e7882f278cce'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:14.010905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-65763333-ed1c-4d8e-9921-e7882f278cce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39b4d97b564340d3a20802dc40f0f801', 'request_id': 'req-65763333-ed1c-4d8e-9921-e7882f278cce'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:14.027303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-65763333-ed1c-4d8e-9921-e7882f278cce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39b4d97b564340d3a20802dc40f0f801', 'request_id': 'req-65763333-ed1c-4d8e-9921-e7882f278cce'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:14.085087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-65763333-ed1c-4d8e-9921-e7882f278cce admin admin] The token cache is being invalidate because project 39b4d97b564340d3a20802dc40f0f801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:36:14.088519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-65763333-ed1c-4d8e-9921-e7882f278cce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:14.089684 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-65763333-ed1c-4d8e-9921-e7882f278cce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:14.099601 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2711/5395] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:36:13 2022] DELETE /identity/v3/projects/39b4d97b564340d3a20802dc40f0f801 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:14.103180 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811e95b-d5d9-4ec5-b35f-bf66f5a68c63 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:14.119460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811e95b-d5d9-4ec5-b35f-bf66f5a68c63 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:14.157329 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:14.322189 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2f907-ba3f-41cb-b51a-25fab90cd39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:14.323051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2f907-ba3f-41cb-b51a-25fab90cd39d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:14.324705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2f907-ba3f-41cb-b51a-25fab90cd39d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:14.324705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2f907-ba3f-41cb-b51a-25fab90cd39d admin admin] PATH_INFO: `/v3/users/570def341b4145e4aec339b2ae250712` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:14.329507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd2f907-ba3f-41cb-b51a-25fab90cd39d admin admin] RBAC: Authorizing `identity:delete_user(user_id=570def341b4145e4aec339b2ae250712)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:14.336750 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd2f907-ba3f-41cb-b51a-25fab90cd39d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:14.466008 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cbd2f907-ba3f-41cb-b51a-25fab90cd39d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '570def341b4145e4aec339b2ae250712'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:14.485890 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cbd2f907-ba3f-41cb-b51a-25fab90cd39d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '570def341b4145e4aec339b2ae250712'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:14.516720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cbd2f907-ba3f-41cb-b51a-25fab90cd39d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '570def341b4145e4aec339b2ae250712'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:14.521630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cbd2f907-ba3f-41cb-b51a-25fab90cd39d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '570def341b4145e4aec339b2ae250712'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:14.538578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cbd2f907-ba3f-41cb-b51a-25fab90cd39d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '570def341b4145e4aec339b2ae250712'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:14.556985 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2685/5396] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:36:14 2022] DELETE /identity/v3/users/570def341b4145e4aec339b2ae250712 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:17.267560 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65763333-ed1c-4d8e-9921-e7882f278cce admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:17.269985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-65763333-ed1c-4d8e-9921-e7882f278cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:17.315284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65763333-ed1c-4d8e-9921-e7882f278cce admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:17.485604 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978bc0d-2b8d-4b98-abed-89bacac1e9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:17.486398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978bc0d-2b8d-4b98-abed-89bacac1e9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:17.486551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978bc0d-2b8d-4b98-abed-89bacac1e9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:17.486832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978bc0d-2b8d-4b98-abed-89bacac1e9bb admin admin] PATH_INFO: `/v3/projects/2d3f605c26e646a8bc80f5bcacb60d1c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:17.489590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978bc0d-2b8d-4b98-abed-89bacac1e9bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d3f605c26e646a8bc80f5bcacb60d1c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:17.491517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978bc0d-2b8d-4b98-abed-89bacac1e9bb admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:17.704506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0978bc0d-2b8d-4b98-abed-89bacac1e9bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d3f605c26e646a8bc80f5bcacb60d1c', 'request_id': 'req-0978bc0d-2b8d-4b98-abed-89bacac1e9bb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:17.711560 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0978bc0d-2b8d-4b98-abed-89bacac1e9bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d3f605c26e646a8bc80f5bcacb60d1c', 'request_id': 'req-0978bc0d-2b8d-4b98-abed-89bacac1e9bb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:17.725376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0978bc0d-2b8d-4b98-abed-89bacac1e9bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d3f605c26e646a8bc80f5bcacb60d1c', 'request_id': 'req-0978bc0d-2b8d-4b98-abed-89bacac1e9bb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:17.752590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0978bc0d-2b8d-4b98-abed-89bacac1e9bb admin admin] The token cache is being invalidate because project 2d3f605c26e646a8bc80f5bcacb60d1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:36:17.752921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0978bc0d-2b8d-4b98-abed-89bacac1e9bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:17.755807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0978bc0d-2b8d-4b98-abed-89bacac1e9bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:17.760432 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2712/5397] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:36:17 2022] DELETE /identity/v3/projects/2d3f605c26e646a8bc80f5bcacb60d1c => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:17.764334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2f907-ba3f-41cb-b51a-25fab90cd39d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:17.766119 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cbd2f907-ba3f-41cb-b51a-25fab90cd39d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:17.784481 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2f907-ba3f-41cb-b51a-25fab90cd39d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:17.866977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a9b6f-adb7-4b10-8783-23115ec9e7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:17.868153 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a9b6f-adb7-4b10-8783-23115ec9e7a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:17.868598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a9b6f-adb7-4b10-8783-23115ec9e7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:17.869226 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a9b6f-adb7-4b10-8783-23115ec9e7a6 admin admin] PATH_INFO: `/v3/users/8a5a60c51b0247ceae361bce323f5f58` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:17.870631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a9b6f-adb7-4b10-8783-23115ec9e7a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a5a60c51b0247ceae361bce323f5f58)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:17.873224 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a9b6f-adb7-4b10-8783-23115ec9e7a6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:17.955148 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:17.978066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a25a9b6f-adb7-4b10-8783-23115ec9e7a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a5a60c51b0247ceae361bce323f5f58'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:17.996088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a25a9b6f-adb7-4b10-8783-23115ec9e7a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a5a60c51b0247ceae361bce323f5f58'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:18.041507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a25a9b6f-adb7-4b10-8783-23115ec9e7a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a5a60c51b0247ceae361bce323f5f58'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:18.042388 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a25a9b6f-adb7-4b10-8783-23115ec9e7a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a5a60c51b0247ceae361bce323f5f58'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:18.073073 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a25a9b6f-adb7-4b10-8783-23115ec9e7a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a5a60c51b0247ceae361bce323f5f58'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:18.080618 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2686/5398] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:36:17 2022] DELETE /identity/v3/users/8a5a60c51b0247ceae361bce323f5f58 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:20.049734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978bc0d-2b8d-4b98-abed-89bacac1e9bb admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:20.052563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0978bc0d-2b8d-4b98-abed-89bacac1e9bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:20.078231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978bc0d-2b8d-4b98-abed-89bacac1e9bb admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:20.124282 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:20.267277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab26ea-107c-49db-baaa-992a02c44835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:20.268517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab26ea-107c-49db-baaa-992a02c44835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:20.268819 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab26ea-107c-49db-baaa-992a02c44835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:20.270621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab26ea-107c-49db-baaa-992a02c44835 admin admin] PATH_INFO: `/v3/projects/c00fc6ca107b4c59bafa68adc5e915fa` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:20.273109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab26ea-107c-49db-baaa-992a02c44835 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c00fc6ca107b4c59bafa68adc5e915fa)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:20.278564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab26ea-107c-49db-baaa-992a02c44835 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:20.409418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-52ab26ea-107c-49db-baaa-992a02c44835 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c00fc6ca107b4c59bafa68adc5e915fa', 'request_id': 'req-52ab26ea-107c-49db-baaa-992a02c44835'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:20.417687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-52ab26ea-107c-49db-baaa-992a02c44835 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c00fc6ca107b4c59bafa68adc5e915fa', 'request_id': 'req-52ab26ea-107c-49db-baaa-992a02c44835'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:20.428601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-52ab26ea-107c-49db-baaa-992a02c44835 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c00fc6ca107b4c59bafa68adc5e915fa', 'request_id': 'req-52ab26ea-107c-49db-baaa-992a02c44835'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:20.460567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-52ab26ea-107c-49db-baaa-992a02c44835 admin admin] The token cache is being invalidate because project c00fc6ca107b4c59bafa68adc5e915fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:36:20.467027 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-52ab26ea-107c-49db-baaa-992a02c44835 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:20.470543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-52ab26ea-107c-49db-baaa-992a02c44835 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:20.475924 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2713/5399] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:36:20 2022] DELETE /identity/v3/projects/c00fc6ca107b4c59bafa68adc5e915fa => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:20.482968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701de0f9-e12c-4d25-87af-6e743a08207f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:20.486749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701de0f9-e12c-4d25-87af-6e743a08207f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:20.487447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701de0f9-e12c-4d25-87af-6e743a08207f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:20.555758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-701de0f9-e12c-4d25-87af-6e743a08207f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:36:20.559164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-701de0f9-e12c-4d25-87af-6e743a08207f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:20.699973 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2687/5400] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:36:20.710967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8d4fe-d694-49b8-a83c-39779e0a5c2c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:20.711263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8d4fe-d694-49b8-a83c-39779e0a5c2c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:20.711543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8d4fe-d694-49b8-a83c-39779e0a5c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:20.737424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b0d8d4fe-d694-49b8-a83c-39779e0a5c2c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:36:20.740823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b0d8d4fe-d694-49b8-a83c-39779e0a5c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:20.766437 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2714/5401] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:36:20.767567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701de0f9-e12c-4d25-87af-6e743a08207f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:20.788533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701de0f9-e12c-4d25-87af-6e743a08207f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:20.796799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f3633-0dd8-47ee-933d-f7e29536f35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:20.797520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f3633-0dd8-47ee-933d-f7e29536f35b admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:20.797875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f3633-0dd8-47ee-933d-f7e29536f35b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:20.798221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f3633-0dd8-47ee-933d-f7e29536f35b admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:20.799084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f3633-0dd8-47ee-933d-f7e29536f35b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:36:20.799440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f3633-0dd8-47ee-933d-f7e29536f35b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:20.804457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f3633-0dd8-47ee-933d-f7e29536f35b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:20.825047 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2688/5402] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:36:20.829431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8d4fe-d694-49b8-a83c-39779e0a5c2c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:20.850110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8d4fe-d694-49b8-a83c-39779e0a5c2c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:20.857817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9efbb-1a87-4f5e-8386-dadb1176be6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:20.858445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9efbb-1a87-4f5e-8386-dadb1176be6b admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:20.858846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9efbb-1a87-4f5e-8386-dadb1176be6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:20.859089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9efbb-1a87-4f5e-8386-dadb1176be6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:20.859777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9efbb-1a87-4f5e-8386-dadb1176be6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:20.862772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9efbb-1a87-4f5e-8386-dadb1176be6b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:20.923616 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2715/5403] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:36:20 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:36:20.924911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f3633-0dd8-47ee-933d-f7e29536f35b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:20.940552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f3633-0dd8-47ee-933d-f7e29536f35b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:21.155838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b68aa-1cfa-4751-9fc7-726284398cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:21.157356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b68aa-1cfa-4751-9fc7-726284398cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:21.158437 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b68aa-1cfa-4751-9fc7-726284398cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:21.159717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b68aa-1cfa-4751-9fc7-726284398cb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:21.162283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b68aa-1cfa-4751-9fc7-726284398cb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:21.167537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b68aa-1cfa-4751-9fc7-726284398cb2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:21.222773 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2689/5404] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:36:20 2022] POST /identity/v3/users => generated 288 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:36:21.227127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9efbb-1a87-4f5e-8386-dadb1176be6b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:21.248971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9efbb-1a87-4f5e-8386-dadb1176be6b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:21.268015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62017389-5540-4252-a3ea-ac29288579b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:21.268664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62017389-5540-4252-a3ea-ac29288579b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:21.268937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62017389-5540-4252-a3ea-ac29288579b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:21.269211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62017389-5540-4252-a3ea-ac29288579b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:21.269900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62017389-5540-4252-a3ea-ac29288579b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:21.271517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62017389-5540-4252-a3ea-ac29288579b3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:21.291321 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b68aa-1cfa-4751-9fc7-726284398cb2 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:21.291995 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2716/5405] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:36:21.306500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b68aa-1cfa-4751-9fc7-726284398cb2 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:21.318371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29536c2a-d2b5-4384-90ee-1230c743a4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:21.319007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29536c2a-d2b5-4384-90ee-1230c743a4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:21.319451 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29536c2a-d2b5-4384-90ee-1230c743a4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:21.319700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29536c2a-d2b5-4384-90ee-1230c743a4c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:21.320234 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29536c2a-d2b5-4384-90ee-1230c743a4c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:21.321871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29536c2a-d2b5-4384-90ee-1230c743a4c9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:21.341023 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2690/5406] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:36:21.341651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62017389-5540-4252-a3ea-ac29288579b3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:21.359327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62017389-5540-4252-a3ea-ac29288579b3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:21.364778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6bdec-a48a-4902-b284-b9ed9ea46647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:21.365711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6bdec-a48a-4902-b284-b9ed9ea46647 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:21.366222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6bdec-a48a-4902-b284-b9ed9ea46647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:21.366786 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6bdec-a48a-4902-b284-b9ed9ea46647 admin admin] PATH_INFO: `/v3/projects/07ab28bb53c645cc91b3a38a565ce758/users/336f46c026384c6db85f0afc93b83fd1/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:21.386260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6bdec-a48a-4902-b284-b9ed9ea46647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07ab28bb53c645cc91b3a38a565ce758, user_id=336f46c026384c6db85f0afc93b83fd1, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:21.389449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6bdec-a48a-4902-b284-b9ed9ea46647 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:21.435137 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2717/5407] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:36:21 2022] PUT /identity/v3/projects/07ab28bb53c645cc91b3a38a565ce758/users/336f46c026384c6db85f0afc93b83fd1/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:21.453401 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859872c0-ce4f-4b9b-8dc8-ea03b182d9e2 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:21.453851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859872c0-ce4f-4b9b-8dc8-ea03b182d9e2 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:21.454302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859872c0-ce4f-4b9b-8dc8-ea03b182d9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:21.496869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-859872c0-ce4f-4b9b-8dc8-ea03b182d9e2 None None] MFA Rules not processed for user `336f46c026384c6db85f0afc93b83fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:36:21.498246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-859872c0-ce4f-4b9b-8dc8-ea03b182d9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:21.506737 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:21.673774 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2691/5408] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:36:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:36:21.680344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6bdec-a48a-4902-b284-b9ed9ea46647 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:21.771526 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:21.790022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6bdec-a48a-4902-b284-b9ed9ea46647 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:21.798250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7d545-a14c-4286-b820-867d440b3b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:21.799522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7d545-a14c-4286-b820-867d440b3b27 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:21.799984 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7d545-a14c-4286-b820-867d440b3b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:21.800341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7d545-a14c-4286-b820-867d440b3b27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:21.802208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7d545-a14c-4286-b820-867d440b3b27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:21.807651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7d545-a14c-4286-b820-867d440b3b27 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:21.865863 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2718/5409] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:36:21 2022] POST /identity/v3/projects => generated 377 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:36:21.871341 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859872c0-ce4f-4b9b-8dc8-ea03b182d9e2 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:21.911466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859872c0-ce4f-4b9b-8dc8-ea03b182d9e2 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:22.004059 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23fb1f-2c2d-4277-8073-e27e1475e40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:22.005588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23fb1f-2c2d-4277-8073-e27e1475e40c admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:22.006425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23fb1f-2c2d-4277-8073-e27e1475e40c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:22.006872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23fb1f-2c2d-4277-8073-e27e1475e40c admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:22.008009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23fb1f-2c2d-4277-8073-e27e1475e40c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:22.010400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23fb1f-2c2d-4277-8073-e27e1475e40c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:22.043187 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2692/5410] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:36:21 2022] POST /identity/v3/users => generated 295 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:36:22.043642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7d545-a14c-4286-b820-867d440b3b27 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:22.063601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7d545-a14c-4286-b820-867d440b3b27 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:22.076819 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52243b89-c5b5-47c7-8731-227313c294fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:22.083515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52243b89-c5b5-47c7-8731-227313c294fc admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:22.084115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52243b89-c5b5-47c7-8731-227313c294fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:22.084557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52243b89-c5b5-47c7-8731-227313c294fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:22.085403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52243b89-c5b5-47c7-8731-227313c294fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:22.087236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52243b89-c5b5-47c7-8731-227313c294fc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:22.114807 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2719/5411] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:36:22.119964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23fb1f-2c2d-4277-8073-e27e1475e40c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:22.137090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23fb1f-2c2d-4277-8073-e27e1475e40c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:22.143597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ff918-1bca-48b0-ab59-132db25c1cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:22.144096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ff918-1bca-48b0-ab59-132db25c1cbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:22.144485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ff918-1bca-48b0-ab59-132db25c1cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:22.145365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ff918-1bca-48b0-ab59-132db25c1cbc admin admin] PATH_INFO: `/v3/projects/6f276da301c54952b64591491cb03ff7/users/0f6010e513034e718ed9e8c55e09c9cd/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:22.178327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ff918-1bca-48b0-ab59-132db25c1cbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f276da301c54952b64591491cb03ff7, user_id=0f6010e513034e718ed9e8c55e09c9cd, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:22.183543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ff918-1bca-48b0-ab59-132db25c1cbc admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:22.222634 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52243b89-c5b5-47c7-8731-227313c294fc admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:22.263296 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2693/5412] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:36:22 2022] PUT /identity/v3/projects/6f276da301c54952b64591491cb03ff7/users/0f6010e513034e718ed9e8c55e09c9cd/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:22.289798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52243b89-c5b5-47c7-8731-227313c294fc admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:22.454656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbf045-397b-41d9-8969-6a04a0d13b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:22.455286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbf045-397b-41d9-8969-6a04a0d13b33 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:22.455566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbf045-397b-41d9-8969-6a04a0d13b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:22.456478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbf045-397b-41d9-8969-6a04a0d13b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:22.457154 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbf045-397b-41d9-8969-6a04a0d13b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:22.459860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbf045-397b-41d9-8969-6a04a0d13b33 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:22.477917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ff918-1bca-48b0-ab59-132db25c1cbc admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:22.484535 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2720/5413] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:36:22.492785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ff918-1bca-48b0-ab59-132db25c1cbc admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:22.499977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ec2c9-4ce7-4ef1-a8a9-fd6bb07bbef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:22.502170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ec2c9-4ce7-4ef1-a8a9-fd6bb07bbef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:22.502627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ec2c9-4ce7-4ef1-a8a9-fd6bb07bbef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:22.503109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ec2c9-4ce7-4ef1-a8a9-fd6bb07bbef7 admin admin] PATH_INFO: `/v3/projects/6f276da301c54952b64591491cb03ff7/users/0f6010e513034e718ed9e8c55e09c9cd/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:22.506137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ec2c9-4ce7-4ef1-a8a9-fd6bb07bbef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f276da301c54952b64591491cb03ff7, user_id=0f6010e513034e718ed9e8c55e09c9cd, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:22.510414 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ec2c9-4ce7-4ef1-a8a9-fd6bb07bbef7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:22.539114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3c07d-443f-4bb7-9d72-23260e0e2c43 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:22.539359 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2694/5414] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:36:22 2022] PUT /identity/v3/projects/6f276da301c54952b64591491cb03ff7/users/0f6010e513034e718ed9e8c55e09c9cd/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:22.539816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3c07d-443f-4bb7-9d72-23260e0e2c43 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:22.540281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3c07d-443f-4bb7-9d72-23260e0e2c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:22.618168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c2f3c07d-443f-4bb7-9d72-23260e0e2c43 None None] MFA Rules not processed for user `0f6010e513034e718ed9e8c55e09c9cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:36:22.619989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c2f3c07d-443f-4bb7-9d72-23260e0e2c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:22.783648 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2721/5415] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:36:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:36:22.810472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ec2c9-4ce7-4ef1-a8a9-fd6bb07bbef7 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:22.812521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-fe5ec2c9-4ce7-4ef1-a8a9-fd6bb07bbef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:22.904187 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ec2c9-4ce7-4ef1-a8a9-fd6bb07bbef7 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:22.908566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16956f-e7c2-418f-a701-f69d8dff62a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:22.909377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16956f-e7c2-418f-a701-f69d8dff62a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:22.909817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16956f-e7c2-418f-a701-f69d8dff62a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:22.910315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16956f-e7c2-418f-a701-f69d8dff62a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:22.922399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16956f-e7c2-418f-a701-f69d8dff62a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:22.924970 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16956f-e7c2-418f-a701-f69d8dff62a5 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:22.952130 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2695/5416] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:36:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:36:27.401365 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12ec8e-1478-4dd5-81e9-b99fbab4da7b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:27.402481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12ec8e-1478-4dd5-81e9-b99fbab4da7b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:27.403077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae12ec8e-1478-4dd5-81e9-b99fbab4da7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:27.445604 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ae12ec8e-1478-4dd5-81e9-b99fbab4da7b None None] MFA Rules not processed for user `bed65a4d62184f52af3d2dd322eeec47`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:36:27.447217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ae12ec8e-1478-4dd5-81e9-b99fbab4da7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:27.508179 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:27.545593 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2722/5417] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:36:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:36:32.944466 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:34.516652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16956f-e7c2-418f-a701-f69d8dff62a5 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:34.522564 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4a16956f-e7c2-418f-a701-f69d8dff62a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:34.678493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16956f-e7c2-418f-a701-f69d8dff62a5 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:34.702234 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45282b-aef9-4df2-9ba2-3204255a0068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:34.702955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45282b-aef9-4df2-9ba2-3204255a0068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:34.704981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45282b-aef9-4df2-9ba2-3204255a0068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:34.705340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45282b-aef9-4df2-9ba2-3204255a0068 admin admin] PATH_INFO: `/v3/users/2dd25a3a76ca4b399ddaf730a1d96878` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:34.712165 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45282b-aef9-4df2-9ba2-3204255a0068 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dd25a3a76ca4b399ddaf730a1d96878)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:34.716897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45282b-aef9-4df2-9ba2-3204255a0068 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:34.841068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ab45282b-aef9-4df2-9ba2-3204255a0068 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dd25a3a76ca4b399ddaf730a1d96878'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:34.883471 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ab45282b-aef9-4df2-9ba2-3204255a0068 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dd25a3a76ca4b399ddaf730a1d96878'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:34.905112 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ab45282b-aef9-4df2-9ba2-3204255a0068 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dd25a3a76ca4b399ddaf730a1d96878'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:34.906102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ab45282b-aef9-4df2-9ba2-3204255a0068 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dd25a3a76ca4b399ddaf730a1d96878'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:34.918155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ab45282b-aef9-4df2-9ba2-3204255a0068 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dd25a3a76ca4b399ddaf730a1d96878'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:34.932927 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2696/5418] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:36:34 2022] DELETE /identity/v3/users/2dd25a3a76ca4b399ddaf730a1d96878 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:35.722010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12ec8e-1478-4dd5-81e9-b99fbab4da7b None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:35.741072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae12ec8e-1478-4dd5-81e9-b99fbab4da7b None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:35.857979 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587594b-2778-4828-9ff1-1c5fffcfc575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:35.860091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587594b-2778-4828-9ff1-1c5fffcfc575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:35.860392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587594b-2778-4828-9ff1-1c5fffcfc575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:35.860668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587594b-2778-4828-9ff1-1c5fffcfc575 admin admin] PATH_INFO: `/v3/projects/610bac63014f490db55c2cdbb89bc46a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:35.864381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587594b-2778-4828-9ff1-1c5fffcfc575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=610bac63014f490db55c2cdbb89bc46a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:35.868419 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587594b-2778-4828-9ff1-1c5fffcfc575 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:35.982308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d587594b-2778-4828-9ff1-1c5fffcfc575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '610bac63014f490db55c2cdbb89bc46a', 'request_id': 'req-d587594b-2778-4828-9ff1-1c5fffcfc575'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:36.001888 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d587594b-2778-4828-9ff1-1c5fffcfc575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '610bac63014f490db55c2cdbb89bc46a', 'request_id': 'req-d587594b-2778-4828-9ff1-1c5fffcfc575'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:36.020338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d587594b-2778-4828-9ff1-1c5fffcfc575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '610bac63014f490db55c2cdbb89bc46a', 'request_id': 'req-d587594b-2778-4828-9ff1-1c5fffcfc575'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:36.044386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d587594b-2778-4828-9ff1-1c5fffcfc575 admin admin] The token cache is being invalidate because project 610bac63014f490db55c2cdbb89bc46a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:36:36.044676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d587594b-2778-4828-9ff1-1c5fffcfc575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:36.045394 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d587594b-2778-4828-9ff1-1c5fffcfc575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:36.051084 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2723/5419] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:36:35 2022] DELETE /identity/v3/projects/610bac63014f490db55c2cdbb89bc46a => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:36.056954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef52c9-7d21-4c33-8634-d85ed64984b3 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:36.057459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef52c9-7d21-4c33-8634-d85ed64984b3 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:36.057576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef52c9-7d21-4c33-8634-d85ed64984b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:36.113696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-46ef52c9-7d21-4c33-8634-d85ed64984b3 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:36:36.114966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-46ef52c9-7d21-4c33-8634-d85ed64984b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:36.214629 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2697/5420] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:36:36.222286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52d7f5-c10f-491d-b2fe-d8008e29f33e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:36.224041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52d7f5-c10f-491d-b2fe-d8008e29f33e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:36.224221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52d7f5-c10f-491d-b2fe-d8008e29f33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:36.255990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-7b52d7f5-c10f-491d-b2fe-d8008e29f33e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:36:36.257355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7b52d7f5-c10f-491d-b2fe-d8008e29f33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:36.272503 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2724/5421] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:36:36.276519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef52c9-7d21-4c33-8634-d85ed64984b3 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:36.290184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef52c9-7d21-4c33-8634-d85ed64984b3 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:36.308376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52429a1-0fb7-4f0f-bc04-5c0eaf88809b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:36.309466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52429a1-0fb7-4f0f-bc04-5c0eaf88809b admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:36.309961 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52429a1-0fb7-4f0f-bc04-5c0eaf88809b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:36.310452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52429a1-0fb7-4f0f-bc04-5c0eaf88809b admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:36.311354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52429a1-0fb7-4f0f-bc04-5c0eaf88809b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:36:36.311936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52429a1-0fb7-4f0f-bc04-5c0eaf88809b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:36.314050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52429a1-0fb7-4f0f-bc04-5c0eaf88809b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:36.335786 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2698/5422] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:36:36.339685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52d7f5-c10f-491d-b2fe-d8008e29f33e None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:36.380259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52d7f5-c10f-491d-b2fe-d8008e29f33e None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:36.396633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96c81e-c611-4438-817b-bb0996f50313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:36.397381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96c81e-c611-4438-817b-bb0996f50313 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:36.397725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96c81e-c611-4438-817b-bb0996f50313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:36.398116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96c81e-c611-4438-817b-bb0996f50313 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:36.398829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96c81e-c611-4438-817b-bb0996f50313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:36.400916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96c81e-c611-4438-817b-bb0996f50313 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:36.468555 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2725/5423] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:36:36 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:36:36.469770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52429a1-0fb7-4f0f-bc04-5c0eaf88809b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:36.482382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52429a1-0fb7-4f0f-bc04-5c0eaf88809b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:36.494490 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:36.645130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5673c3-d0f7-4905-a5a8-7f6d1eaef50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:36.645971 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5673c3-d0f7-4905-a5a8-7f6d1eaef50d admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:36.646416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5673c3-d0f7-4905-a5a8-7f6d1eaef50d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:36.646868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5673c3-d0f7-4905-a5a8-7f6d1eaef50d admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:36.647984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5673c3-d0f7-4905-a5a8-7f6d1eaef50d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:36.650128 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5673c3-d0f7-4905-a5a8-7f6d1eaef50d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:36.692758 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2699/5424] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:36:36 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:36:36.697675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96c81e-c611-4438-817b-bb0996f50313 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:36.711666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96c81e-c611-4438-817b-bb0996f50313 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:36.727106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ea52e-1141-41c0-bf83-cdde55152164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:36.727687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ea52e-1141-41c0-bf83-cdde55152164 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:36.728217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ea52e-1141-41c0-bf83-cdde55152164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:36.728648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ea52e-1141-41c0-bf83-cdde55152164 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:36.729731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ea52e-1141-41c0-bf83-cdde55152164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:36.731811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ea52e-1141-41c0-bf83-cdde55152164 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:36.760496 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2726/5425] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:36:36.762273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5673c3-d0f7-4905-a5a8-7f6d1eaef50d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:36.817024 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5673c3-d0f7-4905-a5a8-7f6d1eaef50d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:36.831042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd161cc-a626-4248-a8dd-7e160629c945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:36.833340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd161cc-a626-4248-a8dd-7e160629c945 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:36.834386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd161cc-a626-4248-a8dd-7e160629c945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:36.835811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd161cc-a626-4248-a8dd-7e160629c945 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:36.836865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd161cc-a626-4248-a8dd-7e160629c945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:36.842734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd161cc-a626-4248-a8dd-7e160629c945 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:36.887611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ea52e-1141-41c0-bf83-cdde55152164 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:36.890837 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2700/5426] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:36:36.907727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ea52e-1141-41c0-bf83-cdde55152164 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:36.919529 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e37c1-f546-4c8c-94da-85eab684238a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:36.921582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e37c1-f546-4c8c-94da-85eab684238a admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:36.922372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e37c1-f546-4c8c-94da-85eab684238a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:36.922654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e37c1-f546-4c8c-94da-85eab684238a admin admin] PATH_INFO: `/v3/projects/69c2cace9e7b487eaf0b898f3498465b/users/79de70b5e3f24371ae212e0145445206/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:36.971682 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e37c1-f546-4c8c-94da-85eab684238a admin admin] RBAC: Authorizing `identity:create_grant(project_id=69c2cace9e7b487eaf0b898f3498465b, user_id=79de70b5e3f24371ae212e0145445206, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:36.975059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e37c1-f546-4c8c-94da-85eab684238a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:37.025996 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2727/5427] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:36:36 2022] PUT /identity/v3/projects/69c2cace9e7b487eaf0b898f3498465b/users/79de70b5e3f24371ae212e0145445206/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:37.036582 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ec9f5-c796-4cc8-b10b-609eca8570c7 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:37.036914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ec9f5-c796-4cc8-b10b-609eca8570c7 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:37.037201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ec9f5-c796-4cc8-b10b-609eca8570c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:37.090436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ff9ec9f5-c796-4cc8-b10b-609eca8570c7 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:36:37.092089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ff9ec9f5-c796-4cc8-b10b-609eca8570c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:37.171818 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2701/5428] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:36:37.201256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e37c1-f546-4c8c-94da-85eab684238a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:37.203306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-521e37c1-f546-4c8c-94da-85eab684238a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:37.217127 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:37.311192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e37c1-f546-4c8c-94da-85eab684238a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:37.322236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb08363-8200-4da7-a92d-5432f353719b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:37.322236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb08363-8200-4da7-a92d-5432f353719b service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:37.322619 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb08363-8200-4da7-a92d-5432f353719b service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:37.322982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb08363-8200-4da7-a92d-5432f353719b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:37.335644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb08363-8200-4da7-a92d-5432f353719b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:37.337036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb08363-8200-4da7-a92d-5432f353719b service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:37.349724 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2728/5429] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:36:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:36:38.245690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50caeae7-6c93-4188-b089-68d7d3691c6a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:38.246107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50caeae7-6c93-4188-b089-68d7d3691c6a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:38.246338 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50caeae7-6c93-4188-b089-68d7d3691c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:38.297065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-50caeae7-6c93-4188-b089-68d7d3691c6a None None] MFA Rules not processed for user `79de70b5e3f24371ae212e0145445206`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:36:38.298269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-50caeae7-6c93-4188-b089-68d7d3691c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:38.406326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb08363-8200-4da7-a92d-5432f353719b service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:38.408473 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7bb08363-8200-4da7-a92d-5432f353719b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:38.449244 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2702/5430] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:36:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:36:38.536512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abf568-a5ee-4755-9c61-248723fde01c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:38.536807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abf568-a5ee-4755-9c61-248723fde01c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:38.537087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abf568-a5ee-4755-9c61-248723fde01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:38.559347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-32abf568-a5ee-4755-9c61-248723fde01c None None] MFA Rules not processed for user `79de70b5e3f24371ae212e0145445206`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:36:38.560438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-32abf568-a5ee-4755-9c61-248723fde01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:38.579814 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2703/5431] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:36:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:36:38.580892 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb08363-8200-4da7-a92d-5432f353719b service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:38.589585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251263b-ee87-472f-80fd-56024adf3625 tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f6010e513034e718ed9e8c55e09c9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f276da301c54952b64591491cb03ff7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:38.590774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251263b-ee87-472f-80fd-56024adf3625 tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:38.591425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251263b-ee87-472f-80fd-56024adf3625 tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:38.592536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251263b-ee87-472f-80fd-56024adf3625 tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:38.595388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251263b-ee87-472f-80fd-56024adf3625 tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:36:38.595673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251263b-ee87-472f-80fd-56024adf3625 tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:38.598877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251263b-ee87-472f-80fd-56024adf3625 tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:38.617459 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2729/5432] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:36:38.621887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abf568-a5ee-4755-9c61-248723fde01c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:38.642749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abf568-a5ee-4755-9c61-248723fde01c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:38.648839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a0a95-b27b-48e1-8439-4ecb8485d994 tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f6010e513034e718ed9e8c55e09c9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f276da301c54952b64591491cb03ff7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:38.649883 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a0a95-b27b-48e1-8439-4ecb8485d994 tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:38.650393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a0a95-b27b-48e1-8439-4ecb8485d994 tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:38.650898 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a0a95-b27b-48e1-8439-4ecb8485d994 tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:38.651841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a0a95-b27b-48e1-8439-4ecb8485d994 tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:38.654242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a0a95-b27b-48e1-8439-4ecb8485d994 tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:38.663425 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:38.730486 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2704/5433] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:36:38 2022] POST /identity/v3/projects => generated 347 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:36:38.734575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251263b-ee87-472f-80fd-56024adf3625 tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:38.750178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251263b-ee87-472f-80fd-56024adf3625 tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:38.760996 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a0a95-b27b-48e1-8439-4ecb8485d994 tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:38.763328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-105a0a95-b27b-48e1-8439-4ecb8485d994 tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:38.855057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a0a95-b27b-48e1-8439-4ecb8485d994 tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:38.862056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c98af7-3e22-4900-aaf0-61ac21969b4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:38.863716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c98af7-3e22-4900-aaf0-61ac21969b4f service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:38.864273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c98af7-3e22-4900-aaf0-61ac21969b4f service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:38.864791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c98af7-3e22-4900-aaf0-61ac21969b4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:38.902892 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe27a2-d9dc-4e4c-8607-ed9a3ada6ea9 tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f6010e513034e718ed9e8c55e09c9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f276da301c54952b64591491cb03ff7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:38.903525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe27a2-d9dc-4e4c-8607-ed9a3ada6ea9 tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:38.903810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe27a2-d9dc-4e4c-8607-ed9a3ada6ea9 tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:38.904112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffe27a2-d9dc-4e4c-8607-ed9a3ada6ea9 tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:38.904780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe27a2-d9dc-4e4c-8607-ed9a3ada6ea9 tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:36:38.905090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe27a2-d9dc-4e4c-8607-ed9a3ada6ea9 tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:38.906705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffe27a2-d9dc-4e4c-8607-ed9a3ada6ea9 tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:38.935912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c98af7-3e22-4900-aaf0-61ac21969b4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:38.937547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c98af7-3e22-4900-aaf0-61ac21969b4f service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:38.956308 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2730/5434] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:36:38.960844 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2705/5435] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:36:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:36:40.001435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe27a2-d9dc-4e4c-8607-ed9a3ada6ea9 tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:40.021545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffe27a2-d9dc-4e4c-8607-ed9a3ada6ea9 tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:40.033205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24629cb9-81f1-43ec-a295-f88f77894f9c tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f6010e513034e718ed9e8c55e09c9cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f276da301c54952b64591491cb03ff7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:40.033866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24629cb9-81f1-43ec-a295-f88f77894f9c tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:40.034146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24629cb9-81f1-43ec-a295-f88f77894f9c tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:40.034428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24629cb9-81f1-43ec-a295-f88f77894f9c tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] PATH_INFO: `/v3/projects/ef6791dae7f14826a153665aba608eb5` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:40.035679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24629cb9-81f1-43ec-a295-f88f77894f9c tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ef6791dae7f14826a153665aba608eb5)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:40.037624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24629cb9-81f1-43ec-a295-f88f77894f9c tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:40.136159 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:40.164538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-24629cb9-81f1-43ec-a295-f88f77894f9c tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef6791dae7f14826a153665aba608eb5', 'request_id': 'req-24629cb9-81f1-43ec-a295-f88f77894f9c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:40.192821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-24629cb9-81f1-43ec-a295-f88f77894f9c tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef6791dae7f14826a153665aba608eb5', 'request_id': 'req-24629cb9-81f1-43ec-a295-f88f77894f9c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:40.213976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-24629cb9-81f1-43ec-a295-f88f77894f9c tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef6791dae7f14826a153665aba608eb5', 'request_id': 'req-24629cb9-81f1-43ec-a295-f88f77894f9c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:40.241166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-24629cb9-81f1-43ec-a295-f88f77894f9c tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] The token cache is being invalidate because project ef6791dae7f14826a153665aba608eb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:36:40.241455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-24629cb9-81f1-43ec-a295-f88f77894f9c tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:40.242355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-24629cb9-81f1-43ec-a295-f88f77894f9c tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:40.247957 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2731/5436] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:36:40 2022] DELETE /identity/v3/projects/ef6791dae7f14826a153665aba608eb5 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:40.255501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c98af7-3e22-4900-aaf0-61ac21969b4f service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:40.356797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c98af7-3e22-4900-aaf0-61ac21969b4f service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:40.403476 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:40.428875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1aabfa-0ce0-4b4e-9b52-d63b78123672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:40.429502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1aabfa-0ce0-4b4e-9b52-d63b78123672 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:40.429779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1aabfa-0ce0-4b4e-9b52-d63b78123672 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:40.430263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1aabfa-0ce0-4b4e-9b52-d63b78123672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:40.448819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0c1aabfa-0ce0-4b4e-9b52-d63b78123672 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:40.560695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1aabfa-0ce0-4b4e-9b52-d63b78123672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:40.562355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1aabfa-0ce0-4b4e-9b52-d63b78123672 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:40.597689 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2706/5437] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:36:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:36:41.384662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24629cb9-81f1-43ec-a295-f88f77894f9c tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:41.388538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-24629cb9-81f1-43ec-a295-f88f77894f9c tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:41.590432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24629cb9-81f1-43ec-a295-f88f77894f9c tempest-RoutersIpV6AdminTest-1158018962 tempest-RoutersIpV6AdminTest-1158018962-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:41.601026 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cc227-e9a4-440e-a3d3-7cc8b7bf9c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:41.602417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cc227-e9a4-440e-a3d3-7cc8b7bf9c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:41.603842 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cc227-e9a4-440e-a3d3-7cc8b7bf9c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:41.604361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cc227-e9a4-440e-a3d3-7cc8b7bf9c8a admin admin] PATH_INFO: `/v3/users/79de70b5e3f24371ae212e0145445206` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:41.611320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287cc227-e9a4-440e-a3d3-7cc8b7bf9c8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=79de70b5e3f24371ae212e0145445206)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:41.615704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287cc227-e9a4-440e-a3d3-7cc8b7bf9c8a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:41.981004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-287cc227-e9a4-440e-a3d3-7cc8b7bf9c8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79de70b5e3f24371ae212e0145445206'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:42.004821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-287cc227-e9a4-440e-a3d3-7cc8b7bf9c8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79de70b5e3f24371ae212e0145445206'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:42.038919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-287cc227-e9a4-440e-a3d3-7cc8b7bf9c8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79de70b5e3f24371ae212e0145445206'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:42.044546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-287cc227-e9a4-440e-a3d3-7cc8b7bf9c8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79de70b5e3f24371ae212e0145445206'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:42.068119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-287cc227-e9a4-440e-a3d3-7cc8b7bf9c8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79de70b5e3f24371ae212e0145445206'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:42.078787 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2732/5438] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:36:41 2022] DELETE /identity/v3/users/79de70b5e3f24371ae212e0145445206 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:43.433088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1aabfa-0ce0-4b4e-9b52-d63b78123672 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:43.480104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1aabfa-0ce0-4b4e-9b52-d63b78123672 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:43.612737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986bc6b8-d304-4875-90a2-2f5019acb3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:43.613697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bc6b8-d304-4875-90a2-2f5019acb3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:43.614159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bc6b8-d304-4875-90a2-2f5019acb3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:43.614596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bc6b8-d304-4875-90a2-2f5019acb3ae admin admin] PATH_INFO: `/v3/projects/69c2cace9e7b487eaf0b898f3498465b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:43.616297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986bc6b8-d304-4875-90a2-2f5019acb3ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=69c2cace9e7b487eaf0b898f3498465b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:43.618660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986bc6b8-d304-4875-90a2-2f5019acb3ae admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:43.712877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-986bc6b8-d304-4875-90a2-2f5019acb3ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69c2cace9e7b487eaf0b898f3498465b', 'request_id': 'req-986bc6b8-d304-4875-90a2-2f5019acb3ae'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:43.712877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-986bc6b8-d304-4875-90a2-2f5019acb3ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69c2cace9e7b487eaf0b898f3498465b', 'request_id': 'req-986bc6b8-d304-4875-90a2-2f5019acb3ae'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:43.731906 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-986bc6b8-d304-4875-90a2-2f5019acb3ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69c2cace9e7b487eaf0b898f3498465b', 'request_id': 'req-986bc6b8-d304-4875-90a2-2f5019acb3ae'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:43.759733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-986bc6b8-d304-4875-90a2-2f5019acb3ae admin admin] The token cache is being invalidate because project 69c2cace9e7b487eaf0b898f3498465b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:36:43.760218 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-986bc6b8-d304-4875-90a2-2f5019acb3ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:43.761391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-986bc6b8-d304-4875-90a2-2f5019acb3ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:43.765570 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2707/5439] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:36:43 2022] DELETE /identity/v3/projects/69c2cace9e7b487eaf0b898f3498465b => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:43.774012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1787f0-2804-4a75-99ba-1becbe97a87f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:43.774582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1787f0-2804-4a75-99ba-1becbe97a87f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:43.774582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1787f0-2804-4a75-99ba-1becbe97a87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:43.813794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-bb1787f0-2804-4a75-99ba-1becbe97a87f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:36:43.815041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-bb1787f0-2804-4a75-99ba-1becbe97a87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:43.938858 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:44.028780 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2733/5440] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:36:44.036244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071c259-aceb-4a3c-8055-f2cdcbfb4f51 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:44.037102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071c259-aceb-4a3c-8055-f2cdcbfb4f51 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:44.037102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071c259-aceb-4a3c-8055-f2cdcbfb4f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:44.084882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-8071c259-aceb-4a3c-8055-f2cdcbfb4f51 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:36:44.086590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8071c259-aceb-4a3c-8055-f2cdcbfb4f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:44.105719 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2708/5441] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:36:44.110208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1787f0-2804-4a75-99ba-1becbe97a87f None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:44.128408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1787f0-2804-4a75-99ba-1becbe97a87f None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:44.138295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1312590-2e84-417a-971b-3f1a00eeb922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:44.138928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1312590-2e84-417a-971b-3f1a00eeb922 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:44.139204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1312590-2e84-417a-971b-3f1a00eeb922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:44.140712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1312590-2e84-417a-971b-3f1a00eeb922 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:44.141416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1312590-2e84-417a-971b-3f1a00eeb922 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:36:44.141754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1312590-2e84-417a-971b-3f1a00eeb922 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:44.143347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1312590-2e84-417a-971b-3f1a00eeb922 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:44.164222 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2734/5442] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:36:44.164459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071c259-aceb-4a3c-8055-f2cdcbfb4f51 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:44.177386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071c259-aceb-4a3c-8055-f2cdcbfb4f51 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:44.191536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d83a59-0c44-40cb-94db-ae5632af9fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:44.192561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d83a59-0c44-40cb-94db-ae5632af9fda admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:44.192702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d83a59-0c44-40cb-94db-ae5632af9fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:44.193006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d83a59-0c44-40cb-94db-ae5632af9fda admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:44.194168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d83a59-0c44-40cb-94db-ae5632af9fda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:44.197647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d83a59-0c44-40cb-94db-ae5632af9fda admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:44.223909 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:44.305717 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2709/5443] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:36:44 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:36:44.310615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1312590-2e84-417a-971b-3f1a00eeb922 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:44.345390 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1312590-2e84-417a-971b-3f1a00eeb922 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:44.455820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07401a-9f7c-4a5d-8ecc-0d5441b3d9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:44.456995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07401a-9f7c-4a5d-8ecc-0d5441b3d9e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:44.457525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07401a-9f7c-4a5d-8ecc-0d5441b3d9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:44.458044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07401a-9f7c-4a5d-8ecc-0d5441b3d9e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:44.458925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07401a-9f7c-4a5d-8ecc-0d5441b3d9e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:44.461955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07401a-9f7c-4a5d-8ecc-0d5441b3d9e4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:44.505739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d83a59-0c44-40cb-94db-ae5632af9fda admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:44.515794 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2735/5444] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:36:44 2022] POST /identity/v3/users => generated 292 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:36:44.520701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d83a59-0c44-40cb-94db-ae5632af9fda admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:44.528255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13811f-6b57-4afd-8da4-ca26548b54cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:44.529525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13811f-6b57-4afd-8da4-ca26548b54cc admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:44.530200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13811f-6b57-4afd-8da4-ca26548b54cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:44.530712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13811f-6b57-4afd-8da4-ca26548b54cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:44.531932 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb13811f-6b57-4afd-8da4-ca26548b54cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:44.534474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb13811f-6b57-4afd-8da4-ca26548b54cc admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:44.556162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07401a-9f7c-4a5d-8ecc-0d5441b3d9e4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:44.567323 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2710/5445] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:36:44.571181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07401a-9f7c-4a5d-8ecc-0d5441b3d9e4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:44.577652 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6705d-339b-4d58-83e4-71bb6f89993e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:44.579074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6705d-339b-4d58-83e4-71bb6f89993e admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:44.579658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6705d-339b-4d58-83e4-71bb6f89993e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:44.580194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6705d-339b-4d58-83e4-71bb6f89993e admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:44.581999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6705d-339b-4d58-83e4-71bb6f89993e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:44.584333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6705d-339b-4d58-83e4-71bb6f89993e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:44.604868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13811f-6b57-4afd-8da4-ca26548b54cc admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:44.613571 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2736/5446] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:36:44.619047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13811f-6b57-4afd-8da4-ca26548b54cc admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:44.624703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3fc8a-112c-43d7-bdd0-ad060adc8efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:44.625813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3fc8a-112c-43d7-bdd0-ad060adc8efa admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:44.626751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3fc8a-112c-43d7-bdd0-ad060adc8efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:44.627296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3fc8a-112c-43d7-bdd0-ad060adc8efa admin admin] PATH_INFO: `/v3/projects/beed0ca43e2c4df5b102f886472f3a33/users/03700ce324e140d6917180880bac026f/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:44.663130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3fc8a-112c-43d7-bdd0-ad060adc8efa admin admin] RBAC: Authorizing `identity:create_grant(project_id=beed0ca43e2c4df5b102f886472f3a33, user_id=03700ce324e140d6917180880bac026f, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:44.666891 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3fc8a-112c-43d7-bdd0-ad060adc8efa admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:44.704751 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345efae-6e32-4af4-af23-f8ecc9eba113 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:44.705451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345efae-6e32-4af4-af23-f8ecc9eba113 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:44.706141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345efae-6e32-4af4-af23-f8ecc9eba113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:44.717443 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2711/5447] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:36:44 2022] PUT /identity/v3/projects/beed0ca43e2c4df5b102f886472f3a33/users/03700ce324e140d6917180880bac026f/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:36:44.749733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e345efae-6e32-4af4-af23-f8ecc9eba113 None None] MFA Rules not processed for user `03700ce324e140d6917180880bac026f`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:36:44.751473 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e345efae-6e32-4af4-af23-f8ecc9eba113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:44.855485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3fc8a-112c-43d7-bdd0-ad060adc8efa admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:44.879937 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2737/5448] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:36:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:36:45.047736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3fc8a-112c-43d7-bdd0-ad060adc8efa admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:45.066121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bb184-a0f1-436b-a5ae-f56db18fa0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:45.067036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bb184-a0f1-436b-a5ae-f56db18fa0ca admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:45.067392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bb184-a0f1-436b-a5ae-f56db18fa0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:45.067705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bb184-a0f1-436b-a5ae-f56db18fa0ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:45.068552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7bb184-a0f1-436b-a5ae-f56db18fa0ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:45.070671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7bb184-a0f1-436b-a5ae-f56db18fa0ca admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:45.131048 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2712/5449] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:36:44 2022] POST /identity/v3/projects => generated 383 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:36:45.134657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345efae-6e32-4af4-af23-f8ecc9eba113 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:45.154783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345efae-6e32-4af4-af23-f8ecc9eba113 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:45.244521 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:45.290095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0533164-e63b-4972-a724-219559af3d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:45.291027 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0533164-e63b-4972-a724-219559af3d68 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:45.291312 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0533164-e63b-4972-a724-219559af3d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:45.291956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0533164-e63b-4972-a724-219559af3d68 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:45.292245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0533164-e63b-4972-a724-219559af3d68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:45.297524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0533164-e63b-4972-a724-219559af3d68 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:45.351379 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2738/5450] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:36:45 2022] POST /identity/v3/users => generated 298 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:36:45.355497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bb184-a0f1-436b-a5ae-f56db18fa0ca admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:45.369230 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bb184-a0f1-436b-a5ae-f56db18fa0ca admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:45.392376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3630b40-03e2-4245-ae1c-f31a6257993f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:45.393226 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3630b40-03e2-4245-ae1c-f31a6257993f admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:45.394461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3630b40-03e2-4245-ae1c-f31a6257993f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:45.394871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3630b40-03e2-4245-ae1c-f31a6257993f admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:45.395718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3630b40-03e2-4245-ae1c-f31a6257993f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:45.399791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3630b40-03e2-4245-ae1c-f31a6257993f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:45.421662 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2713/5451] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:36:45.422671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0533164-e63b-4972-a724-219559af3d68 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:45.435105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0533164-e63b-4972-a724-219559af3d68 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:45.445396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04521554-7507-46d2-b894-d2d76d7864c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:45.446270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04521554-7507-46d2-b894-d2d76d7864c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:45.446626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04521554-7507-46d2-b894-d2d76d7864c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:45.446971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04521554-7507-46d2-b894-d2d76d7864c0 admin admin] PATH_INFO: `/v3/projects/1aeeb65541b84375b0a9c36dd73d1a91/users/7fe535b52fcb40a48ade36126464ae93/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:45.493164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04521554-7507-46d2-b894-d2d76d7864c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aeeb65541b84375b0a9c36dd73d1a91, user_id=7fe535b52fcb40a48ade36126464ae93, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:45.493396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04521554-7507-46d2-b894-d2d76d7864c0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:45.520205 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2739/5452] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:36:45 2022] PUT /identity/v3/projects/1aeeb65541b84375b0a9c36dd73d1a91/users/7fe535b52fcb40a48ade36126464ae93/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:36:45.524046 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3630b40-03e2-4245-ae1c-f31a6257993f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:45.536397 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3630b40-03e2-4245-ae1c-f31a6257993f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:45.609182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0667a-9a21-4324-80ee-71434916db07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:45.610213 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0667a-9a21-4324-80ee-71434916db07 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:45.611044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0667a-9a21-4324-80ee-71434916db07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:45.611566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0667a-9a21-4324-80ee-71434916db07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:45.613174 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e0667a-9a21-4324-80ee-71434916db07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:45.617632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e0667a-9a21-4324-80ee-71434916db07 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:45.635725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04521554-7507-46d2-b894-d2d76d7864c0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:45.635946 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2714/5453] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:36:45.666989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04521554-7507-46d2-b894-d2d76d7864c0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:45.675549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125681cc-45e3-4ca6-82f1-2d575d8d1467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:45.676274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125681cc-45e3-4ca6-82f1-2d575d8d1467 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:45.676552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125681cc-45e3-4ca6-82f1-2d575d8d1467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:45.676826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125681cc-45e3-4ca6-82f1-2d575d8d1467 admin admin] PATH_INFO: `/v3/projects/1aeeb65541b84375b0a9c36dd73d1a91/users/7fe535b52fcb40a48ade36126464ae93/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:45.680795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125681cc-45e3-4ca6-82f1-2d575d8d1467 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aeeb65541b84375b0a9c36dd73d1a91, user_id=7fe535b52fcb40a48ade36126464ae93, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:45.686377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125681cc-45e3-4ca6-82f1-2d575d8d1467 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:45.708380 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2740/5454] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:36:45 2022] PUT /identity/v3/projects/1aeeb65541b84375b0a9c36dd73d1a91/users/7fe535b52fcb40a48ade36126464ae93/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:36:45.727302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2982f00-5727-4ad5-ab08-fdbf41d35f3a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:45.727633 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2982f00-5727-4ad5-ab08-fdbf41d35f3a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:45.727865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2982f00-5727-4ad5-ab08-fdbf41d35f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:45.796559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e2982f00-5727-4ad5-ab08-fdbf41d35f3a None None] MFA Rules not processed for user `7fe535b52fcb40a48ade36126464ae93`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:36:45.801891 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e2982f00-5727-4ad5-ab08-fdbf41d35f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:45.834023 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:45.929569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125681cc-45e3-4ca6-82f1-2d575d8d1467 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:45.930152 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2715/5455] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:36:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:36:45.944929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125681cc-45e3-4ca6-82f1-2d575d8d1467 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:45.951704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a151395-b996-41ad-8a4a-521ee56c890e tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe535b52fcb40a48ade36126464ae93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aeeb65541b84375b0a9c36dd73d1a91', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:45.953157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a151395-b996-41ad-8a4a-521ee56c890e tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:45.953552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a151395-b996-41ad-8a4a-521ee56c890e tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:45.954061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a151395-b996-41ad-8a4a-521ee56c890e tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:45.954890 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a151395-b996-41ad-8a4a-521ee56c890e tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:45.957640 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a151395-b996-41ad-8a4a-521ee56c890e tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:45.972629 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-1a151395-b996-41ad-8a4a-521ee56c890e tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Invalid input for field 'name': '' is too short Aug 07 01:36:45.972629 n-d-master-1 devstack@keystone.service[80492]: Failed validating 'minLength' in schema['properties']['name']: Aug 07 01:36:45.972629 n-d-master-1 devstack@keystone.service[80492]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 07 01:36:45.972629 n-d-master-1 devstack@keystone.service[80492]: On instance['name']: Aug 07 01:36:45.972629 n-d-master-1 devstack@keystone.service[80492]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 07 01:36:45.972629 n-d-master-1 devstack@keystone.service[80492]: Failed validating 'minLength' in schema['properties']['name']: Aug 07 01:36:45.972629 n-d-master-1 devstack@keystone.service[80492]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 07 01:36:45.972629 n-d-master-1 devstack@keystone.service[80492]: On instance['name']: Aug 07 01:36:45.972629 n-d-master-1 devstack@keystone.service[80492]: '' Aug 07 01:36:45.972629 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:36:45.972629 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 07 01:36:45.972629 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 07 01:36:45.972629 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:36:45.972629 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise error Aug 07 01:36:45.972629 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Aug 07 01:36:45.972629 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:36:45.972629 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 07 01:36:45.972629 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 07 01:36:45.972629 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:36:45.972629 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application On instance['name']: Aug 07 01:36:45.972629 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application '' Aug 07 01:36:45.972629 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:36:45.972629 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:36:45.979333 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:36:45.979333 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:36:45.979333 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:36:45.979333 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:36:45.979333 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:36:45.979333 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:36:45.979333 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:36:45.979333 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:36:45.979333 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:36:45.979333 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:36:45.979333 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:36:45.979333 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:36:45.979333 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Aug 07 01:36:45.979333 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Aug 07 01:36:45.979333 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 07 01:36:45.979333 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 07 01:36:45.979333 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 07 01:36:45.981243 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 07 01:36:45.981243 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Aug 07 01:36:45.981243 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:36:45.981243 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Aug 07 01:36:45.981243 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 07 01:36:45.981243 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:36:45.981243 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application On instance['name']: Aug 07 01:36:45.981243 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application '' Aug 07 01:36:45.981243 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:36:45.981243 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2741/5456] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Aug 7 01:36:45 2022] POST /identity/v3/domains => generated 283 bytes in 45 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Aug 07 01:36:45.985515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2982f00-5727-4ad5-ab08-fdbf41d35f3a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:46.000761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2982f00-5727-4ad5-ab08-fdbf41d35f3a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:46.013760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f3a80-4fc9-43dd-808a-413863319836 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe535b52fcb40a48ade36126464ae93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aeeb65541b84375b0a9c36dd73d1a91', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:46.014111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f3a80-4fc9-43dd-808a-413863319836 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:46.016752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f3a80-4fc9-43dd-808a-413863319836 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:46.017057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f3a80-4fc9-43dd-808a-413863319836 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:46.017876 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f3a80-4fc9-43dd-808a-413863319836 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:46.019828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f3a80-4fc9-43dd-808a-413863319836 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:46.028850 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-6c6f3a80-4fc9-43dd-808a-413863319836 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 07 01:36:46.028850 n-d-master-1 devstack@keystone.service[80493]: Failed validating 'maxLength' in schema['properties']['name']: Aug 07 01:36:46.028850 n-d-master-1 devstack@keystone.service[80493]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 07 01:36:46.028850 n-d-master-1 devstack@keystone.service[80493]: On instance['name']: Aug 07 01:36:46.028850 n-d-master-1 devstack@keystone.service[80493]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 07 01:36:46.028850 n-d-master-1 devstack@keystone.service[80493]: Failed validating 'maxLength' in schema['properties']['name']: Aug 07 01:36:46.028850 n-d-master-1 devstack@keystone.service[80493]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 07 01:36:46.028850 n-d-master-1 devstack@keystone.service[80493]: On instance['name']: Aug 07 01:36:46.028850 n-d-master-1 devstack@keystone.service[80493]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 07 01:36:46.028850 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:36:46.028850 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 07 01:36:46.028850 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 07 01:36:46.028850 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:36:46.028850 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise error Aug 07 01:36:46.028850 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 07 01:36:46.028850 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:36:46.028850 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 07 01:36:46.028850 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 07 01:36:46.028850 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:36:46.030287 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application On instance['name']: Aug 07 01:36:46.030287 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 07 01:36:46.030287 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:36:46.030287 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:36:46.030287 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:36:46.030287 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:36:46.030287 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:36:46.030287 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:36:46.030287 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:36:46.030287 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:36:46.030287 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:36:46.030287 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:36:46.030287 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:36:46.030287 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:36:46.030287 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:36:46.030287 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:36:46.030287 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Aug 07 01:36:46.030287 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Aug 07 01:36:46.031492 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 07 01:36:46.031492 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 07 01:36:46.031492 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 07 01:36:46.031492 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 07 01:36:46.031492 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 07 01:36:46.031492 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:36:46.031492 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Aug 07 01:36:46.031492 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Aug 07 01:36:46.031492 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:36:46.031492 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application On instance['name']: Aug 07 01:36:46.031492 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 07 01:36:46.031492 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:36:46.031492 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2716/5457] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Aug 7 01:36:45 2022] POST /identity/v3/domains => generated 412 bytes in 46 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 07 01:36:46.036305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a151395-b996-41ad-8a4a-521ee56c890e tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:46.053361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a151395-b996-41ad-8a4a-521ee56c890e tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:46.067281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfe1d0-267a-4634-b122-7d0eab7088ba tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe535b52fcb40a48ade36126464ae93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aeeb65541b84375b0a9c36dd73d1a91', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:46.068776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfe1d0-267a-4634-b122-7d0eab7088ba tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:46.069190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfe1d0-267a-4634-b122-7d0eab7088ba tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:46.069563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfe1d0-267a-4634-b122-7d0eab7088ba tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:46.071072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bfe1d0-267a-4634-b122-7d0eab7088ba tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:46.073394 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bfe1d0-267a-4634-b122-7d0eab7088ba tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:46.126097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f3a80-4fc9-43dd-808a-413863319836 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:46.131190 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2742/5458] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Aug 7 01:36:46 2022] POST /identity/v3/domains => generated 276 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:36:46.139380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f3a80-4fc9-43dd-808a-413863319836 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:46.211579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec5c45-0039-4b34-8be3-6fc3524161ff tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe535b52fcb40a48ade36126464ae93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aeeb65541b84375b0a9c36dd73d1a91', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:46.212724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec5c45-0039-4b34-8be3-6fc3524161ff tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:46.213017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec5c45-0039-4b34-8be3-6fc3524161ff tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:46.213291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec5c45-0039-4b34-8be3-6fc3524161ff tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] PATH_INFO: `/v3/domains/1f309656e7854485bce122e00e6858d1` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:46.226247 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec5c45-0039-4b34-8be3-6fc3524161ff tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1f309656e7854485bce122e00e6858d1)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:46.229125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec5c45-0039-4b34-8be3-6fc3524161ff tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:46.248671 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-d3ec5c45-0039-4b34-8be3-6fc3524161ff tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Aug 07 01:36:46.248671 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:36:46.248671 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:36:46.248671 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:36:46.248671 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:36:46.248671 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:36:46.248671 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:36:46.248671 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:36:46.248671 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:36:46.248671 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:36:46.248671 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:36:46.248671 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:36:46.248671 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Aug 07 01:36:46.248671 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Aug 07 01:36:46.249940 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:36:46.249940 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:36:46.249940 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Aug 07 01:36:46.249940 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Aug 07 01:36:46.249940 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Aug 07 01:36:46.249940 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Aug 07 01:36:46.249940 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Aug 07 01:36:46.249940 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:36:46.250527 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2717/5459] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:36:46 2022] DELETE /identity/v3/domains/1f309656e7854485bce122e00e6858d1 => generated 120 bytes in 125 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:36:46.255174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfe1d0-267a-4634-b122-7d0eab7088ba tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:46.276196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfe1d0-267a-4634-b122-7d0eab7088ba tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:46.282274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9116a92-6c1e-4552-b202-3a5c03b3ea43 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe535b52fcb40a48ade36126464ae93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aeeb65541b84375b0a9c36dd73d1a91', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:46.283028 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9116a92-6c1e-4552-b202-3a5c03b3ea43 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:46.283390 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9116a92-6c1e-4552-b202-3a5c03b3ea43 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:46.283981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9116a92-6c1e-4552-b202-3a5c03b3ea43 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] PATH_INFO: `/v3/domains/1f309656e7854485bce122e00e6858d1` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:46.286254 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9116a92-6c1e-4552-b202-3a5c03b3ea43 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1f309656e7854485bce122e00e6858d1)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:46.287992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9116a92-6c1e-4552-b202-3a5c03b3ea43 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:46.318435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b9116a92-6c1e-4552-b202-3a5c03b3ea43 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1f309656e7854485bce122e00e6858d1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:46.319541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b9116a92-6c1e-4552-b202-3a5c03b3ea43 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1f309656e7854485bce122e00e6858d1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:46.359257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b9116a92-6c1e-4552-b202-3a5c03b3ea43 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1f309656e7854485bce122e00e6858d1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:46.360204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b9116a92-6c1e-4552-b202-3a5c03b3ea43 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1f309656e7854485bce122e00e6858d1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:46.365761 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2743/5460] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:36:46 2022] PATCH /identity/v3/domains/1f309656e7854485bce122e00e6858d1 => generated 277 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:36:46.369943 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec5c45-0039-4b34-8be3-6fc3524161ff tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:46.372132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d3ec5c45-0039-4b34-8be3-6fc3524161ff tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:46.392338 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec5c45-0039-4b34-8be3-6fc3524161ff tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:46.521317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa099d77-266b-4494-a948-47b88a48d35b tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe535b52fcb40a48ade36126464ae93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aeeb65541b84375b0a9c36dd73d1a91', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:46.522684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa099d77-266b-4494-a948-47b88a48d35b tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:46.525613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa099d77-266b-4494-a948-47b88a48d35b tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:46.525613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa099d77-266b-4494-a948-47b88a48d35b tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] PATH_INFO: `/v3/domains/1f309656e7854485bce122e00e6858d1` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:46.549535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa099d77-266b-4494-a948-47b88a48d35b tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1f309656e7854485bce122e00e6858d1)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:46.552323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa099d77-266b-4494-a948-47b88a48d35b tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:46.599044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aa099d77-266b-4494-a948-47b88a48d35b tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1f309656e7854485bce122e00e6858d1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:46.627650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aa099d77-266b-4494-a948-47b88a48d35b tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1f309656e7854485bce122e00e6858d1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:46.629041 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:46.699645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aa099d77-266b-4494-a948-47b88a48d35b tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f309656e7854485bce122e00e6858d1', 'request_id': 'req-aa099d77-266b-4494-a948-47b88a48d35b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:46.706511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aa099d77-266b-4494-a948-47b88a48d35b tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f309656e7854485bce122e00e6858d1', 'request_id': 'req-aa099d77-266b-4494-a948-47b88a48d35b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:46.715834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aa099d77-266b-4494-a948-47b88a48d35b tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f309656e7854485bce122e00e6858d1', 'request_id': 'req-aa099d77-266b-4494-a948-47b88a48d35b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:46.743817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aa099d77-266b-4494-a948-47b88a48d35b tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] The token cache is being invalidate because project 1f309656e7854485bce122e00e6858d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:36:46.744466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aa099d77-266b-4494-a948-47b88a48d35b tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:46.745203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aa099d77-266b-4494-a948-47b88a48d35b tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:46.758955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aa099d77-266b-4494-a948-47b88a48d35b tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1f309656e7854485bce122e00e6858d1', 'request_id': 'req-aa099d77-266b-4494-a948-47b88a48d35b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:46.760161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aa099d77-266b-4494-a948-47b88a48d35b tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1f309656e7854485bce122e00e6858d1', 'request_id': 'req-aa099d77-266b-4494-a948-47b88a48d35b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:46.765191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aa099d77-266b-4494-a948-47b88a48d35b tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1f309656e7854485bce122e00e6858d1', 'request_id': 'req-aa099d77-266b-4494-a948-47b88a48d35b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:46.784853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9116a92-6c1e-4552-b202-3a5c03b3ea43 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:46.797188 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2718/5461] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:36:46 2022] DELETE /identity/v3/domains/1f309656e7854485bce122e00e6858d1 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:46.801202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9116a92-6c1e-4552-b202-3a5c03b3ea43 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:47.007799 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca7dc4-e235-4986-8482-23c6277ca39f tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe535b52fcb40a48ade36126464ae93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aeeb65541b84375b0a9c36dd73d1a91', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:47.009027 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca7dc4-e235-4986-8482-23c6277ca39f tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:47.009412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca7dc4-e235-4986-8482-23c6277ca39f tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:47.009794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca7dc4-e235-4986-8482-23c6277ca39f tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] PATH_INFO: `/v3/domains/0efc9ebeeb714280ad384b4f7d40366f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:47.039751 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca7dc4-e235-4986-8482-23c6277ca39f tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:36:47.060088 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-01ca7dc4-e235-4986-8482-23c6277ca39f tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Could not find domain: 0efc9ebeeb714280ad384b4f7d40366f.: keystone.exception.DomainNotFound: Could not find domain: 0efc9ebeeb714280ad384b4f7d40366f. Aug 07 01:36:47.060088 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:36:47.060088 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 07 01:36:47.060088 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 07 01:36:47.060088 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 01:36:47.060088 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 01:36:47.060088 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 01:36:47.060088 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 01:36:47.060088 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0efc9ebeeb714280ad384b4f7d40366f. Aug 07 01:36:47.060088 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:36:47.060088 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:36:47.060088 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:36:47.060088 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:36:47.060088 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:36:47.060088 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:36:47.061303 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:36:47.061303 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:36:47.061303 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:36:47.061303 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:36:47.061303 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:36:47.061303 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:36:47.061303 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:36:47.061303 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:36:47.061303 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Aug 07 01:36:47.061303 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Aug 07 01:36:47.061303 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:36:47.061303 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:36:47.061303 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:36:47.061303 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:36:47.061303 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:36:47.061303 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:36:47.062923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:36:47.062923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:36:47.062923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:36:47.062923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:36:47.062923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:36:47.062923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 01:36:47.062923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:36:47.062923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:36:47.062923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:36:47.062923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:36:47.062923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:36:47.062923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:36:47.062923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:36:47.062923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:36:47.062923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 07 01:36:47.062923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:36:47.062923 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0efc9ebeeb714280ad384b4f7d40366f. Aug 07 01:36:47.064228 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:36:47.067125 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2744/5462] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:36:46 2022] DELETE /identity/v3/domains/0efc9ebeeb714280ad384b4f7d40366f => generated 112 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:36:47.073835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa099d77-266b-4494-a948-47b88a48d35b tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:47.075951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-aa099d77-266b-4494-a948-47b88a48d35b tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:47.100386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa099d77-266b-4494-a948-47b88a48d35b tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:47.110580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da900c-0800-4a55-9031-d2a19ea46e3f tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe535b52fcb40a48ade36126464ae93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aeeb65541b84375b0a9c36dd73d1a91', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:47.111355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da900c-0800-4a55-9031-d2a19ea46e3f tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:47.111725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da900c-0800-4a55-9031-d2a19ea46e3f tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:47.112170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da900c-0800-4a55-9031-d2a19ea46e3f tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:47.113869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da900c-0800-4a55-9031-d2a19ea46e3f tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:47.115734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da900c-0800-4a55-9031-d2a19ea46e3f tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:47.142828 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2719/5463] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Aug 7 01:36:47 2022] POST /identity/v3/domains => generated 252 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:36:47.148290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca7dc4-e235-4986-8482-23c6277ca39f tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:47.162479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca7dc4-e235-4986-8482-23c6277ca39f tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:47.265500 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:UPDATE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:47.316650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f1dd3-b0aa-42e6-9e52-71a1b2487218 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe535b52fcb40a48ade36126464ae93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aeeb65541b84375b0a9c36dd73d1a91', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:47.318038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f1dd3-b0aa-42e6-9e52-71a1b2487218 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:47.318594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f1dd3-b0aa-42e6-9e52-71a1b2487218 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:47.321614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f1dd3-b0aa-42e6-9e52-71a1b2487218 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:47.322618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f1dd3-b0aa-42e6-9e52-71a1b2487218 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:47.324727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f1dd3-b0aa-42e6-9e52-71a1b2487218 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:47.336110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.sql.core [None req-743f1dd3-b0aa-42e6-9e52-71a1b2487218 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-926672299' for key 'project.ixu_project_name_domain_id'") Aug 07 01:36:47.336110 n-d-master-1 devstack@keystone.service[80492]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 07 01:36:47.336110 n-d-master-1 devstack@keystone.service[80492]: [parameters: {'id': '7327bb78021f4e989c19482114f034a7', 'name': 'tempest-domain-dup-926672299', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Aug 07 01:36:47.336110 n-d-master-1 devstack@keystone.service[80492]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80492) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 07 01:36:47.348782 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-743f1dd3-b0aa-42e6-9e52-71a1b2487218 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-926672299.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-926672299. Aug 07 01:36:47.348782 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:36:47.348782 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 01:36:47.348782 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 01:36:47.348782 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 01:36:47.348782 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 01:36:47.348782 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 01:36:47.348782 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 01:36:47.348782 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 01:36:47.348782 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application conn.query(q) Aug 07 01:36:47.348782 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 01:36:47.348782 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 01:36:47.348782 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 01:36:47.349832 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application result.read() Aug 07 01:36:47.349832 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 01:36:47.349832 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 01:36:47.349832 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 01:36:47.349832 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 01:36:47.349832 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 01:36:47.349832 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 01:36:47.349832 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 01:36:47.349832 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 01:36:47.349832 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-926672299' for key 'project.ixu_project_name_domain_id'") Aug 07 01:36:47.349832 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:36:47.349832 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 07 01:36:47.349832 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:36:47.349832 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:36:47.349832 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 07 01:36:47.349832 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 07 01:36:47.349832 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 07 01:36:47.349832 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 07 01:36:47.351136 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 01:36:47.351136 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application next(self.gen) Aug 07 01:36:47.351136 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 07 01:36:47.351136 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application yield resource Aug 07 01:36:47.351136 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 01:36:47.351136 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application next(self.gen) Aug 07 01:36:47.351136 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 07 01:36:47.351136 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.session.rollback() Aug 07 01:36:47.351136 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:36:47.351136 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.force_reraise() Aug 07 01:36:47.351136 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:36:47.351136 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise self.value Aug 07 01:36:47.351136 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 07 01:36:47.351136 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 07 01:36:47.351136 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 07 01:36:47.351136 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application session.commit() Aug 07 01:36:47.351136 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 07 01:36:47.353319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 07 01:36:47.353319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 07 01:36:47.353319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._prepare_impl() Aug 07 01:36:47.353319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 07 01:36:47.353319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.session.flush() Aug 07 01:36:47.353319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 07 01:36:47.353319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._flush(objects) Aug 07 01:36:47.353319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 07 01:36:47.353319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 07 01:36:47.353319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 07 01:36:47.353319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application compat.raise_( Aug 07 01:36:47.353319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 01:36:47.353319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception Aug 07 01:36:47.353319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 07 01:36:47.353319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application flush_context.execute() Aug 07 01:36:47.353319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 07 01:36:47.353319 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rec.execute(self) Aug 07 01:36:47.354972 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 07 01:36:47.354972 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 07 01:36:47.354972 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 07 01:36:47.354972 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 07 01:36:47.354972 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 07 01:36:47.354972 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 07 01:36:47.354972 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 07 01:36:47.354972 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 07 01:36:47.354972 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 07 01:36:47.354972 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 07 01:36:47.354972 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 07 01:36:47.354972 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 07 01:36:47.354972 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 07 01:36:47.354972 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 07 01:36:47.354972 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 07 01:36:47.358634 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 07 01:36:47.358634 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 01:36:47.358634 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception Aug 07 01:36:47.358634 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 07 01:36:47.358634 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 07 01:36:47.358634 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 07 01:36:47.358634 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 07 01:36:47.358634 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 07 01:36:47.358634 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application result = self._query(query) Aug 07 01:36:47.358634 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 07 01:36:47.358634 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application conn.query(q) Aug 07 01:36:47.358634 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 07 01:36:47.358634 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 07 01:36:47.358634 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 07 01:36:47.358634 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application result.read() Aug 07 01:36:47.358634 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 07 01:36:47.358634 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 07 01:36:47.362554 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 07 01:36:47.362554 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 07 01:36:47.362554 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 07 01:36:47.362554 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 07 01:36:47.362554 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 07 01:36:47.362554 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 07 01:36:47.362554 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-926672299' for key 'project.ixu_project_name_domain_id'") Aug 07 01:36:47.362554 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 07 01:36:47.362554 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [parameters: {'id': '7327bb78021f4e989c19482114f034a7', 'name': 'tempest-domain-dup-926672299', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Aug 07 01:36:47.362554 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 07 01:36:47.362554 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:36:47.362554 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:36:47.362554 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:36:47.362554 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:36:47.365183 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 07 01:36:47.365183 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 07 01:36:47.365183 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 07 01:36:47.365183 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 07 01:36:47.365183 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-926672299. Aug 07 01:36:47.365183 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:36:47.365183 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:36:47.365183 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:36:47.365183 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:36:47.365183 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:36:47.365183 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:36:47.365183 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:36:47.365183 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:36:47.365183 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:36:47.365183 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:36:47.365183 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:36:47.365183 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:36:47.369216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:36:47.369216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:36:47.369216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Aug 07 01:36:47.369216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Aug 07 01:36:47.369216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:36:47.369216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:36:47.369216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Aug 07 01:36:47.369216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Aug 07 01:36:47.369216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:36:47.369216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:36:47.369216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 07 01:36:47.369216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 07 01:36:47.369216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-926672299. Aug 07 01:36:47.369216 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:36:47.369216 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2745/5464] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Aug 7 01:36:47 2022] POST /identity/v3/domains => generated 211 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 07 01:36:47.371733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da900c-0800-4a55-9031-d2a19ea46e3f tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:47.386164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da900c-0800-4a55-9031-d2a19ea46e3f tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:47.399091 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26638f-2ca7-4bbd-a0a5-97424ec38bcc tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe535b52fcb40a48ade36126464ae93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aeeb65541b84375b0a9c36dd73d1a91', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:47.400296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26638f-2ca7-4bbd-a0a5-97424ec38bcc tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:47.400826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26638f-2ca7-4bbd-a0a5-97424ec38bcc tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:47.401336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26638f-2ca7-4bbd-a0a5-97424ec38bcc tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] PATH_INFO: `/v3/domains/81a9a3e936f84ead97f11411b1ba4f82` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:47.419773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26638f-2ca7-4bbd-a0a5-97424ec38bcc tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=81a9a3e936f84ead97f11411b1ba4f82)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:47.421913 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26638f-2ca7-4bbd-a0a5-97424ec38bcc tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:47.470326 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2f26638f-2ca7-4bbd-a0a5-97424ec38bcc tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '81a9a3e936f84ead97f11411b1ba4f82'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:47.472104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2f26638f-2ca7-4bbd-a0a5-97424ec38bcc tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '81a9a3e936f84ead97f11411b1ba4f82'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:47.522766 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2f26638f-2ca7-4bbd-a0a5-97424ec38bcc tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '81a9a3e936f84ead97f11411b1ba4f82'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:47.523816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2f26638f-2ca7-4bbd-a0a5-97424ec38bcc tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '81a9a3e936f84ead97f11411b1ba4f82'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:47.529222 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2720/5465] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:36:47 2022] PATCH /identity/v3/domains/81a9a3e936f84ead97f11411b1ba4f82 => generated 253 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:36:47.531918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f1dd3-b0aa-42e6-9e52-71a1b2487218 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:47.533967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-743f1dd3-b0aa-42e6-9e52-71a1b2487218 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:47.553143 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f1dd3-b0aa-42e6-9e52-71a1b2487218 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:47.647427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8a83d-cb78-4a15-911e-1732568fd040 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe535b52fcb40a48ade36126464ae93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aeeb65541b84375b0a9c36dd73d1a91', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:47.648219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8a83d-cb78-4a15-911e-1732568fd040 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:47.648566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8a83d-cb78-4a15-911e-1732568fd040 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:47.648971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8a83d-cb78-4a15-911e-1732568fd040 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] PATH_INFO: `/v3/domains/81a9a3e936f84ead97f11411b1ba4f82` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:47.664835 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d8a83d-cb78-4a15-911e-1732568fd040 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=81a9a3e936f84ead97f11411b1ba4f82)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:47.667561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d8a83d-cb78-4a15-911e-1732568fd040 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:47.694249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-24d8a83d-cb78-4a15-911e-1732568fd040 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '81a9a3e936f84ead97f11411b1ba4f82'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:47.709440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-24d8a83d-cb78-4a15-911e-1732568fd040 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '81a9a3e936f84ead97f11411b1ba4f82'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:47.784894 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-24d8a83d-cb78-4a15-911e-1732568fd040 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81a9a3e936f84ead97f11411b1ba4f82', 'request_id': 'req-24d8a83d-cb78-4a15-911e-1732568fd040'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:47.794842 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-24d8a83d-cb78-4a15-911e-1732568fd040 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81a9a3e936f84ead97f11411b1ba4f82', 'request_id': 'req-24d8a83d-cb78-4a15-911e-1732568fd040'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:47.803655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-24d8a83d-cb78-4a15-911e-1732568fd040 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81a9a3e936f84ead97f11411b1ba4f82', 'request_id': 'req-24d8a83d-cb78-4a15-911e-1732568fd040'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:47.824561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-24d8a83d-cb78-4a15-911e-1732568fd040 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] The token cache is being invalidate because project 81a9a3e936f84ead97f11411b1ba4f82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:36:47.825087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-24d8a83d-cb78-4a15-911e-1732568fd040 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:47.826230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-24d8a83d-cb78-4a15-911e-1732568fd040 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:47.840062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-24d8a83d-cb78-4a15-911e-1732568fd040 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '81a9a3e936f84ead97f11411b1ba4f82', 'request_id': 'req-24d8a83d-cb78-4a15-911e-1732568fd040'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:47.845254 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-24d8a83d-cb78-4a15-911e-1732568fd040 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '81a9a3e936f84ead97f11411b1ba4f82', 'request_id': 'req-24d8a83d-cb78-4a15-911e-1732568fd040'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:47.847199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-24d8a83d-cb78-4a15-911e-1732568fd040 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '81a9a3e936f84ead97f11411b1ba4f82', 'request_id': 'req-24d8a83d-cb78-4a15-911e-1732568fd040'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:47.855599 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2746/5466] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:36:47 2022] DELETE /identity/v3/domains/81a9a3e936f84ead97f11411b1ba4f82 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:36:47.861551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26638f-2ca7-4bbd-a0a5-97424ec38bcc tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:47.872593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26638f-2ca7-4bbd-a0a5-97424ec38bcc tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:47.996592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb88015-7416-45c3-9a35-8503b38eda51 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fe535b52fcb40a48ade36126464ae93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1aeeb65541b84375b0a9c36dd73d1a91', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:47.997262 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb88015-7416-45c3-9a35-8503b38eda51 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:47.997545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb88015-7416-45c3-9a35-8503b38eda51 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:47.998096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb88015-7416-45c3-9a35-8503b38eda51 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] PATH_INFO: `/v3/domains/1f309656e7854485bce122e00e6858d1` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:48.008545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb88015-7416-45c3-9a35-8503b38eda51 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:36:48.014457 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-6fb88015-7416-45c3-9a35-8503b38eda51 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Could not find domain: 1f309656e7854485bce122e00e6858d1.: keystone.exception.DomainNotFound: Could not find domain: 1f309656e7854485bce122e00e6858d1. Aug 07 01:36:48.014457 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:36:48.014457 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 07 01:36:48.014457 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 07 01:36:48.014457 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 01:36:48.014457 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 01:36:48.014457 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 01:36:48.014457 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 01:36:48.014457 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 1f309656e7854485bce122e00e6858d1. Aug 07 01:36:48.014457 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:36:48.014457 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:36:48.014457 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:36:48.014457 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:36:48.014457 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:36:48.014457 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:36:48.019533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:36:48.019533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:36:48.019533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:36:48.019533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:36:48.019533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:36:48.019533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:36:48.019533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:36:48.019533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:36:48.019533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 07 01:36:48.019533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 07 01:36:48.019533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:36:48.019533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:36:48.019533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:36:48.019533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:36:48.019533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:36:48.019533 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:36:48.020949 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:36:48.020949 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:36:48.020949 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:36:48.020949 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:36:48.020949 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:36:48.020949 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 01:36:48.020949 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:36:48.020949 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:36:48.020949 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:36:48.020949 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:36:48.020949 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:36:48.020949 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:36:48.020949 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:36:48.020949 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:36:48.020949 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 07 01:36:48.020949 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:36:48.020949 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 1f309656e7854485bce122e00e6858d1. Aug 07 01:36:48.022107 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:36:48.022107 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2721/5467] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:36:47 2022] PATCH /identity/v3/domains/1f309656e7854485bce122e00e6858d1 => generated 112 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:36:48.022263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8a83d-cb78-4a15-911e-1732568fd040 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:48.023975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-24d8a83d-cb78-4a15-911e-1732568fd040 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:48.032223 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:48.124425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8a83d-cb78-4a15-911e-1732568fd040 tempest-DomainsNegativeTestJSON-1895450568 tempest-DomainsNegativeTestJSON-1895450568-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:48.132293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f51069-7cdc-4172-8b9c-64c2df8d19be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:48.133236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f51069-7cdc-4172-8b9c-64c2df8d19be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:48.133677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f51069-7cdc-4172-8b9c-64c2df8d19be admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:48.134136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f51069-7cdc-4172-8b9c-64c2df8d19be admin admin] PATH_INFO: `/v3/users/03700ce324e140d6917180880bac026f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:48.135563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f51069-7cdc-4172-8b9c-64c2df8d19be admin admin] RBAC: Authorizing `identity:delete_user(user_id=03700ce324e140d6917180880bac026f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:48.137533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f51069-7cdc-4172-8b9c-64c2df8d19be admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:48.198057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f4f51069-7cdc-4172-8b9c-64c2df8d19be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03700ce324e140d6917180880bac026f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:48.212761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f4f51069-7cdc-4172-8b9c-64c2df8d19be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03700ce324e140d6917180880bac026f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:48.226752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f4f51069-7cdc-4172-8b9c-64c2df8d19be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03700ce324e140d6917180880bac026f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:48.227574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f4f51069-7cdc-4172-8b9c-64c2df8d19be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03700ce324e140d6917180880bac026f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:48.236210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f4f51069-7cdc-4172-8b9c-64c2df8d19be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03700ce324e140d6917180880bac026f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:48.245832 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2747/5468] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:36:48 2022] DELETE /identity/v3/users/03700ce324e140d6917180880bac026f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:48.250383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ddc60-4bf7-49c5-8f8c-38e0b5ad5c76 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:48.251096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ddc60-4bf7-49c5-8f8c-38e0b5ad5c76 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:48.252240 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ddc60-4bf7-49c5-8f8c-38e0b5ad5c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:48.277468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0b5ddc60-4bf7-49c5-8f8c-38e0b5ad5c76 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:36:48.278700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0b5ddc60-4bf7-49c5-8f8c-38e0b5ad5c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:48.286781 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:48.388719 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2722/5469] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:36:48.431701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f51069-7cdc-4172-8b9c-64c2df8d19be admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:48.433471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f4f51069-7cdc-4172-8b9c-64c2df8d19be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:48.564986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f51069-7cdc-4172-8b9c-64c2df8d19be admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:48.568732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9a383-5c2b-4c20-929d-e4a083edf3d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:48.569346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9a383-5c2b-4c20-929d-e4a083edf3d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:48.569629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9a383-5c2b-4c20-929d-e4a083edf3d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:48.569903 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9a383-5c2b-4c20-929d-e4a083edf3d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:48.582293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9a383-5c2b-4c20-929d-e4a083edf3d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:48.583753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9a383-5c2b-4c20-929d-e4a083edf3d9 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:48.598328 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2748/5470] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:36:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:36:50.086155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ddc60-4bf7-49c5-8f8c-38e0b5ad5c76 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:50.086155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0b5ddc60-4bf7-49c5-8f8c-38e0b5ad5c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:50.105842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ddc60-4bf7-49c5-8f8c-38e0b5ad5c76 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:50.114335 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d27ab-ffd9-41fd-8d9c-bc27c065aff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:50.116386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d27ab-ffd9-41fd-8d9c-bc27c065aff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:50.116859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d27ab-ffd9-41fd-8d9c-bc27c065aff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:50.117403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d27ab-ffd9-41fd-8d9c-bc27c065aff6 admin admin] PATH_INFO: `/v3/projects/beed0ca43e2c4df5b102f886472f3a33` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:50.118835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d27ab-ffd9-41fd-8d9c-bc27c065aff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beed0ca43e2c4df5b102f886472f3a33)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:50.121993 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27d27ab-ffd9-41fd-8d9c-bc27c065aff6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:50.287581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a27d27ab-ffd9-41fd-8d9c-bc27c065aff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beed0ca43e2c4df5b102f886472f3a33', 'request_id': 'req-a27d27ab-ffd9-41fd-8d9c-bc27c065aff6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:50.328054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a27d27ab-ffd9-41fd-8d9c-bc27c065aff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beed0ca43e2c4df5b102f886472f3a33', 'request_id': 'req-a27d27ab-ffd9-41fd-8d9c-bc27c065aff6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:50.363625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a27d27ab-ffd9-41fd-8d9c-bc27c065aff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beed0ca43e2c4df5b102f886472f3a33', 'request_id': 'req-a27d27ab-ffd9-41fd-8d9c-bc27c065aff6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:50.404391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a27d27ab-ffd9-41fd-8d9c-bc27c065aff6 admin admin] The token cache is being invalidate because project beed0ca43e2c4df5b102f886472f3a33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:36:50.405038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a27d27ab-ffd9-41fd-8d9c-bc27c065aff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:50.406297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a27d27ab-ffd9-41fd-8d9c-bc27c065aff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:50.422871 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2723/5471] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:36:50 2022] DELETE /identity/v3/projects/beed0ca43e2c4df5b102f886472f3a33 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:50.423349 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9a383-5c2b-4c20-929d-e4a083edf3d9 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:50.461697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9a383-5c2b-4c20-929d-e4a083edf3d9 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:50.509367 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:50.614970 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce91fc-d5ec-498b-a97e-19a6df9e6d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:50.615928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce91fc-d5ec-498b-a97e-19a6df9e6d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:50.616628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce91fc-d5ec-498b-a97e-19a6df9e6d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:50.617154 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce91fc-d5ec-498b-a97e-19a6df9e6d4c admin admin] PATH_INFO: `/v3/users/7fe535b52fcb40a48ade36126464ae93` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:50.619357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce91fc-d5ec-498b-a97e-19a6df9e6d4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fe535b52fcb40a48ade36126464ae93)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:50.621648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce91fc-d5ec-498b-a97e-19a6df9e6d4c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:50.724801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-76ce91fc-d5ec-498b-a97e-19a6df9e6d4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fe535b52fcb40a48ade36126464ae93'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:50.741149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-76ce91fc-d5ec-498b-a97e-19a6df9e6d4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fe535b52fcb40a48ade36126464ae93'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:50.777630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-76ce91fc-d5ec-498b-a97e-19a6df9e6d4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fe535b52fcb40a48ade36126464ae93'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:50.778536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-76ce91fc-d5ec-498b-a97e-19a6df9e6d4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fe535b52fcb40a48ade36126464ae93'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:50.793594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-76ce91fc-d5ec-498b-a97e-19a6df9e6d4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fe535b52fcb40a48ade36126464ae93'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:50.821619 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2749/5472] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:36:50 2022] DELETE /identity/v3/users/7fe535b52fcb40a48ade36126464ae93 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:36:52.180567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d27ab-ffd9-41fd-8d9c-bc27c065aff6 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:52.182103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a27d27ab-ffd9-41fd-8d9c-bc27c065aff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:52.307875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce91fc-d5ec-498b-a97e-19a6df9e6d4c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:52.310116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-76ce91fc-d5ec-498b-a97e-19a6df9e6d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:52.418075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d27ab-ffd9-41fd-8d9c-bc27c065aff6 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:52.436767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce91fc-d5ec-498b-a97e-19a6df9e6d4c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:52.443506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63b716-635a-49af-9ae9-6a42e9c414f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:52.446764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63b716-635a-49af-9ae9-6a42e9c414f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:52.447308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63b716-635a-49af-9ae9-6a42e9c414f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:52.447639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63b716-635a-49af-9ae9-6a42e9c414f8 admin admin] PATH_INFO: `/v3/projects/1aeeb65541b84375b0a9c36dd73d1a91` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:52.449483 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63b716-635a-49af-9ae9-6a42e9c414f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aeeb65541b84375b0a9c36dd73d1a91)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:52.452903 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63b716-635a-49af-9ae9-6a42e9c414f8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:52.471162 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:52.526532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd876654-eccc-44ab-b73a-ebb5821301f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:52.527270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd876654-eccc-44ab-b73a-ebb5821301f1 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:52.527608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd876654-eccc-44ab-b73a-ebb5821301f1 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:52.527995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd876654-eccc-44ab-b73a-ebb5821301f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:52.532459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-fd876654-eccc-44ab-b73a-ebb5821301f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:52.557991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd876654-eccc-44ab-b73a-ebb5821301f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:52.560232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd876654-eccc-44ab-b73a-ebb5821301f1 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:52.561455 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:52.564749 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cb63b716-635a-49af-9ae9-6a42e9c414f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aeeb65541b84375b0a9c36dd73d1a91', 'request_id': 'req-cb63b716-635a-49af-9ae9-6a42e9c414f8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:52.578665 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2724/5473] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:36:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:36:52.602407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cb63b716-635a-49af-9ae9-6a42e9c414f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aeeb65541b84375b0a9c36dd73d1a91', 'request_id': 'req-cb63b716-635a-49af-9ae9-6a42e9c414f8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:52.617875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cb63b716-635a-49af-9ae9-6a42e9c414f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aeeb65541b84375b0a9c36dd73d1a91', 'request_id': 'req-cb63b716-635a-49af-9ae9-6a42e9c414f8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:52.637944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cb63b716-635a-49af-9ae9-6a42e9c414f8 admin admin] The token cache is being invalidate because project 1aeeb65541b84375b0a9c36dd73d1a91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:36:52.638294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cb63b716-635a-49af-9ae9-6a42e9c414f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:52.639278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cb63b716-635a-49af-9ae9-6a42e9c414f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:52.643022 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2750/5474] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:36:52 2022] DELETE /identity/v3/projects/1aeeb65541b84375b0a9c36dd73d1a91 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:36:52.647494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd81495-d22f-44b3-a006-7f7b4c925df9 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:52.649139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd81495-d22f-44b3-a006-7f7b4c925df9 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:52.649493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd81495-d22f-44b3-a006-7f7b4c925df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:52.681479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7fd81495-d22f-44b3-a006-7f7b4c925df9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:36:52.683049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7fd81495-d22f-44b3-a006-7f7b4c925df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:52.763933 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2725/5475] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:36:52.768596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8305e8-79da-4cfc-8b93-fbd63ee600e8 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:52.768969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8305e8-79da-4cfc-8b93-fbd63ee600e8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:52.769381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8305e8-79da-4cfc-8b93-fbd63ee600e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:52.798943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2d8305e8-79da-4cfc-8b93-fbd63ee600e8 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:36:52.801554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2d8305e8-79da-4cfc-8b93-fbd63ee600e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:52.813373 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2751/5476] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:36:52.818651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd81495-d22f-44b3-a006-7f7b4c925df9 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:52.842426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd81495-d22f-44b3-a006-7f7b4c925df9 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:52.865163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fc2cd-8672-4751-ac5b-4e73ee07c4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:52.872944 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fc2cd-8672-4751-ac5b-4e73ee07c4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:52.873297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fc2cd-8672-4751-ac5b-4e73ee07c4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:52.875603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fc2cd-8672-4751-ac5b-4e73ee07c4f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:52.876484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fc2cd-8672-4751-ac5b-4e73ee07c4f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:36:52.879312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fc2cd-8672-4751-ac5b-4e73ee07c4f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:52.884838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fc2cd-8672-4751-ac5b-4e73ee07c4f9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:52.913972 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2726/5477] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:36:52.918781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8305e8-79da-4cfc-8b93-fbd63ee600e8 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:52.930226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8305e8-79da-4cfc-8b93-fbd63ee600e8 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:52.935926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d064135-9ed3-4435-9e51-ab730bd18c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:52.936843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d064135-9ed3-4435-9e51-ab730bd18c3f admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:52.937346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d064135-9ed3-4435-9e51-ab730bd18c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:52.937774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d064135-9ed3-4435-9e51-ab730bd18c3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:52.939248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d064135-9ed3-4435-9e51-ab730bd18c3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:52.943545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d064135-9ed3-4435-9e51-ab730bd18c3f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:53.001884 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2752/5478] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:36:52 2022] POST /identity/v3/projects => generated 369 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:36:53.003686 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fc2cd-8672-4751-ac5b-4e73ee07c4f9 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:53.020399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fc2cd-8672-4751-ac5b-4e73ee07c4f9 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:53.114128 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42afe229-70db-42c2-b74f-c980200b90da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:53.114793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afe229-70db-42c2-b74f-c980200b90da admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:53.115517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afe229-70db-42c2-b74f-c980200b90da admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:53.116041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afe229-70db-42c2-b74f-c980200b90da admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:53.117497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42afe229-70db-42c2-b74f-c980200b90da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:53.119690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42afe229-70db-42c2-b74f-c980200b90da admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:53.188983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d064135-9ed3-4435-9e51-ab730bd18c3f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:53.189360 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2727/5479] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:36:53 2022] POST /identity/v3/users => generated 285 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:36:53.215598 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d064135-9ed3-4435-9e51-ab730bd18c3f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:53.224721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8cc8e-301d-4a6b-961e-7b13025ba2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:53.225433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8cc8e-301d-4a6b-961e-7b13025ba2ae admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:53.225780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8cc8e-301d-4a6b-961e-7b13025ba2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:53.226123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8cc8e-301d-4a6b-961e-7b13025ba2ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:53.226851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8cc8e-301d-4a6b-961e-7b13025ba2ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:53.231737 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8cc8e-301d-4a6b-961e-7b13025ba2ae admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:53.253858 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2753/5480] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:36:53.258387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42afe229-70db-42c2-b74f-c980200b90da admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:53.277630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42afe229-70db-42c2-b74f-c980200b90da admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:53.284532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452e3a1-2bd5-4b17-af4e-3fd8a13157eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:53.285090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452e3a1-2bd5-4b17-af4e-3fd8a13157eb admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:53.285365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452e3a1-2bd5-4b17-af4e-3fd8a13157eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:53.285637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452e3a1-2bd5-4b17-af4e-3fd8a13157eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:53.286351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452e3a1-2bd5-4b17-af4e-3fd8a13157eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:53.290284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452e3a1-2bd5-4b17-af4e-3fd8a13157eb admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:53.343531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8cc8e-301d-4a6b-961e-7b13025ba2ae admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:53.350191 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2728/5481] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:36:53.362870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8cc8e-301d-4a6b-961e-7b13025ba2ae admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:53.367956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732562c-046b-4b53-80ca-1d3f4b72f597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:53.368978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732562c-046b-4b53-80ca-1d3f4b72f597 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:53.369489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732562c-046b-4b53-80ca-1d3f4b72f597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:53.370338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732562c-046b-4b53-80ca-1d3f4b72f597 admin admin] PATH_INFO: `/v3/projects/957dc086bbc846e6aafeeff68f7ed6c5/users/dccaeecb6fbb483e91c93a1a7e38059f/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:53.390296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732562c-046b-4b53-80ca-1d3f4b72f597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=957dc086bbc846e6aafeeff68f7ed6c5, user_id=dccaeecb6fbb483e91c93a1a7e38059f, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:53.398385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452e3a1-2bd5-4b17-af4e-3fd8a13157eb admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:53.400278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9452e3a1-2bd5-4b17-af4e-3fd8a13157eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:53.400450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732562c-046b-4b53-80ca-1d3f4b72f597 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:53.423207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452e3a1-2bd5-4b17-af4e-3fd8a13157eb admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:53.431397 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2754/5482] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:36:53 2022] PUT /identity/v3/projects/957dc086bbc846e6aafeeff68f7ed6c5/users/dccaeecb6fbb483e91c93a1a7e38059f/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:53.433279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33583d2d-6974-4471-996f-51aa9ec4c31a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:53.433800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33583d2d-6974-4471-996f-51aa9ec4c31a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:53.434284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33583d2d-6974-4471-996f-51aa9ec4c31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:53.498360 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:53.516970 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-33583d2d-6974-4471-996f-51aa9ec4c31a None None] MFA Rules not processed for user `dccaeecb6fbb483e91c93a1a7e38059f`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:36:53.519543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-33583d2d-6974-4471-996f-51aa9ec4c31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:53.563830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8bf49-76f3-4316-bd37-dfd720c463d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:53.564866 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8bf49-76f3-4316-bd37-dfd720c463d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:53.565642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8bf49-76f3-4316-bd37-dfd720c463d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:53.565937 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8bf49-76f3-4316-bd37-dfd720c463d6 admin admin] PATH_INFO: `/v3/users/1e08144123ad4d3e93e6b6fbe2acf03a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:53.573239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8bf49-76f3-4316-bd37-dfd720c463d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e08144123ad4d3e93e6b6fbe2acf03a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:53.574795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8bf49-76f3-4316-bd37-dfd720c463d6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:53.672849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-75f8bf49-76f3-4316-bd37-dfd720c463d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e08144123ad4d3e93e6b6fbe2acf03a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:53.689355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-75f8bf49-76f3-4316-bd37-dfd720c463d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e08144123ad4d3e93e6b6fbe2acf03a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:53.711031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-75f8bf49-76f3-4316-bd37-dfd720c463d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e08144123ad4d3e93e6b6fbe2acf03a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:53.712729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-75f8bf49-76f3-4316-bd37-dfd720c463d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e08144123ad4d3e93e6b6fbe2acf03a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:53.736431 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2755/5483] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:36:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:36:53.738217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33583d2d-6974-4471-996f-51aa9ec4c31a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:53.744398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-75f8bf49-76f3-4316-bd37-dfd720c463d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e08144123ad4d3e93e6b6fbe2acf03a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:53.760421 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2729/5484] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:36:53 2022] DELETE /identity/v3/users/1e08144123ad4d3e93e6b6fbe2acf03a => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:53.769767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fff18a-7873-4e70-b999-17317bd4c224 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:53.770232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fff18a-7873-4e70-b999-17317bd4c224 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:53.770534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fff18a-7873-4e70-b999-17317bd4c224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:53.776493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33583d2d-6974-4471-996f-51aa9ec4c31a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:53.796521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e7fff18a-7873-4e70-b999-17317bd4c224 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:36:53.798233 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e7fff18a-7873-4e70-b999-17317bd4c224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:53.866399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d72f63-7021-4279-8adb-5cb583b7861c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:53.867187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d72f63-7021-4279-8adb-5cb583b7861c admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:53.867571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d72f63-7021-4279-8adb-5cb583b7861c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:53.868346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d72f63-7021-4279-8adb-5cb583b7861c admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:53.868946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d72f63-7021-4279-8adb-5cb583b7861c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:53.871723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d72f63-7021-4279-8adb-5cb583b7861c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:53.878069 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:53.924463 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2730/5485] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:36:53.943094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fff18a-7873-4e70-b999-17317bd4c224 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:53.944884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e7fff18a-7873-4e70-b999-17317bd4c224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:53.949232 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2756/5486] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:36:53 2022] POST /identity/v3/projects => generated 369 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:36:53.952588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d72f63-7021-4279-8adb-5cb583b7861c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:53.957278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-47d72f63-7021-4279-8adb-5cb583b7861c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:54.090027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fff18a-7873-4e70-b999-17317bd4c224 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:54.103449 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:54.137508 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d72f63-7021-4279-8adb-5cb583b7861c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:54.194740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5eaeda-1f5f-4323-92cb-ddf0423885c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:54.198309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5eaeda-1f5f-4323-92cb-ddf0423885c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:54.199209 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5eaeda-1f5f-4323-92cb-ddf0423885c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:54.202841 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5eaeda-1f5f-4323-92cb-ddf0423885c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:54.209917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5eaeda-1f5f-4323-92cb-ddf0423885c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:54.227845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5eaeda-1f5f-4323-92cb-ddf0423885c1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:54.230774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722f243-d7c5-4966-9362-a6e7042efe34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:54.231450 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722f243-d7c5-4966-9362-a6e7042efe34 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:54.231740 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722f243-d7c5-4966-9362-a6e7042efe34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:54.232064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722f243-d7c5-4966-9362-a6e7042efe34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:54.257761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722f243-d7c5-4966-9362-a6e7042efe34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:54.260088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722f243-d7c5-4966-9362-a6e7042efe34 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:54.293422 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2731/5487] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:36:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:36:54.320414 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2757/5488] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:36:53 2022] POST /identity/v3/users => generated 291 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:36:54.323589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722f243-d7c5-4966-9362-a6e7042efe34 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:54.337837 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722f243-d7c5-4966-9362-a6e7042efe34 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:54.348233 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2248db-d754-47ae-a3cd-a028c0cf974e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:54.348865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2248db-d754-47ae-a3cd-a028c0cf974e admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:54.349266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2248db-d754-47ae-a3cd-a028c0cf974e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:54.349447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2248db-d754-47ae-a3cd-a028c0cf974e admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:54.350041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2248db-d754-47ae-a3cd-a028c0cf974e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:54.351654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2248db-d754-47ae-a3cd-a028c0cf974e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:54.381317 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2732/5489] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:36:54.388319 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5eaeda-1f5f-4323-92cb-ddf0423885c1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:54.449317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5eaeda-1f5f-4323-92cb-ddf0423885c1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:54.458681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cdd7a2-6836-4fab-8c9b-6891134db669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:54.460084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdd7a2-6836-4fab-8c9b-6891134db669 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:54.460651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdd7a2-6836-4fab-8c9b-6891134db669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:54.461095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdd7a2-6836-4fab-8c9b-6891134db669 admin admin] PATH_INFO: `/v3/projects/0fe36d3c63664918a548147c6d470bf9/users/32a23810d07045c7b78487abc8c389d0/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:54.494704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cdd7a2-6836-4fab-8c9b-6891134db669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fe36d3c63664918a548147c6d470bf9, user_id=32a23810d07045c7b78487abc8c389d0, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:54.504470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cdd7a2-6836-4fab-8c9b-6891134db669 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:54.551749 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2758/5490] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:36:54 2022] PUT /identity/v3/projects/0fe36d3c63664918a548147c6d470bf9/users/32a23810d07045c7b78487abc8c389d0/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:54.554062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2248db-d754-47ae-a3cd-a028c0cf974e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:54.572682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2248db-d754-47ae-a3cd-a028c0cf974e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:54.749224 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28240b5e-385a-4c67-b561-456820c460eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:54.749856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28240b5e-385a-4c67-b561-456820c460eb admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:54.750138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28240b5e-385a-4c67-b561-456820c460eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:54.751289 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28240b5e-385a-4c67-b561-456820c460eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:54.752004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28240b5e-385a-4c67-b561-456820c460eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:54.773428 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28240b5e-385a-4c67-b561-456820c460eb admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:54.805062 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2733/5491] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:36:54.809811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cdd7a2-6836-4fab-8c9b-6891134db669 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:54.830477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cdd7a2-6836-4fab-8c9b-6891134db669 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:54.846018 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ece884-717e-4566-87e7-09b9301be9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:54.847436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ece884-717e-4566-87e7-09b9301be9ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:54.849349 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ece884-717e-4566-87e7-09b9301be9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:54.849831 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ece884-717e-4566-87e7-09b9301be9ac admin admin] PATH_INFO: `/v3/projects/0fe36d3c63664918a548147c6d470bf9/users/32a23810d07045c7b78487abc8c389d0/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:54.863858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ece884-717e-4566-87e7-09b9301be9ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fe36d3c63664918a548147c6d470bf9, user_id=32a23810d07045c7b78487abc8c389d0, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:54.867068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ece884-717e-4566-87e7-09b9301be9ac admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:54.904146 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2759/5492] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:36:54 2022] PUT /identity/v3/projects/0fe36d3c63664918a548147c6d470bf9/users/32a23810d07045c7b78487abc8c389d0/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:54.916329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ddcb7-ef2f-449b-8315-8e1ffb87a3d8 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:54.916620 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ddcb7-ef2f-449b-8315-8e1ffb87a3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:54.916897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ddcb7-ef2f-449b-8315-8e1ffb87a3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:54.959232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-017ddcb7-ef2f-449b-8315-8e1ffb87a3d8 None None] MFA Rules not processed for user `32a23810d07045c7b78487abc8c389d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:36:54.960603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-017ddcb7-ef2f-449b-8315-8e1ffb87a3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:55.116711 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2734/5493] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:36:54 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:36:55.120511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ece884-717e-4566-87e7-09b9301be9ac admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:55.147157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ece884-717e-4566-87e7-09b9301be9ac admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:55.163088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a851c8-3c48-414b-add8-7800c796a614 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:55.164152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a851c8-3c48-414b-add8-7800c796a614 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:55.164513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a851c8-3c48-414b-add8-7800c796a614 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:55.164932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a851c8-3c48-414b-add8-7800c796a614 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:55.165763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a851c8-3c48-414b-add8-7800c796a614 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:55.169067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a851c8-3c48-414b-add8-7800c796a614 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:55.229737 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2760/5494] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Aug 7 01:36:55 2022] POST /identity/v3/domains => generated 277 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:36:55.231061 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ddcb7-ef2f-449b-8315-8e1ffb87a3d8 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:55.248346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ddcb7-ef2f-449b-8315-8e1ffb87a3d8 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:55.305110 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:55.405480 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb04ddb-f44b-41d4-8c60-a4a3c7150fed tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:55.406120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb04ddb-f44b-41d4-8c60-a4a3c7150fed tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:55.406407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb04ddb-f44b-41d4-8c60-a4a3c7150fed tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:55.406690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb04ddb-f44b-41d4-8c60-a4a3c7150fed tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/groups` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:55.407334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb04ddb-f44b-41d4-8c60-a4a3c7150fed tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:55.411229 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb04ddb-f44b-41d4-8c60-a4a3c7150fed tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:55.475440 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2735/5495] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:36:55 2022] POST /identity/v3/groups => generated 281 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:36:55.480921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a851c8-3c48-414b-add8-7800c796a614 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:55.501691 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a851c8-3c48-414b-add8-7800c796a614 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:55.514001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0b266-d368-46d4-b003-6a2340c8a745 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:55.515162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0b266-d368-46d4-b003-6a2340c8a745 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:55.515613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0b266-d368-46d4-b003-6a2340c8a745 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:55.516096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0b266-d368-46d4-b003-6a2340c8a745 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/groups/5321e420f0f643998192e2a5195bdf16` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:55.531764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0b266-d368-46d4-b003-6a2340c8a745 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:update_group(group_id=5321e420f0f643998192e2a5195bdf16)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:55.533171 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-78a0b266-d368-46d4-b003-6a2340c8a745 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:36:55.533171 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:36:55.533171 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:36:55.535379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0b266-d368-46d4-b003-6a2340c8a745 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:55.572515 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2761/5496] 10.222.0.39 () {60 vars in 1247 bytes} [Sun Aug 7 01:36:55 2022] PATCH /identity/v3/groups/5321e420f0f643998192e2a5195bdf16 => generated 292 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:36:55.576695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb04ddb-f44b-41d4-8c60-a4a3c7150fed tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:55.599009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb04ddb-f44b-41d4-8c60-a4a3c7150fed tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:55.614707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8e8d7-576c-4050-9410-e9ef2f863885 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:55.615370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8e8d7-576c-4050-9410-e9ef2f863885 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:55.615652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8e8d7-576c-4050-9410-e9ef2f863885 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:55.615949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8e8d7-576c-4050-9410-e9ef2f863885 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/groups/5321e420f0f643998192e2a5195bdf16` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:55.629626 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8e8d7-576c-4050-9410-e9ef2f863885 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:get_group(group_id=5321e420f0f643998192e2a5195bdf16)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:55.630686 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-33c8e8d7-576c-4050-9410-e9ef2f863885 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:36:55.630686 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:36:55.630686 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:36:55.631917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8e8d7-576c-4050-9410-e9ef2f863885 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:55.633989 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2736/5497] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:36:55 2022] GET /identity/v3/groups/5321e420f0f643998192e2a5195bdf16 => generated 292 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:36:55.637795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0b266-d368-46d4-b003-6a2340c8a745 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:55.657649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0b266-d368-46d4-b003-6a2340c8a745 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:55.669499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cba08-c22c-4de8-8af9-bbf222a86ea0 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:55.670152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cba08-c22c-4de8-8af9-bbf222a86ea0 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:55.670433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cba08-c22c-4de8-8af9-bbf222a86ea0 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:55.670709 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cba08-c22c-4de8-8af9-bbf222a86ea0 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/groups/5321e420f0f643998192e2a5195bdf16` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:55.671982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70cba08-c22c-4de8-8af9-bbf222a86ea0 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:update_group(group_id=5321e420f0f643998192e2a5195bdf16)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:55.673898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70cba08-c22c-4de8-8af9-bbf222a86ea0 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:55.707827 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2762/5498] 10.222.0.39 () {60 vars in 1246 bytes} [Sun Aug 7 01:36:55 2022] PATCH /identity/v3/groups/5321e420f0f643998192e2a5195bdf16 => generated 309 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:36:55.713265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8e8d7-576c-4050-9410-e9ef2f863885 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:55.736350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8e8d7-576c-4050-9410-e9ef2f863885 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:55.754263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d904310-b4d7-4576-a388-aeca6c03ce3e tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:55.755996 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d904310-b4d7-4576-a388-aeca6c03ce3e tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:55.756359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d904310-b4d7-4576-a388-aeca6c03ce3e tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:55.756717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d904310-b4d7-4576-a388-aeca6c03ce3e tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/groups/5321e420f0f643998192e2a5195bdf16` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:55.780920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d904310-b4d7-4576-a388-aeca6c03ce3e tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:delete_group(group_id=5321e420f0f643998192e2a5195bdf16)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:55.791097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d904310-b4d7-4576-a388-aeca6c03ce3e tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:55.943193 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2737/5499] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Aug 7 01:36:55 2022] DELETE /identity/v3/groups/5321e420f0f643998192e2a5195bdf16 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:55.950368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cba08-c22c-4de8-8af9-bbf222a86ea0 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:55.974646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cba08-c22c-4de8-8af9-bbf222a86ea0 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:56.062276 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:INSERT=7,keystone:UPDATE=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:56.080206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e27204-9f14-4c91-ad38-41d755751e07 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:56.081464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e27204-9f14-4c91-ad38-41d755751e07 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:56.081973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e27204-9f14-4c91-ad38-41d755751e07 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:56.082495 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e27204-9f14-4c91-ad38-41d755751e07 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/groups` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:56.083355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e27204-9f14-4c91-ad38-41d755751e07 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:56.084630 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-b2e27204-9f14-4c91-ad38-41d755751e07 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:36:56.084630 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:36:56.084630 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:36:56.086596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e27204-9f14-4c91-ad38-41d755751e07 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:56.109184 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2763/5500] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:36:55 2022] POST /identity/v3/groups => generated 327 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:36:56.114473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d904310-b4d7-4576-a388-aeca6c03ce3e tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:56.126814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d904310-b4d7-4576-a388-aeca6c03ce3e tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:56.132391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc483c-8228-4848-a571-f0056617d0a0 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:56.133010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc483c-8228-4848-a571-f0056617d0a0 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:56.133294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc483c-8228-4848-a571-f0056617d0a0 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:56.134571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc483c-8228-4848-a571-f0056617d0a0 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:56.135242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc483c-8228-4848-a571-f0056617d0a0 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:56.137608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bc483c-8228-4848-a571-f0056617d0a0 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:56.182167 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2738/5501] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:36:56 2022] POST /identity/v3/users => generated 321 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:36:56.187181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e27204-9f14-4c91-ad38-41d755751e07 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:56.210017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e27204-9f14-4c91-ad38-41d755751e07 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:56.215097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5efca-b0ad-4e56-a416-0ffe961766aa tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:56.215806 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5efca-b0ad-4e56-a416-0ffe961766aa tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:56.216595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5efca-b0ad-4e56-a416-0ffe961766aa tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:56.216873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5efca-b0ad-4e56-a416-0ffe961766aa tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/groups/a3b2f136b5b04ed397d3b65c69ebd94b/users/365db875ed0a4f0ca2cdaea36129531f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:56.248120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5efca-b0ad-4e56-a416-0ffe961766aa tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=a3b2f136b5b04ed397d3b65c69ebd94b, user_id=365db875ed0a4f0ca2cdaea36129531f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:56.249119 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-5bc5efca-b0ad-4e56-a416-0ffe961766aa tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:36:56.249119 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:36:56.249119 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:36:56.250297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5efca-b0ad-4e56-a416-0ffe961766aa tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:56.289536 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2764/5502] 10.222.0.39 () {60 vars in 1360 bytes} [Sun Aug 7 01:36:56 2022] PUT /identity/v3/groups/a3b2f136b5b04ed397d3b65c69ebd94b/users/365db875ed0a4f0ca2cdaea36129531f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:56.290804 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc483c-8228-4848-a571-f0056617d0a0 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:56.308076 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc483c-8228-4848-a571-f0056617d0a0 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:56.315286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5efca-b0ad-4e56-a416-0ffe961766aa tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:56.318078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5bc5efca-b0ad-4e56-a416-0ffe961766aa tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:56.489178 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4b5ed-363e-4ee6-8087-89c9931434cc tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:56.489897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4b5ed-363e-4ee6-8087-89c9931434cc tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:56.490184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4b5ed-363e-4ee6-8087-89c9931434cc tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:56.490458 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4b5ed-363e-4ee6-8087-89c9931434cc tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:56.491542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4b5ed-363e-4ee6-8087-89c9931434cc tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:56.491710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5efca-b0ad-4e56-a416-0ffe961766aa tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:56.493209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4b5ed-363e-4ee6-8087-89c9931434cc tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:56.510938 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a590d-004b-4760-91ea-a3e81a96beba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:56.511520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a590d-004b-4760-91ea-a3e81a96beba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:56.511801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a590d-004b-4760-91ea-a3e81a96beba admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:56.512130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a590d-004b-4760-91ea-a3e81a96beba admin admin] PATH_INFO: `/v3/projects/f3e3bf9d373e43bea6c02b31d2e2e2ed` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:56.513390 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a590d-004b-4760-91ea-a3e81a96beba admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3e3bf9d373e43bea6c02b31d2e2e2ed)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:56.515613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a590d-004b-4760-91ea-a3e81a96beba admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:56.579376 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2739/5503] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:36:56 2022] POST /identity/v3/users => generated 323 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:36:56.581783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4b5ed-363e-4ee6-8087-89c9931434cc tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:56.618121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4b5ed-363e-4ee6-8087-89c9931434cc tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:56.636525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c50a590d-004b-4760-91ea-a3e81a96beba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'request_id': 'req-c50a590d-004b-4760-91ea-a3e81a96beba'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:56.639231 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:INSERT=7,keystone:DELETE=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:56.650371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c50a590d-004b-4760-91ea-a3e81a96beba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'request_id': 'req-c50a590d-004b-4760-91ea-a3e81a96beba'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:56.673280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c50a590d-004b-4760-91ea-a3e81a96beba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3e3bf9d373e43bea6c02b31d2e2e2ed', 'request_id': 'req-c50a590d-004b-4760-91ea-a3e81a96beba'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:56.697893 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c50a590d-004b-4760-91ea-a3e81a96beba admin admin] The token cache is being invalidate because project f3e3bf9d373e43bea6c02b31d2e2e2ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:36:56.698183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c50a590d-004b-4760-91ea-a3e81a96beba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:56.699012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c50a590d-004b-4760-91ea-a3e81a96beba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:56.702371 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2765/5504] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:36:56 2022] DELETE /identity/v3/projects/f3e3bf9d373e43bea6c02b31d2e2e2ed => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:56.710817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62caae-c345-45d7-a0d7-a8e3a245fb33 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:56.711314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62caae-c345-45d7-a0d7-a8e3a245fb33 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:56.711908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62caae-c345-45d7-a0d7-a8e3a245fb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:56.719271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2f4e1-4e4c-4d99-9c74-74944eac8af3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:56.720517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2f4e1-4e4c-4d99-9c74-74944eac8af3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:56.721899 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2f4e1-4e4c-4d99-9c74-74944eac8af3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:56.722466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2f4e1-4e4c-4d99-9c74-74944eac8af3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/groups/a3b2f136b5b04ed397d3b65c69ebd94b/users/cea76431867f41d99869167f7f833193` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:56.762635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2b62caae-c345-45d7-a0d7-a8e3a245fb33 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:36:56.764810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2f4e1-4e4c-4d99-9c74-74944eac8af3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=a3b2f136b5b04ed397d3b65c69ebd94b, user_id=cea76431867f41d99869167f7f833193)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:56.765366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2b62caae-c345-45d7-a0d7-a8e3a245fb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:56.769786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2f4e1-4e4c-4d99-9c74-74944eac8af3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:56.825538 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2740/5505] 10.222.0.39 () {60 vars in 1360 bytes} [Sun Aug 7 01:36:56 2022] PUT /identity/v3/groups/a3b2f136b5b04ed397d3b65c69ebd94b/users/cea76431867f41d99869167f7f833193 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:56.832004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2f4e1-4e4c-4d99-9c74-74944eac8af3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:56.840071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-14c2f4e1-4e4c-4d99-9c74-74944eac8af3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:56.852424 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:56.946629 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2766/5506] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:36:56.955331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a000f-23b2-4dbe-8d04-544c49325487 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:56.955782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a000f-23b2-4dbe-8d04-544c49325487 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:56.956293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a000f-23b2-4dbe-8d04-544c49325487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:56.992651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-099a000f-23b2-4dbe-8d04-544c49325487 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:36:56.995520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-099a000f-23b2-4dbe-8d04-544c49325487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:57.011179 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2f4e1-4e4c-4d99-9c74-74944eac8af3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:57.026608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3645ae4-a210-4a74-9ff8-32339903ff9a tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:57.027231 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3645ae4-a210-4a74-9ff8-32339903ff9a tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:57.027511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3645ae4-a210-4a74-9ff8-32339903ff9a tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:57.027782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3645ae4-a210-4a74-9ff8-32339903ff9a tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:57.028439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3645ae4-a210-4a74-9ff8-32339903ff9a tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:57.030293 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3645ae4-a210-4a74-9ff8-32339903ff9a tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:57.073492 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2741/5507] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:36:56 2022] POST /identity/v3/users => generated 323 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:36:57.074934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3645ae4-a210-4a74-9ff8-32339903ff9a tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:57.087447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3645ae4-a210-4a74-9ff8-32339903ff9a tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:57.094368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca560110-cddc-43ed-8aa7-b64c3cd2d058 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:57.094833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca560110-cddc-43ed-8aa7-b64c3cd2d058 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:57.095116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca560110-cddc-43ed-8aa7-b64c3cd2d058 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:57.095386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca560110-cddc-43ed-8aa7-b64c3cd2d058 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/groups/a3b2f136b5b04ed397d3b65c69ebd94b/users/5b97825c09ef4d639891f7b053f1a976` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:57.116733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca560110-cddc-43ed-8aa7-b64c3cd2d058 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=a3b2f136b5b04ed397d3b65c69ebd94b, user_id=5b97825c09ef4d639891f7b053f1a976)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:57.120087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca560110-cddc-43ed-8aa7-b64c3cd2d058 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:57.159220 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2742/5508] 10.222.0.39 () {60 vars in 1360 bytes} [Sun Aug 7 01:36:57 2022] PUT /identity/v3/groups/a3b2f136b5b04ed397d3b65c69ebd94b/users/5b97825c09ef4d639891f7b053f1a976 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:57.167344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca560110-cddc-43ed-8aa7-b64c3cd2d058 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:57.169176 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2767/5509] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:36:57.170625 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a000f-23b2-4dbe-8d04-544c49325487 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:57.194036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a000f-23b2-4dbe-8d04-544c49325487 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:57.243113 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:57.283221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca560110-cddc-43ed-8aa7-b64c3cd2d058 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:57.300056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc9cb1-d286-4a1d-a70f-0179a3135217 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:57.300757 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc9cb1-d286-4a1d-a70f-0179a3135217 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:57.301142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc9cb1-d286-4a1d-a70f-0179a3135217 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:57.301855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc9cb1-d286-4a1d-a70f-0179a3135217 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/groups/a3b2f136b5b04ed397d3b65c69ebd94b/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:57.302661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc9cb1-d286-4a1d-a70f-0179a3135217 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=a3b2f136b5b04ed397d3b65c69ebd94b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:57.303814 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-8adc9cb1-d286-4a1d-a70f-0179a3135217 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:36:57.303814 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:36:57.303814 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:36:57.305083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc9cb1-d286-4a1d-a70f-0179a3135217 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:57.317533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf3884-3663-4d35-a50c-6810aa30dbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:57.318155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf3884-3663-4d35-a50c-6810aa30dbd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:57.318427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf3884-3663-4d35-a50c-6810aa30dbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:57.318691 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf3884-3663-4d35-a50c-6810aa30dbd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:57.319344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf3884-3663-4d35-a50c-6810aa30dbd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:36:57.319645 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf3884-3663-4d35-a50c-6810aa30dbd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:57.324439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf3884-3663-4d35-a50c-6810aa30dbd9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:57.326766 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2743/5510] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Aug 7 01:36:57 2022] GET /identity/v3/groups/a3b2f136b5b04ed397d3b65c69ebd94b/users => generated 1083 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:36:57.334383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc9cb1-d286-4a1d-a70f-0179a3135217 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:57.345265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc9cb1-d286-4a1d-a70f-0179a3135217 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:57.352607 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ca759-d838-4637-8cf4-67babb40761e tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:57.353316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ca759-d838-4637-8cf4-67babb40761e tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:57.353767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ca759-d838-4637-8cf4-67babb40761e tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:57.354380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ca759-d838-4637-8cf4-67babb40761e tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/groups/a3b2f136b5b04ed397d3b65c69ebd94b/users/365db875ed0a4f0ca2cdaea36129531f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:57.355911 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2768/5511] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:36:57.356315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ca759-d838-4637-8cf4-67babb40761e tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=a3b2f136b5b04ed397d3b65c69ebd94b, user_id=365db875ed0a4f0ca2cdaea36129531f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:57.357440 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-b66ca759-d838-4637-8cf4-67babb40761e tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:36:57.357440 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:36:57.357440 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:36:57.358631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ca759-d838-4637-8cf4-67babb40761e tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:57.360563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf3884-3663-4d35-a50c-6810aa30dbd9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:57.377027 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2744/5512] 10.222.0.39 () {58 vars in 1342 bytes} [Sun Aug 7 01:36:57 2022] HEAD /identity/v3/groups/a3b2f136b5b04ed397d3b65c69ebd94b/users/365db875ed0a4f0ca2cdaea36129531f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:57.379077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf3884-3663-4d35-a50c-6810aa30dbd9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:57.381252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ca759-d838-4637-8cf4-67babb40761e tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:57.393576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ca759-d838-4637-8cf4-67babb40761e tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:57.396788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe3052-43a4-4b0b-a562-c3b50bf48681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:57.397410 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe3052-43a4-4b0b-a562-c3b50bf48681 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:57.397687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe3052-43a4-4b0b-a562-c3b50bf48681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:57.397958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe3052-43a4-4b0b-a562-c3b50bf48681 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:57.398590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe3052-43a4-4b0b-a562-c3b50bf48681 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:57.399615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd4842-6d4e-4ce6-9f15-bfb0895cba28 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:57.400523 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe3052-43a4-4b0b-a562-c3b50bf48681 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:57.400955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd4842-6d4e-4ce6-9f15-bfb0895cba28 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:57.401452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd4842-6d4e-4ce6-9f15-bfb0895cba28 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:57.402023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd4842-6d4e-4ce6-9f15-bfb0895cba28 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/groups/a3b2f136b5b04ed397d3b65c69ebd94b/users/365db875ed0a4f0ca2cdaea36129531f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:57.404258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd4842-6d4e-4ce6-9f15-bfb0895cba28 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=a3b2f136b5b04ed397d3b65c69ebd94b, user_id=365db875ed0a4f0ca2cdaea36129531f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:57.406417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd4842-6d4e-4ce6-9f15-bfb0895cba28 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:57.420065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-13bd4842-6d4e-4ce6-9f15-bfb0895cba28 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '365db875ed0a4f0ca2cdaea36129531f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:57.455057 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2769/5514] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:36:57 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:36:57.456343 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2745/5514] 10.222.0.39 () {58 vars in 1344 bytes} [Sun Aug 7 01:36:57 2022] DELETE /identity/v3/groups/a3b2f136b5b04ed397d3b65c69ebd94b/users/365db875ed0a4f0ca2cdaea36129531f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:57.457965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe3052-43a4-4b0b-a562-c3b50bf48681 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:57.459677 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd4842-6d4e-4ce6-9f15-bfb0895cba28 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:57.594863 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:57.629491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe3052-43a4-4b0b-a562-c3b50bf48681 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:57.645799 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514e878-c046-447f-8b19-dc2493cb4c07 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:57.646498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514e878-c046-447f-8b19-dc2493cb4c07 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:57.646767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514e878-c046-447f-8b19-dc2493cb4c07 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:57.647040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514e878-c046-447f-8b19-dc2493cb4c07 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/groups/a3b2f136b5b04ed397d3b65c69ebd94b/users/cea76431867f41d99869167f7f833193` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:57.650721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd4842-6d4e-4ce6-9f15-bfb0895cba28 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:57.652743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514e878-c046-447f-8b19-dc2493cb4c07 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=a3b2f136b5b04ed397d3b65c69ebd94b, user_id=cea76431867f41d99869167f7f833193)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:57.653790 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-e514e878-c046-447f-8b19-dc2493cb4c07 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:36:57.653790 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:36:57.653790 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:36:57.656738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514e878-c046-447f-8b19-dc2493cb4c07 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:57.692922 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2770/5515] 10.222.0.39 () {58 vars in 1342 bytes} [Sun Aug 7 01:36:57 2022] HEAD /identity/v3/groups/a3b2f136b5b04ed397d3b65c69ebd94b/users/cea76431867f41d99869167f7f833193 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:57.697635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514e878-c046-447f-8b19-dc2493cb4c07 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:57.725244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514e878-c046-447f-8b19-dc2493cb4c07 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:57.738285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea85dd-7bff-4155-9b1a-0a5e1c92732f tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:57.742565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea85dd-7bff-4155-9b1a-0a5e1c92732f tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:57.744175 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea85dd-7bff-4155-9b1a-0a5e1c92732f tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:57.744567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea85dd-7bff-4155-9b1a-0a5e1c92732f tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/groups/a3b2f136b5b04ed397d3b65c69ebd94b/users/cea76431867f41d99869167f7f833193` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:57.748102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea85dd-7bff-4155-9b1a-0a5e1c92732f tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=a3b2f136b5b04ed397d3b65c69ebd94b, user_id=cea76431867f41d99869167f7f833193)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:57.751599 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-d4ea85dd-7bff-4155-9b1a-0a5e1c92732f tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:36:57.751599 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:36:57.751599 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:36:57.754136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea85dd-7bff-4155-9b1a-0a5e1c92732f tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:57.791439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d4ea85dd-7bff-4155-9b1a-0a5e1c92732f tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'cea76431867f41d99869167f7f833193'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:57.818054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5acc3-21c6-445d-8c15-9c91de174e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:57.818984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5acc3-21c6-445d-8c15-9c91de174e37 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:57.820658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5acc3-21c6-445d-8c15-9c91de174e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:57.829719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5acc3-21c6-445d-8c15-9c91de174e37 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:57.831009 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2771/5516] 10.222.0.39 () {58 vars in 1344 bytes} [Sun Aug 7 01:36:57 2022] DELETE /identity/v3/groups/a3b2f136b5b04ed397d3b65c69ebd94b/users/cea76431867f41d99869167f7f833193 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:57.832868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5acc3-21c6-445d-8c15-9c91de174e37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:57.835454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea85dd-7bff-4155-9b1a-0a5e1c92732f tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:57.841048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5acc3-21c6-445d-8c15-9c91de174e37 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:57.895908 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2746/5517] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:36:57 2022] POST /identity/v3/users => generated 288 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:36:57.900031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5acc3-21c6-445d-8c15-9c91de174e37 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:57.932004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5acc3-21c6-445d-8c15-9c91de174e37 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:58.014827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea85dd-7bff-4155-9b1a-0a5e1c92732f tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:58.032914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f9110-a7b2-4320-965d-061be7334617 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:58.034487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f9110-a7b2-4320-965d-061be7334617 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:58.034783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f9110-a7b2-4320-965d-061be7334617 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:58.035519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f9110-a7b2-4320-965d-061be7334617 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/groups/a3b2f136b5b04ed397d3b65c69ebd94b/users/5b97825c09ef4d639891f7b053f1a976` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:58.037083 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f9110-a7b2-4320-965d-061be7334617 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=a3b2f136b5b04ed397d3b65c69ebd94b, user_id=5b97825c09ef4d639891f7b053f1a976)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:58.039015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f9110-a7b2-4320-965d-061be7334617 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:58.039916 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:58.068607 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5b7d9-9778-4566-9f4e-e00aed25e5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:58.069319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5b7d9-9778-4566-9f4e-e00aed25e5ba admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:58.069682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5b7d9-9778-4566-9f4e-e00aed25e5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:58.070025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5b7d9-9778-4566-9f4e-e00aed25e5ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:58.071019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae5b7d9-9778-4566-9f4e-e00aed25e5ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:58.073629 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae5b7d9-9778-4566-9f4e-e00aed25e5ba admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:58.086991 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2772/5518] 10.222.0.39 () {58 vars in 1342 bytes} [Sun Aug 7 01:36:57 2022] HEAD /identity/v3/groups/a3b2f136b5b04ed397d3b65c69ebd94b/users/5b97825c09ef4d639891f7b053f1a976 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:58.091792 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2747/5519] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:36:58.092801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f9110-a7b2-4320-965d-061be7334617 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:58.093020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5b7d9-9778-4566-9f4e-e00aed25e5ba admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:58.105871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5b7d9-9778-4566-9f4e-e00aed25e5ba admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:58.111322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aea6b6-cc94-4430-a6a1-14f48cd1db5d tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:58.113251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aea6b6-cc94-4430-a6a1-14f48cd1db5d tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:58.113701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aea6b6-cc94-4430-a6a1-14f48cd1db5d tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:58.114161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aea6b6-cc94-4430-a6a1-14f48cd1db5d tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/groups/a3b2f136b5b04ed397d3b65c69ebd94b/users/5b97825c09ef4d639891f7b053f1a976` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:58.118356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aea6b6-cc94-4430-a6a1-14f48cd1db5d tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=a3b2f136b5b04ed397d3b65c69ebd94b, user_id=5b97825c09ef4d639891f7b053f1a976)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:58.121681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aea6b6-cc94-4430-a6a1-14f48cd1db5d tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:58.129177 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f9110-a7b2-4320-965d-061be7334617 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:58.133311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b6aea6b6-cc94-4430-a6a1-14f48cd1db5d tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5b97825c09ef4d639891f7b053f1a976'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:58.145382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c67a3-3f9e-4851-a616-9825534b553f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:58.148122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c67a3-3f9e-4851-a616-9825534b553f admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:58.151982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c67a3-3f9e-4851-a616-9825534b553f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:58.152496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c67a3-3f9e-4851-a616-9825534b553f admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:58.154586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c67a3-3f9e-4851-a616-9825534b553f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:58.156755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c67a3-3f9e-4851-a616-9825534b553f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:58.161843 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2748/5520] 10.222.0.39 () {58 vars in 1344 bytes} [Sun Aug 7 01:36:58 2022] DELETE /identity/v3/groups/a3b2f136b5b04ed397d3b65c69ebd94b/users/5b97825c09ef4d639891f7b053f1a976 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:58.168464 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aea6b6-cc94-4430-a6a1-14f48cd1db5d tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:58.188135 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2773/5521] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:36:58.189089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c67a3-3f9e-4851-a616-9825534b553f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:58.222155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c67a3-3f9e-4851-a616-9825534b553f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:58.353361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aea6b6-cc94-4430-a6a1-14f48cd1db5d tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:58.370717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d3bab-c9df-47ff-b235-4e19b7f21f6e tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:58.370985 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d3bab-c9df-47ff-b235-4e19b7f21f6e tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:58.371250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d3bab-c9df-47ff-b235-4e19b7f21f6e tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:58.371522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d3bab-c9df-47ff-b235-4e19b7f21f6e tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/groups/a3b2f136b5b04ed397d3b65c69ebd94b/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:58.379232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d3bab-c9df-47ff-b235-4e19b7f21f6e tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=a3b2f136b5b04ed397d3b65c69ebd94b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:58.381263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d3bab-c9df-47ff-b235-4e19b7f21f6e tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:58.403431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e32aa-459f-4766-a667-b62a964e8b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:58.404142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e32aa-459f-4766-a667-b62a964e8b7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:58.404421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e32aa-459f-4766-a667-b62a964e8b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:58.404695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e32aa-459f-4766-a667-b62a964e8b7c admin admin] PATH_INFO: `/v3/projects/fd244ec665474b3896678f34d6491574/users/2d8e76eb694846cabc55fc8e825c8e43/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:58.424129 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2749/5522] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Aug 7 01:36:58 2022] GET /identity/v3/groups/a3b2f136b5b04ed397d3b65c69ebd94b/users => generated 145 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:36:58.431220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d3bab-c9df-47ff-b235-4e19b7f21f6e tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:58.460986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e32aa-459f-4766-a667-b62a964e8b7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd244ec665474b3896678f34d6491574, user_id=2d8e76eb694846cabc55fc8e825c8e43, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:58.470642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d3bab-c9df-47ff-b235-4e19b7f21f6e tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:58.473879 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e32aa-459f-4766-a667-b62a964e8b7c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:58.490384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcffdf0-7c6f-4d34-ab90-6c8d798edcd4 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:58.491034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcffdf0-7c6f-4d34-ab90-6c8d798edcd4 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:58.491313 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcffdf0-7c6f-4d34-ab90-6c8d798edcd4 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:58.491589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcffdf0-7c6f-4d34-ab90-6c8d798edcd4 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/users/5b97825c09ef4d639891f7b053f1a976` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:58.493339 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcffdf0-7c6f-4d34-ab90-6c8d798edcd4 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5b97825c09ef4d639891f7b053f1a976)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:58.500001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcffdf0-7c6f-4d34-ab90-6c8d798edcd4 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:58.535560 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2774/5523] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:36:58 2022] PUT /identity/v3/projects/fd244ec665474b3896678f34d6491574/users/2d8e76eb694846cabc55fc8e825c8e43/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:58.537030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd795c-4b2c-499c-be24-e3951ea563ee None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:58.537311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd795c-4b2c-499c-be24-e3951ea563ee None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:58.537578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd795c-4b2c-499c-be24-e3951ea563ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:58.566430 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-66cd795c-4b2c-499c-be24-e3951ea563ee None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:36:58.567916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-66cd795c-4b2c-499c-be24-e3951ea563ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:58.594173 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:58.625650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bfcffdf0-7c6f-4d34-ab90-6c8d798edcd4 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b97825c09ef4d639891f7b053f1a976'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:58.637316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bfcffdf0-7c6f-4d34-ab90-6c8d798edcd4 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b97825c09ef4d639891f7b053f1a976'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:58.664707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bfcffdf0-7c6f-4d34-ab90-6c8d798edcd4 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b97825c09ef4d639891f7b053f1a976'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:58.666295 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bfcffdf0-7c6f-4d34-ab90-6c8d798edcd4 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b97825c09ef4d639891f7b053f1a976'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:58.669729 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2775/5524] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:36:58.690393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bfcffdf0-7c6f-4d34-ab90-6c8d798edcd4 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b97825c09ef4d639891f7b053f1a976'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:58.692148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd795c-4b2c-499c-be24-e3951ea563ee None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:58.695474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-66cd795c-4b2c-499c-be24-e3951ea563ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:58.708694 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2750/5525] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:36:58 2022] DELETE /identity/v3/users/5b97825c09ef4d639891f7b053f1a976 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:58.712979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcffdf0-7c6f-4d34-ab90-6c8d798edcd4 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:58.714883 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bfcffdf0-7c6f-4d34-ab90-6c8d798edcd4 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:58.765198 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:58.815488 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd795c-4b2c-499c-be24-e3951ea563ee None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:58.851937 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcffdf0-7c6f-4d34-ab90-6c8d798edcd4 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:58.859442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3df694-e761-434f-97ab-4489bbcb82b3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:58.860382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3df694-e761-434f-97ab-4489bbcb82b3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:58.860868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3df694-e761-434f-97ab-4489bbcb82b3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:58.861133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3df694-e761-434f-97ab-4489bbcb82b3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/users/cea76431867f41d99869167f7f833193` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:58.862437 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3df694-e761-434f-97ab-4489bbcb82b3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:delete_user(user_id=cea76431867f41d99869167f7f833193)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:58.865377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3df694-e761-434f-97ab-4489bbcb82b3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:58.951351 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24780df2-5f26-4716-86b8-16cb52a742f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:58.952166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24780df2-5f26-4716-86b8-16cb52a742f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:58.952471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24780df2-5f26-4716-86b8-16cb52a742f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:58.952785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24780df2-5f26-4716-86b8-16cb52a742f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:58.959020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-24780df2-5f26-4716-86b8-16cb52a742f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:59.015400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cb3df694-e761-434f-97ab-4489bbcb82b3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cea76431867f41d99869167f7f833193'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:59.031503 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cb3df694-e761-434f-97ab-4489bbcb82b3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cea76431867f41d99869167f7f833193'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:59.070235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cb3df694-e761-434f-97ab-4489bbcb82b3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cea76431867f41d99869167f7f833193'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:59.071070 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cb3df694-e761-434f-97ab-4489bbcb82b3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cea76431867f41d99869167f7f833193'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:59.086100 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cb3df694-e761-434f-97ab-4489bbcb82b3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cea76431867f41d99869167f7f833193'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:59.101144 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2751/5526] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:36:58 2022] DELETE /identity/v3/users/cea76431867f41d99869167f7f833193 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:59.102407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3df694-e761-434f-97ab-4489bbcb82b3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:59.104068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cb3df694-e761-434f-97ab-4489bbcb82b3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:59.146770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24780df2-5f26-4716-86b8-16cb52a742f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:59.148510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24780df2-5f26-4716-86b8-16cb52a742f9 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:59.182171 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2776/5527] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:36:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:36:59.298336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3df694-e761-434f-97ab-4489bbcb82b3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:59.317672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7403dc-8424-4394-97bd-74dca68a8dc4 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:59.320047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7403dc-8424-4394-97bd-74dca68a8dc4 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:59.322536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7403dc-8424-4394-97bd-74dca68a8dc4 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:59.323553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7403dc-8424-4394-97bd-74dca68a8dc4 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/users/365db875ed0a4f0ca2cdaea36129531f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:59.329999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7403dc-8424-4394-97bd-74dca68a8dc4 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:delete_user(user_id=365db875ed0a4f0ca2cdaea36129531f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:59.336785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7403dc-8424-4394-97bd-74dca68a8dc4 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:59.455915 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:59.468839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ec7403dc-8424-4394-97bd-74dca68a8dc4 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '365db875ed0a4f0ca2cdaea36129531f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:59.480201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ec7403dc-8424-4394-97bd-74dca68a8dc4 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '365db875ed0a4f0ca2cdaea36129531f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:59.500126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ec7403dc-8424-4394-97bd-74dca68a8dc4 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '365db875ed0a4f0ca2cdaea36129531f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:59.501804 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ec7403dc-8424-4394-97bd-74dca68a8dc4 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '365db875ed0a4f0ca2cdaea36129531f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:59.518935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ec7403dc-8424-4394-97bd-74dca68a8dc4 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '365db875ed0a4f0ca2cdaea36129531f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:36:59.531760 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2752/5528] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:36:59 2022] DELETE /identity/v3/users/365db875ed0a4f0ca2cdaea36129531f => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:59.536651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24780df2-5f26-4716-86b8-16cb52a742f9 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:59.558937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24780df2-5f26-4716-86b8-16cb52a742f9 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:59.614166 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:36:59.672837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc97d51-870c-4d32-acfa-649a19c166f3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:59.673515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc97d51-870c-4d32-acfa-649a19c166f3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:59.673732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc97d51-870c-4d32-acfa-649a19c166f3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:59.674084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc97d51-870c-4d32-acfa-649a19c166f3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/groups/a3b2f136b5b04ed397d3b65c69ebd94b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:59.675448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc97d51-870c-4d32-acfa-649a19c166f3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:delete_group(group_id=a3b2f136b5b04ed397d3b65c69ebd94b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:59.676510 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-3bc97d51-870c-4d32-acfa-649a19c166f3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:36:59.676510 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:36:59.676510 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:36:59.678350 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc97d51-870c-4d32-acfa-649a19c166f3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:59.762394 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2777/5529] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Aug 7 01:36:59 2022] DELETE /identity/v3/groups/a3b2f136b5b04ed397d3b65c69ebd94b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:36:59.768662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7403dc-8424-4394-97bd-74dca68a8dc4 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:59.770438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ec7403dc-8424-4394-97bd-74dca68a8dc4 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:36:59.792791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7403dc-8424-4394-97bd-74dca68a8dc4 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:59.923755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac2834-57ab-41dc-bf3b-8958160d8f3d tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:59.924876 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac2834-57ab-41dc-bf3b-8958160d8f3d tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:59.925393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac2834-57ab-41dc-bf3b-8958160d8f3d tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:59.925915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac2834-57ab-41dc-bf3b-8958160d8f3d tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/groups` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:59.927520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac2834-57ab-41dc-bf3b-8958160d8f3d tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:59.929960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac2834-57ab-41dc-bf3b-8958160d8f3d tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:36:59.952091 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2753/5530] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:36:59 2022] POST /identity/v3/groups => generated 327 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:36:59.956572 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc97d51-870c-4d32-acfa-649a19c166f3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:36:59.970650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc97d51-870c-4d32-acfa-649a19c166f3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:36:59.981517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f9f28-bf02-42ab-a2a0-618fa34492ad tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:36:59.982583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f9f28-bf02-42ab-a2a0-618fa34492ad tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:36:59.983084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f9f28-bf02-42ab-a2a0-618fa34492ad tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:36:59.983592 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f9f28-bf02-42ab-a2a0-618fa34492ad tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/groups` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:36:59.984725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f9f28-bf02-42ab-a2a0-618fa34492ad tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:36:59.987988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f9f28-bf02-42ab-a2a0-618fa34492ad tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:00.040651 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2778/5531] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:36:59 2022] POST /identity/v3/groups => generated 326 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:00.043214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac2834-57ab-41dc-bf3b-8958160d8f3d tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:00.063130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac2834-57ab-41dc-bf3b-8958160d8f3d tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:00.079043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3560acc-0e7a-475e-95d5-eb10f29c8690 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:00.081736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3560acc-0e7a-475e-95d5-eb10f29c8690 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:00.082155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3560acc-0e7a-475e-95d5-eb10f29c8690 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:00.082531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3560acc-0e7a-475e-95d5-eb10f29c8690 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/groups` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:00.083571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3560acc-0e7a-475e-95d5-eb10f29c8690 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:00.090849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3560acc-0e7a-475e-95d5-eb10f29c8690 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:00.122303 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2754/5532] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:37:00 2022] POST /identity/v3/groups => generated 326 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:00.124104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f9f28-bf02-42ab-a2a0-618fa34492ad tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:00.136960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f9f28-bf02-42ab-a2a0-618fa34492ad tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:00.144548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193398bf-f735-4990-8ee5-9977b255fce3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:00.145595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193398bf-f735-4990-8ee5-9977b255fce3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:00.146212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193398bf-f735-4990-8ee5-9977b255fce3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:00.146832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193398bf-f735-4990-8ee5-9977b255fce3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/groups` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:00.148178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193398bf-f735-4990-8ee5-9977b255fce3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:00.150013 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-193398bf-f735-4990-8ee5-9977b255fce3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:37:00.150013 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:37:00.150013 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:37:00.151436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193398bf-f735-4990-8ee5-9977b255fce3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:00.171217 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2779/5533] 10.222.0.39 () {58 vars in 1125 bytes} [Sun Aug 7 01:37:00 2022] GET /identity/v3/groups => generated 1489 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:37:00.176194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3560acc-0e7a-475e-95d5-eb10f29c8690 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:00.192464 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3560acc-0e7a-475e-95d5-eb10f29c8690 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:00.200227 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0517fd3-f2a1-49ae-a501-855936fddefb tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:00.201205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0517fd3-f2a1-49ae-a501-855936fddefb tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:00.201879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0517fd3-f2a1-49ae-a501-855936fddefb tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:00.202020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0517fd3-f2a1-49ae-a501-855936fddefb tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/groups/e1667f5516694cdaa8abd8e3be40b93e` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:00.209055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0517fd3-f2a1-49ae-a501-855936fddefb tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:delete_group(group_id=e1667f5516694cdaa8abd8e3be40b93e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:00.212749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0517fd3-f2a1-49ae-a501-855936fddefb tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:00.339565 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2755/5534] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Aug 7 01:37:00 2022] DELETE /identity/v3/groups/e1667f5516694cdaa8abd8e3be40b93e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:00.344793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193398bf-f735-4990-8ee5-9977b255fce3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:00.365739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193398bf-f735-4990-8ee5-9977b255fce3 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:00.529330 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91ad65-325a-4cfa-93b8-1ccbc40ebda1 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:00.530347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91ad65-325a-4cfa-93b8-1ccbc40ebda1 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:00.530923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91ad65-325a-4cfa-93b8-1ccbc40ebda1 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:00.531477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91ad65-325a-4cfa-93b8-1ccbc40ebda1 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/groups/8c818fd1ab694531ab1b091554de1580` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:00.539105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91ad65-325a-4cfa-93b8-1ccbc40ebda1 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:delete_group(group_id=8c818fd1ab694531ab1b091554de1580)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:00.543110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91ad65-325a-4cfa-93b8-1ccbc40ebda1 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:00.618029 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2780/5535] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Aug 7 01:37:00 2022] DELETE /identity/v3/groups/8c818fd1ab694531ab1b091554de1580 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:00.622693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0517fd3-f2a1-49ae-a501-855936fddefb tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:00.638605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0517fd3-f2a1-49ae-a501-855936fddefb tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:00.729663 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:00.779356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e9706-fb67-4079-b3f7-eec7117b8665 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:00.780806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e9706-fb67-4079-b3f7-eec7117b8665 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:00.781372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e9706-fb67-4079-b3f7-eec7117b8665 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:00.781890 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e9706-fb67-4079-b3f7-eec7117b8665 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/groups/707881ea99e9460499d783045520fa15` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:00.791381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e9706-fb67-4079-b3f7-eec7117b8665 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:delete_group(group_id=707881ea99e9460499d783045520fa15)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:00.793639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e9706-fb67-4079-b3f7-eec7117b8665 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:00.906884 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2756/5536] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Aug 7 01:37:00 2022] DELETE /identity/v3/groups/707881ea99e9460499d783045520fa15 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:37:00.915316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91ad65-325a-4cfa-93b8-1ccbc40ebda1 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:00.936557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91ad65-325a-4cfa-93b8-1ccbc40ebda1 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:00.998611 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:01.106528 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be195e7a-a4ff-4af8-82e3-233cec08fb86 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:01.107700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be195e7a-a4ff-4af8-82e3-233cec08fb86 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:01.108960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be195e7a-a4ff-4af8-82e3-233cec08fb86 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:01.109476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be195e7a-a4ff-4af8-82e3-233cec08fb86 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:01.110306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be195e7a-a4ff-4af8-82e3-233cec08fb86 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:01.113240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be195e7a-a4ff-4af8-82e3-233cec08fb86 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:01.159696 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2781/5537] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:37:00 2022] POST /identity/v3/users => generated 323 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:01.162941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e9706-fb67-4079-b3f7-eec7117b8665 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:01.182621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e9706-fb67-4079-b3f7-eec7117b8665 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:01.196638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfbe8c-a1bb-4b82-b186-947db022a8f9 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:01.197391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfbe8c-a1bb-4b82-b186-947db022a8f9 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:01.197742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfbe8c-a1bb-4b82-b186-947db022a8f9 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:01.198088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfbe8c-a1bb-4b82-b186-947db022a8f9 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/groups` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:01.199417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfbe8c-a1bb-4b82-b186-947db022a8f9 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:01.201612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfbe8c-a1bb-4b82-b186-947db022a8f9 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:01.255241 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2757/5538] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:37:01 2022] POST /identity/v3/groups => generated 327 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:01.259341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be195e7a-a4ff-4af8-82e3-233cec08fb86 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:01.277507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be195e7a-a4ff-4af8-82e3-233cec08fb86 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:01.287974 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406e256-bc5d-4985-8feb-3805d8dd70f1 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:01.291905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406e256-bc5d-4985-8feb-3805d8dd70f1 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:01.292445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406e256-bc5d-4985-8feb-3805d8dd70f1 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:01.292926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406e256-bc5d-4985-8feb-3805d8dd70f1 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/groups/2c83754f553c48b0b8e6ec89462af1c8/users/300c7adb48584212bcf16ec68927087c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:01.326239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406e256-bc5d-4985-8feb-3805d8dd70f1 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=2c83754f553c48b0b8e6ec89462af1c8, user_id=300c7adb48584212bcf16ec68927087c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:01.329941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406e256-bc5d-4985-8feb-3805d8dd70f1 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:01.378134 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2782/5539] 10.222.0.39 () {60 vars in 1360 bytes} [Sun Aug 7 01:37:01 2022] PUT /identity/v3/groups/2c83754f553c48b0b8e6ec89462af1c8/users/300c7adb48584212bcf16ec68927087c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:01.381889 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfbe8c-a1bb-4b82-b186-947db022a8f9 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:01.393286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfbe8c-a1bb-4b82-b186-947db022a8f9 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:01.461921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78bbfd-49ea-4585-84a0-d26bb4b6d50d tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:01.462458 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78bbfd-49ea-4585-84a0-d26bb4b6d50d tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:01.462729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78bbfd-49ea-4585-84a0-d26bb4b6d50d tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:01.463001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78bbfd-49ea-4585-84a0-d26bb4b6d50d tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/groups` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:01.463650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78bbfd-49ea-4585-84a0-d26bb4b6d50d tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:01.465626 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78bbfd-49ea-4585-84a0-d26bb4b6d50d tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:01.490229 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2758/5540] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:37:01 2022] POST /identity/v3/groups => generated 326 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:01.494062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406e256-bc5d-4985-8feb-3805d8dd70f1 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:01.508867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406e256-bc5d-4985-8feb-3805d8dd70f1 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:01.516476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532cc1c-2a71-454a-a915-a2eed91895ef tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:01.517437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532cc1c-2a71-454a-a915-a2eed91895ef tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:01.517952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532cc1c-2a71-454a-a915-a2eed91895ef tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:01.518388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532cc1c-2a71-454a-a915-a2eed91895ef tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/groups/b07580122b9b4663903adc70464ebd20/users/300c7adb48584212bcf16ec68927087c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:01.529924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532cc1c-2a71-454a-a915-a2eed91895ef tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=b07580122b9b4663903adc70464ebd20, user_id=300c7adb48584212bcf16ec68927087c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:01.532178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532cc1c-2a71-454a-a915-a2eed91895ef tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:01.581469 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2783/5541] 10.222.0.39 () {60 vars in 1360 bytes} [Sun Aug 7 01:37:01 2022] PUT /identity/v3/groups/b07580122b9b4663903adc70464ebd20/users/300c7adb48584212bcf16ec68927087c => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:37:01.582913 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78bbfd-49ea-4585-84a0-d26bb4b6d50d tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:01.599081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78bbfd-49ea-4585-84a0-d26bb4b6d50d tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:01.695915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b820ba5-6573-4a8c-9702-a1e2eb433ff6 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:01.696735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b820ba5-6573-4a8c-9702-a1e2eb433ff6 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:01.697121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b820ba5-6573-4a8c-9702-a1e2eb433ff6 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:01.697495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b820ba5-6573-4a8c-9702-a1e2eb433ff6 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/users/300c7adb48584212bcf16ec68927087c/groups` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:01.699006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b820ba5-6573-4a8c-9702-a1e2eb433ff6 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=300c7adb48584212bcf16ec68927087c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:01.701260 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b820ba5-6573-4a8c-9702-a1e2eb433ff6 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:01.725610 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2759/5542] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Aug 7 01:37:01 2022] GET /identity/v3/users/300c7adb48584212bcf16ec68927087c/groups => generated 839 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:37:01.727330 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532cc1c-2a71-454a-a915-a2eed91895ef tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:01.740903 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532cc1c-2a71-454a-a915-a2eed91895ef tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:01.755306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63170ca7-d162-466e-b687-21162a194201 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:01.756251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63170ca7-d162-466e-b687-21162a194201 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:01.756712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63170ca7-d162-466e-b687-21162a194201 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:01.757092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63170ca7-d162-466e-b687-21162a194201 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/groups/b07580122b9b4663903adc70464ebd20` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:01.759433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63170ca7-d162-466e-b687-21162a194201 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:delete_group(group_id=b07580122b9b4663903adc70464ebd20)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:01.764199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63170ca7-d162-466e-b687-21162a194201 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:01.843518 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2784/5543] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Aug 7 01:37:01 2022] DELETE /identity/v3/groups/b07580122b9b4663903adc70464ebd20 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:01.844860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b820ba5-6573-4a8c-9702-a1e2eb433ff6 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:01.861928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b820ba5-6573-4a8c-9702-a1e2eb433ff6 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:01.885814 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:01.983482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec6e34-a132-43cd-b863-df6f569a0e54 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:01.984257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec6e34-a132-43cd-b863-df6f569a0e54 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:01.984605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec6e34-a132-43cd-b863-df6f569a0e54 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:01.984949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec6e34-a132-43cd-b863-df6f569a0e54 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/groups/2c83754f553c48b0b8e6ec89462af1c8` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:01.987288 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ec6e34-a132-43cd-b863-df6f569a0e54 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:delete_group(group_id=2c83754f553c48b0b8e6ec89462af1c8)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:01.989568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ec6e34-a132-43cd-b863-df6f569a0e54 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:02.057900 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2760/5544] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Aug 7 01:37:01 2022] DELETE /identity/v3/groups/2c83754f553c48b0b8e6ec89462af1c8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:02.062431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63170ca7-d162-466e-b687-21162a194201 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:02.079145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63170ca7-d162-466e-b687-21162a194201 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:02.183621 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:02.210221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc124b-1bbd-4075-a47f-4e06e9b599a6 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:02.211176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc124b-1bbd-4075-a47f-4e06e9b599a6 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:02.211559 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc124b-1bbd-4075-a47f-4e06e9b599a6 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:02.213447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc124b-1bbd-4075-a47f-4e06e9b599a6 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/users/300c7adb48584212bcf16ec68927087c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:02.216991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc124b-1bbd-4075-a47f-4e06e9b599a6 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:delete_user(user_id=300c7adb48584212bcf16ec68927087c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:02.223413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc124b-1bbd-4075-a47f-4e06e9b599a6 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:02.335155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c5fc124b-1bbd-4075-a47f-4e06e9b599a6 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '300c7adb48584212bcf16ec68927087c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:02.356716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c5fc124b-1bbd-4075-a47f-4e06e9b599a6 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '300c7adb48584212bcf16ec68927087c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:02.380421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c5fc124b-1bbd-4075-a47f-4e06e9b599a6 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '300c7adb48584212bcf16ec68927087c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:02.382229 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c5fc124b-1bbd-4075-a47f-4e06e9b599a6 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '300c7adb48584212bcf16ec68927087c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:02.396497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c5fc124b-1bbd-4075-a47f-4e06e9b599a6 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '300c7adb48584212bcf16ec68927087c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:02.415007 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2785/5545] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:37:02 2022] DELETE /identity/v3/users/300c7adb48584212bcf16ec68927087c => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:02.416962 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec6e34-a132-43cd-b863-df6f569a0e54 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:02.419558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f6ec6e34-a132-43cd-b863-df6f569a0e54 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:02.456333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec6e34-a132-43cd-b863-df6f569a0e54 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:02.620532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707af593-cf4e-4f94-914b-87c2dfbee8e5 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:02.621222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707af593-cf4e-4f94-914b-87c2dfbee8e5 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:02.621505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707af593-cf4e-4f94-914b-87c2dfbee8e5 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:02.621778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707af593-cf4e-4f94-914b-87c2dfbee8e5 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/domains/2b072f58afdb4071a7893628c6c920ff` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:02.624533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707af593-cf4e-4f94-914b-87c2dfbee8e5 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2b072f58afdb4071a7893628c6c920ff)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:02.626178 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707af593-cf4e-4f94-914b-87c2dfbee8e5 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:02.724193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-707af593-cf4e-4f94-914b-87c2dfbee8e5 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2b072f58afdb4071a7893628c6c920ff'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:02.730988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-707af593-cf4e-4f94-914b-87c2dfbee8e5 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2b072f58afdb4071a7893628c6c920ff'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:02.785791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-707af593-cf4e-4f94-914b-87c2dfbee8e5 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2b072f58afdb4071a7893628c6c920ff'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:02.786716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-707af593-cf4e-4f94-914b-87c2dfbee8e5 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2b072f58afdb4071a7893628c6c920ff'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:02.789472 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2761/5546] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:37:02 2022] PATCH /identity/v3/domains/2b072f58afdb4071a7893628c6c920ff => generated 278 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:37:02.794011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc124b-1bbd-4075-a47f-4e06e9b599a6 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:02.812799 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc124b-1bbd-4075-a47f-4e06e9b599a6 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:02.907280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689d63c-e5ff-4677-885f-61bcc8d8292a tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32a23810d07045c7b78487abc8c389d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0fe36d3c63664918a548147c6d470bf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:02.909000 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689d63c-e5ff-4677-885f-61bcc8d8292a tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:02.909475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689d63c-e5ff-4677-885f-61bcc8d8292a tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:02.910261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689d63c-e5ff-4677-885f-61bcc8d8292a tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] PATH_INFO: `/v3/domains/2b072f58afdb4071a7893628c6c920ff` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:02.932100 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689d63c-e5ff-4677-885f-61bcc8d8292a tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2b072f58afdb4071a7893628c6c920ff)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:02.936047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689d63c-e5ff-4677-885f-61bcc8d8292a tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:03.003357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1689d63c-e5ff-4677-885f-61bcc8d8292a tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2b072f58afdb4071a7893628c6c920ff'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:03.039452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1689d63c-e5ff-4677-885f-61bcc8d8292a tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2b072f58afdb4071a7893628c6c920ff'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:03.125121 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:03.131702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1689d63c-e5ff-4677-885f-61bcc8d8292a tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b072f58afdb4071a7893628c6c920ff', 'request_id': 'req-1689d63c-e5ff-4677-885f-61bcc8d8292a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:03.141213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1689d63c-e5ff-4677-885f-61bcc8d8292a tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b072f58afdb4071a7893628c6c920ff', 'request_id': 'req-1689d63c-e5ff-4677-885f-61bcc8d8292a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:03.149345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1689d63c-e5ff-4677-885f-61bcc8d8292a tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b072f58afdb4071a7893628c6c920ff', 'request_id': 'req-1689d63c-e5ff-4677-885f-61bcc8d8292a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:03.175221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1689d63c-e5ff-4677-885f-61bcc8d8292a tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] The token cache is being invalidate because project 2b072f58afdb4071a7893628c6c920ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:03.176911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1689d63c-e5ff-4677-885f-61bcc8d8292a tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:03.178621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1689d63c-e5ff-4677-885f-61bcc8d8292a tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:03.207603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1689d63c-e5ff-4677-885f-61bcc8d8292a tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2b072f58afdb4071a7893628c6c920ff', 'request_id': 'req-1689d63c-e5ff-4677-885f-61bcc8d8292a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:03.212159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1689d63c-e5ff-4677-885f-61bcc8d8292a tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2b072f58afdb4071a7893628c6c920ff', 'request_id': 'req-1689d63c-e5ff-4677-885f-61bcc8d8292a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:03.212925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1689d63c-e5ff-4677-885f-61bcc8d8292a tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2b072f58afdb4071a7893628c6c920ff', 'request_id': 'req-1689d63c-e5ff-4677-885f-61bcc8d8292a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:03.226877 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2786/5547] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:37:02 2022] DELETE /identity/v3/domains/2b072f58afdb4071a7893628c6c920ff => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:03.230762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707af593-cf4e-4f94-914b-87c2dfbee8e5 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:03.232473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-707af593-cf4e-4f94-914b-87c2dfbee8e5 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:03.335687 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:03.401855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707af593-cf4e-4f94-914b-87c2dfbee8e5 tempest-GroupsV3TestJSON-1903053455 tempest-GroupsV3TestJSON-1903053455-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:03.548643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d63b4-a9de-40c8-ae48-f20551b4cba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:03.550325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d63b4-a9de-40c8-ae48-f20551b4cba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:03.550783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d63b4-a9de-40c8-ae48-f20551b4cba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:03.551415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d63b4-a9de-40c8-ae48-f20551b4cba3 admin admin] PATH_INFO: `/v3/users/dccaeecb6fbb483e91c93a1a7e38059f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:03.552972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d63b4-a9de-40c8-ae48-f20551b4cba3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dccaeecb6fbb483e91c93a1a7e38059f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:03.555326 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d63b4-a9de-40c8-ae48-f20551b4cba3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:03.674902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e86d63b4-a9de-40c8-ae48-f20551b4cba3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dccaeecb6fbb483e91c93a1a7e38059f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:03.684201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e86d63b4-a9de-40c8-ae48-f20551b4cba3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dccaeecb6fbb483e91c93a1a7e38059f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:03.699507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e86d63b4-a9de-40c8-ae48-f20551b4cba3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dccaeecb6fbb483e91c93a1a7e38059f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:03.701528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e86d63b4-a9de-40c8-ae48-f20551b4cba3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dccaeecb6fbb483e91c93a1a7e38059f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:03.716692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e86d63b4-a9de-40c8-ae48-f20551b4cba3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dccaeecb6fbb483e91c93a1a7e38059f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:03.726087 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2762/5548] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:37:03 2022] DELETE /identity/v3/users/dccaeecb6fbb483e91c93a1a7e38059f => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:03.731035 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361295a-b4fc-4966-8272-720c8bc389d0 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:03.731545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361295a-b4fc-4966-8272-720c8bc389d0 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:03.732078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361295a-b4fc-4966-8272-720c8bc389d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:03.760216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c361295a-b4fc-4966-8272-720c8bc389d0 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:03.762047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c361295a-b4fc-4966-8272-720c8bc389d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:03.875667 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2787/5549] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:37:03.914729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d63b4-a9de-40c8-ae48-f20551b4cba3 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:03.916770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e86d63b4-a9de-40c8-ae48-f20551b4cba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:04.100384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d63b4-a9de-40c8-ae48-f20551b4cba3 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:04.108007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50f5e7-7a38-4f46-81fe-883400051bec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:04.110736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50f5e7-7a38-4f46-81fe-883400051bec service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:04.111072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50f5e7-7a38-4f46-81fe-883400051bec service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:04.112474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50f5e7-7a38-4f46-81fe-883400051bec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:04.162079 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c50f5e7-7a38-4f46-81fe-883400051bec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:04.168169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c50f5e7-7a38-4f46-81fe-883400051bec service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:04.197988 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2763/5550] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:37:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:37:05.575131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361295a-b4fc-4966-8272-720c8bc389d0 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:05.584311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c361295a-b4fc-4966-8272-720c8bc389d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:05.602446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361295a-b4fc-4966-8272-720c8bc389d0 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:05.621434 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892774e-bc44-469d-855e-5785ec5304cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:05.622091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892774e-bc44-469d-855e-5785ec5304cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:05.623022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892774e-bc44-469d-855e-5785ec5304cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:05.623470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892774e-bc44-469d-855e-5785ec5304cf admin admin] PATH_INFO: `/v3/projects/957dc086bbc846e6aafeeff68f7ed6c5` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:05.625122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892774e-bc44-469d-855e-5785ec5304cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=957dc086bbc846e6aafeeff68f7ed6c5)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:05.627629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892774e-bc44-469d-855e-5785ec5304cf admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:05.725310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a892774e-bc44-469d-855e-5785ec5304cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '957dc086bbc846e6aafeeff68f7ed6c5', 'request_id': 'req-a892774e-bc44-469d-855e-5785ec5304cf'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:05.739304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a892774e-bc44-469d-855e-5785ec5304cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '957dc086bbc846e6aafeeff68f7ed6c5', 'request_id': 'req-a892774e-bc44-469d-855e-5785ec5304cf'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:05.759139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a892774e-bc44-469d-855e-5785ec5304cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '957dc086bbc846e6aafeeff68f7ed6c5', 'request_id': 'req-a892774e-bc44-469d-855e-5785ec5304cf'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:05.805450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a892774e-bc44-469d-855e-5785ec5304cf admin admin] The token cache is being invalidate because project 957dc086bbc846e6aafeeff68f7ed6c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:05.807119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a892774e-bc44-469d-855e-5785ec5304cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:05.810516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a892774e-bc44-469d-855e-5785ec5304cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:05.815920 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2788/5551] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:37:05 2022] DELETE /identity/v3/projects/957dc086bbc846e6aafeeff68f7ed6c5 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:05.819733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50f5e7-7a38-4f46-81fe-883400051bec service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:05.835028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50f5e7-7a38-4f46-81fe-883400051bec service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:05.839221 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:05.941850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d4a98-426f-4244-a133-fd3be09ff75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:05.944770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d4a98-426f-4244-a133-fd3be09ff75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:05.945902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d4a98-426f-4244-a133-fd3be09ff75f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:05.947388 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d4a98-426f-4244-a133-fd3be09ff75f admin admin] PATH_INFO: `/v3/users/32a23810d07045c7b78487abc8c389d0` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:05.953173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d4a98-426f-4244-a133-fd3be09ff75f admin admin] RBAC: Authorizing `identity:delete_user(user_id=32a23810d07045c7b78487abc8c389d0)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:05.956708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d4a98-426f-4244-a133-fd3be09ff75f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:06.057268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-902d4a98-426f-4244-a133-fd3be09ff75f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32a23810d07045c7b78487abc8c389d0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:06.076526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-902d4a98-426f-4244-a133-fd3be09ff75f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32a23810d07045c7b78487abc8c389d0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:06.096561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-902d4a98-426f-4244-a133-fd3be09ff75f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32a23810d07045c7b78487abc8c389d0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:06.097336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-902d4a98-426f-4244-a133-fd3be09ff75f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32a23810d07045c7b78487abc8c389d0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:06.128682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-902d4a98-426f-4244-a133-fd3be09ff75f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32a23810d07045c7b78487abc8c389d0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:06.152240 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2764/5552] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:37:05 2022] DELETE /identity/v3/users/32a23810d07045c7b78487abc8c389d0 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:06.534563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892774e-bc44-469d-855e-5785ec5304cf admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:06.541448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a892774e-bc44-469d-855e-5785ec5304cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:06.574716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892774e-bc44-469d-855e-5785ec5304cf admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:06.649986 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:06.685965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e23131-bc19-4f79-aba7-474ef4a53768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:06.687038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e23131-bc19-4f79-aba7-474ef4a53768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:06.687385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e23131-bc19-4f79-aba7-474ef4a53768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:06.687728 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e23131-bc19-4f79-aba7-474ef4a53768 admin admin] PATH_INFO: `/v3/users/daf312822d804cb59f9228cde33f8228` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:06.696329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e23131-bc19-4f79-aba7-474ef4a53768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daf312822d804cb59f9228cde33f8228)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:06.697305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e23131-bc19-4f79-aba7-474ef4a53768 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:06.800070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d9e23131-bc19-4f79-aba7-474ef4a53768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daf312822d804cb59f9228cde33f8228'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:06.817992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d9e23131-bc19-4f79-aba7-474ef4a53768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daf312822d804cb59f9228cde33f8228'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:06.843670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d9e23131-bc19-4f79-aba7-474ef4a53768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daf312822d804cb59f9228cde33f8228'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:06.847604 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d9e23131-bc19-4f79-aba7-474ef4a53768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daf312822d804cb59f9228cde33f8228'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:06.859164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d9e23131-bc19-4f79-aba7-474ef4a53768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daf312822d804cb59f9228cde33f8228'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:06.873597 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2789/5553] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:37:06 2022] DELETE /identity/v3/users/daf312822d804cb59f9228cde33f8228 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:06.878617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d8c14-46ff-4f8e-86f7-76b954329553 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:06.879506 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d8c14-46ff-4f8e-86f7-76b954329553 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:06.880010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d8c14-46ff-4f8e-86f7-76b954329553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:06.926689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7d4d8c14-46ff-4f8e-86f7-76b954329553 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:06.928457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7d4d8c14-46ff-4f8e-86f7-76b954329553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:07.090060 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2765/5554] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:07.116089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e23131-bc19-4f79-aba7-474ef4a53768 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:07.117770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d9e23131-bc19-4f79-aba7-474ef4a53768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:07.248716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e23131-bc19-4f79-aba7-474ef4a53768 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:07.254909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91199a51-faad-41a1-9f58-b9348180e1d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:07.255713 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91199a51-faad-41a1-9f58-b9348180e1d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:07.256068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91199a51-faad-41a1-9f58-b9348180e1d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:07.256403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91199a51-faad-41a1-9f58-b9348180e1d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:07.273102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91199a51-faad-41a1-9f58-b9348180e1d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:07.275126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91199a51-faad-41a1-9f58-b9348180e1d9 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:07.290142 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2790/5555] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:37:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:37:07.964173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d8c14-46ff-4f8e-86f7-76b954329553 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:07.966938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7d4d8c14-46ff-4f8e-86f7-76b954329553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:08.033970 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d8c14-46ff-4f8e-86f7-76b954329553 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:08.048364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa588982-1f7a-4ef0-9280-be55218aa6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:08.050934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa588982-1f7a-4ef0-9280-be55218aa6e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:08.051082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa588982-1f7a-4ef0-9280-be55218aa6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:08.051721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa588982-1f7a-4ef0-9280-be55218aa6e9 admin admin] PATH_INFO: `/v3/projects/c06b75f6934b4ca8a992631fde6169a7` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:08.056358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa588982-1f7a-4ef0-9280-be55218aa6e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c06b75f6934b4ca8a992631fde6169a7)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:08.063346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa588982-1f7a-4ef0-9280-be55218aa6e9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:08.112835 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:08.158803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aa588982-1f7a-4ef0-9280-be55218aa6e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c06b75f6934b4ca8a992631fde6169a7', 'request_id': 'req-aa588982-1f7a-4ef0-9280-be55218aa6e9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:08.166897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aa588982-1f7a-4ef0-9280-be55218aa6e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c06b75f6934b4ca8a992631fde6169a7', 'request_id': 'req-aa588982-1f7a-4ef0-9280-be55218aa6e9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:08.176084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aa588982-1f7a-4ef0-9280-be55218aa6e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c06b75f6934b4ca8a992631fde6169a7', 'request_id': 'req-aa588982-1f7a-4ef0-9280-be55218aa6e9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:08.206057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aa588982-1f7a-4ef0-9280-be55218aa6e9 admin admin] The token cache is being invalidate because project c06b75f6934b4ca8a992631fde6169a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:08.206761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aa588982-1f7a-4ef0-9280-be55218aa6e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:08.208545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aa588982-1f7a-4ef0-9280-be55218aa6e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:08.212156 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2766/5556] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:37:07 2022] DELETE /identity/v3/projects/c06b75f6934b4ca8a992631fde6169a7 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:08.217479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91199a51-faad-41a1-9f58-b9348180e1d9 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:08.246322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91199a51-faad-41a1-9f58-b9348180e1d9 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:08.323055 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:08.331348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579e8d3-989d-454f-9525-1da9f5604c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:08.332790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579e8d3-989d-454f-9525-1da9f5604c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:08.333456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579e8d3-989d-454f-9525-1da9f5604c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:08.333819 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579e8d3-989d-454f-9525-1da9f5604c1c admin admin] PATH_INFO: `/v3/users/938be7398dd24bac97226e7938bf5338` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:08.335259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d579e8d3-989d-454f-9525-1da9f5604c1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=938be7398dd24bac97226e7938bf5338)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:08.338100 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d579e8d3-989d-454f-9525-1da9f5604c1c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:08.435273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d579e8d3-989d-454f-9525-1da9f5604c1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '938be7398dd24bac97226e7938bf5338'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:08.452351 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d579e8d3-989d-454f-9525-1da9f5604c1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '938be7398dd24bac97226e7938bf5338'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:08.474823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d579e8d3-989d-454f-9525-1da9f5604c1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '938be7398dd24bac97226e7938bf5338'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:08.475691 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d579e8d3-989d-454f-9525-1da9f5604c1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '938be7398dd24bac97226e7938bf5338'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:08.491774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d579e8d3-989d-454f-9525-1da9f5604c1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '938be7398dd24bac97226e7938bf5338'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:08.512117 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2791/5557] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:37:08 2022] DELETE /identity/v3/users/938be7398dd24bac97226e7938bf5338 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:37:08.531783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa588982-1f7a-4ef0-9280-be55218aa6e9 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:08.533920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-aa588982-1f7a-4ef0-9280-be55218aa6e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:08.553588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa588982-1f7a-4ef0-9280-be55218aa6e9 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:08.684383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7545b1e-7dce-4d47-9b97-69637f3fd344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:08.685050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7545b1e-7dce-4d47-9b97-69637f3fd344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:08.685328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7545b1e-7dce-4d47-9b97-69637f3fd344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:08.685601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7545b1e-7dce-4d47-9b97-69637f3fd344 admin admin] PATH_INFO: `/v3/projects/0fe36d3c63664918a548147c6d470bf9` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:08.687809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7545b1e-7dce-4d47-9b97-69637f3fd344 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fe36d3c63664918a548147c6d470bf9)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:08.691750 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7545b1e-7dce-4d47-9b97-69637f3fd344 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:08.779388 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c7545b1e-7dce-4d47-9b97-69637f3fd344 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fe36d3c63664918a548147c6d470bf9', 'request_id': 'req-c7545b1e-7dce-4d47-9b97-69637f3fd344'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:08.794012 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c7545b1e-7dce-4d47-9b97-69637f3fd344 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fe36d3c63664918a548147c6d470bf9', 'request_id': 'req-c7545b1e-7dce-4d47-9b97-69637f3fd344'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:08.804327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c7545b1e-7dce-4d47-9b97-69637f3fd344 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fe36d3c63664918a548147c6d470bf9', 'request_id': 'req-c7545b1e-7dce-4d47-9b97-69637f3fd344'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:08.824009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c7545b1e-7dce-4d47-9b97-69637f3fd344 admin admin] The token cache is being invalidate because project 0fe36d3c63664918a548147c6d470bf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:08.824422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c7545b1e-7dce-4d47-9b97-69637f3fd344 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:08.825817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c7545b1e-7dce-4d47-9b97-69637f3fd344 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:08.834035 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2767/5558] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:37:08 2022] DELETE /identity/v3/projects/0fe36d3c63664918a548147c6d470bf9 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:08.834962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283ad85-2855-413e-a3c2-30d1b785e57d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:08.835285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283ad85-2855-413e-a3c2-30d1b785e57d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:08.835756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283ad85-2855-413e-a3c2-30d1b785e57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:08.868554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-8283ad85-2855-413e-a3c2-30d1b785e57d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:08.869797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8283ad85-2855-413e-a3c2-30d1b785e57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:08.968512 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2792/5559] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:37:08.976904 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b6f91-c07c-48d6-8064-5be630efd3f2 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:08.977470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b6f91-c07c-48d6-8064-5be630efd3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:08.977470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b6f91-c07c-48d6-8064-5be630efd3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:09.026919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ed0b6f91-c07c-48d6-8064-5be630efd3f2 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:09.028469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ed0b6f91-c07c-48d6-8064-5be630efd3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:09.056668 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2768/5560] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:09.066490 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283ad85-2855-413e-a3c2-30d1b785e57d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:09.082167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283ad85-2855-413e-a3c2-30d1b785e57d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:09.090325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e17f77-34e9-46a7-9d9c-395eaf69359e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:09.091340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e17f77-34e9-46a7-9d9c-395eaf69359e admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:09.092297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e17f77-34e9-46a7-9d9c-395eaf69359e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:09.092655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e17f77-34e9-46a7-9d9c-395eaf69359e admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:09.093556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e17f77-34e9-46a7-9d9c-395eaf69359e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:37:09.094049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e17f77-34e9-46a7-9d9c-395eaf69359e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:09.114759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e17f77-34e9-46a7-9d9c-395eaf69359e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:09.135724 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2793/5561] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:37:09.136959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b6f91-c07c-48d6-8064-5be630efd3f2 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:09.149193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b6f91-c07c-48d6-8064-5be630efd3f2 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:09.156663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9de3e8-6ce3-4715-bdbd-05484384dd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:09.157659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9de3e8-6ce3-4715-bdbd-05484384dd04 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:09.158280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9de3e8-6ce3-4715-bdbd-05484384dd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:09.158753 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9de3e8-6ce3-4715-bdbd-05484384dd04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:09.159618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9de3e8-6ce3-4715-bdbd-05484384dd04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:09.163247 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9de3e8-6ce3-4715-bdbd-05484384dd04 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:09.203436 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2769/5562] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:37:09 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:09.208294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e17f77-34e9-46a7-9d9c-395eaf69359e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:09.227548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e17f77-34e9-46a7-9d9c-395eaf69359e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:09.378505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea64f4-25d7-4fbd-b37f-115f236abcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:09.379971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea64f4-25d7-4fbd-b37f-115f236abcf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:09.380298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea64f4-25d7-4fbd-b37f-115f236abcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:09.380605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea64f4-25d7-4fbd-b37f-115f236abcf8 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:09.382671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea64f4-25d7-4fbd-b37f-115f236abcf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:09.386849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea64f4-25d7-4fbd-b37f-115f236abcf8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:09.414044 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:09.448835 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2794/5563] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:37:09 2022] POST /identity/v3/users => generated 287 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:09.450447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9de3e8-6ce3-4715-bdbd-05484384dd04 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:09.467815 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9de3e8-6ce3-4715-bdbd-05484384dd04 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:09.478659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580d5f7-b959-4d42-aa83-f241b55c6112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:09.479506 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580d5f7-b959-4d42-aa83-f241b55c6112 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:09.479642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580d5f7-b959-4d42-aa83-f241b55c6112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:09.482333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580d5f7-b959-4d42-aa83-f241b55c6112 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:09.483071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580d5f7-b959-4d42-aa83-f241b55c6112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:09.484933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580d5f7-b959-4d42-aa83-f241b55c6112 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:09.505678 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:09.519841 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea64f4-25d7-4fbd-b37f-115f236abcf8 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:09.523036 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2770/5564] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:37:09.537391 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea64f4-25d7-4fbd-b37f-115f236abcf8 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:09.551776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e23da-d6a0-49f1-87c4-1426ada6495e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:09.552518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e23da-d6a0-49f1-87c4-1426ada6495e admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:09.552853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e23da-d6a0-49f1-87c4-1426ada6495e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:09.553597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e23da-d6a0-49f1-87c4-1426ada6495e admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:09.554259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e23da-d6a0-49f1-87c4-1426ada6495e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:09.560763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e23da-d6a0-49f1-87c4-1426ada6495e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:09.585800 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2795/5565] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:37:09.592264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580d5f7-b959-4d42-aa83-f241b55c6112 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:09.608241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580d5f7-b959-4d42-aa83-f241b55c6112 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:09.615754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1342835-17f5-4a51-bb1b-2f4183ba4a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:09.616694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1342835-17f5-4a51-bb1b-2f4183ba4a2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:09.617131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1342835-17f5-4a51-bb1b-2f4183ba4a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:09.617500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1342835-17f5-4a51-bb1b-2f4183ba4a2b admin admin] PATH_INFO: `/v3/projects/01682312419f4c1bb035099129909b9a/users/1a7b04f2ecb74ee5ad6c60b09c320910/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:09.687604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1342835-17f5-4a51-bb1b-2f4183ba4a2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=01682312419f4c1bb035099129909b9a, user_id=1a7b04f2ecb74ee5ad6c60b09c320910, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:09.691761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1342835-17f5-4a51-bb1b-2f4183ba4a2b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:09.718950 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2771/5566] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:37:09 2022] PUT /identity/v3/projects/01682312419f4c1bb035099129909b9a/users/1a7b04f2ecb74ee5ad6c60b09c320910/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:09.734258 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dd5ad-3d7f-4aaf-819b-37d34a06af14 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:09.734513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dd5ad-3d7f-4aaf-819b-37d34a06af14 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:09.734750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dd5ad-3d7f-4aaf-819b-37d34a06af14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:09.793778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-cb5dd5ad-3d7f-4aaf-819b-37d34a06af14 None None] MFA Rules not processed for user `1a7b04f2ecb74ee5ad6c60b09c320910`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:09.795969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-cb5dd5ad-3d7f-4aaf-819b-37d34a06af14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:09.909141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1342835-17f5-4a51-bb1b-2f4183ba4a2b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:09.911447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f1342835-17f5-4a51-bb1b-2f4183ba4a2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:09.951676 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2796/5567] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:09.957992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5dd5ad-3d7f-4aaf-819b-37d34a06af14 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:10.106653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1342835-17f5-4a51-bb1b-2f4183ba4a2b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:10.124541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3dc51e-1b8f-42a5-bb7f-aa4be162b859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:10.126485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dc51e-1b8f-42a5-bb7f-aa4be162b859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:10.126924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dc51e-1b8f-42a5-bb7f-aa4be162b859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:10.127297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dc51e-1b8f-42a5-bb7f-aa4be162b859 admin admin] PATH_INFO: `/v3/projects/43e8e945a8944094835af386f56aa53f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:10.128965 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3dc51e-1b8f-42a5-bb7f-aa4be162b859 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43e8e945a8944094835af386f56aa53f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:10.131238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3dc51e-1b8f-42a5-bb7f-aa4be162b859 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:10.138203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5dd5ad-3d7f-4aaf-819b-37d34a06af14 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:10.151722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c0c11-f2c6-4718-a1e7-b01fd4ad9d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:10.152690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c0c11-f2c6-4718-a1e7-b01fd4ad9d67 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:10.152967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c0c11-f2c6-4718-a1e7-b01fd4ad9d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:10.153221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c0c11-f2c6-4718-a1e7-b01fd4ad9d67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:10.153861 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c0c11-f2c6-4718-a1e7-b01fd4ad9d67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:10.155911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c0c11-f2c6-4718-a1e7-b01fd4ad9d67 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:10.207748 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2797/5568] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:37:09 2022] POST /identity/v3/projects => generated 373 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:10.212044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c0c11-f2c6-4718-a1e7-b01fd4ad9d67 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:10.248157 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ea3dc51e-1b8f-42a5-bb7f-aa4be162b859 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43e8e945a8944094835af386f56aa53f', 'request_id': 'req-ea3dc51e-1b8f-42a5-bb7f-aa4be162b859'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:10.258800 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ea3dc51e-1b8f-42a5-bb7f-aa4be162b859 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43e8e945a8944094835af386f56aa53f', 'request_id': 'req-ea3dc51e-1b8f-42a5-bb7f-aa4be162b859'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:10.271538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ea3dc51e-1b8f-42a5-bb7f-aa4be162b859 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43e8e945a8944094835af386f56aa53f', 'request_id': 'req-ea3dc51e-1b8f-42a5-bb7f-aa4be162b859'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:10.301237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ea3dc51e-1b8f-42a5-bb7f-aa4be162b859 admin admin] The token cache is being invalidate because project 43e8e945a8944094835af386f56aa53f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:10.301526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ea3dc51e-1b8f-42a5-bb7f-aa4be162b859 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:10.302570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ea3dc51e-1b8f-42a5-bb7f-aa4be162b859 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:10.304736 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2772/5569] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:37:09 2022] DELETE /identity/v3/projects/43e8e945a8944094835af386f56aa53f => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:10.309406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2e334-2d04-4b5f-86e3-e0d7dc3e89c9 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:10.309948 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2e334-2d04-4b5f-86e3-e0d7dc3e89c9 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:10.310404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2e334-2d04-4b5f-86e3-e0d7dc3e89c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:10.311837 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:10.318410 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c0c11-f2c6-4718-a1e7-b01fd4ad9d67 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:10.369553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6bb2e334-2d04-4b5f-86e3-e0d7dc3e89c9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:10.370981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6bb2e334-2d04-4b5f-86e3-e0d7dc3e89c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:10.456216 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2773/5570] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:37:10.467609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f646f-dd24-41ab-a560-1457e923baaa None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:10.467609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f646f-dd24-41ab-a560-1457e923baaa None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:10.467609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f646f-dd24-41ab-a560-1457e923baaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:10.479471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70332dd-e231-48d8-9f53-605c806b0393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:10.481333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70332dd-e231-48d8-9f53-605c806b0393 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:10.481712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70332dd-e231-48d8-9f53-605c806b0393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:10.481989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70332dd-e231-48d8-9f53-605c806b0393 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:10.482623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70332dd-e231-48d8-9f53-605c806b0393 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:10.489264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70332dd-e231-48d8-9f53-605c806b0393 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:10.492538 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:10.507120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ae7f646f-dd24-41ab-a560-1457e923baaa None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:10.509438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ae7f646f-dd24-41ab-a560-1457e923baaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:10.539343 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2774/5571] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:37:10.540146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f646f-dd24-41ab-a560-1457e923baaa None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:10.543386 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2798/5572] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:37:10 2022] POST /identity/v3/users => generated 293 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:37:10.547687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70332dd-e231-48d8-9f53-605c806b0393 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:10.551734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b70332dd-e231-48d8-9f53-605c806b0393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:10.564357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f646f-dd24-41ab-a560-1457e923baaa None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:10.570693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429bec9-96e0-466b-aa79-a8de29414ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:10.571633 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429bec9-96e0-466b-aa79-a8de29414ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:10.572105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429bec9-96e0-466b-aa79-a8de29414ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:10.572243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429bec9-96e0-466b-aa79-a8de29414ad5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:10.572861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429bec9-96e0-466b-aa79-a8de29414ad5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:37:10.573164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429bec9-96e0-466b-aa79-a8de29414ad5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:10.574795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429bec9-96e0-466b-aa79-a8de29414ad5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:10.578068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70332dd-e231-48d8-9f53-605c806b0393 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:10.584512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa9bf0-e9bb-49f8-ae57-6212f4ed5ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:10.585642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa9bf0-e9bb-49f8-ae57-6212f4ed5ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:10.586228 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa9bf0-e9bb-49f8-ae57-6212f4ed5ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:10.586804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa9bf0-e9bb-49f8-ae57-6212f4ed5ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:10.590471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa9bf0-e9bb-49f8-ae57-6212f4ed5ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:10.596395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa9bf0-e9bb-49f8-ae57-6212f4ed5ea3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:10.609331 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2775/5573] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:37:10.615504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429bec9-96e0-466b-aa79-a8de29414ad5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:10.629599 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2799/5574] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:37:10.634973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa9bf0-e9bb-49f8-ae57-6212f4ed5ea3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:10.651244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429bec9-96e0-466b-aa79-a8de29414ad5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:10.663492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579c732-bc4c-4e71-849b-75335613a2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:10.666197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579c732-bc4c-4e71-849b-75335613a2de admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:10.666698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579c732-bc4c-4e71-849b-75335613a2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:10.667182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579c732-bc4c-4e71-849b-75335613a2de admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:10.667711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa9bf0-e9bb-49f8-ae57-6212f4ed5ea3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:10.669396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579c732-bc4c-4e71-849b-75335613a2de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:10.673227 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b579c732-bc4c-4e71-849b-75335613a2de admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:10.680331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78f466-c835-4bf5-b593-1582453c39ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:10.681382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78f466-c835-4bf5-b593-1582453c39ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:10.682363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78f466-c835-4bf5-b593-1582453c39ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:10.684133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78f466-c835-4bf5-b593-1582453c39ec admin admin] PATH_INFO: `/v3/projects/567aaa829a894b70896ac1080fe63a23/users/6ca264e1de5b40588253955de43eb6c9/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:10.726749 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78f466-c835-4bf5-b593-1582453c39ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=567aaa829a894b70896ac1080fe63a23, user_id=6ca264e1de5b40588253955de43eb6c9, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:10.746089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78f466-c835-4bf5-b593-1582453c39ec admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:10.772304 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2776/5575] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:37:10 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:10.773938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579c732-bc4c-4e71-849b-75335613a2de admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:10.795175 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2800/5576] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:37:10 2022] PUT /identity/v3/projects/567aaa829a894b70896ac1080fe63a23/users/6ca264e1de5b40588253955de43eb6c9/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:10.796592 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78f466-c835-4bf5-b593-1582453c39ec admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:10.937776 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b579c732-bc4c-4e71-849b-75335613a2de admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:10.961454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78f466-c835-4bf5-b593-1582453c39ec admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:10.973093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e69c00-f2cc-4dcd-b2d1-c3e7af8c5bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:10.973727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e69c00-f2cc-4dcd-b2d1-c3e7af8c5bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:10.974012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e69c00-f2cc-4dcd-b2d1-c3e7af8c5bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:10.974593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e69c00-f2cc-4dcd-b2d1-c3e7af8c5bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:10.975251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e69c00-f2cc-4dcd-b2d1-c3e7af8c5bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:10.976913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e69c00-f2cc-4dcd-b2d1-c3e7af8c5bf0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:11.003675 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2801/5577] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:37:11.007840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c3bec-1ef8-407a-bdad-deed43af297e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:11.008172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c3bec-1ef8-407a-bdad-deed43af297e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:11.008449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c3bec-1ef8-407a-bdad-deed43af297e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:11.091439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-941c3bec-1ef8-407a-bdad-deed43af297e None None] MFA Rules not processed for user `2d8e76eb694846cabc55fc8e825c8e43`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:11.094515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-941c3bec-1ef8-407a-bdad-deed43af297e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:11.101213 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685d8a8-92f3-4d7c-9f38-2a336bfe2286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:11.102145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685d8a8-92f3-4d7c-9f38-2a336bfe2286 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:11.102652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685d8a8-92f3-4d7c-9f38-2a336bfe2286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:11.103195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685d8a8-92f3-4d7c-9f38-2a336bfe2286 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:11.104143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685d8a8-92f3-4d7c-9f38-2a336bfe2286 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:11.106657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685d8a8-92f3-4d7c-9f38-2a336bfe2286 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:11.166765 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2777/5578] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:37:10 2022] POST /identity/v3/users => generated 287 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:11.167651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685d8a8-92f3-4d7c-9f38-2a336bfe2286 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:11.188048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685d8a8-92f3-4d7c-9f38-2a336bfe2286 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:11.197247 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c6f81-1186-4bfb-9302-22f1372d604f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:11.198176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c6f81-1186-4bfb-9302-22f1372d604f admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:11.198743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c6f81-1186-4bfb-9302-22f1372d604f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:11.199490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c6f81-1186-4bfb-9302-22f1372d604f admin admin] PATH_INFO: `/v3/projects/567aaa829a894b70896ac1080fe63a23/users/6ca264e1de5b40588253955de43eb6c9/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:11.214613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c6f81-1186-4bfb-9302-22f1372d604f admin admin] RBAC: Authorizing `identity:create_grant(project_id=567aaa829a894b70896ac1080fe63a23, user_id=6ca264e1de5b40588253955de43eb6c9, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:11.226639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c6f81-1186-4bfb-9302-22f1372d604f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:11.268885 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2778/5579] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:37:11 2022] PUT /identity/v3/projects/567aaa829a894b70896ac1080fe63a23/users/6ca264e1de5b40588253955de43eb6c9/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:11.268885 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c6f81-1186-4bfb-9302-22f1372d604f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:11.271703 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:11.317136 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2802/5580] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:11.317136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c29be5-1c2d-484c-a26b-a8a09aa0ab26 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:11.317136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c29be5-1c2d-484c-a26b-a8a09aa0ab26 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:11.317136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c29be5-1c2d-484c-a26b-a8a09aa0ab26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:11.343719 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:11.360489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c6f81-1186-4bfb-9302-22f1372d604f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:11.375275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ececf8-877d-4766-9126-97e7c3f314c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:11.375672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c7c29be5-1c2d-484c-a26b-a8a09aa0ab26 None None] MFA Rules not processed for user `6ca264e1de5b40588253955de43eb6c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:11.375922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ececf8-877d-4766-9126-97e7c3f314c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:11.376210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ececf8-877d-4766-9126-97e7c3f314c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:11.376491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ececf8-877d-4766-9126-97e7c3f314c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:11.377755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ececf8-877d-4766-9126-97e7c3f314c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:11.377986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c7c29be5-1c2d-484c-a26b-a8a09aa0ab26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:11.379369 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ececf8-877d-4766-9126-97e7c3f314c3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:11.407134 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2779/5581] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:37:11.410650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ececf8-877d-4766-9126-97e7c3f314c3 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:11.414524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-20ececf8-877d-4766-9126-97e7c3f314c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:11.503221 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2803/5582] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:11.504445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c29be5-1c2d-484c-a26b-a8a09aa0ab26 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:11.522010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c29be5-1c2d-484c-a26b-a8a09aa0ab26 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:11.528587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db766d5-8bb0-4859-b8b9-166e9303e547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:11.529339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db766d5-8bb0-4859-b8b9-166e9303e547 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:11.529624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db766d5-8bb0-4859-b8b9-166e9303e547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:11.529893 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db766d5-8bb0-4859-b8b9-166e9303e547 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:11.530713 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db766d5-8bb0-4859-b8b9-166e9303e547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:11.532174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db766d5-8bb0-4859-b8b9-166e9303e547 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:11.544642 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2804/5583] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:37:11.545599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db766d5-8bb0-4859-b8b9-166e9303e547 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:11.560112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db766d5-8bb0-4859-b8b9-166e9303e547 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:11.565687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ececf8-877d-4766-9126-97e7c3f314c3 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:11.566558 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624044a7-4170-4f9b-9c31-623d0e190a51 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:11.567470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624044a7-4170-4f9b-9c31-623d0e190a51 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:11.567872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624044a7-4170-4f9b-9c31-623d0e190a51 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:11.568285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624044a7-4170-4f9b-9c31-623d0e190a51 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:11.569249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624044a7-4170-4f9b-9c31-623d0e190a51 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:11.570937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624044a7-4170-4f9b-9c31-623d0e190a51 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:11.573612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858e452-2ee2-4a7f-9361-a4851104d0e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:11.575995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858e452-2ee2-4a7f-9361-a4851104d0e1 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:11.576535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858e452-2ee2-4a7f-9361-a4851104d0e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:11.577071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858e452-2ee2-4a7f-9361-a4851104d0e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:11.594641 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2805/5584] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Aug 7 01:37:11 2022] POST /identity/v3/domains => generated 276 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:11.596524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624044a7-4170-4f9b-9c31-623d0e190a51 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:11.670140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b858e452-2ee2-4a7f-9361-a4851104d0e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:11.672533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b858e452-2ee2-4a7f-9361-a4851104d0e1 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:11.684361 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2780/5585] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:37:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:37:11.685785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858e452-2ee2-4a7f-9361-a4851104d0e1 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:11.698707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624044a7-4170-4f9b-9c31-623d0e190a51 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:11.701151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858e452-2ee2-4a7f-9361-a4851104d0e1 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:11.713173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb90da-f18e-4d9a-8ffd-b5ba00fe274e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:11.715209 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb90da-f18e-4d9a-8ffd-b5ba00fe274e admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:11.715801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb90da-f18e-4d9a-8ffd-b5ba00fe274e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:11.717268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb90da-f18e-4d9a-8ffd-b5ba00fe274e admin admin] PATH_INFO: `/v3/projects/01efbcff3e40402d9bb00203e7591dd6/users/b328b28645394d758d279eae494ff2e5/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:11.772124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb90da-f18e-4d9a-8ffd-b5ba00fe274e admin admin] RBAC: Authorizing `identity:create_grant(project_id=01efbcff3e40402d9bb00203e7591dd6, user_id=b328b28645394d758d279eae494ff2e5, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:11.779622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb90da-f18e-4d9a-8ffd-b5ba00fe274e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:11.804325 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2806/5586] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:37:11 2022] PUT /identity/v3/projects/01efbcff3e40402d9bb00203e7591dd6/users/b328b28645394d758d279eae494ff2e5/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:11.817461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17ffa5-b510-4373-9d6c-a5dc5078a693 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:11.817704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17ffa5-b510-4373-9d6c-a5dc5078a693 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:11.817979 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17ffa5-b510-4373-9d6c-a5dc5078a693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:11.833098 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88c443-9e4e-4d7a-ac35-a7d70a9440cb tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:11.834098 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88c443-9e4e-4d7a-ac35-a7d70a9440cb tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:11.834382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88c443-9e4e-4d7a-ac35-a7d70a9440cb tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:11.834654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88c443-9e4e-4d7a-ac35-a7d70a9440cb tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:11.835352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa88c443-9e4e-4d7a-ac35-a7d70a9440cb tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:11.837791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa88c443-9e4e-4d7a-ac35-a7d70a9440cb tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:11.891923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2e17ffa5-b510-4373-9d6c-a5dc5078a693 None None] MFA Rules not processed for user `b328b28645394d758d279eae494ff2e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:11.893248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2e17ffa5-b510-4373-9d6c-a5dc5078a693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:11.924130 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:11.937738 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:11.947518 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2781/5587] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:37:11 2022] POST /identity/v3/projects => generated 401 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:11.948840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88c443-9e4e-4d7a-ac35-a7d70a9440cb tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:12.050196 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2807/5588] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:12.056607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17ffa5-b510-4373-9d6c-a5dc5078a693 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:12.061014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2e17ffa5-b510-4373-9d6c-a5dc5078a693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:12.106186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88c443-9e4e-4d7a-ac35-a7d70a9440cb tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:12.113682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddabcd-605b-46e9-8fda-97d549de5a07 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:12.114903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddabcd-605b-46e9-8fda-97d549de5a07 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:12.115257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddabcd-605b-46e9-8fda-97d549de5a07 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:12.115653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddabcd-605b-46e9-8fda-97d549de5a07 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/groups` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:12.116528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ddabcd-605b-46e9-8fda-97d549de5a07 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:12.119631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ddabcd-605b-46e9-8fda-97d549de5a07 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:12.156036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17ffa5-b510-4373-9d6c-a5dc5078a693 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:12.164907 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2782/5589] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:37:11 2022] POST /identity/v3/groups => generated 302 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:12.169323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddabcd-605b-46e9-8fda-97d549de5a07 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:12.196622 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddabcd-605b-46e9-8fda-97d549de5a07 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:12.208479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ff517-c245-492f-be35-f84537fc271e tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:12.220579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ff517-c245-492f-be35-f84537fc271e tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:12.222414 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ff517-c245-492f-be35-f84537fc271e tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:12.222994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ff517-c245-492f-be35-f84537fc271e tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:12.225705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ff517-c245-492f-be35-f84537fc271e tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:12.230265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81ff517-c245-492f-be35-f84537fc271e tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:12.307343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc148f30-782a-46e8-8687-b85c21529930 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:12.308012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc148f30-782a-46e8-8687-b85c21529930 service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:12.308296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc148f30-782a-46e8-8687-b85c21529930 service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:12.308567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc148f30-782a-46e8-8687-b85c21529930 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:12.323482 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2783/5590] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:37:12 2022] POST /identity/v3/users => generated 442 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:12.325709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ff517-c245-492f-be35-f84537fc271e tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:12.355284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ff517-c245-492f-be35-f84537fc271e tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:12.371467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579f9e3-0405-4b34-b46a-0ae7aeb64e25 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:12.372550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579f9e3-0405-4b34-b46a-0ae7aeb64e25 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:12.372838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579f9e3-0405-4b34-b46a-0ae7aeb64e25 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:12.373207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579f9e3-0405-4b34-b46a-0ae7aeb64e25 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:12.379922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579f9e3-0405-4b34-b46a-0ae7aeb64e25 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:12.384872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579f9e3-0405-4b34-b46a-0ae7aeb64e25 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:12.421027 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2784/5591] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:37:12 2022] POST /identity/v3/roles => generated 239 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:12.423082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579f9e3-0405-4b34-b46a-0ae7aeb64e25 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:12.451712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579f9e3-0405-4b34-b46a-0ae7aeb64e25 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:12.465315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1e5ba-ee1b-40da-aa31-dd973db2f9e9 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:12.466136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1e5ba-ee1b-40da-aa31-dd973db2f9e9 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:12.466391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1e5ba-ee1b-40da-aa31-dd973db2f9e9 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:12.466799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1e5ba-ee1b-40da-aa31-dd973db2f9e9 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/31644d59897b44ac8c34d80a6e58d85b/groups/0a27aff4f57a42d38cd42c2cb9f54068/roles/034d9e1de6cb4fe6a1bfcbfa3fd525d0/inherited_to_projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:12.489618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1e5ba-ee1b-40da-aa31-dd973db2f9e9 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:create_grant(project_id=31644d59897b44ac8c34d80a6e58d85b, group_id=0a27aff4f57a42d38cd42c2cb9f54068, role_id=034d9e1de6cb4fe6a1bfcbfa3fd525d0)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:12.490971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc148f30-782a-46e8-8687-b85c21529930 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:12.492438 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc148f30-782a-46e8-8687-b85c21529930 service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:12.497478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1e5ba-ee1b-40da-aa31-dd973db2f9e9 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:12.515909 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2808/5592] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:37:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:37:12.523682 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2785/5593] 10.222.0.39 () {60 vars in 1585 bytes} [Sun Aug 7 01:37:12 2022] PUT /identity/v3/OS-INHERIT/projects/31644d59897b44ac8c34d80a6e58d85b/groups/0a27aff4f57a42d38cd42c2cb9f54068/roles/034d9e1de6cb4fe6a1bfcbfa3fd525d0/inherited_to_projects => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:12.525570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc148f30-782a-46e8-8687-b85c21529930 service cinder] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:12.544810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc148f30-782a-46e8-8687-b85c21529930 service cinder] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:12.577128 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:12.626261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d9ab3-1530-4db2-b2f9-e820d0207a48 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:12.627455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d9ab3-1530-4db2-b2f9-e820d0207a48 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:12.627455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d9ab3-1530-4db2-b2f9-e820d0207a48 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:12.627910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d9ab3-1530-4db2-b2f9-e820d0207a48 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/31644d59897b44ac8c34d80a6e58d85b/groups/0a27aff4f57a42d38cd42c2cb9f54068/roles/034d9e1de6cb4fe6a1bfcbfa3fd525d0/inherited_to_projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:12.631629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d9ab3-1530-4db2-b2f9-e820d0207a48 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:check_grant(project_id=31644d59897b44ac8c34d80a6e58d85b, group_id=0a27aff4f57a42d38cd42c2cb9f54068, role_id=034d9e1de6cb4fe6a1bfcbfa3fd525d0)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:12.635023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d9ab3-1530-4db2-b2f9-e820d0207a48 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:12.650901 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2809/5594] 10.222.0.39 () {58 vars in 1567 bytes} [Sun Aug 7 01:37:12 2022] HEAD /identity/v3/OS-INHERIT/projects/31644d59897b44ac8c34d80a6e58d85b/groups/0a27aff4f57a42d38cd42c2cb9f54068/roles/034d9e1de6cb4fe6a1bfcbfa3fd525d0/inherited_to_projects => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:12.652916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1e5ba-ee1b-40da-aa31-dd973db2f9e9 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:12.670683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1e5ba-ee1b-40da-aa31-dd973db2f9e9 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:12.705013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2d5ca-b72c-4e05-b030-10ecd9cf1a56 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:12.706856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2d5ca-b72c-4e05-b030-10ecd9cf1a56 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:12.707042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2d5ca-b72c-4e05-b030-10ecd9cf1a56 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:12.707722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2d5ca-b72c-4e05-b030-10ecd9cf1a56 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/31644d59897b44ac8c34d80a6e58d85b/groups/0a27aff4f57a42d38cd42c2cb9f54068/roles/034d9e1de6cb4fe6a1bfcbfa3fd525d0/inherited_to_projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:12.717092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2d5ca-b72c-4e05-b030-10ecd9cf1a56 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=31644d59897b44ac8c34d80a6e58d85b, group_id=0a27aff4f57a42d38cd42c2cb9f54068, role_id=034d9e1de6cb4fe6a1bfcbfa3fd525d0)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:12.727486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2d5ca-b72c-4e05-b030-10ecd9cf1a56 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:12.746116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-52e2d5ca-b72c-4e05-b030-10ecd9cf1a56 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invalidating the token cache because role 034d9e1de6cb4fe6a1bfcbfa3fd525d0 was removed from group 0a27aff4f57a42d38cd42c2cb9f54068 on project 31644d59897b44ac8c34d80a6e58d85b. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:12.746519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-52e2d5ca-b72c-4e05-b030-10ecd9cf1a56 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:12.747340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-52e2d5ca-b72c-4e05-b030-10ecd9cf1a56 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:12.775699 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2786/5595] 10.222.0.39 () {58 vars in 1569 bytes} [Sun Aug 7 01:37:12 2022] DELETE /identity/v3/OS-INHERIT/projects/31644d59897b44ac8c34d80a6e58d85b/groups/0a27aff4f57a42d38cd42c2cb9f54068/roles/034d9e1de6cb4fe6a1bfcbfa3fd525d0/inherited_to_projects => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:12.781458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d9ab3-1530-4db2-b2f9-e820d0207a48 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:12.784392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1d7d9ab3-1530-4db2-b2f9-e820d0207a48 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:12.818107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d9ab3-1530-4db2-b2f9-e820d0207a48 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:13.012876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afa1af-d947-40bf-a210-129e79c58745 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:13.013562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afa1af-d947-40bf-a210-129e79c58745 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:13.013881 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afa1af-d947-40bf-a210-129e79c58745 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:13.014413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afa1af-d947-40bf-a210-129e79c58745 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/roles/034d9e1de6cb4fe6a1bfcbfa3fd525d0` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:13.016212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44afa1af-d947-40bf-a210-129e79c58745 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:delete_role(role_id=034d9e1de6cb4fe6a1bfcbfa3fd525d0)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:13.019229 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44afa1af-d947-40bf-a210-129e79c58745 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:13.094856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-44afa1af-d947-40bf-a210-129e79c58745 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invalidating the token cache because role 034d9e1de6cb4fe6a1bfcbfa3fd525d0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:13.095314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-44afa1af-d947-40bf-a210-129e79c58745 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:13.096658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-44afa1af-d947-40bf-a210-129e79c58745 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:13.098579 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2810/5596] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:37:12 2022] DELETE /identity/v3/roles/034d9e1de6cb4fe6a1bfcbfa3fd525d0 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:13.105749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2d5ca-b72c-4e05-b030-10ecd9cf1a56 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:13.141272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2d5ca-b72c-4e05-b030-10ecd9cf1a56 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:13.322934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b74730-5910-4b78-8087-641144c01158 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:13.323748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b74730-5910-4b78-8087-641144c01158 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:13.324430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b74730-5910-4b78-8087-641144c01158 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:13.324729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b74730-5910-4b78-8087-641144c01158 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:13.325670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b74730-5910-4b78-8087-641144c01158 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:13.327351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b74730-5910-4b78-8087-641144c01158 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:13.353559 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2787/5597] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:37:13 2022] POST /identity/v3/roles => generated 239 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:13.358159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afa1af-d947-40bf-a210-129e79c58745 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:13.359657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-44afa1af-d947-40bf-a210-129e79c58745 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:13.381857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afa1af-d947-40bf-a210-129e79c58745 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:13.390485 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31acf15-1a43-4138-bece-f94b7c2759f0 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:13.395663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31acf15-1a43-4138-bece-f94b7c2759f0 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:13.396246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31acf15-1a43-4138-bece-f94b7c2759f0 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:13.396696 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31acf15-1a43-4138-bece-f94b7c2759f0 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/31644d59897b44ac8c34d80a6e58d85b/users/5d97c32fee1849ba9784df3f7c74fb86/roles/83d339557f194d8695a4799d9e4f7c13/inherited_to_projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:13.419643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31acf15-1a43-4138-bece-f94b7c2759f0 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:create_grant(project_id=31644d59897b44ac8c34d80a6e58d85b, user_id=5d97c32fee1849ba9784df3f7c74fb86, role_id=83d339557f194d8695a4799d9e4f7c13)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:13.423990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31acf15-1a43-4138-bece-f94b7c2759f0 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:13.442861 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2811/5598] 10.222.0.39 () {60 vars in 1582 bytes} [Sun Aug 7 01:37:13 2022] PUT /identity/v3/OS-INHERIT/projects/31644d59897b44ac8c34d80a6e58d85b/users/5d97c32fee1849ba9784df3f7c74fb86/roles/83d339557f194d8695a4799d9e4f7c13/inherited_to_projects => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:37:13.447359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b74730-5910-4b78-8087-641144c01158 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:13.464850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b74730-5910-4b78-8087-641144c01158 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:13.510314 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:13.647079 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a5a60-2d32-4046-af90-ac5db3aa59ce tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:13.647793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a5a60-2d32-4046-af90-ac5db3aa59ce tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:13.648094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a5a60-2d32-4046-af90-ac5db3aa59ce tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:13.648368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a5a60-2d32-4046-af90-ac5db3aa59ce tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/31644d59897b44ac8c34d80a6e58d85b/users/5d97c32fee1849ba9784df3f7c74fb86/roles/83d339557f194d8695a4799d9e4f7c13/inherited_to_projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:13.653798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a5a60-2d32-4046-af90-ac5db3aa59ce tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:check_grant(project_id=31644d59897b44ac8c34d80a6e58d85b, user_id=5d97c32fee1849ba9784df3f7c74fb86, role_id=83d339557f194d8695a4799d9e4f7c13)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:13.657126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a5a60-2d32-4046-af90-ac5db3aa59ce tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:13.675590 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2788/5599] 10.222.0.39 () {58 vars in 1564 bytes} [Sun Aug 7 01:37:13 2022] HEAD /identity/v3/OS-INHERIT/projects/31644d59897b44ac8c34d80a6e58d85b/users/5d97c32fee1849ba9784df3f7c74fb86/roles/83d339557f194d8695a4799d9e4f7c13/inherited_to_projects => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:13.679955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31acf15-1a43-4138-bece-f94b7c2759f0 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:13.697319 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31acf15-1a43-4138-bece-f94b7c2759f0 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:13.709646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befb462-252f-4bdb-9043-beca20ed8114 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:13.710530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befb462-252f-4bdb-9043-beca20ed8114 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:13.710939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befb462-252f-4bdb-9043-beca20ed8114 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:13.711323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befb462-252f-4bdb-9043-beca20ed8114 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/31644d59897b44ac8c34d80a6e58d85b/users/5d97c32fee1849ba9784df3f7c74fb86/roles/83d339557f194d8695a4799d9e4f7c13/inherited_to_projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:13.713941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befb462-252f-4bdb-9043-beca20ed8114 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=31644d59897b44ac8c34d80a6e58d85b, user_id=5d97c32fee1849ba9784df3f7c74fb86, role_id=83d339557f194d8695a4799d9e4f7c13)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:13.717003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befb462-252f-4bdb-9043-beca20ed8114 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:13.725055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1befb462-252f-4bdb-9043-beca20ed8114 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invalidating the token cache because role 83d339557f194d8695a4799d9e4f7c13 was removed from user 5d97c32fee1849ba9784df3f7c74fb86 on project 31644d59897b44ac8c34d80a6e58d85b. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:13.725515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1befb462-252f-4bdb-9043-beca20ed8114 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:13.726384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1befb462-252f-4bdb-9043-beca20ed8114 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:13.748735 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2812/5600] 10.222.0.39 () {58 vars in 1566 bytes} [Sun Aug 7 01:37:13 2022] DELETE /identity/v3/OS-INHERIT/projects/31644d59897b44ac8c34d80a6e58d85b/users/5d97c32fee1849ba9784df3f7c74fb86/roles/83d339557f194d8695a4799d9e4f7c13/inherited_to_projects => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:13.750775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a5a60-2d32-4046-af90-ac5db3aa59ce tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:13.752621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-317a5a60-2d32-4046-af90-ac5db3aa59ce tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:13.782706 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a5a60-2d32-4046-af90-ac5db3aa59ce tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:13.905753 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3ca9d-0e79-44c3-a215-d1c44b475fb2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:13.906486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3ca9d-0e79-44c3-a215-d1c44b475fb2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:13.906679 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3ca9d-0e79-44c3-a215-d1c44b475fb2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:13.907145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3ca9d-0e79-44c3-a215-d1c44b475fb2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/roles/83d339557f194d8695a4799d9e4f7c13` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:13.910141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea3ca9d-0e79-44c3-a215-d1c44b475fb2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:delete_role(role_id=83d339557f194d8695a4799d9e4f7c13)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:13.911775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea3ca9d-0e79-44c3-a215-d1c44b475fb2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:14.012691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7ea3ca9d-0e79-44c3-a215-d1c44b475fb2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invalidating the token cache because role 83d339557f194d8695a4799d9e4f7c13 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:14.013057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7ea3ca9d-0e79-44c3-a215-d1c44b475fb2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:14.013701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7ea3ca9d-0e79-44c3-a215-d1c44b475fb2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:14.016282 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2789/5601] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:37:13 2022] DELETE /identity/v3/roles/83d339557f194d8695a4799d9e4f7c13 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:14.026454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befb462-252f-4bdb-9043-beca20ed8114 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:14.051704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befb462-252f-4bdb-9043-beca20ed8114 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:14.225856 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:14.246385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230c19d-30f9-4b3a-a5b6-08a5fabd8f41 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:14.247347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230c19d-30f9-4b3a-a5b6-08a5fabd8f41 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:14.248206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230c19d-30f9-4b3a-a5b6-08a5fabd8f41 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:14.248734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230c19d-30f9-4b3a-a5b6-08a5fabd8f41 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:14.250172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230c19d-30f9-4b3a-a5b6-08a5fabd8f41 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:14.253310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230c19d-30f9-4b3a-a5b6-08a5fabd8f41 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:14.292392 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2813/5602] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:37:14 2022] POST /identity/v3/roles => generated 240 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:14.297025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3ca9d-0e79-44c3-a215-d1c44b475fb2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:14.300703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7ea3ca9d-0e79-44c3-a215-d1c44b475fb2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:14.345756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3ca9d-0e79-44c3-a215-d1c44b475fb2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:14.381952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19422e98-644e-4448-a6bb-95ba7abf58a7 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:14.386762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19422e98-644e-4448-a6bb-95ba7abf58a7 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:14.387245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19422e98-644e-4448-a6bb-95ba7abf58a7 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:14.387962 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19422e98-644e-4448-a6bb-95ba7abf58a7 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/909a8901b54a43fba7cb0f65433e988e/groups/0a27aff4f57a42d38cd42c2cb9f54068/roles/87c64029889c4710ab5d7c37d4c5d8b6/inherited_to_projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:14.402353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19422e98-644e-4448-a6bb-95ba7abf58a7 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=909a8901b54a43fba7cb0f65433e988e, group_id=0a27aff4f57a42d38cd42c2cb9f54068, role_id=87c64029889c4710ab5d7c37d4c5d8b6)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:14.405504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19422e98-644e-4448-a6bb-95ba7abf58a7 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:14.451459 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2790/5603] 10.222.0.39 () {60 vars in 1582 bytes} [Sun Aug 7 01:37:14 2022] PUT /identity/v3/OS-INHERIT/domains/909a8901b54a43fba7cb0f65433e988e/groups/0a27aff4f57a42d38cd42c2cb9f54068/roles/87c64029889c4710ab5d7c37d4c5d8b6/inherited_to_projects => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:14.462860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230c19d-30f9-4b3a-a5b6-08a5fabd8f41 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:14.485413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230c19d-30f9-4b3a-a5b6-08a5fabd8f41 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:14.668315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55298d08-075b-4b1b-8d32-3ebff9cb0636 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:14.673636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55298d08-075b-4b1b-8d32-3ebff9cb0636 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:14.675424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55298d08-075b-4b1b-8d32-3ebff9cb0636 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:14.675810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55298d08-075b-4b1b-8d32-3ebff9cb0636 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/909a8901b54a43fba7cb0f65433e988e/groups/0a27aff4f57a42d38cd42c2cb9f54068/roles/inherited_to_projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:14.680244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55298d08-075b-4b1b-8d32-3ebff9cb0636 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=909a8901b54a43fba7cb0f65433e988e, group_id=0a27aff4f57a42d38cd42c2cb9f54068)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:14.690509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55298d08-075b-4b1b-8d32-3ebff9cb0636 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:14.752383 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2814/5604] 10.222.0.39 () {58 vars in 1464 bytes} [Sun Aug 7 01:37:14 2022] GET /identity/v3/OS-INHERIT/domains/909a8901b54a43fba7cb0f65433e988e/groups/0a27aff4f57a42d38cd42c2cb9f54068/roles/inherited_to_projects => generated 448 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:37:14.756854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19422e98-644e-4448-a6bb-95ba7abf58a7 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:14.772482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19422e98-644e-4448-a6bb-95ba7abf58a7 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:14.784036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40815cf-d219-48d1-8856-b022c8a5e9cd tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:14.785040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40815cf-d219-48d1-8856-b022c8a5e9cd tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:14.785624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40815cf-d219-48d1-8856-b022c8a5e9cd tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:14.786109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40815cf-d219-48d1-8856-b022c8a5e9cd tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/909a8901b54a43fba7cb0f65433e988e/groups/0a27aff4f57a42d38cd42c2cb9f54068/roles/87c64029889c4710ab5d7c37d4c5d8b6/inherited_to_projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:14.796314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40815cf-d219-48d1-8856-b022c8a5e9cd tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=909a8901b54a43fba7cb0f65433e988e, group_id=0a27aff4f57a42d38cd42c2cb9f54068, role_id=87c64029889c4710ab5d7c37d4c5d8b6)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:14.800110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40815cf-d219-48d1-8856-b022c8a5e9cd tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:14.808245 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2791/5605] 10.222.0.39 () {58 vars in 1564 bytes} [Sun Aug 7 01:37:14 2022] HEAD /identity/v3/OS-INHERIT/domains/909a8901b54a43fba7cb0f65433e988e/groups/0a27aff4f57a42d38cd42c2cb9f54068/roles/87c64029889c4710ab5d7c37d4c5d8b6/inherited_to_projects => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:14.812417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55298d08-075b-4b1b-8d32-3ebff9cb0636 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:14.824640 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55298d08-075b-4b1b-8d32-3ebff9cb0636 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:14.856977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf7b6f-5f71-4444-a69c-74162a1ab931 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:14.857856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf7b6f-5f71-4444-a69c-74162a1ab931 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:14.858252 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf7b6f-5f71-4444-a69c-74162a1ab931 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:14.858639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf7b6f-5f71-4444-a69c-74162a1ab931 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/909a8901b54a43fba7cb0f65433e988e/groups/0a27aff4f57a42d38cd42c2cb9f54068/roles/87c64029889c4710ab5d7c37d4c5d8b6/inherited_to_projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:14.876087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf7b6f-5f71-4444-a69c-74162a1ab931 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=909a8901b54a43fba7cb0f65433e988e, group_id=0a27aff4f57a42d38cd42c2cb9f54068, role_id=87c64029889c4710ab5d7c37d4c5d8b6)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:14.878946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf7b6f-5f71-4444-a69c-74162a1ab931 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:14.900233 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9dcf7b6f-5f71-4444-a69c-74162a1ab931 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invalidating the token cache because role 87c64029889c4710ab5d7c37d4c5d8b6 was removed from group 0a27aff4f57a42d38cd42c2cb9f54068 on domain 909a8901b54a43fba7cb0f65433e988e. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:14.901080 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9dcf7b6f-5f71-4444-a69c-74162a1ab931 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:14.904021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9dcf7b6f-5f71-4444-a69c-74162a1ab931 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:14.977732 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2815/5606] 10.222.0.39 () {58 vars in 1566 bytes} [Sun Aug 7 01:37:14 2022] DELETE /identity/v3/OS-INHERIT/domains/909a8901b54a43fba7cb0f65433e988e/groups/0a27aff4f57a42d38cd42c2cb9f54068/roles/87c64029889c4710ab5d7c37d4c5d8b6/inherited_to_projects => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:14.979475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40815cf-d219-48d1-8856-b022c8a5e9cd tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:14.981502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d40815cf-d219-48d1-8856-b022c8a5e9cd tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:15.014802 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40815cf-d219-48d1-8856-b022c8a5e9cd tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:15.207824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d400c69-2106-4d92-87b9-c35909b0d2f8 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:15.246011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d400c69-2106-4d92-87b9-c35909b0d2f8 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:15.246370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d400c69-2106-4d92-87b9-c35909b0d2f8 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:15.246578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d400c69-2106-4d92-87b9-c35909b0d2f8 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/roles/87c64029889c4710ab5d7c37d4c5d8b6` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:15.250019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d400c69-2106-4d92-87b9-c35909b0d2f8 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:delete_role(role_id=87c64029889c4710ab5d7c37d4c5d8b6)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:15.266002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d400c69-2106-4d92-87b9-c35909b0d2f8 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:15.272992 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:15.370062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6d400c69-2106-4d92-87b9-c35909b0d2f8 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invalidating the token cache because role 87c64029889c4710ab5d7c37d4c5d8b6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:15.370624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6d400c69-2106-4d92-87b9-c35909b0d2f8 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:15.371058 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6d400c69-2106-4d92-87b9-c35909b0d2f8 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:15.382968 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2792/5607] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:37:14 2022] DELETE /identity/v3/roles/87c64029889c4710ab5d7c37d4c5d8b6 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:15.389017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf7b6f-5f71-4444-a69c-74162a1ab931 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:15.408153 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf7b6f-5f71-4444-a69c-74162a1ab931 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:15.577803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2c111-47c5-4ec0-ae2b-d162b2eb400c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:15.579387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2c111-47c5-4ec0-ae2b-d162b2eb400c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:15.580483 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2c111-47c5-4ec0-ae2b-d162b2eb400c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:15.592817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2c111-47c5-4ec0-ae2b-d162b2eb400c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:15.593640 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2c111-47c5-4ec0-ae2b-d162b2eb400c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:15.595372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2c111-47c5-4ec0-ae2b-d162b2eb400c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:15.620775 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2816/5608] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:37:15 2022] POST /identity/v3/roles => generated 239 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:15.624762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d400c69-2106-4d92-87b9-c35909b0d2f8 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:15.627043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6d400c69-2106-4d92-87b9-c35909b0d2f8 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:15.648759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d400c69-2106-4d92-87b9-c35909b0d2f8 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:15.655482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49ed81-884d-48b0-ad8b-7af3749b4a55 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:15.656446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49ed81-884d-48b0-ad8b-7af3749b4a55 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:15.656817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49ed81-884d-48b0-ad8b-7af3749b4a55 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:15.657216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49ed81-884d-48b0-ad8b-7af3749b4a55 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/909a8901b54a43fba7cb0f65433e988e/users/5d97c32fee1849ba9784df3f7c74fb86/roles/6f2aeecb578f4f4b9b20ad76551cca5d/inherited_to_projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:15.660434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49ed81-884d-48b0-ad8b-7af3749b4a55 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=909a8901b54a43fba7cb0f65433e988e, user_id=5d97c32fee1849ba9784df3f7c74fb86, role_id=6f2aeecb578f4f4b9b20ad76551cca5d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:15.663777 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49ed81-884d-48b0-ad8b-7af3749b4a55 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:15.684206 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2793/5609] 10.222.0.39 () {60 vars in 1579 bytes} [Sun Aug 7 01:37:15 2022] PUT /identity/v3/OS-INHERIT/domains/909a8901b54a43fba7cb0f65433e988e/users/5d97c32fee1849ba9784df3f7c74fb86/roles/6f2aeecb578f4f4b9b20ad76551cca5d/inherited_to_projects => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:37:15.688726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2c111-47c5-4ec0-ae2b-d162b2eb400c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:15.706707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2c111-47c5-4ec0-ae2b-d162b2eb400c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:15.872479 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:15.908525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cc1e1-d167-47e3-87e7-79feea3153f4 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:15.912812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cc1e1-d167-47e3-87e7-79feea3153f4 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:15.913102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cc1e1-d167-47e3-87e7-79feea3153f4 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:15.913385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cc1e1-d167-47e3-87e7-79feea3153f4 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/909a8901b54a43fba7cb0f65433e988e/users/5d97c32fee1849ba9784df3f7c74fb86/roles/inherited_to_projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:15.926745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961cc1e1-d167-47e3-87e7-79feea3153f4 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=909a8901b54a43fba7cb0f65433e988e, user_id=5d97c32fee1849ba9784df3f7c74fb86)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:15.929781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961cc1e1-d167-47e3-87e7-79feea3153f4 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:15.948100 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2817/5610] 10.222.0.39 () {58 vars in 1461 bytes} [Sun Aug 7 01:37:15 2022] GET /identity/v3/OS-INHERIT/domains/909a8901b54a43fba7cb0f65433e988e/users/5d97c32fee1849ba9784df3f7c74fb86/roles/inherited_to_projects => generated 446 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:37:15.951931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49ed81-884d-48b0-ad8b-7af3749b4a55 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:15.971608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49ed81-884d-48b0-ad8b-7af3749b4a55 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:15.978464 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152de889-962b-49fa-917b-632def1d269a tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:15.979786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152de889-962b-49fa-917b-632def1d269a tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:15.980499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152de889-962b-49fa-917b-632def1d269a tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:15.981275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152de889-962b-49fa-917b-632def1d269a tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/909a8901b54a43fba7cb0f65433e988e/users/5d97c32fee1849ba9784df3f7c74fb86/roles/6f2aeecb578f4f4b9b20ad76551cca5d/inherited_to_projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:15.984012 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152de889-962b-49fa-917b-632def1d269a tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=909a8901b54a43fba7cb0f65433e988e, user_id=5d97c32fee1849ba9784df3f7c74fb86, role_id=6f2aeecb578f4f4b9b20ad76551cca5d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:15.988277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152de889-962b-49fa-917b-632def1d269a tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:16.017892 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2794/5611] 10.222.0.39 () {58 vars in 1561 bytes} [Sun Aug 7 01:37:15 2022] HEAD /identity/v3/OS-INHERIT/domains/909a8901b54a43fba7cb0f65433e988e/users/5d97c32fee1849ba9784df3f7c74fb86/roles/6f2aeecb578f4f4b9b20ad76551cca5d/inherited_to_projects => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:16.019189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cc1e1-d167-47e3-87e7-79feea3153f4 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:16.037039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cc1e1-d167-47e3-87e7-79feea3153f4 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:16.051008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c38203-63ed-42b1-840c-81fa3bd24c2c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:16.051765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c38203-63ed-42b1-840c-81fa3bd24c2c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:16.052088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c38203-63ed-42b1-840c-81fa3bd24c2c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:16.052423 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c38203-63ed-42b1-840c-81fa3bd24c2c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/909a8901b54a43fba7cb0f65433e988e/users/5d97c32fee1849ba9784df3f7c74fb86/roles/6f2aeecb578f4f4b9b20ad76551cca5d/inherited_to_projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:16.073101 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c38203-63ed-42b1-840c-81fa3bd24c2c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=909a8901b54a43fba7cb0f65433e988e, user_id=5d97c32fee1849ba9784df3f7c74fb86, role_id=6f2aeecb578f4f4b9b20ad76551cca5d)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:16.076381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c38203-63ed-42b1-840c-81fa3bd24c2c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:16.094211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c7c38203-63ed-42b1-840c-81fa3bd24c2c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invalidating the token cache because role 6f2aeecb578f4f4b9b20ad76551cca5d was removed from user 5d97c32fee1849ba9784df3f7c74fb86 on domain 909a8901b54a43fba7cb0f65433e988e. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:16.094576 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c7c38203-63ed-42b1-840c-81fa3bd24c2c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:16.098531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c7c38203-63ed-42b1-840c-81fa3bd24c2c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:16.142982 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2818/5612] 10.222.0.39 () {58 vars in 1563 bytes} [Sun Aug 7 01:37:16 2022] DELETE /identity/v3/OS-INHERIT/domains/909a8901b54a43fba7cb0f65433e988e/users/5d97c32fee1849ba9784df3f7c74fb86/roles/6f2aeecb578f4f4b9b20ad76551cca5d/inherited_to_projects => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:16.146771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152de889-962b-49fa-917b-632def1d269a tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:16.149428 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-152de889-962b-49fa-917b-632def1d269a tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:16.184416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152de889-962b-49fa-917b-632def1d269a tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:16.419343 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d70fcd-80a5-40d5-b60c-726620b1a418 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:16.420719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d70fcd-80a5-40d5-b60c-726620b1a418 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:16.421358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d70fcd-80a5-40d5-b60c-726620b1a418 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:16.422541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d70fcd-80a5-40d5-b60c-726620b1a418 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/roles/6f2aeecb578f4f4b9b20ad76551cca5d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:16.428518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d70fcd-80a5-40d5-b60c-726620b1a418 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6f2aeecb578f4f4b9b20ad76551cca5d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:16.433814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d70fcd-80a5-40d5-b60c-726620b1a418 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:16.523090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b5d70fcd-80a5-40d5-b60c-726620b1a418 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invalidating the token cache because role 6f2aeecb578f4f4b9b20ad76551cca5d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:16.524529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b5d70fcd-80a5-40d5-b60c-726620b1a418 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:16.527043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b5d70fcd-80a5-40d5-b60c-726620b1a418 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:16.531786 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2795/5613] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:37:16 2022] DELETE /identity/v3/roles/6f2aeecb578f4f4b9b20ad76551cca5d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:16.537238 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c38203-63ed-42b1-840c-81fa3bd24c2c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:16.560145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c38203-63ed-42b1-840c-81fa3bd24c2c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:16.724342 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dbb9f3-2f6c-418e-b739-7251f13f5b6f tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:16.725908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbb9f3-2f6c-418e-b739-7251f13f5b6f tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:16.726383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbb9f3-2f6c-418e-b739-7251f13f5b6f tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:16.726982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbb9f3-2f6c-418e-b739-7251f13f5b6f tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:16.728090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dbb9f3-2f6c-418e-b739-7251f13f5b6f tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:16.731149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dbb9f3-2f6c-418e-b739-7251f13f5b6f tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:16.779767 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2819/5614] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:37:16 2022] POST /identity/v3/roles => generated 240 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:16.784399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d70fcd-80a5-40d5-b60c-726620b1a418 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:16.786820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b5d70fcd-80a5-40d5-b60c-726620b1a418 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:16.809503 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d70fcd-80a5-40d5-b60c-726620b1a418 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:16.837772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9707e9-8319-4826-b7c5-809e3f670b93 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:16.838592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9707e9-8319-4826-b7c5-809e3f670b93 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:16.838880 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9707e9-8319-4826-b7c5-809e3f670b93 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:16.839158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9707e9-8319-4826-b7c5-809e3f670b93 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:16.839827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9707e9-8319-4826-b7c5-809e3f670b93 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:16.841809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9707e9-8319-4826-b7c5-809e3f670b93 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:16.912070 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2796/5615] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:37:16 2022] POST /identity/v3/projects => generated 409 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:16.916057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dbb9f3-2f6c-418e-b739-7251f13f5b6f tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:16.940284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dbb9f3-2f6c-418e-b739-7251f13f5b6f tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:17.116604 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120cd713-8280-43e4-a38e-8cb462c15003 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:17.117289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cd713-8280-43e4-a38e-8cb462c15003 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:17.117746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cd713-8280-43e4-a38e-8cb462c15003 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:17.118028 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120cd713-8280-43e4-a38e-8cb462c15003 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/909a8901b54a43fba7cb0f65433e988e/users/5d97c32fee1849ba9784df3f7c74fb86/roles/10bb98ceeda843d4b047d1af6d94bd8b/inherited_to_projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:17.124770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120cd713-8280-43e4-a38e-8cb462c15003 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=909a8901b54a43fba7cb0f65433e988e, user_id=5d97c32fee1849ba9784df3f7c74fb86, role_id=10bb98ceeda843d4b047d1af6d94bd8b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:17.127518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120cd713-8280-43e4-a38e-8cb462c15003 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:17.176567 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2820/5616] 10.222.0.39 () {60 vars in 1579 bytes} [Sun Aug 7 01:37:16 2022] PUT /identity/v3/OS-INHERIT/domains/909a8901b54a43fba7cb0f65433e988e/users/5d97c32fee1849ba9784df3f7c74fb86/roles/10bb98ceeda843d4b047d1af6d94bd8b/inherited_to_projects => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:17.177871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9707e9-8319-4826-b7c5-809e3f670b93 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:17.195989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9707e9-8319-4826-b7c5-809e3f670b93 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:17.299532 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:17.324579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca7081-04b6-4316-8f09-f5a05a638aec tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:17.325768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca7081-04b6-4316-8f09-f5a05a638aec tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:17.326214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca7081-04b6-4316-8f09-f5a05a638aec tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:17.326861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca7081-04b6-4316-8f09-f5a05a638aec tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:17.329871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca7081-04b6-4316-8f09-f5a05a638aec tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Adding query filter params (scope.project.id=31644d59897b44ac8c34d80a6e58d85b, user.id=5d97c32fee1849ba9784df3f7c74fb86) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:37:17.330502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca7081-04b6-4316-8f09-f5a05a638aec tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:17.332880 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca7081-04b6-4316-8f09-f5a05a638aec tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:17.463102 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2797/5617] 10.222.0.39 () {58 vars in 1356 bytes} [Sun Aug 7 01:37:17 2022] GET /identity/v3/role_assignments?scope.project.id=31644d59897b44ac8c34d80a6e58d85b&user.id=5d97c32fee1849ba9784df3f7c74fb86&effective => generated 648 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:37:17.467277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120cd713-8280-43e4-a38e-8cb462c15003 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:17.489283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120cd713-8280-43e4-a38e-8cb462c15003 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:17.501405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3790db-a8d8-45f4-bacc-27378edde33f tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:17.502348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3790db-a8d8-45f4-bacc-27378edde33f tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:17.502809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3790db-a8d8-45f4-bacc-27378edde33f tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:17.503247 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3790db-a8d8-45f4-bacc-27378edde33f tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:17.504334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3790db-a8d8-45f4-bacc-27378edde33f tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Adding query filter params (scope.project.id=fd4183dd683349748a9ff63d69776dd7, user.id=5d97c32fee1849ba9784df3f7c74fb86) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:37:17.504988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3790db-a8d8-45f4-bacc-27378edde33f tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:17.507226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3790db-a8d8-45f4-bacc-27378edde33f tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:17.573796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077c1dd-9156-42c0-b0c2-b5cf70256d92 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:17.574096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077c1dd-9156-42c0-b0c2-b5cf70256d92 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:17.574416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077c1dd-9156-42c0-b0c2-b5cf70256d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:17.613631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c077c1dd-9156-42c0-b0c2-b5cf70256d92 None None] MFA Rules not processed for user `2d8e76eb694846cabc55fc8e825c8e43`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:17.614858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c077c1dd-9156-42c0-b0c2-b5cf70256d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:17.669071 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:17.679878 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2821/5618] 10.222.0.39 () {58 vars in 1356 bytes} [Sun Aug 7 01:37:17 2022] GET /identity/v3/role_assignments?scope.project.id=fd4183dd683349748a9ff63d69776dd7&user.id=5d97c32fee1849ba9784df3f7c74fb86&effective => generated 648 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:37:17.681690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3790db-a8d8-45f4-bacc-27378edde33f tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:17.710455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3790db-a8d8-45f4-bacc-27378edde33f tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:17.717253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0e269-acde-4bae-995b-0be0166b0818 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:17.717944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0e269-acde-4bae-995b-0be0166b0818 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:17.718220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0e269-acde-4bae-995b-0be0166b0818 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:17.718492 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0e269-acde-4bae-995b-0be0166b0818 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/909a8901b54a43fba7cb0f65433e988e/users/5d97c32fee1849ba9784df3f7c74fb86/roles/10bb98ceeda843d4b047d1af6d94bd8b/inherited_to_projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:17.722446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0e269-acde-4bae-995b-0be0166b0818 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=909a8901b54a43fba7cb0f65433e988e, user_id=5d97c32fee1849ba9784df3f7c74fb86, role_id=10bb98ceeda843d4b047d1af6d94bd8b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:17.726696 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0e269-acde-4bae-995b-0be0166b0818 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:17.734278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-77a0e269-acde-4bae-995b-0be0166b0818 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invalidating the token cache because role 10bb98ceeda843d4b047d1af6d94bd8b was removed from user 5d97c32fee1849ba9784df3f7c74fb86 on domain 909a8901b54a43fba7cb0f65433e988e. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:17.734568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-77a0e269-acde-4bae-995b-0be0166b0818 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:17.735593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-77a0e269-acde-4bae-995b-0be0166b0818 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:17.752678 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2798/5619] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:17.758986 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2822/5620] 10.222.0.39 () {58 vars in 1563 bytes} [Sun Aug 7 01:37:17 2022] DELETE /identity/v3/OS-INHERIT/domains/909a8901b54a43fba7cb0f65433e988e/users/5d97c32fee1849ba9784df3f7c74fb86/roles/10bb98ceeda843d4b047d1af6d94bd8b/inherited_to_projects => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:17.763016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077c1dd-9156-42c0-b0c2-b5cf70256d92 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:17.766551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c077c1dd-9156-42c0-b0c2-b5cf70256d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:17.789771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077c1dd-9156-42c0-b0c2-b5cf70256d92 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:17.881264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bda98c-8195-488e-8d6e-b8e61e0c2e2e tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:17.881884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bda98c-8195-488e-8d6e-b8e61e0c2e2e tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:17.882160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bda98c-8195-488e-8d6e-b8e61e0c2e2e tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:17.882558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bda98c-8195-488e-8d6e-b8e61e0c2e2e tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:17.883298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bda98c-8195-488e-8d6e-b8e61e0c2e2e tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Adding query filter params (scope.project.id=31644d59897b44ac8c34d80a6e58d85b, user.id=5d97c32fee1849ba9784df3f7c74fb86) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:37:17.883603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bda98c-8195-488e-8d6e-b8e61e0c2e2e tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:17.885604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bda98c-8195-488e-8d6e-b8e61e0c2e2e tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:17.980944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0e269-acde-4bae-995b-0be0166b0818 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:17.997579 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2799/5621] 10.222.0.39 () {58 vars in 1356 bytes} [Sun Aug 7 01:37:17 2022] GET /identity/v3/role_assignments?scope.project.id=31644d59897b44ac8c34d80a6e58d85b&user.id=5d97c32fee1849ba9784df3f7c74fb86&effective => generated 228 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:37:18.000231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0e269-acde-4bae-995b-0be0166b0818 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:18.014253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e70792-9f62-4dfd-bd9f-769574db73e1 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:18.016040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e70792-9f62-4dfd-bd9f-769574db73e1 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:18.016326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e70792-9f62-4dfd-bd9f-769574db73e1 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:18.016600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e70792-9f62-4dfd-bd9f-769574db73e1 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:18.020158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e70792-9f62-4dfd-bd9f-769574db73e1 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Adding query filter params (scope.project.id=fd4183dd683349748a9ff63d69776dd7, user.id=5d97c32fee1849ba9784df3f7c74fb86) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:37:18.020473 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e70792-9f62-4dfd-bd9f-769574db73e1 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:18.023638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e70792-9f62-4dfd-bd9f-769574db73e1 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:18.157502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bda98c-8195-488e-8d6e-b8e61e0c2e2e tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:18.167693 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2823/5622] 10.222.0.39 () {58 vars in 1356 bytes} [Sun Aug 7 01:37:17 2022] GET /identity/v3/role_assignments?scope.project.id=fd4183dd683349748a9ff63d69776dd7&user.id=5d97c32fee1849ba9784df3f7c74fb86&effective => generated 228 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:37:18.174079 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bda98c-8195-488e-8d6e-b8e61e0c2e2e tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:18.182043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029de5f-6f19-4076-9359-aab04ad02a1d tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:18.182694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029de5f-6f19-4076-9359-aab04ad02a1d tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:18.182970 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029de5f-6f19-4076-9359-aab04ad02a1d tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:18.183239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029de5f-6f19-4076-9359-aab04ad02a1d tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/projects/fd4183dd683349748a9ff63d69776dd7` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:18.184458 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029de5f-6f19-4076-9359-aab04ad02a1d tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fd4183dd683349748a9ff63d69776dd7)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:18.186357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029de5f-6f19-4076-9359-aab04ad02a1d tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:18.205973 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:18.289604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a029de5f-6f19-4076-9359-aab04ad02a1d tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd4183dd683349748a9ff63d69776dd7', 'request_id': 'req-a029de5f-6f19-4076-9359-aab04ad02a1d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:18.312177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a029de5f-6f19-4076-9359-aab04ad02a1d tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd4183dd683349748a9ff63d69776dd7', 'request_id': 'req-a029de5f-6f19-4076-9359-aab04ad02a1d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:18.321910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a029de5f-6f19-4076-9359-aab04ad02a1d tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd4183dd683349748a9ff63d69776dd7', 'request_id': 'req-a029de5f-6f19-4076-9359-aab04ad02a1d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:18.341984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a029de5f-6f19-4076-9359-aab04ad02a1d tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] The token cache is being invalidate because project fd4183dd683349748a9ff63d69776dd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:18.342545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a029de5f-6f19-4076-9359-aab04ad02a1d tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:18.343278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a029de5f-6f19-4076-9359-aab04ad02a1d tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:18.345135 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2800/5623] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:37:18 2022] DELETE /identity/v3/projects/fd4183dd683349748a9ff63d69776dd7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:18.349639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e70792-9f62-4dfd-bd9f-769574db73e1 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:18.353524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-39e70792-9f62-4dfd-bd9f-769574db73e1 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:18.371411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e70792-9f62-4dfd-bd9f-769574db73e1 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:18.565927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e1c84-3a9f-4cb8-a199-188c9fcefca9 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:18.566777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e1c84-3a9f-4cb8-a199-188c9fcefca9 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:18.567172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e1c84-3a9f-4cb8-a199-188c9fcefca9 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:18.567645 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e1c84-3a9f-4cb8-a199-188c9fcefca9 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/roles/10bb98ceeda843d4b047d1af6d94bd8b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:18.571326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e1c84-3a9f-4cb8-a199-188c9fcefca9 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:delete_role(role_id=10bb98ceeda843d4b047d1af6d94bd8b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:18.576659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e1c84-3a9f-4cb8-a199-188c9fcefca9 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:18.649134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0c5e1c84-3a9f-4cb8-a199-188c9fcefca9 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invalidating the token cache because role 10bb98ceeda843d4b047d1af6d94bd8b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:18.649741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0c5e1c84-3a9f-4cb8-a199-188c9fcefca9 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:18.652321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0c5e1c84-3a9f-4cb8-a199-188c9fcefca9 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:18.669294 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2824/5624] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:37:18 2022] DELETE /identity/v3/roles/10bb98ceeda843d4b047d1af6d94bd8b => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:18.674537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029de5f-6f19-4076-9359-aab04ad02a1d tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:18.691449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029de5f-6f19-4076-9359-aab04ad02a1d tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:18.865702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020eb8f6-b36b-4753-8fb2-07be25c9618c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:18.866453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020eb8f6-b36b-4753-8fb2-07be25c9618c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:18.866849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020eb8f6-b36b-4753-8fb2-07be25c9618c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:18.867371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020eb8f6-b36b-4753-8fb2-07be25c9618c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:18.868291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020eb8f6-b36b-4753-8fb2-07be25c9618c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:18.870019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020eb8f6-b36b-4753-8fb2-07be25c9618c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:18.905365 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2801/5625] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:37:18 2022] POST /identity/v3/roles => generated 239 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:37:18.910006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e1c84-3a9f-4cb8-a199-188c9fcefca9 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:18.911569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0c5e1c84-3a9f-4cb8-a199-188c9fcefca9 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:18.933459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e1c84-3a9f-4cb8-a199-188c9fcefca9 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:18.950124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c96567-b100-418b-bedc-0d8cd745470c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:18.950921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c96567-b100-418b-bedc-0d8cd745470c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:18.951311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c96567-b100-418b-bedc-0d8cd745470c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:18.951697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c96567-b100-418b-bedc-0d8cd745470c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:18.952478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c96567-b100-418b-bedc-0d8cd745470c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:18.955683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c96567-b100-418b-bedc-0d8cd745470c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:19.032650 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2825/5626] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:37:18 2022] POST /identity/v3/projects => generated 409 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:19.036528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020eb8f6-b36b-4753-8fb2-07be25c9618c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:19.050478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020eb8f6-b36b-4753-8fb2-07be25c9618c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:19.156909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83eab9d-9f94-4322-a5c9-39954b2ccbe2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:19.159320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83eab9d-9f94-4322-a5c9-39954b2ccbe2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:19.160039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83eab9d-9f94-4322-a5c9-39954b2ccbe2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:19.160565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83eab9d-9f94-4322-a5c9-39954b2ccbe2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/31644d59897b44ac8c34d80a6e58d85b/users/5d97c32fee1849ba9784df3f7c74fb86/roles/a1ae13e0e7b04a4abfd5cd0ae1cdf534/inherited_to_projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:19.164421 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83eab9d-9f94-4322-a5c9-39954b2ccbe2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:create_grant(project_id=31644d59897b44ac8c34d80a6e58d85b, user_id=5d97c32fee1849ba9784df3f7c74fb86, role_id=a1ae13e0e7b04a4abfd5cd0ae1cdf534)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:19.167966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83eab9d-9f94-4322-a5c9-39954b2ccbe2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:19.193446 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2802/5627] 10.222.0.39 () {60 vars in 1582 bytes} [Sun Aug 7 01:37:19 2022] PUT /identity/v3/OS-INHERIT/projects/31644d59897b44ac8c34d80a6e58d85b/users/5d97c32fee1849ba9784df3f7c74fb86/roles/a1ae13e0e7b04a4abfd5cd0ae1cdf534/inherited_to_projects => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:19.197505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c96567-b100-418b-bedc-0d8cd745470c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:19.213566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c96567-b100-418b-bedc-0d8cd745470c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:19.280036 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:19.348509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38355e05-1e87-4698-8cf9-640fcb7b59f5 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:19.349043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38355e05-1e87-4698-8cf9-640fcb7b59f5 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:19.349296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38355e05-1e87-4698-8cf9-640fcb7b59f5 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:19.349627 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38355e05-1e87-4698-8cf9-640fcb7b59f5 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:19.350422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38355e05-1e87-4698-8cf9-640fcb7b59f5 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Adding query filter params (scope.project.id=a10b6306cea145dcabc8940e34949b19, user.id=5d97c32fee1849ba9784df3f7c74fb86) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:37:19.350760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38355e05-1e87-4698-8cf9-640fcb7b59f5 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:19.352865 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38355e05-1e87-4698-8cf9-640fcb7b59f5 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:19.441672 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2826/5628] 10.222.0.39 () {58 vars in 1356 bytes} [Sun Aug 7 01:37:19 2022] GET /identity/v3/role_assignments?scope.project.id=a10b6306cea145dcabc8940e34949b19&user.id=5d97c32fee1849ba9784df3f7c74fb86&effective => generated 649 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:37:19.445491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83eab9d-9f94-4322-a5c9-39954b2ccbe2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:19.457961 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83eab9d-9f94-4322-a5c9-39954b2ccbe2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:19.474888 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ce2d0-2366-4260-bec0-5d2dbc06b461 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:19.475507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ce2d0-2366-4260-bec0-5d2dbc06b461 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:19.475859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ce2d0-2366-4260-bec0-5d2dbc06b461 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:19.476433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ce2d0-2366-4260-bec0-5d2dbc06b461 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/31644d59897b44ac8c34d80a6e58d85b/users/5d97c32fee1849ba9784df3f7c74fb86/roles/a1ae13e0e7b04a4abfd5cd0ae1cdf534/inherited_to_projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:19.482421 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ce2d0-2366-4260-bec0-5d2dbc06b461 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=31644d59897b44ac8c34d80a6e58d85b, user_id=5d97c32fee1849ba9784df3f7c74fb86, role_id=a1ae13e0e7b04a4abfd5cd0ae1cdf534)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:19.485564 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ce2d0-2366-4260-bec0-5d2dbc06b461 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:19.499940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-804ce2d0-2366-4260-bec0-5d2dbc06b461 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invalidating the token cache because role a1ae13e0e7b04a4abfd5cd0ae1cdf534 was removed from user 5d97c32fee1849ba9784df3f7c74fb86 on project 31644d59897b44ac8c34d80a6e58d85b. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:19.500986 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-804ce2d0-2366-4260-bec0-5d2dbc06b461 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:19.510036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-804ce2d0-2366-4260-bec0-5d2dbc06b461 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:19.530333 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2803/5629] 10.222.0.39 () {58 vars in 1566 bytes} [Sun Aug 7 01:37:19 2022] DELETE /identity/v3/OS-INHERIT/projects/31644d59897b44ac8c34d80a6e58d85b/users/5d97c32fee1849ba9784df3f7c74fb86/roles/a1ae13e0e7b04a4abfd5cd0ae1cdf534/inherited_to_projects => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:19.535002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38355e05-1e87-4698-8cf9-640fcb7b59f5 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:19.536920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-38355e05-1e87-4698-8cf9-640fcb7b59f5 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:19.568612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38355e05-1e87-4698-8cf9-640fcb7b59f5 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:19.724747 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a8638-b5b5-4902-9bd8-a80abfbed9c1 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:19.725573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a8638-b5b5-4902-9bd8-a80abfbed9c1 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:19.726148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a8638-b5b5-4902-9bd8-a80abfbed9c1 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:19.726636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a8638-b5b5-4902-9bd8-a80abfbed9c1 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:19.728088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a8638-b5b5-4902-9bd8-a80abfbed9c1 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Adding query filter params (scope.project.id=a10b6306cea145dcabc8940e34949b19, user.id=5d97c32fee1849ba9784df3f7c74fb86) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:37:19.728088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a8638-b5b5-4902-9bd8-a80abfbed9c1 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:19.734635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a8638-b5b5-4902-9bd8-a80abfbed9c1 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:19.810943 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ce2d0-2366-4260-bec0-5d2dbc06b461 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:19.816970 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2827/5630] 10.222.0.39 () {58 vars in 1356 bytes} [Sun Aug 7 01:37:19 2022] GET /identity/v3/role_assignments?scope.project.id=a10b6306cea145dcabc8940e34949b19&user.id=5d97c32fee1849ba9784df3f7c74fb86&effective => generated 228 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:37:19.820377 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:19.832731 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ce2d0-2366-4260-bec0-5d2dbc06b461 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:19.861204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d451f43-1d58-4896-b32e-1f002e40aa97 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:19.868396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d451f43-1d58-4896-b32e-1f002e40aa97 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:19.868689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d451f43-1d58-4896-b32e-1f002e40aa97 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:19.868971 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d451f43-1d58-4896-b32e-1f002e40aa97 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/projects/a10b6306cea145dcabc8940e34949b19` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:19.872914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d451f43-1d58-4896-b32e-1f002e40aa97 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a10b6306cea145dcabc8940e34949b19)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:19.883948 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d451f43-1d58-4896-b32e-1f002e40aa97 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:20.038277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3d451f43-1d58-4896-b32e-1f002e40aa97 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a10b6306cea145dcabc8940e34949b19', 'request_id': 'req-3d451f43-1d58-4896-b32e-1f002e40aa97'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:20.056618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3d451f43-1d58-4896-b32e-1f002e40aa97 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a10b6306cea145dcabc8940e34949b19', 'request_id': 'req-3d451f43-1d58-4896-b32e-1f002e40aa97'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:20.068614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3d451f43-1d58-4896-b32e-1f002e40aa97 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a10b6306cea145dcabc8940e34949b19', 'request_id': 'req-3d451f43-1d58-4896-b32e-1f002e40aa97'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:20.119268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3d451f43-1d58-4896-b32e-1f002e40aa97 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] The token cache is being invalidate because project a10b6306cea145dcabc8940e34949b19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:20.120898 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3d451f43-1d58-4896-b32e-1f002e40aa97 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:20.122263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3d451f43-1d58-4896-b32e-1f002e40aa97 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:20.127591 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2804/5631] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:37:19 2022] DELETE /identity/v3/projects/a10b6306cea145dcabc8940e34949b19 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:20.131425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a8638-b5b5-4902-9bd8-a80abfbed9c1 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:20.135508 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-302a8638-b5b5-4902-9bd8-a80abfbed9c1 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:20.164932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a8638-b5b5-4902-9bd8-a80abfbed9c1 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:20.262027 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:20.309015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9505f3-cf66-4415-9a77-9bf8a8f24324 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:20.309670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9505f3-cf66-4415-9a77-9bf8a8f24324 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:20.310167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9505f3-cf66-4415-9a77-9bf8a8f24324 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:20.310640 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9505f3-cf66-4415-9a77-9bf8a8f24324 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/roles/a1ae13e0e7b04a4abfd5cd0ae1cdf534` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:20.316515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9505f3-cf66-4415-9a77-9bf8a8f24324 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a1ae13e0e7b04a4abfd5cd0ae1cdf534)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:20.318383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9505f3-cf66-4415-9a77-9bf8a8f24324 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:20.429812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8b9505f3-cf66-4415-9a77-9bf8a8f24324 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invalidating the token cache because role a1ae13e0e7b04a4abfd5cd0ae1cdf534 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:20.430459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8b9505f3-cf66-4415-9a77-9bf8a8f24324 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:20.431404 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8b9505f3-cf66-4415-9a77-9bf8a8f24324 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:20.433880 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2828/5632] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:37:20 2022] DELETE /identity/v3/roles/a1ae13e0e7b04a4abfd5cd0ae1cdf534 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:20.440586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d451f43-1d58-4896-b32e-1f002e40aa97 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:20.458548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d451f43-1d58-4896-b32e-1f002e40aa97 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:20.553546 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3280a5-36ca-42bb-8902-10948b20d99c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:20.554324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3280a5-36ca-42bb-8902-10948b20d99c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:20.554931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3280a5-36ca-42bb-8902-10948b20d99c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:20.554931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3280a5-36ca-42bb-8902-10948b20d99c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/users/5d97c32fee1849ba9784df3f7c74fb86` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:20.556540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3280a5-36ca-42bb-8902-10948b20d99c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5d97c32fee1849ba9784df3f7c74fb86)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:20.564913 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3280a5-36ca-42bb-8902-10948b20d99c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:20.647947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8d3280a5-36ca-42bb-8902-10948b20d99c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d97c32fee1849ba9784df3f7c74fb86'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:20.659747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8d3280a5-36ca-42bb-8902-10948b20d99c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d97c32fee1849ba9784df3f7c74fb86'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:20.679144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8d3280a5-36ca-42bb-8902-10948b20d99c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d97c32fee1849ba9784df3f7c74fb86'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:20.680287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8d3280a5-36ca-42bb-8902-10948b20d99c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d97c32fee1849ba9784df3f7c74fb86'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:20.697039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8d3280a5-36ca-42bb-8902-10948b20d99c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d97c32fee1849ba9784df3f7c74fb86'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:20.707701 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2805/5633] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:37:20 2022] DELETE /identity/v3/users/5d97c32fee1849ba9784df3f7c74fb86 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:20.712348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9505f3-cf66-4415-9a77-9bf8a8f24324 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:20.714258 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8b9505f3-cf66-4415-9a77-9bf8a8f24324 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:20.730142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9505f3-cf66-4415-9a77-9bf8a8f24324 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:20.814280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfcf1d-706e-4993-9892-bdc1bc31dfed tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:20.815286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfcf1d-706e-4993-9892-bdc1bc31dfed tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:20.815671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfcf1d-706e-4993-9892-bdc1bc31dfed tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:20.816104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfcf1d-706e-4993-9892-bdc1bc31dfed tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/groups/0a27aff4f57a42d38cd42c2cb9f54068` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:20.818639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfcf1d-706e-4993-9892-bdc1bc31dfed tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:delete_group(group_id=0a27aff4f57a42d38cd42c2cb9f54068)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:20.825938 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cfcf1d-706e-4993-9892-bdc1bc31dfed tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:20.951403 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2829/5634] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Aug 7 01:37:20 2022] DELETE /identity/v3/groups/0a27aff4f57a42d38cd42c2cb9f54068 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:20.952631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3280a5-36ca-42bb-8902-10948b20d99c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:20.955196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8d3280a5-36ca-42bb-8902-10948b20d99c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:20.992095 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:21.008509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3280a5-36ca-42bb-8902-10948b20d99c tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:21.147751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da7712-1ce9-4632-a041-aaf15a771fc4 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:21.149431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da7712-1ce9-4632-a041-aaf15a771fc4 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:21.150189 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da7712-1ce9-4632-a041-aaf15a771fc4 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:21.150909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da7712-1ce9-4632-a041-aaf15a771fc4 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/projects/31644d59897b44ac8c34d80a6e58d85b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:21.153771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da7712-1ce9-4632-a041-aaf15a771fc4 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:delete_project(project_id=31644d59897b44ac8c34d80a6e58d85b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:21.159239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da7712-1ce9-4632-a041-aaf15a771fc4 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:21.272307 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b7da7712-1ce9-4632-a041-aaf15a771fc4 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31644d59897b44ac8c34d80a6e58d85b', 'request_id': 'req-b7da7712-1ce9-4632-a041-aaf15a771fc4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:21.282453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfcf1d-706e-4993-9892-bdc1bc31dfed tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:21.285148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d5cfcf1d-706e-4993-9892-bdc1bc31dfed tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:21.295561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b7da7712-1ce9-4632-a041-aaf15a771fc4 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31644d59897b44ac8c34d80a6e58d85b', 'request_id': 'req-b7da7712-1ce9-4632-a041-aaf15a771fc4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:21.307574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b7da7712-1ce9-4632-a041-aaf15a771fc4 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31644d59897b44ac8c34d80a6e58d85b', 'request_id': 'req-b7da7712-1ce9-4632-a041-aaf15a771fc4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:21.341912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b7da7712-1ce9-4632-a041-aaf15a771fc4 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] The token cache is being invalidate because project 31644d59897b44ac8c34d80a6e58d85b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:21.342304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b7da7712-1ce9-4632-a041-aaf15a771fc4 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:21.347059 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b7da7712-1ce9-4632-a041-aaf15a771fc4 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:21.352390 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2806/5635] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:37:20 2022] DELETE /identity/v3/projects/31644d59897b44ac8c34d80a6e58d85b => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:21.358298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da7712-1ce9-4632-a041-aaf15a771fc4 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:21.359870 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b7da7712-1ce9-4632-a041-aaf15a771fc4 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:21.539785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da7712-1ce9-4632-a041-aaf15a771fc4 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:21.554872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cfcf1d-706e-4993-9892-bdc1bc31dfed tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:21.590466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81a6bd-af08-46af-9c80-2091f9a2e0fa tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:21.593406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81a6bd-af08-46af-9c80-2091f9a2e0fa tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:21.597159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81a6bd-af08-46af-9c80-2091f9a2e0fa tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:21.597460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81a6bd-af08-46af-9c80-2091f9a2e0fa tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/domains/909a8901b54a43fba7cb0f65433e988e` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:21.603861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81a6bd-af08-46af-9c80-2091f9a2e0fa tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=909a8901b54a43fba7cb0f65433e988e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:21.612347 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:21.617992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81a6bd-af08-46af-9c80-2091f9a2e0fa tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:21.738812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2a81a6bd-af08-46af-9c80-2091f9a2e0fa tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '909a8901b54a43fba7cb0f65433e988e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:21.742047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2a81a6bd-af08-46af-9c80-2091f9a2e0fa tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '909a8901b54a43fba7cb0f65433e988e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:21.814820 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:21.830887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2a81a6bd-af08-46af-9c80-2091f9a2e0fa tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '909a8901b54a43fba7cb0f65433e988e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:21.833394 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2a81a6bd-af08-46af-9c80-2091f9a2e0fa tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '909a8901b54a43fba7cb0f65433e988e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:21.843138 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2807/5636] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:37:21 2022] PATCH /identity/v3/domains/909a8901b54a43fba7cb0f65433e988e => generated 277 bytes in 485 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:37:21.845251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d927b7-96f9-4acf-a2f1-cecd12b8d48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:21.847087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81a6bd-af08-46af-9c80-2091f9a2e0fa tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:21.848501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d927b7-96f9-4acf-a2f1-cecd12b8d48d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:21.848981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d927b7-96f9-4acf-a2f1-cecd12b8d48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:21.851770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d927b7-96f9-4acf-a2f1-cecd12b8d48d admin admin] PATH_INFO: `/v3/users/b328b28645394d758d279eae494ff2e5` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:21.852424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2a81a6bd-af08-46af-9c80-2091f9a2e0fa tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:21.854398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d927b7-96f9-4acf-a2f1-cecd12b8d48d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b328b28645394d758d279eae494ff2e5)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:21.862887 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d927b7-96f9-4acf-a2f1-cecd12b8d48d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:22.004107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b1d927b7-96f9-4acf-a2f1-cecd12b8d48d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b328b28645394d758d279eae494ff2e5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:22.018031 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b1d927b7-96f9-4acf-a2f1-cecd12b8d48d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b328b28645394d758d279eae494ff2e5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:22.068981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b1d927b7-96f9-4acf-a2f1-cecd12b8d48d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b328b28645394d758d279eae494ff2e5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:22.071377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b1d927b7-96f9-4acf-a2f1-cecd12b8d48d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b328b28645394d758d279eae494ff2e5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:22.096958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b1d927b7-96f9-4acf-a2f1-cecd12b8d48d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b328b28645394d758d279eae494ff2e5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:22.108558 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2830/5637] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:37:21 2022] DELETE /identity/v3/users/b328b28645394d758d279eae494ff2e5 => generated 0 bytes in 828 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:22.113772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725f7fb-269f-4b73-a42e-74a08e3efe47 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:22.114246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725f7fb-269f-4b73-a42e-74a08e3efe47 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:22.114649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725f7fb-269f-4b73-a42e-74a08e3efe47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:22.181001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0725f7fb-269f-4b73-a42e-74a08e3efe47 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:22.183173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0725f7fb-269f-4b73-a42e-74a08e3efe47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:22.430063 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2831/5638] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:37:22.488624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725f7fb-269f-4b73-a42e-74a08e3efe47 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:22.490599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0725f7fb-269f-4b73-a42e-74a08e3efe47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:22.499230 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81a6bd-af08-46af-9c80-2091f9a2e0fa tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:22.567724 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:22.638039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725f7fb-269f-4b73-a42e-74a08e3efe47 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:22.646647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091ac22-d146-4560-a790-91be8888d20a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:22.648392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091ac22-d146-4560-a790-91be8888d20a service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:22.648805 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091ac22-d146-4560-a790-91be8888d20a service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:22.649214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cad94-62d3-46c7-9c72-21fcae1e4fd2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca264e1de5b40588253955de43eb6c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '567aaa829a894b70896ac1080fe63a23', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:22.649634 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091ac22-d146-4560-a790-91be8888d20a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:22.650292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cad94-62d3-46c7-9c72-21fcae1e4fd2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:22.650742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cad94-62d3-46c7-9c72-21fcae1e4fd2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:22.651171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cad94-62d3-46c7-9c72-21fcae1e4fd2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] PATH_INFO: `/v3/domains/909a8901b54a43fba7cb0f65433e988e` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:22.673351 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091ac22-d146-4560-a790-91be8888d20a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:22.678737 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091ac22-d146-4560-a790-91be8888d20a service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:22.684652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5cad94-62d3-46c7-9c72-21fcae1e4fd2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=909a8901b54a43fba7cb0f65433e988e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:22.686559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5cad94-62d3-46c7-9c72-21fcae1e4fd2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:22.709148 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2832/5639] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:37:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:37:22.753114 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7d5cad94-62d3-46c7-9c72-21fcae1e4fd2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '909a8901b54a43fba7cb0f65433e988e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:22.773936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7d5cad94-62d3-46c7-9c72-21fcae1e4fd2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '909a8901b54a43fba7cb0f65433e988e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:22.868314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7d5cad94-62d3-46c7-9c72-21fcae1e4fd2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '909a8901b54a43fba7cb0f65433e988e', 'request_id': 'req-7d5cad94-62d3-46c7-9c72-21fcae1e4fd2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:22.885957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7d5cad94-62d3-46c7-9c72-21fcae1e4fd2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '909a8901b54a43fba7cb0f65433e988e', 'request_id': 'req-7d5cad94-62d3-46c7-9c72-21fcae1e4fd2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:22.905748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7d5cad94-62d3-46c7-9c72-21fcae1e4fd2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '909a8901b54a43fba7cb0f65433e988e', 'request_id': 'req-7d5cad94-62d3-46c7-9c72-21fcae1e4fd2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:22.926718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7d5cad94-62d3-46c7-9c72-21fcae1e4fd2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] The token cache is being invalidate because project 909a8901b54a43fba7cb0f65433e988e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:22.927017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7d5cad94-62d3-46c7-9c72-21fcae1e4fd2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:22.928800 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7d5cad94-62d3-46c7-9c72-21fcae1e4fd2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:22.951785 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:22.960097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7d5cad94-62d3-46c7-9c72-21fcae1e4fd2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '909a8901b54a43fba7cb0f65433e988e', 'request_id': 'req-7d5cad94-62d3-46c7-9c72-21fcae1e4fd2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:22.964806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7d5cad94-62d3-46c7-9c72-21fcae1e4fd2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '909a8901b54a43fba7cb0f65433e988e', 'request_id': 'req-7d5cad94-62d3-46c7-9c72-21fcae1e4fd2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:22.995845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7d5cad94-62d3-46c7-9c72-21fcae1e4fd2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '909a8901b54a43fba7cb0f65433e988e', 'request_id': 'req-7d5cad94-62d3-46c7-9c72-21fcae1e4fd2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:23.004390 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2808/5640] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:37:21 2022] DELETE /identity/v3/domains/909a8901b54a43fba7cb0f65433e988e => generated 0 bytes in 1158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:23.008065 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091ac22-d146-4560-a790-91be8888d20a service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:23.009797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e091ac22-d146-4560-a790-91be8888d20a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:23.025480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091ac22-d146-4560-a790-91be8888d20a service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:23.107479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4694b46-74c3-40b1-9e61-df84044b94ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:23.108390 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4694b46-74c3-40b1-9e61-df84044b94ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:23.108841 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4694b46-74c3-40b1-9e61-df84044b94ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:23.109284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4694b46-74c3-40b1-9e61-df84044b94ea admin admin] PATH_INFO: `/v3/users/1a7b04f2ecb74ee5ad6c60b09c320910` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:23.111173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4694b46-74c3-40b1-9e61-df84044b94ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a7b04f2ecb74ee5ad6c60b09c320910)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:23.113347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4694b46-74c3-40b1-9e61-df84044b94ea admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:23.203716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f4694b46-74c3-40b1-9e61-df84044b94ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a7b04f2ecb74ee5ad6c60b09c320910'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:23.213348 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cad94-62d3-46c7-9c72-21fcae1e4fd2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:23.215139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7d5cad94-62d3-46c7-9c72-21fcae1e4fd2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:23.215617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f4694b46-74c3-40b1-9e61-df84044b94ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a7b04f2ecb74ee5ad6c60b09c320910'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:23.246764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f4694b46-74c3-40b1-9e61-df84044b94ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a7b04f2ecb74ee5ad6c60b09c320910'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:23.248955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f4694b46-74c3-40b1-9e61-df84044b94ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a7b04f2ecb74ee5ad6c60b09c320910'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:23.254911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cad94-62d3-46c7-9c72-21fcae1e4fd2 tempest-InheritsV3TestJSON-2059703409 tempest-InheritsV3TestJSON-2059703409-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:23.262395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f4694b46-74c3-40b1-9e61-df84044b94ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a7b04f2ecb74ee5ad6c60b09c320910'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:23.262645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a81eab-375a-42c4-9239-b829240db8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:23.263223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a81eab-375a-42c4-9239-b829240db8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:23.263574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a81eab-375a-42c4-9239-b829240db8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:23.263840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a81eab-375a-42c4-9239-b829240db8cf admin admin] PATH_INFO: `/v3/users/f901858b1ab7459cb514bc65c679b58f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:23.265739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a81eab-375a-42c4-9239-b829240db8cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f901858b1ab7459cb514bc65c679b58f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:23.268028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a81eab-375a-42c4-9239-b829240db8cf admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:23.285458 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2833/5641] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:37:23 2022] DELETE /identity/v3/users/1a7b04f2ecb74ee5ad6c60b09c320910 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:23.289713 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc606e5-a546-4b89-b6f0-4e315e724c66 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:23.289983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc606e5-a546-4b89-b6f0-4e315e724c66 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:23.290194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc606e5-a546-4b89-b6f0-4e315e724c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:23.314250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-4bc606e5-a546-4b89-b6f0-4e315e724c66 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:23.315612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4bc606e5-a546-4b89-b6f0-4e315e724c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:23.402679 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:23.416540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f9a81eab-375a-42c4-9239-b829240db8cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f901858b1ab7459cb514bc65c679b58f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:23.433922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f9a81eab-375a-42c4-9239-b829240db8cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f901858b1ab7459cb514bc65c679b58f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:23.440166 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2834/5642] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:37:23.450125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc606e5-a546-4b89-b6f0-4e315e724c66 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:23.451975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4bc606e5-a546-4b89-b6f0-4e315e724c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:23.459382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f9a81eab-375a-42c4-9239-b829240db8cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f901858b1ab7459cb514bc65c679b58f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:23.460717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f9a81eab-375a-42c4-9239-b829240db8cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f901858b1ab7459cb514bc65c679b58f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:23.479972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f9a81eab-375a-42c4-9239-b829240db8cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f901858b1ab7459cb514bc65c679b58f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:23.494733 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2809/5643] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:37:23 2022] DELETE /identity/v3/users/f901858b1ab7459cb514bc65c679b58f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:23.500415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908559a-b748-4662-8cde-f0f6bce229fe None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:23.501807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908559a-b748-4662-8cde-f0f6bce229fe None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:23.503551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908559a-b748-4662-8cde-f0f6bce229fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:23.538838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1908559a-b748-4662-8cde-f0f6bce229fe None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:23.542661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1908559a-b748-4662-8cde-f0f6bce229fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:23.555142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc606e5-a546-4b89-b6f0-4e315e724c66 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:23.676051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdaf0ed-b37e-4c5a-b958-214fe9926464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:23.676987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdaf0ed-b37e-4c5a-b958-214fe9926464 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:23.677307 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdaf0ed-b37e-4c5a-b958-214fe9926464 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:23.677580 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdaf0ed-b37e-4c5a-b958-214fe9926464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:23.682350 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2bdaf0ed-b37e-4c5a-b958-214fe9926464 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:23.683836 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2810/5644] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:23.693589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908559a-b748-4662-8cde-f0f6bce229fe None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:23.695375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1908559a-b748-4662-8cde-f0f6bce229fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:23.701435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdaf0ed-b37e-4c5a-b958-214fe9926464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:23.702949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdaf0ed-b37e-4c5a-b958-214fe9926464 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:23.717416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908559a-b748-4662-8cde-f0f6bce229fe None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:23.722558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbb411-6b4e-493b-b9fd-11ac154c7c8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:23.723424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbb411-6b4e-493b-b9fd-11ac154c7c8c service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:23.723917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbb411-6b4e-493b-b9fd-11ac154c7c8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:23.724560 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2835/5645] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:37:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:37:23.733818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbb411-6b4e-493b-b9fd-11ac154c7c8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:23.761365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bbb411-6b4e-493b-b9fd-11ac154c7c8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:23.762838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bbb411-6b4e-493b-b9fd-11ac154c7c8c service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:23.795646 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2811/5646] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:37:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:37:24.438479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdaf0ed-b37e-4c5a-b958-214fe9926464 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:24.440429 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2bdaf0ed-b37e-4c5a-b958-214fe9926464 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:24.459283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdaf0ed-b37e-4c5a-b958-214fe9926464 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:24.468608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf74769-a790-45bf-ba38-8c2cb1718bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:24.470711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf74769-a790-45bf-ba38-8c2cb1718bdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:24.472052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf74769-a790-45bf-ba38-8c2cb1718bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:24.472402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf74769-a790-45bf-ba38-8c2cb1718bdc admin admin] PATH_INFO: `/v3/projects/01efbcff3e40402d9bb00203e7591dd6` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:24.474908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf74769-a790-45bf-ba38-8c2cb1718bdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=01efbcff3e40402d9bb00203e7591dd6)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:24.477250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf74769-a790-45bf-ba38-8c2cb1718bdc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:24.541779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbb411-6b4e-493b-b9fd-11ac154c7c8c service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:24.543372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-17bbb411-6b4e-493b-b9fd-11ac154c7c8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:24.583802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-edf74769-a790-45bf-ba38-8c2cb1718bdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01efbcff3e40402d9bb00203e7591dd6', 'request_id': 'req-edf74769-a790-45bf-ba38-8c2cb1718bdc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:24.597805 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-edf74769-a790-45bf-ba38-8c2cb1718bdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01efbcff3e40402d9bb00203e7591dd6', 'request_id': 'req-edf74769-a790-45bf-ba38-8c2cb1718bdc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:24.611317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-edf74769-a790-45bf-ba38-8c2cb1718bdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01efbcff3e40402d9bb00203e7591dd6', 'request_id': 'req-edf74769-a790-45bf-ba38-8c2cb1718bdc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:24.621037 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:24.637729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-edf74769-a790-45bf-ba38-8c2cb1718bdc admin admin] The token cache is being invalidate because project 01efbcff3e40402d9bb00203e7591dd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:24.637956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-edf74769-a790-45bf-ba38-8c2cb1718bdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:24.638817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-edf74769-a790-45bf-ba38-8c2cb1718bdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:24.643761 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2836/5647] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:37:24 2022] DELETE /identity/v3/projects/01efbcff3e40402d9bb00203e7591dd6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:24.649504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6c620-7065-44ab-b48a-89bacabc6cec None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:24.650088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6c620-7065-44ab-b48a-89bacabc6cec None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:24.650365 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6c620-7065-44ab-b48a-89bacabc6cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:24.691164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d9a6c620-7065-44ab-b48a-89bacabc6cec None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:24.692657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d9a6c620-7065-44ab-b48a-89bacabc6cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:24.693380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbb411-6b4e-493b-b9fd-11ac154c7c8c service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:24.743104 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:24.793448 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2837/5648] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:24.795566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6c620-7065-44ab-b48a-89bacabc6cec None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:24.797095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d9a6c620-7065-44ab-b48a-89bacabc6cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:24.822383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6c620-7065-44ab-b48a-89bacabc6cec None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:24.822597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303551e-b14b-4845-ac1e-772d036fd751 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:24.823041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303551e-b14b-4845-ac1e-772d036fd751 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:24.823321 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303551e-b14b-4845-ac1e-772d036fd751 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:24.823593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303551e-b14b-4845-ac1e-772d036fd751 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:24.827431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9303551e-b14b-4845-ac1e-772d036fd751 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:24.837973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41aa479-0174-4883-96a4-00434e3ad550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:24.838831 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41aa479-0174-4883-96a4-00434e3ad550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:24.839308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41aa479-0174-4883-96a4-00434e3ad550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:24.840059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41aa479-0174-4883-96a4-00434e3ad550 admin admin] PATH_INFO: `/v3/projects/01682312419f4c1bb035099129909b9a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:24.841415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41aa479-0174-4883-96a4-00434e3ad550 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01682312419f4c1bb035099129909b9a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:24.844589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41aa479-0174-4883-96a4-00434e3ad550 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:24.945821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9303551e-b14b-4845-ac1e-772d036fd751 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:24.948050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9303551e-b14b-4845-ac1e-772d036fd751 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:24.960438 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2812/5649] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:37:24 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:37:24.962404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303551e-b14b-4845-ac1e-772d036fd751 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:24.963979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9303551e-b14b-4845-ac1e-772d036fd751 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:24.983373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303551e-b14b-4845-ac1e-772d036fd751 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:25.012717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c41aa479-0174-4883-96a4-00434e3ad550 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01682312419f4c1bb035099129909b9a', 'request_id': 'req-c41aa479-0174-4883-96a4-00434e3ad550'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:25.033929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c41aa479-0174-4883-96a4-00434e3ad550 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01682312419f4c1bb035099129909b9a', 'request_id': 'req-c41aa479-0174-4883-96a4-00434e3ad550'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:25.047543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c41aa479-0174-4883-96a4-00434e3ad550 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01682312419f4c1bb035099129909b9a', 'request_id': 'req-c41aa479-0174-4883-96a4-00434e3ad550'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:25.061377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e90703-2d57-4a02-87e2-96b6720dbc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:25.062014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e90703-2d57-4a02-87e2-96b6720dbc10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:25.062286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e90703-2d57-4a02-87e2-96b6720dbc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:25.062549 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e90703-2d57-4a02-87e2-96b6720dbc10 admin admin] PATH_INFO: `/v3/projects/8c0af125606d432c998a323fc81ed3ff` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:25.064191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e90703-2d57-4a02-87e2-96b6720dbc10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c0af125606d432c998a323fc81ed3ff)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:25.066750 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e90703-2d57-4a02-87e2-96b6720dbc10 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:25.088805 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c41aa479-0174-4883-96a4-00434e3ad550 admin admin] The token cache is being invalidate because project 01682312419f4c1bb035099129909b9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:25.089388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c41aa479-0174-4883-96a4-00434e3ad550 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:25.093606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c41aa479-0174-4883-96a4-00434e3ad550 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:25.098758 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2838/5650] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:37:24 2022] DELETE /identity/v3/projects/01682312419f4c1bb035099129909b9a => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:25.101497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d6b81-335f-4714-ab5e-8c8a0d89b8a0 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:25.103095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d6b81-335f-4714-ab5e-8c8a0d89b8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:25.103502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d6b81-335f-4714-ab5e-8c8a0d89b8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:25.147831 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:25.187195 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f90d6b81-335f-4714-ab5e-8c8a0d89b8a0 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:25.189766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f90d6b81-335f-4714-ab5e-8c8a0d89b8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:25.214354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-16e90703-2d57-4a02-87e2-96b6720dbc10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c0af125606d432c998a323fc81ed3ff', 'request_id': 'req-16e90703-2d57-4a02-87e2-96b6720dbc10'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:25.228083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-16e90703-2d57-4a02-87e2-96b6720dbc10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c0af125606d432c998a323fc81ed3ff', 'request_id': 'req-16e90703-2d57-4a02-87e2-96b6720dbc10'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:25.248996 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-16e90703-2d57-4a02-87e2-96b6720dbc10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c0af125606d432c998a323fc81ed3ff', 'request_id': 'req-16e90703-2d57-4a02-87e2-96b6720dbc10'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:25.276187 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-16e90703-2d57-4a02-87e2-96b6720dbc10 admin admin] The token cache is being invalidate because project 8c0af125606d432c998a323fc81ed3ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:25.276782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-16e90703-2d57-4a02-87e2-96b6720dbc10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:25.278027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-16e90703-2d57-4a02-87e2-96b6720dbc10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:25.286860 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2813/5651] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:37:24 2022] DELETE /identity/v3/projects/8c0af125606d432c998a323fc81ed3ff => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:25.288142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e90703-2d57-4a02-87e2-96b6720dbc10 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:25.290241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-16e90703-2d57-4a02-87e2-96b6720dbc10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:25.354403 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2839/5652] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:25.356007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd601e-0629-4e23-bb7d-f756bb27a5e9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:25.356399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd601e-0629-4e23-bb7d-f756bb27a5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:25.356953 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd601e-0629-4e23-bb7d-f756bb27a5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:25.402551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-64cd601e-0629-4e23-bb7d-f756bb27a5e9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:25.406537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-64cd601e-0629-4e23-bb7d-f756bb27a5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:25.426334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e90703-2d57-4a02-87e2-96b6720dbc10 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:25.427056 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2840/5653] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:25.428032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd601e-0629-4e23-bb7d-f756bb27a5e9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:25.434124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c180f42-0b50-490a-88b9-5fb5feb2d9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:25.435334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c180f42-0b50-490a-88b9-5fb5feb2d9e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:25.436385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c180f42-0b50-490a-88b9-5fb5feb2d9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:25.437371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c180f42-0b50-490a-88b9-5fb5feb2d9e9 admin admin] PATH_INFO: `/v3/users/6ca264e1de5b40588253955de43eb6c9` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:25.440355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c180f42-0b50-490a-88b9-5fb5feb2d9e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ca264e1de5b40588253955de43eb6c9)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:25.445693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c180f42-0b50-490a-88b9-5fb5feb2d9e9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:25.453320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd601e-0629-4e23-bb7d-f756bb27a5e9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:25.468863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8110f2-cadd-4e1c-9d5e-770d47fb7e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:25.469802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8110f2-cadd-4e1c-9d5e-770d47fb7e12 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:25.470256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8110f2-cadd-4e1c-9d5e-770d47fb7e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:25.470727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8110f2-cadd-4e1c-9d5e-770d47fb7e12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:25.471506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8110f2-cadd-4e1c-9d5e-770d47fb7e12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:37:25.471966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8110f2-cadd-4e1c-9d5e-770d47fb7e12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:25.475406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8110f2-cadd-4e1c-9d5e-770d47fb7e12 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:25.507912 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2841/5654] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:37:25.509486 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00935c7-85e3-4569-9e7b-f0bddb2b12c5 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:25.509906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00935c7-85e3-4569-9e7b-f0bddb2b12c5 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:25.510269 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00935c7-85e3-4569-9e7b-f0bddb2b12c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:25.535594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3c180f42-0b50-490a-88b9-5fb5feb2d9e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ca264e1de5b40588253955de43eb6c9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:25.546386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3c180f42-0b50-490a-88b9-5fb5feb2d9e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ca264e1de5b40588253955de43eb6c9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:25.568856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3c180f42-0b50-490a-88b9-5fb5feb2d9e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ca264e1de5b40588253955de43eb6c9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:25.570278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b00935c7-85e3-4569-9e7b-f0bddb2b12c5 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:25.570468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3c180f42-0b50-490a-88b9-5fb5feb2d9e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ca264e1de5b40588253955de43eb6c9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:25.571509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b00935c7-85e3-4569-9e7b-f0bddb2b12c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:25.583522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3c180f42-0b50-490a-88b9-5fb5feb2d9e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ca264e1de5b40588253955de43eb6c9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:25.602584 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2842/5655] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:25.603605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00935c7-85e3-4569-9e7b-f0bddb2b12c5 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:25.605027 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b00935c7-85e3-4569-9e7b-f0bddb2b12c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:25.633501 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2814/5656] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:37:25 2022] DELETE /identity/v3/users/6ca264e1de5b40588253955de43eb6c9 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:25.635261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00935c7-85e3-4569-9e7b-f0bddb2b12c5 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:25.638511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c180f42-0b50-490a-88b9-5fb5feb2d9e9 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:25.711434 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:25.736820 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:25.786555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31091f5a-0f0a-49c7-8b0e-e7bee7d5b17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:25.787427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31091f5a-0f0a-49c7-8b0e-e7bee7d5b17e admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:25.787782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31091f5a-0f0a-49c7-8b0e-e7bee7d5b17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:25.788504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31091f5a-0f0a-49c7-8b0e-e7bee7d5b17e admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:25.790551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31091f5a-0f0a-49c7-8b0e-e7bee7d5b17e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:25.795076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31091f5a-0f0a-49c7-8b0e-e7bee7d5b17e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:25.846916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c180f42-0b50-490a-88b9-5fb5feb2d9e9 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:25.861388 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d76b82-948d-40f8-a994-e9b50e9b073b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:25.864341 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d76b82-948d-40f8-a994-e9b50e9b073b admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:25.866428 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d76b82-948d-40f8-a994-e9b50e9b073b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:25.866950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d76b82-948d-40f8-a994-e9b50e9b073b admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:25.869191 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2843/5657] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:37:25 2022] POST /identity/v3/projects => generated 361 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:25.869732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d76b82-948d-40f8-a994-e9b50e9b073b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:37:25.870247 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d76b82-948d-40f8-a994-e9b50e9b073b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:25.872897 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31091f5a-0f0a-49c7-8b0e-e7bee7d5b17e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:25.874849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d76b82-948d-40f8-a994-e9b50e9b073b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:25.919421 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2815/5658] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:37:25.924676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d76b82-948d-40f8-a994-e9b50e9b073b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:25.945689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d76b82-948d-40f8-a994-e9b50e9b073b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:26.030913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31091f5a-0f0a-49c7-8b0e-e7bee7d5b17e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:26.046040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9f93b-8e57-477e-b2a4-6a2d9278bed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:26.047214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9f93b-8e57-477e-b2a4-6a2d9278bed5 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:26.047764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9f93b-8e57-477e-b2a4-6a2d9278bed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:26.048380 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9f93b-8e57-477e-b2a4-6a2d9278bed5 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:26.049899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc9f93b-8e57-477e-b2a4-6a2d9278bed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:26.052296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc9f93b-8e57-477e-b2a4-6a2d9278bed5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:26.053707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bfaaf9-b5cb-4f28-93e6-6dcaa1fb866a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:26.054569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfaaf9-b5cb-4f28-93e6-6dcaa1fb866a admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:26.055097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfaaf9-b5cb-4f28-93e6-6dcaa1fb866a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:26.055464 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfaaf9-b5cb-4f28-93e6-6dcaa1fb866a admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:26.056145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bfaaf9-b5cb-4f28-93e6-6dcaa1fb866a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:26.058773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bfaaf9-b5cb-4f28-93e6-6dcaa1fb866a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:26.086524 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2844/5659] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:37:25 2022] POST /identity/v3/users => generated 281 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:37:26.093422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9f93b-8e57-477e-b2a4-6a2d9278bed5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:26.102203 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2816/5660] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:37:25 2022] POST /identity/v3/projects => generated 363 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:37:26.107404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bfaaf9-b5cb-4f28-93e6-6dcaa1fb866a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:26.110258 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9f93b-8e57-477e-b2a4-6a2d9278bed5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:26.207034 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590cba6-7809-49d1-bf08-a68fc531d1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:26.210012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590cba6-7809-49d1-bf08-a68fc531d1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:26.210425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590cba6-7809-49d1-bf08-a68fc531d1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:26.210782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590cba6-7809-49d1-bf08-a68fc531d1f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:26.211566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590cba6-7809-49d1-bf08-a68fc531d1f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:26.213726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590cba6-7809-49d1-bf08-a68fc531d1f4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:26.245621 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2845/5661] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:37:26.247511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590cba6-7809-49d1-bf08-a68fc531d1f4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:26.277639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590cba6-7809-49d1-bf08-a68fc531d1f4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:26.280699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bfaaf9-b5cb-4f28-93e6-6dcaa1fb866a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:26.289537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282035c1-6f3f-46a4-87d3-aff782c6e036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:26.290360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282035c1-6f3f-46a4-87d3-aff782c6e036 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:26.290719 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282035c1-6f3f-46a4-87d3-aff782c6e036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:26.291637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282035c1-6f3f-46a4-87d3-aff782c6e036 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:26.292754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1aee34-1402-46fd-84a6-92b66814a338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:26.293640 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1aee34-1402-46fd-84a6-92b66814a338 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:26.293807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282035c1-6f3f-46a4-87d3-aff782c6e036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:26.293921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1aee34-1402-46fd-84a6-92b66814a338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:26.296553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282035c1-6f3f-46a4-87d3-aff782c6e036 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:26.297484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1aee34-1402-46fd-84a6-92b66814a338 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:26.301114 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1aee34-1402-46fd-84a6-92b66814a338 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:26.304322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1aee34-1402-46fd-84a6-92b66814a338 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:26.352685 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2846/5662] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:37:26.357778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282035c1-6f3f-46a4-87d3-aff782c6e036 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:26.394317 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2817/5663] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:37:26 2022] POST /identity/v3/users => generated 282 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:26.395459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1aee34-1402-46fd-84a6-92b66814a338 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:26.405434 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282035c1-6f3f-46a4-87d3-aff782c6e036 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:26.418437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b40d7-467c-46a7-a809-c1d7583ef30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:26.422033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b40d7-467c-46a7-a809-c1d7583ef30c admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:26.423130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b40d7-467c-46a7-a809-c1d7583ef30c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:26.424255 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b40d7-467c-46a7-a809-c1d7583ef30c admin admin] PATH_INFO: `/v3/projects/a7eecd700893476191d4405a1c316858/users/a1f466e299cc43cc8174f655299583fc/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:26.428809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1aee34-1402-46fd-84a6-92b66814a338 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:26.438151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85127e-6b03-44d0-93fb-5832b164f19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:26.439361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85127e-6b03-44d0-93fb-5832b164f19f admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:26.439693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85127e-6b03-44d0-93fb-5832b164f19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:26.440011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85127e-6b03-44d0-93fb-5832b164f19f admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:26.441006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85127e-6b03-44d0-93fb-5832b164f19f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:26.443185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85127e-6b03-44d0-93fb-5832b164f19f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:26.470180 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2818/5664] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:37:26.471249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b40d7-467c-46a7-a809-c1d7583ef30c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7eecd700893476191d4405a1c316858, user_id=a1f466e299cc43cc8174f655299583fc, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:26.475040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85127e-6b03-44d0-93fb-5832b164f19f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:26.481178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b40d7-467c-46a7-a809-c1d7583ef30c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:26.491005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85127e-6b03-44d0-93fb-5832b164f19f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:26.498266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967e892-ce1a-4f5a-a584-2170a1dfb67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:26.498983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967e892-ce1a-4f5a-a584-2170a1dfb67b admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:26.499272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967e892-ce1a-4f5a-a584-2170a1dfb67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:26.499597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967e892-ce1a-4f5a-a584-2170a1dfb67b admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:26.500452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967e892-ce1a-4f5a-a584-2170a1dfb67b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:26.503046 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967e892-ce1a-4f5a-a584-2170a1dfb67b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:26.515320 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2847/5665] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:37:26 2022] PUT /identity/v3/projects/a7eecd700893476191d4405a1c316858/users/a1f466e299cc43cc8174f655299583fc/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:26.517164 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2819/5666] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:37:26.521827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967e892-ce1a-4f5a-a584-2170a1dfb67b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:26.523281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93526e-bd6c-4e49-8011-4f0ce8d8d366 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:26.526937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93526e-bd6c-4e49-8011-4f0ce8d8d366 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:26.527931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93526e-bd6c-4e49-8011-4f0ce8d8d366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:26.535489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967e892-ce1a-4f5a-a584-2170a1dfb67b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:26.550088 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:26.567044 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:26.606721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0f93526e-bd6c-4e49-8011-4f0ce8d8d366 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:26.612275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0f93526e-bd6c-4e49-8011-4f0ce8d8d366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:26.651411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86bf36-c469-4f57-b4fd-6743456e1307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:26.652177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86bf36-c469-4f57-b4fd-6743456e1307 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:26.652464 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86bf36-c469-4f57-b4fd-6743456e1307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:26.652746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86bf36-c469-4f57-b4fd-6743456e1307 admin admin] PATH_INFO: `/v3/projects/393fd8cfdf9842beace99145d27a3fd0/users/a594aa14f1d64745bd748d1d06273f8b/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:26.696480 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86bf36-c469-4f57-b4fd-6743456e1307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=393fd8cfdf9842beace99145d27a3fd0, user_id=a594aa14f1d64745bd748d1d06273f8b, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:26.703310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86bf36-c469-4f57-b4fd-6743456e1307 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:26.748839 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2820/5667] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:37:26 2022] PUT /identity/v3/projects/393fd8cfdf9842beace99145d27a3fd0/users/a594aa14f1d64745bd748d1d06273f8b/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:37:26.752442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea0ca4-a2a1-46de-bef2-e82106016251 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:26.753415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea0ca4-a2a1-46de-bef2-e82106016251 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:26.753905 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea0ca4-a2a1-46de-bef2-e82106016251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:26.772723 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2848/5668] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:26.817659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93526e-bd6c-4e49-8011-4f0ce8d8d366 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:26.821538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0f93526e-bd6c-4e49-8011-4f0ce8d8d366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:26.824089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-efea0ca4-a2a1-46de-bef2-e82106016251 None None] MFA Rules not processed for user `a594aa14f1d64745bd748d1d06273f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:26.826297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-efea0ca4-a2a1-46de-bef2-e82106016251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:26.945210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93526e-bd6c-4e49-8011-4f0ce8d8d366 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:26.993722 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2821/5669] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:27.014493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea0ca4-a2a1-46de-bef2-e82106016251 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:27.015966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-efea0ca4-a2a1-46de-bef2-e82106016251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:27.028455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf56f9c-a406-4c05-8a83-a90f4cb05c40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:27.029768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf56f9c-a406-4c05-8a83-a90f4cb05c40 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:27.030387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf56f9c-a406-4c05-8a83-a90f4cb05c40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:27.030998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf56f9c-a406-4c05-8a83-a90f4cb05c40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:27.131574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea0ca4-a2a1-46de-bef2-e82106016251 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:27.136413 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da44329-76ab-4f55-9011-b24b99721a07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:27.137220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da44329-76ab-4f55-9011-b24b99721a07 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:27.137500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da44329-76ab-4f55-9011-b24b99721a07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:27.138086 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da44329-76ab-4f55-9011-b24b99721a07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:27.164603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da44329-76ab-4f55-9011-b24b99721a07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:27.184856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da44329-76ab-4f55-9011-b24b99721a07 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:27.198549 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2822/5670] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:37:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:37:27.199726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da44329-76ab-4f55-9011-b24b99721a07 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:27.202329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1da44329-76ab-4f55-9011-b24b99721a07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:27.221208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf56f9c-a406-4c05-8a83-a90f4cb05c40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:27.222714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf56f9c-a406-4c05-8a83-a90f4cb05c40 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:27.252055 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2849/5671] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:37:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:37:27.262634 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:27.332989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da44329-76ab-4f55-9011-b24b99721a07 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:27.339670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b6235-f875-4c7f-8a76-c1034697f41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:27.340778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b6235-f875-4c7f-8a76-c1034697f41a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:27.341125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b6235-f875-4c7f-8a76-c1034697f41a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:27.341466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b6235-f875-4c7f-8a76-c1034697f41a admin admin] PATH_INFO: `/v3/projects/567aaa829a894b70896ac1080fe63a23` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:27.343554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b6235-f875-4c7f-8a76-c1034697f41a admin admin] RBAC: Authorizing `identity:delete_project(project_id=567aaa829a894b70896ac1080fe63a23)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:27.346648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3b6235-f875-4c7f-8a76-c1034697f41a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:27.446717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bf3b6235-f875-4c7f-8a76-c1034697f41a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '567aaa829a894b70896ac1080fe63a23', 'request_id': 'req-bf3b6235-f875-4c7f-8a76-c1034697f41a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:27.453663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bf3b6235-f875-4c7f-8a76-c1034697f41a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '567aaa829a894b70896ac1080fe63a23', 'request_id': 'req-bf3b6235-f875-4c7f-8a76-c1034697f41a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:27.461264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bf3b6235-f875-4c7f-8a76-c1034697f41a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '567aaa829a894b70896ac1080fe63a23', 'request_id': 'req-bf3b6235-f875-4c7f-8a76-c1034697f41a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:27.476243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bf3b6235-f875-4c7f-8a76-c1034697f41a admin admin] The token cache is being invalidate because project 567aaa829a894b70896ac1080fe63a23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:27.476946 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bf3b6235-f875-4c7f-8a76-c1034697f41a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:27.477615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bf3b6235-f875-4c7f-8a76-c1034697f41a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:27.479502 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2823/5672] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:37:27 2022] DELETE /identity/v3/projects/567aaa829a894b70896ac1080fe63a23 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:27.484232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f987d-13d2-404e-b1cc-b09a0bbd309d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:27.484774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f987d-13d2-404e-b1cc-b09a0bbd309d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:27.484774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f987d-13d2-404e-b1cc-b09a0bbd309d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:27.505852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-016f987d-13d2-404e-b1cc-b09a0bbd309d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:27.506975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-016f987d-13d2-404e-b1cc-b09a0bbd309d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:27.516630 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:27.582256 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2850/5673] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:27.591107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a355b66-3a49-4285-ab92-71018742aa3b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:27.591637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a355b66-3a49-4285-ab92-71018742aa3b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:27.591936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a355b66-3a49-4285-ab92-71018742aa3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:27.620544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0a355b66-3a49-4285-ab92-71018742aa3b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:27.622665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0a355b66-3a49-4285-ab92-71018742aa3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:27.635679 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2824/5674] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:27.637205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f987d-13d2-404e-b1cc-b09a0bbd309d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:27.652704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f987d-13d2-404e-b1cc-b09a0bbd309d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:27.659072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e080796-c4b2-4cba-9ee9-e3e728027e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:27.659854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e080796-c4b2-4cba-9ee9-e3e728027e0d admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:27.660266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e080796-c4b2-4cba-9ee9-e3e728027e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:27.661057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e080796-c4b2-4cba-9ee9-e3e728027e0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:27.661428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e080796-c4b2-4cba-9ee9-e3e728027e0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:37:27.662478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e080796-c4b2-4cba-9ee9-e3e728027e0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:27.665205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e080796-c4b2-4cba-9ee9-e3e728027e0d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:27.684176 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2851/5675] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:37:27.687713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a355b66-3a49-4285-ab92-71018742aa3b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:27.701607 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a355b66-3a49-4285-ab92-71018742aa3b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:27.708845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766d9e9-8aac-45c5-84fb-11f3a1315860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:27.710174 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766d9e9-8aac-45c5-84fb-11f3a1315860 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:27.710858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766d9e9-8aac-45c5-84fb-11f3a1315860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:27.711505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d766d9e9-8aac-45c5-84fb-11f3a1315860 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:27.712946 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766d9e9-8aac-45c5-84fb-11f3a1315860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:27.717192 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d766d9e9-8aac-45c5-84fb-11f3a1315860 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:27.753400 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2825/5676] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:37:27 2022] POST /identity/v3/projects => generated 377 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:27.758513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e080796-c4b2-4cba-9ee9-e3e728027e0d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:27.795990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e080796-c4b2-4cba-9ee9-e3e728027e0d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:27.951227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab227d-3e29-42ee-825f-e6ead7cad75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:27.952183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab227d-3e29-42ee-825f-e6ead7cad75a admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:27.952633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab227d-3e29-42ee-825f-e6ead7cad75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:27.953069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab227d-3e29-42ee-825f-e6ead7cad75a admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:27.954431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab227d-3e29-42ee-825f-e6ead7cad75a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:27.956957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ab227d-3e29-42ee-825f-e6ead7cad75a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:27.995148 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2852/5677] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:37:27 2022] POST /identity/v3/users => generated 289 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:27.999305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766d9e9-8aac-45c5-84fb-11f3a1315860 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:28.010798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d766d9e9-8aac-45c5-84fb-11f3a1315860 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:28.016968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754fb16-2531-48ca-a0e8-7717428f6a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:28.017780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754fb16-2531-48ca-a0e8-7717428f6a77 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:28.018157 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754fb16-2531-48ca-a0e8-7717428f6a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:28.018528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4754fb16-2531-48ca-a0e8-7717428f6a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:28.019292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4754fb16-2531-48ca-a0e8-7717428f6a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:28.021171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4754fb16-2531-48ca-a0e8-7717428f6a77 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:28.036317 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2826/5678] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:37:28.039195 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab227d-3e29-42ee-825f-e6ead7cad75a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:28.054573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab227d-3e29-42ee-825f-e6ead7cad75a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:28.060596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383f577-ee1c-431f-b930-880492afc812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:28.061322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383f577-ee1c-431f-b930-880492afc812 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:28.061671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383f577-ee1c-431f-b930-880492afc812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:28.062010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383f577-ee1c-431f-b930-880492afc812 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:28.062735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383f577-ee1c-431f-b930-880492afc812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:28.065279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383f577-ee1c-431f-b930-880492afc812 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:28.084722 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2853/5679] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:37:28.091078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754fb16-2531-48ca-a0e8-7717428f6a77 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:28.106604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4754fb16-2531-48ca-a0e8-7717428f6a77 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:28.112987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcef681-4836-447f-8122-7ed448235396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:28.113900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcef681-4836-447f-8122-7ed448235396 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:28.114283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcef681-4836-447f-8122-7ed448235396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:28.115500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcef681-4836-447f-8122-7ed448235396 admin admin] PATH_INFO: `/v3/projects/ade29f1e540e4097a5ee7077fc892962/users/ebda8d0a121c4c6db3c93845f20ba5a5/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:28.137913 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcef681-4836-447f-8122-7ed448235396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ade29f1e540e4097a5ee7077fc892962, user_id=ebda8d0a121c4c6db3c93845f20ba5a5, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:28.142074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcef681-4836-447f-8122-7ed448235396 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:28.156519 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2827/5680] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:37:28 2022] PUT /identity/v3/projects/ade29f1e540e4097a5ee7077fc892962/users/ebda8d0a121c4c6db3c93845f20ba5a5/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:28.168643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a55d2-a1f8-426e-bacb-08b2e95b7907 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:28.168929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a55d2-a1f8-426e-bacb-08b2e95b7907 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:28.169204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a55d2-a1f8-426e-bacb-08b2e95b7907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:28.212470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a08a55d2-a1f8-426e-bacb-08b2e95b7907 None None] MFA Rules not processed for user `ebda8d0a121c4c6db3c93845f20ba5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:28.214602 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a08a55d2-a1f8-426e-bacb-08b2e95b7907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:28.305616 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2854/5681] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:28.306774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcef681-4836-447f-8122-7ed448235396 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:28.420929 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:28.442172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcef681-4836-447f-8122-7ed448235396 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:28.451916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6138da-750e-4be2-abb7-86256de6b6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:28.452997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6138da-750e-4be2-abb7-86256de6b6ce admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:28.454111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6138da-750e-4be2-abb7-86256de6b6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:28.454290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6138da-750e-4be2-abb7-86256de6b6ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:28.454929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6138da-750e-4be2-abb7-86256de6b6ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:28.457616 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6138da-750e-4be2-abb7-86256de6b6ce admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:28.519531 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2828/5682] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:37:28 2022] POST /identity/v3/projects => generated 375 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:28.523688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a55d2-a1f8-426e-bacb-08b2e95b7907 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:28.535776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a55d2-a1f8-426e-bacb-08b2e95b7907 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:28.542628 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:28.603780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c63c40-2f72-445d-a874-9973b52d6740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:28.604563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c63c40-2f72-445d-a874-9973b52d6740 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:28.604795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c63c40-2f72-445d-a874-9973b52d6740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:28.605061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c63c40-2f72-445d-a874-9973b52d6740 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:28.605819 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c63c40-2f72-445d-a874-9973b52d6740 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:28.607965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c63c40-2f72-445d-a874-9973b52d6740 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:28.630534 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2855/5683] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:37:28 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:28.635470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6138da-750e-4be2-abb7-86256de6b6ce admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:28.655680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6138da-750e-4be2-abb7-86256de6b6ce admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:28.662387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556320b4-ce48-46ab-882a-98a9d97b7e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:28.662729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556320b4-ce48-46ab-882a-98a9d97b7e05 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:28.663457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556320b4-ce48-46ab-882a-98a9d97b7e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:28.663595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556320b4-ce48-46ab-882a-98a9d97b7e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:28.664258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556320b4-ce48-46ab-882a-98a9d97b7e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:28.666065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556320b4-ce48-46ab-882a-98a9d97b7e05 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:28.679651 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2829/5684] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:37:28.684139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c63c40-2f72-445d-a874-9973b52d6740 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:28.696963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c63c40-2f72-445d-a874-9973b52d6740 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:28.705418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a093cf-410d-4420-ad61-2772e1db1363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:28.706381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a093cf-410d-4420-ad61-2772e1db1363 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:28.706877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a093cf-410d-4420-ad61-2772e1db1363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:28.707446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a093cf-410d-4420-ad61-2772e1db1363 admin admin] PATH_INFO: `/v3/projects/c08974e9a0ab460ca900891b4ef29c4a/users/dc831a7fac734487a229d90868d07754/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:28.727109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a093cf-410d-4420-ad61-2772e1db1363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c08974e9a0ab460ca900891b4ef29c4a, user_id=dc831a7fac734487a229d90868d07754, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:28.729899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a093cf-410d-4420-ad61-2772e1db1363 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:28.751499 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2856/5685] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:37:28 2022] PUT /identity/v3/projects/c08974e9a0ab460ca900891b4ef29c4a/users/dc831a7fac734487a229d90868d07754/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:28.757907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556320b4-ce48-46ab-882a-98a9d97b7e05 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:28.772650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556320b4-ce48-46ab-882a-98a9d97b7e05 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:28.918281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6380a2-90d8-4911-8c7a-948bb01e344d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:28.919821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6380a2-90d8-4911-8c7a-948bb01e344d admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:28.920513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6380a2-90d8-4911-8c7a-948bb01e344d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:28.920513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6380a2-90d8-4911-8c7a-948bb01e344d admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:28.923517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6380a2-90d8-4911-8c7a-948bb01e344d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:28.925872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6380a2-90d8-4911-8c7a-948bb01e344d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:28.952823 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2830/5686] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:37:28.953036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a093cf-410d-4420-ad61-2772e1db1363 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:28.980959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a093cf-410d-4420-ad61-2772e1db1363 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:28.995484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fa19c-0706-45f5-b784-cba252cfd2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:28.995484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fa19c-0706-45f5-b784-cba252cfd2e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:28.995484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fa19c-0706-45f5-b784-cba252cfd2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:28.995484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fa19c-0706-45f5-b784-cba252cfd2e6 admin admin] PATH_INFO: `/v3/projects/c08974e9a0ab460ca900891b4ef29c4a/users/dc831a7fac734487a229d90868d07754/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:28.996866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694fa19c-0706-45f5-b784-cba252cfd2e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c08974e9a0ab460ca900891b4ef29c4a, user_id=dc831a7fac734487a229d90868d07754, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:29.001077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694fa19c-0706-45f5-b784-cba252cfd2e6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:29.028622 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2857/5687] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:37:28 2022] PUT /identity/v3/projects/c08974e9a0ab460ca900891b4ef29c4a/users/dc831a7fac734487a229d90868d07754/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:29.030670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530c0ee-7538-4919-9361-36be78cec54e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:29.031072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530c0ee-7538-4919-9361-36be78cec54e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:29.031456 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530c0ee-7538-4919-9361-36be78cec54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:29.104379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0530c0ee-7538-4919-9361-36be78cec54e None None] MFA Rules not processed for user `dc831a7fac734487a229d90868d07754`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:29.107194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0530c0ee-7538-4919-9361-36be78cec54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:29.276253 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2831/5688] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:29.280486 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fa19c-0706-45f5-b784-cba252cfd2e6 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:29.292853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fa19c-0706-45f5-b784-cba252cfd2e6 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:29.298164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61084dc3-1104-45ee-b14d-c4c61fdafc82 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc831a7fac734487a229d90868d07754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c08974e9a0ab460ca900891b4ef29c4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:29.298528 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61084dc3-1104-45ee-b14d-c4c61fdafc82 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:29.298849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61084dc3-1104-45ee-b14d-c4c61fdafc82 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:29.299220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61084dc3-1104-45ee-b14d-c4c61fdafc82 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:29.299930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61084dc3-1104-45ee-b14d-c4c61fdafc82 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:29.301807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61084dc3-1104-45ee-b14d-c4c61fdafc82 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:29.338606 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2858/5689] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:37:29 2022] POST /identity/v3/projects => generated 334 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:37:29.342851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530c0ee-7538-4919-9361-36be78cec54e None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:29.355102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530c0ee-7538-4919-9361-36be78cec54e None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:29.437042 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:29.450773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8482f7-c02f-4611-819d-9bc2c5207c91 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc831a7fac734487a229d90868d07754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c08974e9a0ab460ca900891b4ef29c4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:29.452600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8482f7-c02f-4611-819d-9bc2c5207c91 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:29.453136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8482f7-c02f-4611-819d-9bc2c5207c91 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:29.453507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8482f7-c02f-4611-819d-9bc2c5207c91 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:29.454854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8482f7-c02f-4611-819d-9bc2c5207c91 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:29.457210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8482f7-c02f-4611-819d-9bc2c5207c91 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:29.532403 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2832/5690] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Aug 7 01:37:29 2022] POST /identity/v3/projects => generated 332 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:29.534814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61084dc3-1104-45ee-b14d-c4c61fdafc82 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:29.549874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61084dc3-1104-45ee-b14d-c4c61fdafc82 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:29.704565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83285a-89a6-44f7-91d7-b524a284f430 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc831a7fac734487a229d90868d07754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c08974e9a0ab460ca900891b4ef29c4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:29.705816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83285a-89a6-44f7-91d7-b524a284f430 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:29.706327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83285a-89a6-44f7-91d7-b524a284f430 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:29.706825 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83285a-89a6-44f7-91d7-b524a284f430 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:29.707694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c83285a-89a6-44f7-91d7-b524a284f430 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:29.710090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c83285a-89a6-44f7-91d7-b524a284f430 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:29.765549 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2859/5691] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:37:29 2022] POST /identity/v3/projects => generated 358 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:37:29.766950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8482f7-c02f-4611-819d-9bc2c5207c91 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:29.777550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8482f7-c02f-4611-819d-9bc2c5207c91 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:29.847387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e0c80-e7ea-4938-ac06-f2cd8f0f5b1d tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc831a7fac734487a229d90868d07754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c08974e9a0ab460ca900891b4ef29c4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:29.848059 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e0c80-e7ea-4938-ac06-f2cd8f0f5b1d tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:29.848405 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e0c80-e7ea-4938-ac06-f2cd8f0f5b1d tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:29.848864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e0c80-e7ea-4938-ac06-f2cd8f0f5b1d tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:29.849578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e0c80-e7ea-4938-ac06-f2cd8f0f5b1d tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:29.852135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e0c80-e7ea-4938-ac06-f2cd8f0f5b1d tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:29.877128 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2833/5692] 10.222.0.39 () {58 vars in 1131 bytes} [Sun Aug 7 01:37:29 2022] GET /identity/v3/projects => generated 7189 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:37:29.883253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83285a-89a6-44f7-91d7-b524a284f430 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:29.912563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83285a-89a6-44f7-91d7-b524a284f430 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:29.920662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7eed96-6ef2-4ce7-9515-7f225598c823 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc831a7fac734487a229d90868d07754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c08974e9a0ab460ca900891b4ef29c4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:29.920906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7eed96-6ef2-4ce7-9515-7f225598c823 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:29.921263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7eed96-6ef2-4ce7-9515-7f225598c823 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:29.922201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7eed96-6ef2-4ce7-9515-7f225598c823 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:29.924955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7eed96-6ef2-4ce7-9515-7f225598c823 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:37:29.925286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7eed96-6ef2-4ce7-9515-7f225598c823 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:29.929748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7eed96-6ef2-4ce7-9515-7f225598c823 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:29.957028 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2860/5693] 10.222.0.39 () {58 vars in 1158 bytes} [Sun Aug 7 01:37:29 2022] GET /identity/v3/projects?enabled=False => generated 445 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:37:29.967679 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e0c80-e7ea-4938-ac06-f2cd8f0f5b1d tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:29.980103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e0c80-e7ea-4938-ac06-f2cd8f0f5b1d tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:29.990719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf02c5-c047-41f2-add2-679cf3b693e3 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc831a7fac734487a229d90868d07754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c08974e9a0ab460ca900891b4ef29c4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:29.992152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf02c5-c047-41f2-add2-679cf3b693e3 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:29.992499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf02c5-c047-41f2-add2-679cf3b693e3 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:29.992891 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf02c5-c047-41f2-add2-679cf3b693e3 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:29.993969 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf02c5-c047-41f2-add2-679cf3b693e3 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] RBAC: Adding query filter params (parent_id=898806e75b1d460d9f83689d4ed877f2) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:37:29.994373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf02c5-c047-41f2-add2-679cf3b693e3 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:29.996959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf02c5-c047-41f2-add2-679cf3b693e3 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:30.023942 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2834/5694] 10.222.0.39 () {58 vars in 1216 bytes} [Sun Aug 7 01:37:29 2022] GET /identity/v3/projects?parent_id=898806e75b1d460d9f83689d4ed877f2 => generated 498 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:37:30.029756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7eed96-6ef2-4ce7-9515-7f225598c823 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:30.042667 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:30.054291 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7eed96-6ef2-4ce7-9515-7f225598c823 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:30.068044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74925e-0d26-499b-a9b6-27c0bc01cdc5 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc831a7fac734487a229d90868d07754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c08974e9a0ab460ca900891b4ef29c4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:30.070536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74925e-0d26-499b-a9b6-27c0bc01cdc5 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:30.072165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74925e-0d26-499b-a9b6-27c0bc01cdc5 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:30.073379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74925e-0d26-499b-a9b6-27c0bc01cdc5 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] PATH_INFO: `/v3/projects/9eae9f7815b440b580d4827dd8f37212` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:30.077953 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74925e-0d26-499b-a9b6-27c0bc01cdc5 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9eae9f7815b440b580d4827dd8f37212)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:30.086072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74925e-0d26-499b-a9b6-27c0bc01cdc5 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:30.194666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2c74925e-0d26-499b-a9b6-27c0bc01cdc5 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eae9f7815b440b580d4827dd8f37212', 'request_id': 'req-2c74925e-0d26-499b-a9b6-27c0bc01cdc5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:30.207551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2c74925e-0d26-499b-a9b6-27c0bc01cdc5 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eae9f7815b440b580d4827dd8f37212', 'request_id': 'req-2c74925e-0d26-499b-a9b6-27c0bc01cdc5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:30.237294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2c74925e-0d26-499b-a9b6-27c0bc01cdc5 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eae9f7815b440b580d4827dd8f37212', 'request_id': 'req-2c74925e-0d26-499b-a9b6-27c0bc01cdc5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:30.275663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2c74925e-0d26-499b-a9b6-27c0bc01cdc5 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] The token cache is being invalidate because project 9eae9f7815b440b580d4827dd8f37212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:30.276371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2c74925e-0d26-499b-a9b6-27c0bc01cdc5 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:30.277573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2c74925e-0d26-499b-a9b6-27c0bc01cdc5 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:30.280913 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2861/5695] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:37:30 2022] DELETE /identity/v3/projects/9eae9f7815b440b580d4827dd8f37212 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:30.284945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf02c5-c047-41f2-add2-679cf3b693e3 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:30.287548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4fdf02c5-c047-41f2-add2-679cf3b693e3 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:30.306871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf02c5-c047-41f2-add2-679cf3b693e3 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:30.431810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cb8c1-1f41-48d0-a73c-5bf0077d33df tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc831a7fac734487a229d90868d07754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c08974e9a0ab460ca900891b4ef29c4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:30.432483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cb8c1-1f41-48d0-a73c-5bf0077d33df tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:30.432764 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cb8c1-1f41-48d0-a73c-5bf0077d33df tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:30.433041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cb8c1-1f41-48d0-a73c-5bf0077d33df tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] PATH_INFO: `/v3/projects/898806e75b1d460d9f83689d4ed877f2` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:30.434852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451cb8c1-1f41-48d0-a73c-5bf0077d33df tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] RBAC: Authorizing `identity:delete_project(project_id=898806e75b1d460d9f83689d4ed877f2)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:30.438219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451cb8c1-1f41-48d0-a73c-5bf0077d33df tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:30.509472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-451cb8c1-1f41-48d0-a73c-5bf0077d33df tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '898806e75b1d460d9f83689d4ed877f2', 'request_id': 'req-451cb8c1-1f41-48d0-a73c-5bf0077d33df'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:30.519032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-451cb8c1-1f41-48d0-a73c-5bf0077d33df tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '898806e75b1d460d9f83689d4ed877f2', 'request_id': 'req-451cb8c1-1f41-48d0-a73c-5bf0077d33df'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:30.525187 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:30.530663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-451cb8c1-1f41-48d0-a73c-5bf0077d33df tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '898806e75b1d460d9f83689d4ed877f2', 'request_id': 'req-451cb8c1-1f41-48d0-a73c-5bf0077d33df'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:30.589047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-451cb8c1-1f41-48d0-a73c-5bf0077d33df tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] The token cache is being invalidate because project 898806e75b1d460d9f83689d4ed877f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:30.590143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-451cb8c1-1f41-48d0-a73c-5bf0077d33df tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:30.591965 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-451cb8c1-1f41-48d0-a73c-5bf0077d33df tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:30.594150 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2835/5696] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:37:30 2022] DELETE /identity/v3/projects/898806e75b1d460d9f83689d4ed877f2 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:37:30.600972 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74925e-0d26-499b-a9b6-27c0bc01cdc5 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:30.618653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74925e-0d26-499b-a9b6-27c0bc01cdc5 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:30.734824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e2f71-fdd8-44ba-883c-9e754f7e8971 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc831a7fac734487a229d90868d07754', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c08974e9a0ab460ca900891b4ef29c4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:30.735500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e2f71-fdd8-44ba-883c-9e754f7e8971 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:30.735776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e2f71-fdd8-44ba-883c-9e754f7e8971 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:30.736101 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e2f71-fdd8-44ba-883c-9e754f7e8971 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] PATH_INFO: `/v3/projects/9d5d8ab8703544be94a56162fa476d34` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:30.739494 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e2f71-fdd8-44ba-883c-9e754f7e8971 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9d5d8ab8703544be94a56162fa476d34)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:30.741975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e2f71-fdd8-44ba-883c-9e754f7e8971 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:30.852039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-155e2f71-fdd8-44ba-883c-9e754f7e8971 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d5d8ab8703544be94a56162fa476d34', 'request_id': 'req-155e2f71-fdd8-44ba-883c-9e754f7e8971'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:30.861687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-155e2f71-fdd8-44ba-883c-9e754f7e8971 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d5d8ab8703544be94a56162fa476d34', 'request_id': 'req-155e2f71-fdd8-44ba-883c-9e754f7e8971'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:30.869654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-155e2f71-fdd8-44ba-883c-9e754f7e8971 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d5d8ab8703544be94a56162fa476d34', 'request_id': 'req-155e2f71-fdd8-44ba-883c-9e754f7e8971'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:30.903185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-155e2f71-fdd8-44ba-883c-9e754f7e8971 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] The token cache is being invalidate because project 9d5d8ab8703544be94a56162fa476d34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:30.903185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-155e2f71-fdd8-44ba-883c-9e754f7e8971 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:30.904197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-155e2f71-fdd8-44ba-883c-9e754f7e8971 tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:30.911076 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2862/5697] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:37:30 2022] DELETE /identity/v3/projects/9d5d8ab8703544be94a56162fa476d34 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:30.915071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cb8c1-1f41-48d0-a73c-5bf0077d33df tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:30.916673 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-451cb8c1-1f41-48d0-a73c-5bf0077d33df tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:31.079736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cb8c1-1f41-48d0-a73c-5bf0077d33df tempest-ListProjectsTestJSON-358977158 tempest-ListProjectsTestJSON-358977158-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:31.198164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026cb3c3-8938-4cd9-98a8-9178033849c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:31.198829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026cb3c3-8938-4cd9-98a8-9178033849c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:31.199114 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026cb3c3-8938-4cd9-98a8-9178033849c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:31.199391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026cb3c3-8938-4cd9-98a8-9178033849c0 admin admin] PATH_INFO: `/v3/users/ebda8d0a121c4c6db3c93845f20ba5a5` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:31.205032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026cb3c3-8938-4cd9-98a8-9178033849c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebda8d0a121c4c6db3c93845f20ba5a5)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:31.207011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026cb3c3-8938-4cd9-98a8-9178033849c0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:31.352701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-026cb3c3-8938-4cd9-98a8-9178033849c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebda8d0a121c4c6db3c93845f20ba5a5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:31.364885 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-026cb3c3-8938-4cd9-98a8-9178033849c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebda8d0a121c4c6db3c93845f20ba5a5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:31.379862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-026cb3c3-8938-4cd9-98a8-9178033849c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebda8d0a121c4c6db3c93845f20ba5a5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:31.381282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-026cb3c3-8938-4cd9-98a8-9178033849c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebda8d0a121c4c6db3c93845f20ba5a5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:31.420038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-026cb3c3-8938-4cd9-98a8-9178033849c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebda8d0a121c4c6db3c93845f20ba5a5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:31.434342 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2836/5698] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:37:30 2022] DELETE /identity/v3/users/ebda8d0a121c4c6db3c93845f20ba5a5 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:31.436740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39670ce4-4f3d-4114-8af3-d8ed15e99fd1 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:31.437054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39670ce4-4f3d-4114-8af3-d8ed15e99fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:31.437328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39670ce4-4f3d-4114-8af3-d8ed15e99fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:31.524379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-39670ce4-4f3d-4114-8af3-d8ed15e99fd1 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:31.528176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-39670ce4-4f3d-4114-8af3-d8ed15e99fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:31.560817 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:31.701381 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2863/5699] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:31.715367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026cb3c3-8938-4cd9-98a8-9178033849c0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:31.717368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-026cb3c3-8938-4cd9-98a8-9178033849c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:31.755291 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:31.856584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026cb3c3-8938-4cd9-98a8-9178033849c0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:31.866086 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fab99-8009-40c8-b798-70aea61775f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:31.866873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fab99-8009-40c8-b798-70aea61775f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:31.867259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fab99-8009-40c8-b798-70aea61775f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:31.867643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fab99-8009-40c8-b798-70aea61775f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:31.893624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fab99-8009-40c8-b798-70aea61775f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:31.897149 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fab99-8009-40c8-b798-70aea61775f7 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:31.922774 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2837/5700] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:37:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:37:33.434827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39670ce4-4f3d-4114-8af3-d8ed15e99fd1 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:33.438712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-39670ce4-4f3d-4114-8af3-d8ed15e99fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:33.486481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39670ce4-4f3d-4114-8af3-d8ed15e99fd1 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:33.508354 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffcf95-89d1-4dc0-b401-52446c9f2b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:33.511667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffcf95-89d1-4dc0-b401-52446c9f2b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:33.512188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffcf95-89d1-4dc0-b401-52446c9f2b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:33.512578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffcf95-89d1-4dc0-b401-52446c9f2b93 admin admin] PATH_INFO: `/v3/projects/ade29f1e540e4097a5ee7077fc892962` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:33.515256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbffcf95-89d1-4dc0-b401-52446c9f2b93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ade29f1e540e4097a5ee7077fc892962)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:33.521809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbffcf95-89d1-4dc0-b401-52446c9f2b93 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:33.611277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bbffcf95-89d1-4dc0-b401-52446c9f2b93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ade29f1e540e4097a5ee7077fc892962', 'request_id': 'req-bbffcf95-89d1-4dc0-b401-52446c9f2b93'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:33.618618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bbffcf95-89d1-4dc0-b401-52446c9f2b93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ade29f1e540e4097a5ee7077fc892962', 'request_id': 'req-bbffcf95-89d1-4dc0-b401-52446c9f2b93'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:33.629728 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bbffcf95-89d1-4dc0-b401-52446c9f2b93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ade29f1e540e4097a5ee7077fc892962', 'request_id': 'req-bbffcf95-89d1-4dc0-b401-52446c9f2b93'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:33.650131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bbffcf95-89d1-4dc0-b401-52446c9f2b93 admin admin] The token cache is being invalidate because project ade29f1e540e4097a5ee7077fc892962 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:33.650776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bbffcf95-89d1-4dc0-b401-52446c9f2b93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:33.651771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bbffcf95-89d1-4dc0-b401-52446c9f2b93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:33.657178 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2864/5701] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:37:33 2022] DELETE /identity/v3/projects/ade29f1e540e4097a5ee7077fc892962 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:33.658660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fab99-8009-40c8-b798-70aea61775f7 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:33.669173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fab99-8009-40c8-b798-70aea61775f7 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:33.800055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99362b1e-8f8e-46fb-9a73-33c43c372311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:33.800989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99362b1e-8f8e-46fb-9a73-33c43c372311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:33.801873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99362b1e-8f8e-46fb-9a73-33c43c372311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:33.802337 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99362b1e-8f8e-46fb-9a73-33c43c372311 admin admin] PATH_INFO: `/v3/users/dc831a7fac734487a229d90868d07754` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:33.803748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99362b1e-8f8e-46fb-9a73-33c43c372311 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc831a7fac734487a229d90868d07754)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:33.807451 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99362b1e-8f8e-46fb-9a73-33c43c372311 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:33.926307 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-99362b1e-8f8e-46fb-9a73-33c43c372311 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc831a7fac734487a229d90868d07754'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:33.938826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-99362b1e-8f8e-46fb-9a73-33c43c372311 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc831a7fac734487a229d90868d07754'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:33.955130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-99362b1e-8f8e-46fb-9a73-33c43c372311 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc831a7fac734487a229d90868d07754'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:33.956050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-99362b1e-8f8e-46fb-9a73-33c43c372311 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc831a7fac734487a229d90868d07754'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:33.968353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-99362b1e-8f8e-46fb-9a73-33c43c372311 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc831a7fac734487a229d90868d07754'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:33.987441 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2838/5702] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:37:33 2022] DELETE /identity/v3/users/dc831a7fac734487a229d90868d07754 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:34.676618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffcf95-89d1-4dc0-b401-52446c9f2b93 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:34.678743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-bbffcf95-89d1-4dc0-b401-52446c9f2b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:34.696440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffcf95-89d1-4dc0-b401-52446c9f2b93 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:34.780469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3287a76-6695-4449-a1dd-9b0d24ee01e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:34.781639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3287a76-6695-4449-a1dd-9b0d24ee01e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:34.782212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3287a76-6695-4449-a1dd-9b0d24ee01e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:34.782681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3287a76-6695-4449-a1dd-9b0d24ee01e9 admin admin] PATH_INFO: `/v3/projects/c08974e9a0ab460ca900891b4ef29c4a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:34.784708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3287a76-6695-4449-a1dd-9b0d24ee01e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c08974e9a0ab460ca900891b4ef29c4a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:34.789508 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3287a76-6695-4449-a1dd-9b0d24ee01e9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:34.872023 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:34.878812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b3287a76-6695-4449-a1dd-9b0d24ee01e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c08974e9a0ab460ca900891b4ef29c4a', 'request_id': 'req-b3287a76-6695-4449-a1dd-9b0d24ee01e9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:34.907345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b3287a76-6695-4449-a1dd-9b0d24ee01e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c08974e9a0ab460ca900891b4ef29c4a', 'request_id': 'req-b3287a76-6695-4449-a1dd-9b0d24ee01e9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:34.917266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b3287a76-6695-4449-a1dd-9b0d24ee01e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c08974e9a0ab460ca900891b4ef29c4a', 'request_id': 'req-b3287a76-6695-4449-a1dd-9b0d24ee01e9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:34.964184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b3287a76-6695-4449-a1dd-9b0d24ee01e9 admin admin] The token cache is being invalidate because project c08974e9a0ab460ca900891b4ef29c4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:34.964545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b3287a76-6695-4449-a1dd-9b0d24ee01e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:34.965332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b3287a76-6695-4449-a1dd-9b0d24ee01e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:34.967235 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2865/5703] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:37:34 2022] DELETE /identity/v3/projects/c08974e9a0ab460ca900891b4ef29c4a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:34.985876 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6cb62-5d05-402a-9980-8d380da0f790 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:34.986770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6cb62-5d05-402a-9980-8d380da0f790 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:34.987239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6cb62-5d05-402a-9980-8d380da0f790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:35.008736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-65b6cb62-5d05-402a-9980-8d380da0f790 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:35.010407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-65b6cb62-5d05-402a-9980-8d380da0f790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:35.074159 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:35.134373 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2839/5704] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:35.142606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a823455-bca8-4e78-909c-b51332994710 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:35.142887 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a823455-bca8-4e78-909c-b51332994710 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:35.143178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a823455-bca8-4e78-909c-b51332994710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:35.200703 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1a823455-bca8-4e78-909c-b51332994710 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:35.201988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1a823455-bca8-4e78-909c-b51332994710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:35.223191 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2866/5705] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:35.227870 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6cb62-5d05-402a-9980-8d380da0f790 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:35.240937 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6cb62-5d05-402a-9980-8d380da0f790 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:35.256634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cc5d8-786e-405d-ae95-42626c7b81a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:35.257711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cc5d8-786e-405d-ae95-42626c7b81a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:35.258375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cc5d8-786e-405d-ae95-42626c7b81a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:35.258873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cc5d8-786e-405d-ae95-42626c7b81a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:35.259757 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55cc5d8-786e-405d-ae95-42626c7b81a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:37:35.260314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55cc5d8-786e-405d-ae95-42626c7b81a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:35.262160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55cc5d8-786e-405d-ae95-42626c7b81a3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:35.294238 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2840/5706] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:37:35.299379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a823455-bca8-4e78-909c-b51332994710 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:35.314046 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a823455-bca8-4e78-909c-b51332994710 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:35.325988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b8fb4-79cc-41c7-ac6d-af2a9560e6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:35.326741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b8fb4-79cc-41c7-ac6d-af2a9560e6b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:35.327143 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b8fb4-79cc-41c7-ac6d-af2a9560e6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:35.328411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b8fb4-79cc-41c7-ac6d-af2a9560e6b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:35.334930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b8fb4-79cc-41c7-ac6d-af2a9560e6b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:35.337130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b8fb4-79cc-41c7-ac6d-af2a9560e6b0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:35.400103 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2867/5707] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:37:35 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:35.404002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cc5d8-786e-405d-ae95-42626c7b81a3 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:35.420074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cc5d8-786e-405d-ae95-42626c7b81a3 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:35.551280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e6b1d-6dae-431d-8c66-eec61ed5c8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:35.554622 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e6b1d-6dae-431d-8c66-eec61ed5c8e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:35.555104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e6b1d-6dae-431d-8c66-eec61ed5c8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:35.556009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e6b1d-6dae-431d-8c66-eec61ed5c8e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:35.557281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e6b1d-6dae-431d-8c66-eec61ed5c8e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:35.563634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e6b1d-6dae-431d-8c66-eec61ed5c8e0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:35.612478 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2841/5708] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:37:35 2022] POST /identity/v3/users => generated 286 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:37:35.616670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b8fb4-79cc-41c7-ac6d-af2a9560e6b0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:35.628293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b8fb4-79cc-41c7-ac6d-af2a9560e6b0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:35.647245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302494c5-cdfd-4ad3-ba90-4118a4f7b49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:35.648349 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302494c5-cdfd-4ad3-ba90-4118a4f7b49e admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:35.652691 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302494c5-cdfd-4ad3-ba90-4118a4f7b49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:35.653264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302494c5-cdfd-4ad3-ba90-4118a4f7b49e admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:35.654110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302494c5-cdfd-4ad3-ba90-4118a4f7b49e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:35.655949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302494c5-cdfd-4ad3-ba90-4118a4f7b49e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:35.671149 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2868/5709] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:37:35.675072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e6b1d-6dae-431d-8c66-eec61ed5c8e0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:35.688447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e6b1d-6dae-431d-8c66-eec61ed5c8e0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:35.694235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf00c9-afc4-48cd-90d7-e00eabb40c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:35.695122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf00c9-afc4-48cd-90d7-e00eabb40c7e admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:35.695631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf00c9-afc4-48cd-90d7-e00eabb40c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:35.696286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf00c9-afc4-48cd-90d7-e00eabb40c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:35.697166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf00c9-afc4-48cd-90d7-e00eabb40c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:35.699076 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf00c9-afc4-48cd-90d7-e00eabb40c7e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:35.714486 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2842/5710] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:37:35.719272 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302494c5-cdfd-4ad3-ba90-4118a4f7b49e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:35.738393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302494c5-cdfd-4ad3-ba90-4118a4f7b49e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:35.751045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb0fbd-b4df-49b8-be3e-10023f2f0a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:35.752184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb0fbd-b4df-49b8-be3e-10023f2f0a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:35.752692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb0fbd-b4df-49b8-be3e-10023f2f0a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:35.753220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb0fbd-b4df-49b8-be3e-10023f2f0a16 admin admin] PATH_INFO: `/v3/projects/9b5ecb1896674cb585893a94d8ad96fe/users/f9db556fbec9470482e9eae0f086f0c5/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:35.778778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb0fbd-b4df-49b8-be3e-10023f2f0a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b5ecb1896674cb585893a94d8ad96fe, user_id=f9db556fbec9470482e9eae0f086f0c5, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:35.782203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb0fbd-b4df-49b8-be3e-10023f2f0a16 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:35.830482 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2869/5711] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:37:35 2022] PUT /identity/v3/projects/9b5ecb1896674cb585893a94d8ad96fe/users/f9db556fbec9470482e9eae0f086f0c5/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:35.841658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb70e8-a7f4-4320-9b5d-99e49623115a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:35.842528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb70e8-a7f4-4320-9b5d-99e49623115a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:35.843519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb70e8-a7f4-4320-9b5d-99e49623115a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:35.910032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-5adb70e8-a7f4-4320-9b5d-99e49623115a None None] MFA Rules not processed for user `f9db556fbec9470482e9eae0f086f0c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:35.911232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5adb70e8-a7f4-4320-9b5d-99e49623115a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:35.997795 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2843/5712] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:35.999098 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb0fbd-b4df-49b8-be3e-10023f2f0a16 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:36.148173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb0fbd-b4df-49b8-be3e-10023f2f0a16 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:36.154388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd8d55b-58b8-4054-9026-3d9bc3ac9c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:36.155842 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8d55b-58b8-4054-9026-3d9bc3ac9c75 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:36.156581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8d55b-58b8-4054-9026-3d9bc3ac9c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:36.157894 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8d55b-58b8-4054-9026-3d9bc3ac9c75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:36.158707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd8d55b-58b8-4054-9026-3d9bc3ac9c75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:36.162570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd8d55b-58b8-4054-9026-3d9bc3ac9c75 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:36.205054 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2870/5713] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:37:35 2022] POST /identity/v3/projects => generated 367 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:37:36.210390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb70e8-a7f4-4320-9b5d-99e49623115a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:36.229757 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb70e8-a7f4-4320-9b5d-99e49623115a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:36.289250 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:36.409107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02dee4e-d856-4cae-9040-cbd0cd024ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:36.409822 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dee4e-d856-4cae-9040-cbd0cd024ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:36.410175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dee4e-d856-4cae-9040-cbd0cd024ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:36.410949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dee4e-d856-4cae-9040-cbd0cd024ab0 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:36.411386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02dee4e-d856-4cae-9040-cbd0cd024ab0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:36.414334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02dee4e-d856-4cae-9040-cbd0cd024ab0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:36.447602 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2844/5714] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:37:36 2022] POST /identity/v3/users => generated 290 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:37:36.451455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd8d55b-58b8-4054-9026-3d9bc3ac9c75 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:36.468358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd8d55b-58b8-4054-9026-3d9bc3ac9c75 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:36.476451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b44546-3817-41cc-bd42-0ed918ba1f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:36.477307 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b44546-3817-41cc-bd42-0ed918ba1f33 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:36.477747 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b44546-3817-41cc-bd42-0ed918ba1f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:36.478199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b44546-3817-41cc-bd42-0ed918ba1f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:36.479037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b44546-3817-41cc-bd42-0ed918ba1f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:36.480832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b44546-3817-41cc-bd42-0ed918ba1f33 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:36.494812 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2871/5715] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:37:36.498783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02dee4e-d856-4cae-9040-cbd0cd024ab0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:36.515139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02dee4e-d856-4cae-9040-cbd0cd024ab0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:36.529405 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce905a7-224c-46b8-a71e-7d41a0b0aa5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:36.530027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce905a7-224c-46b8-a71e-7d41a0b0aa5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:36.530529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce905a7-224c-46b8-a71e-7d41a0b0aa5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:36.530753 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce905a7-224c-46b8-a71e-7d41a0b0aa5e admin admin] PATH_INFO: `/v3/projects/b3c7424200e7420a8940398de37aab87/users/4680a35ddd274e0faa163bac01d7543c/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:36.573301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce905a7-224c-46b8-a71e-7d41a0b0aa5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c7424200e7420a8940398de37aab87, user_id=4680a35ddd274e0faa163bac01d7543c, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:36.576036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce905a7-224c-46b8-a71e-7d41a0b0aa5e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:36.606636 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2845/5716] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:37:36 2022] PUT /identity/v3/projects/b3c7424200e7420a8940398de37aab87/users/4680a35ddd274e0faa163bac01d7543c/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:36.611413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b44546-3817-41cc-bd42-0ed918ba1f33 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:36.626814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b44546-3817-41cc-bd42-0ed918ba1f33 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:36.701369 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:36.737273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610c53a-b5cd-47c5-86ce-75792e2d63db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:36.738160 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610c53a-b5cd-47c5-86ce-75792e2d63db admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:36.738521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610c53a-b5cd-47c5-86ce-75792e2d63db admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:36.738891 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610c53a-b5cd-47c5-86ce-75792e2d63db admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:36.739809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b610c53a-b5cd-47c5-86ce-75792e2d63db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:36.741727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b610c53a-b5cd-47c5-86ce-75792e2d63db admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:36.781248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce905a7-224c-46b8-a71e-7d41a0b0aa5e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:36.800574 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2872/5717] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:37:36.809108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce905a7-224c-46b8-a71e-7d41a0b0aa5e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:36.815011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a124fae-18ca-4fc5-a73c-edf683f93182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:36.818692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a124fae-18ca-4fc5-a73c-edf683f93182 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:36.820269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a124fae-18ca-4fc5-a73c-edf683f93182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:36.821489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a124fae-18ca-4fc5-a73c-edf683f93182 admin admin] PATH_INFO: `/v3/projects/b3c7424200e7420a8940398de37aab87/users/4680a35ddd274e0faa163bac01d7543c/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:36.824656 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a124fae-18ca-4fc5-a73c-edf683f93182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c7424200e7420a8940398de37aab87, user_id=4680a35ddd274e0faa163bac01d7543c, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:36.843020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a124fae-18ca-4fc5-a73c-edf683f93182 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:36.874093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb65dd-6e17-4943-a641-a84987860289 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:36.874510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb65dd-6e17-4943-a641-a84987860289 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:36.875538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb65dd-6e17-4943-a641-a84987860289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:36.891431 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2846/5718] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:37:36 2022] PUT /identity/v3/projects/b3c7424200e7420a8940398de37aab87/users/4680a35ddd274e0faa163bac01d7543c/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:36.945904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a6bb65dd-6e17-4943-a641-a84987860289 None None] MFA Rules not processed for user `4680a35ddd274e0faa163bac01d7543c`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:36.947762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a6bb65dd-6e17-4943-a641-a84987860289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:37.099251 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2873/5719] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:36 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:37.104952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a124fae-18ca-4fc5-a73c-edf683f93182 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:37.120194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a124fae-18ca-4fc5-a73c-edf683f93182 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:37.126439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b27dbb-99b7-4fcc-a2ff-ad27ccd51904 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4680a35ddd274e0faa163bac01d7543c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c7424200e7420a8940398de37aab87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:37.126439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b27dbb-99b7-4fcc-a2ff-ad27ccd51904 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:37.126857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b27dbb-99b7-4fcc-a2ff-ad27ccd51904 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:37.127936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b27dbb-99b7-4fcc-a2ff-ad27ccd51904 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:37.128695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b27dbb-99b7-4fcc-a2ff-ad27ccd51904 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:37.133845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b27dbb-99b7-4fcc-a2ff-ad27ccd51904 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:37.210393 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2847/5720] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:37:37 2022] POST /identity/v3/projects => generated 357 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:37.213472 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb65dd-6e17-4943-a641-a84987860289 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:37.225466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb65dd-6e17-4943-a641-a84987860289 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:37.403011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98504e96-390e-47ab-b0ae-b798447e185c tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4680a35ddd274e0faa163bac01d7543c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c7424200e7420a8940398de37aab87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:37.404834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98504e96-390e-47ab-b0ae-b798447e185c tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:37.405414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98504e96-390e-47ab-b0ae-b798447e185c tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:37.405945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98504e96-390e-47ab-b0ae-b798447e185c tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:37.407109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98504e96-390e-47ab-b0ae-b798447e185c tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:37.409496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98504e96-390e-47ab-b0ae-b798447e185c tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:37.464247 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2874/5721] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:37:37 2022] POST /identity/v3/users => generated 373 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:37.469566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b27dbb-99b7-4fcc-a2ff-ad27ccd51904 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:37.485843 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b27dbb-99b7-4fcc-a2ff-ad27ccd51904 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:37.503680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb960fba-2dc8-433f-8cd0-dbf82755c409 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4680a35ddd274e0faa163bac01d7543c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c7424200e7420a8940398de37aab87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:37.504437 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb960fba-2dc8-433f-8cd0-dbf82755c409 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:37.504766 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb960fba-2dc8-433f-8cd0-dbf82755c409 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:37.505331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb960fba-2dc8-433f-8cd0-dbf82755c409 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:37.506536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb960fba-2dc8-433f-8cd0-dbf82755c409 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:37:37.508219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb960fba-2dc8-433f-8cd0-dbf82755c409 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:37.510241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb960fba-2dc8-433f-8cd0-dbf82755c409 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:37.603356 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2848/5722] 10.222.0.39 () {58 vars in 1157 bytes} [Sun Aug 7 01:37:37 2022] GET /identity/v3/users?domain_id=default => generated 8001 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:37:37.604148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98504e96-390e-47ab-b0ae-b798447e185c tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:37.631643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98504e96-390e-47ab-b0ae-b798447e185c tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:37.639382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10edea7-0ebb-442a-ae6f-b87f9028a1e6 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4680a35ddd274e0faa163bac01d7543c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c7424200e7420a8940398de37aab87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:37.640610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10edea7-0ebb-442a-ae6f-b87f9028a1e6 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:37.641040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10edea7-0ebb-442a-ae6f-b87f9028a1e6 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:37.641436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10edea7-0ebb-442a-ae6f-b87f9028a1e6 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] PATH_INFO: `/v3/users/ec26409d503742efa861447bb5bbfdcf` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:37.723491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10edea7-0ebb-442a-ae6f-b87f9028a1e6 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] RBAC: Authorizing `identity:update_user(user_id=ec26409d503742efa861447bb5bbfdcf)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:37.723491 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-e10edea7-0ebb-442a-ae6f-b87f9028a1e6 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:37:37.723491 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:37:37.723491 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:37:37.723491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10edea7-0ebb-442a-ae6f-b87f9028a1e6 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:37.795308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e10edea7-0ebb-442a-ae6f-b87f9028a1e6 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'ec26409d503742efa861447bb5bbfdcf'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:37.822323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e10edea7-0ebb-442a-ae6f-b87f9028a1e6 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] Invalidating the token cache because user ec26409d503742efa861447bb5bbfdcf was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:37.822681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e10edea7-0ebb-442a-ae6f-b87f9028a1e6 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:37.825773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e10edea7-0ebb-442a-ae6f-b87f9028a1e6 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:37.831652 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2875/5723] 10.222.0.39 () {60 vars in 1244 bytes} [Sun Aug 7 01:37:37 2022] PATCH /identity/v3/users/ec26409d503742efa861447bb5bbfdcf => generated 488 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:37:37.837215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75579411-bf67-4639-b717-083e6e19fcea None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:37.837582 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75579411-bf67-4639-b717-083e6e19fcea None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:37.837979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75579411-bf67-4639-b717-083e6e19fcea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:37.879788 n-d-master-1 devstack@keystone.service[80493]: WARNING keystone.auth.plugins.core [None req-75579411-bf67-4639-b717-083e6e19fcea None None] User is disabled: ec26409d503742efa861447bb5bbfdcf: AssertionError: User is disabled: ec26409d503742efa861447bb5bbfdcf Aug 07 01:37:37.889535 n-d-master-1 devstack@keystone.service[80493]: WARNING keystone.server.flask.application [None req-75579411-bf67-4639-b717-083e6e19fcea None None] Authorization failed. The request you have made requires authentication. from 10.222.0.39: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 07 01:37:37.912194 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2849/5724] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:37 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 77 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 07 01:37:37.916862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10edea7-0ebb-442a-ae6f-b87f9028a1e6 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:37.918601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e10edea7-0ebb-442a-ae6f-b87f9028a1e6 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:37.946882 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10edea7-0ebb-442a-ae6f-b87f9028a1e6 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:37.971301 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fdccde-0a7a-469e-97dc-c55d4093fec8 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4680a35ddd274e0faa163bac01d7543c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c7424200e7420a8940398de37aab87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:37.972225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdccde-0a7a-469e-97dc-c55d4093fec8 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:37.976336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdccde-0a7a-469e-97dc-c55d4093fec8 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:37.976336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdccde-0a7a-469e-97dc-c55d4093fec8 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] PATH_INFO: `/v3/users/ec26409d503742efa861447bb5bbfdcf` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:38.009888 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:38.022013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fdccde-0a7a-469e-97dc-c55d4093fec8 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ec26409d503742efa861447bb5bbfdcf)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:38.028700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fdccde-0a7a-469e-97dc-c55d4093fec8 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:38.152300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e1fdccde-0a7a-469e-97dc-c55d4093fec8 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec26409d503742efa861447bb5bbfdcf'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:38.189683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e1fdccde-0a7a-469e-97dc-c55d4093fec8 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec26409d503742efa861447bb5bbfdcf'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:38.227508 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e1fdccde-0a7a-469e-97dc-c55d4093fec8 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec26409d503742efa861447bb5bbfdcf'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:38.228728 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e1fdccde-0a7a-469e-97dc-c55d4093fec8 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec26409d503742efa861447bb5bbfdcf'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:38.244682 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e1fdccde-0a7a-469e-97dc-c55d4093fec8 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec26409d503742efa861447bb5bbfdcf'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:38.265741 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2876/5725] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:37:37 2022] DELETE /identity/v3/users/ec26409d503742efa861447bb5bbfdcf => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:38.270283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75579411-bf67-4639-b717-083e6e19fcea None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:38.275174 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-75579411-bf67-4639-b717-083e6e19fcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:38.386182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75579411-bf67-4639-b717-083e6e19fcea None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:38.397853 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a8d46-dfae-4061-afc7-1906f79368cd tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4680a35ddd274e0faa163bac01d7543c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c7424200e7420a8940398de37aab87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:38.398690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a8d46-dfae-4061-afc7-1906f79368cd tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:38.400459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a8d46-dfae-4061-afc7-1906f79368cd tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:38.400459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a8d46-dfae-4061-afc7-1906f79368cd tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] PATH_INFO: `/v3/projects/9b64ec31a29b440fb61f270a36b6662b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:38.402010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a8d46-dfae-4061-afc7-1906f79368cd tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9b64ec31a29b440fb61f270a36b6662b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:38.406536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a8d46-dfae-4061-afc7-1906f79368cd tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:38.526537 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:38.529063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-be3a8d46-dfae-4061-afc7-1906f79368cd tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b64ec31a29b440fb61f270a36b6662b', 'request_id': 'req-be3a8d46-dfae-4061-afc7-1906f79368cd'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:38.546178 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-be3a8d46-dfae-4061-afc7-1906f79368cd tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b64ec31a29b440fb61f270a36b6662b', 'request_id': 'req-be3a8d46-dfae-4061-afc7-1906f79368cd'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:38.559008 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-be3a8d46-dfae-4061-afc7-1906f79368cd tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b64ec31a29b440fb61f270a36b6662b', 'request_id': 'req-be3a8d46-dfae-4061-afc7-1906f79368cd'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:38.591478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-be3a8d46-dfae-4061-afc7-1906f79368cd tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] The token cache is being invalidate because project 9b64ec31a29b440fb61f270a36b6662b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:38.592580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-be3a8d46-dfae-4061-afc7-1906f79368cd tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:38.596293 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-be3a8d46-dfae-4061-afc7-1906f79368cd tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:38.604196 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2850/5726] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:37:38 2022] DELETE /identity/v3/projects/9b64ec31a29b440fb61f270a36b6662b => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:37:38.609271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fdccde-0a7a-469e-97dc-c55d4093fec8 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:38.624045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fdccde-0a7a-469e-97dc-c55d4093fec8 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:38.755229 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966416e-3b8a-4090-90f3-08ca34ea0e20 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4680a35ddd274e0faa163bac01d7543c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b3c7424200e7420a8940398de37aab87', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:38.755897 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966416e-3b8a-4090-90f3-08ca34ea0e20 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:38.756190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966416e-3b8a-4090-90f3-08ca34ea0e20 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:38.762555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966416e-3b8a-4090-90f3-08ca34ea0e20 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:38.763340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966416e-3b8a-4090-90f3-08ca34ea0e20 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:38.771103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966416e-3b8a-4090-90f3-08ca34ea0e20 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:38.814620 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-a966416e-3b8a-4090-90f3-08ca34ea0e20 tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] Could not find domain: af92e4dc95e5475dbe9d571334356f19.: keystone.exception.DomainNotFound: Could not find domain: af92e4dc95e5475dbe9d571334356f19. Aug 07 01:37:38.814620 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:37:38.814620 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 07 01:37:38.814620 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 07 01:37:38.814620 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 01:37:38.814620 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 01:37:38.814620 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 01:37:38.814620 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 01:37:38.814620 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: af92e4dc95e5475dbe9d571334356f19. Aug 07 01:37:38.814620 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:37:38.814620 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:37:38.814620 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:37:38.814620 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:37:38.814620 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:37:38.814620 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:37:38.814620 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:37:38.816595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:37:38.816595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:37:38.816595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:37:38.816595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:37:38.816595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:37:38.816595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:37:38.816595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:37:38.816595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 07 01:37:38.816595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 07 01:37:38.816595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:37:38.816595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:37:38.816595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 01:37:38.816595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 01:37:38.816595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 01:37:38.816595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 01:37:38.816595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Aug 07 01:37:38.816595 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Aug 07 01:37:38.818060 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:37:38.818060 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:37:38.818060 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:37:38.818060 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:37:38.818060 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:37:38.818060 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:37:38.818060 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:37:38.818060 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 01:37:38.818060 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:37:38.818060 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:37:38.818060 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:37:38.818060 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:37:38.818060 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:37:38.818060 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:37:38.818060 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:37:38.818060 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:37:38.818060 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 07 01:37:38.819482 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:37:38.819482 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: af92e4dc95e5475dbe9d571334356f19. Aug 07 01:37:38.819482 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:37:38.819482 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2877/5727] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:37:38 2022] POST /identity/v3/users => generated 112 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:37:38.824538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a8d46-dfae-4061-afc7-1906f79368cd tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:38.828042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-be3a8d46-dfae-4061-afc7-1906f79368cd tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:38.985828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a8d46-dfae-4061-afc7-1906f79368cd tempest-UsersNegativeTest-91169991 tempest-UsersNegativeTest-91169991-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:38.995122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492a426-b219-4bab-a32d-f4b0454adb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:38.995122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492a426-b219-4bab-a32d-f4b0454adb6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:38.995122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492a426-b219-4bab-a32d-f4b0454adb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:38.995122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492a426-b219-4bab-a32d-f4b0454adb6d admin admin] PATH_INFO: `/v3/users/f9db556fbec9470482e9eae0f086f0c5` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:38.995795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492a426-b219-4bab-a32d-f4b0454adb6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9db556fbec9470482e9eae0f086f0c5)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:38.999429 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492a426-b219-4bab-a32d-f4b0454adb6d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:39.027015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2536b-b056-4f7d-88e9-5a381bf6fb7b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:39.027449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2536b-b056-4f7d-88e9-5a381bf6fb7b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:39.028357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2536b-b056-4f7d-88e9-5a381bf6fb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:39.103768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c2a2536b-b056-4f7d-88e9-5a381bf6fb7b None None] MFA Rules not processed for user `a1f466e299cc43cc8174f655299583fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:39.105146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c2a2536b-b056-4f7d-88e9-5a381bf6fb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:39.123502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1492a426-b219-4bab-a32d-f4b0454adb6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9db556fbec9470482e9eae0f086f0c5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:39.135072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1492a426-b219-4bab-a32d-f4b0454adb6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9db556fbec9470482e9eae0f086f0c5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:39.167830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1492a426-b219-4bab-a32d-f4b0454adb6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9db556fbec9470482e9eae0f086f0c5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:39.182983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1492a426-b219-4bab-a32d-f4b0454adb6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9db556fbec9470482e9eae0f086f0c5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:39.205376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1492a426-b219-4bab-a32d-f4b0454adb6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9db556fbec9470482e9eae0f086f0c5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:39.227262 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2851/5728] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:37:38 2022] DELETE /identity/v3/users/f9db556fbec9470482e9eae0f086f0c5 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:39.229993 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df91c87-4703-43a6-9464-47ec5aceb733 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:39.230287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df91c87-4703-43a6-9464-47ec5aceb733 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:39.234865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df91c87-4703-43a6-9464-47ec5aceb733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:39.262673 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2df91c87-4703-43a6-9464-47ec5aceb733 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:39.264180 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2df91c87-4703-43a6-9464-47ec5aceb733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:39.295432 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2878/5729] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:37:39.307787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a2536b-b056-4f7d-88e9-5a381bf6fb7b None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:39.309482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c2a2536b-b056-4f7d-88e9-5a381bf6fb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:39.322458 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:39.334227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a2536b-b056-4f7d-88e9-5a381bf6fb7b None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:39.345977 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:39.370947 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2852/5730] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:39.371995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df91c87-4703-43a6-9464-47ec5aceb733 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:39.373460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2df91c87-4703-43a6-9464-47ec5aceb733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:39.430515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c59f7-e5fe-4323-ad85-558ae83c9c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:39.431510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c59f7-e5fe-4323-ad85-558ae83c9c67 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:39.432184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c59f7-e5fe-4323-ad85-558ae83c9c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:39.432997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c59f7-e5fe-4323-ad85-558ae83c9c67 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:39.434227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c59f7-e5fe-4323-ad85-558ae83c9c67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:39.438733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c59f7-e5fe-4323-ad85-558ae83c9c67 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:39.480023 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2879/5731] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:37:39 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:39.482729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c59f7-e5fe-4323-ad85-558ae83c9c67 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:39.487786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df91c87-4703-43a6-9464-47ec5aceb733 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:39.503091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c59f7-e5fe-4323-ad85-558ae83c9c67 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:39.510771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db7771-ba87-4c3d-9058-8d9546f87577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:39.511949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db7771-ba87-4c3d-9058-8d9546f87577 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:39.512305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db7771-ba87-4c3d-9058-8d9546f87577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:39.512504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db7771-ba87-4c3d-9058-8d9546f87577 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:39.513258 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db7771-ba87-4c3d-9058-8d9546f87577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:39.514904 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f21c5b-a919-4b99-b5d2-6e11c163793a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:39.515390 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db7771-ba87-4c3d-9058-8d9546f87577 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:39.516282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f21c5b-a919-4b99-b5d2-6e11c163793a service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:39.520568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f21c5b-a919-4b99-b5d2-6e11c163793a service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:39.521145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f21c5b-a919-4b99-b5d2-6e11c163793a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:39.527988 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2880/5732] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:37:39.533362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db7771-ba87-4c3d-9058-8d9546f87577 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:39.540921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f21c5b-a919-4b99-b5d2-6e11c163793a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:39.542627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f21c5b-a919-4b99-b5d2-6e11c163793a service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:39.563808 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2853/5733] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:37:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:37:39.568536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db7771-ba87-4c3d-9058-8d9546f87577 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:39.578943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29274784-3d8c-4c34-8fa3-80e9909015bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:39.579642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29274784-3d8c-4c34-8fa3-80e9909015bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:39.580006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29274784-3d8c-4c34-8fa3-80e9909015bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:39.580186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29274784-3d8c-4c34-8fa3-80e9909015bd admin admin] PATH_INFO: `/v3/system/users/80ae7190082147719c1b34470e6cde12/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:39.618333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29274784-3d8c-4c34-8fa3-80e9909015bd admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=80ae7190082147719c1b34470e6cde12, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:39.623273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29274784-3d8c-4c34-8fa3-80e9909015bd admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:39.639920 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2881/5734] 10.222.0.39 () {60 vars in 1378 bytes} [Sun Aug 7 01:37:39 2022] PUT /identity/v3/system/users/80ae7190082147719c1b34470e6cde12/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:39.651544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b98de5-fdd9-4945-93b1-48b325b0c4ac None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:39.652282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b98de5-fdd9-4945-93b1-48b325b0c4ac None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:39.652761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b98de5-fdd9-4945-93b1-48b325b0c4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:39.757128 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d7b98de5-fdd9-4945-93b1-48b325b0c4ac None None] MFA Rules not processed for user `80ae7190082147719c1b34470e6cde12`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:39.762241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d7b98de5-fdd9-4945-93b1-48b325b0c4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:40.000630 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2854/5735] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:39 2022] POST /identity/v3/auth/tokens => generated 2415 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 07 01:37:40.005338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29274784-3d8c-4c34-8fa3-80e9909015bd admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:40.272083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b98de5-fdd9-4945-93b1-48b325b0c4ac None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:40.273930 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d7b98de5-fdd9-4945-93b1-48b325b0c4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:40.287448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29274784-3d8c-4c34-8fa3-80e9909015bd admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:40.311663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b98de5-fdd9-4945-93b1-48b325b0c4ac None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:40.318177 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:40.321983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb089232-f42e-4763-924a-85470f494019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:40.322829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb089232-f42e-4763-924a-85470f494019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:40.323280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb089232-f42e-4763-924a-85470f494019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:40.323963 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb089232-f42e-4763-924a-85470f494019 admin admin] PATH_INFO: `/v3/projects/9b5ecb1896674cb585893a94d8ad96fe` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:40.325586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb089232-f42e-4763-924a-85470f494019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b5ecb1896674cb585893a94d8ad96fe)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:40.329258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb089232-f42e-4763-924a-85470f494019 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:40.379749 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e98f6-7228-4370-9783-34a14a028e44 None tempest-ImageQuotaTest-1835078691-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80ae7190082147719c1b34470e6cde12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:40.380423 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e98f6-7228-4370-9783-34a14a028e44 None tempest-ImageQuotaTest-1835078691-system-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:40.380706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e98f6-7228-4370-9783-34a14a028e44 None tempest-ImageQuotaTest-1835078691-system-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:40.381155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e98f6-7228-4370-9783-34a14a028e44 None tempest-ImageQuotaTest-1835078691-system-admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:40.383737 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e98f6-7228-4370-9783-34a14a028e44 None tempest-ImageQuotaTest-1835078691-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:40.388600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e98f6-7228-4370-9783-34a14a028e44 None tempest-ImageQuotaTest-1835078691-system-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:40.404000 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2882/5736] 10.222.0.39 () {58 vars in 1110 bytes} [Sun Aug 7 01:37:40 2022] GET /identity/v3/services => generated 2191 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:37:40.404539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-eb089232-f42e-4763-924a-85470f494019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b5ecb1896674cb585893a94d8ad96fe', 'request_id': 'req-eb089232-f42e-4763-924a-85470f494019'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:40.407270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e98f6-7228-4370-9783-34a14a028e44 None tempest-ImageQuotaTest-1835078691-system-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:40.423995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-eb089232-f42e-4763-924a-85470f494019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b5ecb1896674cb585893a94d8ad96fe', 'request_id': 'req-eb089232-f42e-4763-924a-85470f494019'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:40.434526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-eb089232-f42e-4763-924a-85470f494019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b5ecb1896674cb585893a94d8ad96fe', 'request_id': 'req-eb089232-f42e-4763-924a-85470f494019'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:40.445486 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:40.481027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-eb089232-f42e-4763-924a-85470f494019 admin admin] The token cache is being invalidate because project 9b5ecb1896674cb585893a94d8ad96fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:40.481254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-eb089232-f42e-4763-924a-85470f494019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:40.482139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-eb089232-f42e-4763-924a-85470f494019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:40.484039 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2855/5737] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:37:40 2022] DELETE /identity/v3/projects/9b5ecb1896674cb585893a94d8ad96fe => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:37:40.491253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb089232-f42e-4763-924a-85470f494019 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:40.492733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-eb089232-f42e-4763-924a-85470f494019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:40.632778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb089232-f42e-4763-924a-85470f494019 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:40.642713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0eee79-795a-4df4-856c-626ca2724c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:40.643517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0eee79-795a-4df4-856c-626ca2724c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:40.643796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0eee79-795a-4df4-856c-626ca2724c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:40.644149 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0eee79-795a-4df4-856c-626ca2724c8a admin admin] PATH_INFO: `/v3/users/4680a35ddd274e0faa163bac01d7543c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:40.646128 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0eee79-795a-4df4-856c-626ca2724c8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4680a35ddd274e0faa163bac01d7543c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:40.650271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0eee79-795a-4df4-856c-626ca2724c8a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:40.691086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e98f6-7228-4370-9783-34a14a028e44 None tempest-ImageQuotaTest-1835078691-system-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:40.757154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5e0eee79-795a-4df4-856c-626ca2724c8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4680a35ddd274e0faa163bac01d7543c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:40.779014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5e0eee79-795a-4df4-856c-626ca2724c8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4680a35ddd274e0faa163bac01d7543c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:40.795772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5e0eee79-795a-4df4-856c-626ca2724c8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4680a35ddd274e0faa163bac01d7543c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:40.797278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5e0eee79-795a-4df4-856c-626ca2724c8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4680a35ddd274e0faa163bac01d7543c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:40.825762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9e7c0-24d9-49cc-a799-2f561a067dbd None tempest-ImageQuotaTest-1835078691-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80ae7190082147719c1b34470e6cde12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:40.825762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9e7c0-24d9-49cc-a799-2f561a067dbd None tempest-ImageQuotaTest-1835078691-system-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:40.826190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5e0eee79-795a-4df4-856c-626ca2724c8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4680a35ddd274e0faa163bac01d7543c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:40.826302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9e7c0-24d9-49cc-a799-2f561a067dbd None tempest-ImageQuotaTest-1835078691-system-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:40.826302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9e7c0-24d9-49cc-a799-2f561a067dbd None tempest-ImageQuotaTest-1835078691-system-admin] PATH_INFO: `/v3/limits` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:40.826302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9e7c0-24d9-49cc-a799-2f561a067dbd None tempest-ImageQuotaTest-1835078691-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:40.826302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b9e7c0-24d9-49cc-a799-2f561a067dbd None tempest-ImageQuotaTest-1835078691-system-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:40.828877 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2856/5738] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:37:40 2022] DELETE /identity/v3/users/4680a35ddd274e0faa163bac01d7543c => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:40.903838 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-b9b9e7c0-24d9-49cc-a799-2f561a067dbd None tempest-ImageQuotaTest-1835078691-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Aug 07 01:37:40.903838 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:37:40.903838 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:37:40.903838 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:37:40.903838 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:37:40.903838 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:37:40.903838 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:37:40.903838 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:37:40.903838 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:37:40.903838 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:37:40.903838 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:37:40.903838 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:37:40.903838 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Aug 07 01:37:40.903838 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Aug 07 01:37:40.905225 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:37:40.905225 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:37:40.905225 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Aug 07 01:37:40.905225 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Aug 07 01:37:40.905225 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 07 01:37:40.905225 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 07 01:37:40.905225 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Aug 07 01:37:40.905225 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Aug 07 01:37:40.905225 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Aug 07 01:37:40.905225 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.NoLimitReference Aug 07 01:37:40.905225 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Aug 07 01:37:40.905225 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:37:40.911812 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2883/5739] 10.222.0.39 () {60 vars in 1126 bytes} [Sun Aug 7 01:37:40 2022] POST /identity/v3/limits => generated 124 bytes in 502 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:37:40.913884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0eee79-795a-4df4-856c-626ca2724c8a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:40.915337 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5e0eee79-795a-4df4-856c-626ca2724c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:41.147821 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:41.317524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0eee79-795a-4df4-856c-626ca2724c8a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:41.410767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d92b11-4be9-4161-b14d-4ca2b16b7567 None tempest-ImageQuotaTest-1835078691-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80ae7190082147719c1b34470e6cde12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:41.411708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d92b11-4be9-4161-b14d-4ca2b16b7567 None tempest-ImageQuotaTest-1835078691-system-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:41.412105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d92b11-4be9-4161-b14d-4ca2b16b7567 None tempest-ImageQuotaTest-1835078691-system-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:41.412275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d92b11-4be9-4161-b14d-4ca2b16b7567 None tempest-ImageQuotaTest-1835078691-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:41.412907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d92b11-4be9-4161-b14d-4ca2b16b7567 None tempest-ImageQuotaTest-1835078691-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:41.414017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d92b11-4be9-4161-b14d-4ca2b16b7567 None tempest-ImageQuotaTest-1835078691-system-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:41.434678 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2857/5740] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Aug 7 01:37:40 2022] GET /identity/v3/registered_limits => generated 129 bytes in 522 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:37:41.444020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9e7c0-24d9-49cc-a799-2f561a067dbd None tempest-ImageQuotaTest-1835078691-system-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:41.509439 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:41.674704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b9e7c0-24d9-49cc-a799-2f561a067dbd None tempest-ImageQuotaTest-1835078691-system-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:41.750578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a51e2-76b8-4dc9-a790-3a2d709ea04c None tempest-ImageQuotaTest-1835078691-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80ae7190082147719c1b34470e6cde12', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:41.751556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a51e2-76b8-4dc9-a790-3a2d709ea04c None tempest-ImageQuotaTest-1835078691-system-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:41.754434 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a51e2-76b8-4dc9-a790-3a2d709ea04c None tempest-ImageQuotaTest-1835078691-system-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:41.756780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a51e2-76b8-4dc9-a790-3a2d709ea04c None tempest-ImageQuotaTest-1835078691-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:41.756965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a51e2-76b8-4dc9-a790-3a2d709ea04c None tempest-ImageQuotaTest-1835078691-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:41.758294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a51e2-76b8-4dc9-a790-3a2d709ea04c None tempest-ImageQuotaTest-1835078691-system-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:41.771739 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2884/5741] 10.222.0.39 () {58 vars in 1137 bytes} [Sun Aug 7 01:37:41 2022] GET /identity/v3/registered_limits => generated 129 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:37:42.544421 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d92b11-4be9-4161-b14d-4ca2b16b7567 None tempest-ImageQuotaTest-1835078691-system-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:42.548189 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-58d92b11-4be9-4161-b14d-4ca2b16b7567 None tempest-ImageQuotaTest-1835078691-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:42.745001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d92b11-4be9-4161-b14d-4ca2b16b7567 None tempest-ImageQuotaTest-1835078691-system-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:42.758081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5686fd-80c1-4b23-8bb4-6425e10e9e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:42.759087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5686fd-80c1-4b23-8bb4-6425e10e9e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:42.759087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5686fd-80c1-4b23-8bb4-6425e10e9e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:42.759331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5686fd-80c1-4b23-8bb4-6425e10e9e0f admin admin] PATH_INFO: `/v3/projects/b3c7424200e7420a8940398de37aab87` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:42.764940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5686fd-80c1-4b23-8bb4-6425e10e9e0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3c7424200e7420a8940398de37aab87)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:42.766939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5686fd-80c1-4b23-8bb4-6425e10e9e0f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:42.927553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2b5686fd-80c1-4b23-8bb4-6425e10e9e0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3c7424200e7420a8940398de37aab87', 'request_id': 'req-2b5686fd-80c1-4b23-8bb4-6425e10e9e0f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:42.929161 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:42.948232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2b5686fd-80c1-4b23-8bb4-6425e10e9e0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3c7424200e7420a8940398de37aab87', 'request_id': 'req-2b5686fd-80c1-4b23-8bb4-6425e10e9e0f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:42.973659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2b5686fd-80c1-4b23-8bb4-6425e10e9e0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3c7424200e7420a8940398de37aab87', 'request_id': 'req-2b5686fd-80c1-4b23-8bb4-6425e10e9e0f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:42.999802 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2b5686fd-80c1-4b23-8bb4-6425e10e9e0f admin admin] The token cache is being invalidate because project b3c7424200e7420a8940398de37aab87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:43.000906 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2b5686fd-80c1-4b23-8bb4-6425e10e9e0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:43.004195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2b5686fd-80c1-4b23-8bb4-6425e10e9e0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:43.007868 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2858/5742] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:37:42 2022] DELETE /identity/v3/projects/b3c7424200e7420a8940398de37aab87 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:43.012824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350087c-88d8-4a47-ae4c-d0fee956619c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:43.014166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350087c-88d8-4a47-ae4c-d0fee956619c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:43.014665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350087c-88d8-4a47-ae4c-d0fee956619c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:43.054541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5350087c-88d8-4a47-ae4c-d0fee956619c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:43.057010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5350087c-88d8-4a47-ae4c-d0fee956619c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:43.214894 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2885/5743] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:43.224007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b27cee-dbe4-46ef-b4b7-d610c4913515 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:43.224007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b27cee-dbe4-46ef-b4b7-d610c4913515 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:43.224007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b27cee-dbe4-46ef-b4b7-d610c4913515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:43.267840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-79b27cee-dbe4-46ef-b4b7-d610c4913515 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:43.269911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-79b27cee-dbe4-46ef-b4b7-d610c4913515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:43.279423 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2859/5744] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:43.283502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350087c-88d8-4a47-ae4c-d0fee956619c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:43.296555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350087c-88d8-4a47-ae4c-d0fee956619c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:43.318067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d340b-c975-40a3-a385-b37541604ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:43.321816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d340b-c975-40a3-a385-b37541604ece admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:43.322464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d340b-c975-40a3-a385-b37541604ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:43.322844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d340b-c975-40a3-a385-b37541604ece admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:43.325058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d340b-c975-40a3-a385-b37541604ece admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:37:43.326098 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d340b-c975-40a3-a385-b37541604ece admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:43.340657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d340b-c975-40a3-a385-b37541604ece admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:43.413523 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2886/5745] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:37:43.418437 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b27cee-dbe4-46ef-b4b7-d610c4913515 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:43.457255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b27cee-dbe4-46ef-b4b7-d610c4913515 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:43.494805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188347ef-5d04-4513-9abd-c7a6f18fbf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:43.494805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188347ef-5d04-4513-9abd-c7a6f18fbf97 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:43.494805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188347ef-5d04-4513-9abd-c7a6f18fbf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:43.494805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188347ef-5d04-4513-9abd-c7a6f18fbf97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:43.505765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188347ef-5d04-4513-9abd-c7a6f18fbf97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:43.510688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188347ef-5d04-4513-9abd-c7a6f18fbf97 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:43.654007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d340b-c975-40a3-a385-b37541604ece admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:43.654973 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2860/5746] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:37:43 2022] POST /identity/v3/projects => generated 393 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:43.690351 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d340b-c975-40a3-a385-b37541604ece admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:43.858419 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:43.929471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605c3ac-b28f-41cf-92f6-7ed42a4ad85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:43.932890 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605c3ac-b28f-41cf-92f6-7ed42a4ad85d admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:43.933430 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605c3ac-b28f-41cf-92f6-7ed42a4ad85d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:43.934174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605c3ac-b28f-41cf-92f6-7ed42a4ad85d admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:43.934431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605c3ac-b28f-41cf-92f6-7ed42a4ad85d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:43.938746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605c3ac-b28f-41cf-92f6-7ed42a4ad85d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:44.004017 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2887/5747] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:37:43 2022] POST /identity/v3/users => generated 297 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:44.007105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188347ef-5d04-4513-9abd-c7a6f18fbf97 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:44.031581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188347ef-5d04-4513-9abd-c7a6f18fbf97 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:44.048172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbaa406-aedd-448f-a8e5-0b6049cd4b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:44.048904 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbaa406-aedd-448f-a8e5-0b6049cd4b17 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:44.049061 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbaa406-aedd-448f-a8e5-0b6049cd4b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:44.049333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbaa406-aedd-448f-a8e5-0b6049cd4b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:44.055509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbaa406-aedd-448f-a8e5-0b6049cd4b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:44.064998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbaa406-aedd-448f-a8e5-0b6049cd4b17 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:44.094430 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2861/5748] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:37:44.098880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605c3ac-b28f-41cf-92f6-7ed42a4ad85d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:44.118845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605c3ac-b28f-41cf-92f6-7ed42a4ad85d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:44.141448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ff8af-ab99-4675-af65-7b0bf50af8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:44.142297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ff8af-ab99-4675-af65-7b0bf50af8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:44.142754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ff8af-ab99-4675-af65-7b0bf50af8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:44.143192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ff8af-ab99-4675-af65-7b0bf50af8a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:44.144165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ff8af-ab99-4675-af65-7b0bf50af8a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:44.145991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ff8af-ab99-4675-af65-7b0bf50af8a1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:44.176430 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2888/5749] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:37:44.182009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbaa406-aedd-448f-a8e5-0b6049cd4b17 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:44.195933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbaa406-aedd-448f-a8e5-0b6049cd4b17 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:44.202726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfa986-81da-4742-bc39-943ce046a625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:44.203770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfa986-81da-4742-bc39-943ce046a625 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:44.204309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfa986-81da-4742-bc39-943ce046a625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:44.204794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfa986-81da-4742-bc39-943ce046a625 admin admin] PATH_INFO: `/v3/projects/2e47055544f94df587f8699c9dd0cc8e/users/539e060b697f4b9a927857489c9df61e/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:44.235257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdfa986-81da-4742-bc39-943ce046a625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e47055544f94df587f8699c9dd0cc8e, user_id=539e060b697f4b9a927857489c9df61e, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:44.238077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdfa986-81da-4742-bc39-943ce046a625 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:44.279071 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2862/5750] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:37:44 2022] PUT /identity/v3/projects/2e47055544f94df587f8699c9dd0cc8e/users/539e060b697f4b9a927857489c9df61e/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:44.280926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221f7f6-73a5-45b3-96fd-7f612ff21ea3 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:44.282189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221f7f6-73a5-45b3-96fd-7f612ff21ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:44.282716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221f7f6-73a5-45b3-96fd-7f612ff21ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:44.352925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e221f7f6-73a5-45b3-96fd-7f612ff21ea3 None None] MFA Rules not processed for user `539e060b697f4b9a927857489c9df61e`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:44.363953 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e221f7f6-73a5-45b3-96fd-7f612ff21ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:44.674244 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2889/5751] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:44.679295 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfa986-81da-4742-bc39-943ce046a625 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:44.710524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfa986-81da-4742-bc39-943ce046a625 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:44.752924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236282ac-4fb6-4d26-b52b-5d7da54d313d tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '539e060b697f4b9a927857489c9df61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e47055544f94df587f8699c9dd0cc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:44.753606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236282ac-4fb6-4d26-b52b-5d7da54d313d tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:44.753887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236282ac-4fb6-4d26-b52b-5d7da54d313d tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:44.754162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236282ac-4fb6-4d26-b52b-5d7da54d313d tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] PATH_INFO: `/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:44.754837 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236282ac-4fb6-4d26-b52b-5d7da54d313d tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorizing `identity:create_application_credential(user_id=539e060b697f4b9a927857489c9df61e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:44.756186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236282ac-4fb6-4d26-b52b-5d7da54d313d tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:44.938512 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2863/5752] 10.222.0.39 () {60 vars in 1314 bytes} [Sun Aug 7 01:37:44 2022] POST /identity/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials => generated 789 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:44.942329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221f7f6-73a5-45b3-96fd-7f612ff21ea3 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:44.959303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221f7f6-73a5-45b3-96fd-7f612ff21ea3 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:45.035224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059ff0f-5a93-40a2-bca1-3189beea391b tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '539e060b697f4b9a927857489c9df61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e47055544f94df587f8699c9dd0cc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:45.035971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059ff0f-5a93-40a2-bca1-3189beea391b tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:45.036268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059ff0f-5a93-40a2-bca1-3189beea391b tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:45.036549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059ff0f-5a93-40a2-bca1-3189beea391b tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] PATH_INFO: `/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials/e34789856dd0426793e059914b1a5058` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:45.071194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059ff0f-5a93-40a2-bca1-3189beea391b tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorizing `identity:get_application_credential(user_id=539e060b697f4b9a927857489c9df61e, application_credential_id=e34789856dd0426793e059914b1a5058)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:45.072940 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059ff0f-5a93-40a2-bca1-3189beea391b tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:45.080875 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2890/5753] 10.222.0.39 () {58 vars in 1392 bytes} [Sun Aug 7 01:37:44 2022] GET /identity/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials/e34789856dd0426793e059914b1a5058 => generated 689 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:37:45.081173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5b30f-d259-4364-919f-3c285e6cb52b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:45.081706 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5b30f-d259-4364-919f-3c285e6cb52b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:45.081915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5b30f-d259-4364-919f-3c285e6cb52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:45.133877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-dbd5b30f-d259-4364-919f-3c285e6cb52b None None] MFA Rules not processed for user `539e060b697f4b9a927857489c9df61e`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:45.135769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-dbd5b30f-d259-4364-919f-3c285e6cb52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:45.316089 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:45.425438 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2864/5754] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:45 2022] POST /identity/v3/auth/tokens => generated 3427 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Aug 07 01:37:45.431421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059ff0f-5a93-40a2-bca1-3189beea391b tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:45.449488 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059ff0f-5a93-40a2-bca1-3189beea391b tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:45.461171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6659119-3bec-49e7-bd57-e41492611e90 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '539e060b697f4b9a927857489c9df61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e47055544f94df587f8699c9dd0cc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:45.462015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6659119-3bec-49e7-bd57-e41492611e90 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:45.462299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6659119-3bec-49e7-bd57-e41492611e90 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:45.464244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6659119-3bec-49e7-bd57-e41492611e90 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] PATH_INFO: `/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials/e34789856dd0426793e059914b1a5058` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:45.467141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6659119-3bec-49e7-bd57-e41492611e90 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorizing `identity:delete_application_credential(user_id=539e060b697f4b9a927857489c9df61e, application_credential_id=e34789856dd0426793e059914b1a5058)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:45.471454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6659119-3bec-49e7-bd57-e41492611e90 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:45.512812 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2891/5755] 10.222.0.39 () {58 vars in 1395 bytes} [Sun Aug 7 01:37:45 2022] DELETE /identity/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials/e34789856dd0426793e059914b1a5058 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:45.519223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5b30f-d259-4364-919f-3c285e6cb52b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:45.536735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5b30f-d259-4364-919f-3c285e6cb52b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:45.547831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9b7d6-501d-46e4-994c-a344bc7c4eee tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '539e060b697f4b9a927857489c9df61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e47055544f94df587f8699c9dd0cc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:45.548901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9b7d6-501d-46e4-994c-a344bc7c4eee tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:45.549876 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9b7d6-501d-46e4-994c-a344bc7c4eee tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:45.550433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9b7d6-501d-46e4-994c-a344bc7c4eee tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] PATH_INFO: `/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:45.552445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9b7d6-501d-46e4-994c-a344bc7c4eee tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorizing `identity:create_application_credential(user_id=539e060b697f4b9a927857489c9df61e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:45.554057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9b7d6-501d-46e4-994c-a344bc7c4eee tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:45.746974 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6659119-3bec-49e7-bd57-e41492611e90 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:45.758621 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2865/5756] 10.222.0.39 () {60 vars in 1315 bytes} [Sun Aug 7 01:37:45 2022] POST /identity/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials => generated 920 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:45.783738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6659119-3bec-49e7-bd57-e41492611e90 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:45.798830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90ca63-0920-4297-af8f-9edd95882d79 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '539e060b697f4b9a927857489c9df61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e47055544f94df587f8699c9dd0cc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:45.799433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90ca63-0920-4297-af8f-9edd95882d79 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:45.799661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90ca63-0920-4297-af8f-9edd95882d79 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:45.799937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90ca63-0920-4297-af8f-9edd95882d79 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] PATH_INFO: `/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials/9a8e8b7ce4ba42c2a361137f556da997` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:45.821841 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90ca63-0920-4297-af8f-9edd95882d79 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorizing `identity:delete_application_credential(user_id=539e060b697f4b9a927857489c9df61e, application_credential_id=9a8e8b7ce4ba42c2a361137f556da997)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:45.824367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90ca63-0920-4297-af8f-9edd95882d79 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:45.908993 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2892/5757] 10.222.0.39 () {58 vars in 1395 bytes} [Sun Aug 7 01:37:45 2022] DELETE /identity/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials/9a8e8b7ce4ba42c2a361137f556da997 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:45.910244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9b7d6-501d-46e4-994c-a344bc7c4eee tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:45.930447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9b7d6-501d-46e4-994c-a344bc7c4eee tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:45.951505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59b974-3f26-4795-874f-717384758a51 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '539e060b697f4b9a927857489c9df61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e47055544f94df587f8699c9dd0cc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:45.952717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59b974-3f26-4795-874f-717384758a51 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:45.953646 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59b974-3f26-4795-874f-717384758a51 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:45.954057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59b974-3f26-4795-874f-717384758a51 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] PATH_INFO: `/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:45.954766 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e59b974-3f26-4795-874f-717384758a51 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorizing `identity:create_application_credential(user_id=539e060b697f4b9a927857489c9df61e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:45.956878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e59b974-3f26-4795-874f-717384758a51 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:46.176114 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2866/5758] 10.222.0.39 () {60 vars in 1315 bytes} [Sun Aug 7 01:37:45 2022] POST /identity/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials => generated 813 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:46.176845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90ca63-0920-4297-af8f-9edd95882d79 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:46.192530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90ca63-0920-4297-af8f-9edd95882d79 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:46.201054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9aafe-ccf4-4075-bc6d-f8952a4c48ee tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '539e060b697f4b9a927857489c9df61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e47055544f94df587f8699c9dd0cc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:46.201739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9aafe-ccf4-4075-bc6d-f8952a4c48ee tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:46.202019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9aafe-ccf4-4075-bc6d-f8952a4c48ee tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:46.202295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9aafe-ccf4-4075-bc6d-f8952a4c48ee tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] PATH_INFO: `/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials/3a4ee2d01c9b4ad48d5657e2766b5c9c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:46.233633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9aafe-ccf4-4075-bc6d-f8952a4c48ee tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorizing `identity:delete_application_credential(user_id=539e060b697f4b9a927857489c9df61e, application_credential_id=3a4ee2d01c9b4ad48d5657e2766b5c9c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:46.235801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9aafe-ccf4-4075-bc6d-f8952a4c48ee tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:46.267878 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:46.274132 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2893/5759] 10.222.0.39 () {58 vars in 1395 bytes} [Sun Aug 7 01:37:46 2022] DELETE /identity/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials/3a4ee2d01c9b4ad48d5657e2766b5c9c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:46.279016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59b974-3f26-4795-874f-717384758a51 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:46.292332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59b974-3f26-4795-874f-717384758a51 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:46.307304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3976b0f-cead-4ce1-b51d-e26cad18cc58 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '539e060b697f4b9a927857489c9df61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e47055544f94df587f8699c9dd0cc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:46.308107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3976b0f-cead-4ce1-b51d-e26cad18cc58 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:46.308386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3976b0f-cead-4ce1-b51d-e26cad18cc58 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:46.308875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3976b0f-cead-4ce1-b51d-e26cad18cc58 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] PATH_INFO: `/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:46.309734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3976b0f-cead-4ce1-b51d-e26cad18cc58 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorizing `identity:create_application_credential(user_id=539e060b697f4b9a927857489c9df61e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:46.311251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3976b0f-cead-4ce1-b51d-e26cad18cc58 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:46.426897 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:46.484829 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2867/5760] 10.222.0.39 () {60 vars in 1314 bytes} [Sun Aug 7 01:37:46 2022] POST /identity/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials => generated 788 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:37:46.485681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9aafe-ccf4-4075-bc6d-f8952a4c48ee tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:46.498231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9aafe-ccf4-4075-bc6d-f8952a4c48ee tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:46.514436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbed447-ffff-49fd-b0b7-033f203c54e9 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '539e060b697f4b9a927857489c9df61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e47055544f94df587f8699c9dd0cc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:46.515102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbed447-ffff-49fd-b0b7-033f203c54e9 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:46.515943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbed447-ffff-49fd-b0b7-033f203c54e9 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:46.516475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbed447-ffff-49fd-b0b7-033f203c54e9 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] PATH_INFO: `/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:46.517325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbed447-ffff-49fd-b0b7-033f203c54e9 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorizing `identity:create_application_credential(user_id=539e060b697f4b9a927857489c9df61e)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:46.518749 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbed447-ffff-49fd-b0b7-033f203c54e9 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:46.664255 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2894/5761] 10.222.0.39 () {60 vars in 1314 bytes} [Sun Aug 7 01:37:46 2022] POST /identity/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials => generated 789 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:46.668051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3976b0f-cead-4ce1-b51d-e26cad18cc58 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:46.681472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3976b0f-cead-4ce1-b51d-e26cad18cc58 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:46.709486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6888c2-6164-43eb-91cb-68de6c88b015 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '539e060b697f4b9a927857489c9df61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e47055544f94df587f8699c9dd0cc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:46.710584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6888c2-6164-43eb-91cb-68de6c88b015 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:46.710981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6888c2-6164-43eb-91cb-68de6c88b015 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:46.711263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6888c2-6164-43eb-91cb-68de6c88b015 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] PATH_INFO: `/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:46.711988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6888c2-6164-43eb-91cb-68de6c88b015 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorizing `identity:list_application_credentials(user_id=539e060b697f4b9a927857489c9df61e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:46.713669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6888c2-6164-43eb-91cb-68de6c88b015 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:46.746746 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2868/5762] 10.222.0.39 () {58 vars in 1293 bytes} [Sun Aug 7 01:37:46 2022] GET /identity/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials => generated 1501 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:37:46.748541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbed447-ffff-49fd-b0b7-033f203c54e9 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:46.768240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbed447-ffff-49fd-b0b7-033f203c54e9 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:46.773216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ffeec4-5c6f-4d3e-a9f7-9aad2f9356cf tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '539e060b697f4b9a927857489c9df61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e47055544f94df587f8699c9dd0cc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:46.773908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffeec4-5c6f-4d3e-a9f7-9aad2f9356cf tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:46.774192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffeec4-5c6f-4d3e-a9f7-9aad2f9356cf tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:46.774470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffeec4-5c6f-4d3e-a9f7-9aad2f9356cf tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] PATH_INFO: `/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials/3a4e2cb5948a483db2fc5bac61ca4e7e` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:46.787442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ffeec4-5c6f-4d3e-a9f7-9aad2f9356cf tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorizing `identity:delete_application_credential(user_id=539e060b697f4b9a927857489c9df61e, application_credential_id=3a4e2cb5948a483db2fc5bac61ca4e7e)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:46.789126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ffeec4-5c6f-4d3e-a9f7-9aad2f9356cf tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:46.814417 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2895/5763] 10.222.0.39 () {58 vars in 1395 bytes} [Sun Aug 7 01:37:46 2022] DELETE /identity/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials/3a4e2cb5948a483db2fc5bac61ca4e7e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:37:46.820677 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6888c2-6164-43eb-91cb-68de6c88b015 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:46.838881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6888c2-6164-43eb-91cb-68de6c88b015 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:46.846756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd08b4-a589-4937-95d1-51c91deeb871 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '539e060b697f4b9a927857489c9df61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e47055544f94df587f8699c9dd0cc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:46.849523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd08b4-a589-4937-95d1-51c91deeb871 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:46.849803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd08b4-a589-4937-95d1-51c91deeb871 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:46.850089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd08b4-a589-4937-95d1-51c91deeb871 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] PATH_INFO: `/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials/091e59845be34d8e880f1e99cb727ad0` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:46.866458 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcd08b4-a589-4937-95d1-51c91deeb871 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorizing `identity:delete_application_credential(user_id=539e060b697f4b9a927857489c9df61e, application_credential_id=091e59845be34d8e880f1e99cb727ad0)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:46.877277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcd08b4-a589-4937-95d1-51c91deeb871 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:46.941752 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2869/5764] 10.222.0.39 () {58 vars in 1395 bytes} [Sun Aug 7 01:37:46 2022] DELETE /identity/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials/091e59845be34d8e880f1e99cb727ad0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:46.949054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ffeec4-5c6f-4d3e-a9f7-9aad2f9356cf tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:46.979925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ffeec4-5c6f-4d3e-a9f7-9aad2f9356cf tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:47.005208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582aa7b-909c-4a4e-b8f7-36883fcc3fd3 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '539e060b697f4b9a927857489c9df61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e47055544f94df587f8699c9dd0cc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:47.006216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582aa7b-909c-4a4e-b8f7-36883fcc3fd3 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:47.006670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582aa7b-909c-4a4e-b8f7-36883fcc3fd3 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:47.007752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582aa7b-909c-4a4e-b8f7-36883fcc3fd3 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] PATH_INFO: `/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:47.008830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582aa7b-909c-4a4e-b8f7-36883fcc3fd3 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorizing `identity:create_application_credential(user_id=539e060b697f4b9a927857489c9df61e)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:47.012337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582aa7b-909c-4a4e-b8f7-36883fcc3fd3 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:47.126837 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2896/5765] 10.222.0.39 () {60 vars in 1314 bytes} [Sun Aug 7 01:37:46 2022] POST /identity/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials => generated 788 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:47.130719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd08b4-a589-4937-95d1-51c91deeb871 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:47.142070 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd08b4-a589-4937-95d1-51c91deeb871 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:47.160851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e4529-208e-45c7-8809-65e80ade89ed tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '539e060b697f4b9a927857489c9df61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e47055544f94df587f8699c9dd0cc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:47.161671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e4529-208e-45c7-8809-65e80ade89ed tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:47.162057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e4529-208e-45c7-8809-65e80ade89ed tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:47.162432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e4529-208e-45c7-8809-65e80ade89ed tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] PATH_INFO: `/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:47.163194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e4529-208e-45c7-8809-65e80ade89ed tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorizing `identity:create_application_credential(user_id=539e060b697f4b9a927857489c9df61e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:47.164496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e4529-208e-45c7-8809-65e80ade89ed tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:47.303107 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2870/5766] 10.222.0.39 () {60 vars in 1314 bytes} [Sun Aug 7 01:37:47 2022] POST /identity/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials => generated 788 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:47.307110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582aa7b-909c-4a4e-b8f7-36883fcc3fd3 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:47.347417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582aa7b-909c-4a4e-b8f7-36883fcc3fd3 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:47.354475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c71f78-5e0c-49b9-b682-daab3f97d138 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '539e060b697f4b9a927857489c9df61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e47055544f94df587f8699c9dd0cc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:47.355111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c71f78-5e0c-49b9-b682-daab3f97d138 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:47.355444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c71f78-5e0c-49b9-b682-daab3f97d138 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:47.355748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c71f78-5e0c-49b9-b682-daab3f97d138 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] PATH_INFO: `/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:47.356426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c71f78-5e0c-49b9-b682-daab3f97d138 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Adding query filter params (name=tempest-application_credential-176211798) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:37:47.357300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c71f78-5e0c-49b9-b682-daab3f97d138 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorizing `identity:list_application_credentials(user_id=539e060b697f4b9a927857489c9df61e)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:47.359119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c71f78-5e0c-49b9-b682-daab3f97d138 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:47.384181 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2897/5767] 10.222.0.39 () {58 vars in 1384 bytes} [Sun Aug 7 01:37:47 2022] GET /identity/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials?name=tempest-application_credential-176211798 => generated 885 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:37:47.384930 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e4529-208e-45c7-8809-65e80ade89ed tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:47.402619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e4529-208e-45c7-8809-65e80ade89ed tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:47.409399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9829d-44e5-4a11-9912-932ee0e74157 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '539e060b697f4b9a927857489c9df61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e47055544f94df587f8699c9dd0cc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:47.410377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9829d-44e5-4a11-9912-932ee0e74157 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:47.411446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9829d-44e5-4a11-9912-932ee0e74157 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:47.411446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9829d-44e5-4a11-9912-932ee0e74157 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] PATH_INFO: `/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials/0c03812b6f4544019a4a3fadc5040e53` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:47.422540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9829d-44e5-4a11-9912-932ee0e74157 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorizing `identity:delete_application_credential(user_id=539e060b697f4b9a927857489c9df61e, application_credential_id=0c03812b6f4544019a4a3fadc5040e53)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:47.424360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9829d-44e5-4a11-9912-932ee0e74157 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:47.456163 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2871/5768] 10.222.0.39 () {58 vars in 1395 bytes} [Sun Aug 7 01:37:47 2022] DELETE /identity/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials/0c03812b6f4544019a4a3fadc5040e53 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:47.460134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c71f78-5e0c-49b9-b682-daab3f97d138 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:47.472310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c71f78-5e0c-49b9-b682-daab3f97d138 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:47.477526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66f0e9-2d2f-4e7f-98c4-4c5b8ad2342c tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '539e060b697f4b9a927857489c9df61e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e47055544f94df587f8699c9dd0cc8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:47.478531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66f0e9-2d2f-4e7f-98c4-4c5b8ad2342c tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:47.478910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66f0e9-2d2f-4e7f-98c4-4c5b8ad2342c tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:47.479328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66f0e9-2d2f-4e7f-98c4-4c5b8ad2342c tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] PATH_INFO: `/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials/72aa4498a9ba4063881f6ee61977661d` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:47.493867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66f0e9-2d2f-4e7f-98c4-4c5b8ad2342c tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorizing `identity:delete_application_credential(user_id=539e060b697f4b9a927857489c9df61e, application_credential_id=72aa4498a9ba4063881f6ee61977661d)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:47.497804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66f0e9-2d2f-4e7f-98c4-4c5b8ad2342c tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:47.530154 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2898/5769] 10.222.0.39 () {58 vars in 1395 bytes} [Sun Aug 7 01:37:47 2022] DELETE /identity/v3/users/539e060b697f4b9a927857489c9df61e/application_credentials/72aa4498a9ba4063881f6ee61977661d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:37:47.535658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9829d-44e5-4a11-9912-932ee0e74157 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:47.683497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9829d-44e5-4a11-9912-932ee0e74157 tempest-ApplicationCredentialsV3Test-2088336673 tempest-ApplicationCredentialsV3Test-2088336673-project] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:47.697166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fc55b-f319-44e0-8d2d-8924e67efd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:47.697916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fc55b-f319-44e0-8d2d-8924e67efd23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:47.698284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fc55b-f319-44e0-8d2d-8924e67efd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:47.698817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fc55b-f319-44e0-8d2d-8924e67efd23 admin admin] PATH_INFO: `/v3/users/539e060b697f4b9a927857489c9df61e` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:47.704190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fc55b-f319-44e0-8d2d-8924e67efd23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=539e060b697f4b9a927857489c9df61e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:47.707299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fc55b-f319-44e0-8d2d-8924e67efd23 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:47.716931 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:47.817109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bf0fc55b-f319-44e0-8d2d-8924e67efd23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '539e060b697f4b9a927857489c9df61e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:47.825587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bf0fc55b-f319-44e0-8d2d-8924e67efd23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '539e060b697f4b9a927857489c9df61e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:47.854881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bf0fc55b-f319-44e0-8d2d-8924e67efd23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '539e060b697f4b9a927857489c9df61e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:47.856161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bf0fc55b-f319-44e0-8d2d-8924e67efd23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '539e060b697f4b9a927857489c9df61e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:47.892391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bf0fc55b-f319-44e0-8d2d-8924e67efd23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '539e060b697f4b9a927857489c9df61e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:47.908638 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2872/5770] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:37:47 2022] DELETE /identity/v3/users/539e060b697f4b9a927857489c9df61e => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:47.913462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2dd95-9460-4064-8486-0133b5df5394 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:47.914157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2dd95-9460-4064-8486-0133b5df5394 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:47.914862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2dd95-9460-4064-8486-0133b5df5394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:47.943083 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a7a2dd95-9460-4064-8486-0133b5df5394 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:47.945009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a7a2dd95-9460-4064-8486-0133b5df5394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:47.961685 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:48.089976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33987252-348d-49e9-908b-5c0605ea8070 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:48.091099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33987252-348d-49e9-908b-5c0605ea8070 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:48.091832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33987252-348d-49e9-908b-5c0605ea8070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:48.096001 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2899/5771] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:48.128504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-33987252-348d-49e9-908b-5c0605ea8070 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:48.129781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-33987252-348d-49e9-908b-5c0605ea8070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:48.196693 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2dd95-9460-4064-8486-0133b5df5394 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:48.199352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a7a2dd95-9460-4064-8486-0133b5df5394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:48.204208 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2873/5772] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:37:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:48.266521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33987252-348d-49e9-908b-5c0605ea8070 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:48.269155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-33987252-348d-49e9-908b-5c0605ea8070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:48.285342 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2dd95-9460-4064-8486-0133b5df5394 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:48.295351 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24919f69-a9f4-476b-857b-47a2e05ea3c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:48.296530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24919f69-a9f4-476b-857b-47a2e05ea3c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:48.297163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24919f69-a9f4-476b-857b-47a2e05ea3c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:48.297902 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24919f69-a9f4-476b-857b-47a2e05ea3c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:48.309655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24919f69-a9f4-476b-857b-47a2e05ea3c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:48.312043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24919f69-a9f4-476b-857b-47a2e05ea3c1 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:48.324615 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2900/5773] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:37:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:37:48.362697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33987252-348d-49e9-908b-5c0605ea8070 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:48.371223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e4061-0f6e-4386-a1d0-6f0eb5dd6ee9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:48.372210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e4061-0f6e-4386-a1d0-6f0eb5dd6ee9 service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:48.372489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e4061-0f6e-4386-a1d0-6f0eb5dd6ee9 service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:48.372769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e4061-0f6e-4386-a1d0-6f0eb5dd6ee9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:48.384615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e4061-0f6e-4386-a1d0-6f0eb5dd6ee9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:48.386242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e4061-0f6e-4386-a1d0-6f0eb5dd6ee9 service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:48.398232 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2874/5774] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:37:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 07 01:37:49.510216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24919f69-a9f4-476b-857b-47a2e05ea3c1 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:49.511780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-24919f69-a9f4-476b-857b-47a2e05ea3c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:49.540829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24919f69-a9f4-476b-857b-47a2e05ea3c1 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:49.554177 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711d22a-eff5-4472-8aaf-24c695cd89c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:49.555204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711d22a-eff5-4472-8aaf-24c695cd89c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:49.556139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711d22a-eff5-4472-8aaf-24c695cd89c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:49.556518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711d22a-eff5-4472-8aaf-24c695cd89c0 admin admin] PATH_INFO: `/v3/projects/2e47055544f94df587f8699c9dd0cc8e` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:49.563094 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711d22a-eff5-4472-8aaf-24c695cd89c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e47055544f94df587f8699c9dd0cc8e)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:49.574033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711d22a-eff5-4472-8aaf-24c695cd89c0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:49.633906 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e4061-0f6e-4386-a1d0-6f0eb5dd6ee9 service swift] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:49.635395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-919e4061-0f6e-4386-a1d0-6f0eb5dd6ee9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:49.697112 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e4061-0f6e-4386-a1d0-6f0eb5dd6ee9 service swift] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:49.711282 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a711d22a-eff5-4472-8aaf-24c695cd89c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e47055544f94df587f8699c9dd0cc8e', 'request_id': 'req-a711d22a-eff5-4472-8aaf-24c695cd89c0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:49.720564 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:49.722489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a711d22a-eff5-4472-8aaf-24c695cd89c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e47055544f94df587f8699c9dd0cc8e', 'request_id': 'req-a711d22a-eff5-4472-8aaf-24c695cd89c0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:49.733702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a711d22a-eff5-4472-8aaf-24c695cd89c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e47055544f94df587f8699c9dd0cc8e', 'request_id': 'req-a711d22a-eff5-4472-8aaf-24c695cd89c0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:49.760922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a711d22a-eff5-4472-8aaf-24c695cd89c0 admin admin] The token cache is being invalidate because project 2e47055544f94df587f8699c9dd0cc8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:49.761221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a711d22a-eff5-4472-8aaf-24c695cd89c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:49.764205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a711d22a-eff5-4472-8aaf-24c695cd89c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:49.774121 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2901/5775] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:37:49 2022] DELETE /identity/v3/projects/2e47055544f94df587f8699c9dd0cc8e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:49.779562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa1fbf-bda9-4531-97ff-54db5a3ab4f7 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:49.779856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa1fbf-bda9-4531-97ff-54db5a3ab4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:49.780285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa1fbf-bda9-4531-97ff-54db5a3ab4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:49.817808 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-93aa1fbf-bda9-4531-97ff-54db5a3ab4f7 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:49.819067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-93aa1fbf-bda9-4531-97ff-54db5a3ab4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:49.895077 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:49.943359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8050e04-57a6-4843-a5fb-57907321f398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:49.945148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8050e04-57a6-4843-a5fb-57907321f398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:49.945463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8050e04-57a6-4843-a5fb-57907321f398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:49.946827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8050e04-57a6-4843-a5fb-57907321f398 admin admin] PATH_INFO: `/v3/users/336f46c026384c6db85f0afc93b83fd1` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:49.949863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8050e04-57a6-4843-a5fb-57907321f398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=336f46c026384c6db85f0afc93b83fd1)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:49.953656 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8050e04-57a6-4843-a5fb-57907321f398 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:49.968712 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2902/5776] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:49.971812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83d9a0-e8e8-4b7e-900c-4053ff8e24df None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:49.975009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83d9a0-e8e8-4b7e-900c-4053ff8e24df None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:49.975369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83d9a0-e8e8-4b7e-900c-4053ff8e24df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:50.037809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2f83d9a0-e8e8-4b7e-900c-4053ff8e24df None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:50.039382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2f83d9a0-e8e8-4b7e-900c-4053ff8e24df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:50.061010 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2903/5777] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:50.065991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83d9a0-e8e8-4b7e-900c-4053ff8e24df None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:50.106198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83d9a0-e8e8-4b7e-900c-4053ff8e24df None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:50.112433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c8050e04-57a6-4843-a5fb-57907321f398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '336f46c026384c6db85f0afc93b83fd1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:50.124925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c8050e04-57a6-4843-a5fb-57907321f398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '336f46c026384c6db85f0afc93b83fd1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:50.126779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30173530-fa48-4606-a3c9-ff66920f526a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:50.130279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30173530-fa48-4606-a3c9-ff66920f526a admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:50.130671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30173530-fa48-4606-a3c9-ff66920f526a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:50.131019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30173530-fa48-4606-a3c9-ff66920f526a admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:50.137730 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30173530-fa48-4606-a3c9-ff66920f526a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:37:50.140190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30173530-fa48-4606-a3c9-ff66920f526a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:50.142198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30173530-fa48-4606-a3c9-ff66920f526a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:50.142600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c8050e04-57a6-4843-a5fb-57907321f398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '336f46c026384c6db85f0afc93b83fd1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:50.143466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c8050e04-57a6-4843-a5fb-57907321f398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '336f46c026384c6db85f0afc93b83fd1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:50.179692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c8050e04-57a6-4843-a5fb-57907321f398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '336f46c026384c6db85f0afc93b83fd1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:50.190729 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2875/5778] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:37:49 2022] DELETE /identity/v3/users/336f46c026384c6db85f0afc93b83fd1 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:50.205861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f089f-b340-4d5f-9c06-3aa534425b32 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:50.206409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f089f-b340-4d5f-9c06-3aa534425b32 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:50.206789 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f089f-b340-4d5f-9c06-3aa534425b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:50.213107 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2904/5779] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:37:50.214374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30173530-fa48-4606-a3c9-ff66920f526a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:50.224474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-30173530-fa48-4606-a3c9-ff66920f526a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:50.240038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30173530-fa48-4606-a3c9-ff66920f526a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:50.246445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-484f089f-b340-4d5f-9c06-3aa534425b32 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:50.252771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-484f089f-b340-4d5f-9c06-3aa534425b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:50.460670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84dc10d-b16a-455f-a3b9-70299120c73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:50.461295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dc10d-b16a-455f-a3b9-70299120c73d admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:50.461574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dc10d-b16a-455f-a3b9-70299120c73d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:50.461842 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dc10d-b16a-455f-a3b9-70299120c73d admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:50.462476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84dc10d-b16a-455f-a3b9-70299120c73d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:50.464446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84dc10d-b16a-455f-a3b9-70299120c73d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:50.532755 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2905/5780] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:37:50 2022] POST /identity/v3/projects => generated 395 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:50.534191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84dc10d-b16a-455f-a3b9-70299120c73d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:50.568930 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2876/5781] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:50.605300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f089f-b340-4d5f-9c06-3aa534425b32 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:50.606994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-484f089f-b340-4d5f-9c06-3aa534425b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:50.682837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84dc10d-b16a-455f-a3b9-70299120c73d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:50.700365 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9601d0-6b93-43f3-842a-c6a8462fa337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:50.701078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9601d0-6b93-43f3-842a-c6a8462fa337 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:50.701483 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9601d0-6b93-43f3-842a-c6a8462fa337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:50.701758 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9601d0-6b93-43f3-842a-c6a8462fa337 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:50.702399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9601d0-6b93-43f3-842a-c6a8462fa337 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:50.705024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9601d0-6b93-43f3-842a-c6a8462fa337 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:50.706092 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:50.770096 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2906/5782] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:37:50 2022] POST /identity/v3/users => generated 304 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:50.771050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9601d0-6b93-43f3-842a-c6a8462fa337 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:50.800054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f089f-b340-4d5f-9c06-3aa534425b32 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:50.806019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9601d0-6b93-43f3-842a-c6a8462fa337 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:50.825821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874aeac-8c6a-44bb-91b0-698a02dac912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:50.826456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874aeac-8c6a-44bb-91b0-698a02dac912 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:50.826734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874aeac-8c6a-44bb-91b0-698a02dac912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:50.827005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874aeac-8c6a-44bb-91b0-698a02dac912 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:50.827768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874aeac-8c6a-44bb-91b0-698a02dac912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:50.829454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874aeac-8c6a-44bb-91b0-698a02dac912 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:50.862785 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2907/5783] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:37:50.867011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874aeac-8c6a-44bb-91b0-698a02dac912 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:50.881653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874aeac-8c6a-44bb-91b0-698a02dac912 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:50.894254 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201fca2-febf-4df6-a3ed-61c66c1e0154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:50.894742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201fca2-febf-4df6-a3ed-61c66c1e0154 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:50.895020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201fca2-febf-4df6-a3ed-61c66c1e0154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:50.895437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201fca2-febf-4df6-a3ed-61c66c1e0154 admin admin] PATH_INFO: `/v3/projects/1a558dcff4bb40469bb19bcfe0dbb7cb/users/01f7246ffe8a4dea9d13a7ddc6c9689c/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:50.945610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201fca2-febf-4df6-a3ed-61c66c1e0154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a558dcff4bb40469bb19bcfe0dbb7cb, user_id=01f7246ffe8a4dea9d13a7ddc6c9689c, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:50.949206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201fca2-febf-4df6-a3ed-61c66c1e0154 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:50.957520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a98f92-8b9d-4af4-8569-a25f02d3ddec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:50.962857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a98f92-8b9d-4af4-8569-a25f02d3ddec service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:50.963144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a98f92-8b9d-4af4-8569-a25f02d3ddec service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:50.963422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a98f92-8b9d-4af4-8569-a25f02d3ddec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:50.997754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a98f92-8b9d-4af4-8569-a25f02d3ddec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:51.002561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a98f92-8b9d-4af4-8569-a25f02d3ddec service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:51.015828 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2908/5784] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:37:50 2022] PUT /identity/v3/projects/1a558dcff4bb40469bb19bcfe0dbb7cb/users/01f7246ffe8a4dea9d13a7ddc6c9689c/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:37:51.018547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201fca2-febf-4df6-a3ed-61c66c1e0154 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:51.026325 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:51.043978 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2877/5785] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:37:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:37:51.290696 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201fca2-febf-4df6-a3ed-61c66c1e0154 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:51.301317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140c223-2288-4069-88f5-e27616dfd7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:51.303618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140c223-2288-4069-88f5-e27616dfd7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:51.305442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140c223-2288-4069-88f5-e27616dfd7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:51.305442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140c223-2288-4069-88f5-e27616dfd7e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:51.308611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140c223-2288-4069-88f5-e27616dfd7e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:51.313722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140c223-2288-4069-88f5-e27616dfd7e0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:51.347835 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2909/5786] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:37:51.349129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a98f92-8b9d-4af4-8569-a25f02d3ddec service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:51.372027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a98f92-8b9d-4af4-8569-a25f02d3ddec service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:51.392730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff6f23-937f-4f11-9109-6fb637ac05f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:51.393477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff6f23-937f-4f11-9109-6fb637ac05f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:51.393788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff6f23-937f-4f11-9109-6fb637ac05f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:51.394078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff6f23-937f-4f11-9109-6fb637ac05f2 admin admin] PATH_INFO: `/v3/projects/1a558dcff4bb40469bb19bcfe0dbb7cb/users/01f7246ffe8a4dea9d13a7ddc6c9689c/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:51.399248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff6f23-937f-4f11-9109-6fb637ac05f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a558dcff4bb40469bb19bcfe0dbb7cb, user_id=01f7246ffe8a4dea9d13a7ddc6c9689c, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:51.406739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff6f23-937f-4f11-9109-6fb637ac05f2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:51.432753 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2878/5787] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:37:51 2022] PUT /identity/v3/projects/1a558dcff4bb40469bb19bcfe0dbb7cb/users/01f7246ffe8a4dea9d13a7ddc6c9689c/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:51.446293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2131a14-ccdc-46b6-97c4-4252dae6fea9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:51.447025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2131a14-ccdc-46b6-97c4-4252dae6fea9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:51.447801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2131a14-ccdc-46b6-97c4-4252dae6fea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:51.516949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d2131a14-ccdc-46b6-97c4-4252dae6fea9 None None] MFA Rules not processed for user `01f7246ffe8a4dea9d13a7ddc6c9689c`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:51.518677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d2131a14-ccdc-46b6-97c4-4252dae6fea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:51.732771 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2910/5788] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:51 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:51.738142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff6f23-937f-4f11-9109-6fb637ac05f2 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:51.884662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2131a14-ccdc-46b6-97c4-4252dae6fea9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:51.886516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d2131a14-ccdc-46b6-97c4-4252dae6fea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:51.988182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff6f23-937f-4f11-9109-6fb637ac05f2 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:52.000669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b92c4f-b331-4d1f-97d7-4323efac725a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:52.001295 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b92c4f-b331-4d1f-97d7-4323efac725a admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:52.001576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b92c4f-b331-4d1f-97d7-4323efac725a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:52.001850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b92c4f-b331-4d1f-97d7-4323efac725a admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:52.002522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b92c4f-b331-4d1f-97d7-4323efac725a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:52.010828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b92c4f-b331-4d1f-97d7-4323efac725a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:52.083738 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2879/5789] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:37:51 2022] POST /identity/v3/projects => generated 397 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:52.085129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b92c4f-b331-4d1f-97d7-4323efac725a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:52.094675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f9b92c4f-b331-4d1f-97d7-4323efac725a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:52.125945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2131a14-ccdc-46b6-97c4-4252dae6fea9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:52.210817 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:52.257534 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:52.284646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cab8da-f8f2-474c-bcb8-f566f55c0c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:52.285388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cab8da-f8f2-474c-bcb8-f566f55c0c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:52.285667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cab8da-f8f2-474c-bcb8-f566f55c0c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:52.285927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cab8da-f8f2-474c-bcb8-f566f55c0c40 admin admin] PATH_INFO: `/v3/projects/07ab28bb53c645cc91b3a38a565ce758` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:52.287236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cab8da-f8f2-474c-bcb8-f566f55c0c40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07ab28bb53c645cc91b3a38a565ce758)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:52.291686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cab8da-f8f2-474c-bcb8-f566f55c0c40 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:52.295633 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b92c4f-b331-4d1f-97d7-4323efac725a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:52.312432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444e73d-e50c-4bb4-9a67-befe7cfa903f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:52.312571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444e73d-e50c-4bb4-9a67-befe7cfa903f service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:52.312715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444e73d-e50c-4bb4-9a67-befe7cfa903f service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:52.313016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444e73d-e50c-4bb4-9a67-befe7cfa903f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:52.316553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4444e73d-e50c-4bb4-9a67-befe7cfa903f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:52.406038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-88cab8da-f8f2-474c-bcb8-f566f55c0c40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07ab28bb53c645cc91b3a38a565ce758', 'request_id': 'req-88cab8da-f8f2-474c-bcb8-f566f55c0c40'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:52.424502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-88cab8da-f8f2-474c-bcb8-f566f55c0c40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07ab28bb53c645cc91b3a38a565ce758', 'request_id': 'req-88cab8da-f8f2-474c-bcb8-f566f55c0c40'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:52.441200 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-88cab8da-f8f2-474c-bcb8-f566f55c0c40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07ab28bb53c645cc91b3a38a565ce758', 'request_id': 'req-88cab8da-f8f2-474c-bcb8-f566f55c0c40'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:52.479330 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-88cab8da-f8f2-474c-bcb8-f566f55c0c40 admin admin] The token cache is being invalidate because project 07ab28bb53c645cc91b3a38a565ce758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:52.479552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-88cab8da-f8f2-474c-bcb8-f566f55c0c40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:52.480684 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-88cab8da-f8f2-474c-bcb8-f566f55c0c40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:52.493093 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2911/5790] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:37:51 2022] DELETE /identity/v3/projects/07ab28bb53c645cc91b3a38a565ce758 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:52.494512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cab8da-f8f2-474c-bcb8-f566f55c0c40 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:52.496100 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444e73d-e50c-4bb4-9a67-befe7cfa903f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:52.498066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444e73d-e50c-4bb4-9a67-befe7cfa903f service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:52.499207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-88cab8da-f8f2-474c-bcb8-f566f55c0c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:52.559315 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2880/5791] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:37:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:37:52.560590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444e73d-e50c-4bb4-9a67-befe7cfa903f service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:52.595303 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444e73d-e50c-4bb4-9a67-befe7cfa903f service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:52.739727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cab8da-f8f2-474c-bcb8-f566f55c0c40 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:52.747207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825db55-9c1f-491e-8bd3-98ed95e2204f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:52.748309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825db55-9c1f-491e-8bd3-98ed95e2204f admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:52.748783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825db55-9c1f-491e-8bd3-98ed95e2204f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:52.750235 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825db55-9c1f-491e-8bd3-98ed95e2204f admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:52.751225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825db55-9c1f-491e-8bd3-98ed95e2204f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:52.753366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825db55-9c1f-491e-8bd3-98ed95e2204f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:52.755136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec510b-ada9-4111-8533-a82ea5cde4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:52.755928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec510b-ada9-4111-8533-a82ea5cde4b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:52.756324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec510b-ada9-4111-8533-a82ea5cde4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:52.756708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec510b-ada9-4111-8533-a82ea5cde4b4 admin admin] PATH_INFO: `/v3/users/0f6010e513034e718ed9e8c55e09c9cd` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:52.760937 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec510b-ada9-4111-8533-a82ea5cde4b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f6010e513034e718ed9e8c55e09c9cd)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:52.762987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec510b-ada9-4111-8533-a82ea5cde4b4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:52.794975 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2912/5792] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:37:52 2022] POST /identity/v3/users => generated 299 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:52.800472 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825db55-9c1f-491e-8bd3-98ed95e2204f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:52.821237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825db55-9c1f-491e-8bd3-98ed95e2204f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:52.843821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebadb61-3ddd-459b-8459-24e0ac1c27d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:52.844555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebadb61-3ddd-459b-8459-24e0ac1c27d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:52.844985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebadb61-3ddd-459b-8459-24e0ac1c27d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:52.845358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebadb61-3ddd-459b-8459-24e0ac1c27d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:52.846272 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebadb61-3ddd-459b-8459-24e0ac1c27d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:52.852569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebadb61-3ddd-459b-8459-24e0ac1c27d8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:52.868308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3aec510b-ada9-4111-8533-a82ea5cde4b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f6010e513034e718ed9e8c55e09c9cd'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:52.879951 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2913/5793] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:37:52.885867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebadb61-3ddd-459b-8459-24e0ac1c27d8 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:52.886086 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3aec510b-ada9-4111-8533-a82ea5cde4b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f6010e513034e718ed9e8c55e09c9cd'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:52.905348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebadb61-3ddd-459b-8459-24e0ac1c27d8 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:52.911097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec257295-9a90-4ae6-b9b0-e7e22cc5d6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:52.912306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec257295-9a90-4ae6-b9b0-e7e22cc5d6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:52.912825 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec257295-9a90-4ae6-b9b0-e7e22cc5d6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:52.913416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec257295-9a90-4ae6-b9b0-e7e22cc5d6e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:52.915154 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec257295-9a90-4ae6-b9b0-e7e22cc5d6e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:52.917573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec257295-9a90-4ae6-b9b0-e7e22cc5d6e6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:52.937793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3aec510b-ada9-4111-8533-a82ea5cde4b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f6010e513034e718ed9e8c55e09c9cd'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:52.940027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3aec510b-ada9-4111-8533-a82ea5cde4b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f6010e513034e718ed9e8c55e09c9cd'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:52.947816 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2914/5794] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:37:52.950392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec257295-9a90-4ae6-b9b0-e7e22cc5d6e6 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:52.956784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3aec510b-ada9-4111-8533-a82ea5cde4b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f6010e513034e718ed9e8c55e09c9cd'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:52.969187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec257295-9a90-4ae6-b9b0-e7e22cc5d6e6 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:52.992424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda191a0-4f56-4a41-9704-acd72a03f85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:52.993726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda191a0-4f56-4a41-9704-acd72a03f85f admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:52.994206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda191a0-4f56-4a41-9704-acd72a03f85f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:52.996202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda191a0-4f56-4a41-9704-acd72a03f85f admin admin] PATH_INFO: `/v3/projects/337d1bb08b0d4159a8463ebbf31f6e05/users/a381b7f05d1b45e58e12f0173137a3cf/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:52.996347 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2881/5795] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:37:52 2022] DELETE /identity/v3/users/0f6010e513034e718ed9e8c55e09c9cd => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:53.047918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda191a0-4f56-4a41-9704-acd72a03f85f admin admin] RBAC: Authorizing `identity:create_grant(project_id=337d1bb08b0d4159a8463ebbf31f6e05, user_id=a381b7f05d1b45e58e12f0173137a3cf, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:53.049101 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda191a0-4f56-4a41-9704-acd72a03f85f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:53.093764 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2915/5796] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:37:52 2022] PUT /identity/v3/projects/337d1bb08b0d4159a8463ebbf31f6e05/users/a381b7f05d1b45e58e12f0173137a3cf/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:53.114680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36511ef-cbfd-41cc-b554-49484cc0386a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:53.114974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36511ef-cbfd-41cc-b554-49484cc0386a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:53.115256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36511ef-cbfd-41cc-b554-49484cc0386a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:53.138961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a45596-64e8-4ee9-9af5-3d4860d50135 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:53.139408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a45596-64e8-4ee9-9af5-3d4860d50135 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:53.139822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a45596-64e8-4ee9-9af5-3d4860d50135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:53.152161 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:53.184062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-79a45596-64e8-4ee9-9af5-3d4860d50135 None None] MFA Rules not processed for user `2f5acf7da18b43f89e24760744cfdb49`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:53.185951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-79a45596-64e8-4ee9-9af5-3d4860d50135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:53.186439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-a36511ef-cbfd-41cc-b554-49484cc0386a None None] MFA Rules not processed for user `a381b7f05d1b45e58e12f0173137a3cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:53.187676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a36511ef-cbfd-41cc-b554-49484cc0386a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:53.201458 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:53.349529 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2916/5797] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:37:53.355240 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2882/5798] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:53 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:53.380289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a45596-64e8-4ee9-9af5-3d4860d50135 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:53.382559 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-79a45596-64e8-4ee9-9af5-3d4860d50135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:53.589948 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a45596-64e8-4ee9-9af5-3d4860d50135 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:53.602012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4167a7-6c28-404e-917c-aabd62e395c7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:53.607454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4167a7-6c28-404e-917c-aabd62e395c7 service glance] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:53.608047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4167a7-6c28-404e-917c-aabd62e395c7 service glance] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:53.608534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4167a7-6c28-404e-917c-aabd62e395c7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:53.615151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1d4167a7-6c28-404e-917c-aabd62e395c7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:53.770879 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4167a7-6c28-404e-917c-aabd62e395c7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:53.772468 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4167a7-6c28-404e-917c-aabd62e395c7 service glance] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:53.792935 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2917/5799] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:37:53 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:37:54.623652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36511ef-cbfd-41cc-b554-49484cc0386a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:54.625731 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a36511ef-cbfd-41cc-b554-49484cc0386a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:54.657252 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4167a7-6c28-404e-917c-aabd62e395c7 service glance] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:54.659204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1d4167a7-6c28-404e-917c-aabd62e395c7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:54.820966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36511ef-cbfd-41cc-b554-49484cc0386a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:54.837620 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a494c-6f12-44a7-bcef-1f6bbeb879e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:54.838614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a494c-6f12-44a7-bcef-1f6bbeb879e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:54.839699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a494c-6f12-44a7-bcef-1f6bbeb879e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:54.840205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a494c-6f12-44a7-bcef-1f6bbeb879e0 admin admin] PATH_INFO: `/v3/projects/6f276da301c54952b64591491cb03ff7` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:54.844103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a494c-6f12-44a7-bcef-1f6bbeb879e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f276da301c54952b64591491cb03ff7)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:54.847711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4167a7-6c28-404e-917c-aabd62e395c7 service glance] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:54.850233 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a494c-6f12-44a7-bcef-1f6bbeb879e0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:54.864399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7036bd23-4464-4d0f-bc97-d62526a3b724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:54.865473 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036bd23-4464-4d0f-bc97-d62526a3b724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:54.866085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036bd23-4464-4d0f-bc97-d62526a3b724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:54.866535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036bd23-4464-4d0f-bc97-d62526a3b724 admin admin] PATH_INFO: `/v3/users/01f7246ffe8a4dea9d13a7ddc6c9689c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:54.872551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7036bd23-4464-4d0f-bc97-d62526a3b724 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01f7246ffe8a4dea9d13a7ddc6c9689c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:54.874884 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7036bd23-4464-4d0f-bc97-d62526a3b724 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:54.878756 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:55.001794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7036bd23-4464-4d0f-bc97-d62526a3b724 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01f7246ffe8a4dea9d13a7ddc6c9689c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:55.006739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7b1a494c-6f12-44a7-bcef-1f6bbeb879e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f276da301c54952b64591491cb03ff7', 'request_id': 'req-7b1a494c-6f12-44a7-bcef-1f6bbeb879e0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:55.018511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7036bd23-4464-4d0f-bc97-d62526a3b724 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01f7246ffe8a4dea9d13a7ddc6c9689c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:55.031192 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7b1a494c-6f12-44a7-bcef-1f6bbeb879e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f276da301c54952b64591491cb03ff7', 'request_id': 'req-7b1a494c-6f12-44a7-bcef-1f6bbeb879e0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:55.035300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7036bd23-4464-4d0f-bc97-d62526a3b724 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01f7246ffe8a4dea9d13a7ddc6c9689c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:55.036298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7036bd23-4464-4d0f-bc97-d62526a3b724 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01f7246ffe8a4dea9d13a7ddc6c9689c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:55.048818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7036bd23-4464-4d0f-bc97-d62526a3b724 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01f7246ffe8a4dea9d13a7ddc6c9689c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:55.057482 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2918/5800] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:37:54 2022] DELETE /identity/v3/users/01f7246ffe8a4dea9d13a7ddc6c9689c => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:37:55.061885 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13498ab2-b7bb-463b-8abb-2f17a20ed344 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:55.062181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13498ab2-b7bb-463b-8abb-2f17a20ed344 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:55.062497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13498ab2-b7bb-463b-8abb-2f17a20ed344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:55.064668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7b1a494c-6f12-44a7-bcef-1f6bbeb879e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f276da301c54952b64591491cb03ff7', 'request_id': 'req-7b1a494c-6f12-44a7-bcef-1f6bbeb879e0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:55.109857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-13498ab2-b7bb-463b-8abb-2f17a20ed344 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:55.110126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7b1a494c-6f12-44a7-bcef-1f6bbeb879e0 admin admin] The token cache is being invalidate because project 6f276da301c54952b64591491cb03ff7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:55.112791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7b1a494c-6f12-44a7-bcef-1f6bbeb879e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:55.115813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7b1a494c-6f12-44a7-bcef-1f6bbeb879e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:55.121222 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2883/5801] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:37:54 2022] DELETE /identity/v3/projects/6f276da301c54952b64591491cb03ff7 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:55.122759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba56742-346d-4919-b211-035cbb532ca9 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:55.123159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba56742-346d-4919-b211-035cbb532ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:55.123539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba56742-346d-4919-b211-035cbb532ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:55.131076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-13498ab2-b7bb-463b-8abb-2f17a20ed344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:55.168136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-8ba56742-346d-4919-b211-035cbb532ca9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:55.178786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8ba56742-346d-4919-b211-035cbb532ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:55.244241 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:55.297447 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2919/5802] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:55.334191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ccc3b-c1cc-48a2-bea1-3d7bad96bf33 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:55.334672 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2884/5803] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:55.334799 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ccc3b-c1cc-48a2-bea1-3d7bad96bf33 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:55.334982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ccc3b-c1cc-48a2-bea1-3d7bad96bf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:55.336311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba56742-346d-4919-b211-035cbb532ca9 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:55.341698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8ba56742-346d-4919-b211-035cbb532ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:55.363924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b68ccc3b-c1cc-48a2-bea1-3d7bad96bf33 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:55.365201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b68ccc3b-c1cc-48a2-bea1-3d7bad96bf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:55.376919 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2920/5804] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:55.382415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ccc3b-c1cc-48a2-bea1-3d7bad96bf33 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:55.402856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ccc3b-c1cc-48a2-bea1-3d7bad96bf33 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:55.410021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa3eb4-286f-40e0-94b4-805e86886e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:55.410640 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa3eb4-286f-40e0-94b4-805e86886e32 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:55.411072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa3eb4-286f-40e0-94b4-805e86886e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:55.411344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa3eb4-286f-40e0-94b4-805e86886e32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:55.412108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa3eb4-286f-40e0-94b4-805e86886e32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:37:55.412415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa3eb4-286f-40e0-94b4-805e86886e32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:55.414492 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa3eb4-286f-40e0-94b4-805e86886e32 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:55.429495 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2921/5805] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:37:55.434778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa3eb4-286f-40e0-94b4-805e86886e32 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:55.464229 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa3eb4-286f-40e0-94b4-805e86886e32 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:55.482651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc76bc-14ff-45d5-91b0-05d7eff5782f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:55.483301 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc76bc-14ff-45d5-91b0-05d7eff5782f admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:55.483616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc76bc-14ff-45d5-91b0-05d7eff5782f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:55.483925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc76bc-14ff-45d5-91b0-05d7eff5782f admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:55.484985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc76bc-14ff-45d5-91b0-05d7eff5782f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:55.488901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc76bc-14ff-45d5-91b0-05d7eff5782f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:55.526017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba56742-346d-4919-b211-035cbb532ca9 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:55.531219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b13c3-3dab-4f64-8885-ea81a96b4d66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:55.532562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b13c3-3dab-4f64-8885-ea81a96b4d66 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:55.533074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b13c3-3dab-4f64-8885-ea81a96b4d66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:55.533922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b13c3-3dab-4f64-8885-ea81a96b4d66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:55.549021 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2922/5806] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:37:55 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:55.549021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc76bc-14ff-45d5-91b0-05d7eff5782f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:55.549021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6bfc76bc-14ff-45d5-91b0-05d7eff5782f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:55.557954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b13c3-3dab-4f64-8885-ea81a96b4d66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:55.560677 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b13c3-3dab-4f64-8885-ea81a96b4d66 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:55.592096 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2885/5807] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:37:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:37:55.597206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b13c3-3dab-4f64-8885-ea81a96b4d66 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:55.626364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b13c3-3dab-4f64-8885-ea81a96b4d66 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:55.643933 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:55.700809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc76bc-14ff-45d5-91b0-05d7eff5782f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:55.711797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a236f7e-c213-49ff-adae-7480b2390d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:55.712538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a236f7e-c213-49ff-adae-7480b2390d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:55.712986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a236f7e-c213-49ff-adae-7480b2390d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:55.713292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a236f7e-c213-49ff-adae-7480b2390d76 admin admin] PATH_INFO: `/v3/users/a1f466e299cc43cc8174f655299583fc` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:55.715491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a236f7e-c213-49ff-adae-7480b2390d76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1f466e299cc43cc8174f655299583fc)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:55.717537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a236f7e-c213-49ff-adae-7480b2390d76 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:55.756897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabca061-defe-47df-9cff-8868c8ed0bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:55.758980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabca061-defe-47df-9cff-8868c8ed0bfc admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:55.760045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabca061-defe-47df-9cff-8868c8ed0bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:55.760977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabca061-defe-47df-9cff-8868c8ed0bfc admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:55.763803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabca061-defe-47df-9cff-8868c8ed0bfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:55.770595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabca061-defe-47df-9cff-8868c8ed0bfc admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:55.847837 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2886/5808] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:37:55 2022] POST /identity/v3/users => generated 286 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:55.851687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabca061-defe-47df-9cff-8868c8ed0bfc admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:55.865855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6a236f7e-c213-49ff-adae-7480b2390d76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1f466e299cc43cc8174f655299583fc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:55.882174 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabca061-defe-47df-9cff-8868c8ed0bfc admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:55.885658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6a236f7e-c213-49ff-adae-7480b2390d76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1f466e299cc43cc8174f655299583fc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:55.896235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa72297-753f-4a98-b3e1-5b57b0f574ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:55.898647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa72297-753f-4a98-b3e1-5b57b0f574ce admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:55.900998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa72297-753f-4a98-b3e1-5b57b0f574ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:55.901916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa72297-753f-4a98-b3e1-5b57b0f574ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:55.904305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa72297-753f-4a98-b3e1-5b57b0f574ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:55.908050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa72297-753f-4a98-b3e1-5b57b0f574ce admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:55.930008 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2887/5809] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:37:55.930275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6a236f7e-c213-49ff-adae-7480b2390d76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1f466e299cc43cc8174f655299583fc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:55.931111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6a236f7e-c213-49ff-adae-7480b2390d76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1f466e299cc43cc8174f655299583fc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:55.932761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa72297-753f-4a98-b3e1-5b57b0f574ce admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:55.935655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6aa72297-753f-4a98-b3e1-5b57b0f574ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:55.950523 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6a236f7e-c213-49ff-adae-7480b2390d76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1f466e299cc43cc8174f655299583fc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:55.987412 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2923/5810] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:37:55 2022] DELETE /identity/v3/users/a1f466e299cc43cc8174f655299583fc => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:55.987412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a236f7e-c213-49ff-adae-7480b2390d76 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:55.988946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6a236f7e-c213-49ff-adae-7480b2390d76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:56.065924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa72297-753f-4a98-b3e1-5b57b0f574ce admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:56.096445 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:56.172999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a236f7e-c213-49ff-adae-7480b2390d76 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:56.197443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13ac57-d810-406c-a013-25886c7e3526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:56.202001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13ac57-d810-406c-a013-25886c7e3526 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:56.202500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13ac57-d810-406c-a013-25886c7e3526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:56.202789 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13ac57-d810-406c-a013-25886c7e3526 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:56.205851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13ac57-d810-406c-a013-25886c7e3526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:56.209934 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13ac57-d810-406c-a013-25886c7e3526 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:56.213036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d3b59-206f-49dd-afee-d47b09436e30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:56.213886 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d3b59-206f-49dd-afee-d47b09436e30 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:56.214331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d3b59-206f-49dd-afee-d47b09436e30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:56.215442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d3b59-206f-49dd-afee-d47b09436e30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:56.217580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b16d3b59-206f-49dd-afee-d47b09436e30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:56.234401 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d3b59-206f-49dd-afee-d47b09436e30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:56.236405 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d3b59-206f-49dd-afee-d47b09436e30 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:56.240144 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2924/5811] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:37:56.243121 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13ac57-d810-406c-a013-25886c7e3526 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:56.263229 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2888/5812] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:37:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:37:56.271916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13ac57-d810-406c-a013-25886c7e3526 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:56.284437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b23b9-40f1-4491-ab62-08effde74a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:56.285123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b23b9-40f1-4491-ab62-08effde74a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:56.285398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b23b9-40f1-4491-ab62-08effde74a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:56.285673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b23b9-40f1-4491-ab62-08effde74a69 admin admin] PATH_INFO: `/v3/projects/777ac6e3853e42b698444a6ca14bc1c0/users/6f572c9d36974f339eb2e680b17ba91d/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:56.322318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b23b9-40f1-4491-ab62-08effde74a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=777ac6e3853e42b698444a6ca14bc1c0, user_id=6f572c9d36974f339eb2e680b17ba91d, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:56.325469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b23b9-40f1-4491-ab62-08effde74a69 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:56.362905 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2925/5813] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:37:56 2022] PUT /identity/v3/projects/777ac6e3853e42b698444a6ca14bc1c0/users/6f572c9d36974f339eb2e680b17ba91d/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:56.363978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8207f3-0a7c-46c0-a92e-633caf46682d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:56.364142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8207f3-0a7c-46c0-a92e-633caf46682d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:56.364301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8207f3-0a7c-46c0-a92e-633caf46682d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:56.528871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-fc8207f3-0a7c-46c0-a92e-633caf46682d None None] MFA Rules not processed for user `6f572c9d36974f339eb2e680b17ba91d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:56.532786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-fc8207f3-0a7c-46c0-a92e-633caf46682d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:56.555151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b23b9-40f1-4491-ab62-08effde74a69 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:56.560453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d11b23b9-40f1-4491-ab62-08effde74a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:56.659402 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:56.743469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b23b9-40f1-4491-ab62-08effde74a69 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:56.750378 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2889/5814] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:37:56.763226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c34d8d-b5cd-4bbb-80a0-bc2ef73b178b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:56.764248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c34d8d-b5cd-4bbb-80a0-bc2ef73b178b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:56.764542 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c34d8d-b5cd-4bbb-80a0-bc2ef73b178b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:56.765480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c34d8d-b5cd-4bbb-80a0-bc2ef73b178b admin admin] PATH_INFO: `/v3/projects/1a558dcff4bb40469bb19bcfe0dbb7cb` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:56.770380 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c34d8d-b5cd-4bbb-80a0-bc2ef73b178b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a558dcff4bb40469bb19bcfe0dbb7cb)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:56.772732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8207f3-0a7c-46c0-a92e-633caf46682d None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:56.774387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-fc8207f3-0a7c-46c0-a92e-633caf46682d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:56.778995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c34d8d-b5cd-4bbb-80a0-bc2ef73b178b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:57.008164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8207f3-0a7c-46c0-a92e-633caf46682d None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:57.010137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e2c34d8d-b5cd-4bbb-80a0-bc2ef73b178b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a558dcff4bb40469bb19bcfe0dbb7cb', 'request_id': 'req-e2c34d8d-b5cd-4bbb-80a0-bc2ef73b178b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:57.047974 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e2c34d8d-b5cd-4bbb-80a0-bc2ef73b178b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a558dcff4bb40469bb19bcfe0dbb7cb', 'request_id': 'req-e2c34d8d-b5cd-4bbb-80a0-bc2ef73b178b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:57.074542 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e2c34d8d-b5cd-4bbb-80a0-bc2ef73b178b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a558dcff4bb40469bb19bcfe0dbb7cb', 'request_id': 'req-e2c34d8d-b5cd-4bbb-80a0-bc2ef73b178b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:57.122209 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e2c34d8d-b5cd-4bbb-80a0-bc2ef73b178b admin admin] The token cache is being invalidate because project 1a558dcff4bb40469bb19bcfe0dbb7cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:57.122604 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e2c34d8d-b5cd-4bbb-80a0-bc2ef73b178b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:57.123764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e2c34d8d-b5cd-4bbb-80a0-bc2ef73b178b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:57.125775 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2926/5815] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:37:56 2022] DELETE /identity/v3/projects/1a558dcff4bb40469bb19bcfe0dbb7cb => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:57.126800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c34d8d-b5cd-4bbb-80a0-bc2ef73b178b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:57.128762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e2c34d8d-b5cd-4bbb-80a0-bc2ef73b178b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:57.177523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9bb52-58fd-46d7-9176-65bcbe4d4927 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:57.178171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9bb52-58fd-46d7-9176-65bcbe4d4927 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:57.178453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9bb52-58fd-46d7-9176-65bcbe4d4927 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:57.178724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9bb52-58fd-46d7-9176-65bcbe4d4927 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:57.185369 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bae9bb52-58fd-46d7-9176-65bcbe4d4927 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:57.238882 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:57.318929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9bb52-58fd-46d7-9176-65bcbe4d4927 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:57.320623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9bb52-58fd-46d7-9176-65bcbe4d4927 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:57.339975 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2890/5816] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:37:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:37:57.340943 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9bb52-58fd-46d7-9176-65bcbe4d4927 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:57.345714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bae9bb52-58fd-46d7-9176-65bcbe4d4927 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:57.351199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c34d8d-b5cd-4bbb-80a0-bc2ef73b178b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:57.365768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9bb52-58fd-46d7-9176-65bcbe4d4927 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:57.370019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4f460-fb99-4b66-84d1-75f8f826c166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:57.370902 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4f460-fb99-4b66-84d1-75f8f826c166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:57.371340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4f460-fb99-4b66-84d1-75f8f826c166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:57.373447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4f460-fb99-4b66-84d1-75f8f826c166 admin admin] PATH_INFO: `/v3/projects/a7eecd700893476191d4405a1c316858` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:57.375674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4f460-fb99-4b66-84d1-75f8f826c166 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7eecd700893476191d4405a1c316858)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:57.381421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4f460-fb99-4b66-84d1-75f8f826c166 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:57.402604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13005c4e-dd03-49cf-a095-b304677720d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:57.408968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13005c4e-dd03-49cf-a095-b304677720d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:57.409278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13005c4e-dd03-49cf-a095-b304677720d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:57.409567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13005c4e-dd03-49cf-a095-b304677720d4 admin admin] PATH_INFO: `/v3/users/a381b7f05d1b45e58e12f0173137a3cf` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:57.411984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13005c4e-dd03-49cf-a095-b304677720d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a381b7f05d1b45e58e12f0173137a3cf)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:57.415150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13005c4e-dd03-49cf-a095-b304677720d4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:57.550436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-13005c4e-dd03-49cf-a095-b304677720d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a381b7f05d1b45e58e12f0173137a3cf'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:57.575868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-13005c4e-dd03-49cf-a095-b304677720d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a381b7f05d1b45e58e12f0173137a3cf'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:57.591018 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b5a4f460-fb99-4b66-84d1-75f8f826c166 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7eecd700893476191d4405a1c316858', 'request_id': 'req-b5a4f460-fb99-4b66-84d1-75f8f826c166'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:57.614918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b5a4f460-fb99-4b66-84d1-75f8f826c166 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7eecd700893476191d4405a1c316858', 'request_id': 'req-b5a4f460-fb99-4b66-84d1-75f8f826c166'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:57.615100 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-13005c4e-dd03-49cf-a095-b304677720d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a381b7f05d1b45e58e12f0173137a3cf'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:57.616083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-13005c4e-dd03-49cf-a095-b304677720d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a381b7f05d1b45e58e12f0173137a3cf'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:57.621252 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:57.640451 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-13005c4e-dd03-49cf-a095-b304677720d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a381b7f05d1b45e58e12f0173137a3cf'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:57.652279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b5a4f460-fb99-4b66-84d1-75f8f826c166 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7eecd700893476191d4405a1c316858', 'request_id': 'req-b5a4f460-fb99-4b66-84d1-75f8f826c166'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:57.656465 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2891/5817] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:37:57 2022] DELETE /identity/v3/users/a381b7f05d1b45e58e12f0173137a3cf => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:57.697446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b5a4f460-fb99-4b66-84d1-75f8f826c166 admin admin] The token cache is being invalidate because project a7eecd700893476191d4405a1c316858 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:57.701096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b5a4f460-fb99-4b66-84d1-75f8f826c166 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:57.703306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b5a4f460-fb99-4b66-84d1-75f8f826c166 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:57.718257 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2927/5818] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:37:57 2022] DELETE /identity/v3/projects/a7eecd700893476191d4405a1c316858 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:57.722577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13005c4e-dd03-49cf-a095-b304677720d4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:57.725575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-13005c4e-dd03-49cf-a095-b304677720d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:57.929966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13005c4e-dd03-49cf-a095-b304677720d4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:57.935717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6e5c8-af0f-4f33-8eaa-c1bc0e0b81df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:57.936637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6e5c8-af0f-4f33-8eaa-c1bc0e0b81df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:57.936999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6e5c8-af0f-4f33-8eaa-c1bc0e0b81df admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:57.937375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6e5c8-af0f-4f33-8eaa-c1bc0e0b81df admin admin] PATH_INFO: `/v3/users/80ae7190082147719c1b34470e6cde12` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:57.942769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6e5c8-af0f-4f33-8eaa-c1bc0e0b81df admin admin] RBAC: Authorizing `identity:delete_user(user_id=80ae7190082147719c1b34470e6cde12)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:57.944972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6e5c8-af0f-4f33-8eaa-c1bc0e0b81df admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:58.040771 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:58.112881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-62e6e5c8-af0f-4f33-8eaa-c1bc0e0b81df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80ae7190082147719c1b34470e6cde12'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:58.130066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-62e6e5c8-af0f-4f33-8eaa-c1bc0e0b81df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80ae7190082147719c1b34470e6cde12'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:58.164600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-62e6e5c8-af0f-4f33-8eaa-c1bc0e0b81df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80ae7190082147719c1b34470e6cde12'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:58.167627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-62e6e5c8-af0f-4f33-8eaa-c1bc0e0b81df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80ae7190082147719c1b34470e6cde12'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:58.201029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-62e6e5c8-af0f-4f33-8eaa-c1bc0e0b81df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80ae7190082147719c1b34470e6cde12'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:58.225807 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2892/5819] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:37:57 2022] DELETE /identity/v3/users/80ae7190082147719c1b34470e6cde12 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:58.590835 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4f460-fb99-4b66-84d1-75f8f826c166 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:58.592436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b5a4f460-fb99-4b66-84d1-75f8f826c166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:58.843695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4f460-fb99-4b66-84d1-75f8f826c166 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:59.011509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f225f-e7cf-4699-866a-9800b3292afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:59.011700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f225f-e7cf-4699-866a-9800b3292afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:59.012000 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f225f-e7cf-4699-866a-9800b3292afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:59.012280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f225f-e7cf-4699-866a-9800b3292afa admin admin] PATH_INFO: `/v3/projects/337d1bb08b0d4159a8463ebbf31f6e05` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:59.015494 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f225f-e7cf-4699-866a-9800b3292afa admin admin] RBAC: Authorizing `identity:delete_project(project_id=337d1bb08b0d4159a8463ebbf31f6e05)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:59.019475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f225f-e7cf-4699-866a-9800b3292afa admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:59.137982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-627f225f-e7cf-4699-866a-9800b3292afa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '337d1bb08b0d4159a8463ebbf31f6e05', 'request_id': 'req-627f225f-e7cf-4699-866a-9800b3292afa'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:59.146706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-627f225f-e7cf-4699-866a-9800b3292afa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '337d1bb08b0d4159a8463ebbf31f6e05', 'request_id': 'req-627f225f-e7cf-4699-866a-9800b3292afa'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:59.154465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-627f225f-e7cf-4699-866a-9800b3292afa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '337d1bb08b0d4159a8463ebbf31f6e05', 'request_id': 'req-627f225f-e7cf-4699-866a-9800b3292afa'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:59.174317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-627f225f-e7cf-4699-866a-9800b3292afa admin admin] The token cache is being invalidate because project 337d1bb08b0d4159a8463ebbf31f6e05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:37:59.174637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-627f225f-e7cf-4699-866a-9800b3292afa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:59.175519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-627f225f-e7cf-4699-866a-9800b3292afa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:37:59.181170 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2928/5820] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:37:58 2022] DELETE /identity/v3/projects/337d1bb08b0d4159a8463ebbf31f6e05 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:37:59.183537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5d1b0-c87b-4c37-a44f-2f82e0fcaa16 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:59.188415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5d1b0-c87b-4c37-a44f-2f82e0fcaa16 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:59.188745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5d1b0-c87b-4c37-a44f-2f82e0fcaa16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:59.224994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-bab5d1b0-c87b-4c37-a44f-2f82e0fcaa16 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:59.226298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bab5d1b0-c87b-4c37-a44f-2f82e0fcaa16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:59.352168 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2893/5821] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:59.358790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8d4f0-23e4-4cde-9deb-14db58dea109 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:59.359149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8d4f0-23e4-4cde-9deb-14db58dea109 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:59.359353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8d4f0-23e4-4cde-9deb-14db58dea109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:59.417794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-8da8d4f0-23e4-4cde-9deb-14db58dea109 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:37:59.419082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8da8d4f0-23e4-4cde-9deb-14db58dea109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:59.449381 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2929/5822] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:37:59.453860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5d1b0-c87b-4c37-a44f-2f82e0fcaa16 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:59.466142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5d1b0-c87b-4c37-a44f-2f82e0fcaa16 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:59.485044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7622d61-c393-45a2-a28f-4cc755bf36df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:59.487018 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7622d61-c393-45a2-a28f-4cc755bf36df admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:59.487431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7622d61-c393-45a2-a28f-4cc755bf36df admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:59.487615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7622d61-c393-45a2-a28f-4cc755bf36df admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:59.493261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7622d61-c393-45a2-a28f-4cc755bf36df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:37:59.493587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7622d61-c393-45a2-a28f-4cc755bf36df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:59.496831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7622d61-c393-45a2-a28f-4cc755bf36df admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:59.529901 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2894/5823] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:37:59.533114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8d4f0-23e4-4cde-9deb-14db58dea109 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:59.547497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8d4f0-23e4-4cde-9deb-14db58dea109 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:59.560655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ec48b-9ecf-4163-8d8c-6599115892f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:59.561377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ec48b-9ecf-4163-8d8c-6599115892f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:59.562191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ec48b-9ecf-4163-8d8c-6599115892f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:59.562546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ec48b-9ecf-4163-8d8c-6599115892f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:59.563196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ec48b-9ecf-4163-8d8c-6599115892f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:59.567984 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ec48b-9ecf-4163-8d8c-6599115892f5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:59.615131 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:37:59.633760 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2930/5824] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:37:59 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:59.637664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7622d61-c393-45a2-a28f-4cc755bf36df admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:59.654270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7622d61-c393-45a2-a28f-4cc755bf36df admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:59.783712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ec48b-9ecf-4163-8d8c-6599115892f5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:59.786006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b93ec48b-9ecf-4163-8d8c-6599115892f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:37:59.863988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083a141-aa29-49f5-abc9-820d152330b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:59.864623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083a141-aa29-49f5-abc9-820d152330b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:59.864908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083a141-aa29-49f5-abc9-820d152330b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:59.865199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083a141-aa29-49f5-abc9-820d152330b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:59.865854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083a141-aa29-49f5-abc9-820d152330b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:59.867768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083a141-aa29-49f5-abc9-820d152330b1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:59.930634 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2895/5825] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:37:59 2022] POST /identity/v3/users => generated 285 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:37:59.936500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083a141-aa29-49f5-abc9-820d152330b1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:37:59.956015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ec48b-9ecf-4163-8d8c-6599115892f5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:59.974597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083a141-aa29-49f5-abc9-820d152330b1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:37:59.980359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bb02b-f00a-43a5-adc9-8f2b91f15e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:59.981033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bb02b-f00a-43a5-adc9-8f2b91f15e19 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:37:59.981249 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bb02b-f00a-43a5-adc9-8f2b91f15e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:37:59.981518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bb02b-f00a-43a5-adc9-8f2b91f15e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:37:59.982205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998bb02b-f00a-43a5-adc9-8f2b91f15e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:37:59.988319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998bb02b-f00a-43a5-adc9-8f2b91f15e19 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:37:59.993960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a105aa6-a07f-40a7-a267-bf1cfcede82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:37:59.994778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a105aa6-a07f-40a7-a267-bf1cfcede82d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:00.005463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a105aa6-a07f-40a7-a267-bf1cfcede82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:00.005921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a105aa6-a07f-40a7-a267-bf1cfcede82d admin admin] PATH_INFO: `/v3/projects/None` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:00.016388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a105aa6-a07f-40a7-a267-bf1cfcede82d admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:00.018574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a105aa6-a07f-40a7-a267-bf1cfcede82d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:00.018749 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2896/5826] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:38:00.019672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bb02b-f00a-43a5-adc9-8f2b91f15e19 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:00.034538 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:00.035995 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-3a105aa6-a07f-40a7-a267-bf1cfcede82d admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. Aug 07 01:38:00.035995 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:38:00.035995 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:38:00.035995 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:38:00.035995 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:38:00.035995 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:38:00.035995 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:38:00.035995 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:38:00.035995 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:38:00.035995 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:38:00.035995 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:38:00.035995 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:38:00.035995 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Aug 07 01:38:00.035995 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Aug 07 01:38:00.035995 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:38:00.035995 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:38:00.037708 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Aug 07 01:38:00.037708 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Aug 07 01:38:00.037708 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 01:38:00.037708 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 01:38:00.037708 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 01:38:00.037708 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 01:38:00.037708 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: None. Aug 07 01:38:00.037708 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:38:00.039306 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2931/5827] 10.222.0.39 () {58 vars in 1149 bytes} [Sun Aug 7 01:37:59 2022] DELETE /identity/v3/projects/None => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:38:00.046935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bb02b-f00a-43a5-adc9-8f2b91f15e19 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:00.047516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a6e43-5432-4736-b14d-00ccf69e5d3e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:00.048069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a6e43-5432-4736-b14d-00ccf69e5d3e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:00.048634 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a6e43-5432-4736-b14d-00ccf69e5d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:00.064795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06902816-6a56-45d7-962c-91c7cb89b03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:00.065420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06902816-6a56-45d7-962c-91c7cb89b03f admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:00.065686 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06902816-6a56-45d7-962c-91c7cb89b03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:00.065958 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06902816-6a56-45d7-962c-91c7cb89b03f admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:00.066605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06902816-6a56-45d7-962c-91c7cb89b03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:00.068254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06902816-6a56-45d7-962c-91c7cb89b03f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:00.097320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-dc6a6e43-5432-4736-b14d-00ccf69e5d3e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:38:00.102137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dc6a6e43-5432-4736-b14d-00ccf69e5d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:00.113128 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2897/5828] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:38:00.114342 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06902816-6a56-45d7-962c-91c7cb89b03f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:00.133373 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2932/5829] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:38:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:38:00.135246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cab730-13aa-4c9f-a79a-54bf057d33aa None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:00.136392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cab730-13aa-4c9f-a79a-54bf057d33aa None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:00.136797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cab730-13aa-4c9f-a79a-54bf057d33aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:00.160923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06902816-6a56-45d7-962c-91c7cb89b03f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:00.176504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbacf3c-e1c7-462d-ac81-28b6f3b15b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:00.177178 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbacf3c-e1c7-462d-ac81-28b6f3b15b48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:00.177463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbacf3c-e1c7-462d-ac81-28b6f3b15b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:00.177810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbacf3c-e1c7-462d-ac81-28b6f3b15b48 admin admin] PATH_INFO: `/v3/projects/a6f518184d534a52a01383e9a5e37b5f/users/58affafdf7c14c2795853c7d9cf7154f/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:00.188721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f7cab730-13aa-4c9f-a79a-54bf057d33aa None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:38:00.189967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f7cab730-13aa-4c9f-a79a-54bf057d33aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:00.218131 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2933/5830] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:38:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:38:00.220498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cab730-13aa-4c9f-a79a-54bf057d33aa None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:00.221440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbacf3c-e1c7-462d-ac81-28b6f3b15b48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6f518184d534a52a01383e9a5e37b5f, user_id=58affafdf7c14c2795853c7d9cf7154f, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:00.233047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbacf3c-e1c7-462d-ac81-28b6f3b15b48 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:00.238979 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cab730-13aa-4c9f-a79a-54bf057d33aa None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:00.257190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4b1a8-e836-46eb-b9d1-fce76a86e1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:00.257938 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4b1a8-e836-46eb-b9d1-fce76a86e1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:00.258216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4b1a8-e836-46eb-b9d1-fce76a86e1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:00.258547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4b1a8-e836-46eb-b9d1-fce76a86e1c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:00.259299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4b1a8-e836-46eb-b9d1-fce76a86e1c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:38:00.259670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4b1a8-e836-46eb-b9d1-fce76a86e1c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:00.261501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4b1a8-e836-46eb-b9d1-fce76a86e1c3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:00.279284 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2898/5831] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:38:00 2022] PUT /identity/v3/projects/a6f518184d534a52a01383e9a5e37b5f/users/58affafdf7c14c2795853c7d9cf7154f/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:38:00.294378 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04113a3-ad38-4559-ae0e-b1261154764d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:00.294378 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04113a3-ad38-4559-ae0e-b1261154764d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:00.294378 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04113a3-ad38-4559-ae0e-b1261154764d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:00.304069 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2934/5832] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:38:00.305463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4b1a8-e836-46eb-b9d1-fce76a86e1c3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:00.327728 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4b1a8-e836-46eb-b9d1-fce76a86e1c3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:00.375876 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b04113a3-ad38-4559-ae0e-b1261154764d None None] MFA Rules not processed for user `58affafdf7c14c2795853c7d9cf7154f`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:38:00.377185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b04113a3-ad38-4559-ae0e-b1261154764d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:00.485538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568909f-e124-4a0c-aff9-854f8e2c523b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:00.486433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568909f-e124-4a0c-aff9-854f8e2c523b admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:00.486961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568909f-e124-4a0c-aff9-854f8e2c523b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:00.487443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568909f-e124-4a0c-aff9-854f8e2c523b admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:00.488607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568909f-e124-4a0c-aff9-854f8e2c523b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:00.493128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568909f-e124-4a0c-aff9-854f8e2c523b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:00.563121 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2935/5833] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:38:00 2022] POST /identity/v3/projects => generated 383 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:38:00.567155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568909f-e124-4a0c-aff9-854f8e2c523b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:00.586305 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2899/5834] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:38:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:38:00.603989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04113a3-ad38-4559-ae0e-b1261154764d None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:00.607674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b04113a3-ad38-4559-ae0e-b1261154764d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:00.688360 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:00.707685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568909f-e124-4a0c-aff9-854f8e2c523b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:00.717213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e234143-6eb2-4e5d-9369-b294a20ca257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:00.719160 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e234143-6eb2-4e5d-9369-b294a20ca257 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:00.719670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e234143-6eb2-4e5d-9369-b294a20ca257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:00.720296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e234143-6eb2-4e5d-9369-b294a20ca257 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:00.721855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e234143-6eb2-4e5d-9369-b294a20ca257 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:00.724130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e234143-6eb2-4e5d-9369-b294a20ca257 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:00.757099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04113a3-ad38-4559-ae0e-b1261154764d None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:00.762549 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2936/5835] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:38:00 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:38:00.767009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e234143-6eb2-4e5d-9369-b294a20ca257 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:00.783762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e234143-6eb2-4e5d-9369-b294a20ca257 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:00.794220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ddcb6-5d64-4f91-8892-d47014302763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:00.795565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ddcb6-5d64-4f91-8892-d47014302763 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:00.797106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ddcb6-5d64-4f91-8892-d47014302763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:00.797633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ddcb6-5d64-4f91-8892-d47014302763 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:00.800824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ddcb6-5d64-4f91-8892-d47014302763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:00.805272 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ddcb6-5d64-4f91-8892-d47014302763 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:00.826613 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2937/5836] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:38:00.831746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ddcb6-5d64-4f91-8892-d47014302763 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:00.865207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ddcb6-5d64-4f91-8892-d47014302763 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:00.891313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad558543-6992-4f8e-a342-0457898db417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:00.892300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad558543-6992-4f8e-a342-0457898db417 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:00.894643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ae870-54ee-4961-8fb3-12a43ffb9098 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:00.895272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ae870-54ee-4961-8fb3-12a43ffb9098 service glance] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:00.895405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad558543-6992-4f8e-a342-0457898db417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:00.895602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ae870-54ee-4961-8fb3-12a43ffb9098 service glance] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:00.895807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ae870-54ee-4961-8fb3-12a43ffb9098 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:00.898061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad558543-6992-4f8e-a342-0457898db417 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:00.900509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad558543-6992-4f8e-a342-0457898db417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:00.912056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad558543-6992-4f8e-a342-0457898db417 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:00.941393 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2938/5837] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:38:00.946971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad558543-6992-4f8e-a342-0457898db417 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:00.965226 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:00.984160 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad558543-6992-4f8e-a342-0457898db417 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:00.991373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f261e-70bd-4024-ad84-643d30277c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:00.992335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f261e-70bd-4024-ad84-643d30277c97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:00.992777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f261e-70bd-4024-ad84-643d30277c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:00.993176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f261e-70bd-4024-ad84-643d30277c97 admin admin] PATH_INFO: `/v3/projects/3139e77141f84e2485d2ba5d305f4ec7/users/68324eedf5c840f4806f4c4ae410774f/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:01.053495 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f261e-70bd-4024-ad84-643d30277c97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3139e77141f84e2485d2ba5d305f4ec7, user_id=68324eedf5c840f4806f4c4ae410774f, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:01.056403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f261e-70bd-4024-ad84-643d30277c97 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:01.058172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ae870-54ee-4961-8fb3-12a43ffb9098 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:01.059658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ae870-54ee-4961-8fb3-12a43ffb9098 service glance] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:01.095533 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2939/5838] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:38:00 2022] PUT /identity/v3/projects/3139e77141f84e2485d2ba5d305f4ec7/users/68324eedf5c840f4806f4c4ae410774f/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:38:01.097565 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2900/5839] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:38:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:38:01.120588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f07384-4ea2-4096-bc12-e031051d5e87 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:01.120977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f07384-4ea2-4096-bc12-e031051d5e87 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:01.121353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f07384-4ea2-4096-bc12-e031051d5e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:01.150182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-00f07384-4ea2-4096-bc12-e031051d5e87 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:38:01.151788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-00f07384-4ea2-4096-bc12-e031051d5e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:01.296419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ae870-54ee-4961-8fb3-12a43ffb9098 service glance] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:01.323772 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2940/5840] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:38:01.325608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ae870-54ee-4961-8fb3-12a43ffb9098 service glance] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:01.343287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b02bf5-b5df-4a0b-a926-4407445dc078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:01.343866 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b02bf5-b5df-4a0b-a926-4407445dc078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:01.344179 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b02bf5-b5df-4a0b-a926-4407445dc078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:01.344454 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b02bf5-b5df-4a0b-a926-4407445dc078 admin admin] PATH_INFO: `/v3/users/58affafdf7c14c2795853c7d9cf7154f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:01.346253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f07384-4ea2-4096-bc12-e031051d5e87 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:01.346439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b02bf5-b5df-4a0b-a926-4407445dc078 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58affafdf7c14c2795853c7d9cf7154f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:01.348058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-00f07384-4ea2-4096-bc12-e031051d5e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:01.349290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b02bf5-b5df-4a0b-a926-4407445dc078 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:01.453141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e2b02bf5-b5df-4a0b-a926-4407445dc078 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58affafdf7c14c2795853c7d9cf7154f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:01.472022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e2b02bf5-b5df-4a0b-a926-4407445dc078 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58affafdf7c14c2795853c7d9cf7154f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:01.486489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f07384-4ea2-4096-bc12-e031051d5e87 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:01.496463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e2b02bf5-b5df-4a0b-a926-4407445dc078 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58affafdf7c14c2795853c7d9cf7154f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:01.497708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e2b02bf5-b5df-4a0b-a926-4407445dc078 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58affafdf7c14c2795853c7d9cf7154f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:01.500141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ede744-2c8d-448e-8c6a-2cd63cd40408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:01.500782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ede744-2c8d-448e-8c6a-2cd63cd40408 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:01.501058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ede744-2c8d-448e-8c6a-2cd63cd40408 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:01.501331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ede744-2c8d-448e-8c6a-2cd63cd40408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:01.518668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e2b02bf5-b5df-4a0b-a926-4407445dc078 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58affafdf7c14c2795853c7d9cf7154f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:01.531771 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2901/5841] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:38:01 2022] DELETE /identity/v3/users/58affafdf7c14c2795853c7d9cf7154f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:38:01.533120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ede744-2c8d-448e-8c6a-2cd63cd40408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:01.535167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ede744-2c8d-448e-8c6a-2cd63cd40408 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:01.538655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d70edd-cc78-462d-a6f4-acdad7d33faa None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:01.539002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d70edd-cc78-462d-a6f4-acdad7d33faa None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:01.539206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d70edd-cc78-462d-a6f4-acdad7d33faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:01.567655 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2941/5842] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:38:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:38:01.585957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-f6d70edd-cc78-462d-a6f4-acdad7d33faa None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:38:01.587432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f6d70edd-cc78-462d-a6f4-acdad7d33faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:01.790046 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2902/5843] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:38:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:38:01.829989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ede744-2c8d-448e-8c6a-2cd63cd40408 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:01.838552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-49ede744-2c8d-448e-8c6a-2cd63cd40408 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:01.896327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ede744-2c8d-448e-8c6a-2cd63cd40408 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:01.951521 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:01.974603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96413fd9-f05d-4718-8744-54a512eca30d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:01.975562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96413fd9-f05d-4718-8744-54a512eca30d service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:01.976115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96413fd9-f05d-4718-8744-54a512eca30d service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:01.976640 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96413fd9-f05d-4718-8744-54a512eca30d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:02.006235 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96413fd9-f05d-4718-8744-54a512eca30d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:02.012002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96413fd9-f05d-4718-8744-54a512eca30d service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:02.037587 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2942/5844] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:38:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:38:03.991823 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d70edd-cc78-462d-a6f4-acdad7d33faa None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:03.993378 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f6d70edd-cc78-462d-a6f4-acdad7d33faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:04.038705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d70edd-cc78-462d-a6f4-acdad7d33faa None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:04.057958 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c2087-c84f-4ae8-996e-a3fdfe2ddeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:04.058712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c2087-c84f-4ae8-996e-a3fdfe2ddeac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:04.058997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c2087-c84f-4ae8-996e-a3fdfe2ddeac admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:04.062632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c2087-c84f-4ae8-996e-a3fdfe2ddeac admin admin] PATH_INFO: `/v3/projects/a6f518184d534a52a01383e9a5e37b5f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:04.066892 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c2087-c84f-4ae8-996e-a3fdfe2ddeac admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6f518184d534a52a01383e9a5e37b5f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:04.081181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c2087-c84f-4ae8-996e-a3fdfe2ddeac admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:04.192760 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:04.221521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-797c2087-c84f-4ae8-996e-a3fdfe2ddeac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6f518184d534a52a01383e9a5e37b5f', 'request_id': 'req-797c2087-c84f-4ae8-996e-a3fdfe2ddeac'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:04.234597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-797c2087-c84f-4ae8-996e-a3fdfe2ddeac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6f518184d534a52a01383e9a5e37b5f', 'request_id': 'req-797c2087-c84f-4ae8-996e-a3fdfe2ddeac'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:04.246589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-797c2087-c84f-4ae8-996e-a3fdfe2ddeac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6f518184d534a52a01383e9a5e37b5f', 'request_id': 'req-797c2087-c84f-4ae8-996e-a3fdfe2ddeac'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:04.270270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-797c2087-c84f-4ae8-996e-a3fdfe2ddeac admin admin] The token cache is being invalidate because project a6f518184d534a52a01383e9a5e37b5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:38:04.270478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-797c2087-c84f-4ae8-996e-a3fdfe2ddeac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:04.271118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-797c2087-c84f-4ae8-996e-a3fdfe2ddeac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:04.272686 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2903/5845] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:38:03 2022] DELETE /identity/v3/projects/a6f518184d534a52a01383e9a5e37b5f => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:38:04.277629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fecc69-86a7-4f35-91f8-b281af20258d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:04.278133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fecc69-86a7-4f35-91f8-b281af20258d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:04.278263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fecc69-86a7-4f35-91f8-b281af20258d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:04.315387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b4fecc69-86a7-4f35-91f8-b281af20258d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:38:04.317535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b4fecc69-86a7-4f35-91f8-b281af20258d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:04.451316 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2943/5846] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:38:04.460135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd05988-447a-4b9a-a0f3-e57562fa032e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:04.460422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd05988-447a-4b9a-a0f3-e57562fa032e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:04.460699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd05988-447a-4b9a-a0f3-e57562fa032e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:04.491995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2fd05988-447a-4b9a-a0f3-e57562fa032e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:38:04.493328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2fd05988-447a-4b9a-a0f3-e57562fa032e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:04.507659 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2904/5847] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:38:04.509405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fecc69-86a7-4f35-91f8-b281af20258d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:04.532412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fecc69-86a7-4f35-91f8-b281af20258d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:04.547359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e05609-5ad7-4dc3-b202-5971ba1e781a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:04.548323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e05609-5ad7-4dc3-b202-5971ba1e781a admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:04.548783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e05609-5ad7-4dc3-b202-5971ba1e781a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:04.549237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e05609-5ad7-4dc3-b202-5971ba1e781a admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:04.550164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e05609-5ad7-4dc3-b202-5971ba1e781a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:38:04.550651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e05609-5ad7-4dc3-b202-5971ba1e781a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:04.556601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e05609-5ad7-4dc3-b202-5971ba1e781a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:04.594998 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2944/5848] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:38:04.595876 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd05988-447a-4b9a-a0f3-e57562fa032e None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:04.613421 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd05988-447a-4b9a-a0f3-e57562fa032e None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:04.621720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399de4ee-ddab-4184-9643-a85b731147b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:04.623027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399de4ee-ddab-4184-9643-a85b731147b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:04.623405 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399de4ee-ddab-4184-9643-a85b731147b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:04.623707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399de4ee-ddab-4184-9643-a85b731147b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:04.624406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399de4ee-ddab-4184-9643-a85b731147b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:04.628363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399de4ee-ddab-4184-9643-a85b731147b6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:04.723388 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2905/5849] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:38:04 2022] POST /identity/v3/projects => generated 357 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:38:04.725094 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e05609-5ad7-4dc3-b202-5971ba1e781a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:04.742770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e05609-5ad7-4dc3-b202-5971ba1e781a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:04.891904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d75879-a06d-4cc9-8886-e59a2dc09685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:04.892881 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d75879-a06d-4cc9-8886-e59a2dc09685 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:04.893466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d75879-a06d-4cc9-8886-e59a2dc09685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:04.893905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d75879-a06d-4cc9-8886-e59a2dc09685 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:04.894725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d75879-a06d-4cc9-8886-e59a2dc09685 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:04.896936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d75879-a06d-4cc9-8886-e59a2dc09685 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:04.954463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399de4ee-ddab-4184-9643-a85b731147b6 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:04.955009 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2945/5850] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:38:04 2022] POST /identity/v3/users => generated 279 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:38:04.994404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399de4ee-ddab-4184-9643-a85b731147b6 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:05.019004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7a214-3f0d-4e47-a3b0-361aebac9aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:05.020678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7a214-3f0d-4e47-a3b0-361aebac9aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:05.022511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7a214-3f0d-4e47-a3b0-361aebac9aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:05.026170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7a214-3f0d-4e47-a3b0-361aebac9aa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:05.027539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7a214-3f0d-4e47-a3b0-361aebac9aa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:05.031457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7a214-3f0d-4e47-a3b0-361aebac9aa3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:05.086624 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2906/5851] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:38:05.091094 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d75879-a06d-4cc9-8886-e59a2dc09685 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:05.118762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d75879-a06d-4cc9-8886-e59a2dc09685 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:05.147585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcac1ea-a099-4f8a-ba6f-213143dbc2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:05.148251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcac1ea-a099-4f8a-ba6f-213143dbc2dc admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:05.148529 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcac1ea-a099-4f8a-ba6f-213143dbc2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:05.148813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcac1ea-a099-4f8a-ba6f-213143dbc2dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:05.152221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcac1ea-a099-4f8a-ba6f-213143dbc2dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:05.153853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcac1ea-a099-4f8a-ba6f-213143dbc2dc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:05.186780 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2946/5852] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:38:05.187595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7a214-3f0d-4e47-a3b0-361aebac9aa3 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:05.213541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7a214-3f0d-4e47-a3b0-361aebac9aa3 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:05.247004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4079cdd-8202-4bed-9a10-039b626c18d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:05.249310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4079cdd-8202-4bed-9a10-039b626c18d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:05.249803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4079cdd-8202-4bed-9a10-039b626c18d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:05.250242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4079cdd-8202-4bed-9a10-039b626c18d8 admin admin] PATH_INFO: `/v3/projects/76c55f5e459541709d9f2d08e208b570/users/077714d216034700a0e43ea5a643d9da/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:05.308817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4079cdd-8202-4bed-9a10-039b626c18d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76c55f5e459541709d9f2d08e208b570, user_id=077714d216034700a0e43ea5a643d9da, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:05.322094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4079cdd-8202-4bed-9a10-039b626c18d8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:05.356974 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2907/5853] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:38:05 2022] PUT /identity/v3/projects/76c55f5e459541709d9f2d08e208b570/users/077714d216034700a0e43ea5a643d9da/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:38:05.367906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0e3fa-5047-4a63-bf44-a3e022275993 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:05.368414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0e3fa-5047-4a63-bf44-a3e022275993 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:05.368577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0e3fa-5047-4a63-bf44-a3e022275993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:05.438526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-8ac0e3fa-5047-4a63-bf44-a3e022275993 None None] MFA Rules not processed for user `077714d216034700a0e43ea5a643d9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:38:05.447798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8ac0e3fa-5047-4a63-bf44-a3e022275993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:05.527508 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:05.611987 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2947/5854] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:38:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:38:05.616462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4079cdd-8202-4bed-9a10-039b626c18d8 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:05.735925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4079cdd-8202-4bed-9a10-039b626c18d8 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:05.747666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c90295-1424-4aae-953e-1ea9efa407ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:05.749160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c90295-1424-4aae-953e-1ea9efa407ea admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:05.749664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c90295-1424-4aae-953e-1ea9efa407ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:05.750185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c90295-1424-4aae-953e-1ea9efa407ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:05.751030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c90295-1424-4aae-953e-1ea9efa407ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:05.755359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c90295-1424-4aae-953e-1ea9efa407ea admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:05.804488 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2908/5855] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:38:05 2022] POST /identity/v3/projects => generated 355 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:38:05.805656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0e3fa-5047-4a63-bf44-a3e022275993 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:05.822024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0e3fa-5047-4a63-bf44-a3e022275993 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:05.986059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d900e-bed3-4025-b077-5f451f54638f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:05.988409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d900e-bed3-4025-b077-5f451f54638f admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:05.988676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d900e-bed3-4025-b077-5f451f54638f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:05.989422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d900e-bed3-4025-b077-5f451f54638f admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:05.989764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d900e-bed3-4025-b077-5f451f54638f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:05.991919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d900e-bed3-4025-b077-5f451f54638f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:06.059623 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2948/5856] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:38:05 2022] POST /identity/v3/users => generated 284 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:38:06.065607 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c90295-1424-4aae-953e-1ea9efa407ea admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:06.099964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c90295-1424-4aae-953e-1ea9efa407ea admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:06.121239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822fd49-7775-492b-9393-45ec81812156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:06.122476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822fd49-7775-492b-9393-45ec81812156 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:06.126082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822fd49-7775-492b-9393-45ec81812156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:06.127914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822fd49-7775-492b-9393-45ec81812156 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:06.130176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822fd49-7775-492b-9393-45ec81812156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:06.133923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822fd49-7775-492b-9393-45ec81812156 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:06.178356 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2909/5857] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:38:06.179319 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d900e-bed3-4025-b077-5f451f54638f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:06.198007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a5609-422d-4046-a917-a04c5873393e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:06.198291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a5609-422d-4046-a917-a04c5873393e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:06.198617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a5609-422d-4046-a917-a04c5873393e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:06.206601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d900e-bed3-4025-b077-5f451f54638f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:06.224759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff040b82-a697-4898-9e9c-29e7e8a75174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:06.225754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff040b82-a697-4898-9e9c-29e7e8a75174 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:06.226222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff040b82-a697-4898-9e9c-29e7e8a75174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:06.226679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff040b82-a697-4898-9e9c-29e7e8a75174 admin admin] PATH_INFO: `/v3/projects/d8b9caf9a4594e38b2cf77a57f55ab51/users/1c5ca437ca6f4ac68a99f2166db34125/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:06.238770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3d1a5609-422d-4046-a917-a04c5873393e None None] MFA Rules not processed for user `d556a8ae0d524894a93203ce3f70d420`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:38:06.240422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3d1a5609-422d-4046-a917-a04c5873393e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:06.266745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff040b82-a697-4898-9e9c-29e7e8a75174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8b9caf9a4594e38b2cf77a57f55ab51, user_id=1c5ca437ca6f4ac68a99f2166db34125, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:06.275370 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff040b82-a697-4898-9e9c-29e7e8a75174 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:06.295216 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:06.309514 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2949/5858] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:38:06 2022] PUT /identity/v3/projects/d8b9caf9a4594e38b2cf77a57f55ab51/users/1c5ca437ca6f4ac68a99f2166db34125/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:38:06.317310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff040b82-a697-4898-9e9c-29e7e8a75174 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:06.372907 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2910/5859] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:38:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:38:06.463192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff040b82-a697-4898-9e9c-29e7e8a75174 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:06.472565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff021566-9196-445c-a45e-fda6df92549a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:06.473997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff021566-9196-445c-a45e-fda6df92549a admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:06.475647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff021566-9196-445c-a45e-fda6df92549a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:06.476070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff021566-9196-445c-a45e-fda6df92549a admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:06.476850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff021566-9196-445c-a45e-fda6df92549a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:06.480226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff021566-9196-445c-a45e-fda6df92549a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:06.505876 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2950/5860] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:38:06.509682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a5609-422d-4046-a917-a04c5873393e None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:06.534130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a5609-422d-4046-a917-a04c5873393e None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:06.548649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243b2bc-06a8-4d1d-939a-8170c73801e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:06.550628 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243b2bc-06a8-4d1d-939a-8170c73801e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:06.550931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243b2bc-06a8-4d1d-939a-8170c73801e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:06.551211 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243b2bc-06a8-4d1d-939a-8170c73801e0 admin admin] PATH_INFO: `/v3/projects/d8b9caf9a4594e38b2cf77a57f55ab51/users/1c5ca437ca6f4ac68a99f2166db34125/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:06.554361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243b2bc-06a8-4d1d-939a-8170c73801e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8b9caf9a4594e38b2cf77a57f55ab51, user_id=1c5ca437ca6f4ac68a99f2166db34125, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:06.557781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243b2bc-06a8-4d1d-939a-8170c73801e0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:06.584717 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2911/5861] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:38:06 2022] PUT /identity/v3/projects/d8b9caf9a4594e38b2cf77a57f55ab51/users/1c5ca437ca6f4ac68a99f2166db34125/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:38:06.587136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762726b5-7360-480b-b6b4-9b8c84c1ebfe None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:06.587441 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762726b5-7360-480b-b6b4-9b8c84c1ebfe None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:06.587745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762726b5-7360-480b-b6b4-9b8c84c1ebfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:06.663300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-762726b5-7360-480b-b6b4-9b8c84c1ebfe None None] MFA Rules not processed for user `1c5ca437ca6f4ac68a99f2166db34125`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:38:06.664675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-762726b5-7360-480b-b6b4-9b8c84c1ebfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:06.738212 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:06.863745 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2951/5862] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:38:06 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:38:06.869048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243b2bc-06a8-4d1d-939a-8170c73801e0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:06.883574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243b2bc-06a8-4d1d-939a-8170c73801e0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:06.897812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be01536-0a69-4004-a389-7ba92e7e60a4 tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ca437ca6f4ac68a99f2166db34125', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8b9caf9a4594e38b2cf77a57f55ab51', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:06.898435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be01536-0a69-4004-a389-7ba92e7e60a4 tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:06.898721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be01536-0a69-4004-a389-7ba92e7e60a4 tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:06.899034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be01536-0a69-4004-a389-7ba92e7e60a4 tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:06.900386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be01536-0a69-4004-a389-7ba92e7e60a4 tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:38:06.900386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be01536-0a69-4004-a389-7ba92e7e60a4 tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:06.901642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be01536-0a69-4004-a389-7ba92e7e60a4 tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:06.917290 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2912/5863] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:38:06.924819 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762726b5-7360-480b-b6b4-9b8c84c1ebfe None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:06.943113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762726b5-7360-480b-b6b4-9b8c84c1ebfe None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:06.948745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4ce45-bcec-4cb2-98cb-8605294ef19b tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ca437ca6f4ac68a99f2166db34125', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8b9caf9a4594e38b2cf77a57f55ab51', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:06.949691 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4ce45-bcec-4cb2-98cb-8605294ef19b tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:06.950087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4ce45-bcec-4cb2-98cb-8605294ef19b tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:06.950395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4ce45-bcec-4cb2-98cb-8605294ef19b tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:06.951067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4ce45-bcec-4cb2-98cb-8605294ef19b tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:06.953697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4ce45-bcec-4cb2-98cb-8605294ef19b tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:07.019131 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2952/5864] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:38:06 2022] POST /identity/v3/projects => generated 349 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:38:07.022945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be01536-0a69-4004-a389-7ba92e7e60a4 tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:07.056513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be01536-0a69-4004-a389-7ba92e7e60a4 tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:07.171113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da409596-3a58-4f8c-a185-e70f0578eeac tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ca437ca6f4ac68a99f2166db34125', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8b9caf9a4594e38b2cf77a57f55ab51', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:07.173033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da409596-3a58-4f8c-a185-e70f0578eeac tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:07.173497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da409596-3a58-4f8c-a185-e70f0578eeac tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:07.175851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da409596-3a58-4f8c-a185-e70f0578eeac tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:07.176829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da409596-3a58-4f8c-a185-e70f0578eeac tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:38:07.178213 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da409596-3a58-4f8c-a185-e70f0578eeac tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:07.180585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da409596-3a58-4f8c-a185-e70f0578eeac tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:07.198667 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2913/5865] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:38:07.329532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4ce45-bcec-4cb2-98cb-8605294ef19b tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:07.335116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0ab4ce45-bcec-4cb2-98cb-8605294ef19b tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:07.530331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4ce45-bcec-4cb2-98cb-8605294ef19b tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:07.551283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589c90a-d72b-4ac7-9796-15ee2195529a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:07.552189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589c90a-d72b-4ac7-9796-15ee2195529a service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:07.553440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589c90a-d72b-4ac7-9796-15ee2195529a service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:07.555095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589c90a-d72b-4ac7-9796-15ee2195529a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:07.585870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589c90a-d72b-4ac7-9796-15ee2195529a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:07.602432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589c90a-d72b-4ac7-9796-15ee2195529a service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:07.635175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da409596-3a58-4f8c-a185-e70f0578eeac tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:07.637252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-da409596-3a58-4f8c-a185-e70f0578eeac tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:07.647012 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2953/5866] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:38:07 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:38:07.663036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da409596-3a58-4f8c-a185-e70f0578eeac tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:07.676084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9416ab-37c8-4a23-a56b-aeb644520dc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:07.676773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9416ab-37c8-4a23-a56b-aeb644520dc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:07.677058 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9416ab-37c8-4a23-a56b-aeb644520dc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:07.677336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9416ab-37c8-4a23-a56b-aeb644520dc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:07.679978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3f9416ab-37c8-4a23-a56b-aeb644520dc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:07.711250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9416ab-37c8-4a23-a56b-aeb644520dc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:07.715018 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9416ab-37c8-4a23-a56b-aeb644520dc1 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:07.746403 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2914/5867] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:38:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:38:08.786708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589c90a-d72b-4ac7-9796-15ee2195529a service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:08.801770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589c90a-d72b-4ac7-9796-15ee2195529a service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:08.814285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074a3af-9623-4cef-a11c-b13a33498939 tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c5ca437ca6f4ac68a99f2166db34125', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8b9caf9a4594e38b2cf77a57f55ab51', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:08.815141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074a3af-9623-4cef-a11c-b13a33498939 tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:08.816060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074a3af-9623-4cef-a11c-b13a33498939 tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:08.816987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074a3af-9623-4cef-a11c-b13a33498939 tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] PATH_INFO: `/v3/projects/b560dd152a5b4476b009266c56e9cac6` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:08.820800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074a3af-9623-4cef-a11c-b13a33498939 tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b560dd152a5b4476b009266c56e9cac6)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:08.823783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074a3af-9623-4cef-a11c-b13a33498939 tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:08.932978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e074a3af-9623-4cef-a11c-b13a33498939 tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b560dd152a5b4476b009266c56e9cac6', 'request_id': 'req-e074a3af-9623-4cef-a11c-b13a33498939'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:08.949570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e074a3af-9623-4cef-a11c-b13a33498939 tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b560dd152a5b4476b009266c56e9cac6', 'request_id': 'req-e074a3af-9623-4cef-a11c-b13a33498939'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:08.978857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e074a3af-9623-4cef-a11c-b13a33498939 tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b560dd152a5b4476b009266c56e9cac6', 'request_id': 'req-e074a3af-9623-4cef-a11c-b13a33498939'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:09.020880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e074a3af-9623-4cef-a11c-b13a33498939 tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] The token cache is being invalidate because project b560dd152a5b4476b009266c56e9cac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:38:09.021173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e074a3af-9623-4cef-a11c-b13a33498939 tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:09.021852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e074a3af-9623-4cef-a11c-b13a33498939 tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:09.030222 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2954/5868] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:38:08 2022] DELETE /identity/v3/projects/b560dd152a5b4476b009266c56e9cac6 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:38:09.441767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9416ab-37c8-4a23-a56b-aeb644520dc1 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:09.614413 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9416ab-37c8-4a23-a56b-aeb644520dc1 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:09.657042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074a3af-9623-4cef-a11c-b13a33498939 tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:09.660005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e074a3af-9623-4cef-a11c-b13a33498939 tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:09.709173 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:09.731549 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:09.747741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e559de3-1974-4b2c-a838-5fa0e5bb865a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:09.748537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e559de3-1974-4b2c-a838-5fa0e5bb865a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:09.748949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e559de3-1974-4b2c-a838-5fa0e5bb865a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:09.749214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e559de3-1974-4b2c-a838-5fa0e5bb865a admin admin] PATH_INFO: `/v3/users/077714d216034700a0e43ea5a643d9da` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:09.753830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e559de3-1974-4b2c-a838-5fa0e5bb865a admin admin] RBAC: Authorizing `identity:delete_user(user_id=077714d216034700a0e43ea5a643d9da)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:09.756171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e559de3-1974-4b2c-a838-5fa0e5bb865a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:09.803802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074a3af-9623-4cef-a11c-b13a33498939 tempest-QuotasTest-654421566 tempest-QuotasTest-654421566-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:09.811256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f37011-6f62-49fd-9d6a-865512a867b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:09.812070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f37011-6f62-49fd-9d6a-865512a867b6 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:09.812503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f37011-6f62-49fd-9d6a-865512a867b6 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:09.812840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f37011-6f62-49fd-9d6a-865512a867b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:09.814868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f8f37011-6f62-49fd-9d6a-865512a867b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:09.834323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f37011-6f62-49fd-9d6a-865512a867b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:09.837124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f37011-6f62-49fd-9d6a-865512a867b6 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:09.858357 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2955/5869] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:38:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:38:09.893274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6e559de3-1974-4b2c-a838-5fa0e5bb865a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '077714d216034700a0e43ea5a643d9da'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:09.914097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6e559de3-1974-4b2c-a838-5fa0e5bb865a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '077714d216034700a0e43ea5a643d9da'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:09.954429 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6e559de3-1974-4b2c-a838-5fa0e5bb865a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '077714d216034700a0e43ea5a643d9da'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:09.955156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6e559de3-1974-4b2c-a838-5fa0e5bb865a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '077714d216034700a0e43ea5a643d9da'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:09.989527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6e559de3-1974-4b2c-a838-5fa0e5bb865a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '077714d216034700a0e43ea5a643d9da'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:10.006966 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2915/5870] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:38:09 2022] DELETE /identity/v3/users/077714d216034700a0e43ea5a643d9da => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:38:10.012460 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de2b8e-9dbe-47bd-8622-aa8c29c475fe None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:10.013712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de2b8e-9dbe-47bd-8622-aa8c29c475fe None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:10.015254 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de2b8e-9dbe-47bd-8622-aa8c29c475fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:10.087808 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-36de2b8e-9dbe-47bd-8622-aa8c29c475fe None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:38:10.099111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-36de2b8e-9dbe-47bd-8622-aa8c29c475fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:10.259077 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2956/5871] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:38:10.303095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e559de3-1974-4b2c-a838-5fa0e5bb865a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:10.305106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6e559de3-1974-4b2c-a838-5fa0e5bb865a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:10.451765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e559de3-1974-4b2c-a838-5fa0e5bb865a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:10.463343 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f389d7-58b9-4dee-bc2f-4cb24e914ab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:10.464022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f389d7-58b9-4dee-bc2f-4cb24e914ab5 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:10.464291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f389d7-58b9-4dee-bc2f-4cb24e914ab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:10.464572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f389d7-58b9-4dee-bc2f-4cb24e914ab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:10.497457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f389d7-58b9-4dee-bc2f-4cb24e914ab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:10.498894 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f389d7-58b9-4dee-bc2f-4cb24e914ab5 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:10.512181 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2916/5872] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:38:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:38:12.356726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de2b8e-9dbe-47bd-8622-aa8c29c475fe None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:12.359371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-36de2b8e-9dbe-47bd-8622-aa8c29c475fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:12.375004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de2b8e-9dbe-47bd-8622-aa8c29c475fe None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:12.381844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50a0fa-49de-485d-9693-d1a574f614fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:12.382675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50a0fa-49de-485d-9693-d1a574f614fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:12.382957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50a0fa-49de-485d-9693-d1a574f614fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:12.383227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50a0fa-49de-485d-9693-d1a574f614fc admin admin] PATH_INFO: `/v3/projects/76c55f5e459541709d9f2d08e208b570` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:12.384543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50a0fa-49de-485d-9693-d1a574f614fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=76c55f5e459541709d9f2d08e208b570)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:12.387566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50a0fa-49de-485d-9693-d1a574f614fc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:12.454893 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5d50a0fa-49de-485d-9693-d1a574f614fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76c55f5e459541709d9f2d08e208b570', 'request_id': 'req-5d50a0fa-49de-485d-9693-d1a574f614fc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:12.461648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5d50a0fa-49de-485d-9693-d1a574f614fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76c55f5e459541709d9f2d08e208b570', 'request_id': 'req-5d50a0fa-49de-485d-9693-d1a574f614fc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:12.469388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5d50a0fa-49de-485d-9693-d1a574f614fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76c55f5e459541709d9f2d08e208b570', 'request_id': 'req-5d50a0fa-49de-485d-9693-d1a574f614fc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:12.486446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5d50a0fa-49de-485d-9693-d1a574f614fc admin admin] The token cache is being invalidate because project 76c55f5e459541709d9f2d08e208b570 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:38:12.487237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5d50a0fa-49de-485d-9693-d1a574f614fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:12.488147 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5d50a0fa-49de-485d-9693-d1a574f614fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:12.491331 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2957/5873] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:38:12 2022] DELETE /identity/v3/projects/76c55f5e459541709d9f2d08e208b570 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:38:12.495358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f389d7-58b9-4dee-bc2f-4cb24e914ab5 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:12.507320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f389d7-58b9-4dee-bc2f-4cb24e914ab5 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:12.599543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c97c5-6924-4139-ae87-784ef4c433aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:12.600687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c97c5-6924-4139-ae87-784ef4c433aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:12.601180 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c97c5-6924-4139-ae87-784ef4c433aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:12.601679 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c97c5-6924-4139-ae87-784ef4c433aa admin admin] PATH_INFO: `/v3/users/1c5ca437ca6f4ac68a99f2166db34125` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:12.603566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c97c5-6924-4139-ae87-784ef4c433aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c5ca437ca6f4ac68a99f2166db34125)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:12.606237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c97c5-6924-4139-ae87-784ef4c433aa admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:12.611510 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:12.758017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c98c97c5-6924-4139-ae87-784ef4c433aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c5ca437ca6f4ac68a99f2166db34125'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:12.777142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c98c97c5-6924-4139-ae87-784ef4c433aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c5ca437ca6f4ac68a99f2166db34125'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:12.800878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c98c97c5-6924-4139-ae87-784ef4c433aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c5ca437ca6f4ac68a99f2166db34125'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:12.802071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c98c97c5-6924-4139-ae87-784ef4c433aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c5ca437ca6f4ac68a99f2166db34125'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:12.813615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c98c97c5-6924-4139-ae87-784ef4c433aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c5ca437ca6f4ac68a99f2166db34125'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:12.823392 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2917/5874] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:38:12 2022] DELETE /identity/v3/users/1c5ca437ca6f4ac68a99f2166db34125 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:38:14.852664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50a0fa-49de-485d-9693-d1a574f614fc admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:14.854849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5d50a0fa-49de-485d-9693-d1a574f614fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:14.898047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50a0fa-49de-485d-9693-d1a574f614fc admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:15.059537 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:15.207080 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f2747-f02f-4eb3-b9f0-712191e12a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:15.208642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f2747-f02f-4eb3-b9f0-712191e12a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:15.209400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f2747-f02f-4eb3-b9f0-712191e12a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:15.210016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f2747-f02f-4eb3-b9f0-712191e12a18 admin admin] PATH_INFO: `/v3/projects/d8b9caf9a4594e38b2cf77a57f55ab51` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:15.212742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f2747-f02f-4eb3-b9f0-712191e12a18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8b9caf9a4594e38b2cf77a57f55ab51)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:15.217460 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f2747-f02f-4eb3-b9f0-712191e12a18 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:15.375380 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-601f2747-f02f-4eb3-b9f0-712191e12a18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8b9caf9a4594e38b2cf77a57f55ab51', 'request_id': 'req-601f2747-f02f-4eb3-b9f0-712191e12a18'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:15.396610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-601f2747-f02f-4eb3-b9f0-712191e12a18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8b9caf9a4594e38b2cf77a57f55ab51', 'request_id': 'req-601f2747-f02f-4eb3-b9f0-712191e12a18'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:15.424902 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-601f2747-f02f-4eb3-b9f0-712191e12a18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8b9caf9a4594e38b2cf77a57f55ab51', 'request_id': 'req-601f2747-f02f-4eb3-b9f0-712191e12a18'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:15.442328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-601f2747-f02f-4eb3-b9f0-712191e12a18 admin admin] The token cache is being invalidate because project d8b9caf9a4594e38b2cf77a57f55ab51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:38:15.442943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-601f2747-f02f-4eb3-b9f0-712191e12a18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:15.446211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-601f2747-f02f-4eb3-b9f0-712191e12a18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:15.449525 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2958/5875] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:38:14 2022] DELETE /identity/v3/projects/d8b9caf9a4594e38b2cf77a57f55ab51 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:38:15.457664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e7c9a-366d-4388-9c36-08e59559c5e4 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:15.458279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e7c9a-366d-4388-9c36-08e59559c5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:15.458428 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e7c9a-366d-4388-9c36-08e59559c5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:15.516858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0e5e7c9a-366d-4388-9c36-08e59559c5e4 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:38:15.522469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0e5e7c9a-366d-4388-9c36-08e59559c5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:15.703230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e801ce-4f70-4892-a8c5-4fcd0707fbd9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:15.703969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e801ce-4f70-4892-a8c5-4fcd0707fbd9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:15.704474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e801ce-4f70-4892-a8c5-4fcd0707fbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:15.712363 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2918/5876] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:38:15.753006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-98e801ce-4f70-4892-a8c5-4fcd0707fbd9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:38:15.758207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-98e801ce-4f70-4892-a8c5-4fcd0707fbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:15.789911 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2959/5877] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:38:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:38:15.794105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e7c9a-366d-4388-9c36-08e59559c5e4 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:15.809665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e7c9a-366d-4388-9c36-08e59559c5e4 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:15.831399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8dcca3-2970-45af-8dcb-5694204fecd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:15.832076 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8dcca3-2970-45af-8dcb-5694204fecd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:15.832576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8dcca3-2970-45af-8dcb-5694204fecd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:15.833048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8dcca3-2970-45af-8dcb-5694204fecd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:15.833890 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8dcca3-2970-45af-8dcb-5694204fecd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:38:15.834379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8dcca3-2970-45af-8dcb-5694204fecd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:15.836255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8dcca3-2970-45af-8dcb-5694204fecd8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:15.875284 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2919/5878] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:38:15.881192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e801ce-4f70-4892-a8c5-4fcd0707fbd9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:15.899152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e801ce-4f70-4892-a8c5-4fcd0707fbd9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:15.926369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7274a-3f82-4a30-9864-7f0342225411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:15.928991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7274a-3f82-4a30-9864-7f0342225411 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:15.929279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7274a-3f82-4a30-9864-7f0342225411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:15.929557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7274a-3f82-4a30-9864-7f0342225411 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:15.933285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7274a-3f82-4a30-9864-7f0342225411 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:15.939484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7274a-3f82-4a30-9864-7f0342225411 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:16.027719 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2960/5879] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:38:15 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:38:16.032260 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8dcca3-2970-45af-8dcb-5694204fecd8 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:16.042595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8dcca3-2970-45af-8dcb-5694204fecd8 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:16.268612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254c19d-437f-49b1-80c2-1f37ee101790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:16.269509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254c19d-437f-49b1-80c2-1f37ee101790 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:16.269641 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254c19d-437f-49b1-80c2-1f37ee101790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:16.269892 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254c19d-437f-49b1-80c2-1f37ee101790 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:16.270538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254c19d-437f-49b1-80c2-1f37ee101790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:16.278019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254c19d-437f-49b1-80c2-1f37ee101790 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:16.321050 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:16.334491 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2920/5880] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:38:16 2022] POST /identity/v3/users => generated 287 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:38:16.335071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7274a-3f82-4a30-9864-7f0342225411 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:16.352253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7274a-3f82-4a30-9864-7f0342225411 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:16.362397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc85973-9466-4cc5-8333-f71d617d6d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:16.363619 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc85973-9466-4cc5-8333-f71d617d6d41 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:16.364131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc85973-9466-4cc5-8333-f71d617d6d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:16.364668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc85973-9466-4cc5-8333-f71d617d6d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:16.365782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc85973-9466-4cc5-8333-f71d617d6d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:16.368588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc85973-9466-4cc5-8333-f71d617d6d41 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:16.430847 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2961/5881] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:38:16.436673 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254c19d-437f-49b1-80c2-1f37ee101790 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:16.453203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254c19d-437f-49b1-80c2-1f37ee101790 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:16.464104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7c7a9-b1e8-45c9-bf91-6d079ceaa762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:16.467315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7c7a9-b1e8-45c9-bf91-6d079ceaa762 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:16.467608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7c7a9-b1e8-45c9-bf91-6d079ceaa762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:16.467920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7c7a9-b1e8-45c9-bf91-6d079ceaa762 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:16.471268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac7c7a9-b1e8-45c9-bf91-6d079ceaa762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:16.474122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac7c7a9-b1e8-45c9-bf91-6d079ceaa762 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:16.496902 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc85973-9466-4cc5-8333-f71d617d6d41 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:16.497846 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2921/5882] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:38:16.511340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc85973-9466-4cc5-8333-f71d617d6d41 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:16.557506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39644ad-06f9-460d-bd1b-1e339446cec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:16.558212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39644ad-06f9-460d-bd1b-1e339446cec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:16.558497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39644ad-06f9-460d-bd1b-1e339446cec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:16.564876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39644ad-06f9-460d-bd1b-1e339446cec6 admin admin] PATH_INFO: `/v3/projects/d0df27eb51f842b3ab3c31e5105cdd5d/users/b28c750cc13d4a168866de3d6571a256/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:16.632232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39644ad-06f9-460d-bd1b-1e339446cec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0df27eb51f842b3ab3c31e5105cdd5d, user_id=b28c750cc13d4a168866de3d6571a256, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:16.640122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39644ad-06f9-460d-bd1b-1e339446cec6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:16.691913 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2962/5883] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:38:16 2022] PUT /identity/v3/projects/d0df27eb51f842b3ab3c31e5105cdd5d/users/b28c750cc13d4a168866de3d6571a256/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:38:16.703832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af535ebb-9b71-4dfc-8558-2e3f25621d57 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:16.704168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af535ebb-9b71-4dfc-8558-2e3f25621d57 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:16.704444 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af535ebb-9b71-4dfc-8558-2e3f25621d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:16.766058 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-af535ebb-9b71-4dfc-8558-2e3f25621d57 None None] MFA Rules not processed for user `b28c750cc13d4a168866de3d6571a256`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:38:16.767584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-af535ebb-9b71-4dfc-8558-2e3f25621d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:16.930671 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2922/5884] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:38:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:38:16.963850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39644ad-06f9-460d-bd1b-1e339446cec6 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:16.966551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a39644ad-06f9-460d-bd1b-1e339446cec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:17.102018 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39644ad-06f9-460d-bd1b-1e339446cec6 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:17.110491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffaa2c-ac94-4880-8106-790926875727 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:17.112480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffaa2c-ac94-4880-8106-790926875727 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:17.114117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffaa2c-ac94-4880-8106-790926875727 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:17.115518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffaa2c-ac94-4880-8106-790926875727 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:17.135336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ffaa2c-ac94-4880-8106-790926875727 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:17.136962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ffaa2c-ac94-4880-8106-790926875727 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:17.141912 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:17.162595 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2963/5885] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:38:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:38:19.473173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af535ebb-9b71-4dfc-8558-2e3f25621d57 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:19.624631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af535ebb-9b71-4dfc-8558-2e3f25621d57 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:19.641460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceac030-ab70-48ad-9016-8e50eb79c1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:19.642118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceac030-ab70-48ad-9016-8e50eb79c1a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:19.642480 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceac030-ab70-48ad-9016-8e50eb79c1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:19.642831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceac030-ab70-48ad-9016-8e50eb79c1a3 admin admin] PATH_INFO: `/v3/users/b28c750cc13d4a168866de3d6571a256` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:19.644272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceac030-ab70-48ad-9016-8e50eb79c1a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b28c750cc13d4a168866de3d6571a256)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:19.649824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceac030-ab70-48ad-9016-8e50eb79c1a3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:19.787693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bceac030-ab70-48ad-9016-8e50eb79c1a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b28c750cc13d4a168866de3d6571a256'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:19.812119 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bceac030-ab70-48ad-9016-8e50eb79c1a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b28c750cc13d4a168866de3d6571a256'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:19.847408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bceac030-ab70-48ad-9016-8e50eb79c1a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b28c750cc13d4a168866de3d6571a256'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:19.848359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bceac030-ab70-48ad-9016-8e50eb79c1a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b28c750cc13d4a168866de3d6571a256'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:19.855696 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:19.862649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bceac030-ab70-48ad-9016-8e50eb79c1a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b28c750cc13d4a168866de3d6571a256'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:19.885920 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2923/5886] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:38:19 2022] DELETE /identity/v3/users/b28c750cc13d4a168866de3d6571a256 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:38:19.892134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1dbf16-137b-47d5-8272-fd11e411496d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:19.892702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1dbf16-137b-47d5-8272-fd11e411496d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:19.893061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1dbf16-137b-47d5-8272-fd11e411496d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:19.950567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ba1dbf16-137b-47d5-8272-fd11e411496d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:38:19.957447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ba1dbf16-137b-47d5-8272-fd11e411496d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:20.090663 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2964/5887] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:38:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:38:20.221035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceac030-ab70-48ad-9016-8e50eb79c1a3 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:20.222815 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bceac030-ab70-48ad-9016-8e50eb79c1a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:20.380366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceac030-ab70-48ad-9016-8e50eb79c1a3 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:20.385063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1dbf16-137b-47d5-8272-fd11e411496d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:20.385532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51dc374-2430-4b1f-9f26-4d5030eae6b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:20.386306 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51dc374-2430-4b1f-9f26-4d5030eae6b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:20.386686 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51dc374-2430-4b1f-9f26-4d5030eae6b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:20.387062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51dc374-2430-4b1f-9f26-4d5030eae6b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:20.387448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ba1dbf16-137b-47d5-8272-fd11e411496d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:20.399589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51dc374-2430-4b1f-9f26-4d5030eae6b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:20.401569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51dc374-2430-4b1f-9f26-4d5030eae6b3 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:20.434678 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2924/5888] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:38:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:38:20.535154 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1dbf16-137b-47d5-8272-fd11e411496d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:20.541708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cf45e-d794-4e59-ba77-35aa8eb1d46d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:20.542455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cf45e-d794-4e59-ba77-35aa8eb1d46d service glance] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:20.542690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cf45e-d794-4e59-ba77-35aa8eb1d46d service glance] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:20.543160 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cf45e-d794-4e59-ba77-35aa8eb1d46d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:20.550740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2a6cf45e-d794-4e59-ba77-35aa8eb1d46d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:20.694032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6cf45e-d794-4e59-ba77-35aa8eb1d46d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:20.695854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6cf45e-d794-4e59-ba77-35aa8eb1d46d service glance] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:20.714433 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2965/5889] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:38:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:38:20.878948 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51dc374-2430-4b1f-9f26-4d5030eae6b3 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:20.913987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51dc374-2430-4b1f-9f26-4d5030eae6b3 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:20.923069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2cc37c-6425-4e33-80c4-479ca093304b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:20.926987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cc37c-6425-4e33-80c4-479ca093304b service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:20.927754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cc37c-6425-4e33-80c4-479ca093304b service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:20.928920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2cc37c-6425-4e33-80c4-479ca093304b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:20.937126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4c2cc37c-6425-4e33-80c4-479ca093304b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:20.957186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2cc37c-6425-4e33-80c4-479ca093304b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:20.958903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2cc37c-6425-4e33-80c4-479ca093304b service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:20.984424 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2925/5890] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:38:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:38:21.544744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34dab21-3cc7-4181-b19c-5fa53228c891 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:21.546391 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34dab21-3cc7-4181-b19c-5fa53228c891 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:21.547000 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34dab21-3cc7-4181-b19c-5fa53228c891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:21.641441 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e34dab21-3cc7-4181-b19c-5fa53228c891 None None] MFA Rules not processed for user `68324eedf5c840f4806f4c4ae410774f`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:38:21.645832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e34dab21-3cc7-4181-b19c-5fa53228c891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:21.677895 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:21.766008 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2966/5891] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:38:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:38:21.770351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2cc37c-6425-4e33-80c4-479ca093304b service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:21.772323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4c2cc37c-6425-4e33-80c4-479ca093304b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:21.790310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2cc37c-6425-4e33-80c4-479ca093304b service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:21.796203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f502272-120b-4784-ad8b-4d1325554094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:21.797163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f502272-120b-4784-ad8b-4d1325554094 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:21.797647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f502272-120b-4784-ad8b-4d1325554094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:21.798208 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f502272-120b-4784-ad8b-4d1325554094 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:21.799203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f502272-120b-4784-ad8b-4d1325554094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:21.801516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f502272-120b-4784-ad8b-4d1325554094 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:21.814453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34dab21-3cc7-4181-b19c-5fa53228c891 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:21.816339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e34dab21-3cc7-4181-b19c-5fa53228c891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:21.902177 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2926/5892] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:38:21 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:38:21.907618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f502272-120b-4784-ad8b-4d1325554094 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:22.041431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34dab21-3cc7-4181-b19c-5fa53228c891 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:22.072376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f502272-120b-4784-ad8b-4d1325554094 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:22.096877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af869e80-bfaf-4008-a20c-cb844919adc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:22.097873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af869e80-bfaf-4008-a20c-cb844919adc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:22.098438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af869e80-bfaf-4008-a20c-cb844919adc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:22.098936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af869e80-bfaf-4008-a20c-cb844919adc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:22.101157 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af869e80-bfaf-4008-a20c-cb844919adc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:22.104919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af869e80-bfaf-4008-a20c-cb844919adc9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:22.136347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6b84b-a7ee-4b36-887e-ce11cc38235c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:22.138914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6b84b-a7ee-4b36-887e-ce11cc38235c service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:22.138914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6b84b-a7ee-4b36-887e-ce11cc38235c service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:22.139235 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6b84b-a7ee-4b36-887e-ce11cc38235c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:22.142540 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3ab6b84b-a7ee-4b36-887e-ce11cc38235c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:22.157396 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2927/5893] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:38:21 2022] POST /identity/v3/users => generated 297 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:38:22.161171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af869e80-bfaf-4008-a20c-cb844919adc9 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:22.164587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab6b84b-a7ee-4b36-887e-ce11cc38235c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:22.167029 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab6b84b-a7ee-4b36-887e-ce11cc38235c service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:22.187279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af869e80-bfaf-4008-a20c-cb844919adc9 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:22.188065 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2967/5894] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:38:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:38:22.206057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70cfe4-e2b1-4d99-a356-f12cff64594d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:22.207004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70cfe4-e2b1-4d99-a356-f12cff64594d admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:22.207578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70cfe4-e2b1-4d99-a356-f12cff64594d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:22.208089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70cfe4-e2b1-4d99-a356-f12cff64594d admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:22.208757 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f70cfe4-e2b1-4d99-a356-f12cff64594d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:22.212619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f70cfe4-e2b1-4d99-a356-f12cff64594d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:22.272311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6b84b-a7ee-4b36-887e-ce11cc38235c service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:22.275439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3ab6b84b-a7ee-4b36-887e-ce11cc38235c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:22.309197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6b84b-a7ee-4b36-887e-ce11cc38235c service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:22.323516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf5cbc-2744-4640-b1a8-53fba455178d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:22.326509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf5cbc-2744-4640-b1a8-53fba455178d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:22.328958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf5cbc-2744-4640-b1a8-53fba455178d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:22.329387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf5cbc-2744-4640-b1a8-53fba455178d admin admin] PATH_INFO: `/v3/users/6f572c9d36974f339eb2e680b17ba91d` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:22.341195 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf5cbc-2744-4640-b1a8-53fba455178d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f572c9d36974f339eb2e680b17ba91d)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:22.351944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf5cbc-2744-4640-b1a8-53fba455178d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:22.356007 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2928/5895] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:38:22.359984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70cfe4-e2b1-4d99-a356-f12cff64594d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:22.387335 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70cfe4-e2b1-4d99-a356-f12cff64594d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:22.400656 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef275db-ad22-4b6b-a5bd-92511dd9af16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:22.401640 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef275db-ad22-4b6b-a5bd-92511dd9af16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:22.402020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef275db-ad22-4b6b-a5bd-92511dd9af16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:22.402391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef275db-ad22-4b6b-a5bd-92511dd9af16 admin admin] PATH_INFO: `/v3/projects/70422b57cac5403c83e3ab1b59b8fc7c/users/b2335a63d136422fb118d46be7a01364/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:22.441533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef275db-ad22-4b6b-a5bd-92511dd9af16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70422b57cac5403c83e3ab1b59b8fc7c, user_id=b2335a63d136422fb118d46be7a01364, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:22.449779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef275db-ad22-4b6b-a5bd-92511dd9af16 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:22.481448 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:22.492405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6dbf5cbc-2744-4640-b1a8-53fba455178d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f572c9d36974f339eb2e680b17ba91d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:22.494449 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2929/5896] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:38:22 2022] PUT /identity/v3/projects/70422b57cac5403c83e3ab1b59b8fc7c/users/b2335a63d136422fb118d46be7a01364/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:38:22.495916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef275db-ad22-4b6b-a5bd-92511dd9af16 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:22.504603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6dbf5cbc-2744-4640-b1a8-53fba455178d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f572c9d36974f339eb2e680b17ba91d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:22.505943 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7ef275db-ad22-4b6b-a5bd-92511dd9af16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:22.539482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6dbf5cbc-2744-4640-b1a8-53fba455178d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f572c9d36974f339eb2e680b17ba91d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:22.540337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6dbf5cbc-2744-4640-b1a8-53fba455178d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f572c9d36974f339eb2e680b17ba91d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:22.550447 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:22.557858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6dbf5cbc-2744-4640-b1a8-53fba455178d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f572c9d36974f339eb2e680b17ba91d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:22.571706 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2968/5897] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:38:22 2022] DELETE /identity/v3/users/6f572c9d36974f339eb2e680b17ba91d => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:38:22.572877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf5cbc-2744-4640-b1a8-53fba455178d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:22.578004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6dbf5cbc-2744-4640-b1a8-53fba455178d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:22.657949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef275db-ad22-4b6b-a5bd-92511dd9af16 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:22.724832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf5cbc-2744-4640-b1a8-53fba455178d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:22.739355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06317ffc-785a-4dc6-a8ea-a1caba5b89cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:22.740022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06317ffc-785a-4dc6-a8ea-a1caba5b89cf admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:22.740307 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06317ffc-785a-4dc6-a8ea-a1caba5b89cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:22.740580 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06317ffc-785a-4dc6-a8ea-a1caba5b89cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:22.741293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06317ffc-785a-4dc6-a8ea-a1caba5b89cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:22.744321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06317ffc-785a-4dc6-a8ea-a1caba5b89cf admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:22.759571 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2969/5898] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:38:22.759571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c54d36-8685-4505-b13f-be34129c35a1 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:22.759571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c54d36-8685-4505-b13f-be34129c35a1 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:22.759571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c54d36-8685-4505-b13f-be34129c35a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:22.783588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450d6b9-a2da-4a1f-ba95-a211ed684a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:22.784274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450d6b9-a2da-4a1f-ba95-a211ed684a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:22.784554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450d6b9-a2da-4a1f-ba95-a211ed684a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:22.784840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450d6b9-a2da-4a1f-ba95-a211ed684a30 admin admin] PATH_INFO: `/v3/projects/d0df27eb51f842b3ab3c31e5105cdd5d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:22.788829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450d6b9-a2da-4a1f-ba95-a211ed684a30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0df27eb51f842b3ab3c31e5105cdd5d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:22.791432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7450d6b9-a2da-4a1f-ba95-a211ed684a30 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:22.808766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a9c54d36-8685-4505-b13f-be34129c35a1 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:38:22.810037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a9c54d36-8685-4505-b13f-be34129c35a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:22.837432 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2970/5899] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:38:22.844904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c54d36-8685-4505-b13f-be34129c35a1 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:22.878913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c54d36-8685-4505-b13f-be34129c35a1 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:22.882062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7450d6b9-a2da-4a1f-ba95-a211ed684a30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0df27eb51f842b3ab3c31e5105cdd5d', 'request_id': 'req-7450d6b9-a2da-4a1f-ba95-a211ed684a30'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:22.890694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7450d6b9-a2da-4a1f-ba95-a211ed684a30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0df27eb51f842b3ab3c31e5105cdd5d', 'request_id': 'req-7450d6b9-a2da-4a1f-ba95-a211ed684a30'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:22.899685 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7450d6b9-a2da-4a1f-ba95-a211ed684a30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0df27eb51f842b3ab3c31e5105cdd5d', 'request_id': 'req-7450d6b9-a2da-4a1f-ba95-a211ed684a30'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:22.920132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7450d6b9-a2da-4a1f-ba95-a211ed684a30 admin admin] The token cache is being invalidate because project d0df27eb51f842b3ab3c31e5105cdd5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:38:22.920798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7450d6b9-a2da-4a1f-ba95-a211ed684a30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:22.921201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7450d6b9-a2da-4a1f-ba95-a211ed684a30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:22.923956 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2930/5900] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:38:22 2022] DELETE /identity/v3/projects/d0df27eb51f842b3ab3c31e5105cdd5d => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:38:22.929657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450d6b9-a2da-4a1f-ba95-a211ed684a30 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:22.931092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7450d6b9-a2da-4a1f-ba95-a211ed684a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:23.017249 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450d6b9-a2da-4a1f-ba95-a211ed684a30 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:23.024094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93732c27-f799-4d43-a8a3-9e149fbd2b09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:23.025206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93732c27-f799-4d43-a8a3-9e149fbd2b09 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:23.025710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93732c27-f799-4d43-a8a3-9e149fbd2b09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:23.026081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93732c27-f799-4d43-a8a3-9e149fbd2b09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:23.029398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-93732c27-f799-4d43-a8a3-9e149fbd2b09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:23.036775 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfaccc1-779e-4eec-a4e9-a21d9718615d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:23.037661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfaccc1-779e-4eec-a4e9-a21d9718615d admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:23.038010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfaccc1-779e-4eec-a4e9-a21d9718615d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:23.038479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfaccc1-779e-4eec-a4e9-a21d9718615d admin admin] PATH_INFO: `/v3/projects/70422b57cac5403c83e3ab1b59b8fc7c/users/b2335a63d136422fb118d46be7a01364/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:23.045305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfaccc1-779e-4eec-a4e9-a21d9718615d admin admin] RBAC: Authorizing `identity:create_grant(project_id=70422b57cac5403c83e3ab1b59b8fc7c, user_id=b2335a63d136422fb118d46be7a01364, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:23.047197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93732c27-f799-4d43-a8a3-9e149fbd2b09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:23.049001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93732c27-f799-4d43-a8a3-9e149fbd2b09 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:23.052315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfaccc1-779e-4eec-a4e9-a21d9718615d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:23.054794 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:23.076745 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2931/5901] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:38:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:38:23.079362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f0406-4cd1-4d13-99c0-6037206791b5 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:23.079781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f0406-4cd1-4d13-99c0-6037206791b5 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:23.080957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f0406-4cd1-4d13-99c0-6037206791b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:23.083672 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2971/5902] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:38:22 2022] PUT /identity/v3/projects/70422b57cac5403c83e3ab1b59b8fc7c/users/b2335a63d136422fb118d46be7a01364/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:38:23.132898 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b36f0406-4cd1-4d13-99c0-6037206791b5 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:38:23.136224 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b36f0406-4cd1-4d13-99c0-6037206791b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:23.296664 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2932/5903] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:38:23.306065 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e6856-cc1b-49bc-a8f3-c0739eca5610 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:23.306537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e6856-cc1b-49bc-a8f3-c0739eca5610 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:23.306937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e6856-cc1b-49bc-a8f3-c0739eca5610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:23.352587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d75e6856-cc1b-49bc-a8f3-c0739eca5610 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:38:23.354003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d75e6856-cc1b-49bc-a8f3-c0739eca5610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:23.386521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f0406-4cd1-4d13-99c0-6037206791b5 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:23.401055 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2972/5904] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:38:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:38:23.401754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f0406-4cd1-4d13-99c0-6037206791b5 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:23.428803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ea4a9-cef6-48d1-a785-3f68bb3f2226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:23.429956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ea4a9-cef6-48d1-a785-3f68bb3f2226 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:23.430254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ea4a9-cef6-48d1-a785-3f68bb3f2226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:23.430532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ea4a9-cef6-48d1-a785-3f68bb3f2226 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:23.432061 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ea4a9-cef6-48d1-a785-3f68bb3f2226 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:38:23.432397 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ea4a9-cef6-48d1-a785-3f68bb3f2226 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:23.434061 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ea4a9-cef6-48d1-a785-3f68bb3f2226 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:23.470174 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2933/5905] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:38:23.475189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e6856-cc1b-49bc-a8f3-c0739eca5610 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:23.486531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e6856-cc1b-49bc-a8f3-c0739eca5610 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:23.496856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb1d85-2e4e-4b92-acb1-2db7007aeaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:23.497587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb1d85-2e4e-4b92-acb1-2db7007aeaba admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:23.499318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb1d85-2e4e-4b92-acb1-2db7007aeaba admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:23.499645 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb1d85-2e4e-4b92-acb1-2db7007aeaba admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:23.501402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb1d85-2e4e-4b92-acb1-2db7007aeaba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:23.505736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb1d85-2e4e-4b92-acb1-2db7007aeaba admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:23.588226 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ea4a9-cef6-48d1-a785-3f68bb3f2226 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:23.598324 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2973/5906] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:38:23 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:38:23.602548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ea4a9-cef6-48d1-a785-3f68bb3f2226 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:23.707368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddeedec-7403-4ade-b48a-2a48e0e8a76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:23.708808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddeedec-7403-4ade-b48a-2a48e0e8a76f admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:23.709154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddeedec-7403-4ade-b48a-2a48e0e8a76f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:23.709591 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddeedec-7403-4ade-b48a-2a48e0e8a76f admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:23.710245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddeedec-7403-4ade-b48a-2a48e0e8a76f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:23.714173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddeedec-7403-4ade-b48a-2a48e0e8a76f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:23.758196 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2934/5907] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:38:23 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:38:23.763350 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb1d85-2e4e-4b92-acb1-2db7007aeaba admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:23.784073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb1d85-2e4e-4b92-acb1-2db7007aeaba admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:23.796344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f17c0f-a0df-47c9-a8f5-765cd0d28e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:23.796979 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f17c0f-a0df-47c9-a8f5-765cd0d28e98 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:23.797257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f17c0f-a0df-47c9-a8f5-765cd0d28e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:23.797531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f17c0f-a0df-47c9-a8f5-765cd0d28e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:23.814970 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f17c0f-a0df-47c9-a8f5-765cd0d28e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:23.816701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f17c0f-a0df-47c9-a8f5-765cd0d28e98 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:23.833925 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:23.850721 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2974/5908] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:38:23.855340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddeedec-7403-4ade-b48a-2a48e0e8a76f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:23.870469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddeedec-7403-4ade-b48a-2a48e0e8a76f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:23.883659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499cfcd-c57f-43b2-a729-2d7a5e0b5a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:23.884395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499cfcd-c57f-43b2-a729-2d7a5e0b5a74 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:23.884820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499cfcd-c57f-43b2-a729-2d7a5e0b5a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:23.885150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499cfcd-c57f-43b2-a729-2d7a5e0b5a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:23.885811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d499cfcd-c57f-43b2-a729-2d7a5e0b5a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:23.890153 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d499cfcd-c57f-43b2-a729-2d7a5e0b5a74 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:23.920593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f17c0f-a0df-47c9-a8f5-765cd0d28e98 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:23.932394 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2935/5909] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:38:23.934753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f17c0f-a0df-47c9-a8f5-765cd0d28e98 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:23.947171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91416da1-e118-4d41-8b70-393aba647b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:23.947930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91416da1-e118-4d41-8b70-393aba647b9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:23.948286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91416da1-e118-4d41-8b70-393aba647b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:23.948565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91416da1-e118-4d41-8b70-393aba647b9c admin admin] PATH_INFO: `/v3/projects/f1162b6f1f0b45d3bf8fb4614f1c2b41/users/7132394edb85488dac1d6456318ed4aa/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:24.000890 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91416da1-e118-4d41-8b70-393aba647b9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1162b6f1f0b45d3bf8fb4614f1c2b41, user_id=7132394edb85488dac1d6456318ed4aa, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:24.010504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91416da1-e118-4d41-8b70-393aba647b9c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:24.051982 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2975/5910] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:38:23 2022] PUT /identity/v3/projects/f1162b6f1f0b45d3bf8fb4614f1c2b41/users/7132394edb85488dac1d6456318ed4aa/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:38:24.055532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06dfe6-9dab-486e-84af-a0f3437bd8df None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:24.055815 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06dfe6-9dab-486e-84af-a0f3437bd8df None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:24.056122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06dfe6-9dab-486e-84af-a0f3437bd8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:24.101318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ea06dfe6-9dab-486e-84af-a0f3437bd8df None None] MFA Rules not processed for user `7132394edb85488dac1d6456318ed4aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:38:24.102716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ea06dfe6-9dab-486e-84af-a0f3437bd8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:24.245079 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:24.308842 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2936/5911] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:38:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:38:24.526973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91416da1-e118-4d41-8b70-393aba647b9c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:24.531148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-91416da1-e118-4d41-8b70-393aba647b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:24.696625 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91416da1-e118-4d41-8b70-393aba647b9c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:24.714304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f202d-4179-4a69-9eea-598e2135e2a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:24.714935 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f202d-4179-4a69-9eea-598e2135e2a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:24.715213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f202d-4179-4a69-9eea-598e2135e2a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:24.715484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f202d-4179-4a69-9eea-598e2135e2a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:24.754158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f202d-4179-4a69-9eea-598e2135e2a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:24.765984 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f202d-4179-4a69-9eea-598e2135e2a8 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:24.799758 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2976/5912] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:38:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:38:25.165035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06dfe6-9dab-486e-84af-a0f3437bd8df None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:25.167665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ea06dfe6-9dab-486e-84af-a0f3437bd8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:25.347946 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06dfe6-9dab-486e-84af-a0f3437bd8df None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:25.354290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9dd279-5d56-46c7-856a-71ac209e0a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:25.355301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9dd279-5d56-46c7-856a-71ac209e0a5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:25.355740 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9dd279-5d56-46c7-856a-71ac209e0a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:25.356198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9dd279-5d56-46c7-856a-71ac209e0a5b admin admin] PATH_INFO: `/v3/projects/777ac6e3853e42b698444a6ca14bc1c0` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:25.358680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9dd279-5d56-46c7-856a-71ac209e0a5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=777ac6e3853e42b698444a6ca14bc1c0)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:25.361193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9dd279-5d56-46c7-856a-71ac209e0a5b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:25.461399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fd9dd279-5d56-46c7-856a-71ac209e0a5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '777ac6e3853e42b698444a6ca14bc1c0', 'request_id': 'req-fd9dd279-5d56-46c7-856a-71ac209e0a5b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:25.470619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fd9dd279-5d56-46c7-856a-71ac209e0a5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '777ac6e3853e42b698444a6ca14bc1c0', 'request_id': 'req-fd9dd279-5d56-46c7-856a-71ac209e0a5b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:25.483669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fd9dd279-5d56-46c7-856a-71ac209e0a5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '777ac6e3853e42b698444a6ca14bc1c0', 'request_id': 'req-fd9dd279-5d56-46c7-856a-71ac209e0a5b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:25.511083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fd9dd279-5d56-46c7-856a-71ac209e0a5b admin admin] The token cache is being invalidate because project 777ac6e3853e42b698444a6ca14bc1c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:38:25.511382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fd9dd279-5d56-46c7-856a-71ac209e0a5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:25.513578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fd9dd279-5d56-46c7-856a-71ac209e0a5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:25.515592 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2937/5913] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:38:25 2022] DELETE /identity/v3/projects/777ac6e3853e42b698444a6ca14bc1c0 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:38:25.521245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99783523-4510-4da6-b53a-130c15adb92d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:25.521655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99783523-4510-4da6-b53a-130c15adb92d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:25.522005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99783523-4510-4da6-b53a-130c15adb92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:25.574302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-99783523-4510-4da6-b53a-130c15adb92d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:38:25.578716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-99783523-4510-4da6-b53a-130c15adb92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:25.715040 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2977/5914] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:38:25.723017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d9a44-2b2c-4f8d-9dbc-4af76c400a9e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:25.723266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d9a44-2b2c-4f8d-9dbc-4af76c400a9e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:25.723400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d9a44-2b2c-4f8d-9dbc-4af76c400a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:25.763851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3b6d9a44-2b2c-4f8d-9dbc-4af76c400a9e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:38:25.768699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3b6d9a44-2b2c-4f8d-9dbc-4af76c400a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:25.808665 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2938/5915] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:38:25.809652 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99783523-4510-4da6-b53a-130c15adb92d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:25.830607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99783523-4510-4da6-b53a-130c15adb92d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:25.845952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a12dc-8830-4f63-8bf6-600ff72c5b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:25.849006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a12dc-8830-4f63-8bf6-600ff72c5b90 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:25.849983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a12dc-8830-4f63-8bf6-600ff72c5b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:25.849983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a12dc-8830-4f63-8bf6-600ff72c5b90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:25.850770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a12dc-8830-4f63-8bf6-600ff72c5b90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:38:25.853579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a12dc-8830-4f63-8bf6-600ff72c5b90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:25.856430 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a12dc-8830-4f63-8bf6-600ff72c5b90 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:25.904822 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2978/5916] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:38:25.906043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d9a44-2b2c-4f8d-9dbc-4af76c400a9e None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:25.917839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d9a44-2b2c-4f8d-9dbc-4af76c400a9e None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:25.929558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b41d3-45b6-44da-aadc-42b65e818d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:25.930348 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b41d3-45b6-44da-aadc-42b65e818d35 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:25.930630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b41d3-45b6-44da-aadc-42b65e818d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:25.930901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b41d3-45b6-44da-aadc-42b65e818d35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:25.931552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b41d3-45b6-44da-aadc-42b65e818d35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:25.933581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b41d3-45b6-44da-aadc-42b65e818d35 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:25.989909 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2939/5917] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:38:25 2022] POST /identity/v3/projects => generated 365 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:38:25.994214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a12dc-8830-4f63-8bf6-600ff72c5b90 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:26.008883 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a12dc-8830-4f63-8bf6-600ff72c5b90 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:26.168555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9729c4a-bba8-4466-906e-cb22d54ac595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:26.169197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9729c4a-bba8-4466-906e-cb22d54ac595 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:26.169977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9729c4a-bba8-4466-906e-cb22d54ac595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:26.170660 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9729c4a-bba8-4466-906e-cb22d54ac595 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:26.171309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9729c4a-bba8-4466-906e-cb22d54ac595 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:26.174550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9729c4a-bba8-4466-906e-cb22d54ac595 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:26.240093 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:26.260484 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2979/5918] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:38:25 2022] POST /identity/v3/users => generated 283 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:38:26.265352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b41d3-45b6-44da-aadc-42b65e818d35 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:26.280319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b41d3-45b6-44da-aadc-42b65e818d35 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:26.299182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01f601-1655-4c83-8c91-d35f5e20aadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:26.300283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01f601-1655-4c83-8c91-d35f5e20aadc admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:26.300875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01f601-1655-4c83-8c91-d35f5e20aadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:26.301350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01f601-1655-4c83-8c91-d35f5e20aadc admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:26.302838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01f601-1655-4c83-8c91-d35f5e20aadc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:26.304772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01f601-1655-4c83-8c91-d35f5e20aadc admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:26.336238 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2940/5919] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:38:26.340381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9729c4a-bba8-4466-906e-cb22d54ac595 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:26.357724 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9729c4a-bba8-4466-906e-cb22d54ac595 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:26.371621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e9e68-5543-4416-a75c-078f7f814486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:26.373280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e9e68-5543-4416-a75c-078f7f814486 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:26.373671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e9e68-5543-4416-a75c-078f7f814486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:26.374056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e9e68-5543-4416-a75c-078f7f814486 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:26.375113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e9e68-5543-4416-a75c-078f7f814486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:26.379806 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e9e68-5543-4416-a75c-078f7f814486 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:26.407804 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2980/5920] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:38:26.411822 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01f601-1655-4c83-8c91-d35f5e20aadc admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:26.427196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01f601-1655-4c83-8c91-d35f5e20aadc admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:26.443551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b188b-13d3-46c3-aa09-8ad92ee4c6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:26.444564 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b188b-13d3-46c3-aa09-8ad92ee4c6c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:26.445064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b188b-13d3-46c3-aa09-8ad92ee4c6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:26.445532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b188b-13d3-46c3-aa09-8ad92ee4c6c7 admin admin] PATH_INFO: `/v3/projects/d915d1d9b6724c88acd845968e7bca6e/users/2f0e1c5ed46b44c881df0059642c6de8/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:26.486662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b188b-13d3-46c3-aa09-8ad92ee4c6c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d915d1d9b6724c88acd845968e7bca6e, user_id=2f0e1c5ed46b44c881df0059642c6de8, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:26.496299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b188b-13d3-46c3-aa09-8ad92ee4c6c7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:26.529373 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2941/5921] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:38:26 2022] PUT /identity/v3/projects/d915d1d9b6724c88acd845968e7bca6e/users/2f0e1c5ed46b44c881df0059642c6de8/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:38:26.541670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc85979-b598-4de6-a54c-3e2ead533590 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:26.542050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc85979-b598-4de6-a54c-3e2ead533590 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:26.542398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc85979-b598-4de6-a54c-3e2ead533590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:26.625030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-4dc85979-b598-4de6-a54c-3e2ead533590 None None] MFA Rules not processed for user `2f0e1c5ed46b44c881df0059642c6de8`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:38:26.626435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4dc85979-b598-4de6-a54c-3e2ead533590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:26.808464 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2981/5922] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:38:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:38:26.853862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b188b-13d3-46c3-aa09-8ad92ee4c6c7 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:26.857185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8d3b188b-13d3-46c3-aa09-8ad92ee4c6c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:26.911319 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:27.022998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b188b-13d3-46c3-aa09-8ad92ee4c6c7 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:27.029594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6bfc9-ea22-4718-9df8-6f4b9d641431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:27.031025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6bfc9-ea22-4718-9df8-6f4b9d641431 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:27.031617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6bfc9-ea22-4718-9df8-6f4b9d641431 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:27.032247 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6bfc9-ea22-4718-9df8-6f4b9d641431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:27.058219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de6bfc9-ea22-4718-9df8-6f4b9d641431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:27.060785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de6bfc9-ea22-4718-9df8-6f4b9d641431 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:27.072102 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2942/5923] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:38:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:38:28.188917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb7ba4-acf2-4218-90d9-05d483f0c7a0 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:28.189491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb7ba4-acf2-4218-90d9-05d483f0c7a0 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:28.189491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb7ba4-acf2-4218-90d9-05d483f0c7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:28.264430 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6dfb7ba4-acf2-4218-90d9-05d483f0c7a0 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:38:28.266194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6dfb7ba4-acf2-4218-90d9-05d483f0c7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:28.441548 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2982/5924] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:38:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:38:28.457297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6bfc9-ea22-4718-9df8-6f4b9d641431 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:28.459371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8de6bfc9-ea22-4718-9df8-6f4b9d641431 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:28.693151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6bfc9-ea22-4718-9df8-6f4b9d641431 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:28.704365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b36431-3b1e-42ad-b084-d583d60dd3f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:28.705013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b36431-3b1e-42ad-b084-d583d60dd3f8 service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:28.705294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b36431-3b1e-42ad-b084-d583d60dd3f8 service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:28.705566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b36431-3b1e-42ad-b084-d583d60dd3f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:28.747066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b36431-3b1e-42ad-b084-d583d60dd3f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:28.749721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b36431-3b1e-42ad-b084-d583d60dd3f8 service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:28.773947 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2943/5925] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:38:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:38:38.426472 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=64 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:38.782399 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=49 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:45.783122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd78bbb-e665-4c35-a25f-72bacfc4d9c5 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:45.784833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd78bbb-e665-4c35-a25f-72bacfc4d9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:45.785443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd78bbb-e665-4c35-a25f-72bacfc4d9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:45.838094 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-fbd78bbb-e665-4c35-a25f-72bacfc4d9c5 None None] MFA Rules not processed for user `b2335a63d136422fb118d46be7a01364`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:38:45.839647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fbd78bbb-e665-4c35-a25f-72bacfc4d9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:45.969230 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2983/5926] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:38:45 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:38:45.977838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b36431-3b1e-42ad-b084-d583d60dd3f8 service swift] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:45.979372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-71b36431-3b1e-42ad-b084-d583d60dd3f8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:46.155145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b36431-3b1e-42ad-b084-d583d60dd3f8 service swift] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:46.164477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a97c0b-aab8-4165-8208-b6506d95a6b8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:46.165126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a97c0b-aab8-4165-8208-b6506d95a6b8 service glance] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:46.167586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a97c0b-aab8-4165-8208-b6506d95a6b8 service glance] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:46.167912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a97c0b-aab8-4165-8208-b6506d95a6b8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:46.172663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e9a97c0b-aab8-4165-8208-b6506d95a6b8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:46.369717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a97c0b-aab8-4165-8208-b6506d95a6b8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:46.383517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a97c0b-aab8-4165-8208-b6506d95a6b8 service glance] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:46.422416 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2944/5927] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:38:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:38:50.965483 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd78bbb-e665-4c35-a25f-72bacfc4d9c5 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:50.967050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fbd78bbb-e665-4c35-a25f-72bacfc4d9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:51.175445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd78bbb-e665-4c35-a25f-72bacfc4d9c5 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:51.184010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6eb7c-a6e8-4f8c-ae1d-153d916a898a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:51.185328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6eb7c-a6e8-4f8c-ae1d-153d916a898a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:51.185944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6eb7c-a6e8-4f8c-ae1d-153d916a898a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:51.186412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6eb7c-a6e8-4f8c-ae1d-153d916a898a admin admin] PATH_INFO: `/v3/users/7132394edb85488dac1d6456318ed4aa` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:51.192303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6eb7c-a6e8-4f8c-ae1d-153d916a898a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7132394edb85488dac1d6456318ed4aa)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:51.194599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f6eb7c-a6e8-4f8c-ae1d-153d916a898a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:51.285885 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-17f6eb7c-a6e8-4f8c-ae1d-153d916a898a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7132394edb85488dac1d6456318ed4aa'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:51.299929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-17f6eb7c-a6e8-4f8c-ae1d-153d916a898a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7132394edb85488dac1d6456318ed4aa'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:51.341759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-17f6eb7c-a6e8-4f8c-ae1d-153d916a898a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7132394edb85488dac1d6456318ed4aa'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:51.343661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-17f6eb7c-a6e8-4f8c-ae1d-153d916a898a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7132394edb85488dac1d6456318ed4aa'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:51.370204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-17f6eb7c-a6e8-4f8c-ae1d-153d916a898a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7132394edb85488dac1d6456318ed4aa'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:51.400092 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2984/5928] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:38:50 2022] DELETE /identity/v3/users/7132394edb85488dac1d6456318ed4aa => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:38:51.404829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c4e95-4223-40a5-8c40-9b9837411531 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:51.405421 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c4e95-4223-40a5-8c40-9b9837411531 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:51.405665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c4e95-4223-40a5-8c40-9b9837411531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:51.446055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-a84c4e95-4223-40a5-8c40-9b9837411531 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:38:51.451164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a84c4e95-4223-40a5-8c40-9b9837411531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:51.507184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6eb7c-a6e8-4f8c-ae1d-153d916a898a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:51.509777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-17f6eb7c-a6e8-4f8c-ae1d-153d916a898a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:51.520226 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:51.576881 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2945/5929] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:38:51.606515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c4e95-4223-40a5-8c40-9b9837411531 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:51.608098 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a84c4e95-4223-40a5-8c40-9b9837411531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:51.773979 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6eb7c-a6e8-4f8c-ae1d-153d916a898a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:51.775836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c4e95-4223-40a5-8c40-9b9837411531 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:51.780649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3ca15-9934-4713-8bdb-ca89b996f9ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:51.781521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3ca15-9934-4713-8bdb-ca89b996f9ba service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:51.782028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3ca15-9934-4713-8bdb-ca89b996f9ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:51.782566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3ca15-9934-4713-8bdb-ca89b996f9ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:51.798986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30d8cb-40db-4131-8f7a-c799a62a51e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:51.799622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30d8cb-40db-4131-8f7a-c799a62a51e6 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:51.799910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30d8cb-40db-4131-8f7a-c799a62a51e6 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:51.819317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3ca15-9934-4713-8bdb-ca89b996f9ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:51.821300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3ca15-9934-4713-8bdb-ca89b996f9ba service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:51.823345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30d8cb-40db-4131-8f7a-c799a62a51e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:51.831594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fd30d8cb-40db-4131-8f7a-c799a62a51e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:51.844326 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:51.856310 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2946/5930] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:38:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:38:51.889215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd30d8cb-40db-4131-8f7a-c799a62a51e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:51.891353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd30d8cb-40db-4131-8f7a-c799a62a51e6 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:51.924350 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2985/5931] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:38:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:38:52.570377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3ca15-9934-4713-8bdb-ca89b996f9ba service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:52.572428 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-31a3ca15-9934-4713-8bdb-ca89b996f9ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:52.598754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3ca15-9934-4713-8bdb-ca89b996f9ba service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:52.614078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd337313-115a-4719-bf73-98ccafd46c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:52.616138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd337313-115a-4719-bf73-98ccafd46c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:52.616944 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd337313-115a-4719-bf73-98ccafd46c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:52.617494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd337313-115a-4719-bf73-98ccafd46c88 admin admin] PATH_INFO: `/v3/projects/f1162b6f1f0b45d3bf8fb4614f1c2b41` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:52.622471 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd337313-115a-4719-bf73-98ccafd46c88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1162b6f1f0b45d3bf8fb4614f1c2b41)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:52.639431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd337313-115a-4719-bf73-98ccafd46c88 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:52.774247 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bd337313-115a-4719-bf73-98ccafd46c88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1162b6f1f0b45d3bf8fb4614f1c2b41', 'request_id': 'req-bd337313-115a-4719-bf73-98ccafd46c88'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:52.816845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bd337313-115a-4719-bf73-98ccafd46c88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1162b6f1f0b45d3bf8fb4614f1c2b41', 'request_id': 'req-bd337313-115a-4719-bf73-98ccafd46c88'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:52.841304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bd337313-115a-4719-bf73-98ccafd46c88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1162b6f1f0b45d3bf8fb4614f1c2b41', 'request_id': 'req-bd337313-115a-4719-bf73-98ccafd46c88'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:52.885611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bd337313-115a-4719-bf73-98ccafd46c88 admin admin] The token cache is being invalidate because project f1162b6f1f0b45d3bf8fb4614f1c2b41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:38:52.885920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bd337313-115a-4719-bf73-98ccafd46c88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:52.889399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bd337313-115a-4719-bf73-98ccafd46c88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:38:52.898646 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2947/5932] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:38:52 2022] DELETE /identity/v3/projects/f1162b6f1f0b45d3bf8fb4614f1c2b41 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:38:52.900840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea3e25-b570-4abd-9da0-4bdbbe929f62 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:52.901313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea3e25-b570-4abd-9da0-4bdbbe929f62 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:52.901609 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cea3e25-b570-4abd-9da0-4bdbbe929f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:52.940773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5cea3e25-b570-4abd-9da0-4bdbbe929f62 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:38:52.943137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5cea3e25-b570-4abd-9da0-4bdbbe929f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:53.098458 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2986/5933] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:38:53.100503 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfad2e-7072-4e46-b2d2-b66eb7c868af None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:53.101093 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfad2e-7072-4e46-b2d2-b66eb7c868af None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:53.101450 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcfad2e-7072-4e46-b2d2-b66eb7c868af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:53.160932 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-dfcfad2e-7072-4e46-b2d2-b66eb7c868af None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:38:53.162465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-dfcfad2e-7072-4e46-b2d2-b66eb7c868af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:53.185862 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2948/5934] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:38:53.190491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea3e25-b570-4abd-9da0-4bdbbe929f62 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:53.204527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cea3e25-b570-4abd-9da0-4bdbbe929f62 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:53.215458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc09f0-d867-4101-a543-68c1d56f11b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:53.216138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc09f0-d867-4101-a543-68c1d56f11b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:53.216739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc09f0-d867-4101-a543-68c1d56f11b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:53.217023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc09f0-d867-4101-a543-68c1d56f11b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:53.217697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc09f0-d867-4101-a543-68c1d56f11b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:38:53.218810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc09f0-d867-4101-a543-68c1d56f11b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:53.220502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc09f0-d867-4101-a543-68c1d56f11b6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:53.257856 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2987/5935] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:38:53.258068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfad2e-7072-4e46-b2d2-b66eb7c868af None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:53.269727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcfad2e-7072-4e46-b2d2-b66eb7c868af None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:53.281756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3a09c-b428-4429-87fa-13137a026027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:53.282889 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3a09c-b428-4429-87fa-13137a026027 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:53.283393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3a09c-b428-4429-87fa-13137a026027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:53.283728 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3a09c-b428-4429-87fa-13137a026027 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:53.284414 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3a09c-b428-4429-87fa-13137a026027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:53.286373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3a09c-b428-4429-87fa-13137a026027 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:53.327264 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2949/5936] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:38:53 2022] POST /identity/v3/projects => generated 369 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:38:53.332444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc09f0-d867-4101-a543-68c1d56f11b6 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:53.349015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc09f0-d867-4101-a543-68c1d56f11b6 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:53.448526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33a9de-365e-4910-b523-17872aa53e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:53.449555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33a9de-365e-4910-b523-17872aa53e77 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:53.449838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33a9de-365e-4910-b523-17872aa53e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:53.450110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33a9de-365e-4910-b523-17872aa53e77 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:53.453632 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33a9de-365e-4910-b523-17872aa53e77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:53.457792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33a9de-365e-4910-b523-17872aa53e77 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:53.527250 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2988/5937] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:38:53 2022] POST /identity/v3/users => generated 285 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:38:53.533136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3a09c-b428-4429-87fa-13137a026027 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:53.547488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3a09c-b428-4429-87fa-13137a026027 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:53.560262 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c65c8-d588-4fba-b33f-430f6c782728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:53.563169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c65c8-d588-4fba-b33f-430f6c782728 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:53.563451 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c65c8-d588-4fba-b33f-430f6c782728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:53.564644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c65c8-d588-4fba-b33f-430f6c782728 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:53.573042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c65c8-d588-4fba-b33f-430f6c782728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:53.576243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c65c8-d588-4fba-b33f-430f6c782728 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:53.649977 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2950/5938] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:38:53.656174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33a9de-365e-4910-b523-17872aa53e77 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:53.677146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33a9de-365e-4910-b523-17872aa53e77 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:53.690357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66137b-d58d-4f10-8abf-9a25d62e803c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:53.690584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3991c-25fe-4ada-a2c6-b5676b71675a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:53.691086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3991c-25fe-4ada-a2c6-b5676b71675a admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:53.691405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3991c-25fe-4ada-a2c6-b5676b71675a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:53.691704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3991c-25fe-4ada-a2c6-b5676b71675a admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:53.692294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3991c-25fe-4ada-a2c6-b5676b71675a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:53.694854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66137b-d58d-4f10-8abf-9a25d62e803c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:53.695090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66137b-d58d-4f10-8abf-9a25d62e803c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:53.697432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3991c-25fe-4ada-a2c6-b5676b71675a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:53.713337 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:53.731193 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2989/5939] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:38:53.731411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3991c-25fe-4ada-a2c6-b5676b71675a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:53.741538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9b66137b-d58d-4f10-8abf-9a25d62e803c None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:38:53.742787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9b66137b-d58d-4f10-8abf-9a25d62e803c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:53.752108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3991c-25fe-4ada-a2c6-b5676b71675a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:53.771337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48d82f-6e9d-405e-b5f1-46236f00ad25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:53.772053 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48d82f-6e9d-405e-b5f1-46236f00ad25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:53.772341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48d82f-6e9d-405e-b5f1-46236f00ad25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:53.772605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48d82f-6e9d-405e-b5f1-46236f00ad25 admin admin] PATH_INFO: `/v3/projects/c733343fde9a4b9fafb270668b6cd8b2/users/c47c8919ac824bcc8f43b312f194768a/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:53.811606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48d82f-6e9d-405e-b5f1-46236f00ad25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c733343fde9a4b9fafb270668b6cd8b2, user_id=c47c8919ac824bcc8f43b312f194768a, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:53.814365 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48d82f-6e9d-405e-b5f1-46236f00ad25 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:53.855991 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2990/5940] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:38:53 2022] PUT /identity/v3/projects/c733343fde9a4b9fafb270668b6cd8b2/users/c47c8919ac824bcc8f43b312f194768a/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:38:53.933047 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2951/5941] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:38:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:38:53.945175 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48d82f-6e9d-405e-b5f1-46236f00ad25 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:53.948017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9c48d82f-6e9d-405e-b5f1-46236f00ad25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:53.960457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd550874-41d2-49a0-9bf8-ddedbf381880 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:53.961091 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd550874-41d2-49a0-9bf8-ddedbf381880 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:53.969742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd550874-41d2-49a0-9bf8-ddedbf381880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:54.076025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-dd550874-41d2-49a0-9bf8-ddedbf381880 None None] MFA Rules not processed for user `c47c8919ac824bcc8f43b312f194768a`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:38:54.079130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-dd550874-41d2-49a0-9bf8-ddedbf381880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:54.168106 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:38:54.245133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48d82f-6e9d-405e-b5f1-46236f00ad25 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:54.259199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ad946-ebb0-4e07-9bca-7e777c8c92af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:54.261199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ad946-ebb0-4e07-9bca-7e777c8c92af service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:54.261199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ad946-ebb0-4e07-9bca-7e777c8c92af service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:54.261199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ad946-ebb0-4e07-9bca-7e777c8c92af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:54.287926 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2952/5942] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:38:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:38:54.316013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd550874-41d2-49a0-9bf8-ddedbf381880 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:38:54.323484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-dd550874-41d2-49a0-9bf8-ddedbf381880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:38:54.408466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ad946-ebb0-4e07-9bca-7e777c8c92af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:54.410560 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ad946-ebb0-4e07-9bca-7e777c8c92af service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:54.427230 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2991/5943] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:38:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:38:54.478116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd550874-41d2-49a0-9bf8-ddedbf381880 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:38:54.489069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8836659-2c3a-41e5-b34c-6232b5df9c70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:38:54.489691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8836659-2c3a-41e5-b34c-6232b5df9c70 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:38:54.491730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8836659-2c3a-41e5-b34c-6232b5df9c70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:38:54.492070 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8836659-2c3a-41e5-b34c-6232b5df9c70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:38:54.523221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8836659-2c3a-41e5-b34c-6232b5df9c70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:38:54.525836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8836659-2c3a-41e5-b34c-6232b5df9c70 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:38:54.554070 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2953/5944] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:38:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:39:04.419761 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=64,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:39:04.534499 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=37 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:39:33.701478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ad946-ebb0-4e07-9bca-7e777c8c92af service swift] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:39:33.719572 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ad946-ebb0-4e07-9bca-7e777c8c92af service swift] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:39:33.734474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1adbb1-95d8-46fa-bdb4-da079821217a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:39:33.735109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1adbb1-95d8-46fa-bdb4-da079821217a service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:39:33.735388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1adbb1-95d8-46fa-bdb4-da079821217a service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:39:33.735662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1adbb1-95d8-46fa-bdb4-da079821217a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:39:33.737633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5a1adbb1-95d8-46fa-bdb4-da079821217a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:39:33.828208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1adbb1-95d8-46fa-bdb4-da079821217a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:39:33.830142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1adbb1-95d8-46fa-bdb4-da079821217a service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:39:33.843030 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2992/5945] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:39:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:39:38.935267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8836659-2c3a-41e5-b34c-6232b5df9c70 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:39:38.963838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8836659-2c3a-41e5-b34c-6232b5df9c70 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:39:38.996737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8679422-313a-4373-a51a-4dfb5ac2ff71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:39:39.001408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8679422-313a-4373-a51a-4dfb5ac2ff71 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:39:39.002223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8679422-313a-4373-a51a-4dfb5ac2ff71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:39:39.002538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8679422-313a-4373-a51a-4dfb5ac2ff71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:39:39.010628 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a8679422-313a-4373-a51a-4dfb5ac2ff71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:39:39.222579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8679422-313a-4373-a51a-4dfb5ac2ff71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:39:39.224314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8679422-313a-4373-a51a-4dfb5ac2ff71 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:39:39.257873 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2954/5946] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:39:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:39:40.888249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1adbb1-95d8-46fa-bdb4-da079821217a service swift] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:39:40.889693 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5a1adbb1-95d8-46fa-bdb4-da079821217a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:39:41.013569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1adbb1-95d8-46fa-bdb4-da079821217a service swift] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:39:41.018862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4f29a-de6f-4bf1-b826-c6a8c99db6b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:39:41.019721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4f29a-de6f-4bf1-b826-c6a8c99db6b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:39:41.020172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4f29a-de6f-4bf1-b826-c6a8c99db6b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:39:41.020610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4f29a-de6f-4bf1-b826-c6a8c99db6b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:39:41.029544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-bcd4f29a-de6f-4bf1-b826-c6a8c99db6b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:39:41.061498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4f29a-de6f-4bf1-b826-c6a8c99db6b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:39:41.064083 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4f29a-de6f-4bf1-b826-c6a8c99db6b3 service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:39:41.092127 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2993/5947] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:39:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:39:44.189296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb526c20-3e8f-4794-bea6-73d67169d417 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:39:44.189804 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb526c20-3e8f-4794-bea6-73d67169d417 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:39:44.189881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb526c20-3e8f-4794-bea6-73d67169d417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:39:44.234550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-eb526c20-3e8f-4794-bea6-73d67169d417 None None] MFA Rules not processed for user `2f5acf7da18b43f89e24760744cfdb49`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:39:44.236885 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-eb526c20-3e8f-4794-bea6-73d67169d417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:39:44.429034 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2955/5948] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:39:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:39:51.076767 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=54 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:39:54.406186 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=59 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:39:55.418200 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4f29a-de6f-4bf1-b826-c6a8c99db6b3 service cinder] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:39:55.565401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4f29a-de6f-4bf1-b826-c6a8c99db6b3 service cinder] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:39:55.583082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfacc5-4cf3-4944-9785-1b54c48154a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:39:55.584048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfacc5-4cf3-4944-9785-1b54c48154a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:39:55.584512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfacc5-4cf3-4944-9785-1b54c48154a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:39:55.585054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccfacc5-4cf3-4944-9785-1b54c48154a0 admin admin] PATH_INFO: `/v3/users/c47c8919ac824bcc8f43b312f194768a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:39:55.587301 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccfacc5-4cf3-4944-9785-1b54c48154a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c47c8919ac824bcc8f43b312f194768a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:39:55.589453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccfacc5-4cf3-4944-9785-1b54c48154a0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:39:55.710664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7ccfacc5-4cf3-4944-9785-1b54c48154a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c47c8919ac824bcc8f43b312f194768a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:39:55.729091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7ccfacc5-4cf3-4944-9785-1b54c48154a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c47c8919ac824bcc8f43b312f194768a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:39:55.759555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7ccfacc5-4cf3-4944-9785-1b54c48154a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c47c8919ac824bcc8f43b312f194768a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:39:55.760484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7ccfacc5-4cf3-4944-9785-1b54c48154a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c47c8919ac824bcc8f43b312f194768a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:39:55.776071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7ccfacc5-4cf3-4944-9785-1b54c48154a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c47c8919ac824bcc8f43b312f194768a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:39:55.786550 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2994/5949] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:39:55 2022] DELETE /identity/v3/users/c47c8919ac824bcc8f43b312f194768a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:39:55.792783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8edcade-2f7e-485d-b8ab-b8efe53352b2 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:39:55.793614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8edcade-2f7e-485d-b8ab-b8efe53352b2 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:39:55.794028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8edcade-2f7e-485d-b8ab-b8efe53352b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:39:55.841399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-a8edcade-2f7e-485d-b8ab-b8efe53352b2 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:39:55.845574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a8edcade-2f7e-485d-b8ab-b8efe53352b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:39:56.049103 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2956/5950] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:39:56.089973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfacc5-4cf3-4944-9785-1b54c48154a0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:39:56.092640 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7ccfacc5-4cf3-4944-9785-1b54c48154a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:39:56.280963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccfacc5-4cf3-4944-9785-1b54c48154a0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:39:56.294215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab2a61-416e-4309-aba8-614abb7686c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:39:56.294847 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab2a61-416e-4309-aba8-614abb7686c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:39:56.295124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab2a61-416e-4309-aba8-614abb7686c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:39:56.295451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab2a61-416e-4309-aba8-614abb7686c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:39:56.318070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab2a61-416e-4309-aba8-614abb7686c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:39:56.319532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab2a61-416e-4309-aba8-614abb7686c6 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:39:56.353619 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2995/5951] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:39:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:39:57.047401 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8edcade-2f7e-485d-b8ab-b8efe53352b2 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:39:57.048883 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a8edcade-2f7e-485d-b8ab-b8efe53352b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:39:57.075860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8edcade-2f7e-485d-b8ab-b8efe53352b2 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:39:57.105875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7901c-b0be-4b50-9d4d-58ece473f59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:39:57.106558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7901c-b0be-4b50-9d4d-58ece473f59a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:39:57.106819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7901c-b0be-4b50-9d4d-58ece473f59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:39:57.107088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7901c-b0be-4b50-9d4d-58ece473f59a admin admin] PATH_INFO: `/v3/projects/c733343fde9a4b9fafb270668b6cd8b2` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:39:57.108988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7901c-b0be-4b50-9d4d-58ece473f59a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c733343fde9a4b9fafb270668b6cd8b2)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:39:57.110928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7901c-b0be-4b50-9d4d-58ece473f59a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:39:57.235487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3af7901c-b0be-4b50-9d4d-58ece473f59a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c733343fde9a4b9fafb270668b6cd8b2', 'request_id': 'req-3af7901c-b0be-4b50-9d4d-58ece473f59a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:39:57.251115 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3af7901c-b0be-4b50-9d4d-58ece473f59a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c733343fde9a4b9fafb270668b6cd8b2', 'request_id': 'req-3af7901c-b0be-4b50-9d4d-58ece473f59a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:39:57.269121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3af7901c-b0be-4b50-9d4d-58ece473f59a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c733343fde9a4b9fafb270668b6cd8b2', 'request_id': 'req-3af7901c-b0be-4b50-9d4d-58ece473f59a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:39:57.285408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3af7901c-b0be-4b50-9d4d-58ece473f59a admin admin] The token cache is being invalidate because project c733343fde9a4b9fafb270668b6cd8b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:39:57.285960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3af7901c-b0be-4b50-9d4d-58ece473f59a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:39:57.296616 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3af7901c-b0be-4b50-9d4d-58ece473f59a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:39:57.301851 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2957/5952] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:39:57 2022] DELETE /identity/v3/projects/c733343fde9a4b9fafb270668b6cd8b2 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:39:57.303702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5d005-5243-405c-b8af-421e72b43f51 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:39:57.304202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5d005-5243-405c-b8af-421e72b43f51 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:39:57.304507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5d005-5243-405c-b8af-421e72b43f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:39:57.356117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-82d5d005-5243-405c-b8af-421e72b43f51 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:39:57.357711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-82d5d005-5243-405c-b8af-421e72b43f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:39:57.458777 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:39:57.596581 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2996/5953] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:39:57.604577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d859b83-deea-421b-bb36-73b158677918 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:39:57.605121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d859b83-deea-421b-bb36-73b158677918 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:39:57.605552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d859b83-deea-421b-bb36-73b158677918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:39:57.657001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3d859b83-deea-421b-bb36-73b158677918 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:39:57.658252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3d859b83-deea-421b-bb36-73b158677918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:39:57.676129 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2958/5954] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:39:57.680530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5d005-5243-405c-b8af-421e72b43f51 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:39:57.693353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5d005-5243-405c-b8af-421e72b43f51 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:39:57.719132 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b61d6e-d885-4083-9d68-f8ba8bf85c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:39:57.720040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b61d6e-d885-4083-9d68-f8ba8bf85c83 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:39:57.720487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b61d6e-d885-4083-9d68-f8ba8bf85c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:39:57.720917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b61d6e-d885-4083-9d68-f8ba8bf85c83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:39:57.721742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b61d6e-d885-4083-9d68-f8ba8bf85c83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:39:57.722190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b61d6e-d885-4083-9d68-f8ba8bf85c83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:39:57.723981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b61d6e-d885-4083-9d68-f8ba8bf85c83 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:39:57.754551 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2997/5955] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:39:57.758855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d859b83-deea-421b-bb36-73b158677918 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:39:57.774614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d859b83-deea-421b-bb36-73b158677918 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:39:57.788289 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53422396-39ef-460d-b8a9-4d3dfa0a05e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:39:57.789366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53422396-39ef-460d-b8a9-4d3dfa0a05e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:39:57.790287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53422396-39ef-460d-b8a9-4d3dfa0a05e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:39:57.790706 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53422396-39ef-460d-b8a9-4d3dfa0a05e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:39:57.791501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53422396-39ef-460d-b8a9-4d3dfa0a05e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:39:57.793630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53422396-39ef-460d-b8a9-4d3dfa0a05e4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:39:57.908794 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2959/5956] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:39:57 2022] POST /identity/v3/projects => generated 377 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:39:57.913403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b61d6e-d885-4083-9d68-f8ba8bf85c83 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:39:57.929198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b61d6e-d885-4083-9d68-f8ba8bf85c83 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:39:58.094550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3935b3-3105-4034-8f2d-088de94bb988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:39:58.095353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3935b3-3105-4034-8f2d-088de94bb988 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:39:58.095934 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3935b3-3105-4034-8f2d-088de94bb988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:39:58.096511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3935b3-3105-4034-8f2d-088de94bb988 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:39:58.097123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3935b3-3105-4034-8f2d-088de94bb988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:39:58.099269 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3935b3-3105-4034-8f2d-088de94bb988 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:39:58.160376 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2998/5957] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:39:57 2022] POST /identity/v3/users => generated 289 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:39:58.165067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53422396-39ef-460d-b8a9-4d3dfa0a05e4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:39:58.179360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53422396-39ef-460d-b8a9-4d3dfa0a05e4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:39:58.208731 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d868761-4766-4c99-ac72-45ca81460135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:39:58.209468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d868761-4766-4c99-ac72-45ca81460135 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:39:58.209831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d868761-4766-4c99-ac72-45ca81460135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:39:58.210177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d868761-4766-4c99-ac72-45ca81460135 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:39:58.210933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d868761-4766-4c99-ac72-45ca81460135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:39:58.213314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d868761-4766-4c99-ac72-45ca81460135 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:39:58.257233 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3935b3-3105-4034-8f2d-088de94bb988 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:39:58.264532 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2960/5958] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:39:58.269126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3935b3-3105-4034-8f2d-088de94bb988 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:39:58.284546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba764b-f7fa-47ef-bac3-767c54f1ffb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:39:58.285659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba764b-f7fa-47ef-bac3-767c54f1ffb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:39:58.286076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba764b-f7fa-47ef-bac3-767c54f1ffb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:39:58.286490 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba764b-f7fa-47ef-bac3-767c54f1ffb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:39:58.287308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba764b-f7fa-47ef-bac3-767c54f1ffb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:39:58.289569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba764b-f7fa-47ef-bac3-767c54f1ffb7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:39:58.320257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d868761-4766-4c99-ac72-45ca81460135 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:39:58.328976 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 2999/5959] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:39:58.338271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d868761-4766-4c99-ac72-45ca81460135 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:39:58.370405 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb005b98-e26b-415d-ba8a-d0061a88663e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:39:58.371094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb005b98-e26b-415d-ba8a-d0061a88663e admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:39:58.371373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb005b98-e26b-415d-ba8a-d0061a88663e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:39:58.371646 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb005b98-e26b-415d-ba8a-d0061a88663e admin admin] PATH_INFO: `/v3/projects/34fca9667a3249fc8b2bdaa510adbf3a/users/df0ff1e20dc448ac88ab006d7bf19fb9/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:39:58.413520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb005b98-e26b-415d-ba8a-d0061a88663e admin admin] RBAC: Authorizing `identity:create_grant(project_id=34fca9667a3249fc8b2bdaa510adbf3a, user_id=df0ff1e20dc448ac88ab006d7bf19fb9, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:39:58.416971 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb005b98-e26b-415d-ba8a-d0061a88663e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:39:58.442326 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2961/5960] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:39:58 2022] PUT /identity/v3/projects/34fca9667a3249fc8b2bdaa510adbf3a/users/df0ff1e20dc448ac88ab006d7bf19fb9/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:39:58.452965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e7849-c9a4-4756-959b-7724dfcc8737 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:39:58.453428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e7849-c9a4-4756-959b-7724dfcc8737 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:39:58.453858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e7849-c9a4-4756-959b-7724dfcc8737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:39:58.484915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb005b98-e26b-415d-ba8a-d0061a88663e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:39:58.486933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bb005b98-e26b-415d-ba8a-d0061a88663e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:39:58.533068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ac1e7849-c9a4-4756-959b-7724dfcc8737 None None] MFA Rules not processed for user `df0ff1e20dc448ac88ab006d7bf19fb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:39:58.534343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ac1e7849-c9a4-4756-959b-7724dfcc8737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:39:58.537825 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:39:58.629280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb005b98-e26b-415d-ba8a-d0061a88663e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:39:58.633878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d05e5-0366-4ada-9c45-a788415c1e6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:39:58.634580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d05e5-0366-4ada-9c45-a788415c1e6a service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:39:58.634870 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d05e5-0366-4ada-9c45-a788415c1e6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:39:58.635135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d05e5-0366-4ada-9c45-a788415c1e6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:39:58.637285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5d1d05e5-0366-4ada-9c45-a788415c1e6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:39:58.795516 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3000/5961] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:39:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:39:58.796286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d05e5-0366-4ada-9c45-a788415c1e6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:39:58.797880 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d05e5-0366-4ada-9c45-a788415c1e6a service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:39:58.823283 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2962/5962] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:39:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:39:58.929555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e7849-c9a4-4756-959b-7724dfcc8737 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:39:58.943688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e7849-c9a4-4756-959b-7724dfcc8737 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:39:58.954954 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f189d-0cd3-4c37-bbc0-5ff7593a4837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:39:58.955756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f189d-0cd3-4c37-bbc0-5ff7593a4837 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:39:58.956166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f189d-0cd3-4c37-bbc0-5ff7593a4837 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:39:58.960278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f189d-0cd3-4c37-bbc0-5ff7593a4837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:39:59.054388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f189d-0cd3-4c37-bbc0-5ff7593a4837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:39:59.060584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f189d-0cd3-4c37-bbc0-5ff7593a4837 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:39:59.098352 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3001/5963] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:39:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:39:59.214254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d05e5-0366-4ada-9c45-a788415c1e6a service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:39:59.231437 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d05e5-0366-4ada-9c45-a788415c1e6a service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:39:59.241797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494f698-675a-430c-97f9-db7b36aaed09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:39:59.242646 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494f698-675a-430c-97f9-db7b36aaed09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:39:59.243026 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494f698-675a-430c-97f9-db7b36aaed09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:39:59.243403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494f698-675a-430c-97f9-db7b36aaed09 admin admin] PATH_INFO: `/v3/users/df0ff1e20dc448ac88ab006d7bf19fb9` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:39:59.244719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494f698-675a-430c-97f9-db7b36aaed09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df0ff1e20dc448ac88ab006d7bf19fb9)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:39:59.246763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494f698-675a-430c-97f9-db7b36aaed09 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:39:59.366345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1494f698-675a-430c-97f9-db7b36aaed09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df0ff1e20dc448ac88ab006d7bf19fb9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:39:59.381175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1494f698-675a-430c-97f9-db7b36aaed09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df0ff1e20dc448ac88ab006d7bf19fb9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:39:59.412025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1494f698-675a-430c-97f9-db7b36aaed09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df0ff1e20dc448ac88ab006d7bf19fb9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:39:59.418363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1494f698-675a-430c-97f9-db7b36aaed09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df0ff1e20dc448ac88ab006d7bf19fb9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:39:59.429674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1494f698-675a-430c-97f9-db7b36aaed09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df0ff1e20dc448ac88ab006d7bf19fb9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:39:59.443552 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2963/5964] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:39:59 2022] DELETE /identity/v3/users/df0ff1e20dc448ac88ab006d7bf19fb9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:39:59.448495 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac01ce-7458-4339-a128-23fb93db17b5 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:39:59.449514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac01ce-7458-4339-a128-23fb93db17b5 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:39:59.450623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac01ce-7458-4339-a128-23fb93db17b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:39:59.460969 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:39:59.495162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-32ac01ce-7458-4339-a128-23fb93db17b5 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:39:59.499281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-32ac01ce-7458-4339-a128-23fb93db17b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:39:59.726293 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3002/5965] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:39:59.780141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494f698-675a-430c-97f9-db7b36aaed09 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:39:59.781911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1494f698-675a-430c-97f9-db7b36aaed09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:39:59.870316 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:39:59.933279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494f698-675a-430c-97f9-db7b36aaed09 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:39:59.949229 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26736307-59f5-4365-9498-9710a1b3b0fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:39:59.949909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26736307-59f5-4365-9498-9710a1b3b0fd service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:39:59.950226 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26736307-59f5-4365-9498-9710a1b3b0fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:39:59.950477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26736307-59f5-4365-9498-9710a1b3b0fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:39:59.981743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26736307-59f5-4365-9498-9710a1b3b0fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:39:59.990162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26736307-59f5-4365-9498-9710a1b3b0fd service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:00.017636 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2964/5966] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:39:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:40:01.985840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac01ce-7458-4339-a128-23fb93db17b5 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:01.987259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-32ac01ce-7458-4339-a128-23fb93db17b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:02.003477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac01ce-7458-4339-a128-23fb93db17b5 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:02.010422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b13dd-6686-4fbc-856a-27ae7a111392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:02.011732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b13dd-6686-4fbc-856a-27ae7a111392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:02.012287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b13dd-6686-4fbc-856a-27ae7a111392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:02.012763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b13dd-6686-4fbc-856a-27ae7a111392 admin admin] PATH_INFO: `/v3/projects/34fca9667a3249fc8b2bdaa510adbf3a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:02.015281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b13dd-6686-4fbc-856a-27ae7a111392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34fca9667a3249fc8b2bdaa510adbf3a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:02.017882 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b13dd-6686-4fbc-856a-27ae7a111392 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:02.084155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-870b13dd-6686-4fbc-856a-27ae7a111392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34fca9667a3249fc8b2bdaa510adbf3a', 'request_id': 'req-870b13dd-6686-4fbc-856a-27ae7a111392'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:02.093279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-870b13dd-6686-4fbc-856a-27ae7a111392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34fca9667a3249fc8b2bdaa510adbf3a', 'request_id': 'req-870b13dd-6686-4fbc-856a-27ae7a111392'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:02.104500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-870b13dd-6686-4fbc-856a-27ae7a111392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34fca9667a3249fc8b2bdaa510adbf3a', 'request_id': 'req-870b13dd-6686-4fbc-856a-27ae7a111392'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:02.120651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-870b13dd-6686-4fbc-856a-27ae7a111392 admin admin] The token cache is being invalidate because project 34fca9667a3249fc8b2bdaa510adbf3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:40:02.120974 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-870b13dd-6686-4fbc-856a-27ae7a111392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:02.121665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-870b13dd-6686-4fbc-856a-27ae7a111392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:02.123818 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3003/5967] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:40:01 2022] DELETE /identity/v3/projects/34fca9667a3249fc8b2bdaa510adbf3a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:02.128738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19572a1a-2f7e-4e42-96be-777cbec1624b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:02.129665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19572a1a-2f7e-4e42-96be-777cbec1624b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:02.130142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19572a1a-2f7e-4e42-96be-777cbec1624b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:02.166665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-19572a1a-2f7e-4e42-96be-777cbec1624b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:02.168322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-19572a1a-2f7e-4e42-96be-777cbec1624b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:02.281698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551afa0c-2eb4-4098-9be6-790b9e631146 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:02.282005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551afa0c-2eb4-4098-9be6-790b9e631146 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:02.282476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551afa0c-2eb4-4098-9be6-790b9e631146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:02.286487 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2965/5968] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:02.320494 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-551afa0c-2eb4-4098-9be6-790b9e631146 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:02.322063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-551afa0c-2eb4-4098-9be6-790b9e631146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:02.341641 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19572a1a-2f7e-4e42-96be-777cbec1624b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:02.353375 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3004/5969] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:02.360393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19572a1a-2f7e-4e42-96be-777cbec1624b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:02.372744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b538a-7f90-4753-ba2f-d54c3ad8310c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:02.375721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b538a-7f90-4753-ba2f-d54c3ad8310c admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:02.376500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b538a-7f90-4753-ba2f-d54c3ad8310c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:02.377554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b538a-7f90-4753-ba2f-d54c3ad8310c admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:02.378737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b538a-7f90-4753-ba2f-d54c3ad8310c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:40:02.379047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b538a-7f90-4753-ba2f-d54c3ad8310c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:02.380981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b538a-7f90-4753-ba2f-d54c3ad8310c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:02.407850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551afa0c-2eb4-4098-9be6-790b9e631146 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:02.439798 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2966/5970] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:40:02.450785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551afa0c-2eb4-4098-9be6-790b9e631146 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:02.464212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3f59a-8c40-42d5-8342-ac25b4a490f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:02.479853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3f59a-8c40-42d5-8342-ac25b4a490f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:02.479853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3f59a-8c40-42d5-8342-ac25b4a490f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:02.479853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3f59a-8c40-42d5-8342-ac25b4a490f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:02.480156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3f59a-8c40-42d5-8342-ac25b4a490f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:02.484798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3f59a-8c40-42d5-8342-ac25b4a490f4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:02.543012 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b538a-7f90-4753-ba2f-d54c3ad8310c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:02.547924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8d3b538a-7f90-4753-ba2f-d54c3ad8310c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:02.564270 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3005/5971] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:40:02 2022] POST /identity/v3/projects => generated 355 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:40:02.568247 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3f59a-8c40-42d5-8342-ac25b4a490f4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:02.606042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b538a-7f90-4753-ba2f-d54c3ad8310c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:02.724476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec622e8c-114c-47f3-81f9-3450592d10bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:02.725081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec622e8c-114c-47f3-81f9-3450592d10bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:02.725457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec622e8c-114c-47f3-81f9-3450592d10bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:02.725827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec622e8c-114c-47f3-81f9-3450592d10bd admin admin] PATH_INFO: `/v3/users/a594aa14f1d64745bd748d1d06273f8b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:02.726677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3f59a-8c40-42d5-8342-ac25b4a490f4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:02.743195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec622e8c-114c-47f3-81f9-3450592d10bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a594aa14f1d64745bd748d1d06273f8b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:02.745585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec622e8c-114c-47f3-81f9-3450592d10bd admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:02.756267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac542fd-618c-461a-a163-17e179d1850d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:02.758588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac542fd-618c-461a-a163-17e179d1850d admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:02.758588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac542fd-618c-461a-a163-17e179d1850d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:02.758588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac542fd-618c-461a-a163-17e179d1850d admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:02.764261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac542fd-618c-461a-a163-17e179d1850d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:02.766291 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac542fd-618c-461a-a163-17e179d1850d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:02.785604 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:02.818100 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3006/5972] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:40:02 2022] POST /identity/v3/users => generated 278 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:40:02.825005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac542fd-618c-461a-a163-17e179d1850d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:02.849193 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac542fd-618c-461a-a163-17e179d1850d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:02.869513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1000a2-76a1-4838-9e00-a39e55707b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:02.870150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1000a2-76a1-4838-9e00-a39e55707b16 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:02.870439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1000a2-76a1-4838-9e00-a39e55707b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:02.870711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1000a2-76a1-4838-9e00-a39e55707b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:02.871376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1000a2-76a1-4838-9e00-a39e55707b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:02.873113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1000a2-76a1-4838-9e00-a39e55707b16 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:02.910305 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3007/5973] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:40:02.922694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1000a2-76a1-4838-9e00-a39e55707b16 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:02.938003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ec622e8c-114c-47f3-81f9-3450592d10bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a594aa14f1d64745bd748d1d06273f8b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:02.951736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1000a2-76a1-4838-9e00-a39e55707b16 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:02.958432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ec622e8c-114c-47f3-81f9-3450592d10bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a594aa14f1d64745bd748d1d06273f8b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:02.969328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101aaa3-349e-418b-b3d6-e1bdf8e41ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:02.970011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101aaa3-349e-418b-b3d6-e1bdf8e41ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:02.970293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101aaa3-349e-418b-b3d6-e1bdf8e41ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:02.970565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101aaa3-349e-418b-b3d6-e1bdf8e41ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:02.971268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101aaa3-349e-418b-b3d6-e1bdf8e41ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:02.972914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101aaa3-349e-418b-b3d6-e1bdf8e41ba1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:03.000223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ec622e8c-114c-47f3-81f9-3450592d10bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a594aa14f1d64745bd748d1d06273f8b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:03.001003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ec622e8c-114c-47f3-81f9-3450592d10bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a594aa14f1d64745bd748d1d06273f8b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:03.003092 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:03.006186 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3008/5974] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:03.011979 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101aaa3-349e-418b-b3d6-e1bdf8e41ba1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:03.016896 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ec622e8c-114c-47f3-81f9-3450592d10bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a594aa14f1d64745bd748d1d06273f8b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:03.025012 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2967/5975] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:40:02 2022] DELETE /identity/v3/users/a594aa14f1d64745bd748d1d06273f8b => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:03.029973 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6b3b8-e23e-4a1b-a66a-60d5bcf0be80 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:03.030265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6b3b8-e23e-4a1b-a66a-60d5bcf0be80 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:03.030509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6b3b8-e23e-4a1b-a66a-60d5bcf0be80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:03.051590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101aaa3-349e-418b-b3d6-e1bdf8e41ba1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:03.081072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-47a6b3b8-e23e-4a1b-a66a-60d5bcf0be80 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:03.082325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-47a6b3b8-e23e-4a1b-a66a-60d5bcf0be80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:03.245757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0579e41-56a3-4df0-ba72-7f3ec18f5e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:03.246881 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0579e41-56a3-4df0-ba72-7f3ec18f5e77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:03.247528 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0579e41-56a3-4df0-ba72-7f3ec18f5e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:03.248449 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2968/5976] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:40:03.250035 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0579e41-56a3-4df0-ba72-7f3ec18f5e77 admin admin] PATH_INFO: `/v3/projects/32fe87da03b04f57901aa42325eae5cd/users/a092573d9c37433eb6aaba005e9273af/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:03.291284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0579e41-56a3-4df0-ba72-7f3ec18f5e77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32fe87da03b04f57901aa42325eae5cd, user_id=a092573d9c37433eb6aaba005e9273af, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:03.296235 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0579e41-56a3-4df0-ba72-7f3ec18f5e77 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:03.319401 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3009/5977] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:03 2022] PUT /identity/v3/projects/32fe87da03b04f57901aa42325eae5cd/users/a092573d9c37433eb6aaba005e9273af/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:03.330731 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da2b0b-e6a5-4991-a9fd-3ca83473356d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:03.330979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da2b0b-e6a5-4991-a9fd-3ca83473356d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:03.331150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da2b0b-e6a5-4991-a9fd-3ca83473356d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:03.395088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-22da2b0b-e6a5-4991-a9fd-3ca83473356d None None] MFA Rules not processed for user `a092573d9c37433eb6aaba005e9273af`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:03.396377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-22da2b0b-e6a5-4991-a9fd-3ca83473356d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:03.536836 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2969/5978] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:03 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:03.539966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0579e41-56a3-4df0-ba72-7f3ec18f5e77 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:03.542761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da2b0b-e6a5-4991-a9fd-3ca83473356d None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:03.543322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e0579e41-56a3-4df0-ba72-7f3ec18f5e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:03.544269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-22da2b0b-e6a5-4991-a9fd-3ca83473356d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:03.660138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da2b0b-e6a5-4991-a9fd-3ca83473356d None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:03.664792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c314db93-ca63-4d08-831f-0ca57b2ee092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:03.665803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314db93-ca63-4d08-831f-0ca57b2ee092 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:03.666319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314db93-ca63-4d08-831f-0ca57b2ee092 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:03.666793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314db93-ca63-4d08-831f-0ca57b2ee092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:03.678477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0579e41-56a3-4df0-ba72-7f3ec18f5e77 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:03.685178 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c314db93-ca63-4d08-831f-0ca57b2ee092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:03.687038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c314db93-ca63-4d08-831f-0ca57b2ee092 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:03.693508 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6edf3-7144-4d65-ab70-f7aed93ca20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:03.694535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6edf3-7144-4d65-ab70-f7aed93ca20a admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:03.695083 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6edf3-7144-4d65-ab70-f7aed93ca20a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:03.696300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6edf3-7144-4d65-ab70-f7aed93ca20a admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:03.698294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc6edf3-7144-4d65-ab70-f7aed93ca20a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:03.705410 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc6edf3-7144-4d65-ab70-f7aed93ca20a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:03.726635 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2970/5979] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:40:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:40:03.762960 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3010/5980] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:40:03 2022] POST /identity/v3/projects => generated 357 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:03.766586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c314db93-ca63-4d08-831f-0ca57b2ee092 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:03.781710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c314db93-ca63-4d08-831f-0ca57b2ee092 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:03.794198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6edf3-7144-4d65-ab70-f7aed93ca20a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:03.796121 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5bc6edf3-7144-4d65-ab70-f7aed93ca20a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:03.874689 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:03.903104 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:03.986622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6edf3-7144-4d65-ab70-f7aed93ca20a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:04.003673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96e0a8-757b-407d-869b-e7f308ab6099 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:04.003673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96e0a8-757b-407d-869b-e7f308ab6099 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:04.003673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96e0a8-757b-407d-869b-e7f308ab6099 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:04.004045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96e0a8-757b-407d-869b-e7f308ab6099 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:04.007415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6f96e0a8-757b-407d-869b-e7f308ab6099 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:04.023669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94906992-43aa-4839-9e39-1256a8f796de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:04.026349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94906992-43aa-4839-9e39-1256a8f796de admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:04.026635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94906992-43aa-4839-9e39-1256a8f796de admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:04.028351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94906992-43aa-4839-9e39-1256a8f796de admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:04.029053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94906992-43aa-4839-9e39-1256a8f796de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:04.032954 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96e0a8-757b-407d-869b-e7f308ab6099 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:04.033916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94906992-43aa-4839-9e39-1256a8f796de admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:04.034549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96e0a8-757b-407d-869b-e7f308ab6099 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:04.050714 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3011/5981] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:40:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:40:04.113260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96e0a8-757b-407d-869b-e7f308ab6099 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:04.113969 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2971/5982] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:40:03 2022] POST /identity/v3/users => generated 285 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:04.128867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96e0a8-757b-407d-869b-e7f308ab6099 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:04.145732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abea8d-0af2-4750-9d71-a9edcaf93b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:04.146871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abea8d-0af2-4750-9d71-a9edcaf93b7b admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:04.147169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abea8d-0af2-4750-9d71-a9edcaf93b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:04.147456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abea8d-0af2-4750-9d71-a9edcaf93b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:04.148149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08abea8d-0af2-4750-9d71-a9edcaf93b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:04.150420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08abea8d-0af2-4750-9d71-a9edcaf93b7b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:04.178939 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3012/5983] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:04.183816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94906992-43aa-4839-9e39-1256a8f796de admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:04.196579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94906992-43aa-4839-9e39-1256a8f796de admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:04.212777 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba9bbb-c6d7-43d8-a83e-a0aafb1a651b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:04.213705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba9bbb-c6d7-43d8-a83e-a0aafb1a651b admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:04.214137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba9bbb-c6d7-43d8-a83e-a0aafb1a651b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:04.214827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba9bbb-c6d7-43d8-a83e-a0aafb1a651b admin admin] PATH_INFO: `/v3/projects/7514fd037c2742cb8196c14e2c2a29b3/users/7c9c7bf7210b4182a09eb3e8731a025e/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:04.248125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba9bbb-c6d7-43d8-a83e-a0aafb1a651b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7514fd037c2742cb8196c14e2c2a29b3, user_id=7c9c7bf7210b4182a09eb3e8731a025e, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:04.254479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba9bbb-c6d7-43d8-a83e-a0aafb1a651b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:04.286337 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2972/5984] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:04 2022] PUT /identity/v3/projects/7514fd037c2742cb8196c14e2c2a29b3/users/7c9c7bf7210b4182a09eb3e8731a025e/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:04.290664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abea8d-0af2-4750-9d71-a9edcaf93b7b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:04.304400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abea8d-0af2-4750-9d71-a9edcaf93b7b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:04.412883 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe8ddf-43de-4408-a3cd-5447c6872b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:04.413831 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe8ddf-43de-4408-a3cd-5447c6872b18 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:04.414711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe8ddf-43de-4408-a3cd-5447c6872b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:04.414983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe8ddf-43de-4408-a3cd-5447c6872b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:04.416169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe8ddf-43de-4408-a3cd-5447c6872b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:04.417783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe8ddf-43de-4408-a3cd-5447c6872b18 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:04.435357 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3013/5985] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:04.436101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba9bbb-c6d7-43d8-a83e-a0aafb1a651b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:04.451048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba9bbb-c6d7-43d8-a83e-a0aafb1a651b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:04.464325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f5eb1-a077-452a-bbb4-30e6c8cf6497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:04.464936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f5eb1-a077-452a-bbb4-30e6c8cf6497 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:04.465224 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f5eb1-a077-452a-bbb4-30e6c8cf6497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:04.465487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f5eb1-a077-452a-bbb4-30e6c8cf6497 admin admin] PATH_INFO: `/v3/projects/7514fd037c2742cb8196c14e2c2a29b3/users/7c9c7bf7210b4182a09eb3e8731a025e/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:04.468651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f5eb1-a077-452a-bbb4-30e6c8cf6497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7514fd037c2742cb8196c14e2c2a29b3, user_id=7c9c7bf7210b4182a09eb3e8731a025e, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:04.471306 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f5eb1-a077-452a-bbb4-30e6c8cf6497 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:04.498571 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2973/5986] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:04 2022] PUT /identity/v3/projects/7514fd037c2742cb8196c14e2c2a29b3/users/7c9c7bf7210b4182a09eb3e8731a025e/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:40:04.514685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed777f-f917-45f2-a1ca-4699aa7be1c9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:04.515030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed777f-f917-45f2-a1ca-4699aa7be1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:04.515332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed777f-f917-45f2-a1ca-4699aa7be1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:04.548550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b3ed777f-f917-45f2-a1ca-4699aa7be1c9 None None] MFA Rules not processed for user `7c9c7bf7210b4182a09eb3e8731a025e`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:04.549794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b3ed777f-f917-45f2-a1ca-4699aa7be1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:04.684373 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3014/5987] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:04 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:04.697496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f5eb1-a077-452a-bbb4-30e6c8cf6497 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:04.700313 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a06f5eb1-a077-452a-bbb4-30e6c8cf6497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:04.797162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f5eb1-a077-452a-bbb4-30e6c8cf6497 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:04.802124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e096a-d7e9-4cd6-a62f-82ed369a3e53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:04.802862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e096a-d7e9-4cd6-a62f-82ed369a3e53 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:04.803237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e096a-d7e9-4cd6-a62f-82ed369a3e53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:04.803607 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e096a-d7e9-4cd6-a62f-82ed369a3e53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:04.817141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e096a-d7e9-4cd6-a62f-82ed369a3e53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:04.819564 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e096a-d7e9-4cd6-a62f-82ed369a3e53 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:04.849537 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2974/5988] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:40:04 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:40:05.084806 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed777f-f917-45f2-a1ca-4699aa7be1c9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:05.106728 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed777f-f917-45f2-a1ca-4699aa7be1c9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:05.120334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f3d1d-fc68-4fe4-bbc5-d2a1bd74bfd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:05.121337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f3d1d-fc68-4fe4-bbc5-d2a1bd74bfd1 service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:05.121772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f3d1d-fc68-4fe4-bbc5-d2a1bd74bfd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:05.122249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f3d1d-fc68-4fe4-bbc5-d2a1bd74bfd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:05.245718 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:05.311419 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f3d1d-fc68-4fe4-bbc5-d2a1bd74bfd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:05.312920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f3d1d-fc68-4fe4-bbc5-d2a1bd74bfd1 service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:05.344218 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3015/5989] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:40:05 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:40:05.442534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e096a-d7e9-4cd6-a62f-82ed369a3e53 service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:05.445305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0d8e096a-d7e9-4cd6-a62f-82ed369a3e53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:05.746056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e096a-d7e9-4cd6-a62f-82ed369a3e53 service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:05.760172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182e768-86df-4cc8-be2a-65f45b708622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:05.760812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182e768-86df-4cc8-be2a-65f45b708622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:05.761355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182e768-86df-4cc8-be2a-65f45b708622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:05.761905 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182e768-86df-4cc8-be2a-65f45b708622 admin admin] PATH_INFO: `/v3/projects/393fd8cfdf9842beace99145d27a3fd0` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:05.765419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182e768-86df-4cc8-be2a-65f45b708622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=393fd8cfdf9842beace99145d27a3fd0)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:05.774203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182e768-86df-4cc8-be2a-65f45b708622 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:05.817326 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:05.867831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4182e768-86df-4cc8-be2a-65f45b708622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '393fd8cfdf9842beace99145d27a3fd0', 'request_id': 'req-4182e768-86df-4cc8-be2a-65f45b708622'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:05.875565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4182e768-86df-4cc8-be2a-65f45b708622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '393fd8cfdf9842beace99145d27a3fd0', 'request_id': 'req-4182e768-86df-4cc8-be2a-65f45b708622'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:05.885773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4182e768-86df-4cc8-be2a-65f45b708622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '393fd8cfdf9842beace99145d27a3fd0', 'request_id': 'req-4182e768-86df-4cc8-be2a-65f45b708622'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:05.927474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4182e768-86df-4cc8-be2a-65f45b708622 admin admin] The token cache is being invalidate because project 393fd8cfdf9842beace99145d27a3fd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:40:05.927955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4182e768-86df-4cc8-be2a-65f45b708622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:05.930568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4182e768-86df-4cc8-be2a-65f45b708622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:05.933811 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2975/5990] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:40:05 2022] DELETE /identity/v3/projects/393fd8cfdf9842beace99145d27a3fd0 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:05.938710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b61a4a-d2b7-4192-9974-d4e7169509d6 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:05.938994 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b61a4a-d2b7-4192-9974-d4e7169509d6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:05.939267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b61a4a-d2b7-4192-9974-d4e7169509d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:05.978597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-33b61a4a-d2b7-4192-9974-d4e7169509d6 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:05.979857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-33b61a4a-d2b7-4192-9974-d4e7169509d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:06.095636 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3016/5991] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:40:06.106041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30370c6e-03ee-48eb-8385-1e2b2b0e66a8 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:06.106604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30370c6e-03ee-48eb-8385-1e2b2b0e66a8 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:06.107406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30370c6e-03ee-48eb-8385-1e2b2b0e66a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:06.134663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-30370c6e-03ee-48eb-8385-1e2b2b0e66a8 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:06.136522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-30370c6e-03ee-48eb-8385-1e2b2b0e66a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:06.146181 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2976/5992] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:06.151854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b61a4a-d2b7-4192-9974-d4e7169509d6 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:06.165985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b61a4a-d2b7-4192-9974-d4e7169509d6 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:06.173455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7869493-bf85-4143-9e6f-79b59c55f039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:06.174253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7869493-bf85-4143-9e6f-79b59c55f039 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:06.174707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7869493-bf85-4143-9e6f-79b59c55f039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:06.175127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7869493-bf85-4143-9e6f-79b59c55f039 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:06.177413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7869493-bf85-4143-9e6f-79b59c55f039 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:40:06.177872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7869493-bf85-4143-9e6f-79b59c55f039 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:06.180043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7869493-bf85-4143-9e6f-79b59c55f039 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:06.200999 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3017/5993] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:40:06.205513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30370c6e-03ee-48eb-8385-1e2b2b0e66a8 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:06.228347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30370c6e-03ee-48eb-8385-1e2b2b0e66a8 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:06.251638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ad3ad-217d-44a9-b28e-dabbd40febd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:06.252311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ad3ad-217d-44a9-b28e-dabbd40febd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:06.252866 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ad3ad-217d-44a9-b28e-dabbd40febd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:06.253147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ad3ad-217d-44a9-b28e-dabbd40febd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:06.255050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ad3ad-217d-44a9-b28e-dabbd40febd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:06.263796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ad3ad-217d-44a9-b28e-dabbd40febd1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:06.365943 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2977/5994] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:40:06 2022] POST /identity/v3/projects => generated 377 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:06.371257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7869493-bf85-4143-9e6f-79b59c55f039 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:06.421320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7869493-bf85-4143-9e6f-79b59c55f039 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:06.545452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abb692-8b80-40bf-8a24-2834d0b23eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:06.546341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abb692-8b80-40bf-8a24-2834d0b23eed admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:06.546767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abb692-8b80-40bf-8a24-2834d0b23eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:06.547244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abb692-8b80-40bf-8a24-2834d0b23eed admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:06.548088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abb692-8b80-40bf-8a24-2834d0b23eed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:06.552604 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99abb692-8b80-40bf-8a24-2834d0b23eed admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:06.620598 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3018/5995] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:40:06 2022] POST /identity/v3/users => generated 289 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:06.624507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ad3ad-217d-44a9-b28e-dabbd40febd1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:06.642292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ad3ad-217d-44a9-b28e-dabbd40febd1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:06.668504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c88d75-ca9f-46ef-aea6-4213c67c6aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:06.669433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c88d75-ca9f-46ef-aea6-4213c67c6aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:06.670133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c88d75-ca9f-46ef-aea6-4213c67c6aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:06.670617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c88d75-ca9f-46ef-aea6-4213c67c6aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:06.671484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c88d75-ca9f-46ef-aea6-4213c67c6aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:06.673306 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c88d75-ca9f-46ef-aea6-4213c67c6aa8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:06.702494 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2978/5996] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:06.706976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abb692-8b80-40bf-8a24-2834d0b23eed admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:06.726556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abb692-8b80-40bf-8a24-2834d0b23eed admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:06.746224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f504b1-9895-486a-b6a2-d2a7f6fe4619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:06.747561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f504b1-9895-486a-b6a2-d2a7f6fe4619 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:06.748174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f504b1-9895-486a-b6a2-d2a7f6fe4619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:06.748601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f504b1-9895-486a-b6a2-d2a7f6fe4619 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:06.749527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f504b1-9895-486a-b6a2-d2a7f6fe4619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:06.752605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f504b1-9895-486a-b6a2-d2a7f6fe4619 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:06.799145 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3019/5997] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:06.803570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c88d75-ca9f-46ef-aea6-4213c67c6aa8 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:06.825644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c88d75-ca9f-46ef-aea6-4213c67c6aa8 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:06.843800 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a825e3-e2d2-4b09-9059-ba57bfdf5e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:06.844511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a825e3-e2d2-4b09-9059-ba57bfdf5e7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:06.844793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a825e3-e2d2-4b09-9059-ba57bfdf5e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:06.845071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a825e3-e2d2-4b09-9059-ba57bfdf5e7a admin admin] PATH_INFO: `/v3/projects/bd481ee16e9c4bce8943579a5bf12183/users/1c18fa95435443a2beaeeb56e1bc4bf3/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:06.897668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a825e3-e2d2-4b09-9059-ba57bfdf5e7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd481ee16e9c4bce8943579a5bf12183, user_id=1c18fa95435443a2beaeeb56e1bc4bf3, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:06.909831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a825e3-e2d2-4b09-9059-ba57bfdf5e7a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:06.947961 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2979/5998] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:06 2022] PUT /identity/v3/projects/bd481ee16e9c4bce8943579a5bf12183/users/1c18fa95435443a2beaeeb56e1bc4bf3/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:06.951933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841d846-3754-40f8-a2a0-724b8236de25 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:06.952221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841d846-3754-40f8-a2a0-724b8236de25 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:06.952503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841d846-3754-40f8-a2a0-724b8236de25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:07.034923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1841d846-3754-40f8-a2a0-724b8236de25 None None] MFA Rules not processed for user `1c18fa95435443a2beaeeb56e1bc4bf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:07.036196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1841d846-3754-40f8-a2a0-724b8236de25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:07.086490 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:07.204433 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3020/5999] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:07.233688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a825e3-e2d2-4b09-9059-ba57bfdf5e7a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:07.236191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c6a825e3-e2d2-4b09-9059-ba57bfdf5e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:07.374004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a825e3-e2d2-4b09-9059-ba57bfdf5e7a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:07.384009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464c244-fc77-4dfb-a9d3-af034a88bd8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:07.384660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464c244-fc77-4dfb-a9d3-af034a88bd8a service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:07.384943 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464c244-fc77-4dfb-a9d3-af034a88bd8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:07.385218 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464c244-fc77-4dfb-a9d3-af034a88bd8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:07.407733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464c244-fc77-4dfb-a9d3-af034a88bd8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:07.409561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464c244-fc77-4dfb-a9d3-af034a88bd8a service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:07.448276 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2980/6000] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:40:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:40:07.468202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841d846-3754-40f8-a2a0-724b8236de25 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:07.633655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841d846-3754-40f8-a2a0-724b8236de25 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:07.644932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84f009-5644-40b0-8b9b-3d95c4c82cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:07.648355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84f009-5644-40b0-8b9b-3d95c4c82cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:07.648850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84f009-5644-40b0-8b9b-3d95c4c82cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:07.649362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84f009-5644-40b0-8b9b-3d95c4c82cf1 admin admin] PATH_INFO: `/v3/users/1c18fa95435443a2beaeeb56e1bc4bf3` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:07.652253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84f009-5644-40b0-8b9b-3d95c4c82cf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c18fa95435443a2beaeeb56e1bc4bf3)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:07.661427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84f009-5644-40b0-8b9b-3d95c4c82cf1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:07.780437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ee84f009-5644-40b0-8b9b-3d95c4c82cf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c18fa95435443a2beaeeb56e1bc4bf3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:07.795060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ee84f009-5644-40b0-8b9b-3d95c4c82cf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c18fa95435443a2beaeeb56e1bc4bf3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:07.824155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ee84f009-5644-40b0-8b9b-3d95c4c82cf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c18fa95435443a2beaeeb56e1bc4bf3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:07.825396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ee84f009-5644-40b0-8b9b-3d95c4c82cf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c18fa95435443a2beaeeb56e1bc4bf3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:07.841240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ee84f009-5644-40b0-8b9b-3d95c4c82cf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c18fa95435443a2beaeeb56e1bc4bf3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:07.853494 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3021/6001] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:40:07 2022] DELETE /identity/v3/users/1c18fa95435443a2beaeeb56e1bc4bf3 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:07.860159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78626f3-50ed-4b9a-b1a2-5644e3f6c909 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:07.860671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78626f3-50ed-4b9a-b1a2-5644e3f6c909 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:07.860788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78626f3-50ed-4b9a-b1a2-5644e3f6c909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:07.908523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-f78626f3-50ed-4b9a-b1a2-5644e3f6c909 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:07.909757 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f78626f3-50ed-4b9a-b1a2-5644e3f6c909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:08.030612 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:08.070863 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2981/6002] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:08.123010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84f009-5644-40b0-8b9b-3d95c4c82cf1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:08.124509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ee84f009-5644-40b0-8b9b-3d95c4c82cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:08.182705 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:08.198829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84f009-5644-40b0-8b9b-3d95c4c82cf1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:08.207428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65446c93-20db-4661-a462-6c846b844b4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:08.211421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65446c93-20db-4661-a462-6c846b844b4f service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:08.212146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65446c93-20db-4661-a462-6c846b844b4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:08.216329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65446c93-20db-4661-a462-6c846b844b4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:08.234392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65446c93-20db-4661-a462-6c846b844b4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:08.236063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65446c93-20db-4661-a462-6c846b844b4f service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:08.247384 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3022/6003] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:40:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:40:10.578208 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78626f3-50ed-4b9a-b1a2-5644e3f6c909 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:10.581281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f78626f3-50ed-4b9a-b1a2-5644e3f6c909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:10.606723 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78626f3-50ed-4b9a-b1a2-5644e3f6c909 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:10.615838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a2c3f-8b5b-4afb-9362-881e8f825ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:10.617158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a2c3f-8b5b-4afb-9362-881e8f825ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:10.617942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a2c3f-8b5b-4afb-9362-881e8f825ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:10.618492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a2c3f-8b5b-4afb-9362-881e8f825ca1 admin admin] PATH_INFO: `/v3/projects/bd481ee16e9c4bce8943579a5bf12183` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:10.620088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a2c3f-8b5b-4afb-9362-881e8f825ca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd481ee16e9c4bce8943579a5bf12183)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:10.622407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a2c3f-8b5b-4afb-9362-881e8f825ca1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:10.685169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-657a2c3f-8b5b-4afb-9362-881e8f825ca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd481ee16e9c4bce8943579a5bf12183', 'request_id': 'req-657a2c3f-8b5b-4afb-9362-881e8f825ca1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:10.700533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-657a2c3f-8b5b-4afb-9362-881e8f825ca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd481ee16e9c4bce8943579a5bf12183', 'request_id': 'req-657a2c3f-8b5b-4afb-9362-881e8f825ca1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:10.722209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-657a2c3f-8b5b-4afb-9362-881e8f825ca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd481ee16e9c4bce8943579a5bf12183', 'request_id': 'req-657a2c3f-8b5b-4afb-9362-881e8f825ca1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:10.741951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-657a2c3f-8b5b-4afb-9362-881e8f825ca1 admin admin] The token cache is being invalidate because project bd481ee16e9c4bce8943579a5bf12183 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:40:10.742431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-657a2c3f-8b5b-4afb-9362-881e8f825ca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:10.743278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-657a2c3f-8b5b-4afb-9362-881e8f825ca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:10.747938 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2982/6004] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:40:10 2022] DELETE /identity/v3/projects/bd481ee16e9c4bce8943579a5bf12183 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:10.750262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9c6b1-d7bd-4a70-8c96-9ec4ece411cf None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:10.751070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9c6b1-d7bd-4a70-8c96-9ec4ece411cf None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:10.751505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9c6b1-d7bd-4a70-8c96-9ec4ece411cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:10.795227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-55b9c6b1-d7bd-4a70-8c96-9ec4ece411cf None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:10.797498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-55b9c6b1-d7bd-4a70-8c96-9ec4ece411cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:10.961536 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3023/6005] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:10.963441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18203b60-1efa-4208-96ef-d300e41f4691 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:10.964102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18203b60-1efa-4208-96ef-d300e41f4691 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:10.964705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18203b60-1efa-4208-96ef-d300e41f4691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:11.002041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-18203b60-1efa-4208-96ef-d300e41f4691 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:11.003413 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-18203b60-1efa-4208-96ef-d300e41f4691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:11.034311 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2983/6006] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:11.038322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9c6b1-d7bd-4a70-8c96-9ec4ece411cf None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:11.052403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9c6b1-d7bd-4a70-8c96-9ec4ece411cf None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:11.068879 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb4960-f29b-4a02-8900-bee3d3c27c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:11.069758 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb4960-f29b-4a02-8900-bee3d3c27c32 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:11.070859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb4960-f29b-4a02-8900-bee3d3c27c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:11.071459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb4960-f29b-4a02-8900-bee3d3c27c32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:11.072501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb4960-f29b-4a02-8900-bee3d3c27c32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:40:11.072962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb4960-f29b-4a02-8900-bee3d3c27c32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:11.074724 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb4960-f29b-4a02-8900-bee3d3c27c32 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:11.105643 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3024/6007] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:40:11.105982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18203b60-1efa-4208-96ef-d300e41f4691 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:11.129223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18203b60-1efa-4208-96ef-d300e41f4691 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:11.171623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c410e2-5700-4e6e-8567-a96fe688db30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:11.173646 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c410e2-5700-4e6e-8567-a96fe688db30 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:11.174706 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c410e2-5700-4e6e-8567-a96fe688db30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:11.177143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c410e2-5700-4e6e-8567-a96fe688db30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:11.179117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c410e2-5700-4e6e-8567-a96fe688db30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:11.187198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c410e2-5700-4e6e-8567-a96fe688db30 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:11.360808 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2984/6008] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:40:11 2022] POST /identity/v3/projects => generated 357 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:40:11.365054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb4960-f29b-4a02-8900-bee3d3c27c32 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:11.381635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb4960-f29b-4a02-8900-bee3d3c27c32 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:11.525287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10ec21-5f3a-418e-ba7e-6bb43c9720d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:11.526103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10ec21-5f3a-418e-ba7e-6bb43c9720d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:11.526383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10ec21-5f3a-418e-ba7e-6bb43c9720d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:11.526655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10ec21-5f3a-418e-ba7e-6bb43c9720d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:11.527533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10ec21-5f3a-418e-ba7e-6bb43c9720d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:11.529940 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10ec21-5f3a-418e-ba7e-6bb43c9720d4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:11.583128 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c410e2-5700-4e6e-8567-a96fe688db30 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:11.591617 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3025/6009] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:40:11 2022] POST /identity/v3/users => generated 279 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:11.601090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c410e2-5700-4e6e-8567-a96fe688db30 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:11.619593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827d2be-a3c0-46b8-ab69-9cef65b90bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:11.621754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827d2be-a3c0-46b8-ab69-9cef65b90bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:11.622211 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827d2be-a3c0-46b8-ab69-9cef65b90bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:11.622497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a827d2be-a3c0-46b8-ab69-9cef65b90bc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:11.624445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a827d2be-a3c0-46b8-ab69-9cef65b90bc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:11.629040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a827d2be-a3c0-46b8-ab69-9cef65b90bc1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:11.661277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10ec21-5f3a-418e-ba7e-6bb43c9720d4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:11.661757 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2985/6010] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:40:11.669246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827d2be-a3c0-46b8-ab69-9cef65b90bc1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:11.674555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a827d2be-a3c0-46b8-ab69-9cef65b90bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:11.685374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10ec21-5f3a-418e-ba7e-6bb43c9720d4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:11.708715 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc09121-6542-4939-bbc4-0719d7d01c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:11.709595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc09121-6542-4939-bbc4-0719d7d01c63 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:11.710069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc09121-6542-4939-bbc4-0719d7d01c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:11.710513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc09121-6542-4939-bbc4-0719d7d01c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:11.712675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc09121-6542-4939-bbc4-0719d7d01c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:11.719010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc09121-6542-4939-bbc4-0719d7d01c63 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:11.728916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a827d2be-a3c0-46b8-ab69-9cef65b90bc1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:11.745852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1faab3-e3c3-44c8-b2ed-fd529e8ede07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:11.746498 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1faab3-e3c3-44c8-b2ed-fd529e8ede07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:11.746773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1faab3-e3c3-44c8-b2ed-fd529e8ede07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:11.747044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1faab3-e3c3-44c8-b2ed-fd529e8ede07 admin admin] PATH_INFO: `/v3/users/bed65a4d62184f52af3d2dd322eeec47` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:11.753042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1faab3-e3c3-44c8-b2ed-fd529e8ede07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bed65a4d62184f52af3d2dd322eeec47)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:11.761574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1faab3-e3c3-44c8-b2ed-fd529e8ede07 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:11.763046 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3026/6011] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:11 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:11.768316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc09121-6542-4939-bbc4-0719d7d01c63 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:11.805283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc09121-6542-4939-bbc4-0719d7d01c63 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:11.838806 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaadbb4-0fc4-46ce-9438-904d8707a703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:11.845108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaadbb4-0fc4-46ce-9438-904d8707a703 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:11.845643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaadbb4-0fc4-46ce-9438-904d8707a703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:11.848260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaadbb4-0fc4-46ce-9438-904d8707a703 admin admin] PATH_INFO: `/v3/projects/ccd23866e88e4aa4acf5b0f41c0b2004/users/23ff59c0b401438ab6c45bcf6eab42c8/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:11.923455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaadbb4-0fc4-46ce-9438-904d8707a703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd23866e88e4aa4acf5b0f41c0b2004, user_id=23ff59c0b401438ab6c45bcf6eab42c8, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:11.930200 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaadbb4-0fc4-46ce-9438-904d8707a703 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:11.955949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0f1faab3-e3c3-44c8-b2ed-fd529e8ede07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bed65a4d62184f52af3d2dd322eeec47'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:11.975091 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3027/6012] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:11 2022] PUT /identity/v3/projects/ccd23866e88e4aa4acf5b0f41c0b2004/users/23ff59c0b401438ab6c45bcf6eab42c8/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:11.977767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0f1faab3-e3c3-44c8-b2ed-fd529e8ede07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bed65a4d62184f52af3d2dd322eeec47'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:11.980678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b253ed6-bc41-418f-b8ef-a6939a6309b0 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:11.982261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b253ed6-bc41-418f-b8ef-a6939a6309b0 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:11.983355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b253ed6-bc41-418f-b8ef-a6939a6309b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:12.014411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0f1faab3-e3c3-44c8-b2ed-fd529e8ede07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bed65a4d62184f52af3d2dd322eeec47'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:12.015643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0f1faab3-e3c3-44c8-b2ed-fd529e8ede07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bed65a4d62184f52af3d2dd322eeec47'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:12.028099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0f1faab3-e3c3-44c8-b2ed-fd529e8ede07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bed65a4d62184f52af3d2dd322eeec47'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:12.042321 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2986/6013] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:40:11 2022] DELETE /identity/v3/users/bed65a4d62184f52af3d2dd322eeec47 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:12.083513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9b253ed6-bc41-418f-b8ef-a6939a6309b0 None None] MFA Rules not processed for user `23ff59c0b401438ab6c45bcf6eab42c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:12.086369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9b253ed6-bc41-418f-b8ef-a6939a6309b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:12.129735 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:12.302563 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3028/6014] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:11 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:12.546094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1faab3-e3c3-44c8-b2ed-fd529e8ede07 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:12.549538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0f1faab3-e3c3-44c8-b2ed-fd529e8ede07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:12.558098 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:12.718766 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1faab3-e3c3-44c8-b2ed-fd529e8ede07 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:12.739582 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de754a7-34e4-4e56-a1bf-c4038323f454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:12.740571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de754a7-34e4-4e56-a1bf-c4038323f454 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:12.740965 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de754a7-34e4-4e56-a1bf-c4038323f454 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:12.741350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de754a7-34e4-4e56-a1bf-c4038323f454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:12.777589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de754a7-34e4-4e56-a1bf-c4038323f454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:12.779642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de754a7-34e4-4e56-a1bf-c4038323f454 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:12.804718 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2987/6015] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:40:12 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:40:14.348653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b253ed6-bc41-418f-b8ef-a6939a6309b0 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:14.351386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9b253ed6-bc41-418f-b8ef-a6939a6309b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:14.509773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b253ed6-bc41-418f-b8ef-a6939a6309b0 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:14.515982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9e04e-dedb-4ac8-9030-3e1fbea55d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:14.516696 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9e04e-dedb-4ac8-9030-3e1fbea55d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:14.516975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9e04e-dedb-4ac8-9030-3e1fbea55d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:14.517249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9e04e-dedb-4ac8-9030-3e1fbea55d59 admin admin] PATH_INFO: `/v3/projects/284c227cd03a4c1294ed40d7b1594d56` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:14.518466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9e04e-dedb-4ac8-9030-3e1fbea55d59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=284c227cd03a4c1294ed40d7b1594d56)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:14.520754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9e04e-dedb-4ac8-9030-3e1fbea55d59 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:14.629111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7fe9e04e-dedb-4ac8-9030-3e1fbea55d59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '284c227cd03a4c1294ed40d7b1594d56', 'request_id': 'req-7fe9e04e-dedb-4ac8-9030-3e1fbea55d59'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:14.645898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7fe9e04e-dedb-4ac8-9030-3e1fbea55d59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '284c227cd03a4c1294ed40d7b1594d56', 'request_id': 'req-7fe9e04e-dedb-4ac8-9030-3e1fbea55d59'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:14.657930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7fe9e04e-dedb-4ac8-9030-3e1fbea55d59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '284c227cd03a4c1294ed40d7b1594d56', 'request_id': 'req-7fe9e04e-dedb-4ac8-9030-3e1fbea55d59'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:14.683612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7fe9e04e-dedb-4ac8-9030-3e1fbea55d59 admin admin] The token cache is being invalidate because project 284c227cd03a4c1294ed40d7b1594d56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:40:14.683955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7fe9e04e-dedb-4ac8-9030-3e1fbea55d59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:14.688346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7fe9e04e-dedb-4ac8-9030-3e1fbea55d59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:14.693027 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3029/6016] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:40:14 2022] DELETE /identity/v3/projects/284c227cd03a4c1294ed40d7b1594d56 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:40:14.694781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c2c96-027a-47ac-b9ee-8be7a9a77f5a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:14.695285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c2c96-027a-47ac-b9ee-8be7a9a77f5a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:14.695364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c2c96-027a-47ac-b9ee-8be7a9a77f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:14.740773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e45c2c96-027a-47ac-b9ee-8be7a9a77f5a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:14.742972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e45c2c96-027a-47ac-b9ee-8be7a9a77f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:14.967997 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2988/6017] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:14.975961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce0af8-570e-492d-b68b-e0d453cfbfe8 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:14.986625 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce0af8-570e-492d-b68b-e0d453cfbfe8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:14.986952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce0af8-570e-492d-b68b-e0d453cfbfe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:15.028705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-47ce0af8-570e-492d-b68b-e0d453cfbfe8 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:15.029975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-47ce0af8-570e-492d-b68b-e0d453cfbfe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:15.054512 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3030/6018] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:15.056196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c2c96-027a-47ac-b9ee-8be7a9a77f5a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:15.077507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c2c96-027a-47ac-b9ee-8be7a9a77f5a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:15.091519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6703f-f7cd-4a73-85ca-1e163501ccff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:15.092203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6703f-f7cd-4a73-85ca-1e163501ccff admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:15.092481 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6703f-f7cd-4a73-85ca-1e163501ccff admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:15.096074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6703f-f7cd-4a73-85ca-1e163501ccff admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:15.096889 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6703f-f7cd-4a73-85ca-1e163501ccff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:40:15.097204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6703f-f7cd-4a73-85ca-1e163501ccff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:15.102284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6703f-f7cd-4a73-85ca-1e163501ccff admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:15.159642 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2989/6019] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:40:15.164623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce0af8-570e-492d-b68b-e0d453cfbfe8 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:15.177244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce0af8-570e-492d-b68b-e0d453cfbfe8 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:15.203171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62d975-8539-4331-9407-59f92b1d9d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:15.204526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62d975-8539-4331-9407-59f92b1d9d05 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:15.204814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62d975-8539-4331-9407-59f92b1d9d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:15.205088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62d975-8539-4331-9407-59f92b1d9d05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:15.207967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62d975-8539-4331-9407-59f92b1d9d05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:15.211672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62d975-8539-4331-9407-59f92b1d9d05 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:15.302948 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3031/6020] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:40:15 2022] POST /identity/v3/projects => generated 369 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:15.307597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6703f-f7cd-4a73-85ca-1e163501ccff admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:15.324352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6703f-f7cd-4a73-85ca-1e163501ccff admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:15.517713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c82f0-409e-4e33-a289-366a5bb460b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:15.518385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c82f0-409e-4e33-a289-366a5bb460b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:15.518667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c82f0-409e-4e33-a289-366a5bb460b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:15.519184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c82f0-409e-4e33-a289-366a5bb460b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:15.519878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c82f0-409e-4e33-a289-366a5bb460b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:15.525887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c82f0-409e-4e33-a289-366a5bb460b4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:15.580224 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2990/6021] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:40:15 2022] POST /identity/v3/users => generated 285 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:15.584089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62d975-8539-4331-9407-59f92b1d9d05 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:15.598064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62d975-8539-4331-9407-59f92b1d9d05 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:15.611307 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c09da4-d41d-4990-94d7-0b19ef77bbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:15.612132 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c09da4-d41d-4990-94d7-0b19ef77bbe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:15.612416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c09da4-d41d-4990-94d7-0b19ef77bbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:15.612686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c09da4-d41d-4990-94d7-0b19ef77bbe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:15.613413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c09da4-d41d-4990-94d7-0b19ef77bbe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:15.615024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c09da4-d41d-4990-94d7-0b19ef77bbe5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:15.647605 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3032/6022] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:15.651382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c82f0-409e-4e33-a289-366a5bb460b4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:15.663418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c82f0-409e-4e33-a289-366a5bb460b4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:15.677299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ae745-3255-44a8-a836-441945457803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:15.677927 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ae745-3255-44a8-a836-441945457803 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:15.678203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ae745-3255-44a8-a836-441945457803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:15.681313 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ae745-3255-44a8-a836-441945457803 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:15.683283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ae745-3255-44a8-a836-441945457803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:15.687027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ae745-3255-44a8-a836-441945457803 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:15.719155 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2991/6023] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:15.722669 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c09da4-d41d-4990-94d7-0b19ef77bbe5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:15.742803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c09da4-d41d-4990-94d7-0b19ef77bbe5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:15.756814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd108ba-91c4-49b7-a905-4b13dc18692c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:15.757542 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd108ba-91c4-49b7-a905-4b13dc18692c admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:15.757821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd108ba-91c4-49b7-a905-4b13dc18692c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:15.758093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd108ba-91c4-49b7-a905-4b13dc18692c admin admin] PATH_INFO: `/v3/projects/9be07c3ca04041cb9b9a774505685be8/users/967696da8fe64430bba3e4005fd6b558/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:15.765187 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:15.810866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd108ba-91c4-49b7-a905-4b13dc18692c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9be07c3ca04041cb9b9a774505685be8, user_id=967696da8fe64430bba3e4005fd6b558, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:15.813634 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd108ba-91c4-49b7-a905-4b13dc18692c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:15.842874 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3033/6024] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:15 2022] PUT /identity/v3/projects/9be07c3ca04041cb9b9a774505685be8/users/967696da8fe64430bba3e4005fd6b558/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:40:15.853498 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe122b-f5c7-4804-b3e8-98b2da31dc48 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:15.853782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe122b-f5c7-4804-b3e8-98b2da31dc48 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:15.854054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe122b-f5c7-4804-b3e8-98b2da31dc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:15.918182 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:15.924656 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-96fe122b-f5c7-4804-b3e8-98b2da31dc48 None None] MFA Rules not processed for user `967696da8fe64430bba3e4005fd6b558`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:15.934593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-96fe122b-f5c7-4804-b3e8-98b2da31dc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:16.201700 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2992/6025] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:16.206540 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd108ba-91c4-49b7-a905-4b13dc18692c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:16.488337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd108ba-91c4-49b7-a905-4b13dc18692c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:16.526157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e3207-9a02-4734-8c11-e825e3f8bf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:16.526794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e3207-9a02-4734-8c11-e825e3f8bf9d admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:16.527078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e3207-9a02-4734-8c11-e825e3f8bf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:16.527348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e3207-9a02-4734-8c11-e825e3f8bf9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:16.528088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e3207-9a02-4734-8c11-e825e3f8bf9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:16.530760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e3207-9a02-4734-8c11-e825e3f8bf9d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:16.634972 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3034/6026] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:40:16 2022] POST /identity/v3/projects => generated 367 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:16.639196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe122b-f5c7-4804-b3e8-98b2da31dc48 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:16.658451 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe122b-f5c7-4804-b3e8-98b2da31dc48 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:16.830295 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd73052-9bf6-46f7-9387-ea6079ce949f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:16.832462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd73052-9bf6-46f7-9387-ea6079ce949f admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:16.832756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd73052-9bf6-46f7-9387-ea6079ce949f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:16.835118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd73052-9bf6-46f7-9387-ea6079ce949f admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:16.839873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd73052-9bf6-46f7-9387-ea6079ce949f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:16.846475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd73052-9bf6-46f7-9387-ea6079ce949f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:16.933782 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2993/6027] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:40:16 2022] POST /identity/v3/users => generated 290 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:16.934032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e3207-9a02-4734-8c11-e825e3f8bf9d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:16.954572 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e3207-9a02-4734-8c11-e825e3f8bf9d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:16.990348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83557c7a-234b-430d-8182-5040b03e08f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:16.991001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83557c7a-234b-430d-8182-5040b03e08f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:16.991801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83557c7a-234b-430d-8182-5040b03e08f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:16.992201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83557c7a-234b-430d-8182-5040b03e08f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:16.992904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83557c7a-234b-430d-8182-5040b03e08f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:16.994605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83557c7a-234b-430d-8182-5040b03e08f7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:17.036755 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3035/6028] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:17.038382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd73052-9bf6-46f7-9387-ea6079ce949f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:17.054711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd73052-9bf6-46f7-9387-ea6079ce949f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:17.070912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3e780-149f-4b19-84b9-82b3b363bbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:17.071725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3e780-149f-4b19-84b9-82b3b363bbd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:17.072475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3e780-149f-4b19-84b9-82b3b363bbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:17.072475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3e780-149f-4b19-84b9-82b3b363bbd6 admin admin] PATH_INFO: `/v3/projects/7b086caf29eb438fb35a58ed1c84abf5/users/01ddb68259cd413899712c2ccd9fcd4e/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:17.125509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3e780-149f-4b19-84b9-82b3b363bbd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b086caf29eb438fb35a58ed1c84abf5, user_id=01ddb68259cd413899712c2ccd9fcd4e, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:17.130997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3e780-149f-4b19-84b9-82b3b363bbd6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:17.166506 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2994/6029] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:17 2022] PUT /identity/v3/projects/7b086caf29eb438fb35a58ed1c84abf5/users/01ddb68259cd413899712c2ccd9fcd4e/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:17.168023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83557c7a-234b-430d-8182-5040b03e08f7 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:17.186971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83557c7a-234b-430d-8182-5040b03e08f7 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:17.386857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92df72-5c6d-483e-9e31-63bb09c2da0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:17.387600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92df72-5c6d-483e-9e31-63bb09c2da0b admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:17.387914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92df72-5c6d-483e-9e31-63bb09c2da0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:17.390967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92df72-5c6d-483e-9e31-63bb09c2da0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:17.393975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92df72-5c6d-483e-9e31-63bb09c2da0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:17.395993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92df72-5c6d-483e-9e31-63bb09c2da0b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:17.430234 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3036/6030] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:17.431984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3e780-149f-4b19-84b9-82b3b363bbd6 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:17.466289 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3e780-149f-4b19-84b9-82b3b363bbd6 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:17.492758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e812e0d-0dbd-4baa-8b51-b5ef7bbb905b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:17.494059 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e812e0d-0dbd-4baa-8b51-b5ef7bbb905b admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:17.494352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e812e0d-0dbd-4baa-8b51-b5ef7bbb905b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:17.494596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e812e0d-0dbd-4baa-8b51-b5ef7bbb905b admin admin] PATH_INFO: `/v3/projects/7b086caf29eb438fb35a58ed1c84abf5/users/01ddb68259cd413899712c2ccd9fcd4e/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:17.507783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e812e0d-0dbd-4baa-8b51-b5ef7bbb905b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b086caf29eb438fb35a58ed1c84abf5, user_id=01ddb68259cd413899712c2ccd9fcd4e, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:17.515346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e812e0d-0dbd-4baa-8b51-b5ef7bbb905b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:17.564721 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2995/6031] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:17 2022] PUT /identity/v3/projects/7b086caf29eb438fb35a58ed1c84abf5/users/01ddb68259cd413899712c2ccd9fcd4e/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:17.575993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11f730-8593-454c-91ba-e71b81620efa None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:17.576311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11f730-8593-454c-91ba-e71b81620efa None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:17.576598 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11f730-8593-454c-91ba-e71b81620efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:17.699445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ed11f730-8593-454c-91ba-e71b81620efa None None] MFA Rules not processed for user `01ddb68259cd413899712c2ccd9fcd4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:17.705583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ed11f730-8593-454c-91ba-e71b81620efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:17.924336 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:18.009467 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3037/6032] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:17 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:18.015641 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e812e0d-0dbd-4baa-8b51-b5ef7bbb905b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:18.035370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e812e0d-0dbd-4baa-8b51-b5ef7bbb905b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:18.051466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d2ef8-0752-46db-abc9-c2205a82841b tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01ddb68259cd413899712c2ccd9fcd4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b086caf29eb438fb35a58ed1c84abf5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:18.052305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d2ef8-0752-46db-abc9-c2205a82841b tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:18.052627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d2ef8-0752-46db-abc9-c2205a82841b tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:18.063692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d2ef8-0752-46db-abc9-c2205a82841b tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] PATH_INFO: `/v3/policies` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:18.066289 n-d-master-1 devstack@keystone.service[80493]: WARNING oslo_log.versionutils [None req-d51d2ef8-0752-46db-abc9-c2205a82841b tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 07 01:40:18.066825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d2ef8-0752-46db-abc9-c2205a82841b tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:18.077510 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-d51d2ef8-0752-46db-abc9-c2205a82841b tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:40:18.077510 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:40:18.077510 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:40:18.081574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d2ef8-0752-46db-abc9-c2205a82841b tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:18.149369 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2996/6033] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Aug 7 01:40:18 2022] POST /identity/v3/policies => generated 228 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:18.150024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11f730-8593-454c-91ba-e71b81620efa None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:18.180995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11f730-8593-454c-91ba-e71b81620efa None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:18.199685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75663930-db78-46dd-9054-6e93cd39eb6f tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01ddb68259cd413899712c2ccd9fcd4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b086caf29eb438fb35a58ed1c84abf5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:18.200384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75663930-db78-46dd-9054-6e93cd39eb6f tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:18.200666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75663930-db78-46dd-9054-6e93cd39eb6f tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:18.201213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75663930-db78-46dd-9054-6e93cd39eb6f tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] PATH_INFO: `/v3/policies/d5dc6a927a83417faa0f3ab2b2db5e85` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:18.202997 n-d-master-1 devstack@keystone.service[80492]: WARNING oslo_log.versionutils [None req-75663930-db78-46dd-9054-6e93cd39eb6f tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 07 01:40:18.203973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75663930-db78-46dd-9054-6e93cd39eb6f tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=d5dc6a927a83417faa0f3ab2b2db5e85)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:18.225794 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-75663930-db78-46dd-9054-6e93cd39eb6f tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:40:18.225794 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:40:18.225794 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:40:18.226732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75663930-db78-46dd-9054-6e93cd39eb6f tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:18.318557 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3038/6034] 10.222.0.39 () {60 vars in 1252 bytes} [Sun Aug 7 01:40:18 2022] PATCH /identity/v3/policies/d5dc6a927a83417faa0f3ab2b2db5e85 => generated 236 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:40:18.324690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d2ef8-0752-46db-abc9-c2205a82841b tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:18.347261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d2ef8-0752-46db-abc9-c2205a82841b tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:18.368648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b47179-ec03-4fce-88c2-dccbcebea1e7 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01ddb68259cd413899712c2ccd9fcd4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b086caf29eb438fb35a58ed1c84abf5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:18.369586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b47179-ec03-4fce-88c2-dccbcebea1e7 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:18.371661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b47179-ec03-4fce-88c2-dccbcebea1e7 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:18.373081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b47179-ec03-4fce-88c2-dccbcebea1e7 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] PATH_INFO: `/v3/policies/d5dc6a927a83417faa0f3ab2b2db5e85` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:18.375743 n-d-master-1 devstack@keystone.service[80493]: WARNING oslo_log.versionutils [None req-d9b47179-ec03-4fce-88c2-dccbcebea1e7 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 07 01:40:18.376538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b47179-ec03-4fce-88c2-dccbcebea1e7 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=d5dc6a927a83417faa0f3ab2b2db5e85)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:18.389747 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-d9b47179-ec03-4fce-88c2-dccbcebea1e7 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:40:18.389747 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:40:18.389747 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:40:18.390688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b47179-ec03-4fce-88c2-dccbcebea1e7 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:18.421283 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2997/6035] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:40:18 2022] GET /identity/v3/policies/d5dc6a927a83417faa0f3ab2b2db5e85 => generated 236 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:40:18.425687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75663930-db78-46dd-9054-6e93cd39eb6f tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:18.441875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75663930-db78-46dd-9054-6e93cd39eb6f tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:18.455330 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94549d3a-3596-44fc-b15d-8585cbe2ef1a tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01ddb68259cd413899712c2ccd9fcd4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b086caf29eb438fb35a58ed1c84abf5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:18.456260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94549d3a-3596-44fc-b15d-8585cbe2ef1a tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:18.456540 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94549d3a-3596-44fc-b15d-8585cbe2ef1a tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:18.456829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94549d3a-3596-44fc-b15d-8585cbe2ef1a tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] PATH_INFO: `/v3/policies/d5dc6a927a83417faa0f3ab2b2db5e85` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:18.457708 n-d-master-1 devstack@keystone.service[80492]: WARNING oslo_log.versionutils [None req-94549d3a-3596-44fc-b15d-8585cbe2ef1a tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 07 01:40:18.459947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94549d3a-3596-44fc-b15d-8585cbe2ef1a tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=d5dc6a927a83417faa0f3ab2b2db5e85)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:18.461998 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-94549d3a-3596-44fc-b15d-8585cbe2ef1a tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:40:18.461998 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:40:18.461998 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:40:18.464657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94549d3a-3596-44fc-b15d-8585cbe2ef1a tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:18.495876 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3039/6036] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:40:18 2022] DELETE /identity/v3/policies/d5dc6a927a83417faa0f3ab2b2db5e85 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:18.501396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b47179-ec03-4fce-88c2-dccbcebea1e7 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:18.514411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b47179-ec03-4fce-88c2-dccbcebea1e7 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:18.537831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd3797-57da-4157-b38a-a1d7e4fae4e7 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01ddb68259cd413899712c2ccd9fcd4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b086caf29eb438fb35a58ed1c84abf5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:18.540015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd3797-57da-4157-b38a-a1d7e4fae4e7 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:18.540295 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd3797-57da-4157-b38a-a1d7e4fae4e7 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:18.541431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd3797-57da-4157-b38a-a1d7e4fae4e7 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] PATH_INFO: `/v3/policies` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:18.543835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd3797-57da-4157-b38a-a1d7e4fae4e7 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:18.547837 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd3797-57da-4157-b38a-a1d7e4fae4e7 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:18.593037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94549d3a-3596-44fc-b15d-8585cbe2ef1a tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:18.600444 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2998/6037] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Aug 7 01:40:18 2022] POST /identity/v3/policies => generated 229 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:18.610551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94549d3a-3596-44fc-b15d-8585cbe2ef1a tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:18.625601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833393e1-7156-4e6c-9eed-7b832f7f56f5 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01ddb68259cd413899712c2ccd9fcd4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b086caf29eb438fb35a58ed1c84abf5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:18.626412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833393e1-7156-4e6c-9eed-7b832f7f56f5 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:18.626854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833393e1-7156-4e6c-9eed-7b832f7f56f5 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:18.627283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833393e1-7156-4e6c-9eed-7b832f7f56f5 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] PATH_INFO: `/v3/policies` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:18.628781 n-d-master-1 devstack@keystone.service[80492]: WARNING oslo_log.versionutils [None req-833393e1-7156-4e6c-9eed-7b832f7f56f5 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 07 01:40:18.630278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833393e1-7156-4e6c-9eed-7b832f7f56f5 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:18.633781 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-833393e1-7156-4e6c-9eed-7b832f7f56f5 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:40:18.633781 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:40:18.633781 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:40:18.638939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833393e1-7156-4e6c-9eed-7b832f7f56f5 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:18.679394 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3040/6038] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Aug 7 01:40:18 2022] POST /identity/v3/policies => generated 227 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:40:18.682130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd3797-57da-4157-b38a-a1d7e4fae4e7 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:18.696530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd3797-57da-4157-b38a-a1d7e4fae4e7 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:18.720851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df274345-6cf0-4f69-b3cd-4621de970a95 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01ddb68259cd413899712c2ccd9fcd4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b086caf29eb438fb35a58ed1c84abf5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:18.721741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df274345-6cf0-4f69-b3cd-4621de970a95 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:18.722168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df274345-6cf0-4f69-b3cd-4621de970a95 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:18.722616 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df274345-6cf0-4f69-b3cd-4621de970a95 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] PATH_INFO: `/v3/policies` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:18.723921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df274345-6cf0-4f69-b3cd-4621de970a95 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:18.726065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df274345-6cf0-4f69-b3cd-4621de970a95 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:18.779763 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 2999/6039] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Aug 7 01:40:18 2022] POST /identity/v3/policies => generated 229 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:18.783554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833393e1-7156-4e6c-9eed-7b832f7f56f5 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:18.804697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833393e1-7156-4e6c-9eed-7b832f7f56f5 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:18.834273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3ec9e-8276-4058-9bdb-c560d02f4df3 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01ddb68259cd413899712c2ccd9fcd4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b086caf29eb438fb35a58ed1c84abf5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:18.834665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3ec9e-8276-4058-9bdb-c560d02f4df3 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:18.835744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3ec9e-8276-4058-9bdb-c560d02f4df3 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:18.836139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3ec9e-8276-4058-9bdb-c560d02f4df3 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] PATH_INFO: `/v3/policies` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:18.837049 n-d-master-1 devstack@keystone.service[80492]: WARNING oslo_log.versionutils [None req-70d3ec9e-8276-4058-9bdb-c560d02f4df3 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 07 01:40:18.837604 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3ec9e-8276-4058-9bdb-c560d02f4df3 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:18.842566 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-70d3ec9e-8276-4058-9bdb-c560d02f4df3 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:40:18.842566 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:40:18.842566 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:40:18.843564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3ec9e-8276-4058-9bdb-c560d02f4df3 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:18.878647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df274345-6cf0-4f69-b3cd-4621de970a95 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:18.887623 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3041/6040] 10.222.0.39 () {58 vars in 1131 bytes} [Sun Aug 7 01:40:18 2022] GET /identity/v3/policies => generated 761 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:40:18.899412 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df274345-6cf0-4f69-b3cd-4621de970a95 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:18.935773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd7af8-6769-427c-9f5c-29436bb4d5ae tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01ddb68259cd413899712c2ccd9fcd4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b086caf29eb438fb35a58ed1c84abf5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:18.936566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd7af8-6769-427c-9f5c-29436bb4d5ae tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:18.936873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd7af8-6769-427c-9f5c-29436bb4d5ae tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:18.937248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd7af8-6769-427c-9f5c-29436bb4d5ae tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] PATH_INFO: `/v3/policies/127bbec9e95a43a3ad98f44194ed9ef5` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:18.938314 n-d-master-1 devstack@keystone.service[80493]: WARNING oslo_log.versionutils [None req-30bd7af8-6769-427c-9f5c-29436bb4d5ae tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Aug 07 01:40:18.939134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd7af8-6769-427c-9f5c-29436bb4d5ae tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=127bbec9e95a43a3ad98f44194ed9ef5)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:18.941794 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-30bd7af8-6769-427c-9f5c-29436bb4d5ae tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:40:18.941794 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:40:18.941794 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:40:18.946452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd7af8-6769-427c-9f5c-29436bb4d5ae tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:18.953687 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:19.008631 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3000/6041] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:40:18 2022] DELETE /identity/v3/policies/127bbec9e95a43a3ad98f44194ed9ef5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:19.010086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3ec9e-8276-4058-9bdb-c560d02f4df3 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:19.027823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3ec9e-8276-4058-9bdb-c560d02f4df3 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:19.043352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab60e8e-c73f-4264-890d-a729565a9add tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01ddb68259cd413899712c2ccd9fcd4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b086caf29eb438fb35a58ed1c84abf5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:19.044057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab60e8e-c73f-4264-890d-a729565a9add tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:19.044338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab60e8e-c73f-4264-890d-a729565a9add tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:19.044608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab60e8e-c73f-4264-890d-a729565a9add tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] PATH_INFO: `/v3/policies/87e59fdd0d0f47dab2be80144a46c2fb` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:19.045695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab60e8e-c73f-4264-890d-a729565a9add tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=87e59fdd0d0f47dab2be80144a46c2fb)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:19.050206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab60e8e-c73f-4264-890d-a729565a9add tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:19.127915 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3042/6042] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:40:19 2022] DELETE /identity/v3/policies/87e59fdd0d0f47dab2be80144a46c2fb => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:19.132599 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd7af8-6769-427c-9f5c-29436bb4d5ae tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:19.156016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd7af8-6769-427c-9f5c-29436bb4d5ae tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:19.173914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df852f4-ed84-4b0e-a5e6-43a4c47df3b9 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01ddb68259cd413899712c2ccd9fcd4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b086caf29eb438fb35a58ed1c84abf5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:19.174864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df852f4-ed84-4b0e-a5e6-43a4c47df3b9 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:19.176408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df852f4-ed84-4b0e-a5e6-43a4c47df3b9 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:19.177005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df852f4-ed84-4b0e-a5e6-43a4c47df3b9 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] PATH_INFO: `/v3/policies/bd8ea5b611044f42a1489e63c17f3ad6` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:19.179754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df852f4-ed84-4b0e-a5e6-43a4c47df3b9 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=bd8ea5b611044f42a1489e63c17f3ad6)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:19.184611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df852f4-ed84-4b0e-a5e6-43a4c47df3b9 tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:19.223667 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3001/6043] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:40:19 2022] DELETE /identity/v3/policies/bd8ea5b611044f42a1489e63c17f3ad6 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:19.229394 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab60e8e-c73f-4264-890d-a729565a9add tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:19.438310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab60e8e-c73f-4264-890d-a729565a9add tempest-PoliciesTestJSON-835090641 tempest-PoliciesTestJSON-835090641-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:19.450285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5ea9f-203a-4db7-81b6-26fd0b8ed29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:19.451227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5ea9f-203a-4db7-81b6-26fd0b8ed29c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:19.451685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5ea9f-203a-4db7-81b6-26fd0b8ed29c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:19.452131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5ea9f-203a-4db7-81b6-26fd0b8ed29c admin admin] PATH_INFO: `/v3/users/967696da8fe64430bba3e4005fd6b558` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:19.456163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5ea9f-203a-4db7-81b6-26fd0b8ed29c admin admin] RBAC: Authorizing `identity:delete_user(user_id=967696da8fe64430bba3e4005fd6b558)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:19.459646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5ea9f-203a-4db7-81b6-26fd0b8ed29c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:19.596584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dcf5ea9f-203a-4db7-81b6-26fd0b8ed29c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '967696da8fe64430bba3e4005fd6b558'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:19.616567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dcf5ea9f-203a-4db7-81b6-26fd0b8ed29c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '967696da8fe64430bba3e4005fd6b558'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:19.660873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dcf5ea9f-203a-4db7-81b6-26fd0b8ed29c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '967696da8fe64430bba3e4005fd6b558'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:19.664484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dcf5ea9f-203a-4db7-81b6-26fd0b8ed29c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '967696da8fe64430bba3e4005fd6b558'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:19.670210 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:19.684638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dcf5ea9f-203a-4db7-81b6-26fd0b8ed29c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '967696da8fe64430bba3e4005fd6b558'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:19.697797 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3043/6044] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:40:19 2022] DELETE /identity/v3/users/967696da8fe64430bba3e4005fd6b558 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:19.702608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6872eb5-f604-432a-8baa-6178b0d9f53e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:19.703139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6872eb5-f604-432a-8baa-6178b0d9f53e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:19.703605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6872eb5-f604-432a-8baa-6178b0d9f53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:19.757757 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-a6872eb5-f604-432a-8baa-6178b0d9f53e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:19.759276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a6872eb5-f604-432a-8baa-6178b0d9f53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:19.919374 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3002/6045] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:40:19.931379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5ea9f-203a-4db7-81b6-26fd0b8ed29c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:19.933068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dcf5ea9f-203a-4db7-81b6-26fd0b8ed29c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:20.054933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5ea9f-203a-4db7-81b6-26fd0b8ed29c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:20.065032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba54233-10aa-4dad-8a74-f361dd190761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:20.065670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba54233-10aa-4dad-8a74-f361dd190761 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:20.065942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba54233-10aa-4dad-8a74-f361dd190761 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:20.066210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba54233-10aa-4dad-8a74-f361dd190761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:20.093880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba54233-10aa-4dad-8a74-f361dd190761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:20.098349 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba54233-10aa-4dad-8a74-f361dd190761 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:20.139013 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3044/6046] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:40:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:40:20.858637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6872eb5-f604-432a-8baa-6178b0d9f53e None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:20.858637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a6872eb5-f604-432a-8baa-6178b0d9f53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:20.895678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6872eb5-f604-432a-8baa-6178b0d9f53e None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:20.957367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820e2bb-2e91-4d68-9814-73729ca110b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:20.958564 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820e2bb-2e91-4d68-9814-73729ca110b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:20.970700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820e2bb-2e91-4d68-9814-73729ca110b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:20.980437 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820e2bb-2e91-4d68-9814-73729ca110b0 admin admin] PATH_INFO: `/v3/projects/9be07c3ca04041cb9b9a774505685be8` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:20.988502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820e2bb-2e91-4d68-9814-73729ca110b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9be07c3ca04041cb9b9a774505685be8)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:20.991769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820e2bb-2e91-4d68-9814-73729ca110b0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:21.185638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e820e2bb-2e91-4d68-9814-73729ca110b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9be07c3ca04041cb9b9a774505685be8', 'request_id': 'req-e820e2bb-2e91-4d68-9814-73729ca110b0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:21.208416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e820e2bb-2e91-4d68-9814-73729ca110b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9be07c3ca04041cb9b9a774505685be8', 'request_id': 'req-e820e2bb-2e91-4d68-9814-73729ca110b0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:21.236755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e820e2bb-2e91-4d68-9814-73729ca110b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9be07c3ca04041cb9b9a774505685be8', 'request_id': 'req-e820e2bb-2e91-4d68-9814-73729ca110b0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:21.299252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e820e2bb-2e91-4d68-9814-73729ca110b0 admin admin] The token cache is being invalidate because project 9be07c3ca04041cb9b9a774505685be8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:40:21.300198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e820e2bb-2e91-4d68-9814-73729ca110b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:21.303409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e820e2bb-2e91-4d68-9814-73729ca110b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:21.307581 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3003/6047] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:40:20 2022] DELETE /identity/v3/projects/9be07c3ca04041cb9b9a774505685be8 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:21.311707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba54233-10aa-4dad-8a74-f361dd190761 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:21.329017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba54233-10aa-4dad-8a74-f361dd190761 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:21.540729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fcf5a-9a9c-444b-839f-297e67fbfc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:21.543607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fcf5a-9a9c-444b-839f-297e67fbfc1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:21.545741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fcf5a-9a9c-444b-839f-297e67fbfc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:21.546264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fcf5a-9a9c-444b-839f-297e67fbfc1c admin admin] PATH_INFO: `/v3/users/01ddb68259cd413899712c2ccd9fcd4e` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:21.549363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fcf5a-9a9c-444b-839f-297e67fbfc1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=01ddb68259cd413899712c2ccd9fcd4e)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:21.555408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fcf5a-9a9c-444b-839f-297e67fbfc1c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:21.791706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-098fcf5a-9a9c-444b-839f-297e67fbfc1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01ddb68259cd413899712c2ccd9fcd4e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:21.820890 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-098fcf5a-9a9c-444b-839f-297e67fbfc1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01ddb68259cd413899712c2ccd9fcd4e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:21.876909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-098fcf5a-9a9c-444b-839f-297e67fbfc1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01ddb68259cd413899712c2ccd9fcd4e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:21.877837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-098fcf5a-9a9c-444b-839f-297e67fbfc1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01ddb68259cd413899712c2ccd9fcd4e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:21.892222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-098fcf5a-9a9c-444b-839f-297e67fbfc1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01ddb68259cd413899712c2ccd9fcd4e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:21.905703 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3045/6048] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:40:21 2022] DELETE /identity/v3/users/01ddb68259cd413899712c2ccd9fcd4e => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:40:23.472283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820e2bb-2e91-4d68-9814-73729ca110b0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:23.474634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e820e2bb-2e91-4d68-9814-73729ca110b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:23.505399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820e2bb-2e91-4d68-9814-73729ca110b0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:23.708396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72e897-0b0d-4e94-981d-be9c5444b7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:23.709057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72e897-0b0d-4e94-981d-be9c5444b7a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:23.709336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72e897-0b0d-4e94-981d-be9c5444b7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:23.709609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72e897-0b0d-4e94-981d-be9c5444b7a4 admin admin] PATH_INFO: `/v3/projects/7b086caf29eb438fb35a58ed1c84abf5` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:23.717695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72e897-0b0d-4e94-981d-be9c5444b7a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b086caf29eb438fb35a58ed1c84abf5)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:23.727241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f72e897-0b0d-4e94-981d-be9c5444b7a4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:23.737798 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:23.898265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2f72e897-0b0d-4e94-981d-be9c5444b7a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b086caf29eb438fb35a58ed1c84abf5', 'request_id': 'req-2f72e897-0b0d-4e94-981d-be9c5444b7a4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:23.921540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2f72e897-0b0d-4e94-981d-be9c5444b7a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b086caf29eb438fb35a58ed1c84abf5', 'request_id': 'req-2f72e897-0b0d-4e94-981d-be9c5444b7a4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:23.939140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2f72e897-0b0d-4e94-981d-be9c5444b7a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b086caf29eb438fb35a58ed1c84abf5', 'request_id': 'req-2f72e897-0b0d-4e94-981d-be9c5444b7a4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:23.994328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2f72e897-0b0d-4e94-981d-be9c5444b7a4 admin admin] The token cache is being invalidate because project 7b086caf29eb438fb35a58ed1c84abf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:40:23.994675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2f72e897-0b0d-4e94-981d-be9c5444b7a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:23.996164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2f72e897-0b0d-4e94-981d-be9c5444b7a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:23.999055 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3004/6049] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:40:23 2022] DELETE /identity/v3/projects/7b086caf29eb438fb35a58ed1c84abf5 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:24.003871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ed6b5-978f-4486-b8c1-711a6c36b164 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:24.004338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ed6b5-978f-4486-b8c1-711a6c36b164 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:24.004453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ed6b5-978f-4486-b8c1-711a6c36b164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:24.048544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-898ed6b5-978f-4486-b8c1-711a6c36b164 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:24.051114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-898ed6b5-978f-4486-b8c1-711a6c36b164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:24.073792 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:24.199566 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3046/6050] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:40:24.207517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b20465-99db-4ea7-a054-e187579dd08c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:24.207809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b20465-99db-4ea7-a054-e187579dd08c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:24.208108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b20465-99db-4ea7-a054-e187579dd08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:24.248738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-11b20465-99db-4ea7-a054-e187579dd08c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:24.249960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-11b20465-99db-4ea7-a054-e187579dd08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:24.272541 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3005/6051] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:24.276589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ed6b5-978f-4486-b8c1-711a6c36b164 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:24.294005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ed6b5-978f-4486-b8c1-711a6c36b164 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:24.318537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59742a-a620-4fbc-b2aa-cc1ad1e369cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:24.319221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59742a-a620-4fbc-b2aa-cc1ad1e369cc admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:24.319563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59742a-a620-4fbc-b2aa-cc1ad1e369cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:24.319767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59742a-a620-4fbc-b2aa-cc1ad1e369cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:24.331404 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab59742a-a620-4fbc-b2aa-cc1ad1e369cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:40:24.331807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab59742a-a620-4fbc-b2aa-cc1ad1e369cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:24.336411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab59742a-a620-4fbc-b2aa-cc1ad1e369cc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:24.395211 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b20465-99db-4ea7-a054-e187579dd08c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:24.397472 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3047/6052] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:40:24.406544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b20465-99db-4ea7-a054-e187579dd08c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:24.419443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb65ced-0329-4caa-a000-654329a71146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:24.420125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb65ced-0329-4caa-a000-654329a71146 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:24.420402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb65ced-0329-4caa-a000-654329a71146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:24.420666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb65ced-0329-4caa-a000-654329a71146 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:24.421315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb65ced-0329-4caa-a000-654329a71146 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:24.426602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb65ced-0329-4caa-a000-654329a71146 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:24.492440 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3006/6053] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:40:24 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:40:24.494078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59742a-a620-4fbc-b2aa-cc1ad1e369cc admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:24.512418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59742a-a620-4fbc-b2aa-cc1ad1e369cc admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:24.718785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629b934-4d9a-42b1-8873-4432db9e8d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:24.719754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629b934-4d9a-42b1-8873-4432db9e8d91 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:24.720200 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629b934-4d9a-42b1-8873-4432db9e8d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:24.720613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5629b934-4d9a-42b1-8873-4432db9e8d91 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:24.721388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5629b934-4d9a-42b1-8873-4432db9e8d91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:24.723467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5629b934-4d9a-42b1-8873-4432db9e8d91 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:24.796831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb65ced-0329-4caa-a000-654329a71146 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:24.799846 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3048/6054] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:40:24 2022] POST /identity/v3/users => generated 284 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:24.818220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb65ced-0329-4caa-a000-654329a71146 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:24.841674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7ae18-b3ca-4581-b676-d195f886fc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:24.843263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7ae18-b3ca-4581-b676-d195f886fc23 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:24.843550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7ae18-b3ca-4581-b676-d195f886fc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:24.843820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7ae18-b3ca-4581-b676-d195f886fc23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:24.844529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7ae18-b3ca-4581-b676-d195f886fc23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:24.854425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7ae18-b3ca-4581-b676-d195f886fc23 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:24.878343 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3007/6055] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:40:24.882536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629b934-4d9a-42b1-8873-4432db9e8d91 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:24.900017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5629b934-4d9a-42b1-8873-4432db9e8d91 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:24.923257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6585aa-2996-4f44-b557-e60589f0870b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:24.923904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6585aa-2996-4f44-b557-e60589f0870b admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:24.924189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6585aa-2996-4f44-b557-e60589f0870b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:24.924459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6585aa-2996-4f44-b557-e60589f0870b admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:24.925107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6585aa-2996-4f44-b557-e60589f0870b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:24.929325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6585aa-2996-4f44-b557-e60589f0870b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:24.970815 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7ae18-b3ca-4581-b676-d195f886fc23 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:24.988908 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3049/6056] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:24.989727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7ae18-b3ca-4581-b676-d195f886fc23 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:25.001879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2d4fc-9158-4976-9128-437b9a11509a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:25.002686 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2d4fc-9158-4976-9128-437b9a11509a admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:25.002834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2d4fc-9158-4976-9128-437b9a11509a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:25.003284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2d4fc-9158-4976-9128-437b9a11509a admin admin] PATH_INFO: `/v3/projects/afd633b1366f422cbff7b26a55cbff4d/users/64df910d4bc04b96886606b6c490b8a5/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:25.037950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2d4fc-9158-4976-9128-437b9a11509a admin admin] RBAC: Authorizing `identity:create_grant(project_id=afd633b1366f422cbff7b26a55cbff4d, user_id=64df910d4bc04b96886606b6c490b8a5, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:25.042282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2d4fc-9158-4976-9128-437b9a11509a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:25.071920 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3008/6057] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:24 2022] PUT /identity/v3/projects/afd633b1366f422cbff7b26a55cbff4d/users/64df910d4bc04b96886606b6c490b8a5/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:25.087569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719e74f-c48f-45e8-a2a7-59b2a1cf923f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:25.088156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719e74f-c48f-45e8-a2a7-59b2a1cf923f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:25.088156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719e74f-c48f-45e8-a2a7-59b2a1cf923f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:25.213125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0719e74f-c48f-45e8-a2a7-59b2a1cf923f None None] MFA Rules not processed for user `64df910d4bc04b96886606b6c490b8a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:25.220638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0719e74f-c48f-45e8-a2a7-59b2a1cf923f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:25.348083 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3050/6058] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:25.349363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2d4fc-9158-4976-9128-437b9a11509a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:25.563403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2d4fc-9158-4976-9128-437b9a11509a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:25.579992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744bb29-d6d9-417b-bf84-40be7a8f52b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:25.580629 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744bb29-d6d9-417b-bf84-40be7a8f52b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:25.580903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744bb29-d6d9-417b-bf84-40be7a8f52b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:25.581170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744bb29-d6d9-417b-bf84-40be7a8f52b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:25.581817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744bb29-d6d9-417b-bf84-40be7a8f52b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:25.583839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4744bb29-d6d9-417b-bf84-40be7a8f52b5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:25.677271 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3009/6059] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:40:25 2022] POST /identity/v3/projects => generated 369 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:25.682255 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719e74f-c48f-45e8-a2a7-59b2a1cf923f None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:25.748648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719e74f-c48f-45e8-a2a7-59b2a1cf923f None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:25.769402 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:25.934575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae82fde-87d6-40a6-a051-c9d612632fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:25.935491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae82fde-87d6-40a6-a051-c9d612632fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:25.937902 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae82fde-87d6-40a6-a051-c9d612632fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:25.939453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae82fde-87d6-40a6-a051-c9d612632fd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:25.941814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae82fde-87d6-40a6-a051-c9d612632fd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:25.944951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae82fde-87d6-40a6-a051-c9d612632fd4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:26.009858 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3051/6060] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:40:25 2022] POST /identity/v3/users => generated 291 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:26.014986 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744bb29-d6d9-417b-bf84-40be7a8f52b5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:26.043165 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744bb29-d6d9-417b-bf84-40be7a8f52b5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:26.064875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb68fa2-9b2e-46f7-90f7-4f03c65df024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:26.065508 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb68fa2-9b2e-46f7-90f7-4f03c65df024 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:26.065830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb68fa2-9b2e-46f7-90f7-4f03c65df024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:26.066109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb68fa2-9b2e-46f7-90f7-4f03c65df024 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:26.066773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb68fa2-9b2e-46f7-90f7-4f03c65df024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:26.077292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb68fa2-9b2e-46f7-90f7-4f03c65df024 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:26.100097 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:26.145515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae82fde-87d6-40a6-a051-c9d612632fd4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:26.146814 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3010/6061] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:26.162087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae82fde-87d6-40a6-a051-c9d612632fd4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:26.196178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ec9e2-26c9-49cb-875d-fef64514709e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:26.196974 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ec9e2-26c9-49cb-875d-fef64514709e admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:26.197379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ec9e2-26c9-49cb-875d-fef64514709e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:26.197731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ec9e2-26c9-49cb-875d-fef64514709e admin admin] PATH_INFO: `/v3/projects/2d954f4585c348faafea870792faf488/users/6e4fc26c03184400a8e1048cfb7c5e5d/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:26.261123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ec9e2-26c9-49cb-875d-fef64514709e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d954f4585c348faafea870792faf488, user_id=6e4fc26c03184400a8e1048cfb7c5e5d, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:26.265402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ec9e2-26c9-49cb-875d-fef64514709e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:26.296074 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3052/6062] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:26 2022] PUT /identity/v3/projects/2d954f4585c348faafea870792faf488/users/6e4fc26c03184400a8e1048cfb7c5e5d/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:40:26.304805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb68fa2-9b2e-46f7-90f7-4f03c65df024 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:26.337461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb68fa2-9b2e-46f7-90f7-4f03c65df024 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:26.526426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13504d9-fe44-4e28-aff6-5c787d28c243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:26.527200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13504d9-fe44-4e28-aff6-5c787d28c243 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:26.527547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13504d9-fe44-4e28-aff6-5c787d28c243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:26.527980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13504d9-fe44-4e28-aff6-5c787d28c243 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:26.528727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13504d9-fe44-4e28-aff6-5c787d28c243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:26.532414 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13504d9-fe44-4e28-aff6-5c787d28c243 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:26.560850 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3011/6063] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:26.563378 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ec9e2-26c9-49cb-875d-fef64514709e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:26.578415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ec9e2-26c9-49cb-875d-fef64514709e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:26.590051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3fcbb-026a-4869-8f21-46647f54394a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:26.591504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3fcbb-026a-4869-8f21-46647f54394a admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:26.591988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3fcbb-026a-4869-8f21-46647f54394a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:26.592379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3fcbb-026a-4869-8f21-46647f54394a admin admin] PATH_INFO: `/v3/projects/2d954f4585c348faafea870792faf488/users/6e4fc26c03184400a8e1048cfb7c5e5d/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:26.595437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3fcbb-026a-4869-8f21-46647f54394a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d954f4585c348faafea870792faf488, user_id=6e4fc26c03184400a8e1048cfb7c5e5d, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:26.607541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3fcbb-026a-4869-8f21-46647f54394a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:26.646479 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3053/6064] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:26 2022] PUT /identity/v3/projects/2d954f4585c348faafea870792faf488/users/6e4fc26c03184400a8e1048cfb7c5e5d/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:26.646843 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ab75c-e7a4-49bf-ae36-59ed45bfdb1b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:26.647945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ab75c-e7a4-49bf-ae36-59ed45bfdb1b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:26.647945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ab75c-e7a4-49bf-ae36-59ed45bfdb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:26.722032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-404ab75c-e7a4-49bf-ae36-59ed45bfdb1b None None] MFA Rules not processed for user `6e4fc26c03184400a8e1048cfb7c5e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:26.723263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-404ab75c-e7a4-49bf-ae36-59ed45bfdb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:26.876852 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3012/6065] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:26 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:26.888725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3fcbb-026a-4869-8f21-46647f54394a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:26.907218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3fcbb-026a-4869-8f21-46647f54394a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:26.916962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ed9d7-c3cc-4bc7-b193-7599264be066 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:26.917580 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ed9d7-c3cc-4bc7-b193-7599264be066 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:26.918137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ed9d7-c3cc-4bc7-b193-7599264be066 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:26.918422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ed9d7-c3cc-4bc7-b193-7599264be066 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:26.919056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ed9d7-c3cc-4bc7-b193-7599264be066 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:26.921024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ed9d7-c3cc-4bc7-b193-7599264be066 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:26.988601 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3054/6066] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Aug 7 01:40:26 2022] POST /identity/v3/projects => generated 329 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:26.993426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ab75c-e7a4-49bf-ae36-59ed45bfdb1b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:27.014438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ab75c-e7a4-49bf-ae36-59ed45bfdb1b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:27.165079 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352e88c-fc30-4b41-a26b-c3eaaf931f33 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:27.166066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352e88c-fc30-4b41-a26b-c3eaaf931f33 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:27.168596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352e88c-fc30-4b41-a26b-c3eaaf931f33 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:27.169090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352e88c-fc30-4b41-a26b-c3eaaf931f33 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:27.169957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352e88c-fc30-4b41-a26b-c3eaaf931f33 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:27.172901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352e88c-fc30-4b41-a26b-c3eaaf931f33 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:27.243922 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3013/6067] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:40:26 2022] POST /identity/v3/users => generated 416 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:40:27.248172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ed9d7-c3cc-4bc7-b193-7599264be066 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:27.267655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ed9d7-c3cc-4bc7-b193-7599264be066 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:27.284520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4224c-55d4-48cc-96b7-42240de3e620 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:27.285694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4224c-55d4-48cc-96b7-42240de3e620 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:27.286171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4224c-55d4-48cc-96b7-42240de3e620 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:27.286631 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4224c-55d4-48cc-96b7-42240de3e620 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:27.287477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4224c-55d4-48cc-96b7-42240de3e620 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:27.297237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4224c-55d4-48cc-96b7-42240de3e620 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:27.325763 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3055/6068] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:40:27 2022] POST /identity/v3/roles => generated 244 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:27.329386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352e88c-fc30-4b41-a26b-c3eaaf931f33 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:27.348527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352e88c-fc30-4b41-a26b-c3eaaf931f33 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:27.358014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2900f0-e2c5-4f29-baba-1051d360fb64 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:27.359074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2900f0-e2c5-4f29-baba-1051d360fb64 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:27.359462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2900f0-e2c5-4f29-baba-1051d360fb64 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:27.359838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2900f0-e2c5-4f29-baba-1051d360fb64 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:27.360660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2900f0-e2c5-4f29-baba-1051d360fb64 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:27.363127 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2900f0-e2c5-4f29-baba-1051d360fb64 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:27.384692 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:27.396626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4224c-55d4-48cc-96b7-42240de3e620 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:27.403460 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3014/6069] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:40:27 2022] POST /identity/v3/roles => generated 246 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:40:27.412073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4224c-55d4-48cc-96b7-42240de3e620 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:27.440602 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a625bc7-f1c0-462b-b585-89a365f7e26d tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:27.441413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a625bc7-f1c0-462b-b585-89a365f7e26d tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:27.444772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a625bc7-f1c0-462b-b585-89a365f7e26d tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:27.445215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a625bc7-f1c0-462b-b585-89a365f7e26d tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/projects/deb90023d5654330be8b463fa58d6a19/users/f97a1669723549639092f09b38396a8c/roles/d546a5036cfd4cb0aaf4e13d05cfcea8` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:27.474199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a625bc7-f1c0-462b-b585-89a365f7e26d tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_grant(project_id=deb90023d5654330be8b463fa58d6a19, user_id=f97a1669723549639092f09b38396a8c, role_id=d546a5036cfd4cb0aaf4e13d05cfcea8)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:27.477335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a625bc7-f1c0-462b-b585-89a365f7e26d tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:27.496461 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3056/6070] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:27 2022] PUT /identity/v3/projects/deb90023d5654330be8b463fa58d6a19/users/f97a1669723549639092f09b38396a8c/roles/d546a5036cfd4cb0aaf4e13d05cfcea8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:27.500470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2900f0-e2c5-4f29-baba-1051d360fb64 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:27.515162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2900f0-e2c5-4f29-baba-1051d360fb64 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:27.683187 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98187a6e-a231-4984-8d8b-ac529a87aa11 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:27.687453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98187a6e-a231-4984-8d8b-ac529a87aa11 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:27.687823 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98187a6e-a231-4984-8d8b-ac529a87aa11 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:27.702502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98187a6e-a231-4984-8d8b-ac529a87aa11 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/projects/deb90023d5654330be8b463fa58d6a19/users/f97a1669723549639092f09b38396a8c/roles/3a2ccf588a614b078029e66fea51c55a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:27.711770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98187a6e-a231-4984-8d8b-ac529a87aa11 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_grant(project_id=deb90023d5654330be8b463fa58d6a19, user_id=f97a1669723549639092f09b38396a8c, role_id=3a2ccf588a614b078029e66fea51c55a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:27.723225 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98187a6e-a231-4984-8d8b-ac529a87aa11 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:27.771280 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3015/6071] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:27 2022] PUT /identity/v3/projects/deb90023d5654330be8b463fa58d6a19/users/f97a1669723549639092f09b38396a8c/roles/3a2ccf588a614b078029e66fea51c55a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:40:27.776363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a625bc7-f1c0-462b-b585-89a365f7e26d tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:27.807945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a625bc7-f1c0-462b-b585-89a365f7e26d tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:27.939740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73714698-f23e-4d87-9e06-7ec6d50b73ca tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:27.940534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73714698-f23e-4d87-9e06-7ec6d50b73ca tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:27.941181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73714698-f23e-4d87-9e06-7ec6d50b73ca tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:27.941589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73714698-f23e-4d87-9e06-7ec6d50b73ca tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:27.945862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73714698-f23e-4d87-9e06-7ec6d50b73ca tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:27.948774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73714698-f23e-4d87-9e06-7ec6d50b73ca tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:27.952164 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:28.138297 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3057/6072] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:27 2022] GET /identity/v3/users => generated 8592 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:28.143474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6b923-89d6-482e-8f03-bfe322cc4e2c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:28.143782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6b923-89d6-482e-8f03-bfe322cc4e2c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:28.144155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6b923-89d6-482e-8f03-bfe322cc4e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:28.422049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e5a6b923-89d6-482e-8f03-bfe322cc4e2c None None] MFA Rules not processed for user `f97a1669723549639092f09b38396a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:28.423270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e5a6b923-89d6-482e-8f03-bfe322cc4e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:28.513547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73714698-f23e-4d87-9e06-7ec6d50b73ca tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:28.515860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-73714698-f23e-4d87-9e06-7ec6d50b73ca tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:28.738220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73714698-f23e-4d87-9e06-7ec6d50b73ca tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:28.745925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f51ff-dbd1-4741-aabf-357dffc8a980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:28.746577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f51ff-dbd1-4741-aabf-357dffc8a980 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:28.746961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f51ff-dbd1-4741-aabf-357dffc8a980 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:28.747241 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f51ff-dbd1-4741-aabf-357dffc8a980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:28.754914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-002f51ff-dbd1-4741-aabf-357dffc8a980 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:28.762355 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3016/6073] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:28 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 621 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:28.776526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bfb05-72c9-408b-bb4a-ddac8098fbf8 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:28.776874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bfb05-72c9-408b-bb4a-ddac8098fbf8 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:28.777084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209bfb05-72c9-408b-bb4a-ddac8098fbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:28.860809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-209bfb05-72c9-408b-bb4a-ddac8098fbf8 None None] MFA Rules not processed for user `f97a1669723549639092f09b38396a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:28.867959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-209bfb05-72c9-408b-bb4a-ddac8098fbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:28.893876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f51ff-dbd1-4741-aabf-357dffc8a980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:28.895745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f51ff-dbd1-4741-aabf-357dffc8a980 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:28.905594 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3017/6074] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:28 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:28.909799 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3058/6075] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:40:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:40:28.910791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bfb05-72c9-408b-bb4a-ddac8098fbf8 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:28.932438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209bfb05-72c9-408b-bb4a-ddac8098fbf8 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:28.944353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db13f88-3451-478f-b1a3-11eef06240c2 tempest-TrustsV3TestJSON-2140298650 tempest-user-2088390472] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f97a1669723549639092f09b38396a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'deb90023d5654330be8b463fa58d6a19', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1991279494', 'tempest-NotDelegatedRole-341615046'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:28.945129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db13f88-3451-478f-b1a3-11eef06240c2 tempest-TrustsV3TestJSON-2140298650 tempest-user-2088390472] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:28.945556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db13f88-3451-478f-b1a3-11eef06240c2 tempest-TrustsV3TestJSON-2140298650 tempest-user-2088390472] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:28.945884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db13f88-3451-478f-b1a3-11eef06240c2 tempest-TrustsV3TestJSON-2140298650 tempest-user-2088390472] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:28.946588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db13f88-3451-478f-b1a3-11eef06240c2 tempest-TrustsV3TestJSON-2140298650 tempest-user-2088390472] RBAC: Authorizing `identity:create_trust()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:28.959147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db13f88-3451-478f-b1a3-11eef06240c2 tempest-TrustsV3TestJSON-2140298650 tempest-user-2088390472] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:29.152459 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:29.168378 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3018/6076] 10.222.0.39 () {60 vars in 1174 bytes} [Sun Aug 7 01:40:28 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:29.172015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f51ff-dbd1-4741-aabf-357dffc8a980 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:29.191478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f51ff-dbd1-4741-aabf-357dffc8a980 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:29.200292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a13e6-d181-46c3-8519-69beefe1dfc9 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:29.201395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a13e6-d181-46c3-8519-69beefe1dfc9 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:29.201754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a13e6-d181-46c3-8519-69beefe1dfc9 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:29.202087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a13e6-d181-46c3-8519-69beefe1dfc9 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:29.203424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a13e6-d181-46c3-8519-69beefe1dfc9 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:29.205445 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-da2a13e6-d181-46c3-8519-69beefe1dfc9 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:40:29.205445 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:40:29.205445 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:40:29.206810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a13e6-d181-46c3-8519-69beefe1dfc9 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:29.233412 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3059/6077] 10.222.0.39 () {58 vars in 1155 bytes} [Sun Aug 7 01:40:29 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:40:29.238200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db13f88-3451-478f-b1a3-11eef06240c2 tempest-TrustsV3TestJSON-2140298650 tempest-user-2088390472] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:29.258138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db13f88-3451-478f-b1a3-11eef06240c2 tempest-TrustsV3TestJSON-2140298650 tempest-user-2088390472] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:29.273968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150f45f-dccd-4c8e-8bf9-a5acf32040e3 tempest-TrustsV3TestJSON-2140298650 tempest-user-2088390472] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f97a1669723549639092f09b38396a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'deb90023d5654330be8b463fa58d6a19', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1991279494', 'tempest-NotDelegatedRole-341615046'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:29.274892 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150f45f-dccd-4c8e-8bf9-a5acf32040e3 tempest-TrustsV3TestJSON-2140298650 tempest-user-2088390472] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:29.277790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150f45f-dccd-4c8e-8bf9-a5acf32040e3 tempest-TrustsV3TestJSON-2140298650 tempest-user-2088390472] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:29.279803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150f45f-dccd-4c8e-8bf9-a5acf32040e3 tempest-TrustsV3TestJSON-2140298650 tempest-user-2088390472] PATH_INFO: `/v3/OS-TRUST/trusts/d110e08bb15a4690af5eeabc0c454a94` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:29.311343 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150f45f-dccd-4c8e-8bf9-a5acf32040e3 tempest-TrustsV3TestJSON-2140298650 tempest-user-2088390472] RBAC: Authorizing `identity:delete_trust(trust_id=d110e08bb15a4690af5eeabc0c454a94)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:29.324246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150f45f-dccd-4c8e-8bf9-a5acf32040e3 tempest-TrustsV3TestJSON-2140298650 tempest-user-2088390472] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:29.405741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1150f45f-dccd-4c8e-8bf9-a5acf32040e3 tempest-TrustsV3TestJSON-2140298650 tempest-user-2088390472] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'd110e08bb15a4690af5eeabc0c454a94', 'request_id': 'req-1150f45f-dccd-4c8e-8bf9-a5acf32040e3'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:29.407323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1150f45f-dccd-4c8e-8bf9-a5acf32040e3 tempest-TrustsV3TestJSON-2140298650 tempest-user-2088390472] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'd110e08bb15a4690af5eeabc0c454a94', 'request_id': 'req-1150f45f-dccd-4c8e-8bf9-a5acf32040e3'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:29.428896 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1150f45f-dccd-4c8e-8bf9-a5acf32040e3 tempest-TrustsV3TestJSON-2140298650 tempest-user-2088390472] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'd110e08bb15a4690af5eeabc0c454a94', 'request_id': 'req-1150f45f-dccd-4c8e-8bf9-a5acf32040e3'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:29.458067 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3019/6078] 10.222.0.39 () {58 vars in 1254 bytes} [Sun Aug 7 01:40:29 2022] DELETE /identity/v3/OS-TRUST/trusts/d110e08bb15a4690af5eeabc0c454a94 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:29.463959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a13e6-d181-46c3-8519-69beefe1dfc9 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:29.465735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-da2a13e6-d181-46c3-8519-69beefe1dfc9 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:29.490526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a13e6-d181-46c3-8519-69beefe1dfc9 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:29.502268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5277801-bf7b-484c-a281-a1af7b03861e tempest-TrustsV3TestJSON-2140298650 tempest-user-2088390472] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f97a1669723549639092f09b38396a8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'deb90023d5654330be8b463fa58d6a19', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1991279494', 'tempest-NotDelegatedRole-341615046'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:29.502939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5277801-bf7b-484c-a281-a1af7b03861e tempest-TrustsV3TestJSON-2140298650 tempest-user-2088390472] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:29.503224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5277801-bf7b-484c-a281-a1af7b03861e tempest-TrustsV3TestJSON-2140298650 tempest-user-2088390472] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:29.512337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5277801-bf7b-484c-a281-a1af7b03861e tempest-TrustsV3TestJSON-2140298650 tempest-user-2088390472] PATH_INFO: `/v3/OS-TRUST/trusts/d110e08bb15a4690af5eeabc0c454a94` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:29.558441 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-c5277801-bf7b-484c-a281-a1af7b03861e tempest-TrustsV3TestJSON-2140298650 tempest-user-2088390472] Could not find trust: d110e08bb15a4690af5eeabc0c454a94.: keystone.exception.TrustNotFound: Could not find trust: d110e08bb15a4690af5eeabc0c454a94. Aug 07 01:40:29.558441 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:40:29.558441 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:40:29.558441 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:40:29.558441 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:40:29.558441 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:40:29.558441 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:40:29.558441 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:40:29.558441 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:40:29.558441 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:40:29.558441 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:40:29.558441 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:40:29.558441 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 07 01:40:29.558441 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 07 01:40:29.558441 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 07 01:40:29.559924 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 07 01:40:29.559924 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 07 01:40:29.559924 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 07 01:40:29.559924 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 07 01:40:29.559924 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 07 01:40:29.559924 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:40:29.559924 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:40:29.559924 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 07 01:40:29.559924 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 07 01:40:29.559924 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 07 01:40:29.559924 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 07 01:40:29.559924 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: d110e08bb15a4690af5eeabc0c454a94. Aug 07 01:40:29.559924 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:40:29.559924 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3060/6079] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Aug 7 01:40:29 2022] GET /identity/v3/OS-TRUST/trusts/d110e08bb15a4690af5eeabc0c454a94 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:40:29.565706 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150f45f-dccd-4c8e-8bf9-a5acf32040e3 tempest-TrustsV3TestJSON-2140298650 tempest-user-2088390472] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:29.568342 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1150f45f-dccd-4c8e-8bf9-a5acf32040e3 tempest-TrustsV3TestJSON-2140298650 tempest-user-2088390472] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:29.608331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150f45f-dccd-4c8e-8bf9-a5acf32040e3 tempest-TrustsV3TestJSON-2140298650 tempest-user-2088390472] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:29.630368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1037eb4-9b2c-41f5-bde6-bd26953afda5 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:29.634117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1037eb4-9b2c-41f5-bde6-bd26953afda5 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:29.634740 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1037eb4-9b2c-41f5-bde6-bd26953afda5 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:29.635167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1037eb4-9b2c-41f5-bde6-bd26953afda5 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/roles/3a2ccf588a614b078029e66fea51c55a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:29.640440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1037eb4-9b2c-41f5-bde6-bd26953afda5 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3a2ccf588a614b078029e66fea51c55a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:29.650491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1037eb4-9b2c-41f5-bde6-bd26953afda5 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:29.786222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b1037eb4-9b2c-41f5-bde6-bd26953afda5 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invalidating the token cache because role 3a2ccf588a614b078029e66fea51c55a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:40:29.786818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b1037eb4-9b2c-41f5-bde6-bd26953afda5 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:29.788574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b1037eb4-9b2c-41f5-bde6-bd26953afda5 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:29.802911 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3020/6080] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:40:29 2022] DELETE /identity/v3/roles/3a2ccf588a614b078029e66fea51c55a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:29.820642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5277801-bf7b-484c-a281-a1af7b03861e tempest-TrustsV3TestJSON-2140298650 tempest-user-2088390472] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:29.829403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c5277801-bf7b-484c-a281-a1af7b03861e tempest-TrustsV3TestJSON-2140298650 tempest-user-2088390472] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:29.861358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5277801-bf7b-484c-a281-a1af7b03861e tempest-TrustsV3TestJSON-2140298650 tempest-user-2088390472] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:30.192855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e7f2b-9ea4-4e6e-ad5d-4dbdc8b06f3f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:30.194847 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e7f2b-9ea4-4e6e-ad5d-4dbdc8b06f3f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:30.195132 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e7f2b-9ea4-4e6e-ad5d-4dbdc8b06f3f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:30.195399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e7f2b-9ea4-4e6e-ad5d-4dbdc8b06f3f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/roles/d546a5036cfd4cb0aaf4e13d05cfcea8` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:30.204204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e7f2b-9ea4-4e6e-ad5d-4dbdc8b06f3f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d546a5036cfd4cb0aaf4e13d05cfcea8)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:30.206112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e7f2b-9ea4-4e6e-ad5d-4dbdc8b06f3f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:30.285948 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:30.306326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-151e7f2b-9ea4-4e6e-ad5d-4dbdc8b06f3f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invalidating the token cache because role d546a5036cfd4cb0aaf4e13d05cfcea8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:40:30.309463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-151e7f2b-9ea4-4e6e-ad5d-4dbdc8b06f3f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:30.310394 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-151e7f2b-9ea4-4e6e-ad5d-4dbdc8b06f3f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:30.312552 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3061/6081] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:40:29 2022] DELETE /identity/v3/roles/d546a5036cfd4cb0aaf4e13d05cfcea8 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:30.318495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1037eb4-9b2c-41f5-bde6-bd26953afda5 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:30.345593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1037eb4-9b2c-41f5-bde6-bd26953afda5 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:30.612939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8866c-90dd-45e6-85af-bda81a3a2d02 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:30.613615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8866c-90dd-45e6-85af-bda81a3a2d02 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:30.613901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8866c-90dd-45e6-85af-bda81a3a2d02 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:30.614176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8866c-90dd-45e6-85af-bda81a3a2d02 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/users/f97a1669723549639092f09b38396a8c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:30.616048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c8866c-90dd-45e6-85af-bda81a3a2d02 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f97a1669723549639092f09b38396a8c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:30.618240 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c8866c-90dd-45e6-85af-bda81a3a2d02 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:30.758105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-01c8866c-90dd-45e6-85af-bda81a3a2d02 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f97a1669723549639092f09b38396a8c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:30.798271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-01c8866c-90dd-45e6-85af-bda81a3a2d02 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f97a1669723549639092f09b38396a8c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:30.819218 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-01c8866c-90dd-45e6-85af-bda81a3a2d02 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f97a1669723549639092f09b38396a8c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:30.828493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-01c8866c-90dd-45e6-85af-bda81a3a2d02 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f97a1669723549639092f09b38396a8c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:30.833949 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=83,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=14 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:30.843079 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-01c8866c-90dd-45e6-85af-bda81a3a2d02 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f97a1669723549639092f09b38396a8c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:30.854990 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3021/6082] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:40:30 2022] DELETE /identity/v3/users/f97a1669723549639092f09b38396a8c => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:30.859432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e7f2b-9ea4-4e6e-ad5d-4dbdc8b06f3f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:30.868097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-151e7f2b-9ea4-4e6e-ad5d-4dbdc8b06f3f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:30.911673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e7f2b-9ea4-4e6e-ad5d-4dbdc8b06f3f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:31.223315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c09ab1-f7c7-4dac-b690-b30d2dbd51cd tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:31.226482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c09ab1-f7c7-4dac-b690-b30d2dbd51cd tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:31.227402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c09ab1-f7c7-4dac-b690-b30d2dbd51cd tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:31.229911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c09ab1-f7c7-4dac-b690-b30d2dbd51cd tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/projects/deb90023d5654330be8b463fa58d6a19` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:31.233817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c09ab1-f7c7-4dac-b690-b30d2dbd51cd tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:delete_project(project_id=deb90023d5654330be8b463fa58d6a19)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:31.238875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c09ab1-f7c7-4dac-b690-b30d2dbd51cd tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:31.492317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-28c09ab1-f7c7-4dac-b690-b30d2dbd51cd tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deb90023d5654330be8b463fa58d6a19', 'request_id': 'req-28c09ab1-f7c7-4dac-b690-b30d2dbd51cd'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:31.509007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-28c09ab1-f7c7-4dac-b690-b30d2dbd51cd tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deb90023d5654330be8b463fa58d6a19', 'request_id': 'req-28c09ab1-f7c7-4dac-b690-b30d2dbd51cd'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:31.543681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-28c09ab1-f7c7-4dac-b690-b30d2dbd51cd tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deb90023d5654330be8b463fa58d6a19', 'request_id': 'req-28c09ab1-f7c7-4dac-b690-b30d2dbd51cd'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:31.568323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-28c09ab1-f7c7-4dac-b690-b30d2dbd51cd tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] The token cache is being invalidate because project deb90023d5654330be8b463fa58d6a19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:40:31.569977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-28c09ab1-f7c7-4dac-b690-b30d2dbd51cd tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:31.572395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-28c09ab1-f7c7-4dac-b690-b30d2dbd51cd tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:31.586593 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3062/6083] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:40:30 2022] DELETE /identity/v3/projects/deb90023d5654330be8b463fa58d6a19 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:31.587139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8866c-90dd-45e6-85af-bda81a3a2d02 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:31.588643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-01c8866c-90dd-45e6-85af-bda81a3a2d02 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:31.622878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8866c-90dd-45e6-85af-bda81a3a2d02 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:31.841493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20aabd9-5669-4dbe-8a3f-432e1c0ca4ce tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:31.842134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20aabd9-5669-4dbe-8a3f-432e1c0ca4ce tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:31.842583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20aabd9-5669-4dbe-8a3f-432e1c0ca4ce tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:31.843028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20aabd9-5669-4dbe-8a3f-432e1c0ca4ce tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:31.843832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20aabd9-5669-4dbe-8a3f-432e1c0ca4ce tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:31.846074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20aabd9-5669-4dbe-8a3f-432e1c0ca4ce tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:31.949915 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3022/6084] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Aug 7 01:40:31 2022] POST /identity/v3/projects => generated 329 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:40:31.955200 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c09ab1-f7c7-4dac-b690-b30d2dbd51cd tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:31.957180 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-28c09ab1-f7c7-4dac-b690-b30d2dbd51cd tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:32.001884 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c09ab1-f7c7-4dac-b690-b30d2dbd51cd tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:32.208960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70e373-d670-40b7-95c0-da922610e8bd tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:32.210272 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70e373-d670-40b7-95c0-da922610e8bd tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:32.213016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70e373-d670-40b7-95c0-da922610e8bd tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:32.213773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70e373-d670-40b7-95c0-da922610e8bd tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:32.214837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc70e373-d670-40b7-95c0-da922610e8bd tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:32.218971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc70e373-d670-40b7-95c0-da922610e8bd tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:32.330558 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3063/6085] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:40:31 2022] POST /identity/v3/users => generated 413 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:32.336009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20aabd9-5669-4dbe-8a3f-432e1c0ca4ce tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:32.374761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20aabd9-5669-4dbe-8a3f-432e1c0ca4ce tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:32.414469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385e0f2-386a-4cd2-851d-8317feda222f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:32.415111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385e0f2-386a-4cd2-851d-8317feda222f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:32.415396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385e0f2-386a-4cd2-851d-8317feda222f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:32.415673 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385e0f2-386a-4cd2-851d-8317feda222f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:32.416402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385e0f2-386a-4cd2-851d-8317feda222f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:32.418068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385e0f2-386a-4cd2-851d-8317feda222f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:32.500102 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3023/6086] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:40:32 2022] POST /identity/v3/roles => generated 244 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:32.504249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70e373-d670-40b7-95c0-da922610e8bd tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:32.519237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70e373-d670-40b7-95c0-da922610e8bd tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:32.538830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13878ee7-01c4-4564-ba48-25eaf7ed691a tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:32.539747 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13878ee7-01c4-4564-ba48-25eaf7ed691a tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:32.540260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13878ee7-01c4-4564-ba48-25eaf7ed691a tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:32.540742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13878ee7-01c4-4564-ba48-25eaf7ed691a tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:32.541650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13878ee7-01c4-4564-ba48-25eaf7ed691a tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:32.543538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13878ee7-01c4-4564-ba48-25eaf7ed691a tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:32.566215 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:32.580323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385e0f2-386a-4cd2-851d-8317feda222f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:32.586297 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3064/6087] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:40:32 2022] POST /identity/v3/roles => generated 245 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:32.595738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385e0f2-386a-4cd2-851d-8317feda222f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:32.611519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d2ad4-a80d-4db9-b5ec-391d679c12d8 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:32.612672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d2ad4-a80d-4db9-b5ec-391d679c12d8 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:32.613189 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d2ad4-a80d-4db9-b5ec-391d679c12d8 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:32.613696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d2ad4-a80d-4db9-b5ec-391d679c12d8 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/projects/42146db350a445a8a2f202d6b6c1a4f1/users/a4578268285945019ecd2c47864f39c0/roles/86a21b8cdc3f449789d45e9ae46856c4` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:32.663757 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d2ad4-a80d-4db9-b5ec-391d679c12d8 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_grant(project_id=42146db350a445a8a2f202d6b6c1a4f1, user_id=a4578268285945019ecd2c47864f39c0, role_id=86a21b8cdc3f449789d45e9ae46856c4)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:32.673842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d2ad4-a80d-4db9-b5ec-391d679c12d8 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:32.705785 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3024/6088] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:32 2022] PUT /identity/v3/projects/42146db350a445a8a2f202d6b6c1a4f1/users/a4578268285945019ecd2c47864f39c0/roles/86a21b8cdc3f449789d45e9ae46856c4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:32.710197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13878ee7-01c4-4564-ba48-25eaf7ed691a tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:32.722179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13878ee7-01c4-4564-ba48-25eaf7ed691a tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:33.127461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622bf42-71af-4550-a500-334edd73d09f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:33.128309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622bf42-71af-4550-a500-334edd73d09f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:33.129526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622bf42-71af-4550-a500-334edd73d09f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:33.129526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622bf42-71af-4550-a500-334edd73d09f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/projects/42146db350a445a8a2f202d6b6c1a4f1/users/a4578268285945019ecd2c47864f39c0/roles/d993a67111c947a296b27aba3ccd561c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:33.152532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622bf42-71af-4550-a500-334edd73d09f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_grant(project_id=42146db350a445a8a2f202d6b6c1a4f1, user_id=a4578268285945019ecd2c47864f39c0, role_id=d993a67111c947a296b27aba3ccd561c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:33.160022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622bf42-71af-4550-a500-334edd73d09f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:33.212958 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3065/6089] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:32 2022] PUT /identity/v3/projects/42146db350a445a8a2f202d6b6c1a4f1/users/a4578268285945019ecd2c47864f39c0/roles/d993a67111c947a296b27aba3ccd561c => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:33.217182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d2ad4-a80d-4db9-b5ec-391d679c12d8 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:33.239041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d2ad4-a80d-4db9-b5ec-391d679c12d8 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:33.505308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b4f78-8571-4da9-b11e-a527662ad283 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:33.505945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b4f78-8571-4da9-b11e-a527662ad283 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:33.506249 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b4f78-8571-4da9-b11e-a527662ad283 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:33.506519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b4f78-8571-4da9-b11e-a527662ad283 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:33.507203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b4f78-8571-4da9-b11e-a527662ad283 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:33.513927 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b4f78-8571-4da9-b11e-a527662ad283 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:33.662166 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3025/6090] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:33 2022] GET /identity/v3/users => generated 8589 bytes in 445 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:33.663332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0e0e4-5fc2-45d1-a05c-a949b9fa9e47 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:33.663592 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0e0e4-5fc2-45d1-a05c-a949b9fa9e47 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:33.664026 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0e0e4-5fc2-45d1-a05c-a949b9fa9e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:33.794947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1fd0e0e4-5fc2-45d1-a05c-a949b9fa9e47 None None] MFA Rules not processed for user `a4578268285945019ecd2c47864f39c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:33.796247 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1fd0e0e4-5fc2-45d1-a05c-a949b9fa9e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:34.083919 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3066/6091] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:33 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:40:34.089008 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36c84f-4436-473e-95a8-d94afdf205c5 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:34.089543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36c84f-4436-473e-95a8-d94afdf205c5 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:34.090033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36c84f-4436-473e-95a8-d94afdf205c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:34.168803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-db36c84f-4436-473e-95a8-d94afdf205c5 None None] MFA Rules not processed for user `a4578268285945019ecd2c47864f39c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:34.181196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-db36c84f-4436-473e-95a8-d94afdf205c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:34.224173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0e0e4-5fc2-45d1-a05c-a949b9fa9e47 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:34.224861 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3026/6092] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:34 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:34.239608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0e0e4-5fc2-45d1-a05c-a949b9fa9e47 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:34.255483 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d028ae-ea1d-4f74-b8b7-faa25af71f94 tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4578268285945019ecd2c47864f39c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42146db350a445a8a2f202d6b6c1a4f1', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-27314850', 'tempest-DelegatedRole-1480575861'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:34.256624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d028ae-ea1d-4f74-b8b7-faa25af71f94 tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:34.257557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d028ae-ea1d-4f74-b8b7-faa25af71f94 tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:34.258463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d028ae-ea1d-4f74-b8b7-faa25af71f94 tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:34.262038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d028ae-ea1d-4f74-b8b7-faa25af71f94 tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] RBAC: Authorizing `identity:create_trust()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:34.263857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d028ae-ea1d-4f74-b8b7-faa25af71f94 tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:34.437564 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3067/6093] 10.222.0.39 () {60 vars in 1174 bytes} [Sun Aug 7 01:40:34 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:40:34.441703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36c84f-4436-473e-95a8-d94afdf205c5 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:34.455974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36c84f-4436-473e-95a8-d94afdf205c5 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:34.470738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb514a7-ef59-44d5-900a-b594855bb5c1 tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4578268285945019ecd2c47864f39c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42146db350a445a8a2f202d6b6c1a4f1', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-27314850', 'tempest-DelegatedRole-1480575861'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:34.472095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb514a7-ef59-44d5-900a-b594855bb5c1 tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:34.472874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb514a7-ef59-44d5-900a-b594855bb5c1 tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:34.473302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb514a7-ef59-44d5-900a-b594855bb5c1 tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:34.474621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb514a7-ef59-44d5-900a-b594855bb5c1 tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:34.482380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb514a7-ef59-44d5-900a-b594855bb5c1 tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:34.511169 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3027/6094] 10.222.0.39 () {58 vars in 1252 bytes} [Sun Aug 7 01:40:34 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=a4578268285945019ecd2c47864f39c0 => generated 611 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:40:34.515339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d028ae-ea1d-4f74-b8b7-faa25af71f94 tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:34.529104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d028ae-ea1d-4f74-b8b7-faa25af71f94 tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:34.545669 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22926dfc-024b-4d05-8d9f-cfa17e2cb201 tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4578268285945019ecd2c47864f39c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42146db350a445a8a2f202d6b6c1a4f1', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-27314850', 'tempest-DelegatedRole-1480575861'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:34.547740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22926dfc-024b-4d05-8d9f-cfa17e2cb201 tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:34.548266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22926dfc-024b-4d05-8d9f-cfa17e2cb201 tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:34.551464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22926dfc-024b-4d05-8d9f-cfa17e2cb201 tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] PATH_INFO: `/v3/OS-TRUST/trusts/e96cb937f5fe4bba89e134621b8aece7` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:34.572778 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:34.593386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22926dfc-024b-4d05-8d9f-cfa17e2cb201 tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] RBAC: Authorizing `identity:delete_trust(trust_id=e96cb937f5fe4bba89e134621b8aece7)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:34.596378 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22926dfc-024b-4d05-8d9f-cfa17e2cb201 tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:34.686205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-22926dfc-024b-4d05-8d9f-cfa17e2cb201 tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'e96cb937f5fe4bba89e134621b8aece7', 'request_id': 'req-22926dfc-024b-4d05-8d9f-cfa17e2cb201'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:34.687522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-22926dfc-024b-4d05-8d9f-cfa17e2cb201 tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'e96cb937f5fe4bba89e134621b8aece7', 'request_id': 'req-22926dfc-024b-4d05-8d9f-cfa17e2cb201'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:34.689713 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-22926dfc-024b-4d05-8d9f-cfa17e2cb201 tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'e96cb937f5fe4bba89e134621b8aece7', 'request_id': 'req-22926dfc-024b-4d05-8d9f-cfa17e2cb201'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:34.731999 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3068/6095] 10.222.0.39 () {58 vars in 1254 bytes} [Sun Aug 7 01:40:34 2022] DELETE /identity/v3/OS-TRUST/trusts/e96cb937f5fe4bba89e134621b8aece7 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:34.733292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb514a7-ef59-44d5-900a-b594855bb5c1 tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:34.736481 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ecb514a7-ef59-44d5-900a-b594855bb5c1 tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:34.766736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb514a7-ef59-44d5-900a-b594855bb5c1 tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:34.775026 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f485520-cf09-47d1-b16b-d9e594a4925f tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4578268285945019ecd2c47864f39c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42146db350a445a8a2f202d6b6c1a4f1', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-27314850', 'tempest-DelegatedRole-1480575861'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:34.775680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f485520-cf09-47d1-b16b-d9e594a4925f tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:34.775988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f485520-cf09-47d1-b16b-d9e594a4925f tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:34.776269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f485520-cf09-47d1-b16b-d9e594a4925f tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] PATH_INFO: `/v3/OS-TRUST/trusts/e96cb937f5fe4bba89e134621b8aece7` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:34.796852 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-7f485520-cf09-47d1-b16b-d9e594a4925f tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] Could not find trust: e96cb937f5fe4bba89e134621b8aece7.: keystone.exception.TrustNotFound: Could not find trust: e96cb937f5fe4bba89e134621b8aece7. Aug 07 01:40:34.796852 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:40:34.796852 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:40:34.796852 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:40:34.796852 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:40:34.796852 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:40:34.796852 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:40:34.796852 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:40:34.796852 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:40:34.796852 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:40:34.796852 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:40:34.796852 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:40:34.796852 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 07 01:40:34.796852 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 07 01:40:34.796852 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 07 01:40:34.797962 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 07 01:40:34.797962 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 07 01:40:34.797962 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 07 01:40:34.797962 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 07 01:40:34.797962 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 07 01:40:34.797962 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:40:34.797962 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:40:34.797962 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 07 01:40:34.797962 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 07 01:40:34.797962 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 07 01:40:34.797962 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 07 01:40:34.797962 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: e96cb937f5fe4bba89e134621b8aece7. Aug 07 01:40:34.797962 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:40:34.807820 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3028/6096] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Aug 7 01:40:34 2022] GET /identity/v3/OS-TRUST/trusts/e96cb937f5fe4bba89e134621b8aece7 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:40:34.811351 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22926dfc-024b-4d05-8d9f-cfa17e2cb201 tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:34.813450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-22926dfc-024b-4d05-8d9f-cfa17e2cb201 tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:34.854257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22926dfc-024b-4d05-8d9f-cfa17e2cb201 tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:34.874627 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855e66a-c3de-44ba-8825-cec53f7997ff tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:34.891422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855e66a-c3de-44ba-8825-cec53f7997ff tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:34.891736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855e66a-c3de-44ba-8825-cec53f7997ff tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:34.893569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855e66a-c3de-44ba-8825-cec53f7997ff tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/roles/d993a67111c947a296b27aba3ccd561c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:34.900366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855e66a-c3de-44ba-8825-cec53f7997ff tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d993a67111c947a296b27aba3ccd561c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:34.907779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855e66a-c3de-44ba-8825-cec53f7997ff tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:35.019486 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9855e66a-c3de-44ba-8825-cec53f7997ff tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invalidating the token cache because role d993a67111c947a296b27aba3ccd561c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:40:35.019870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9855e66a-c3de-44ba-8825-cec53f7997ff tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:35.020716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9855e66a-c3de-44ba-8825-cec53f7997ff tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:35.023695 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3069/6097] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:40:34 2022] DELETE /identity/v3/roles/d993a67111c947a296b27aba3ccd561c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:35.027513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f485520-cf09-47d1-b16b-d9e594a4925f tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:35.029475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7f485520-cf09-47d1-b16b-d9e594a4925f tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:35.053481 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f485520-cf09-47d1-b16b-d9e594a4925f tempest-TrustsV3TestJSON-1053165550 tempest-user-424160812] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:35.087705 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:35.204548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf519ba7-669c-41eb-99c5-00177a97fb09 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:35.205820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf519ba7-669c-41eb-99c5-00177a97fb09 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:35.207097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf519ba7-669c-41eb-99c5-00177a97fb09 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:35.207856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf519ba7-669c-41eb-99c5-00177a97fb09 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/roles/86a21b8cdc3f449789d45e9ae46856c4` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:35.213702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf519ba7-669c-41eb-99c5-00177a97fb09 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:delete_role(role_id=86a21b8cdc3f449789d45e9ae46856c4)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:35.215978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf519ba7-669c-41eb-99c5-00177a97fb09 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:35.360164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bf519ba7-669c-41eb-99c5-00177a97fb09 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invalidating the token cache because role 86a21b8cdc3f449789d45e9ae46856c4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:40:35.362152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bf519ba7-669c-41eb-99c5-00177a97fb09 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:35.364837 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bf519ba7-669c-41eb-99c5-00177a97fb09 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:35.373132 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3029/6098] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:40:35 2022] DELETE /identity/v3/roles/86a21b8cdc3f449789d45e9ae46856c4 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:35.376765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855e66a-c3de-44ba-8825-cec53f7997ff tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:35.403029 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855e66a-c3de-44ba-8825-cec53f7997ff tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:35.519492 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729c88e-3748-40f1-a7b7-9c3f83ec1810 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:35.520412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729c88e-3748-40f1-a7b7-9c3f83ec1810 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:35.520760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729c88e-3748-40f1-a7b7-9c3f83ec1810 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:35.521367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d729c88e-3748-40f1-a7b7-9c3f83ec1810 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/users/a4578268285945019ecd2c47864f39c0` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:35.523334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d729c88e-3748-40f1-a7b7-9c3f83ec1810 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a4578268285945019ecd2c47864f39c0)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:35.525742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d729c88e-3748-40f1-a7b7-9c3f83ec1810 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:35.588721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d729c88e-3748-40f1-a7b7-9c3f83ec1810 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4578268285945019ecd2c47864f39c0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:35.599307 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d729c88e-3748-40f1-a7b7-9c3f83ec1810 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4578268285945019ecd2c47864f39c0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:35.617776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d729c88e-3748-40f1-a7b7-9c3f83ec1810 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4578268285945019ecd2c47864f39c0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:35.619124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d729c88e-3748-40f1-a7b7-9c3f83ec1810 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4578268285945019ecd2c47864f39c0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:35.636594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d729c88e-3748-40f1-a7b7-9c3f83ec1810 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4578268285945019ecd2c47864f39c0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:35.645153 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3070/6099] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:40:35 2022] DELETE /identity/v3/users/a4578268285945019ecd2c47864f39c0 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:35.649656 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf519ba7-669c-41eb-99c5-00177a97fb09 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:35.651863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bf519ba7-669c-41eb-99c5-00177a97fb09 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:35.680921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf519ba7-669c-41eb-99c5-00177a97fb09 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:35.834527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60d6e6-53ce-4398-80cc-808d945a3df8 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:35.837162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60d6e6-53ce-4398-80cc-808d945a3df8 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:35.838566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60d6e6-53ce-4398-80cc-808d945a3df8 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:35.840044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60d6e6-53ce-4398-80cc-808d945a3df8 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/projects/42146db350a445a8a2f202d6b6c1a4f1` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:35.843735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f60d6e6-53ce-4398-80cc-808d945a3df8 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:delete_project(project_id=42146db350a445a8a2f202d6b6c1a4f1)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:35.849718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f60d6e6-53ce-4398-80cc-808d945a3df8 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:35.977519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8f60d6e6-53ce-4398-80cc-808d945a3df8 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42146db350a445a8a2f202d6b6c1a4f1', 'request_id': 'req-8f60d6e6-53ce-4398-80cc-808d945a3df8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:35.994518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8f60d6e6-53ce-4398-80cc-808d945a3df8 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42146db350a445a8a2f202d6b6c1a4f1', 'request_id': 'req-8f60d6e6-53ce-4398-80cc-808d945a3df8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:36.014291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8f60d6e6-53ce-4398-80cc-808d945a3df8 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42146db350a445a8a2f202d6b6c1a4f1', 'request_id': 'req-8f60d6e6-53ce-4398-80cc-808d945a3df8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:36.046406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8f60d6e6-53ce-4398-80cc-808d945a3df8 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] The token cache is being invalidate because project 42146db350a445a8a2f202d6b6c1a4f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:40:36.046902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8f60d6e6-53ce-4398-80cc-808d945a3df8 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:36.049694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8f60d6e6-53ce-4398-80cc-808d945a3df8 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:36.064438 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3030/6100] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:40:35 2022] DELETE /identity/v3/projects/42146db350a445a8a2f202d6b6c1a4f1 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:36.065946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729c88e-3748-40f1-a7b7-9c3f83ec1810 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:36.067443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d729c88e-3748-40f1-a7b7-9c3f83ec1810 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:36.094143 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=83,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=14 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:36.107857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d729c88e-3748-40f1-a7b7-9c3f83ec1810 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:36.323454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0eac46-b9ea-42dd-8cbf-5875553aab76 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:36.325891 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0eac46-b9ea-42dd-8cbf-5875553aab76 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:36.325891 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0eac46-b9ea-42dd-8cbf-5875553aab76 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:36.328394 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0eac46-b9ea-42dd-8cbf-5875553aab76 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:36.329056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0eac46-b9ea-42dd-8cbf-5875553aab76 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:36.340442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0eac46-b9ea-42dd-8cbf-5875553aab76 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:36.409842 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3071/6101] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Aug 7 01:40:36 2022] POST /identity/v3/projects => generated 329 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:36.411651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60d6e6-53ce-4398-80cc-808d945a3df8 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:36.415291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8f60d6e6-53ce-4398-80cc-808d945a3df8 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:36.433606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60d6e6-53ce-4398-80cc-808d945a3df8 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:36.444437 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:36.623746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496d368-3249-4df9-89f3-b1c5f603a869 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:36.624703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496d368-3249-4df9-89f3-b1c5f603a869 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:36.625238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496d368-3249-4df9-89f3-b1c5f603a869 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:36.625612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496d368-3249-4df9-89f3-b1c5f603a869 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:36.627270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496d368-3249-4df9-89f3-b1c5f603a869 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:36.629625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496d368-3249-4df9-89f3-b1c5f603a869 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:36.695940 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3031/6102] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:40:36 2022] POST /identity/v3/users => generated 413 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:36.700708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0eac46-b9ea-42dd-8cbf-5875553aab76 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:36.718245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0eac46-b9ea-42dd-8cbf-5875553aab76 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:36.739413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096cdbb-db20-4dd3-9f31-de57c55aca9a tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:36.746004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096cdbb-db20-4dd3-9f31-de57c55aca9a tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:36.748101 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096cdbb-db20-4dd3-9f31-de57c55aca9a tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:36.748634 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096cdbb-db20-4dd3-9f31-de57c55aca9a tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:36.750222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7096cdbb-db20-4dd3-9f31-de57c55aca9a tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:36.760417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7096cdbb-db20-4dd3-9f31-de57c55aca9a tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:36.820209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496d368-3249-4df9-89f3-b1c5f603a869 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:36.821270 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3072/6103] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:40:36 2022] POST /identity/v3/roles => generated 243 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:36.867446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496d368-3249-4df9-89f3-b1c5f603a869 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:36.909534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715ffff-553f-47ad-9b8a-3220e14cc248 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:36.909867 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715ffff-553f-47ad-9b8a-3220e14cc248 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:36.910148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715ffff-553f-47ad-9b8a-3220e14cc248 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:36.910788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3715ffff-553f-47ad-9b8a-3220e14cc248 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:36.911138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715ffff-553f-47ad-9b8a-3220e14cc248 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:36.922067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3715ffff-553f-47ad-9b8a-3220e14cc248 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:36.970856 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3032/6104] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:40:36 2022] POST /identity/v3/roles => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:36.974873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096cdbb-db20-4dd3-9f31-de57c55aca9a tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:36.994292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096cdbb-db20-4dd3-9f31-de57c55aca9a tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:37.024426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4651a6b-4b48-4279-a72c-9d45dfd13ee3 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:37.025151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4651a6b-4b48-4279-a72c-9d45dfd13ee3 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:37.025440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4651a6b-4b48-4279-a72c-9d45dfd13ee3 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:37.025722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4651a6b-4b48-4279-a72c-9d45dfd13ee3 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/projects/957d1973d79341438d0d9e33e7b05588/users/df78657bdfa44547b6a914952bd98147/roles/51591275435347c3b26638bee1a7e2bf` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:37.093753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4651a6b-4b48-4279-a72c-9d45dfd13ee3 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_grant(project_id=957d1973d79341438d0d9e33e7b05588, user_id=df78657bdfa44547b6a914952bd98147, role_id=51591275435347c3b26638bee1a7e2bf)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:37.108330 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4651a6b-4b48-4279-a72c-9d45dfd13ee3 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:37.151070 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3073/6105] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:36 2022] PUT /identity/v3/projects/957d1973d79341438d0d9e33e7b05588/users/df78657bdfa44547b6a914952bd98147/roles/51591275435347c3b26638bee1a7e2bf => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:37.152699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715ffff-553f-47ad-9b8a-3220e14cc248 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:37.168013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3715ffff-553f-47ad-9b8a-3220e14cc248 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:37.360367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0414b8-1fb5-4eba-b202-91b228cd9b77 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:37.361486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0414b8-1fb5-4eba-b202-91b228cd9b77 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:37.366858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0414b8-1fb5-4eba-b202-91b228cd9b77 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:37.367356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0414b8-1fb5-4eba-b202-91b228cd9b77 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/projects/957d1973d79341438d0d9e33e7b05588/users/df78657bdfa44547b6a914952bd98147/roles/c5da9b096e344efc909357f0db1c6e5f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:37.371721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0414b8-1fb5-4eba-b202-91b228cd9b77 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_grant(project_id=957d1973d79341438d0d9e33e7b05588, user_id=df78657bdfa44547b6a914952bd98147, role_id=c5da9b096e344efc909357f0db1c6e5f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:37.374601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0414b8-1fb5-4eba-b202-91b228cd9b77 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:37.406045 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3033/6106] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:37 2022] PUT /identity/v3/projects/957d1973d79341438d0d9e33e7b05588/users/df78657bdfa44547b6a914952bd98147/roles/c5da9b096e344efc909357f0db1c6e5f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:37.410344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4651a6b-4b48-4279-a72c-9d45dfd13ee3 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:37.427853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4651a6b-4b48-4279-a72c-9d45dfd13ee3 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:37.608111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac0d50-38fe-40a1-8598-c09f9a9940ea tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:37.610340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac0d50-38fe-40a1-8598-c09f9a9940ea tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:37.610340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac0d50-38fe-40a1-8598-c09f9a9940ea tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:37.610340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac0d50-38fe-40a1-8598-c09f9a9940ea tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:37.610616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac0d50-38fe-40a1-8598-c09f9a9940ea tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:37.614906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac0d50-38fe-40a1-8598-c09f9a9940ea tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:37.685536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b0ed7-df25-4615-a6fb-e14419e4b273 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:37.686106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b0ed7-df25-4615-a6fb-e14419e4b273 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:37.686539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b0ed7-df25-4615-a6fb-e14419e4b273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:37.689876 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3074/6107] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:37 2022] GET /identity/v3/users => generated 8589 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:37.806849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9d0b0ed7-df25-4615-a6fb-e14419e4b273 None None] MFA Rules not processed for user `df78657bdfa44547b6a914952bd98147`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:37.808138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9d0b0ed7-df25-4615-a6fb-e14419e4b273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:38.036124 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3034/6108] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:37 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:40:38.136287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8c647-6679-4376-b770-d0526ed01689 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:38.136788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8c647-6679-4376-b770-d0526ed01689 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:38.137103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca8c647-6679-4376-b770-d0526ed01689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:38.197309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0ca8c647-6679-4376-b770-d0526ed01689 None None] MFA Rules not processed for user `df78657bdfa44547b6a914952bd98147`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:38.201752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0ca8c647-6679-4376-b770-d0526ed01689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:38.229844 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3075/6109] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:38 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:38.234181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b0ed7-df25-4615-a6fb-e14419e4b273 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:38.241280 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:38.277496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b0ed7-df25-4615-a6fb-e14419e4b273 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:38.295970 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e5628-ed23-4263-bfdd-937487ce611f tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df78657bdfa44547b6a914952bd98147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '957d1973d79341438d0d9e33e7b05588', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-231095154', 'tempest-DelegatedRole-782911275'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:38.304292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e5628-ed23-4263-bfdd-937487ce611f tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:38.304668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e5628-ed23-4263-bfdd-937487ce611f tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:38.307367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e5628-ed23-4263-bfdd-937487ce611f tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:38.317940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e5628-ed23-4263-bfdd-937487ce611f tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] RBAC: Authorizing `identity:create_trust()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:38.319237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e5628-ed23-4263-bfdd-937487ce611f tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:38.516894 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3035/6110] 10.222.0.39 () {60 vars in 1174 bytes} [Sun Aug 7 01:40:38 2022] POST /identity/v3/OS-TRUST/trusts => generated 858 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:38.520931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8c647-6679-4376-b770-d0526ed01689 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:38.531919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca8c647-6679-4376-b770-d0526ed01689 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:38.544138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250dd75-3d96-4398-814e-d26007c140ea tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df78657bdfa44547b6a914952bd98147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '957d1973d79341438d0d9e33e7b05588', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-231095154', 'tempest-DelegatedRole-782911275'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:38.544947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250dd75-3d96-4398-814e-d26007c140ea tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:38.545325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250dd75-3d96-4398-814e-d26007c140ea tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:38.545768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250dd75-3d96-4398-814e-d26007c140ea tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] PATH_INFO: `/v3/OS-TRUST/trusts/d7aa68e1c8034dfb8c76d689581a29f6` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:38.559765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250dd75-3d96-4398-814e-d26007c140ea tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] RBAC: Authorizing `identity:get_trust(trust_id=d7aa68e1c8034dfb8c76d689581a29f6)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:38.564251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250dd75-3d96-4398-814e-d26007c140ea tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:38.585616 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3076/6111] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Aug 7 01:40:38 2022] GET /identity/v3/OS-TRUST/trusts/d7aa68e1c8034dfb8c76d689581a29f6 => generated 858 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:40:38.589923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e5628-ed23-4263-bfdd-937487ce611f tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:38.602394 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e5628-ed23-4263-bfdd-937487ce611f tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:38.614037 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf6471-3754-4f4e-b703-d08550f835ab tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df78657bdfa44547b6a914952bd98147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '957d1973d79341438d0d9e33e7b05588', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-231095154', 'tempest-DelegatedRole-782911275'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:38.618424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf6471-3754-4f4e-b703-d08550f835ab tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:38.618829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf6471-3754-4f4e-b703-d08550f835ab tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:38.619120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf6471-3754-4f4e-b703-d08550f835ab tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] PATH_INFO: `/v3/OS-TRUST/trusts/d7aa68e1c8034dfb8c76d689581a29f6/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:38.645543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf6471-3754-4f4e-b703-d08550f835ab tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=d7aa68e1c8034dfb8c76d689581a29f6)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:38.648553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf6471-3754-4f4e-b703-d08550f835ab tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:38.671575 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3036/6112] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Aug 7 01:40:38 2022] GET /identity/v3/OS-TRUST/trusts/d7aa68e1c8034dfb8c76d689581a29f6/roles => generated 370 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:40:38.674942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250dd75-3d96-4398-814e-d26007c140ea tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:38.688803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250dd75-3d96-4398-814e-d26007c140ea tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:38.699466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59cd344-d7aa-4390-997a-19ee453fc205 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df78657bdfa44547b6a914952bd98147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '957d1973d79341438d0d9e33e7b05588', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-231095154', 'tempest-DelegatedRole-782911275'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:38.700519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cd344-d7aa-4390-997a-19ee453fc205 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:38.700906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cd344-d7aa-4390-997a-19ee453fc205 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:38.704302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59cd344-d7aa-4390-997a-19ee453fc205 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] PATH_INFO: `/v3/OS-TRUST/trusts/d7aa68e1c8034dfb8c76d689581a29f6/roles/51591275435347c3b26638bee1a7e2bf` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:38.717999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59cd344-d7aa-4390-997a-19ee453fc205 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] RBAC: Authorizing `identity:get_role_for_trust(trust_id=d7aa68e1c8034dfb8c76d689581a29f6, role_id=51591275435347c3b26638bee1a7e2bf)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:38.719772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59cd344-d7aa-4390-997a-19ee453fc205 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:38.739847 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3077/6113] 10.222.0.39 () {58 vars in 1368 bytes} [Sun Aug 7 01:40:38 2022] GET /identity/v3/OS-TRUST/trusts/d7aa68e1c8034dfb8c76d689581a29f6/roles/51591275435347c3b26638bee1a7e2bf => generated 243 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:40:38.743743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf6471-3754-4f4e-b703-d08550f835ab tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:38.757076 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf6471-3754-4f4e-b703-d08550f835ab tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:38.773311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b640da-e312-4957-a471-9cb84c27c7de tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df78657bdfa44547b6a914952bd98147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '957d1973d79341438d0d9e33e7b05588', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-231095154', 'tempest-DelegatedRole-782911275'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:38.774779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b640da-e312-4957-a471-9cb84c27c7de tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] REQUEST_METHOD: `HEAD` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:38.776269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b640da-e312-4957-a471-9cb84c27c7de tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:38.777629 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b640da-e312-4957-a471-9cb84c27c7de tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] PATH_INFO: `/v3/OS-TRUST/trusts/d7aa68e1c8034dfb8c76d689581a29f6/roles/51591275435347c3b26638bee1a7e2bf` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:38.797231 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b640da-e312-4957-a471-9cb84c27c7de tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] RBAC: Authorizing `identity:get_role_for_trust(trust_id=d7aa68e1c8034dfb8c76d689581a29f6, role_id=51591275435347c3b26638bee1a7e2bf)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:38.803165 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b640da-e312-4957-a471-9cb84c27c7de tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:38.822505 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3037/6114] 10.222.0.39 () {58 vars in 1369 bytes} [Sun Aug 7 01:40:38 2022] HEAD /identity/v3/OS-TRUST/trusts/d7aa68e1c8034dfb8c76d689581a29f6/roles/51591275435347c3b26638bee1a7e2bf => generated 0 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 07 01:40:38.826525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59cd344-d7aa-4390-997a-19ee453fc205 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:38.839204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59cd344-d7aa-4390-997a-19ee453fc205 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:38.879698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f072d11-bf93-4cd2-921e-1a136a847e68 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df78657bdfa44547b6a914952bd98147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '957d1973d79341438d0d9e33e7b05588', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-231095154', 'tempest-DelegatedRole-782911275'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:38.880458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f072d11-bf93-4cd2-921e-1a136a847e68 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:38.880771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f072d11-bf93-4cd2-921e-1a136a847e68 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:38.881580 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f072d11-bf93-4cd2-921e-1a136a847e68 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] PATH_INFO: `/v3/OS-TRUST/trusts/d7aa68e1c8034dfb8c76d689581a29f6/roles/c5da9b096e344efc909357f0db1c6e5f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:38.884692 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:38.901300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f072d11-bf93-4cd2-921e-1a136a847e68 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] RBAC: Authorizing `identity:get_role_for_trust(trust_id=d7aa68e1c8034dfb8c76d689581a29f6, role_id=c5da9b096e344efc909357f0db1c6e5f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:38.902937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f072d11-bf93-4cd2-921e-1a136a847e68 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:38.925528 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-4f072d11-bf93-4cd2-921e-1a136a847e68 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] Could not find role: c5da9b096e344efc909357f0db1c6e5f.: keystone.exception.RoleNotFound: Could not find role: c5da9b096e344efc909357f0db1c6e5f. Aug 07 01:40:38.925528 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:40:38.925528 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:40:38.925528 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:40:38.925528 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:40:38.925528 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:40:38.925528 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:40:38.925528 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:40:38.925528 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:40:38.925528 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:40:38.925528 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:40:38.925528 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:40:38.925528 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 07 01:40:38.925528 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 01:40:38.925528 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: c5da9b096e344efc909357f0db1c6e5f. Aug 07 01:40:38.926768 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:40:38.930102 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3078/6115] 10.222.0.39 () {58 vars in 1368 bytes} [Sun Aug 7 01:40:38 2022] GET /identity/v3/OS-TRUST/trusts/d7aa68e1c8034dfb8c76d689581a29f6/roles/c5da9b096e344efc909357f0db1c6e5f => generated 110 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:40:38.933799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b640da-e312-4957-a471-9cb84c27c7de tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:38.951816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b640da-e312-4957-a471-9cb84c27c7de tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:38.974756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18207c71-4f6b-4d63-9f60-4d85bd6fbcd9 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df78657bdfa44547b6a914952bd98147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '957d1973d79341438d0d9e33e7b05588', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-231095154', 'tempest-DelegatedRole-782911275'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:38.975800 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18207c71-4f6b-4d63-9f60-4d85bd6fbcd9 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] REQUEST_METHOD: `HEAD` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:38.978957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18207c71-4f6b-4d63-9f60-4d85bd6fbcd9 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:38.979805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18207c71-4f6b-4d63-9f60-4d85bd6fbcd9 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] PATH_INFO: `/v3/OS-TRUST/trusts/d7aa68e1c8034dfb8c76d689581a29f6/roles/c5da9b096e344efc909357f0db1c6e5f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:38.999845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18207c71-4f6b-4d63-9f60-4d85bd6fbcd9 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] RBAC: Authorizing `identity:get_role_for_trust(trust_id=d7aa68e1c8034dfb8c76d689581a29f6, role_id=c5da9b096e344efc909357f0db1c6e5f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:39.001510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18207c71-4f6b-4d63-9f60-4d85bd6fbcd9 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:39.035799 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-18207c71-4f6b-4d63-9f60-4d85bd6fbcd9 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] Could not find role: c5da9b096e344efc909357f0db1c6e5f.: keystone.exception.RoleNotFound: Could not find role: c5da9b096e344efc909357f0db1c6e5f. Aug 07 01:40:39.035799 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:40:39.035799 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:40:39.035799 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:40:39.035799 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:40:39.035799 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:40:39.035799 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:40:39.035799 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:40:39.035799 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:40:39.035799 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:40:39.035799 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:40:39.035799 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:40:39.035799 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 07 01:40:39.035799 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 01:40:39.035799 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: c5da9b096e344efc909357f0db1c6e5f. Aug 07 01:40:39.036896 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:40:39.040818 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3038/6116] 10.222.0.39 () {58 vars in 1369 bytes} [Sun Aug 7 01:40:38 2022] HEAD /identity/v3/OS-TRUST/trusts/d7aa68e1c8034dfb8c76d689581a29f6/roles/c5da9b096e344efc909357f0db1c6e5f => generated 0 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:40:39.051183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f072d11-bf93-4cd2-921e-1a136a847e68 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:39.066522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f072d11-bf93-4cd2-921e-1a136a847e68 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:39.081140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16b6ab-16a1-48fa-afec-cbf382deece7 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df78657bdfa44547b6a914952bd98147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '957d1973d79341438d0d9e33e7b05588', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-231095154', 'tempest-DelegatedRole-782911275'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:39.085133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16b6ab-16a1-48fa-afec-cbf382deece7 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:39.085536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16b6ab-16a1-48fa-afec-cbf382deece7 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:39.094601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16b6ab-16a1-48fa-afec-cbf382deece7 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] PATH_INFO: `/v3/OS-TRUST/trusts/d7aa68e1c8034dfb8c76d689581a29f6` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:39.106731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16b6ab-16a1-48fa-afec-cbf382deece7 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] RBAC: Authorizing `identity:delete_trust(trust_id=d7aa68e1c8034dfb8c76d689581a29f6)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:39.112660 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16b6ab-16a1-48fa-afec-cbf382deece7 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:39.161784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ad16b6ab-16a1-48fa-afec-cbf382deece7 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'd7aa68e1c8034dfb8c76d689581a29f6', 'request_id': 'req-ad16b6ab-16a1-48fa-afec-cbf382deece7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:39.162937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ad16b6ab-16a1-48fa-afec-cbf382deece7 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'd7aa68e1c8034dfb8c76d689581a29f6', 'request_id': 'req-ad16b6ab-16a1-48fa-afec-cbf382deece7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:39.163688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ad16b6ab-16a1-48fa-afec-cbf382deece7 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'd7aa68e1c8034dfb8c76d689581a29f6', 'request_id': 'req-ad16b6ab-16a1-48fa-afec-cbf382deece7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:39.190886 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3079/6117] 10.222.0.39 () {58 vars in 1254 bytes} [Sun Aug 7 01:40:39 2022] DELETE /identity/v3/OS-TRUST/trusts/d7aa68e1c8034dfb8c76d689581a29f6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:39.192198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18207c71-4f6b-4d63-9f60-4d85bd6fbcd9 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:39.196098 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-18207c71-4f6b-4d63-9f60-4d85bd6fbcd9 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:39.228620 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18207c71-4f6b-4d63-9f60-4d85bd6fbcd9 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:39.240377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e39b09-b974-46d8-9f01-2c29ddc224a0 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df78657bdfa44547b6a914952bd98147', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '957d1973d79341438d0d9e33e7b05588', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-231095154', 'tempest-DelegatedRole-782911275'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:39.241040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e39b09-b974-46d8-9f01-2c29ddc224a0 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:39.241360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e39b09-b974-46d8-9f01-2c29ddc224a0 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:39.241636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e39b09-b974-46d8-9f01-2c29ddc224a0 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] PATH_INFO: `/v3/OS-TRUST/trusts/d7aa68e1c8034dfb8c76d689581a29f6` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:39.253869 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-10e39b09-b974-46d8-9f01-2c29ddc224a0 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] Could not find trust: d7aa68e1c8034dfb8c76d689581a29f6.: keystone.exception.TrustNotFound: Could not find trust: d7aa68e1c8034dfb8c76d689581a29f6. Aug 07 01:40:39.253869 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:40:39.253869 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:40:39.253869 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:40:39.253869 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:40:39.253869 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:40:39.253869 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:40:39.253869 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:40:39.253869 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:40:39.253869 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:40:39.253869 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:40:39.253869 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:40:39.253869 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 07 01:40:39.253869 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 07 01:40:39.253869 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 07 01:40:39.254903 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 07 01:40:39.254903 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 07 01:40:39.254903 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 07 01:40:39.254903 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 07 01:40:39.254903 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 07 01:40:39.254903 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:40:39.254903 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:40:39.254903 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 07 01:40:39.254903 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 07 01:40:39.254903 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 07 01:40:39.254903 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 07 01:40:39.254903 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: d7aa68e1c8034dfb8c76d689581a29f6. Aug 07 01:40:39.254903 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:40:39.259967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16b6ab-16a1-48fa-afec-cbf382deece7 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:39.261942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ad16b6ab-16a1-48fa-afec-cbf382deece7 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:39.287130 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3039/6118] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Aug 7 01:40:39 2022] GET /identity/v3/OS-TRUST/trusts/d7aa68e1c8034dfb8c76d689581a29f6 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 07 01:40:39.300763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16b6ab-16a1-48fa-afec-cbf382deece7 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:39.316668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d356e5-b506-475d-8d04-1cd59029405f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:39.317332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d356e5-b506-475d-8d04-1cd59029405f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:39.317612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d356e5-b506-475d-8d04-1cd59029405f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:39.317886 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d356e5-b506-475d-8d04-1cd59029405f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/roles/c5da9b096e344efc909357f0db1c6e5f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:39.320716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d356e5-b506-475d-8d04-1cd59029405f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c5da9b096e344efc909357f0db1c6e5f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:39.322346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d356e5-b506-475d-8d04-1cd59029405f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:39.462778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e7d356e5-b506-475d-8d04-1cd59029405f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invalidating the token cache because role c5da9b096e344efc909357f0db1c6e5f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:40:39.463334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e7d356e5-b506-475d-8d04-1cd59029405f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:39.468164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e7d356e5-b506-475d-8d04-1cd59029405f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:39.478204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e39b09-b974-46d8-9f01-2c29ddc224a0 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:39.478642 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3080/6119] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:40:39 2022] DELETE /identity/v3/roles/c5da9b096e344efc909357f0db1c6e5f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:39.479966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-10e39b09-b974-46d8-9f01-2c29ddc224a0 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:39.523954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e39b09-b974-46d8-9f01-2c29ddc224a0 tempest-TrustsV3TestJSON-1992513371 tempest-user-915454613] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:39.746232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b3e55-3c15-4de3-839d-b9852d90a718 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:39.746911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b3e55-3c15-4de3-839d-b9852d90a718 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:39.747189 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b3e55-3c15-4de3-839d-b9852d90a718 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:39.747417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b3e55-3c15-4de3-839d-b9852d90a718 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/roles/51591275435347c3b26638bee1a7e2bf` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:39.749869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b3e55-3c15-4de3-839d-b9852d90a718 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:delete_role(role_id=51591275435347c3b26638bee1a7e2bf)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:39.751486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b3e55-3c15-4de3-839d-b9852d90a718 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:39.842497 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:39.872465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-321b3e55-3c15-4de3-839d-b9852d90a718 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invalidating the token cache because role 51591275435347c3b26638bee1a7e2bf has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:40:39.873151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-321b3e55-3c15-4de3-839d-b9852d90a718 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:39.875741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-321b3e55-3c15-4de3-839d-b9852d90a718 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:39.887058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d356e5-b506-475d-8d04-1cd59029405f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:39.887763 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3040/6120] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:40:39 2022] DELETE /identity/v3/roles/51591275435347c3b26638bee1a7e2bf => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:40:39.899470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d356e5-b506-475d-8d04-1cd59029405f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:40.133590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b3e55-3c15-4de3-839d-b9852d90a718 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:40.135297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-321b3e55-3c15-4de3-839d-b9852d90a718 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:40.211668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fac494-5284-4a70-aca6-2c0a872f4619 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:40.216611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fac494-5284-4a70-aca6-2c0a872f4619 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:40.217125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fac494-5284-4a70-aca6-2c0a872f4619 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:40.217572 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fac494-5284-4a70-aca6-2c0a872f4619 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/users/df78657bdfa44547b6a914952bd98147` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:40.222013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fac494-5284-4a70-aca6-2c0a872f4619 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:delete_user(user_id=df78657bdfa44547b6a914952bd98147)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:40.232193 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fac494-5284-4a70-aca6-2c0a872f4619 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:40.306221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b3e55-3c15-4de3-839d-b9852d90a718 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:40.316595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9eb59-53f2-4eb3-b0bc-842ac5b9c1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:40.317705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9eb59-53f2-4eb3-b0bc-842ac5b9c1d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:40.318097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9eb59-53f2-4eb3-b0bc-842ac5b9c1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:40.318799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9eb59-53f2-4eb3-b0bc-842ac5b9c1d7 admin admin] PATH_INFO: `/v3/users/23ff59c0b401438ab6c45bcf6eab42c8` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:40.328336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9eb59-53f2-4eb3-b0bc-842ac5b9c1d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23ff59c0b401438ab6c45bcf6eab42c8)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:40.337922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9eb59-53f2-4eb3-b0bc-842ac5b9c1d7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:40.453722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-61fac494-5284-4a70-aca6-2c0a872f4619 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df78657bdfa44547b6a914952bd98147'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:40.466624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-84f9eb59-53f2-4eb3-b0bc-842ac5b9c1d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23ff59c0b401438ab6c45bcf6eab42c8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:40.485891 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-84f9eb59-53f2-4eb3-b0bc-842ac5b9c1d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23ff59c0b401438ab6c45bcf6eab42c8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:40.490779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-61fac494-5284-4a70-aca6-2c0a872f4619 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df78657bdfa44547b6a914952bd98147'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:40.519790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-84f9eb59-53f2-4eb3-b0bc-842ac5b9c1d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23ff59c0b401438ab6c45bcf6eab42c8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:40.522197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-84f9eb59-53f2-4eb3-b0bc-842ac5b9c1d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23ff59c0b401438ab6c45bcf6eab42c8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:40.525626 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=86,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=12 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:40.542062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-61fac494-5284-4a70-aca6-2c0a872f4619 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df78657bdfa44547b6a914952bd98147'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:40.542260 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-84f9eb59-53f2-4eb3-b0bc-842ac5b9c1d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23ff59c0b401438ab6c45bcf6eab42c8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:40.544457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-61fac494-5284-4a70-aca6-2c0a872f4619 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df78657bdfa44547b6a914952bd98147'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:40.556278 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3041/6121] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:40:40 2022] DELETE /identity/v3/users/23ff59c0b401438ab6c45bcf6eab42c8 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:40:40.558065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9eb59-53f2-4eb3-b0bc-842ac5b9c1d7 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:40.562591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-61fac494-5284-4a70-aca6-2c0a872f4619 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df78657bdfa44547b6a914952bd98147'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:40.564383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-84f9eb59-53f2-4eb3-b0bc-842ac5b9c1d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:40.574697 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3081/6122] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:40:39 2022] DELETE /identity/v3/users/df78657bdfa44547b6a914952bd98147 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:40.576758 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb1e3d-ac3a-4e68-9109-86024863e2c2 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:40.578544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb1e3d-ac3a-4e68-9109-86024863e2c2 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:40.578984 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb1e3d-ac3a-4e68-9109-86024863e2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:40.616204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-4ffb1e3d-ac3a-4e68-9109-86024863e2c2 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:40.618016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4ffb1e3d-ac3a-4e68-9109-86024863e2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:40.704719 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3082/6123] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:40.705835 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb1e3d-ac3a-4e68-9109-86024863e2c2 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:40.707783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4ffb1e3d-ac3a-4e68-9109-86024863e2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:40.718135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9eb59-53f2-4eb3-b0bc-842ac5b9c1d7 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:40.738534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b726495-ab17-4089-9bf4-76db56fed883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:40.741362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b726495-ab17-4089-9bf4-76db56fed883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:40.741643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b726495-ab17-4089-9bf4-76db56fed883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:40.741916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b726495-ab17-4089-9bf4-76db56fed883 admin admin] PATH_INFO: `/v3/users/d556a8ae0d524894a93203ce3f70d420` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:40.743769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b726495-ab17-4089-9bf4-76db56fed883 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d556a8ae0d524894a93203ce3f70d420)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:40.749099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b726495-ab17-4089-9bf4-76db56fed883 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:40.790706 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:40.863255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4b726495-ab17-4089-9bf4-76db56fed883 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd556a8ae0d524894a93203ce3f70d420'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:40.871732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb1e3d-ac3a-4e68-9109-86024863e2c2 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:40.887157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7719ec4-c6c8-4465-b62b-d94dccaf7367 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:40.887929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7719ec4-c6c8-4465-b62b-d94dccaf7367 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:40.888228 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7719ec4-c6c8-4465-b62b-d94dccaf7367 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:40.888507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7719ec4-c6c8-4465-b62b-d94dccaf7367 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/projects/957d1973d79341438d0d9e33e7b05588` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:40.890941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7719ec4-c6c8-4465-b62b-d94dccaf7367 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:delete_project(project_id=957d1973d79341438d0d9e33e7b05588)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:40.893690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4b726495-ab17-4089-9bf4-76db56fed883 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd556a8ae0d524894a93203ce3f70d420'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:40.898896 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7719ec4-c6c8-4465-b62b-d94dccaf7367 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:40.922894 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4b726495-ab17-4089-9bf4-76db56fed883 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd556a8ae0d524894a93203ce3f70d420'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:40.924787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4b726495-ab17-4089-9bf4-76db56fed883 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd556a8ae0d524894a93203ce3f70d420'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:40.944643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4b726495-ab17-4089-9bf4-76db56fed883 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd556a8ae0d524894a93203ce3f70d420'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:40.971074 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3042/6124] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:40:40 2022] DELETE /identity/v3/users/d556a8ae0d524894a93203ce3f70d420 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:40.971074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b726495-ab17-4089-9bf4-76db56fed883 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:40.971074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4b726495-ab17-4089-9bf4-76db56fed883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:41.117602 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b7719ec4-c6c8-4465-b62b-d94dccaf7367 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '957d1973d79341438d0d9e33e7b05588', 'request_id': 'req-b7719ec4-c6c8-4465-b62b-d94dccaf7367'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:41.127631 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b7719ec4-c6c8-4465-b62b-d94dccaf7367 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '957d1973d79341438d0d9e33e7b05588', 'request_id': 'req-b7719ec4-c6c8-4465-b62b-d94dccaf7367'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:41.157881 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b7719ec4-c6c8-4465-b62b-d94dccaf7367 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '957d1973d79341438d0d9e33e7b05588', 'request_id': 'req-b7719ec4-c6c8-4465-b62b-d94dccaf7367'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:41.206825 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b7719ec4-c6c8-4465-b62b-d94dccaf7367 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] The token cache is being invalidate because project 957d1973d79341438d0d9e33e7b05588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:40:41.207205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b7719ec4-c6c8-4465-b62b-d94dccaf7367 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:41.211743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b7719ec4-c6c8-4465-b62b-d94dccaf7367 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:41.213807 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3083/6125] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:40:40 2022] DELETE /identity/v3/projects/957d1973d79341438d0d9e33e7b05588 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:41.231369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7719ec4-c6c8-4465-b62b-d94dccaf7367 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:41.232730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b726495-ab17-4089-9bf4-76db56fed883 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:41.233500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b7719ec4-c6c8-4465-b62b-d94dccaf7367 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:41.269115 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:41.393058 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5176b-2d09-4b00-ab88-cec93ecb4365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:41.394035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5176b-2d09-4b00-ab88-cec93ecb4365 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:41.394512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5176b-2d09-4b00-ab88-cec93ecb4365 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:41.394768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5176b-2d09-4b00-ab88-cec93ecb4365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:41.399542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-01f5176b-2d09-4b00-ab88-cec93ecb4365 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:41.411292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7719ec4-c6c8-4465-b62b-d94dccaf7367 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:41.429152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368193a-e792-4acb-8d13-df27929f08a0 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:41.430993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368193a-e792-4acb-8d13-df27929f08a0 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:41.432044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368193a-e792-4acb-8d13-df27929f08a0 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:41.433936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368193a-e792-4acb-8d13-df27929f08a0 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:41.434885 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368193a-e792-4acb-8d13-df27929f08a0 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:41.438253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368193a-e792-4acb-8d13-df27929f08a0 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:41.513318 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3084/6126] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Aug 7 01:40:41 2022] POST /identity/v3/projects => generated 329 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:40:41.517242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368193a-e792-4acb-8d13-df27929f08a0 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:41.601467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5176b-2d09-4b00-ab88-cec93ecb4365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:41.603120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5176b-2d09-4b00-ab88-cec93ecb4365 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:41.614681 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:41.680651 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3043/6127] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:40:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 712 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:40:41.775045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368193a-e792-4acb-8d13-df27929f08a0 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:41.781921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc63580-7c3e-4b44-a88a-851513bb6493 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:41.782571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc63580-7c3e-4b44-a88a-851513bb6493 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:41.782911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc63580-7c3e-4b44-a88a-851513bb6493 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:41.783189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc63580-7c3e-4b44-a88a-851513bb6493 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:41.784461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc63580-7c3e-4b44-a88a-851513bb6493 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:41.786437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc63580-7c3e-4b44-a88a-851513bb6493 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:41.817678 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3085/6128] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:40:41 2022] POST /identity/v3/users => generated 416 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:41.821920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5176b-2d09-4b00-ab88-cec93ecb4365 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:41.843608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5176b-2d09-4b00-ab88-cec93ecb4365 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:41.861931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc63580-7c3e-4b44-a88a-851513bb6493 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:41.862504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddca96-ed55-4dde-92b8-9801280f1529 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:41.863253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddca96-ed55-4dde-92b8-9801280f1529 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:41.863583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddca96-ed55-4dde-92b8-9801280f1529 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:41.863920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddca96-ed55-4dde-92b8-9801280f1529 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:41.864760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddca96-ed55-4dde-92b8-9801280f1529 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:41.865233 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-afc63580-7c3e-4b44-a88a-851513bb6493 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:41.866401 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddca96-ed55-4dde-92b8-9801280f1529 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:41.922543 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3044/6129] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:40:41 2022] POST /identity/v3/roles => generated 243 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:41.923900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddca96-ed55-4dde-92b8-9801280f1529 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:41.940815 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddca96-ed55-4dde-92b8-9801280f1529 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:41.953417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdde145-4ce2-41c6-bc8c-1ebcadd76bcf tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:41.955228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdde145-4ce2-41c6-bc8c-1ebcadd76bcf tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:41.955512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdde145-4ce2-41c6-bc8c-1ebcadd76bcf tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:41.955797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdde145-4ce2-41c6-bc8c-1ebcadd76bcf tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:41.957597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdde145-4ce2-41c6-bc8c-1ebcadd76bcf tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:41.959769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdde145-4ce2-41c6-bc8c-1ebcadd76bcf tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:42.019367 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3045/6130] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:40:41 2022] POST /identity/v3/roles => generated 246 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:40:42.020650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdde145-4ce2-41c6-bc8c-1ebcadd76bcf tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:42.043409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdde145-4ce2-41c6-bc8c-1ebcadd76bcf tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:42.067562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44220c-1432-4745-8f85-6268dd156963 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:42.069050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44220c-1432-4745-8f85-6268dd156963 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:42.069327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44220c-1432-4745-8f85-6268dd156963 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:42.069599 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44220c-1432-4745-8f85-6268dd156963 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/projects/a02748498569467da150fa591282f951/users/4808c3fcba0e40e5b30eb02e3c3d486c/roles/774d066982d74a15a56c2ffd68a17f4a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:42.102170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc63580-7c3e-4b44-a88a-851513bb6493 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:42.107223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44220c-1432-4745-8f85-6268dd156963 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a02748498569467da150fa591282f951, user_id=4808c3fcba0e40e5b30eb02e3c3d486c, role_id=774d066982d74a15a56c2ffd68a17f4a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:42.109942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44220c-1432-4745-8f85-6268dd156963 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:42.116922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2007104-a2ec-4677-be7e-3102903a942b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:42.117579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2007104-a2ec-4677-be7e-3102903a942b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:42.117852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2007104-a2ec-4677-be7e-3102903a942b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:42.118121 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2007104-a2ec-4677-be7e-3102903a942b admin admin] PATH_INFO: `/v3/projects/b630a4c3bb824b90b4c1898a92b47aa7` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:42.119458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2007104-a2ec-4677-be7e-3102903a942b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b630a4c3bb824b90b4c1898a92b47aa7)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:42.121489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2007104-a2ec-4677-be7e-3102903a942b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:42.136843 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3046/6131] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:42 2022] PUT /identity/v3/projects/a02748498569467da150fa591282f951/users/4808c3fcba0e40e5b30eb02e3c3d486c/roles/774d066982d74a15a56c2ffd68a17f4a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:40:42.141022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44220c-1432-4745-8f85-6268dd156963 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:42.229332 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:42.269860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a2007104-a2ec-4677-be7e-3102903a942b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b630a4c3bb824b90b4c1898a92b47aa7', 'request_id': 'req-a2007104-a2ec-4677-be7e-3102903a942b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:42.292185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a2007104-a2ec-4677-be7e-3102903a942b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b630a4c3bb824b90b4c1898a92b47aa7', 'request_id': 'req-a2007104-a2ec-4677-be7e-3102903a942b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:42.308385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a2007104-a2ec-4677-be7e-3102903a942b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b630a4c3bb824b90b4c1898a92b47aa7', 'request_id': 'req-a2007104-a2ec-4677-be7e-3102903a942b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:42.310084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44220c-1432-4745-8f85-6268dd156963 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:42.343568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a2007104-a2ec-4677-be7e-3102903a942b admin admin] The token cache is being invalidate because project b630a4c3bb824b90b4c1898a92b47aa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:40:42.348608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a2007104-a2ec-4677-be7e-3102903a942b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:42.350659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a2007104-a2ec-4677-be7e-3102903a942b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:42.357715 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3086/6132] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:40:41 2022] DELETE /identity/v3/projects/b630a4c3bb824b90b4c1898a92b47aa7 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:42.360078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b800d1a-d553-4392-9cf8-4eb4af2ce97f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:42.360409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b800d1a-d553-4392-9cf8-4eb4af2ce97f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:42.360759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b800d1a-d553-4392-9cf8-4eb4af2ce97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:42.422269 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3b800d1a-d553-4392-9cf8-4eb4af2ce97f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:42.429108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3b800d1a-d553-4392-9cf8-4eb4af2ce97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:42.486552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876ad21-14ac-4593-8a3a-bb7305748420 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:42.487255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876ad21-14ac-4593-8a3a-bb7305748420 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:42.490046 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876ad21-14ac-4593-8a3a-bb7305748420 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:42.490375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876ad21-14ac-4593-8a3a-bb7305748420 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/projects/a02748498569467da150fa591282f951/users/4808c3fcba0e40e5b30eb02e3c3d486c/roles/e9e1b440b184450a91e547898f59cc64` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:42.497406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876ad21-14ac-4593-8a3a-bb7305748420 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a02748498569467da150fa591282f951, user_id=4808c3fcba0e40e5b30eb02e3c3d486c, role_id=e9e1b440b184450a91e547898f59cc64)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:42.506401 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876ad21-14ac-4593-8a3a-bb7305748420 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:42.534048 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3047/6133] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:42 2022] PUT /identity/v3/projects/a02748498569467da150fa591282f951/users/4808c3fcba0e40e5b30eb02e3c3d486c/roles/e9e1b440b184450a91e547898f59cc64 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:40:42.535472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876ad21-14ac-4593-8a3a-bb7305748420 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:42.544360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1876ad21-14ac-4593-8a3a-bb7305748420 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:42.587814 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3087/6134] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:40:42.588896 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b800d1a-d553-4392-9cf8-4eb4af2ce97f None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:42.591021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3b800d1a-d553-4392-9cf8-4eb4af2ce97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:42.620774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b800d1a-d553-4392-9cf8-4eb4af2ce97f None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:42.759713 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:42.779186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff2d0e-7a99-41a6-8bb7-f264768e19d1 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:42.779843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff2d0e-7a99-41a6-8bb7-f264768e19d1 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:42.780147 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff2d0e-7a99-41a6-8bb7-f264768e19d1 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:42.780848 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff2d0e-7a99-41a6-8bb7-f264768e19d1 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:42.781232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff2d0e-7a99-41a6-8bb7-f264768e19d1 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:42.791221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876ad21-14ac-4593-8a3a-bb7305748420 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:42.793315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff2d0e-7a99-41a6-8bb7-f264768e19d1 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:42.802290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38de218-284b-47e9-a44c-a75d5ef2d310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:42.808499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38de218-284b-47e9-a44c-a75d5ef2d310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:42.808792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38de218-284b-47e9-a44c-a75d5ef2d310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:42.809071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38de218-284b-47e9-a44c-a75d5ef2d310 admin admin] PATH_INFO: `/v3/projects/ccd23866e88e4aa4acf5b0f41c0b2004` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:42.813527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38de218-284b-47e9-a44c-a75d5ef2d310 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccd23866e88e4aa4acf5b0f41c0b2004)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:42.817199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38de218-284b-47e9-a44c-a75d5ef2d310 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:42.852349 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3088/6135] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:42 2022] GET /identity/v3/users => generated 8038 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:42.856967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c7837-e03b-4301-a96b-7f7dd7fdc0d4 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:42.864019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c7837-e03b-4301-a96b-7f7dd7fdc0d4 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:42.864528 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c7837-e03b-4301-a96b-7f7dd7fdc0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:42.907413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a83c7837-e03b-4301-a96b-7f7dd7fdc0d4 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:42.910447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a83c7837-e03b-4301-a96b-7f7dd7fdc0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:42.949693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d38de218-284b-47e9-a44c-a75d5ef2d310 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccd23866e88e4aa4acf5b0f41c0b2004', 'request_id': 'req-d38de218-284b-47e9-a44c-a75d5ef2d310'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:42.974177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d38de218-284b-47e9-a44c-a75d5ef2d310 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccd23866e88e4aa4acf5b0f41c0b2004', 'request_id': 'req-d38de218-284b-47e9-a44c-a75d5ef2d310'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:42.985793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d38de218-284b-47e9-a44c-a75d5ef2d310 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccd23866e88e4aa4acf5b0f41c0b2004', 'request_id': 'req-d38de218-284b-47e9-a44c-a75d5ef2d310'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:43.006855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d38de218-284b-47e9-a44c-a75d5ef2d310 admin admin] The token cache is being invalidate because project ccd23866e88e4aa4acf5b0f41c0b2004 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:40:43.007142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d38de218-284b-47e9-a44c-a75d5ef2d310 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:43.008231 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d38de218-284b-47e9-a44c-a75d5ef2d310 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:43.016175 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3048/6136] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:40:42 2022] DELETE /identity/v3/projects/ccd23866e88e4aa4acf5b0f41c0b2004 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:43.020756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d336c-d241-46eb-abc9-901e96788690 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:43.021085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d336c-d241-46eb-abc9-901e96788690 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:43.021370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d336c-d241-46eb-abc9-901e96788690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:43.054931 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:43.077439 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3089/6137] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:43.078783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495416cc-9c4a-418c-9789-f7da81c17d48 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:43.079063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495416cc-9c4a-418c-9789-f7da81c17d48 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:43.079472 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495416cc-9c4a-418c-9789-f7da81c17d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:43.141541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-495416cc-9c4a-418c-9789-f7da81c17d48 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:43.144582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-495416cc-9c4a-418c-9789-f7da81c17d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:43.171136 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3090/6138] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:43.174198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495416cc-9c4a-418c-9789-f7da81c17d48 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:43.185356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7c8d336c-d241-46eb-abc9-901e96788690 None None] MFA Rules not processed for user `4808c3fcba0e40e5b30eb02e3c3d486c`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:43.186690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7c8d336c-d241-46eb-abc9-901e96788690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:43.203823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495416cc-9c4a-418c-9789-f7da81c17d48 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:43.224497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df4ada-5c46-4800-9ae7-afbdc38328a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:43.225121 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df4ada-5c46-4800-9ae7-afbdc38328a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:43.225396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df4ada-5c46-4800-9ae7-afbdc38328a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:43.225664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df4ada-5c46-4800-9ae7-afbdc38328a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:43.226333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df4ada-5c46-4800-9ae7-afbdc38328a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:40:43.226628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df4ada-5c46-4800-9ae7-afbdc38328a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:43.228277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df4ada-5c46-4800-9ae7-afbdc38328a8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:43.268993 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3091/6139] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:40:43.268993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b18d1-1f7f-4912-adb4-ce51f2e3f74c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:43.268993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b18d1-1f7f-4912-adb4-ce51f2e3f74c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:43.268993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b18d1-1f7f-4912-adb4-ce51f2e3f74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:43.310190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0d4b18d1-1f7f-4912-adb4-ce51f2e3f74c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:43.311726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0d4b18d1-1f7f-4912-adb4-ce51f2e3f74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:43.333040 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3092/6140] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:43.333844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b18d1-1f7f-4912-adb4-ce51f2e3f74c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:43.357242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b18d1-1f7f-4912-adb4-ce51f2e3f74c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:43.366036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08dcdf9-fb90-4d7f-9e30-f0fea69a72af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:43.366675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dcdf9-fb90-4d7f-9e30-f0fea69a72af admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:43.366950 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dcdf9-fb90-4d7f-9e30-f0fea69a72af admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:43.367216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dcdf9-fb90-4d7f-9e30-f0fea69a72af admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:43.367855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08dcdf9-fb90-4d7f-9e30-f0fea69a72af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:43.369844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08dcdf9-fb90-4d7f-9e30-f0fea69a72af admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:43.459157 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3093/6141] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:40:43 2022] POST /identity/v3/projects => generated 401 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:43.459986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08dcdf9-fb90-4d7f-9e30-f0fea69a72af admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:43.490544 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3049/6142] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:43 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:43.501213 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d336c-d241-46eb-abc9-901e96788690 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:43.537505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d336c-d241-46eb-abc9-901e96788690 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:43.599569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08dcdf9-fb90-4d7f-9e30-f0fea69a72af admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:43.618778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750178fe-9757-470a-892d-283a6bc83d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:43.619186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750178fe-9757-470a-892d-283a6bc83d5b admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:43.619461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750178fe-9757-470a-892d-283a6bc83d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:43.620044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750178fe-9757-470a-892d-283a6bc83d5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:43.620706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750178fe-9757-470a-892d-283a6bc83d5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:40:43.621002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750178fe-9757-470a-892d-283a6bc83d5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:43.622584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750178fe-9757-470a-892d-283a6bc83d5b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:43.673723 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3094/6143] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:40:43.674424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457abe2f-a560-477c-a475-b9ea2be43b15 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:43.674713 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457abe2f-a560-477c-a475-b9ea2be43b15 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:43.674989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457abe2f-a560-477c-a475-b9ea2be43b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:43.741759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-457abe2f-a560-477c-a475-b9ea2be43b15 None None] MFA Rules not processed for user `4808c3fcba0e40e5b30eb02e3c3d486c`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:43.744557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-457abe2f-a560-477c-a475-b9ea2be43b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:43.766170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3cad8-e42c-4240-bdcb-883a5ad659c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:43.768111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3cad8-e42c-4240-bdcb-883a5ad659c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:43.769729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3cad8-e42c-4240-bdcb-883a5ad659c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:43.773188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3cad8-e42c-4240-bdcb-883a5ad659c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:43.774894 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3cad8-e42c-4240-bdcb-883a5ad659c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:43.781583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3cad8-e42c-4240-bdcb-883a5ad659c0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:43.812504 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:43.853355 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3050/6144] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:40:43 2022] POST /identity/v3/users => generated 301 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:43.859672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3cad8-e42c-4240-bdcb-883a5ad659c0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:43.885790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3cad8-e42c-4240-bdcb-883a5ad659c0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:43.907187 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea8256-5a5e-4bd6-8f05-5c5127a27ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:43.908383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea8256-5a5e-4bd6-8f05-5c5127a27ff6 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:43.908772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea8256-5a5e-4bd6-8f05-5c5127a27ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:43.910358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea8256-5a5e-4bd6-8f05-5c5127a27ff6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:43.911121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea8256-5a5e-4bd6-8f05-5c5127a27ff6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:43.917669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea8256-5a5e-4bd6-8f05-5c5127a27ff6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:43.989647 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3095/6145] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:43 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:43.996589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457abe2f-a560-477c-a475-b9ea2be43b15 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:44.013241 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3051/6146] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:40:43 2022] POST /identity/v3/projects => generated 371 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:44.014835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea8256-5a5e-4bd6-8f05-5c5127a27ff6 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:44.019730 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457abe2f-a560-477c-a475-b9ea2be43b15 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:44.079702 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:44.096569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eaac76-f648-4394-ad71-9f9e13f77af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:44.097368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eaac76-f648-4394-ad71-9f9e13f77af2 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:44.097649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eaac76-f648-4394-ad71-9f9e13f77af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:44.097914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eaac76-f648-4394-ad71-9f9e13f77af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:44.098574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eaac76-f648-4394-ad71-9f9e13f77af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:44.101166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eaac76-f648-4394-ad71-9f9e13f77af2 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:44.116554 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3096/6147] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:43 2022] GET /identity/v3/roles => generated 1891 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:44.122866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eaac76-f648-4394-ad71-9f9e13f77af2 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:44.144718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eaac76-f648-4394-ad71-9f9e13f77af2 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:44.166286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741ea14-c414-479e-a718-e8287e336c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:44.166971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741ea14-c414-479e-a718-e8287e336c12 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:44.167246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741ea14-c414-479e-a718-e8287e336c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:44.167517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741ea14-c414-479e-a718-e8287e336c12 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:44.168179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741ea14-c414-479e-a718-e8287e336c12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:44.171244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741ea14-c414-479e-a718-e8287e336c12 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:44.187834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea8256-5a5e-4bd6-8f05-5c5127a27ff6 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:44.198239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6c320-02b0-4998-a5bf-9457d31eeb5d tempest-TrustsV3TestJSON-1309941675 tempest-user-1133094511] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4808c3fcba0e40e5b30eb02e3c3d486c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a02748498569467da150fa591282f951', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-425241803', 'tempest-DelegatedRole-892738754'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:44.200254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6c320-02b0-4998-a5bf-9457d31eeb5d tempest-TrustsV3TestJSON-1309941675 tempest-user-1133094511] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:44.201642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6c320-02b0-4998-a5bf-9457d31eeb5d tempest-TrustsV3TestJSON-1309941675 tempest-user-1133094511] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:44.202031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6c320-02b0-4998-a5bf-9457d31eeb5d tempest-TrustsV3TestJSON-1309941675 tempest-user-1133094511] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:44.204398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6c320-02b0-4998-a5bf-9457d31eeb5d tempest-TrustsV3TestJSON-1309941675 tempest-user-1133094511] RBAC: Authorizing `identity:create_trust()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:44.208231 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6c320-02b0-4998-a5bf-9457d31eeb5d tempest-TrustsV3TestJSON-1309941675 tempest-user-1133094511] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:44.209046 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3097/6148] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:40:44 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:44.210155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741ea14-c414-479e-a718-e8287e336c12 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:44.262454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741ea14-c414-479e-a718-e8287e336c12 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:44.275847 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431be3a-6c97-4594-9afe-5204a12fac2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:44.278121 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431be3a-6c97-4594-9afe-5204a12fac2a admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:44.278658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431be3a-6c97-4594-9afe-5204a12fac2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:44.291037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431be3a-6c97-4594-9afe-5204a12fac2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:44.293081 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431be3a-6c97-4594-9afe-5204a12fac2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:44.295517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431be3a-6c97-4594-9afe-5204a12fac2a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:44.327762 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3098/6149] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:44 2022] GET /identity/v3/roles => generated 1891 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:44.331397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431be3a-6c97-4594-9afe-5204a12fac2a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:44.360064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431be3a-6c97-4594-9afe-5204a12fac2a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:44.373347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc2a2e-720e-4a9c-ae09-644907befe4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:44.376986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc2a2e-720e-4a9c-ae09-644907befe4c admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:44.377270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc2a2e-720e-4a9c-ae09-644907befe4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:44.377573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc2a2e-720e-4a9c-ae09-644907befe4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:44.378200 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc2a2e-720e-4a9c-ae09-644907befe4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:44.378571 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-96b6c320-02b0-4998-a5bf-9457d31eeb5d tempest-TrustsV3TestJSON-1309941675 tempest-user-1133094511] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 07 01:40:44.378571 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:40:44.378571 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Aug 07 01:40:44.378571 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Aug 07 01:40:44.378571 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Aug 07 01:40:44.378571 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Aug 07 01:40:44.378571 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Aug 07 01:40:44.378571 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:40:44.378571 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:40:44.378571 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:40:44.378571 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:40:44.378571 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Aug 07 01:40:44.378571 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Aug 07 01:40:44.378571 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Aug 07 01:40:44.379491 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise ValueError(str(e)) Aug 07 01:40:44.379491 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Aug 07 01:40:44.379491 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:40:44.379491 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:40:44.379491 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:40:44.379491 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:40:44.379491 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:40:44.379491 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:40:44.379491 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:40:44.379491 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:40:44.379491 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:40:44.379491 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:40:44.379491 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:40:44.379491 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:40:44.379491 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:40:44.379491 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:40:44.379491 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Aug 07 01:40:44.379491 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Aug 07 01:40:44.380645 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Aug 07 01:40:44.380645 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Aug 07 01:40:44.380645 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Aug 07 01:40:44.380645 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Aug 07 01:40:44.380645 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Aug 07 01:40:44.380645 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:40:44.380645 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3052/6150] 10.222.0.39 () {60 vars in 1174 bytes} [Sun Aug 7 01:40:44 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 365 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 07 01:40:44.381065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6c320-02b0-4998-a5bf-9457d31eeb5d tempest-TrustsV3TestJSON-1309941675 tempest-user-1133094511] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:44.387303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc2a2e-720e-4a9c-ae09-644907befe4c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:44.404760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6c320-02b0-4998-a5bf-9457d31eeb5d tempest-TrustsV3TestJSON-1309941675 tempest-user-1133094511] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:44.413652 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3099/6151] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:44 2022] GET /identity/v3/roles => generated 1891 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:44.413652 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc2a2e-720e-4a9c-ae09-644907befe4c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:44.415667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5460331-5094-4168-b543-bfe683df5ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:44.416227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-78dc2a2e-720e-4a9c-ae09-644907befe4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:44.416374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5460331-5094-4168-b543-bfe683df5ed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:44.417332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5460331-5094-4168-b543-bfe683df5ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:44.417618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5460331-5094-4168-b543-bfe683df5ed2 admin admin] PATH_INFO: `/v3/projects/ad2dfa83ff5f4ba38598c99e36c32c9c/users/c58a4d5bf77c4ee5b17fb6954d33f022/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:44.453500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5460331-5094-4168-b543-bfe683df5ed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad2dfa83ff5f4ba38598c99e36c32c9c, user_id=c58a4d5bf77c4ee5b17fb6954d33f022, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:44.456409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5460331-5094-4168-b543-bfe683df5ed2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:44.484702 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3053/6152] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:44 2022] PUT /identity/v3/projects/ad2dfa83ff5f4ba38598c99e36c32c9c/users/c58a4d5bf77c4ee5b17fb6954d33f022/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:44.485212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5460331-5094-4168-b543-bfe683df5ed2 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:44.564037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc2a2e-720e-4a9c-ae09-644907befe4c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:44.643483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5460331-5094-4168-b543-bfe683df5ed2 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:44.665583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d597b3-e3d6-4df2-abbf-8ba20f2cb92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:44.665985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31216ead-8afe-4922-acf6-4c7f82bb6023 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:44.666168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d597b3-e3d6-4df2-abbf-8ba20f2cb92e admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:44.666464 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d597b3-e3d6-4df2-abbf-8ba20f2cb92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:44.666626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31216ead-8afe-4922-acf6-4c7f82bb6023 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:44.666889 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d597b3-e3d6-4df2-abbf-8ba20f2cb92e admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:44.667008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31216ead-8afe-4922-acf6-4c7f82bb6023 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:44.667450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31216ead-8afe-4922-acf6-4c7f82bb6023 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/roles/e9e1b440b184450a91e547898f59cc64` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:44.667560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d597b3-e3d6-4df2-abbf-8ba20f2cb92e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:44.669209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d597b3-e3d6-4df2-abbf-8ba20f2cb92e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:44.669810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31216ead-8afe-4922-acf6-4c7f82bb6023 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e9e1b440b184450a91e547898f59cc64)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:44.670930 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:44.675814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31216ead-8afe-4922-acf6-4c7f82bb6023 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:44.711948 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3054/6153] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:44 2022] GET /identity/v3/roles => generated 1891 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:44.711948 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f955ffc-6150-44bb-a8ea-db010b6d9674 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:44.711948 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f955ffc-6150-44bb-a8ea-db010b6d9674 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:44.711948 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f955ffc-6150-44bb-a8ea-db010b6d9674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:44.753826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-31216ead-8afe-4922-acf6-4c7f82bb6023 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invalidating the token cache because role e9e1b440b184450a91e547898f59cc64 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:40:44.754047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-31216ead-8afe-4922-acf6-4c7f82bb6023 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:44.754707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-31216ead-8afe-4922-acf6-4c7f82bb6023 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:44.756977 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3100/6154] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:40:44 2022] DELETE /identity/v3/roles/e9e1b440b184450a91e547898f59cc64 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:44.758340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31216ead-8afe-4922-acf6-4c7f82bb6023 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:44.765692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-31216ead-8afe-4922-acf6-4c7f82bb6023 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:44.811338 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:44.845059 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-8f955ffc-6150-44bb-a8ea-db010b6d9674 None None] MFA Rules not processed for user `c58a4d5bf77c4ee5b17fb6954d33f022`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:44.847098 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8f955ffc-6150-44bb-a8ea-db010b6d9674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:44.944280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31216ead-8afe-4922-acf6-4c7f82bb6023 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:44.966519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27b7bd-5330-46cb-82c6-4a8f0f34f023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:44.966519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27b7bd-5330-46cb-82c6-4a8f0f34f023 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:44.966519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27b7bd-5330-46cb-82c6-4a8f0f34f023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:44.966519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27b7bd-5330-46cb-82c6-4a8f0f34f023 admin admin] PATH_INFO: `/v3/projects/0787b61171194ec9a2c349f8c863154e/users/949505e7db1d4a60bfa185be8b2058e7/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:45.025873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27b7bd-5330-46cb-82c6-4a8f0f34f023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0787b61171194ec9a2c349f8c863154e, user_id=949505e7db1d4a60bfa185be8b2058e7, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:45.033340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27b7bd-5330-46cb-82c6-4a8f0f34f023 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:45.072359 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3055/6155] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:44 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:45.077119 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3101/6156] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:44 2022] PUT /identity/v3/projects/0787b61171194ec9a2c349f8c863154e/users/949505e7db1d4a60bfa185be8b2058e7/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:45.084653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27b7bd-5330-46cb-82c6-4a8f0f34f023 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:45.087974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f955ffc-6150-44bb-a8ea-db010b6d9674 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:45.088738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fa27b7bd-5330-46cb-82c6-4a8f0f34f023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:45.093608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8f955ffc-6150-44bb-a8ea-db010b6d9674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:45.273309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f955ffc-6150-44bb-a8ea-db010b6d9674 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:45.398204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27b7bd-5330-46cb-82c6-4a8f0f34f023 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:45.404710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5504860-d2a8-4865-9169-ecc1aa487f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:45.406586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5504860-d2a8-4865-9169-ecc1aa487f41 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:45.407129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5504860-d2a8-4865-9169-ecc1aa487f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:45.408556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5504860-d2a8-4865-9169-ecc1aa487f41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:45.409595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5504860-d2a8-4865-9169-ecc1aa487f41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:45.412357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5504860-d2a8-4865-9169-ecc1aa487f41 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:45.465348 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3102/6157] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:40:45 2022] POST /identity/v3/projects => generated 401 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:45.466904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbc088-fca5-4116-ba3e-4ea44f233a39 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:45.467195 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbc088-fca5-4116-ba3e-4ea44f233a39 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:45.467481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbc088-fca5-4116-ba3e-4ea44f233a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:45.479468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00213a-d33a-4eb0-896b-a0951f133c81 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:45.482605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00213a-d33a-4eb0-896b-a0951f133c81 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:45.483074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00213a-d33a-4eb0-896b-a0951f133c81 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:45.489492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00213a-d33a-4eb0-896b-a0951f133c81 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/roles/774d066982d74a15a56c2ffd68a17f4a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:45.500003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00213a-d33a-4eb0-896b-a0951f133c81 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:delete_role(role_id=774d066982d74a15a56c2ffd68a17f4a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:45.503525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00213a-d33a-4eb0-896b-a0951f133c81 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:45.508369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ebcbc088-fca5-4116-ba3e-4ea44f233a39 None None] MFA Rules not processed for user `949505e7db1d4a60bfa185be8b2058e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:45.510614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ebcbc088-fca5-4116-ba3e-4ea44f233a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:45.613132 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3103/6158] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:45.616771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbc088-fca5-4116-ba3e-4ea44f233a39 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:45.621584 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:45.638512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-eb00213a-d33a-4eb0-896b-a0951f133c81 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invalidating the token cache because role 774d066982d74a15a56c2ffd68a17f4a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:40:45.638875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-eb00213a-d33a-4eb0-896b-a0951f133c81 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:45.641733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-eb00213a-d33a-4eb0-896b-a0951f133c81 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:45.649341 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3056/6159] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:40:45 2022] DELETE /identity/v3/roles/774d066982d74a15a56c2ffd68a17f4a => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:45.650531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00213a-d33a-4eb0-896b-a0951f133c81 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:45.653688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-eb00213a-d33a-4eb0-896b-a0951f133c81 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:45.664053 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:45.725101 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbc088-fca5-4116-ba3e-4ea44f233a39 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:45.826581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00213a-d33a-4eb0-896b-a0951f133c81 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:45.835512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242df1aa-e2b4-4535-b4f6-794e105d34e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:45.836447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242df1aa-e2b4-4535-b4f6-794e105d34e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:45.836840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242df1aa-e2b4-4535-b4f6-794e105d34e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:45.837286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242df1aa-e2b4-4535-b4f6-794e105d34e4 admin admin] PATH_INFO: `/v3/users/a092573d9c37433eb6aaba005e9273af` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:45.838596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242df1aa-e2b4-4535-b4f6-794e105d34e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a092573d9c37433eb6aaba005e9273af)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:45.855048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9828c6-a178-4da8-902e-1e46b2ed8a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:45.855661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9828c6-a178-4da8-902e-1e46b2ed8a77 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:45.855969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9828c6-a178-4da8-902e-1e46b2ed8a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:45.856233 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9828c6-a178-4da8-902e-1e46b2ed8a77 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:45.856855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9828c6-a178-4da8-902e-1e46b2ed8a77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:45.858547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242df1aa-e2b4-4535-b4f6-794e105d34e4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:45.858773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9828c6-a178-4da8-902e-1e46b2ed8a77 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:45.902550 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3104/6160] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:40:45 2022] POST /identity/v3/users => generated 307 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:45.902550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9828c6-a178-4da8-902e-1e46b2ed8a77 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:45.909423 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2d9828c6-a178-4da8-902e-1e46b2ed8a77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:45.934265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9828c6-a178-4da8-902e-1e46b2ed8a77 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:45.942266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc419812-502b-4558-9bfe-f7c3fa0ce4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:45.942904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc419812-502b-4558-9bfe-f7c3fa0ce4ba admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:45.943184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc419812-502b-4558-9bfe-f7c3fa0ce4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:45.943450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc419812-502b-4558-9bfe-f7c3fa0ce4ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:45.944129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc419812-502b-4558-9bfe-f7c3fa0ce4ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:45.946030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc419812-502b-4558-9bfe-f7c3fa0ce4ba admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:45.977635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-242df1aa-e2b4-4535-b4f6-794e105d34e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a092573d9c37433eb6aaba005e9273af'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:45.990362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-242df1aa-e2b4-4535-b4f6-794e105d34e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a092573d9c37433eb6aaba005e9273af'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:46.029362 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3105/6161] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:40:45 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:46.029362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc419812-502b-4558-9bfe-f7c3fa0ce4ba admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:46.029362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-cc419812-502b-4558-9bfe-f7c3fa0ce4ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:46.032493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-242df1aa-e2b4-4535-b4f6-794e105d34e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a092573d9c37433eb6aaba005e9273af'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:46.035276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-242df1aa-e2b4-4535-b4f6-794e105d34e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a092573d9c37433eb6aaba005e9273af'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:46.049552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-242df1aa-e2b4-4535-b4f6-794e105d34e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a092573d9c37433eb6aaba005e9273af'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:46.059456 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3057/6162] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:40:45 2022] DELETE /identity/v3/users/a092573d9c37433eb6aaba005e9273af => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:46.064666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242df1aa-e2b4-4535-b4f6-794e105d34e4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:46.067397 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-242df1aa-e2b4-4535-b4f6-794e105d34e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:46.149444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc419812-502b-4558-9bfe-f7c3fa0ce4ba admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:46.223541 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:46.267559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242df1aa-e2b4-4535-b4f6-794e105d34e4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:46.272935 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeaa4b1-80cf-45d0-b47e-07b966824c21 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:46.273609 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeaa4b1-80cf-45d0-b47e-07b966824c21 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:46.274637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeaa4b1-80cf-45d0-b47e-07b966824c21 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:46.274916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeaa4b1-80cf-45d0-b47e-07b966824c21 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/users/4808c3fcba0e40e5b30eb02e3c3d486c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:46.277328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bee040-1a89-4c2d-9ce6-deed0afb47ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:46.278189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeaa4b1-80cf-45d0-b47e-07b966824c21 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4808c3fcba0e40e5b30eb02e3c3d486c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:46.278625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bee040-1a89-4c2d-9ce6-deed0afb47ef admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:46.279084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bee040-1a89-4c2d-9ce6-deed0afb47ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:46.279530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bee040-1a89-4c2d-9ce6-deed0afb47ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:46.280173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeaa4b1-80cf-45d0-b47e-07b966824c21 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:46.280912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bee040-1a89-4c2d-9ce6-deed0afb47ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:46.283372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bee040-1a89-4c2d-9ce6-deed0afb47ef admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:46.306637 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3058/6163] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:46.310186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bee040-1a89-4c2d-9ce6-deed0afb47ef admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:46.312354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f2bee040-1a89-4c2d-9ce6-deed0afb47ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:46.331056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bee040-1a89-4c2d-9ce6-deed0afb47ef admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:46.341174 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854edfeb-3492-42f4-810f-1d1b82a89ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:46.342159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854edfeb-3492-42f4-810f-1d1b82a89ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:46.342444 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854edfeb-3492-42f4-810f-1d1b82a89ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:46.342939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854edfeb-3492-42f4-810f-1d1b82a89ce5 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:46.344975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854edfeb-3492-42f4-810f-1d1b82a89ce5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:46.351267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854edfeb-3492-42f4-810f-1d1b82a89ce5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:46.370781 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:46.373523 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cdeaa4b1-80cf-45d0-b47e-07b966824c21 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4808c3fcba0e40e5b30eb02e3c3d486c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:46.391951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cdeaa4b1-80cf-45d0-b47e-07b966824c21 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4808c3fcba0e40e5b30eb02e3c3d486c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:46.397114 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3059/6164] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:40:46 2022] POST /identity/v3/users => generated 292 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:46.398500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9508a3d-dcd8-4ac8-a296-8e3a70694ad3 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:46.398786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9508a3d-dcd8-4ac8-a296-8e3a70694ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:46.399061 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9508a3d-dcd8-4ac8-a296-8e3a70694ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:46.414436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cdeaa4b1-80cf-45d0-b47e-07b966824c21 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4808c3fcba0e40e5b30eb02e3c3d486c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:46.416040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cdeaa4b1-80cf-45d0-b47e-07b966824c21 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4808c3fcba0e40e5b30eb02e3c3d486c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:46.428470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cdeaa4b1-80cf-45d0-b47e-07b966824c21 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4808c3fcba0e40e5b30eb02e3c3d486c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:46.446364 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3106/6165] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:40:46 2022] DELETE /identity/v3/users/4808c3fcba0e40e5b30eb02e3c3d486c => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:46.447464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeaa4b1-80cf-45d0-b47e-07b966824c21 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:46.450754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-cdeaa4b1-80cf-45d0-b47e-07b966824c21 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:46.467645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c9508a3d-dcd8-4ac8-a296-8e3a70694ad3 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:46.479814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c9508a3d-dcd8-4ac8-a296-8e3a70694ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:46.638882 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3060/6166] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:46.639755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9508a3d-dcd8-4ac8-a296-8e3a70694ad3 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:46.649130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c9508a3d-dcd8-4ac8-a296-8e3a70694ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:46.662113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9508a3d-dcd8-4ac8-a296-8e3a70694ad3 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:46.667329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266807fc-df9b-4fd3-8c64-c49600c76df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:46.667990 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266807fc-df9b-4fd3-8c64-c49600c76df2 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:46.668410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266807fc-df9b-4fd3-8c64-c49600c76df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:46.668687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266807fc-df9b-4fd3-8c64-c49600c76df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:46.669344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266807fc-df9b-4fd3-8c64-c49600c76df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:46.670117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeaa4b1-80cf-45d0-b47e-07b966824c21 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:46.671071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266807fc-df9b-4fd3-8c64-c49600c76df2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:46.686425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a19195-758e-4c1e-8a70-3d300a129909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:46.688147 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a19195-758e-4c1e-8a70-3d300a129909 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:46.689916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a19195-758e-4c1e-8a70-3d300a129909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:46.690640 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a19195-758e-4c1e-8a70-3d300a129909 admin admin] PATH_INFO: `/v3/projects/5c37f3ac264a423dbf66b4f65b8230bc/users/a971e051d8cc45249422aff0d6010b29/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:46.691964 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3061/6167] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:46 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:46.694114 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266807fc-df9b-4fd3-8c64-c49600c76df2 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:46.701730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-266807fc-df9b-4fd3-8c64-c49600c76df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:46.733255 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a19195-758e-4c1e-8a70-3d300a129909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c37f3ac264a423dbf66b4f65b8230bc, user_id=a971e051d8cc45249422aff0d6010b29, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:46.736742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a19195-758e-4c1e-8a70-3d300a129909 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:46.762906 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3107/6168] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:46 2022] PUT /identity/v3/projects/5c37f3ac264a423dbf66b4f65b8230bc/users/a971e051d8cc45249422aff0d6010b29/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:46.773022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a19195-758e-4c1e-8a70-3d300a129909 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:46.784080 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-09a19195-758e-4c1e-8a70-3d300a129909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:46.892035 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:46.909027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266807fc-df9b-4fd3-8c64-c49600c76df2 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:46.926061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a19195-758e-4c1e-8a70-3d300a129909 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:46.942265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54516c-9aea-4db5-a9b6-3d49be621f5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:46.943494 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54516c-9aea-4db5-a9b6-3d49be621f5e service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:46.943788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54516c-9aea-4db5-a9b6-3d49be621f5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:46.944084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54516c-9aea-4db5-a9b6-3d49be621f5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:47.089151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2df58-4301-4f80-8f7d-2c0b9811f15c tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:47.090696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2df58-4301-4f80-8f7d-2c0b9811f15c tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:47.092420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2df58-4301-4f80-8f7d-2c0b9811f15c tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:47.092420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2df58-4301-4f80-8f7d-2c0b9811f15c tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/projects/a02748498569467da150fa591282f951` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:47.093784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2df58-4301-4f80-8f7d-2c0b9811f15c tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a02748498569467da150fa591282f951)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:47.109948 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2df58-4301-4f80-8f7d-2c0b9811f15c tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:47.151867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54516c-9aea-4db5-a9b6-3d49be621f5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:47.153383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54516c-9aea-4db5-a9b6-3d49be621f5e service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:47.192182 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3108/6169] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:40:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:40:47.193703 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54516c-9aea-4db5-a9b6-3d49be621f5e service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:47.225378 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54516c-9aea-4db5-a9b6-3d49be621f5e service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:47.242791 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:47.248360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadadfbc-d71a-43af-8c25-b3334a627075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:47.249058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadadfbc-d71a-43af-8c25-b3334a627075 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:47.249431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadadfbc-d71a-43af-8c25-b3334a627075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:47.249655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadadfbc-d71a-43af-8c25-b3334a627075 admin admin] PATH_INFO: `/v3/projects/d338d19aa0b743458304d6fe8cefe92e/users/0f6cd4f06d8846e592a2854639e33d41/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:47.284593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c5e2df58-4301-4f80-8f7d-2c0b9811f15c tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a02748498569467da150fa591282f951', 'request_id': 'req-c5e2df58-4301-4f80-8f7d-2c0b9811f15c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:47.296936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c5e2df58-4301-4f80-8f7d-2c0b9811f15c tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a02748498569467da150fa591282f951', 'request_id': 'req-c5e2df58-4301-4f80-8f7d-2c0b9811f15c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:47.298754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadadfbc-d71a-43af-8c25-b3334a627075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d338d19aa0b743458304d6fe8cefe92e, user_id=0f6cd4f06d8846e592a2854639e33d41, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:47.303382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadadfbc-d71a-43af-8c25-b3334a627075 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:47.312083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c5e2df58-4301-4f80-8f7d-2c0b9811f15c tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a02748498569467da150fa591282f951', 'request_id': 'req-c5e2df58-4301-4f80-8f7d-2c0b9811f15c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:47.335306 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c5e2df58-4301-4f80-8f7d-2c0b9811f15c tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] The token cache is being invalidate because project a02748498569467da150fa591282f951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:40:47.335306 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c5e2df58-4301-4f80-8f7d-2c0b9811f15c tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:47.338894 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3109/6170] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:47 2022] PUT /identity/v3/projects/d338d19aa0b743458304d6fe8cefe92e/users/0f6cd4f06d8846e592a2854639e33d41/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:47.338894 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadadfbc-d71a-43af-8c25-b3334a627075 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:47.339278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c5e2df58-4301-4f80-8f7d-2c0b9811f15c tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:47.341029 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3062/6171] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:40:46 2022] DELETE /identity/v3/projects/a02748498569467da150fa591282f951 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:47.342145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2df58-4301-4f80-8f7d-2c0b9811f15c tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:47.351602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c5e2df58-4301-4f80-8f7d-2c0b9811f15c tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:47.506939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2df58-4301-4f80-8f7d-2c0b9811f15c tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:47.523608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68e51e-4f3c-4504-8ead-9aa894307382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:47.527036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68e51e-4f3c-4504-8ead-9aa894307382 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:47.527174 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68e51e-4f3c-4504-8ead-9aa894307382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:47.527538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68e51e-4f3c-4504-8ead-9aa894307382 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:47.528348 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68e51e-4f3c-4504-8ead-9aa894307382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:47.530090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadadfbc-d71a-43af-8c25-b3334a627075 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:47.531555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68e51e-4f3c-4504-8ead-9aa894307382 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:47.542463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae63a7-95db-419c-9fce-d9e0aa5ab5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:47.543458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae63a7-95db-419c-9fce-d9e0aa5ab5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:47.543737 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae63a7-95db-419c-9fce-d9e0aa5ab5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:47.544479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae63a7-95db-419c-9fce-d9e0aa5ab5d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:47.545817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae63a7-95db-419c-9fce-d9e0aa5ab5d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:47.549618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae63a7-95db-419c-9fce-d9e0aa5ab5d5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:47.573619 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3063/6172] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:47.576378 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68e51e-4f3c-4504-8ead-9aa894307382 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:47.581219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bd68e51e-4f3c-4504-8ead-9aa894307382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:47.583508 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3110/6173] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:47.585452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae63a7-95db-419c-9fce-d9e0aa5ab5d5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:47.598266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae63a7-95db-419c-9fce-d9e0aa5ab5d5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:47.604462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd07592-09a9-41b2-8937-53aebc88a90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:47.605891 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd07592-09a9-41b2-8937-53aebc88a90a admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:47.606557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd07592-09a9-41b2-8937-53aebc88a90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:47.607061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd07592-09a9-41b2-8937-53aebc88a90a admin admin] PATH_INFO: `/v3/projects/d338d19aa0b743458304d6fe8cefe92e/users/0f6cd4f06d8846e592a2854639e33d41/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:47.609657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd07592-09a9-41b2-8937-53aebc88a90a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d338d19aa0b743458304d6fe8cefe92e, user_id=0f6cd4f06d8846e592a2854639e33d41, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:47.613035 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd07592-09a9-41b2-8937-53aebc88a90a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:47.643111 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3111/6174] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:47 2022] PUT /identity/v3/projects/d338d19aa0b743458304d6fe8cefe92e/users/0f6cd4f06d8846e592a2854639e33d41/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:47.644218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd07592-09a9-41b2-8937-53aebc88a90a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:47.653862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fdd07592-09a9-41b2-8937-53aebc88a90a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:47.736473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68e51e-4f3c-4504-8ead-9aa894307382 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:47.854843 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd3c860-65db-46b4-9069-51a79d14b7dc tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:47.855472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3c860-65db-46b4-9069-51a79d14b7dc tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:47.855753 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3c860-65db-46b4-9069-51a79d14b7dc tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:47.856066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd3c860-65db-46b4-9069-51a79d14b7dc tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:47.856702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3c860-65db-46b4-9069-51a79d14b7dc tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:47.858780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd3c860-65db-46b4-9069-51a79d14b7dc tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:47.861407 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:47.878707 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:47.908579 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3064/6175] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Aug 7 01:40:47 2022] POST /identity/v3/projects => generated 329 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:47.908579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff8af1-ee94-4a68-b1bf-5feeacc6bec1 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:47.908579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff8af1-ee94-4a68-b1bf-5feeacc6bec1 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:47.908579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff8af1-ee94-4a68-b1bf-5feeacc6bec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:47.915487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd07592-09a9-41b2-8937-53aebc88a90a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:47.940827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-5fff8af1-ee94-4a68-b1bf-5feeacc6bec1 None None] MFA Rules not processed for user `0f6cd4f06d8846e592a2854639e33d41`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:47.942343 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5fff8af1-ee94-4a68-b1bf-5feeacc6bec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:48.037951 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3065/6176] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:48.038975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff8af1-ee94-4a68-b1bf-5feeacc6bec1 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:48.044011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5fff8af1-ee94-4a68-b1bf-5feeacc6bec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:48.051022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c17487-0407-408d-ba81-81b70fa208ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:48.051713 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c17487-0407-408d-ba81-81b70fa208ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:48.052062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c17487-0407-408d-ba81-81b70fa208ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:48.052335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c17487-0407-408d-ba81-81b70fa208ec admin admin] PATH_INFO: `/v3/projects/5c37f3ac264a423dbf66b4f65b8230bc/users/a971e051d8cc45249422aff0d6010b29/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:48.056921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c17487-0407-408d-ba81-81b70fa208ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c37f3ac264a423dbf66b4f65b8230bc, user_id=a971e051d8cc45249422aff0d6010b29, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:48.060143 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c17487-0407-408d-ba81-81b70fa208ec admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:48.062702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff8af1-ee94-4a68-b1bf-5feeacc6bec1 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:48.070473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd40a80-6eef-435a-83ef-a708b31e0f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:48.071201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd40a80-6eef-435a-83ef-a708b31e0f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:48.071943 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd40a80-6eef-435a-83ef-a708b31e0f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:48.072360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd40a80-6eef-435a-83ef-a708b31e0f7c admin admin] PATH_INFO: `/v3/projects/32fe87da03b04f57901aa42325eae5cd` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:48.073634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd40a80-6eef-435a-83ef-a708b31e0f7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=32fe87da03b04f57901aa42325eae5cd)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:48.075831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd40a80-6eef-435a-83ef-a708b31e0f7c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:48.090276 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3112/6177] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:47 2022] PUT /identity/v3/projects/5c37f3ac264a423dbf66b4f65b8230bc/users/a971e051d8cc45249422aff0d6010b29/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:48.091363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c17487-0407-408d-ba81-81b70fa208ec admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:48.175694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4bd40a80-6eef-435a-83ef-a708b31e0f7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32fe87da03b04f57901aa42325eae5cd', 'request_id': 'req-4bd40a80-6eef-435a-83ef-a708b31e0f7c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:48.183131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4bd40a80-6eef-435a-83ef-a708b31e0f7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32fe87da03b04f57901aa42325eae5cd', 'request_id': 'req-4bd40a80-6eef-435a-83ef-a708b31e0f7c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:48.199635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4bd40a80-6eef-435a-83ef-a708b31e0f7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32fe87da03b04f57901aa42325eae5cd', 'request_id': 'req-4bd40a80-6eef-435a-83ef-a708b31e0f7c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:48.218364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4bd40a80-6eef-435a-83ef-a708b31e0f7c admin admin] The token cache is being invalidate because project 32fe87da03b04f57901aa42325eae5cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:40:48.218836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4bd40a80-6eef-435a-83ef-a708b31e0f7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:48.219589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4bd40a80-6eef-435a-83ef-a708b31e0f7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:48.221774 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3066/6178] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:40:48 2022] DELETE /identity/v3/projects/32fe87da03b04f57901aa42325eae5cd => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:48.222676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd40a80-6eef-435a-83ef-a708b31e0f7c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:48.224700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4bd40a80-6eef-435a-83ef-a708b31e0f7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:48.241269 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c17487-0407-408d-ba81-81b70fa208ec admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:48.348658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd40a80-6eef-435a-83ef-a708b31e0f7c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:48.351126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02091328-2e7f-4c64-9241-3d97900e43d2 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:48.352070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02091328-2e7f-4c64-9241-3d97900e43d2 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:48.352746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02091328-2e7f-4c64-9241-3d97900e43d2 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:48.353217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02091328-2e7f-4c64-9241-3d97900e43d2 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:48.354627 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02091328-2e7f-4c64-9241-3d97900e43d2 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:48.356013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8eeee-b180-43ac-b0a6-9b7d47740403 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:48.356721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8eeee-b180-43ac-b0a6-9b7d47740403 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:48.356933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02091328-2e7f-4c64-9241-3d97900e43d2 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:48.357254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8eeee-b180-43ac-b0a6-9b7d47740403 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:48.357604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8eeee-b180-43ac-b0a6-9b7d47740403 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:48.362516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-53f8eeee-b180-43ac-b0a6-9b7d47740403 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:48.389683 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:48.394738 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3113/6179] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:40:48 2022] POST /identity/v3/users => generated 410 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:48.396409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3af2b-8ff5-4bd9-b644-b1c863c81bdb None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:48.396913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3af2b-8ff5-4bd9-b644-b1c863c81bdb None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:48.397297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb3af2b-8ff5-4bd9-b644-b1c863c81bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:48.441642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-fdb3af2b-8ff5-4bd9-b644-b1c863c81bdb None None] MFA Rules not processed for user `a971e051d8cc45249422aff0d6010b29`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:48.444279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fdb3af2b-8ff5-4bd9-b644-b1c863c81bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:48.475173 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:48.534917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8eeee-b180-43ac-b0a6-9b7d47740403 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:48.538170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8eeee-b180-43ac-b0a6-9b7d47740403 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:48.565031 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3067/6180] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:40:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:40:48.567557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8eeee-b180-43ac-b0a6-9b7d47740403 service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:48.570928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-53f8eeee-b180-43ac-b0a6-9b7d47740403 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:48.640109 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3114/6181] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:48 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:48.641052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3af2b-8ff5-4bd9-b644-b1c863c81bdb None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:48.648072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fdb3af2b-8ff5-4bd9-b644-b1c863c81bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:48.701345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb3af2b-8ff5-4bd9-b644-b1c863c81bdb None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:48.718262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f392f-f9d4-4ee2-9031-1fecb672033f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:48.721870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f392f-f9d4-4ee2-9031-1fecb672033f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:48.722363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f392f-f9d4-4ee2-9031-1fecb672033f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:48.723690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f392f-f9d4-4ee2-9031-1fecb672033f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:48.726097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f392f-f9d4-4ee2-9031-1fecb672033f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:48.729672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f392f-f9d4-4ee2-9031-1fecb672033f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:48.754276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8eeee-b180-43ac-b0a6-9b7d47740403 service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:48.760628 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933bc30-eecd-461c-8727-cde3a65c8b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:48.761676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933bc30-eecd-461c-8727-cde3a65c8b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:48.762164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933bc30-eecd-461c-8727-cde3a65c8b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:48.762641 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933bc30-eecd-461c-8727-cde3a65c8b2d admin admin] PATH_INFO: `/v3/users/7c9c7bf7210b4182a09eb3e8731a025e` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:48.762894 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3115/6182] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:40:48 2022] POST /identity/v3/roles => generated 243 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:48.765587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f392f-f9d4-4ee2-9031-1fecb672033f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:48.766177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933bc30-eecd-461c-8727-cde3a65c8b2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c9c7bf7210b4182a09eb3e8731a025e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:48.769032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933bc30-eecd-461c-8727-cde3a65c8b2d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:48.805957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f392f-f9d4-4ee2-9031-1fecb672033f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:48.815016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f167b12-7067-44f4-aba9-23965cd3b0a6 tempest-ApplicationCredentialsV3AdminTest-799067217 tempest-ApplicationCredentialsV3AdminTest-799067217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a971e051d8cc45249422aff0d6010b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c37f3ac264a423dbf66b4f65b8230bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:48.816181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f167b12-7067-44f4-aba9-23965cd3b0a6 tempest-ApplicationCredentialsV3AdminTest-799067217 tempest-ApplicationCredentialsV3AdminTest-799067217-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:48.816673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f167b12-7067-44f4-aba9-23965cd3b0a6 tempest-ApplicationCredentialsV3AdminTest-799067217 tempest-ApplicationCredentialsV3AdminTest-799067217-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:48.817157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f167b12-7067-44f4-aba9-23965cd3b0a6 tempest-ApplicationCredentialsV3AdminTest-799067217 tempest-ApplicationCredentialsV3AdminTest-799067217-project-admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:48.820826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f167b12-7067-44f4-aba9-23965cd3b0a6 tempest-ApplicationCredentialsV3AdminTest-799067217 tempest-ApplicationCredentialsV3AdminTest-799067217-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:48.824610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f167b12-7067-44f4-aba9-23965cd3b0a6 tempest-ApplicationCredentialsV3AdminTest-799067217 tempest-ApplicationCredentialsV3AdminTest-799067217-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:48.847819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1933bc30-eecd-461c-8727-cde3a65c8b2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c9c7bf7210b4182a09eb3e8731a025e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:48.859911 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3116/6183] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:40:48 2022] POST /identity/v3/roles => generated 240 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:48.861363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f167b12-7067-44f4-aba9-23965cd3b0a6 tempest-ApplicationCredentialsV3AdminTest-799067217 tempest-ApplicationCredentialsV3AdminTest-799067217-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:48.865854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1933bc30-eecd-461c-8727-cde3a65c8b2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c9c7bf7210b4182a09eb3e8731a025e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:48.880709 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f167b12-7067-44f4-aba9-23965cd3b0a6 tempest-ApplicationCredentialsV3AdminTest-799067217 tempest-ApplicationCredentialsV3AdminTest-799067217-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:48.899209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1933bc30-eecd-461c-8727-cde3a65c8b2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c9c7bf7210b4182a09eb3e8731a025e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:48.900398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fece3-6e97-4c74-811c-a7afa415a28f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:48.903340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1933bc30-eecd-461c-8727-cde3a65c8b2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c9c7bf7210b4182a09eb3e8731a025e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:48.905721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fece3-6e97-4c74-811c-a7afa415a28f service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:48.906008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fece3-6e97-4c74-811c-a7afa415a28f service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:48.906899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fece3-6e97-4c74-811c-a7afa415a28f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:48.912491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f84fece3-6e97-4c74-811c-a7afa415a28f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:48.920450 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1933bc30-eecd-461c-8727-cde3a65c8b2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c9c7bf7210b4182a09eb3e8731a025e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:48.930132 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3068/6184] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:40:48 2022] DELETE /identity/v3/users/7c9c7bf7210b4182a09eb3e8731a025e => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:48.931695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933bc30-eecd-461c-8727-cde3a65c8b2d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:48.933305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1933bc30-eecd-461c-8727-cde3a65c8b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:49.016388 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:49.042649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84fece3-6e97-4c74-811c-a7afa415a28f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:49.044392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84fece3-6e97-4c74-811c-a7afa415a28f service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:49.058649 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3117/6185] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:40:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:40:49.059588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fece3-6e97-4c74-811c-a7afa415a28f service cinder] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:49.074393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fece3-6e97-4c74-811c-a7afa415a28f service cinder] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:49.099521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933bc30-eecd-461c-8727-cde3a65c8b2d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:49.110790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f50804-abec-40bd-af96-fd14c2848b6c tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:49.111634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f50804-abec-40bd-af96-fd14c2848b6c tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:49.112037 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f50804-abec-40bd-af96-fd14c2848b6c tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:49.112415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f50804-abec-40bd-af96-fd14c2848b6c tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:49.113249 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f50804-abec-40bd-af96-fd14c2848b6c tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:49.115335 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f50804-abec-40bd-af96-fd14c2848b6c tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:49.141397 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3069/6186] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:40:48 2022] POST /identity/v3/roles => generated 246 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:49.146553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f50804-abec-40bd-af96-fd14c2848b6c tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:49.176210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f50804-abec-40bd-af96-fd14c2848b6c tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:49.187758 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125fe31-ce64-496d-856c-e31549872741 tempest-ApplicationCredentialsV3AdminTest-799067217 tempest-ApplicationCredentialsV3AdminTest-799067217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a971e051d8cc45249422aff0d6010b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c37f3ac264a423dbf66b4f65b8230bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:49.188570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125fe31-ce64-496d-856c-e31549872741 tempest-ApplicationCredentialsV3AdminTest-799067217 tempest-ApplicationCredentialsV3AdminTest-799067217-project-admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:49.188767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125fe31-ce64-496d-856c-e31549872741 tempest-ApplicationCredentialsV3AdminTest-799067217 tempest-ApplicationCredentialsV3AdminTest-799067217-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:49.189047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125fe31-ce64-496d-856c-e31549872741 tempest-ApplicationCredentialsV3AdminTest-799067217 tempest-ApplicationCredentialsV3AdminTest-799067217-project-admin] PATH_INFO: `/v3/projects/ad2dfa83ff5f4ba38598c99e36c32c9c/users/c58a4d5bf77c4ee5b17fb6954d33f022/roles/88738577c14842a9a4af2b9d8e2ebbf2` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:49.195660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81fe3b-bb61-44f4-9d4e-babeabd68d87 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:49.196475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125fe31-ce64-496d-856c-e31549872741 tempest-ApplicationCredentialsV3AdminTest-799067217 tempest-ApplicationCredentialsV3AdminTest-799067217-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ad2dfa83ff5f4ba38598c99e36c32c9c, user_id=c58a4d5bf77c4ee5b17fb6954d33f022, role_id=88738577c14842a9a4af2b9d8e2ebbf2)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:49.196721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81fe3b-bb61-44f4-9d4e-babeabd68d87 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:49.197149 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81fe3b-bb61-44f4-9d4e-babeabd68d87 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:49.197456 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81fe3b-bb61-44f4-9d4e-babeabd68d87 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/projects/20374f42729d4bac8015045880463014/users/1cd23690b73f4df58f970d677bfa6d39/roles/52d6c4daf6534423b6d13d395699c117` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:49.200493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125fe31-ce64-496d-856c-e31549872741 tempest-ApplicationCredentialsV3AdminTest-799067217 tempest-ApplicationCredentialsV3AdminTest-799067217-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:49.232511 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3118/6187] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:49 2022] PUT /identity/v3/projects/ad2dfa83ff5f4ba38598c99e36c32c9c/users/c58a4d5bf77c4ee5b17fb6954d33f022/roles/88738577c14842a9a4af2b9d8e2ebbf2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:49.236987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125fe31-ce64-496d-856c-e31549872741 tempest-ApplicationCredentialsV3AdminTest-799067217 tempest-ApplicationCredentialsV3AdminTest-799067217-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:49.238746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7125fe31-ce64-496d-856c-e31549872741 tempest-ApplicationCredentialsV3AdminTest-799067217 tempest-ApplicationCredentialsV3AdminTest-799067217-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:49.241199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81fe3b-bb61-44f4-9d4e-babeabd68d87 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_grant(project_id=20374f42729d4bac8015045880463014, user_id=1cd23690b73f4df58f970d677bfa6d39, role_id=52d6c4daf6534423b6d13d395699c117)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:49.243807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81fe3b-bb61-44f4-9d4e-babeabd68d87 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:49.274049 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3070/6188] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:49 2022] PUT /identity/v3/projects/20374f42729d4bac8015045880463014/users/1cd23690b73f4df58f970d677bfa6d39/roles/52d6c4daf6534423b6d13d395699c117 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:49.275085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81fe3b-bb61-44f4-9d4e-babeabd68d87 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:49.305964 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:49.453534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81fe3b-bb61-44f4-9d4e-babeabd68d87 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:49.457645 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125fe31-ce64-496d-856c-e31549872741 tempest-ApplicationCredentialsV3AdminTest-799067217 tempest-ApplicationCredentialsV3AdminTest-799067217-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:49.468767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c91539-ab71-4e78-a041-7a12ab591b99 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:49.473393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c91539-ab71-4e78-a041-7a12ab591b99 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:49.473982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c91539-ab71-4e78-a041-7a12ab591b99 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:49.474529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c91539-ab71-4e78-a041-7a12ab591b99 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/projects/20374f42729d4bac8015045880463014/users/1cd23690b73f4df58f970d677bfa6d39/roles/699f0b2c917b44d6b460517bb6e6237b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:49.481612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c91539-ab71-4e78-a041-7a12ab591b99 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_grant(project_id=20374f42729d4bac8015045880463014, user_id=1cd23690b73f4df58f970d677bfa6d39, role_id=699f0b2c917b44d6b460517bb6e6237b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:49.490124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c91539-ab71-4e78-a041-7a12ab591b99 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:49.527964 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3071/6189] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:49 2022] PUT /identity/v3/projects/20374f42729d4bac8015045880463014/users/1cd23690b73f4df58f970d677bfa6d39/roles/699f0b2c917b44d6b460517bb6e6237b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:49.532272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c91539-ab71-4e78-a041-7a12ab591b99 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:49.617061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9be2db-a319-42c5-8bc7-97b8056b7fc6 tempest-ApplicationCredentialsV3AdminTest-581116951 tempest-ApplicationCredentialsV3AdminTest-581116951-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c58a4d5bf77c4ee5b17fb6954d33f022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfa83ff5f4ba38598c99e36c32c9c', 'project_domain_id': 'default', 'roles': ['tempest-test_role-1115058202', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:49.617752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9be2db-a319-42c5-8bc7-97b8056b7fc6 tempest-ApplicationCredentialsV3AdminTest-581116951 tempest-ApplicationCredentialsV3AdminTest-581116951-project] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:49.618033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9be2db-a319-42c5-8bc7-97b8056b7fc6 tempest-ApplicationCredentialsV3AdminTest-581116951 tempest-ApplicationCredentialsV3AdminTest-581116951-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:49.618308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9be2db-a319-42c5-8bc7-97b8056b7fc6 tempest-ApplicationCredentialsV3AdminTest-581116951 tempest-ApplicationCredentialsV3AdminTest-581116951-project] PATH_INFO: `/v3/users/c58a4d5bf77c4ee5b17fb6954d33f022/application_credentials` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:49.619114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9be2db-a319-42c5-8bc7-97b8056b7fc6 tempest-ApplicationCredentialsV3AdminTest-581116951 tempest-ApplicationCredentialsV3AdminTest-581116951-project] RBAC: Authorizing `identity:create_application_credential(user_id=c58a4d5bf77c4ee5b17fb6954d33f022)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:49.620323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9be2db-a319-42c5-8bc7-97b8056b7fc6 tempest-ApplicationCredentialsV3AdminTest-581116951 tempest-ApplicationCredentialsV3AdminTest-581116951-project] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:49.682602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c91539-ab71-4e78-a041-7a12ab591b99 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:49.697801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a8a6f-5fe2-4a0d-b580-3536b18f64fe tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:49.698727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a8a6f-5fe2-4a0d-b580-3536b18f64fe tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:49.706512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a8a6f-5fe2-4a0d-b580-3536b18f64fe tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:49.708299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a8a6f-5fe2-4a0d-b580-3536b18f64fe tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:49.709447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a8a6f-5fe2-4a0d-b580-3536b18f64fe tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:49.716518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a8a6f-5fe2-4a0d-b580-3536b18f64fe tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:49.769781 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3119/6190] 10.222.0.39 () {60 vars in 1315 bytes} [Sun Aug 7 01:40:49 2022] POST /identity/v3/users/c58a4d5bf77c4ee5b17fb6954d33f022/application_credentials => generated 659 bytes in 533 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:40:49.775467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9be2db-a319-42c5-8bc7-97b8056b7fc6 tempest-ApplicationCredentialsV3AdminTest-581116951 tempest-ApplicationCredentialsV3AdminTest-581116951-project] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:49.775467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6b9be2db-a319-42c5-8bc7-97b8056b7fc6 tempest-ApplicationCredentialsV3AdminTest-581116951 tempest-ApplicationCredentialsV3AdminTest-581116951-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:49.813317 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3072/6191] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:49 2022] GET /identity/v3/users => generated 8637 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:49.820236 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b0bb2-f36a-4806-8752-30e5133140e0 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:49.821430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b0bb2-f36a-4806-8752-30e5133140e0 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:49.822230 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b0bb2-f36a-4806-8752-30e5133140e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:49.910967 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ac0b0bb2-f36a-4806-8752-30e5133140e0 None None] MFA Rules not processed for user `c58a4d5bf77c4ee5b17fb6954d33f022`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:49.912745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ac0b0bb2-f36a-4806-8752-30e5133140e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:49.932996 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:49.936692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9be2db-a319-42c5-8bc7-97b8056b7fc6 tempest-ApplicationCredentialsV3AdminTest-581116951 tempest-ApplicationCredentialsV3AdminTest-581116951-project] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:49.957748 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:50.072723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0febfcb-824f-44dd-a67a-1b55a2f45faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:50.073398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0febfcb-824f-44dd-a67a-1b55a2f45faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:50.073680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0febfcb-824f-44dd-a67a-1b55a2f45faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:50.073951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0febfcb-824f-44dd-a67a-1b55a2f45faa admin admin] PATH_INFO: `/v3/projects/7514fd037c2742cb8196c14e2c2a29b3` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:50.076120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0febfcb-824f-44dd-a67a-1b55a2f45faa admin admin] RBAC: Authorizing `identity:delete_project(project_id=7514fd037c2742cb8196c14e2c2a29b3)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:50.079101 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0febfcb-824f-44dd-a67a-1b55a2f45faa admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:50.142140 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3073/6192] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:49 2022] POST /identity/v3/auth/tokens => generated 3394 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 07 01:40:50.145013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b4421-e8e6-4824-8937-a22a6f11167f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:50.145380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b4421-e8e6-4824-8937-a22a6f11167f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:50.145814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b4421-e8e6-4824-8937-a22a6f11167f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:50.181061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c0febfcb-824f-44dd-a67a-1b55a2f45faa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7514fd037c2742cb8196c14e2c2a29b3', 'request_id': 'req-c0febfcb-824f-44dd-a67a-1b55a2f45faa'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:50.189590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c0febfcb-824f-44dd-a67a-1b55a2f45faa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7514fd037c2742cb8196c14e2c2a29b3', 'request_id': 'req-c0febfcb-824f-44dd-a67a-1b55a2f45faa'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:50.203523 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c0febfcb-824f-44dd-a67a-1b55a2f45faa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7514fd037c2742cb8196c14e2c2a29b3', 'request_id': 'req-c0febfcb-824f-44dd-a67a-1b55a2f45faa'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:50.229637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6d6b4421-e8e6-4824-8937-a22a6f11167f None None] MFA Rules not processed for user `1cd23690b73f4df58f970d677bfa6d39`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:50.238235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6d6b4421-e8e6-4824-8937-a22a6f11167f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:50.240014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c0febfcb-824f-44dd-a67a-1b55a2f45faa admin admin] The token cache is being invalidate because project 7514fd037c2742cb8196c14e2c2a29b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:40:50.240720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c0febfcb-824f-44dd-a67a-1b55a2f45faa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:50.241707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c0febfcb-824f-44dd-a67a-1b55a2f45faa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:50.243835 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3120/6193] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:40:49 2022] DELETE /identity/v3/projects/7514fd037c2742cb8196c14e2c2a29b3 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:50.245007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0febfcb-824f-44dd-a67a-1b55a2f45faa admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:50.246662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c0febfcb-824f-44dd-a67a-1b55a2f45faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:50.376016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0febfcb-824f-44dd-a67a-1b55a2f45faa admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:50.382779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d727a-b3e2-4fd6-9295-1c5c255b941e tempest-ApplicationCredentialsV3AdminTest-581116951 tempest-ApplicationCredentialsV3AdminTest-581116951-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c58a4d5bf77c4ee5b17fb6954d33f022', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad2dfa83ff5f4ba38598c99e36c32c9c', 'project_domain_id': 'default', 'roles': ['tempest-test_role-1115058202', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:50.384487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d727a-b3e2-4fd6-9295-1c5c255b941e tempest-ApplicationCredentialsV3AdminTest-581116951 tempest-ApplicationCredentialsV3AdminTest-581116951-project] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:50.384926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d727a-b3e2-4fd6-9295-1c5c255b941e tempest-ApplicationCredentialsV3AdminTest-581116951 tempest-ApplicationCredentialsV3AdminTest-581116951-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:50.385602 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d727a-b3e2-4fd6-9295-1c5c255b941e tempest-ApplicationCredentialsV3AdminTest-581116951 tempest-ApplicationCredentialsV3AdminTest-581116951-project] PATH_INFO: `/v3/users/c58a4d5bf77c4ee5b17fb6954d33f022/application_credentials/9e725530ee164f078fe6a58e907f83a9` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:50.387085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d727a-b3e2-4fd6-9295-1c5c255b941e tempest-ApplicationCredentialsV3AdminTest-581116951 tempest-ApplicationCredentialsV3AdminTest-581116951-project] RBAC: Authorizing `identity:delete_application_credential(user_id=c58a4d5bf77c4ee5b17fb6954d33f022, application_credential_id=9e725530ee164f078fe6a58e907f83a9)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:50.388782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d727a-b3e2-4fd6-9295-1c5c255b941e tempest-ApplicationCredentialsV3AdminTest-581116951 tempest-ApplicationCredentialsV3AdminTest-581116951-project] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:50.426936 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3074/6194] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:50 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:50.437833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e27b52-e219-4d1f-bf30-74cbf5a5ad50 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:50.438876 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e27b52-e219-4d1f-bf30-74cbf5a5ad50 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:50.439656 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e27b52-e219-4d1f-bf30-74cbf5a5ad50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:50.440378 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3121/6195] 10.222.0.39 () {58 vars in 1395 bytes} [Sun Aug 7 01:40:50 2022] DELETE /identity/v3/users/c58a4d5bf77c4ee5b17fb6954d33f022/application_credentials/9e725530ee164f078fe6a58e907f83a9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:50.444012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ec8ce-a563-4a59-a884-026f03c0dbd1 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:50.444259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ec8ce-a563-4a59-a884-026f03c0dbd1 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:50.444531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ec8ce-a563-4a59-a884-026f03c0dbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:50.514848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-46e27b52-e219-4d1f-bf30-74cbf5a5ad50 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:50.516895 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-46e27b52-e219-4d1f-bf30-74cbf5a5ad50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:50.528801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6e4ec8ce-a563-4a59-a884-026f03c0dbd1 None None] MFA Rules not processed for user `1cd23690b73f4df58f970d677bfa6d39`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:50.530649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6e4ec8ce-a563-4a59-a884-026f03c0dbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:50.579219 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3122/6196] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:50 2022] POST /identity/v3/auth/tokens => generated 3277 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:50.581908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ec8ce-a563-4a59-a884-026f03c0dbd1 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:50.589418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6e4ec8ce-a563-4a59-a884-026f03c0dbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:50.675167 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:50.678887 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:50.757698 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3075/6197] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:50.758737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e27b52-e219-4d1f-bf30-74cbf5a5ad50 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:50.793072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e27b52-e219-4d1f-bf30-74cbf5a5ad50 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:50.808164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ec8ce-a563-4a59-a884-026f03c0dbd1 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:50.815707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182dc4d6-4273-41ba-9d40-cb14fb6f4f2f tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cd23690b73f4df58f970d677bfa6d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20374f42729d4bac8015045880463014', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-982216749', 'tempest-NotDelegatedRole-491653239'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:50.816349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182dc4d6-4273-41ba-9d40-cb14fb6f4f2f tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:50.816770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182dc4d6-4273-41ba-9d40-cb14fb6f4f2f tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:50.817149 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182dc4d6-4273-41ba-9d40-cb14fb6f4f2f tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:50.818520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182dc4d6-4273-41ba-9d40-cb14fb6f4f2f tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] RBAC: Authorizing `identity:create_trust()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:50.819821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182dc4d6-4273-41ba-9d40-cb14fb6f4f2f tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:50.832476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05cb58-c8cb-4265-8a5d-f560ae505db1 tempest-ApplicationCredentialsV3AdminTest-799067217 tempest-ApplicationCredentialsV3AdminTest-799067217-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a971e051d8cc45249422aff0d6010b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c37f3ac264a423dbf66b4f65b8230bc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:50.833883 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05cb58-c8cb-4265-8a5d-f560ae505db1 tempest-ApplicationCredentialsV3AdminTest-799067217 tempest-ApplicationCredentialsV3AdminTest-799067217-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:50.834167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05cb58-c8cb-4265-8a5d-f560ae505db1 tempest-ApplicationCredentialsV3AdminTest-799067217 tempest-ApplicationCredentialsV3AdminTest-799067217-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:50.834444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05cb58-c8cb-4265-8a5d-f560ae505db1 tempest-ApplicationCredentialsV3AdminTest-799067217 tempest-ApplicationCredentialsV3AdminTest-799067217-project-admin] PATH_INFO: `/v3/roles/88738577c14842a9a4af2b9d8e2ebbf2` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:50.840882 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f05cb58-c8cb-4265-8a5d-f560ae505db1 tempest-ApplicationCredentialsV3AdminTest-799067217 tempest-ApplicationCredentialsV3AdminTest-799067217-project-admin] RBAC: Authorizing `identity:delete_role(role_id=88738577c14842a9a4af2b9d8e2ebbf2)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:50.848393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f05cb58-c8cb-4265-8a5d-f560ae505db1 tempest-ApplicationCredentialsV3AdminTest-799067217 tempest-ApplicationCredentialsV3AdminTest-799067217-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:50.955908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9f05cb58-c8cb-4265-8a5d-f560ae505db1 tempest-ApplicationCredentialsV3AdminTest-799067217 tempest-ApplicationCredentialsV3AdminTest-799067217-project-admin] Invalidating the token cache because role 88738577c14842a9a4af2b9d8e2ebbf2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:40:50.956430 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9f05cb58-c8cb-4265-8a5d-f560ae505db1 tempest-ApplicationCredentialsV3AdminTest-799067217 tempest-ApplicationCredentialsV3AdminTest-799067217-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:50.957972 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9f05cb58-c8cb-4265-8a5d-f560ae505db1 tempest-ApplicationCredentialsV3AdminTest-799067217 tempest-ApplicationCredentialsV3AdminTest-799067217-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:50.961190 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3123/6198] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:40:50 2022] DELETE /identity/v3/roles/88738577c14842a9a4af2b9d8e2ebbf2 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:50.974671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafacaa3-555d-47e1-9eef-8da6b1772bfe None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:50.991266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafacaa3-555d-47e1-9eef-8da6b1772bfe None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:50.991266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafacaa3-555d-47e1-9eef-8da6b1772bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:51.007546 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3076/6199] 10.222.0.39 () {60 vars in 1174 bytes} [Sun Aug 7 01:40:50 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:51.011491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182dc4d6-4273-41ba-9d40-cb14fb6f4f2f tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:51.017706 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-182dc4d6-4273-41ba-9d40-cb14fb6f4f2f tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:51.068767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-eafacaa3-555d-47e1-9eef-8da6b1772bfe None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:51.071407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-eafacaa3-555d-47e1-9eef-8da6b1772bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:51.083529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182dc4d6-4273-41ba-9d40-cb14fb6f4f2f tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:51.274213 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1581bb-df40-4557-92f1-b5419515623c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:51.275146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1581bb-df40-4557-92f1-b5419515623c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:51.275640 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1581bb-df40-4557-92f1-b5419515623c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:51.276200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1581bb-df40-4557-92f1-b5419515623c admin admin] PATH_INFO: `/v3/users/c58a4d5bf77c4ee5b17fb6954d33f022` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:51.281338 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1581bb-df40-4557-92f1-b5419515623c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c58a4d5bf77c4ee5b17fb6954d33f022)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:51.283736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1581bb-df40-4557-92f1-b5419515623c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:51.387373 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3124/6200] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:51.390945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafacaa3-555d-47e1-9eef-8da6b1772bfe None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:51.397029 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-eafacaa3-555d-47e1-9eef-8da6b1772bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:51.426631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6f1581bb-df40-4557-92f1-b5419515623c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c58a4d5bf77c4ee5b17fb6954d33f022'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:51.439212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6f1581bb-df40-4557-92f1-b5419515623c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c58a4d5bf77c4ee5b17fb6954d33f022'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:51.494916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6f1581bb-df40-4557-92f1-b5419515623c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c58a4d5bf77c4ee5b17fb6954d33f022'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:51.497124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6f1581bb-df40-4557-92f1-b5419515623c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c58a4d5bf77c4ee5b17fb6954d33f022'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:51.520442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6f1581bb-df40-4557-92f1-b5419515623c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c58a4d5bf77c4ee5b17fb6954d33f022'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:51.524074 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:51.541025 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3077/6201] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:40:51 2022] DELETE /identity/v3/users/c58a4d5bf77c4ee5b17fb6954d33f022 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:51.549331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1581bb-df40-4557-92f1-b5419515623c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:51.554534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6f1581bb-df40-4557-92f1-b5419515623c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:51.572713 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafacaa3-555d-47e1-9eef-8da6b1772bfe None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:51.639169 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:51.703137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856df727-20db-46ae-97e7-57961a1edbac tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cd23690b73f4df58f970d677bfa6d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20374f42729d4bac8015045880463014', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-982216749', 'tempest-NotDelegatedRole-491653239'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:51.703975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856df727-20db-46ae-97e7-57961a1edbac tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:51.704360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856df727-20db-46ae-97e7-57961a1edbac tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:51.704759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856df727-20db-46ae-97e7-57961a1edbac tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] PATH_INFO: `/v3/OS-TRUST/trusts/1cc5f4729e474dbbb25c2265ea6d3dbe` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:51.710100 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1581bb-df40-4557-92f1-b5419515623c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:51.713877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856df727-20db-46ae-97e7-57961a1edbac tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] RBAC: Authorizing `identity:get_trust(trust_id=1cc5f4729e474dbbb25c2265ea6d3dbe)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:51.715549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856df727-20db-46ae-97e7-57961a1edbac tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:51.725041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b38ffc-c121-4ab0-b4d9-317ffacc2ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:51.725676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b38ffc-c121-4ab0-b4d9-317ffacc2ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:51.725951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b38ffc-c121-4ab0-b4d9-317ffacc2ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:51.726217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b38ffc-c121-4ab0-b4d9-317ffacc2ee3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:51.726882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b38ffc-c121-4ab0-b4d9-317ffacc2ee3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:40:51.727938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b38ffc-c121-4ab0-b4d9-317ffacc2ee3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:51.730225 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b38ffc-c121-4ab0-b4d9-317ffacc2ee3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:51.734629 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3125/6202] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Aug 7 01:40:51 2022] GET /identity/v3/OS-TRUST/trusts/1cc5f4729e474dbbb25c2265ea6d3dbe => generated 833 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:40:51.742995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c870e-5818-418b-9c35-ceb3b38d4aab None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:51.744123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c870e-5818-418b-9c35-ceb3b38d4aab None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:51.744521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c870e-5818-418b-9c35-ceb3b38d4aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:51.774664 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3078/6203] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:40:51.775923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b38ffc-c121-4ab0-b4d9-317ffacc2ee3 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:51.778577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d0b38ffc-c121-4ab0-b4d9-317ffacc2ee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:51.810010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b38ffc-c121-4ab0-b4d9-317ffacc2ee3 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:51.823105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e198c0b-f151-4c97-8c34-0bddbd8f64dd tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cd23690b73f4df58f970d677bfa6d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20374f42729d4bac8015045880463014', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-982216749', 'tempest-NotDelegatedRole-491653239'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:51.824224 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e198c0b-f151-4c97-8c34-0bddbd8f64dd tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:51.824685 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e198c0b-f151-4c97-8c34-0bddbd8f64dd tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:51.824910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-952c870e-5818-418b-9c35-ceb3b38d4aab None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:51.825614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e198c0b-f151-4c97-8c34-0bddbd8f64dd tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] PATH_INFO: `/v3/OS-TRUST/trusts/1cc5f4729e474dbbb25c2265ea6d3dbe/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:51.826497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-952c870e-5818-418b-9c35-ceb3b38d4aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:51.840151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e198c0b-f151-4c97-8c34-0bddbd8f64dd tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=1cc5f4729e474dbbb25c2265ea6d3dbe)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:51.841668 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3126/6204] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:51.842666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c870e-5818-418b-9c35-ceb3b38d4aab None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:51.845009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e198c0b-f151-4c97-8c34-0bddbd8f64dd tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:51.866476 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3079/6205] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Aug 7 01:40:51 2022] GET /identity/v3/OS-TRUST/trusts/1cc5f4729e474dbbb25c2265ea6d3dbe/roles => generated 370 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:40:51.867520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c870e-5818-418b-9c35-ceb3b38d4aab None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:51.869095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e198c0b-f151-4c97-8c34-0bddbd8f64dd tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:51.871333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5e198c0b-f151-4c97-8c34-0bddbd8f64dd tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:51.881385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e595d17-3009-4210-aef5-fd6e83e6d8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:51.882174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e595d17-3009-4210-aef5-fd6e83e6d8ec admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:51.882561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e595d17-3009-4210-aef5-fd6e83e6d8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:51.882937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e595d17-3009-4210-aef5-fd6e83e6d8ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:51.883671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e595d17-3009-4210-aef5-fd6e83e6d8ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:51.885979 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e595d17-3009-4210-aef5-fd6e83e6d8ec admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:51.941523 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3127/6206] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:40:51 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:51.946348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e595d17-3009-4210-aef5-fd6e83e6d8ec admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:52.035820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e198c0b-f151-4c97-8c34-0bddbd8f64dd tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:52.208895 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcaf5b-9106-474a-8094-ac66ab166e7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:52.209778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcaf5b-9106-474a-8094-ac66ab166e7e service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:52.210325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcaf5b-9106-474a-8094-ac66ab166e7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:52.210750 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcaf5b-9106-474a-8094-ac66ab166e7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:52.212066 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e595d17-3009-4210-aef5-fd6e83e6d8ec admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:52.227650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d3179-0b28-48fd-8e8d-2242e37b2635 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cd23690b73f4df58f970d677bfa6d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20374f42729d4bac8015045880463014', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-982216749', 'tempest-NotDelegatedRole-491653239'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:52.228714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d3179-0b28-48fd-8e8d-2242e37b2635 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:52.230047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d3179-0b28-48fd-8e8d-2242e37b2635 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:52.230551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d3179-0b28-48fd-8e8d-2242e37b2635 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] PATH_INFO: `/v3/OS-TRUST/trusts/1cc5f4729e474dbbb25c2265ea6d3dbe/roles/52d6c4daf6534423b6d13d395699c117` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:52.240983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d3179-0b28-48fd-8e8d-2242e37b2635 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] RBAC: Authorizing `identity:get_role_for_trust(trust_id=1cc5f4729e474dbbb25c2265ea6d3dbe, role_id=52d6c4daf6534423b6d13d395699c117)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:52.242503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d3179-0b28-48fd-8e8d-2242e37b2635 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:52.265431 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3128/6207] 10.222.0.39 () {58 vars in 1368 bytes} [Sun Aug 7 01:40:51 2022] GET /identity/v3/OS-TRUST/trusts/1cc5f4729e474dbbb25c2265ea6d3dbe/roles/52d6c4daf6534423b6d13d395699c117 => generated 243 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:40:52.266374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d3179-0b28-48fd-8e8d-2242e37b2635 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:52.313514 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:52.362076 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fcaf5b-9106-474a-8094-ac66ab166e7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:52.363538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fcaf5b-9106-474a-8094-ac66ab166e7e service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:52.393506 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3080/6208] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:40:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:40:52.404029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcaf5b-9106-474a-8094-ac66ab166e7e service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:52.443505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcaf5b-9106-474a-8094-ac66ab166e7e service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:52.450148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d3179-0b28-48fd-8e8d-2242e37b2635 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:52.457768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e9bff-8202-4775-a78a-34cd970daaf8 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cd23690b73f4df58f970d677bfa6d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20374f42729d4bac8015045880463014', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-982216749', 'tempest-NotDelegatedRole-491653239'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:52.460715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e9bff-8202-4775-a78a-34cd970daaf8 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] REQUEST_METHOD: `HEAD` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:52.460930 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e9bff-8202-4775-a78a-34cd970daaf8 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:52.462636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e9bff-8202-4775-a78a-34cd970daaf8 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] PATH_INFO: `/v3/OS-TRUST/trusts/1cc5f4729e474dbbb25c2265ea6d3dbe/roles/52d6c4daf6534423b6d13d395699c117` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:52.466481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a49103-0bb1-4307-83e5-c7aa8b853a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:52.468442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a49103-0bb1-4307-83e5-c7aa8b853a4c admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:52.468600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a49103-0bb1-4307-83e5-c7aa8b853a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:52.468872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a49103-0bb1-4307-83e5-c7aa8b853a4c admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:52.470948 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a49103-0bb1-4307-83e5-c7aa8b853a4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:52.482317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e9bff-8202-4775-a78a-34cd970daaf8 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] RBAC: Authorizing `identity:get_role_for_trust(trust_id=1cc5f4729e474dbbb25c2265ea6d3dbe, role_id=52d6c4daf6534423b6d13d395699c117)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:52.482685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a49103-0bb1-4307-83e5-c7aa8b853a4c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:52.484420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e9bff-8202-4775-a78a-34cd970daaf8 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:52.511978 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3081/6209] 10.222.0.39 () {58 vars in 1369 bytes} [Sun Aug 7 01:40:52 2022] HEAD /identity/v3/OS-TRUST/trusts/1cc5f4729e474dbbb25c2265ea6d3dbe/roles/52d6c4daf6534423b6d13d395699c117 => generated 0 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 07 01:40:52.516632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e9bff-8202-4775-a78a-34cd970daaf8 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:52.537040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e9bff-8202-4775-a78a-34cd970daaf8 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:52.542393 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3129/6210] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:40:52 2022] POST /identity/v3/users => generated 292 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:52.548556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4635ac3-629b-4b8c-996e-5b7702a07c92 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cd23690b73f4df58f970d677bfa6d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20374f42729d4bac8015045880463014', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-982216749', 'tempest-NotDelegatedRole-491653239'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:52.549418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4635ac3-629b-4b8c-996e-5b7702a07c92 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:52.549843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a49103-0bb1-4307-83e5-c7aa8b853a4c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:52.551303 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4635ac3-629b-4b8c-996e-5b7702a07c92 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:52.551832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4635ac3-629b-4b8c-996e-5b7702a07c92 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] PATH_INFO: `/v3/OS-TRUST/trusts/1cc5f4729e474dbbb25c2265ea6d3dbe/roles/699f0b2c917b44d6b460517bb6e6237b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:52.561343 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4635ac3-629b-4b8c-996e-5b7702a07c92 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] RBAC: Authorizing `identity:get_role_for_trust(trust_id=1cc5f4729e474dbbb25c2265ea6d3dbe, role_id=699f0b2c917b44d6b460517bb6e6237b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:52.563109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4635ac3-629b-4b8c-996e-5b7702a07c92 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:52.577090 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-e4635ac3-629b-4b8c-996e-5b7702a07c92 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] Could not find role: 699f0b2c917b44d6b460517bb6e6237b.: keystone.exception.RoleNotFound: Could not find role: 699f0b2c917b44d6b460517bb6e6237b. Aug 07 01:40:52.577090 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:40:52.577090 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:40:52.577090 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:40:52.577090 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:40:52.577090 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:40:52.577090 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:40:52.577090 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:40:52.577090 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:40:52.577090 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:40:52.577090 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:40:52.577090 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:40:52.577090 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 07 01:40:52.577090 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 01:40:52.577090 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 699f0b2c917b44d6b460517bb6e6237b. Aug 07 01:40:52.578263 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:40:52.579942 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3082/6211] 10.222.0.39 () {58 vars in 1368 bytes} [Sun Aug 7 01:40:52 2022] GET /identity/v3/OS-TRUST/trusts/1cc5f4729e474dbbb25c2265ea6d3dbe/roles/699f0b2c917b44d6b460517bb6e6237b => generated 110 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:40:52.584725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4635ac3-629b-4b8c-996e-5b7702a07c92 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:52.596635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4635ac3-629b-4b8c-996e-5b7702a07c92 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:52.596846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a49103-0bb1-4307-83e5-c7aa8b853a4c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:52.603334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00986560-1325-4e65-ad3e-0923ebdcc3ec tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cd23690b73f4df58f970d677bfa6d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20374f42729d4bac8015045880463014', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-982216749', 'tempest-NotDelegatedRole-491653239'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:52.604487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00986560-1325-4e65-ad3e-0923ebdcc3ec tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] REQUEST_METHOD: `HEAD` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:52.605249 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00986560-1325-4e65-ad3e-0923ebdcc3ec tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:52.605679 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00986560-1325-4e65-ad3e-0923ebdcc3ec tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] PATH_INFO: `/v3/OS-TRUST/trusts/1cc5f4729e474dbbb25c2265ea6d3dbe/roles/699f0b2c917b44d6b460517bb6e6237b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:52.608761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407c755-5566-42e9-9110-13c415812f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:52.610273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407c755-5566-42e9-9110-13c415812f5c admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:52.610561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407c755-5566-42e9-9110-13c415812f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:52.612021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407c755-5566-42e9-9110-13c415812f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:52.612756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407c755-5566-42e9-9110-13c415812f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:52.617103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407c755-5566-42e9-9110-13c415812f5c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:52.621357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00986560-1325-4e65-ad3e-0923ebdcc3ec tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] RBAC: Authorizing `identity:get_role_for_trust(trust_id=1cc5f4729e474dbbb25c2265ea6d3dbe, role_id=699f0b2c917b44d6b460517bb6e6237b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:52.628700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00986560-1325-4e65-ad3e-0923ebdcc3ec tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:52.647726 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3130/6212] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:52 2022] GET /identity/v3/roles => generated 1891 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:52.649733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407c755-5566-42e9-9110-13c415812f5c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:52.664892 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-00986560-1325-4e65-ad3e-0923ebdcc3ec tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] Could not find role: 699f0b2c917b44d6b460517bb6e6237b.: keystone.exception.RoleNotFound: Could not find role: 699f0b2c917b44d6b460517bb6e6237b. Aug 07 01:40:52.664892 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:40:52.664892 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:40:52.664892 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:40:52.664892 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:40:52.664892 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:40:52.664892 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:40:52.664892 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:40:52.664892 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:40:52.664892 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:40:52.664892 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:40:52.664892 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:40:52.664892 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 07 01:40:52.664892 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 01:40:52.664892 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 699f0b2c917b44d6b460517bb6e6237b. Aug 07 01:40:52.665855 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:40:52.669307 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3083/6213] 10.222.0.39 () {58 vars in 1369 bytes} [Sun Aug 7 01:40:52 2022] HEAD /identity/v3/OS-TRUST/trusts/1cc5f4729e474dbbb25c2265ea6d3dbe/roles/699f0b2c917b44d6b460517bb6e6237b => generated 0 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:40:52.673257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00986560-1325-4e65-ad3e-0923ebdcc3ec tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:52.688761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407c755-5566-42e9-9110-13c415812f5c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:52.705449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00986560-1325-4e65-ad3e-0923ebdcc3ec tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:52.709527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251ee02-3f4e-47cf-ad4c-a636d05cfe18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:52.710298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251ee02-3f4e-47cf-ad4c-a636d05cfe18 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:52.710659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251ee02-3f4e-47cf-ad4c-a636d05cfe18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:52.711150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251ee02-3f4e-47cf-ad4c-a636d05cfe18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:52.711844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a251ee02-3f4e-47cf-ad4c-a636d05cfe18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:52.712195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204fdcc-3654-4d9f-a957-339f5365f93b tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cd23690b73f4df58f970d677bfa6d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20374f42729d4bac8015045880463014', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-982216749', 'tempest-NotDelegatedRole-491653239'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:52.713007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204fdcc-3654-4d9f-a957-339f5365f93b tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:52.713893 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a251ee02-3f4e-47cf-ad4c-a636d05cfe18 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:52.714323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204fdcc-3654-4d9f-a957-339f5365f93b tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:52.714760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204fdcc-3654-4d9f-a957-339f5365f93b tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] PATH_INFO: `/v3/OS-TRUST/trusts/1cc5f4729e474dbbb25c2265ea6d3dbe` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:52.729613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204fdcc-3654-4d9f-a957-339f5365f93b tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] RBAC: Authorizing `identity:delete_trust(trust_id=1cc5f4729e474dbbb25c2265ea6d3dbe)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:52.736027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204fdcc-3654-4d9f-a957-339f5365f93b tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:52.740674 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3131/6214] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:52 2022] GET /identity/v3/roles => generated 1891 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:52.744743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251ee02-3f4e-47cf-ad4c-a636d05cfe18 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:52.764144 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:52.771706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251ee02-3f4e-47cf-ad4c-a636d05cfe18 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:52.801137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0853c-f1f3-4ad5-91c6-9d738719a59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:52.802091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0853c-f1f3-4ad5-91c6-9d738719a59e admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:52.802566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0853c-f1f3-4ad5-91c6-9d738719a59e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:52.802964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0853c-f1f3-4ad5-91c6-9d738719a59e admin admin] PATH_INFO: `/v3/projects/e80875457b164e288b8c1a1a31496e37/users/2d27434c0cdf47f8bf0987d6c62b948a/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:52.806495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d204fdcc-3654-4d9f-a957-339f5365f93b tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '1cc5f4729e474dbbb25c2265ea6d3dbe', 'request_id': 'req-d204fdcc-3654-4d9f-a957-339f5365f93b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:52.809559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d204fdcc-3654-4d9f-a957-339f5365f93b tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '1cc5f4729e474dbbb25c2265ea6d3dbe', 'request_id': 'req-d204fdcc-3654-4d9f-a957-339f5365f93b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:52.837801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d204fdcc-3654-4d9f-a957-339f5365f93b tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '1cc5f4729e474dbbb25c2265ea6d3dbe', 'request_id': 'req-d204fdcc-3654-4d9f-a957-339f5365f93b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:52.847870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0853c-f1f3-4ad5-91c6-9d738719a59e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e80875457b164e288b8c1a1a31496e37, user_id=2d27434c0cdf47f8bf0987d6c62b948a, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:52.856395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0853c-f1f3-4ad5-91c6-9d738719a59e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:52.863957 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3084/6215] 10.222.0.39 () {58 vars in 1254 bytes} [Sun Aug 7 01:40:52 2022] DELETE /identity/v3/OS-TRUST/trusts/1cc5f4729e474dbbb25c2265ea6d3dbe => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:52.868469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204fdcc-3654-4d9f-a957-339f5365f93b tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:52.870662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d204fdcc-3654-4d9f-a957-339f5365f93b tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:52.889543 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3132/6216] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:52 2022] PUT /identity/v3/projects/e80875457b164e288b8c1a1a31496e37/users/2d27434c0cdf47f8bf0987d6c62b948a/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:52.899910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91fae4-ffe2-4e69-b038-30e1d626b35d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:52.900813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91fae4-ffe2-4e69-b038-30e1d626b35d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:52.901204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91fae4-ffe2-4e69-b038-30e1d626b35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:52.904447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204fdcc-3654-4d9f-a957-339f5365f93b tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:53.012655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-4a91fae4-ffe2-4e69-b038-30e1d626b35d None None] MFA Rules not processed for user `2d27434c0cdf47f8bf0987d6c62b948a`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:53.014404 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4a91fae4-ffe2-4e69-b038-30e1d626b35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:53.124961 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db6973-c089-494c-9f73-a0c325a878c9 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1cd23690b73f4df58f970d677bfa6d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20374f42729d4bac8015045880463014', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-982216749', 'tempest-NotDelegatedRole-491653239'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:53.125230 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db6973-c089-494c-9f73-a0c325a878c9 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:53.125327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db6973-c089-494c-9f73-a0c325a878c9 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:53.125611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db6973-c089-494c-9f73-a0c325a878c9 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] PATH_INFO: `/v3/OS-TRUST/trusts/1cc5f4729e474dbbb25c2265ea6d3dbe` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:53.169558 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-b4db6973-c089-494c-9f73-a0c325a878c9 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] Could not find trust: 1cc5f4729e474dbbb25c2265ea6d3dbe.: keystone.exception.TrustNotFound: Could not find trust: 1cc5f4729e474dbbb25c2265ea6d3dbe. Aug 07 01:40:53.169558 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:40:53.169558 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:40:53.169558 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:40:53.169558 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:40:53.169558 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:40:53.169558 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:40:53.169558 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:40:53.169558 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:40:53.169558 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:40:53.169558 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:40:53.169558 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:40:53.169558 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 07 01:40:53.169558 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 07 01:40:53.169558 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 07 01:40:53.174480 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 07 01:40:53.174480 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 07 01:40:53.174480 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 07 01:40:53.174480 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 07 01:40:53.174480 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 07 01:40:53.174480 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:40:53.174480 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:40:53.174480 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 07 01:40:53.174480 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 07 01:40:53.174480 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 07 01:40:53.174480 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 07 01:40:53.174480 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 1cc5f4729e474dbbb25c2265ea6d3dbe. Aug 07 01:40:53.174480 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:40:53.174480 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3085/6217] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Aug 7 01:40:52 2022] GET /identity/v3/OS-TRUST/trusts/1cc5f4729e474dbbb25c2265ea6d3dbe => generated 111 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:40:53.175425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db6973-c089-494c-9f73-a0c325a878c9 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:53.180243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b4db6973-c089-494c-9f73-a0c325a878c9 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:53.252858 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3133/6218] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:40:53.253826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91fae4-ffe2-4e69-b038-30e1d626b35d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:53.258084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4a91fae4-ffe2-4e69-b038-30e1d626b35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:53.297391 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:53.329052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db6973-c089-494c-9f73-a0c325a878c9 tempest-TrustsV3TestJSON-1372674387 tempest-user-78679502] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:53.339868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2ba91-3242-4f7d-87d7-bb07de1c1cef tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:53.341002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2ba91-3242-4f7d-87d7-bb07de1c1cef tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:53.341002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2ba91-3242-4f7d-87d7-bb07de1c1cef tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:53.341235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2ba91-3242-4f7d-87d7-bb07de1c1cef tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/roles/699f0b2c917b44d6b460517bb6e6237b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:53.344978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2ba91-3242-4f7d-87d7-bb07de1c1cef tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:delete_role(role_id=699f0b2c917b44d6b460517bb6e6237b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:53.350327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2ba91-3242-4f7d-87d7-bb07de1c1cef tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:53.470421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91fae4-ffe2-4e69-b038-30e1d626b35d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:53.483335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e748e-c0c0-490f-a508-580537a77eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:53.484571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e748e-c0c0-490f-a508-580537a77eee admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:53.484973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e748e-c0c0-490f-a508-580537a77eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:53.486000 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16e748e-c0c0-490f-a508-580537a77eee admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:53.488355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e748e-c0c0-490f-a508-580537a77eee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:53.493555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16e748e-c0c0-490f-a508-580537a77eee admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:53.523181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6dd2ba91-3242-4f7d-87d7-bb07de1c1cef tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invalidating the token cache because role 699f0b2c917b44d6b460517bb6e6237b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:40:53.526661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6dd2ba91-3242-4f7d-87d7-bb07de1c1cef tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:53.532318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6dd2ba91-3242-4f7d-87d7-bb07de1c1cef tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:53.545114 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3086/6219] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:40:53 2022] DELETE /identity/v3/roles/699f0b2c917b44d6b460517bb6e6237b => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:53.545114 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2ba91-3242-4f7d-87d7-bb07de1c1cef tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:53.547842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6dd2ba91-3242-4f7d-87d7-bb07de1c1cef tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:53.585423 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3134/6220] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:40:53 2022] POST /identity/v3/projects => generated 381 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:53.586711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e748e-c0c0-490f-a508-580537a77eee admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:53.588793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a16e748e-c0c0-490f-a508-580537a77eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:53.676047 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:53.686490 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16e748e-c0c0-490f-a508-580537a77eee admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:53.697070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b736058-9706-45fa-80dd-8ca90076e5d3 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:53.698918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b736058-9706-45fa-80dd-8ca90076e5d3 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:53.700301 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b736058-9706-45fa-80dd-8ca90076e5d3 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:53.701346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b736058-9706-45fa-80dd-8ca90076e5d3 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/roles/52d6c4daf6534423b6d13d395699c117` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:53.708949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b736058-9706-45fa-80dd-8ca90076e5d3 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:delete_role(role_id=52d6c4daf6534423b6d13d395699c117)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:53.715127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b736058-9706-45fa-80dd-8ca90076e5d3 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:53.765188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2ba91-3242-4f7d-87d7-bb07de1c1cef tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:53.811912 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8b736058-9706-45fa-80dd-8ca90076e5d3 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invalidating the token cache because role 52d6c4daf6534423b6d13d395699c117 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:40:53.812764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8b736058-9706-45fa-80dd-8ca90076e5d3 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:53.815357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8b736058-9706-45fa-80dd-8ca90076e5d3 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:53.820767 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3135/6221] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:40:53 2022] DELETE /identity/v3/roles/52d6c4daf6534423b6d13d395699c117 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:53.828428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b736058-9706-45fa-80dd-8ca90076e5d3 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:53.831396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8b736058-9706-45fa-80dd-8ca90076e5d3 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:53.908374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97498c68-5cff-4c58-b25b-ddc4e35dbd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:53.909019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97498c68-5cff-4c58-b25b-ddc4e35dbd71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:53.909297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97498c68-5cff-4c58-b25b-ddc4e35dbd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:53.909567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97498c68-5cff-4c58-b25b-ddc4e35dbd71 admin admin] PATH_INFO: `/v3/projects/ad2dfa83ff5f4ba38598c99e36c32c9c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:53.910725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97498c68-5cff-4c58-b25b-ddc4e35dbd71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad2dfa83ff5f4ba38598c99e36c32c9c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:53.913313 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97498c68-5cff-4c58-b25b-ddc4e35dbd71 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:53.990557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-97498c68-5cff-4c58-b25b-ddc4e35dbd71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad2dfa83ff5f4ba38598c99e36c32c9c', 'request_id': 'req-97498c68-5cff-4c58-b25b-ddc4e35dbd71'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:53.997725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b736058-9706-45fa-80dd-8ca90076e5d3 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:53.998694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-97498c68-5cff-4c58-b25b-ddc4e35dbd71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad2dfa83ff5f4ba38598c99e36c32c9c', 'request_id': 'req-97498c68-5cff-4c58-b25b-ddc4e35dbd71'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:54.011109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-97498c68-5cff-4c58-b25b-ddc4e35dbd71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad2dfa83ff5f4ba38598c99e36c32c9c', 'request_id': 'req-97498c68-5cff-4c58-b25b-ddc4e35dbd71'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:54.013754 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:54.029433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-97498c68-5cff-4c58-b25b-ddc4e35dbd71 admin admin] The token cache is being invalidate because project ad2dfa83ff5f4ba38598c99e36c32c9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:40:54.030826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-97498c68-5cff-4c58-b25b-ddc4e35dbd71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:54.031979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-97498c68-5cff-4c58-b25b-ddc4e35dbd71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:54.034378 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3087/6222] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:40:53 2022] DELETE /identity/v3/projects/ad2dfa83ff5f4ba38598c99e36c32c9c => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:54.037264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97498c68-5cff-4c58-b25b-ddc4e35dbd71 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:54.039288 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-97498c68-5cff-4c58-b25b-ddc4e35dbd71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:54.131596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37714d-2387-4a3f-b6ad-6d78f886d993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:54.132698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37714d-2387-4a3f-b6ad-6d78f886d993 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:54.133142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37714d-2387-4a3f-b6ad-6d78f886d993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:54.134268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37714d-2387-4a3f-b6ad-6d78f886d993 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:54.135075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37714d-2387-4a3f-b6ad-6d78f886d993 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:54.137536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37714d-2387-4a3f-b6ad-6d78f886d993 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:54.145785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97498c68-5cff-4c58-b25b-ddc4e35dbd71 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:54.153727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69673133-2f63-4670-8b98-9e39dd69cd14 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:54.154638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69673133-2f63-4670-8b98-9e39dd69cd14 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:54.154922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69673133-2f63-4670-8b98-9e39dd69cd14 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:54.155194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69673133-2f63-4670-8b98-9e39dd69cd14 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/users/1cd23690b73f4df58f970d677bfa6d39` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:54.156989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69673133-2f63-4670-8b98-9e39dd69cd14 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1cd23690b73f4df58f970d677bfa6d39)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:54.162498 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69673133-2f63-4670-8b98-9e39dd69cd14 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:54.209206 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3136/6223] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:40:53 2022] POST /identity/v3/users => generated 297 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:54.235467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37714d-2387-4a3f-b6ad-6d78f886d993 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:54.238480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ac37714d-2387-4a3f-b6ad-6d78f886d993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:54.248570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-69673133-2f63-4670-8b98-9e39dd69cd14 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cd23690b73f4df58f970d677bfa6d39'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:54.260581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-69673133-2f63-4670-8b98-9e39dd69cd14 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cd23690b73f4df58f970d677bfa6d39'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:54.279333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37714d-2387-4a3f-b6ad-6d78f886d993 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:54.281097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-69673133-2f63-4670-8b98-9e39dd69cd14 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cd23690b73f4df58f970d677bfa6d39'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:54.282216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-69673133-2f63-4670-8b98-9e39dd69cd14 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cd23690b73f4df58f970d677bfa6d39'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:54.294370 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f53743-736b-4e94-ad30-dab0c34cf9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:54.295248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f53743-736b-4e94-ad30-dab0c34cf9c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:54.295931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f53743-736b-4e94-ad30-dab0c34cf9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:54.296426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f53743-736b-4e94-ad30-dab0c34cf9c6 admin admin] PATH_INFO: `/v3/users/a971e051d8cc45249422aff0d6010b29` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:54.301807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-69673133-2f63-4670-8b98-9e39dd69cd14 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cd23690b73f4df58f970d677bfa6d39'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:54.304410 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f53743-736b-4e94-ad30-dab0c34cf9c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a971e051d8cc45249422aff0d6010b29)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:54.306918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f53743-736b-4e94-ad30-dab0c34cf9c6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:54.315844 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3088/6224] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:40:54 2022] DELETE /identity/v3/users/1cd23690b73f4df58f970d677bfa6d39 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:54.316990 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69673133-2f63-4670-8b98-9e39dd69cd14 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:54.318622 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-69673133-2f63-4670-8b98-9e39dd69cd14 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:54.420841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69673133-2f63-4670-8b98-9e39dd69cd14 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:54.441857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf31d5a-ca3a-44b5-b9e0-6c40ef5aa3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:54.443299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf31d5a-ca3a-44b5-b9e0-6c40ef5aa3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:54.444535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf31d5a-ca3a-44b5-b9e0-6c40ef5aa3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:54.445336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf31d5a-ca3a-44b5-b9e0-6c40ef5aa3d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:54.447670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf31d5a-ca3a-44b5-b9e0-6c40ef5aa3d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:54.449758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf31d5a-ca3a-44b5-b9e0-6c40ef5aa3d5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:54.454199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c8f53743-736b-4e94-ad30-dab0c34cf9c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a971e051d8cc45249422aff0d6010b29'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:54.465885 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:54.474381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c8f53743-736b-4e94-ad30-dab0c34cf9c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a971e051d8cc45249422aff0d6010b29'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:54.483722 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3089/6225] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:54.486124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf31d5a-ca3a-44b5-b9e0-6c40ef5aa3d5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:54.489807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2cf31d5a-ca3a-44b5-b9e0-6c40ef5aa3d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:54.511469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c8f53743-736b-4e94-ad30-dab0c34cf9c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a971e051d8cc45249422aff0d6010b29'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:54.513412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c8f53743-736b-4e94-ad30-dab0c34cf9c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a971e051d8cc45249422aff0d6010b29'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:54.522070 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:54.531849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c8f53743-736b-4e94-ad30-dab0c34cf9c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a971e051d8cc45249422aff0d6010b29'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:54.547567 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3137/6226] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:40:54 2022] DELETE /identity/v3/users/a971e051d8cc45249422aff0d6010b29 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:54.549511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f53743-736b-4e94-ad30-dab0c34cf9c6 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:54.553750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c8f53743-736b-4e94-ad30-dab0c34cf9c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:54.667051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf31d5a-ca3a-44b5-b9e0-6c40ef5aa3d5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:54.719423 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f53743-736b-4e94-ad30-dab0c34cf9c6 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:54.735552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47c2b9-256e-44b4-b148-48e0a70e7a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:54.736517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47c2b9-256e-44b4-b148-48e0a70e7a51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:54.736871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47c2b9-256e-44b4-b148-48e0a70e7a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:54.737336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47c2b9-256e-44b4-b148-48e0a70e7a51 admin admin] PATH_INFO: `/v3/projects/812fc187d63f40f39e2096dda2db4d3e/users/46d1c67e065c4718b10c9382e804d929/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:54.770166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d47c2b9-256e-44b4-b148-48e0a70e7a51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=812fc187d63f40f39e2096dda2db4d3e, user_id=46d1c67e065c4718b10c9382e804d929, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:54.774618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d47c2b9-256e-44b4-b148-48e0a70e7a51 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:54.804248 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3138/6227] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:54 2022] PUT /identity/v3/projects/812fc187d63f40f39e2096dda2db4d3e/users/46d1c67e065c4718b10c9382e804d929/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:54.808790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47c2b9-256e-44b4-b148-48e0a70e7a51 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:54.810555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a70893-51a8-4902-b576-ab59b0b7920a tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:54.813068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a70893-51a8-4902-b576-ab59b0b7920a tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:54.813593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a70893-51a8-4902-b576-ab59b0b7920a tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:54.814325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a70893-51a8-4902-b576-ab59b0b7920a tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/projects/20374f42729d4bac8015045880463014` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:54.819205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a70893-51a8-4902-b576-ab59b0b7920a tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:delete_project(project_id=20374f42729d4bac8015045880463014)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:54.825807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a70893-51a8-4902-b576-ab59b0b7920a tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:54.969716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e4a70893-51a8-4902-b576-ab59b0b7920a tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20374f42729d4bac8015045880463014', 'request_id': 'req-e4a70893-51a8-4902-b576-ab59b0b7920a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:54.990347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e4a70893-51a8-4902-b576-ab59b0b7920a tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20374f42729d4bac8015045880463014', 'request_id': 'req-e4a70893-51a8-4902-b576-ab59b0b7920a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:54.998863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47c2b9-256e-44b4-b148-48e0a70e7a51 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:55.007044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e4a70893-51a8-4902-b576-ab59b0b7920a tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20374f42729d4bac8015045880463014', 'request_id': 'req-e4a70893-51a8-4902-b576-ab59b0b7920a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:55.042197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e4a70893-51a8-4902-b576-ab59b0b7920a tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] The token cache is being invalidate because project 20374f42729d4bac8015045880463014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:40:55.042778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e4a70893-51a8-4902-b576-ab59b0b7920a tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:55.045237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e4a70893-51a8-4902-b576-ab59b0b7920a tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:55.049460 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3090/6228] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:40:54 2022] DELETE /identity/v3/projects/20374f42729d4bac8015045880463014 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:55.056626 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a70893-51a8-4902-b576-ab59b0b7920a tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:55.069229 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e4a70893-51a8-4902-b576-ab59b0b7920a tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:55.187976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63eb333-c7ff-43f2-9886-b58e23563804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:55.190901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63eb333-c7ff-43f2-9886-b58e23563804 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:55.190901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63eb333-c7ff-43f2-9886-b58e23563804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:55.190901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63eb333-c7ff-43f2-9886-b58e23563804 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:55.193061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63eb333-c7ff-43f2-9886-b58e23563804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:55.196113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63eb333-c7ff-43f2-9886-b58e23563804 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:55.199925 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:55.244537 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:55.244692 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3139/6229] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:55.246835 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63eb333-c7ff-43f2-9886-b58e23563804 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:55.253342 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b63eb333-c7ff-43f2-9886-b58e23563804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:55.302328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63eb333-c7ff-43f2-9886-b58e23563804 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:55.317718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a70893-51a8-4902-b576-ab59b0b7920a tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:55.320916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694f4f8-eaa1-475e-91b3-02b83d90d285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:55.322690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694f4f8-eaa1-475e-91b3-02b83d90d285 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:55.328372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694f4f8-eaa1-475e-91b3-02b83d90d285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:55.330182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694f4f8-eaa1-475e-91b3-02b83d90d285 admin admin] PATH_INFO: `/v3/projects/812fc187d63f40f39e2096dda2db4d3e/users/46d1c67e065c4718b10c9382e804d929/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:55.346173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae11128-a535-44f2-b2e7-9a61c327a2a3 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:55.347315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694f4f8-eaa1-475e-91b3-02b83d90d285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=812fc187d63f40f39e2096dda2db4d3e, user_id=46d1c67e065c4718b10c9382e804d929, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:55.352592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae11128-a535-44f2-b2e7-9a61c327a2a3 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:55.354271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae11128-a535-44f2-b2e7-9a61c327a2a3 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:55.356136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae11128-a535-44f2-b2e7-9a61c327a2a3 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:55.359709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae11128-a535-44f2-b2e7-9a61c327a2a3 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:55.363161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae11128-a535-44f2-b2e7-9a61c327a2a3 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:55.364209 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694f4f8-eaa1-475e-91b3-02b83d90d285 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:55.399941 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3140/6230] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:55 2022] PUT /identity/v3/projects/812fc187d63f40f39e2096dda2db4d3e/users/46d1c67e065c4718b10c9382e804d929/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:55.402170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece45cf2-eb04-4b2b-b3a0-90b6d68ad95a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:55.402578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece45cf2-eb04-4b2b-b3a0-90b6d68ad95a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:55.403041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece45cf2-eb04-4b2b-b3a0-90b6d68ad95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:55.450285 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3091/6231] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Aug 7 01:40:55 2022] POST /identity/v3/projects => generated 328 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:40:55.455296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae11128-a535-44f2-b2e7-9a61c327a2a3 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:55.485369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ece45cf2-eb04-4b2b-b3a0-90b6d68ad95a None None] MFA Rules not processed for user `46d1c67e065c4718b10c9382e804d929`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:55.486759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ece45cf2-eb04-4b2b-b3a0-90b6d68ad95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:55.612777 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae11128-a535-44f2-b2e7-9a61c327a2a3 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:55.627350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efb073-b89f-45bc-b337-f51f93866128 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:55.628673 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efb073-b89f-45bc-b337-f51f93866128 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:55.629156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efb073-b89f-45bc-b337-f51f93866128 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:55.629572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efb073-b89f-45bc-b337-f51f93866128 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:55.630399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00efb073-b89f-45bc-b337-f51f93866128 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:55.635944 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00efb073-b89f-45bc-b337-f51f93866128 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:55.648971 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3141/6232] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:55.657103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece45cf2-eb04-4b2b-b3a0-90b6d68ad95a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:55.660618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ece45cf2-eb04-4b2b-b3a0-90b6d68ad95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:55.688155 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3092/6233] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:40:55 2022] POST /identity/v3/users => generated 416 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:40:55.691732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efb073-b89f-45bc-b337-f51f93866128 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:55.715966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efb073-b89f-45bc-b337-f51f93866128 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:55.727600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c344d65-e280-4595-aab7-7a94b7d93362 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:55.728576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c344d65-e280-4595-aab7-7a94b7d93362 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:55.729075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c344d65-e280-4595-aab7-7a94b7d93362 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:55.729583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c344d65-e280-4595-aab7-7a94b7d93362 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:55.730466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c344d65-e280-4595-aab7-7a94b7d93362 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:55.734611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c344d65-e280-4595-aab7-7a94b7d93362 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:55.775029 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3093/6234] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:40:55 2022] POST /identity/v3/roles => generated 243 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:40:55.780665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c344d65-e280-4595-aab7-7a94b7d93362 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:55.798513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c344d65-e280-4595-aab7-7a94b7d93362 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:55.804961 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f733d5-568f-4ac3-8911-d9a37704a195 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:55.805679 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f733d5-568f-4ac3-8911-d9a37704a195 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:55.805963 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f733d5-568f-4ac3-8911-d9a37704a195 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:55.806233 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f733d5-568f-4ac3-8911-d9a37704a195 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:55.806419 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece45cf2-eb04-4b2b-b3a0-90b6d68ad95a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:55.806896 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f733d5-568f-4ac3-8911-d9a37704a195 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:55.808607 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f733d5-568f-4ac3-8911-d9a37704a195 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:55.820678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d2807-a717-4b5d-ba49-2ccbaa142a1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:55.822241 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d2807-a717-4b5d-ba49-2ccbaa142a1b service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:55.822639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d2807-a717-4b5d-ba49-2ccbaa142a1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:55.823020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d2807-a717-4b5d-ba49-2ccbaa142a1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:55.825196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dd2d2807-a717-4b5d-ba49-2ccbaa142a1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:55.830569 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3094/6235] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:40:55 2022] POST /identity/v3/roles => generated 246 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:55.837076 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f733d5-568f-4ac3-8911-d9a37704a195 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:55.876784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f733d5-568f-4ac3-8911-d9a37704a195 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:55.905885 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592f3bc-795d-4cd4-b431-6734d8b52c81 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:55.907042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592f3bc-795d-4cd4-b431-6734d8b52c81 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:55.907839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592f3bc-795d-4cd4-b431-6734d8b52c81 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:55.907977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592f3bc-795d-4cd4-b431-6734d8b52c81 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/projects/b4f6a42db0a94c9f8eade64ef6076cf5/users/1370a51382bf4aa2aa556409a0416981/roles/709d7967866d4a3293733092fef2789c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:55.946467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592f3bc-795d-4cd4-b431-6734d8b52c81 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b4f6a42db0a94c9f8eade64ef6076cf5, user_id=1370a51382bf4aa2aa556409a0416981, role_id=709d7967866d4a3293733092fef2789c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:55.955793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592f3bc-795d-4cd4-b431-6734d8b52c81 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:56.001878 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3095/6236] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:55 2022] PUT /identity/v3/projects/b4f6a42db0a94c9f8eade64ef6076cf5/users/1370a51382bf4aa2aa556409a0416981/roles/709d7967866d4a3293733092fef2789c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:56.007326 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592f3bc-795d-4cd4-b431-6734d8b52c81 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:56.071784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d2807-a717-4b5d-ba49-2ccbaa142a1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:56.075128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d2807-a717-4b5d-ba49-2ccbaa142a1b service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:56.112068 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3142/6237] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:40:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:40:56.140551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592f3bc-795d-4cd4-b431-6734d8b52c81 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:56.148459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c4094-5270-4634-9dda-87e8bc504f75 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:56.149401 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c4094-5270-4634-9dda-87e8bc504f75 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:56.149806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c4094-5270-4634-9dda-87e8bc504f75 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:56.150186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c4094-5270-4634-9dda-87e8bc504f75 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/projects/b4f6a42db0a94c9f8eade64ef6076cf5/users/1370a51382bf4aa2aa556409a0416981/roles/b89668afda684b1eb8127ce5e2fffee7` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:56.153316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c4094-5270-4634-9dda-87e8bc504f75 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b4f6a42db0a94c9f8eade64ef6076cf5, user_id=1370a51382bf4aa2aa556409a0416981, role_id=b89668afda684b1eb8127ce5e2fffee7)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:56.156601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c4094-5270-4634-9dda-87e8bc504f75 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:56.182066 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3096/6238] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:56 2022] PUT /identity/v3/projects/b4f6a42db0a94c9f8eade64ef6076cf5/users/1370a51382bf4aa2aa556409a0416981/roles/b89668afda684b1eb8127ce5e2fffee7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:56.183622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d2807-a717-4b5d-ba49-2ccbaa142a1b service cinder] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:56.202838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d2807-a717-4b5d-ba49-2ccbaa142a1b service cinder] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:56.259960 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:56.402662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27891d40-91c7-4df7-815e-24d90450271f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:56.403444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27891d40-91c7-4df7-815e-24d90450271f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:56.403727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27891d40-91c7-4df7-815e-24d90450271f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:56.404048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27891d40-91c7-4df7-815e-24d90450271f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:56.404736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27891d40-91c7-4df7-815e-24d90450271f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:56.406630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27891d40-91c7-4df7-815e-24d90450271f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:56.547699 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3143/6239] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:56 2022] GET /identity/v3/users => generated 8624 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:56.554349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c69fcb-cad8-4bc9-80a3-dc3ebf010cec None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:56.555072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c69fcb-cad8-4bc9-80a3-dc3ebf010cec None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:56.556101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c69fcb-cad8-4bc9-80a3-dc3ebf010cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:56.583260 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:56.666074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27891d40-91c7-4df7-815e-24d90450271f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:56.667895 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-27891d40-91c7-4df7-815e-24d90450271f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:56.779527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-56c69fcb-cad8-4bc9-80a3-dc3ebf010cec None None] MFA Rules not processed for user `1370a51382bf4aa2aa556409a0416981`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:56.804302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-56c69fcb-cad8-4bc9-80a3-dc3ebf010cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:56.876785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27891d40-91c7-4df7-815e-24d90450271f tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:56.919731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bb4bd-404f-4677-8747-e868c2f95b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:56.923543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bb4bd-404f-4677-8747-e868c2f95b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:56.924088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bb4bd-404f-4677-8747-e868c2f95b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:56.924513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bb4bd-404f-4677-8747-e868c2f95b09 admin admin] PATH_INFO: `/v3/projects/5c37f3ac264a423dbf66b4f65b8230bc` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:56.927689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bb4bd-404f-4677-8747-e868c2f95b09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c37f3ac264a423dbf66b4f65b8230bc)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:56.930009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bb4bd-404f-4677-8747-e868c2f95b09 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:56.959449 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3097/6240] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:56 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:56.964404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ecb825-71c3-4a4e-94f7-92b021da6bb5 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:56.964713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ecb825-71c3-4a4e-94f7-92b021da6bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:56.965446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ecb825-71c3-4a4e-94f7-92b021da6bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:57.002037 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c4ecb825-71c3-4a4e-94f7-92b021da6bb5 None None] MFA Rules not processed for user `1370a51382bf4aa2aa556409a0416981`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:57.006458 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c4ecb825-71c3-4a4e-94f7-92b021da6bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:57.033215 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3098/6241] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:56 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:40:57.046565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ecb825-71c3-4a4e-94f7-92b021da6bb5 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:57.057241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ecb825-71c3-4a4e-94f7-92b021da6bb5 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:57.110297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4d6bb4bd-404f-4677-8747-e868c2f95b09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c37f3ac264a423dbf66b4f65b8230bc', 'request_id': 'req-4d6bb4bd-404f-4677-8747-e868c2f95b09'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:57.120865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20f074-e39e-4c63-a09a-ff7585ec9fed tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1370a51382bf4aa2aa556409a0416981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4f6a42db0a94c9f8eade64ef6076cf5', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-216218669', 'tempest-DelegatedRole-552919537'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:57.121711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20f074-e39e-4c63-a09a-ff7585ec9fed tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:57.122101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20f074-e39e-4c63-a09a-ff7585ec9fed tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:57.122726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20f074-e39e-4c63-a09a-ff7585ec9fed tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:57.123535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20f074-e39e-4c63-a09a-ff7585ec9fed tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] RBAC: Authorizing `identity:create_trust()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:57.124782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20f074-e39e-4c63-a09a-ff7585ec9fed tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:57.138744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4d6bb4bd-404f-4677-8747-e868c2f95b09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c37f3ac264a423dbf66b4f65b8230bc', 'request_id': 'req-4d6bb4bd-404f-4677-8747-e868c2f95b09'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:57.159068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4d6bb4bd-404f-4677-8747-e868c2f95b09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c37f3ac264a423dbf66b4f65b8230bc', 'request_id': 'req-4d6bb4bd-404f-4677-8747-e868c2f95b09'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:57.219991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4d6bb4bd-404f-4677-8747-e868c2f95b09 admin admin] The token cache is being invalidate because project 5c37f3ac264a423dbf66b4f65b8230bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:40:57.220303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4d6bb4bd-404f-4677-8747-e868c2f95b09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:57.224552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4d6bb4bd-404f-4677-8747-e868c2f95b09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:57.231273 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3144/6242] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:40:56 2022] DELETE /identity/v3/projects/5c37f3ac264a423dbf66b4f65b8230bc => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:57.241370 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3099/6243] 10.222.0.39 () {60 vars in 1174 bytes} [Sun Aug 7 01:40:57 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:57.242319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20f074-e39e-4c63-a09a-ff7585ec9fed tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:57.245920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2c20f074-e39e-4c63-a09a-ff7585ec9fed tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:57.253167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2185a6-c24c-4c3f-a182-461ed60db478 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:57.253453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2185a6-c24c-4c3f-a182-461ed60db478 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:57.253730 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2185a6-c24c-4c3f-a182-461ed60db478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:57.285849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20f074-e39e-4c63-a09a-ff7585ec9fed tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:57.305318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372c6cf-d531-49e4-a15a-7f2e89f7d97c tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1370a51382bf4aa2aa556409a0416981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4f6a42db0a94c9f8eade64ef6076cf5', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-216218669', 'tempest-DelegatedRole-552919537'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:57.308660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372c6cf-d531-49e4-a15a-7f2e89f7d97c tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:57.308960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372c6cf-d531-49e4-a15a-7f2e89f7d97c tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:57.309239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372c6cf-d531-49e4-a15a-7f2e89f7d97c tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] PATH_INFO: `/v3/OS-TRUST/trusts/03ac750f84a24e59af23f18e385a7e6b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:57.336055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372c6cf-d531-49e4-a15a-7f2e89f7d97c tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] RBAC: Authorizing `identity:get_trust(trust_id=03ac750f84a24e59af23f18e385a7e6b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:57.339741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372c6cf-d531-49e4-a15a-7f2e89f7d97c tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:57.366343 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3100/6244] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Aug 7 01:40:57 2022] GET /identity/v3/OS-TRUST/trusts/03ac750f84a24e59af23f18e385a7e6b => generated 834 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:40:57.370766 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372c6cf-d531-49e4-a15a-7f2e89f7d97c tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:57.375164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-dc2185a6-c24c-4c3f-a182-461ed60db478 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:57.387151 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:57.388161 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dc2185a6-c24c-4c3f-a182-461ed60db478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:57.398869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372c6cf-d531-49e4-a15a-7f2e89f7d97c tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:57.414195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d76106-16fd-4899-b487-bb404be335cf tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1370a51382bf4aa2aa556409a0416981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4f6a42db0a94c9f8eade64ef6076cf5', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-216218669', 'tempest-DelegatedRole-552919537'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:57.414936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d76106-16fd-4899-b487-bb404be335cf tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:57.415223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d76106-16fd-4899-b487-bb404be335cf tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:57.415501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d76106-16fd-4899-b487-bb404be335cf tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] PATH_INFO: `/v3/OS-TRUST/trusts/03ac750f84a24e59af23f18e385a7e6b/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:57.450078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d76106-16fd-4899-b487-bb404be335cf tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=03ac750f84a24e59af23f18e385a7e6b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:57.451608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d76106-16fd-4899-b487-bb404be335cf tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:57.498681 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3101/6245] 10.222.0.39 () {58 vars in 1269 bytes} [Sun Aug 7 01:40:57 2022] GET /identity/v3/OS-TRUST/trusts/03ac750f84a24e59af23f18e385a7e6b/roles => generated 370 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:40:57.499669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d76106-16fd-4899-b487-bb404be335cf tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:57.555840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d76106-16fd-4899-b487-bb404be335cf tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:57.571228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf9d9f-748f-4839-803c-8963533c26f4 tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1370a51382bf4aa2aa556409a0416981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4f6a42db0a94c9f8eade64ef6076cf5', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-216218669', 'tempest-DelegatedRole-552919537'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:57.610545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf9d9f-748f-4839-803c-8963533c26f4 tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:57.610973 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf9d9f-748f-4839-803c-8963533c26f4 tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:57.611986 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf9d9f-748f-4839-803c-8963533c26f4 tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] PATH_INFO: `/v3/OS-TRUST/trusts/03ac750f84a24e59af23f18e385a7e6b/roles/709d7967866d4a3293733092fef2789c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:57.649633 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:57.673730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf9d9f-748f-4839-803c-8963533c26f4 tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] RBAC: Authorizing `identity:get_role_for_trust(trust_id=03ac750f84a24e59af23f18e385a7e6b, role_id=709d7967866d4a3293733092fef2789c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:57.682493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf9d9f-748f-4839-803c-8963533c26f4 tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:57.738537 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3145/6246] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 500 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:57.740099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fbde0-5020-4f29-ad56-29264009a066 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:57.740597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fbde0-5020-4f29-ad56-29264009a066 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:57.740708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2fbde0-5020-4f29-ad56-29264009a066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:57.771273 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3102/6247] 10.222.0.39 () {58 vars in 1368 bytes} [Sun Aug 7 01:40:57 2022] GET /identity/v3/OS-TRUST/trusts/03ac750f84a24e59af23f18e385a7e6b/roles/709d7967866d4a3293733092fef2789c => generated 243 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:40:57.772919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf9d9f-748f-4839-803c-8963533c26f4 tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:57.806121 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0a2fbde0-5020-4f29-ad56-29264009a066 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:57.810401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0a2fbde0-5020-4f29-ad56-29264009a066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:57.854029 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3146/6248] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:57.855077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fbde0-5020-4f29-ad56-29264009a066 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:57.881906 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf9d9f-748f-4839-803c-8963533c26f4 tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:57.902184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2fbde0-5020-4f29-ad56-29264009a066 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:57.902899 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fc1ed-4a39-41f3-ade0-a9cda35de13c tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1370a51382bf4aa2aa556409a0416981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4f6a42db0a94c9f8eade64ef6076cf5', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-216218669', 'tempest-DelegatedRole-552919537'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:57.903737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fc1ed-4a39-41f3-ade0-a9cda35de13c tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] REQUEST_METHOD: `HEAD` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:57.904353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fc1ed-4a39-41f3-ade0-a9cda35de13c tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:57.904790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fc1ed-4a39-41f3-ade0-a9cda35de13c tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] PATH_INFO: `/v3/OS-TRUST/trusts/03ac750f84a24e59af23f18e385a7e6b/roles/709d7967866d4a3293733092fef2789c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:57.919106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c373ee-e258-479e-84b0-a31f7f6136f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:57.919739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c373ee-e258-479e-84b0-a31f7f6136f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:57.925748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c373ee-e258-479e-84b0-a31f7f6136f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:57.926001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c373ee-e258-479e-84b0-a31f7f6136f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:57.927397 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0fc1ed-4a39-41f3-ade0-a9cda35de13c tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] RBAC: Authorizing `identity:get_role_for_trust(trust_id=03ac750f84a24e59af23f18e385a7e6b, role_id=709d7967866d4a3293733092fef2789c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:57.927823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c373ee-e258-479e-84b0-a31f7f6136f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:40:57.928297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c373ee-e258-479e-84b0-a31f7f6136f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:57.928932 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0fc1ed-4a39-41f3-ade0-a9cda35de13c tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:57.945887 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3103/6249] 10.222.0.39 () {58 vars in 1369 bytes} [Sun Aug 7 01:40:57 2022] HEAD /identity/v3/OS-TRUST/trusts/03ac750f84a24e59af23f18e385a7e6b/roles/709d7967866d4a3293733092fef2789c => generated 0 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Aug 07 01:40:57.947571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c373ee-e258-479e-84b0-a31f7f6136f1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:57.948794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fc1ed-4a39-41f3-ade0-a9cda35de13c tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:57.978176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fc1ed-4a39-41f3-ade0-a9cda35de13c tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:57.996289 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3147/6250] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:40:57.997290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c373ee-e258-479e-84b0-a31f7f6136f1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:58.012612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d707a8d-7c96-4454-9f8a-407b7162172f tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1370a51382bf4aa2aa556409a0416981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4f6a42db0a94c9f8eade64ef6076cf5', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-216218669', 'tempest-DelegatedRole-552919537'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:58.013289 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d707a8d-7c96-4454-9f8a-407b7162172f tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:58.013571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d707a8d-7c96-4454-9f8a-407b7162172f tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:58.013848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d707a8d-7c96-4454-9f8a-407b7162172f tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] PATH_INFO: `/v3/OS-TRUST/trusts/03ac750f84a24e59af23f18e385a7e6b/roles/b89668afda684b1eb8127ce5e2fffee7` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:58.027936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c373ee-e258-479e-84b0-a31f7f6136f1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:58.029063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d707a8d-7c96-4454-9f8a-407b7162172f tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] RBAC: Authorizing `identity:get_role_for_trust(trust_id=03ac750f84a24e59af23f18e385a7e6b, role_id=b89668afda684b1eb8127ce5e2fffee7)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:58.030652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d707a8d-7c96-4454-9f8a-407b7162172f tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:58.050065 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6605ad3-c95e-4552-b36e-2e1ccbd46f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:58.050694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6605ad3-c95e-4552-b36e-2e1ccbd46f6e admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:58.050976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6605ad3-c95e-4552-b36e-2e1ccbd46f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:58.051246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6605ad3-c95e-4552-b36e-2e1ccbd46f6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:58.052134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6605ad3-c95e-4552-b36e-2e1ccbd46f6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:58.055445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6605ad3-c95e-4552-b36e-2e1ccbd46f6e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:58.070133 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-4d707a8d-7c96-4454-9f8a-407b7162172f tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] Could not find role: b89668afda684b1eb8127ce5e2fffee7.: keystone.exception.RoleNotFound: Could not find role: b89668afda684b1eb8127ce5e2fffee7. Aug 07 01:40:58.070133 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:40:58.070133 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:40:58.070133 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:40:58.070133 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:40:58.070133 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:40:58.070133 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:40:58.070133 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:40:58.070133 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:40:58.070133 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:40:58.070133 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:40:58.070133 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:40:58.070133 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 07 01:40:58.070133 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 01:40:58.070133 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: b89668afda684b1eb8127ce5e2fffee7. Aug 07 01:40:58.071295 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:40:58.078206 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3104/6251] 10.222.0.39 () {58 vars in 1368 bytes} [Sun Aug 7 01:40:57 2022] GET /identity/v3/OS-TRUST/trusts/03ac750f84a24e59af23f18e385a7e6b/roles/b89668afda684b1eb8127ce5e2fffee7 => generated 110 bytes in 132 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:40:58.079386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d707a8d-7c96-4454-9f8a-407b7162172f tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:58.106775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d707a8d-7c96-4454-9f8a-407b7162172f tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:58.125163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a19a66-73e6-4fa9-9011-53710294a733 tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1370a51382bf4aa2aa556409a0416981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4f6a42db0a94c9f8eade64ef6076cf5', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-216218669', 'tempest-DelegatedRole-552919537'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:58.129468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a19a66-73e6-4fa9-9011-53710294a733 tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] REQUEST_METHOD: `HEAD` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:58.133001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a19a66-73e6-4fa9-9011-53710294a733 tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:58.133310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a19a66-73e6-4fa9-9011-53710294a733 tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] PATH_INFO: `/v3/OS-TRUST/trusts/03ac750f84a24e59af23f18e385a7e6b/roles/b89668afda684b1eb8127ce5e2fffee7` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:58.150095 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3148/6252] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:40:57 2022] POST /identity/v3/projects => generated 369 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:58.154224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6605ad3-c95e-4552-b36e-2e1ccbd46f6e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:58.170126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a19a66-73e6-4fa9-9011-53710294a733 tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] RBAC: Authorizing `identity:get_role_for_trust(trust_id=03ac750f84a24e59af23f18e385a7e6b, role_id=b89668afda684b1eb8127ce5e2fffee7)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:58.171654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a19a66-73e6-4fa9-9011-53710294a733 tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:58.198589 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-69a19a66-73e6-4fa9-9011-53710294a733 tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] Could not find role: b89668afda684b1eb8127ce5e2fffee7.: keystone.exception.RoleNotFound: Could not find role: b89668afda684b1eb8127ce5e2fffee7. Aug 07 01:40:58.198589 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:40:58.198589 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:40:58.198589 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:40:58.198589 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:40:58.198589 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:40:58.198589 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:40:58.198589 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:40:58.198589 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:40:58.198589 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:40:58.198589 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:40:58.198589 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:40:58.198589 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Aug 07 01:40:58.198589 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 07 01:40:58.198589 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: b89668afda684b1eb8127ce5e2fffee7. Aug 07 01:40:58.199731 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:40:58.203201 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3105/6253] 10.222.0.39 () {58 vars in 1369 bytes} [Sun Aug 7 01:40:58 2022] HEAD /identity/v3/OS-TRUST/trusts/03ac750f84a24e59af23f18e385a7e6b/roles/b89668afda684b1eb8127ce5e2fffee7 => generated 0 bytes in 121 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Aug 07 01:40:58.205969 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a19a66-73e6-4fa9-9011-53710294a733 tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:58.229604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a19a66-73e6-4fa9-9011-53710294a733 tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:58.319819 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6605ad3-c95e-4552-b36e-2e1ccbd46f6e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:58.331142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4d594-946b-46f1-95a3-2ec442f065eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:58.331775 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4d594-946b-46f1-95a3-2ec442f065eb admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:58.332076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4d594-946b-46f1-95a3-2ec442f065eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:58.333378 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4d594-946b-46f1-95a3-2ec442f065eb admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:58.333807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4d594-946b-46f1-95a3-2ec442f065eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:58.338576 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4d594-946b-46f1-95a3-2ec442f065eb admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:58.367130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4d7d5-4093-434a-a573-35bb51264212 tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1370a51382bf4aa2aa556409a0416981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4f6a42db0a94c9f8eade64ef6076cf5', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-216218669', 'tempest-DelegatedRole-552919537'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:58.368403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4d7d5-4093-434a-a573-35bb51264212 tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:58.368857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4d7d5-4093-434a-a573-35bb51264212 tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:58.369359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4d7d5-4093-434a-a573-35bb51264212 tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] PATH_INFO: `/v3/OS-TRUST/trusts/03ac750f84a24e59af23f18e385a7e6b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:58.378020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf4d7d5-4093-434a-a573-35bb51264212 tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] RBAC: Authorizing `identity:delete_trust(trust_id=03ac750f84a24e59af23f18e385a7e6b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:58.380092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf4d7d5-4093-434a-a573-35bb51264212 tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:58.385602 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3149/6254] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:40:58 2022] POST /identity/v3/users => generated 285 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:40:58.390543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4d594-946b-46f1-95a3-2ec442f065eb admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:58.403172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dbf4d7d5-4093-434a-a573-35bb51264212 tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '03ac750f84a24e59af23f18e385a7e6b', 'request_id': 'req-dbf4d7d5-4093-434a-a573-35bb51264212'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:58.405167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dbf4d7d5-4093-434a-a573-35bb51264212 tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '03ac750f84a24e59af23f18e385a7e6b', 'request_id': 'req-dbf4d7d5-4093-434a-a573-35bb51264212'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:58.416772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4d594-946b-46f1-95a3-2ec442f065eb admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:58.420324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dbf4d7d5-4093-434a-a573-35bb51264212 tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '03ac750f84a24e59af23f18e385a7e6b', 'request_id': 'req-dbf4d7d5-4093-434a-a573-35bb51264212'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:58.431204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4edc1-73a2-40c6-bd1d-6645960f3e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:58.433454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4edc1-73a2-40c6-bd1d-6645960f3e55 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:58.444884 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4edc1-73a2-40c6-bd1d-6645960f3e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:58.444884 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4edc1-73a2-40c6-bd1d-6645960f3e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:58.444884 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f4edc1-73a2-40c6-bd1d-6645960f3e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:58.445114 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3106/6255] 10.222.0.39 () {58 vars in 1254 bytes} [Sun Aug 7 01:40:58 2022] DELETE /identity/v3/OS-TRUST/trusts/03ac750f84a24e59af23f18e385a7e6b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:58.445201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f4edc1-73a2-40c6-bd1d-6645960f3e55 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:58.449472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4d7d5-4093-434a-a573-35bb51264212 tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:58.452503 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-dbf4d7d5-4093-434a-a573-35bb51264212 tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:58.482238 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3150/6256] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:58 2022] GET /identity/v3/roles => generated 1891 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:58.483153 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4edc1-73a2-40c6-bd1d-6645960f3e55 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:58.490812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f4f4edc1-73a2-40c6-bd1d-6645960f3e55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:58.498605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4d7d5-4093-434a-a573-35bb51264212 tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:58.511768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b510e02-dbea-4710-b268-fb8abe1417cf tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1370a51382bf4aa2aa556409a0416981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b4f6a42db0a94c9f8eade64ef6076cf5', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-216218669', 'tempest-DelegatedRole-552919537'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:58.514494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b510e02-dbea-4710-b268-fb8abe1417cf tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:58.514882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b510e02-dbea-4710-b268-fb8abe1417cf tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:58.515259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b510e02-dbea-4710-b268-fb8abe1417cf tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] PATH_INFO: `/v3/OS-TRUST/trusts/03ac750f84a24e59af23f18e385a7e6b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:58.517735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4edc1-73a2-40c6-bd1d-6645960f3e55 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:58.535941 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-2b510e02-dbea-4710-b268-fb8abe1417cf tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] Could not find trust: 03ac750f84a24e59af23f18e385a7e6b.: keystone.exception.TrustNotFound: Could not find trust: 03ac750f84a24e59af23f18e385a7e6b. Aug 07 01:40:58.535941 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:40:58.535941 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:40:58.535941 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:40:58.535941 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:40:58.535941 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:40:58.535941 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:40:58.535941 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:40:58.535941 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:40:58.535941 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:40:58.535941 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:40:58.535941 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:40:58.535941 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Aug 07 01:40:58.535941 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Aug 07 01:40:58.535941 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Aug 07 01:40:58.537512 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Aug 07 01:40:58.537512 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 07 01:40:58.537512 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 07 01:40:58.537512 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Aug 07 01:40:58.537512 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Aug 07 01:40:58.537512 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:40:58.537512 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:40:58.537512 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Aug 07 01:40:58.537512 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Aug 07 01:40:58.537512 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Aug 07 01:40:58.537512 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Aug 07 01:40:58.537512 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 03ac750f84a24e59af23f18e385a7e6b. Aug 07 01:40:58.537512 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:40:58.537512 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3107/6257] 10.222.0.39 () {58 vars in 1251 bytes} [Sun Aug 7 01:40:58 2022] GET /identity/v3/OS-TRUST/trusts/03ac750f84a24e59af23f18e385a7e6b => generated 111 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:40:58.547981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdee66e-f74c-41f2-bb9d-c7f641a65c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:58.551211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdee66e-f74c-41f2-bb9d-c7f641a65c26 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:58.551211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdee66e-f74c-41f2-bb9d-c7f641a65c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:58.551595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdee66e-f74c-41f2-bb9d-c7f641a65c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:58.552893 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdee66e-f74c-41f2-bb9d-c7f641a65c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:58.553470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b510e02-dbea-4710-b268-fb8abe1417cf tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:58.555616 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2b510e02-dbea-4710-b268-fb8abe1417cf tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:58.560057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdee66e-f74c-41f2-bb9d-c7f641a65c26 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:58.593692 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3151/6258] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:58 2022] GET /identity/v3/roles => generated 1891 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:40:58.594933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdee66e-f74c-41f2-bb9d-c7f641a65c26 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:58.606383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdee66e-f74c-41f2-bb9d-c7f641a65c26 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:58.615548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a466a9b-9d1d-4425-bf28-d2f73b9b6b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:58.615919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a466a9b-9d1d-4425-bf28-d2f73b9b6b65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:58.618171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a466a9b-9d1d-4425-bf28-d2f73b9b6b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:58.618477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a466a9b-9d1d-4425-bf28-d2f73b9b6b65 admin admin] PATH_INFO: `/v3/projects/0955236950324e559cbed3438d138060/users/ffb075b025f14df494f683dd10365d8e/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:58.640070 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:58.665182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a466a9b-9d1d-4425-bf28-d2f73b9b6b65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0955236950324e559cbed3438d138060, user_id=ffb075b025f14df494f683dd10365d8e, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:58.665182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a466a9b-9d1d-4425-bf28-d2f73b9b6b65 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:58.689171 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3152/6259] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:58 2022] PUT /identity/v3/projects/0955236950324e559cbed3438d138060/users/ffb075b025f14df494f683dd10365d8e/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:58.702963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c5b25-7bc8-419a-b055-a381e111f85f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:58.703281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c5b25-7bc8-419a-b055-a381e111f85f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:58.703862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c5b25-7bc8-419a-b055-a381e111f85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:58.739557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b510e02-dbea-4710-b268-fb8abe1417cf tempest-TrustsV3TestJSON-918458253 tempest-user-1244879271] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:58.771493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-932c5b25-7bc8-419a-b055-a381e111f85f None None] MFA Rules not processed for user `ffb075b025f14df494f683dd10365d8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:40:58.772786 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-932c5b25-7bc8-419a-b055-a381e111f85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:58.857149 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:58.885965 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf8df5-2945-4d13-81e1-37141cb3b8ee tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:58.886607 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf8df5-2945-4d13-81e1-37141cb3b8ee tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:58.886907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf8df5-2945-4d13-81e1-37141cb3b8ee tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:58.887164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf8df5-2945-4d13-81e1-37141cb3b8ee tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/roles/b89668afda684b1eb8127ce5e2fffee7` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:58.890576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf8df5-2945-4d13-81e1-37141cb3b8ee tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b89668afda684b1eb8127ce5e2fffee7)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:58.892689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf8df5-2945-4d13-81e1-37141cb3b8ee tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:58.895903 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3153/6260] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:40:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:40:58.896899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c5b25-7bc8-419a-b055-a381e111f85f None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:58.971305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-43bf8df5-2945-4d13-81e1-37141cb3b8ee tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invalidating the token cache because role b89668afda684b1eb8127ce5e2fffee7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:40:58.971626 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-43bf8df5-2945-4d13-81e1-37141cb3b8ee tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:58.973328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-43bf8df5-2945-4d13-81e1-37141cb3b8ee tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:58.975682 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3108/6261] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:40:58 2022] DELETE /identity/v3/roles/b89668afda684b1eb8127ce5e2fffee7 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:58.979707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf8df5-2945-4d13-81e1-37141cb3b8ee tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:58.981974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-43bf8df5-2945-4d13-81e1-37141cb3b8ee tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:58.984769 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c5b25-7bc8-419a-b055-a381e111f85f None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:59.105877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf908d1-9b14-470e-9ff2-0f757c93ccd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:59.106672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf908d1-9b14-470e-9ff2-0f757c93ccd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:59.107110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf908d1-9b14-470e-9ff2-0f757c93ccd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:59.107646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf908d1-9b14-470e-9ff2-0f757c93ccd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:59.108733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf908d1-9b14-470e-9ff2-0f757c93ccd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:59.113843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf908d1-9b14-470e-9ff2-0f757c93ccd2 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:59.129938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf8df5-2945-4d13-81e1-37141cb3b8ee tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:59.139511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83df167-0413-4721-979b-3ae800e53246 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:59.140617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83df167-0413-4721-979b-3ae800e53246 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:59.141023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83df167-0413-4721-979b-3ae800e53246 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:59.141423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83df167-0413-4721-979b-3ae800e53246 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/roles/709d7967866d4a3293733092fef2789c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:59.143555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83df167-0413-4721-979b-3ae800e53246 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:delete_role(role_id=709d7967866d4a3293733092fef2789c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:59.150799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83df167-0413-4721-979b-3ae800e53246 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:59.166346 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3154/6262] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:40:58 2022] POST /identity/v3/projects => generated 371 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:40:59.170605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf908d1-9b14-470e-9ff2-0f757c93ccd2 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:59.174611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fdf908d1-9b14-470e-9ff2-0f757c93ccd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:59.238491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a83df167-0413-4721-979b-3ae800e53246 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invalidating the token cache because role 709d7967866d4a3293733092fef2789c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:40:59.238792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a83df167-0413-4721-979b-3ae800e53246 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:59.244252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a83df167-0413-4721-979b-3ae800e53246 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:59.252081 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3109/6263] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:40:58 2022] DELETE /identity/v3/roles/709d7967866d4a3293733092fef2789c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:40:59.253064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83df167-0413-4721-979b-3ae800e53246 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:59.261167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a83df167-0413-4721-979b-3ae800e53246 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:59.338999 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:59.392926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf908d1-9b14-470e-9ff2-0f757c93ccd2 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:59.426485 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:40:59.458395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83df167-0413-4721-979b-3ae800e53246 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:59.488485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f8f46-0655-49b9-a649-529baaa763a1 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:59.490792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f8f46-0655-49b9-a649-529baaa763a1 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:59.492335 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f8f46-0655-49b9-a649-529baaa763a1 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:59.492688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f8f46-0655-49b9-a649-529baaa763a1 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/users/1370a51382bf4aa2aa556409a0416981` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:59.497421 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352f8f46-0655-49b9-a649-529baaa763a1 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1370a51382bf4aa2aa556409a0416981)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:59.501352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352f8f46-0655-49b9-a649-529baaa763a1 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:59.597080 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e564c-f782-4a7f-ad44-b44c89f48479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:59.598951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e564c-f782-4a7f-ad44-b44c89f48479 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:59.603470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e564c-f782-4a7f-ad44-b44c89f48479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:59.605755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e564c-f782-4a7f-ad44-b44c89f48479 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:59.609092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e564c-f782-4a7f-ad44-b44c89f48479 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:59.614980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e564c-f782-4a7f-ad44-b44c89f48479 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:59.659427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-352f8f46-0655-49b9-a649-529baaa763a1 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1370a51382bf4aa2aa556409a0416981'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:59.683382 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3155/6264] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:40:59 2022] POST /identity/v3/users => generated 292 bytes in 513 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:40:59.694625 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e564c-f782-4a7f-ad44-b44c89f48479 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:59.698552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a13e564c-f782-4a7f-ad44-b44c89f48479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:59.710151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-352f8f46-0655-49b9-a649-529baaa763a1 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1370a51382bf4aa2aa556409a0416981'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:59.719147 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e564c-f782-4a7f-ad44-b44c89f48479 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:59.725536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267e169-91db-4e09-afce-42d1f9a5554b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:59.726670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267e169-91db-4e09-afce-42d1f9a5554b admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:59.727163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267e169-91db-4e09-afce-42d1f9a5554b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:59.727745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267e169-91db-4e09-afce-42d1f9a5554b admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:59.728648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267e169-91db-4e09-afce-42d1f9a5554b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:59.730491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7267e169-91db-4e09-afce-42d1f9a5554b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:59.749630 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3156/6265] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:40:59.755629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267e169-91db-4e09-afce-42d1f9a5554b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:59.763571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-352f8f46-0655-49b9-a649-529baaa763a1 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1370a51382bf4aa2aa556409a0416981'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:59.768330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-352f8f46-0655-49b9-a649-529baaa763a1 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1370a51382bf4aa2aa556409a0416981'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:59.779239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7267e169-91db-4e09-afce-42d1f9a5554b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:40:59.791239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-352f8f46-0655-49b9-a649-529baaa763a1 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1370a51382bf4aa2aa556409a0416981'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:40:59.793174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d63766-6789-4cb2-a0a3-becc02f7a8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:40:59.794549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d63766-6789-4cb2-a0a3-becc02f7a8c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:40:59.795610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d63766-6789-4cb2-a0a3-becc02f7a8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:40:59.796382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d63766-6789-4cb2-a0a3-becc02f7a8c3 admin admin] PATH_INFO: `/v3/projects/653eb34e68cc4f09badb885fdda402c5/users/e92715fa5a1c4e9f87e22d29544d4df8/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:40:59.816746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d63766-6789-4cb2-a0a3-becc02f7a8c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=653eb34e68cc4f09badb885fdda402c5, user_id=e92715fa5a1c4e9f87e22d29544d4df8, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:40:59.820876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d63766-6789-4cb2-a0a3-becc02f7a8c3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:40:59.827167 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3110/6266] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:40:59 2022] DELETE /identity/v3/users/1370a51382bf4aa2aa556409a0416981 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:40:59.828453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f8f46-0655-49b9-a649-529baaa763a1 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:59.829959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-352f8f46-0655-49b9-a649-529baaa763a1 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:40:59.850138 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3157/6267] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:40:59 2022] PUT /identity/v3/projects/653eb34e68cc4f09badb885fdda402c5/users/e92715fa5a1c4e9f87e22d29544d4df8/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:40:59.853502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d63766-6789-4cb2-a0a3-becc02f7a8c3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:40:59.856411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-11d63766-6789-4cb2-a0a3-becc02f7a8c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:00.007916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f8f46-0655-49b9-a649-529baaa763a1 tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:00.030565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d63766-6789-4cb2-a0a3-becc02f7a8c3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:00.046715 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1961db-1d48-491c-8949-b0f2d6ac1fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:00.047362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1961db-1d48-491c-8949-b0f2d6ac1fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:00.047798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1961db-1d48-491c-8949-b0f2d6ac1fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:00.048101 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1961db-1d48-491c-8949-b0f2d6ac1fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:00.048763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1961db-1d48-491c-8949-b0f2d6ac1fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:00.051625 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1961db-1d48-491c-8949-b0f2d6ac1fa4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:00.095334 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:00.124970 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3158/6268] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:00.126839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1961db-1d48-491c-8949-b0f2d6ac1fa4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:00.135789 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609276e0-76c5-4a46-b2b9-21cb28be652d tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e4fc26c03184400a8e1048cfb7c5e5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d954f4585c348faafea870792faf488', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:00.136470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609276e0-76c5-4a46-b2b9-21cb28be652d tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:00.136748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609276e0-76c5-4a46-b2b9-21cb28be652d tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:00.137015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609276e0-76c5-4a46-b2b9-21cb28be652d tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] PATH_INFO: `/v3/projects/b4f6a42db0a94c9f8eade64ef6076cf5` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:00.139350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609276e0-76c5-4a46-b2b9-21cb28be652d tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b4f6a42db0a94c9f8eade64ef6076cf5)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:00.142196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609276e0-76c5-4a46-b2b9-21cb28be652d tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:00.167461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1961db-1d48-491c-8949-b0f2d6ac1fa4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:00.186917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee6b59-6c52-478d-8a81-81d8d616bde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:00.187617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee6b59-6c52-478d-8a81-81d8d616bde9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:00.187911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee6b59-6c52-478d-8a81-81d8d616bde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:00.188196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee6b59-6c52-478d-8a81-81d8d616bde9 admin admin] PATH_INFO: `/v3/projects/653eb34e68cc4f09badb885fdda402c5/users/e92715fa5a1c4e9f87e22d29544d4df8/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:00.194829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee6b59-6c52-478d-8a81-81d8d616bde9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=653eb34e68cc4f09badb885fdda402c5, user_id=e92715fa5a1c4e9f87e22d29544d4df8, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:00.197919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee6b59-6c52-478d-8a81-81d8d616bde9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:00.273004 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3159/6269] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:00 2022] PUT /identity/v3/projects/653eb34e68cc4f09badb885fdda402c5/users/e92715fa5a1c4e9f87e22d29544d4df8/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:00.274613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1f49a-003a-419d-9fd0-cb0dd738a236 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:00.274904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1f49a-003a-419d-9fd0-cb0dd738a236 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:00.275186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1f49a-003a-419d-9fd0-cb0dd738a236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:00.355748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2bd1f49a-003a-419d-9fd0-cb0dd738a236 None None] MFA Rules not processed for user `e92715fa5a1c4e9f87e22d29544d4df8`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:00.357083 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2bd1f49a-003a-419d-9fd0-cb0dd738a236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:00.376808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-609276e0-76c5-4a46-b2b9-21cb28be652d tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4f6a42db0a94c9f8eade64ef6076cf5', 'request_id': 'req-609276e0-76c5-4a46-b2b9-21cb28be652d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:00.391185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-609276e0-76c5-4a46-b2b9-21cb28be652d tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4f6a42db0a94c9f8eade64ef6076cf5', 'request_id': 'req-609276e0-76c5-4a46-b2b9-21cb28be652d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:00.405193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-609276e0-76c5-4a46-b2b9-21cb28be652d tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4f6a42db0a94c9f8eade64ef6076cf5', 'request_id': 'req-609276e0-76c5-4a46-b2b9-21cb28be652d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:00.430747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-609276e0-76c5-4a46-b2b9-21cb28be652d tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] The token cache is being invalidate because project b4f6a42db0a94c9f8eade64ef6076cf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:00.430747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-609276e0-76c5-4a46-b2b9-21cb28be652d tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:00.431768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-609276e0-76c5-4a46-b2b9-21cb28be652d tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:00.433891 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3111/6270] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:40:59 2022] DELETE /identity/v3/projects/b4f6a42db0a94c9f8eade64ef6076cf5 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:41:00.439848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609276e0-76c5-4a46-b2b9-21cb28be652d tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:00.444470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-609276e0-76c5-4a46-b2b9-21cb28be652d tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:00.454913 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:00.534056 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3160/6271] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:00.535261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1f49a-003a-419d-9fd0-cb0dd738a236 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:00.547901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1f49a-003a-419d-9fd0-cb0dd738a236 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:00.554180 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02435d28-c6ba-43c0-a689-ff488c17def8 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:00.555270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02435d28-c6ba-43c0-a689-ff488c17def8 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:00.555765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02435d28-c6ba-43c0-a689-ff488c17def8 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:00.557496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02435d28-c6ba-43c0-a689-ff488c17def8 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:00.558521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02435d28-c6ba-43c0-a689-ff488c17def8 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:00.569228 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02435d28-c6ba-43c0-a689-ff488c17def8 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:00.601356 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3161/6272] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:00 2022] POST /identity/v3/services => generated 289 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:00.604694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02435d28-c6ba-43c0-a689-ff488c17def8 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:00.605357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609276e0-76c5-4a46-b2b9-21cb28be652d tempest-TrustsV3TestJSON-1789051302 tempest-TrustsV3TestJSON-1789051302-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:00.624682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d866c-67a8-4697-a705-35723af682c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:00.625499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d866c-67a8-4697-a705-35723af682c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:00.625628 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d866c-67a8-4697-a705-35723af682c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:00.625903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d866c-67a8-4697-a705-35723af682c2 admin admin] PATH_INFO: `/v3/users/64df910d4bc04b96886606b6c490b8a5` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:00.627658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d866c-67a8-4697-a705-35723af682c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64df910d4bc04b96886606b6c490b8a5)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:00.630326 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d866c-67a8-4697-a705-35723af682c2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:00.656836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02435d28-c6ba-43c0-a689-ff488c17def8 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:00.669846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0d1e8-692b-4eba-bac2-85dd5674ca6d tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:00.673077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0d1e8-692b-4eba-bac2-85dd5674ca6d tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:00.673530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0d1e8-692b-4eba-bac2-85dd5674ca6d tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:00.674435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0d1e8-692b-4eba-bac2-85dd5674ca6d tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:00.677733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0d1e8-692b-4eba-bac2-85dd5674ca6d tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:00.679917 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-26d0d1e8-692b-4eba-bac2-85dd5674ca6d tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:41:00.679917 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:41:00.679917 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:41:00.682572 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0d1e8-692b-4eba-bac2-85dd5674ca6d tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:00.723336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d17d866c-67a8-4697-a705-35723af682c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64df910d4bc04b96886606b6c490b8a5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:00.739819 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-26d0d1e8-692b-4eba-bac2-85dd5674ca6d tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2087925935. To ensure interoperability, identifiers should be a valid uuid. Aug 07 01:41:00.739819 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 07 01:41:00.739819 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:41:00.775550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d17d866c-67a8-4697-a705-35723af682c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64df910d4bc04b96886606b6c490b8a5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:00.801459 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:00.837455 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3162/6273] 10.222.0.39 () {60 vars in 1156 bytes} [Sun Aug 7 01:41:00 2022] POST /identity/v3/endpoints => generated 361 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:00.837667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d17d866c-67a8-4697-a705-35723af682c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64df910d4bc04b96886606b6c490b8a5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:00.839721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0d1e8-692b-4eba-bac2-85dd5674ca6d tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:00.841462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d17d866c-67a8-4697-a705-35723af682c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64df910d4bc04b96886606b6c490b8a5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:00.860036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d17d866c-67a8-4697-a705-35723af682c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64df910d4bc04b96886606b6c490b8a5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:00.881171 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3112/6274] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:41:00 2022] DELETE /identity/v3/users/64df910d4bc04b96886606b6c490b8a5 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:41:00.887323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd0cbc-013b-430e-881f-7294b2dbc219 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:00.887959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd0cbc-013b-430e-881f-7294b2dbc219 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:00.888298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd0cbc-013b-430e-881f-7294b2dbc219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:00.900660 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0d1e8-692b-4eba-bac2-85dd5674ca6d tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:00.974040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b4cd0cbc-013b-430e-881f-7294b2dbc219 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:00.985589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b4cd0cbc-013b-430e-881f-7294b2dbc219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:01.063731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c24a60-0083-42d0-a94a-f06730c1c3f6 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:01.066145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c24a60-0083-42d0-a94a-f06730c1c3f6 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:01.066145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c24a60-0083-42d0-a94a-f06730c1c3f6 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:01.066145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c24a60-0083-42d0-a94a-f06730c1c3f6 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/regions/tempest-region-2087925935` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:01.066778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c24a60-0083-42d0-a94a-f06730c1c3f6 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-2087925935)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:01.069311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c24a60-0083-42d0-a94a-f06730c1c3f6 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:01.082859 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3163/6275] 10.222.0.39 () {58 vars in 1206 bytes} [Sun Aug 7 01:41:00 2022] GET /identity/v3/regions/tempest-region-2087925935 => generated 180 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:01.088583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c24a60-0083-42d0-a94a-f06730c1c3f6 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:01.093459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e6c24a60-0083-42d0-a94a-f06730c1c3f6 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:01.155188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c24a60-0083-42d0-a94a-f06730c1c3f6 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:01.164426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c688e2-fa24-48a7-b409-8226d1700173 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:01.165081 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c688e2-fa24-48a7-b409-8226d1700173 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:01.165360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c688e2-fa24-48a7-b409-8226d1700173 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:01.166003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c688e2-fa24-48a7-b409-8226d1700173 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:01.166275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c688e2-fa24-48a7-b409-8226d1700173 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:01.167876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c688e2-fa24-48a7-b409-8226d1700173 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:01.213568 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3164/6276] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:01 2022] POST /identity/v3/services => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:01.218716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c688e2-fa24-48a7-b409-8226d1700173 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:01.251793 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3113/6277] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:00 2022] POST /identity/v3/auth/tokens => generated 3689 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:01.296168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd0cbc-013b-430e-881f-7294b2dbc219 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:01.297997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c688e2-fa24-48a7-b409-8226d1700173 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:01.299081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b4cd0cbc-013b-430e-881f-7294b2dbc219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:01.307878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059424e-1e4d-482b-8dac-ef47470f6ad0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:01.308485 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059424e-1e4d-482b-8dac-ef47470f6ad0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:01.308761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059424e-1e4d-482b-8dac-ef47470f6ad0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:01.309033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059424e-1e4d-482b-8dac-ef47470f6ad0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:01.309706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059424e-1e4d-482b-8dac-ef47470f6ad0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:01.311297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059424e-1e4d-482b-8dac-ef47470f6ad0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:01.372572 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-e059424e-1e4d-482b-8dac-ef47470f6ad0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1373872853. To ensure interoperability, identifiers should be a valid uuid. Aug 07 01:41:01.372572 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 07 01:41:01.372572 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:41:01.464851 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3165/6278] 10.222.0.39 () {60 vars in 1156 bytes} [Sun Aug 7 01:41:01 2022] POST /identity/v3/endpoints => generated 362 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:01.469686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059424e-1e4d-482b-8dac-ef47470f6ad0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:01.525963 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:01.531498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059424e-1e4d-482b-8dac-ef47470f6ad0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:01.549490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd0cbc-013b-430e-881f-7294b2dbc219 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:01.549741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d544055-f534-489b-9d94-7a9a81bca8ee tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:01.550405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d544055-f534-489b-9d94-7a9a81bca8ee tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:01.551071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d544055-f534-489b-9d94-7a9a81bca8ee tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:01.551071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d544055-f534-489b-9d94-7a9a81bca8ee tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/regions/tempest-region-1373872853` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:01.552098 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d544055-f534-489b-9d94-7a9a81bca8ee tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1373872853)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:01.553181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d544055-f534-489b-9d94-7a9a81bca8ee tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:01.564546 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3166/6279] 10.222.0.39 () {58 vars in 1206 bytes} [Sun Aug 7 01:41:01 2022] GET /identity/v3/regions/tempest-region-1373872853 => generated 180 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:01.566510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d544055-f534-489b-9d94-7a9a81bca8ee tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:01.587755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d544055-f534-489b-9d94-7a9a81bca8ee tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:01.590924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000eff12-f58e-4246-ae7e-5d72750918c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:01.591761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000eff12-f58e-4246-ae7e-5d72750918c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:01.592278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000eff12-f58e-4246-ae7e-5d72750918c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:01.594174 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000eff12-f58e-4246-ae7e-5d72750918c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:01.614383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c3d5a-105f-43d6-bcc9-026aed8b81d3 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:01.615637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c3d5a-105f-43d6-bcc9-026aed8b81d3 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:01.634059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c3d5a-105f-43d6-bcc9-026aed8b81d3 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:01.634374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c3d5a-105f-43d6-bcc9-026aed8b81d3 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:01.635371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c3d5a-105f-43d6-bcc9-026aed8b81d3 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:01.640832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c3d5a-105f-43d6-bcc9-026aed8b81d3 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:01.656362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000eff12-f58e-4246-ae7e-5d72750918c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:01.659510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000eff12-f58e-4246-ae7e-5d72750918c8 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:01.701170 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-0f6c3d5a-105f-43d6-bcc9-026aed8b81d3 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-126193453. To ensure interoperability, identifiers should be a valid uuid. Aug 07 01:41:01.701170 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 07 01:41:01.701170 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:41:01.724051 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3114/6280] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:01 2022] GET /identity/v3/auth/tokens => generated 3873 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:41:01.774868 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3167/6281] 10.222.0.39 () {60 vars in 1156 bytes} [Sun Aug 7 01:41:01 2022] POST /identity/v3/endpoints => generated 359 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:01.775597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000eff12-f58e-4246-ae7e-5d72750918c8 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:01.824083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000eff12-f58e-4246-ae7e-5d72750918c8 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:01.869368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f8489-99fc-4d81-a81e-d9980847a2d0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:01.871721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f8489-99fc-4d81-a81e-d9980847a2d0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:01.872247 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f8489-99fc-4d81-a81e-d9980847a2d0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:01.872715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f8489-99fc-4d81-a81e-d9980847a2d0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/regions/tempest-region-126193453` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:01.876011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f8489-99fc-4d81-a81e-d9980847a2d0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-126193453)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:01.880463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f8489-99fc-4d81-a81e-d9980847a2d0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:01.890425 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3115/6282] 10.222.0.39 () {58 vars in 1203 bytes} [Sun Aug 7 01:41:01 2022] GET /identity/v3/regions/tempest-region-126193453 => generated 178 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:01.890641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c3d5a-105f-43d6-bcc9-026aed8b81d3 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:01.911415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c3d5a-105f-43d6-bcc9-026aed8b81d3 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:01.924921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446555b-af81-41d3-b69d-1f1f8e992d6c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:01.925607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446555b-af81-41d3-b69d-1f1f8e992d6c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:01.927576 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446555b-af81-41d3-b69d-1f1f8e992d6c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:01.930908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446555b-af81-41d3-b69d-1f1f8e992d6c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:01.932273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446555b-af81-41d3-b69d-1f1f8e992d6c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:01.933318 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-c446555b-af81-41d3-b69d-1f1f8e992d6c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:41:01.933318 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:41:01.933318 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:41:01.937220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446555b-af81-41d3-b69d-1f1f8e992d6c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:01.980155 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3168/6283] 10.222.0.39 () {58 vars in 1134 bytes} [Sun Aug 7 01:41:01 2022] GET /identity/v3/endpoints => generated 4396 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:01.984601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f8489-99fc-4d81-a81e-d9980847a2d0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:02.002030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f8489-99fc-4d81-a81e-d9980847a2d0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:02.036389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebece38b-2f4a-4ccf-b8ac-599b1099258c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:02.036389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebece38b-2f4a-4ccf-b8ac-599b1099258c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:02.036389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebece38b-2f4a-4ccf-b8ac-599b1099258c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:02.037059 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebece38b-2f4a-4ccf-b8ac-599b1099258c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/endpoints/b4c7ca25bab14a38a7a4f617a51e9f84` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:02.065944 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebece38b-2f4a-4ccf-b8ac-599b1099258c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=b4c7ca25bab14a38a7a4f617a51e9f84)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:02.066474 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-ebece38b-2f4a-4ccf-b8ac-599b1099258c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:41:02.066474 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:41:02.066474 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:41:02.067424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebece38b-2f4a-4ccf-b8ac-599b1099258c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:02.069206 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3116/6284] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:41:01 2022] GET /identity/v3/endpoints/b4c7ca25bab14a38a7a4f617a51e9f84 => generated 359 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:02.073334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446555b-af81-41d3-b69d-1f1f8e992d6c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:02.091248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446555b-af81-41d3-b69d-1f1f8e992d6c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:02.110157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd9980-7b7a-46de-a46a-51c8b6973ed9 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:02.111474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd9980-7b7a-46de-a46a-51c8b6973ed9 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:02.111943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd9980-7b7a-46de-a46a-51c8b6973ed9 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:02.112400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd9980-7b7a-46de-a46a-51c8b6973ed9 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/endpoints/b4c7ca25bab14a38a7a4f617a51e9f84` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:02.115379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd9980-7b7a-46de-a46a-51c8b6973ed9 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=b4c7ca25bab14a38a7a4f617a51e9f84)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:02.118780 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-bcfd9980-7b7a-46de-a46a-51c8b6973ed9 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:41:02.118780 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:41:02.118780 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:41:02.123944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd9980-7b7a-46de-a46a-51c8b6973ed9 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:02.154465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bcfd9980-7b7a-46de-a46a-51c8b6973ed9 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'b4c7ca25bab14a38a7a4f617a51e9f84', 'request_id': 'req-bcfd9980-7b7a-46de-a46a-51c8b6973ed9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:02.187561 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3169/6285] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:41:02 2022] DELETE /identity/v3/endpoints/b4c7ca25bab14a38a7a4f617a51e9f84 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:02.189530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebece38b-2f4a-4ccf-b8ac-599b1099258c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:02.210309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebece38b-2f4a-4ccf-b8ac-599b1099258c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:02.278004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd65626-5208-422f-bcae-6d8fb6dce319 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:02.278004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd65626-5208-422f-bcae-6d8fb6dce319 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:02.278004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd65626-5208-422f-bcae-6d8fb6dce319 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:02.278757 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd65626-5208-422f-bcae-6d8fb6dce319 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:02.278757 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd65626-5208-422f-bcae-6d8fb6dce319 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:02.279589 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-dcd65626-5208-422f-bcae-6d8fb6dce319 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:41:02.279589 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:41:02.279589 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:41:02.280504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd65626-5208-422f-bcae-6d8fb6dce319 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:02.323332 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3117/6286] 10.222.0.39 () {58 vars in 1134 bytes} [Sun Aug 7 01:41:02 2022] GET /identity/v3/endpoints => generated 4050 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:02.326127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd9980-7b7a-46de-a46a-51c8b6973ed9 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:02.349641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd9980-7b7a-46de-a46a-51c8b6973ed9 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:02.374157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750ddcf-037a-492f-b030-4029c0b3ba36 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:02.380731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750ddcf-037a-492f-b030-4029c0b3ba36 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:02.382787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750ddcf-037a-492f-b030-4029c0b3ba36 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:02.383185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750ddcf-037a-492f-b030-4029c0b3ba36 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/endpoints/b4c7ca25bab14a38a7a4f617a51e9f84` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:02.403106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750ddcf-037a-492f-b030-4029c0b3ba36 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:41:02.440922 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-d750ddcf-037a-492f-b030-4029c0b3ba36 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Could not find endpoint: b4c7ca25bab14a38a7a4f617a51e9f84.: keystone.exception.EndpointNotFound: Could not find endpoint: b4c7ca25bab14a38a7a4f617a51e9f84. Aug 07 01:41:02.440922 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:41:02.440922 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Aug 07 01:41:02.440922 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Aug 07 01:41:02.440922 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Aug 07 01:41:02.440922 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._iter().one() Aug 07 01:41:02.440922 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Aug 07 01:41:02.440922 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._only_one_row( Aug 07 01:41:02.440922 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Aug 07 01:41:02.440922 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exc.NoResultFound( Aug 07 01:41:02.440922 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Aug 07 01:41:02.440922 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:41:02.440922 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:41:02.440922 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:41:02.440922 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:41:02.440922 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Aug 07 01:41:02.442233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Aug 07 01:41:02.442233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Aug 07 01:41:02.442233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Aug 07 01:41:02.442233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Aug 07 01:41:02.442233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Aug 07 01:41:02.442233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: b4c7ca25bab14a38a7a4f617a51e9f84. Aug 07 01:41:02.442233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:41:02.442233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:41:02.442233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:41:02.442233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:41:02.442233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:41:02.442233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:41:02.442233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:41:02.442233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:41:02.442233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:41:02.442233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:41:02.442233 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:41:02.445138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:41:02.445138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:41:02.445138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:41:02.445138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Aug 07 01:41:02.445138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Aug 07 01:41:02.445138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:41:02.445138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:41:02.445138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:41:02.445138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:41:02.445138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:41:02.445138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:41:02.445138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:41:02.445138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:41:02.445138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:41:02.445138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:41:02.445138 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:41:02.446267 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 01:41:02.446267 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:41:02.446267 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:41:02.446267 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:41:02.446267 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:41:02.446267 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:41:02.446267 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:41:02.446267 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:41:02.446267 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:41:02.446267 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Aug 07 01:41:02.446267 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Aug 07 01:41:02.446267 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: b4c7ca25bab14a38a7a4f617a51e9f84. Aug 07 01:41:02.446267 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:41:02.450521 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3170/6287] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:41:02 2022] DELETE /identity/v3/endpoints/b4c7ca25bab14a38a7a4f617a51e9f84 => generated 114 bytes in 125 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:41:02.454905 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd65626-5208-422f-bcae-6d8fb6dce319 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:02.467578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd65626-5208-422f-bcae-6d8fb6dce319 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:02.478881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711ab33-f9b9-42eb-9028-cf164c112b8a tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:02.479482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711ab33-f9b9-42eb-9028-cf164c112b8a tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:02.479762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711ab33-f9b9-42eb-9028-cf164c112b8a tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:02.480078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711ab33-f9b9-42eb-9028-cf164c112b8a tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/regions/tempest-region-126193453` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:02.480676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711ab33-f9b9-42eb-9028-cf164c112b8a tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-126193453)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:02.481837 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-9711ab33-f9b9-42eb-9028-cf164c112b8a tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:41:02.481837 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:41:02.481837 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:41:02.482761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711ab33-f9b9-42eb-9028-cf164c112b8a tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:02.495321 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:02.536932 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-9711ab33-f9b9-42eb-9028-cf164c112b8a tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-126193453. To ensure interoperability, identifiers should be a valid uuid. Aug 07 01:41:02.536932 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 07 01:41:02.536932 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:41:02.577214 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3118/6288] 10.222.0.39 () {58 vars in 1206 bytes} [Sun Aug 7 01:41:02 2022] DELETE /identity/v3/regions/tempest-region-126193453 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:02.578543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750ddcf-037a-492f-b030-4029c0b3ba36 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:02.607413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750ddcf-037a-492f-b030-4029c0b3ba36 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:02.697250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e222589-4304-4369-a3bd-3e6e9d06152f tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:02.700183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e222589-4304-4369-a3bd-3e6e9d06152f tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:02.700654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e222589-4304-4369-a3bd-3e6e9d06152f tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:02.701081 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e222589-4304-4369-a3bd-3e6e9d06152f tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:02.701882 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e222589-4304-4369-a3bd-3e6e9d06152f tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:02.725079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e222589-4304-4369-a3bd-3e6e9d06152f tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:02.750402 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3171/6289] 10.222.0.39 () {58 vars in 1134 bytes} [Sun Aug 7 01:41:02 2022] GET /identity/v3/endpoints => generated 4050 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:02.752954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711ab33-f9b9-42eb-9028-cf164c112b8a tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:02.779857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711ab33-f9b9-42eb-9028-cf164c112b8a tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:02.810323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcbab58-6f46-46fc-857a-7bbda73a974e tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:02.811194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbab58-6f46-46fc-857a-7bbda73a974e tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:02.811590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbab58-6f46-46fc-857a-7bbda73a974e tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:02.811867 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbab58-6f46-46fc-857a-7bbda73a974e tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:02.812597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcbab58-6f46-46fc-857a-7bbda73a974e tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Adding query filter params (service_id=a0456705d623440b931760b2bb90871f) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:41:02.812949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcbab58-6f46-46fc-857a-7bbda73a974e tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:02.814672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcbab58-6f46-46fc-857a-7bbda73a974e tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:02.827962 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3119/6290] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Aug 7 01:41:02 2022] GET /identity/v3/endpoints?service_id=a0456705d623440b931760b2bb90871f => generated 503 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:41:02.829514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e222589-4304-4369-a3bd-3e6e9d06152f tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:02.847420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e222589-4304-4369-a3bd-3e6e9d06152f tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:02.878198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf113df-ccf7-44ef-aef4-b7b4fd5c6099 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:02.878574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf113df-ccf7-44ef-aef4-b7b4fd5c6099 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:02.878853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf113df-ccf7-44ef-aef4-b7b4fd5c6099 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:02.879199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf113df-ccf7-44ef-aef4-b7b4fd5c6099 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:02.879822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf113df-ccf7-44ef-aef4-b7b4fd5c6099 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Adding query filter params (service_id=548f0d5801ad4b8f94f4a9bda1fb42e9) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:41:02.880153 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf113df-ccf7-44ef-aef4-b7b4fd5c6099 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:02.895558 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf113df-ccf7-44ef-aef4-b7b4fd5c6099 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:02.929174 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3172/6291] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Aug 7 01:41:02 2022] GET /identity/v3/endpoints?service_id=548f0d5801ad4b8f94f4a9bda1fb42e9 => generated 504 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:02.933771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcbab58-6f46-46fc-857a-7bbda73a974e tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:02.959725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcbab58-6f46-46fc-857a-7bbda73a974e tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:02.977941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79414fad-2fd7-4738-86c4-80925acb7651 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:02.978589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79414fad-2fd7-4738-86c4-80925acb7651 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:02.978907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79414fad-2fd7-4738-86c4-80925acb7651 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:02.979188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79414fad-2fd7-4738-86c4-80925acb7651 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:02.980061 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79414fad-2fd7-4738-86c4-80925acb7651 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:41:02.980396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79414fad-2fd7-4738-86c4-80925acb7651 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:02.982651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79414fad-2fd7-4738-86c4-80925acb7651 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:03.010358 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3120/6292] 10.222.0.39 () {58 vars in 1167 bytes} [Sun Aug 7 01:41:02 2022] GET /identity/v3/endpoints?interface=public => generated 3406 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:03.014746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf113df-ccf7-44ef-aef4-b7b4fd5c6099 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:03.047035 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf113df-ccf7-44ef-aef4-b7b4fd5c6099 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:03.068058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ea05c-4704-4fb7-b261-c2252f3e9cd0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:03.068694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ea05c-4704-4fb7-b261-c2252f3e9cd0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:03.068972 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ea05c-4704-4fb7-b261-c2252f3e9cd0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:03.069246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ea05c-4704-4fb7-b261-c2252f3e9cd0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:03.069914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ea05c-4704-4fb7-b261-c2252f3e9cd0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:41:03.070215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ea05c-4704-4fb7-b261-c2252f3e9cd0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:03.071838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ea05c-4704-4fb7-b261-c2252f3e9cd0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:03.099297 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3173/6293] 10.222.0.39 () {58 vars in 1171 bytes} [Sun Aug 7 01:41:03 2022] GET /identity/v3/endpoints?interface=internal => generated 479 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:03.104304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79414fad-2fd7-4738-86c4-80925acb7651 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:03.126894 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79414fad-2fd7-4738-86c4-80925acb7651 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:03.140293 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a135d5c-fec7-4e86-8b9a-9f050cc54117 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:03.140933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a135d5c-fec7-4e86-8b9a-9f050cc54117 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:03.141213 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a135d5c-fec7-4e86-8b9a-9f050cc54117 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:03.141489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a135d5c-fec7-4e86-8b9a-9f050cc54117 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:03.144527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a135d5c-fec7-4e86-8b9a-9f050cc54117 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:03.152939 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-3a135d5c-fec7-4e86-8b9a-9f050cc54117 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:41:03.152939 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:41:03.152939 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:41:03.154184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a135d5c-fec7-4e86-8b9a-9f050cc54117 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:03.189153 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3121/6294] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:03 2022] POST /identity/v3/services => generated 288 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:03.191732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ea05c-4704-4fb7-b261-c2252f3e9cd0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:03.208512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ea05c-4704-4fb7-b261-c2252f3e9cd0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:03.241340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdec2e1-c43c-4081-b994-8911cf94d3e6 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:03.242491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdec2e1-c43c-4081-b994-8911cf94d3e6 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:03.243174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdec2e1-c43c-4081-b994-8911cf94d3e6 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:03.243666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdec2e1-c43c-4081-b994-8911cf94d3e6 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:03.244597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdec2e1-c43c-4081-b994-8911cf94d3e6 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:03.246526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdec2e1-c43c-4081-b994-8911cf94d3e6 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:03.299547 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-6bdec2e1-c43c-4081-b994-8911cf94d3e6 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-989010657. To ensure interoperability, identifiers should be a valid uuid. Aug 07 01:41:03.299547 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 07 01:41:03.299547 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:41:03.411412 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3174/6295] 10.222.0.39 () {60 vars in 1156 bytes} [Sun Aug 7 01:41:03 2022] POST /identity/v3/endpoints => generated 358 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:41:03.413252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a135d5c-fec7-4e86-8b9a-9f050cc54117 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:03.414335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdec2e1-c43c-4081-b994-8911cf94d3e6 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:03.415801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3a135d5c-fec7-4e86-8b9a-9f050cc54117 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:03.474923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdec2e1-c43c-4081-b994-8911cf94d3e6 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:03.484711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac268cec-a69f-45fa-9f0a-535bff7bc857 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:03.485364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac268cec-a69f-45fa-9f0a-535bff7bc857 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:03.485646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac268cec-a69f-45fa-9f0a-535bff7bc857 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:03.485974 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac268cec-a69f-45fa-9f0a-535bff7bc857 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/regions/tempest-region-989010657` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:03.486655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac268cec-a69f-45fa-9f0a-535bff7bc857 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-989010657)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:03.487700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac268cec-a69f-45fa-9f0a-535bff7bc857 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:03.490864 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3175/6296] 10.222.0.39 () {58 vars in 1203 bytes} [Sun Aug 7 01:41:03 2022] GET /identity/v3/regions/tempest-region-989010657 => generated 178 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:03.494515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac268cec-a69f-45fa-9f0a-535bff7bc857 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:03.522978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac268cec-a69f-45fa-9f0a-535bff7bc857 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:03.537161 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681140f-8d4a-405f-8246-6aee4bdd87c5 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:03.539164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681140f-8d4a-405f-8246-6aee4bdd87c5 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:03.539572 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681140f-8d4a-405f-8246-6aee4bdd87c5 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:03.541000 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681140f-8d4a-405f-8246-6aee4bdd87c5 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/endpoints/47dd757ef06444a89364261f9b2ac22a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:03.557279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681140f-8d4a-405f-8246-6aee4bdd87c5 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=47dd757ef06444a89364261f9b2ac22a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:03.558117 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-0681140f-8d4a-405f-8246-6aee4bdd87c5 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:41:03.558117 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:41:03.558117 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:41:03.559484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681140f-8d4a-405f-8246-6aee4bdd87c5 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:03.602376 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-0681140f-8d4a-405f-8246-6aee4bdd87c5 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1716895004. To ensure interoperability, identifiers should be a valid uuid. Aug 07 01:41:03.602376 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 07 01:41:03.602376 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:41:03.683922 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3176/6297] 10.222.0.39 () {60 vars in 1256 bytes} [Sun Aug 7 01:41:03 2022] PATCH /identity/v3/endpoints/47dd757ef06444a89364261f9b2ac22a => generated 364 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:03.687346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681140f-8d4a-405f-8246-6aee4bdd87c5 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:03.715047 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:03.742017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681140f-8d4a-405f-8246-6aee4bdd87c5 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:03.760990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bb57c-3f25-4634-8011-10a70afebc98 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:03.764051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bb57c-3f25-4634-8011-10a70afebc98 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:03.764520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bb57c-3f25-4634-8011-10a70afebc98 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:03.766702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bb57c-3f25-4634-8011-10a70afebc98 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/regions/tempest-region-1716895004` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:03.767482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bb57c-3f25-4634-8011-10a70afebc98 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1716895004)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:03.771491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bb57c-3f25-4634-8011-10a70afebc98 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:03.771817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a135d5c-fec7-4e86-8b9a-9f050cc54117 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:03.780200 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3177/6298] 10.222.0.39 () {58 vars in 1206 bytes} [Sun Aug 7 01:41:03 2022] GET /identity/v3/regions/tempest-region-1716895004 => generated 180 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:03.782298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bb57c-3f25-4634-8011-10a70afebc98 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:03.822448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bb57c-3f25-4634-8011-10a70afebc98 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:03.825966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f11f4e-c5cc-4d5e-bb71-a4fb89999177 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:03.828592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f11f4e-c5cc-4d5e-bb71-a4fb89999177 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:03.829055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f11f4e-c5cc-4d5e-bb71-a4fb89999177 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:03.829552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f11f4e-c5cc-4d5e-bb71-a4fb89999177 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:03.833105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a7f11f4e-c5cc-4d5e-bb71-a4fb89999177 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:03.839731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e675a5-2f6f-464b-bff3-d8d9f51a7fc6 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:03.840545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e675a5-2f6f-464b-bff3-d8d9f51a7fc6 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:03.840933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e675a5-2f6f-464b-bff3-d8d9f51a7fc6 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:03.841314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e675a5-2f6f-464b-bff3-d8d9f51a7fc6 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/endpoints/47dd757ef06444a89364261f9b2ac22a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:03.853762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e675a5-2f6f-464b-bff3-d8d9f51a7fc6 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=47dd757ef06444a89364261f9b2ac22a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:03.866899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e675a5-2f6f-464b-bff3-d8d9f51a7fc6 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:03.868648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f11f4e-c5cc-4d5e-bb71-a4fb89999177 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:03.870441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f11f4e-c5cc-4d5e-bb71-a4fb89999177 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:03.886836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d5e675a5-2f6f-464b-bff3-d8d9f51a7fc6 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '47dd757ef06444a89364261f9b2ac22a', 'request_id': 'req-d5e675a5-2f6f-464b-bff3-d8d9f51a7fc6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:03.916569 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3178/6299] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:41:03 2022] DELETE /identity/v3/endpoints/47dd757ef06444a89364261f9b2ac22a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:03.920539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e675a5-2f6f-464b-bff3-d8d9f51a7fc6 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:03.943023 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3122/6300] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:03 2022] GET /identity/v3/auth/tokens => generated 4139 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:03.975049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e675a5-2f6f-464b-bff3-d8d9f51a7fc6 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:03.981576 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0302599-0afc-43ee-a841-ae59ebf8e2d0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:03.982656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0302599-0afc-43ee-a841-ae59ebf8e2d0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:03.983433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0302599-0afc-43ee-a841-ae59ebf8e2d0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:03.983832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0302599-0afc-43ee-a841-ae59ebf8e2d0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/regions/tempest-region-1716895004` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:03.984777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0302599-0afc-43ee-a841-ae59ebf8e2d0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1716895004)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:03.986192 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-c0302599-0afc-43ee-a841-ae59ebf8e2d0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:41:03.986192 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:41:03.986192 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:41:03.988338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0302599-0afc-43ee-a841-ae59ebf8e2d0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:04.073530 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3179/6301] 10.222.0.39 () {58 vars in 1209 bytes} [Sun Aug 7 01:41:03 2022] DELETE /identity/v3/regions/tempest-region-1716895004 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:04.077790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f11f4e-c5cc-4d5e-bb71-a4fb89999177 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:04.108472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f11f4e-c5cc-4d5e-bb71-a4fb89999177 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:04.206458 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec0a74-75be-41b2-813d-222939a29a90 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:04.207124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec0a74-75be-41b2-813d-222939a29a90 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:04.208356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec0a74-75be-41b2-813d-222939a29a90 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:04.208618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec0a74-75be-41b2-813d-222939a29a90 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/regions/tempest-region-989010657` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:04.216236 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec0a74-75be-41b2-813d-222939a29a90 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-989010657)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:04.227177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec0a74-75be-41b2-813d-222939a29a90 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:04.261043 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-7eec0a74-75be-41b2-813d-222939a29a90 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-989010657. To ensure interoperability, identifiers should be a valid uuid. Aug 07 01:41:04.261043 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 07 01:41:04.261043 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:41:04.294881 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3123/6302] 10.222.0.39 () {58 vars in 1206 bytes} [Sun Aug 7 01:41:04 2022] DELETE /identity/v3/regions/tempest-region-989010657 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:04.295670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0302599-0afc-43ee-a841-ae59ebf8e2d0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:04.310107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec0a74-75be-41b2-813d-222939a29a90 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:04.311712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0302599-0afc-43ee-a841-ae59ebf8e2d0 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:04.314453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7eec0a74-75be-41b2-813d-222939a29a90 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:04.383464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36e98f-6f05-4669-85cd-78d2de9cd0dd tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:04.384220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36e98f-6f05-4669-85cd-78d2de9cd0dd tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:04.384512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36e98f-6f05-4669-85cd-78d2de9cd0dd tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:04.384790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36e98f-6f05-4669-85cd-78d2de9cd0dd tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/services/e9ec24d1c587455b8d6748b4b26dd5d8` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:04.385698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36e98f-6f05-4669-85cd-78d2de9cd0dd tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:delete_service(service_id=e9ec24d1c587455b8d6748b4b26dd5d8)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:04.387353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36e98f-6f05-4669-85cd-78d2de9cd0dd tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:04.423089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec0a74-75be-41b2-813d-222939a29a90 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:04.447092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b465e7-131f-4866-8d38-fb3a004b20dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:04.456379 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3180/6303] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:41:04 2022] DELETE /identity/v3/services/e9ec24d1c587455b8d6748b4b26dd5d8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:04.457348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36e98f-6f05-4669-85cd-78d2de9cd0dd tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:04.474749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b465e7-131f-4866-8d38-fb3a004b20dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:04.474749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b465e7-131f-4866-8d38-fb3a004b20dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:04.474749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b465e7-131f-4866-8d38-fb3a004b20dc admin admin] PATH_INFO: `/v3/projects/afd633b1366f422cbff7b26a55cbff4d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:04.474749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b465e7-131f-4866-8d38-fb3a004b20dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=afd633b1366f422cbff7b26a55cbff4d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:04.480808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b465e7-131f-4866-8d38-fb3a004b20dc admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:04.533939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36e98f-6f05-4669-85cd-78d2de9cd0dd tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:04.546322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9962b-eb10-4db8-9248-5c9f65ca5e8c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:04.547274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9962b-eb10-4db8-9248-5c9f65ca5e8c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:04.547274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9962b-eb10-4db8-9248-5c9f65ca5e8c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:04.547532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9962b-eb10-4db8-9248-5c9f65ca5e8c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/endpoints/6bb2bb306f62424e8141fc83478036ee` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:04.569611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9962b-eb10-4db8-9248-5c9f65ca5e8c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=6bb2bb306f62424e8141fc83478036ee)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:04.571268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9962b-eb10-4db8-9248-5c9f65ca5e8c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:04.603320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-40d9962b-eb10-4db8-9248-5c9f65ca5e8c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '6bb2bb306f62424e8141fc83478036ee', 'request_id': 'req-40d9962b-eb10-4db8-9248-5c9f65ca5e8c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:04.634743 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3181/6304] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:41:04 2022] DELETE /identity/v3/endpoints/6bb2bb306f62424e8141fc83478036ee => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:04.635970 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9962b-eb10-4db8-9248-5c9f65ca5e8c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:04.637649 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:04.662624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-01b465e7-131f-4866-8d38-fb3a004b20dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afd633b1366f422cbff7b26a55cbff4d', 'request_id': 'req-01b465e7-131f-4866-8d38-fb3a004b20dc'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:04.677540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-01b465e7-131f-4866-8d38-fb3a004b20dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afd633b1366f422cbff7b26a55cbff4d', 'request_id': 'req-01b465e7-131f-4866-8d38-fb3a004b20dc'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:04.696056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-01b465e7-131f-4866-8d38-fb3a004b20dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afd633b1366f422cbff7b26a55cbff4d', 'request_id': 'req-01b465e7-131f-4866-8d38-fb3a004b20dc'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:04.703056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9962b-eb10-4db8-9248-5c9f65ca5e8c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:04.756909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-01b465e7-131f-4866-8d38-fb3a004b20dc admin admin] The token cache is being invalidate because project afd633b1366f422cbff7b26a55cbff4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:04.757462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-01b465e7-131f-4866-8d38-fb3a004b20dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:04.759488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-01b465e7-131f-4866-8d38-fb3a004b20dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:04.764239 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3124/6305] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:41:04 2022] DELETE /identity/v3/projects/afd633b1366f422cbff7b26a55cbff4d => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:04.768689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b465e7-131f-4866-8d38-fb3a004b20dc admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:04.773590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-01b465e7-131f-4866-8d38-fb3a004b20dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:04.909211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a58a3-dba7-4e03-bea9-fb3c2646ce7d tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:04.909478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a58a3-dba7-4e03-bea9-fb3c2646ce7d tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:04.909758 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a58a3-dba7-4e03-bea9-fb3c2646ce7d tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:04.910162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a58a3-dba7-4e03-bea9-fb3c2646ce7d tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/regions/tempest-region-1373872853` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:04.910654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a58a3-dba7-4e03-bea9-fb3c2646ce7d tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1373872853)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:04.912489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a58a3-dba7-4e03-bea9-fb3c2646ce7d tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:04.989795 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3182/6306] 10.222.0.39 () {58 vars in 1209 bytes} [Sun Aug 7 01:41:04 2022] DELETE /identity/v3/regions/tempest-region-1373872853 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:04.996965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a58a3-dba7-4e03-bea9-fb3c2646ce7d tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:05.007092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-de5a58a3-dba7-4e03-bea9-fb3c2646ce7d tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:05.013777 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b465e7-131f-4866-8d38-fb3a004b20dc admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:05.058356 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:05.070256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a58a3-dba7-4e03-bea9-fb3c2646ce7d tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:05.092510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c44679-5a1a-44a8-aa9f-e6ea9f3bb938 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:05.094419 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c44679-5a1a-44a8-aa9f-e6ea9f3bb938 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:05.094904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c44679-5a1a-44a8-aa9f-e6ea9f3bb938 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:05.095339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c44679-5a1a-44a8-aa9f-e6ea9f3bb938 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/services/548f0d5801ad4b8f94f4a9bda1fb42e9` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:05.096139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c44679-5a1a-44a8-aa9f-e6ea9f3bb938 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:delete_service(service_id=548f0d5801ad4b8f94f4a9bda1fb42e9)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:05.109809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cbf45-8528-4270-acb6-297dd968da9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:05.110541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cbf45-8528-4270-acb6-297dd968da9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:05.110940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cbf45-8528-4270-acb6-297dd968da9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:05.111216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cbf45-8528-4270-acb6-297dd968da9b admin admin] PATH_INFO: `/v3/users/6e4fc26c03184400a8e1048cfb7c5e5d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:05.116260 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435cbf45-8528-4270-acb6-297dd968da9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e4fc26c03184400a8e1048cfb7c5e5d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:05.120931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c44679-5a1a-44a8-aa9f-e6ea9f3bb938 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:05.124811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435cbf45-8528-4270-acb6-297dd968da9b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:05.282349 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3183/6307] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:41:04 2022] DELETE /identity/v3/services/548f0d5801ad4b8f94f4a9bda1fb42e9 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:05.293202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c44679-5a1a-44a8-aa9f-e6ea9f3bb938 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:05.435743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-435cbf45-8528-4270-acb6-297dd968da9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e4fc26c03184400a8e1048cfb7c5e5d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:05.468679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c44679-5a1a-44a8-aa9f-e6ea9f3bb938 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:05.479855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-435cbf45-8528-4270-acb6-297dd968da9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e4fc26c03184400a8e1048cfb7c5e5d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:05.500561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73920211-b851-4577-b9c8-fd9e5a3a0b88 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:05.501400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73920211-b851-4577-b9c8-fd9e5a3a0b88 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:05.504201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73920211-b851-4577-b9c8-fd9e5a3a0b88 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:05.505877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73920211-b851-4577-b9c8-fd9e5a3a0b88 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/endpoints/c08f276cab7341289454de69f9aef9bb` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:05.530271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73920211-b851-4577-b9c8-fd9e5a3a0b88 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=c08f276cab7341289454de69f9aef9bb)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:05.533494 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73920211-b851-4577-b9c8-fd9e5a3a0b88 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:05.548566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-435cbf45-8528-4270-acb6-297dd968da9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e4fc26c03184400a8e1048cfb7c5e5d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:05.563983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-435cbf45-8528-4270-acb6-297dd968da9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e4fc26c03184400a8e1048cfb7c5e5d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:05.566105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73920211-b851-4577-b9c8-fd9e5a3a0b88 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'c08f276cab7341289454de69f9aef9bb', 'request_id': 'req-73920211-b851-4577-b9c8-fd9e5a3a0b88'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:05.587780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-435cbf45-8528-4270-acb6-297dd968da9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e4fc26c03184400a8e1048cfb7c5e5d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:05.631446 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3125/6308] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:41:04 2022] DELETE /identity/v3/users/6e4fc26c03184400a8e1048cfb7c5e5d => generated 0 bytes in 861 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:05.632650 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3184/6309] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:41:05 2022] DELETE /identity/v3/endpoints/c08f276cab7341289454de69f9aef9bb => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:41:05.636938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cbf45-8528-4270-acb6-297dd968da9b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:05.644892 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-435cbf45-8528-4270-acb6-297dd968da9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:05.824614 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:05.908681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cbf45-8528-4270-acb6-297dd968da9b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:05.952813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784e9af-1e77-4a5d-bade-defd1f9b72be tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:05.953471 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784e9af-1e77-4a5d-bade-defd1f9b72be tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:05.955709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784e9af-1e77-4a5d-bade-defd1f9b72be tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:05.956033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784e9af-1e77-4a5d-bade-defd1f9b72be tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/regions/tempest-region-2087925935` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:05.956652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784e9af-1e77-4a5d-bade-defd1f9b72be tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-2087925935)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:05.974839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784e9af-1e77-4a5d-bade-defd1f9b72be tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:06.045279 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-0784e9af-1e77-4a5d-bade-defd1f9b72be tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-2087925935. To ensure interoperability, identifiers should be a valid uuid. Aug 07 01:41:06.045279 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 07 01:41:06.045279 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:41:06.066842 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3126/6310] 10.222.0.39 () {58 vars in 1209 bytes} [Sun Aug 7 01:41:05 2022] DELETE /identity/v3/regions/tempest-region-2087925935 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:06.072208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73920211-b851-4577-b9c8-fd9e5a3a0b88 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:06.086064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73920211-b851-4577-b9c8-fd9e5a3a0b88 tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:06.126977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98573540-89cd-4c43-8625-230c3bc7b91c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e92715fa5a1c4e9f87e22d29544d4df8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '653eb34e68cc4f09badb885fdda402c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:06.127859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98573540-89cd-4c43-8625-230c3bc7b91c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:06.128170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98573540-89cd-4c43-8625-230c3bc7b91c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:06.128444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98573540-89cd-4c43-8625-230c3bc7b91c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] PATH_INFO: `/v3/services/a0456705d623440b931760b2bb90871f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:06.129046 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98573540-89cd-4c43-8625-230c3bc7b91c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a0456705d623440b931760b2bb90871f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:06.130701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98573540-89cd-4c43-8625-230c3bc7b91c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:06.201360 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3185/6311] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:41:06 2022] DELETE /identity/v3/services/a0456705d623440b931760b2bb90871f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:06.202489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784e9af-1e77-4a5d-bade-defd1f9b72be tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:06.204527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0784e9af-1e77-4a5d-bade-defd1f9b72be tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:06.433884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784e9af-1e77-4a5d-bade-defd1f9b72be tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:06.439220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98573540-89cd-4c43-8625-230c3bc7b91c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:06.441111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-98573540-89cd-4c43-8625-230c3bc7b91c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:06.475129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5ea83-75b3-48d2-97e0-052e0affa3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:06.475845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5ea83-75b3-48d2-97e0-052e0affa3b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:06.476084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5ea83-75b3-48d2-97e0-052e0affa3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:06.476355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5ea83-75b3-48d2-97e0-052e0affa3b8 admin admin] PATH_INFO: `/v3/users/ffb075b025f14df494f683dd10365d8e` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:06.478610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5ea83-75b3-48d2-97e0-052e0affa3b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffb075b025f14df494f683dd10365d8e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:06.480699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5ea83-75b3-48d2-97e0-052e0affa3b8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:06.602532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4ae5ea83-75b3-48d2-97e0-052e0affa3b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffb075b025f14df494f683dd10365d8e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:06.630427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4ae5ea83-75b3-48d2-97e0-052e0affa3b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffb075b025f14df494f683dd10365d8e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:06.676771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4ae5ea83-75b3-48d2-97e0-052e0affa3b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffb075b025f14df494f683dd10365d8e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:06.678796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4ae5ea83-75b3-48d2-97e0-052e0affa3b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffb075b025f14df494f683dd10365d8e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:06.680846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98573540-89cd-4c43-8625-230c3bc7b91c tempest-EndPointsTestJSON-2031649048 tempest-EndPointsTestJSON-2031649048-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:06.696688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d738d-e912-4ffc-9eb6-c30598ac95e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:06.697382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d738d-e912-4ffc-9eb6-c30598ac95e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:06.697685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d738d-e912-4ffc-9eb6-c30598ac95e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:06.697975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d738d-e912-4ffc-9eb6-c30598ac95e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:06.699670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4ae5ea83-75b3-48d2-97e0-052e0affa3b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffb075b025f14df494f683dd10365d8e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:06.700670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-491d738d-e912-4ffc-9eb6-c30598ac95e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:06.717409 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3127/6312] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:41:06 2022] DELETE /identity/v3/users/ffb075b025f14df494f683dd10365d8e => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:06.717409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5ea83-75b3-48d2-97e0-052e0affa3b8 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:06.719213 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4ae5ea83-75b3-48d2-97e0-052e0affa3b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:06.771255 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:06.890112 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5ea83-75b3-48d2-97e0-052e0affa3b8 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:06.896512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d738d-e912-4ffc-9eb6-c30598ac95e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:06.897970 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d738d-e912-4ffc-9eb6-c30598ac95e2 service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:06.914494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8ff60-62b1-4a90-9871-371123e66bf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:06.915357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8ff60-62b1-4a90-9871-371123e66bf7 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:06.915821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8ff60-62b1-4a90-9871-371123e66bf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:06.916657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8ff60-62b1-4a90-9871-371123e66bf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:06.923047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9fb8ff60-62b1-4a90-9871-371123e66bf7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:06.991965 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3186/6313] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:41:06.993768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcda48-1bc7-4c19-9667-e9ebf23aba85 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:06.994223 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcda48-1bc7-4c19-9667-e9ebf23aba85 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:06.994665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcda48-1bc7-4c19-9667-e9ebf23aba85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:07.028750 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:07.067163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-77fcda48-1bc7-4c19-9667-e9ebf23aba85 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:07.068457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-77fcda48-1bc7-4c19-9667-e9ebf23aba85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:07.093512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8ff60-62b1-4a90-9871-371123e66bf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:07.094974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8ff60-62b1-4a90-9871-371123e66bf7 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:07.149293 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3128/6314] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:06 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:07.150180 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8ff60-62b1-4a90-9871-371123e66bf7 service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:07.154141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9fb8ff60-62b1-4a90-9871-371123e66bf7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:07.325805 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3187/6315] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:07.350218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fcda48-1bc7-4c19-9667-e9ebf23aba85 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:07.354398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-77fcda48-1bc7-4c19-9667-e9ebf23aba85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:07.382833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8ff60-62b1-4a90-9871-371123e66bf7 service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:07.407602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9421eac-ccf8-46bb-a239-563a3a29a182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:07.410137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9421eac-ccf8-46bb-a239-563a3a29a182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:07.412389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9421eac-ccf8-46bb-a239-563a3a29a182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:07.412713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9421eac-ccf8-46bb-a239-563a3a29a182 admin admin] PATH_INFO: `/v3/projects/2d954f4585c348faafea870792faf488` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:07.420158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9421eac-ccf8-46bb-a239-563a3a29a182 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d954f4585c348faafea870792faf488)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:07.429072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9421eac-ccf8-46bb-a239-563a3a29a182 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:07.586255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a9421eac-ccf8-46bb-a239-563a3a29a182 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d954f4585c348faafea870792faf488', 'request_id': 'req-a9421eac-ccf8-46bb-a239-563a3a29a182'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:07.594074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fcda48-1bc7-4c19-9667-e9ebf23aba85 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:07.599868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a9421eac-ccf8-46bb-a239-563a3a29a182 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d954f4585c348faafea870792faf488', 'request_id': 'req-a9421eac-ccf8-46bb-a239-563a3a29a182'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:07.626670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a9421eac-ccf8-46bb-a239-563a3a29a182 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d954f4585c348faafea870792faf488', 'request_id': 'req-a9421eac-ccf8-46bb-a239-563a3a29a182'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:07.631672 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:07.682478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a9421eac-ccf8-46bb-a239-563a3a29a182 admin admin] The token cache is being invalidate because project 2d954f4585c348faafea870792faf488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:07.682781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a9421eac-ccf8-46bb-a239-563a3a29a182 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:07.686929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a9421eac-ccf8-46bb-a239-563a3a29a182 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:07.694839 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3129/6316] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:41:07 2022] DELETE /identity/v3/projects/2d954f4585c348faafea870792faf488 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:07.704067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd75bdd-3988-4257-bc4d-1015a8bb6a8e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:07.704580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd75bdd-3988-4257-bc4d-1015a8bb6a8e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:07.705311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd75bdd-3988-4257-bc4d-1015a8bb6a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:07.793430 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bda057-1510-425e-a72f-55d3dd2a21fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:07.794074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bda057-1510-425e-a72f-55d3dd2a21fd service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:07.794381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bda057-1510-425e-a72f-55d3dd2a21fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:07.794705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bda057-1510-425e-a72f-55d3dd2a21fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:07.796773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-afd75bdd-3988-4257-bc4d-1015a8bb6a8e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:07.799153 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f4bda057-1510-425e-a72f-55d3dd2a21fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:07.803551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-afd75bdd-3988-4257-bc4d-1015a8bb6a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:07.976174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bda057-1510-425e-a72f-55d3dd2a21fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:07.988086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bda057-1510-425e-a72f-55d3dd2a21fd service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:07.992897 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3130/6317] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:07.998610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df8794-3d09-432c-9cc0-3e920cc56138 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:07.998985 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df8794-3d09-432c-9cc0-3e920cc56138 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:07.999368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df8794-3d09-432c-9cc0-3e920cc56138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:08.009150 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3188/6318] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:08.043461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-16df8794-3d09-432c-9cc0-3e920cc56138 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:08.047634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-16df8794-3d09-432c-9cc0-3e920cc56138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:08.069527 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3131/6319] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:41:08.071230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bda057-1510-425e-a72f-55d3dd2a21fd service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:08.077026 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:08.086284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bda057-1510-425e-a72f-55d3dd2a21fd service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:08.104016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a387361-c736-4803-b03f-8b6192c6b278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:08.106098 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a387361-c736-4803-b03f-8b6192c6b278 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:08.106645 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a387361-c736-4803-b03f-8b6192c6b278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:08.107091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a387361-c736-4803-b03f-8b6192c6b278 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:08.108181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a387361-c736-4803-b03f-8b6192c6b278 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:41:08.108727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a387361-c736-4803-b03f-8b6192c6b278 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:08.111101 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a387361-c736-4803-b03f-8b6192c6b278 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:08.147373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df8794-3d09-432c-9cc0-3e920cc56138 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:08.147629 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3189/6320] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:08.162111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df8794-3d09-432c-9cc0-3e920cc56138 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:08.175565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bbae8-4c81-4303-b0f5-5f57f0153dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:08.176595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bbae8-4c81-4303-b0f5-5f57f0153dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:08.178701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bbae8-4c81-4303-b0f5-5f57f0153dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:08.179331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bbae8-4c81-4303-b0f5-5f57f0153dd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:08.180773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0bbae8-4c81-4303-b0f5-5f57f0153dd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:08.187549 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0bbae8-4c81-4303-b0f5-5f57f0153dd1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:08.249716 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3132/6321] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:08 2022] POST /identity/v3/projects => generated 369 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:41:08.251770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a387361-c736-4803-b03f-8b6192c6b278 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:08.266566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a387361-c736-4803-b03f-8b6192c6b278 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:08.482641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0934757-9934-4226-92dd-075337c6cce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:08.483281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0934757-9934-4226-92dd-075337c6cce8 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:08.483558 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0934757-9934-4226-92dd-075337c6cce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:08.485908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0934757-9934-4226-92dd-075337c6cce8 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:08.486615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0934757-9934-4226-92dd-075337c6cce8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:08.494579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0934757-9934-4226-92dd-075337c6cce8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:08.558476 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3190/6322] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:41:08 2022] POST /identity/v3/users => generated 285 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:08.559897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bbae8-4c81-4303-b0f5-5f57f0153dd1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:08.578115 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bbae8-4c81-4303-b0f5-5f57f0153dd1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:08.588462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5d478-8824-408d-9eb1-e8f50990e657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:08.589527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5d478-8824-408d-9eb1-e8f50990e657 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:08.591082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5d478-8824-408d-9eb1-e8f50990e657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:08.591614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5d478-8824-408d-9eb1-e8f50990e657 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:08.592473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5d478-8824-408d-9eb1-e8f50990e657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:08.595471 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5d478-8824-408d-9eb1-e8f50990e657 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:08.621785 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3133/6323] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:08.622355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0934757-9934-4226-92dd-075337c6cce8 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:08.639069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0934757-9934-4226-92dd-075337c6cce8 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:08.651675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbaa31-4d21-4673-87a1-140f2cc41c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:08.653636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbaa31-4d21-4673-87a1-140f2cc41c19 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:08.653920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbaa31-4d21-4673-87a1-140f2cc41c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:08.654195 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbaa31-4d21-4673-87a1-140f2cc41c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:08.654860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dbaa31-4d21-4673-87a1-140f2cc41c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:08.660781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dbaa31-4d21-4673-87a1-140f2cc41c19 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:08.692957 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3191/6324] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:41:08.694504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5d478-8824-408d-9eb1-e8f50990e657 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:08.711061 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5d478-8824-408d-9eb1-e8f50990e657 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:08.719917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605b84b-901f-485e-99bf-5d098fedad7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:08.720298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605b84b-901f-485e-99bf-5d098fedad7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:08.720723 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605b84b-901f-485e-99bf-5d098fedad7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:08.721247 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a605b84b-901f-485e-99bf-5d098fedad7a admin admin] PATH_INFO: `/v3/projects/4457ea018af04d6f86e6d319aedb95bb/users/b5d99676650940a4a2305dcebce25c12/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:08.780722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605b84b-901f-485e-99bf-5d098fedad7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4457ea018af04d6f86e6d319aedb95bb, user_id=b5d99676650940a4a2305dcebce25c12, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:08.783406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a605b84b-901f-485e-99bf-5d098fedad7a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:08.818758 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3134/6325] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:08 2022] PUT /identity/v3/projects/4457ea018af04d6f86e6d319aedb95bb/users/b5d99676650940a4a2305dcebce25c12/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:08.828844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0af66-1535-4df0-9b3e-ef237e07dec5 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:08.829343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0af66-1535-4df0-9b3e-ef237e07dec5 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:08.829424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef0af66-1535-4df0-9b3e-ef237e07dec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:08.915745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5ef0af66-1535-4df0-9b3e-ef237e07dec5 None None] MFA Rules not processed for user `b5d99676650940a4a2305dcebce25c12`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:08.927720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5ef0af66-1535-4df0-9b3e-ef237e07dec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:09.101342 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3192/6326] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:09.103875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605b84b-901f-485e-99bf-5d098fedad7a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:09.131333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a605b84b-901f-485e-99bf-5d098fedad7a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:09.142019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0232bba-e279-495d-85e2-7acc320444e4 tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d99676650940a4a2305dcebce25c12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4457ea018af04d6f86e6d319aedb95bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:09.146361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0232bba-e279-495d-85e2-7acc320444e4 tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:09.147163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0232bba-e279-495d-85e2-7acc320444e4 tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:09.147749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0232bba-e279-495d-85e2-7acc320444e4 tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] PATH_INFO: `/v3/users/b5d99676650940a4a2305dcebce25c12/application_credentials` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:09.149129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0232bba-e279-495d-85e2-7acc320444e4 tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] RBAC: Authorizing `identity:create_application_credential(user_id=b5d99676650940a4a2305dcebce25c12)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:09.151775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0232bba-e279-495d-85e2-7acc320444e4 tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:09.510858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0af66-1535-4df0-9b3e-ef237e07dec5 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:09.538947 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3135/6327] 10.222.0.39 () {60 vars in 1315 bytes} [Sun Aug 7 01:41:09 2022] POST /identity/v3/users/b5d99676650940a4a2305dcebce25c12/application_credentials => generated 920 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:09.546338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef0af66-1535-4df0-9b3e-ef237e07dec5 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:09.561620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2d993-a4e9-4c4c-85c7-b9d63e22817d tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d99676650940a4a2305dcebce25c12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4457ea018af04d6f86e6d319aedb95bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:09.562771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2d993-a4e9-4c4c-85c7-b9d63e22817d tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:09.563472 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2d993-a4e9-4c4c-85c7-b9d63e22817d tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:09.565060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2d993-a4e9-4c4c-85c7-b9d63e22817d tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] PATH_INFO: `/v3/users/b5d99676650940a4a2305dcebce25c12/access_rules/254ef5c8d44f457ab88afdca16578170` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:09.568162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2d993-a4e9-4c4c-85c7-b9d63e22817d tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] RBAC: Authorizing `identity:delete_access_rule(user_id=b5d99676650940a4a2305dcebce25c12, access_rule_id=254ef5c8d44f457ab88afdca16578170)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:09.571579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2d993-a4e9-4c4c-85c7-b9d63e22817d tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:09.650641 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-68b2d993-a4e9-4c4c-85c7-b9d63e22817d tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Aug 07 01:41:09.650641 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:41:09.650641 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Aug 07 01:41:09.650641 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application session.delete(ref) Aug 07 01:41:09.650641 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 01:41:09.650641 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application next(self.gen) Aug 07 01:41:09.650641 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 07 01:41:09.650641 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application yield resource Aug 07 01:41:09.650641 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 07 01:41:09.650641 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application next(self.gen) Aug 07 01:41:09.650641 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 07 01:41:09.650641 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.session.rollback() Aug 07 01:41:09.650641 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 07 01:41:09.650641 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.force_reraise() Aug 07 01:41:09.650641 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 07 01:41:09.650641 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise self.value Aug 07 01:41:09.651902 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 07 01:41:09.651902 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 07 01:41:09.651902 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 07 01:41:09.651902 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application session.commit() Aug 07 01:41:09.651902 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 07 01:41:09.651902 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 07 01:41:09.651902 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 07 01:41:09.651902 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._prepare_impl() Aug 07 01:41:09.651902 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 07 01:41:09.651902 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.session.flush() Aug 07 01:41:09.651902 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 07 01:41:09.651902 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._flush(objects) Aug 07 01:41:09.651902 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 07 01:41:09.651902 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 07 01:41:09.651902 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 07 01:41:09.651902 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application compat.raise_( Aug 07 01:41:09.653100 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 07 01:41:09.653100 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception Aug 07 01:41:09.653100 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 07 01:41:09.653100 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application flush_context.execute() Aug 07 01:41:09.653100 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 07 01:41:09.653100 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rec.execute(self) Aug 07 01:41:09.653100 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Aug 07 01:41:09.653100 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Aug 07 01:41:09.653100 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Aug 07 01:41:09.653100 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._synchronize( Aug 07 01:41:09.653100 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Aug 07 01:41:09.653100 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Aug 07 01:41:09.653100 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Aug 07 01:41:09.653100 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise AssertionError( Aug 07 01:41:09.653100 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Aug 07 01:41:09.653100 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:41:09.654072 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:41:09.654072 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:41:09.654072 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:41:09.654072 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:41:09.654072 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:41:09.654072 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:41:09.654072 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:41:09.654072 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:41:09.654072 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:41:09.654072 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:41:09.654072 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:41:09.654072 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:41:09.654072 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:41:09.654072 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Aug 07 01:41:09.654072 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Aug 07 01:41:09.654072 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:41:09.654072 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:41:09.655052 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Aug 07 01:41:09.655052 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Aug 07 01:41:09.655052 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Aug 07 01:41:09.655052 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Aug 07 01:41:09.655052 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Aug 07 01:41:09.655052 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:41:09.655052 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3193/6328] 10.222.0.39 () {58 vars in 1362 bytes} [Sun Aug 7 01:41:09 2022] DELETE /identity/v3/users/b5d99676650940a4a2305dcebce25c12/access_rules/254ef5c8d44f457ab88afdca16578170 => generated 89 bytes in 144 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:41:09.659784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0232bba-e279-495d-85e2-7acc320444e4 tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:09.673158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0232bba-e279-495d-85e2-7acc320444e4 tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:09.705392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d8890-7b95-4233-a7fa-505690061f18 tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d99676650940a4a2305dcebce25c12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4457ea018af04d6f86e6d319aedb95bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:09.706588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d8890-7b95-4233-a7fa-505690061f18 tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:09.707647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d8890-7b95-4233-a7fa-505690061f18 tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:09.708194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d8890-7b95-4233-a7fa-505690061f18 tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] PATH_INFO: `/v3/users/b5d99676650940a4a2305dcebce25c12/application_credentials/208da14c995747798ed19c033a918868` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:09.725568 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:INSERT=7,keystone:DELETE=1,keystone:SELECT=92 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:09.735697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d8890-7b95-4233-a7fa-505690061f18 tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] RBAC: Authorizing `identity:delete_application_credential(user_id=b5d99676650940a4a2305dcebce25c12, application_credential_id=208da14c995747798ed19c033a918868)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:09.738280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d8890-7b95-4233-a7fa-505690061f18 tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:09.795838 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3136/6329] 10.222.0.39 () {58 vars in 1395 bytes} [Sun Aug 7 01:41:09 2022] DELETE /identity/v3/users/b5d99676650940a4a2305dcebce25c12/application_credentials/208da14c995747798ed19c033a918868 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:09.797040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2d993-a4e9-4c4c-85c7-b9d63e22817d tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:09.811829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2d993-a4e9-4c4c-85c7-b9d63e22817d tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:09.823347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeaa8a9-7ea3-4c64-9f32-90f01c6d181b tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d99676650940a4a2305dcebce25c12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4457ea018af04d6f86e6d319aedb95bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:09.824066 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaa8a9-7ea3-4c64-9f32-90f01c6d181b tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:09.824255 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaa8a9-7ea3-4c64-9f32-90f01c6d181b tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:09.824535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeaa8a9-7ea3-4c64-9f32-90f01c6d181b tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] PATH_INFO: `/v3/users/b5d99676650940a4a2305dcebce25c12/access_rules` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:09.827614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeaa8a9-7ea3-4c64-9f32-90f01c6d181b tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] RBAC: Authorizing `identity:list_access_rules(user_id=b5d99676650940a4a2305dcebce25c12)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:09.829150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeaa8a9-7ea3-4c64-9f32-90f01c6d181b tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:09.846361 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3194/6330] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Aug 7 01:41:09 2022] GET /identity/v3/users/b5d99676650940a4a2305dcebce25c12/access_rules => generated 369 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:09.848361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d8890-7b95-4233-a7fa-505690061f18 tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:09.880738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d8890-7b95-4233-a7fa-505690061f18 tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:09.903068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758b482-ab7a-45b5-a3d6-7247f25327da tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d99676650940a4a2305dcebce25c12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4457ea018af04d6f86e6d319aedb95bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:09.906054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758b482-ab7a-45b5-a3d6-7247f25327da tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:09.907179 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758b482-ab7a-45b5-a3d6-7247f25327da tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:09.908746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758b482-ab7a-45b5-a3d6-7247f25327da tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] PATH_INFO: `/v3/users/b5d99676650940a4a2305dcebce25c12/access_rules/254ef5c8d44f457ab88afdca16578170` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:09.915771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5758b482-ab7a-45b5-a3d6-7247f25327da tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] RBAC: Authorizing `identity:delete_access_rule(user_id=b5d99676650940a4a2305dcebce25c12, access_rule_id=254ef5c8d44f457ab88afdca16578170)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:09.923285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5758b482-ab7a-45b5-a3d6-7247f25327da tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:10.043516 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3137/6331] 10.222.0.39 () {58 vars in 1362 bytes} [Sun Aug 7 01:41:09 2022] DELETE /identity/v3/users/b5d99676650940a4a2305dcebce25c12/access_rules/254ef5c8d44f457ab88afdca16578170 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:41:10.045176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeaa8a9-7ea3-4c64-9f32-90f01c6d181b tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:10.055491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeaa8a9-7ea3-4c64-9f32-90f01c6d181b tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:10.076010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655a97a-ef47-49da-bed8-16c8f2a1a7fd tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d99676650940a4a2305dcebce25c12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4457ea018af04d6f86e6d319aedb95bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:10.077144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655a97a-ef47-49da-bed8-16c8f2a1a7fd tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:10.080251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655a97a-ef47-49da-bed8-16c8f2a1a7fd tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:10.080692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655a97a-ef47-49da-bed8-16c8f2a1a7fd tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] PATH_INFO: `/v3/users/b5d99676650940a4a2305dcebce25c12/access_rules` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:10.085458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655a97a-ef47-49da-bed8-16c8f2a1a7fd tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] RBAC: Authorizing `identity:list_access_rules(user_id=b5d99676650940a4a2305dcebce25c12)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:10.087163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655a97a-ef47-49da-bed8-16c8f2a1a7fd tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:10.104911 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3195/6332] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Aug 7 01:41:10 2022] GET /identity/v3/users/b5d99676650940a4a2305dcebce25c12/access_rules => generated 158 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:10.105888 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758b482-ab7a-45b5-a3d6-7247f25327da tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:10.120587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758b482-ab7a-45b5-a3d6-7247f25327da tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:10.135779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecdd32-b1ca-4943-b184-838bbd735565 tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d99676650940a4a2305dcebce25c12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4457ea018af04d6f86e6d319aedb95bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:10.136899 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecdd32-b1ca-4943-b184-838bbd735565 tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:10.137017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecdd32-b1ca-4943-b184-838bbd735565 tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:10.137818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecdd32-b1ca-4943-b184-838bbd735565 tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] PATH_INFO: `/v3/users/b5d99676650940a4a2305dcebce25c12/application_credentials` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:10.138495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eecdd32-b1ca-4943-b184-838bbd735565 tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] RBAC: Authorizing `identity:create_application_credential(user_id=b5d99676650940a4a2305dcebce25c12)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:10.139698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eecdd32-b1ca-4943-b184-838bbd735565 tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:10.306034 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3138/6333] 10.222.0.39 () {60 vars in 1315 bytes} [Sun Aug 7 01:41:10 2022] POST /identity/v3/users/b5d99676650940a4a2305dcebce25c12/application_credentials => generated 921 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:10.307985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655a97a-ef47-49da-bed8-16c8f2a1a7fd tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:10.333845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655a97a-ef47-49da-bed8-16c8f2a1a7fd tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:10.390701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec304362-3089-4428-8e04-d292abb145ae tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d99676650940a4a2305dcebce25c12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4457ea018af04d6f86e6d319aedb95bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:10.391632 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec304362-3089-4428-8e04-d292abb145ae tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:10.392170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec304362-3089-4428-8e04-d292abb145ae tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:10.392594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec304362-3089-4428-8e04-d292abb145ae tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] PATH_INFO: `/v3/users/b5d99676650940a4a2305dcebce25c12/access_rules` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:10.398404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecdd32-b1ca-4943-b184-838bbd735565 tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:10.400627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3eecdd32-b1ca-4943-b184-838bbd735565 tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:10.402841 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec304362-3089-4428-8e04-d292abb145ae tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] RBAC: Authorizing `identity:list_access_rules(user_id=b5d99676650940a4a2305dcebce25c12)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:10.408273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec304362-3089-4428-8e04-d292abb145ae tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:10.460498 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3196/6334] 10.222.0.39 () {58 vars in 1260 bytes} [Sun Aug 7 01:41:10 2022] GET /identity/v3/users/b5d99676650940a4a2305dcebce25c12/access_rules => generated 369 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:10.461794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec304362-3089-4428-8e04-d292abb145ae tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:10.498718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec304362-3089-4428-8e04-d292abb145ae tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:10.512967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c72ab-10da-48df-8772-b9e844a73d1a tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d99676650940a4a2305dcebce25c12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4457ea018af04d6f86e6d319aedb95bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:10.513667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c72ab-10da-48df-8772-b9e844a73d1a tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:10.513926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c72ab-10da-48df-8772-b9e844a73d1a tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:10.514268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c72ab-10da-48df-8772-b9e844a73d1a tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] PATH_INFO: `/v3/users/b5d99676650940a4a2305dcebce25c12/application_credentials` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:10.514883 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c72ab-10da-48df-8772-b9e844a73d1a tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] RBAC: Authorizing `identity:create_application_credential(user_id=b5d99676650940a4a2305dcebce25c12)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:10.519175 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c72ab-10da-48df-8772-b9e844a73d1a tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:10.575797 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:10.643083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecdd32-b1ca-4943-b184-838bbd735565 tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:10.667878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8aa7b5-1ecb-4b19-b8fa-70c11c28e29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:10.668587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aa7b5-1ecb-4b19-b8fa-70c11c28e29d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:10.668870 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aa7b5-1ecb-4b19-b8fa-70c11c28e29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:10.669158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aa7b5-1ecb-4b19-b8fa-70c11c28e29d admin admin] PATH_INFO: `/v3/projects/0955236950324e559cbed3438d138060` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:10.675807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8aa7b5-1ecb-4b19-b8fa-70c11c28e29d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0955236950324e559cbed3438d138060)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:10.678557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8aa7b5-1ecb-4b19-b8fa-70c11c28e29d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:10.777070 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3197/6335] 10.222.0.39 () {60 vars in 1315 bytes} [Sun Aug 7 01:41:10 2022] POST /identity/v3/users/b5d99676650940a4a2305dcebce25c12/application_credentials => generated 921 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:41:10.790975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c72ab-10da-48df-8772-b9e844a73d1a tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:10.826868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c72ab-10da-48df-8772-b9e844a73d1a tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:10.836326 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:10.851968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7f8aa7b5-1ecb-4b19-b8fa-70c11c28e29d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0955236950324e559cbed3438d138060', 'request_id': 'req-7f8aa7b5-1ecb-4b19-b8fa-70c11c28e29d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:10.912012 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7f8aa7b5-1ecb-4b19-b8fa-70c11c28e29d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0955236950324e559cbed3438d138060', 'request_id': 'req-7f8aa7b5-1ecb-4b19-b8fa-70c11c28e29d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:10.927735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7f8aa7b5-1ecb-4b19-b8fa-70c11c28e29d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0955236950324e559cbed3438d138060', 'request_id': 'req-7f8aa7b5-1ecb-4b19-b8fa-70c11c28e29d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:10.955009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7f8aa7b5-1ecb-4b19-b8fa-70c11c28e29d admin admin] The token cache is being invalidate because project 0955236950324e559cbed3438d138060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:10.955311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7f8aa7b5-1ecb-4b19-b8fa-70c11c28e29d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:10.956132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7f8aa7b5-1ecb-4b19-b8fa-70c11c28e29d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:10.962797 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3139/6336] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:41:10 2022] DELETE /identity/v3/projects/0955236950324e559cbed3438d138060 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:10.964535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8aa7b5-1ecb-4b19-b8fa-70c11c28e29d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:10.966376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7f8aa7b5-1ecb-4b19-b8fa-70c11c28e29d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:11.050333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928eac6e-aa91-4cbf-9b60-943a4799d6de tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b5d99676650940a4a2305dcebce25c12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4457ea018af04d6f86e6d319aedb95bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:11.051034 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928eac6e-aa91-4cbf-9b60-943a4799d6de tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:11.055398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928eac6e-aa91-4cbf-9b60-943a4799d6de tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:11.056000 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928eac6e-aa91-4cbf-9b60-943a4799d6de tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] PATH_INFO: `/v3/users/b5d99676650940a4a2305dcebce25c12/access_rules/94a295c70a324c60a284968ea0ff3743` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:11.057756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928eac6e-aa91-4cbf-9b60-943a4799d6de tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] RBAC: Authorizing `identity:get_access_rule(user_id=b5d99676650940a4a2305dcebce25c12, access_rule_id=94a295c70a324c60a284968ea0ff3743)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:11.062093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928eac6e-aa91-4cbf-9b60-943a4799d6de tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:11.084097 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3198/6337] 10.222.0.39 () {58 vars in 1359 bytes} [Sun Aug 7 01:41:10 2022] GET /identity/v3/users/b5d99676650940a4a2305dcebce25c12/access_rules/94a295c70a324c60a284968ea0ff3743 => generated 229 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:11.092446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928eac6e-aa91-4cbf-9b60-943a4799d6de tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:11.130999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-928eac6e-aa91-4cbf-9b60-943a4799d6de tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:11.255197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8aa7b5-1ecb-4b19-b8fa-70c11c28e29d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:11.283644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48577e-ee2a-4477-9afb-f25fa238ce28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:11.284732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48577e-ee2a-4477-9afb-f25fa238ce28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:11.298212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48577e-ee2a-4477-9afb-f25fa238ce28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:11.298878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48577e-ee2a-4477-9afb-f25fa238ce28 admin admin] PATH_INFO: `/v3/users/e92715fa5a1c4e9f87e22d29544d4df8` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:11.301629 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48577e-ee2a-4477-9afb-f25fa238ce28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e92715fa5a1c4e9f87e22d29544d4df8)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:11.303575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48577e-ee2a-4477-9afb-f25fa238ce28 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:11.478267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928eac6e-aa91-4cbf-9b60-943a4799d6de tempest-AccessRulesV3Test-335899744 tempest-AccessRulesV3Test-335899744-project] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:11.479078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ee48577e-ee2a-4477-9afb-f25fa238ce28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e92715fa5a1c4e9f87e22d29544d4df8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:11.497483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ee48577e-ee2a-4477-9afb-f25fa238ce28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e92715fa5a1c4e9f87e22d29544d4df8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:11.501805 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88429da-fd29-4924-b31e-3024e206964e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:11.502460 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88429da-fd29-4924-b31e-3024e206964e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:11.502735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88429da-fd29-4924-b31e-3024e206964e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:11.503007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88429da-fd29-4924-b31e-3024e206964e admin admin] PATH_INFO: `/v3/users/b5d99676650940a4a2305dcebce25c12` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:11.504249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88429da-fd29-4924-b31e-3024e206964e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5d99676650940a4a2305dcebce25c12)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:11.506175 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88429da-fd29-4924-b31e-3024e206964e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:11.555987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ee48577e-ee2a-4477-9afb-f25fa238ce28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e92715fa5a1c4e9f87e22d29544d4df8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:11.555987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ee48577e-ee2a-4477-9afb-f25fa238ce28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e92715fa5a1c4e9f87e22d29544d4df8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:11.586221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ee48577e-ee2a-4477-9afb-f25fa238ce28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e92715fa5a1c4e9f87e22d29544d4df8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:11.587647 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3140/6338] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:41:10 2022] DELETE /identity/v3/users/e92715fa5a1c4e9f87e22d29544d4df8 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:11.685882 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b88429da-fd29-4924-b31e-3024e206964e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5d99676650940a4a2305dcebce25c12'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:11.695126 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:11.697538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b88429da-fd29-4924-b31e-3024e206964e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5d99676650940a4a2305dcebce25c12'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:11.797276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b88429da-fd29-4924-b31e-3024e206964e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5d99676650940a4a2305dcebce25c12'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:11.804440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b88429da-fd29-4924-b31e-3024e206964e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5d99676650940a4a2305dcebce25c12'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:11.832707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b88429da-fd29-4924-b31e-3024e206964e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5d99676650940a4a2305dcebce25c12'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:11.851436 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3199/6339] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:41:11 2022] DELETE /identity/v3/users/b5d99676650940a4a2305dcebce25c12 => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:11.857938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4d2b1-b0c5-47de-9ec3-d651240191ec None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:11.858821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4d2b1-b0c5-47de-9ec3-d651240191ec None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:11.859261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4d2b1-b0c5-47de-9ec3-d651240191ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:11.937291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-aef4d2b1-b0c5-47de-9ec3-d651240191ec None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:11.938527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-aef4d2b1-b0c5-47de-9ec3-d651240191ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:12.093260 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:12.120455 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3141/6340] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:12.340496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88429da-fd29-4924-b31e-3024e206964e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:12.342187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b88429da-fd29-4924-b31e-3024e206964e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:12.584966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88429da-fd29-4924-b31e-3024e206964e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:12.605047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6ec86-b22b-4304-a35f-37872d5e6541 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:12.605595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6ec86-b22b-4304-a35f-37872d5e6541 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:12.606035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6ec86-b22b-4304-a35f-37872d5e6541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:12.626974 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417c290-ce64-4d81-aade-6e4668aabcc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:12.627663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417c290-ce64-4d81-aade-6e4668aabcc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:12.627988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417c290-ce64-4d81-aade-6e4668aabcc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:12.628264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417c290-ce64-4d81-aade-6e4668aabcc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:12.647384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417c290-ce64-4d81-aade-6e4668aabcc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:12.649605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417c290-ce64-4d81-aade-6e4668aabcc5 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:12.661013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-4ee6ec86-b22b-4304-a35f-37872d5e6541 None None] MFA Rules not processed for user `2d8e76eb694846cabc55fc8e825c8e43`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:12.662585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4ee6ec86-b22b-4304-a35f-37872d5e6541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:12.674742 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3200/6341] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:12.842994 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3142/6342] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:13.532867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417c290-ce64-4d81-aade-6e4668aabcc5 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:13.534476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c417c290-ce64-4d81-aade-6e4668aabcc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:13.565843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417c290-ce64-4d81-aade-6e4668aabcc5 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:13.596651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86594b45-467b-4689-b3d8-8f0edb301062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:13.597433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86594b45-467b-4689-b3d8-8f0edb301062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:13.598377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86594b45-467b-4689-b3d8-8f0edb301062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:13.598781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86594b45-467b-4689-b3d8-8f0edb301062 admin admin] PATH_INFO: `/v3/projects/653eb34e68cc4f09badb885fdda402c5` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:13.600137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86594b45-467b-4689-b3d8-8f0edb301062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=653eb34e68cc4f09badb885fdda402c5)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:13.602134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86594b45-467b-4689-b3d8-8f0edb301062 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:13.820002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-86594b45-467b-4689-b3d8-8f0edb301062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '653eb34e68cc4f09badb885fdda402c5', 'request_id': 'req-86594b45-467b-4689-b3d8-8f0edb301062'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:13.835372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-86594b45-467b-4689-b3d8-8f0edb301062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '653eb34e68cc4f09badb885fdda402c5', 'request_id': 'req-86594b45-467b-4689-b3d8-8f0edb301062'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:13.865189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-86594b45-467b-4689-b3d8-8f0edb301062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '653eb34e68cc4f09badb885fdda402c5', 'request_id': 'req-86594b45-467b-4689-b3d8-8f0edb301062'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:13.928395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-86594b45-467b-4689-b3d8-8f0edb301062 admin admin] The token cache is being invalidate because project 653eb34e68cc4f09badb885fdda402c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:13.928718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-86594b45-467b-4689-b3d8-8f0edb301062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:13.931493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-86594b45-467b-4689-b3d8-8f0edb301062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:13.935287 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3201/6343] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:41:13 2022] DELETE /identity/v3/projects/653eb34e68cc4f09badb885fdda402c5 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:41:13.942767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d690e-d3fd-42c9-9fba-a1d741f67286 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:13.943296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d690e-d3fd-42c9-9fba-a1d741f67286 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:13.943296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d690e-d3fd-42c9-9fba-a1d741f67286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:14.000466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-4e1d690e-d3fd-42c9-9fba-a1d741f67286 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:14.020308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4e1d690e-d3fd-42c9-9fba-a1d741f67286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:14.220002 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3143/6344] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:14.224832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95721990-efce-4984-ac51-934e63371bf4 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:14.225120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95721990-efce-4984-ac51-934e63371bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:14.225400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95721990-efce-4984-ac51-934e63371bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:14.281073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-95721990-efce-4984-ac51-934e63371bf4 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:14.282483 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-95721990-efce-4984-ac51-934e63371bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:14.315484 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3202/6345] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:14.321164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d690e-d3fd-42c9-9fba-a1d741f67286 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:14.389222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d690e-d3fd-42c9-9fba-a1d741f67286 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:14.422283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26da8a0-f5d0-412a-8468-36d72059974f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:14.422913 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26da8a0-f5d0-412a-8468-36d72059974f admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:14.423193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26da8a0-f5d0-412a-8468-36d72059974f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:14.423465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26da8a0-f5d0-412a-8468-36d72059974f admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:14.424160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26da8a0-f5d0-412a-8468-36d72059974f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:41:14.424461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26da8a0-f5d0-412a-8468-36d72059974f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:14.426690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26da8a0-f5d0-412a-8468-36d72059974f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:14.477976 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3144/6346] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:14.482529 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95721990-efce-4984-ac51-934e63371bf4 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:14.514713 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95721990-efce-4984-ac51-934e63371bf4 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:14.540786 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a474f-de02-42b2-bf43-832be4d9cf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:14.546561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a474f-de02-42b2-bf43-832be4d9cf89 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:14.548267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a474f-de02-42b2-bf43-832be4d9cf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:14.548664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a474f-de02-42b2-bf43-832be4d9cf89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:14.552685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a474f-de02-42b2-bf43-832be4d9cf89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:14.576031 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a474f-de02-42b2-bf43-832be4d9cf89 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:14.673368 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3203/6347] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:14 2022] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:14.678408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26da8a0-f5d0-412a-8468-36d72059974f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:14.694371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26da8a0-f5d0-412a-8468-36d72059974f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:14.794234 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea48705-fdd1-4edf-b56f-6d639830bfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:14.795030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea48705-fdd1-4edf-b56f-6d639830bfa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:14.795427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea48705-fdd1-4edf-b56f-6d639830bfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:14.795812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea48705-fdd1-4edf-b56f-6d639830bfa5 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:14.796617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea48705-fdd1-4edf-b56f-6d639830bfa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:14.801901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea48705-fdd1-4edf-b56f-6d639830bfa5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:14.856188 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3145/6348] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:41:14 2022] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:14.857838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a474f-de02-42b2-bf43-832be4d9cf89 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:14.866083 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:14.873605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a474f-de02-42b2-bf43-832be4d9cf89 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:14.908306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fff7e-5a61-4d6b-a8d1-b30dc871620e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:14.912593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fff7e-5a61-4d6b-a8d1-b30dc871620e admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:14.917347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fff7e-5a61-4d6b-a8d1-b30dc871620e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:14.924663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fff7e-5a61-4d6b-a8d1-b30dc871620e admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:14.952223 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690fff7e-5a61-4d6b-a8d1-b30dc871620e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:14.953919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690fff7e-5a61-4d6b-a8d1-b30dc871620e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:15.006922 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3204/6349] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:15.008311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea48705-fdd1-4edf-b56f-6d639830bfa5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:15.025170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea48705-fdd1-4edf-b56f-6d639830bfa5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:15.052082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430bdbb-94f3-4f90-bdac-3371ae62b588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:15.054944 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430bdbb-94f3-4f90-bdac-3371ae62b588 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:15.055547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430bdbb-94f3-4f90-bdac-3371ae62b588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:15.056093 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430bdbb-94f3-4f90-bdac-3371ae62b588 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:15.058787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430bdbb-94f3-4f90-bdac-3371ae62b588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:15.061007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430bdbb-94f3-4f90-bdac-3371ae62b588 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:15.071544 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:15.122485 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3146/6350] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:41:15.124484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fff7e-5a61-4d6b-a8d1-b30dc871620e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:15.146018 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fff7e-5a61-4d6b-a8d1-b30dc871620e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:15.171020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be33803-0d9e-4a49-a659-689ba2a3b209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:15.172054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be33803-0d9e-4a49-a659-689ba2a3b209 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:15.172512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be33803-0d9e-4a49-a659-689ba2a3b209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:15.172961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be33803-0d9e-4a49-a659-689ba2a3b209 admin admin] PATH_INFO: `/v3/projects/4049c38cd533478c930fc799b53f97e0/users/9a385c1a6f6d4325bc92dcd4f4ed10b9/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:15.210933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be33803-0d9e-4a49-a659-689ba2a3b209 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4049c38cd533478c930fc799b53f97e0, user_id=9a385c1a6f6d4325bc92dcd4f4ed10b9, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:15.213776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be33803-0d9e-4a49-a659-689ba2a3b209 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:15.248452 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3205/6351] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:15 2022] PUT /identity/v3/projects/4049c38cd533478c930fc799b53f97e0/users/9a385c1a6f6d4325bc92dcd4f4ed10b9/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:15.250122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454da4f5-a816-4ef4-8da9-4f506e937575 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:15.250691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454da4f5-a816-4ef4-8da9-4f506e937575 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:15.251343 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454da4f5-a816-4ef4-8da9-4f506e937575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:15.371953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-454da4f5-a816-4ef4-8da9-4f506e937575 None None] MFA Rules not processed for user `9a385c1a6f6d4325bc92dcd4f4ed10b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:15.373205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-454da4f5-a816-4ef4-8da9-4f506e937575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:15.543163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be33803-0d9e-4a49-a659-689ba2a3b209 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:15.546829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8be33803-0d9e-4a49-a659-689ba2a3b209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:15.659019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be33803-0d9e-4a49-a659-689ba2a3b209 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:15.667092 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3147/6352] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:41:15.669159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f87dd-923e-4bb4-93f5-074f41f1a34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:15.669918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f87dd-923e-4bb4-93f5-074f41f1a34f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:15.670308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f87dd-923e-4bb4-93f5-074f41f1a34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:15.670743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f87dd-923e-4bb4-93f5-074f41f1a34f admin admin] PATH_INFO: `/v3/projects/4457ea018af04d6f86e6d319aedb95bb` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:15.671747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454da4f5-a816-4ef4-8da9-4f506e937575 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:15.672251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f87dd-923e-4bb4-93f5-074f41f1a34f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4457ea018af04d6f86e6d319aedb95bb)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:15.674589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f87dd-923e-4bb4-93f5-074f41f1a34f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:15.704572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454da4f5-a816-4ef4-8da9-4f506e937575 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:15.719112 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970b264-e771-47fc-a649-c396092a256f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:15.720179 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970b264-e771-47fc-a649-c396092a256f admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:15.720561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970b264-e771-47fc-a649-c396092a256f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:15.720956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970b264-e771-47fc-a649-c396092a256f admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:15.721711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970b264-e771-47fc-a649-c396092a256f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:15.723806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970b264-e771-47fc-a649-c396092a256f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:15.790999 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3148/6353] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:15 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:41:15.794547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970b264-e771-47fc-a649-c396092a256f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:15.832231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ca9f87dd-923e-4bb4-93f5-074f41f1a34f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4457ea018af04d6f86e6d319aedb95bb', 'request_id': 'req-ca9f87dd-923e-4bb4-93f5-074f41f1a34f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:15.881843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ca9f87dd-923e-4bb4-93f5-074f41f1a34f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4457ea018af04d6f86e6d319aedb95bb', 'request_id': 'req-ca9f87dd-923e-4bb4-93f5-074f41f1a34f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:15.925410 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ca9f87dd-923e-4bb4-93f5-074f41f1a34f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4457ea018af04d6f86e6d319aedb95bb', 'request_id': 'req-ca9f87dd-923e-4bb4-93f5-074f41f1a34f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:15.986476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ca9f87dd-923e-4bb4-93f5-074f41f1a34f admin admin] The token cache is being invalidate because project 4457ea018af04d6f86e6d319aedb95bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:15.986781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ca9f87dd-923e-4bb4-93f5-074f41f1a34f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:15.987803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ca9f87dd-923e-4bb4-93f5-074f41f1a34f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:15.992363 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3206/6354] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:41:15 2022] DELETE /identity/v3/projects/4457ea018af04d6f86e6d319aedb95bb => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:16.001938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970b264-e771-47fc-a649-c396092a256f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:16.003838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fbe93-5cf4-4c06-9de1-482bd6233a48 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:16.005138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fbe93-5cf4-4c06-9de1-482bd6233a48 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:16.005579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4fbe93-5cf4-4c06-9de1-482bd6233a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:16.016562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50daff-0ca4-4fc9-8b4b-cc521766e78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:16.017856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50daff-0ca4-4fc9-8b4b-cc521766e78e admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:16.018384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50daff-0ca4-4fc9-8b4b-cc521766e78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:16.018825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50daff-0ca4-4fc9-8b4b-cc521766e78e admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:16.019682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50daff-0ca4-4fc9-8b4b-cc521766e78e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:16.025794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50daff-0ca4-4fc9-8b4b-cc521766e78e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:16.056218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ea4fbe93-5cf4-4c06-9de1-482bd6233a48 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:16.059357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ea4fbe93-5cf4-4c06-9de1-482bd6233a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:16.092321 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3149/6355] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:41:15 2022] POST /identity/v3/users => generated 299 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:16.102247 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50daff-0ca4-4fc9-8b4b-cc521766e78e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:16.112102 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3207/6356] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:16.112338 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1b50daff-0ca4-4fc9-8b4b-cc521766e78e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:16.114425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e008c03-15dc-476a-b61b-86efe548d0ad None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:16.116045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e008c03-15dc-476a-b61b-86efe548d0ad None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:16.117946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e008c03-15dc-476a-b61b-86efe548d0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:16.130178 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50daff-0ca4-4fc9-8b4b-cc521766e78e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:16.147618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a10bcd-9979-468b-acc1-119e7fe632e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:16.148430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a10bcd-9979-468b-acc1-119e7fe632e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:16.148718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a10bcd-9979-468b-acc1-119e7fe632e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:16.149614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a10bcd-9979-468b-acc1-119e7fe632e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:16.150657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a10bcd-9979-468b-acc1-119e7fe632e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:16.156724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a10bcd-9979-468b-acc1-119e7fe632e7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:16.193509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9e008c03-15dc-476a-b61b-86efe548d0ad None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:16.195031 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3150/6357] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:16.199310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9e008c03-15dc-476a-b61b-86efe548d0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:16.202071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a10bcd-9979-468b-acc1-119e7fe632e7 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:16.237473 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3208/6358] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:41:16.238752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a10bcd-9979-468b-acc1-119e7fe632e7 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:16.239685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e008c03-15dc-476a-b61b-86efe548d0ad None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:16.259315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044af1b0-7314-45c8-9744-ef29d3e0c6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:16.260404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044af1b0-7314-45c8-9744-ef29d3e0c6c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:16.260683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044af1b0-7314-45c8-9744-ef29d3e0c6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:16.261031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044af1b0-7314-45c8-9744-ef29d3e0c6c6 admin admin] PATH_INFO: `/v3/projects/db2d9c0939194793a0ac1ac497285f07/users/5f4d1599707642a587830f5ac9efc714/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:16.262329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e008c03-15dc-476a-b61b-86efe548d0ad None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:16.283013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8300409-1f02-4cfa-a358-9a6f623d68ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:16.283646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8300409-1f02-4cfa-a358-9a6f623d68ca admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:16.283942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8300409-1f02-4cfa-a358-9a6f623d68ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:16.284217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8300409-1f02-4cfa-a358-9a6f623d68ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:16.284916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8300409-1f02-4cfa-a358-9a6f623d68ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:41:16.285219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8300409-1f02-4cfa-a358-9a6f623d68ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:16.286848 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8300409-1f02-4cfa-a358-9a6f623d68ca admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:16.297178 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044af1b0-7314-45c8-9744-ef29d3e0c6c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db2d9c0939194793a0ac1ac497285f07, user_id=5f4d1599707642a587830f5ac9efc714, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:16.304276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044af1b0-7314-45c8-9744-ef29d3e0c6c6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:16.336488 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3209/6359] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:41:16.340677 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3151/6360] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:16 2022] PUT /identity/v3/projects/db2d9c0939194793a0ac1ac497285f07/users/5f4d1599707642a587830f5ac9efc714/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:41:16.346558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044af1b0-7314-45c8-9744-ef29d3e0c6c6 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:16.347577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8300409-1f02-4cfa-a358-9a6f623d68ca admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:16.383708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8300409-1f02-4cfa-a358-9a6f623d68ca admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:16.391728 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:16.476206 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:16.537629 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044af1b0-7314-45c8-9744-ef29d3e0c6c6 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:16.542351 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66314f59-453f-4df4-85e9-96dd672de9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:16.543005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66314f59-453f-4df4-85e9-96dd672de9d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:16.543323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66314f59-453f-4df4-85e9-96dd672de9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:16.543955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66314f59-453f-4df4-85e9-96dd672de9d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:16.544299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66314f59-453f-4df4-85e9-96dd672de9d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:16.547205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66314f59-453f-4df4-85e9-96dd672de9d5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:16.558157 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe149d-a807-48b3-beb8-6d5235690c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:16.563144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe149d-a807-48b3-beb8-6d5235690c88 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:16.563517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe149d-a807-48b3-beb8-6d5235690c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:16.563875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe149d-a807-48b3-beb8-6d5235690c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:16.564681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe149d-a807-48b3-beb8-6d5235690c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:16.567196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe149d-a807-48b3-beb8-6d5235690c88 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:16.593759 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3152/6361] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:16.595979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe149d-a807-48b3-beb8-6d5235690c88 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:16.612808 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3210/6362] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:16 2022] POST /identity/v3/projects => generated 387 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:16.616887 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66314f59-453f-4df4-85e9-96dd672de9d5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:16.620251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe149d-a807-48b3-beb8-6d5235690c88 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:16.768187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66314f59-453f-4df4-85e9-96dd672de9d5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:16.775659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c80af3-70f1-47bb-a87a-0a2adbd8da31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:16.776567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c80af3-70f1-47bb-a87a-0a2adbd8da31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:16.776830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c80af3-70f1-47bb-a87a-0a2adbd8da31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:16.777103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c80af3-70f1-47bb-a87a-0a2adbd8da31 admin admin] PATH_INFO: `/v3/projects/db2d9c0939194793a0ac1ac497285f07/users/5f4d1599707642a587830f5ac9efc714/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:16.781640 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0c9ba-a499-42ee-aa7b-efe5b5923001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:16.781819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c80af3-70f1-47bb-a87a-0a2adbd8da31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db2d9c0939194793a0ac1ac497285f07, user_id=5f4d1599707642a587830f5ac9efc714, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:16.782610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0c9ba-a499-42ee-aa7b-efe5b5923001 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:16.783055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0c9ba-a499-42ee-aa7b-efe5b5923001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:16.783532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0c9ba-a499-42ee-aa7b-efe5b5923001 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:16.784415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0c9ba-a499-42ee-aa7b-efe5b5923001 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:16.784559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c80af3-70f1-47bb-a87a-0a2adbd8da31 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:16.787694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a0c9ba-a499-42ee-aa7b-efe5b5923001 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:16.813275 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3153/6363] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:16 2022] PUT /identity/v3/projects/db2d9c0939194793a0ac1ac497285f07/users/5f4d1599707642a587830f5ac9efc714/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:16.828162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c2b26-439b-4e5b-93ca-2eb575d5ec7f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:16.828445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c2b26-439b-4e5b-93ca-2eb575d5ec7f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:16.828735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c2b26-439b-4e5b-93ca-2eb575d5ec7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:16.857873 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3211/6364] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:41:16 2022] POST /identity/v3/users => generated 294 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:16.859686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0c9ba-a499-42ee-aa7b-efe5b5923001 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:16.902787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0c9ba-a499-42ee-aa7b-efe5b5923001 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:16.914476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ba2c2b26-439b-4e5b-93ca-2eb575d5ec7f None None] MFA Rules not processed for user `5f4d1599707642a587830f5ac9efc714`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:16.916463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ba2c2b26-439b-4e5b-93ca-2eb575d5ec7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:17.079663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f5b8a-1d48-457f-b0d4-c209bebf3f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:17.082833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f5b8a-1d48-457f-b0d4-c209bebf3f8a admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:17.086509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f5b8a-1d48-457f-b0d4-c209bebf3f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:17.087562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f5b8a-1d48-457f-b0d4-c209bebf3f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:17.088896 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f5b8a-1d48-457f-b0d4-c209bebf3f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:17.096871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f5b8a-1d48-457f-b0d4-c209bebf3f8a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:17.102637 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3154/6365] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:17.107115 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c2b26-439b-4e5b-93ca-2eb575d5ec7f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:17.138562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c2b26-439b-4e5b-93ca-2eb575d5ec7f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:17.167237 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3212/6366] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:17.174478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f5b8a-1d48-457f-b0d4-c209bebf3f8a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:17.177253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b2503-da97-474d-87ff-9f3f2ad051a0 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f4d1599707642a587830f5ac9efc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db2d9c0939194793a0ac1ac497285f07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:17.179271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b2503-da97-474d-87ff-9f3f2ad051a0 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:17.179691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b2503-da97-474d-87ff-9f3f2ad051a0 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:17.181494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b2503-da97-474d-87ff-9f3f2ad051a0 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:17.184847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b2503-da97-474d-87ff-9f3f2ad051a0 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:17.187121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b2503-da97-474d-87ff-9f3f2ad051a0 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:17.210661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f5b8a-1d48-457f-b0d4-c209bebf3f8a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:17.229487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c2761-46cb-41e2-a909-97213b889ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:17.230008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c2761-46cb-41e2-a909-97213b889ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:17.230284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c2761-46cb-41e2-a909-97213b889ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:17.230553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c2761-46cb-41e2-a909-97213b889ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:17.231213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c2761-46cb-41e2-a909-97213b889ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:17.238806 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c2761-46cb-41e2-a909-97213b889ac9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:17.239632 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3155/6367] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:17 2022] POST /identity/v3/services => generated 286 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:17.241483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b2503-da97-474d-87ff-9f3f2ad051a0 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:17.263265 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3213/6368] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:17.267948 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c2761-46cb-41e2-a909-97213b889ac9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:17.286580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b2503-da97-474d-87ff-9f3f2ad051a0 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:17.303085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c7b84-a7b8-4d42-94ac-7d72fb858a16 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f4d1599707642a587830f5ac9efc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db2d9c0939194793a0ac1ac497285f07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:17.303790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c7b84-a7b8-4d42-94ac-7d72fb858a16 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:17.304032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c7b84-a7b8-4d42-94ac-7d72fb858a16 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:17.304278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c7b84-a7b8-4d42-94ac-7d72fb858a16 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:17.304976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c7b84-a7b8-4d42-94ac-7d72fb858a16 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:17.306021 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-678c7b84-a7b8-4d42-94ac-7d72fb858a16 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:41:17.306021 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:41:17.306021 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:41:17.306331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c2761-46cb-41e2-a909-97213b889ac9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:17.307115 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c7b84-a7b8-4d42-94ac-7d72fb858a16 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:17.315793 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-678c7b84-a7b8-4d42-94ac-7d72fb858a16 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 07 01:41:17.315793 n-d-master-1 devstack@keystone.service[80493]: Failed validating 'type' in schema['properties']['enabled']: Aug 07 01:41:17.315793 n-d-master-1 devstack@keystone.service[80493]: {'enum': [True, False, None], 'type': 'boolean'} Aug 07 01:41:17.315793 n-d-master-1 devstack@keystone.service[80493]: On instance['enabled']: Aug 07 01:41:17.315793 n-d-master-1 devstack@keystone.service[80493]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 07 01:41:17.315793 n-d-master-1 devstack@keystone.service[80493]: Failed validating 'type' in schema['properties']['enabled']: Aug 07 01:41:17.315793 n-d-master-1 devstack@keystone.service[80493]: {'enum': [True, False, None], 'type': 'boolean'} Aug 07 01:41:17.315793 n-d-master-1 devstack@keystone.service[80493]: On instance['enabled']: Aug 07 01:41:17.315793 n-d-master-1 devstack@keystone.service[80493]: 'False' Aug 07 01:41:17.315793 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:41:17.315793 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 07 01:41:17.315793 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 07 01:41:17.315793 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:41:17.315793 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise error Aug 07 01:41:17.315793 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Aug 07 01:41:17.315793 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:41:17.315793 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 07 01:41:17.315793 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 07 01:41:17.315793 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:41:17.315793 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application On instance['enabled']: Aug 07 01:41:17.315793 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application 'False' Aug 07 01:41:17.315793 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:41:17.315793 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:41:17.317494 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:41:17.317494 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:41:17.317494 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:41:17.317494 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:41:17.317494 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:41:17.317494 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:41:17.317494 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:41:17.317494 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:41:17.317494 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:41:17.317494 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:41:17.317494 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:41:17.317494 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:41:17.317494 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Aug 07 01:41:17.317494 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Aug 07 01:41:17.317494 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 07 01:41:17.317494 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 07 01:41:17.317494 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 07 01:41:17.318799 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 07 01:41:17.318799 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 07 01:41:17.318799 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:41:17.318799 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 07 01:41:17.318799 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 07 01:41:17.318799 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:41:17.318799 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application On instance['enabled']: Aug 07 01:41:17.318799 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application 'False' Aug 07 01:41:17.318799 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:41:17.318799 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3156/6369] 10.222.0.39 () {60 vars in 1156 bytes} [Sun Aug 7 01:41:17 2022] POST /identity/v3/endpoints => generated 283 bytes in 78 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 07 01:41:17.324175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c7b84-a7b8-4d42-94ac-7d72fb858a16 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:17.356884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c7b84-a7b8-4d42-94ac-7d72fb858a16 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:17.367045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc25387-da9b-46ce-8a30-a294a970ede2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f4d1599707642a587830f5ac9efc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db2d9c0939194793a0ac1ac497285f07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:17.367941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc25387-da9b-46ce-8a30-a294a970ede2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:17.368574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc25387-da9b-46ce-8a30-a294a970ede2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:17.369005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc25387-da9b-46ce-8a30-a294a970ede2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:17.369465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82073ce-d6d5-4925-977e-00b777eba13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:17.370036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc25387-da9b-46ce-8a30-a294a970ede2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:17.370171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82073ce-d6d5-4925-977e-00b777eba13d admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:17.370401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82073ce-d6d5-4925-977e-00b777eba13d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:17.370672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82073ce-d6d5-4925-977e-00b777eba13d admin admin] PATH_INFO: `/v3/projects/6ca43e6b529c422fae6f2bf4662a1849/users/55da7bb68504477ea18824accf87f29f/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:17.373553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc25387-da9b-46ce-8a30-a294a970ede2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:17.381441 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-7cc25387-da9b-46ce-8a30-a294a970ede2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 07 01:41:17.381441 n-d-master-1 devstack@keystone.service[80493]: Failed validating 'type' in schema['properties']['enabled']: Aug 07 01:41:17.381441 n-d-master-1 devstack@keystone.service[80493]: {'enum': [True, False, None], 'type': 'boolean'} Aug 07 01:41:17.381441 n-d-master-1 devstack@keystone.service[80493]: On instance['enabled']: Aug 07 01:41:17.381441 n-d-master-1 devstack@keystone.service[80493]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 07 01:41:17.381441 n-d-master-1 devstack@keystone.service[80493]: Failed validating 'type' in schema['properties']['enabled']: Aug 07 01:41:17.381441 n-d-master-1 devstack@keystone.service[80493]: {'enum': [True, False, None], 'type': 'boolean'} Aug 07 01:41:17.381441 n-d-master-1 devstack@keystone.service[80493]: On instance['enabled']: Aug 07 01:41:17.381441 n-d-master-1 devstack@keystone.service[80493]: 'True' Aug 07 01:41:17.381441 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:41:17.381441 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 07 01:41:17.381441 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 07 01:41:17.381441 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:41:17.381441 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise error Aug 07 01:41:17.381441 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Aug 07 01:41:17.381441 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:41:17.381441 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 07 01:41:17.381441 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 07 01:41:17.381441 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:41:17.381441 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application On instance['enabled']: Aug 07 01:41:17.381441 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application 'True' Aug 07 01:41:17.381441 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:41:17.381441 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:41:17.383147 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:41:17.383147 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:41:17.383147 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:41:17.383147 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:41:17.383147 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:41:17.383147 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:41:17.383147 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:41:17.383147 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:41:17.383147 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:41:17.383147 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:41:17.383147 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:41:17.383147 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:41:17.383147 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Aug 07 01:41:17.383147 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Aug 07 01:41:17.383147 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 07 01:41:17.383147 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 07 01:41:17.383147 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 07 01:41:17.384355 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 07 01:41:17.384355 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 07 01:41:17.384355 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:41:17.384355 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 07 01:41:17.384355 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 07 01:41:17.384355 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:41:17.384355 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application On instance['enabled']: Aug 07 01:41:17.384355 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application 'True' Aug 07 01:41:17.384355 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:41:17.390201 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3157/6370] 10.222.0.39 () {60 vars in 1156 bytes} [Sun Aug 7 01:41:17 2022] POST /identity/v3/endpoints => generated 281 bytes in 66 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 07 01:41:17.390622 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc25387-da9b-46ce-8a30-a294a970ede2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:17.401494 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:17.407342 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc25387-da9b-46ce-8a30-a294a970ede2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:17.418088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ff576-ce82-42c9-b731-b78c97746be6 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f4d1599707642a587830f5ac9efc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db2d9c0939194793a0ac1ac497285f07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:17.419079 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ff576-ce82-42c9-b731-b78c97746be6 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:17.419592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ff576-ce82-42c9-b731-b78c97746be6 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:17.419980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ff576-ce82-42c9-b731-b78c97746be6 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:17.421082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ff576-ce82-42c9-b731-b78c97746be6 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:17.423691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ff576-ce82-42c9-b731-b78c97746be6 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:17.435738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82073ce-d6d5-4925-977e-00b777eba13d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ca43e6b529c422fae6f2bf4662a1849, user_id=55da7bb68504477ea18824accf87f29f, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:17.438784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82073ce-d6d5-4925-977e-00b777eba13d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:17.450831 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-8c0ff576-ce82-42c9-b731-b78c97746be6 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1629970426. To ensure interoperability, identifiers should be a valid uuid. Aug 07 01:41:17.450831 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 07 01:41:17.450831 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:41:17.465194 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:17.475638 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3214/6371] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:17 2022] PUT /identity/v3/projects/6ca43e6b529c422fae6f2bf4662a1849/users/55da7bb68504477ea18824accf87f29f/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:17.477897 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82073ce-d6d5-4925-977e-00b777eba13d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:17.491147 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d82073ce-d6d5-4925-977e-00b777eba13d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:17.529073 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3158/6372] 10.222.0.39 () {60 vars in 1156 bytes} [Sun Aug 7 01:41:17 2022] POST /identity/v3/endpoints => generated 360 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:17.530825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb90ff-f626-4518-80c6-ce8d9af13483 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:17.531383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb90ff-f626-4518-80c6-ce8d9af13483 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:17.531938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb90ff-f626-4518-80c6-ce8d9af13483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:17.617864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-24bb90ff-f626-4518-80c6-ce8d9af13483 None None] MFA Rules not processed for user `55da7bb68504477ea18824accf87f29f`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:17.619879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-24bb90ff-f626-4518-80c6-ce8d9af13483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:17.785812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82073ce-d6d5-4925-977e-00b777eba13d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:17.823994 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3159/6373] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:17 2022] POST /identity/v3/auth/tokens => generated 3578 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:17.828861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb90ff-f626-4518-80c6-ce8d9af13483 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:17.830631 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed459c8f-079c-4090-80e5-1fca85cc9182 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:17.832182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed459c8f-079c-4090-80e5-1fca85cc9182 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:17.833876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed459c8f-079c-4090-80e5-1fca85cc9182 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:17.834836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed459c8f-079c-4090-80e5-1fca85cc9182 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:17.838507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ed459c8f-079c-4090-80e5-1fca85cc9182 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:17.878511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed459c8f-079c-4090-80e5-1fca85cc9182 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:17.882313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed459c8f-079c-4090-80e5-1fca85cc9182 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:17.911428 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3215/6374] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:17 2022] GET /identity/v3/auth/tokens => generated 3622 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:17.912890 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed459c8f-079c-4090-80e5-1fca85cc9182 service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:17.922161 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ed459c8f-079c-4090-80e5-1fca85cc9182 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:18.103298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb90ff-f626-4518-80c6-ce8d9af13483 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:18.124572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e400b-ff4b-43e1-9bbb-3d9873327ce9 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f4d1599707642a587830f5ac9efc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db2d9c0939194793a0ac1ac497285f07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:18.124921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e400b-ff4b-43e1-9bbb-3d9873327ce9 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:18.125196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e400b-ff4b-43e1-9bbb-3d9873327ce9 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:18.125538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e400b-ff4b-43e1-9bbb-3d9873327ce9 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] PATH_INFO: `/v3/regions/tempest-region-1629970426` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:18.126412 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e400b-ff4b-43e1-9bbb-3d9873327ce9 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1629970426)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:18.127600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e400b-ff4b-43e1-9bbb-3d9873327ce9 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:18.135800 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3160/6375] 10.222.0.39 () {58 vars in 1206 bytes} [Sun Aug 7 01:41:17 2022] GET /identity/v3/regions/tempest-region-1629970426 => generated 180 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:18.141325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e400b-ff4b-43e1-9bbb-3d9873327ce9 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:18.167270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e400b-ff4b-43e1-9bbb-3d9873327ce9 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:18.196589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a35b99-c276-4f3a-a933-6f632f434cd2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f4d1599707642a587830f5ac9efc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db2d9c0939194793a0ac1ac497285f07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:18.197252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a35b99-c276-4f3a-a933-6f632f434cd2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:18.197530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a35b99-c276-4f3a-a933-6f632f434cd2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:18.197877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a35b99-c276-4f3a-a933-6f632f434cd2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] PATH_INFO: `/v3/endpoints/d6f688d9c06e485ba7f042771d686210` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:18.216331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed459c8f-079c-4090-80e5-1fca85cc9182 service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:18.221236 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a35b99-c276-4f3a-a933-6f632f434cd2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=d6f688d9c06e485ba7f042771d686210)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:18.223393 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-b1a35b99-c276-4f3a-a933-6f632f434cd2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:41:18.223393 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:41:18.223393 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:41:18.225199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a35b99-c276-4f3a-a933-6f632f434cd2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:18.245868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-b1a35b99-c276-4f3a-a933-6f632f434cd2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 07 01:41:18.245868 n-d-master-1 devstack@keystone.service[80493]: Failed validating 'type' in schema['properties']['enabled']: Aug 07 01:41:18.245868 n-d-master-1 devstack@keystone.service[80493]: {'enum': [True, False, None], 'type': 'boolean'} Aug 07 01:41:18.245868 n-d-master-1 devstack@keystone.service[80493]: On instance['enabled']: Aug 07 01:41:18.245868 n-d-master-1 devstack@keystone.service[80493]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 07 01:41:18.245868 n-d-master-1 devstack@keystone.service[80493]: Failed validating 'type' in schema['properties']['enabled']: Aug 07 01:41:18.245868 n-d-master-1 devstack@keystone.service[80493]: {'enum': [True, False, None], 'type': 'boolean'} Aug 07 01:41:18.245868 n-d-master-1 devstack@keystone.service[80493]: On instance['enabled']: Aug 07 01:41:18.245868 n-d-master-1 devstack@keystone.service[80493]: 'False' Aug 07 01:41:18.245868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:41:18.245868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 07 01:41:18.245868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 07 01:41:18.245868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:41:18.245868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise error Aug 07 01:41:18.245868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Aug 07 01:41:18.245868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:41:18.245868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 07 01:41:18.245868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 07 01:41:18.245868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:41:18.245868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application On instance['enabled']: Aug 07 01:41:18.245868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application 'False' Aug 07 01:41:18.245868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:41:18.245868 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:41:18.247327 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:41:18.247327 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:41:18.247327 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:41:18.247327 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:41:18.247327 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:41:18.247327 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:41:18.247327 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:41:18.247327 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:41:18.247327 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:41:18.247327 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:41:18.247327 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:41:18.247327 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:41:18.247327 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Aug 07 01:41:18.247327 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Aug 07 01:41:18.247327 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 07 01:41:18.247327 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 07 01:41:18.247327 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 07 01:41:18.248355 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 07 01:41:18.248355 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Aug 07 01:41:18.248355 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:41:18.248355 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 07 01:41:18.248355 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 07 01:41:18.248355 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:41:18.248355 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application On instance['enabled']: Aug 07 01:41:18.248355 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application 'False' Aug 07 01:41:18.248355 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:41:18.257468 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd127a-f620-4ebd-ba7b-fe00bde9734e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:18.258776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd127a-f620-4ebd-ba7b-fe00bde9734e service glance] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:18.259023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd127a-f620-4ebd-ba7b-fe00bde9734e service glance] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:18.259296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd127a-f620-4ebd-ba7b-fe00bde9734e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:18.260055 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3161/6376] 10.222.0.39 () {60 vars in 1255 bytes} [Sun Aug 7 01:41:18 2022] PATCH /identity/v3/endpoints/d6f688d9c06e485ba7f042771d686210 => generated 283 bytes in 117 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 07 01:41:18.261230 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a35b99-c276-4f3a-a933-6f632f434cd2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:18.278671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd127a-f620-4ebd-ba7b-fe00bde9734e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:18.284949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd127a-f620-4ebd-ba7b-fe00bde9734e service glance] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:18.303040 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3216/6377] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:17 2022] GET /identity/v3/auth/tokens => generated 3578 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:18.306299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a35b99-c276-4f3a-a933-6f632f434cd2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:18.335768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652905b-e025-42ed-828a-76c609ad0bcc tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f4d1599707642a587830f5ac9efc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db2d9c0939194793a0ac1ac497285f07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:18.336461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652905b-e025-42ed-828a-76c609ad0bcc tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:18.336740 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652905b-e025-42ed-828a-76c609ad0bcc tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:18.337013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652905b-e025-42ed-828a-76c609ad0bcc tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] PATH_INFO: `/v3/endpoints/d6f688d9c06e485ba7f042771d686210` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:18.340718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652905b-e025-42ed-828a-76c609ad0bcc tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=d6f688d9c06e485ba7f042771d686210)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:18.341765 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-b652905b-e025-42ed-828a-76c609ad0bcc tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:41:18.341765 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:41:18.341765 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:41:18.342669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652905b-e025-42ed-828a-76c609ad0bcc tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:18.362543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b652905b-e025-42ed-828a-76c609ad0bcc tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'd6f688d9c06e485ba7f042771d686210', 'request_id': 'req-b652905b-e025-42ed-828a-76c609ad0bcc'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:18.385902 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3162/6378] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:41:18 2022] DELETE /identity/v3/endpoints/d6f688d9c06e485ba7f042771d686210 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:18.390081 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd127a-f620-4ebd-ba7b-fe00bde9734e service glance] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:18.404705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd127a-f620-4ebd-ba7b-fe00bde9734e service glance] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:18.453409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cc441-57ea-42fd-aef4-b0a237876880 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f4d1599707642a587830f5ac9efc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db2d9c0939194793a0ac1ac497285f07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:18.454059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cc441-57ea-42fd-aef4-b0a237876880 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:18.454344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cc441-57ea-42fd-aef4-b0a237876880 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:18.454643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cc441-57ea-42fd-aef4-b0a237876880 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] PATH_INFO: `/v3/regions/tempest-region-1629970426` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:18.455208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164cc441-57ea-42fd-aef4-b0a237876880 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1629970426)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:18.456903 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164cc441-57ea-42fd-aef4-b0a237876880 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:18.501359 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-164cc441-57ea-42fd-aef4-b0a237876880 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1629970426. To ensure interoperability, identifiers should be a valid uuid. Aug 07 01:41:18.501359 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 07 01:41:18.501359 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:41:18.514981 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3217/6379] 10.222.0.39 () {58 vars in 1209 bytes} [Sun Aug 7 01:41:18 2022] DELETE /identity/v3/regions/tempest-region-1629970426 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:18.520694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652905b-e025-42ed-828a-76c609ad0bcc tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:18.536376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652905b-e025-42ed-828a-76c609ad0bcc tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:18.556941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40997f35-65e6-4054-a9ab-d5c9e72590f2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f4d1599707642a587830f5ac9efc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db2d9c0939194793a0ac1ac497285f07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:18.557549 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40997f35-65e6-4054-a9ab-d5c9e72590f2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:18.557828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40997f35-65e6-4054-a9ab-d5c9e72590f2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:18.558156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40997f35-65e6-4054-a9ab-d5c9e72590f2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:18.558826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40997f35-65e6-4054-a9ab-d5c9e72590f2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:18.560544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40997f35-65e6-4054-a9ab-d5c9e72590f2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:18.572399 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:18.578229 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf98da-0bea-4e1b-a568-d953d083f5a5 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:18.578512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf98da-0bea-4e1b-a568-d953d083f5a5 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:18.579060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf98da-0bea-4e1b-a568-d953d083f5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:18.601916 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-40997f35-65e6-4054-a9ab-d5c9e72590f2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1093742011. To ensure interoperability, identifiers should be a valid uuid. Aug 07 01:41:18.601916 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 07 01:41:18.601916 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:41:18.622882 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-77bf98da-0bea-4e1b-a568-d953d083f5a5 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:18.625539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-77bf98da-0bea-4e1b-a568-d953d083f5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:18.654871 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3163/6380] 10.222.0.39 () {60 vars in 1156 bytes} [Sun Aug 7 01:41:18 2022] POST /identity/v3/endpoints => generated 361 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:18.661642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40997f35-65e6-4054-a9ab-d5c9e72590f2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:18.733200 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:18.734038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40997f35-65e6-4054-a9ab-d5c9e72590f2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:18.748544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534b3f1-6160-4eb2-a65f-529fbdd4f9a1 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f4d1599707642a587830f5ac9efc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db2d9c0939194793a0ac1ac497285f07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:18.749685 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534b3f1-6160-4eb2-a65f-529fbdd4f9a1 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:18.764795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534b3f1-6160-4eb2-a65f-529fbdd4f9a1 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:18.767590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534b3f1-6160-4eb2-a65f-529fbdd4f9a1 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] PATH_INFO: `/v3/regions/tempest-region-1093742011` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:18.767590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534b3f1-6160-4eb2-a65f-529fbdd4f9a1 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1093742011)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:18.775308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534b3f1-6160-4eb2-a65f-529fbdd4f9a1 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:18.785900 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3164/6381] 10.222.0.39 () {58 vars in 1206 bytes} [Sun Aug 7 01:41:18 2022] GET /identity/v3/regions/tempest-region-1093742011 => generated 180 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:18.806077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534b3f1-6160-4eb2-a65f-529fbdd4f9a1 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:18.836993 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3218/6382] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:41:18 2022] POST /identity/v3/auth/tokens => generated 3510 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:18.875073 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534b3f1-6160-4eb2-a65f-529fbdd4f9a1 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:18.890921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3ff29-ca9f-4b70-a98f-1dee63d32294 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f4d1599707642a587830f5ac9efc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db2d9c0939194793a0ac1ac497285f07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:18.892293 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3ff29-ca9f-4b70-a98f-1dee63d32294 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:18.892721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3ff29-ca9f-4b70-a98f-1dee63d32294 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:18.896485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3ff29-ca9f-4b70-a98f-1dee63d32294 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] PATH_INFO: `/v3/endpoints/7f449c35920c4f19bf30ae0ee06cb9b3` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:18.912972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3ff29-ca9f-4b70-a98f-1dee63d32294 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=7f449c35920c4f19bf30ae0ee06cb9b3)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:18.914459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3ff29-ca9f-4b70-a98f-1dee63d32294 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:18.935263 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-7cc3ff29-ca9f-4b70-a98f-1dee63d32294 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 07 01:41:18.935263 n-d-master-1 devstack@keystone.service[80493]: Failed validating 'type' in schema['properties']['enabled']: Aug 07 01:41:18.935263 n-d-master-1 devstack@keystone.service[80493]: {'enum': [True, False, None], 'type': 'boolean'} Aug 07 01:41:18.935263 n-d-master-1 devstack@keystone.service[80493]: On instance['enabled']: Aug 07 01:41:18.935263 n-d-master-1 devstack@keystone.service[80493]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 07 01:41:18.935263 n-d-master-1 devstack@keystone.service[80493]: Failed validating 'type' in schema['properties']['enabled']: Aug 07 01:41:18.935263 n-d-master-1 devstack@keystone.service[80493]: {'enum': [True, False, None], 'type': 'boolean'} Aug 07 01:41:18.935263 n-d-master-1 devstack@keystone.service[80493]: On instance['enabled']: Aug 07 01:41:18.935263 n-d-master-1 devstack@keystone.service[80493]: 'True' Aug 07 01:41:18.935263 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:41:18.935263 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Aug 07 01:41:18.935263 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Aug 07 01:41:18.935263 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 07 01:41:18.935263 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise error Aug 07 01:41:18.935263 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Aug 07 01:41:18.935263 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:41:18.935263 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 07 01:41:18.935263 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 07 01:41:18.935263 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:41:18.935263 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application On instance['enabled']: Aug 07 01:41:18.935263 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application 'True' Aug 07 01:41:18.935263 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:41:18.935263 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:41:18.936867 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:41:18.936867 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:41:18.936867 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:41:18.936867 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:41:18.936867 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:41:18.936867 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:41:18.936867 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:41:18.936867 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:41:18.936867 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:41:18.936867 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:41:18.936867 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:41:18.936867 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:41:18.936867 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Aug 07 01:41:18.936867 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Aug 07 01:41:18.936867 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Aug 07 01:41:18.936867 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Aug 07 01:41:18.936867 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Aug 07 01:41:18.937835 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Aug 07 01:41:18.937835 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Aug 07 01:41:18.937835 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:41:18.937835 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Aug 07 01:41:18.937835 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Aug 07 01:41:18.937835 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:41:18.937835 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application On instance['enabled']: Aug 07 01:41:18.937835 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application 'True' Aug 07 01:41:18.937835 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:41:18.940443 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3165/6383] 10.222.0.39 () {60 vars in 1255 bytes} [Sun Aug 7 01:41:18 2022] PATCH /identity/v3/endpoints/7f449c35920c4f19bf30ae0ee06cb9b3 => generated 281 bytes in 141 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Aug 07 01:41:18.941910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf98da-0bea-4e1b-a568-d953d083f5a5 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:18.943768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-77bf98da-0bea-4e1b-a568-d953d083f5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:18.953496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3ff29-ca9f-4b70-a98f-1dee63d32294 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:18.994418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3ff29-ca9f-4b70-a98f-1dee63d32294 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:19.040692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fc8cd-d202-4440-830e-06eeaabf0a07 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f4d1599707642a587830f5ac9efc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db2d9c0939194793a0ac1ac497285f07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:19.041344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fc8cd-d202-4440-830e-06eeaabf0a07 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:19.041626 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fc8cd-d202-4440-830e-06eeaabf0a07 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:19.041901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fc8cd-d202-4440-830e-06eeaabf0a07 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] PATH_INFO: `/v3/endpoints/7f449c35920c4f19bf30ae0ee06cb9b3` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:19.043229 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fc8cd-d202-4440-830e-06eeaabf0a07 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=7f449c35920c4f19bf30ae0ee06cb9b3)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:19.045213 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fc8cd-d202-4440-830e-06eeaabf0a07 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:19.070696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d12fc8cd-d202-4440-830e-06eeaabf0a07 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '7f449c35920c4f19bf30ae0ee06cb9b3', 'request_id': 'req-d12fc8cd-d202-4440-830e-06eeaabf0a07'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:19.092139 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3166/6384] 10.222.0.39 () {58 vars in 1236 bytes} [Sun Aug 7 01:41:18 2022] DELETE /identity/v3/endpoints/7f449c35920c4f19bf30ae0ee06cb9b3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:19.095910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fc8cd-d202-4440-830e-06eeaabf0a07 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:19.143150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fc8cd-d202-4440-830e-06eeaabf0a07 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:19.150381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f45cb2-611f-408a-929c-37bae0ccbca2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f4d1599707642a587830f5ac9efc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db2d9c0939194793a0ac1ac497285f07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:19.151575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f45cb2-611f-408a-929c-37bae0ccbca2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:19.152253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f45cb2-611f-408a-929c-37bae0ccbca2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:19.152786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f45cb2-611f-408a-929c-37bae0ccbca2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] PATH_INFO: `/v3/regions/tempest-region-1093742011` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:19.153655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f45cb2-611f-408a-929c-37bae0ccbca2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1093742011)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:19.156311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f45cb2-611f-408a-929c-37bae0ccbca2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:19.166350 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf98da-0bea-4e1b-a568-d953d083f5a5 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:19.189231 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3167/6385] 10.222.0.39 () {58 vars in 1209 bytes} [Sun Aug 7 01:41:19 2022] DELETE /identity/v3/regions/tempest-region-1093742011 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:19.191197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f45cb2-611f-408a-929c-37bae0ccbca2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:19.204449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da244f85-fc6e-4243-87f9-5616e822cb44 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:19.205146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da244f85-fc6e-4243-87f9-5616e822cb44 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:19.205425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da244f85-fc6e-4243-87f9-5616e822cb44 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:19.205806 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da244f85-fc6e-4243-87f9-5616e822cb44 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:19.223674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f45cb2-611f-408a-929c-37bae0ccbca2 tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:19.225234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da244f85-fc6e-4243-87f9-5616e822cb44 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:19.226947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da244f85-fc6e-4243-87f9-5616e822cb44 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:19.238585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c5afb-901e-46ec-b85f-61221689989d tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f4d1599707642a587830f5ac9efc714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db2d9c0939194793a0ac1ac497285f07', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:19.239265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c5afb-901e-46ec-b85f-61221689989d tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:19.239535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c5afb-901e-46ec-b85f-61221689989d tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:19.239816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c5afb-901e-46ec-b85f-61221689989d tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] PATH_INFO: `/v3/services/155a70dcbbc24319a457737eefe74cfd` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:19.240462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c5afb-901e-46ec-b85f-61221689989d tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: Authorizing `identity:delete_service(service_id=155a70dcbbc24319a457737eefe74cfd)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:19.243649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c5afb-901e-46ec-b85f-61221689989d tempest-EndpointsNegativeTestJSON-462845496 tempest-EndpointsNegativeTestJSON-462845496-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:19.248942 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3219/6386] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:41:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:41:19.304926 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3168/6387] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:41:19 2022] DELETE /identity/v3/services/155a70dcbbc24319a457737eefe74cfd => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:19.309266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da244f85-fc6e-4243-87f9-5616e822cb44 service swift] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:19.552099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da244f85-fc6e-4243-87f9-5616e822cb44 service swift] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:19.605625 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d6938-3abc-4ee8-8b62-975f51f7ee50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:19.606879 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d6938-3abc-4ee8-8b62-975f51f7ee50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:19.608873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d6938-3abc-4ee8-8b62-975f51f7ee50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:19.611496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d6938-3abc-4ee8-8b62-975f51f7ee50 admin admin] PATH_INFO: `/v3/users/9a385c1a6f6d4325bc92dcd4f4ed10b9` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:19.614218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d6938-3abc-4ee8-8b62-975f51f7ee50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a385c1a6f6d4325bc92dcd4f4ed10b9)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:19.620932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d6938-3abc-4ee8-8b62-975f51f7ee50 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:19.678246 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:19.764284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-779d6938-3abc-4ee8-8b62-975f51f7ee50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a385c1a6f6d4325bc92dcd4f4ed10b9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:19.772957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-779d6938-3abc-4ee8-8b62-975f51f7ee50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a385c1a6f6d4325bc92dcd4f4ed10b9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:19.787283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-779d6938-3abc-4ee8-8b62-975f51f7ee50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a385c1a6f6d4325bc92dcd4f4ed10b9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:19.788561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-779d6938-3abc-4ee8-8b62-975f51f7ee50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a385c1a6f6d4325bc92dcd4f4ed10b9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:19.799540 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-779d6938-3abc-4ee8-8b62-975f51f7ee50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a385c1a6f6d4325bc92dcd4f4ed10b9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:19.807671 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3220/6388] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:41:19 2022] DELETE /identity/v3/users/9a385c1a6f6d4325bc92dcd4f4ed10b9 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:41:19.812389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a943326-f450-4c3a-a2f3-e324cc9821e1 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:19.812863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a943326-f450-4c3a-a2f3-e324cc9821e1 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:19.813312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a943326-f450-4c3a-a2f3-e324cc9821e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:19.845762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-5a943326-f450-4c3a-a2f3-e324cc9821e1 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:19.850197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5a943326-f450-4c3a-a2f3-e324cc9821e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:20.026689 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3169/6389] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:41:20.051527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d6938-3abc-4ee8-8b62-975f51f7ee50 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:20.053283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-779d6938-3abc-4ee8-8b62-975f51f7ee50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:20.082832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572b0fb-4f17-49ca-8162-5dc4ccee83f3 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:20.083327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572b0fb-4f17-49ca-8162-5dc4ccee83f3 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:20.083974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572b0fb-4f17-49ca-8162-5dc4ccee83f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:20.124232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1572b0fb-4f17-49ca-8162-5dc4ccee83f3 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:20.126099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1572b0fb-4f17-49ca-8162-5dc4ccee83f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:20.191716 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:20.240421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d6938-3abc-4ee8-8b62-975f51f7ee50 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:20.252362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b38da8-56b6-460c-87cf-0cace40724e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:20.253004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b38da8-56b6-460c-87cf-0cace40724e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:20.254511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b38da8-56b6-460c-87cf-0cace40724e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:20.254796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b38da8-56b6-460c-87cf-0cace40724e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:20.280514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b38da8-56b6-460c-87cf-0cace40724e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:20.282080 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b38da8-56b6-460c-87cf-0cace40724e4 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:20.313277 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3170/6390] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:41:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:20.325954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572b0fb-4f17-49ca-8162-5dc4ccee83f3 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:20.328798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1572b0fb-4f17-49ca-8162-5dc4ccee83f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:20.338544 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3221/6391] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:20.456024 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572b0fb-4f17-49ca-8162-5dc4ccee83f3 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:20.463138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c330d-eb61-49c9-9dd8-977d8c726068 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:20.463780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c330d-eb61-49c9-9dd8-977d8c726068 service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:20.464170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c330d-eb61-49c9-9dd8-977d8c726068 service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:20.464458 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c330d-eb61-49c9-9dd8-977d8c726068 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:20.475351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c330d-eb61-49c9-9dd8-977d8c726068 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:20.477557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c330d-eb61-49c9-9dd8-977d8c726068 service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:20.489441 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3171/6392] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:41:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:41:21.338885 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9295fca-3fed-46ef-b1b9-0bc002a98d18 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:21.339754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9295fca-3fed-46ef-b1b9-0bc002a98d18 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:21.340231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9295fca-3fed-46ef-b1b9-0bc002a98d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:21.377655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c9295fca-3fed-46ef-b1b9-0bc002a98d18 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:21.379687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c9295fca-3fed-46ef-b1b9-0bc002a98d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:21.402549 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3222/6393] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:41:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:21.416834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c330d-eb61-49c9-9dd8-977d8c726068 service swift] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:21.443547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c330d-eb61-49c9-9dd8-977d8c726068 service swift] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:21.471522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24780e5-f0e1-4315-b55c-d43a3e8ae0f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:21.472231 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24780e5-f0e1-4315-b55c-d43a3e8ae0f8 service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:21.472515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24780e5-f0e1-4315-b55c-d43a3e8ae0f8 service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:21.472790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24780e5-f0e1-4315-b55c-d43a3e8ae0f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:21.511636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24780e5-f0e1-4315-b55c-d43a3e8ae0f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:21.516631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24780e5-f0e1-4315-b55c-d43a3e8ae0f8 service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:21.557822 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3172/6394] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:41:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:41:21.883796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a82b34-5a3a-47bc-b2b3-2afa46e6e354 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:21.884422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a82b34-5a3a-47bc-b2b3-2afa46e6e354 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:21.885168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a82b34-5a3a-47bc-b2b3-2afa46e6e354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:21.929637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c0a82b34-5a3a-47bc-b2b3-2afa46e6e354 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:21.935193 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c0a82b34-5a3a-47bc-b2b3-2afa46e6e354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:21.978064 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3223/6395] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:41:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:21.995417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24780e5-f0e1-4315-b55c-d43a3e8ae0f8 service swift] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:22.011423 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a82b34-5a3a-47bc-b2b3-2afa46e6e354 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:22.012847 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c0a82b34-5a3a-47bc-b2b3-2afa46e6e354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:22.021180 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24780e5-f0e1-4315-b55c-d43a3e8ae0f8 service swift] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:22.052387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a82b34-5a3a-47bc-b2b3-2afa46e6e354 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:22.055856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742533c-edd9-4bbc-9e3f-9f0cf64961c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:22.056509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742533c-edd9-4bbc-9e3f-9f0cf64961c6 service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:22.056786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742533c-edd9-4bbc-9e3f-9f0cf64961c6 service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:22.057051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742533c-edd9-4bbc-9e3f-9f0cf64961c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:22.073902 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce93b7-7c34-430a-a7d4-628106b80cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:22.074556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce93b7-7c34-430a-a7d4-628106b80cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:22.074829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce93b7-7c34-430a-a7d4-628106b80cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:22.075097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce93b7-7c34-430a-a7d4-628106b80cd9 admin admin] PATH_INFO: `/v3/projects/4049c38cd533478c930fc799b53f97e0` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:22.087123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce93b7-7c34-430a-a7d4-628106b80cd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4049c38cd533478c930fc799b53f97e0)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:22.089104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce93b7-7c34-430a-a7d4-628106b80cd9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:22.090270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742533c-edd9-4bbc-9e3f-9f0cf64961c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:22.092322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c742533c-edd9-4bbc-9e3f-9f0cf64961c6 service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:22.111719 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3173/6396] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:41:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:41:22.223211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-02ce93b7-7c34-430a-a7d4-628106b80cd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4049c38cd533478c930fc799b53f97e0', 'request_id': 'req-02ce93b7-7c34-430a-a7d4-628106b80cd9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:22.233782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-02ce93b7-7c34-430a-a7d4-628106b80cd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4049c38cd533478c930fc799b53f97e0', 'request_id': 'req-02ce93b7-7c34-430a-a7d4-628106b80cd9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:22.248585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-02ce93b7-7c34-430a-a7d4-628106b80cd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4049c38cd533478c930fc799b53f97e0', 'request_id': 'req-02ce93b7-7c34-430a-a7d4-628106b80cd9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:22.283308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-02ce93b7-7c34-430a-a7d4-628106b80cd9 admin admin] The token cache is being invalidate because project 4049c38cd533478c930fc799b53f97e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:22.283308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-02ce93b7-7c34-430a-a7d4-628106b80cd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:22.286585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-02ce93b7-7c34-430a-a7d4-628106b80cd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:22.290486 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3224/6397] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:41:22 2022] DELETE /identity/v3/projects/4049c38cd533478c930fc799b53f97e0 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:41:22.295566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742533c-edd9-4bbc-9e3f-9f0cf64961c6 service swift] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:22.318534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742533c-edd9-4bbc-9e3f-9f0cf64961c6 service swift] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:22.427651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6816f-6dc8-4d52-a8c6-e98777012a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:22.428365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6816f-6dc8-4d52-a8c6-e98777012a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:22.428593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6816f-6dc8-4d52-a8c6-e98777012a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:22.429185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6816f-6dc8-4d52-a8c6-e98777012a0b admin admin] PATH_INFO: `/v3/users/5f4d1599707642a587830f5ac9efc714` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:22.437191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6816f-6dc8-4d52-a8c6-e98777012a0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f4d1599707642a587830f5ac9efc714)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:22.447878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6816f-6dc8-4d52-a8c6-e98777012a0b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:22.540409 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:22.630452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-22b6816f-6dc8-4d52-a8c6-e98777012a0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f4d1599707642a587830f5ac9efc714'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:22.676602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-22b6816f-6dc8-4d52-a8c6-e98777012a0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f4d1599707642a587830f5ac9efc714'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:22.747381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-22b6816f-6dc8-4d52-a8c6-e98777012a0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f4d1599707642a587830f5ac9efc714'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:22.748425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-22b6816f-6dc8-4d52-a8c6-e98777012a0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f4d1599707642a587830f5ac9efc714'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:22.778904 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-22b6816f-6dc8-4d52-a8c6-e98777012a0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f4d1599707642a587830f5ac9efc714'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:22.786381 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3174/6398] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:41:22 2022] DELETE /identity/v3/users/5f4d1599707642a587830f5ac9efc714 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:22.879367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b592bb0-969e-4571-b32e-45eee851623f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:22.879768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b592bb0-969e-4571-b32e-45eee851623f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:22.879982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b592bb0-969e-4571-b32e-45eee851623f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:22.938357 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:22.989568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-8b592bb0-969e-4571-b32e-45eee851623f None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:22.992966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8b592bb0-969e-4571-b32e-45eee851623f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:23.138795 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3225/6399] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:41:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:23.157366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6816f-6dc8-4d52-a8c6-e98777012a0b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:23.158346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-22b6816f-6dc8-4d52-a8c6-e98777012a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:23.449010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6816f-6dc8-4d52-a8c6-e98777012a0b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:23.462780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b9ff4-5702-43af-9077-e0b90b954772 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:23.464597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b9ff4-5702-43af-9077-e0b90b954772 service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:23.464885 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b9ff4-5702-43af-9077-e0b90b954772 service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:23.465161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b9ff4-5702-43af-9077-e0b90b954772 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:23.497205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b9ff4-5702-43af-9077-e0b90b954772 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:23.507661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b9ff4-5702-43af-9077-e0b90b954772 service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:23.563674 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3175/6400] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:41:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:41:23.887111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9af5fc-9bb0-4932-8748-63db690f7d0c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:23.888156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9af5fc-9bb0-4932-8748-63db690f7d0c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:23.888796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9af5fc-9bb0-4932-8748-63db690f7d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:23.915590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3c9af5fc-9bb0-4932-8748-63db690f7d0c None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:23.917794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3c9af5fc-9bb0-4932-8748-63db690f7d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:23.929367 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3226/6401] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:41:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:41:23.946788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b9ff4-5702-43af-9077-e0b90b954772 service swift] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:23.990774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b9ff4-5702-43af-9077-e0b90b954772 service swift] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:23.995764 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6624e15-2905-40e9-a3ff-b206ff2737dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:23.996576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6624e15-2905-40e9-a3ff-b206ff2737dc service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:23.996849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6624e15-2905-40e9-a3ff-b206ff2737dc service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:23.997144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6624e15-2905-40e9-a3ff-b206ff2737dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:24.006854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6624e15-2905-40e9-a3ff-b206ff2737dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:24.008734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6624e15-2905-40e9-a3ff-b206ff2737dc service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:24.030240 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3176/6402] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:41:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:41:24.223480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9af5fc-9bb0-4932-8748-63db690f7d0c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:24.225372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3c9af5fc-9bb0-4932-8748-63db690f7d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:24.414206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6624e15-2905-40e9-a3ff-b206ff2737dc service swift] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:24.414903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f6624e15-2905-40e9-a3ff-b206ff2737dc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:24.545854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9af5fc-9bb0-4932-8748-63db690f7d0c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:24.567974 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f4d29-a4bb-4a38-89e8-8e637d6a2518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:24.570078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f4d29-a4bb-4a38-89e8-8e637d6a2518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:24.570370 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f4d29-a4bb-4a38-89e8-8e637d6a2518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:24.570645 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f4d29-a4bb-4a38-89e8-8e637d6a2518 admin admin] PATH_INFO: `/v3/users/55da7bb68504477ea18824accf87f29f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:24.576096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f4d29-a4bb-4a38-89e8-8e637d6a2518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55da7bb68504477ea18824accf87f29f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:24.583682 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f4d29-a4bb-4a38-89e8-8e637d6a2518 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:24.666517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6624e15-2905-40e9-a3ff-b206ff2737dc service swift] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:24.680812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23773f32-2eb5-4117-9f8b-8d6581fbc3aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:24.682858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23773f32-2eb5-4117-9f8b-8d6581fbc3aa service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:24.683365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23773f32-2eb5-4117-9f8b-8d6581fbc3aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:24.684211 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23773f32-2eb5-4117-9f8b-8d6581fbc3aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:24.695102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-23773f32-2eb5-4117-9f8b-8d6581fbc3aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:24.792615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23773f32-2eb5-4117-9f8b-8d6581fbc3aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:24.799540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23773f32-2eb5-4117-9f8b-8d6581fbc3aa service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:24.832201 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3177/6403] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:41:24.833234 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23773f32-2eb5-4117-9f8b-8d6581fbc3aa service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:24.840075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-23773f32-2eb5-4117-9f8b-8d6581fbc3aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:24.861893 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-450f4d29-a4bb-4a38-89e8-8e637d6a2518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55da7bb68504477ea18824accf87f29f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:24.908099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-450f4d29-a4bb-4a38-89e8-8e637d6a2518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55da7bb68504477ea18824accf87f29f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:24.911058 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23773f32-2eb5-4117-9f8b-8d6581fbc3aa service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:24.930849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee863b6-afb8-4aa8-bf56-5abe8dc5e073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:24.932025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee863b6-afb8-4aa8-bf56-5abe8dc5e073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:24.932490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee863b6-afb8-4aa8-bf56-5abe8dc5e073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:24.932924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee863b6-afb8-4aa8-bf56-5abe8dc5e073 admin admin] PATH_INFO: `/v3/projects/db2d9c0939194793a0ac1ac497285f07` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:24.937203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee863b6-afb8-4aa8-bf56-5abe8dc5e073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db2d9c0939194793a0ac1ac497285f07)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:24.949282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee863b6-afb8-4aa8-bf56-5abe8dc5e073 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:24.994393 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:24.995565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-450f4d29-a4bb-4a38-89e8-8e637d6a2518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55da7bb68504477ea18824accf87f29f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:24.996976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-450f4d29-a4bb-4a38-89e8-8e637d6a2518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55da7bb68504477ea18824accf87f29f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:25.032735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-450f4d29-a4bb-4a38-89e8-8e637d6a2518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55da7bb68504477ea18824accf87f29f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:25.057610 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3227/6404] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:41:24 2022] DELETE /identity/v3/users/55da7bb68504477ea18824accf87f29f => generated 0 bytes in 835 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:25.065327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08bfee-83c3-4967-adc9-58feb201c9a8 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:25.068353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08bfee-83c3-4967-adc9-58feb201c9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:25.068691 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08bfee-83c3-4967-adc9-58feb201c9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:25.074689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3ee863b6-afb8-4aa8-bf56-5abe8dc5e073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db2d9c0939194793a0ac1ac497285f07', 'request_id': 'req-3ee863b6-afb8-4aa8-bf56-5abe8dc5e073'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:25.088611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3ee863b6-afb8-4aa8-bf56-5abe8dc5e073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db2d9c0939194793a0ac1ac497285f07', 'request_id': 'req-3ee863b6-afb8-4aa8-bf56-5abe8dc5e073'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:25.099585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3ee863b6-afb8-4aa8-bf56-5abe8dc5e073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db2d9c0939194793a0ac1ac497285f07', 'request_id': 'req-3ee863b6-afb8-4aa8-bf56-5abe8dc5e073'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:25.125912 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1c08bfee-83c3-4967-adc9-58feb201c9a8 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:25.127603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1c08bfee-83c3-4967-adc9-58feb201c9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:25.131444 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3ee863b6-afb8-4aa8-bf56-5abe8dc5e073 admin admin] The token cache is being invalidate because project db2d9c0939194793a0ac1ac497285f07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:25.132002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3ee863b6-afb8-4aa8-bf56-5abe8dc5e073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:25.132825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3ee863b6-afb8-4aa8-bf56-5abe8dc5e073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:25.136193 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3178/6405] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:41:24 2022] DELETE /identity/v3/projects/db2d9c0939194793a0ac1ac497285f07 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:25.141090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcff8d-62eb-4c52-8ec3-4f4d2439e7ee None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:25.141423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcff8d-62eb-4c52-8ec3-4f4d2439e7ee None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:25.141645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fcff8d-62eb-4c52-8ec3-4f4d2439e7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:25.165758 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:25.181251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b9fcff8d-62eb-4c52-8ec3-4f4d2439e7ee None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:25.182488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b9fcff8d-62eb-4c52-8ec3-4f4d2439e7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:25.299028 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3228/6406] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:25.344001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08bfee-83c3-4967-adc9-58feb201c9a8 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:25.354486 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1c08bfee-83c3-4967-adc9-58feb201c9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:25.465320 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3179/6407] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:25.474240 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b7161-7348-4872-98f7-aac2639fccb5 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:25.475329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b7161-7348-4872-98f7-aac2639fccb5 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:25.475627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b7161-7348-4872-98f7-aac2639fccb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:25.516227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08bfee-83c3-4967-adc9-58feb201c9a8 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:25.530453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ef1a5-9243-4082-a4e1-4c1ede576271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:25.531086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ef1a5-9243-4082-a4e1-4c1ede576271 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:25.531361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ef1a5-9243-4082-a4e1-4c1ede576271 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:25.531627 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ef1a5-9243-4082-a4e1-4c1ede576271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:25.536248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d82b7161-7348-4872-98f7-aac2639fccb5 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:25.537514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d82b7161-7348-4872-98f7-aac2639fccb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:25.559973 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3180/6408] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:41:25.561074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ef1a5-9243-4082-a4e1-4c1ede576271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:25.562357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b7161-7348-4872-98f7-aac2639fccb5 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:25.562553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ef1a5-9243-4082-a4e1-4c1ede576271 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:25.579252 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3229/6409] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:25.584925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b7161-7348-4872-98f7-aac2639fccb5 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:25.598197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d905a-427c-4c4b-ae2a-1146d5a21c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:25.599181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d905a-427c-4c4b-ae2a-1146d5a21c74 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:25.599637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d905a-427c-4c4b-ae2a-1146d5a21c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:25.600216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d905a-427c-4c4b-ae2a-1146d5a21c74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:25.601235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d905a-427c-4c4b-ae2a-1146d5a21c74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:41:25.601707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d905a-427c-4c4b-ae2a-1146d5a21c74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:25.603504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d905a-427c-4c4b-ae2a-1146d5a21c74 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:25.635672 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3181/6410] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:25.640018 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ef1a5-9243-4082-a4e1-4c1ede576271 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:25.654733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ef1a5-9243-4082-a4e1-4c1ede576271 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:25.666321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fac5e-7be0-4774-8ac4-b7b60e463fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:25.666946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fac5e-7be0-4774-8ac4-b7b60e463fcb admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:25.667222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fac5e-7be0-4774-8ac4-b7b60e463fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:25.667500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fac5e-7be0-4774-8ac4-b7b60e463fcb admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:25.668224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4fac5e-7be0-4774-8ac4-b7b60e463fcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:25.674270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4fac5e-7be0-4774-8ac4-b7b60e463fcb admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:25.731722 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3230/6411] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:25 2022] POST /identity/v3/projects => generated 387 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:25.736230 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d905a-427c-4c4b-ae2a-1146d5a21c74 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:25.750543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d905a-427c-4c4b-ae2a-1146d5a21c74 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:25.851342 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fac5e-7be0-4774-8ac4-b7b60e463fcb admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:25.853619 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1b4fac5e-7be0-4774-8ac4-b7b60e463fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:25.925550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec679a0e-02e2-416c-a0ae-87d730400cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:25.928880 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec679a0e-02e2-416c-a0ae-87d730400cff admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:25.933744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec679a0e-02e2-416c-a0ae-87d730400cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:25.934872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec679a0e-02e2-416c-a0ae-87d730400cff admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:25.935623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec679a0e-02e2-416c-a0ae-87d730400cff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:25.943265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec679a0e-02e2-416c-a0ae-87d730400cff admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:26.071736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fac5e-7be0-4774-8ac4-b7b60e463fcb admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:26.073986 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3182/6412] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:41:25 2022] POST /identity/v3/users => generated 294 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:41:26.076351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec679a0e-02e2-416c-a0ae-87d730400cff admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:26.084606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01756b8b-87ce-40fc-aa45-644a8f1bfced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:26.085620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01756b8b-87ce-40fc-aa45-644a8f1bfced service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:26.086105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01756b8b-87ce-40fc-aa45-644a8f1bfced service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:26.086578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01756b8b-87ce-40fc-aa45-644a8f1bfced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:26.093091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-01756b8b-87ce-40fc-aa45-644a8f1bfced service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:26.098313 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec679a0e-02e2-416c-a0ae-87d730400cff admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:26.122049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54098002-8d63-4fef-9db9-1cbc09259700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:26.122849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54098002-8d63-4fef-9db9-1cbc09259700 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:26.123141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54098002-8d63-4fef-9db9-1cbc09259700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:26.123490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54098002-8d63-4fef-9db9-1cbc09259700 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:26.124272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54098002-8d63-4fef-9db9-1cbc09259700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:26.129905 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54098002-8d63-4fef-9db9-1cbc09259700 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:26.132232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01756b8b-87ce-40fc-aa45-644a8f1bfced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:26.140203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01756b8b-87ce-40fc-aa45-644a8f1bfced service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:26.227230 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3183/6413] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:26.229695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54098002-8d63-4fef-9db9-1cbc09259700 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:26.250410 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:26.279932 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3231/6414] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:41:26.291773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54098002-8d63-4fef-9db9-1cbc09259700 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:26.316082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0696f2-cfa3-4df2-ad87-51e5d5a1f456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:26.321377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0696f2-cfa3-4df2-ad87-51e5d5a1f456 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:26.323736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0696f2-cfa3-4df2-ad87-51e5d5a1f456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:26.324233 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0696f2-cfa3-4df2-ad87-51e5d5a1f456 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:26.325780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0696f2-cfa3-4df2-ad87-51e5d5a1f456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:26.336404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0696f2-cfa3-4df2-ad87-51e5d5a1f456 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:26.391636 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3184/6415] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:26.396781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01756b8b-87ce-40fc-aa45-644a8f1bfced service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:26.416201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01756b8b-87ce-40fc-aa45-644a8f1bfced service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:26.432413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5083a-f69e-46a3-afdc-9818c4e6c348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:26.433106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5083a-f69e-46a3-afdc-9818c4e6c348 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:26.433387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5083a-f69e-46a3-afdc-9818c4e6c348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:26.433663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5083a-f69e-46a3-afdc-9818c4e6c348 admin admin] PATH_INFO: `/v3/projects/8e915ba4758644378919128571a6356f/users/e9cbef1921c043a4b91025427507d4ba/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:26.495741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc5083a-f69e-46a3-afdc-9818c4e6c348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e915ba4758644378919128571a6356f, user_id=e9cbef1921c043a4b91025427507d4ba, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:26.498587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc5083a-f69e-46a3-afdc-9818c4e6c348 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:26.518377 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3232/6416] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:26 2022] PUT /identity/v3/projects/8e915ba4758644378919128571a6356f/users/e9cbef1921c043a4b91025427507d4ba/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:26.529442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f913c8-4ce8-4c4e-aad4-85010116420d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:26.530052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f913c8-4ce8-4c4e-aad4-85010116420d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:26.530535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f913c8-4ce8-4c4e-aad4-85010116420d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:26.614384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-23f913c8-4ce8-4c4e-aad4-85010116420d None None] MFA Rules not processed for user `e9cbef1921c043a4b91025427507d4ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:26.616375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-23f913c8-4ce8-4c4e-aad4-85010116420d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:26.766554 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3185/6417] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:26.771320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5083a-f69e-46a3-afdc-9818c4e6c348 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:26.822159 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:26.924128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5083a-f69e-46a3-afdc-9818c4e6c348 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:26.941211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730452bc-af14-4312-a7c9-cb6474ccee0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:26.942393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730452bc-af14-4312-a7c9-cb6474ccee0e admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:26.959656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730452bc-af14-4312-a7c9-cb6474ccee0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:26.961499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730452bc-af14-4312-a7c9-cb6474ccee0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:26.962390 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730452bc-af14-4312-a7c9-cb6474ccee0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:26.964975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730452bc-af14-4312-a7c9-cb6474ccee0e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:27.086966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f913c8-4ce8-4c4e-aad4-85010116420d None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:27.090969 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3233/6418] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:26 2022] POST /identity/v3/projects => generated 385 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:27.106474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f913c8-4ce8-4c4e-aad4-85010116420d None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:27.315158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234a5c7-64c3-48b3-98a1-af527be3d932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:27.316398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234a5c7-64c3-48b3-98a1-af527be3d932 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:27.316676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234a5c7-64c3-48b3-98a1-af527be3d932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:27.316945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234a5c7-64c3-48b3-98a1-af527be3d932 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:27.317895 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234a5c7-64c3-48b3-98a1-af527be3d932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:27.320956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234a5c7-64c3-48b3-98a1-af527be3d932 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:27.381440 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3186/6419] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:41:27 2022] POST /identity/v3/users => generated 299 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:41:27.383409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730452bc-af14-4312-a7c9-cb6474ccee0e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:27.403679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730452bc-af14-4312-a7c9-cb6474ccee0e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:27.420103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574c07d-21ef-4b0e-bd95-c0961eaff7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:27.420956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574c07d-21ef-4b0e-bd95-c0961eaff7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:27.421392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574c07d-21ef-4b0e-bd95-c0961eaff7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:27.421820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574c07d-21ef-4b0e-bd95-c0961eaff7e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:27.422646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574c07d-21ef-4b0e-bd95-c0961eaff7e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:27.435210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574c07d-21ef-4b0e-bd95-c0961eaff7e6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:27.458650 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3234/6420] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:27.462909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234a5c7-64c3-48b3-98a1-af527be3d932 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:27.486196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234a5c7-64c3-48b3-98a1-af527be3d932 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:27.507022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22088f3-ea40-4985-a50c-cb13ea10c2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:27.507935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22088f3-ea40-4985-a50c-cb13ea10c2b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:27.508087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22088f3-ea40-4985-a50c-cb13ea10c2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:27.508518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22088f3-ea40-4985-a50c-cb13ea10c2b3 admin admin] PATH_INFO: `/v3/projects/ef4049fb7bef4eea975ff648a7f9d799/users/3b796beac5be4a6e9290cc1d022897fc/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:27.547774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22088f3-ea40-4985-a50c-cb13ea10c2b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4049fb7bef4eea975ff648a7f9d799, user_id=3b796beac5be4a6e9290cc1d022897fc, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:27.551096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22088f3-ea40-4985-a50c-cb13ea10c2b3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:27.581093 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3187/6421] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:27 2022] PUT /identity/v3/projects/ef4049fb7bef4eea975ff648a7f9d799/users/3b796beac5be4a6e9290cc1d022897fc/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:41:27.583285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574c07d-21ef-4b0e-bd95-c0961eaff7e6 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:27.595555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574c07d-21ef-4b0e-bd95-c0961eaff7e6 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:27.837017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22088f3-ea40-4985-a50c-cb13ea10c2b3 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:27.838768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d22088f3-ea40-4985-a50c-cb13ea10c2b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:27.861762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9268b-f1a4-42a4-ad8f-598a0adc513a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:27.863130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9268b-f1a4-42a4-ad8f-598a0adc513a admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:27.863306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9268b-f1a4-42a4-ad8f-598a0adc513a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:27.863592 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9268b-f1a4-42a4-ad8f-598a0adc513a admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:27.864910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9268b-f1a4-42a4-ad8f-598a0adc513a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:27.877856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9268b-f1a4-42a4-ad8f-598a0adc513a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:27.906397 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3235/6422] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:27.925474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9268b-f1a4-42a4-ad8f-598a0adc513a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:27.975418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9268b-f1a4-42a4-ad8f-598a0adc513a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:27.994343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb09ec-e1d9-40f4-a6e8-b7fed876d87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:27.995039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb09ec-e1d9-40f4-a6e8-b7fed876d87a admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:27.995496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb09ec-e1d9-40f4-a6e8-b7fed876d87a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:27.999754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb09ec-e1d9-40f4-a6e8-b7fed876d87a admin admin] PATH_INFO: `/v3/projects/ef4049fb7bef4eea975ff648a7f9d799/users/3b796beac5be4a6e9290cc1d022897fc/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:28.006944 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:28.014572 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb09ec-e1d9-40f4-a6e8-b7fed876d87a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4049fb7bef4eea975ff648a7f9d799, user_id=3b796beac5be4a6e9290cc1d022897fc, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:28.029838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb09ec-e1d9-40f4-a6e8-b7fed876d87a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:28.037024 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22088f3-ea40-4985-a50c-cb13ea10c2b3 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:28.043374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac7223-e26f-4899-81cd-4e846685723c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:28.044096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac7223-e26f-4899-81cd-4e846685723c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:28.044380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac7223-e26f-4899-81cd-4e846685723c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:28.044659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac7223-e26f-4899-81cd-4e846685723c admin admin] PATH_INFO: `/v3/projects/6ca43e6b529c422fae6f2bf4662a1849` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:28.047008 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac7223-e26f-4899-81cd-4e846685723c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ca43e6b529c422fae6f2bf4662a1849)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:28.050267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac7223-e26f-4899-81cd-4e846685723c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:28.088051 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3236/6423] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:27 2022] PUT /identity/v3/projects/ef4049fb7bef4eea975ff648a7f9d799/users/3b796beac5be4a6e9290cc1d022897fc/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:28.188177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7fac7223-e26f-4899-81cd-4e846685723c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ca43e6b529c422fae6f2bf4662a1849', 'request_id': 'req-7fac7223-e26f-4899-81cd-4e846685723c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:28.204772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c315a6-4e73-4724-83c8-fc4e00008c9a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:28.205713 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c315a6-4e73-4724-83c8-fc4e00008c9a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:28.207281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c315a6-4e73-4724-83c8-fc4e00008c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:28.208552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7fac7223-e26f-4899-81cd-4e846685723c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ca43e6b529c422fae6f2bf4662a1849', 'request_id': 'req-7fac7223-e26f-4899-81cd-4e846685723c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:28.225620 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7fac7223-e26f-4899-81cd-4e846685723c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ca43e6b529c422fae6f2bf4662a1849', 'request_id': 'req-7fac7223-e26f-4899-81cd-4e846685723c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:28.257400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c1c315a6-4e73-4724-83c8-fc4e00008c9a None None] MFA Rules not processed for user `3b796beac5be4a6e9290cc1d022897fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:28.259117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c1c315a6-4e73-4724-83c8-fc4e00008c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:28.272575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7fac7223-e26f-4899-81cd-4e846685723c admin admin] The token cache is being invalidate because project 6ca43e6b529c422fae6f2bf4662a1849 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:28.273588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7fac7223-e26f-4899-81cd-4e846685723c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:28.276163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7fac7223-e26f-4899-81cd-4e846685723c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:28.283349 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3188/6424] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:41:27 2022] DELETE /identity/v3/projects/6ca43e6b529c422fae6f2bf4662a1849 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:41:28.285587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1e0f0-31c2-4bee-a137-e75c62c77902 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:28.286230 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1e0f0-31c2-4bee-a137-e75c62c77902 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:28.286614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1e0f0-31c2-4bee-a137-e75c62c77902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:28.340076 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e9c1e0f0-31c2-4bee-a137-e75c62c77902 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:28.344733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e9c1e0f0-31c2-4bee-a137-e75c62c77902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:28.397396 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3237/6425] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:28 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:41:28.398864 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c315a6-4e73-4724-83c8-fc4e00008c9a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:28.422377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c315a6-4e73-4724-83c8-fc4e00008c9a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:28.440549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a4461-a6b3-4a4b-b720-7ad211606e20 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b796beac5be4a6e9290cc1d022897fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef4049fb7bef4eea975ff648a7f9d799', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:28.443649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a4461-a6b3-4a4b-b720-7ad211606e20 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:28.443966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a4461-a6b3-4a4b-b720-7ad211606e20 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:28.445681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a4461-a6b3-4a4b-b720-7ad211606e20 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:28.446336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a4461-a6b3-4a4b-b720-7ad211606e20 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:28.453682 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a4461-a6b3-4a4b-b720-7ad211606e20 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:28.465833 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:28.485357 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3189/6426] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:41:28.497006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c0d20-dd9f-415f-8a77-f1fbe0903ad7 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:28.498809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c0d20-dd9f-415f-8a77-f1fbe0903ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:28.499450 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c0d20-dd9f-415f-8a77-f1fbe0903ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:28.543906 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ef1c0d20-dd9f-415f-8a77-f1fbe0903ad7 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:28.552081 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3238/6427] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:28 2022] POST /identity/v3/projects => generated 359 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:28.552285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ef1c0d20-dd9f-415f-8a77-f1fbe0903ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:28.555681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a4461-a6b3-4a4b-b720-7ad211606e20 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:28.671644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a4461-a6b3-4a4b-b720-7ad211606e20 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:28.677901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038061be-2d82-43ca-aa98-2be0511d5529 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b796beac5be4a6e9290cc1d022897fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef4049fb7bef4eea975ff648a7f9d799', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:28.678719 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038061be-2d82-43ca-aa98-2be0511d5529 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:28.679103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038061be-2d82-43ca-aa98-2be0511d5529 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:28.679481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038061be-2d82-43ca-aa98-2be0511d5529 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] PATH_INFO: `/v3/projects/d61eb24569ba46fab1af7a1875a1d093/tags/tempest-tag-244062529` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:28.681282 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038061be-2d82-43ca-aa98-2be0511d5529 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=d61eb24569ba46fab1af7a1875a1d093, value=tempest-tag-244062529)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:28.683702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038061be-2d82-43ca-aa98-2be0511d5529 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:28.685212 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3190/6428] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:28.691620 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c0d20-dd9f-415f-8a77-f1fbe0903ad7 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:28.703772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c0d20-dd9f-415f-8a77-f1fbe0903ad7 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:28.709436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3530e5-5fa3-4c0f-b173-368e5d9fc665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:28.710062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3530e5-5fa3-4c0f-b173-368e5d9fc665 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:28.710441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3530e5-5fa3-4c0f-b173-368e5d9fc665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:28.711277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3530e5-5fa3-4c0f-b173-368e5d9fc665 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:28.712144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3530e5-5fa3-4c0f-b173-368e5d9fc665 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:41:28.712579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3530e5-5fa3-4c0f-b173-368e5d9fc665 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:28.714238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3530e5-5fa3-4c0f-b173-368e5d9fc665 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:28.734833 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3191/6429] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:28.735789 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3530e5-5fa3-4c0f-b173-368e5d9fc665 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:28.744382 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:28.751289 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3530e5-5fa3-4c0f-b173-368e5d9fc665 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:28.756773 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-038061be-2d82-43ca-aa98-2be0511d5529 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-244062529. To ensure interoperability, identifiers should be a valid uuid. Aug 07 01:41:28.756773 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 07 01:41:28.756773 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:41:28.763582 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ea041-7b47-454a-b9e7-a069c1a98095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:28.764602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ea041-7b47-454a-b9e7-a069c1a98095 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:28.765272 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3239/6430] 10.222.0.39 () {60 vars in 1330 bytes} [Sun Aug 7 01:41:28 2022] PUT /identity/v3/projects/d61eb24569ba46fab1af7a1875a1d093/tags/tempest-tag-244062529 => generated 0 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 290 bytes (1 switches on core 0) Aug 07 01:41:28.765843 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ea041-7b47-454a-b9e7-a069c1a98095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:28.766295 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ea041-7b47-454a-b9e7-a069c1a98095 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:28.767237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ea041-7b47-454a-b9e7-a069c1a98095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:28.769078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038061be-2d82-43ca-aa98-2be0511d5529 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:28.771769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ea041-7b47-454a-b9e7-a069c1a98095 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:28.780850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038061be-2d82-43ca-aa98-2be0511d5529 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:28.790273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844dd50-8194-4dad-92a6-a611be2cfdbe tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b796beac5be4a6e9290cc1d022897fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef4049fb7bef4eea975ff648a7f9d799', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:28.791393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844dd50-8194-4dad-92a6-a611be2cfdbe tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:28.791963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844dd50-8194-4dad-92a6-a611be2cfdbe tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:28.792566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844dd50-8194-4dad-92a6-a611be2cfdbe tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] PATH_INFO: `/v3/projects/d61eb24569ba46fab1af7a1875a1d093/tags/tempest-tag-244062529` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:28.830739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844dd50-8194-4dad-92a6-a611be2cfdbe tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=d61eb24569ba46fab1af7a1875a1d093, value=tempest-tag-244062529)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:28.833448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5844dd50-8194-4dad-92a6-a611be2cfdbe tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:28.837688 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3192/6431] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:28 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:28.839146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ea041-7b47-454a-b9e7-a069c1a98095 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:28.876096 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3240/6432] 10.222.0.39 () {58 vars in 1311 bytes} [Sun Aug 7 01:41:28 2022] GET /identity/v3/projects/d61eb24569ba46fab1af7a1875a1d093/tags/tempest-tag-244062529 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:28.877837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844dd50-8194-4dad-92a6-a611be2cfdbe tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:28.899427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844dd50-8194-4dad-92a6-a611be2cfdbe tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:29.021813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c4fa5-0975-4ed9-ada5-9ae7c4679724 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b796beac5be4a6e9290cc1d022897fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef4049fb7bef4eea975ff648a7f9d799', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:29.022714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c4fa5-0975-4ed9-ada5-9ae7c4679724 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:29.023104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c4fa5-0975-4ed9-ada5-9ae7c4679724 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:29.023500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6c4fa5-0975-4ed9-ada5-9ae7c4679724 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] PATH_INFO: `/v3/projects/d61eb24569ba46fab1af7a1875a1d093/tags` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:29.029060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c4fa5-0975-4ed9-ada5-9ae7c4679724 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=d61eb24569ba46fab1af7a1875a1d093)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:29.029950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ea041-7b47-454a-b9e7-a069c1a98095 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:29.031964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6c4fa5-0975-4ed9-ada5-9ae7c4679724 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:29.047955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5a42c-d2a2-4e3f-9078-3678f547f214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:29.048604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5a42c-d2a2-4e3f-9078-3678f547f214 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:29.048889 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5a42c-d2a2-4e3f-9078-3678f547f214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:29.049162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5a42c-d2a2-4e3f-9078-3678f547f214 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:29.049834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5a42c-d2a2-4e3f-9078-3678f547f214 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:29.051780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5a42c-d2a2-4e3f-9078-3678f547f214 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:29.087991 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:29.138331 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3193/6433] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:41:28 2022] POST /identity/v3/users => generated 286 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:29.142776 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5a42c-d2a2-4e3f-9078-3678f547f214 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:29.156069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5a42c-d2a2-4e3f-9078-3678f547f214 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:29.163159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655caa3d-50af-43a4-91e5-7633480307ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:29.163773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655caa3d-50af-43a4-91e5-7633480307ec admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:29.164105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655caa3d-50af-43a4-91e5-7633480307ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:29.164427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655caa3d-50af-43a4-91e5-7633480307ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:29.165138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655caa3d-50af-43a4-91e5-7633480307ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:29.166826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655caa3d-50af-43a4-91e5-7633480307ec admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:29.176444 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3241/6434] 10.222.0.39 () {60 vars in 1265 bytes} [Sun Aug 7 01:41:28 2022] PUT /identity/v3/projects/d61eb24569ba46fab1af7a1875a1d093/tags => generated 142 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:41:29.181479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c4fa5-0975-4ed9-ada5-9ae7c4679724 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:29.183997 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3194/6435] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:29.187805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655caa3d-50af-43a4-91e5-7633480307ec admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:29.203708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655caa3d-50af-43a4-91e5-7633480307ec admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:29.210464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6c4fa5-0975-4ed9-ada5-9ae7c4679724 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:29.225495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e319d26-e554-48ba-8577-da732be72ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:29.226122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e319d26-e554-48ba-8577-da732be72ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:29.227318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e319d26-e554-48ba-8577-da732be72ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:29.227318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e319d26-e554-48ba-8577-da732be72ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:29.242267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e319d26-e554-48ba-8577-da732be72ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:29.242267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e319d26-e554-48ba-8577-da732be72ea9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:29.243077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49756a-7887-448d-bf3f-abb8c94f9c98 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b796beac5be4a6e9290cc1d022897fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef4049fb7bef4eea975ff648a7f9d799', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:29.243752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49756a-7887-448d-bf3f-abb8c94f9c98 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:29.244093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49756a-7887-448d-bf3f-abb8c94f9c98 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:29.244549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49756a-7887-448d-bf3f-abb8c94f9c98 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] PATH_INFO: `/v3/projects/d61eb24569ba46fab1af7a1875a1d093/tags` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:29.264564 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3195/6436] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:29.265703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e319d26-e554-48ba-8577-da732be72ea9 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:29.298772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e319d26-e554-48ba-8577-da732be72ea9 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:29.300416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49756a-7887-448d-bf3f-abb8c94f9c98 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=d61eb24569ba46fab1af7a1875a1d093)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:29.306141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49756a-7887-448d-bf3f-abb8c94f9c98 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:29.309428 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799ed64-e8f8-4d4b-ad68-0e6700d91bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:29.310182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799ed64-e8f8-4d4b-ad68-0e6700d91bbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:29.311318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799ed64-e8f8-4d4b-ad68-0e6700d91bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:29.311504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799ed64-e8f8-4d4b-ad68-0e6700d91bbd admin admin] PATH_INFO: `/v3/projects/13fcf4f96f9b4cdd9c847206251dff16/users/d5d89774362849ffa68df0952926c80b/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:29.332060 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3242/6437] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Aug 7 01:41:29 2022] GET /identity/v3/projects/d61eb24569ba46fab1af7a1875a1d093/tags => generated 142 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:29.333134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49756a-7887-448d-bf3f-abb8c94f9c98 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:29.339019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799ed64-e8f8-4d4b-ad68-0e6700d91bbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=13fcf4f96f9b4cdd9c847206251dff16, user_id=d5d89774362849ffa68df0952926c80b, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:29.340510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2b49756a-7887-448d-bf3f-abb8c94f9c98 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:29.343184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799ed64-e8f8-4d4b-ad68-0e6700d91bbd admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:29.385262 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3196/6438] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:29 2022] PUT /identity/v3/projects/13fcf4f96f9b4cdd9c847206251dff16/users/d5d89774362849ffa68df0952926c80b/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:29.385262 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799ed64-e8f8-4d4b-ad68-0e6700d91bbd admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:29.385595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49756a-7887-448d-bf3f-abb8c94f9c98 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:29.566194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799ed64-e8f8-4d4b-ad68-0e6700d91bbd admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:29.580273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff776507-b562-4786-bd6e-80dbb8e7baf2 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b796beac5be4a6e9290cc1d022897fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef4049fb7bef4eea975ff648a7f9d799', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:29.583335 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff776507-b562-4786-bd6e-80dbb8e7baf2 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:29.583786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff776507-b562-4786-bd6e-80dbb8e7baf2 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:29.584329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff776507-b562-4786-bd6e-80dbb8e7baf2 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] PATH_INFO: `/v3/projects/d61eb24569ba46fab1af7a1875a1d093/tags/tempest-tag-1728632432` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:29.585149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d9104-49fd-4161-98a9-2bc0254fd469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:29.585927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d9104-49fd-4161-98a9-2bc0254fd469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:29.586221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff776507-b562-4786-bd6e-80dbb8e7baf2 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=d61eb24569ba46fab1af7a1875a1d093, value=tempest-tag-1728632432)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:29.586394 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d9104-49fd-4161-98a9-2bc0254fd469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:29.586767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d9104-49fd-4161-98a9-2bc0254fd469 admin admin] PATH_INFO: `/v3/users/2d27434c0cdf47f8bf0987d6c62b948a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:29.588610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d9104-49fd-4161-98a9-2bc0254fd469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d27434c0cdf47f8bf0987d6c62b948a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:29.589861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff776507-b562-4786-bd6e-80dbb8e7baf2 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:29.595063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d9104-49fd-4161-98a9-2bc0254fd469 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:29.689628 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:29.712041 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-ff776507-b562-4786-bd6e-80dbb8e7baf2 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1728632432. To ensure interoperability, identifiers should be a valid uuid. Aug 07 01:41:29.712041 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Aug 07 01:41:29.712041 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:41:29.730712 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3197/6439] 10.222.0.39 () {58 vars in 1317 bytes} [Sun Aug 7 01:41:29 2022] DELETE /identity/v3/projects/d61eb24569ba46fab1af7a1875a1d093/tags/tempest-tag-1728632432 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:29.738028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f2d46-5d10-4a93-b8e8-b6d52f6c89aa None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:29.739366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0e4d9104-49fd-4161-98a9-2bc0254fd469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d27434c0cdf47f8bf0987d6c62b948a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:29.739568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f2d46-5d10-4a93-b8e8-b6d52f6c89aa None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:29.739948 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f2d46-5d10-4a93-b8e8-b6d52f6c89aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:29.763261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0e4d9104-49fd-4161-98a9-2bc0254fd469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d27434c0cdf47f8bf0987d6c62b948a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:29.810259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0e4d9104-49fd-4161-98a9-2bc0254fd469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d27434c0cdf47f8bf0987d6c62b948a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:29.812458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0e4d9104-49fd-4161-98a9-2bc0254fd469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d27434c0cdf47f8bf0987d6c62b948a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:29.831088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0e4d9104-49fd-4161-98a9-2bc0254fd469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d27434c0cdf47f8bf0987d6c62b948a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:29.838307 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3243/6440] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:41:29 2022] DELETE /identity/v3/users/2d27434c0cdf47f8bf0987d6c62b948a => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:29.839376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d9104-49fd-4161-98a9-2bc0254fd469 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:29.849337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0e4d9104-49fd-4161-98a9-2bc0254fd469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:29.862066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-5f0f2d46-5d10-4a93-b8e8-b6d52f6c89aa None None] MFA Rules not processed for user `d5d89774362849ffa68df0952926c80b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:29.866190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5f0f2d46-5d10-4a93-b8e8-b6d52f6c89aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:29.993024 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:30.044270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d9104-49fd-4161-98a9-2bc0254fd469 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:30.068758 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2412c2-0a43-4fd6-ae11-ad2a9ce35437 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b796beac5be4a6e9290cc1d022897fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef4049fb7bef4eea975ff648a7f9d799', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:30.069812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2412c2-0a43-4fd6-ae11-ad2a9ce35437 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:30.070312 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2412c2-0a43-4fd6-ae11-ad2a9ce35437 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:30.070824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2412c2-0a43-4fd6-ae11-ad2a9ce35437 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] PATH_INFO: `/v3/projects/d61eb24569ba46fab1af7a1875a1d093/tags/tempest-tag-1728632432` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:30.112578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2412c2-0a43-4fd6-ae11-ad2a9ce35437 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=d61eb24569ba46fab1af7a1875a1d093, value=tempest-tag-1728632432)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:30.115431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2412c2-0a43-4fd6-ae11-ad2a9ce35437 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:30.122735 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3198/6441] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:30.124356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821a08e-5de5-41f6-bce0-745560a6f723 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:30.124742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821a08e-5de5-41f6-bce0-745560a6f723 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:30.125062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821a08e-5de5-41f6-bce0-745560a6f723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:30.158904 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-0e2412c2-0a43-4fd6-ae11-ad2a9ce35437 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] Could not find project tag: tempest-tag-1728632432.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1728632432. Aug 07 01:41:30.158904 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:41:30.158904 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:41:30.158904 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:41:30.158904 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:41:30.158904 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:41:30.158904 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:41:30.158904 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:41:30.158904 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:41:30.158904 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:41:30.158904 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:41:30.158904 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:41:30.158904 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Aug 07 01:41:30.158904 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Aug 07 01:41:30.160527 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:41:30.160527 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:41:30.160527 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Aug 07 01:41:30.160527 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Aug 07 01:41:30.160527 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1728632432. Aug 07 01:41:30.160527 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:41:30.166485 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3244/6442] 10.222.0.39 () {58 vars in 1314 bytes} [Sun Aug 7 01:41:29 2022] GET /identity/v3/projects/d61eb24569ba46fab1af7a1875a1d093/tags/tempest-tag-1728632432 => generated 107 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:41:30.172144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2412c2-0a43-4fd6-ae11-ad2a9ce35437 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:30.176237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0e2412c2-0a43-4fd6-ae11-ad2a9ce35437 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:30.208965 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c821a08e-5de5-41f6-bce0-745560a6f723 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:30.212470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c821a08e-5de5-41f6-bce0-745560a6f723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:30.389319 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2412c2-0a43-4fd6-ae11-ad2a9ce35437 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:30.395874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2dc584-72a6-41f0-a058-bc63ff58d7a6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:30.396991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2dc584-72a6-41f0-a058-bc63ff58d7a6 service glance] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:30.397484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2dc584-72a6-41f0-a058-bc63ff58d7a6 service glance] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:30.397971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2dc584-72a6-41f0-a058-bc63ff58d7a6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:30.418362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2dc584-72a6-41f0-a058-bc63ff58d7a6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:30.420549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2dc584-72a6-41f0-a058-bc63ff58d7a6 service glance] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:30.455409 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3245/6443] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:30.457254 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2dc584-72a6-41f0-a058-bc63ff58d7a6 service glance] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:30.490328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2dc584-72a6-41f0-a058-bc63ff58d7a6 service glance] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:30.492461 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3199/6444] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:30.505977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbd04f-88f0-494c-8f12-72a8d4233a77 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b796beac5be4a6e9290cc1d022897fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef4049fb7bef4eea975ff648a7f9d799', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:30.506794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbd04f-88f0-494c-8f12-72a8d4233a77 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:30.508397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbd04f-88f0-494c-8f12-72a8d4233a77 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:30.508397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbd04f-88f0-494c-8f12-72a8d4233a77 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] PATH_INFO: `/v3/projects/d61eb24569ba46fab1af7a1875a1d093/tags` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:30.509327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbd04f-88f0-494c-8f12-72a8d4233a77 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=d61eb24569ba46fab1af7a1875a1d093)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:30.511929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbd04f-88f0-494c-8f12-72a8d4233a77 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:30.513015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821a08e-5de5-41f6-bce0-745560a6f723 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:30.514820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c821a08e-5de5-41f6-bce0-745560a6f723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:30.658192 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3246/6445] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Aug 7 01:41:30 2022] DELETE /identity/v3/projects/d61eb24569ba46fab1af7a1875a1d093/tags => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:30.666070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbd04f-88f0-494c-8f12-72a8d4233a77 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:30.699448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbd04f-88f0-494c-8f12-72a8d4233a77 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:30.711860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d120e0-ef6c-47be-a9ed-1d80fde0004b tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b796beac5be4a6e9290cc1d022897fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef4049fb7bef4eea975ff648a7f9d799', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:30.712730 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d120e0-ef6c-47be-a9ed-1d80fde0004b tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:30.713155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d120e0-ef6c-47be-a9ed-1d80fde0004b tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:30.713525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d120e0-ef6c-47be-a9ed-1d80fde0004b tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] PATH_INFO: `/v3/projects/d61eb24569ba46fab1af7a1875a1d093/tags` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:30.753547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821a08e-5de5-41f6-bce0-745560a6f723 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:30.755863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d120e0-ef6c-47be-a9ed-1d80fde0004b tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=d61eb24569ba46fab1af7a1875a1d093)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:30.759387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d120e0-ef6c-47be-a9ed-1d80fde0004b tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:30.763199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb682e64-d983-4eac-935b-c14e3cfe6a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:30.764099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb682e64-d983-4eac-935b-c14e3cfe6a00 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:30.764540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb682e64-d983-4eac-935b-c14e3cfe6a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:30.765000 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb682e64-d983-4eac-935b-c14e3cfe6a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:30.816565 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3247/6446] 10.222.0.39 () {58 vars in 1245 bytes} [Sun Aug 7 01:41:30 2022] GET /identity/v3/projects/d61eb24569ba46fab1af7a1875a1d093/tags => generated 66 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Aug 07 01:41:30.817736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d120e0-ef6c-47be-a9ed-1d80fde0004b tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:30.826537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb682e64-d983-4eac-935b-c14e3cfe6a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:30.835820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb682e64-d983-4eac-935b-c14e3cfe6a00 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:30.854259 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3200/6447] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:41:30.858118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d120e0-ef6c-47be-a9ed-1d80fde0004b tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:30.876906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ed1f1-b254-4156-9c38-d26413827290 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b796beac5be4a6e9290cc1d022897fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ef4049fb7bef4eea975ff648a7f9d799', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:30.878449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ed1f1-b254-4156-9c38-d26413827290 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:30.878914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ed1f1-b254-4156-9c38-d26413827290 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:30.879294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ed1f1-b254-4156-9c38-d26413827290 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] PATH_INFO: `/v3/projects/d61eb24569ba46fab1af7a1875a1d093` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:30.881838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ed1f1-b254-4156-9c38-d26413827290 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d61eb24569ba46fab1af7a1875a1d093)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:30.886175 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ed1f1-b254-4156-9c38-d26413827290 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:31.057454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c87ed1f1-b254-4156-9c38-d26413827290 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd61eb24569ba46fab1af7a1875a1d093', 'request_id': 'req-c87ed1f1-b254-4156-9c38-d26413827290'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:31.070370 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c87ed1f1-b254-4156-9c38-d26413827290 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd61eb24569ba46fab1af7a1875a1d093', 'request_id': 'req-c87ed1f1-b254-4156-9c38-d26413827290'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:31.071689 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:31.080663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c87ed1f1-b254-4156-9c38-d26413827290 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd61eb24569ba46fab1af7a1875a1d093', 'request_id': 'req-c87ed1f1-b254-4156-9c38-d26413827290'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:31.104821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c87ed1f1-b254-4156-9c38-d26413827290 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] The token cache is being invalidate because project d61eb24569ba46fab1af7a1875a1d093 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:31.105269 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c87ed1f1-b254-4156-9c38-d26413827290 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:31.108370 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c87ed1f1-b254-4156-9c38-d26413827290 tempest-IdentityV3ProjectTagsTest-435909539 tempest-IdentityV3ProjectTagsTest-435909539-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:31.115182 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3248/6448] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:41:30 2022] DELETE /identity/v3/projects/d61eb24569ba46fab1af7a1875a1d093 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:31.116457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb682e64-d983-4eac-935b-c14e3cfe6a00 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:31.118614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cb682e64-d983-4eac-935b-c14e3cfe6a00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:31.157998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb682e64-d983-4eac-935b-c14e3cfe6a00 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:31.256799 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:31.445155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c2ae6-36f1-46eb-8dbb-fa4b31206ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:31.450909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c2ae6-36f1-46eb-8dbb-fa4b31206ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:31.451257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c2ae6-36f1-46eb-8dbb-fa4b31206ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:31.451539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c2ae6-36f1-46eb-8dbb-fa4b31206ede admin admin] PATH_INFO: `/v3/users/e9cbef1921c043a4b91025427507d4ba` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:31.462494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c2ae6-36f1-46eb-8dbb-fa4b31206ede admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9cbef1921c043a4b91025427507d4ba)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:31.467473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c2ae6-36f1-46eb-8dbb-fa4b31206ede admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:31.619100 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fc3c2ae6-36f1-46eb-8dbb-fa4b31206ede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9cbef1921c043a4b91025427507d4ba'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:31.649978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fc3c2ae6-36f1-46eb-8dbb-fa4b31206ede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9cbef1921c043a4b91025427507d4ba'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:31.711496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fc3c2ae6-36f1-46eb-8dbb-fa4b31206ede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9cbef1921c043a4b91025427507d4ba'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:31.712991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fc3c2ae6-36f1-46eb-8dbb-fa4b31206ede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9cbef1921c043a4b91025427507d4ba'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:31.741411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fc3c2ae6-36f1-46eb-8dbb-fa4b31206ede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9cbef1921c043a4b91025427507d4ba'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:31.754204 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3201/6449] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:41:31 2022] DELETE /identity/v3/users/e9cbef1921c043a4b91025427507d4ba => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:41:31.760507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33be6f4-66d0-4b8c-a17b-6f963aebece3 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:31.761043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33be6f4-66d0-4b8c-a17b-6f963aebece3 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:31.761293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33be6f4-66d0-4b8c-a17b-6f963aebece3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:31.824034 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d33be6f4-66d0-4b8c-a17b-6f963aebece3 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:31.827115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d33be6f4-66d0-4b8c-a17b-6f963aebece3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:32.044699 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3249/6450] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:41:32.182461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c2ae6-36f1-46eb-8dbb-fa4b31206ede admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:32.184073 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-fc3c2ae6-36f1-46eb-8dbb-fa4b31206ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:32.382678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c2ae6-36f1-46eb-8dbb-fa4b31206ede admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:32.392649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec023a-dfe9-41bf-aa98-bbc35352f9d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:32.393442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec023a-dfe9-41bf-aa98-bbc35352f9d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:32.394496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec023a-dfe9-41bf-aa98-bbc35352f9d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:32.394871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec023a-dfe9-41bf-aa98-bbc35352f9d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:32.416945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec023a-dfe9-41bf-aa98-bbc35352f9d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:32.421652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec023a-dfe9-41bf-aa98-bbc35352f9d8 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:32.456971 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3202/6451] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:32.594859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33be6f4-66d0-4b8c-a17b-6f963aebece3 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:32.596644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d33be6f4-66d0-4b8c-a17b-6f963aebece3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:32.616065 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33be6f4-66d0-4b8c-a17b-6f963aebece3 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:32.633474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09cdec0-8bf9-4d52-9904-8605eb309fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:32.634273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cdec0-8bf9-4d52-9904-8605eb309fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:32.634912 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cdec0-8bf9-4d52-9904-8605eb309fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:32.635294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cdec0-8bf9-4d52-9904-8605eb309fd5 admin admin] PATH_INFO: `/v3/users/d5d89774362849ffa68df0952926c80b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:32.636906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09cdec0-8bf9-4d52-9904-8605eb309fd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5d89774362849ffa68df0952926c80b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:32.638955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09cdec0-8bf9-4d52-9904-8605eb309fd5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:32.739145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a09cdec0-8bf9-4d52-9904-8605eb309fd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5d89774362849ffa68df0952926c80b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:32.748562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a09cdec0-8bf9-4d52-9904-8605eb309fd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5d89774362849ffa68df0952926c80b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:32.774177 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a09cdec0-8bf9-4d52-9904-8605eb309fd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5d89774362849ffa68df0952926c80b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:32.775110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a09cdec0-8bf9-4d52-9904-8605eb309fd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5d89774362849ffa68df0952926c80b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:32.788842 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a09cdec0-8bf9-4d52-9904-8605eb309fd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5d89774362849ffa68df0952926c80b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:32.803627 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3250/6452] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:41:32 2022] DELETE /identity/v3/users/d5d89774362849ffa68df0952926c80b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:32.805518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0dcb6-b4ed-4a18-8517-ba08a429a170 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:32.806094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0dcb6-b4ed-4a18-8517-ba08a429a170 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:32.806587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0dcb6-b4ed-4a18-8517-ba08a429a170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:32.840140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-aca0dcb6-b4ed-4a18-8517-ba08a429a170 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:32.845846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-aca0dcb6-b4ed-4a18-8517-ba08a429a170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:32.960862 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:33.019922 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3203/6453] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:33.101170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09cdec0-8bf9-4d52-9904-8605eb309fd5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:33.102752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a09cdec0-8bf9-4d52-9904-8605eb309fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:33.233190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09cdec0-8bf9-4d52-9904-8605eb309fd5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:33.244308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc8af0-57b6-4a48-bbb3-75eade12990d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:33.245129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc8af0-57b6-4a48-bbb3-75eade12990d service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:33.245582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc8af0-57b6-4a48-bbb3-75eade12990d service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:33.246001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc8af0-57b6-4a48-bbb3-75eade12990d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:33.266838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc8af0-57b6-4a48-bbb3-75eade12990d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:33.274678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0dcb6-b4ed-4a18-8517-ba08a429a170 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:33.277614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-aca0dcb6-b4ed-4a18-8517-ba08a429a170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:33.279017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc8af0-57b6-4a48-bbb3-75eade12990d service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:33.324305 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3251/6454] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:33.351765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc8af0-57b6-4a48-bbb3-75eade12990d service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:33.353478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-bbcc8af0-57b6-4a48-bbb3-75eade12990d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:33.363519 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:33.377225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc8af0-57b6-4a48-bbb3-75eade12990d service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:33.399251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c26846-3ec4-4cb4-81e4-1fcb002df9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:33.400083 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c26846-3ec4-4cb4-81e4-1fcb002df9ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:33.400470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c26846-3ec4-4cb4-81e4-1fcb002df9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:33.400870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c26846-3ec4-4cb4-81e4-1fcb002df9ae admin admin] PATH_INFO: `/v3/projects/e80875457b164e288b8c1a1a31496e37` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:33.405536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c26846-3ec4-4cb4-81e4-1fcb002df9ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=e80875457b164e288b8c1a1a31496e37)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:33.408012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c26846-3ec4-4cb4-81e4-1fcb002df9ae admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:33.528570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-87c26846-3ec4-4cb4-81e4-1fcb002df9ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e80875457b164e288b8c1a1a31496e37', 'request_id': 'req-87c26846-3ec4-4cb4-81e4-1fcb002df9ae'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:33.543337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-87c26846-3ec4-4cb4-81e4-1fcb002df9ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e80875457b164e288b8c1a1a31496e37', 'request_id': 'req-87c26846-3ec4-4cb4-81e4-1fcb002df9ae'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:33.554074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0dcb6-b4ed-4a18-8517-ba08a429a170 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:33.568062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-87c26846-3ec4-4cb4-81e4-1fcb002df9ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e80875457b164e288b8c1a1a31496e37', 'request_id': 'req-87c26846-3ec4-4cb4-81e4-1fcb002df9ae'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:33.592725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-87c26846-3ec4-4cb4-81e4-1fcb002df9ae admin admin] The token cache is being invalidate because project e80875457b164e288b8c1a1a31496e37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:33.592961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-87c26846-3ec4-4cb4-81e4-1fcb002df9ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:33.598410 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-87c26846-3ec4-4cb4-81e4-1fcb002df9ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:33.604048 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3252/6455] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:41:33 2022] DELETE /identity/v3/projects/e80875457b164e288b8c1a1a31496e37 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:33.604723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c26846-3ec4-4cb4-81e4-1fcb002df9ae admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:33.606194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-87c26846-3ec4-4cb4-81e4-1fcb002df9ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:33.773421 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d2079-0ab9-445d-93b7-d107b6b9801e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:33.776270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d2079-0ab9-445d-93b7-d107b6b9801e service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:33.776555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d2079-0ab9-445d-93b7-d107b6b9801e service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:33.776833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d2079-0ab9-445d-93b7-d107b6b9801e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:33.784790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-df3d2079-0ab9-445d-93b7-d107b6b9801e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:33.791723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c26846-3ec4-4cb4-81e4-1fcb002df9ae admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:33.804422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856007ee-8f81-4f8d-9dc7-8689dfe5fc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:33.805085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856007ee-8f81-4f8d-9dc7-8689dfe5fc2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:33.805358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856007ee-8f81-4f8d-9dc7-8689dfe5fc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:33.805629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856007ee-8f81-4f8d-9dc7-8689dfe5fc2e admin admin] PATH_INFO: `/v3/users/46d1c67e065c4718b10c9382e804d929` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:33.811676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856007ee-8f81-4f8d-9dc7-8689dfe5fc2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=46d1c67e065c4718b10c9382e804d929)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:33.813142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856007ee-8f81-4f8d-9dc7-8689dfe5fc2e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:33.860787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d2079-0ab9-445d-93b7-d107b6b9801e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:33.867693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d2079-0ab9-445d-93b7-d107b6b9801e service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:33.907908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-856007ee-8f81-4f8d-9dc7-8689dfe5fc2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46d1c67e065c4718b10c9382e804d929'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:33.923195 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-856007ee-8f81-4f8d-9dc7-8689dfe5fc2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46d1c67e065c4718b10c9382e804d929'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:33.950770 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3204/6456] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:33.951019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-856007ee-8f81-4f8d-9dc7-8689dfe5fc2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46d1c67e065c4718b10c9382e804d929'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:33.951949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-856007ee-8f81-4f8d-9dc7-8689dfe5fc2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46d1c67e065c4718b10c9382e804d929'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:33.968236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-856007ee-8f81-4f8d-9dc7-8689dfe5fc2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46d1c67e065c4718b10c9382e804d929'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:33.981663 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3253/6457] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:41:33 2022] DELETE /identity/v3/users/46d1c67e065c4718b10c9382e804d929 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:41:34.231290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d2079-0ab9-445d-93b7-d107b6b9801e service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:34.233199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-df3d2079-0ab9-445d-93b7-d107b6b9801e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:34.269266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d2079-0ab9-445d-93b7-d107b6b9801e service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:34.406295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856007ee-8f81-4f8d-9dc7-8689dfe5fc2e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:34.408409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-856007ee-8f81-4f8d-9dc7-8689dfe5fc2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:34.415514 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:34.461132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc721f-2953-407e-bd54-29f0658f69d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:34.461801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc721f-2953-407e-bd54-29f0658f69d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:34.462541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc721f-2953-407e-bd54-29f0658f69d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:34.464061 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc721f-2953-407e-bd54-29f0658f69d4 admin admin] PATH_INFO: `/v3/users/2f0e1c5ed46b44c881df0059642c6de8` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:34.465389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc721f-2953-407e-bd54-29f0658f69d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f0e1c5ed46b44c881df0059642c6de8)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:34.472871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc721f-2953-407e-bd54-29f0658f69d4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:34.480039 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:34.538355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856007ee-8f81-4f8d-9dc7-8689dfe5fc2e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:34.547247 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da7f77-ec61-4dd6-bb5f-dadd7dc974ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:34.548981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da7f77-ec61-4dd6-bb5f-dadd7dc974ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:34.549364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da7f77-ec61-4dd6-bb5f-dadd7dc974ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:34.549989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da7f77-ec61-4dd6-bb5f-dadd7dc974ed admin admin] PATH_INFO: `/v3/projects/8e915ba4758644378919128571a6356f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:34.551540 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da7f77-ec61-4dd6-bb5f-dadd7dc974ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e915ba4758644378919128571a6356f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:34.554278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da7f77-ec61-4dd6-bb5f-dadd7dc974ed admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:34.597329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-93fc721f-2953-407e-bd54-29f0658f69d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f0e1c5ed46b44c881df0059642c6de8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:34.617103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-93fc721f-2953-407e-bd54-29f0658f69d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f0e1c5ed46b44c881df0059642c6de8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:34.640573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d1da7f77-ec61-4dd6-bb5f-dadd7dc974ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e915ba4758644378919128571a6356f', 'request_id': 'req-d1da7f77-ec61-4dd6-bb5f-dadd7dc974ed'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:34.649051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d1da7f77-ec61-4dd6-bb5f-dadd7dc974ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e915ba4758644378919128571a6356f', 'request_id': 'req-d1da7f77-ec61-4dd6-bb5f-dadd7dc974ed'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:34.651903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-93fc721f-2953-407e-bd54-29f0658f69d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f0e1c5ed46b44c881df0059642c6de8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:34.654215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-93fc721f-2953-407e-bd54-29f0658f69d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f0e1c5ed46b44c881df0059642c6de8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:34.657814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d1da7f77-ec61-4dd6-bb5f-dadd7dc974ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e915ba4758644378919128571a6356f', 'request_id': 'req-d1da7f77-ec61-4dd6-bb5f-dadd7dc974ed'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:34.676006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-93fc721f-2953-407e-bd54-29f0658f69d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f0e1c5ed46b44c881df0059642c6de8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:34.679191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d1da7f77-ec61-4dd6-bb5f-dadd7dc974ed admin admin] The token cache is being invalidate because project 8e915ba4758644378919128571a6356f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:34.680193 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d1da7f77-ec61-4dd6-bb5f-dadd7dc974ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:34.681585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d1da7f77-ec61-4dd6-bb5f-dadd7dc974ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:34.688743 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3205/6459] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:41:34 2022] DELETE /identity/v3/users/2f0e1c5ed46b44c881df0059642c6de8 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:34.689977 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3254/6459] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:41:34 2022] DELETE /identity/v3/projects/8e915ba4758644378919128571a6356f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:41:34.691398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da7f77-ec61-4dd6-bb5f-dadd7dc974ed admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:34.693804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d1da7f77-ec61-4dd6-bb5f-dadd7dc974ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:34.694077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc721f-2953-407e-bd54-29f0658f69d4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:34.701374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-93fc721f-2953-407e-bd54-29f0658f69d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:34.821248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da7f77-ec61-4dd6-bb5f-dadd7dc974ed admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:34.874171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc721f-2953-407e-bd54-29f0658f69d4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:34.896630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e6147-acfb-488e-b5d2-e18838768352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:34.898887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e6147-acfb-488e-b5d2-e18838768352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:34.899910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e6147-acfb-488e-b5d2-e18838768352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:34.900362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e6147-acfb-488e-b5d2-e18838768352 admin admin] PATH_INFO: `/v3/projects/13fcf4f96f9b4cdd9c847206251dff16` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:34.904082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e6147-acfb-488e-b5d2-e18838768352 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13fcf4f96f9b4cdd9c847206251dff16)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:34.908663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e6147-acfb-488e-b5d2-e18838768352 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:34.965740 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:35.014846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106ad37-4af9-4f89-8157-0922481b3ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:35.015430 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106ad37-4af9-4f89-8157-0922481b3ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:35.015833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106ad37-4af9-4f89-8157-0922481b3ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:35.016136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106ad37-4af9-4f89-8157-0922481b3ba6 admin admin] PATH_INFO: `/v3/users/3b796beac5be4a6e9290cc1d022897fc` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:35.017352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106ad37-4af9-4f89-8157-0922481b3ba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b796beac5be4a6e9290cc1d022897fc)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:35.019360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106ad37-4af9-4f89-8157-0922481b3ba6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:35.026007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-319e6147-acfb-488e-b5d2-e18838768352 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13fcf4f96f9b4cdd9c847206251dff16', 'request_id': 'req-319e6147-acfb-488e-b5d2-e18838768352'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:35.042710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-319e6147-acfb-488e-b5d2-e18838768352 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13fcf4f96f9b4cdd9c847206251dff16', 'request_id': 'req-319e6147-acfb-488e-b5d2-e18838768352'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:35.076542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-319e6147-acfb-488e-b5d2-e18838768352 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13fcf4f96f9b4cdd9c847206251dff16', 'request_id': 'req-319e6147-acfb-488e-b5d2-e18838768352'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:35.114154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-319e6147-acfb-488e-b5d2-e18838768352 admin admin] The token cache is being invalidate because project 13fcf4f96f9b4cdd9c847206251dff16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:35.114794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-319e6147-acfb-488e-b5d2-e18838768352 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:35.116275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-319e6147-acfb-488e-b5d2-e18838768352 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:35.127163 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3206/6460] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:41:34 2022] DELETE /identity/v3/projects/13fcf4f96f9b4cdd9c847206251dff16 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:35.129800 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c7b29-9285-4544-84dd-589998c4a49d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:35.130459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c7b29-9285-4544-84dd-589998c4a49d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:35.131071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c7b29-9285-4544-84dd-589998c4a49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:35.158561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a106ad37-4af9-4f89-8157-0922481b3ba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b796beac5be4a6e9290cc1d022897fc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:35.173404 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a106ad37-4af9-4f89-8157-0922481b3ba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b796beac5be4a6e9290cc1d022897fc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:35.177405 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-077c7b29-9285-4544-84dd-589998c4a49d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:35.178928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-077c7b29-9285-4544-84dd-589998c4a49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:35.202176 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:35.219163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a106ad37-4af9-4f89-8157-0922481b3ba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b796beac5be4a6e9290cc1d022897fc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:35.221173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a106ad37-4af9-4f89-8157-0922481b3ba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b796beac5be4a6e9290cc1d022897fc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:35.233178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a106ad37-4af9-4f89-8157-0922481b3ba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b796beac5be4a6e9290cc1d022897fc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:35.249790 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3255/6461] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:41:34 2022] DELETE /identity/v3/users/3b796beac5be4a6e9290cc1d022897fc => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:35.250936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106ad37-4af9-4f89-8157-0922481b3ba6 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:35.254549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a106ad37-4af9-4f89-8157-0922481b3ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:35.340726 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3207/6462] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:35.344861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda6453-f331-4864-99cb-56fc3fe8dc15 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:35.345155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda6453-f331-4864-99cb-56fc3fe8dc15 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:35.345431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda6453-f331-4864-99cb-56fc3fe8dc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:35.393425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3fda6453-f331-4864-99cb-56fc3fe8dc15 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:35.397570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3fda6453-f331-4864-99cb-56fc3fe8dc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:35.411746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106ad37-4af9-4f89-8157-0922481b3ba6 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:35.421279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbf4b8-4d8a-457e-9a8f-4d196ff803bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:35.421944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbf4b8-4d8a-457e-9a8f-4d196ff803bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:35.422227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbf4b8-4d8a-457e-9a8f-4d196ff803bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:35.422504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbf4b8-4d8a-457e-9a8f-4d196ff803bf admin admin] PATH_INFO: `/v3/projects/812fc187d63f40f39e2096dda2db4d3e` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:35.424157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbf4b8-4d8a-457e-9a8f-4d196ff803bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=812fc187d63f40f39e2096dda2db4d3e)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:35.426757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbf4b8-4d8a-457e-9a8f-4d196ff803bf admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:35.437577 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3208/6463] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:35.450567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43121e93-aebb-44df-bf34-67c6fe9d7cab None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:35.450848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43121e93-aebb-44df-bf34-67c6fe9d7cab None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:35.451120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43121e93-aebb-44df-bf34-67c6fe9d7cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:35.513833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-43121e93-aebb-44df-bf34-67c6fe9d7cab None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:35.517013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-43121e93-aebb-44df-bf34-67c6fe9d7cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:35.565729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6dbbf4b8-4d8a-457e-9a8f-4d196ff803bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '812fc187d63f40f39e2096dda2db4d3e', 'request_id': 'req-6dbbf4b8-4d8a-457e-9a8f-4d196ff803bf'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:35.583461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6dbbf4b8-4d8a-457e-9a8f-4d196ff803bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '812fc187d63f40f39e2096dda2db4d3e', 'request_id': 'req-6dbbf4b8-4d8a-457e-9a8f-4d196ff803bf'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:35.603690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6dbbf4b8-4d8a-457e-9a8f-4d196ff803bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '812fc187d63f40f39e2096dda2db4d3e', 'request_id': 'req-6dbbf4b8-4d8a-457e-9a8f-4d196ff803bf'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:35.606106 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:35.649784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6dbbf4b8-4d8a-457e-9a8f-4d196ff803bf admin admin] The token cache is being invalidate because project 812fc187d63f40f39e2096dda2db4d3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:35.650105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6dbbf4b8-4d8a-457e-9a8f-4d196ff803bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:35.669242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6dbbf4b8-4d8a-457e-9a8f-4d196ff803bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:35.686521 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3256/6464] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:41:35 2022] DELETE /identity/v3/projects/812fc187d63f40f39e2096dda2db4d3e => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:35.691702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbf4b8-4d8a-457e-9a8f-4d196ff803bf admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:35.708630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6dbbf4b8-4d8a-457e-9a8f-4d196ff803bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:35.781059 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3209/6465] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:35.782001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d66d15-a91a-4766-b992-9019bc2a3475 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:35.782291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d66d15-a91a-4766-b992-9019bc2a3475 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:35.782565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d66d15-a91a-4766-b992-9019bc2a3475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:35.884651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-90d66d15-a91a-4766-b992-9019bc2a3475 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:35.886046 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-90d66d15-a91a-4766-b992-9019bc2a3475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:35.912269 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3210/6466] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:35.915509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d66d15-a91a-4766-b992-9019bc2a3475 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:35.937929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d66d15-a91a-4766-b992-9019bc2a3475 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:35.967011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbf4b8-4d8a-457e-9a8f-4d196ff803bf admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:35.973055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f1de0-4c65-431d-b0a3-0f7ab75f5452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:35.974296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f1de0-4c65-431d-b0a3-0f7ab75f5452 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:35.974563 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f1de0-4c65-431d-b0a3-0f7ab75f5452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:35.975211 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f1de0-4c65-431d-b0a3-0f7ab75f5452 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:35.976121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f1de0-4c65-431d-b0a3-0f7ab75f5452 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:41:35.980217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f1de0-4c65-431d-b0a3-0f7ab75f5452 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:35.980217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f1de0-4c65-431d-b0a3-0f7ab75f5452 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:35.982170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b37d83-6374-4482-97d0-23f465998361 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:35.983068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b37d83-6374-4482-97d0-23f465998361 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:35.983481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b37d83-6374-4482-97d0-23f465998361 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:35.984064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b37d83-6374-4482-97d0-23f465998361 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:35.987853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-33b37d83-6374-4482-97d0-23f465998361 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:36.028839 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3211/6467] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:36.030055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f1de0-4c65-431d-b0a3-0f7ab75f5452 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:36.031321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b37d83-6374-4482-97d0-23f465998361 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:36.033335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b37d83-6374-4482-97d0-23f465998361 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:36.039081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8b8f1de0-4c65-431d-b0a3-0f7ab75f5452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:36.063216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f1de0-4c65-431d-b0a3-0f7ab75f5452 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:36.069125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f6cf3-523c-4229-b450-ae00e48ed67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:36.070108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f6cf3-523c-4229-b450-ae00e48ed67f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:36.070581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f6cf3-523c-4229-b450-ae00e48ed67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:36.070701 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3257/6468] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:36.070947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f6cf3-523c-4229-b450-ae00e48ed67f admin admin] PATH_INFO: `/v3/projects/ef4049fb7bef4eea975ff648a7f9d799` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:36.072007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566525d5-6048-44a4-9443-27e57e6d0751 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:36.072345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566525d5-6048-44a4-9443-27e57e6d0751 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:36.072515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f6cf3-523c-4229-b450-ae00e48ed67f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef4049fb7bef4eea975ff648a7f9d799)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:36.072639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566525d5-6048-44a4-9443-27e57e6d0751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:36.074783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f6cf3-523c-4229-b450-ae00e48ed67f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:36.117899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-566525d5-6048-44a4-9443-27e57e6d0751 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:36.119920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-566525d5-6048-44a4-9443-27e57e6d0751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:36.141921 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3258/6469] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:36.146192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566525d5-6048-44a4-9443-27e57e6d0751 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:36.172767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b19f6cf3-523c-4229-b450-ae00e48ed67f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef4049fb7bef4eea975ff648a7f9d799', 'request_id': 'req-b19f6cf3-523c-4229-b450-ae00e48ed67f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:36.179696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b19f6cf3-523c-4229-b450-ae00e48ed67f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef4049fb7bef4eea975ff648a7f9d799', 'request_id': 'req-b19f6cf3-523c-4229-b450-ae00e48ed67f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:36.194307 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566525d5-6048-44a4-9443-27e57e6d0751 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:36.198569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b19f6cf3-523c-4229-b450-ae00e48ed67f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef4049fb7bef4eea975ff648a7f9d799', 'request_id': 'req-b19f6cf3-523c-4229-b450-ae00e48ed67f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:36.220288 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b19f6cf3-523c-4229-b450-ae00e48ed67f admin admin] The token cache is being invalidate because project ef4049fb7bef4eea975ff648a7f9d799 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:36.220773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b19f6cf3-523c-4229-b450-ae00e48ed67f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:36.221708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b19f6cf3-523c-4229-b450-ae00e48ed67f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:36.226778 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3212/6470] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:41:36 2022] DELETE /identity/v3/projects/ef4049fb7bef4eea975ff648a7f9d799 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:36.226778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f6cf3-523c-4229-b450-ae00e48ed67f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:36.226778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b19f6cf3-523c-4229-b450-ae00e48ed67f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:36.240227 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:36.365167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7002e-d6e5-4a56-8297-1305dc8d21be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:36.365812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7002e-d6e5-4a56-8297-1305dc8d21be admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:36.366084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7002e-d6e5-4a56-8297-1305dc8d21be admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:36.366353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7002e-d6e5-4a56-8297-1305dc8d21be admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:36.366984 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7002e-d6e5-4a56-8297-1305dc8d21be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:36.369343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7002e-d6e5-4a56-8297-1305dc8d21be admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:36.435147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f6cf3-523c-4229-b450-ae00e48ed67f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:36.442796 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3259/6471] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:36 2022] POST /identity/v3/projects => generated 365 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:36.442796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f61724-cb9c-4b5e-b03f-a615c2544889 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:36.442796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f61724-cb9c-4b5e-b03f-a615c2544889 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:36.442796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f61724-cb9c-4b5e-b03f-a615c2544889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:36.452132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fc5d7-dcdc-4417-bf8b-b83f52a42d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:36.453126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fc5d7-dcdc-4417-bf8b-b83f52a42d06 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:36.454672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fc5d7-dcdc-4417-bf8b-b83f52a42d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:36.455189 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fc5d7-dcdc-4417-bf8b-b83f52a42d06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:36.457352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683fc5d7-dcdc-4417-bf8b-b83f52a42d06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:41:36.458678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683fc5d7-dcdc-4417-bf8b-b83f52a42d06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:36.461275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683fc5d7-dcdc-4417-bf8b-b83f52a42d06 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:36.488744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c2f61724-cb9c-4b5e-b03f-a615c2544889 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:36.490231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c2f61724-cb9c-4b5e-b03f-a615c2544889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:36.496228 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3213/6472] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:36.503900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fc5d7-dcdc-4417-bf8b-b83f52a42d06 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:36.507241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-683fc5d7-dcdc-4417-bf8b-b83f52a42d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:36.524443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fc5d7-dcdc-4417-bf8b-b83f52a42d06 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:36.599099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897732e-11b9-422e-927b-d363cb59b0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:36.599815 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897732e-11b9-422e-927b-d363cb59b0ae admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:36.600185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897732e-11b9-422e-927b-d363cb59b0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:36.600544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897732e-11b9-422e-927b-d363cb59b0ae admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:36.601252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897732e-11b9-422e-927b-d363cb59b0ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:36.603324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897732e-11b9-422e-927b-d363cb59b0ae admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:36.604520 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3260/6473] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:36.605727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f61724-cb9c-4b5e-b03f-a615c2544889 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:36.622935 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f61724-cb9c-4b5e-b03f-a615c2544889 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:36.632725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b81c54-638f-4b0f-ae68-ef2a237cfade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:36.633933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b81c54-638f-4b0f-ae68-ef2a237cfade admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:36.634548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b81c54-638f-4b0f-ae68-ef2a237cfade admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:36.634959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b81c54-638f-4b0f-ae68-ef2a237cfade admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:36.635940 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b81c54-638f-4b0f-ae68-ef2a237cfade admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:36.644371 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3214/6474] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:41:36 2022] POST /identity/v3/users => generated 283 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:36.647525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897732e-11b9-422e-927b-d363cb59b0ae admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:36.650092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a897732e-11b9-422e-927b-d363cb59b0ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:36.659379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b81c54-638f-4b0f-ae68-ef2a237cfade admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:36.669011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897732e-11b9-422e-927b-d363cb59b0ae admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:36.675143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a7b38-9b72-497e-810b-a691fa553922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:36.676174 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a7b38-9b72-497e-810b-a691fa553922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:36.676559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a7b38-9b72-497e-810b-a691fa553922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:36.676923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a7b38-9b72-497e-810b-a691fa553922 admin admin] PATH_INFO: `/v3/projects/d915d1d9b6724c88acd845968e7bca6e` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:36.678537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a7b38-9b72-497e-810b-a691fa553922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d915d1d9b6724c88acd845968e7bca6e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:36.681092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a7b38-9b72-497e-810b-a691fa553922 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:36.695712 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:36.733794 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3261/6475] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:36 2022] POST /identity/v3/projects => generated 387 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:36.735535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083f4b7-0db4-4f54-a3f1-6d677953d3b7 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:36.736095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083f4b7-0db4-4f54-a3f1-6d677953d3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:36.736506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083f4b7-0db4-4f54-a3f1-6d677953d3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:36.765758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e38a7b38-9b72-497e-810b-a691fa553922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd915d1d9b6724c88acd845968e7bca6e', 'request_id': 'req-e38a7b38-9b72-497e-810b-a691fa553922'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:36.778314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9083f4b7-0db4-4f54-a3f1-6d677953d3b7 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:36.779793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9083f4b7-0db4-4f54-a3f1-6d677953d3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:36.781170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e38a7b38-9b72-497e-810b-a691fa553922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd915d1d9b6724c88acd845968e7bca6e', 'request_id': 'req-e38a7b38-9b72-497e-810b-a691fa553922'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:36.790786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e38a7b38-9b72-497e-810b-a691fa553922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd915d1d9b6724c88acd845968e7bca6e', 'request_id': 'req-e38a7b38-9b72-497e-810b-a691fa553922'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:36.821619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e38a7b38-9b72-497e-810b-a691fa553922 admin admin] The token cache is being invalidate because project d915d1d9b6724c88acd845968e7bca6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:36.821925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e38a7b38-9b72-497e-810b-a691fa553922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:36.824225 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e38a7b38-9b72-497e-810b-a691fa553922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:36.828178 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3215/6476] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:41:36 2022] DELETE /identity/v3/projects/d915d1d9b6724c88acd845968e7bca6e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:36.829091 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a7b38-9b72-497e-810b-a691fa553922 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:36.835919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e38a7b38-9b72-497e-810b-a691fa553922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:36.896735 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:36.931566 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3262/6477] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:36.939696 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083f4b7-0db4-4f54-a3f1-6d677953d3b7 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:36.939696 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9083f4b7-0db4-4f54-a3f1-6d677953d3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:36.995272 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083f4b7-0db4-4f54-a3f1-6d677953d3b7 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:37.019740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e29331-e9f2-4a96-b8ed-3b924269a525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:37.024449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e29331-e9f2-4a96-b8ed-3b924269a525 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:37.028640 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e29331-e9f2-4a96-b8ed-3b924269a525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:37.031795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e29331-e9f2-4a96-b8ed-3b924269a525 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:37.033706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e29331-e9f2-4a96-b8ed-3b924269a525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:37.039938 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e29331-e9f2-4a96-b8ed-3b924269a525 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:37.068032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a7b38-9b72-497e-810b-a691fa553922 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:37.089377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad944a-c3c2-44a0-a096-4bfed83c70f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:37.091609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad944a-c3c2-44a0-a096-4bfed83c70f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:37.095662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad944a-c3c2-44a0-a096-4bfed83c70f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:37.098559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad944a-c3c2-44a0-a096-4bfed83c70f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:37.102162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad944a-c3c2-44a0-a096-4bfed83c70f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:37.109373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad944a-c3c2-44a0-a096-4bfed83c70f5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:37.128700 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3263/6478] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:41:36 2022] POST /identity/v3/users => generated 294 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:37.131790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c45a9-f243-4757-b79b-4e85342612f6 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:37.132598 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c45a9-f243-4757-b79b-4e85342612f6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:37.136068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c45a9-f243-4757-b79b-4e85342612f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:37.162982 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3216/6479] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:37.164547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad944a-c3c2-44a0-a096-4bfed83c70f5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:37.183877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9e0c45a9-f243-4757-b79b-4e85342612f6 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:37.186398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9e0c45a9-f243-4757-b79b-4e85342612f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:37.206657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad944a-c3c2-44a0-a096-4bfed83c70f5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:37.219119 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3264/6480] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:37.230003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0fd48-2676-45e7-90b8-b693da89bdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:37.230003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0fd48-2676-45e7-90b8-b693da89bdaf admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:37.230003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0fd48-2676-45e7-90b8-b693da89bdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:37.230003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0fd48-2676-45e7-90b8-b693da89bdaf admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:37.230561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0fd48-2676-45e7-90b8-b693da89bdaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:41:37.230561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0fd48-2676-45e7-90b8-b693da89bdaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:37.230561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0fd48-2676-45e7-90b8-b693da89bdaf admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:37.238481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c45a9-f243-4757-b79b-4e85342612f6 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:37.258719 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3217/6481] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:37.260000 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0fd48-2676-45e7-90b8-b693da89bdaf admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:37.284861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0fd48-2676-45e7-90b8-b693da89bdaf admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:37.294466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6b7e1-dc83-4494-b198-83fef8b875ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:37.294466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6b7e1-dc83-4494-b198-83fef8b875ea admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:37.294466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6b7e1-dc83-4494-b198-83fef8b875ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:37.294466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6b7e1-dc83-4494-b198-83fef8b875ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:37.297034 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c45a9-f243-4757-b79b-4e85342612f6 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:37.300420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6b7e1-dc83-4494-b198-83fef8b875ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:37.302368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6b7e1-dc83-4494-b198-83fef8b875ea admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:37.309538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b726e2-b243-43eb-8158-327d5c5325cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:37.311190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b726e2-b243-43eb-8158-327d5c5325cf admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:37.311774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b726e2-b243-43eb-8158-327d5c5325cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:37.312414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b726e2-b243-43eb-8158-327d5c5325cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:37.313701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b726e2-b243-43eb-8158-327d5c5325cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:37.321513 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3218/6482] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:37.326563 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fa81d-abef-4870-8214-33e1e68566df None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:37.326853 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fa81d-abef-4870-8214-33e1e68566df None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:37.327145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fa81d-abef-4870-8214-33e1e68566df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:37.336998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b726e2-b243-43eb-8158-327d5c5325cf admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:37.365995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-8f7fa81d-abef-4870-8214-33e1e68566df None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:37.367742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8f7fa81d-abef-4870-8214-33e1e68566df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:37.399011 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3219/6483] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:37.403965 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7fa81d-abef-4870-8214-33e1e68566df None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:37.414264 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3265/6484] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:37.417686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b726e2-b243-43eb-8158-327d5c5325cf admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:37.427327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7fa81d-abef-4870-8214-33e1e68566df None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:37.459351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410d4e8-c9ff-43ad-a664-b92c0ca7322d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:37.461304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410d4e8-c9ff-43ad-a664-b92c0ca7322d admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:37.462389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410d4e8-c9ff-43ad-a664-b92c0ca7322d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:37.463158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410d4e8-c9ff-43ad-a664-b92c0ca7322d admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:37.464198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410d4e8-c9ff-43ad-a664-b92c0ca7322d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:37.467296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410d4e8-c9ff-43ad-a664-b92c0ca7322d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:37.474735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b726e2-b243-43eb-8158-327d5c5325cf admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:37.510337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0bca3-bcaa-4fff-b4b5-2589c84a2c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:37.511801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0bca3-bcaa-4fff-b4b5-2589c84a2c37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:37.512540 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0bca3-bcaa-4fff-b4b5-2589c84a2c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:37.513153 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0bca3-bcaa-4fff-b4b5-2589c84a2c37 admin admin] PATH_INFO: `/v3/projects/141e790672204253a7d1beaf2fc6f2cc/users/b5ee7570205749f29f70607e8a3b29fa/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:37.551127 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3220/6485] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:37 2022] POST /identity/v3/projects => generated 367 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:37.555165 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410d4e8-c9ff-43ad-a664-b92c0ca7322d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:37.566969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0bca3-bcaa-4fff-b4b5-2589c84a2c37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=141e790672204253a7d1beaf2fc6f2cc, user_id=b5ee7570205749f29f70607e8a3b29fa, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:37.569796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0bca3-bcaa-4fff-b4b5-2589c84a2c37 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:37.601353 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3266/6486] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:37 2022] PUT /identity/v3/projects/141e790672204253a7d1beaf2fc6f2cc/users/b5ee7570205749f29f70607e8a3b29fa/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:37.603148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0bca3-bcaa-4fff-b4b5-2589c84a2c37 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:37.821098 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410d4e8-c9ff-43ad-a664-b92c0ca7322d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:37.875474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0bca3-bcaa-4fff-b4b5-2589c84a2c37 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:37.895605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c8c6c-f14e-45b2-a211-87c142e32a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:37.896395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c8c6c-f14e-45b2-a211-87c142e32a2f admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:37.898660 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c8c6c-f14e-45b2-a211-87c142e32a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:37.898660 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c8c6c-f14e-45b2-a211-87c142e32a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:37.902119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c8c6c-f14e-45b2-a211-87c142e32a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:37.905911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c8c6c-f14e-45b2-a211-87c142e32a2f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:37.930719 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3267/6487] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:37.931617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c8c6c-f14e-45b2-a211-87c142e32a2f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:37.970295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c8c6c-f14e-45b2-a211-87c142e32a2f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:37.980443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a40367-0967-4d97-af64-3bc1a11b72ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:37.981070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a40367-0967-4d97-af64-3bc1a11b72ea admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:37.981345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a40367-0967-4d97-af64-3bc1a11b72ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:37.981612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a40367-0967-4d97-af64-3bc1a11b72ea admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:37.982237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a40367-0967-4d97-af64-3bc1a11b72ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:37.984181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a40367-0967-4d97-af64-3bc1a11b72ea admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:38.017565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0ed8f-9c5b-409b-95b4-c82d6313b5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:38.018958 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0ed8f-9c5b-409b-95b4-c82d6313b5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:38.020345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0ed8f-9c5b-409b-95b4-c82d6313b5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:38.020654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0ed8f-9c5b-409b-95b4-c82d6313b5d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:38.021672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0ed8f-9c5b-409b-95b4-c82d6313b5d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:41:38.022779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0ed8f-9c5b-409b-95b4-c82d6313b5d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:38.024982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0ed8f-9c5b-409b-95b4-c82d6313b5d4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:38.045454 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3268/6488] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:41:37 2022] POST /identity/v3/users => generated 284 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:38.046849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f0bee-b917-47a0-b74d-be582ee26428 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:38.047133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f0bee-b917-47a0-b74d-be582ee26428 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:38.047405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f0bee-b917-47a0-b74d-be582ee26428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:38.053338 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:38.068479 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3221/6489] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 514 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:38.068479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0ed8f-9c5b-409b-95b4-c82d6313b5d4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:38.083384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0ed8f-9c5b-409b-95b4-c82d6313b5d4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:38.089999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30c9e6-7e83-415c-b2f8-b8db155a96b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:38.090930 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30c9e6-7e83-415c-b2f8-b8db155a96b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:38.102794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30c9e6-7e83-415c-b2f8-b8db155a96b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:38.104788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30c9e6-7e83-415c-b2f8-b8db155a96b5 admin admin] PATH_INFO: `/v3/projects/bbdda533911b45c88549afbf7f9a071a/users/7641a3b491f64e9b90ebe2ab7de66395/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:38.108021 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:38.116922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-060f0bee-b917-47a0-b74d-be582ee26428 None None] MFA Rules not processed for user `b5ee7570205749f29f70607e8a3b29fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:38.118855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-060f0bee-b917-47a0-b74d-be582ee26428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:38.158325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30c9e6-7e83-415c-b2f8-b8db155a96b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbdda533911b45c88549afbf7f9a071a, user_id=7641a3b491f64e9b90ebe2ab7de66395, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:38.165064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30c9e6-7e83-415c-b2f8-b8db155a96b5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:38.201479 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3222/6490] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:38 2022] PUT /identity/v3/projects/bbdda533911b45c88549afbf7f9a071a/users/7641a3b491f64e9b90ebe2ab7de66395/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:38.202537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30c9e6-7e83-415c-b2f8-b8db155a96b5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:38.255637 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3269/6491] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:38.256499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f0bee-b917-47a0-b74d-be582ee26428 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:38.270711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f0bee-b917-47a0-b74d-be582ee26428 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:38.310778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30c9e6-7e83-415c-b2f8-b8db155a96b5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:38.316870 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9821a22-d5cf-4e2b-9e6e-c00db1f82780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:38.317625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9821a22-d5cf-4e2b-9e6e-c00db1f82780 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:38.317984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9821a22-d5cf-4e2b-9e6e-c00db1f82780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:38.318327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9821a22-d5cf-4e2b-9e6e-c00db1f82780 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:38.319060 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9821a22-d5cf-4e2b-9e6e-c00db1f82780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:38.321022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9821a22-d5cf-4e2b-9e6e-c00db1f82780 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:38.345283 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3223/6492] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:38.348169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba3b99-70e4-48cb-a350-cc027d3bf7cf None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:38.349232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba3b99-70e4-48cb-a350-cc027d3bf7cf None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:38.349596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba3b99-70e4-48cb-a350-cc027d3bf7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:38.394974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e3ba3b99-70e4-48cb-a350-cc027d3bf7cf None None] MFA Rules not processed for user `7641a3b491f64e9b90ebe2ab7de66395`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:38.399149 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e3ba3b99-70e4-48cb-a350-cc027d3bf7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:38.423748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be4829-630b-47ec-8012-c15cad5ff6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:38.424522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be4829-630b-47ec-8012-c15cad5ff6a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:38.424805 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be4829-630b-47ec-8012-c15cad5ff6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:38.425080 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be4829-630b-47ec-8012-c15cad5ff6a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:38.426035 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be4829-630b-47ec-8012-c15cad5ff6a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:38.432407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be4829-630b-47ec-8012-c15cad5ff6a8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:38.499149 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3270/6493] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:38 2022] POST /identity/v3/projects => generated 367 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:38.500082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be4829-630b-47ec-8012-c15cad5ff6a8 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:38.519370 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3224/6494] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:38.521262 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba3b99-70e4-48cb-a350-cc027d3bf7cf None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:38.537408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba3b99-70e4-48cb-a350-cc027d3bf7cf None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:38.655730 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be4829-630b-47ec-8012-c15cad5ff6a8 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:38.671981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f588e-f867-4fbd-b884-82e55cf41c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:38.673541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f588e-f867-4fbd-b884-82e55cf41c10 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:38.675050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f588e-f867-4fbd-b884-82e55cf41c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:38.675337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f588e-f867-4fbd-b884-82e55cf41c10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:38.676609 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f588e-f867-4fbd-b884-82e55cf41c10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:38.682325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f588e-f867-4fbd-b884-82e55cf41c10 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:38.683699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a6fe0-765a-4a0f-a9d2-17ddcf3f5f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:38.686672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a6fe0-765a-4a0f-a9d2-17ddcf3f5f2c admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:38.687010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a6fe0-765a-4a0f-a9d2-17ddcf3f5f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:38.687296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a6fe0-765a-4a0f-a9d2-17ddcf3f5f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:38.689053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a6fe0-765a-4a0f-a9d2-17ddcf3f5f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:38.691788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a6fe0-765a-4a0f-a9d2-17ddcf3f5f2c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:38.698453 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:38.728914 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3225/6495] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:38.728914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a6fe0-765a-4a0f-a9d2-17ddcf3f5f2c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:38.748293 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3271/6496] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:38 2022] POST /identity/v3/projects => generated 365 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:38.749322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f588e-f867-4fbd-b884-82e55cf41c10 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:38.755941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a6fe0-765a-4a0f-a9d2-17ddcf3f5f2c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:38.764725 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:38.851772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0e42c-2289-47c8-bbea-83c815bb9ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:38.852785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0e42c-2289-47c8-bbea-83c815bb9ffa admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:38.853106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0e42c-2289-47c8-bbea-83c815bb9ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:38.853459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0e42c-2289-47c8-bbea-83c815bb9ffa admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:38.854479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0e42c-2289-47c8-bbea-83c815bb9ffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:38.858868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0e42c-2289-47c8-bbea-83c815bb9ffa admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:38.878943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f588e-f867-4fbd-b884-82e55cf41c10 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:38.894107 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3226/6497] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:41:38 2022] POST /identity/v3/users => generated 284 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:38.894955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0e42c-2289-47c8-bbea-83c815bb9ffa admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:38.901059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0cb38-38c7-43ec-b09b-08f4fc68cc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:38.904553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0cb38-38c7-43ec-b09b-08f4fc68cc6e admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:38.905050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0cb38-38c7-43ec-b09b-08f4fc68cc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:38.905497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0cb38-38c7-43ec-b09b-08f4fc68cc6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:38.906362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0cb38-38c7-43ec-b09b-08f4fc68cc6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:38.909826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0e42c-2289-47c8-bbea-83c815bb9ffa admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:38.914418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0cb38-38c7-43ec-b09b-08f4fc68cc6e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:38.916721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715ea88-914a-4de8-971f-13832425a811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:38.917410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715ea88-914a-4de8-971f-13832425a811 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:38.917747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715ea88-914a-4de8-971f-13832425a811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:38.918548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715ea88-914a-4de8-971f-13832425a811 admin admin] PATH_INFO: `/v3/projects/e6725a6a133d4433a5606d033590c90d/users/69ffb490be73440191f6a22ac5cc718d/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:38.942864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715ea88-914a-4de8-971f-13832425a811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6725a6a133d4433a5606d033590c90d, user_id=69ffb490be73440191f6a22ac5cc718d, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:38.947702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715ea88-914a-4de8-971f-13832425a811 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:38.974829 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3227/6498] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:38 2022] PUT /identity/v3/projects/e6725a6a133d4433a5606d033590c90d/users/69ffb490be73440191f6a22ac5cc718d/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:38.976117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715ea88-914a-4de8-971f-13832425a811 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:38.992244 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3272/6499] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:38 2022] POST /identity/v3/projects => generated 387 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:38.993813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0cb38-38c7-43ec-b09b-08f4fc68cc6e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:38.997146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1bf0cb38-38c7-43ec-b09b-08f4fc68cc6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:39.112016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0cb38-38c7-43ec-b09b-08f4fc68cc6e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:39.119569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8820c-1db1-43eb-84bf-3679e95ee271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:39.121551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8820c-1db1-43eb-84bf-3679e95ee271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:39.122260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8820c-1db1-43eb-84bf-3679e95ee271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:39.122892 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8820c-1db1-43eb-84bf-3679e95ee271 admin admin] PATH_INFO: `/v3/users/2f5acf7da18b43f89e24760744cfdb49` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:39.125057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace8820c-1db1-43eb-84bf-3679e95ee271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f5acf7da18b43f89e24760744cfdb49)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:39.128701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace8820c-1db1-43eb-84bf-3679e95ee271 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:39.170827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715ea88-914a-4de8-971f-13832425a811 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:39.187688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686680a5-c408-490e-8a1c-12d3b9570248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:39.190861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686680a5-c408-490e-8a1c-12d3b9570248 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:39.191071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686680a5-c408-490e-8a1c-12d3b9570248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:39.191607 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686680a5-c408-490e-8a1c-12d3b9570248 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:39.192308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686680a5-c408-490e-8a1c-12d3b9570248 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:39.195875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686680a5-c408-490e-8a1c-12d3b9570248 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:39.256606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ace8820c-1db1-43eb-84bf-3679e95ee271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f5acf7da18b43f89e24760744cfdb49'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:39.263612 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3228/6500] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:41:38 2022] POST /identity/v3/users => generated 289 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:39.268036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686680a5-c408-490e-8a1c-12d3b9570248 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:39.286009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ace8820c-1db1-43eb-84bf-3679e95ee271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f5acf7da18b43f89e24760744cfdb49'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:39.293406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686680a5-c408-490e-8a1c-12d3b9570248 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:39.304088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ace8820c-1db1-43eb-84bf-3679e95ee271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f5acf7da18b43f89e24760744cfdb49'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:39.305145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ace8820c-1db1-43eb-84bf-3679e95ee271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f5acf7da18b43f89e24760744cfdb49'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:39.308004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d30610-2028-4199-b69b-6e4c7df1a9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:39.309051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d30610-2028-4199-b69b-6e4c7df1a9bf admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:39.309292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d30610-2028-4199-b69b-6e4c7df1a9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:39.309608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d30610-2028-4199-b69b-6e4c7df1a9bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:39.313121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d30610-2028-4199-b69b-6e4c7df1a9bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:39.315815 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d30610-2028-4199-b69b-6e4c7df1a9bf admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:39.317038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ace8820c-1db1-43eb-84bf-3679e95ee271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f5acf7da18b43f89e24760744cfdb49'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:39.328197 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3273/6501] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:41:38 2022] DELETE /identity/v3/users/2f5acf7da18b43f89e24760744cfdb49 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:39.332266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f5cc9-dbba-4106-9da8-a2cf43400548 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:39.332580 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f5cc9-dbba-4106-9da8-a2cf43400548 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:39.332867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f5cc9-dbba-4106-9da8-a2cf43400548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:39.340839 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3229/6502] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:39.343833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d30610-2028-4199-b69b-6e4c7df1a9bf admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:39.351455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-01d30610-2028-4199-b69b-6e4c7df1a9bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:39.392356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d30610-2028-4199-b69b-6e4c7df1a9bf admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:39.408385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a17f5cc9-dbba-4106-9da8-a2cf43400548 None None] MFA Rules not processed for user `69ffb490be73440191f6a22ac5cc718d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:39.410250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a17f5cc9-dbba-4106-9da8-a2cf43400548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:39.420608 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:39.459706 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:39.482677 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0bdd3c-6c21-4129-af98-87f3e9deadde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:39.483629 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bdd3c-6c21-4129-af98-87f3e9deadde admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:39.484142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bdd3c-6c21-4129-af98-87f3e9deadde admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:39.484573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bdd3c-6c21-4129-af98-87f3e9deadde admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:39.485499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0bdd3c-6c21-4129-af98-87f3e9deadde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:39.488794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0bdd3c-6c21-4129-af98-87f3e9deadde admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:39.521873 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3230/6503] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:41:39 2022] POST /identity/v3/users => generated 300 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:39.523138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0bdd3c-6c21-4129-af98-87f3e9deadde admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:39.525411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5d0bdd3c-6c21-4129-af98-87f3e9deadde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:39.539751 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3274/6504] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:39.541446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f5cc9-dbba-4106-9da8-a2cf43400548 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:39.543772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a17f5cc9-dbba-4106-9da8-a2cf43400548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:39.554875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0bdd3c-6c21-4129-af98-87f3e9deadde admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:39.568639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f5cc9-dbba-4106-9da8-a2cf43400548 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:39.576692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ac2d8-1b45-4cf4-a164-844d3a22cfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:39.577334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ac2d8-1b45-4cf4-a164-844d3a22cfb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:39.577622 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ac2d8-1b45-4cf4-a164-844d3a22cfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:39.577882 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf0b8c-52eb-4b78-96c0-192aad520cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:39.578118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ac2d8-1b45-4cf4-a164-844d3a22cfb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:39.578546 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ac2d8-1b45-4cf4-a164-844d3a22cfb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:39.578869 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf0b8c-52eb-4b78-96c0-192aad520cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:39.579623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf0b8c-52eb-4b78-96c0-192aad520cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:39.580058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf0b8c-52eb-4b78-96c0-192aad520cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:39.580309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ac2d8-1b45-4cf4-a164-844d3a22cfb1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:39.580989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf0b8c-52eb-4b78-96c0-192aad520cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:39.582876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf0b8c-52eb-4b78-96c0-192aad520cc5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:39.607616 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3275/6505] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:39.608736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf0b8c-52eb-4b78-96c0-192aad520cc5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:39.614919 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3231/6506] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:39.616834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ac2d8-1b45-4cf4-a164-844d3a22cfb1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:39.620811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-283ac2d8-1b45-4cf4-a164-844d3a22cfb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:39.635308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf0b8c-52eb-4b78-96c0-192aad520cc5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:39.637220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ac2d8-1b45-4cf4-a164-844d3a22cfb1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:39.643309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b40e71-0781-4e3c-96df-70f8f9690a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:39.644366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b40e71-0781-4e3c-96df-70f8f9690a6f admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:39.644366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b40e71-0781-4e3c-96df-70f8f9690a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:39.644614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b40e71-0781-4e3c-96df-70f8f9690a6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:39.645730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b40e71-0781-4e3c-96df-70f8f9690a6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:39.648669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b40e71-0781-4e3c-96df-70f8f9690a6f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:39.649088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6b41d-ac38-478b-888b-7526a9ed3fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:39.651623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6b41d-ac38-478b-888b-7526a9ed3fdb admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:39.651623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6b41d-ac38-478b-888b-7526a9ed3fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:39.651623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6b41d-ac38-478b-888b-7526a9ed3fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:39.651948 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6b41d-ac38-478b-888b-7526a9ed3fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:39.660044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6b41d-ac38-478b-888b-7526a9ed3fdb admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:39.681809 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3276/6507] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:39.684282 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6b41d-ac38-478b-888b-7526a9ed3fdb admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:39.698670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6b41d-ac38-478b-888b-7526a9ed3fdb admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:39.702366 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3232/6508] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:39 2022] POST /identity/v3/projects => generated 367 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:39.703395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b40e71-0781-4e3c-96df-70f8f9690a6f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:39.783437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6b3c6-413e-4975-9415-54e269765143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:39.784953 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6b3c6-413e-4975-9415-54e269765143 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:39.785238 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6b3c6-413e-4975-9415-54e269765143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:39.785513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6b3c6-413e-4975-9415-54e269765143 admin admin] PATH_INFO: `/v3/projects/638a60100a1d460aaf422bae85034f22/users/904a756643e348eaa801946a6b0e3bd3/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:39.801114 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b40e71-0781-4e3c-96df-70f8f9690a6f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:39.805324 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6b3c6-413e-4975-9415-54e269765143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=638a60100a1d460aaf422bae85034f22, user_id=904a756643e348eaa801946a6b0e3bd3, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:39.808096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193376fb-9197-43b7-bd1f-273703471059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:39.808357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6b3c6-413e-4975-9415-54e269765143 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:39.809247 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193376fb-9197-43b7-bd1f-273703471059 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:39.809741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193376fb-9197-43b7-bd1f-273703471059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:39.810223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193376fb-9197-43b7-bd1f-273703471059 admin admin] PATH_INFO: `/v3/projects/c5c44bdb016f42e3a06fa5e5e82e6365/users/22541225521344a690241ee18ba81683/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:39.826349 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3277/6509] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:39 2022] PUT /identity/v3/projects/638a60100a1d460aaf422bae85034f22/users/904a756643e348eaa801946a6b0e3bd3/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:39.827258 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6b3c6-413e-4975-9415-54e269765143 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:39.836385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193376fb-9197-43b7-bd1f-273703471059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5c44bdb016f42e3a06fa5e5e82e6365, user_id=22541225521344a690241ee18ba81683, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:39.839439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193376fb-9197-43b7-bd1f-273703471059 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:39.864768 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3233/6510] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:39 2022] PUT /identity/v3/projects/c5c44bdb016f42e3a06fa5e5e82e6365/users/22541225521344a690241ee18ba81683/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:39.869620 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193376fb-9197-43b7-bd1f-273703471059 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:39.872583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-193376fb-9197-43b7-bd1f-273703471059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:39.905807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6b3c6-413e-4975-9415-54e269765143 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:39.920419 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:39.990511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193376fb-9197-43b7-bd1f-273703471059 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:39.996393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05a56d-7d2e-4d50-8e67-dd671e45ec5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:39.996846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5c855-d885-4dec-8268-83933f4e8c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:39.997535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5c855-d885-4dec-8268-83933f4e8c73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:39.997675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05a56d-7d2e-4d50-8e67-dd671e45ec5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:39.997858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5c855-d885-4dec-8268-83933f4e8c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:39.998081 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5c855-d885-4dec-8268-83933f4e8c73 admin admin] PATH_INFO: `/v3/projects/49615a704bb441ba9bb78d1f476c9561/users/657de75fcb7849bd8cff41d88c1781be/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:39.998565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05a56d-7d2e-4d50-8e67-dd671e45ec5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:39.999701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05a56d-7d2e-4d50-8e67-dd671e45ec5e admin admin] PATH_INFO: `/v3/projects/70f17360f0c84562bd99b006b659736e` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:40.001510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05a56d-7d2e-4d50-8e67-dd671e45ec5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=70f17360f0c84562bd99b006b659736e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:40.005223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05a56d-7d2e-4d50-8e67-dd671e45ec5e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:40.019859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5c855-d885-4dec-8268-83933f4e8c73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49615a704bb441ba9bb78d1f476c9561, user_id=657de75fcb7849bd8cff41d88c1781be, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:40.023513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5c855-d885-4dec-8268-83933f4e8c73 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:40.048356 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:40.050434 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3278/6511] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:39 2022] PUT /identity/v3/projects/49615a704bb441ba9bb78d1f476c9561/users/657de75fcb7849bd8cff41d88c1781be/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:40.051165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5c855-d885-4dec-8268-83933f4e8c73 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:40.094314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1f05a56d-7d2e-4d50-8e67-dd671e45ec5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70f17360f0c84562bd99b006b659736e', 'request_id': 'req-1f05a56d-7d2e-4d50-8e67-dd671e45ec5e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:40.101925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1f05a56d-7d2e-4d50-8e67-dd671e45ec5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70f17360f0c84562bd99b006b659736e', 'request_id': 'req-1f05a56d-7d2e-4d50-8e67-dd671e45ec5e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:40.110279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1f05a56d-7d2e-4d50-8e67-dd671e45ec5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70f17360f0c84562bd99b006b659736e', 'request_id': 'req-1f05a56d-7d2e-4d50-8e67-dd671e45ec5e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:40.136044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1f05a56d-7d2e-4d50-8e67-dd671e45ec5e admin admin] The token cache is being invalidate because project 70f17360f0c84562bd99b006b659736e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:40.136044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1f05a56d-7d2e-4d50-8e67-dd671e45ec5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:40.137191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1f05a56d-7d2e-4d50-8e67-dd671e45ec5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:40.139810 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3234/6512] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:41:39 2022] DELETE /identity/v3/projects/70f17360f0c84562bd99b006b659736e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:40.141127 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8f188-2a51-48d8-99aa-710caa00f6de None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:40.141413 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8f188-2a51-48d8-99aa-710caa00f6de None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:40.141688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8f188-2a51-48d8-99aa-710caa00f6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:40.159296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5c855-d885-4dec-8268-83933f4e8c73 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:40.209012 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-75c8f188-2a51-48d8-99aa-710caa00f6de None None] MFA Rules not processed for user `904a756643e348eaa801946a6b0e3bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:40.210913 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-75c8f188-2a51-48d8-99aa-710caa00f6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:40.264251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca4e45-6c93-4f0f-b6a6-367d739dfb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:40.264892 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca4e45-6c93-4f0f-b6a6-367d739dfb5d admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:40.265172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca4e45-6c93-4f0f-b6a6-367d739dfb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:40.265447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca4e45-6c93-4f0f-b6a6-367d739dfb5d admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:40.266084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca4e45-6c93-4f0f-b6a6-367d739dfb5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:40.268935 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca4e45-6c93-4f0f-b6a6-367d739dfb5d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:40.312885 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3279/6513] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:41:40 2022] POST /identity/v3/users => generated 290 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:40.314733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca4e45-6c93-4f0f-b6a6-367d739dfb5d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:40.317405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-42ca4e45-6c93-4f0f-b6a6-367d739dfb5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:40.353309 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3235/6514] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:40.354390 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca4e45-6c93-4f0f-b6a6-367d739dfb5d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:40.355823 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8f188-2a51-48d8-99aa-710caa00f6de None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:40.358688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-75c8f188-2a51-48d8-99aa-710caa00f6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:40.365019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a61b4d-9979-491b-b166-2e27b2ea0ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:40.367712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a61b4d-9979-491b-b166-2e27b2ea0ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:40.367712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a61b4d-9979-491b-b166-2e27b2ea0ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:40.367712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a61b4d-9979-491b-b166-2e27b2ea0ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:40.368895 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a61b4d-9979-491b-b166-2e27b2ea0ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:40.372034 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a61b4d-9979-491b-b166-2e27b2ea0ff2 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:40.383399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8f188-2a51-48d8-99aa-710caa00f6de None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:40.389191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2706b-e5ff-4398-a6d5-083a91ee6176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:40.389678 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3280/6515] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:40.391155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc749fe8-203f-498e-88b1-721724a1864c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:40.391610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc749fe8-203f-498e-88b1-721724a1864c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:40.392217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc749fe8-203f-498e-88b1-721724a1864c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:40.393946 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2706b-e5ff-4398-a6d5-083a91ee6176 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:40.394339 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2706b-e5ff-4398-a6d5-083a91ee6176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:40.394742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2706b-e5ff-4398-a6d5-083a91ee6176 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:40.395639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2706b-e5ff-4398-a6d5-083a91ee6176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:40.411830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2706b-e5ff-4398-a6d5-083a91ee6176 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:40.421627 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-dc749fe8-203f-498e-88b1-721724a1864c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:40.423011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dc749fe8-203f-498e-88b1-721724a1864c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:40.435655 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3281/6516] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:40.438650 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3236/6517] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:40.442389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2706b-e5ff-4398-a6d5-083a91ee6176 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:40.444317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc749fe8-203f-498e-88b1-721724a1864c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:40.445748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dc749fe8-203f-498e-88b1-721724a1864c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:40.446696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-54b2706b-e5ff-4398-a6d5-083a91ee6176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:40.459611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc749fe8-203f-498e-88b1-721724a1864c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:40.465920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd8467-9604-41c1-8e98-aee7358ec0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:40.466543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd8467-9604-41c1-8e98-aee7358ec0ea admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:40.466818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd8467-9604-41c1-8e98-aee7358ec0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:40.467086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd8467-9604-41c1-8e98-aee7358ec0ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:40.467733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd8467-9604-41c1-8e98-aee7358ec0ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:40.470078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd8467-9604-41c1-8e98-aee7358ec0ea admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:40.484510 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3282/6518] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:40.485826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd8467-9604-41c1-8e98-aee7358ec0ea admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:40.492999 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:40.498987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd8467-9604-41c1-8e98-aee7358ec0ea admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:40.513336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a335e5-1a6e-4554-9b41-7da67faf6b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:40.514414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a335e5-1a6e-4554-9b41-7da67faf6b25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:40.514844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a335e5-1a6e-4554-9b41-7da67faf6b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:40.515287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a335e5-1a6e-4554-9b41-7da67faf6b25 admin admin] PATH_INFO: `/v3/projects/c5c44bdb016f42e3a06fa5e5e82e6365/users/22541225521344a690241ee18ba81683/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:40.518721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a335e5-1a6e-4554-9b41-7da67faf6b25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5c44bdb016f42e3a06fa5e5e82e6365, user_id=22541225521344a690241ee18ba81683, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:40.524175 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a335e5-1a6e-4554-9b41-7da67faf6b25 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:40.542448 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3283/6519] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:40 2022] PUT /identity/v3/projects/c5c44bdb016f42e3a06fa5e5e82e6365/users/22541225521344a690241ee18ba81683/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:40.543371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a335e5-1a6e-4554-9b41-7da67faf6b25 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:40.589064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2706b-e5ff-4398-a6d5-083a91ee6176 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:40.637291 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a335e5-1a6e-4554-9b41-7da67faf6b25 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:40.649388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd3d22-b251-4a22-b7ef-9ec35697d1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:40.650381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd3d22-b251-4a22-b7ef-9ec35697d1e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:40.651076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd3d22-b251-4a22-b7ef-9ec35697d1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:40.653993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd3d22-b251-4a22-b7ef-9ec35697d1e5 admin admin] PATH_INFO: `/v3/projects/49615a704bb441ba9bb78d1f476c9561/users/657de75fcb7849bd8cff41d88c1781be/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:40.659082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd3d22-b251-4a22-b7ef-9ec35697d1e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49615a704bb441ba9bb78d1f476c9561, user_id=657de75fcb7849bd8cff41d88c1781be, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:40.662148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd3d22-b251-4a22-b7ef-9ec35697d1e5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:40.685547 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:40.696993 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3284/6520] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:40 2022] PUT /identity/v3/projects/49615a704bb441ba9bb78d1f476c9561/users/657de75fcb7849bd8cff41d88c1781be/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:40.698873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c815a-d8ac-4704-a879-7c1a40e84cc3 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:40.700065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06d4c5-b7f2-4e17-83e0-999507c4b255 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:40.700693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06d4c5-b7f2-4e17-83e0-999507c4b255 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:40.700974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06d4c5-b7f2-4e17-83e0-999507c4b255 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:40.701109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c815a-d8ac-4704-a879-7c1a40e84cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:40.701243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e06d4c5-b7f2-4e17-83e0-999507c4b255 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:40.702232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c815a-d8ac-4704-a879-7c1a40e84cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:40.744626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6e8c815a-d8ac-4704-a879-7c1a40e84cc3 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:40.748528 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6e8c815a-d8ac-4704-a879-7c1a40e84cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:40.841171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e06d4c5-b7f2-4e17-83e0-999507c4b255 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:40.842788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e06d4c5-b7f2-4e17-83e0-999507c4b255 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:40.862381 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3237/6521] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:40.863244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06d4c5-b7f2-4e17-83e0-999507c4b255 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:40.884887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e06d4c5-b7f2-4e17-83e0-999507c4b255 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:40.894086 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3285/6522] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:40.896024 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236ffb4-b4de-4049-b95b-50902cc578ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:40.898329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e6cad-e0cf-4ac4-aa6f-9b1e976b6b76 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:40.898702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e6cad-e0cf-4ac4-aa6f-9b1e976b6b76 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:40.899009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236ffb4-b4de-4049-b95b-50902cc578ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:40.899774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236ffb4-b4de-4049-b95b-50902cc578ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:40.899774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236ffb4-b4de-4049-b95b-50902cc578ae admin admin] PATH_INFO: `/v3/projects/c28e58b03f724c95be9ff2672a6a78c2/users/73040768ca7e4688a63574524be101a1/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:40.900007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e6cad-e0cf-4ac4-aa6f-9b1e976b6b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:40.947592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236ffb4-b4de-4049-b95b-50902cc578ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=c28e58b03f724c95be9ff2672a6a78c2, user_id=73040768ca7e4688a63574524be101a1, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:40.951434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236ffb4-b4de-4049-b95b-50902cc578ae admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:40.960879 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e31e6cad-e0cf-4ac4-aa6f-9b1e976b6b76 None None] MFA Rules not processed for user `22541225521344a690241ee18ba81683`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:40.964578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e31e6cad-e0cf-4ac4-aa6f-9b1e976b6b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:40.981764 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3238/6523] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:40 2022] PUT /identity/v3/projects/c28e58b03f724c95be9ff2672a6a78c2/users/73040768ca7e4688a63574524be101a1/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:40.985184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eaf8a4-5231-40fc-87d1-f4d11418c141 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:40.985485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eaf8a4-5231-40fc-87d1-f4d11418c141 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:40.985762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eaf8a4-5231-40fc-87d1-f4d11418c141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:41.068259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c1eaf8a4-5231-40fc-87d1-f4d11418c141 None None] MFA Rules not processed for user `657de75fcb7849bd8cff41d88c1781be`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:41.068259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c1eaf8a4-5231-40fc-87d1-f4d11418c141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:41.134579 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3286/6524] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:40 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:41.136613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e6cad-e0cf-4ac4-aa6f-9b1e976b6b76 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:41.180716 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:41.269835 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3239/6525] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:40 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:41.273817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eaf8a4-5231-40fc-87d1-f4d11418c141 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:41.319981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e6cad-e0cf-4ac4-aa6f-9b1e976b6b76 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:41.325188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f08eb-a117-46a0-b0dd-66b33ed125b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:41.325818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f08eb-a117-46a0-b0dd-66b33ed125b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:41.326510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f08eb-a117-46a0-b0dd-66b33ed125b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:41.326792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f08eb-a117-46a0-b0dd-66b33ed125b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:41.327467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f08eb-a117-46a0-b0dd-66b33ed125b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:41:41.327768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f08eb-a117-46a0-b0dd-66b33ed125b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:41.329784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f08eb-a117-46a0-b0dd-66b33ed125b4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:41.350158 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3287/6526] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:41.351185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f08eb-a117-46a0-b0dd-66b33ed125b4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:41.426286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f08eb-a117-46a0-b0dd-66b33ed125b4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:41.430594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471424f-2238-489c-ad35-ec3427ba4d51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:41.431392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471424f-2238-489c-ad35-ec3427ba4d51 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:41.432239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471424f-2238-489c-ad35-ec3427ba4d51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:41.432531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471424f-2238-489c-ad35-ec3427ba4d51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:41.445568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471424f-2238-489c-ad35-ec3427ba4d51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:41.445777 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eaf8a4-5231-40fc-87d1-f4d11418c141 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:41.447389 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471424f-2238-489c-ad35-ec3427ba4d51 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:41.460199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1118ae-bdc2-49b3-b075-8c335e8a901b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:41.460614 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3288/6527] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:41 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:41.460825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1118ae-bdc2-49b3-b075-8c335e8a901b admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:41.461575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1118ae-bdc2-49b3-b075-8c335e8a901b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:41.461691 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471424f-2238-489c-ad35-ec3427ba4d51 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:41.462325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1118ae-bdc2-49b3-b075-8c335e8a901b admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:41.462597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1118ae-bdc2-49b3-b075-8c335e8a901b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:41.463525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1471424f-2238-489c-ad35-ec3427ba4d51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:41.464155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1118ae-bdc2-49b3-b075-8c335e8a901b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:41.471957 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:41.514219 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3240/6528] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:41.515194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1118ae-bdc2-49b3-b075-8c335e8a901b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:41.536945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1118ae-bdc2-49b3-b075-8c335e8a901b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:41.550573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfd5cb-dfa6-4da4-89cc-92f3102f6fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:41.551461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfd5cb-dfa6-4da4-89cc-92f3102f6fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:41.551920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfd5cb-dfa6-4da4-89cc-92f3102f6fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:41.552350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbfd5cb-dfa6-4da4-89cc-92f3102f6fe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:41.553140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbfd5cb-dfa6-4da4-89cc-92f3102f6fe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:41.555232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbfd5cb-dfa6-4da4-89cc-92f3102f6fe4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:41.592744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471424f-2238-489c-ad35-ec3427ba4d51 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:41.598332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44ce0d-861a-463c-96f2-03b7703c077f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:41.599318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44ce0d-861a-463c-96f2-03b7703c077f service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:41.599689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44ce0d-861a-463c-96f2-03b7703c077f service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:41.600185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44ce0d-861a-463c-96f2-03b7703c077f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:41.612716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44ce0d-861a-463c-96f2-03b7703c077f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:41.614755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44ce0d-861a-463c-96f2-03b7703c077f service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:41.629054 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3289/6529] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:41 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:41.630179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44ce0d-861a-463c-96f2-03b7703c077f service cinder] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:41.638950 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3241/6530] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:41 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:41.640864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfd5cb-dfa6-4da4-89cc-92f3102f6fe4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:41.646618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44ce0d-861a-463c-96f2-03b7703c077f service cinder] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:41.753566 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:41.786734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbfd5cb-dfa6-4da4-89cc-92f3102f6fe4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:41.795474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe594e-fc8d-42d2-a3eb-58155d8a33a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:41.806880 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe594e-fc8d-42d2-a3eb-58155d8a33a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:41.807483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe594e-fc8d-42d2-a3eb-58155d8a33a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:41.808434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe594e-fc8d-42d2-a3eb-58155d8a33a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:41.809489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe594e-fc8d-42d2-a3eb-58155d8a33a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:41.833884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe594e-fc8d-42d2-a3eb-58155d8a33a2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:41.837147 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52724b64-ac87-4bc7-b570-147b1f02348d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:41.844008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52724b64-ac87-4bc7-b570-147b1f02348d admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:41.844451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52724b64-ac87-4bc7-b570-147b1f02348d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:41.848335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52724b64-ac87-4bc7-b570-147b1f02348d admin admin] PATH_INFO: `/v3/projects/c28e58b03f724c95be9ff2672a6a78c2/users/73040768ca7e4688a63574524be101a1/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:41.854813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52724b64-ac87-4bc7-b570-147b1f02348d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c28e58b03f724c95be9ff2672a6a78c2, user_id=73040768ca7e4688a63574524be101a1, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:41.884933 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3242/6531] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:41:41 2022] POST /identity/v3/users => generated 286 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:41.886431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52724b64-ac87-4bc7-b570-147b1f02348d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:41.889291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe594e-fc8d-42d2-a3eb-58155d8a33a2 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:41.913009 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3290/6532] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:41 2022] PUT /identity/v3/projects/c28e58b03f724c95be9ff2672a6a78c2/users/73040768ca7e4688a63574524be101a1/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:41.915575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52724b64-ac87-4bc7-b570-147b1f02348d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:41.925592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe594e-fc8d-42d2-a3eb-58155d8a33a2 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:42.059460 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52724b64-ac87-4bc7-b570-147b1f02348d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:42.067120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e07aef-2ece-4890-b71d-44bf9f1500f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:42.067779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e07aef-2ece-4890-b71d-44bf9f1500f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:42.068110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e07aef-2ece-4890-b71d-44bf9f1500f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:42.068390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e07aef-2ece-4890-b71d-44bf9f1500f2 admin admin] PATH_INFO: `/v3/users/7641a3b491f64e9b90ebe2ab7de66395` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:42.072708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e07aef-2ece-4890-b71d-44bf9f1500f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7641a3b491f64e9b90ebe2ab7de66395)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:42.075495 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681977c-6838-4cfc-9008-5b8129ecae7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:42.076460 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681977c-6838-4cfc-9008-5b8129ecae7a admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:42.076986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681977c-6838-4cfc-9008-5b8129ecae7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:42.077476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681977c-6838-4cfc-9008-5b8129ecae7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:42.078030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e07aef-2ece-4890-b71d-44bf9f1500f2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:42.078620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681977c-6838-4cfc-9008-5b8129ecae7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:42.081185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681977c-6838-4cfc-9008-5b8129ecae7a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:42.106244 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3291/6533] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:42.107958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170fcb9-80c0-4fcf-a95f-8879aaef819f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:42.112160 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170fcb9-80c0-4fcf-a95f-8879aaef819f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:42.112709 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170fcb9-80c0-4fcf-a95f-8879aaef819f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:42.225203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c6e07aef-2ece-4890-b71d-44bf9f1500f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7641a3b491f64e9b90ebe2ab7de66395'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:42.232120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b170fcb9-80c0-4fcf-a95f-8879aaef819f None None] MFA Rules not processed for user `73040768ca7e4688a63574524be101a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:42.234170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b170fcb9-80c0-4fcf-a95f-8879aaef819f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:42.240014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c6e07aef-2ece-4890-b71d-44bf9f1500f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7641a3b491f64e9b90ebe2ab7de66395'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:42.254896 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:42.266603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c6e07aef-2ece-4890-b71d-44bf9f1500f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7641a3b491f64e9b90ebe2ab7de66395'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:42.269037 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c6e07aef-2ece-4890-b71d-44bf9f1500f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7641a3b491f64e9b90ebe2ab7de66395'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:42.293900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c6e07aef-2ece-4890-b71d-44bf9f1500f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7641a3b491f64e9b90ebe2ab7de66395'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:42.313027 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3243/6534] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:41:41 2022] DELETE /identity/v3/users/7641a3b491f64e9b90ebe2ab7de66395 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:42.320073 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e07aef-2ece-4890-b71d-44bf9f1500f2 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:42.324663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c6e07aef-2ece-4890-b71d-44bf9f1500f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:42.395204 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3292/6535] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:42.395204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfdb26-8f61-4ba5-a432-9cfb04979d27 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:42.395204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfdb26-8f61-4ba5-a432-9cfb04979d27 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:42.395204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfdb26-8f61-4ba5-a432-9cfb04979d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:42.438982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-11dfdb26-8f61-4ba5-a432-9cfb04979d27 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:42.440333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-11dfdb26-8f61-4ba5-a432-9cfb04979d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:42.546814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e07aef-2ece-4890-b71d-44bf9f1500f2 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:42.563081 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:42.568388 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312a64b-c6ad-4f90-bbee-577f38a3a836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:42.569098 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312a64b-c6ad-4f90-bbee-577f38a3a836 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:42.569417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312a64b-c6ad-4f90-bbee-577f38a3a836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:42.571392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312a64b-c6ad-4f90-bbee-577f38a3a836 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:42.572230 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312a64b-c6ad-4f90-bbee-577f38a3a836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:42.577251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312a64b-c6ad-4f90-bbee-577f38a3a836 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:42.583636 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3293/6536] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:42.584567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfdb26-8f61-4ba5-a432-9cfb04979d27 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:42.587835 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-11dfdb26-8f61-4ba5-a432-9cfb04979d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:42.606082 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3244/6537] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:42.612203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfdb26-8f61-4ba5-a432-9cfb04979d27 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:42.614072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312a64b-c6ad-4f90-bbee-577f38a3a836 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:42.627196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef602b-4678-4d18-a625-c120b508d5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:42.628015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef602b-4678-4d18-a625-c120b508d5f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:42.628306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef602b-4678-4d18-a625-c120b508d5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:42.628586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef602b-4678-4d18-a625-c120b508d5f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:42.629239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef602b-4678-4d18-a625-c120b508d5f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:42.631221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef602b-4678-4d18-a625-c120b508d5f4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:42.643372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312a64b-c6ad-4f90-bbee-577f38a3a836 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:42.651975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06342c5a-3b62-40e0-8448-64862ee60a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:42.653955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06342c5a-3b62-40e0-8448-64862ee60a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:42.654233 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06342c5a-3b62-40e0-8448-64862ee60a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:42.654505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06342c5a-3b62-40e0-8448-64862ee60a49 admin admin] PATH_INFO: `/v3/projects/019b0c4dadba463e99513297ede55f3c/users/7d4cd041ba884cedb08c70ea8083d027/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:42.706833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06342c5a-3b62-40e0-8448-64862ee60a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=019b0c4dadba463e99513297ede55f3c, user_id=7d4cd041ba884cedb08c70ea8083d027, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:42.709546 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3294/6538] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:42 2022] POST /identity/v3/projects => generated 369 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:42.710507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef602b-4678-4d18-a625-c120b508d5f4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:42.712599 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06342c5a-3b62-40e0-8448-64862ee60a49 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:42.716395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c1ef602b-4678-4d18-a625-c120b508d5f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:42.741976 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3245/6539] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:42 2022] PUT /identity/v3/projects/019b0c4dadba463e99513297ede55f3c/users/7d4cd041ba884cedb08c70ea8083d027/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:42.743099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06342c5a-3b62-40e0-8448-64862ee60a49 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:42.857334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef602b-4678-4d18-a625-c120b508d5f4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:42.901363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06342c5a-3b62-40e0-8448-64862ee60a49 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:42.919203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5425ea-2063-4346-b3cc-095321a42847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:42.920218 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5425ea-2063-4346-b3cc-095321a42847 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:42.920592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5425ea-2063-4346-b3cc-095321a42847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:42.921039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5425ea-2063-4346-b3cc-095321a42847 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:42.922346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5425ea-2063-4346-b3cc-095321a42847 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:42.930388 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5425ea-2063-4346-b3cc-095321a42847 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:42.990755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69d2a4-c63d-406c-88a6-504e6ae94dd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:42.994451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69d2a4-c63d-406c-88a6-504e6ae94dd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:42.994742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69d2a4-c63d-406c-88a6-504e6ae94dd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:42.995013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69d2a4-c63d-406c-88a6-504e6ae94dd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:42.999582 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3246/6540] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:41:42 2022] POST /identity/v3/users => generated 285 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:43.006184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264ff25-e550-4c42-8afd-f92e02f42eb8 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:43.006469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264ff25-e550-4c42-8afd-f92e02f42eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:43.006745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264ff25-e550-4c42-8afd-f92e02f42eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:43.026038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69d2a4-c63d-406c-88a6-504e6ae94dd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:43.028177 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69d2a4-c63d-406c-88a6-504e6ae94dd1 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:43.044760 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3295/6541] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:43.045966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69d2a4-c63d-406c-88a6-504e6ae94dd1 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:43.057819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-5264ff25-e550-4c42-8afd-f92e02f42eb8 None None] MFA Rules not processed for user `7d4cd041ba884cedb08c70ea8083d027`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:43.059344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69d2a4-c63d-406c-88a6-504e6ae94dd1 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:43.061119 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5264ff25-e550-4c42-8afd-f92e02f42eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:43.066778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418310b6-650d-4384-8472-1fd95f3a3f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:43.067376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418310b6-650d-4384-8472-1fd95f3a3f70 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:43.068777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418310b6-650d-4384-8472-1fd95f3a3f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:43.068777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418310b6-650d-4384-8472-1fd95f3a3f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:43.069424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418310b6-650d-4384-8472-1fd95f3a3f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:43.071929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418310b6-650d-4384-8472-1fd95f3a3f70 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:43.090518 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3296/6542] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:43.091681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418310b6-650d-4384-8472-1fd95f3a3f70 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:43.109234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418310b6-650d-4384-8472-1fd95f3a3f70 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:43.118791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95b5ff-db15-4eaa-8b55-23282d69954c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:43.120010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95b5ff-db15-4eaa-8b55-23282d69954c admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:43.120377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95b5ff-db15-4eaa-8b55-23282d69954c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:43.120955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95b5ff-db15-4eaa-8b55-23282d69954c admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:43.121449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95b5ff-db15-4eaa-8b55-23282d69954c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:43.124507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95b5ff-db15-4eaa-8b55-23282d69954c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:43.135511 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:43.162079 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3297/6543] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:43.164445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95b5ff-db15-4eaa-8b55-23282d69954c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:43.194150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95b5ff-db15-4eaa-8b55-23282d69954c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:43.206211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38880324-d048-4b92-9ec9-3369a99690ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:43.207050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38880324-d048-4b92-9ec9-3369a99690ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:43.207394 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38880324-d048-4b92-9ec9-3369a99690ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:43.207737 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38880324-d048-4b92-9ec9-3369a99690ca admin admin] PATH_INFO: `/v3/projects/282683e7e9b64354b1c17db4e8cb5104/users/fee1bfd918e649daa820844403012329/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:43.235998 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3247/6544] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:43.239255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37f33f-b37d-4e6e-b2e8-eecf395db8a0 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:43.240151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37f33f-b37d-4e6e-b2e8-eecf395db8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:43.240151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37f33f-b37d-4e6e-b2e8-eecf395db8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:43.250496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38880324-d048-4b92-9ec9-3369a99690ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=282683e7e9b64354b1c17db4e8cb5104, user_id=fee1bfd918e649daa820844403012329, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:43.254238 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38880324-d048-4b92-9ec9-3369a99690ca admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:43.279795 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3298/6545] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:43 2022] PUT /identity/v3/projects/282683e7e9b64354b1c17db4e8cb5104/users/fee1bfd918e649daa820844403012329/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:43.290033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ea37f33f-b37d-4e6e-b2e8-eecf395db8a0 None None] MFA Rules not processed for user `7d4cd041ba884cedb08c70ea8083d027`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:43.292555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ea37f33f-b37d-4e6e-b2e8-eecf395db8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:43.304437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8492d97-91be-4203-a011-fa6a2d15cd27 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:43.306702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8492d97-91be-4203-a011-fa6a2d15cd27 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:43.307284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8492d97-91be-4203-a011-fa6a2d15cd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:43.371338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b8492d97-91be-4203-a011-fa6a2d15cd27 None None] MFA Rules not processed for user `fee1bfd918e649daa820844403012329`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:43.373733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b8492d97-91be-4203-a011-fa6a2d15cd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:43.409005 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3248/6546] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:43.422593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37f33f-b37d-4e6e-b2e8-eecf395db8a0 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:43.426685 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ea37f33f-b37d-4e6e-b2e8-eecf395db8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:43.459043 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:43.523646 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3299/6547] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:43.524660 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8492d97-91be-4203-a011-fa6a2d15cd27 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:43.555385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37f33f-b37d-4e6e-b2e8-eecf395db8a0 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:43.573309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f177964-9213-4fdd-9cf3-eb849b3a104d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:43.573988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f177964-9213-4fdd-9cf3-eb849b3a104d service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:43.574271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f177964-9213-4fdd-9cf3-eb849b3a104d service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:43.574541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f177964-9213-4fdd-9cf3-eb849b3a104d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:43.593910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f177964-9213-4fdd-9cf3-eb849b3a104d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:43.595508 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f177964-9213-4fdd-9cf3-eb849b3a104d service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:43.626909 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3249/6548] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:43.708867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8492d97-91be-4203-a011-fa6a2d15cd27 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:43.724490 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be910a-fb13-4a04-93fe-d2e23b75988b tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:43.726687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be910a-fb13-4a04-93fe-d2e23b75988b tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:43.727052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be910a-fb13-4a04-93fe-d2e23b75988b tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:43.727396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be910a-fb13-4a04-93fe-d2e23b75988b tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:43.728345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be910a-fb13-4a04-93fe-d2e23b75988b tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:43.733399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be910a-fb13-4a04-93fe-d2e23b75988b tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:43.781167 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3300/6549] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Aug 7 01:41:43 2022] POST /identity/v3/domains => generated 277 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:41:43.782590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f177964-9213-4fdd-9cf3-eb849b3a104d service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:43.814046 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f177964-9213-4fdd-9cf3-eb849b3a104d service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:43.942248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858db1a7-9d4d-46fe-8970-28006e846ce7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:43.942744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858db1a7-9d4d-46fe-8970-28006e846ce7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:43.942853 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858db1a7-9d4d-46fe-8970-28006e846ce7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:43.943087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858db1a7-9d4d-46fe-8970-28006e846ce7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:43.943771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858db1a7-9d4d-46fe-8970-28006e846ce7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:43.945423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858db1a7-9d4d-46fe-8970-28006e846ce7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:43.967310 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:43.992252 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3250/6550] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:41:43 2022] POST /identity/v3/roles => generated 239 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:43.992717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be910a-fb13-4a04-93fe-d2e23b75988b tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:44.019362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be910a-fb13-4a04-93fe-d2e23b75988b tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:44.029687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396612e-4e39-4342-8784-51c53721afd5 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:44.030516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396612e-4e39-4342-8784-51c53721afd5 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:44.030847 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396612e-4e39-4342-8784-51c53721afd5 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:44.031249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396612e-4e39-4342-8784-51c53721afd5 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/domains/37c45d9554e34798b41b7da35a409eb4/users/fee1bfd918e649daa820844403012329/roles/b463172ad39a463caf3a45210dade79b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:44.049482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396612e-4e39-4342-8784-51c53721afd5 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=37c45d9554e34798b41b7da35a409eb4, user_id=fee1bfd918e649daa820844403012329, role_id=b463172ad39a463caf3a45210dade79b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:44.054138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858db1a7-9d4d-46fe-8970-28006e846ce7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:44.056258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-858db1a7-9d4d-46fe-8970-28006e846ce7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:44.066524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396612e-4e39-4342-8784-51c53721afd5 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:44.088253 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3301/6551] 10.222.0.39 () {60 vars in 1480 bytes} [Sun Aug 7 01:41:43 2022] PUT /identity/v3/domains/37c45d9554e34798b41b7da35a409eb4/users/fee1bfd918e649daa820844403012329/roles/b463172ad39a463caf3a45210dade79b => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:41:44.091947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396612e-4e39-4342-8784-51c53721afd5 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:44.185286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858db1a7-9d4d-46fe-8970-28006e846ce7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:44.269862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396612e-4e39-4342-8784-51c53721afd5 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:44.278279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef95f9-d500-495b-8a0f-739febbaa62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:44.278944 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef95f9-d500-495b-8a0f-739febbaa62b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:44.279222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef95f9-d500-495b-8a0f-739febbaa62b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:44.279498 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef95f9-d500-495b-8a0f-739febbaa62b admin admin] PATH_INFO: `/v3/projects/bbdda533911b45c88549afbf7f9a071a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:44.280090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ac3a7-8c28-433c-9d8b-dc6b60960348 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:44.280942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef95f9-d500-495b-8a0f-739febbaa62b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbdda533911b45c88549afbf7f9a071a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:44.281502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ac3a7-8c28-433c-9d8b-dc6b60960348 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:44.282014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ac3a7-8c28-433c-9d8b-dc6b60960348 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:44.282480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ac3a7-8c28-433c-9d8b-dc6b60960348 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:44.282994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef95f9-d500-495b-8a0f-739febbaa62b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:44.284292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ac3a7-8c28-433c-9d8b-dc6b60960348 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:44.287417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ac3a7-8c28-433c-9d8b-dc6b60960348 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:44.315731 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3302/6552] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Aug 7 01:41:44 2022] POST /identity/v3/domains => generated 276 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:44.319918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ac3a7-8c28-433c-9d8b-dc6b60960348 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:44.360123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-93ef95f9-d500-495b-8a0f-739febbaa62b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbdda533911b45c88549afbf7f9a071a', 'request_id': 'req-93ef95f9-d500-495b-8a0f-739febbaa62b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:44.369277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-93ef95f9-d500-495b-8a0f-739febbaa62b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbdda533911b45c88549afbf7f9a071a', 'request_id': 'req-93ef95f9-d500-495b-8a0f-739febbaa62b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:44.380795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-93ef95f9-d500-495b-8a0f-739febbaa62b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbdda533911b45c88549afbf7f9a071a', 'request_id': 'req-93ef95f9-d500-495b-8a0f-739febbaa62b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:44.423643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-93ef95f9-d500-495b-8a0f-739febbaa62b admin admin] The token cache is being invalidate because project bbdda533911b45c88549afbf7f9a071a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:44.425977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-93ef95f9-d500-495b-8a0f-739febbaa62b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:44.432196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-93ef95f9-d500-495b-8a0f-739febbaa62b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:44.434209 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3251/6553] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:41:44 2022] DELETE /identity/v3/projects/bbdda533911b45c88549afbf7f9a071a => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:41:44.437928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef95f9-d500-495b-8a0f-739febbaa62b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:44.441024 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-93ef95f9-d500-495b-8a0f-739febbaa62b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:44.482119 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:44.542326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ac3a7-8c28-433c-9d8b-dc6b60960348 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:44.564061 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:44.618963 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef95f9-d500-495b-8a0f-739febbaa62b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:44.633235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f474ec-ea09-47c9-bded-101c7806c83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:44.633895 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f474ec-ea09-47c9-bded-101c7806c83f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:44.634423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f474ec-ea09-47c9-bded-101c7806c83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:44.634697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f474ec-ea09-47c9-bded-101c7806c83f admin admin] PATH_INFO: `/v3/users/657de75fcb7849bd8cff41d88c1781be` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:44.638007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f474ec-ea09-47c9-bded-101c7806c83f admin admin] RBAC: Authorizing `identity:delete_user(user_id=657de75fcb7849bd8cff41d88c1781be)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:44.640010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f474ec-ea09-47c9-bded-101c7806c83f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:44.684211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba4800-2913-4ba5-a26c-0f0b6b145bee tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:44.685475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba4800-2913-4ba5-a26c-0f0b6b145bee tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:44.685475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba4800-2913-4ba5-a26c-0f0b6b145bee tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:44.685676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba4800-2913-4ba5-a26c-0f0b6b145bee tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:44.686509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba4800-2913-4ba5-a26c-0f0b6b145bee tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:44.688248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba4800-2913-4ba5-a26c-0f0b6b145bee tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:44.723680 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3303/6554] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:41:44 2022] POST /identity/v3/roles => generated 239 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:41:44.725733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba4800-2913-4ba5-a26c-0f0b6b145bee tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:44.727781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dcba4800-2913-4ba5-a26c-0f0b6b145bee tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:44.742391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-22f474ec-ea09-47c9-bded-101c7806c83f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '657de75fcb7849bd8cff41d88c1781be'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:44.751583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba4800-2913-4ba5-a26c-0f0b6b145bee tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:44.751926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-22f474ec-ea09-47c9-bded-101c7806c83f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '657de75fcb7849bd8cff41d88c1781be'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:44.766056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c95c54-5250-4957-bc0b-bd0d28300758 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:44.766801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c95c54-5250-4957-bc0b-bd0d28300758 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:44.768605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c95c54-5250-4957-bc0b-bd0d28300758 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:44.770073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c95c54-5250-4957-bc0b-bd0d28300758 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/groups` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:44.770332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-22f474ec-ea09-47c9-bded-101c7806c83f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '657de75fcb7849bd8cff41d88c1781be'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:44.770883 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c95c54-5250-4957-bc0b-bd0d28300758 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:44.771149 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-22f474ec-ea09-47c9-bded-101c7806c83f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '657de75fcb7849bd8cff41d88c1781be'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:44.776088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c95c54-5250-4957-bc0b-bd0d28300758 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:44.782697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-22f474ec-ea09-47c9-bded-101c7806c83f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '657de75fcb7849bd8cff41d88c1781be'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:44.801894 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3252/6555] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:41:44 2022] DELETE /identity/v3/users/657de75fcb7849bd8cff41d88c1781be => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:41:44.851280 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3304/6556] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:41:44 2022] POST /identity/v3/groups => generated 326 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:44.855613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f474ec-ea09-47c9-bded-101c7806c83f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:44.860929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-22f474ec-ea09-47c9-bded-101c7806c83f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:44.949898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c95c54-5250-4957-bc0b-bd0d28300758 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:44.952194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-22c95c54-5250-4957-bc0b-bd0d28300758 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:45.087457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f474ec-ea09-47c9-bded-101c7806c83f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:45.102639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f06471-f9c6-4f2e-b592-29a4c7e7e0d0 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:45.103327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f06471-f9c6-4f2e-b592-29a4c7e7e0d0 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:45.103606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f06471-f9c6-4f2e-b592-29a4c7e7e0d0 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:45.103901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f06471-f9c6-4f2e-b592-29a4c7e7e0d0 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/groups/acddcd0baf3548098403d28ef5c94cb1/users/fee1bfd918e649daa820844403012329` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:45.125027 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c95c54-5250-4957-bc0b-bd0d28300758 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:45.128655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f06471-f9c6-4f2e-b592-29a4c7e7e0d0 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=acddcd0baf3548098403d28ef5c94cb1, user_id=fee1bfd918e649daa820844403012329)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:45.130671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f06471-f9c6-4f2e-b592-29a4c7e7e0d0 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:45.193498 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3253/6557] 10.222.0.39 () {60 vars in 1360 bytes} [Sun Aug 7 01:41:44 2022] PUT /identity/v3/groups/acddcd0baf3548098403d28ef5c94cb1/users/fee1bfd918e649daa820844403012329 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:45.198670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f06471-f9c6-4f2e-b592-29a4c7e7e0d0 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:45.269597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5b054-d8bf-4052-b206-836ba7889a65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:45.270409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5b054-d8bf-4052-b206-836ba7889a65 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:45.271839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5b054-d8bf-4052-b206-836ba7889a65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:45.272541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5b054-d8bf-4052-b206-836ba7889a65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:45.278595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9bd5b054-d8bf-4052-b206-836ba7889a65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:45.315476 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:45.365387 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:45.389728 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f06471-f9c6-4f2e-b592-29a4c7e7e0d0 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:45.403826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c5f75-e4b1-428d-8357-d12063bc1a28 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:45.409623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c5f75-e4b1-428d-8357-d12063bc1a28 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:45.409807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c5f75-e4b1-428d-8357-d12063bc1a28 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:45.410187 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c5f75-e4b1-428d-8357-d12063bc1a28 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/domains/ac75d2559ffa47c3b4a033386e917c80/groups/acddcd0baf3548098403d28ef5c94cb1/roles/fcf28c4854464f29b8c12f1f7a6d3084` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:45.419513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c5f75-e4b1-428d-8357-d12063bc1a28 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=ac75d2559ffa47c3b4a033386e917c80, group_id=acddcd0baf3548098403d28ef5c94cb1, role_id=fcf28c4854464f29b8c12f1f7a6d3084)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:45.423496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c5f75-e4b1-428d-8357-d12063bc1a28 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:45.443215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5b054-d8bf-4052-b206-836ba7889a65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:45.444912 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5b054-d8bf-4052-b206-836ba7889a65 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:45.446011 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3254/6558] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:45 2022] PUT /identity/v3/domains/ac75d2559ffa47c3b4a033386e917c80/groups/acddcd0baf3548098403d28ef5c94cb1/roles/fcf28c4854464f29b8c12f1f7a6d3084 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:45.451935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c5f75-e4b1-428d-8357-d12063bc1a28 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:45.488569 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3305/6559] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:45.492418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5b054-d8bf-4052-b206-836ba7889a65 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:45.495555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9bd5b054-d8bf-4052-b206-836ba7889a65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:45.592333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c5f75-e4b1-428d-8357-d12063bc1a28 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:45.600935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa4b26-f34c-4f19-965e-74f727c77acb tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:45.601853 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa4b26-f34c-4f19-965e-74f727c77acb tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:45.602229 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa4b26-f34c-4f19-965e-74f727c77acb tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:45.602558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa4b26-f34c-4f19-965e-74f727c77acb tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:45.603634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa4b26-f34c-4f19-965e-74f727c77acb tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:45.605931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa4b26-f34c-4f19-965e-74f727c77acb tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:45.658972 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3255/6560] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Aug 7 01:41:45 2022] POST /identity/v3/domains => generated 277 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:45.666042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa4b26-f34c-4f19-965e-74f727c77acb tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:45.675805 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5b054-d8bf-4052-b206-836ba7889a65 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:45.800173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286fd508-f29e-42fd-aa1c-e51b4c064459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:45.801170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fd508-f29e-42fd-aa1c-e51b4c064459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:45.801821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fd508-f29e-42fd-aa1c-e51b4c064459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:45.802669 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fd508-f29e-42fd-aa1c-e51b4c064459 admin admin] PATH_INFO: `/v3/projects/49615a704bb441ba9bb78d1f476c9561` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:45.803909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286fd508-f29e-42fd-aa1c-e51b4c064459 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49615a704bb441ba9bb78d1f476c9561)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:45.807822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286fd508-f29e-42fd-aa1c-e51b4c064459 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:45.839311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa4b26-f34c-4f19-965e-74f727c77acb tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:45.845473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67483802-c822-4d0f-8373-c5287adc71d4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:45.846644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67483802-c822-4d0f-8373-c5287adc71d4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:45.847457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67483802-c822-4d0f-8373-c5287adc71d4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:45.847457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67483802-c822-4d0f-8373-c5287adc71d4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:45.847850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67483802-c822-4d0f-8373-c5287adc71d4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:45.849510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67483802-c822-4d0f-8373-c5287adc71d4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:45.871333 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3256/6561] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:41:45 2022] POST /identity/v3/roles => generated 239 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:45.874500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67483802-c822-4d0f-8373-c5287adc71d4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:45.886698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67483802-c822-4d0f-8373-c5287adc71d4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:45.905829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-286fd508-f29e-42fd-aa1c-e51b4c064459 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49615a704bb441ba9bb78d1f476c9561', 'request_id': 'req-286fd508-f29e-42fd-aa1c-e51b4c064459'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:45.918353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-286fd508-f29e-42fd-aa1c-e51b4c064459 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49615a704bb441ba9bb78d1f476c9561', 'request_id': 'req-286fd508-f29e-42fd-aa1c-e51b4c064459'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:45.928218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-286fd508-f29e-42fd-aa1c-e51b4c064459 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49615a704bb441ba9bb78d1f476c9561', 'request_id': 'req-286fd508-f29e-42fd-aa1c-e51b4c064459'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:45.947445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-286fd508-f29e-42fd-aa1c-e51b4c064459 admin admin] The token cache is being invalidate because project 49615a704bb441ba9bb78d1f476c9561 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:45.947691 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-286fd508-f29e-42fd-aa1c-e51b4c064459 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:45.948520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-286fd508-f29e-42fd-aa1c-e51b4c064459 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:45.950445 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3306/6562] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:41:45 2022] DELETE /identity/v3/projects/49615a704bb441ba9bb78d1f476c9561 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:45.955291 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c9382-5d70-4c94-8a39-61a7c2729d2a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:45.955731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c9382-5d70-4c94-8a39-61a7c2729d2a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:45.956144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c9382-5d70-4c94-8a39-61a7c2729d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:45.985538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ccdae-f02f-45d6-bcda-a77d94f494f9 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:45.986466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ccdae-f02f-45d6-bcda-a77d94f494f9 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:45.987268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ccdae-f02f-45d6-bcda-a77d94f494f9 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:45.987569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ccdae-f02f-45d6-bcda-a77d94f494f9 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/domains/f13e4e6e91794c1d8c9092d2b1cdd96a/users/fee1bfd918e649daa820844403012329/roles/f6d35692f60641c09c3884b6f5ae8fec` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:45.989919 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:46.005615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ccdae-f02f-45d6-bcda-a77d94f494f9 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=f13e4e6e91794c1d8c9092d2b1cdd96a, user_id=fee1bfd918e649daa820844403012329, role_id=f6d35692f60641c09c3884b6f5ae8fec)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:46.008783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ccdae-f02f-45d6-bcda-a77d94f494f9 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:46.014115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-007c9382-5d70-4c94-8a39-61a7c2729d2a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:46.015389 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-007c9382-5d70-4c94-8a39-61a7c2729d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:46.029423 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3257/6563] 10.222.0.39 () {60 vars in 1480 bytes} [Sun Aug 7 01:41:45 2022] PUT /identity/v3/domains/f13e4e6e91794c1d8c9092d2b1cdd96a/users/fee1bfd918e649daa820844403012329/roles/f6d35692f60641c09c3884b6f5ae8fec => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:46.034632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ccdae-f02f-45d6-bcda-a77d94f494f9 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:46.035194 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:46.036844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d23ccdae-f02f-45d6-bcda-a77d94f494f9 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:46.152807 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3307/6564] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:46.161409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f4169-900f-41e5-ba75-f05e94dd8c62 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:46.161752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f4169-900f-41e5-ba75-f05e94dd8c62 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:46.162035 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f4169-900f-41e5-ba75-f05e94dd8c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:46.208664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ea7f4169-900f-41e5-ba75-f05e94dd8c62 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:46.208664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ea7f4169-900f-41e5-ba75-f05e94dd8c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:46.223699 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3308/6565] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:46.243189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f4169-900f-41e5-ba75-f05e94dd8c62 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:46.267950 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f4169-900f-41e5-ba75-f05e94dd8c62 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:46.282721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ccdae-f02f-45d6-bcda-a77d94f494f9 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:46.283438 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed30450-317d-495f-9d44-cb53f4bbcc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:46.284222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed30450-317d-495f-9d44-cb53f4bbcc06 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:46.284663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed30450-317d-495f-9d44-cb53f4bbcc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:46.285084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed30450-317d-495f-9d44-cb53f4bbcc06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:46.285997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed30450-317d-495f-9d44-cb53f4bbcc06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:41:46.288245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed30450-317d-495f-9d44-cb53f4bbcc06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:46.289998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec3073-302b-4151-ae6a-8f5b64b68a32 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:46.290149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed30450-317d-495f-9d44-cb53f4bbcc06 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:46.290684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec3073-302b-4151-ae6a-8f5b64b68a32 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:46.291473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec3073-302b-4151-ae6a-8f5b64b68a32 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:46.292172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec3073-302b-4151-ae6a-8f5b64b68a32 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:46.292917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec3073-302b-4151-ae6a-8f5b64b68a32 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:46.294590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec3073-302b-4151-ae6a-8f5b64b68a32 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:46.325086 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3309/6566] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:46.333441 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed30450-317d-495f-9d44-cb53f4bbcc06 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:46.340469 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3258/6567] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Aug 7 01:41:46 2022] POST /identity/v3/domains => generated 274 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:46.348502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec3073-302b-4151-ae6a-8f5b64b68a32 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:46.369688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed30450-317d-495f-9d44-cb53f4bbcc06 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:46.494869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec3073-302b-4151-ae6a-8f5b64b68a32 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:46.501905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578f521-897c-4eeb-bf6d-5742f743b69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:46.502818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d219c-198f-4ca5-8bd4-3e6110210702 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:46.502955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578f521-897c-4eeb-bf6d-5742f743b69c admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:46.503102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578f521-897c-4eeb-bf6d-5742f743b69c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:46.503511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d219c-198f-4ca5-8bd4-3e6110210702 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:46.503647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578f521-897c-4eeb-bf6d-5742f743b69c admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:46.503788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d219c-198f-4ca5-8bd4-3e6110210702 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:46.504099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d219c-198f-4ca5-8bd4-3e6110210702 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:46.504548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e578f521-897c-4eeb-bf6d-5742f743b69c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:46.507909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d219c-198f-4ca5-8bd4-3e6110210702 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:46.507909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528d219c-198f-4ca5-8bd4-3e6110210702 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:46.508184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e578f521-897c-4eeb-bf6d-5742f743b69c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:46.528878 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3259/6568] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:41:46 2022] POST /identity/v3/roles => generated 240 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:41:46.532937 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d219c-198f-4ca5-8bd4-3e6110210702 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:46.546646 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d219c-198f-4ca5-8bd4-3e6110210702 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:46.547442 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3310/6569] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:46 2022] POST /identity/v3/projects => generated 381 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:46.550675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578f521-897c-4eeb-bf6d-5742f743b69c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:46.630096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa5fd7-f028-49ce-8bb4-ebbec8762889 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:46.630682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa5fd7-f028-49ce-8bb4-ebbec8762889 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:46.630971 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa5fd7-f028-49ce-8bb4-ebbec8762889 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:46.631301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa5fd7-f028-49ce-8bb4-ebbec8762889 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/groups` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:46.632442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa5fd7-f028-49ce-8bb4-ebbec8762889 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:46.635126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa5fd7-f028-49ce-8bb4-ebbec8762889 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:46.639216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578f521-897c-4eeb-bf6d-5742f743b69c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:46.647246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ec8d8-96b7-4c4f-948f-731175254be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:46.648344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ec8d8-96b7-4c4f-948f-731175254be6 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:46.648849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ec8d8-96b7-4c4f-948f-731175254be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:46.649334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ec8d8-96b7-4c4f-948f-731175254be6 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:46.650311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ec8d8-96b7-4c4f-948f-731175254be6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:46.653687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ec8d8-96b7-4c4f-948f-731175254be6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:46.665913 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:46.678437 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3260/6570] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:41:46 2022] POST /identity/v3/groups => generated 326 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:41:46.682365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa5fd7-f028-49ce-8bb4-ebbec8762889 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:46.687252 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3311/6571] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:41:46 2022] POST /identity/v3/users => generated 291 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:41:46.688920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ec8d8-96b7-4c4f-948f-731175254be6 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:46.699071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa5fd7-f028-49ce-8bb4-ebbec8762889 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:46.706276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc31f01-f70d-42a5-bfed-80787cbb4245 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:46.707099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc31f01-f70d-42a5-bfed-80787cbb4245 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:46.707485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc31f01-f70d-42a5-bfed-80787cbb4245 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:46.707972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc31f01-f70d-42a5-bfed-80787cbb4245 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/groups/56e34f51276e4686a2cc8568af42226c/users/fee1bfd918e649daa820844403012329` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:46.716060 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc31f01-f70d-42a5-bfed-80787cbb4245 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=56e34f51276e4686a2cc8568af42226c, user_id=fee1bfd918e649daa820844403012329)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:46.718458 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc31f01-f70d-42a5-bfed-80787cbb4245 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:46.736433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ec8d8-96b7-4c4f-948f-731175254be6 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:46.752794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1553b2-08c8-438f-864d-8ddb30f1e9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:46.753879 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1553b2-08c8-438f-864d-8ddb30f1e9ce admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:46.754171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1553b2-08c8-438f-864d-8ddb30f1e9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:46.756903 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1553b2-08c8-438f-864d-8ddb30f1e9ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:46.757964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1553b2-08c8-438f-864d-8ddb30f1e9ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:46.762969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1553b2-08c8-438f-864d-8ddb30f1e9ce admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:46.765722 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:46.788618 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3261/6572] 10.222.0.39 () {60 vars in 1360 bytes} [Sun Aug 7 01:41:46 2022] PUT /identity/v3/groups/56e34f51276e4686a2cc8568af42226c/users/fee1bfd918e649daa820844403012329 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:46.790909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc31f01-f70d-42a5-bfed-80787cbb4245 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:46.804582 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3312/6573] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:46 2022] GET /identity/v3/roles => generated 2341 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:46.808392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1553b2-08c8-438f-864d-8ddb30f1e9ce admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:46.837528 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1553b2-08c8-438f-864d-8ddb30f1e9ce admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:46.916129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc31f01-f70d-42a5-bfed-80787cbb4245 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:46.929691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd54ad2-f2f1-43a2-9a06-629be5e36320 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:46.930709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd54ad2-f2f1-43a2-9a06-629be5e36320 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:46.934523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd54ad2-f2f1-43a2-9a06-629be5e36320 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:46.934708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd54ad2-f2f1-43a2-9a06-629be5e36320 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/domains/b70b56f1e3994ed09a1c78cd801a6e2f/groups/56e34f51276e4686a2cc8568af42226c/roles/608f13fd70a2473b98128888b1f5109c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:46.939531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd54ad2-f2f1-43a2-9a06-629be5e36320 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=b70b56f1e3994ed09a1c78cd801a6e2f, group_id=56e34f51276e4686a2cc8568af42226c, role_id=608f13fd70a2473b98128888b1f5109c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:46.942641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b072a-00f9-4d0b-807e-e25d95afb85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:46.943412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b072a-00f9-4d0b-807e-e25d95afb85a admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:46.943697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b072a-00f9-4d0b-807e-e25d95afb85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:46.945665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b072a-00f9-4d0b-807e-e25d95afb85a admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:46.946338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b072a-00f9-4d0b-807e-e25d95afb85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:46.947763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd54ad2-f2f1-43a2-9a06-629be5e36320 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:46.950843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b072a-00f9-4d0b-807e-e25d95afb85a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:46.965219 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3313/6574] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:46 2022] GET /identity/v3/roles => generated 2341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:46.969382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b072a-00f9-4d0b-807e-e25d95afb85a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:46.971688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-054b072a-00f9-4d0b-807e-e25d95afb85a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:46.989922 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3262/6575] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:46 2022] PUT /identity/v3/domains/b70b56f1e3994ed09a1c78cd801a6e2f/groups/56e34f51276e4686a2cc8568af42226c/roles/608f13fd70a2473b98128888b1f5109c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:46.991047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd54ad2-f2f1-43a2-9a06-629be5e36320 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:47.062465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b072a-00f9-4d0b-807e-e25d95afb85a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:47.068210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd54ad2-f2f1-43a2-9a06-629be5e36320 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:47.074548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62f5ee-2890-43ef-9a55-2578e93f1493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:47.075358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62f5ee-2890-43ef-9a55-2578e93f1493 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:47.075831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62f5ee-2890-43ef-9a55-2578e93f1493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:47.076267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62f5ee-2890-43ef-9a55-2578e93f1493 admin admin] PATH_INFO: `/v3/projects/5964193f4f9c4ccdb2258e8dc72f8dd7/users/8fc8b91614c74a258c8e0d95db5e2033/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:47.094737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62f5ee-2890-43ef-9a55-2578e93f1493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5964193f4f9c4ccdb2258e8dc72f8dd7, user_id=8fc8b91614c74a258c8e0d95db5e2033, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:47.098501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62f5ee-2890-43ef-9a55-2578e93f1493 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:47.119826 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3263/6576] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:46 2022] PUT /identity/v3/projects/5964193f4f9c4ccdb2258e8dc72f8dd7/users/8fc8b91614c74a258c8e0d95db5e2033/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:47.130181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62f5ee-2890-43ef-9a55-2578e93f1493 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:47.130181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ae62f5ee-2890-43ef-9a55-2578e93f1493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:47.161849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a6e6f-3cc5-4caf-aeee-f4839319fcf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:47.161849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a6e6f-3cc5-4caf-aeee-f4839319fcf7 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:47.161849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a6e6f-3cc5-4caf-aeee-f4839319fcf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:47.161849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a6e6f-3cc5-4caf-aeee-f4839319fcf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:47.163299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-527a6e6f-3cc5-4caf-aeee-f4839319fcf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:47.178116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a6e6f-3cc5-4caf-aeee-f4839319fcf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:47.179664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a6e6f-3cc5-4caf-aeee-f4839319fcf7 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:47.194241 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3314/6577] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:47.196166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ad693-d8bc-4618-bc41-73e299b2aea9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:47.196499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ad693-d8bc-4618-bc41-73e299b2aea9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:47.196890 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ad693-d8bc-4618-bc41-73e299b2aea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:47.236971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-cf9ad693-d8bc-4618-bc41-73e299b2aea9 None None] MFA Rules not processed for user `8fc8b91614c74a258c8e0d95db5e2033`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:47.238659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-cf9ad693-d8bc-4618-bc41-73e299b2aea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:47.246159 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:47.303108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62f5ee-2890-43ef-9a55-2578e93f1493 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:47.308818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3a381-9f84-467f-91a6-9aa44476f2a7 tempest-TokensV3TestJSON-1550782372 tempest-TokensV3TestJSON-1550782372-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fee1bfd918e649daa820844403012329', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '282683e7e9b64354b1c17db4e8cb5104', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:47.310078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3a381-9f84-467f-91a6-9aa44476f2a7 tempest-TokensV3TestJSON-1550782372 tempest-TokensV3TestJSON-1550782372-project] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:47.311327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3a381-9f84-467f-91a6-9aa44476f2a7 tempest-TokensV3TestJSON-1550782372 tempest-TokensV3TestJSON-1550782372-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:47.311776 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3a381-9f84-467f-91a6-9aa44476f2a7 tempest-TokensV3TestJSON-1550782372 tempest-TokensV3TestJSON-1550782372-project] PATH_INFO: `/v3/auth/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:47.313215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3a381-9f84-467f-91a6-9aa44476f2a7 tempest-TokensV3TestJSON-1550782372 tempest-TokensV3TestJSON-1550782372-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:47.315172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3a381-9f84-467f-91a6-9aa44476f2a7 tempest-TokensV3TestJSON-1550782372 tempest-TokensV3TestJSON-1550782372-project] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:47.327948 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:47.377758 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3315/6578] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:47.378836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ad693-d8bc-4618-bc41-73e299b2aea9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:47.380219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-cf9ad693-d8bc-4618-bc41-73e299b2aea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:47.456175 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3264/6579] 10.222.0.39 () {58 vars in 1143 bytes} [Sun Aug 7 01:41:47 2022] GET /identity/v3/auth/domains => generated 1172 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:47.456175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3a381-9f84-467f-91a6-9aa44476f2a7 tempest-TokensV3TestJSON-1550782372 tempest-TokensV3TestJSON-1550782372-project] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:47.539701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3a381-9f84-467f-91a6-9aa44476f2a7 tempest-TokensV3TestJSON-1550782372 tempest-TokensV3TestJSON-1550782372-project] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:47.547350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3fa44-98c5-4b45-8c9c-5165ea13cb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:47.547955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3fa44-98c5-4b45-8c9c-5165ea13cb77 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:47.548426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3fa44-98c5-4b45-8c9c-5165ea13cb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:47.548765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f3fa44-98c5-4b45-8c9c-5165ea13cb77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:47.550256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3fa44-98c5-4b45-8c9c-5165ea13cb77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:47.552757 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f3fa44-98c5-4b45-8c9c-5165ea13cb77 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:47.554010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ad693-d8bc-4618-bc41-73e299b2aea9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:47.560086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745b925-e4a0-4d78-978e-f9fa36b18f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:47.560746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745b925-e4a0-4d78-978e-f9fa36b18f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:47.561025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745b925-e4a0-4d78-978e-f9fa36b18f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:47.561299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745b925-e4a0-4d78-978e-f9fa36b18f17 admin admin] PATH_INFO: `/v3/users/b5ee7570205749f29f70607e8a3b29fa` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:47.564636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745b925-e4a0-4d78-978e-f9fa36b18f17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5ee7570205749f29f70607e8a3b29fa)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:47.566575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745b925-e4a0-4d78-978e-f9fa36b18f17 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:47.629567 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3265/6580] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:47 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:47.629567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3fa44-98c5-4b45-8c9c-5165ea13cb77 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:47.665293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f745b925-e4a0-4d78-978e-f9fa36b18f17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5ee7570205749f29f70607e8a3b29fa'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:47.675735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f745b925-e4a0-4d78-978e-f9fa36b18f17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5ee7570205749f29f70607e8a3b29fa'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:47.690042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f745b925-e4a0-4d78-978e-f9fa36b18f17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5ee7570205749f29f70607e8a3b29fa'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:47.690739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f745b925-e4a0-4d78-978e-f9fa36b18f17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5ee7570205749f29f70607e8a3b29fa'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:47.713197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f745b925-e4a0-4d78-978e-f9fa36b18f17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5ee7570205749f29f70607e8a3b29fa'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:47.727149 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:47.732515 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3316/6581] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:41:47 2022] DELETE /identity/v3/users/b5ee7570205749f29f70607e8a3b29fa => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:47.732515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745b925-e4a0-4d78-978e-f9fa36b18f17 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:47.736688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f745b925-e4a0-4d78-978e-f9fa36b18f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:47.750532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f3fa44-98c5-4b45-8c9c-5165ea13cb77 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:47.853375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61377759-0585-4cee-bced-5cc5b98bbad1 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:47.854276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61377759-0585-4cee-bced-5cc5b98bbad1 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:47.854849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61377759-0585-4cee-bced-5cc5b98bbad1 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:47.855019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61377759-0585-4cee-bced-5cc5b98bbad1 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/domains/b70b56f1e3994ed09a1c78cd801a6e2f/groups/56e34f51276e4686a2cc8568af42226c/roles/608f13fd70a2473b98128888b1f5109c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:47.857499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61377759-0585-4cee-bced-5cc5b98bbad1 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=b70b56f1e3994ed09a1c78cd801a6e2f, group_id=56e34f51276e4686a2cc8568af42226c, role_id=608f13fd70a2473b98128888b1f5109c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:47.861072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61377759-0585-4cee-bced-5cc5b98bbad1 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:47.873260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745b925-e4a0-4d78-978e-f9fa36b18f17 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:47.877907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-61377759-0585-4cee-bced-5cc5b98bbad1 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invalidating the token cache because role 608f13fd70a2473b98128888b1f5109c was removed from group 56e34f51276e4686a2cc8568af42226c on domain b70b56f1e3994ed09a1c78cd801a6e2f. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:47.878813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-61377759-0585-4cee-bced-5cc5b98bbad1 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:47.879788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-61377759-0585-4cee-bced-5cc5b98bbad1 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:47.884424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cad08-e113-4f90-a21f-c6933082ba71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:47.885769 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cad08-e113-4f90-a21f-c6933082ba71 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:47.886341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cad08-e113-4f90-a21f-c6933082ba71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:47.886845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cad08-e113-4f90-a21f-c6933082ba71 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:47.888391 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60cad08-e113-4f90-a21f-c6933082ba71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:47.891553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60cad08-e113-4f90-a21f-c6933082ba71 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:47.900530 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3266/6582] 10.222.0.39 () {58 vars in 1467 bytes} [Sun Aug 7 01:41:47 2022] DELETE /identity/v3/domains/b70b56f1e3994ed09a1c78cd801a6e2f/groups/56e34f51276e4686a2cc8568af42226c/roles/608f13fd70a2473b98128888b1f5109c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:47.902509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ba7f6-d7c1-4691-a2fd-ad0f7ddde7da None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:47.903070 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ba7f6-d7c1-4691-a2fd-ad0f7ddde7da None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:47.903809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ba7f6-d7c1-4691-a2fd-ad0f7ddde7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:47.906217 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:47.931736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1d6ba7f6-d7c1-4691-a2fd-ad0f7ddde7da None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:47.935048 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3317/6583] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:41:47 2022] POST /identity/v3/users => generated 296 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:47.935048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cad08-e113-4f90-a21f-c6933082ba71 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:47.937036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f60cad08-e113-4f90-a21f-c6933082ba71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:47.937690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1d6ba7f6-d7c1-4691-a2fd-ad0f7ddde7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:47.956530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cad08-e113-4f90-a21f-c6933082ba71 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:48.012512 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3267/6584] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:48.013835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ba7f6-d7c1-4691-a2fd-ad0f7ddde7da None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:48.015519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1d6ba7f6-d7c1-4691-a2fd-ad0f7ddde7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:48.029516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ba7f6-d7c1-4691-a2fd-ad0f7ddde7da None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:48.036233 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6fd4b-b351-4157-abbb-25c13a6b440d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:48.037162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6fd4b-b351-4157-abbb-25c13a6b440d admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:48.038279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6fd4b-b351-4157-abbb-25c13a6b440d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:48.038787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6fd4b-b351-4157-abbb-25c13a6b440d admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:48.039657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6fd4b-b351-4157-abbb-25c13a6b440d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:48.041773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6fd4b-b351-4157-abbb-25c13a6b440d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:48.053955 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3268/6585] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:48 2022] GET /identity/v3/roles => generated 2341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:48.055238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6fd4b-b351-4157-abbb-25c13a6b440d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:48.057357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-daf6fd4b-b351-4157-abbb-25c13a6b440d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:48.078023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a060a-f3e1-4d5f-844e-6ef8cf8c24b3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:48.078690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a060a-f3e1-4d5f-844e-6ef8cf8c24b3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:48.078966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a060a-f3e1-4d5f-844e-6ef8cf8c24b3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:48.079237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a060a-f3e1-4d5f-844e-6ef8cf8c24b3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/groups/56e34f51276e4686a2cc8568af42226c/users/fee1bfd918e649daa820844403012329` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:48.081834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a060a-f3e1-4d5f-844e-6ef8cf8c24b3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=56e34f51276e4686a2cc8568af42226c, user_id=fee1bfd918e649daa820844403012329)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:48.083938 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a060a-f3e1-4d5f-844e-6ef8cf8c24b3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:48.094607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-283a060a-f3e1-4d5f-844e-6ef8cf8c24b3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'fee1bfd918e649daa820844403012329'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:48.119764 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3318/6586] 10.222.0.39 () {58 vars in 1344 bytes} [Sun Aug 7 01:41:47 2022] DELETE /identity/v3/groups/56e34f51276e4686a2cc8568af42226c/users/fee1bfd918e649daa820844403012329 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:48.119764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a060a-f3e1-4d5f-844e-6ef8cf8c24b3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:48.172364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6fd4b-b351-4157-abbb-25c13a6b440d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:48.222463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a060a-f3e1-4d5f-844e-6ef8cf8c24b3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:48.228250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b6eb4-64ba-4561-ad84-0bd01815a6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:48.228852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b6eb4-64ba-4561-ad84-0bd01815a6fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:48.229131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b6eb4-64ba-4561-ad84-0bd01815a6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:48.229404 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b6eb4-64ba-4561-ad84-0bd01815a6fa admin admin] PATH_INFO: `/v3/projects/18d589b917ad42a88d3132d3669c6d59/users/5640c9bab43a4877920c02250bf94445/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:48.242475 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:48.284354 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b6eb4-64ba-4561-ad84-0bd01815a6fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=18d589b917ad42a88d3132d3669c6d59, user_id=5640c9bab43a4877920c02250bf94445, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:48.285360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8287d86-5a23-41cb-9ed6-34d64c5d0973 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:48.286185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8287d86-5a23-41cb-9ed6-34d64c5d0973 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:48.286645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8287d86-5a23-41cb-9ed6-34d64c5d0973 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:48.287117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8287d86-5a23-41cb-9ed6-34d64c5d0973 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:48.287228 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b6eb4-64ba-4561-ad84-0bd01815a6fa admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:48.304398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8287d86-5a23-41cb-9ed6-34d64c5d0973 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:48.307019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8287d86-5a23-41cb-9ed6-34d64c5d0973 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:48.322119 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3269/6587] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:48.323849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8287d86-5a23-41cb-9ed6-34d64c5d0973 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:48.338125 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3319/6588] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:48 2022] PUT /identity/v3/projects/18d589b917ad42a88d3132d3669c6d59/users/5640c9bab43a4877920c02250bf94445/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:48.344771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b6eb4-64ba-4561-ad84-0bd01815a6fa admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:48.441228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8287d86-5a23-41cb-9ed6-34d64c5d0973 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:48.488795 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:INSERT=5,keystone:SELECT=93,keystone:DELETE=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:48.499202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b6eb4-64ba-4561-ad84-0bd01815a6fa admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:48.508994 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b4695-9b45-42e3-8082-38f3f39a97c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:48.510459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b4695-9b45-42e3-8082-38f3f39a97c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:48.510896 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b4695-9b45-42e3-8082-38f3f39a97c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:48.511379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b4695-9b45-42e3-8082-38f3f39a97c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:48.512903 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b4695-9b45-42e3-8082-38f3f39a97c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:48.516689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b4695-9b45-42e3-8082-38f3f39a97c0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:48.540777 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc65797-1360-446f-af7b-3aaa14dbf96e tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:48.541432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc65797-1360-446f-af7b-3aaa14dbf96e tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:48.541857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc65797-1360-446f-af7b-3aaa14dbf96e tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:48.542136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc65797-1360-446f-af7b-3aaa14dbf96e tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/groups/56e34f51276e4686a2cc8568af42226c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:48.544121 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3320/6589] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:48 2022] GET /identity/v3/roles => generated 2341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:48.544487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc65797-1360-446f-af7b-3aaa14dbf96e tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:delete_group(group_id=56e34f51276e4686a2cc8568af42226c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:48.545075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b4695-9b45-42e3-8082-38f3f39a97c0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:48.548552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc65797-1360-446f-af7b-3aaa14dbf96e tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:48.578653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b4695-9b45-42e3-8082-38f3f39a97c0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:48.585470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95873712-06ee-48b5-b21c-5b0f1c0ca88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:48.586391 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95873712-06ee-48b5-b21c-5b0f1c0ca88d admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:48.586684 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95873712-06ee-48b5-b21c-5b0f1c0ca88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:48.588430 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95873712-06ee-48b5-b21c-5b0f1c0ca88d admin admin] PATH_INFO: `/v3/projects/18d589b917ad42a88d3132d3669c6d59/users/5640c9bab43a4877920c02250bf94445/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:48.592371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95873712-06ee-48b5-b21c-5b0f1c0ca88d admin admin] RBAC: Authorizing `identity:create_grant(project_id=18d589b917ad42a88d3132d3669c6d59, user_id=5640c9bab43a4877920c02250bf94445, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:48.596918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95873712-06ee-48b5-b21c-5b0f1c0ca88d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:48.623715 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3321/6590] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:48 2022] PUT /identity/v3/projects/18d589b917ad42a88d3132d3669c6d59/users/5640c9bab43a4877920c02250bf94445/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:48.628670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c3af6-d0a3-424a-b574-d57002850bfd None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:48.629814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c3af6-d0a3-424a-b574-d57002850bfd None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:48.630150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c3af6-d0a3-424a-b574-d57002850bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:48.659425 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3270/6591] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Aug 7 01:41:48 2022] DELETE /identity/v3/groups/56e34f51276e4686a2cc8568af42226c => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:48.664028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc65797-1360-446f-af7b-3aaa14dbf96e tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:48.733735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-be4c3af6-d0a3-424a-b574-d57002850bfd None None] MFA Rules not processed for user `5640c9bab43a4877920c02250bf94445`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:48.740513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-be4c3af6-d0a3-424a-b574-d57002850bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:48.778671 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:48.843478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc65797-1360-446f-af7b-3aaa14dbf96e tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:48.857805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1038e0-b788-441c-bc61-1e565c205f46 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:48.861207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1038e0-b788-441c-bc61-1e565c205f46 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:48.861702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1038e0-b788-441c-bc61-1e565c205f46 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:48.862082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1038e0-b788-441c-bc61-1e565c205f46 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/roles/608f13fd70a2473b98128888b1f5109c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:48.866637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1038e0-b788-441c-bc61-1e565c205f46 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:delete_role(role_id=608f13fd70a2473b98128888b1f5109c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:48.879337 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1038e0-b788-441c-bc61-1e565c205f46 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:48.923210 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3322/6592] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:48 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:48.924418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c3af6-d0a3-424a-b574-d57002850bfd None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:48.925904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-be4c3af6-d0a3-424a-b574-d57002850bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:48.974605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1d1038e0-b788-441c-bc61-1e565c205f46 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invalidating the token cache because role 608f13fd70a2473b98128888b1f5109c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:48.976568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1d1038e0-b788-441c-bc61-1e565c205f46 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:48.979806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1d1038e0-b788-441c-bc61-1e565c205f46 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:48.990356 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3271/6593] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:41:48 2022] DELETE /identity/v3/roles/608f13fd70a2473b98128888b1f5109c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:41:48.993870 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1038e0-b788-441c-bc61-1e565c205f46 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:48.997593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1d1038e0-b788-441c-bc61-1e565c205f46 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:49.021797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c3af6-d0a3-424a-b574-d57002850bfd None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:49.095071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1038e0-b788-441c-bc61-1e565c205f46 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:49.099657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16986a-2b0d-4ca6-8f56-f8349fbfe2bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:49.100353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16986a-2b0d-4ca6-8f56-f8349fbfe2bd service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:49.100633 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16986a-2b0d-4ca6-8f56-f8349fbfe2bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:49.100903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16986a-2b0d-4ca6-8f56-f8349fbfe2bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:49.102884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9e16986a-2b0d-4ca6-8f56-f8349fbfe2bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:49.163456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5527e2-6c89-4a34-8c5b-212b795cb9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:49.164052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5527e2-6c89-4a34-8c5b-212b795cb9fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:49.164333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5527e2-6c89-4a34-8c5b-212b795cb9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:49.164605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5527e2-6c89-4a34-8c5b-212b795cb9fc admin admin] PATH_INFO: `/v3/projects/141e790672204253a7d1beaf2fc6f2cc` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:49.168820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5527e2-6c89-4a34-8c5b-212b795cb9fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=141e790672204253a7d1beaf2fc6f2cc)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:49.173276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5527e2-6c89-4a34-8c5b-212b795cb9fc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:49.184273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16986a-2b0d-4ca6-8f56-f8349fbfe2bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:49.186337 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16986a-2b0d-4ca6-8f56-f8349fbfe2bd service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:49.198367 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3272/6594] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:49.211531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16986a-2b0d-4ca6-8f56-f8349fbfe2bd service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:49.213069 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:49.215307 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9e16986a-2b0d-4ca6-8f56-f8349fbfe2bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:49.294379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fb5527e2-6c89-4a34-8c5b-212b795cb9fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '141e790672204253a7d1beaf2fc6f2cc', 'request_id': 'req-fb5527e2-6c89-4a34-8c5b-212b795cb9fc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:49.310307 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fb5527e2-6c89-4a34-8c5b-212b795cb9fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '141e790672204253a7d1beaf2fc6f2cc', 'request_id': 'req-fb5527e2-6c89-4a34-8c5b-212b795cb9fc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:49.335708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fb5527e2-6c89-4a34-8c5b-212b795cb9fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '141e790672204253a7d1beaf2fc6f2cc', 'request_id': 'req-fb5527e2-6c89-4a34-8c5b-212b795cb9fc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:49.366663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fb5527e2-6c89-4a34-8c5b-212b795cb9fc admin admin] The token cache is being invalidate because project 141e790672204253a7d1beaf2fc6f2cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:49.368028 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fb5527e2-6c89-4a34-8c5b-212b795cb9fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:49.374140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fb5527e2-6c89-4a34-8c5b-212b795cb9fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:49.377964 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:49.381054 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3323/6595] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:41:48 2022] DELETE /identity/v3/projects/141e790672204253a7d1beaf2fc6f2cc => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:49.384437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5527e2-6c89-4a34-8c5b-212b795cb9fc admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:49.387289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fb5527e2-6c89-4a34-8c5b-212b795cb9fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:49.409447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16986a-2b0d-4ca6-8f56-f8349fbfe2bd service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:49.558387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8a07e-518a-4b43-a685-01ba10cd3a31 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:49.560085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8a07e-518a-4b43-a685-01ba10cd3a31 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:49.563660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8a07e-518a-4b43-a685-01ba10cd3a31 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:49.564094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8a07e-518a-4b43-a685-01ba10cd3a31 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/domains/b70b56f1e3994ed09a1c78cd801a6e2f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:49.566305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d8a07e-518a-4b43-a685-01ba10cd3a31 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b70b56f1e3994ed09a1c78cd801a6e2f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:49.570045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d8a07e-518a-4b43-a685-01ba10cd3a31 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:49.582739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5527e2-6c89-4a34-8c5b-212b795cb9fc admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:49.597428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121d0d8-238f-4ee9-bfb9-69df04656176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:49.598244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121d0d8-238f-4ee9-bfb9-69df04656176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:49.598529 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121d0d8-238f-4ee9-bfb9-69df04656176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:49.598937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121d0d8-238f-4ee9-bfb9-69df04656176 admin admin] PATH_INFO: `/v3/users/22541225521344a690241ee18ba81683` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:49.600937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8121d0d8-238f-4ee9-bfb9-69df04656176 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22541225521344a690241ee18ba81683)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:49.604663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8121d0d8-238f-4ee9-bfb9-69df04656176 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:49.621294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-01d8a07e-518a-4b43-a685-01ba10cd3a31 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b70b56f1e3994ed09a1c78cd801a6e2f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:49.622234 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-01d8a07e-518a-4b43-a685-01ba10cd3a31 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b70b56f1e3994ed09a1c78cd801a6e2f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:49.696992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-01d8a07e-518a-4b43-a685-01ba10cd3a31 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b70b56f1e3994ed09a1c78cd801a6e2f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:49.698362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-01d8a07e-518a-4b43-a685-01ba10cd3a31 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b70b56f1e3994ed09a1c78cd801a6e2f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:49.706092 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3273/6596] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:41:49 2022] PATCH /identity/v3/domains/b70b56f1e3994ed09a1c78cd801a6e2f => generated 275 bytes in 505 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:49.712108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8a07e-518a-4b43-a685-01ba10cd3a31 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:49.716968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-01d8a07e-518a-4b43-a685-01ba10cd3a31 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:49.732776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8121d0d8-238f-4ee9-bfb9-69df04656176 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22541225521344a690241ee18ba81683'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:49.760260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8121d0d8-238f-4ee9-bfb9-69df04656176 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22541225521344a690241ee18ba81683'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:49.810650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8121d0d8-238f-4ee9-bfb9-69df04656176 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22541225521344a690241ee18ba81683'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:49.812156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8121d0d8-238f-4ee9-bfb9-69df04656176 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22541225521344a690241ee18ba81683'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:49.832177 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8121d0d8-238f-4ee9-bfb9-69df04656176 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22541225521344a690241ee18ba81683'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:49.847699 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3324/6597] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:41:49 2022] DELETE /identity/v3/users/22541225521344a690241ee18ba81683 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:49.873164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8a07e-518a-4b43-a685-01ba10cd3a31 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:50.010600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd5918-264e-408a-80f1-23df08b63ec4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:50.013681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd5918-264e-408a-80f1-23df08b63ec4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:50.015444 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd5918-264e-408a-80f1-23df08b63ec4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:50.015748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd5918-264e-408a-80f1-23df08b63ec4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/domains/b70b56f1e3994ed09a1c78cd801a6e2f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:50.050701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121d0d8-238f-4ee9-bfb9-69df04656176 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:50.052220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8121d0d8-238f-4ee9-bfb9-69df04656176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:50.081419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd5918-264e-408a-80f1-23df08b63ec4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b70b56f1e3994ed09a1c78cd801a6e2f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:50.083708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd5918-264e-408a-80f1-23df08b63ec4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:50.106758 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:50.127949 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:50.156189 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9fdd5918-264e-408a-80f1-23df08b63ec4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b70b56f1e3994ed09a1c78cd801a6e2f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:50.187138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9fdd5918-264e-408a-80f1-23df08b63ec4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b70b56f1e3994ed09a1c78cd801a6e2f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:50.240049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121d0d8-238f-4ee9-bfb9-69df04656176 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:50.248601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5ea16-5d73-43bf-87b1-7dcf93475f9a tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5640c9bab43a4877920c02250bf94445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18d589b917ad42a88d3132d3669c6d59', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:50.250322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5ea16-5d73-43bf-87b1-7dcf93475f9a tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:50.251181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5ea16-5d73-43bf-87b1-7dcf93475f9a tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:50.251466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5ea16-5d73-43bf-87b1-7dcf93475f9a tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:50.255113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5ea16-5d73-43bf-87b1-7dcf93475f9a tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:41:50.255289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5ea16-5d73-43bf-87b1-7dcf93475f9a tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:50.257848 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5ea16-5d73-43bf-87b1-7dcf93475f9a tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:50.284844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9fdd5918-264e-408a-80f1-23df08b63ec4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b70b56f1e3994ed09a1c78cd801a6e2f', 'request_id': 'req-9fdd5918-264e-408a-80f1-23df08b63ec4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:50.285039 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3325/6598] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:41:50.286210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5ea16-5d73-43bf-87b1-7dcf93475f9a tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:50.297640 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9fdd5918-264e-408a-80f1-23df08b63ec4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b70b56f1e3994ed09a1c78cd801a6e2f', 'request_id': 'req-9fdd5918-264e-408a-80f1-23df08b63ec4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:50.301733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5ea16-5d73-43bf-87b1-7dcf93475f9a tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:50.308745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9fdd5918-264e-408a-80f1-23df08b63ec4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b70b56f1e3994ed09a1c78cd801a6e2f', 'request_id': 'req-9fdd5918-264e-408a-80f1-23df08b63ec4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:50.330437 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9fdd5918-264e-408a-80f1-23df08b63ec4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] The token cache is being invalidate because project b70b56f1e3994ed09a1c78cd801a6e2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:50.358896 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9fdd5918-264e-408a-80f1-23df08b63ec4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:50.360063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9fdd5918-264e-408a-80f1-23df08b63ec4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:50.388374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9fdd5918-264e-408a-80f1-23df08b63ec4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b70b56f1e3994ed09a1c78cd801a6e2f', 'request_id': 'req-9fdd5918-264e-408a-80f1-23df08b63ec4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:50.389896 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9fdd5918-264e-408a-80f1-23df08b63ec4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b70b56f1e3994ed09a1c78cd801a6e2f', 'request_id': 'req-9fdd5918-264e-408a-80f1-23df08b63ec4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:50.395393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9fdd5918-264e-408a-80f1-23df08b63ec4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b70b56f1e3994ed09a1c78cd801a6e2f', 'request_id': 'req-9fdd5918-264e-408a-80f1-23df08b63ec4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:50.403650 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3274/6599] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:41:49 2022] DELETE /identity/v3/domains/b70b56f1e3994ed09a1c78cd801a6e2f => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:50.408724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd5918-264e-408a-80f1-23df08b63ec4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:50.412829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9fdd5918-264e-408a-80f1-23df08b63ec4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:50.486922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f2ba8-1df6-4736-ad4a-5532f155f525 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5640c9bab43a4877920c02250bf94445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18d589b917ad42a88d3132d3669c6d59', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:50.491155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f2ba8-1df6-4736-ad4a-5532f155f525 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:50.492110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f2ba8-1df6-4736-ad4a-5532f155f525 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:50.493032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f2ba8-1df6-4736-ad4a-5532f155f525 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:50.495275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f2ba8-1df6-4736-ad4a-5532f155f525 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:50.500275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f2ba8-1df6-4736-ad4a-5532f155f525 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:50.591755 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3326/6600] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:50 2022] POST /identity/v3/projects => generated 354 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:50.596144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f2ba8-1df6-4736-ad4a-5532f155f525 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:50.599633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-158f2ba8-1df6-4736-ad4a-5532f155f525 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:50.608916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd5918-264e-408a-80f1-23df08b63ec4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:50.746627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854566d-3ab2-4f7d-9232-d2960897cbb3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:50.747318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854566d-3ab2-4f7d-9232-d2960897cbb3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:50.747614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854566d-3ab2-4f7d-9232-d2960897cbb3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:50.747872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854566d-3ab2-4f7d-9232-d2960897cbb3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/domains/f13e4e6e91794c1d8c9092d2b1cdd96a/users/fee1bfd918e649daa820844403012329/roles/f6d35692f60641c09c3884b6f5ae8fec` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:50.755666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854566d-3ab2-4f7d-9232-d2960897cbb3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=f13e4e6e91794c1d8c9092d2b1cdd96a, user_id=fee1bfd918e649daa820844403012329, role_id=f6d35692f60641c09c3884b6f5ae8fec)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:50.761585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3854566d-3ab2-4f7d-9232-d2960897cbb3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:50.768445 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:50.779636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3854566d-3ab2-4f7d-9232-d2960897cbb3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invalidating the token cache because role f6d35692f60641c09c3884b6f5ae8fec was removed from user fee1bfd918e649daa820844403012329 on domain f13e4e6e91794c1d8c9092d2b1cdd96a. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:50.782815 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3854566d-3ab2-4f7d-9232-d2960897cbb3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:50.784601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3854566d-3ab2-4f7d-9232-d2960897cbb3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:50.805685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f2ba8-1df6-4736-ad4a-5532f155f525 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:50.810811 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3275/6601] 10.222.0.39 () {58 vars in 1464 bytes} [Sun Aug 7 01:41:50 2022] DELETE /identity/v3/domains/f13e4e6e91794c1d8c9092d2b1cdd96a/users/fee1bfd918e649daa820844403012329/roles/f6d35692f60641c09c3884b6f5ae8fec => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:50.816995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854566d-3ab2-4f7d-9232-d2960897cbb3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:50.821490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3854566d-3ab2-4f7d-9232-d2960897cbb3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:50.878364 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:50.907164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74ed8b-2a09-4f46-a98c-7755826b0712 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5640c9bab43a4877920c02250bf94445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18d589b917ad42a88d3132d3669c6d59', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:50.908994 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74ed8b-2a09-4f46-a98c-7755826b0712 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:50.911295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74ed8b-2a09-4f46-a98c-7755826b0712 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:50.912075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74ed8b-2a09-4f46-a98c-7755826b0712 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:50.914156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74ed8b-2a09-4f46-a98c-7755826b0712 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:41:50.917005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74ed8b-2a09-4f46-a98c-7755826b0712 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:50.921555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74ed8b-2a09-4f46-a98c-7755826b0712 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:50.966716 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3327/6602] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:41:50.967689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74ed8b-2a09-4f46-a98c-7755826b0712 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:50.969490 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7b74ed8b-2a09-4f46-a98c-7755826b0712 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:50.996393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3854566d-3ab2-4f7d-9232-d2960897cbb3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:51.014304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6257e0f-197b-4ae1-a538-8a0fbdbc1f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:51.016981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6257e0f-197b-4ae1-a538-8a0fbdbc1f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:51.020036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6257e0f-197b-4ae1-a538-8a0fbdbc1f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:51.021939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6257e0f-197b-4ae1-a538-8a0fbdbc1f76 admin admin] PATH_INFO: `/v3/projects/c5c44bdb016f42e3a06fa5e5e82e6365` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:51.028692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6257e0f-197b-4ae1-a538-8a0fbdbc1f76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5c44bdb016f42e3a06fa5e5e82e6365)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:51.047738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6257e0f-197b-4ae1-a538-8a0fbdbc1f76 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:51.132298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74ed8b-2a09-4f46-a98c-7755826b0712 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:51.139181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dbb586-b17d-43f9-b17b-dbc969372c1b tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:51.140155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbb586-b17d-43f9-b17b-dbc969372c1b tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:51.140540 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbb586-b17d-43f9-b17b-dbc969372c1b tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:51.140980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dbb586-b17d-43f9-b17b-dbc969372c1b tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/roles/f6d35692f60641c09c3884b6f5ae8fec` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:51.142907 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dbb586-b17d-43f9-b17b-dbc969372c1b tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f6d35692f60641c09c3884b6f5ae8fec)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:51.146685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dbb586-b17d-43f9-b17b-dbc969372c1b tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:51.165499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b6257e0f-197b-4ae1-a538-8a0fbdbc1f76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5c44bdb016f42e3a06fa5e5e82e6365', 'request_id': 'req-b6257e0f-197b-4ae1-a538-8a0fbdbc1f76'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:51.181924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b6257e0f-197b-4ae1-a538-8a0fbdbc1f76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5c44bdb016f42e3a06fa5e5e82e6365', 'request_id': 'req-b6257e0f-197b-4ae1-a538-8a0fbdbc1f76'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:51.205083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b6257e0f-197b-4ae1-a538-8a0fbdbc1f76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5c44bdb016f42e3a06fa5e5e82e6365', 'request_id': 'req-b6257e0f-197b-4ae1-a538-8a0fbdbc1f76'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:51.235448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-75dbb586-b17d-43f9-b17b-dbc969372c1b tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invalidating the token cache because role f6d35692f60641c09c3884b6f5ae8fec has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:51.235830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-75dbb586-b17d-43f9-b17b-dbc969372c1b tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:51.237904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-75dbb586-b17d-43f9-b17b-dbc969372c1b tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:51.242333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b6257e0f-197b-4ae1-a538-8a0fbdbc1f76 admin admin] The token cache is being invalidate because project c5c44bdb016f42e3a06fa5e5e82e6365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:51.242916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b6257e0f-197b-4ae1-a538-8a0fbdbc1f76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:51.243520 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3328/6603] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:41:50 2022] DELETE /identity/v3/roles/f6d35692f60641c09c3884b6f5ae8fec => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:51.244762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b6257e0f-197b-4ae1-a538-8a0fbdbc1f76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:51.247315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dbb586-b17d-43f9-b17b-dbc969372c1b tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:51.248126 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3276/6604] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:41:50 2022] DELETE /identity/v3/projects/c5c44bdb016f42e3a06fa5e5e82e6365 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:51.249344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6257e0f-197b-4ae1-a538-8a0fbdbc1f76 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:51.251403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b6257e0f-197b-4ae1-a538-8a0fbdbc1f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:51.252440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-75dbb586-b17d-43f9-b17b-dbc969372c1b tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:51.387783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6257e0f-197b-4ae1-a538-8a0fbdbc1f76 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:51.431555 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:51.443727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dbb586-b17d-43f9-b17b-dbc969372c1b tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:51.464376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99515c04-964b-4296-be66-a5a9a48ef299 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5640c9bab43a4877920c02250bf94445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '18d589b917ad42a88d3132d3669c6d59', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:51.465048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99515c04-964b-4296-be66-a5a9a48ef299 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:51.465333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99515c04-964b-4296-be66-a5a9a48ef299 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:51.465613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99515c04-964b-4296-be66-a5a9a48ef299 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] PATH_INFO: `/v3/projects/75f967f95f9c4de7b43715a2f9aabc0c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:51.471079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99515c04-964b-4296-be66-a5a9a48ef299 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] RBAC: Authorizing `identity:delete_project(project_id=75f967f95f9c4de7b43715a2f9aabc0c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:51.476231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99515c04-964b-4296-be66-a5a9a48ef299 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:51.505532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b867488-d4f6-4b22-abbc-d17f9c96b1c3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:51.506470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b867488-d4f6-4b22-abbc-d17f9c96b1c3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:51.506689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b867488-d4f6-4b22-abbc-d17f9c96b1c3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:51.506963 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b867488-d4f6-4b22-abbc-d17f9c96b1c3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/domains/f13e4e6e91794c1d8c9092d2b1cdd96a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:51.508900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b867488-d4f6-4b22-abbc-d17f9c96b1c3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f13e4e6e91794c1d8c9092d2b1cdd96a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:51.510789 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b867488-d4f6-4b22-abbc-d17f9c96b1c3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:51.589736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1b867488-d4f6-4b22-abbc-d17f9c96b1c3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f13e4e6e91794c1d8c9092d2b1cdd96a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:51.590532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1b867488-d4f6-4b22-abbc-d17f9c96b1c3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f13e4e6e91794c1d8c9092d2b1cdd96a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:51.622895 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-99515c04-964b-4296-be66-a5a9a48ef299 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75f967f95f9c4de7b43715a2f9aabc0c', 'request_id': 'req-99515c04-964b-4296-be66-a5a9a48ef299'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:51.627310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1b867488-d4f6-4b22-abbc-d17f9c96b1c3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f13e4e6e91794c1d8c9092d2b1cdd96a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:51.627617 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:51.628645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1b867488-d4f6-4b22-abbc-d17f9c96b1c3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f13e4e6e91794c1d8c9092d2b1cdd96a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:51.633436 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3277/6605] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:41:51 2022] PATCH /identity/v3/domains/f13e4e6e91794c1d8c9092d2b1cdd96a => generated 278 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:51.637481 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447c46b-60fc-41ac-9f0d-bcc970127b4b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:51.637646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-99515c04-964b-4296-be66-a5a9a48ef299 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75f967f95f9c4de7b43715a2f9aabc0c', 'request_id': 'req-99515c04-964b-4296-be66-a5a9a48ef299'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:51.637896 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447c46b-60fc-41ac-9f0d-bcc970127b4b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:51.638289 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447c46b-60fc-41ac-9f0d-bcc970127b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:51.663812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9447c46b-60fc-41ac-9f0d-bcc970127b4b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:51.665630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9447c46b-60fc-41ac-9f0d-bcc970127b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:51.672929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-99515c04-964b-4296-be66-a5a9a48ef299 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75f967f95f9c4de7b43715a2f9aabc0c', 'request_id': 'req-99515c04-964b-4296-be66-a5a9a48ef299'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:51.701459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-99515c04-964b-4296-be66-a5a9a48ef299 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] The token cache is being invalidate because project 75f967f95f9c4de7b43715a2f9aabc0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:51.709127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-99515c04-964b-4296-be66-a5a9a48ef299 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:51.714446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-99515c04-964b-4296-be66-a5a9a48ef299 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:51.717156 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3329/6606] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:41:51 2022] DELETE /identity/v3/projects/75f967f95f9c4de7b43715a2f9aabc0c => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:51.728141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99515c04-964b-4296-be66-a5a9a48ef299 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:51.731583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-99515c04-964b-4296-be66-a5a9a48ef299 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:51.888406 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3278/6607] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:51.896942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d0c00-764f-40ac-a3af-27a4b235974b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:51.897167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d0c00-764f-40ac-a3af-27a4b235974b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:51.897447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d0c00-764f-40ac-a3af-27a4b235974b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:51.916917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99515c04-964b-4296-be66-a5a9a48ef299 tempest-VolumeQuotaClassesTest-646520083 tempest-VolumeQuotaClassesTest-646520083-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:51.941348 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e20d0c00-764f-40ac-a3af-27a4b235974b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:51.942702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e20d0c00-764f-40ac-a3af-27a4b235974b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:51.972551 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3279/6608] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:51.989784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d0c00-764f-40ac-a3af-27a4b235974b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:52.006193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d0c00-764f-40ac-a3af-27a4b235974b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:52.019836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c3146-c3a5-48df-9750-dee463f89c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:52.031995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c3146-c3a5-48df-9750-dee463f89c81 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:52.032470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c3146-c3a5-48df-9750-dee463f89c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:52.034094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c3146-c3a5-48df-9750-dee463f89c81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:52.034825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c3146-c3a5-48df-9750-dee463f89c81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:41:52.035128 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c3146-c3a5-48df-9750-dee463f89c81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:52.040433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c3146-c3a5-48df-9750-dee463f89c81 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:52.065923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21799e11-8848-4f3a-af0a-0002a0868808 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:52.068635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21799e11-8848-4f3a-af0a-0002a0868808 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:52.069007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21799e11-8848-4f3a-af0a-0002a0868808 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:52.069568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21799e11-8848-4f3a-af0a-0002a0868808 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/domains/f13e4e6e91794c1d8c9092d2b1cdd96a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:52.073669 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3280/6609] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:41:52.083996 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c3146-c3a5-48df-9750-dee463f89c81 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:52.097572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c3146-c3a5-48df-9750-dee463f89c81 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:52.103507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b50a5-4e6d-47d8-979a-28d8a0a3cbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:52.104166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b50a5-4e6d-47d8-979a-28d8a0a3cbd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:52.104445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b50a5-4e6d-47d8-979a-28d8a0a3cbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:52.104716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b50a5-4e6d-47d8-979a-28d8a0a3cbd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:52.105356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b50a5-4e6d-47d8-979a-28d8a0a3cbd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:52.108199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b50a5-4e6d-47d8-979a-28d8a0a3cbd5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:52.116963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21799e11-8848-4f3a-af0a-0002a0868808 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f13e4e6e91794c1d8c9092d2b1cdd96a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:52.121841 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21799e11-8848-4f3a-af0a-0002a0868808 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:52.158615 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3281/6610] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:52 2022] POST /identity/v3/projects => generated 393 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:52.159713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b50a5-4e6d-47d8-979a-28d8a0a3cbd5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:52.196745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-21799e11-8848-4f3a-af0a-0002a0868808 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f13e4e6e91794c1d8c9092d2b1cdd96a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:52.239733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-21799e11-8848-4f3a-af0a-0002a0868808 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f13e4e6e91794c1d8c9092d2b1cdd96a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:52.285786 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:52.301484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b50a5-4e6d-47d8-979a-28d8a0a3cbd5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:52.309447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb574d-2f5a-48c7-a856-d5d391e46fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:52.310154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb574d-2f5a-48c7-a856-d5d391e46fc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:52.311548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb574d-2f5a-48c7-a856-d5d391e46fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:52.311855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb574d-2f5a-48c7-a856-d5d391e46fc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:52.312521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb574d-2f5a-48c7-a856-d5d391e46fc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:52.315132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb574d-2f5a-48c7-a856-d5d391e46fc5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:52.345390 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3282/6611] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:41:52 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:52.346396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb574d-2f5a-48c7-a856-d5d391e46fc5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:52.348380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-babb574d-2f5a-48c7-a856-d5d391e46fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:52.362926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb574d-2f5a-48c7-a856-d5d391e46fc5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:52.393959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-21799e11-8848-4f3a-af0a-0002a0868808 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f13e4e6e91794c1d8c9092d2b1cdd96a', 'request_id': 'req-21799e11-8848-4f3a-af0a-0002a0868808'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:52.405875 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:52.413820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-21799e11-8848-4f3a-af0a-0002a0868808 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f13e4e6e91794c1d8c9092d2b1cdd96a', 'request_id': 'req-21799e11-8848-4f3a-af0a-0002a0868808'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:52.442255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacdfde-9917-4ff1-9256-97d2b98e8d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:52.442742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-21799e11-8848-4f3a-af0a-0002a0868808 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f13e4e6e91794c1d8c9092d2b1cdd96a', 'request_id': 'req-21799e11-8848-4f3a-af0a-0002a0868808'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:52.442903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacdfde-9917-4ff1-9256-97d2b98e8d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:52.443205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacdfde-9917-4ff1-9256-97d2b98e8d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:52.443556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacdfde-9917-4ff1-9256-97d2b98e8d2a admin admin] PATH_INFO: `/v3/users/8fc8b91614c74a258c8e0d95db5e2033` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:52.444762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cacdfde-9917-4ff1-9256-97d2b98e8d2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fc8b91614c74a258c8e0d95db5e2033)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:52.446760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cacdfde-9917-4ff1-9256-97d2b98e8d2a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:52.509992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-21799e11-8848-4f3a-af0a-0002a0868808 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] The token cache is being invalidate because project f13e4e6e91794c1d8c9092d2b1cdd96a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:52.510551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-21799e11-8848-4f3a-af0a-0002a0868808 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:52.512184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-21799e11-8848-4f3a-af0a-0002a0868808 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:52.516489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4cacdfde-9917-4ff1-9256-97d2b98e8d2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fc8b91614c74a258c8e0d95db5e2033'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:52.526243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4cacdfde-9917-4ff1-9256-97d2b98e8d2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fc8b91614c74a258c8e0d95db5e2033'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:52.537337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-21799e11-8848-4f3a-af0a-0002a0868808 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f13e4e6e91794c1d8c9092d2b1cdd96a', 'request_id': 'req-21799e11-8848-4f3a-af0a-0002a0868808'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:52.547231 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4cacdfde-9917-4ff1-9256-97d2b98e8d2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fc8b91614c74a258c8e0d95db5e2033'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:52.548265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4cacdfde-9917-4ff1-9256-97d2b98e8d2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fc8b91614c74a258c8e0d95db5e2033'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:52.549837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-21799e11-8848-4f3a-af0a-0002a0868808 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f13e4e6e91794c1d8c9092d2b1cdd96a', 'request_id': 'req-21799e11-8848-4f3a-af0a-0002a0868808'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:52.551445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-21799e11-8848-4f3a-af0a-0002a0868808 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f13e4e6e91794c1d8c9092d2b1cdd96a', 'request_id': 'req-21799e11-8848-4f3a-af0a-0002a0868808'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:52.559194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4cacdfde-9917-4ff1-9256-97d2b98e8d2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fc8b91614c74a258c8e0d95db5e2033'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:52.568950 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3330/6612] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:41:51 2022] DELETE /identity/v3/domains/f13e4e6e91794c1d8c9092d2b1cdd96a => generated 0 bytes in 851 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:52.575250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21799e11-8848-4f3a-af0a-0002a0868808 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:52.578594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-21799e11-8848-4f3a-af0a-0002a0868808 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:52.581413 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3283/6613] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:41:52 2022] DELETE /identity/v3/users/8fc8b91614c74a258c8e0d95db5e2033 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:52.583034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacdfde-9917-4ff1-9256-97d2b98e8d2a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:52.586507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4cacdfde-9917-4ff1-9256-97d2b98e8d2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:52.607363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21799e11-8848-4f3a-af0a-0002a0868808 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:52.684695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacdfde-9917-4ff1-9256-97d2b98e8d2a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:52.690530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5eefda-6b93-4e36-85da-12f6093b5943 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:52.691809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5eefda-6b93-4e36-85da-12f6093b5943 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:52.692281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5eefda-6b93-4e36-85da-12f6093b5943 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:52.692706 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5eefda-6b93-4e36-85da-12f6093b5943 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/domains/ac75d2559ffa47c3b4a033386e917c80/groups/acddcd0baf3548098403d28ef5c94cb1/roles/fcf28c4854464f29b8c12f1f7a6d3084` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:52.695470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5eefda-6b93-4e36-85da-12f6093b5943 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=ac75d2559ffa47c3b4a033386e917c80, group_id=acddcd0baf3548098403d28ef5c94cb1, role_id=fcf28c4854464f29b8c12f1f7a6d3084)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:52.698581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5eefda-6b93-4e36-85da-12f6093b5943 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:52.702704 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:52.706991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5a5eefda-6b93-4e36-85da-12f6093b5943 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invalidating the token cache because role fcf28c4854464f29b8c12f1f7a6d3084 was removed from group acddcd0baf3548098403d28ef5c94cb1 on domain ac75d2559ffa47c3b4a033386e917c80. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:52.707768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5a5eefda-6b93-4e36-85da-12f6093b5943 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:52.708991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5a5eefda-6b93-4e36-85da-12f6093b5943 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:52.749469 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3284/6614] 10.222.0.39 () {58 vars in 1467 bytes} [Sun Aug 7 01:41:52 2022] DELETE /identity/v3/domains/ac75d2559ffa47c3b4a033386e917c80/groups/acddcd0baf3548098403d28ef5c94cb1/roles/fcf28c4854464f29b8c12f1f7a6d3084 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:52.753050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ced912-bf83-40b5-9e7b-9015e1c2081a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:52.755100 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ced912-bf83-40b5-9e7b-9015e1c2081a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:52.756557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04785868-3f79-4fd4-82e1-68efecd3d9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:52.757573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ced912-bf83-40b5-9e7b-9015e1c2081a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:52.763777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04785868-3f79-4fd4-82e1-68efecd3d9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:52.765295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04785868-3f79-4fd4-82e1-68efecd3d9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:52.766936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04785868-3f79-4fd4-82e1-68efecd3d9a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:52.770829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04785868-3f79-4fd4-82e1-68efecd3d9a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:52.778971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04785868-3f79-4fd4-82e1-68efecd3d9a0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:52.808057 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3331/6615] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:52 2022] GET /identity/v3/roles => generated 1880 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:52.810003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04785868-3f79-4fd4-82e1-68efecd3d9a0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:52.815501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-04785868-3f79-4fd4-82e1-68efecd3d9a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:52.817145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-09ced912-bf83-40b5-9e7b-9015e1c2081a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:52.818343 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-09ced912-bf83-40b5-9e7b-9015e1c2081a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:52.834929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04785868-3f79-4fd4-82e1-68efecd3d9a0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:52.909471 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3285/6616] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:52.920581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ced912-bf83-40b5-9e7b-9015e1c2081a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:52.924568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-09ced912-bf83-40b5-9e7b-9015e1c2081a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:52.932724 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479a883-7fc3-4272-a7bb-e3d4c37587c7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:52.933947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479a883-7fc3-4272-a7bb-e3d4c37587c7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:52.936216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479a883-7fc3-4272-a7bb-e3d4c37587c7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:52.936697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479a883-7fc3-4272-a7bb-e3d4c37587c7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/groups/acddcd0baf3548098403d28ef5c94cb1/users/fee1bfd918e649daa820844403012329` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:52.938819 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479a883-7fc3-4272-a7bb-e3d4c37587c7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=acddcd0baf3548098403d28ef5c94cb1, user_id=fee1bfd918e649daa820844403012329)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:52.941148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479a883-7fc3-4272-a7bb-e3d4c37587c7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:52.949814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ced912-bf83-40b5-9e7b-9015e1c2081a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:52.969316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e479a883-7fc3-4272-a7bb-e3d4c37587c7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'fee1bfd918e649daa820844403012329'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:52.988918 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be25496-d28d-4efe-867d-e7260f22e610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:52.989631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be25496-d28d-4efe-867d-e7260f22e610 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:52.989868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be25496-d28d-4efe-867d-e7260f22e610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:52.990180 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be25496-d28d-4efe-867d-e7260f22e610 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:52.990847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be25496-d28d-4efe-867d-e7260f22e610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:52.992796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be25496-d28d-4efe-867d-e7260f22e610 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:53.000556 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3332/6617] 10.222.0.39 () {58 vars in 1344 bytes} [Sun Aug 7 01:41:52 2022] DELETE /identity/v3/groups/acddcd0baf3548098403d28ef5c94cb1/users/fee1bfd918e649daa820844403012329 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:53.002022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479a883-7fc3-4272-a7bb-e3d4c37587c7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:53.007447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e479a883-7fc3-4272-a7bb-e3d4c37587c7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:53.014099 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3286/6618] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:52 2022] GET /identity/v3/roles => generated 1880 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:53.014099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be25496-d28d-4efe-867d-e7260f22e610 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:53.029322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be25496-d28d-4efe-867d-e7260f22e610 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:53.125132 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:53.145168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b94053-a4d1-4200-b38f-36121a5e4281 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:53.145168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b94053-a4d1-4200-b38f-36121a5e4281 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:53.145168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b94053-a4d1-4200-b38f-36121a5e4281 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:53.145557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b94053-a4d1-4200-b38f-36121a5e4281 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/groups/acddcd0baf3548098403d28ef5c94cb1` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:53.146874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b94053-a4d1-4200-b38f-36121a5e4281 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:delete_group(group_id=acddcd0baf3548098403d28ef5c94cb1)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:53.154287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b94053-a4d1-4200-b38f-36121a5e4281 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:53.156374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479a883-7fc3-4272-a7bb-e3d4c37587c7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:53.163305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583df583-3cb0-42fc-a7e9-c5e14afcc5fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:53.164085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583df583-3cb0-42fc-a7e9-c5e14afcc5fb service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:53.164424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583df583-3cb0-42fc-a7e9-c5e14afcc5fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:53.164697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583df583-3cb0-42fc-a7e9-c5e14afcc5fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:53.219852 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3287/6619] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Aug 7 01:41:53 2022] DELETE /identity/v3/groups/acddcd0baf3548098403d28ef5c94cb1 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:53.222212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b94053-a4d1-4200-b38f-36121a5e4281 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:53.292218 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:53.320738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b94053-a4d1-4200-b38f-36121a5e4281 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:53.327439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba7f15-3abd-48ad-a5a9-fedd5beb47af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:53.328498 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba7f15-3abd-48ad-a5a9-fedd5beb47af admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:53.329020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba7f15-3abd-48ad-a5a9-fedd5beb47af admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:53.329696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba7f15-3abd-48ad-a5a9-fedd5beb47af admin admin] PATH_INFO: `/v3/projects/fc3277d05685483d8653428362c29c2e/users/d24d1853a3e04e499558a8b4e8aaec41/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:53.341872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583df583-3cb0-42fc-a7e9-c5e14afcc5fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:53.346257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583df583-3cb0-42fc-a7e9-c5e14afcc5fb service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:53.348945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba7f15-3abd-48ad-a5a9-fedd5beb47af admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc3277d05685483d8653428362c29c2e, user_id=d24d1853a3e04e499558a8b4e8aaec41, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:53.352411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba7f15-3abd-48ad-a5a9-fedd5beb47af admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:53.385959 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3288/6620] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:53 2022] PUT /identity/v3/projects/fc3277d05685483d8653428362c29c2e/users/d24d1853a3e04e499558a8b4e8aaec41/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:53.388066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba7f15-3abd-48ad-a5a9-fedd5beb47af admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:53.390351 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3333/6621] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:53.401412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8db0a-118e-4312-8d43-60c9273bd334 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:53.401810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8db0a-118e-4312-8d43-60c9273bd334 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:53.403485 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8db0a-118e-4312-8d43-60c9273bd334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:53.492934 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-38d8db0a-118e-4312-8d43-60c9273bd334 None None] MFA Rules not processed for user `d24d1853a3e04e499558a8b4e8aaec41`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:53.493603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-38d8db0a-118e-4312-8d43-60c9273bd334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:53.531916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba7f15-3abd-48ad-a5a9-fedd5beb47af admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:53.537966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee49e00-a4cc-4669-9586-4182b2640a54 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:53.538724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee49e00-a4cc-4669-9586-4182b2640a54 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:53.539281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee49e00-a4cc-4669-9586-4182b2640a54 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:53.540107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee49e00-a4cc-4669-9586-4182b2640a54 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/roles/fcf28c4854464f29b8c12f1f7a6d3084` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:53.543134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee49e00-a4cc-4669-9586-4182b2640a54 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:delete_role(role_id=fcf28c4854464f29b8c12f1f7a6d3084)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:53.545396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee49e00-a4cc-4669-9586-4182b2640a54 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:53.609423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8ee49e00-a4cc-4669-9586-4182b2640a54 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invalidating the token cache because role fcf28c4854464f29b8c12f1f7a6d3084 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:53.610074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8ee49e00-a4cc-4669-9586-4182b2640a54 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:53.610729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8ee49e00-a4cc-4669-9586-4182b2640a54 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:53.616437 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3289/6622] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:41:53 2022] DELETE /identity/v3/roles/fcf28c4854464f29b8c12f1f7a6d3084 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:53.621335 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee49e00-a4cc-4669-9586-4182b2640a54 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:53.623559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8ee49e00-a4cc-4669-9586-4182b2640a54 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:53.688651 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3334/6623] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:53.691581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8db0a-118e-4312-8d43-60c9273bd334 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:53.698782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-38d8db0a-118e-4312-8d43-60c9273bd334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:53.885149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8db0a-118e-4312-8d43-60c9273bd334 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:53.948631 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:53.996160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee49e00-a4cc-4669-9586-4182b2640a54 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:54.005390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7861f5-5efc-40bf-9e2f-1337e08269bd tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:54.006051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7861f5-5efc-40bf-9e2f-1337e08269bd tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:54.006330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7861f5-5efc-40bf-9e2f-1337e08269bd tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:54.006600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7861f5-5efc-40bf-9e2f-1337e08269bd tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/domains/ac75d2559ffa47c3b4a033386e917c80` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:54.010008 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7861f5-5efc-40bf-9e2f-1337e08269bd tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ac75d2559ffa47c3b4a033386e917c80)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:54.014039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7861f5-5efc-40bf-9e2f-1337e08269bd tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:54.019681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea520c-f454-488a-98a7-b4f3f19bcddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:54.023765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea520c-f454-488a-98a7-b4f3f19bcddd admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:54.024126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea520c-f454-488a-98a7-b4f3f19bcddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:54.024357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea520c-f454-488a-98a7-b4f3f19bcddd admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:54.025040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea520c-f454-488a-98a7-b4f3f19bcddd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:54.030036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea520c-f454-488a-98a7-b4f3f19bcddd admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:54.050965 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bb7861f5-5efc-40bf-9e2f-1337e08269bd tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ac75d2559ffa47c3b4a033386e917c80'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:54.052681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bb7861f5-5efc-40bf-9e2f-1337e08269bd tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ac75d2559ffa47c3b4a033386e917c80'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:54.070302 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:54.092759 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3335/6624] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:53 2022] POST /identity/v3/projects => generated 391 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:54.096587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea520c-f454-488a-98a7-b4f3f19bcddd admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:54.097438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bb7861f5-5efc-40bf-9e2f-1337e08269bd tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ac75d2559ffa47c3b4a033386e917c80'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:54.098383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-eaea520c-f454-488a-98a7-b4f3f19bcddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:54.099818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bb7861f5-5efc-40bf-9e2f-1337e08269bd tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ac75d2559ffa47c3b4a033386e917c80'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:54.103564 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3290/6625] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:41:53 2022] PATCH /identity/v3/domains/ac75d2559ffa47c3b4a033386e917c80 => generated 277 bytes in 484 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:54.110868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7861f5-5efc-40bf-9e2f-1337e08269bd tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:54.115008 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bb7861f5-5efc-40bf-9e2f-1337e08269bd tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:54.283311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7861f5-5efc-40bf-9e2f-1337e08269bd tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:54.307620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea520c-f454-488a-98a7-b4f3f19bcddd admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:54.315385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046b00a-4a19-416c-999d-2fca901084d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:54.316239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046b00a-4a19-416c-999d-2fca901084d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:54.316588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046b00a-4a19-416c-999d-2fca901084d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:54.316938 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046b00a-4a19-416c-999d-2fca901084d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:54.317655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046b00a-4a19-416c-999d-2fca901084d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:54.319713 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046b00a-4a19-416c-999d-2fca901084d7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:54.361497 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3336/6626] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:41:54 2022] POST /identity/v3/users => generated 302 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:41:54.362345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046b00a-4a19-416c-999d-2fca901084d7 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:54.364402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1046b00a-4a19-416c-999d-2fca901084d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:54.372965 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f77bf-a906-4170-9df3-a82c215bd6ed tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:54.374386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f77bf-a906-4170-9df3-a82c215bd6ed tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:54.374680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f77bf-a906-4170-9df3-a82c215bd6ed tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:54.375273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f77bf-a906-4170-9df3-a82c215bd6ed tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/domains/ac75d2559ffa47c3b4a033386e917c80` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:54.378813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046b00a-4a19-416c-999d-2fca901084d7 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:54.384323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af9dad-80a0-4223-87b0-421a22b222b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:54.384984 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af9dad-80a0-4223-87b0-421a22b222b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:54.385256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af9dad-80a0-4223-87b0-421a22b222b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:54.385618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af9dad-80a0-4223-87b0-421a22b222b1 admin admin] PATH_INFO: `/v3/projects/5964193f4f9c4ccdb2258e8dc72f8dd7` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:54.386732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af9dad-80a0-4223-87b0-421a22b222b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5964193f4f9c4ccdb2258e8dc72f8dd7)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:54.388969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af9dad-80a0-4223-87b0-421a22b222b1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:54.407381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f77bf-a906-4170-9df3-a82c215bd6ed tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ac75d2559ffa47c3b4a033386e917c80)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:54.410367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f77bf-a906-4170-9df3-a82c215bd6ed tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:54.462040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-640f77bf-a906-4170-9df3-a82c215bd6ed tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ac75d2559ffa47c3b4a033386e917c80'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:54.473817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-93af9dad-80a0-4223-87b0-421a22b222b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5964193f4f9c4ccdb2258e8dc72f8dd7', 'request_id': 'req-93af9dad-80a0-4223-87b0-421a22b222b1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:54.483360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-93af9dad-80a0-4223-87b0-421a22b222b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5964193f4f9c4ccdb2258e8dc72f8dd7', 'request_id': 'req-93af9dad-80a0-4223-87b0-421a22b222b1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:54.483856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-640f77bf-a906-4170-9df3-a82c215bd6ed tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ac75d2559ffa47c3b4a033386e917c80'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:54.494852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-93af9dad-80a0-4223-87b0-421a22b222b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5964193f4f9c4ccdb2258e8dc72f8dd7', 'request_id': 'req-93af9dad-80a0-4223-87b0-421a22b222b1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:54.542119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-93af9dad-80a0-4223-87b0-421a22b222b1 admin admin] The token cache is being invalidate because project 5964193f4f9c4ccdb2258e8dc72f8dd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:54.542289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-93af9dad-80a0-4223-87b0-421a22b222b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:54.543635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-93af9dad-80a0-4223-87b0-421a22b222b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:54.547020 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3337/6627] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:41:54 2022] DELETE /identity/v3/projects/5964193f4f9c4ccdb2258e8dc72f8dd7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:54.548053 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af9dad-80a0-4223-87b0-421a22b222b1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:54.551689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-93af9dad-80a0-4223-87b0-421a22b222b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:54.554782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-640f77bf-a906-4170-9df3-a82c215bd6ed tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac75d2559ffa47c3b4a033386e917c80', 'request_id': 'req-640f77bf-a906-4170-9df3-a82c215bd6ed'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:54.576813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-640f77bf-a906-4170-9df3-a82c215bd6ed tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac75d2559ffa47c3b4a033386e917c80', 'request_id': 'req-640f77bf-a906-4170-9df3-a82c215bd6ed'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:54.593552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-640f77bf-a906-4170-9df3-a82c215bd6ed tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac75d2559ffa47c3b4a033386e917c80', 'request_id': 'req-640f77bf-a906-4170-9df3-a82c215bd6ed'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:54.594040 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:54.601883 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:54.622894 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-640f77bf-a906-4170-9df3-a82c215bd6ed tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] The token cache is being invalidate because project ac75d2559ffa47c3b4a033386e917c80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:54.623350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-640f77bf-a906-4170-9df3-a82c215bd6ed tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:54.625067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-640f77bf-a906-4170-9df3-a82c215bd6ed tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:54.638840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-640f77bf-a906-4170-9df3-a82c215bd6ed tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ac75d2559ffa47c3b4a033386e917c80', 'request_id': 'req-640f77bf-a906-4170-9df3-a82c215bd6ed'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:54.640159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-640f77bf-a906-4170-9df3-a82c215bd6ed tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ac75d2559ffa47c3b4a033386e917c80', 'request_id': 'req-640f77bf-a906-4170-9df3-a82c215bd6ed'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:54.648216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-640f77bf-a906-4170-9df3-a82c215bd6ed tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ac75d2559ffa47c3b4a033386e917c80', 'request_id': 'req-640f77bf-a906-4170-9df3-a82c215bd6ed'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:54.649025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af9dad-80a0-4223-87b0-421a22b222b1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:54.663050 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3291/6628] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:41:54 2022] DELETE /identity/v3/domains/ac75d2559ffa47c3b4a033386e917c80 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:41:54.663050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f77bf-a906-4170-9df3-a82c215bd6ed tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:54.663936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-640f77bf-a906-4170-9df3-a82c215bd6ed tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:54.753232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932329c2-00fb-4e05-99c1-ba5fc47fbbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:54.754466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932329c2-00fb-4e05-99c1-ba5fc47fbbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:54.754899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932329c2-00fb-4e05-99c1-ba5fc47fbbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:54.755346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932329c2-00fb-4e05-99c1-ba5fc47fbbd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:54.756212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932329c2-00fb-4e05-99c1-ba5fc47fbbd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:54.758395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932329c2-00fb-4e05-99c1-ba5fc47fbbd1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:54.771985 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f77bf-a906-4170-9df3-a82c215bd6ed tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:54.776001 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3338/6629] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:54 2022] GET /identity/v3/roles => generated 1650 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:54.776001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932329c2-00fb-4e05-99c1-ba5fc47fbbd1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:54.777536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-932329c2-00fb-4e05-99c1-ba5fc47fbbd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:54.778175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f61c0-7fab-400c-a1be-caccbff0abdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:54.778827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f61c0-7fab-400c-a1be-caccbff0abdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:54.779108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f61c0-7fab-400c-a1be-caccbff0abdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:54.779381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f61c0-7fab-400c-a1be-caccbff0abdc admin admin] PATH_INFO: `/v3/users/5640c9bab43a4877920c02250bf94445` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:54.780563 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f61c0-7fab-400c-a1be-caccbff0abdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5640c9bab43a4877920c02250bf94445)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:54.782832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f61c0-7fab-400c-a1be-caccbff0abdc admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:54.879415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932329c2-00fb-4e05-99c1-ba5fc47fbbd1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:54.880430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9c4f61c0-7fab-400c-a1be-caccbff0abdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5640c9bab43a4877920c02250bf94445'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:54.889756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916f4fc-4d9e-4a35-a6ef-cb5a5f0a8fa7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:54.890440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916f4fc-4d9e-4a35-a6ef-cb5a5f0a8fa7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:54.890723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916f4fc-4d9e-4a35-a6ef-cb5a5f0a8fa7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:54.891001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916f4fc-4d9e-4a35-a6ef-cb5a5f0a8fa7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/domains/37c45d9554e34798b41b7da35a409eb4/users/fee1bfd918e649daa820844403012329/roles/b463172ad39a463caf3a45210dade79b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:54.893746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9c4f61c0-7fab-400c-a1be-caccbff0abdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5640c9bab43a4877920c02250bf94445'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:54.905116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7916f4fc-4d9e-4a35-a6ef-cb5a5f0a8fa7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=37c45d9554e34798b41b7da35a409eb4, user_id=fee1bfd918e649daa820844403012329, role_id=b463172ad39a463caf3a45210dade79b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:54.908297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7916f4fc-4d9e-4a35-a6ef-cb5a5f0a8fa7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:54.920947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9c4f61c0-7fab-400c-a1be-caccbff0abdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5640c9bab43a4877920c02250bf94445'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:54.922019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7916f4fc-4d9e-4a35-a6ef-cb5a5f0a8fa7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invalidating the token cache because role b463172ad39a463caf3a45210dade79b was removed from user fee1bfd918e649daa820844403012329 on domain 37c45d9554e34798b41b7da35a409eb4. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:54.922516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9c4f61c0-7fab-400c-a1be-caccbff0abdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5640c9bab43a4877920c02250bf94445'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:54.926301 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7916f4fc-4d9e-4a35-a6ef-cb5a5f0a8fa7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:54.929321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7916f4fc-4d9e-4a35-a6ef-cb5a5f0a8fa7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:54.939785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9c4f61c0-7fab-400c-a1be-caccbff0abdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5640c9bab43a4877920c02250bf94445'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:54.983957 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3339/6630] 10.222.0.39 () {58 vars in 1464 bytes} [Sun Aug 7 01:41:54 2022] DELETE /identity/v3/domains/37c45d9554e34798b41b7da35a409eb4/users/fee1bfd918e649daa820844403012329/roles/b463172ad39a463caf3a45210dade79b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:54.983957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916f4fc-4d9e-4a35-a6ef-cb5a5f0a8fa7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:54.983957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7916f4fc-4d9e-4a35-a6ef-cb5a5f0a8fa7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:54.988784 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3292/6631] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:41:54 2022] DELETE /identity/v3/users/5640c9bab43a4877920c02250bf94445 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:54.989806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f61c0-7fab-400c-a1be-caccbff0abdc admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:54.993306 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9c4f61c0-7fab-400c-a1be-caccbff0abdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:55.135256 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:55.138969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916f4fc-4d9e-4a35-a6ef-cb5a5f0a8fa7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:55.151042 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:55.151528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f61c0-7fab-400c-a1be-caccbff0abdc admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:55.163795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3b7ca-fd26-4099-87d9-2d296ab0c493 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:55.164487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3b7ca-fd26-4099-87d9-2d296ab0c493 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:55.166976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3b7ca-fd26-4099-87d9-2d296ab0c493 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:55.167261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3b7ca-fd26-4099-87d9-2d296ab0c493 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/roles/b463172ad39a463caf3a45210dade79b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:55.169123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3b7ca-fd26-4099-87d9-2d296ab0c493 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b463172ad39a463caf3a45210dade79b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:55.176625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3b7ca-fd26-4099-87d9-2d296ab0c493 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:55.261873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4de3b7ca-fd26-4099-87d9-2d296ab0c493 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invalidating the token cache because role b463172ad39a463caf3a45210dade79b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:55.262333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4de3b7ca-fd26-4099-87d9-2d296ab0c493 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:55.265844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4de3b7ca-fd26-4099-87d9-2d296ab0c493 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:55.276430 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3293/6632] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:41:54 2022] DELETE /identity/v3/roles/b463172ad39a463caf3a45210dade79b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:55.277442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3b7ca-fd26-4099-87d9-2d296ab0c493 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:55.281354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4de3b7ca-fd26-4099-87d9-2d296ab0c493 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:55.308799 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646c4cf-8f29-4fba-9029-56a5003d1175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:55.309840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646c4cf-8f29-4fba-9029-56a5003d1175 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:55.310324 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646c4cf-8f29-4fba-9029-56a5003d1175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:55.311023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646c4cf-8f29-4fba-9029-56a5003d1175 admin admin] PATH_INFO: `/v3/projects/b23ee38431954b77872762278bba918e/users/bbe9245c960c4d7b882d0f71ff30e9e8/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:55.349692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1646c4cf-8f29-4fba-9029-56a5003d1175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b23ee38431954b77872762278bba918e, user_id=bbe9245c960c4d7b882d0f71ff30e9e8, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:55.353475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1646c4cf-8f29-4fba-9029-56a5003d1175 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:55.380878 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3340/6633] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:54 2022] PUT /identity/v3/projects/b23ee38431954b77872762278bba918e/users/bbe9245c960c4d7b882d0f71ff30e9e8/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:55.385873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646c4cf-8f29-4fba-9029-56a5003d1175 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:55.389989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1646c4cf-8f29-4fba-9029-56a5003d1175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:55.414670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3b7ca-fd26-4099-87d9-2d296ab0c493 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:55.486194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646c4cf-8f29-4fba-9029-56a5003d1175 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:55.514661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbf26f-b6e7-40bc-a676-3e539d9eeb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:55.516679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbf26f-b6e7-40bc-a676-3e539d9eeb4b admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:55.517617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbf26f-b6e7-40bc-a676-3e539d9eeb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:55.518642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbf26f-b6e7-40bc-a676-3e539d9eeb4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:55.521672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcbf26f-b6e7-40bc-a676-3e539d9eeb4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:55.532212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcbf26f-b6e7-40bc-a676-3e539d9eeb4b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:55.560138 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3341/6634] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:55.560138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbf26f-b6e7-40bc-a676-3e539d9eeb4b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:55.560138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2dcbf26f-b6e7-40bc-a676-3e539d9eeb4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:55.569743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecee734-4c90-4397-abfc-396d176d35fc tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:55.570567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecee734-4c90-4397-abfc-396d176d35fc tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:55.570925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecee734-4c90-4397-abfc-396d176d35fc tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:55.571243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecee734-4c90-4397-abfc-396d176d35fc tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/domains/37c45d9554e34798b41b7da35a409eb4` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:55.572702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecee734-4c90-4397-abfc-396d176d35fc tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=37c45d9554e34798b41b7da35a409eb4)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:55.574641 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecee734-4c90-4397-abfc-396d176d35fc tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:55.594954 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbf26f-b6e7-40bc-a676-3e539d9eeb4b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:55.620700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47545b-fa7e-42d4-9715-687e1f620c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:55.621768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47545b-fa7e-42d4-9715-687e1f620c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:55.622390 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47545b-fa7e-42d4-9715-687e1f620c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:55.622673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47545b-fa7e-42d4-9715-687e1f620c92 admin admin] PATH_INFO: `/v3/projects/18d589b917ad42a88d3132d3669c6d59` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:55.626061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47545b-fa7e-42d4-9715-687e1f620c92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18d589b917ad42a88d3132d3669c6d59)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:55.628648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47545b-fa7e-42d4-9715-687e1f620c92 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:55.636305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3ecee734-4c90-4397-abfc-396d176d35fc tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '37c45d9554e34798b41b7da35a409eb4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:55.636305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3ecee734-4c90-4397-abfc-396d176d35fc tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '37c45d9554e34798b41b7da35a409eb4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:55.685210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3ecee734-4c90-4397-abfc-396d176d35fc tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '37c45d9554e34798b41b7da35a409eb4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:55.690034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3ecee734-4c90-4397-abfc-396d176d35fc tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '37c45d9554e34798b41b7da35a409eb4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:55.696009 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3294/6635] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:41:55 2022] PATCH /identity/v3/domains/37c45d9554e34798b41b7da35a409eb4 => generated 278 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:55.696009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecee734-4c90-4397-abfc-396d176d35fc tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:55.696009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3ecee734-4c90-4397-abfc-396d176d35fc tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:55.696451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5c47545b-fa7e-42d4-9715-687e1f620c92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18d589b917ad42a88d3132d3669c6d59', 'request_id': 'req-5c47545b-fa7e-42d4-9715-687e1f620c92'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:55.703929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5c47545b-fa7e-42d4-9715-687e1f620c92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18d589b917ad42a88d3132d3669c6d59', 'request_id': 'req-5c47545b-fa7e-42d4-9715-687e1f620c92'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:55.713911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5c47545b-fa7e-42d4-9715-687e1f620c92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18d589b917ad42a88d3132d3669c6d59', 'request_id': 'req-5c47545b-fa7e-42d4-9715-687e1f620c92'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:55.730527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5c47545b-fa7e-42d4-9715-687e1f620c92 admin admin] The token cache is being invalidate because project 18d589b917ad42a88d3132d3669c6d59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:55.730942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5c47545b-fa7e-42d4-9715-687e1f620c92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:55.731951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5c47545b-fa7e-42d4-9715-687e1f620c92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:55.734179 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3342/6636] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:41:55 2022] DELETE /identity/v3/projects/18d589b917ad42a88d3132d3669c6d59 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:55.735131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47545b-fa7e-42d4-9715-687e1f620c92 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:55.736787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5c47545b-fa7e-42d4-9715-687e1f620c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:55.753022 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:55.754826 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:55.802556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecee734-4c90-4397-abfc-396d176d35fc tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:55.827190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47545b-fa7e-42d4-9715-687e1f620c92 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:55.835068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30e0afb-29d2-486b-9208-534f28a8ed36 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:55.835727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e0afb-29d2-486b-9208-534f28a8ed36 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:55.836046 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e0afb-29d2-486b-9208-534f28a8ed36 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:55.836320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30e0afb-29d2-486b-9208-534f28a8ed36 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/domains/37c45d9554e34798b41b7da35a409eb4` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:55.851178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e0afb-29d2-486b-9208-534f28a8ed36 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=37c45d9554e34798b41b7da35a409eb4)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:55.853416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30e0afb-29d2-486b-9208-534f28a8ed36 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:55.886779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b30e0afb-29d2-486b-9208-534f28a8ed36 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '37c45d9554e34798b41b7da35a409eb4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:55.902356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b30e0afb-29d2-486b-9208-534f28a8ed36 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '37c45d9554e34798b41b7da35a409eb4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:55.915729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518a80e-8753-4114-8e08-10242a276fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:55.916475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518a80e-8753-4114-8e08-10242a276fa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:55.916756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518a80e-8753-4114-8e08-10242a276fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:55.917173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518a80e-8753-4114-8e08-10242a276fa8 admin admin] PATH_INFO: `/v3/projects/b23ee38431954b77872762278bba918e/users/bbe9245c960c4d7b882d0f71ff30e9e8/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:55.919425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518a80e-8753-4114-8e08-10242a276fa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b23ee38431954b77872762278bba918e, user_id=bbe9245c960c4d7b882d0f71ff30e9e8, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:55.922734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518a80e-8753-4114-8e08-10242a276fa8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:55.954976 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3295/6637] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:55 2022] PUT /identity/v3/projects/b23ee38431954b77872762278bba918e/users/bbe9245c960c4d7b882d0f71ff30e9e8/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:55.957271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449932a4-2afb-4fd7-ac01-553d77e0bc6e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:55.957759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449932a4-2afb-4fd7-ac01-553d77e0bc6e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:55.958238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449932a4-2afb-4fd7-ac01-553d77e0bc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:56.002140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-449932a4-2afb-4fd7-ac01-553d77e0bc6e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:56.008658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-449932a4-2afb-4fd7-ac01-553d77e0bc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:56.020756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b30e0afb-29d2-486b-9208-534f28a8ed36 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37c45d9554e34798b41b7da35a409eb4', 'request_id': 'req-b30e0afb-29d2-486b-9208-534f28a8ed36'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:56.029703 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b30e0afb-29d2-486b-9208-534f28a8ed36 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37c45d9554e34798b41b7da35a409eb4', 'request_id': 'req-b30e0afb-29d2-486b-9208-534f28a8ed36'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:56.038611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b30e0afb-29d2-486b-9208-534f28a8ed36 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37c45d9554e34798b41b7da35a409eb4', 'request_id': 'req-b30e0afb-29d2-486b-9208-534f28a8ed36'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:56.065336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b30e0afb-29d2-486b-9208-534f28a8ed36 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] The token cache is being invalidate because project 37c45d9554e34798b41b7da35a409eb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:56.065574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b30e0afb-29d2-486b-9208-534f28a8ed36 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:56.066756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b30e0afb-29d2-486b-9208-534f28a8ed36 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:56.077717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b30e0afb-29d2-486b-9208-534f28a8ed36 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '37c45d9554e34798b41b7da35a409eb4', 'request_id': 'req-b30e0afb-29d2-486b-9208-534f28a8ed36'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:56.082524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b30e0afb-29d2-486b-9208-534f28a8ed36 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '37c45d9554e34798b41b7da35a409eb4', 'request_id': 'req-b30e0afb-29d2-486b-9208-534f28a8ed36'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:56.083389 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b30e0afb-29d2-486b-9208-534f28a8ed36 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '37c45d9554e34798b41b7da35a409eb4', 'request_id': 'req-b30e0afb-29d2-486b-9208-534f28a8ed36'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:56.090843 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3343/6638] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:41:55 2022] DELETE /identity/v3/domains/37c45d9554e34798b41b7da35a409eb4 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:56.092330 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4480116-a751-4774-8fb2-f36eb4407602 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:56.092684 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4480116-a751-4774-8fb2-f36eb4407602 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:56.093030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4480116-a751-4774-8fb2-f36eb4407602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:56.114471 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3296/6639] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:56.115805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449932a4-2afb-4fd7-ac01-553d77e0bc6e None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:56.118260 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-449932a4-2afb-4fd7-ac01-553d77e0bc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:56.139519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f4480116-a751-4774-8fb2-f36eb4407602 None None] MFA Rules not processed for user `bbe9245c960c4d7b882d0f71ff30e9e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:56.141754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f4480116-a751-4774-8fb2-f36eb4407602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:56.215504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449932a4-2afb-4fd7-ac01-553d77e0bc6e None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:56.234002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44146ad1-98b2-41cd-b87e-c6471ab739a3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:56.234654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44146ad1-98b2-41cd-b87e-c6471ab739a3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:56.234935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44146ad1-98b2-41cd-b87e-c6471ab739a3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:56.235211 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44146ad1-98b2-41cd-b87e-c6471ab739a3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:56.236301 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:56.236495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44146ad1-98b2-41cd-b87e-c6471ab739a3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:56.238647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44146ad1-98b2-41cd-b87e-c6471ab739a3 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:56.264659 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3297/6640] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:56.266437 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5d10e-ca82-4876-aa21-69e35370c14a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:56.266726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5d10e-ca82-4876-aa21-69e35370c14a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:56.271831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5d10e-ca82-4876-aa21-69e35370c14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:56.285574 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3344/6641] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:56 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:56.286692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4480116-a751-4774-8fb2-f36eb4407602 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:56.312439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4480116-a751-4774-8fb2-f36eb4407602 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:56.319084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1cd5d10e-ca82-4876-aa21-69e35370c14a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:56.320346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1cd5d10e-ca82-4876-aa21-69e35370c14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:56.326438 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad950dd-177b-4e8f-8804-499f98b8c617 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:56.327131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad950dd-177b-4e8f-8804-499f98b8c617 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:56.327416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad950dd-177b-4e8f-8804-499f98b8c617 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:56.327695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad950dd-177b-4e8f-8804-499f98b8c617 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/projects/e6725a6a133d4433a5606d033590c90d/users/73040768ca7e4688a63574524be101a1/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:56.335693 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad950dd-177b-4e8f-8804-499f98b8c617 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e6725a6a133d4433a5606d033590c90d, user_id=73040768ca7e4688a63574524be101a1, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:56.336157 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3298/6642] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:56.337222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5d10e-ca82-4876-aa21-69e35370c14a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:56.338772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1cd5d10e-ca82-4876-aa21-69e35370c14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:56.338916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad950dd-177b-4e8f-8804-499f98b8c617 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:56.347278 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:56.364845 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3345/6643] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:56 2022] PUT /identity/v3/projects/e6725a6a133d4433a5606d033590c90d/users/73040768ca7e4688a63574524be101a1/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:56.366275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad950dd-177b-4e8f-8804-499f98b8c617 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:56.459347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5d10e-ca82-4876-aa21-69e35370c14a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:56.477712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad950dd-177b-4e8f-8804-499f98b8c617 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:56.497781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c76e9-6280-46fe-9fac-7927f57d52f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:56.498441 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c76e9-6280-46fe-9fac-7927f57d52f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:56.500658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c76e9-6280-46fe-9fac-7927f57d52f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:56.500959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c76e9-6280-46fe-9fac-7927f57d52f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:56.502437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c76e9-6280-46fe-9fac-7927f57d52f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:41:56.503844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c76e9-6280-46fe-9fac-7927f57d52f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:56.508291 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1c76e9-6280-46fe-9fac-7927f57d52f5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:56.549116 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3346/6644] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:56.550115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c76e9-6280-46fe-9fac-7927f57d52f5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:56.661123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb1dcd-43b0-45d2-9b30-d054205f75c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:56.663257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb1dcd-43b0-45d2-9b30-d054205f75c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:56.664859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb1dcd-43b0-45d2-9b30-d054205f75c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:56.665951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb1dcd-43b0-45d2-9b30-d054205f75c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:56.701395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c76e9-6280-46fe-9fac-7927f57d52f5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:56.715334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ecb970-ad13-4705-b7a9-61bcb7d748aa tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:56.716293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecb970-ad13-4705-b7a9-61bcb7d748aa tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:56.718355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecb970-ad13-4705-b7a9-61bcb7d748aa tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:56.718719 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecb970-ad13-4705-b7a9-61bcb7d748aa tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:56.719852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ecb970-ad13-4705-b7a9-61bcb7d748aa tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:56.937185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ecb970-ad13-4705-b7a9-61bcb7d748aa tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:56.940085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb1dcd-43b0-45d2-9b30-d054205f75c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:56.940085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb1dcd-43b0-45d2-9b30-d054205f75c2 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:56.940085 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3299/6645] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:56 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:56.940085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb1dcd-43b0-45d2-9b30-d054205f75c2 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:56.941150 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3347/6646] 10.222.0.39 () {58 vars in 1146 bytes} [Sun Aug 7 01:41:56 2022] GET /identity/v3/auth/projects => generated 824 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:41:56.941150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ecb970-ad13-4705-b7a9-61bcb7d748aa tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:56.941737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb1dcd-43b0-45d2-9b30-d054205f75c2 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:56.941737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa809a0-e403-40a9-aa2c-2da0bc3b0689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:56.942638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ecb970-ad13-4705-b7a9-61bcb7d748aa tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:56.943221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa809a0-e403-40a9-aa2c-2da0bc3b0689 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:56.943221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa809a0-e403-40a9-aa2c-2da0bc3b0689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:56.943221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa809a0-e403-40a9-aa2c-2da0bc3b0689 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:56.943221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa809a0-e403-40a9-aa2c-2da0bc3b0689 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:56.943221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa809a0-e403-40a9-aa2c-2da0bc3b0689 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:56.944037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537e69b-a09a-4562-9f50-6bf755050ac0 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:56.944037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537e69b-a09a-4562-9f50-6bf755050ac0 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:56.944037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537e69b-a09a-4562-9f50-6bf755050ac0 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:56.944503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537e69b-a09a-4562-9f50-6bf755050ac0 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/projects/e6725a6a133d4433a5606d033590c90d/users/73040768ca7e4688a63574524be101a1/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:56.944503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537e69b-a09a-4562-9f50-6bf755050ac0 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=e6725a6a133d4433a5606d033590c90d, user_id=73040768ca7e4688a63574524be101a1, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:56.944503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537e69b-a09a-4562-9f50-6bf755050ac0 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:56.944503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8537e69b-a09a-4562-9f50-6bf755050ac0 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invalidating the token cache because role 695b07606e564668bac7afff4ab6052a was removed from user 73040768ca7e4688a63574524be101a1 on project e6725a6a133d4433a5606d033590c90d. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:56.945134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8537e69b-a09a-4562-9f50-6bf755050ac0 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:56.945134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8537e69b-a09a-4562-9f50-6bf755050ac0 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:56.950362 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:56.963634 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3300/6647] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:56 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:56.965949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa809a0-e403-40a9-aa2c-2da0bc3b0689 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:56.973097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-aaa809a0-e403-40a9-aa2c-2da0bc3b0689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:56.984151 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3348/6648] 10.222.0.39 () {58 vars in 1467 bytes} [Sun Aug 7 01:41:56 2022] DELETE /identity/v3/projects/e6725a6a133d4433a5606d033590c90d/users/73040768ca7e4688a63574524be101a1/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:56.986152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537e69b-a09a-4562-9f50-6bf755050ac0 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:56.992058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8537e69b-a09a-4562-9f50-6bf755050ac0 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:57.092776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537e69b-a09a-4562-9f50-6bf755050ac0 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:57.129723 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:57.159192 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa809a0-e403-40a9-aa2c-2da0bc3b0689 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:57.171331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111e99d-639d-4a32-a683-dedc3dac9ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:57.172631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111e99d-639d-4a32-a683-dedc3dac9ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:57.172824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111e99d-639d-4a32-a683-dedc3dac9ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:57.173121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111e99d-639d-4a32-a683-dedc3dac9ad5 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:57.174409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7111e99d-639d-4a32-a683-dedc3dac9ad5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:57.176422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7111e99d-639d-4a32-a683-dedc3dac9ad5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:57.213373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0fe73-a269-4d0e-8a91-1a09a8fdc470 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:57.214356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0fe73-a269-4d0e-8a91-1a09a8fdc470 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:57.214761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0fe73-a269-4d0e-8a91-1a09a8fdc470 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:57.215253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0fe73-a269-4d0e-8a91-1a09a8fdc470 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:57.216177 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0fe73-a269-4d0e-8a91-1a09a8fdc470 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:57.218931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0fe73-a269-4d0e-8a91-1a09a8fdc470 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:57.231708 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3301/6649] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:41:56 2022] POST /identity/v3/users => generated 294 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:57.235225 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111e99d-639d-4a32-a683-dedc3dac9ad5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:57.258651 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3349/6650] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:41:56 2022] POST /identity/v3/users => generated 323 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:57.263487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0fe73-a269-4d0e-8a91-1a09a8fdc470 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:57.277583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0fe73-a269-4d0e-8a91-1a09a8fdc470 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:57.289136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111e99d-639d-4a32-a683-dedc3dac9ad5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:57.289806 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138981e-d553-483c-8892-27f59a2d8be7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:57.290393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138981e-d553-483c-8892-27f59a2d8be7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:57.290677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138981e-d553-483c-8892-27f59a2d8be7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:57.290955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138981e-d553-483c-8892-27f59a2d8be7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:57.291595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138981e-d553-483c-8892-27f59a2d8be7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:57.295745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a047ef6-eb17-455f-8f7e-860c694c5c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:57.298868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a047ef6-eb17-455f-8f7e-860c694c5c42 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:57.301244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a047ef6-eb17-455f-8f7e-860c694c5c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:57.301244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a047ef6-eb17-455f-8f7e-860c694c5c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:57.301244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a047ef6-eb17-455f-8f7e-860c694c5c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:57.304971 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a047ef6-eb17-455f-8f7e-860c694c5c42 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:57.325645 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3302/6651] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:57.329951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a047ef6-eb17-455f-8f7e-860c694c5c42 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:57.331444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138981e-d553-483c-8892-27f59a2d8be7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:57.348707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a047ef6-eb17-455f-8f7e-860c694c5c42 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:57.357499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea6bbf-c35f-4be6-8ab4-dd1d54f22ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:57.358251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea6bbf-c35f-4be6-8ab4-dd1d54f22ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:57.358549 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea6bbf-c35f-4be6-8ab4-dd1d54f22ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:57.358822 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea6bbf-c35f-4be6-8ab4-dd1d54f22ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:57.359478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea6bbf-c35f-4be6-8ab4-dd1d54f22ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:57.372539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea6bbf-c35f-4be6-8ab4-dd1d54f22ef4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:57.403345 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3303/6652] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:41:57.405635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea6bbf-c35f-4be6-8ab4-dd1d54f22ef4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:57.427774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea6bbf-c35f-4be6-8ab4-dd1d54f22ef4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:57.440680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38bd43e-c83a-4a85-ba36-c12292b81eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:57.440895 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3350/6653] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:57 2022] POST /identity/v3/projects => generated 363 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:57.441824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bd43e-c83a-4a85-ba36-c12292b81eb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:57.442310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bd43e-c83a-4a85-ba36-c12292b81eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:57.442783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bd43e-c83a-4a85-ba36-c12292b81eb8 admin admin] PATH_INFO: `/v3/projects/17689d9fb2cc43af87779fbbb399ba24/users/799efc4d6d774eb0801e2ea64a56e29b/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:57.444947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138981e-d553-483c-8892-27f59a2d8be7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:57.472140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38bd43e-c83a-4a85-ba36-c12292b81eb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17689d9fb2cc43af87779fbbb399ba24, user_id=799efc4d6d774eb0801e2ea64a56e29b, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:57.476897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38bd43e-c83a-4a85-ba36-c12292b81eb8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:57.504593 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3304/6654] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:57 2022] PUT /identity/v3/projects/17689d9fb2cc43af87779fbbb399ba24/users/799efc4d6d774eb0801e2ea64a56e29b/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:57.516137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765e73f-9363-4064-96bb-74f6591195cc None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:57.516431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765e73f-9363-4064-96bb-74f6591195cc None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:57.516680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765e73f-9363-4064-96bb-74f6591195cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:57.570894 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1765e73f-9363-4064-96bb-74f6591195cc None None] MFA Rules not processed for user `799efc4d6d774eb0801e2ea64a56e29b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:57.573210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1765e73f-9363-4064-96bb-74f6591195cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:57.575523 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138981e-d553-483c-8892-27f59a2d8be7 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:57.627070 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:57.705000 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c4446-6983-4fbb-b13c-6ab1f101ba19 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:57.705912 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c4446-6983-4fbb-b13c-6ab1f101ba19 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:57.706458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c4446-6983-4fbb-b13c-6ab1f101ba19 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:57.706839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c4446-6983-4fbb-b13c-6ab1f101ba19 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:57.708163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c4446-6983-4fbb-b13c-6ab1f101ba19 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:57.709357 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3305/6655] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:57.710144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c4446-6983-4fbb-b13c-6ab1f101ba19 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:57.717413 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765e73f-9363-4064-96bb-74f6591195cc None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:57.717413 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1765e73f-9363-4064-96bb-74f6591195cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:57.757547 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3351/6656] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:57 2022] POST /identity/v3/projects => generated 364 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:41:57.757547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c4446-6983-4fbb-b13c-6ab1f101ba19 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:57.839929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765e73f-9363-4064-96bb-74f6591195cc None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:57.871813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c4446-6983-4fbb-b13c-6ab1f101ba19 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:57.896163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d675df-d7f3-4afa-b89e-b2eeb5fe3db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:57.897413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d675df-d7f3-4afa-b89e-b2eeb5fe3db1 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:57.897783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d675df-d7f3-4afa-b89e-b2eeb5fe3db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:57.898221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d675df-d7f3-4afa-b89e-b2eeb5fe3db1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:57.899127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d675df-d7f3-4afa-b89e-b2eeb5fe3db1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:57.901468 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d675df-d7f3-4afa-b89e-b2eeb5fe3db1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:57.926559 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:57.967024 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3352/6657] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:57 2022] POST /identity/v3/projects => generated 385 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:57.967898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d675df-d7f3-4afa-b89e-b2eeb5fe3db1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:57.972309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41fc051-045d-4135-a185-39ba41a50beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:57.973193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fc051-045d-4135-a185-39ba41a50beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:57.974055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fc051-045d-4135-a185-39ba41a50beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:57.974055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41fc051-045d-4135-a185-39ba41a50beb admin admin] PATH_INFO: `/v3/users/904a756643e348eaa801946a6b0e3bd3` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:57.975967 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41fc051-045d-4135-a185-39ba41a50beb admin admin] RBAC: Authorizing `identity:delete_user(user_id=904a756643e348eaa801946a6b0e3bd3)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:57.980021 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41fc051-045d-4135-a185-39ba41a50beb admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:58.057201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c41fc051-045d-4135-a185-39ba41a50beb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '904a756643e348eaa801946a6b0e3bd3'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:58.078439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c41fc051-045d-4135-a185-39ba41a50beb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '904a756643e348eaa801946a6b0e3bd3'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:58.094423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c41fc051-045d-4135-a185-39ba41a50beb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '904a756643e348eaa801946a6b0e3bd3'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:58.095262 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c41fc051-045d-4135-a185-39ba41a50beb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '904a756643e348eaa801946a6b0e3bd3'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:58.109713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c41fc051-045d-4135-a185-39ba41a50beb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '904a756643e348eaa801946a6b0e3bd3'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:58.113221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d675df-d7f3-4afa-b89e-b2eeb5fe3db1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:58.117966 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3306/6658] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:41:57 2022] DELETE /identity/v3/users/904a756643e348eaa801946a6b0e3bd3 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:58.118982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41fc051-045d-4135-a185-39ba41a50beb admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:58.120763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c41fc051-045d-4135-a185-39ba41a50beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:58.124516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c06978-38bb-448e-8f81-de8429a49721 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:58.133088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c06978-38bb-448e-8f81-de8429a49721 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:58.133504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c06978-38bb-448e-8f81-de8429a49721 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:58.134513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c06978-38bb-448e-8f81-de8429a49721 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:58.148942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c06978-38bb-448e-8f81-de8429a49721 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:58.150584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c06978-38bb-448e-8f81-de8429a49721 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:58.185413 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3353/6659] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:41:57 2022] POST /identity/v3/roles => generated 239 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:58.191210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028f2b6-44c7-4af4-9bc5-3f6c11cc4029 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:58.191744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028f2b6-44c7-4af4-9bc5-3f6c11cc4029 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:58.192250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028f2b6-44c7-4af4-9bc5-3f6c11cc4029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:58.219849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2028f2b6-44c7-4af4-9bc5-3f6c11cc4029 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:58.222251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2028f2b6-44c7-4af4-9bc5-3f6c11cc4029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:58.268967 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41fc051-045d-4135-a185-39ba41a50beb admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:58.271878 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:58.283156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15252286-2c7f-4e67-a3a9-fd29aa0bd06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:58.283932 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15252286-2c7f-4e67-a3a9-fd29aa0bd06c admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:58.285651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15252286-2c7f-4e67-a3a9-fd29aa0bd06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:58.285935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15252286-2c7f-4e67-a3a9-fd29aa0bd06c admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:58.286586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15252286-2c7f-4e67-a3a9-fd29aa0bd06c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:58.289535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15252286-2c7f-4e67-a3a9-fd29aa0bd06c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:58.336916 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3307/6660] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:41:58 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:58.337750 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15252286-2c7f-4e67-a3a9-fd29aa0bd06c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:58.340327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-15252286-2c7f-4e67-a3a9-fd29aa0bd06c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:58.364245 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3354/6661] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:58.365918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2028f2b6-44c7-4af4-9bc5-3f6c11cc4029 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:58.379754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2028f2b6-44c7-4af4-9bc5-3f6c11cc4029 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:58.389666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2594f-d0f1-454a-b82b-678b07186672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:58.390827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2594f-d0f1-454a-b82b-678b07186672 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:58.390827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2594f-d0f1-454a-b82b-678b07186672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:58.390827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2594f-d0f1-454a-b82b-678b07186672 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:58.393385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2594f-d0f1-454a-b82b-678b07186672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:58.397149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2594f-d0f1-454a-b82b-678b07186672 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:58.414527 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3355/6662] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:58 2022] GET /identity/v3/roles => generated 1650 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:58.415748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2594f-d0f1-454a-b82b-678b07186672 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:58.417490 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e4f2594f-d0f1-454a-b82b-678b07186672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:58.452841 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:58.500091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2594f-d0f1-454a-b82b-678b07186672 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:58.506121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15252286-2c7f-4e67-a3a9-fd29aa0bd06c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:58.506776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d1957-9351-46ee-ae35-1d8a4cdf998e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:58.507494 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d1957-9351-46ee-ae35-1d8a4cdf998e service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:58.507836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d1957-9351-46ee-ae35-1d8a4cdf998e service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:58.508166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d1957-9351-46ee-ae35-1d8a4cdf998e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:58.531815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d1957-9351-46ee-ae35-1d8a4cdf998e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:58.534307 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d1957-9351-46ee-ae35-1d8a4cdf998e service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:58.536912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3684b-9432-4a6e-ab5a-87e0abeacd67 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:58.537960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3684b-9432-4a6e-ab5a-87e0abeacd67 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:58.539758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3684b-9432-4a6e-ab5a-87e0abeacd67 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:58.540284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3684b-9432-4a6e-ab5a-87e0abeacd67 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/projects/99e462d74e444cfaa382b398ccec401b/users/1c9311a3a1104788a9887e32748a291d/roles/cd75e34ce1724fb6a707bded0fb789ed` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:58.546492 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3356/6663] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:41:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:41:58.547171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d1957-9351-46ee-ae35-1d8a4cdf998e service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:58.558778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d1957-9351-46ee-ae35-1d8a4cdf998e service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:58.566448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45101e4f-93d1-4d2e-b722-79c5c3539640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:58.567170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45101e4f-93d1-4d2e-b722-79c5c3539640 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:58.567518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45101e4f-93d1-4d2e-b722-79c5c3539640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:58.567866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45101e4f-93d1-4d2e-b722-79c5c3539640 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:58.569467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45101e4f-93d1-4d2e-b722-79c5c3539640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:58.571955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45101e4f-93d1-4d2e-b722-79c5c3539640 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:58.588130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b3684b-9432-4a6e-ab5a-87e0abeacd67 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:create_grant(project_id=99e462d74e444cfaa382b398ccec401b, user_id=1c9311a3a1104788a9887e32748a291d, role_id=cd75e34ce1724fb6a707bded0fb789ed)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:58.590841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b3684b-9432-4a6e-ab5a-87e0abeacd67 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:58.597957 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3357/6664] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:58 2022] GET /identity/v3/roles => generated 1650 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:58.599364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45101e4f-93d1-4d2e-b722-79c5c3539640 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:58.616680 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3308/6665] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:58 2022] PUT /identity/v3/projects/99e462d74e444cfaa382b398ccec401b/users/1c9311a3a1104788a9887e32748a291d/roles/cd75e34ce1724fb6a707bded0fb789ed => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:58.621044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3684b-9432-4a6e-ab5a-87e0abeacd67 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:58.621481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45101e4f-93d1-4d2e-b722-79c5c3539640 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:58.710572 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d88be3-3b9a-4733-aee9-199a81d39f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:58.711276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d88be3-3b9a-4733-aee9-199a81d39f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:58.711567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d88be3-3b9a-4733-aee9-199a81d39f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:58.711846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d88be3-3b9a-4733-aee9-199a81d39f3d admin admin] PATH_INFO: `/v3/projects/5bcbadc38fb94490aa6fcd6aa6c33c90/users/7734cf4b9307488ba85ddbd4f8e8335f/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:58.746325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d88be3-3b9a-4733-aee9-199a81d39f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bcbadc38fb94490aa6fcd6aa6c33c90, user_id=7734cf4b9307488ba85ddbd4f8e8335f, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:58.749271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d88be3-3b9a-4733-aee9-199a81d39f3d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:58.775631 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3358/6666] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:58 2022] PUT /identity/v3/projects/5bcbadc38fb94490aa6fcd6aa6c33c90/users/7734cf4b9307488ba85ddbd4f8e8335f/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:58.786754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893d681-398d-4767-aecf-bb60dfab057f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:58.787026 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893d681-398d-4767-aecf-bb60dfab057f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:58.787310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893d681-398d-4767-aecf-bb60dfab057f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:58.838087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3684b-9432-4a6e-ab5a-87e0abeacd67 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:58.843532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2893d681-398d-4767-aecf-bb60dfab057f None None] MFA Rules not processed for user `7734cf4b9307488ba85ddbd4f8e8335f`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:58.849566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2893d681-398d-4767-aecf-bb60dfab057f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:58.896502 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:58.980975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c6dbf-f542-4979-b7c4-63db946853cc tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:58.982483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c6dbf-f542-4979-b7c4-63db946853cc tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:58.982850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c6dbf-f542-4979-b7c4-63db946853cc tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:58.983049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c6dbf-f542-4979-b7c4-63db946853cc tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/projects/ce40df1bfc9a4241b5b8df919d1aae9f/users/1c9311a3a1104788a9887e32748a291d/roles/cd75e34ce1724fb6a707bded0fb789ed` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:59.012565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c6dbf-f542-4979-b7c4-63db946853cc tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ce40df1bfc9a4241b5b8df919d1aae9f, user_id=1c9311a3a1104788a9887e32748a291d, role_id=cd75e34ce1724fb6a707bded0fb789ed)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:59.021169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c6dbf-f542-4979-b7c4-63db946853cc tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:59.021558 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3359/6667] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:41:59.022344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893d681-398d-4767-aecf-bb60dfab057f None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:59.029244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2893d681-398d-4767-aecf-bb60dfab057f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:59.057177 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3309/6668] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:58 2022] PUT /identity/v3/projects/ce40df1bfc9a4241b5b8df919d1aae9f/users/1c9311a3a1104788a9887e32748a291d/roles/cd75e34ce1724fb6a707bded0fb789ed => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:59.057177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c6dbf-f542-4979-b7c4-63db946853cc tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:59.199525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893d681-398d-4767-aecf-bb60dfab057f None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:59.200222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c6dbf-f542-4979-b7c4-63db946853cc tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:59.205692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646a3fb-a76a-4ef3-9077-c65caf46bb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:59.206964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646a3fb-a76a-4ef3-9077-c65caf46bb9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:59.207331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac5058-11d9-4452-b67b-e897cf113afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:59.207483 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646a3fb-a76a-4ef3-9077-c65caf46bb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:59.207799 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646a3fb-a76a-4ef3-9077-c65caf46bb9c admin admin] PATH_INFO: `/v3/projects/638a60100a1d460aaf422bae85034f22` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:59.208018 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac5058-11d9-4452-b67b-e897cf113afa admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:59.208316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac5058-11d9-4452-b67b-e897cf113afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:59.208589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac5058-11d9-4452-b67b-e897cf113afa admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:59.209226 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac5058-11d9-4452-b67b-e897cf113afa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:59.209440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646a3fb-a76a-4ef3-9077-c65caf46bb9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=638a60100a1d460aaf422bae85034f22)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:59.211427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646a3fb-a76a-4ef3-9077-c65caf46bb9c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:59.211695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac5058-11d9-4452-b67b-e897cf113afa admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:59.220079 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:59.258175 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3310/6669] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:41:59 2022] POST /identity/v3/projects => generated 385 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:59.259752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb629e-2252-4832-96b0-3e4553bf3c4f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:59.260067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb629e-2252-4832-96b0-3e4553bf3c4f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:59.260577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb629e-2252-4832-96b0-3e4553bf3c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:59.273329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b646a3fb-a76a-4ef3-9077-c65caf46bb9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '638a60100a1d460aaf422bae85034f22', 'request_id': 'req-b646a3fb-a76a-4ef3-9077-c65caf46bb9c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:59.280290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b646a3fb-a76a-4ef3-9077-c65caf46bb9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '638a60100a1d460aaf422bae85034f22', 'request_id': 'req-b646a3fb-a76a-4ef3-9077-c65caf46bb9c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:59.289736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b646a3fb-a76a-4ef3-9077-c65caf46bb9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '638a60100a1d460aaf422bae85034f22', 'request_id': 'req-b646a3fb-a76a-4ef3-9077-c65caf46bb9c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:59.300359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-26eb629e-2252-4832-96b0-3e4553bf3c4f None None] MFA Rules not processed for user `1c9311a3a1104788a9887e32748a291d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:59.303358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-26eb629e-2252-4832-96b0-3e4553bf3c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:59.310645 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3311/6670] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:59 2022] POST /identity/v3/auth/tokens => generated 335 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 01:41:59.311570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb629e-2252-4832-96b0-3e4553bf3c4f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:59.340978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b646a3fb-a76a-4ef3-9077-c65caf46bb9c admin admin] The token cache is being invalidate because project 638a60100a1d460aaf422bae85034f22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:41:59.341275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b646a3fb-a76a-4ef3-9077-c65caf46bb9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:59.341980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b646a3fb-a76a-4ef3-9077-c65caf46bb9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:41:59.350389 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3360/6671] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:41:59 2022] DELETE /identity/v3/projects/638a60100a1d460aaf422bae85034f22 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:59.351927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3730e-da9f-462b-80af-403e9661016d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:59.352229 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3730e-da9f-462b-80af-403e9661016d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:59.352509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3730e-da9f-462b-80af-403e9661016d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:59.375561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-86d3730e-da9f-462b-80af-403e9661016d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:59.396880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-86d3730e-da9f-462b-80af-403e9661016d None None] MFA Rules not processed for user `1c9311a3a1104788a9887e32748a291d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:59.398042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-86d3730e-da9f-462b-80af-403e9661016d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:59.436161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb629e-2252-4832-96b0-3e4553bf3c4f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:59.440925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ebb6f-4f3e-46a2-950f-36a388dcffa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:59.441547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ebb6f-4f3e-46a2-950f-36a388dcffa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:59.441822 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ebb6f-4f3e-46a2-950f-36a388dcffa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:59.442093 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ebb6f-4f3e-46a2-950f-36a388dcffa2 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:59.442988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ebb6f-4f3e-46a2-950f-36a388dcffa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:59.445033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ebb6f-4f3e-46a2-950f-36a388dcffa2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:59.458724 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:41:59.486911 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3312/6672] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:41:59 2022] POST /identity/v3/users => generated 299 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:41:59.499592 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3361/6673] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:59 2022] POST /identity/v3/auth/tokens => generated 3225 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 07 01:41:59.499592 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3730e-da9f-462b-80af-403e9661016d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:59.499592 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-86d3730e-da9f-462b-80af-403e9661016d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:59.511049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da39c3-c979-41d2-b0b9-1b34f3f102f3 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:59.511758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da39c3-c979-41d2-b0b9-1b34f3f102f3 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:59.512265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da39c3-c979-41d2-b0b9-1b34f3f102f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:59.530934 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3730e-da9f-462b-80af-403e9661016d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:59.552271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466af5a1-1aeb-4f05-8cf0-f372c6dfd444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:59.553570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466af5a1-1aeb-4f05-8cf0-f372c6dfd444 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:59.553863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466af5a1-1aeb-4f05-8cf0-f372c6dfd444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:59.554194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466af5a1-1aeb-4f05-8cf0-f372c6dfd444 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:59.554878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466af5a1-1aeb-4f05-8cf0-f372c6dfd444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:59.561804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466af5a1-1aeb-4f05-8cf0-f372c6dfd444 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:59.588562 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3362/6674] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:59 2022] GET /identity/v3/roles => generated 1650 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:59.589565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466af5a1-1aeb-4f05-8cf0-f372c6dfd444 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:59.591970 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-466af5a1-1aeb-4f05-8cf0-f372c6dfd444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:59.610485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-36da39c3-c979-41d2-b0b9-1b34f3f102f3 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:59.617185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-36da39c3-c979-41d2-b0b9-1b34f3f102f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:59.627830 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3313/6675] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:59.629103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da39c3-c979-41d2-b0b9-1b34f3f102f3 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:59.662567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da39c3-c979-41d2-b0b9-1b34f3f102f3 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:59.668051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db125aad-777a-4598-94c7-a50f753a6dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:59.670571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db125aad-777a-4598-94c7-a50f753a6dab admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:59.672711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db125aad-777a-4598-94c7-a50f753a6dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:59.674316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db125aad-777a-4598-94c7-a50f753a6dab admin admin] PATH_INFO: `/v3/projects/23dd807bcbb44610a230e6a39483d77a/users/4c0034e65f0c446698df095467a5968b/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:59.697743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466af5a1-1aeb-4f05-8cf0-f372c6dfd444 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:59.704313 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db125aad-777a-4598-94c7-a50f753a6dab admin admin] RBAC: Authorizing `identity:create_grant(project_id=23dd807bcbb44610a230e6a39483d77a, user_id=4c0034e65f0c446698df095467a5968b, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:59.707135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db125aad-777a-4598-94c7-a50f753a6dab admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:59.718052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a15e28-a474-493f-82dd-1195aa125b3f tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:59.721662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a15e28-a474-493f-82dd-1195aa125b3f tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:59.722061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a15e28-a474-493f-82dd-1195aa125b3f tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:59.722409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a15e28-a474-493f-82dd-1195aa125b3f tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:59.731083 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3314/6676] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:41:59 2022] PUT /identity/v3/projects/23dd807bcbb44610a230e6a39483d77a/users/4c0034e65f0c446698df095467a5968b/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:59.731083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b252a02-5b87-4db8-b1ab-966fcf7e9ba7 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:59.731517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b252a02-5b87-4db8-b1ab-966fcf7e9ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:59.731796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b252a02-5b87-4db8-b1ab-966fcf7e9ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:59.736428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a15e28-a474-493f-82dd-1195aa125b3f tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:59.740354 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a15e28-a474-493f-82dd-1195aa125b3f tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:59.779111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9b252a02-5b87-4db8-b1ab-966fcf7e9ba7 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:59.782509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9b252a02-5b87-4db8-b1ab-966fcf7e9ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:59.786937 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3363/6677] 10.222.0.39 () {56 vars in 1308 bytes} [Sun Aug 7 01:41:59 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:41:59.792099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a15e28-a474-493f-82dd-1195aa125b3f tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:59.829616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a15e28-a474-493f-82dd-1195aa125b3f tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:59.908187 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3315/6678] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:41:59.909503 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf2eef-a09b-45ca-b3a4-0f602a315fb0 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:59.909794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf2eef-a09b-45ca-b3a4-0f602a315fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:59.910072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf2eef-a09b-45ca-b3a4-0f602a315fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:59.924450 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-22cf2eef-a09b-45ca-b3a4-0f602a315fb0 None None] MFA Rules not processed for user `1c9311a3a1104788a9887e32748a291d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:41:59.925627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-22cf2eef-a09b-45ca-b3a4-0f602a315fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:41:59.930161 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72851dae-190a-4551-ab09-cccab119fe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:41:59.930793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72851dae-190a-4551-ab09-cccab119fe41 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:41:59.931074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72851dae-190a-4551-ab09-cccab119fe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:41:59.931343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72851dae-190a-4551-ab09-cccab119fe41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:41:59.932050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72851dae-190a-4551-ab09-cccab119fe41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:41:59.933677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72851dae-190a-4551-ab09-cccab119fe41 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:41:59.952855 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3364/6679] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:41:59 2022] GET /identity/v3/roles => generated 1650 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:41:59.954003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72851dae-190a-4551-ab09-cccab119fe41 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:41:59.969316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72851dae-190a-4551-ab09-cccab119fe41 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:41:59.973088 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:00.006821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95816cca-eca5-4d81-a30c-d4cee131875a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:00.008294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95816cca-eca5-4d81-a30c-d4cee131875a admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:00.009471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95816cca-eca5-4d81-a30c-d4cee131875a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:00.009758 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95816cca-eca5-4d81-a30c-d4cee131875a admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:00.012229 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95816cca-eca5-4d81-a30c-d4cee131875a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:42:00.013160 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95816cca-eca5-4d81-a30c-d4cee131875a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:00.016021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95816cca-eca5-4d81-a30c-d4cee131875a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:00.036871 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3365/6680] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:42:00.037748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95816cca-eca5-4d81-a30c-d4cee131875a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:00.055710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95816cca-eca5-4d81-a30c-d4cee131875a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:00.062396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa90d0-09b1-4c26-8a39-c9bbd35eab41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:00.063282 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa90d0-09b1-4c26-8a39-c9bbd35eab41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:00.063467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa90d0-09b1-4c26-8a39-c9bbd35eab41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:00.063782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa90d0-09b1-4c26-8a39-c9bbd35eab41 admin admin] PATH_INFO: `/v3/projects/23dd807bcbb44610a230e6a39483d77a/users/4c0034e65f0c446698df095467a5968b/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:00.065796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa90d0-09b1-4c26-8a39-c9bbd35eab41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23dd807bcbb44610a230e6a39483d77a, user_id=4c0034e65f0c446698df095467a5968b, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:00.067786 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3316/6681] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:41:59 2022] POST /identity/v3/auth/tokens => generated 3225 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Aug 07 01:42:00.069830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf2eef-a09b-45ca-b3a4-0f602a315fb0 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:00.073226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa90d0-09b1-4c26-8a39-c9bbd35eab41 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:00.089394 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3366/6682] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:00 2022] PUT /identity/v3/projects/23dd807bcbb44610a230e6a39483d77a/users/4c0034e65f0c446698df095467a5968b/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:00.090597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa90d0-09b1-4c26-8a39-c9bbd35eab41 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:00.094120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf2eef-a09b-45ca-b3a4-0f602a315fb0 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:00.168419 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:00.193731 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226630f-11ee-411f-b205-76f88bbd4782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:00.195858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226630f-11ee-411f-b205-76f88bbd4782 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:00.196173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226630f-11ee-411f-b205-76f88bbd4782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:00.196547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226630f-11ee-411f-b205-76f88bbd4782 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:00.198196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226630f-11ee-411f-b205-76f88bbd4782 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:00.202132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226630f-11ee-411f-b205-76f88bbd4782 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:00.223482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa90d0-09b1-4c26-8a39-c9bbd35eab41 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:00.238720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87f82f-e18d-459e-a573-3ac10f658239 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:00.239820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87f82f-e18d-459e-a573-3ac10f658239 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:00.240368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87f82f-e18d-459e-a573-3ac10f658239 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:00.240680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87f82f-e18d-459e-a573-3ac10f658239 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/roles/cd75e34ce1724fb6a707bded0fb789ed` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:00.242734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87f82f-e18d-459e-a573-3ac10f658239 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:delete_role(role_id=cd75e34ce1724fb6a707bded0fb789ed)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:00.246497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef87f82f-e18d-459e-a573-3ac10f658239 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:00.272279 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3317/6683] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:42:00 2022] POST /identity/v3/projects => generated 379 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:00.273792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d70307-2d8e-47d2-b8ab-d70657c44d94 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:00.274080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d70307-2d8e-47d2-b8ab-d70657c44d94 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:00.275322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d70307-2d8e-47d2-b8ab-d70657c44d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:00.307306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ef87f82f-e18d-459e-a573-3ac10f658239 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invalidating the token cache because role cd75e34ce1724fb6a707bded0fb789ed has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:00.307792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ef87f82f-e18d-459e-a573-3ac10f658239 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:00.309398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ef87f82f-e18d-459e-a573-3ac10f658239 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:00.311842 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3367/6684] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:42:00 2022] DELETE /identity/v3/roles/cd75e34ce1724fb6a707bded0fb789ed => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:00.312957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87f82f-e18d-459e-a573-3ac10f658239 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:00.314543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ef87f82f-e18d-459e-a573-3ac10f658239 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:00.362476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-93d70307-2d8e-47d2-b8ab-d70657c44d94 None None] MFA Rules not processed for user `4c0034e65f0c446698df095467a5968b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:00.364225 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-93d70307-2d8e-47d2-b8ab-d70657c44d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:00.424811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef87f82f-e18d-459e-a573-3ac10f658239 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:00.430457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ddeb1-2917-41b4-acdd-6e455834bd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:00.431755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ddeb1-2917-41b4-acdd-6e455834bd31 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:00.432294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ddeb1-2917-41b4-acdd-6e455834bd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:00.432718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ddeb1-2917-41b4-acdd-6e455834bd31 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:00.433525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ddeb1-2917-41b4-acdd-6e455834bd31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:00.435851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ddeb1-2917-41b4-acdd-6e455834bd31 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:00.457681 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3318/6685] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:00.459559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d70307-2d8e-47d2-b8ab-d70657c44d94 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:00.461821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-93d70307-2d8e-47d2-b8ab-d70657c44d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:00.472016 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3368/6686] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:42:00 2022] POST /identity/v3/users => generated 290 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:00.472016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ddeb1-2917-41b4-acdd-6e455834bd31 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:00.473699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-840ddeb1-2917-41b4-acdd-6e455834bd31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:00.486183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ddeb1-2917-41b4-acdd-6e455834bd31 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:00.491915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee2d78-d085-47e6-8506-d1a44cab1371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:00.492552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee2d78-d085-47e6-8506-d1a44cab1371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:00.492830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee2d78-d085-47e6-8506-d1a44cab1371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:00.493100 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee2d78-d085-47e6-8506-d1a44cab1371 admin admin] PATH_INFO: `/v3/users/d24d1853a3e04e499558a8b4e8aaec41` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:00.494263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee2d78-d085-47e6-8506-d1a44cab1371 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d24d1853a3e04e499558a8b4e8aaec41)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:00.496240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee2d78-d085-47e6-8506-d1a44cab1371 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:00.537162 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:00.557108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7eee2d78-d085-47e6-8506-d1a44cab1371 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd24d1853a3e04e499558a8b4e8aaec41'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:00.559772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d70307-2d8e-47d2-b8ab-d70657c44d94 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:00.564967 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb45b0-d144-4149-b124-23708de4e106 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:00.565780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb45b0-d144-4149-b124-23708de4e106 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:00.566129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb45b0-d144-4149-b124-23708de4e106 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:00.566364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7eee2d78-d085-47e6-8506-d1a44cab1371 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd24d1853a3e04e499558a8b4e8aaec41'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:00.566525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb45b0-d144-4149-b124-23708de4e106 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/projects/ce40df1bfc9a4241b5b8df919d1aae9f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:00.567820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb45b0-d144-4149-b124-23708de4e106 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ce40df1bfc9a4241b5b8df919d1aae9f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:00.570052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb45b0-d144-4149-b124-23708de4e106 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:00.584036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7eee2d78-d085-47e6-8506-d1a44cab1371 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd24d1853a3e04e499558a8b4e8aaec41'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:00.585097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7eee2d78-d085-47e6-8506-d1a44cab1371 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd24d1853a3e04e499558a8b4e8aaec41'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:00.594325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7eee2d78-d085-47e6-8506-d1a44cab1371 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd24d1853a3e04e499558a8b4e8aaec41'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:00.603365 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3369/6687] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:42:00 2022] DELETE /identity/v3/users/d24d1853a3e04e499558a8b4e8aaec41 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:00.604978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee2d78-d085-47e6-8506-d1a44cab1371 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:00.607134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7eee2d78-d085-47e6-8506-d1a44cab1371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:00.615206 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=83,keystone:DELETE=13,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:00.625519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1ecb45b0-d144-4149-b124-23708de4e106 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce40df1bfc9a4241b5b8df919d1aae9f', 'request_id': 'req-1ecb45b0-d144-4149-b124-23708de4e106'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:00.631441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1ecb45b0-d144-4149-b124-23708de4e106 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce40df1bfc9a4241b5b8df919d1aae9f', 'request_id': 'req-1ecb45b0-d144-4149-b124-23708de4e106'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:00.638464 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1ecb45b0-d144-4149-b124-23708de4e106 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce40df1bfc9a4241b5b8df919d1aae9f', 'request_id': 'req-1ecb45b0-d144-4149-b124-23708de4e106'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:00.651526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1ecb45b0-d144-4149-b124-23708de4e106 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] The token cache is being invalidate because project ce40df1bfc9a4241b5b8df919d1aae9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:00.651813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1ecb45b0-d144-4149-b124-23708de4e106 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:00.652477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1ecb45b0-d144-4149-b124-23708de4e106 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:00.654324 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3319/6688] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:00 2022] DELETE /identity/v3/projects/ce40df1bfc9a4241b5b8df919d1aae9f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:00.654751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb45b0-d144-4149-b124-23708de4e106 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:00.656115 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1ecb45b0-d144-4149-b124-23708de4e106 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:00.700168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee2d78-d085-47e6-8506-d1a44cab1371 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:00.734424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb45b0-d144-4149-b124-23708de4e106 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:00.739999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96073f-291d-4631-8436-0dd0f6824c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:00.740610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96073f-291d-4631-8436-0dd0f6824c74 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:00.740885 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96073f-291d-4631-8436-0dd0f6824c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:00.741164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96073f-291d-4631-8436-0dd0f6824c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:00.741796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c96073f-291d-4631-8436-0dd0f6824c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:00.743592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c96073f-291d-4631-8436-0dd0f6824c74 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:00.758489 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3320/6689] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:00.758711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcbe69-68e1-4615-be53-aeb3d5a8f207 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:00.758711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcbe69-68e1-4615-be53-aeb3d5a8f207 service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:00.758711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcbe69-68e1-4615-be53-aeb3d5a8f207 service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:00.759246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898858fe-10ff-40b4-b730-60d9ea416ad2 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:00.759371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcbe69-68e1-4615-be53-aeb3d5a8f207 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:00.759472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898858fe-10ff-40b4-b730-60d9ea416ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:00.759472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898858fe-10ff-40b4-b730-60d9ea416ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:00.761148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5cfcbe69-68e1-4615-be53-aeb3d5a8f207 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:00.780604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-898858fe-10ff-40b4-b730-60d9ea416ad2 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:00.781813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-898858fe-10ff-40b4-b730-60d9ea416ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:00.792830 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3321/6690] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:00.793707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898858fe-10ff-40b4-b730-60d9ea416ad2 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:00.808075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-898858fe-10ff-40b4-b730-60d9ea416ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:00.854566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfcbe69-68e1-4615-be53-aeb3d5a8f207 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:00.857471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfcbe69-68e1-4615-be53-aeb3d5a8f207 service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:00.868632 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3370/6691] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:00.869361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcbe69-68e1-4615-be53-aeb3d5a8f207 service cinder] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:00.884757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcbe69-68e1-4615-be53-aeb3d5a8f207 service cinder] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:00.892734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d788d-c131-40f6-8bb8-69d31215d5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:00.893450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d788d-c131-40f6-8bb8-69d31215d5db admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:00.894480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d788d-c131-40f6-8bb8-69d31215d5db admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:00.894874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d788d-c131-40f6-8bb8-69d31215d5db admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:00.899526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d788d-c131-40f6-8bb8-69d31215d5db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:00.901863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d788d-c131-40f6-8bb8-69d31215d5db admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:00.924578 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3371/6692] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:00.925554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d788d-c131-40f6-8bb8-69d31215d5db admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:00.935007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d71d788d-c131-40f6-8bb8-69d31215d5db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:00.968957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898858fe-10ff-40b4-b730-60d9ea416ad2 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:00.968957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed2602-0d39-4418-aae5-679d6d725ce4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:00.970113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed2602-0d39-4418-aae5-679d6d725ce4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:00.970514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed2602-0d39-4418-aae5-679d6d725ce4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:00.971135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed2602-0d39-4418-aae5-679d6d725ce4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/projects/ce40df1bfc9a4241b5b8df919d1aae9f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:00.992710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed2602-0d39-4418-aae5-679d6d725ce4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ce40df1bfc9a4241b5b8df919d1aae9f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:00.996280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed2602-0d39-4418-aae5-679d6d725ce4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:01.014941 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:01.041032 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-d6ed2602-0d39-4418-aae5-679d6d725ce4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Could not find project: ce40df1bfc9a4241b5b8df919d1aae9f.: keystone.exception.ProjectNotFound: Could not find project: ce40df1bfc9a4241b5b8df919d1aae9f. Aug 07 01:42:01.041032 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:42:01.041032 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:42:01.041032 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:42:01.041032 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:42:01.041032 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:42:01.041032 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:42:01.041032 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:42:01.041032 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:42:01.041032 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:42:01.041032 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:42:01.041032 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:42:01.041032 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Aug 07 01:42:01.041032 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Aug 07 01:42:01.042269 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:42:01.042269 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:42:01.042269 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Aug 07 01:42:01.042269 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Aug 07 01:42:01.042269 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 01:42:01.042269 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 01:42:01.042269 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 01:42:01.042269 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 01:42:01.042269 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: ce40df1bfc9a4241b5b8df919d1aae9f. Aug 07 01:42:01.042269 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:42:01.049349 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3322/6693] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:00 2022] DELETE /identity/v3/projects/ce40df1bfc9a4241b5b8df919d1aae9f => generated 113 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:42:01.050582 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed2602-0d39-4418-aae5-679d6d725ce4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:01.055688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d788d-c131-40f6-8bb8-69d31215d5db admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:01.072983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed2602-0d39-4418-aae5-679d6d725ce4 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:01.085024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669ccb7-f393-4024-84a9-1cb25dbd3f42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:01.085963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669ccb7-f393-4024-84a9-1cb25dbd3f42 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:01.086344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669ccb7-f393-4024-84a9-1cb25dbd3f42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:01.086824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bdd9d-418f-4888-b02c-3ed3aa3e0606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:01.086970 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669ccb7-f393-4024-84a9-1cb25dbd3f42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:01.087501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bdd9d-418f-4888-b02c-3ed3aa3e0606 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:01.087977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bdd9d-418f-4888-b02c-3ed3aa3e0606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:01.088255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bdd9d-418f-4888-b02c-3ed3aa3e0606 admin admin] PATH_INFO: `/v3/projects/223f8ed551464993aa605ca6ff77d1fd/users/fb3aa034814c4dbeb5908c7d91f6f83a/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:01.098271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669ccb7-f393-4024-84a9-1cb25dbd3f42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:01.100419 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669ccb7-f393-4024-84a9-1cb25dbd3f42 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:01.109309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070bdd9d-418f-4888-b02c-3ed3aa3e0606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=223f8ed551464993aa605ca6ff77d1fd, user_id=fb3aa034814c4dbeb5908c7d91f6f83a, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:01.113267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070bdd9d-418f-4888-b02c-3ed3aa3e0606 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:01.121403 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3372/6694] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:01.122618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669ccb7-f393-4024-84a9-1cb25dbd3f42 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:01.135239 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:01.152487 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3323/6695] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:01 2022] PUT /identity/v3/projects/223f8ed551464993aa605ca6ff77d1fd/users/fb3aa034814c4dbeb5908c7d91f6f83a/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:01.155755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde78b32-9d1c-483b-bafa-16a065e0f40d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:01.156530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde78b32-9d1c-483b-bafa-16a065e0f40d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:01.156650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde78b32-9d1c-483b-bafa-16a065e0f40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:01.158323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669ccb7-f393-4024-84a9-1cb25dbd3f42 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:01.203632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-cde78b32-9d1c-483b-bafa-16a065e0f40d None None] MFA Rules not processed for user `fb3aa034814c4dbeb5908c7d91f6f83a`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:01.206375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cde78b32-9d1c-483b-bafa-16a065e0f40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:01.286490 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83af44-1fd3-46dc-b2d3-188dbdf2e94a tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:01.287417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83af44-1fd3-46dc-b2d3-188dbdf2e94a tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:01.287705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83af44-1fd3-46dc-b2d3-188dbdf2e94a tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:01.288063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83af44-1fd3-46dc-b2d3-188dbdf2e94a tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/projects/99e462d74e444cfaa382b398ccec401b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:01.289722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f83af44-1fd3-46dc-b2d3-188dbdf2e94a tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:delete_project(project_id=99e462d74e444cfaa382b398ccec401b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:01.291648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f83af44-1fd3-46dc-b2d3-188dbdf2e94a tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:01.319044 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3324/6696] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:01.322024 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde78b32-9d1c-483b-bafa-16a065e0f40d None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:01.391729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0f83af44-1fd3-46dc-b2d3-188dbdf2e94a tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99e462d74e444cfaa382b398ccec401b', 'request_id': 'req-0f83af44-1fd3-46dc-b2d3-188dbdf2e94a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:01.402487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0f83af44-1fd3-46dc-b2d3-188dbdf2e94a tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99e462d74e444cfaa382b398ccec401b', 'request_id': 'req-0f83af44-1fd3-46dc-b2d3-188dbdf2e94a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:01.413861 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0f83af44-1fd3-46dc-b2d3-188dbdf2e94a tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99e462d74e444cfaa382b398ccec401b', 'request_id': 'req-0f83af44-1fd3-46dc-b2d3-188dbdf2e94a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:01.436265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0f83af44-1fd3-46dc-b2d3-188dbdf2e94a tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] The token cache is being invalidate because project 99e462d74e444cfaa382b398ccec401b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:01.436735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0f83af44-1fd3-46dc-b2d3-188dbdf2e94a tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:01.437754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0f83af44-1fd3-46dc-b2d3-188dbdf2e94a tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:01.441854 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3373/6697] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:01 2022] DELETE /identity/v3/projects/99e462d74e444cfaa382b398ccec401b => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:01.449000 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83af44-1fd3-46dc-b2d3-188dbdf2e94a tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:01.449000 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0f83af44-1fd3-46dc-b2d3-188dbdf2e94a tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:01.525143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde78b32-9d1c-483b-bafa-16a065e0f40d None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:01.562251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83af44-1fd3-46dc-b2d3-188dbdf2e94a tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:01.578438 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741f745-17a8-498f-9ae7-2778ddd6fbae tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:01.583826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741f745-17a8-498f-9ae7-2778ddd6fbae tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:01.584623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741f745-17a8-498f-9ae7-2778ddd6fbae tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:01.585087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741f745-17a8-498f-9ae7-2778ddd6fbae tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/users/1c9311a3a1104788a9887e32748a291d` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:01.590236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741f745-17a8-498f-9ae7-2778ddd6fbae tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1c9311a3a1104788a9887e32748a291d)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:01.595206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741f745-17a8-498f-9ae7-2778ddd6fbae tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:01.698452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b2f7c-37f8-435b-bdd3-7649bd97c50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:01.698452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b2f7c-37f8-435b-bdd3-7649bd97c50c admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:01.698452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b2f7c-37f8-435b-bdd3-7649bd97c50c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:01.699822 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b2f7c-37f8-435b-bdd3-7649bd97c50c admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:01.706947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b2f7c-37f8-435b-bdd3-7649bd97c50c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:01.717211 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b2f7c-37f8-435b-bdd3-7649bd97c50c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:01.718212 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:01.772844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a741f745-17a8-498f-9ae7-2778ddd6fbae tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c9311a3a1104788a9887e32748a291d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:01.800589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a741f745-17a8-498f-9ae7-2778ddd6fbae tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c9311a3a1104788a9887e32748a291d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:01.807706 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:01.834949 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3325/6698] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:42:01 2022] POST /identity/v3/projects => generated 379 bytes in 515 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:01.839241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b2f7c-37f8-435b-bdd3-7649bd97c50c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:01.840919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a741f745-17a8-498f-9ae7-2778ddd6fbae tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c9311a3a1104788a9887e32748a291d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:01.842360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0e5b2f7c-37f8-435b-bdd3-7649bd97c50c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:01.842660 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a741f745-17a8-498f-9ae7-2778ddd6fbae tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c9311a3a1104788a9887e32748a291d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:01.857073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a741f745-17a8-498f-9ae7-2778ddd6fbae tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c9311a3a1104788a9887e32748a291d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:01.875529 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3374/6699] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:42:01 2022] DELETE /identity/v3/users/1c9311a3a1104788a9887e32748a291d => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:01.879210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741f745-17a8-498f-9ae7-2778ddd6fbae tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:01.880855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a741f745-17a8-498f-9ae7-2778ddd6fbae tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:01.974603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b2f7c-37f8-435b-bdd3-7649bd97c50c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:02.135726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741f745-17a8-498f-9ae7-2778ddd6fbae tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:02.156845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba29e2-6891-4e16-80b1-42e09fd0dbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:02.158104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba29e2-6891-4e16-80b1-42e09fd0dbcb admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:02.158385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba29e2-6891-4e16-80b1-42e09fd0dbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:02.158655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba29e2-6891-4e16-80b1-42e09fd0dbcb admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:02.159293 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba29e2-6891-4e16-80b1-42e09fd0dbcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:02.161043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301e0a2-d6b0-4f64-8695-5e0957860fbe tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:02.161330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba29e2-6891-4e16-80b1-42e09fd0dbcb admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:02.164441 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301e0a2-d6b0-4f64-8695-5e0957860fbe tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:02.164940 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301e0a2-d6b0-4f64-8695-5e0957860fbe tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:02.165397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301e0a2-d6b0-4f64-8695-5e0957860fbe tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/domains/b70b56f1e3994ed09a1c78cd801a6e2f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:02.176420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301e0a2-d6b0-4f64-8695-5e0957860fbe tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:42:02.185371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-1301e0a2-d6b0-4f64-8695-5e0957860fbe tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Could not find domain: b70b56f1e3994ed09a1c78cd801a6e2f.: keystone.exception.DomainNotFound: Could not find domain: b70b56f1e3994ed09a1c78cd801a6e2f. Aug 07 01:42:02.185371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:42:02.185371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 07 01:42:02.185371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 07 01:42:02.185371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 01:42:02.185371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 01:42:02.185371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 01:42:02.185371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 01:42:02.185371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b70b56f1e3994ed09a1c78cd801a6e2f. Aug 07 01:42:02.185371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:42:02.185371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:42:02.185371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:42:02.185371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:42:02.185371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:42:02.185371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:42:02.185371 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:42:02.186426 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:42:02.186426 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:42:02.186426 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:42:02.186426 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:42:02.186426 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:42:02.186426 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:42:02.186426 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:42:02.186426 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 07 01:42:02.186426 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 07 01:42:02.186426 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:42:02.186426 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:42:02.186426 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:42:02.186426 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:42:02.186426 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:42:02.186426 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:42:02.186426 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:42:02.187449 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:42:02.187449 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:42:02.187449 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:42:02.187449 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:42:02.187449 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 01:42:02.187449 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:42:02.187449 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:42:02.187449 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:42:02.187449 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:42:02.187449 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:42:02.187449 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:42:02.187449 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:42:02.187449 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:42:02.187449 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 07 01:42:02.187449 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:42:02.187449 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b70b56f1e3994ed09a1c78cd801a6e2f. Aug 07 01:42:02.187449 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:42:02.191346 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3375/6700] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:42:01 2022] PATCH /identity/v3/domains/b70b56f1e3994ed09a1c78cd801a6e2f => generated 112 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:42:02.192680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301e0a2-d6b0-4f64-8695-5e0957860fbe tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:02.205186 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3326/6701] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:42:01 2022] POST /identity/v3/users => generated 296 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:42:02.206044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba29e2-6891-4e16-80b1-42e09fd0dbcb admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:02.207287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1301e0a2-d6b0-4f64-8695-5e0957860fbe tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:02.218822 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba29e2-6891-4e16-80b1-42e09fd0dbcb admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:02.226415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301e0a2-d6b0-4f64-8695-5e0957860fbe tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:02.226667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2834090-0cd4-413f-9c8e-8f16ebbe09bd tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:02.227319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2834090-0cd4-413f-9c8e-8f16ebbe09bd tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:02.227661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2834090-0cd4-413f-9c8e-8f16ebbe09bd tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:02.227981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2834090-0cd4-413f-9c8e-8f16ebbe09bd tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/domains/f13e4e6e91794c1d8c9092d2b1cdd96a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:02.236126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f569f6-3ec0-44a6-88e4-d5e61fae4b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:02.236781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f569f6-3ec0-44a6-88e4-d5e61fae4b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:02.237056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f569f6-3ec0-44a6-88e4-d5e61fae4b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:02.237326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f569f6-3ec0-44a6-88e4-d5e61fae4b2a admin admin] PATH_INFO: `/v3/projects/fc3277d05685483d8653428362c29c2e` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:02.237881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2834090-0cd4-413f-9c8e-8f16ebbe09bd tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:42:02.238752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f569f6-3ec0-44a6-88e4-d5e61fae4b2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc3277d05685483d8653428362c29c2e)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:02.241075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f569f6-3ec0-44a6-88e4-d5e61fae4b2a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:02.244199 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-e2834090-0cd4-413f-9c8e-8f16ebbe09bd tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Could not find domain: f13e4e6e91794c1d8c9092d2b1cdd96a.: keystone.exception.DomainNotFound: Could not find domain: f13e4e6e91794c1d8c9092d2b1cdd96a. Aug 07 01:42:02.244199 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:42:02.244199 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 07 01:42:02.244199 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 07 01:42:02.244199 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 01:42:02.244199 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 01:42:02.244199 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 01:42:02.244199 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 01:42:02.244199 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f13e4e6e91794c1d8c9092d2b1cdd96a. Aug 07 01:42:02.244199 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:42:02.244199 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:42:02.244199 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:42:02.244199 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:42:02.244199 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:42:02.244199 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:42:02.244199 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:42:02.246359 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:42:02.246359 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:42:02.246359 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:42:02.246359 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:42:02.246359 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:42:02.246359 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:42:02.246359 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:42:02.246359 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 07 01:42:02.246359 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 07 01:42:02.246359 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:42:02.246359 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:42:02.246359 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:42:02.246359 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:42:02.246359 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:42:02.246359 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:42:02.246359 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:42:02.247855 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:42:02.247855 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:42:02.247855 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:42:02.247855 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:42:02.247855 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 01:42:02.247855 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:42:02.247855 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:42:02.247855 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:42:02.247855 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:42:02.247855 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:42:02.247855 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:42:02.247855 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:42:02.247855 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:42:02.247855 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 07 01:42:02.247855 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:42:02.247855 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f13e4e6e91794c1d8c9092d2b1cdd96a. Aug 07 01:42:02.247855 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:42:02.248916 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3327/6702] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:42:02 2022] PATCH /identity/v3/domains/f13e4e6e91794c1d8c9092d2b1cdd96a => generated 112 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:42:02.248916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2834090-0cd4-413f-9c8e-8f16ebbe09bd tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:02.249384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e2834090-0cd4-413f-9c8e-8f16ebbe09bd tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:02.335308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d0f569f6-3ec0-44a6-88e4-d5e61fae4b2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc3277d05685483d8653428362c29c2e', 'request_id': 'req-d0f569f6-3ec0-44a6-88e4-d5e61fae4b2a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:02.342665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d0f569f6-3ec0-44a6-88e4-d5e61fae4b2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc3277d05685483d8653428362c29c2e', 'request_id': 'req-d0f569f6-3ec0-44a6-88e4-d5e61fae4b2a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:02.347769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2834090-0cd4-413f-9c8e-8f16ebbe09bd tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:02.352239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d0f569f6-3ec0-44a6-88e4-d5e61fae4b2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc3277d05685483d8653428362c29c2e', 'request_id': 'req-d0f569f6-3ec0-44a6-88e4-d5e61fae4b2a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:02.369942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d0f569f6-3ec0-44a6-88e4-d5e61fae4b2a admin admin] The token cache is being invalidate because project fc3277d05685483d8653428362c29c2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:02.370288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d0f569f6-3ec0-44a6-88e4-d5e61fae4b2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:02.371452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d0f569f6-3ec0-44a6-88e4-d5e61fae4b2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:02.373563 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3376/6703] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:02 2022] DELETE /identity/v3/projects/fc3277d05685483d8653428362c29c2e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:02.374752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f569f6-3ec0-44a6-88e4-d5e61fae4b2a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:02.379078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d0f569f6-3ec0-44a6-88e4-d5e61fae4b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:02.405062 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:02.429652 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:02.433802 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ffdab-e5d5-4184-a3cf-e8e812b25bfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:02.434575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ffdab-e5d5-4184-a3cf-e8e812b25bfc service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:02.434697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ffdab-e5d5-4184-a3cf-e8e812b25bfc service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:02.434957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ffdab-e5d5-4184-a3cf-e8e812b25bfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:02.436794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8d2ffdab-e5d5-4184-a3cf-e8e812b25bfc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:02.476243 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f569f6-3ec0-44a6-88e4-d5e61fae4b2a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:02.482457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ca9b3-8b1b-4919-be5f-d27299fc8096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:02.483213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ca9b3-8b1b-4919-be5f-d27299fc8096 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:02.484302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ca9b3-8b1b-4919-be5f-d27299fc8096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:02.484690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ca9b3-8b1b-4919-be5f-d27299fc8096 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:02.485611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ca9b3-8b1b-4919-be5f-d27299fc8096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:02.490472 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ca9b3-8b1b-4919-be5f-d27299fc8096 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:02.508123 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3377/6704] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:02.510945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ca9b3-8b1b-4919-be5f-d27299fc8096 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:02.514191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ae2ca9b3-8b1b-4919-be5f-d27299fc8096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:02.535279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ffdab-e5d5-4184-a3cf-e8e812b25bfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:02.537839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ffdab-e5d5-4184-a3cf-e8e812b25bfc service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:02.550864 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3328/6705] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:02 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:02.552206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ffdab-e5d5-4184-a3cf-e8e812b25bfc service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:02.554203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8d2ffdab-e5d5-4184-a3cf-e8e812b25bfc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:02.573730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ffdab-e5d5-4184-a3cf-e8e812b25bfc service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:02.580162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57de6df-6acb-4ac4-8ac4-88f9efc0b82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:02.580404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57de6df-6acb-4ac4-8ac4-88f9efc0b82c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:02.580704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57de6df-6acb-4ac4-8ac4-88f9efc0b82c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:02.580942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57de6df-6acb-4ac4-8ac4-88f9efc0b82c admin admin] PATH_INFO: `/v3/users/bbe9245c960c4d7b882d0f71ff30e9e8` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:02.582446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57de6df-6acb-4ac4-8ac4-88f9efc0b82c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbe9245c960c4d7b882d0f71ff30e9e8)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:02.585087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57de6df-6acb-4ac4-8ac4-88f9efc0b82c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:02.669560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d57de6df-6acb-4ac4-8ac4-88f9efc0b82c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbe9245c960c4d7b882d0f71ff30e9e8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:02.687279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d57de6df-6acb-4ac4-8ac4-88f9efc0b82c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbe9245c960c4d7b882d0f71ff30e9e8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:02.721923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d57de6df-6acb-4ac4-8ac4-88f9efc0b82c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbe9245c960c4d7b882d0f71ff30e9e8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:02.723414 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d57de6df-6acb-4ac4-8ac4-88f9efc0b82c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbe9245c960c4d7b882d0f71ff30e9e8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:02.737717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d57de6df-6acb-4ac4-8ac4-88f9efc0b82c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbe9245c960c4d7b882d0f71ff30e9e8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:02.749147 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3329/6706] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:42:02 2022] DELETE /identity/v3/users/bbe9245c960c4d7b882d0f71ff30e9e8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:02.765650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57de6df-6acb-4ac4-8ac4-88f9efc0b82c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:02.779947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d57de6df-6acb-4ac4-8ac4-88f9efc0b82c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:02.953656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ca9b3-8b1b-4919-be5f-d27299fc8096 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:02.974148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57de6df-6acb-4ac4-8ac4-88f9efc0b82c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:02.991976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d95a21-c931-47ea-998b-bb65fd09a94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:02.994194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d95a21-c931-47ea-998b-bb65fd09a94f admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:02.994627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d95a21-c931-47ea-998b-bb65fd09a94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:02.995028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d95a21-c931-47ea-998b-bb65fd09a94f admin admin] PATH_INFO: `/v3/projects/972a563fdf43487ea87fb643d1197e5a/users/f5f3f39ba5e34121a7fadeee9324f325/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:03.024061 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:03.035319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d95a21-c931-47ea-998b-bb65fd09a94f admin admin] RBAC: Authorizing `identity:create_grant(project_id=972a563fdf43487ea87fb643d1197e5a, user_id=f5f3f39ba5e34121a7fadeee9324f325, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:03.039002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d95a21-c931-47ea-998b-bb65fd09a94f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:03.073572 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726c7b6-c98e-41f4-ac6a-f0ef50134f96 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:03.074457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726c7b6-c98e-41f4-ac6a-f0ef50134f96 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:03.074989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726c7b6-c98e-41f4-ac6a-f0ef50134f96 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:03.075547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726c7b6-c98e-41f4-ac6a-f0ef50134f96 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/domains/ac75d2559ffa47c3b4a033386e917c80` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:03.083510 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3330/6707] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:02 2022] PUT /identity/v3/projects/972a563fdf43487ea87fb643d1197e5a/users/f5f3f39ba5e34121a7fadeee9324f325/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:03.087453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d95a21-c931-47ea-998b-bb65fd09a94f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:03.093140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726c7b6-c98e-41f4-ac6a-f0ef50134f96 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:42:03.099921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-d726c7b6-c98e-41f4-ac6a-f0ef50134f96 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Could not find domain: ac75d2559ffa47c3b4a033386e917c80.: keystone.exception.DomainNotFound: Could not find domain: ac75d2559ffa47c3b4a033386e917c80. Aug 07 01:42:03.099921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:42:03.099921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 07 01:42:03.099921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 07 01:42:03.099921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 01:42:03.099921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 01:42:03.099921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 01:42:03.099921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 01:42:03.099921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: ac75d2559ffa47c3b4a033386e917c80. Aug 07 01:42:03.099921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:42:03.099921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:42:03.099921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:42:03.099921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:42:03.099921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:42:03.099921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:42:03.099921 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:42:03.101178 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:42:03.101178 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:42:03.101178 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:42:03.101178 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:42:03.101178 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:42:03.101178 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:42:03.101178 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:42:03.101178 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 07 01:42:03.101178 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 07 01:42:03.101178 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:42:03.101178 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:42:03.101178 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:42:03.101178 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:42:03.101178 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:42:03.101178 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:42:03.101178 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:42:03.102249 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:42:03.102249 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:42:03.102249 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:42:03.102249 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:42:03.102249 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 01:42:03.102249 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:42:03.102249 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:42:03.102249 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:42:03.102249 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:42:03.102249 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:42:03.102249 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:42:03.102249 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:42:03.102249 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:42:03.102249 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 07 01:42:03.102249 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:42:03.102249 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: ac75d2559ffa47c3b4a033386e917c80. Aug 07 01:42:03.102249 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:42:03.134648 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3378/6708] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:42:02 2022] PATCH /identity/v3/domains/ac75d2559ffa47c3b4a033386e917c80 => generated 112 bytes in 623 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:42:03.147512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726c7b6-c98e-41f4-ac6a-f0ef50134f96 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:03.155392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d726c7b6-c98e-41f4-ac6a-f0ef50134f96 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:03.209151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726c7b6-c98e-41f4-ac6a-f0ef50134f96 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:03.305541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d95a21-c931-47ea-998b-bb65fd09a94f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:03.331106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ff32d-cf82-4097-b58c-324f7d8a80c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:03.331731 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ff32d-cf82-4097-b58c-324f7d8a80c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:03.332057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ff32d-cf82-4097-b58c-324f7d8a80c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:03.333920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ff32d-cf82-4097-b58c-324f7d8a80c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:03.334595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ff32d-cf82-4097-b58c-324f7d8a80c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:03.342925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ff32d-cf82-4097-b58c-324f7d8a80c2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:03.353136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272a002-9745-4575-96e7-22f4d4dd9003 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73040768ca7e4688a63574524be101a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c28e58b03f724c95be9ff2672a6a78c2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:03.354129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272a002-9745-4575-96e7-22f4d4dd9003 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:03.354576 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272a002-9745-4575-96e7-22f4d4dd9003 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:03.355226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272a002-9745-4575-96e7-22f4d4dd9003 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] PATH_INFO: `/v3/domains/37c45d9554e34798b41b7da35a409eb4` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:03.365086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272a002-9745-4575-96e7-22f4d4dd9003 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:42:03.373436 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-3272a002-9745-4575-96e7-22f4d4dd9003 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Could not find domain: 37c45d9554e34798b41b7da35a409eb4.: keystone.exception.DomainNotFound: Could not find domain: 37c45d9554e34798b41b7da35a409eb4. Aug 07 01:42:03.373436 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:42:03.373436 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 07 01:42:03.373436 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 07 01:42:03.373436 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 01:42:03.373436 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 01:42:03.373436 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 01:42:03.373436 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 01:42:03.373436 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 37c45d9554e34798b41b7da35a409eb4. Aug 07 01:42:03.373436 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:42:03.373436 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:42:03.373436 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:42:03.373436 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:42:03.373436 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:42:03.373436 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:42:03.373436 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:42:03.374758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:42:03.374758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:42:03.374758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:42:03.374758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:42:03.374758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:42:03.374758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:42:03.374758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:42:03.374758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 07 01:42:03.374758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 07 01:42:03.374758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:42:03.374758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:42:03.374758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:42:03.374758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:42:03.374758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:42:03.374758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:42:03.374758 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:42:03.377307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:42:03.377307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:42:03.377307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:42:03.377307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:42:03.377307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 01:42:03.377307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:42:03.377307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:42:03.377307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:42:03.377307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:42:03.377307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:42:03.377307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:42:03.377307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:42:03.377307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:42:03.377307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 07 01:42:03.377307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:42:03.377307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 37c45d9554e34798b41b7da35a409eb4. Aug 07 01:42:03.377307 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:42:03.380592 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3331/6709] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:03.382059 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3379/6710] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:42:03 2022] PATCH /identity/v3/domains/37c45d9554e34798b41b7da35a409eb4 => generated 112 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:42:03.387607 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ff32d-cf82-4097-b58c-324f7d8a80c2 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:03.395801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272a002-9745-4575-96e7-22f4d4dd9003 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:03.399809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ff32d-cf82-4097-b58c-324f7d8a80c2 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:03.402025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3272a002-9745-4575-96e7-22f4d4dd9003 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:03.409837 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d09c6-c5dc-451c-8dd3-1654e059b7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:03.412004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d09c6-c5dc-451c-8dd3-1654e059b7e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:03.412900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d09c6-c5dc-451c-8dd3-1654e059b7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:03.414205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d09c6-c5dc-451c-8dd3-1654e059b7e0 admin admin] PATH_INFO: `/v3/projects/972a563fdf43487ea87fb643d1197e5a/users/f5f3f39ba5e34121a7fadeee9324f325/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:03.427615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d09c6-c5dc-451c-8dd3-1654e059b7e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=972a563fdf43487ea87fb643d1197e5a, user_id=f5f3f39ba5e34121a7fadeee9324f325, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:03.431368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d09c6-c5dc-451c-8dd3-1654e059b7e0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:03.437125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272a002-9745-4575-96e7-22f4d4dd9003 tempest-TokensV3TestJSON-241877603 tempest-TokensV3TestJSON-241877603-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:03.451718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd701365-300b-4e89-aa1c-9e45c18952df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:03.451718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd701365-300b-4e89-aa1c-9e45c18952df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:03.451718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd701365-300b-4e89-aa1c-9e45c18952df admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:03.451718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd701365-300b-4e89-aa1c-9e45c18952df admin admin] PATH_INFO: `/v3/users/69ffb490be73440191f6a22ac5cc718d` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:03.453412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd701365-300b-4e89-aa1c-9e45c18952df admin admin] RBAC: Authorizing `identity:delete_user(user_id=69ffb490be73440191f6a22ac5cc718d)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:03.455869 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd701365-300b-4e89-aa1c-9e45c18952df admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:03.458851 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3332/6711] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:03 2022] PUT /identity/v3/projects/972a563fdf43487ea87fb643d1197e5a/users/f5f3f39ba5e34121a7fadeee9324f325/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:03.472329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591fc50-f85d-43ff-9631-9d7aeaf22354 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:03.472875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591fc50-f85d-43ff-9631-9d7aeaf22354 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:03.473425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591fc50-f85d-43ff-9631-9d7aeaf22354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:03.475814 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:03.536714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e591fc50-f85d-43ff-9631-9d7aeaf22354 None None] MFA Rules not processed for user `f5f3f39ba5e34121a7fadeee9324f325`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:03.542086 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e591fc50-f85d-43ff-9631-9d7aeaf22354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:03.554522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fd701365-300b-4e89-aa1c-9e45c18952df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69ffb490be73440191f6a22ac5cc718d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:03.564444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fd701365-300b-4e89-aa1c-9e45c18952df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69ffb490be73440191f6a22ac5cc718d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:03.578276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fd701365-300b-4e89-aa1c-9e45c18952df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69ffb490be73440191f6a22ac5cc718d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:03.579278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fd701365-300b-4e89-aa1c-9e45c18952df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69ffb490be73440191f6a22ac5cc718d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:03.592130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fd701365-300b-4e89-aa1c-9e45c18952df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69ffb490be73440191f6a22ac5cc718d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:03.600799 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3380/6712] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:42:03 2022] DELETE /identity/v3/users/69ffb490be73440191f6a22ac5cc718d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:03.601698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd701365-300b-4e89-aa1c-9e45c18952df admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:03.603384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fd701365-300b-4e89-aa1c-9e45c18952df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:03.645956 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3333/6713] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:03 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:42:03.647648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144d8e2-b992-4a96-a268-e5f56e2ef156 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:03.648154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144d8e2-b992-4a96-a268-e5f56e2ef156 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:03.648576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144d8e2-b992-4a96-a268-e5f56e2ef156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:03.679456 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3144d8e2-b992-4a96-a268-e5f56e2ef156 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:03.681077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3144d8e2-b992-4a96-a268-e5f56e2ef156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:03.688367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd701365-300b-4e89-aa1c-9e45c18952df admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:03.694540 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3334/6714] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:03.694975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28cd92-5dc1-40d3-a563-42e48380a434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:03.695519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144d8e2-b992-4a96-a268-e5f56e2ef156 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:03.696192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28cd92-5dc1-40d3-a563-42e48380a434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:03.696644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28cd92-5dc1-40d3-a563-42e48380a434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:03.696824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3144d8e2-b992-4a96-a268-e5f56e2ef156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:03.697356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28cd92-5dc1-40d3-a563-42e48380a434 admin admin] PATH_INFO: `/v3/projects/b23ee38431954b77872762278bba918e` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:03.698832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e28cd92-5dc1-40d3-a563-42e48380a434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b23ee38431954b77872762278bba918e)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:03.700981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e28cd92-5dc1-40d3-a563-42e48380a434 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:03.776128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1e28cd92-5dc1-40d3-a563-42e48380a434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b23ee38431954b77872762278bba918e', 'request_id': 'req-1e28cd92-5dc1-40d3-a563-42e48380a434'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:03.784806 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1e28cd92-5dc1-40d3-a563-42e48380a434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b23ee38431954b77872762278bba918e', 'request_id': 'req-1e28cd92-5dc1-40d3-a563-42e48380a434'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:03.794411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1e28cd92-5dc1-40d3-a563-42e48380a434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b23ee38431954b77872762278bba918e', 'request_id': 'req-1e28cd92-5dc1-40d3-a563-42e48380a434'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:03.801938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144d8e2-b992-4a96-a268-e5f56e2ef156 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:03.817096 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:03.822564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1e28cd92-5dc1-40d3-a563-42e48380a434 admin admin] The token cache is being invalidate because project b23ee38431954b77872762278bba918e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:03.822929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1e28cd92-5dc1-40d3-a563-42e48380a434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:03.823735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1e28cd92-5dc1-40d3-a563-42e48380a434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:03.832876 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3381/6715] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:03 2022] DELETE /identity/v3/projects/b23ee38431954b77872762278bba918e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:03.833824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28cd92-5dc1-40d3-a563-42e48380a434 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:03.838342 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1e28cd92-5dc1-40d3-a563-42e48380a434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:03.882716 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:03.925005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1298c4f-9731-4775-82b8-472d604034e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:03.925005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1298c4f-9731-4775-82b8-472d604034e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:03.925005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1298c4f-9731-4775-82b8-472d604034e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:03.925474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1298c4f-9731-4775-82b8-472d604034e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:03.927801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b1298c4f-9731-4775-82b8-472d604034e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:03.950704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28cd92-5dc1-40d3-a563-42e48380a434 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:03.967937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd56ed3-0f41-411e-b1e1-aa89e188d005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:03.967937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd56ed3-0f41-411e-b1e1-aa89e188d005 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:03.967937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd56ed3-0f41-411e-b1e1-aa89e188d005 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:03.967937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd56ed3-0f41-411e-b1e1-aa89e188d005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:03.969507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9bd56ed3-0f41-411e-b1e1-aa89e188d005 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:04.014412 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1298c4f-9731-4775-82b8-472d604034e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:04.016208 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1298c4f-9731-4775-82b8-472d604034e1 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:04.055651 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3335/6716] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:03 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:04.058960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e86e9-3cfe-49e3-a04e-b33a03311c65 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:04.059395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e86e9-3cfe-49e3-a04e-b33a03311c65 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:04.059663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e86e9-3cfe-49e3-a04e-b33a03311c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:04.095575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd56ed3-0f41-411e-b1e1-aa89e188d005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:04.097874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd56ed3-0f41-411e-b1e1-aa89e188d005 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:04.126570 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3382/6717] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:04.132479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3a7e86e9-3cfe-49e3-a04e-b33a03311c65 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:04.134125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3a7e86e9-3cfe-49e3-a04e-b33a03311c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:04.174768 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3336/6718] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:04.189893 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaf3e5-72b8-40ef-bb87-c82dadbeb455 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:04.190738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaf3e5-72b8-40ef-bb87-c82dadbeb455 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:04.190738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaf3e5-72b8-40ef-bb87-c82dadbeb455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:04.229463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6cfaf3e5-72b8-40ef-bb87-c82dadbeb455 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:04.230733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6cfaf3e5-72b8-40ef-bb87-c82dadbeb455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:04.233142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e86e9-3cfe-49e3-a04e-b33a03311c65 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:04.234795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3a7e86e9-3cfe-49e3-a04e-b33a03311c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:04.258634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e86e9-3cfe-49e3-a04e-b33a03311c65 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:04.261912 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3383/6719] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:04.269421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfaf3e5-72b8-40ef-bb87-c82dadbeb455 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:04.287267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906c2fa-ae61-4579-8435-6dc9bfedd981 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:04.287831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906c2fa-ae61-4579-8435-6dc9bfedd981 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:04.288149 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906c2fa-ae61-4579-8435-6dc9bfedd981 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:04.288436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906c2fa-ae61-4579-8435-6dc9bfedd981 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:04.289797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfaf3e5-72b8-40ef-bb87-c82dadbeb455 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:04.297308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f7b6a-a251-4b99-81ee-2de471512cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:04.299566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f7b6a-a251-4b99-81ee-2de471512cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:04.300088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f7b6a-a251-4b99-81ee-2de471512cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:04.300991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f7b6a-a251-4b99-81ee-2de471512cc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:04.301522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e906c2fa-ae61-4579-8435-6dc9bfedd981 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:04.302247 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f7b6a-a251-4b99-81ee-2de471512cc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:42:04.302857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f7b6a-a251-4b99-81ee-2de471512cc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:04.321702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f7b6a-a251-4b99-81ee-2de471512cc3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:04.375791 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3384/6720] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:42:04.377993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f7b6a-a251-4b99-81ee-2de471512cc3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:04.407387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f7b6a-a251-4b99-81ee-2de471512cc3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:04.426524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7fd94d-0250-4ef6-92d7-50b21bb13622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:04.428651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fd94d-0250-4ef6-92d7-50b21bb13622 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:04.432875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fd94d-0250-4ef6-92d7-50b21bb13622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:04.433425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fd94d-0250-4ef6-92d7-50b21bb13622 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:04.435095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7fd94d-0250-4ef6-92d7-50b21bb13622 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:04.438551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7fd94d-0250-4ef6-92d7-50b21bb13622 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:04.495367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906c2fa-ae61-4579-8435-6dc9bfedd981 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:04.500126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906c2fa-ae61-4579-8435-6dc9bfedd981 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:04.523567 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3385/6721] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:42:04 2022] POST /identity/v3/projects => generated 397 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:04.540031 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7fd94d-0250-4ef6-92d7-50b21bb13622 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:04.544134 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3337/6722] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:04.768773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7fd94d-0250-4ef6-92d7-50b21bb13622 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:04.793175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906c2fa-ae61-4579-8435-6dc9bfedd981 service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:04.793175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e906c2fa-ae61-4579-8435-6dc9bfedd981 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:04.801803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9d14d-8d2a-4287-a767-4823e53284b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:04.802435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9d14d-8d2a-4287-a767-4823e53284b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:04.802766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9d14d-8d2a-4287-a767-4823e53284b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:04.803038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa9d14d-8d2a-4287-a767-4823e53284b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:04.803662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9d14d-8d2a-4287-a767-4823e53284b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:04.805795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa9d14d-8d2a-4287-a767-4823e53284b4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:04.817585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906c2fa-ae61-4579-8435-6dc9bfedd981 service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:04.823115 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca11d2-965c-439c-8aad-de389082cad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:04.823900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca11d2-965c-439c-8aad-de389082cad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:04.824316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca11d2-965c-439c-8aad-de389082cad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:04.824688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca11d2-965c-439c-8aad-de389082cad8 admin admin] PATH_INFO: `/v3/projects/e6725a6a133d4433a5606d033590c90d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:04.826441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca11d2-965c-439c-8aad-de389082cad8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6725a6a133d4433a5606d033590c90d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:04.861446 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3386/6723] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:42:04 2022] POST /identity/v3/users => generated 299 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:04.865823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9d14d-8d2a-4287-a767-4823e53284b4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:04.866810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca11d2-965c-439c-8aad-de389082cad8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:04.887294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa9d14d-8d2a-4287-a767-4823e53284b4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:04.893622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce216170-070a-4bbf-abd1-76d84455ca3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:04.894844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce216170-070a-4bbf-abd1-76d84455ca3c admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:04.894844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce216170-070a-4bbf-abd1-76d84455ca3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:04.895003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce216170-070a-4bbf-abd1-76d84455ca3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:04.895791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce216170-070a-4bbf-abd1-76d84455ca3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:04.897769 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce216170-070a-4bbf-abd1-76d84455ca3c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:04.911028 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3387/6724] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:42:04.914831 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce216170-070a-4bbf-abd1-76d84455ca3c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:04.921082 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:04.934264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce216170-070a-4bbf-abd1-76d84455ca3c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:04.946163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ca32a-69ba-46bf-bb6d-c94b3e067622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:04.948579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ca32a-69ba-46bf-bb6d-c94b3e067622 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:04.949498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ca32a-69ba-46bf-bb6d-c94b3e067622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:04.950554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ca32a-69ba-46bf-bb6d-c94b3e067622 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:04.951225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ca32a-69ba-46bf-bb6d-c94b3e067622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:04.954859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ca32a-69ba-46bf-bb6d-c94b3e067622 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:04.957565 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:04.962039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d7ca11d2-965c-439c-8aad-de389082cad8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6725a6a133d4433a5606d033590c90d', 'request_id': 'req-d7ca11d2-965c-439c-8aad-de389082cad8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:04.975004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d7ca11d2-965c-439c-8aad-de389082cad8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6725a6a133d4433a5606d033590c90d', 'request_id': 'req-d7ca11d2-965c-439c-8aad-de389082cad8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:04.983816 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3388/6725] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:42:04.984075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d7ca11d2-965c-439c-8aad-de389082cad8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6725a6a133d4433a5606d033590c90d', 'request_id': 'req-d7ca11d2-965c-439c-8aad-de389082cad8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:04.986074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ca32a-69ba-46bf-bb6d-c94b3e067622 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:05.007113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d7ca11d2-965c-439c-8aad-de389082cad8 admin admin] The token cache is being invalidate because project e6725a6a133d4433a5606d033590c90d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:05.007334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ca32a-69ba-46bf-bb6d-c94b3e067622 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:05.007546 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d7ca11d2-965c-439c-8aad-de389082cad8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:05.008546 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d7ca11d2-965c-439c-8aad-de389082cad8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:05.010828 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3338/6726] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:04 2022] DELETE /identity/v3/projects/e6725a6a133d4433a5606d033590c90d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:05.014472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca11d2-965c-439c-8aad-de389082cad8 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:05.015938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d7ca11d2-965c-439c-8aad-de389082cad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:05.105471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7d72e-5022-42b3-bdac-245c99d28cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:05.106217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7d72e-5022-42b3-bdac-245c99d28cd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:05.106708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7d72e-5022-42b3-bdac-245c99d28cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:05.107053 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7d72e-5022-42b3-bdac-245c99d28cd1 admin admin] PATH_INFO: `/v3/projects/b8fe38b4641e468f926388faae3c3331/users/e6e40abac8ac46b39c46e4d701e079a5/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:05.113881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca11d2-965c-439c-8aad-de389082cad8 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:05.119052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31104cb4-a759-4dc5-8159-5c72116e006b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:05.119682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31104cb4-a759-4dc5-8159-5c72116e006b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:05.120148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31104cb4-a759-4dc5-8159-5c72116e006b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:05.120419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31104cb4-a759-4dc5-8159-5c72116e006b admin admin] PATH_INFO: `/v3/users/73040768ca7e4688a63574524be101a1` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:05.121709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31104cb4-a759-4dc5-8159-5c72116e006b admin admin] RBAC: Authorizing `identity:delete_user(user_id=73040768ca7e4688a63574524be101a1)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:05.124322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31104cb4-a759-4dc5-8159-5c72116e006b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:05.127989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7d72e-5022-42b3-bdac-245c99d28cd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8fe38b4641e468f926388faae3c3331, user_id=e6e40abac8ac46b39c46e4d701e079a5, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:05.135567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7d72e-5022-42b3-bdac-245c99d28cd1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:05.178496 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3389/6727] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:04 2022] PUT /identity/v3/projects/b8fe38b4641e468f926388faae3c3331/users/e6e40abac8ac46b39c46e4d701e079a5/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:05.185074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5864f-e8b8-4b3a-9de0-d1d6dc60de74 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:05.185384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5864f-e8b8-4b3a-9de0-d1d6dc60de74 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:05.185947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5864f-e8b8-4b3a-9de0-d1d6dc60de74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:05.206101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-31104cb4-a759-4dc5-8159-5c72116e006b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73040768ca7e4688a63574524be101a1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:05.222632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-31104cb4-a759-4dc5-8159-5c72116e006b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73040768ca7e4688a63574524be101a1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:05.228813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e6b5864f-e8b8-4b3a-9de0-d1d6dc60de74 None None] MFA Rules not processed for user `e6e40abac8ac46b39c46e4d701e079a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:05.230075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e6b5864f-e8b8-4b3a-9de0-d1d6dc60de74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:05.244069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-31104cb4-a759-4dc5-8159-5c72116e006b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73040768ca7e4688a63574524be101a1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:05.244877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-31104cb4-a759-4dc5-8159-5c72116e006b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73040768ca7e4688a63574524be101a1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:05.257766 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-31104cb4-a759-4dc5-8159-5c72116e006b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73040768ca7e4688a63574524be101a1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:05.267155 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3339/6728] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:42:05 2022] DELETE /identity/v3/users/73040768ca7e4688a63574524be101a1 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:42:05.404105 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3390/6729] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:05 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:05.422488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31104cb4-a759-4dc5-8159-5c72116e006b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:05.424948 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-31104cb4-a759-4dc5-8159-5c72116e006b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:05.518385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31104cb4-a759-4dc5-8159-5c72116e006b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:05.524125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849d457-0d09-438e-a273-07b66bbdc495 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:05.525588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849d457-0d09-438e-a273-07b66bbdc495 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:05.526718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849d457-0d09-438e-a273-07b66bbdc495 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:05.527244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849d457-0d09-438e-a273-07b66bbdc495 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:05.535765 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:05.650306 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849d457-0d09-438e-a273-07b66bbdc495 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:05.651855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849d457-0d09-438e-a273-07b66bbdc495 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:05.670952 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3340/6730] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:05 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:06.186467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5864f-e8b8-4b3a-9de0-d1d6dc60de74 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:06.188091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e6b5864f-e8b8-4b3a-9de0-d1d6dc60de74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:06.404519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5864f-e8b8-4b3a-9de0-d1d6dc60de74 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:06.436088 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:06.635535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06abe5b-1125-4b9c-8ef4-552c33e47b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:06.637778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06abe5b-1125-4b9c-8ef4-552c33e47b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:06.638070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06abe5b-1125-4b9c-8ef4-552c33e47b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:06.638371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06abe5b-1125-4b9c-8ef4-552c33e47b7e admin admin] PATH_INFO: `/v3/projects/c28e58b03f724c95be9ff2672a6a78c2` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:06.643104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06abe5b-1125-4b9c-8ef4-552c33e47b7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c28e58b03f724c95be9ff2672a6a78c2)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:06.649806 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06abe5b-1125-4b9c-8ef4-552c33e47b7e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:06.773414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e06abe5b-1125-4b9c-8ef4-552c33e47b7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c28e58b03f724c95be9ff2672a6a78c2', 'request_id': 'req-e06abe5b-1125-4b9c-8ef4-552c33e47b7e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:06.779308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e06abe5b-1125-4b9c-8ef4-552c33e47b7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c28e58b03f724c95be9ff2672a6a78c2', 'request_id': 'req-e06abe5b-1125-4b9c-8ef4-552c33e47b7e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:06.789258 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e06abe5b-1125-4b9c-8ef4-552c33e47b7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c28e58b03f724c95be9ff2672a6a78c2', 'request_id': 'req-e06abe5b-1125-4b9c-8ef4-552c33e47b7e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:06.811332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e06abe5b-1125-4b9c-8ef4-552c33e47b7e admin admin] The token cache is being invalidate because project c28e58b03f724c95be9ff2672a6a78c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:06.829524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e06abe5b-1125-4b9c-8ef4-552c33e47b7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:06.829524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e06abe5b-1125-4b9c-8ef4-552c33e47b7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:06.829524 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3391/6731] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:06 2022] DELETE /identity/v3/projects/c28e58b03f724c95be9ff2672a6a78c2 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:06.829901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849d457-0d09-438e-a273-07b66bbdc495 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:06.846836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849d457-0d09-438e-a273-07b66bbdc495 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:06.970945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5bc5be-f4ec-4265-b4ba-00b336afcbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:06.971589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bc5be-f4ec-4265-b4ba-00b336afcbde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:06.971864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bc5be-f4ec-4265-b4ba-00b336afcbde admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:06.972158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5bc5be-f4ec-4265-b4ba-00b336afcbde admin admin] PATH_INFO: `/v3/users/fee1bfd918e649daa820844403012329` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:06.973409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5bc5be-f4ec-4265-b4ba-00b336afcbde admin admin] RBAC: Authorizing `identity:delete_user(user_id=fee1bfd918e649daa820844403012329)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:06.975348 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5bc5be-f4ec-4265-b4ba-00b336afcbde admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:07.082597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2e5bc5be-f4ec-4265-b4ba-00b336afcbde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fee1bfd918e649daa820844403012329'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:07.107866 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2e5bc5be-f4ec-4265-b4ba-00b336afcbde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fee1bfd918e649daa820844403012329'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:07.154180 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2e5bc5be-f4ec-4265-b4ba-00b336afcbde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fee1bfd918e649daa820844403012329'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:07.155007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2e5bc5be-f4ec-4265-b4ba-00b336afcbde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fee1bfd918e649daa820844403012329'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:07.166170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2e5bc5be-f4ec-4265-b4ba-00b336afcbde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fee1bfd918e649daa820844403012329'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:07.193996 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3341/6732] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:42:06 2022] DELETE /identity/v3/users/fee1bfd918e649daa820844403012329 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:07.745649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06abe5b-1125-4b9c-8ef4-552c33e47b7e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:07.747195 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e06abe5b-1125-4b9c-8ef4-552c33e47b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:07.767189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06abe5b-1125-4b9c-8ef4-552c33e47b7e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:07.878190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1bcf4e-755c-4771-9bf6-a3c780082ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:07.879057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bcf4e-755c-4771-9bf6-a3c780082ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:07.879519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bcf4e-755c-4771-9bf6-a3c780082ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:07.879981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bcf4e-755c-4771-9bf6-a3c780082ff8 admin admin] PATH_INFO: `/v3/projects/282683e7e9b64354b1c17db4e8cb5104` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:07.881311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1bcf4e-755c-4771-9bf6-a3c780082ff8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=282683e7e9b64354b1c17db4e8cb5104)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:07.883988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1bcf4e-755c-4771-9bf6-a3c780082ff8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:08.009923 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:08.020654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7a1bcf4e-755c-4771-9bf6-a3c780082ff8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '282683e7e9b64354b1c17db4e8cb5104', 'request_id': 'req-7a1bcf4e-755c-4771-9bf6-a3c780082ff8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:08.033266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7a1bcf4e-755c-4771-9bf6-a3c780082ff8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '282683e7e9b64354b1c17db4e8cb5104', 'request_id': 'req-7a1bcf4e-755c-4771-9bf6-a3c780082ff8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:08.061353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7a1bcf4e-755c-4771-9bf6-a3c780082ff8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '282683e7e9b64354b1c17db4e8cb5104', 'request_id': 'req-7a1bcf4e-755c-4771-9bf6-a3c780082ff8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:08.090591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7a1bcf4e-755c-4771-9bf6-a3c780082ff8 admin admin] The token cache is being invalidate because project 282683e7e9b64354b1c17db4e8cb5104 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:08.090885 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7a1bcf4e-755c-4771-9bf6-a3c780082ff8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:08.092790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7a1bcf4e-755c-4771-9bf6-a3c780082ff8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:08.105455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66568655-7b75-45c3-b652-72aa9c5c3876 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:08.105955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66568655-7b75-45c3-b652-72aa9c5c3876 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:08.106055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66568655-7b75-45c3-b652-72aa9c5c3876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:08.109148 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3392/6733] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:07 2022] DELETE /identity/v3/projects/282683e7e9b64354b1c17db4e8cb5104 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:08.147460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-66568655-7b75-45c3-b652-72aa9c5c3876 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:08.148728 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-66568655-7b75-45c3-b652-72aa9c5c3876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:08.194544 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:08.368431 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3342/6734] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:08.396636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b5b0e-3ddc-4937-a4ab-0893ee32bd5c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:08.396878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b5b0e-3ddc-4937-a4ab-0893ee32bd5c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:08.407297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b5b0e-3ddc-4937-a4ab-0893ee32bd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:08.436832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9b3b5b0e-3ddc-4937-a4ab-0893ee32bd5c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:08.439028 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9b3b5b0e-3ddc-4937-a4ab-0893ee32bd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:08.454976 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3393/6735] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:08.456194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66568655-7b75-45c3-b652-72aa9c5c3876 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:08.524135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66568655-7b75-45c3-b652-72aa9c5c3876 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:08.550864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027e571-90f0-46c3-9b43-e060413652b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:08.552661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027e571-90f0-46c3-9b43-e060413652b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:08.553759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027e571-90f0-46c3-9b43-e060413652b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:08.554080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027e571-90f0-46c3-9b43-e060413652b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:08.555787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2027e571-90f0-46c3-9b43-e060413652b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:42:08.556353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2027e571-90f0-46c3-9b43-e060413652b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:08.558527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2027e571-90f0-46c3-9b43-e060413652b4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:08.589167 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3343/6736] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:42:08.596330 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b5b0e-3ddc-4937-a4ab-0893ee32bd5c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:08.619085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b5b0e-3ddc-4937-a4ab-0893ee32bd5c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:08.654141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47874c-82df-4145-a66b-bf5bedfcafa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:08.654141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47874c-82df-4145-a66b-bf5bedfcafa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:08.654141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47874c-82df-4145-a66b-bf5bedfcafa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:08.654141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47874c-82df-4145-a66b-bf5bedfcafa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:08.656760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47874c-82df-4145-a66b-bf5bedfcafa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:08.659091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47874c-82df-4145-a66b-bf5bedfcafa2 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:08.760315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027e571-90f0-46c3-9b43-e060413652b4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:08.760688 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3394/6737] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:42:08 2022] POST /identity/v3/projects => generated 377 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:08.773345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027e571-90f0-46c3-9b43-e060413652b4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:08.901532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c869fa9-f29e-47a3-bee4-fbe26d882764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:08.902183 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c869fa9-f29e-47a3-bee4-fbe26d882764 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:08.902478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c869fa9-f29e-47a3-bee4-fbe26d882764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:08.902733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c869fa9-f29e-47a3-bee4-fbe26d882764 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:08.903380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c869fa9-f29e-47a3-bee4-fbe26d882764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:08.905638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c869fa9-f29e-47a3-bee4-fbe26d882764 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:08.951673 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3344/6738] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:42:08 2022] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:42:08.954142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47874c-82df-4145-a66b-bf5bedfcafa2 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:08.994027 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47874c-82df-4145-a66b-bf5bedfcafa2 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:09.007139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e58c7a-8690-4212-be19-9cdb3362db7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:09.007760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e58c7a-8690-4212-be19-9cdb3362db7b admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:09.008063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e58c7a-8690-4212-be19-9cdb3362db7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:09.008516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e58c7a-8690-4212-be19-9cdb3362db7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:09.009436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e58c7a-8690-4212-be19-9cdb3362db7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:09.015423 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e58c7a-8690-4212-be19-9cdb3362db7b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:09.053147 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3395/6739] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:09.055213 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c869fa9-f29e-47a3-bee4-fbe26d882764 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:09.074664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c869fa9-f29e-47a3-bee4-fbe26d882764 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:09.084356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d6ada-af10-436b-af75-ba808e93014d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:09.084982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d6ada-af10-436b-af75-ba808e93014d admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:09.085340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d6ada-af10-436b-af75-ba808e93014d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:09.085511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d6ada-af10-436b-af75-ba808e93014d admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:09.086213 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d6ada-af10-436b-af75-ba808e93014d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:09.087824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d6ada-af10-436b-af75-ba808e93014d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:09.108424 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3345/6740] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:42:09.115106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e58c7a-8690-4212-be19-9cdb3362db7b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:09.129342 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e58c7a-8690-4212-be19-9cdb3362db7b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:09.153198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e26165-b7f1-445d-ab25-da9cd4477dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:09.153606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e26165-b7f1-445d-ab25-da9cd4477dbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:09.153886 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e26165-b7f1-445d-ab25-da9cd4477dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:09.154158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e26165-b7f1-445d-ab25-da9cd4477dbf admin admin] PATH_INFO: `/v3/projects/c03fe7c427e941aa9df037702c5984b6/users/421c4466b17e4aa2824341921ec9fc9a/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:09.186962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e26165-b7f1-445d-ab25-da9cd4477dbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c03fe7c427e941aa9df037702c5984b6, user_id=421c4466b17e4aa2824341921ec9fc9a, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:09.192329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e26165-b7f1-445d-ab25-da9cd4477dbf admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:09.229582 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3396/6741] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:09 2022] PUT /identity/v3/projects/c03fe7c427e941aa9df037702c5984b6/users/421c4466b17e4aa2824341921ec9fc9a/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:42:09.249615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133e039-2d90-4d1d-9c80-acfff616200c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:09.249893 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133e039-2d90-4d1d-9c80-acfff616200c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:09.250158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133e039-2d90-4d1d-9c80-acfff616200c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:09.340677 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2133e039-2d90-4d1d-9c80-acfff616200c None None] MFA Rules not processed for user `421c4466b17e4aa2824341921ec9fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:09.345032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2133e039-2d90-4d1d-9c80-acfff616200c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:09.518613 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3346/6742] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:09.523103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e26165-b7f1-445d-ab25-da9cd4477dbf admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:09.725451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e26165-b7f1-445d-ab25-da9cd4477dbf admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:09.746995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d3a2d-943f-4d0e-981d-1868b1bb3173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:09.747631 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d3a2d-943f-4d0e-981d-1868b1bb3173 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:09.747923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d3a2d-943f-4d0e-981d-1868b1bb3173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:09.748201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d3a2d-943f-4d0e-981d-1868b1bb3173 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:09.748873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d3a2d-943f-4d0e-981d-1868b1bb3173 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:09.750808 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d3a2d-943f-4d0e-981d-1868b1bb3173 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:09.844210 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3397/6743] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:42:09 2022] POST /identity/v3/projects => generated 379 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:09.848800 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133e039-2d90-4d1d-9c80-acfff616200c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:09.878684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133e039-2d90-4d1d-9c80-acfff616200c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:09.936337 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:10.093273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f9d5e-ec86-41ae-9c29-044a553c25f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:10.094172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f9d5e-ec86-41ae-9c29-044a553c25f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:10.095777 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f9d5e-ec86-41ae-9c29-044a553c25f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:10.096121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f9d5e-ec86-41ae-9c29-044a553c25f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:10.096779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f9d5e-ec86-41ae-9c29-044a553c25f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:10.100630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f9d5e-ec86-41ae-9c29-044a553c25f1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:10.139983 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3347/6744] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:42:09 2022] POST /identity/v3/users => generated 290 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:10.141030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d3a2d-943f-4d0e-981d-1868b1bb3173 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:10.153545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d3a2d-943f-4d0e-981d-1868b1bb3173 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:10.158971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc8d55-bc7f-4b15-abe8-bfecf29d56ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:10.159567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc8d55-bc7f-4b15-abe8-bfecf29d56ea admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:10.160077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc8d55-bc7f-4b15-abe8-bfecf29d56ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:10.160358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc8d55-bc7f-4b15-abe8-bfecf29d56ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:10.164893 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc8d55-bc7f-4b15-abe8-bfecf29d56ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:10.166975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc8d55-bc7f-4b15-abe8-bfecf29d56ea admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:10.188716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f9d5e-ec86-41ae-9c29-044a553c25f1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:10.192182 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3398/6745] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:42:10.207073 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f9d5e-ec86-41ae-9c29-044a553c25f1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:10.215631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329c72f-2169-4e81-a823-313dc52b8aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:10.217579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329c72f-2169-4e81-a823-313dc52b8aec admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:10.217868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329c72f-2169-4e81-a823-313dc52b8aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:10.219361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329c72f-2169-4e81-a823-313dc52b8aec admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:10.222226 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329c72f-2169-4e81-a823-313dc52b8aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:10.226872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329c72f-2169-4e81-a823-313dc52b8aec admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:10.263045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc8d55-bc7f-4b15-abe8-bfecf29d56ea admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:10.263992 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3348/6746] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:10.296720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc8d55-bc7f-4b15-abe8-bfecf29d56ea admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:10.356555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01574a90-aa82-449f-96c8-31aeb9a3b412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:10.357477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01574a90-aa82-449f-96c8-31aeb9a3b412 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:10.357910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01574a90-aa82-449f-96c8-31aeb9a3b412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:10.358343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01574a90-aa82-449f-96c8-31aeb9a3b412 admin admin] PATH_INFO: `/v3/projects/8511826fda664c7088c046b9e7cea345/users/cb6f60524b1f485f98fc0ef0f01e65fc/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:10.398458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01574a90-aa82-449f-96c8-31aeb9a3b412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8511826fda664c7088c046b9e7cea345, user_id=cb6f60524b1f485f98fc0ef0f01e65fc, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:10.401517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01574a90-aa82-449f-96c8-31aeb9a3b412 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:10.428483 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3399/6747] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:10 2022] PUT /identity/v3/projects/8511826fda664c7088c046b9e7cea345/users/cb6f60524b1f485f98fc0ef0f01e65fc/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:42:10.439369 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d546b-4fdf-451c-b083-1df8791894ad None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:10.439659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d546b-4fdf-451c-b083-1df8791894ad None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:10.439966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d546b-4fdf-451c-b083-1df8791894ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:10.494084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-a18d546b-4fdf-451c-b083-1df8791894ad None None] MFA Rules not processed for user `cb6f60524b1f485f98fc0ef0f01e65fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:10.495169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a18d546b-4fdf-451c-b083-1df8791894ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:10.614972 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3349/6748] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:10.624241 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01574a90-aa82-449f-96c8-31aeb9a3b412 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:10.664915 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:10.794549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01574a90-aa82-449f-96c8-31aeb9a3b412 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:10.825146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8178e6-c511-4432-b6cf-b691df8f3905 tempest-IdentityV3ProjectsTest-60611840 tempest-IdentityV3ProjectsTest-60611840-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421c4466b17e4aa2824341921ec9fc9a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c03fe7c427e941aa9df037702c5984b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:10.826079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8178e6-c511-4432-b6cf-b691df8f3905 tempest-IdentityV3ProjectsTest-60611840 tempest-IdentityV3ProjectsTest-60611840-project] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:10.826574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8178e6-c511-4432-b6cf-b691df8f3905 tempest-IdentityV3ProjectsTest-60611840 tempest-IdentityV3ProjectsTest-60611840-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:10.827071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8178e6-c511-4432-b6cf-b691df8f3905 tempest-IdentityV3ProjectsTest-60611840 tempest-IdentityV3ProjectsTest-60611840-project] PATH_INFO: `/v3/users/421c4466b17e4aa2824341921ec9fc9a/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:10.828680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8178e6-c511-4432-b6cf-b691df8f3905 tempest-IdentityV3ProjectsTest-60611840 tempest-IdentityV3ProjectsTest-60611840-project] RBAC: Authorizing `identity:list_user_projects(user_id=421c4466b17e4aa2824341921ec9fc9a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:10.831248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8178e6-c511-4432-b6cf-b691df8f3905 tempest-IdentityV3ProjectsTest-60611840 tempest-IdentityV3ProjectsTest-60611840-project] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:10.905651 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3400/6749] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Aug 7 01:42:10 2022] GET /identity/v3/users/421c4466b17e4aa2824341921ec9fc9a/projects => generated 513 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:42:10.911738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03960b38-7da9-4aa3-b9ae-a5f3120bb650 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:10.911738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03960b38-7da9-4aa3-b9ae-a5f3120bb650 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:10.912144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03960b38-7da9-4aa3-b9ae-a5f3120bb650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:11.073029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-03960b38-7da9-4aa3-b9ae-a5f3120bb650 None None] MFA Rules not processed for user `421c4466b17e4aa2824341921ec9fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:11.080982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-03960b38-7da9-4aa3-b9ae-a5f3120bb650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:11.106998 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3350/6750] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:11.112336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989c30c-aa9f-4d91-8013-bfff2ec4ccde None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:11.113019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989c30c-aa9f-4d91-8013-bfff2ec4ccde None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:11.113508 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989c30c-aa9f-4d91-8013-bfff2ec4ccde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:11.206269 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3989c30c-aa9f-4d91-8013-bfff2ec4ccde None None] MFA Rules not processed for user `421c4466b17e4aa2824341921ec9fc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:11.217370 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3989c30c-aa9f-4d91-8013-bfff2ec4ccde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:11.449760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.models.token_model [None req-3989c30c-aa9f-4d91-8013-bfff2ec4ccde None None] User 421c4466b17e4aa2824341921ec9fc9a has no access to project 8511826fda664c7088c046b9e7cea345 {{(pid=80492) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Aug 07 01:42:11.470186 n-d-master-1 devstack@keystone.service[80492]: WARNING keystone.server.flask.application [None req-3989c30c-aa9f-4d91-8013-bfff2ec4ccde None None] Authorization failed. The request you have made requires authentication. from 10.222.0.39: keystone.exception.Unauthorized: The request you have made requires authentication. Aug 07 01:42:11.481196 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3401/6751] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:11 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 368 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Aug 07 01:42:11.482561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03960b38-7da9-4aa3-b9ae-a5f3120bb650 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:11.651310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03960b38-7da9-4aa3-b9ae-a5f3120bb650 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:11.668048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01242511-9591-4547-a032-56293a484136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:11.669314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01242511-9591-4547-a032-56293a484136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:11.669314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01242511-9591-4547-a032-56293a484136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:11.684981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01242511-9591-4547-a032-56293a484136 admin admin] PATH_INFO: `/v3/users/421c4466b17e4aa2824341921ec9fc9a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:11.684981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01242511-9591-4547-a032-56293a484136 admin admin] RBAC: Authorizing `identity:delete_user(user_id=421c4466b17e4aa2824341921ec9fc9a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:11.684981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01242511-9591-4547-a032-56293a484136 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:11.770817 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:11.881664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-01242511-9591-4547-a032-56293a484136 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '421c4466b17e4aa2824341921ec9fc9a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:11.918924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-01242511-9591-4547-a032-56293a484136 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '421c4466b17e4aa2824341921ec9fc9a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:11.971101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-01242511-9591-4547-a032-56293a484136 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '421c4466b17e4aa2824341921ec9fc9a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:11.972209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-01242511-9591-4547-a032-56293a484136 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '421c4466b17e4aa2824341921ec9fc9a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:12.000920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-01242511-9591-4547-a032-56293a484136 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '421c4466b17e4aa2824341921ec9fc9a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:12.011869 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3351/6752] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:42:11 2022] DELETE /identity/v3/users/421c4466b17e4aa2824341921ec9fc9a => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:12.014341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b82f5-b7f1-44f8-b3a6-613c8c392267 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:12.014867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b82f5-b7f1-44f8-b3a6-613c8c392267 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:12.014867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b82f5-b7f1-44f8-b3a6-613c8c392267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:12.089803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ec1b82f5-b7f1-44f8-b3a6-613c8c392267 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:12.091026 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ec1b82f5-b7f1-44f8-b3a6-613c8c392267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:12.370899 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3402/6753] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:12.378089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01242511-9591-4547-a032-56293a484136 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:12.379826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-01242511-9591-4547-a032-56293a484136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:12.553216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01242511-9591-4547-a032-56293a484136 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:12.560719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bbb41e-203f-4d9d-8683-22876bf140d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:12.561534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbb41e-203f-4d9d-8683-22876bf140d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:12.561966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbb41e-203f-4d9d-8683-22876bf140d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:12.562413 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbb41e-203f-4d9d-8683-22876bf140d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:12.574785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bbb41e-203f-4d9d-8683-22876bf140d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:12.576453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bbb41e-203f-4d9d-8683-22876bf140d7 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:12.590009 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3352/6754] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:12.991285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b82f5-b7f1-44f8-b3a6-613c8c392267 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:12.993110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ec1b82f5-b7f1-44f8-b3a6-613c8c392267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:13.193991 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:13.309908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b82f5-b7f1-44f8-b3a6-613c8c392267 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:13.348248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575bc95-6258-407b-8c2b-4fd9ad05a3e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:13.349248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575bc95-6258-407b-8c2b-4fd9ad05a3e4 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:13.349753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575bc95-6258-407b-8c2b-4fd9ad05a3e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:13.350228 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575bc95-6258-407b-8c2b-4fd9ad05a3e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:13.355679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4575bc95-6258-407b-8c2b-4fd9ad05a3e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:13.409840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bbb41e-203f-4d9d-8683-22876bf140d7 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:13.411557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-59bbb41e-203f-4d9d-8683-22876bf140d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:13.464094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bbb41e-203f-4d9d-8683-22876bf140d7 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:13.491045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef25c90-e82f-42c4-a10f-e8a5b3ea9b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:13.491691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef25c90-e82f-42c4-a10f-e8a5b3ea9b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:13.491993 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef25c90-e82f-42c4-a10f-e8a5b3ea9b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:13.492265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef25c90-e82f-42c4-a10f-e8a5b3ea9b83 admin admin] PATH_INFO: `/v3/projects/c03fe7c427e941aa9df037702c5984b6` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:13.493419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef25c90-e82f-42c4-a10f-e8a5b3ea9b83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c03fe7c427e941aa9df037702c5984b6)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:13.495324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef25c90-e82f-42c4-a10f-e8a5b3ea9b83 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:13.647820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575bc95-6258-407b-8c2b-4fd9ad05a3e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:13.649877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575bc95-6258-407b-8c2b-4fd9ad05a3e4 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:13.707101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1ef25c90-e82f-42c4-a10f-e8a5b3ea9b83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c03fe7c427e941aa9df037702c5984b6', 'request_id': 'req-1ef25c90-e82f-42c4-a10f-e8a5b3ea9b83'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:13.713178 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3403/6755] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 722 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:13.752153 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1ef25c90-e82f-42c4-a10f-e8a5b3ea9b83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c03fe7c427e941aa9df037702c5984b6', 'request_id': 'req-1ef25c90-e82f-42c4-a10f-e8a5b3ea9b83'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:13.788060 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1ef25c90-e82f-42c4-a10f-e8a5b3ea9b83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c03fe7c427e941aa9df037702c5984b6', 'request_id': 'req-1ef25c90-e82f-42c4-a10f-e8a5b3ea9b83'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:13.843355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1ef25c90-e82f-42c4-a10f-e8a5b3ea9b83 admin admin] The token cache is being invalidate because project c03fe7c427e941aa9df037702c5984b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:13.846487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1ef25c90-e82f-42c4-a10f-e8a5b3ea9b83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:13.852452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1ef25c90-e82f-42c4-a10f-e8a5b3ea9b83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:13.857987 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3353/6756] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:13 2022] DELETE /identity/v3/projects/c03fe7c427e941aa9df037702c5984b6 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:13.865564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575bc95-6258-407b-8c2b-4fd9ad05a3e4 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:13.892243 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575bc95-6258-407b-8c2b-4fd9ad05a3e4 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:14.317925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0daad6c-8350-457c-9c55-b77ee3d44e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:14.320825 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0daad6c-8350-457c-9c55-b77ee3d44e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:14.321438 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0daad6c-8350-457c-9c55-b77ee3d44e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:14.322499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0daad6c-8350-457c-9c55-b77ee3d44e3d admin admin] PATH_INFO: `/v3/users/cb6f60524b1f485f98fc0ef0f01e65fc` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:14.325068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0daad6c-8350-457c-9c55-b77ee3d44e3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb6f60524b1f485f98fc0ef0f01e65fc)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:14.337431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0daad6c-8350-457c-9c55-b77ee3d44e3d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:14.518467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f0daad6c-8350-457c-9c55-b77ee3d44e3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb6f60524b1f485f98fc0ef0f01e65fc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:14.544811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f0daad6c-8350-457c-9c55-b77ee3d44e3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb6f60524b1f485f98fc0ef0f01e65fc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:14.587952 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:14.593834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f0daad6c-8350-457c-9c55-b77ee3d44e3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb6f60524b1f485f98fc0ef0f01e65fc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:14.595256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f0daad6c-8350-457c-9c55-b77ee3d44e3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb6f60524b1f485f98fc0ef0f01e65fc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:14.615993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f0daad6c-8350-457c-9c55-b77ee3d44e3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb6f60524b1f485f98fc0ef0f01e65fc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:14.623151 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3404/6757] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:42:13 2022] DELETE /identity/v3/users/cb6f60524b1f485f98fc0ef0f01e65fc => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:42:15.456597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef25c90-e82f-42c4-a10f-e8a5b3ea9b83 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:15.458242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1ef25c90-e82f-42c4-a10f-e8a5b3ea9b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:15.493211 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:15.570392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef25c90-e82f-42c4-a10f-e8a5b3ea9b83 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:15.717947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b884cc1-3559-42f5-800d-5836c76a0c4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:15.720061 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b884cc1-3559-42f5-800d-5836c76a0c4e service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:15.720578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b884cc1-3559-42f5-800d-5836c76a0c4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:15.721383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b884cc1-3559-42f5-800d-5836c76a0c4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:15.728511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5b884cc1-3559-42f5-800d-5836c76a0c4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:15.851498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0daad6c-8350-457c-9c55-b77ee3d44e3d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:15.853352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f0daad6c-8350-457c-9c55-b77ee3d44e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:15.897539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b884cc1-3559-42f5-800d-5836c76a0c4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:15.899281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b884cc1-3559-42f5-800d-5836c76a0c4e service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:15.939119 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3354/6758] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:16.029665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0daad6c-8350-457c-9c55-b77ee3d44e3d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:16.044874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad78e2-9f1f-4ce6-bf1a-20f94f7cea1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:16.045663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad78e2-9f1f-4ce6-bf1a-20f94f7cea1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:16.045950 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad78e2-9f1f-4ce6-bf1a-20f94f7cea1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:16.046227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad78e2-9f1f-4ce6-bf1a-20f94f7cea1d admin admin] PATH_INFO: `/v3/projects/8511826fda664c7088c046b9e7cea345` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:16.050278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad78e2-9f1f-4ce6-bf1a-20f94f7cea1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8511826fda664c7088c046b9e7cea345)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:16.052536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad78e2-9f1f-4ce6-bf1a-20f94f7cea1d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:16.152976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3dad78e2-9f1f-4ce6-bf1a-20f94f7cea1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8511826fda664c7088c046b9e7cea345', 'request_id': 'req-3dad78e2-9f1f-4ce6-bf1a-20f94f7cea1d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:16.161621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3dad78e2-9f1f-4ce6-bf1a-20f94f7cea1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8511826fda664c7088c046b9e7cea345', 'request_id': 'req-3dad78e2-9f1f-4ce6-bf1a-20f94f7cea1d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:16.175009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3dad78e2-9f1f-4ce6-bf1a-20f94f7cea1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8511826fda664c7088c046b9e7cea345', 'request_id': 'req-3dad78e2-9f1f-4ce6-bf1a-20f94f7cea1d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:16.194392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3dad78e2-9f1f-4ce6-bf1a-20f94f7cea1d admin admin] The token cache is being invalidate because project 8511826fda664c7088c046b9e7cea345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:16.194392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3dad78e2-9f1f-4ce6-bf1a-20f94f7cea1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:16.195114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3dad78e2-9f1f-4ce6-bf1a-20f94f7cea1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:16.201433 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3405/6759] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:15 2022] DELETE /identity/v3/projects/8511826fda664c7088c046b9e7cea345 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:42:16.207099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff899e-4c0d-4288-864e-4d326660439a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:16.207982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff899e-4c0d-4288-864e-4d326660439a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:16.208809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff899e-4c0d-4288-864e-4d326660439a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:16.295544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-21ff899e-4c0d-4288-864e-4d326660439a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:16.296804 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-21ff899e-4c0d-4288-864e-4d326660439a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:16.539561 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3355/6760] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:16.548449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310832ff-5fdb-48d7-940a-152a96f08f51 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:16.548981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310832ff-5fdb-48d7-940a-152a96f08f51 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:16.549449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310832ff-5fdb-48d7-940a-152a96f08f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:16.626530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-310832ff-5fdb-48d7-940a-152a96f08f51 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:16.629994 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-310832ff-5fdb-48d7-940a-152a96f08f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:16.656008 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3406/6761] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:16.659632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff899e-4c0d-4288-864e-4d326660439a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:16.672433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff899e-4c0d-4288-864e-4d326660439a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:16.718261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377b0cc-f7c2-4a11-b6d1-18982cc89cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:16.719264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377b0cc-f7c2-4a11-b6d1-18982cc89cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:16.723086 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377b0cc-f7c2-4a11-b6d1-18982cc89cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:16.723577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377b0cc-f7c2-4a11-b6d1-18982cc89cc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:16.725911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377b0cc-f7c2-4a11-b6d1-18982cc89cc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:42:16.726402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377b0cc-f7c2-4a11-b6d1-18982cc89cc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:16.728793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377b0cc-f7c2-4a11-b6d1-18982cc89cc7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:16.778585 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3356/6762] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:42:16.783102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310832ff-5fdb-48d7-940a-152a96f08f51 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:16.811302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310832ff-5fdb-48d7-940a-152a96f08f51 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:16.835835 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d343a-0838-4fa4-86c9-3fdc89481d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:16.837402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d343a-0838-4fa4-86c9-3fdc89481d93 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:16.838616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d343a-0838-4fa4-86c9-3fdc89481d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:16.839759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d343a-0838-4fa4-86c9-3fdc89481d93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:16.845262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d343a-0838-4fa4-86c9-3fdc89481d93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:16.851170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d343a-0838-4fa4-86c9-3fdc89481d93 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:16.959521 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3407/6763] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:42:16 2022] POST /identity/v3/projects => generated 393 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:16.962853 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377b0cc-f7c2-4a11-b6d1-18982cc89cc7 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:16.982568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377b0cc-f7c2-4a11-b6d1-18982cc89cc7 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:17.088641 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:17.259038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa46729-39b0-4940-976a-2887c024774a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:17.262553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa46729-39b0-4940-976a-2887c024774a admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:17.264997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa46729-39b0-4940-976a-2887c024774a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:17.265477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa46729-39b0-4940-976a-2887c024774a admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:17.269342 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa46729-39b0-4940-976a-2887c024774a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:17.275636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa46729-39b0-4940-976a-2887c024774a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:17.374440 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3357/6764] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:42:16 2022] POST /identity/v3/users => generated 303 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:17.379412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d343a-0838-4fa4-86c9-3fdc89481d93 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:17.398679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d343a-0838-4fa4-86c9-3fdc89481d93 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:17.415416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69400fd3-1bfb-4867-ac4f-92673f09d003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:17.416071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69400fd3-1bfb-4867-ac4f-92673f09d003 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:17.416352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69400fd3-1bfb-4867-ac4f-92673f09d003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:17.416623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69400fd3-1bfb-4867-ac4f-92673f09d003 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:17.417281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69400fd3-1bfb-4867-ac4f-92673f09d003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:17.437226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69400fd3-1bfb-4867-ac4f-92673f09d003 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:17.473994 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3408/6765] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:17.476252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa46729-39b0-4940-976a-2887c024774a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:17.491310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa46729-39b0-4940-976a-2887c024774a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:17.536587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a81f5-fbac-40bd-ac1a-fc33b2302a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:17.542966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a81f5-fbac-40bd-ac1a-fc33b2302a9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:17.543581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a81f5-fbac-40bd-ac1a-fc33b2302a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:17.543581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a81f5-fbac-40bd-ac1a-fc33b2302a9d admin admin] PATH_INFO: `/v3/projects/4a85c61933e24faba4e017aa3c0cb7cf/users/e543854113484da3af20ca6a6c148285/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:17.604256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a81f5-fbac-40bd-ac1a-fc33b2302a9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a85c61933e24faba4e017aa3c0cb7cf, user_id=e543854113484da3af20ca6a6c148285, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:17.606934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a81f5-fbac-40bd-ac1a-fc33b2302a9d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:17.645195 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3358/6766] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:17 2022] PUT /identity/v3/projects/4a85c61933e24faba4e017aa3c0cb7cf/users/e543854113484da3af20ca6a6c148285/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:17.648993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69400fd3-1bfb-4867-ac4f-92673f09d003 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:17.682138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69400fd3-1bfb-4867-ac4f-92673f09d003 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:17.780030 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:17.821635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b3ee1-a763-4f4a-81d9-d64e9553f65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:17.822798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b3ee1-a763-4f4a-81d9-d64e9553f65e admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:17.823459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b3ee1-a763-4f4a-81d9-d64e9553f65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:17.824021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b3ee1-a763-4f4a-81d9-d64e9553f65e admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:17.825116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b3ee1-a763-4f4a-81d9-d64e9553f65e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:17.827180 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b3ee1-a763-4f4a-81d9-d64e9553f65e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:17.846703 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3409/6767] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:17.850732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a81f5-fbac-40bd-ac1a-fc33b2302a9d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:17.869799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a81f5-fbac-40bd-ac1a-fc33b2302a9d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:17.878111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4236c-5d68-4f45-a804-c3f738a12804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:17.878917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4236c-5d68-4f45-a804-c3f738a12804 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:17.879278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4236c-5d68-4f45-a804-c3f738a12804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:17.879673 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4236c-5d68-4f45-a804-c3f738a12804 admin admin] PATH_INFO: `/v3/projects/4a85c61933e24faba4e017aa3c0cb7cf/users/e543854113484da3af20ca6a6c148285/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:17.887065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4236c-5d68-4f45-a804-c3f738a12804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a85c61933e24faba4e017aa3c0cb7cf, user_id=e543854113484da3af20ca6a6c148285, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:17.893544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4236c-5d68-4f45-a804-c3f738a12804 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:17.929685 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3359/6768] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:17 2022] PUT /identity/v3/projects/4a85c61933e24faba4e017aa3c0cb7cf/users/e543854113484da3af20ca6a6c148285/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:17.947363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecd827-75e6-48fe-b90e-ebbc305ee45b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:17.947661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecd827-75e6-48fe-b90e-ebbc305ee45b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:17.947973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecd827-75e6-48fe-b90e-ebbc305ee45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:18.005641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6fecd827-75e6-48fe-b90e-ebbc305ee45b None None] MFA Rules not processed for user `e543854113484da3af20ca6a6c148285`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:18.007052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6fecd827-75e6-48fe-b90e-ebbc305ee45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:18.231363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4236c-5d68-4f45-a804-c3f738a12804 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:18.231663 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3410/6769] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:17 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:18.418770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4236c-5d68-4f45-a804-c3f738a12804 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:18.433791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5dd25-7403-4b41-a23e-d9a5e38a5f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:18.435828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5dd25-7403-4b41-a23e-d9a5e38a5f31 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:18.436612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5dd25-7403-4b41-a23e-d9a5e38a5f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:18.438407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5dd25-7403-4b41-a23e-d9a5e38a5f31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:18.454680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5dd25-7403-4b41-a23e-d9a5e38a5f31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:18.460936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5dd25-7403-4b41-a23e-d9a5e38a5f31 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:18.593064 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3360/6770] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:42:18 2022] POST /identity/v3/projects => generated 391 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:42:18.597695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fecd827-75e6-48fe-b90e-ebbc305ee45b None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:18.622567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fecd827-75e6-48fe-b90e-ebbc305ee45b None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:18.871208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc246db-1da3-430c-a1b2-3fc748469358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:18.871786 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc246db-1da3-430c-a1b2-3fc748469358 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:18.872810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc246db-1da3-430c-a1b2-3fc748469358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:18.873335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc246db-1da3-430c-a1b2-3fc748469358 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:18.874504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc246db-1da3-430c-a1b2-3fc748469358 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:18.878023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc246db-1da3-430c-a1b2-3fc748469358 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:18.921857 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3411/6771] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:42:18 2022] POST /identity/v3/users => generated 296 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:18.926556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5dd25-7403-4b41-a23e-d9a5e38a5f31 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:18.945958 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5dd25-7403-4b41-a23e-d9a5e38a5f31 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:18.965459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37a7c5-8484-4087-94bc-be7ab8ac5839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:18.966251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37a7c5-8484-4087-94bc-be7ab8ac5839 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:18.966607 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37a7c5-8484-4087-94bc-be7ab8ac5839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:18.966951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37a7c5-8484-4087-94bc-be7ab8ac5839 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:18.968447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37a7c5-8484-4087-94bc-be7ab8ac5839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:18.971191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37a7c5-8484-4087-94bc-be7ab8ac5839 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:19.006572 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3361/6772] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:19.011964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc246db-1da3-430c-a1b2-3fc748469358 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:19.027339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc246db-1da3-430c-a1b2-3fc748469358 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:19.043461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5477c6-e715-49b4-9a26-8b77c95cba42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:19.045231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5477c6-e715-49b4-9a26-8b77c95cba42 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:19.049435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5477c6-e715-49b4-9a26-8b77c95cba42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:19.050619 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5477c6-e715-49b4-9a26-8b77c95cba42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:19.053269 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5477c6-e715-49b4-9a26-8b77c95cba42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:19.058939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5477c6-e715-49b4-9a26-8b77c95cba42 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:19.096957 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3412/6773] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:19.100868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37a7c5-8484-4087-94bc-be7ab8ac5839 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:19.117932 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37a7c5-8484-4087-94bc-be7ab8ac5839 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:19.123954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946a613-1703-47e4-8db1-65f8aa908da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:19.125015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946a613-1703-47e4-8db1-65f8aa908da0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:19.125432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946a613-1703-47e4-8db1-65f8aa908da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:19.126084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946a613-1703-47e4-8db1-65f8aa908da0 admin admin] PATH_INFO: `/v3/projects/42d468c1bfe54df89d654baa22f90b2d/users/34aa9f6e6235477fb3c72f5bbff4820b/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:19.180424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946a613-1703-47e4-8db1-65f8aa908da0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d468c1bfe54df89d654baa22f90b2d, user_id=34aa9f6e6235477fb3c72f5bbff4820b, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:19.186638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c946a613-1703-47e4-8db1-65f8aa908da0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:19.214709 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3362/6774] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:19 2022] PUT /identity/v3/projects/42d468c1bfe54df89d654baa22f90b2d/users/34aa9f6e6235477fb3c72f5bbff4820b/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:19.227224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bffda1-45c6-47c8-8364-119cbe9aa6a0 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:19.227455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bffda1-45c6-47c8-8364-119cbe9aa6a0 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:19.227792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bffda1-45c6-47c8-8364-119cbe9aa6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:19.313748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-02bffda1-45c6-47c8-8364-119cbe9aa6a0 None None] MFA Rules not processed for user `34aa9f6e6235477fb3c72f5bbff4820b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:19.315484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-02bffda1-45c6-47c8-8364-119cbe9aa6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:19.417820 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:19.636030 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3413/6775] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:19.655493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946a613-1703-47e4-8db1-65f8aa908da0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:19.658363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c946a613-1703-47e4-8db1-65f8aa908da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:19.748741 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:19.872587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946a613-1703-47e4-8db1-65f8aa908da0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:19.939669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02546a10-0e2a-4797-a1c5-8cb2f5860c0b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:19.940815 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02546a10-0e2a-4797-a1c5-8cb2f5860c0b service glance] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:19.941283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02546a10-0e2a-4797-a1c5-8cb2f5860c0b service glance] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:19.941739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02546a10-0e2a-4797-a1c5-8cb2f5860c0b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:20.074523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02546a10-0e2a-4797-a1c5-8cb2f5860c0b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:20.076295 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02546a10-0e2a-4797-a1c5-8cb2f5860c0b service glance] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:20.104650 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3363/6776] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:19 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:22.173078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bffda1-45c6-47c8-8364-119cbe9aa6a0 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:22.373209 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bffda1-45c6-47c8-8364-119cbe9aa6a0 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:22.384933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0659da-417b-4d47-b8fd-8ed40e7b14ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:22.385609 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0659da-417b-4d47-b8fd-8ed40e7b14ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:22.385978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0659da-417b-4d47-b8fd-8ed40e7b14ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:22.386185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0659da-417b-4d47-b8fd-8ed40e7b14ac admin admin] PATH_INFO: `/v3/users/e543854113484da3af20ca6a6c148285` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:22.388619 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0659da-417b-4d47-b8fd-8ed40e7b14ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=e543854113484da3af20ca6a6c148285)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:22.390621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0659da-417b-4d47-b8fd-8ed40e7b14ac admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:22.495148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1e0659da-417b-4d47-b8fd-8ed40e7b14ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e543854113484da3af20ca6a6c148285'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:22.530585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1e0659da-417b-4d47-b8fd-8ed40e7b14ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e543854113484da3af20ca6a6c148285'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:22.565036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1e0659da-417b-4d47-b8fd-8ed40e7b14ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e543854113484da3af20ca6a6c148285'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:22.566020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1e0659da-417b-4d47-b8fd-8ed40e7b14ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e543854113484da3af20ca6a6c148285'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:22.583421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1e0659da-417b-4d47-b8fd-8ed40e7b14ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e543854113484da3af20ca6a6c148285'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:22.604521 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3414/6777] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:42:22 2022] DELETE /identity/v3/users/e543854113484da3af20ca6a6c148285 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:22.609342 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed44d3-4505-4fca-b63b-6ca5f41a189f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:22.610719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed44d3-4505-4fca-b63b-6ca5f41a189f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:22.611202 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed44d3-4505-4fca-b63b-6ca5f41a189f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:22.700700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-27ed44d3-4505-4fca-b63b-6ca5f41a189f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:22.713796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-27ed44d3-4505-4fca-b63b-6ca5f41a189f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:22.944212 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3364/6778] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:42:22.956067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0659da-417b-4d47-b8fd-8ed40e7b14ac admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:22.957845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1e0659da-417b-4d47-b8fd-8ed40e7b14ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:23.090353 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:23.111056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0659da-417b-4d47-b8fd-8ed40e7b14ac admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:23.143367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a8eb7-5d13-4d44-a83f-2c4861eca71b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:23.145373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a8eb7-5d13-4d44-a83f-2c4861eca71b service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:23.147701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a8eb7-5d13-4d44-a83f-2c4861eca71b service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:23.148108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a8eb7-5d13-4d44-a83f-2c4861eca71b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:23.168981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a8eb7-5d13-4d44-a83f-2c4861eca71b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:23.170838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a8eb7-5d13-4d44-a83f-2c4861eca71b service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:23.208196 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3415/6779] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:24.114525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed44d3-4505-4fca-b63b-6ca5f41a189f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:24.116448 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-27ed44d3-4505-4fca-b63b-6ca5f41a189f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:24.141854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed44d3-4505-4fca-b63b-6ca5f41a189f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:24.169697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512371f-ba72-4e54-993a-86eb8ccba662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:24.174022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512371f-ba72-4e54-993a-86eb8ccba662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:24.174477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512371f-ba72-4e54-993a-86eb8ccba662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:24.174847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512371f-ba72-4e54-993a-86eb8ccba662 admin admin] PATH_INFO: `/v3/projects/4a85c61933e24faba4e017aa3c0cb7cf` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:24.176279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512371f-ba72-4e54-993a-86eb8ccba662 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a85c61933e24faba4e017aa3c0cb7cf)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:24.182704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512371f-ba72-4e54-993a-86eb8ccba662 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:24.345686 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1512371f-ba72-4e54-993a-86eb8ccba662 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a85c61933e24faba4e017aa3c0cb7cf', 'request_id': 'req-1512371f-ba72-4e54-993a-86eb8ccba662'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:24.358635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1512371f-ba72-4e54-993a-86eb8ccba662 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a85c61933e24faba4e017aa3c0cb7cf', 'request_id': 'req-1512371f-ba72-4e54-993a-86eb8ccba662'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:24.381354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1512371f-ba72-4e54-993a-86eb8ccba662 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a85c61933e24faba4e017aa3c0cb7cf', 'request_id': 'req-1512371f-ba72-4e54-993a-86eb8ccba662'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:24.386122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a8eb7-5d13-4d44-a83f-2c4861eca71b service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:24.387725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9c1a8eb7-5d13-4d44-a83f-2c4861eca71b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:24.407294 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:24.410155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a8eb7-5d13-4d44-a83f-2c4861eca71b service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:24.430125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1512371f-ba72-4e54-993a-86eb8ccba662 admin admin] The token cache is being invalidate because project 4a85c61933e24faba4e017aa3c0cb7cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:24.431839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1512371f-ba72-4e54-993a-86eb8ccba662 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:24.433787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1512371f-ba72-4e54-993a-86eb8ccba662 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:24.439877 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3365/6780] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:24 2022] DELETE /identity/v3/projects/4a85c61933e24faba4e017aa3c0cb7cf => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:24.444286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512371f-ba72-4e54-993a-86eb8ccba662 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:24.447675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1512371f-ba72-4e54-993a-86eb8ccba662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:24.633111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee546df-e8da-434f-a1d4-5d269d00e41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:24.634180 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee546df-e8da-434f-a1d4-5d269d00e41d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:24.634447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee546df-e8da-434f-a1d4-5d269d00e41d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:24.634718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee546df-e8da-434f-a1d4-5d269d00e41d admin admin] PATH_INFO: `/v3/users/7d4cd041ba884cedb08c70ea8083d027` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:24.637583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee546df-e8da-434f-a1d4-5d269d00e41d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d4cd041ba884cedb08c70ea8083d027)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:24.639622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee546df-e8da-434f-a1d4-5d269d00e41d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:24.688542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512371f-ba72-4e54-993a-86eb8ccba662 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:24.702214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efa429-c365-44e1-a8b3-58e180dd62e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:24.704260 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efa429-c365-44e1-a8b3-58e180dd62e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:24.705300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efa429-c365-44e1-a8b3-58e180dd62e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:24.706276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efa429-c365-44e1-a8b3-58e180dd62e4 admin admin] PATH_INFO: `/v3/users/34aa9f6e6235477fb3c72f5bbff4820b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:24.710517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10efa429-c365-44e1-a8b3-58e180dd62e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34aa9f6e6235477fb3c72f5bbff4820b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:24.718324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10efa429-c365-44e1-a8b3-58e180dd62e4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:24.786020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1ee546df-e8da-434f-a1d4-5d269d00e41d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d4cd041ba884cedb08c70ea8083d027'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:24.824345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1ee546df-e8da-434f-a1d4-5d269d00e41d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d4cd041ba884cedb08c70ea8083d027'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:24.859918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1ee546df-e8da-434f-a1d4-5d269d00e41d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d4cd041ba884cedb08c70ea8083d027'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:24.860776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1ee546df-e8da-434f-a1d4-5d269d00e41d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d4cd041ba884cedb08c70ea8083d027'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:24.876649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1ee546df-e8da-434f-a1d4-5d269d00e41d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d4cd041ba884cedb08c70ea8083d027'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:24.885387 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3416/6781] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:42:24 2022] DELETE /identity/v3/users/7d4cd041ba884cedb08c70ea8083d027 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:42:24.886506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee546df-e8da-434f-a1d4-5d269d00e41d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:24.891973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1ee546df-e8da-434f-a1d4-5d269d00e41d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:24.935346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-10efa429-c365-44e1-a8b3-58e180dd62e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34aa9f6e6235477fb3c72f5bbff4820b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:24.959395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-10efa429-c365-44e1-a8b3-58e180dd62e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34aa9f6e6235477fb3c72f5bbff4820b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:25.000864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-10efa429-c365-44e1-a8b3-58e180dd62e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34aa9f6e6235477fb3c72f5bbff4820b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:25.002128 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-10efa429-c365-44e1-a8b3-58e180dd62e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34aa9f6e6235477fb3c72f5bbff4820b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:25.044179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee546df-e8da-434f-a1d4-5d269d00e41d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:25.044504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-10efa429-c365-44e1-a8b3-58e180dd62e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34aa9f6e6235477fb3c72f5bbff4820b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:25.056100 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31354dfe-ffef-4cb1-b675-83f669e6801b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:25.057047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31354dfe-ffef-4cb1-b675-83f669e6801b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:25.057495 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31354dfe-ffef-4cb1-b675-83f669e6801b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:25.057917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31354dfe-ffef-4cb1-b675-83f669e6801b admin admin] PATH_INFO: `/v3/users/799efc4d6d774eb0801e2ea64a56e29b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:25.059182 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3366/6782] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:42:24 2022] DELETE /identity/v3/users/34aa9f6e6235477fb3c72f5bbff4820b => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:25.060118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31354dfe-ffef-4cb1-b675-83f669e6801b admin admin] RBAC: Authorizing `identity:delete_user(user_id=799efc4d6d774eb0801e2ea64a56e29b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:25.064584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31354dfe-ffef-4cb1-b675-83f669e6801b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:25.072401 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677098a5-77b6-4d0a-ab8a-fa3c4f7fda8e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:25.072687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677098a5-77b6-4d0a-ab8a-fa3c4f7fda8e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:25.072972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677098a5-77b6-4d0a-ab8a-fa3c4f7fda8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:25.108699 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:25.179668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-677098a5-77b6-4d0a-ab8a-fa3c4f7fda8e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:25.186763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-677098a5-77b6-4d0a-ab8a-fa3c4f7fda8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:25.223586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-31354dfe-ffef-4cb1-b675-83f669e6801b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '799efc4d6d774eb0801e2ea64a56e29b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:25.246105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-31354dfe-ffef-4cb1-b675-83f669e6801b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '799efc4d6d774eb0801e2ea64a56e29b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:25.290207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-31354dfe-ffef-4cb1-b675-83f669e6801b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '799efc4d6d774eb0801e2ea64a56e29b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:25.290899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-31354dfe-ffef-4cb1-b675-83f669e6801b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '799efc4d6d774eb0801e2ea64a56e29b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:25.315563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-31354dfe-ffef-4cb1-b675-83f669e6801b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '799efc4d6d774eb0801e2ea64a56e29b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:25.342099 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3417/6783] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:42:24 2022] DELETE /identity/v3/users/799efc4d6d774eb0801e2ea64a56e29b => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:25.347670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041bc844-7185-4ef3-abc3-bf0279096b91 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:25.347981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041bc844-7185-4ef3-abc3-bf0279096b91 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:25.348261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041bc844-7185-4ef3-abc3-bf0279096b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:25.391700 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3367/6784] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:25.405863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-041bc844-7185-4ef3-abc3-bf0279096b91 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:25.407855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-041bc844-7185-4ef3-abc3-bf0279096b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:25.420499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677098a5-77b6-4d0a-ab8a-fa3c4f7fda8e None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:25.422766 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-677098a5-77b6-4d0a-ab8a-fa3c4f7fda8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:25.487873 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:25.522506 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3418/6785] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:25.546819 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041bc844-7185-4ef3-abc3-bf0279096b91 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:25.548450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-041bc844-7185-4ef3-abc3-bf0279096b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:25.653063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677098a5-77b6-4d0a-ab8a-fa3c4f7fda8e None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:25.681360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fd348-f648-4c8f-9ca3-4e1a672fbea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:25.682496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fd348-f648-4c8f-9ca3-4e1a672fbea7 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:25.686242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fd348-f648-4c8f-9ca3-4e1a672fbea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:25.686677 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fd348-f648-4c8f-9ca3-4e1a672fbea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:25.693284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041bc844-7185-4ef3-abc3-bf0279096b91 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:25.708417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532e345-6a1a-4a11-bace-6d8535ef453a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:25.709739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532e345-6a1a-4a11-bace-6d8535ef453a service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:25.710146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532e345-6a1a-4a11-bace-6d8535ef453a service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:25.713443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532e345-6a1a-4a11-bace-6d8535ef453a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:25.716991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fd348-f648-4c8f-9ca3-4e1a672fbea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:25.728023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fd348-f648-4c8f-9ca3-4e1a672fbea7 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:25.748967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d532e345-6a1a-4a11-bace-6d8535ef453a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:25.755176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d532e345-6a1a-4a11-bace-6d8535ef453a service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:25.762484 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3368/6786] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:25.773090 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3419/6787] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:42:26.123188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fd348-f648-4c8f-9ca3-4e1a672fbea7 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:26.126901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5c0fd348-f648-4c8f-9ca3-4e1a672fbea7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:26.186147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fd348-f648-4c8f-9ca3-4e1a672fbea7 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:26.212968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8446e7-8edd-4f43-a12f-5862fda62589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:26.214514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8446e7-8edd-4f43-a12f-5862fda62589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:26.215832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8446e7-8edd-4f43-a12f-5862fda62589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:26.216161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8446e7-8edd-4f43-a12f-5862fda62589 admin admin] PATH_INFO: `/v3/projects/42d468c1bfe54df89d654baa22f90b2d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:26.219395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8446e7-8edd-4f43-a12f-5862fda62589 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42d468c1bfe54df89d654baa22f90b2d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:26.223611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8446e7-8edd-4f43-a12f-5862fda62589 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:26.352566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3d8446e7-8edd-4f43-a12f-5862fda62589 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42d468c1bfe54df89d654baa22f90b2d', 'request_id': 'req-3d8446e7-8edd-4f43-a12f-5862fda62589'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:26.381240 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3d8446e7-8edd-4f43-a12f-5862fda62589 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42d468c1bfe54df89d654baa22f90b2d', 'request_id': 'req-3d8446e7-8edd-4f43-a12f-5862fda62589'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:26.400238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3d8446e7-8edd-4f43-a12f-5862fda62589 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42d468c1bfe54df89d654baa22f90b2d', 'request_id': 'req-3d8446e7-8edd-4f43-a12f-5862fda62589'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:26.432634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3d8446e7-8edd-4f43-a12f-5862fda62589 admin admin] The token cache is being invalidate because project 42d468c1bfe54df89d654baa22f90b2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:26.432972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3d8446e7-8edd-4f43-a12f-5862fda62589 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:26.434221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3d8446e7-8edd-4f43-a12f-5862fda62589 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:26.436069 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3369/6788] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:26 2022] DELETE /identity/v3/projects/42d468c1bfe54df89d654baa22f90b2d => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:26.440824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a66bf-2330-4b1f-b39e-137d154bbca8 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:26.442604 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a66bf-2330-4b1f-b39e-137d154bbca8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:26.443222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a66bf-2330-4b1f-b39e-137d154bbca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:26.491841 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b48a66bf-2330-4b1f-b39e-137d154bbca8 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:26.496048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b48a66bf-2330-4b1f-b39e-137d154bbca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:26.582886 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:26.643394 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3420/6789] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:26.644316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d2760-b435-4b53-aa5f-9d351e745905 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:26.644639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d2760-b435-4b53-aa5f-9d351e745905 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:26.644984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d2760-b435-4b53-aa5f-9d351e745905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:26.669627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b27d2760-b435-4b53-aa5f-9d351e745905 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:26.670882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b27d2760-b435-4b53-aa5f-9d351e745905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:26.683749 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3370/6790] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:26.685976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a66bf-2330-4b1f-b39e-137d154bbca8 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:26.703971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a66bf-2330-4b1f-b39e-137d154bbca8 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:26.723215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911514d-67e6-4d82-a794-0067c3f038b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:26.723856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911514d-67e6-4d82-a794-0067c3f038b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:26.724194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911514d-67e6-4d82-a794-0067c3f038b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:26.724463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911514d-67e6-4d82-a794-0067c3f038b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:26.725141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911514d-67e6-4d82-a794-0067c3f038b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:42:26.725439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911514d-67e6-4d82-a794-0067c3f038b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:26.734396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911514d-67e6-4d82-a794-0067c3f038b8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:26.762301 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3421/6791] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:42:26.767707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d2760-b435-4b53-aa5f-9d351e745905 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:26.780899 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d2760-b435-4b53-aa5f-9d351e745905 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:26.795108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a151bd-e391-4b6e-9844-edf0ce711ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:26.795980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a151bd-e391-4b6e-9844-edf0ce711ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:26.796522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a151bd-e391-4b6e-9844-edf0ce711ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:26.797626 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a151bd-e391-4b6e-9844-edf0ce711ea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:26.801556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a151bd-e391-4b6e-9844-edf0ce711ea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:26.809081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a151bd-e391-4b6e-9844-edf0ce711ea5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:26.931358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911514d-67e6-4d82-a794-0067c3f038b8 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:26.934998 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3371/6792] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:42:26 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:26.939025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a151bd-e391-4b6e-9844-edf0ce711ea5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:26.946706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6911514d-67e6-4d82-a794-0067c3f038b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:27.006433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911514d-67e6-4d82-a794-0067c3f038b8 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:27.163915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a151bd-e391-4b6e-9844-edf0ce711ea5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:27.173260 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82784dfa-7368-47e5-a10b-b787940d2e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:27.173575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82784dfa-7368-47e5-a10b-b787940d2e57 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:27.174778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82784dfa-7368-47e5-a10b-b787940d2e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:27.175135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82784dfa-7368-47e5-a10b-b787940d2e57 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:27.178542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82784dfa-7368-47e5-a10b-b787940d2e57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:27.180678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82784dfa-7368-47e5-a10b-b787940d2e57 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:27.192381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894d1bb-90a0-4bb4-a691-b50909475508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:27.193591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894d1bb-90a0-4bb4-a691-b50909475508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:27.193942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894d1bb-90a0-4bb4-a691-b50909475508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:27.194234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894d1bb-90a0-4bb4-a691-b50909475508 admin admin] PATH_INFO: `/v3/projects/17689d9fb2cc43af87779fbbb399ba24` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:27.196508 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894d1bb-90a0-4bb4-a691-b50909475508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17689d9fb2cc43af87779fbbb399ba24)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:27.200840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894d1bb-90a0-4bb4-a691-b50909475508 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:27.246976 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3372/6793] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:42:26 2022] POST /identity/v3/users => generated 296 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:27.250928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82784dfa-7368-47e5-a10b-b787940d2e57 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:27.263252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-82784dfa-7368-47e5-a10b-b787940d2e57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:27.271544 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:27.288984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82784dfa-7368-47e5-a10b-b787940d2e57 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:27.303200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94820e3a-faa8-4776-a471-ea8985f9855c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:27.303876 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94820e3a-faa8-4776-a471-ea8985f9855c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:27.304182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94820e3a-faa8-4776-a471-ea8985f9855c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:27.304454 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94820e3a-faa8-4776-a471-ea8985f9855c admin admin] PATH_INFO: `/v3/projects/019b0c4dadba463e99513297ede55f3c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:27.308287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94820e3a-faa8-4776-a471-ea8985f9855c admin admin] RBAC: Authorizing `identity:delete_project(project_id=019b0c4dadba463e99513297ede55f3c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:27.310251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94820e3a-faa8-4776-a471-ea8985f9855c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:27.368806 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9894d1bb-90a0-4bb4-a691-b50909475508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17689d9fb2cc43af87779fbbb399ba24', 'request_id': 'req-9894d1bb-90a0-4bb4-a691-b50909475508'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:27.384447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9894d1bb-90a0-4bb4-a691-b50909475508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17689d9fb2cc43af87779fbbb399ba24', 'request_id': 'req-9894d1bb-90a0-4bb4-a691-b50909475508'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:27.402476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9894d1bb-90a0-4bb4-a691-b50909475508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17689d9fb2cc43af87779fbbb399ba24', 'request_id': 'req-9894d1bb-90a0-4bb4-a691-b50909475508'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:27.450922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-94820e3a-faa8-4776-a471-ea8985f9855c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '019b0c4dadba463e99513297ede55f3c', 'request_id': 'req-94820e3a-faa8-4776-a471-ea8985f9855c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:27.451878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9894d1bb-90a0-4bb4-a691-b50909475508 admin admin] The token cache is being invalidate because project 17689d9fb2cc43af87779fbbb399ba24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:27.452424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9894d1bb-90a0-4bb4-a691-b50909475508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:27.454356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9894d1bb-90a0-4bb4-a691-b50909475508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:27.457821 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3422/6794] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:26 2022] DELETE /identity/v3/projects/17689d9fb2cc43af87779fbbb399ba24 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:27.461909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894d1bb-90a0-4bb4-a691-b50909475508 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:27.464749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-94820e3a-faa8-4776-a471-ea8985f9855c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '019b0c4dadba463e99513297ede55f3c', 'request_id': 'req-94820e3a-faa8-4776-a471-ea8985f9855c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:27.466625 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9894d1bb-90a0-4bb4-a691-b50909475508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:27.478923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-94820e3a-faa8-4776-a471-ea8985f9855c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '019b0c4dadba463e99513297ede55f3c', 'request_id': 'req-94820e3a-faa8-4776-a471-ea8985f9855c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:27.518960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-94820e3a-faa8-4776-a471-ea8985f9855c admin admin] The token cache is being invalidate because project 019b0c4dadba463e99513297ede55f3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:27.519388 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-94820e3a-faa8-4776-a471-ea8985f9855c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:27.520182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-94820e3a-faa8-4776-a471-ea8985f9855c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:27.526778 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3373/6795] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:27 2022] DELETE /identity/v3/projects/019b0c4dadba463e99513297ede55f3c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:27.530788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94820e3a-faa8-4776-a471-ea8985f9855c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:27.533645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-94820e3a-faa8-4776-a471-ea8985f9855c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:27.591372 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:27.619195 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894d1bb-90a0-4bb4-a691-b50909475508 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:27.691426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94820e3a-faa8-4776-a471-ea8985f9855c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:27.704024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f7f9d-b55a-4b0a-9a6c-7366848d6087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:27.704659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f7f9d-b55a-4b0a-9a6c-7366848d6087 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:27.705493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67db78-a537-4ce6-b5ae-0f08b9b2b462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:27.706187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f7f9d-b55a-4b0a-9a6c-7366848d6087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:27.706507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f7f9d-b55a-4b0a-9a6c-7366848d6087 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:27.706964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67db78-a537-4ce6-b5ae-0f08b9b2b462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:27.707399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67db78-a537-4ce6-b5ae-0f08b9b2b462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:27.707817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67db78-a537-4ce6-b5ae-0f08b9b2b462 admin admin] PATH_INFO: `/v3/users/7734cf4b9307488ba85ddbd4f8e8335f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:27.709870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f7f9d-b55a-4b0a-9a6c-7366848d6087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:27.711728 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67db78-a537-4ce6-b5ae-0f08b9b2b462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7734cf4b9307488ba85ddbd4f8e8335f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:27.713318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f7f9d-b55a-4b0a-9a6c-7366848d6087 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:27.716403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67db78-a537-4ce6-b5ae-0f08b9b2b462 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:27.733166 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3423/6796] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:27.734997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d64326-8bf8-4bc2-ab92-1be0edb11f9b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:27.736092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d64326-8bf8-4bc2-ab92-1be0edb11f9b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:27.736556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d64326-8bf8-4bc2-ab92-1be0edb11f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:27.757428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-27d64326-8bf8-4bc2-ab92-1be0edb11f9b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:27.759646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-27d64326-8bf8-4bc2-ab92-1be0edb11f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:27.778611 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3424/6797] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:27.782104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d64326-8bf8-4bc2-ab92-1be0edb11f9b None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:27.783866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-27d64326-8bf8-4bc2-ab92-1be0edb11f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:27.791332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-be67db78-a537-4ce6-b5ae-0f08b9b2b462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7734cf4b9307488ba85ddbd4f8e8335f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:27.798905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d64326-8bf8-4bc2-ab92-1be0edb11f9b None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:27.804314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-be67db78-a537-4ce6-b5ae-0f08b9b2b462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7734cf4b9307488ba85ddbd4f8e8335f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:27.809281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161b6bb-59f7-457d-80ab-34be5c25cab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:27.823488 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161b6bb-59f7-457d-80ab-34be5c25cab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:27.824087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-be67db78-a537-4ce6-b5ae-0f08b9b2b462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7734cf4b9307488ba85ddbd4f8e8335f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:27.824335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161b6bb-59f7-457d-80ab-34be5c25cab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:27.825362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-be67db78-a537-4ce6-b5ae-0f08b9b2b462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7734cf4b9307488ba85ddbd4f8e8335f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:27.827380 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161b6bb-59f7-457d-80ab-34be5c25cab1 admin admin] PATH_INFO: `/v3/projects/07302a9ffc8c4c8fb49df093c103e92b/users/10ffb2739e264a5a9ef07acee5587820/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:27.846924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-be67db78-a537-4ce6-b5ae-0f08b9b2b462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7734cf4b9307488ba85ddbd4f8e8335f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:27.859460 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3374/6798] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:42:27 2022] DELETE /identity/v3/users/7734cf4b9307488ba85ddbd4f8e8335f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:27.859460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d70fa4-bb49-410a-8883-7ded0ef2f629 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:27.859460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d70fa4-bb49-410a-8883-7ded0ef2f629 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:27.859460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d70fa4-bb49-410a-8883-7ded0ef2f629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:27.872347 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:27.885878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161b6bb-59f7-457d-80ab-34be5c25cab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07302a9ffc8c4c8fb49df093c103e92b, user_id=10ffb2739e264a5a9ef07acee5587820, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:27.890015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-39d70fa4-bb49-410a-8883-7ded0ef2f629 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:27.891583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161b6bb-59f7-457d-80ab-34be5c25cab1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:27.893426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-39d70fa4-bb49-410a-8883-7ded0ef2f629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:27.920756 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3425/6799] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:27 2022] PUT /identity/v3/projects/07302a9ffc8c4c8fb49df093c103e92b/users/10ffb2739e264a5a9ef07acee5587820/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:27.925235 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161b6bb-59f7-457d-80ab-34be5c25cab1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:27.926826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b161b6bb-59f7-457d-80ab-34be5c25cab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:28.064793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161b6bb-59f7-457d-80ab-34be5c25cab1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:28.069587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49bbb5c-8ae7-43c0-b240-9384aaa9ce6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:28.070221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bbb5c-8ae7-43c0-b240-9384aaa9ce6e admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:28.070494 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bbb5c-8ae7-43c0-b240-9384aaa9ce6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:28.070763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bbb5c-8ae7-43c0-b240-9384aaa9ce6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:28.071411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49bbb5c-8ae7-43c0-b240-9384aaa9ce6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:28.073052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49bbb5c-8ae7-43c0-b240-9384aaa9ce6e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:28.084921 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3375/6800] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:28.089214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d70fa4-bb49-410a-8883-7ded0ef2f629 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:28.103840 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3426/6801] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:42:28.104957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49bbb5c-8ae7-43c0-b240-9384aaa9ce6e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:28.107755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d70fa4-bb49-410a-8883-7ded0ef2f629 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:28.119387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d39d4-d141-44c5-b8c8-b238e73e7557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:28.120215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d39d4-d141-44c5-b8c8-b238e73e7557 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:28.120604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d39d4-d141-44c5-b8c8-b238e73e7557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:28.121022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d39d4-d141-44c5-b8c8-b238e73e7557 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:28.122216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d39d4-d141-44c5-b8c8-b238e73e7557 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:42:28.122474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d39d4-d141-44c5-b8c8-b238e73e7557 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:28.125034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d39d4-d141-44c5-b8c8-b238e73e7557 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:28.139489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49bbb5c-8ae7-43c0-b240-9384aaa9ce6e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:28.139489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5759d-db44-478b-a818-f23de3342011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:28.139489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5759d-db44-478b-a818-f23de3342011 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:28.139489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5759d-db44-478b-a818-f23de3342011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:28.140001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5759d-db44-478b-a818-f23de3342011 admin admin] PATH_INFO: `/v3/projects/07302a9ffc8c4c8fb49df093c103e92b/users/10ffb2739e264a5a9ef07acee5587820/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:28.142987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5759d-db44-478b-a818-f23de3342011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07302a9ffc8c4c8fb49df093c103e92b, user_id=10ffb2739e264a5a9ef07acee5587820, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:28.148487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5759d-db44-478b-a818-f23de3342011 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:28.153358 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3376/6802] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:42:28.157446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d39d4-d141-44c5-b8c8-b238e73e7557 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:28.183300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d39d4-d141-44c5-b8c8-b238e73e7557 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:28.186523 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3427/6803] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:28 2022] PUT /identity/v3/projects/07302a9ffc8c4c8fb49df093c103e92b/users/10ffb2739e264a5a9ef07acee5587820/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:28.188738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6473a-4827-44a0-aa55-4bc1fdde1429 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:28.189029 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6473a-4827-44a0-aa55-4bc1fdde1429 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:28.189301 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6473a-4827-44a0-aa55-4bc1fdde1429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:28.268815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3da6473a-4827-44a0-aa55-4bc1fdde1429 None None] MFA Rules not processed for user `10ffb2739e264a5a9ef07acee5587820`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:28.270041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3da6473a-4827-44a0-aa55-4bc1fdde1429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:28.356416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff0465-2578-4289-823a-39485746cf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:28.357161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff0465-2578-4289-823a-39485746cf93 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:28.357340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff0465-2578-4289-823a-39485746cf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:28.358115 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff0465-2578-4289-823a-39485746cf93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:28.358778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff0465-2578-4289-823a-39485746cf93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:28.361404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ff0465-2578-4289-823a-39485746cf93 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:28.372442 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:28.429015 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3377/6804] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:42:28 2022] POST /identity/v3/projects => generated 365 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:28.433306 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff0465-2578-4289-823a-39485746cf93 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:28.504321 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3428/6805] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:28 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:28.509627 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6473a-4827-44a0-aa55-4bc1fdde1429 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:28.545745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6473a-4827-44a0-aa55-4bc1fdde1429 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:28.647723 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff0465-2578-4289-823a-39485746cf93 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:28.662425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ab476-4c7b-4769-b0aa-0ec3f6462789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:28.663054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ab476-4c7b-4769-b0aa-0ec3f6462789 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:28.663360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ab476-4c7b-4769-b0aa-0ec3f6462789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:28.663623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ab476-4c7b-4769-b0aa-0ec3f6462789 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:28.664284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ab476-4c7b-4769-b0aa-0ec3f6462789 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:28.666219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ab476-4c7b-4769-b0aa-0ec3f6462789 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:28.684170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529d3b1-45d8-4598-ac37-52a2dbfeb08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:28.685165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529d3b1-45d8-4598-ac37-52a2dbfeb08e admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:28.685653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529d3b1-45d8-4598-ac37-52a2dbfeb08e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:28.686382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529d3b1-45d8-4598-ac37-52a2dbfeb08e admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:28.687289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529d3b1-45d8-4598-ac37-52a2dbfeb08e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:28.689456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529d3b1-45d8-4598-ac37-52a2dbfeb08e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:28.710998 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3378/6806] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:42:28 2022] POST /identity/v3/users => generated 283 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:42:28.710998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ab476-4c7b-4769-b0aa-0ec3f6462789 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:28.715323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-508ab476-4c7b-4769-b0aa-0ec3f6462789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:28.765666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ab476-4c7b-4769-b0aa-0ec3f6462789 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:28.785861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8762fa1-ba89-4acf-a1e7-9a7f077288f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:28.786528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8762fa1-ba89-4acf-a1e7-9a7f077288f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:28.786805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8762fa1-ba89-4acf-a1e7-9a7f077288f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:28.787073 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8762fa1-ba89-4acf-a1e7-9a7f077288f1 admin admin] PATH_INFO: `/v3/projects/5bcbadc38fb94490aa6fcd6aa6c33c90` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:28.789350 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3429/6807] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:42:28 2022] POST /identity/v3/projects => generated 381 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:28.793683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8762fa1-ba89-4acf-a1e7-9a7f077288f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bcbadc38fb94490aa6fcd6aa6c33c90)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:28.795651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8762fa1-ba89-4acf-a1e7-9a7f077288f1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:28.798447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529d3b1-45d8-4598-ac37-52a2dbfeb08e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:28.800507 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:28.954436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b8762fa1-ba89-4acf-a1e7-9a7f077288f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bcbadc38fb94490aa6fcd6aa6c33c90', 'request_id': 'req-b8762fa1-ba89-4acf-a1e7-9a7f077288f1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:28.964305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529d3b1-45d8-4598-ac37-52a2dbfeb08e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:28.973663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b8762fa1-ba89-4acf-a1e7-9a7f077288f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bcbadc38fb94490aa6fcd6aa6c33c90', 'request_id': 'req-b8762fa1-ba89-4acf-a1e7-9a7f077288f1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:28.999005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b8762fa1-ba89-4acf-a1e7-9a7f077288f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bcbadc38fb94490aa6fcd6aa6c33c90', 'request_id': 'req-b8762fa1-ba89-4acf-a1e7-9a7f077288f1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:29.042963 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b8762fa1-ba89-4acf-a1e7-9a7f077288f1 admin admin] The token cache is being invalidate because project 5bcbadc38fb94490aa6fcd6aa6c33c90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:29.043257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b8762fa1-ba89-4acf-a1e7-9a7f077288f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:29.044244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b8762fa1-ba89-4acf-a1e7-9a7f077288f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:29.046303 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3379/6808] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:28 2022] DELETE /identity/v3/projects/5bcbadc38fb94490aa6fcd6aa6c33c90 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:29.052360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8762fa1-ba89-4acf-a1e7-9a7f077288f1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:29.064585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b8762fa1-ba89-4acf-a1e7-9a7f077288f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:29.141179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722bcb6-d8aa-44ad-9010-811d8dbfdfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:29.141808 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722bcb6-d8aa-44ad-9010-811d8dbfdfd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:29.142111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722bcb6-d8aa-44ad-9010-811d8dbfdfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:29.142450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722bcb6-d8aa-44ad-9010-811d8dbfdfd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:29.143252 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722bcb6-d8aa-44ad-9010-811d8dbfdfd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:29.145102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722bcb6-d8aa-44ad-9010-811d8dbfdfd4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:29.161239 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:29.173396 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3430/6809] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:29.174393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722bcb6-d8aa-44ad-9010-811d8dbfdfd4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:29.180540 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6722bcb6-d8aa-44ad-9010-811d8dbfdfd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:29.201781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722bcb6-d8aa-44ad-9010-811d8dbfdfd4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:29.215469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4204f-7942-4525-bea1-d9731f66f7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:29.216150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4204f-7942-4525-bea1-d9731f66f7f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:29.216425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4204f-7942-4525-bea1-d9731f66f7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:29.216847 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4204f-7942-4525-bea1-d9731f66f7f7 admin admin] PATH_INFO: `/v3/users/fb3aa034814c4dbeb5908c7d91f6f83a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:29.220302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f4204f-7942-4525-bea1-d9731f66f7f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb3aa034814c4dbeb5908c7d91f6f83a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:29.222274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f4204f-7942-4525-bea1-d9731f66f7f7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:29.231140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8762fa1-ba89-4acf-a1e7-9a7f077288f1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:29.256518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d724452-0222-410c-a595-4b6f89fd1187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:29.257290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d724452-0222-410c-a595-4b6f89fd1187 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:29.257575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d724452-0222-410c-a595-4b6f89fd1187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:29.257857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d724452-0222-410c-a595-4b6f89fd1187 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:29.258741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d724452-0222-410c-a595-4b6f89fd1187 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:29.262721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d724452-0222-410c-a595-4b6f89fd1187 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:29.331304 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3380/6810] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:42:29 2022] POST /identity/v3/users => generated 291 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:29.333972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d724452-0222-410c-a595-4b6f89fd1187 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:29.340499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8d724452-0222-410c-a595-4b6f89fd1187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:29.347676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c0f4204f-7942-4525-bea1-d9731f66f7f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb3aa034814c4dbeb5908c7d91f6f83a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:29.362635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c0f4204f-7942-4525-bea1-d9731f66f7f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb3aa034814c4dbeb5908c7d91f6f83a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:29.384357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c0f4204f-7942-4525-bea1-d9731f66f7f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb3aa034814c4dbeb5908c7d91f6f83a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:29.385286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c0f4204f-7942-4525-bea1-d9731f66f7f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb3aa034814c4dbeb5908c7d91f6f83a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:29.385441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d724452-0222-410c-a595-4b6f89fd1187 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:29.397099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c0f4204f-7942-4525-bea1-d9731f66f7f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb3aa034814c4dbeb5908c7d91f6f83a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:29.403528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90820b4-900a-412f-ad91-e40087a92cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:29.404217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90820b4-900a-412f-ad91-e40087a92cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:29.404495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90820b4-900a-412f-ad91-e40087a92cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:29.404767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90820b4-900a-412f-ad91-e40087a92cc7 admin admin] PATH_INFO: `/v3/users/4c0034e65f0c446698df095467a5968b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:29.408841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90820b4-900a-412f-ad91-e40087a92cc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c0034e65f0c446698df095467a5968b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:29.412769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90820b4-900a-412f-ad91-e40087a92cc7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:29.418935 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3431/6811] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:42:29 2022] DELETE /identity/v3/users/fb3aa034814c4dbeb5908c7d91f6f83a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:29.418935 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4204f-7942-4525-bea1-d9731f66f7f7 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:29.419603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c0f4204f-7942-4525-bea1-d9731f66f7f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:29.513108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4204f-7942-4525-bea1-d9731f66f7f7 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:29.518338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e08a6-7355-4029-84f5-7d8d9174277b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:29.519047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e08a6-7355-4029-84f5-7d8d9174277b admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:29.519388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e08a6-7355-4029-84f5-7d8d9174277b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:29.519722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e08a6-7355-4029-84f5-7d8d9174277b admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:29.520486 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e08a6-7355-4029-84f5-7d8d9174277b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:29.522536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e08a6-7355-4029-84f5-7d8d9174277b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:29.523153 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c90820b4-900a-412f-ad91-e40087a92cc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c0034e65f0c446698df095467a5968b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:29.538487 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3432/6812] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:29.538487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e08a6-7355-4029-84f5-7d8d9174277b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:29.538793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c90820b4-900a-412f-ad91-e40087a92cc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c0034e65f0c446698df095467a5968b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:29.539997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-950e08a6-7355-4029-84f5-7d8d9174277b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:29.560611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e08a6-7355-4029-84f5-7d8d9174277b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:29.567663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf756c3c-80f9-4fc1-a6cd-a85f68efb0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:29.568707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf756c3c-80f9-4fc1-a6cd-a85f68efb0fa admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:29.569304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf756c3c-80f9-4fc1-a6cd-a85f68efb0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:29.569761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf756c3c-80f9-4fc1-a6cd-a85f68efb0fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:29.570650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf756c3c-80f9-4fc1-a6cd-a85f68efb0fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:29.572466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c90820b4-900a-412f-ad91-e40087a92cc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c0034e65f0c446698df095467a5968b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:29.572855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf756c3c-80f9-4fc1-a6cd-a85f68efb0fa admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:29.573497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c90820b4-900a-412f-ad91-e40087a92cc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c0034e65f0c446698df095467a5968b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:29.576818 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=80,keystone:DELETE=16,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:29.590146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c90820b4-900a-412f-ad91-e40087a92cc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c0034e65f0c446698df095467a5968b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:29.590471 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3433/6813] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:29.592142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8129a9e-85da-4e9d-81b5-07080c938fb5 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:29.592610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8129a9e-85da-4e9d-81b5-07080c938fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:29.593279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8129a9e-85da-4e9d-81b5-07080c938fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:29.608199 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3381/6814] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:42:29 2022] DELETE /identity/v3/users/4c0034e65f0c446698df095467a5968b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:29.608199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90820b4-900a-412f-ad91-e40087a92cc7 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:29.608761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c90820b4-900a-412f-ad91-e40087a92cc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:29.622495 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d8129a9e-85da-4e9d-81b5-07080c938fb5 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:29.624070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d8129a9e-85da-4e9d-81b5-07080c938fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:29.768354 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:29.803811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90820b4-900a-412f-ad91-e40087a92cc7 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:29.806118 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3434/6815] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:29.808566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8129a9e-85da-4e9d-81b5-07080c938fb5 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:29.811096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d8129a9e-85da-4e9d-81b5-07080c938fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:29.814908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5690de-352e-481f-a1fc-33c3c487a83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:29.816647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5690de-352e-481f-a1fc-33c3c487a83c admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:29.816970 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5690de-352e-481f-a1fc-33c3c487a83c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:29.818058 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5690de-352e-481f-a1fc-33c3c487a83c admin admin] PATH_INFO: `/v3/projects/99fc117272b74d44a99e68bc88cd99bb/users/b45160943ae64ad88035b0e71b0063b5/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:29.854650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8129a9e-85da-4e9d-81b5-07080c938fb5 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:29.869102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5690de-352e-481f-a1fc-33c3c487a83c admin admin] RBAC: Authorizing `identity:create_grant(project_id=99fc117272b74d44a99e68bc88cd99bb, user_id=b45160943ae64ad88035b0e71b0063b5, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:29.871801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5690de-352e-481f-a1fc-33c3c487a83c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:29.878493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55bf67-4163-4c43-a294-ec1f95093645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:29.879326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55bf67-4163-4c43-a294-ec1f95093645 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:29.879326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55bf67-4163-4c43-a294-ec1f95093645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:29.879588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55bf67-4163-4c43-a294-ec1f95093645 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:29.880333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f55bf67-4163-4c43-a294-ec1f95093645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:29.882149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f55bf67-4163-4c43-a294-ec1f95093645 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:29.903197 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3382/6816] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:29 2022] PUT /identity/v3/projects/99fc117272b74d44a99e68bc88cd99bb/users/b45160943ae64ad88035b0e71b0063b5/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:29.906682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5690de-352e-481f-a1fc-33c3c487a83c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:29.908327 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3435/6817] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:29.912094 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55bf67-4163-4c43-a294-ec1f95093645 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:29.914861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ee5690de-352e-481f-a1fc-33c3c487a83c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:29.934422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55bf67-4163-4c43-a294-ec1f95093645 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:30.069265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5690de-352e-481f-a1fc-33c3c487a83c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:30.073177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556e279-0396-4f24-829e-626ba9253537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:30.073807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556e279-0396-4f24-829e-626ba9253537 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:30.074084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556e279-0396-4f24-829e-626ba9253537 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:30.074354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556e279-0396-4f24-829e-626ba9253537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:30.090752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e0abb-fedc-4411-a46d-30e9040bb186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:30.092268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e0abb-fedc-4411-a46d-30e9040bb186 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:30.095583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e0abb-fedc-4411-a46d-30e9040bb186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:30.095958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e0abb-fedc-4411-a46d-30e9040bb186 admin admin] PATH_INFO: `/v3/projects/cd803183a2a84ad28d4c6f154bef6b80/users/8c35d3203ad541a2853167791c0c139b/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:30.130797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e0abb-fedc-4411-a46d-30e9040bb186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd803183a2a84ad28d4c6f154bef6b80, user_id=8c35d3203ad541a2853167791c0c139b, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:30.139641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e0abb-fedc-4411-a46d-30e9040bb186 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:30.169693 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3436/6818] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:29 2022] PUT /identity/v3/projects/cd803183a2a84ad28d4c6f154bef6b80/users/8c35d3203ad541a2853167791c0c139b/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:30.171205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38c8e4-6914-423d-b29c-b0a0c4c1832d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:30.172050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38c8e4-6914-423d-b29c-b0a0c4c1832d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:30.172453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f38c8e4-6914-423d-b29c-b0a0c4c1832d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:30.221247 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556e279-0396-4f24-829e-626ba9253537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:30.224864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556e279-0396-4f24-829e-626ba9253537 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:30.237805 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2f38c8e4-6914-423d-b29c-b0a0c4c1832d None None] MFA Rules not processed for user `b45160943ae64ad88035b0e71b0063b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:30.239290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2f38c8e4-6914-423d-b29c-b0a0c4c1832d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:30.250041 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3383/6819] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:30.251468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e4a9f-95ac-4aba-a1ec-b27705a1f645 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:30.251759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e4a9f-95ac-4aba-a1ec-b27705a1f645 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:30.252066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e4a9f-95ac-4aba-a1ec-b27705a1f645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:30.331395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6a1e4a9f-95ac-4aba-a1ec-b27705a1f645 None None] MFA Rules not processed for user `8c35d3203ad541a2853167791c0c139b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:30.333393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6a1e4a9f-95ac-4aba-a1ec-b27705a1f645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:30.351498 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3437/6820] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:30.366038 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:30.393650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38c8e4-6914-423d-b29c-b0a0c4c1832d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:30.396632 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2f38c8e4-6914-423d-b29c-b0a0c4c1832d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:30.486840 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:30.541089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f38c8e4-6914-423d-b29c-b0a0c4c1832d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:30.558897 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d50c86-5d42-47a3-930e-8d176dd8e85c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:30.559535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d50c86-5d42-47a3-930e-8d176dd8e85c service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:30.559808 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d50c86-5d42-47a3-930e-8d176dd8e85c service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:30.560099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d50c86-5d42-47a3-930e-8d176dd8e85c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:30.571640 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3384/6821] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:30.581110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e4a9f-95ac-4aba-a1ec-b27705a1f645 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:30.583863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6a1e4a9f-95ac-4aba-a1ec-b27705a1f645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:30.585187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d50c86-5d42-47a3-930e-8d176dd8e85c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:30.592714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d50c86-5d42-47a3-930e-8d176dd8e85c service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:30.613419 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3438/6822] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:30.680371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d50c86-5d42-47a3-930e-8d176dd8e85c service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:30.800959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e4a9f-95ac-4aba-a1ec-b27705a1f645 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:30.808871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd9551-cd03-4669-b4d9-8d5ee9f94bff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:30.813294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd9551-cd03-4669-b4d9-8d5ee9f94bff service glance] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:30.813673 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd9551-cd03-4669-b4d9-8d5ee9f94bff service glance] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:30.813852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd9551-cd03-4669-b4d9-8d5ee9f94bff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:30.819478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f7fd9551-cd03-4669-b4d9-8d5ee9f94bff service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:30.854165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d50c86-5d42-47a3-930e-8d176dd8e85c service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:30.876470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6d874-a8f8-4f09-975e-a0b12845f57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:30.877166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6d874-a8f8-4f09-975e-a0b12845f57d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:30.877454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6d874-a8f8-4f09-975e-a0b12845f57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:30.877797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6d874-a8f8-4f09-975e-a0b12845f57d admin admin] PATH_INFO: `/v3/users/b45160943ae64ad88035b0e71b0063b5` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:30.880048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6d874-a8f8-4f09-975e-a0b12845f57d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b45160943ae64ad88035b0e71b0063b5)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:30.881978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6d874-a8f8-4f09-975e-a0b12845f57d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:30.989443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bad6d874-a8f8-4f09-975e-a0b12845f57d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b45160943ae64ad88035b0e71b0063b5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:30.998236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bad6d874-a8f8-4f09-975e-a0b12845f57d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b45160943ae64ad88035b0e71b0063b5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:31.013479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bad6d874-a8f8-4f09-975e-a0b12845f57d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b45160943ae64ad88035b0e71b0063b5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:31.014331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bad6d874-a8f8-4f09-975e-a0b12845f57d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b45160943ae64ad88035b0e71b0063b5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:31.023991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd9551-cd03-4669-b4d9-8d5ee9f94bff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:31.026084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd9551-cd03-4669-b4d9-8d5ee9f94bff service glance] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:31.029268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bad6d874-a8f8-4f09-975e-a0b12845f57d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b45160943ae64ad88035b0e71b0063b5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:31.042339 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3439/6823] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:42:30 2022] DELETE /identity/v3/users/b45160943ae64ad88035b0e71b0063b5 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:42:31.043214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6d874-a8f8-4f09-975e-a0b12845f57d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:31.045104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-bad6d874-a8f8-4f09-975e-a0b12845f57d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:31.054758 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3385/6824] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:30 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:42:31.057060 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd9551-cd03-4669-b4d9-8d5ee9f94bff service glance] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:31.060535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f7fd9551-cd03-4669-b4d9-8d5ee9f94bff service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:31.096872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd9551-cd03-4669-b4d9-8d5ee9f94bff service glance] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:31.303162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6d874-a8f8-4f09-975e-a0b12845f57d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:31.313592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc28a6b-eb09-43fd-9910-52e7b8c3a83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:31.314812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc28a6b-eb09-43fd-9910-52e7b8c3a83d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:31.314812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc28a6b-eb09-43fd-9910-52e7b8c3a83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:31.314812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc28a6b-eb09-43fd-9910-52e7b8c3a83d admin admin] PATH_INFO: `/v3/projects/23dd807bcbb44610a230e6a39483d77a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:31.316098 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc28a6b-eb09-43fd-9910-52e7b8c3a83d admin admin] RBAC: Authorizing `identity:delete_project(project_id=23dd807bcbb44610a230e6a39483d77a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:31.318330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc28a6b-eb09-43fd-9910-52e7b8c3a83d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:31.322814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61bf5b7-387c-459d-815e-bdab17fd8ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:31.323474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bf5b7-387c-459d-815e-bdab17fd8ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:31.323748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bf5b7-387c-459d-815e-bdab17fd8ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:31.324111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bf5b7-387c-459d-815e-bdab17fd8ed4 admin admin] PATH_INFO: `/v3/projects/223f8ed551464993aa605ca6ff77d1fd` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:31.326013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61bf5b7-387c-459d-815e-bdab17fd8ed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=223f8ed551464993aa605ca6ff77d1fd)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:31.336801 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:31.337233 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61bf5b7-387c-459d-815e-bdab17fd8ed4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:31.355282 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:31.431142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5cc28a6b-eb09-43fd-9910-52e7b8c3a83d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23dd807bcbb44610a230e6a39483d77a', 'request_id': 'req-5cc28a6b-eb09-43fd-9910-52e7b8c3a83d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:31.451234 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5cc28a6b-eb09-43fd-9910-52e7b8c3a83d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23dd807bcbb44610a230e6a39483d77a', 'request_id': 'req-5cc28a6b-eb09-43fd-9910-52e7b8c3a83d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:31.473089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5cc28a6b-eb09-43fd-9910-52e7b8c3a83d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23dd807bcbb44610a230e6a39483d77a', 'request_id': 'req-5cc28a6b-eb09-43fd-9910-52e7b8c3a83d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:31.485192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e61bf5b7-387c-459d-815e-bdab17fd8ed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '223f8ed551464993aa605ca6ff77d1fd', 'request_id': 'req-e61bf5b7-387c-459d-815e-bdab17fd8ed4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:31.501701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e61bf5b7-387c-459d-815e-bdab17fd8ed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '223f8ed551464993aa605ca6ff77d1fd', 'request_id': 'req-e61bf5b7-387c-459d-815e-bdab17fd8ed4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:31.512137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e61bf5b7-387c-459d-815e-bdab17fd8ed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '223f8ed551464993aa605ca6ff77d1fd', 'request_id': 'req-e61bf5b7-387c-459d-815e-bdab17fd8ed4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:31.517768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5cc28a6b-eb09-43fd-9910-52e7b8c3a83d admin admin] The token cache is being invalidate because project 23dd807bcbb44610a230e6a39483d77a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:31.521358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5cc28a6b-eb09-43fd-9910-52e7b8c3a83d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:31.524416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5cc28a6b-eb09-43fd-9910-52e7b8c3a83d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:31.530417 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3386/6825] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:31 2022] DELETE /identity/v3/projects/23dd807bcbb44610a230e6a39483d77a => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:31.535535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26637b-e02e-4adf-941b-ccffdb851bc8 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:31.536235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26637b-e02e-4adf-941b-ccffdb851bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:31.539670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26637b-e02e-4adf-941b-ccffdb851bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:31.549133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e61bf5b7-387c-459d-815e-bdab17fd8ed4 admin admin] The token cache is being invalidate because project 223f8ed551464993aa605ca6ff77d1fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:31.549706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e61bf5b7-387c-459d-815e-bdab17fd8ed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:31.550960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e61bf5b7-387c-459d-815e-bdab17fd8ed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:31.553103 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3440/6826] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:31 2022] DELETE /identity/v3/projects/223f8ed551464993aa605ca6ff77d1fd => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:31.556290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcd2a5-4ef7-46e3-aa7a-632d7d3bf254 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:31.556538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcd2a5-4ef7-46e3-aa7a-632d7d3bf254 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:31.556755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcd2a5-4ef7-46e3-aa7a-632d7d3bf254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:31.577171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1a26637b-e02e-4adf-941b-ccffdb851bc8 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:31.580126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1a26637b-e02e-4adf-941b-ccffdb851bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:31.635352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-acbcd2a5-4ef7-46e3-aa7a-632d7d3bf254 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:31.636622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-acbcd2a5-4ef7-46e3-aa7a-632d7d3bf254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:31.749987 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3387/6827] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:31.751370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26637b-e02e-4adf-941b-ccffdb851bc8 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:31.755678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1a26637b-e02e-4adf-941b-ccffdb851bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:31.792906 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26637b-e02e-4adf-941b-ccffdb851bc8 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:31.811026 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b15765-d70d-4387-9bfa-3f579c0b1d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:31.815014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b15765-d70d-4387-9bfa-3f579c0b1d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:31.817371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b15765-d70d-4387-9bfa-3f579c0b1d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:31.819848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b15765-d70d-4387-9bfa-3f579c0b1d28 admin admin] PATH_INFO: `/v3/users/f5f3f39ba5e34121a7fadeee9324f325` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:31.823774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b15765-d70d-4387-9bfa-3f579c0b1d28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5f3f39ba5e34121a7fadeee9324f325)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:31.833620 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b15765-d70d-4387-9bfa-3f579c0b1d28 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:31.857271 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3441/6828] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:31.857271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcd2a5-4ef7-46e3-aa7a-632d7d3bf254 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:31.857271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-acbcd2a5-4ef7-46e3-aa7a-632d7d3bf254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:31.998300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-02b15765-d70d-4387-9bfa-3f579c0b1d28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5f3f39ba5e34121a7fadeee9324f325'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:32.011382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbcd2a5-4ef7-46e3-aa7a-632d7d3bf254 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:32.014336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d593e10-39b1-413b-9abb-eb37e168da9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:32.015164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d593e10-39b1-413b-9abb-eb37e168da9f service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:32.015551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d593e10-39b1-413b-9abb-eb37e168da9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:32.015957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d593e10-39b1-413b-9abb-eb37e168da9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:32.019702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-02b15765-d70d-4387-9bfa-3f579c0b1d28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5f3f39ba5e34121a7fadeee9324f325'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:32.040690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d593e10-39b1-413b-9abb-eb37e168da9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:32.042831 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d593e10-39b1-413b-9abb-eb37e168da9f service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:32.057045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-02b15765-d70d-4387-9bfa-3f579c0b1d28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5f3f39ba5e34121a7fadeee9324f325'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:32.057365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-02b15765-d70d-4387-9bfa-3f579c0b1d28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5f3f39ba5e34121a7fadeee9324f325'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:32.072256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-02b15765-d70d-4387-9bfa-3f579c0b1d28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5f3f39ba5e34121a7fadeee9324f325'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:32.081189 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3442/6829] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:32.085346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247e4f0-c6af-4aaa-86a8-dff1460c258f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:32.086316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247e4f0-c6af-4aaa-86a8-dff1460c258f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:32.086676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247e4f0-c6af-4aaa-86a8-dff1460c258f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:32.092247 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3388/6830] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:42:31 2022] DELETE /identity/v3/users/f5f3f39ba5e34121a7fadeee9324f325 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:32.155328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3247e4f0-c6af-4aaa-86a8-dff1460c258f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:32.158171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3247e4f0-c6af-4aaa-86a8-dff1460c258f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:32.237017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b15765-d70d-4387-9bfa-3f579c0b1d28 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:32.238439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-02b15765-d70d-4387-9bfa-3f579c0b1d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:32.252190 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:32.269922 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:32.327397 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3443/6831] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:32.336082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247e4f0-c6af-4aaa-86a8-dff1460c258f None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:32.373443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b15765-d70d-4387-9bfa-3f579c0b1d28 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:32.382692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247e4f0-c6af-4aaa-86a8-dff1460c258f None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:32.388908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcb368-753c-43e1-8288-bd709bd64d9d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:32.390923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcb368-753c-43e1-8288-bd709bd64d9d service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:32.391585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcb368-753c-43e1-8288-bd709bd64d9d service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:32.392223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcb368-753c-43e1-8288-bd709bd64d9d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:32.396768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-04bcb368-753c-43e1-8288-bd709bd64d9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:32.398259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3d76f-b159-4db9-82e9-e7c8f65bceda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:32.400114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3d76f-b159-4db9-82e9-e7c8f65bceda admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:32.400464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3d76f-b159-4db9-82e9-e7c8f65bceda admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:32.400658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3d76f-b159-4db9-82e9-e7c8f65bceda admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:32.401277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3d76f-b159-4db9-82e9-e7c8f65bceda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:42:32.401581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3d76f-b159-4db9-82e9-e7c8f65bceda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:32.403209 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3d76f-b159-4db9-82e9-e7c8f65bceda admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:32.418755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bcb368-753c-43e1-8288-bd709bd64d9d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:32.424640 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bcb368-753c-43e1-8288-bd709bd64d9d service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:32.438312 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3444/6832] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:42:32.439249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3d76f-b159-4db9-82e9-e7c8f65bceda admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:32.452035 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3d76f-b159-4db9-82e9-e7c8f65bceda admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:32.461318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb15eae-33a6-4b88-830c-440bd7d4d36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:32.462387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb15eae-33a6-4b88-830c-440bd7d4d36d admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:32.462387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb15eae-33a6-4b88-830c-440bd7d4d36d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:32.462387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb15eae-33a6-4b88-830c-440bd7d4d36d admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:32.462996 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb15eae-33a6-4b88-830c-440bd7d4d36d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:32.473873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb15eae-33a6-4b88-830c-440bd7d4d36d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:32.481873 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3389/6833] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:42:32.484762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcb368-753c-43e1-8288-bd709bd64d9d service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:32.490870 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-04bcb368-753c-43e1-8288-bd709bd64d9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:32.537775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcb368-753c-43e1-8288-bd709bd64d9d service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:32.554836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930298e-ca41-4c4a-946e-902e9f4be4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:32.555494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930298e-ca41-4c4a-946e-902e9f4be4f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:32.555781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930298e-ca41-4c4a-946e-902e9f4be4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:32.556104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930298e-ca41-4c4a-946e-902e9f4be4f4 admin admin] PATH_INFO: `/v3/users/10ffb2739e264a5a9ef07acee5587820` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:32.561110 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3445/6834] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:42:32 2022] POST /identity/v3/projects => generated 401 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:32.563433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930298e-ca41-4c4a-946e-902e9f4be4f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10ffb2739e264a5a9ef07acee5587820)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:32.564274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb15eae-33a6-4b88-830c-440bd7d4d36d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:32.566459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930298e-ca41-4c4a-946e-902e9f4be4f4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:32.701671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d930298e-ca41-4c4a-946e-902e9f4be4f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10ffb2739e264a5a9ef07acee5587820'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:32.737405 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d930298e-ca41-4c4a-946e-902e9f4be4f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10ffb2739e264a5a9ef07acee5587820'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:32.761435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb15eae-33a6-4b88-830c-440bd7d4d36d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:32.772050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d930298e-ca41-4c4a-946e-902e9f4be4f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10ffb2739e264a5a9ef07acee5587820'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:32.773204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d930298e-ca41-4c4a-946e-902e9f4be4f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10ffb2739e264a5a9ef07acee5587820'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:32.775290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37d641-fe03-417c-aec9-ba3c5dac2907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:32.775959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37d641-fe03-417c-aec9-ba3c5dac2907 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:32.776240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37d641-fe03-417c-aec9-ba3c5dac2907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:32.776510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37d641-fe03-417c-aec9-ba3c5dac2907 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:32.777613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f37d641-fe03-417c-aec9-ba3c5dac2907 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:32.784336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f37d641-fe03-417c-aec9-ba3c5dac2907 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:32.792967 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d930298e-ca41-4c4a-946e-902e9f4be4f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10ffb2739e264a5a9ef07acee5587820'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:32.807630 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3390/6835] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:42:32 2022] DELETE /identity/v3/users/10ffb2739e264a5a9ef07acee5587820 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:32.811000 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930298e-ca41-4c4a-946e-902e9f4be4f4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:32.814218 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d930298e-ca41-4c4a-946e-902e9f4be4f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:32.834156 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3446/6836] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:42:32 2022] POST /identity/v3/users => generated 301 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:32.836580 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99dabe-203c-4eeb-b98e-823419f177b5 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:32.836978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99dabe-203c-4eeb-b98e-823419f177b5 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:32.837299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99dabe-203c-4eeb-b98e-823419f177b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:32.915214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9a99dabe-203c-4eeb-b98e-823419f177b5 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:32.920247 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9a99dabe-203c-4eeb-b98e-823419f177b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:33.049407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930298e-ca41-4c4a-946e-902e9f4be4f4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:33.065811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804edf1-facf-4c9d-8269-b2441e683074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:33.066466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804edf1-facf-4c9d-8269-b2441e683074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:33.066743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804edf1-facf-4c9d-8269-b2441e683074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:33.067157 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804edf1-facf-4c9d-8269-b2441e683074 admin admin] PATH_INFO: `/v3/users/e6e40abac8ac46b39c46e4d701e079a5` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:33.068360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804edf1-facf-4c9d-8269-b2441e683074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6e40abac8ac46b39c46e4d701e079a5)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:33.070281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804edf1-facf-4c9d-8269-b2441e683074 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:33.072066 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:33.113829 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3447/6837] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:33.119161 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99dabe-203c-4eeb-b98e-823419f177b5 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:33.123724 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9a99dabe-203c-4eeb-b98e-823419f177b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:33.172222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99dabe-203c-4eeb-b98e-823419f177b5 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:33.198733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febe7c0-6c7b-4035-b581-3fc2cee88aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:33.199361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febe7c0-6c7b-4035-b581-3fc2cee88aad admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:33.199655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febe7c0-6c7b-4035-b581-3fc2cee88aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:33.200712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febe7c0-6c7b-4035-b581-3fc2cee88aad admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:33.202637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6804edf1-facf-4c9d-8269-b2441e683074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6e40abac8ac46b39c46e4d701e079a5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:33.205001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0febe7c0-6c7b-4035-b581-3fc2cee88aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:33.207458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0febe7c0-6c7b-4035-b581-3fc2cee88aad admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:33.226284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6804edf1-facf-4c9d-8269-b2441e683074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6e40abac8ac46b39c46e4d701e079a5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:33.238916 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3448/6838] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:33.239937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febe7c0-6c7b-4035-b581-3fc2cee88aad admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:33.247115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0febe7c0-6c7b-4035-b581-3fc2cee88aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:33.257095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6804edf1-facf-4c9d-8269-b2441e683074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6e40abac8ac46b39c46e4d701e079a5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:33.259565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6804edf1-facf-4c9d-8269-b2441e683074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6e40abac8ac46b39c46e4d701e079a5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:33.270562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6804edf1-facf-4c9d-8269-b2441e683074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6e40abac8ac46b39c46e4d701e079a5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:33.277545 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3391/6839] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:42:32 2022] DELETE /identity/v3/users/e6e40abac8ac46b39c46e4d701e079a5 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:33.278270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febe7c0-6c7b-4035-b581-3fc2cee88aad admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:33.278606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804edf1-facf-4c9d-8269-b2441e683074 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:33.284739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6804edf1-facf-4c9d-8269-b2441e683074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:33.318605 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:33.379718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804edf1-facf-4c9d-8269-b2441e683074 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:33.386759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c23ef-c81f-4979-84b8-ea3ae0b7bb8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:33.387444 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c23ef-c81f-4979-84b8-ea3ae0b7bb8f service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:33.387763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c23ef-c81f-4979-84b8-ea3ae0b7bb8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:33.388077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c23ef-c81f-4979-84b8-ea3ae0b7bb8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:33.390674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-266c23ef-c81f-4979-84b8-ea3ae0b7bb8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:33.396481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f24b8-f176-49ba-859d-a0ec2355989e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:33.397324 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f24b8-f176-49ba-859d-a0ec2355989e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:33.397770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f24b8-f176-49ba-859d-a0ec2355989e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:33.398200 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f24b8-f176-49ba-859d-a0ec2355989e admin admin] PATH_INFO: `/v3/projects/972a563fdf43487ea87fb643d1197e5a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:33.406800 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c23ef-c81f-4979-84b8-ea3ae0b7bb8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:33.408671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c23ef-c81f-4979-84b8-ea3ae0b7bb8f service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:33.409953 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f24b8-f176-49ba-859d-a0ec2355989e admin admin] RBAC: Authorizing `identity:delete_project(project_id=972a563fdf43487ea87fb643d1197e5a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:33.414376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f24b8-f176-49ba-859d-a0ec2355989e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:33.452349 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3392/6840] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:33.454044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c23ef-c81f-4979-84b8-ea3ae0b7bb8f service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:33.455588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-266c23ef-c81f-4979-84b8-ea3ae0b7bb8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:33.468925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c23ef-c81f-4979-84b8-ea3ae0b7bb8f service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:33.481927 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce305a0d-cc98-4a4c-9d19-ea96f5c6ecb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:33.483099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce305a0d-cc98-4a4c-9d19-ea96f5c6ecb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:33.483514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce305a0d-cc98-4a4c-9d19-ea96f5c6ecb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:33.483826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce305a0d-cc98-4a4c-9d19-ea96f5c6ecb8 admin admin] PATH_INFO: `/v3/projects/99fc117272b74d44a99e68bc88cd99bb` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:33.485982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce305a0d-cc98-4a4c-9d19-ea96f5c6ecb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99fc117272b74d44a99e68bc88cd99bb)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:33.489414 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce305a0d-cc98-4a4c-9d19-ea96f5c6ecb8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:33.552406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e87f24b8-f176-49ba-859d-a0ec2355989e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '972a563fdf43487ea87fb643d1197e5a', 'request_id': 'req-e87f24b8-f176-49ba-859d-a0ec2355989e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:33.566547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e87f24b8-f176-49ba-859d-a0ec2355989e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '972a563fdf43487ea87fb643d1197e5a', 'request_id': 'req-e87f24b8-f176-49ba-859d-a0ec2355989e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:33.585600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e87f24b8-f176-49ba-859d-a0ec2355989e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '972a563fdf43487ea87fb643d1197e5a', 'request_id': 'req-e87f24b8-f176-49ba-859d-a0ec2355989e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:33.597858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ce305a0d-cc98-4a4c-9d19-ea96f5c6ecb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99fc117272b74d44a99e68bc88cd99bb', 'request_id': 'req-ce305a0d-cc98-4a4c-9d19-ea96f5c6ecb8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:33.603110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e87f24b8-f176-49ba-859d-a0ec2355989e admin admin] The token cache is being invalidate because project 972a563fdf43487ea87fb643d1197e5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:33.603407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e87f24b8-f176-49ba-859d-a0ec2355989e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:33.604429 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e87f24b8-f176-49ba-859d-a0ec2355989e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:33.606301 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3449/6841] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:33 2022] DELETE /identity/v3/projects/972a563fdf43487ea87fb643d1197e5a => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:33.607286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f24b8-f176-49ba-859d-a0ec2355989e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:33.609018 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e87f24b8-f176-49ba-859d-a0ec2355989e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:33.616305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ce305a0d-cc98-4a4c-9d19-ea96f5c6ecb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99fc117272b74d44a99e68bc88cd99bb', 'request_id': 'req-ce305a0d-cc98-4a4c-9d19-ea96f5c6ecb8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:33.638719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ce305a0d-cc98-4a4c-9d19-ea96f5c6ecb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99fc117272b74d44a99e68bc88cd99bb', 'request_id': 'req-ce305a0d-cc98-4a4c-9d19-ea96f5c6ecb8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:33.662758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ce305a0d-cc98-4a4c-9d19-ea96f5c6ecb8 admin admin] The token cache is being invalidate because project 99fc117272b74d44a99e68bc88cd99bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:33.663042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ce305a0d-cc98-4a4c-9d19-ea96f5c6ecb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:33.667462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ce305a0d-cc98-4a4c-9d19-ea96f5c6ecb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:33.671791 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3393/6842] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:33 2022] DELETE /identity/v3/projects/99fc117272b74d44a99e68bc88cd99bb => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:33.673210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874ac04-97e5-48a1-8e31-c9f507922a7c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:33.673493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874ac04-97e5-48a1-8e31-c9f507922a7c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:33.673765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874ac04-97e5-48a1-8e31-c9f507922a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:33.698225 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:33.710193 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f24b8-f176-49ba-859d-a0ec2355989e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:33.720967 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-a874ac04-97e5-48a1-8e31-c9f507922a7c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:33.726760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a874ac04-97e5-48a1-8e31-c9f507922a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:33.805311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401dcf5-a2a3-4efd-b48a-4ac8fa945f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:33.806606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401dcf5-a2a3-4efd-b48a-4ac8fa945f8f admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:33.807157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401dcf5-a2a3-4efd-b48a-4ac8fa945f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:33.807722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401dcf5-a2a3-4efd-b48a-4ac8fa945f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:33.808889 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401dcf5-a2a3-4efd-b48a-4ac8fa945f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:33.811214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401dcf5-a2a3-4efd-b48a-4ac8fa945f8f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:33.814276 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:33.829084 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3450/6843] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:33.831915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ee372-ca11-42a9-8672-d04095106161 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:33.833125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ee372-ca11-42a9-8672-d04095106161 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:33.833643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ee372-ca11-42a9-8672-d04095106161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:33.862851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c40ee372-ca11-42a9-8672-d04095106161 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:33.864650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c40ee372-ca11-42a9-8672-d04095106161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:33.867319 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3394/6844] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:33.868647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c15574-6f78-42e4-a73a-840814374c55 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:33.868942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c15574-6f78-42e4-a73a-840814374c55 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:33.869199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c15574-6f78-42e4-a73a-840814374c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:33.889349 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3451/6845] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:33.890843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ee372-ca11-42a9-8672-d04095106161 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:33.893164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c40ee372-ca11-42a9-8672-d04095106161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:33.909064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ee372-ca11-42a9-8672-d04095106161 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:33.915495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b6c15574-6f78-42e4-a73a-840814374c55 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:33.916861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b6c15574-6f78-42e4-a73a-840814374c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:33.919316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733e2bd-5ce0-4ca8-89d0-595670036e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:33.923875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733e2bd-5ce0-4ca8-89d0-595670036e84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:33.928740 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3395/6846] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:33.929944 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c15574-6f78-42e4-a73a-840814374c55 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:33.931435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b6c15574-6f78-42e4-a73a-840814374c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:33.938338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733e2bd-5ce0-4ca8-89d0-595670036e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:33.939787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733e2bd-5ce0-4ca8-89d0-595670036e84 admin admin] PATH_INFO: `/v3/projects/1f679c42ae044bd995302f19759362d3/users/07975cb480d2431bbe94a8ebfc88d792/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:33.978866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733e2bd-5ce0-4ca8-89d0-595670036e84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f679c42ae044bd995302f19759362d3, user_id=07975cb480d2431bbe94a8ebfc88d792, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:33.993084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733e2bd-5ce0-4ca8-89d0-595670036e84 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:34.021660 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3452/6847] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:33 2022] PUT /identity/v3/projects/1f679c42ae044bd995302f19759362d3/users/07975cb480d2431bbe94a8ebfc88d792/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:34.022737 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8665b0a-4704-4e4e-87d1-9a8db872fdc5 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:34.023021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8665b0a-4704-4e4e-87d1-9a8db872fdc5 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:34.023293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8665b0a-4704-4e4e-87d1-9a8db872fdc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:34.050469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c15574-6f78-42e4-a73a-840814374c55 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:34.061506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b8665b0a-4704-4e4e-87d1-9a8db872fdc5 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:34.062845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b8665b0a-4704-4e4e-87d1-9a8db872fdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:34.152091 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e95255-cf01-4008-98a9-dcb251ac6343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:34.153153 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e95255-cf01-4008-98a9-dcb251ac6343 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:34.154095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e95255-cf01-4008-98a9-dcb251ac6343 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:34.154602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e95255-cf01-4008-98a9-dcb251ac6343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:34.188808 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3453/6848] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:34.190408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6afa1-e282-47b0-822d-2d9a43af28b4 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:34.190875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6afa1-e282-47b0-822d-2d9a43af28b4 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:34.191302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6afa1-e282-47b0-822d-2d9a43af28b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:34.222550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-38a6afa1-e282-47b0-822d-2d9a43af28b4 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:34.224761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-38a6afa1-e282-47b0-822d-2d9a43af28b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:34.237654 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3454/6849] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:34.238886 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6afa1-e282-47b0-822d-2d9a43af28b4 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:34.240287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-38a6afa1-e282-47b0-822d-2d9a43af28b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:34.247119 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e95255-cf01-4008-98a9-dcb251ac6343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:34.249344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e95255-cf01-4008-98a9-dcb251ac6343 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:34.255117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6afa1-e282-47b0-822d-2d9a43af28b4 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:34.261865 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0640b7-df37-42d2-8949-6694f6387d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:34.262411 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3396/6850] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:34.262698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0640b7-df37-42d2-8949-6694f6387d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:34.263281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0640b7-df37-42d2-8949-6694f6387d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:34.263836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0640b7-df37-42d2-8949-6694f6387d6b admin admin] PATH_INFO: `/v3/projects/07302a9ffc8c4c8fb49df093c103e92b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:34.265480 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699aa700-2c3a-41f1-bdce-42c2f6c0356c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:34.265957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699aa700-2c3a-41f1-bdce-42c2f6c0356c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:34.266433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699aa700-2c3a-41f1-bdce-42c2f6c0356c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:34.266562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0640b7-df37-42d2-8949-6694f6387d6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=07302a9ffc8c4c8fb49df093c103e92b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:34.268950 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0640b7-df37-42d2-8949-6694f6387d6b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:34.275842 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:34.301162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-699aa700-2c3a-41f1-bdce-42c2f6c0356c None None] MFA Rules not processed for user `07975cb480d2431bbe94a8ebfc88d792`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:34.302641 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-699aa700-2c3a-41f1-bdce-42c2f6c0356c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:34.364660 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7d0640b7-df37-42d2-8949-6694f6387d6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07302a9ffc8c4c8fb49df093c103e92b', 'request_id': 'req-7d0640b7-df37-42d2-8949-6694f6387d6b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:34.379032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7d0640b7-df37-42d2-8949-6694f6387d6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07302a9ffc8c4c8fb49df093c103e92b', 'request_id': 'req-7d0640b7-df37-42d2-8949-6694f6387d6b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:34.390529 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3397/6851] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:34 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:34.391866 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699aa700-2c3a-41f1-bdce-42c2f6c0356c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:34.404764 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699aa700-2c3a-41f1-bdce-42c2f6c0356c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:34.413771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7d0640b7-df37-42d2-8949-6694f6387d6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07302a9ffc8c4c8fb49df093c103e92b', 'request_id': 'req-7d0640b7-df37-42d2-8949-6694f6387d6b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:34.436823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7d0640b7-df37-42d2-8949-6694f6387d6b admin admin] The token cache is being invalidate because project 07302a9ffc8c4c8fb49df093c103e92b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:34.437201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7d0640b7-df37-42d2-8949-6694f6387d6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:34.437968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7d0640b7-df37-42d2-8949-6694f6387d6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:34.443945 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3455/6852] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:34 2022] DELETE /identity/v3/projects/07302a9ffc8c4c8fb49df093c103e92b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:34.445269 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0640b7-df37-42d2-8949-6694f6387d6b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:34.446769 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7d0640b7-df37-42d2-8949-6694f6387d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:34.502041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadca526-ae0e-41ed-b628-9e237555e4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:34.503340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadca526-ae0e-41ed-b628-9e237555e4bb admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:34.503814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadca526-ae0e-41ed-b628-9e237555e4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:34.504289 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadca526-ae0e-41ed-b628-9e237555e4bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:34.506115 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadca526-ae0e-41ed-b628-9e237555e4bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:42:34.507318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadca526-ae0e-41ed-b628-9e237555e4bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:34.510229 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadca526-ae0e-41ed-b628-9e237555e4bb admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:34.520045 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:34.546100 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0640b7-df37-42d2-8949-6694f6387d6b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:34.546754 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3398/6853] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:42:34.547949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadca526-ae0e-41ed-b628-9e237555e4bb admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:34.551404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-eadca526-ae0e-41ed-b628-9e237555e4bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:34.551551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220586c-5294-452b-aff0-497bc80931e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:34.552559 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220586c-5294-452b-aff0-497bc80931e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:34.552913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220586c-5294-452b-aff0-497bc80931e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:34.553299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220586c-5294-452b-aff0-497bc80931e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:34.554056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220586c-5294-452b-aff0-497bc80931e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:42:34.554424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220586c-5294-452b-aff0-497bc80931e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:34.556886 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220586c-5294-452b-aff0-497bc80931e6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:34.576898 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3456/6854] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:42:34.578508 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220586c-5294-452b-aff0-497bc80931e6 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:34.580733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9220586c-5294-452b-aff0-497bc80931e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:34.587543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadca526-ae0e-41ed-b628-9e237555e4bb admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:34.598455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220586c-5294-452b-aff0-497bc80931e6 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:34.603864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795615aa-7ed0-4620-a2e2-2af323013577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:34.604592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795615aa-7ed0-4620-a2e2-2af323013577 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:34.605078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795615aa-7ed0-4620-a2e2-2af323013577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:34.605389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795615aa-7ed0-4620-a2e2-2af323013577 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:34.606083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795615aa-7ed0-4620-a2e2-2af323013577 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:34.608101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795615aa-7ed0-4620-a2e2-2af323013577 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:34.609067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06b5df-aa10-4af3-94f2-ffce07949fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:34.610980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06b5df-aa10-4af3-94f2-ffce07949fee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:34.611333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06b5df-aa10-4af3-94f2-ffce07949fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:34.611684 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06b5df-aa10-4af3-94f2-ffce07949fee admin admin] PATH_INFO: `/v3/users/8c35d3203ad541a2853167791c0c139b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:34.613025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06b5df-aa10-4af3-94f2-ffce07949fee admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c35d3203ad541a2853167791c0c139b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:34.615949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06b5df-aa10-4af3-94f2-ffce07949fee admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:34.675126 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3399/6855] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:42:34 2022] POST /identity/v3/projects => generated 401 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:34.676487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795615aa-7ed0-4620-a2e2-2af323013577 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:34.682063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-795615aa-7ed0-4620-a2e2-2af323013577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:34.698934 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8d06b5df-aa10-4af3-94f2-ffce07949fee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c35d3203ad541a2853167791c0c139b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:34.717045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8d06b5df-aa10-4af3-94f2-ffce07949fee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c35d3203ad541a2853167791c0c139b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:34.735071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8d06b5df-aa10-4af3-94f2-ffce07949fee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c35d3203ad541a2853167791c0c139b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:34.736146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8d06b5df-aa10-4af3-94f2-ffce07949fee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c35d3203ad541a2853167791c0c139b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:34.749078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8d06b5df-aa10-4af3-94f2-ffce07949fee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c35d3203ad541a2853167791c0c139b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:34.759773 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3457/6856] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:42:34 2022] DELETE /identity/v3/users/8c35d3203ad541a2853167791c0c139b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:34.761095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06b5df-aa10-4af3-94f2-ffce07949fee admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:34.764585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8d06b5df-aa10-4af3-94f2-ffce07949fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:34.796863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795615aa-7ed0-4620-a2e2-2af323013577 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:34.808249 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:34.855103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06b5df-aa10-4af3-94f2-ffce07949fee admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:34.869331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd5d12-3f35-44d3-b739-774459e8c650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:34.871274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd5d12-3f35-44d3-b739-774459e8c650 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:34.871589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd5d12-3f35-44d3-b739-774459e8c650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:34.871986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd5d12-3f35-44d3-b739-774459e8c650 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:34.872704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd5d12-3f35-44d3-b739-774459e8c650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:34.876566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd5d12-3f35-44d3-b739-774459e8c650 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:34.895287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c21df-8183-4889-a52e-db69eafc8595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:34.896292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c21df-8183-4889-a52e-db69eafc8595 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:34.896857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c21df-8183-4889-a52e-db69eafc8595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:34.897237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c21df-8183-4889-a52e-db69eafc8595 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:34.897971 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c21df-8183-4889-a52e-db69eafc8595 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:34.900077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c21df-8183-4889-a52e-db69eafc8595 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:34.955156 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3458/6857] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:42:34 2022] POST /identity/v3/projects => generated 373 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:34.958358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd5d12-3f35-44d3-b739-774459e8c650 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:34.962338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1bfd5d12-3f35-44d3-b739-774459e8c650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:34.971477 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3400/6858] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:42:34 2022] POST /identity/v3/projects => generated 369 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:34.973424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c21df-8183-4889-a52e-db69eafc8595 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:34.980757 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2b4c21df-8183-4889-a52e-db69eafc8595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:35.024939 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:35.115432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c21df-8183-4889-a52e-db69eafc8595 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:35.127960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1ad20-7561-4478-b48e-14c5b2f145bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:35.128882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1ad20-7561-4478-b48e-14c5b2f145bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:35.132000 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1ad20-7561-4478-b48e-14c5b2f145bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:35.132344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1ad20-7561-4478-b48e-14c5b2f145bc admin admin] PATH_INFO: `/v3/users/949505e7db1d4a60bfa185be8b2058e7` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:35.134893 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd5d12-3f35-44d3-b739-774459e8c650 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:35.136774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1ad20-7561-4478-b48e-14c5b2f145bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=949505e7db1d4a60bfa185be8b2058e7)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:35.143274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1ad20-7561-4478-b48e-14c5b2f145bc admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:35.143579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f98c7-c481-4b8b-a8ba-9f0f5f19e91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:35.144403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f98c7-c481-4b8b-a8ba-9f0f5f19e91d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:35.144772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f98c7-c481-4b8b-a8ba-9f0f5f19e91d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:35.145167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f98c7-c481-4b8b-a8ba-9f0f5f19e91d admin admin] PATH_INFO: `/v3/projects/b8fe38b4641e468f926388faae3c3331` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:35.146817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f98c7-c481-4b8b-a8ba-9f0f5f19e91d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8fe38b4641e468f926388faae3c3331)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:35.149333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f98c7-c481-4b8b-a8ba-9f0f5f19e91d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:35.237290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-060f98c7-c481-4b8b-a8ba-9f0f5f19e91d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8fe38b4641e468f926388faae3c3331', 'request_id': 'req-060f98c7-c481-4b8b-a8ba-9f0f5f19e91d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:35.244691 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-060f98c7-c481-4b8b-a8ba-9f0f5f19e91d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8fe38b4641e468f926388faae3c3331', 'request_id': 'req-060f98c7-c481-4b8b-a8ba-9f0f5f19e91d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:35.253254 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-060f98c7-c481-4b8b-a8ba-9f0f5f19e91d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8fe38b4641e468f926388faae3c3331', 'request_id': 'req-060f98c7-c481-4b8b-a8ba-9f0f5f19e91d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:35.256692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f4d1ad20-7561-4478-b48e-14c5b2f145bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '949505e7db1d4a60bfa185be8b2058e7'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:35.275756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f4d1ad20-7561-4478-b48e-14c5b2f145bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '949505e7db1d4a60bfa185be8b2058e7'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:35.280435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-060f98c7-c481-4b8b-a8ba-9f0f5f19e91d admin admin] The token cache is being invalidate because project b8fe38b4641e468f926388faae3c3331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:35.281408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-060f98c7-c481-4b8b-a8ba-9f0f5f19e91d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:35.282472 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-060f98c7-c481-4b8b-a8ba-9f0f5f19e91d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:35.284412 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3459/6859] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:34 2022] DELETE /identity/v3/projects/b8fe38b4641e468f926388faae3c3331 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:35.292816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f98c7-c481-4b8b-a8ba-9f0f5f19e91d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:35.297077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f4d1ad20-7561-4478-b48e-14c5b2f145bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '949505e7db1d4a60bfa185be8b2058e7'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:35.297581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-060f98c7-c481-4b8b-a8ba-9f0f5f19e91d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:35.298019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f4d1ad20-7561-4478-b48e-14c5b2f145bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '949505e7db1d4a60bfa185be8b2058e7'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:35.308223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f4d1ad20-7561-4478-b48e-14c5b2f145bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '949505e7db1d4a60bfa185be8b2058e7'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:35.328723 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3401/6860] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:42:34 2022] DELETE /identity/v3/users/949505e7db1d4a60bfa185be8b2058e7 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:35.329593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1ad20-7561-4478-b48e-14c5b2f145bc admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:35.331344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f4d1ad20-7561-4478-b48e-14c5b2f145bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:35.369946 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:35.417100 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f98c7-c481-4b8b-a8ba-9f0f5f19e91d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:35.441921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1ad20-7561-4478-b48e-14c5b2f145bc admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:35.446829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0947946-3412-41c6-b888-1c0c6fd00d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:35.447558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0947946-3412-41c6-b888-1c0c6fd00d61 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:35.447977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0947946-3412-41c6-b888-1c0c6fd00d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:35.448261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0947946-3412-41c6-b888-1c0c6fd00d61 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:35.448948 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0947946-3412-41c6-b888-1c0c6fd00d61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:35.451019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0947946-3412-41c6-b888-1c0c6fd00d61 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:35.480511 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3402/6861] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:42:35 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:35.480511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0947946-3412-41c6-b888-1c0c6fd00d61 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:35.481037 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f0947946-3412-41c6-b888-1c0c6fd00d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:35.495194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82d947-1221-4104-8d86-4082334369ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:35.495935 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82d947-1221-4104-8d86-4082334369ab admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:35.496294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82d947-1221-4104-8d86-4082334369ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:35.496653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82d947-1221-4104-8d86-4082334369ab admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:35.497346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0947946-3412-41c6-b888-1c0c6fd00d61 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:35.497463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82d947-1221-4104-8d86-4082334369ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:35.499439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82d947-1221-4104-8d86-4082334369ab admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:35.502183 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d1563-1ccb-47a7-8202-ae3ce4b62d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:35.502857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d1563-1ccb-47a7-8202-ae3ce4b62d70 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:35.503200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d1563-1ccb-47a7-8202-ae3ce4b62d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:35.503539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d1563-1ccb-47a7-8202-ae3ce4b62d70 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:35.504357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d1563-1ccb-47a7-8202-ae3ce4b62d70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:35.506311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d1563-1ccb-47a7-8202-ae3ce4b62d70 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:35.517982 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:35.525975 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3460/6862] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:42:35 2022] POST /identity/v3/users => generated 307 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:35.527286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8c0e9-3e2e-4401-9fc5-d1e5a7dfdf15 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:35.527774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8c0e9-3e2e-4401-9fc5-d1e5a7dfdf15 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:35.528410 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8c0e9-3e2e-4401-9fc5-d1e5a7dfdf15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:35.540287 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3403/6863] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:42:35 2022] POST /identity/v3/users => generated 285 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:35.540287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d1563-1ccb-47a7-8202-ae3ce4b62d70 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:35.540287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8d7d1563-1ccb-47a7-8202-ae3ce4b62d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:35.552267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d1563-1ccb-47a7-8202-ae3ce4b62d70 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:35.552716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d8a8c0e9-3e2e-4401-9fc5-d1e5a7dfdf15 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:35.553929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d8a8c0e9-3e2e-4401-9fc5-d1e5a7dfdf15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:35.557444 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbf990-f137-4dee-9a0f-a7272e6c2a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:35.558080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbf990-f137-4dee-9a0f-a7272e6c2a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:35.558430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbf990-f137-4dee-9a0f-a7272e6c2a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:35.558701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbf990-f137-4dee-9a0f-a7272e6c2a0e admin admin] PATH_INFO: `/v3/projects/cd803183a2a84ad28d4c6f154bef6b80` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:35.559929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dbf990-f137-4dee-9a0f-a7272e6c2a0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd803183a2a84ad28d4c6f154bef6b80)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:35.562477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dbf990-f137-4dee-9a0f-a7272e6c2a0e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:35.568277 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3461/6864] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:35.568277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b272f-7b86-4fbb-ab34-9f069a2853ea None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:35.568277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b272f-7b86-4fbb-ab34-9f069a2853ea None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:35.568277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b272f-7b86-4fbb-ab34-9f069a2853ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:35.588271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d05b272f-7b86-4fbb-ab34-9f069a2853ea None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:35.589579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d05b272f-7b86-4fbb-ab34-9f069a2853ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:35.599999 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3462/6865] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:35.599999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b272f-7b86-4fbb-ab34-9f069a2853ea None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:35.613509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b272f-7b86-4fbb-ab34-9f069a2853ea None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:35.628806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b7dbf990-f137-4dee-9a0f-a7272e6c2a0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd803183a2a84ad28d4c6f154bef6b80', 'request_id': 'req-b7dbf990-f137-4dee-9a0f-a7272e6c2a0e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:35.635352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b7dbf990-f137-4dee-9a0f-a7272e6c2a0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd803183a2a84ad28d4c6f154bef6b80', 'request_id': 'req-b7dbf990-f137-4dee-9a0f-a7272e6c2a0e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:35.643105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b7dbf990-f137-4dee-9a0f-a7272e6c2a0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd803183a2a84ad28d4c6f154bef6b80', 'request_id': 'req-b7dbf990-f137-4dee-9a0f-a7272e6c2a0e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:35.660523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b7dbf990-f137-4dee-9a0f-a7272e6c2a0e admin admin] The token cache is being invalidate because project cd803183a2a84ad28d4c6f154bef6b80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:35.661137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b7dbf990-f137-4dee-9a0f-a7272e6c2a0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:35.661886 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b7dbf990-f137-4dee-9a0f-a7272e6c2a0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:35.664513 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3404/6866] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:35 2022] DELETE /identity/v3/projects/cd803183a2a84ad28d4c6f154bef6b80 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:35.665439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbf990-f137-4dee-9a0f-a7272e6c2a0e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:35.666962 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b7dbf990-f137-4dee-9a0f-a7272e6c2a0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:35.687819 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa09d1-4cbb-419a-9392-c5d0718ac52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:35.688384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa09d1-4cbb-419a-9392-c5d0718ac52e admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:35.688662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa09d1-4cbb-419a-9392-c5d0718ac52e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:35.688932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa09d1-4cbb-419a-9392-c5d0718ac52e admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:35.689579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa09d1-4cbb-419a-9392-c5d0718ac52e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:35.691211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa09d1-4cbb-419a-9392-c5d0718ac52e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:35.702432 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3463/6867] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:35.703363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa09d1-4cbb-419a-9392-c5d0718ac52e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:35.705229 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-beaa09d1-4cbb-419a-9392-c5d0718ac52e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:35.718789 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa09d1-4cbb-419a-9392-c5d0718ac52e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:35.724052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec9982-1341-4380-becb-8f9dd6c75a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:35.724662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec9982-1341-4380-becb-8f9dd6c75a09 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:35.724945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec9982-1341-4380-becb-8f9dd6c75a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:35.725218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec9982-1341-4380-becb-8f9dd6c75a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:35.725859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec9982-1341-4380-becb-8f9dd6c75a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:35.727494 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec9982-1341-4380-becb-8f9dd6c75a09 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:35.738384 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3464/6868] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:35.739530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bf2b6-7095-49f1-b692-98bdf4f328c5 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:35.739820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bf2b6-7095-49f1-b692-98bdf4f328c5 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:35.740118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bf2b6-7095-49f1-b692-98bdf4f328c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:35.748338 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbf990-f137-4dee-9a0f-a7272e6c2a0e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:35.754153 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75faf4d4-c913-4c86-88da-8a4ee1307a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:35.755216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faf4d4-c913-4c86-88da-8a4ee1307a0a admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:35.755498 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faf4d4-c913-4c86-88da-8a4ee1307a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:35.755768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faf4d4-c913-4c86-88da-8a4ee1307a0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:35.756466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75faf4d4-c913-4c86-88da-8a4ee1307a0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:35.758584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75faf4d4-c913-4c86-88da-8a4ee1307a0a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:35.760745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-fc8bf2b6-7095-49f1-b692-98bdf4f328c5 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:35.761944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fc8bf2b6-7095-49f1-b692-98bdf4f328c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:35.770536 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3465/6869] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:35.771182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8bf2b6-7095-49f1-b692-98bdf4f328c5 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:35.775229 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fc8bf2b6-7095-49f1-b692-98bdf4f328c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:35.775705 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3405/6870] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:35.777413 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2484b-1aae-4886-ac06-1eb3e0372b37 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:35.777867 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2484b-1aae-4886-ac06-1eb3e0372b37 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:35.778141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2484b-1aae-4886-ac06-1eb3e0372b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:35.800867 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-39a2484b-1aae-4886-ac06-1eb3e0372b37 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:35.803042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-39a2484b-1aae-4886-ac06-1eb3e0372b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:35.817045 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3406/6871] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:35.818135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2484b-1aae-4886-ac06-1eb3e0372b37 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:35.819561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-39a2484b-1aae-4886-ac06-1eb3e0372b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:35.828782 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:35.836864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2484b-1aae-4886-ac06-1eb3e0372b37 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:35.844174 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36c1ec-58b7-4c99-823b-0268e9d483f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:35.844805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36c1ec-58b7-4c99-823b-0268e9d483f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:35.845172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36c1ec-58b7-4c99-823b-0268e9d483f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:35.845453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36c1ec-58b7-4c99-823b-0268e9d483f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:35.846122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36c1ec-58b7-4c99-823b-0268e9d483f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:35.847802 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36c1ec-58b7-4c99-823b-0268e9d483f7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:35.856972 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8bf2b6-7095-49f1-b692-98bdf4f328c5 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:35.860861 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3407/6872] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:35.861622 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36c1ec-58b7-4c99-823b-0268e9d483f7 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:35.864941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a93675-7f42-4d91-80ce-67dc5ba0813f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:35.866213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a93675-7f42-4d91-80ce-67dc5ba0813f service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:35.866499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a93675-7f42-4d91-80ce-67dc5ba0813f service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:35.866764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a93675-7f42-4d91-80ce-67dc5ba0813f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:35.869450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-07a93675-7f42-4d91-80ce-67dc5ba0813f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:35.875722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36c1ec-58b7-4c99-823b-0268e9d483f7 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:35.881063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05406a50-972d-4203-889c-fa0890381a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:35.881448 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05406a50-972d-4203-889c-fa0890381a49 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:35.881728 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05406a50-972d-4203-889c-fa0890381a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:35.882000 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05406a50-972d-4203-889c-fa0890381a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:35.882663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05406a50-972d-4203-889c-fa0890381a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:35.884606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05406a50-972d-4203-889c-fa0890381a49 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:35.887475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a93675-7f42-4d91-80ce-67dc5ba0813f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:35.888109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a93675-7f42-4d91-80ce-67dc5ba0813f service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:35.901601 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3466/6873] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:35.902480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a93675-7f42-4d91-80ce-67dc5ba0813f service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:35.914043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a93675-7f42-4d91-80ce-67dc5ba0813f service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:35.915102 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3408/6874] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:35.916087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05406a50-972d-4203-889c-fa0890381a49 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:35.921046 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeba4d9-dce0-4ab5-b6f8-8deede319d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:35.921828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeba4d9-dce0-4ab5-b6f8-8deede319d62 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:35.922174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeba4d9-dce0-4ab5-b6f8-8deede319d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:35.922524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeba4d9-dce0-4ab5-b6f8-8deede319d62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:35.923261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeba4d9-dce0-4ab5-b6f8-8deede319d62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:42:35.923624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeba4d9-dce0-4ab5-b6f8-8deede319d62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:35.925359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeba4d9-dce0-4ab5-b6f8-8deede319d62 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:35.928366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05406a50-972d-4203-889c-fa0890381a49 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:35.933445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe9458-f853-4779-bfc4-d270251914c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:35.934121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe9458-f853-4779-bfc4-d270251914c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:35.934400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe9458-f853-4779-bfc4-d270251914c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:35.934782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe9458-f853-4779-bfc4-d270251914c0 admin admin] PATH_INFO: `/v3/projects/3ee54b9b9b1e4f44b708f5139cfc187f/users/9644da44cce34b4cae9db4074dfd8ca0/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:35.954044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe9458-f853-4779-bfc4-d270251914c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee54b9b9b1e4f44b708f5139cfc187f, user_id=9644da44cce34b4cae9db4074dfd8ca0, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:35.957040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbe9458-f853-4779-bfc4-d270251914c0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:35.959692 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3467/6875] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:42:35.961438 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13c50a-92a6-42b3-a603-673cfff06e04 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:35.961891 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13c50a-92a6-42b3-a603-673cfff06e04 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:35.962271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13c50a-92a6-42b3-a603-673cfff06e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:35.988198 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3409/6876] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:35 2022] PUT /identity/v3/projects/3ee54b9b9b1e4f44b708f5139cfc187f/users/9644da44cce34b4cae9db4074dfd8ca0/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:35.989603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe9458-f853-4779-bfc4-d270251914c0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:36.009225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-df13c50a-92a6-42b3-a603-673cfff06e04 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:36.011666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-df13c50a-92a6-42b3-a603-673cfff06e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:36.090775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe9458-f853-4779-bfc4-d270251914c0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:36.094691 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:36.096652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1e735-a53c-4c06-a4fc-d46ccedb8786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:36.099928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1e735-a53c-4c06-a4fc-d46ccedb8786 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:36.099928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1e735-a53c-4c06-a4fc-d46ccedb8786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:36.099928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1e735-a53c-4c06-a4fc-d46ccedb8786 admin admin] PATH_INFO: `/v3/projects/344ac056616e401ea468c643140ad6dd/users/9fc871740d3543ec85bb04cedbefdd00/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:36.116090 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3468/6877] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:36.117265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13c50a-92a6-42b3-a603-673cfff06e04 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:36.125781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1e735-a53c-4c06-a4fc-d46ccedb8786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=344ac056616e401ea468c643140ad6dd, user_id=9fc871740d3543ec85bb04cedbefdd00, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:36.128661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1e735-a53c-4c06-a4fc-d46ccedb8786 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:36.130589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13c50a-92a6-42b3-a603-673cfff06e04 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:36.138969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02615e6-b8b9-4937-a945-fee20f38203a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:36.140568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02615e6-b8b9-4937-a945-fee20f38203a admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:36.140974 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02615e6-b8b9-4937-a945-fee20f38203a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:36.141552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02615e6-b8b9-4937-a945-fee20f38203a admin admin] PATH_INFO: `/v3/projects/50f5f2c9ab9b4bc78bac5d420e31e290/users/a17688cd961f45e39a4ed551a78f4aad/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:36.152258 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3410/6878] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:35 2022] PUT /identity/v3/projects/344ac056616e401ea468c643140ad6dd/users/9fc871740d3543ec85bb04cedbefdd00/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:36.154554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1e735-a53c-4c06-a4fc-d46ccedb8786 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:36.164830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02615e6-b8b9-4937-a945-fee20f38203a admin admin] RBAC: Authorizing `identity:create_grant(project_id=50f5f2c9ab9b4bc78bac5d420e31e290, user_id=a17688cd961f45e39a4ed551a78f4aad, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:36.169148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02615e6-b8b9-4937-a945-fee20f38203a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:36.197334 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3469/6879] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:36 2022] PUT /identity/v3/projects/50f5f2c9ab9b4bc78bac5d420e31e290/users/a17688cd961f45e39a4ed551a78f4aad/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:36.197334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02615e6-b8b9-4937-a945-fee20f38203a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:36.244465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1e735-a53c-4c06-a4fc-d46ccedb8786 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:36.291684 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02615e6-b8b9-4937-a945-fee20f38203a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:36.302899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9d8e6-d73a-42e6-9ac4-cd05188ad5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:36.304835 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9d8e6-d73a-42e6-9ac4-cd05188ad5df admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:36.305181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9d8e6-d73a-42e6-9ac4-cd05188ad5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:36.306264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9d8e6-d73a-42e6-9ac4-cd05188ad5df admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:36.306992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9d8e6-d73a-42e6-9ac4-cd05188ad5df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:36.308863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9d8e6-d73a-42e6-9ac4-cd05188ad5df admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:36.309915 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:36.325287 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3470/6880] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:36.328608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91ac8c-5fd6-43be-95aa-b3295a225543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:36.329267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91ac8c-5fd6-43be-95aa-b3295a225543 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:36.329834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91ac8c-5fd6-43be-95aa-b3295a225543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:36.330065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91ac8c-5fd6-43be-95aa-b3295a225543 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:36.330180 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9d8e6-d73a-42e6-9ac4-cd05188ad5df admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:36.330882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91ac8c-5fd6-43be-95aa-b3295a225543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:36.333682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91ac8c-5fd6-43be-95aa-b3295a225543 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:36.341941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9d8e6-d73a-42e6-9ac4-cd05188ad5df admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:36.348439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb07a5c-e671-4d5f-8c68-287d32f2e290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:36.349167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb07a5c-e671-4d5f-8c68-287d32f2e290 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:36.349545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb07a5c-e671-4d5f-8c68-287d32f2e290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:36.349912 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb07a5c-e671-4d5f-8c68-287d32f2e290 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:36.350654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb07a5c-e671-4d5f-8c68-287d32f2e290 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:42:36.351190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb07a5c-e671-4d5f-8c68-287d32f2e290 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:36.352944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb07a5c-e671-4d5f-8c68-287d32f2e290 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:36.367065 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3411/6881] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:42:36 2022] POST /identity/v3/projects => generated 371 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:36.367065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14dcb6-68a2-4051-bb69-cf6817193f4f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:36.367065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14dcb6-68a2-4051-bb69-cf6817193f4f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:36.367065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14dcb6-68a2-4051-bb69-cf6817193f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:36.374610 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3471/6882] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:42:36.374610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd29f5-4967-4e95-8ee0-4647d57ad81a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:36.374610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd29f5-4967-4e95-8ee0-4647d57ad81a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:36.374610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd29f5-4967-4e95-8ee0-4647d57ad81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:36.397238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2a14dcb6-68a2-4051-bb69-cf6817193f4f None None] MFA Rules not processed for user `9fc871740d3543ec85bb04cedbefdd00`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:36.398971 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2a14dcb6-68a2-4051-bb69-cf6817193f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:36.407705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-40dd29f5-4967-4e95-8ee0-4647d57ad81a None None] MFA Rules not processed for user `a17688cd961f45e39a4ed551a78f4aad`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:36.409791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-40dd29f5-4967-4e95-8ee0-4647d57ad81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:36.492674 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3412/6883] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:36.496404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14dcb6-68a2-4051-bb69-cf6817193f4f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:36.496404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2a14dcb6-68a2-4051-bb69-cf6817193f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:36.496929 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3472/6884] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:36.497959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd29f5-4967-4e95-8ee0-4647d57ad81a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:36.552915 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:36.576413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd29f5-4967-4e95-8ee0-4647d57ad81a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:36.582027 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a4e6c-647e-4d0a-9a6e-bed73212cf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:36.582994 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a4e6c-647e-4d0a-9a6e-bed73212cf21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:36.583760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a4e6c-647e-4d0a-9a6e-bed73212cf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:36.584222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a4e6c-647e-4d0a-9a6e-bed73212cf21 admin admin] PATH_INFO: `/v3/projects/3ee54b9b9b1e4f44b708f5139cfc187f/users/9644da44cce34b4cae9db4074dfd8ca0/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:36.587680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a4e6c-647e-4d0a-9a6e-bed73212cf21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee54b9b9b1e4f44b708f5139cfc187f, user_id=9644da44cce34b4cae9db4074dfd8ca0, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:36.590073 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14dcb6-68a2-4051-bb69-cf6817193f4f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:36.590766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a4e6c-647e-4d0a-9a6e-bed73212cf21 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:36.595779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f1a27-eeb9-4302-b00b-4d6a6206ba23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:36.596508 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f1a27-eeb9-4302-b00b-4d6a6206ba23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:36.596791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f1a27-eeb9-4302-b00b-4d6a6206ba23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:36.597068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f1a27-eeb9-4302-b00b-4d6a6206ba23 admin admin] PATH_INFO: `/v3/projects/0787b61171194ec9a2c349f8c863154e` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:36.598199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f1a27-eeb9-4302-b00b-4d6a6206ba23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0787b61171194ec9a2c349f8c863154e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:36.600147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f1a27-eeb9-4302-b00b-4d6a6206ba23 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:36.605437 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3473/6885] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:36 2022] PUT /identity/v3/projects/3ee54b9b9b1e4f44b708f5139cfc187f/users/9644da44cce34b4cae9db4074dfd8ca0/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:36.606433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a4e6c-647e-4d0a-9a6e-bed73212cf21 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:36.658874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-db5f1a27-eeb9-4302-b00b-4d6a6206ba23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0787b61171194ec9a2c349f8c863154e', 'request_id': 'req-db5f1a27-eeb9-4302-b00b-4d6a6206ba23'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:36.665717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-db5f1a27-eeb9-4302-b00b-4d6a6206ba23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0787b61171194ec9a2c349f8c863154e', 'request_id': 'req-db5f1a27-eeb9-4302-b00b-4d6a6206ba23'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:36.672713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-db5f1a27-eeb9-4302-b00b-4d6a6206ba23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0787b61171194ec9a2c349f8c863154e', 'request_id': 'req-db5f1a27-eeb9-4302-b00b-4d6a6206ba23'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:36.674626 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:36.687020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-db5f1a27-eeb9-4302-b00b-4d6a6206ba23 admin admin] The token cache is being invalidate because project 0787b61171194ec9a2c349f8c863154e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:36.687395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-db5f1a27-eeb9-4302-b00b-4d6a6206ba23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:36.688263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-db5f1a27-eeb9-4302-b00b-4d6a6206ba23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:36.689320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a4e6c-647e-4d0a-9a6e-bed73212cf21 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:36.689728 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3413/6886] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:36 2022] DELETE /identity/v3/projects/0787b61171194ec9a2c349f8c863154e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:36.690520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f1a27-eeb9-4302-b00b-4d6a6206ba23 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:36.691699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-db5f1a27-eeb9-4302-b00b-4d6a6206ba23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:36.752347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b93b7-debf-4c7d-8377-399045f9ed5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:36.752888 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b93b7-debf-4c7d-8377-399045f9ed5f admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:36.753168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b93b7-debf-4c7d-8377-399045f9ed5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:36.753435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b93b7-debf-4c7d-8377-399045f9ed5f admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:36.754090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b93b7-debf-4c7d-8377-399045f9ed5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:36.756082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b93b7-debf-4c7d-8377-399045f9ed5f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:36.766781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f1a27-eeb9-4302-b00b-4d6a6206ba23 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:36.775433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbec1fb-cc47-4a96-a387-9c15f2e4e3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:36.776016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbec1fb-cc47-4a96-a387-9c15f2e4e3d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:36.776298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbec1fb-cc47-4a96-a387-9c15f2e4e3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:36.776750 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbec1fb-cc47-4a96-a387-9c15f2e4e3d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:36.777672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbec1fb-cc47-4a96-a387-9c15f2e4e3d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:36.784566 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3474/6887] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:42:36 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:36.784777 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbec1fb-cc47-4a96-a387-9c15f2e4e3d7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:36.784868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b93b7-debf-4c7d-8377-399045f9ed5f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:36.786659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2a0b93b7-debf-4c7d-8377-399045f9ed5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:36.799280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b93b7-debf-4c7d-8377-399045f9ed5f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:36.806311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff976e76-b126-4c2f-9c0a-d5013a9ce6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:36.808645 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff976e76-b126-4c2f-9c0a-d5013a9ce6cf admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:36.809999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff976e76-b126-4c2f-9c0a-d5013a9ce6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:36.810495 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff976e76-b126-4c2f-9c0a-d5013a9ce6cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:36.811302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff976e76-b126-4c2f-9c0a-d5013a9ce6cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:36.814278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff976e76-b126-4c2f-9c0a-d5013a9ce6cf admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:36.823046 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3414/6888] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:42:36 2022] POST /identity/v3/projects => generated 411 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:36.823975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbec1fb-cc47-4a96-a387-9c15f2e4e3d7 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:36.825774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3cbec1fb-cc47-4a96-a387-9c15f2e4e3d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:36.853305 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3475/6889] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:42:36 2022] POST /identity/v3/projects => generated 367 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:36.854682 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0c5f4-eea0-4cfb-8cdd-8b3c40eb8dda None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:36.854969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0c5f4-eea0-4cfb-8cdd-8b3c40eb8dda None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:36.855239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0c5f4-eea0-4cfb-8cdd-8b3c40eb8dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:36.889407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f8a0c5f4-eea0-4cfb-8cdd-8b3c40eb8dda None None] MFA Rules not processed for user `9644da44cce34b4cae9db4074dfd8ca0`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:36.891375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f8a0c5f4-eea0-4cfb-8cdd-8b3c40eb8dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:36.920851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbec1fb-cc47-4a96-a387-9c15f2e4e3d7 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:36.949993 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:36.991216 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3476/6890] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:36 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:36.995919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0c5f4-eea0-4cfb-8cdd-8b3c40eb8dda None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:36.997362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f8a0c5f4-eea0-4cfb-8cdd-8b3c40eb8dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:37.020598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade8e26-1eb5-4caf-943e-38dc8ca915c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:37.021579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade8e26-1eb5-4caf-943e-38dc8ca915c8 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:37.022082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade8e26-1eb5-4caf-943e-38dc8ca915c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:37.022576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade8e26-1eb5-4caf-943e-38dc8ca915c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:37.025796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bade8e26-1eb5-4caf-943e-38dc8ca915c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:37.044672 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:37.082735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0c5f4-eea0-4cfb-8cdd-8b3c40eb8dda None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:37.088026 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91db692-e021-474c-aa68-6d895290109d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:37.088599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91db692-e021-474c-aa68-6d895290109d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:37.088868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91db692-e021-474c-aa68-6d895290109d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:37.089146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91db692-e021-474c-aa68-6d895290109d admin admin] PATH_INFO: `/v3/users/0f6cd4f06d8846e592a2854639e33d41` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:37.090353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91db692-e021-474c-aa68-6d895290109d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f6cd4f06d8846e592a2854639e33d41)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:37.095026 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91db692-e021-474c-aa68-6d895290109d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:37.137107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade8e26-1eb5-4caf-943e-38dc8ca915c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:37.140942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade8e26-1eb5-4caf-943e-38dc8ca915c8 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:37.151453 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3415/6891] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:37.152145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade8e26-1eb5-4caf-943e-38dc8ca915c8 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:37.153987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bade8e26-1eb5-4caf-943e-38dc8ca915c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:37.156631 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a91db692-e021-474c-aa68-6d895290109d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f6cd4f06d8846e592a2854639e33d41'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:37.168094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade8e26-1eb5-4caf-943e-38dc8ca915c8 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:37.169851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a91db692-e021-474c-aa68-6d895290109d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f6cd4f06d8846e592a2854639e33d41'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:37.175792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22d33a-c046-4b7e-a94c-1cb6ab39d975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:37.177038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22d33a-c046-4b7e-a94c-1cb6ab39d975 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:37.177314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22d33a-c046-4b7e-a94c-1cb6ab39d975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:37.177587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22d33a-c046-4b7e-a94c-1cb6ab39d975 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:37.178239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa22d33a-c046-4b7e-a94c-1cb6ab39d975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:37.180353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa22d33a-c046-4b7e-a94c-1cb6ab39d975 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:37.186295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a91db692-e021-474c-aa68-6d895290109d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f6cd4f06d8846e592a2854639e33d41'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:37.187985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a91db692-e021-474c-aa68-6d895290109d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f6cd4f06d8846e592a2854639e33d41'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:37.196684 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3416/6892] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:37.197563 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22d33a-c046-4b7e-a94c-1cb6ab39d975 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:37.202519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a91db692-e021-474c-aa68-6d895290109d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f6cd4f06d8846e592a2854639e33d41'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:37.210481 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22d33a-c046-4b7e-a94c-1cb6ab39d975 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:37.212203 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3477/6893] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:42:36 2022] DELETE /identity/v3/users/0f6cd4f06d8846e592a2854639e33d41 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:37.213027 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91db692-e021-474c-aa68-6d895290109d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:37.214638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a91db692-e021-474c-aa68-6d895290109d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:37.301991 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:37.307174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91db692-e021-474c-aa68-6d895290109d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:37.317881 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda94062-5759-4019-b23c-309ec1d5c4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:37.318841 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda94062-5759-4019-b23c-309ec1d5c4fb admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:37.319716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda94062-5759-4019-b23c-309ec1d5c4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:37.320097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda94062-5759-4019-b23c-309ec1d5c4fb admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:37.321513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda94062-5759-4019-b23c-309ec1d5c4fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:37.324589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda94062-5759-4019-b23c-309ec1d5c4fb admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:37.342020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867b8a7-e3b6-4f9b-a2c6-ffa13f735e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:37.343237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867b8a7-e3b6-4f9b-a2c6-ffa13f735e16 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:37.343638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867b8a7-e3b6-4f9b-a2c6-ffa13f735e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:37.344105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867b8a7-e3b6-4f9b-a2c6-ffa13f735e16 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:37.344784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867b8a7-e3b6-4f9b-a2c6-ffa13f735e16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:37.347346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867b8a7-e3b6-4f9b-a2c6-ffa13f735e16 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:37.355313 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3478/6894] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:42:37 2022] POST /identity/v3/users => generated 290 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:37.355313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda94062-5759-4019-b23c-309ec1d5c4fb admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:37.356830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-eda94062-5759-4019-b23c-309ec1d5c4fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:37.381603 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3417/6895] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:42:37 2022] POST /identity/v3/users => generated 306 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:37.383026 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867b8a7-e3b6-4f9b-a2c6-ffa13f735e16 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:37.387931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c867b8a7-e3b6-4f9b-a2c6-ffa13f735e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:37.407262 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867b8a7-e3b6-4f9b-a2c6-ffa13f735e16 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:37.414556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22505682-6beb-4586-88c9-911506448bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:37.415492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22505682-6beb-4586-88c9-911506448bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:37.416100 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22505682-6beb-4586-88c9-911506448bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:37.416431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22505682-6beb-4586-88c9-911506448bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:37.417197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22505682-6beb-4586-88c9-911506448bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:37.419042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22505682-6beb-4586-88c9-911506448bd4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:37.445597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda94062-5759-4019-b23c-309ec1d5c4fb admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:37.450919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d4e67-9280-456b-8e21-d22644bde0f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:37.452190 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3418/6896] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:37.453253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22505682-6beb-4586-88c9-911506448bd4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:37.455521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d4e67-9280-456b-8e21-d22644bde0f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:37.455816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d4e67-9280-456b-8e21-d22644bde0f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:37.456177 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d4e67-9280-456b-8e21-d22644bde0f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:37.465168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-bb8d4e67-9280-456b-8e21-d22644bde0f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:37.467783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22505682-6beb-4586-88c9-911506448bd4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:37.473617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9301a90-2e3b-4611-825e-f4ce7afe505f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:37.474122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9301a90-2e3b-4611-825e-f4ce7afe505f admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:37.474443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9301a90-2e3b-4611-825e-f4ce7afe505f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:37.474713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9301a90-2e3b-4611-825e-f4ce7afe505f admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:37.475439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9301a90-2e3b-4611-825e-f4ce7afe505f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:37.477915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9301a90-2e3b-4611-825e-f4ce7afe505f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:37.491396 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3419/6897] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:37.492591 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9301a90-2e3b-4611-825e-f4ce7afe505f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:37.494566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b9301a90-2e3b-4611-825e-f4ce7afe505f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:37.523931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9301a90-2e3b-4611-825e-f4ce7afe505f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:37.535139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feee761-0b70-49dc-95a5-4ac9be68e4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:37.535722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feee761-0b70-49dc-95a5-4ac9be68e4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:37.536093 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feee761-0b70-49dc-95a5-4ac9be68e4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:37.536368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feee761-0b70-49dc-95a5-4ac9be68e4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:37.537024 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feee761-0b70-49dc-95a5-4ac9be68e4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:37.538639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feee761-0b70-49dc-95a5-4ac9be68e4f5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:37.550659 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3420/6898] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:37.553680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feee761-0b70-49dc-95a5-4ac9be68e4f5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:37.565451 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feee761-0b70-49dc-95a5-4ac9be68e4f5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:37.586419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf15079-43cf-4988-8973-b89f436959f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:37.587325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf15079-43cf-4988-8973-b89f436959f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:37.587609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf15079-43cf-4988-8973-b89f436959f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:37.587931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf15079-43cf-4988-8973-b89f436959f5 admin admin] PATH_INFO: `/v3/projects/996cb008efe4474c9f8e71d51fb285af/users/e089b475c57a4879b9d28e656ab4fd76/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:37.628828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf15079-43cf-4988-8973-b89f436959f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=996cb008efe4474c9f8e71d51fb285af, user_id=e089b475c57a4879b9d28e656ab4fd76, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:37.631506 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf15079-43cf-4988-8973-b89f436959f5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:37.636283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d4e67-9280-456b-8e21-d22644bde0f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:37.637959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d4e67-9280-456b-8e21-d22644bde0f7 service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:37.659062 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3421/6899] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:37 2022] PUT /identity/v3/projects/996cb008efe4474c9f8e71d51fb285af/users/e089b475c57a4879b9d28e656ab4fd76/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:37.660351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf15079-43cf-4988-8973-b89f436959f5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:37.670724 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3479/6900] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:37 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:37.678105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d4e67-9280-456b-8e21-d22644bde0f7 service cinder] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:37.693636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d4e67-9280-456b-8e21-d22644bde0f7 service cinder] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:37.766296 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:37.783632 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4810a6a-33e7-4df9-8635-a32c8713170d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:37.784522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4810a6a-33e7-4df9-8635-a32c8713170d admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:37.785005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4810a6a-33e7-4df9-8635-a32c8713170d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:37.785569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4810a6a-33e7-4df9-8635-a32c8713170d admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:37.786928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4810a6a-33e7-4df9-8635-a32c8713170d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:37.788853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4810a6a-33e7-4df9-8635-a32c8713170d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:37.803919 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3480/6901] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:37.805351 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13800872-6834-4766-8b3d-5ebf60029e22 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:37.805712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13800872-6834-4766-8b3d-5ebf60029e22 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:37.806063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13800872-6834-4766-8b3d-5ebf60029e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:37.850822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-13800872-6834-4766-8b3d-5ebf60029e22 None None] MFA Rules not processed for user `e089b475c57a4879b9d28e656ab4fd76`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:37.852601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-13800872-6834-4766-8b3d-5ebf60029e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:37.885840 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:37.892588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf15079-43cf-4988-8973-b89f436959f5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:37.899858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94142f8-28e5-4d0f-a311-aae06be3bd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:37.900783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94142f8-28e5-4d0f-a311-aae06be3bd90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:37.901064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94142f8-28e5-4d0f-a311-aae06be3bd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:37.901339 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94142f8-28e5-4d0f-a311-aae06be3bd90 admin admin] PATH_INFO: `/v3/projects/48b1dc9806ee48e799b8a4ba8eb778ca/users/c840669e3667413bb3f48b06a1827b36/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:37.922565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94142f8-28e5-4d0f-a311-aae06be3bd90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48b1dc9806ee48e799b8a4ba8eb778ca, user_id=c840669e3667413bb3f48b06a1827b36, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:37.925466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94142f8-28e5-4d0f-a311-aae06be3bd90 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:37.947448 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3422/6902] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:37 2022] PUT /identity/v3/projects/48b1dc9806ee48e799b8a4ba8eb778ca/users/c840669e3667413bb3f48b06a1827b36/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:37.948426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94142f8-28e5-4d0f-a311-aae06be3bd90 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:37.970065 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3481/6903] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:37.975138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13800872-6834-4766-8b3d-5ebf60029e22 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:37.976644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-13800872-6834-4766-8b3d-5ebf60029e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:38.057613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13800872-6834-4766-8b3d-5ebf60029e22 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:38.065774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94142f8-28e5-4d0f-a311-aae06be3bd90 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:38.071109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4768d45-e01e-4331-8e89-95781fb94087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:38.071983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4768d45-e01e-4331-8e89-95781fb94087 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:38.073028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4768d45-e01e-4331-8e89-95781fb94087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:38.073028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4768d45-e01e-4331-8e89-95781fb94087 admin admin] PATH_INFO: `/v3/projects/e76dd5169f174474968731329fedd524/users/55849d5754b843268f1230bf7560d1e6/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:38.096217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4768d45-e01e-4331-8e89-95781fb94087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76dd5169f174474968731329fedd524, user_id=55849d5754b843268f1230bf7560d1e6, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:38.106539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4768d45-e01e-4331-8e89-95781fb94087 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:38.126037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87254c03-4e6d-421f-8cce-b735048e2d71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:38.127429 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87254c03-4e6d-421f-8cce-b735048e2d71 service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:38.128000 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3423/6904] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:37 2022] PUT /identity/v3/projects/e76dd5169f174474968731329fedd524/users/55849d5754b843268f1230bf7560d1e6/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:38.128394 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87254c03-4e6d-421f-8cce-b735048e2d71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:38.128927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87254c03-4e6d-421f-8cce-b735048e2d71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:38.130969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-87254c03-4e6d-421f-8cce-b735048e2d71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:38.141159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4768d45-e01e-4331-8e89-95781fb94087 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:38.144119 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e4768d45-e01e-4331-8e89-95781fb94087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:38.208598 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87254c03-4e6d-421f-8cce-b735048e2d71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:38.210326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87254c03-4e6d-421f-8cce-b735048e2d71 service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:38.220496 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3482/6905] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:37 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:38.221173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87254c03-4e6d-421f-8cce-b735048e2d71 service cinder] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:38.229259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4768d45-e01e-4331-8e89-95781fb94087 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:38.234696 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87254c03-4e6d-421f-8cce-b735048e2d71 service cinder] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:38.237410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03735db5-577f-4dea-9746-3396bb52d0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:38.238321 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03735db5-577f-4dea-9746-3396bb52d0f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:38.238705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03735db5-577f-4dea-9746-3396bb52d0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:38.239104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03735db5-577f-4dea-9746-3396bb52d0f4 admin admin] PATH_INFO: `/v3/projects/d338d19aa0b743458304d6fe8cefe92e` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:38.240727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03735db5-577f-4dea-9746-3396bb52d0f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d338d19aa0b743458304d6fe8cefe92e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:38.242183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb5542-5ee8-49ce-ba83-acd0e1bc1a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:38.243161 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb5542-5ee8-49ce-ba83-acd0e1bc1a3e admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:38.243281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03735db5-577f-4dea-9746-3396bb52d0f4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:38.243803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb5542-5ee8-49ce-ba83-acd0e1bc1a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:38.244251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb5542-5ee8-49ce-ba83-acd0e1bc1a3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:38.245060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb5542-5ee8-49ce-ba83-acd0e1bc1a3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:38.246796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb5542-5ee8-49ce-ba83-acd0e1bc1a3e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:38.258952 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3483/6906] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:38.260140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb5542-5ee8-49ce-ba83-acd0e1bc1a3e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:38.262156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-31cb5542-5ee8-49ce-ba83-acd0e1bc1a3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:38.295501 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:38.306130 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:38.315628 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-03735db5-577f-4dea-9746-3396bb52d0f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd338d19aa0b743458304d6fe8cefe92e', 'request_id': 'req-03735db5-577f-4dea-9746-3396bb52d0f4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:38.325428 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-03735db5-577f-4dea-9746-3396bb52d0f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd338d19aa0b743458304d6fe8cefe92e', 'request_id': 'req-03735db5-577f-4dea-9746-3396bb52d0f4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:38.334690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-03735db5-577f-4dea-9746-3396bb52d0f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd338d19aa0b743458304d6fe8cefe92e', 'request_id': 'req-03735db5-577f-4dea-9746-3396bb52d0f4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:38.344308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb5542-5ee8-49ce-ba83-acd0e1bc1a3e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:38.355484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-03735db5-577f-4dea-9746-3396bb52d0f4 admin admin] The token cache is being invalidate because project d338d19aa0b743458304d6fe8cefe92e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:38.356295 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-03735db5-577f-4dea-9746-3396bb52d0f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:38.357039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-03735db5-577f-4dea-9746-3396bb52d0f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:38.363956 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3424/6907] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:38 2022] DELETE /identity/v3/projects/d338d19aa0b743458304d6fe8cefe92e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:38.365621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25985741-74bf-4265-8033-34ac512bec8b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:38.366865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25985741-74bf-4265-8033-34ac512bec8b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:38.367318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25985741-74bf-4265-8033-34ac512bec8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:38.408186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-25985741-74bf-4265-8033-34ac512bec8b None None] MFA Rules not processed for user `55849d5754b843268f1230bf7560d1e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:38.409735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-25985741-74bf-4265-8033-34ac512bec8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:38.417248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1ac2f-c94e-440e-bb2c-77f3e91c9988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:38.418884 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1ac2f-c94e-440e-bb2c-77f3e91c9988 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:38.419571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1ac2f-c94e-440e-bb2c-77f3e91c9988 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:38.420206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1ac2f-c94e-440e-bb2c-77f3e91c9988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:38.426975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dcc1ac2f-c94e-440e-bb2c-77f3e91c9988 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:38.507820 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3425/6908] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:38 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:38.507820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25985741-74bf-4265-8033-34ac512bec8b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:38.507820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-25985741-74bf-4265-8033-34ac512bec8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:38.519845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1ac2f-c94e-440e-bb2c-77f3e91c9988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:38.521621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1ac2f-c94e-440e-bb2c-77f3e91c9988 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:38.549560 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3484/6909] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:38.551493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858e0c5-3a0d-44ef-a2d2-dc8d19c46a85 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:38.551814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858e0c5-3a0d-44ef-a2d2-dc8d19c46a85 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:38.552126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858e0c5-3a0d-44ef-a2d2-dc8d19c46a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:38.610409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a858e0c5-3a0d-44ef-a2d2-dc8d19c46a85 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:38.630430 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a858e0c5-3a0d-44ef-a2d2-dc8d19c46a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:38.709835 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3485/6910] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:38.710411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858e0c5-3a0d-44ef-a2d2-dc8d19c46a85 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:38.716490 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a858e0c5-3a0d-44ef-a2d2-dc8d19c46a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:38.718652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25985741-74bf-4265-8033-34ac512bec8b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:38.738999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb48dd-9c4a-44f9-b13a-75119ecd069a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:38.740316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb48dd-9c4a-44f9-b13a-75119ecd069a admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:38.740601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb48dd-9c4a-44f9-b13a-75119ecd069a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:38.740875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb48dd-9c4a-44f9-b13a-75119ecd069a admin admin] PATH_INFO: `/v3/projects/48b1dc9806ee48e799b8a4ba8eb778ca/users/c840669e3667413bb3f48b06a1827b36/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:38.750046 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb48dd-9c4a-44f9-b13a-75119ecd069a admin admin] RBAC: Authorizing `identity:create_grant(project_id=48b1dc9806ee48e799b8a4ba8eb778ca, user_id=c840669e3667413bb3f48b06a1827b36, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:38.752775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb48dd-9c4a-44f9-b13a-75119ecd069a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:38.756437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858e0c5-3a0d-44ef-a2d2-dc8d19c46a85 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:38.783792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89380f-3470-4331-b4bb-aa84b60fa2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:38.784956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89380f-3470-4331-b4bb-aa84b60fa2fe admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:38.784956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89380f-3470-4331-b4bb-aa84b60fa2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:38.785157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89380f-3470-4331-b4bb-aa84b60fa2fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:38.785714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89380f-3470-4331-b4bb-aa84b60fa2fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:38.787637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89380f-3470-4331-b4bb-aa84b60fa2fe admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:38.797233 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3426/6911] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:38 2022] PUT /identity/v3/projects/48b1dc9806ee48e799b8a4ba8eb778ca/users/c840669e3667413bb3f48b06a1827b36/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:38.811535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13cd7e-df24-477b-9337-5e008250d35a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:38.811830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13cd7e-df24-477b-9337-5e008250d35a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:38.812762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13cd7e-df24-477b-9337-5e008250d35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:38.862577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ec13cd7e-df24-477b-9337-5e008250d35a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:38.864458 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ec13cd7e-df24-477b-9337-5e008250d35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:38.877961 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3486/6912] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:42:38 2022] POST /identity/v3/projects => generated 409 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:38.880520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20d8ed-ce0e-4f70-87ef-3c7df35b853f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:38.881068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20d8ed-ce0e-4f70-87ef-3c7df35b853f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:38.881342 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20d8ed-ce0e-4f70-87ef-3c7df35b853f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:38.943513 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:38.975799 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3427/6913] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:38.975799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13cd7e-df24-477b-9337-5e008250d35a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:38.976090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3d20d8ed-ce0e-4f70-87ef-3c7df35b853f None None] MFA Rules not processed for user `c840669e3667413bb3f48b06a1827b36`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:38.979154 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3d20d8ed-ce0e-4f70-87ef-3c7df35b853f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:39.000752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13cd7e-df24-477b-9337-5e008250d35a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:39.014281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5dfe4-5300-48d5-a308-a527f6d64bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:39.015712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5dfe4-5300-48d5-a308-a527f6d64bab admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:39.016304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5dfe4-5300-48d5-a308-a527f6d64bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:39.018795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5dfe4-5300-48d5-a308-a527f6d64bab admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:39.020777 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c5dfe4-5300-48d5-a308-a527f6d64bab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:39.024672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c5dfe4-5300-48d5-a308-a527f6d64bab admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:39.069289 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3428/6914] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:42:38 2022] POST /identity/v3/users => generated 311 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:39.070440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5dfe4-5300-48d5-a308-a527f6d64bab admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:39.086273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5dfe4-5300-48d5-a308-a527f6d64bab admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:39.092895 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfafac5-3a62-4d6a-a9b2-8b618d358a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:39.094433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfafac5-3a62-4d6a-a9b2-8b618d358a02 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:39.094433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfafac5-3a62-4d6a-a9b2-8b618d358a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:39.094980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfafac5-3a62-4d6a-a9b2-8b618d358a02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:39.095828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfafac5-3a62-4d6a-a9b2-8b618d358a02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:42:39.096273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfafac5-3a62-4d6a-a9b2-8b618d358a02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:39.098582 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfafac5-3a62-4d6a-a9b2-8b618d358a02 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:39.120665 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:39.187993 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3487/6915] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:39.187993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20d8ed-ce0e-4f70-87ef-3c7df35b853f None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:39.198866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20d8ed-ce0e-4f70-87ef-3c7df35b853f None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:39.205368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8b051-1f5d-4c7d-8ca0-f38db23b0305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:39.205995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8b051-1f5d-4c7d-8ca0-f38db23b0305 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:39.206271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8b051-1f5d-4c7d-8ca0-f38db23b0305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:39.206539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8b051-1f5d-4c7d-8ca0-f38db23b0305 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:39.207360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8b051-1f5d-4c7d-8ca0-f38db23b0305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:39.214028 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8b051-1f5d-4c7d-8ca0-f38db23b0305 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:39.227253 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3488/6916] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:39.228036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8b051-1f5d-4c7d-8ca0-f38db23b0305 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:39.230092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-11c8b051-1f5d-4c7d-8ca0-f38db23b0305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:39.355050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8b051-1f5d-4c7d-8ca0-f38db23b0305 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:39.369210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c822fe0-869d-4a79-ba74-365a85bef443 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:39.369825 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c822fe0-869d-4a79-ba74-365a85bef443 service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:39.370101 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c822fe0-869d-4a79-ba74-365a85bef443 service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:39.370372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c822fe0-869d-4a79-ba74-365a85bef443 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:39.396968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c822fe0-869d-4a79-ba74-365a85bef443 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:39.398527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c822fe0-869d-4a79-ba74-365a85bef443 service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:39.445392 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3489/6917] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:39.446931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c822fe0-869d-4a79-ba74-365a85bef443 service cinder] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:39.477980 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3429/6918] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:42:39.479645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfafac5-3a62-4d6a-a9b2-8b618d358a02 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:39.483290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c822fe0-869d-4a79-ba74-365a85bef443 service cinder] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:39.489831 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956257d-b001-4876-bd38-f136bb7e8d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:39.490782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956257d-b001-4876-bd38-f136bb7e8d5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:39.491378 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956257d-b001-4876-bd38-f136bb7e8d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:39.491746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956257d-b001-4876-bd38-f136bb7e8d5f admin admin] PATH_INFO: `/v3/projects/aff7c011bdaa4c519c0344daec7a8a34/users/2439eb84c3d547fb9d7959fe174ccdb5/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:39.505371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfafac5-3a62-4d6a-a9b2-8b618d358a02 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:39.513631 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956257d-b001-4876-bd38-f136bb7e8d5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aff7c011bdaa4c519c0344daec7a8a34, user_id=2439eb84c3d547fb9d7959fe174ccdb5, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:39.514446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f8907-1c72-419b-8c50-16731976da90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:39.515924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f8907-1c72-419b-8c50-16731976da90 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:39.516458 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f8907-1c72-419b-8c50-16731976da90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:39.517255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f8907-1c72-419b-8c50-16731976da90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:39.518315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956257d-b001-4876-bd38-f136bb7e8d5f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:39.518673 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f8907-1c72-419b-8c50-16731976da90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:39.520883 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f8907-1c72-419b-8c50-16731976da90 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:39.543542 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3490/6919] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:39 2022] PUT /identity/v3/projects/aff7c011bdaa4c519c0344daec7a8a34/users/2439eb84c3d547fb9d7959fe174ccdb5/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:39.548693 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956257d-b001-4876-bd38-f136bb7e8d5f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:39.580863 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3430/6920] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:42:39 2022] POST /identity/v3/projects => generated 363 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:39.585708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f8907-1c72-419b-8c50-16731976da90 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:39.697298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956257d-b001-4876-bd38-f136bb7e8d5f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:39.805063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f8907-1c72-419b-8c50-16731976da90 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:39.832315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4ae32-e6b4-4a3e-9a14-a3b4636f8fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:39.832953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4ae32-e6b4-4a3e-9a14-a3b4636f8fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:39.833207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4ae32-e6b4-4a3e-9a14-a3b4636f8fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:39.833534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4ae32-e6b4-4a3e-9a14-a3b4636f8fb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:39.834084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad4ae32-e6b4-4a3e-9a14-a3b4636f8fb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:39.836034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad4ae32-e6b4-4a3e-9a14-a3b4636f8fb3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:39.870701 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:39.900085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef523bb9-03b0-448e-9642-c5650d2433c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:39.900721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef523bb9-03b0-448e-9642-c5650d2433c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:39.901001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef523bb9-03b0-448e-9642-c5650d2433c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:39.901274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef523bb9-03b0-448e-9642-c5650d2433c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:39.902031 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef523bb9-03b0-448e-9642-c5650d2433c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:39.903636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef523bb9-03b0-448e-9642-c5650d2433c8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:39.905010 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3431/6921] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:42:39 2022] POST /identity/v3/users => generated 282 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:42:39.906023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4ae32-e6b4-4a3e-9a14-a3b4636f8fb3 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:39.947580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad4ae32-e6b4-4a3e-9a14-a3b4636f8fb3 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:39.950867 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3491/6922] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:39.961387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef523bb9-03b0-448e-9642-c5650d2433c8 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:39.966275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78054700-02d1-4d8a-bbee-2650287c6374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:39.966904 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78054700-02d1-4d8a-bbee-2650287c6374 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:39.967183 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78054700-02d1-4d8a-bbee-2650287c6374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:39.967445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78054700-02d1-4d8a-bbee-2650287c6374 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:39.968678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78054700-02d1-4d8a-bbee-2650287c6374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:39.970383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78054700-02d1-4d8a-bbee-2650287c6374 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:39.985355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef523bb9-03b0-448e-9642-c5650d2433c8 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:40.000462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35b1ba-2edf-44b6-97d1-1912b8006c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:40.001513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35b1ba-2edf-44b6-97d1-1912b8006c4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:40.002310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35b1ba-2edf-44b6-97d1-1912b8006c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:40.005213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35b1ba-2edf-44b6-97d1-1912b8006c4d admin admin] PATH_INFO: `/v3/projects/aff7c011bdaa4c519c0344daec7a8a34/users/2439eb84c3d547fb9d7959fe174ccdb5/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:40.007947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35b1ba-2edf-44b6-97d1-1912b8006c4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aff7c011bdaa4c519c0344daec7a8a34, user_id=2439eb84c3d547fb9d7959fe174ccdb5, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:40.008949 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3432/6923] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:40.012750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35b1ba-2edf-44b6-97d1-1912b8006c4d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:40.012883 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78054700-02d1-4d8a-bbee-2650287c6374 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:40.029115 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78054700-02d1-4d8a-bbee-2650287c6374 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:40.037308 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3492/6924] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:39 2022] PUT /identity/v3/projects/aff7c011bdaa4c519c0344daec7a8a34/users/2439eb84c3d547fb9d7959fe174ccdb5/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:42:40.051758 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f971dce-1d95-4a86-9057-5d7a144addf2 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:40.052434 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f971dce-1d95-4a86-9057-5d7a144addf2 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:40.052955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f971dce-1d95-4a86-9057-5d7a144addf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:40.111348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9f971dce-1d95-4a86-9057-5d7a144addf2 None None] MFA Rules not processed for user `2439eb84c3d547fb9d7959fe174ccdb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:40.113303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9f971dce-1d95-4a86-9057-5d7a144addf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:40.169870 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68ad75-975c-4a6a-8646-d9d83cfd743a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:40.170513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68ad75-975c-4a6a-8646-d9d83cfd743a admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:40.170869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68ad75-975c-4a6a-8646-d9d83cfd743a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:40.172372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f68ad75-975c-4a6a-8646-d9d83cfd743a admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:40.174105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68ad75-975c-4a6a-8646-d9d83cfd743a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:40.176284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f68ad75-975c-4a6a-8646-d9d83cfd743a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:40.204351 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3433/6925] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:42:40.209468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68ad75-975c-4a6a-8646-d9d83cfd743a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:40.247396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f68ad75-975c-4a6a-8646-d9d83cfd743a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:40.266770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe06c79-e6c8-4f11-82b1-5ccbf1aad36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:40.268837 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe06c79-e6c8-4f11-82b1-5ccbf1aad36d admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:40.270518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe06c79-e6c8-4f11-82b1-5ccbf1aad36d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:40.275285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe06c79-e6c8-4f11-82b1-5ccbf1aad36d admin admin] PATH_INFO: `/v3/projects/cdaf2b486cfb41628de75dbd8cb92d2e/users/63bf452bc67e48cba6e030497111503a/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:40.359902 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:40.375751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe06c79-e6c8-4f11-82b1-5ccbf1aad36d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdaf2b486cfb41628de75dbd8cb92d2e, user_id=63bf452bc67e48cba6e030497111503a, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:40.379205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe06c79-e6c8-4f11-82b1-5ccbf1aad36d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:40.404947 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3434/6926] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:40 2022] PUT /identity/v3/projects/cdaf2b486cfb41628de75dbd8cb92d2e/users/63bf452bc67e48cba6e030497111503a/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:40.419272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7954754-eba0-4557-b1f5-44eade6eda40 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:40.419906 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7954754-eba0-4557-b1f5-44eade6eda40 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:40.421648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7954754-eba0-4557-b1f5-44eade6eda40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:40.444332 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3493/6927] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:40 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:40.493421 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-f7954754-eba0-4557-b1f5-44eade6eda40 None None] MFA Rules not processed for user `63bf452bc67e48cba6e030497111503a`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:40.494911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f7954754-eba0-4557-b1f5-44eade6eda40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:40.516297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f971dce-1d95-4a86-9057-5d7a144addf2 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:40.519314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9f971dce-1d95-4a86-9057-5d7a144addf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:40.668643 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3435/6928] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:40.673091 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7954754-eba0-4557-b1f5-44eade6eda40 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:40.791857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f971dce-1d95-4a86-9057-5d7a144addf2 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:40.850404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7954754-eba0-4557-b1f5-44eade6eda40 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:40.864084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a19f27-9e09-4ce6-8dfa-66caee04d97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:40.865769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a19f27-9e09-4ce6-8dfa-66caee04d97d admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:40.866215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a19f27-9e09-4ce6-8dfa-66caee04d97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:40.866822 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a19f27-9e09-4ce6-8dfa-66caee04d97d admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:40.868595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a19f27-9e09-4ce6-8dfa-66caee04d97d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:40.872644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a19f27-9e09-4ce6-8dfa-66caee04d97d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:40.943814 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3436/6929] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:42:40 2022] POST /identity/v3/projects => generated 359 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:40.946253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a19f27-9e09-4ce6-8dfa-66caee04d97d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:40.963514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6337673-686a-4cc7-a85e-6c978a9c2347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:40.964986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6337673-686a-4cc7-a85e-6c978a9c2347 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:40.965467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6337673-686a-4cc7-a85e-6c978a9c2347 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:40.965980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6337673-686a-4cc7-a85e-6c978a9c2347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:41.046289 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:41.135259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6337673-686a-4cc7-a85e-6c978a9c2347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:41.137489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6337673-686a-4cc7-a85e-6c978a9c2347 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:41.153295 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a19f27-9e09-4ce6-8dfa-66caee04d97d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:41.165285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04f5dc-7096-4eaa-bab0-418d8226c2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:41.166803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04f5dc-7096-4eaa-bab0-418d8226c2f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:41.167461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04f5dc-7096-4eaa-bab0-418d8226c2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:41.168123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04f5dc-7096-4eaa-bab0-418d8226c2f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:41.169495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04f5dc-7096-4eaa-bab0-418d8226c2f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:41.170087 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3494/6930] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:40 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:41.174522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04f5dc-7096-4eaa-bab0-418d8226c2f7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:41.230740 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:41.281624 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3437/6931] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:42:40 2022] POST /identity/v3/users => generated 286 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:41.286438 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6337673-686a-4cc7-a85e-6c978a9c2347 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:41.304273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6337673-686a-4cc7-a85e-6c978a9c2347 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:41.317836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1726f-5e02-4a0e-908e-a5f62e4a2687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:41.318577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1726f-5e02-4a0e-908e-a5f62e4a2687 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:41.321185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1726f-5e02-4a0e-908e-a5f62e4a2687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:41.321927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1726f-5e02-4a0e-908e-a5f62e4a2687 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:41.322750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae1726f-5e02-4a0e-908e-a5f62e4a2687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:41.326553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae1726f-5e02-4a0e-908e-a5f62e4a2687 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:41.353002 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3495/6932] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:41.355806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04f5dc-7096-4eaa-bab0-418d8226c2f7 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:41.384241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04f5dc-7096-4eaa-bab0-418d8226c2f7 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:41.405513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fb3cb-984a-44f5-891d-5b54ca36b1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:41.408878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fb3cb-984a-44f5-891d-5b54ca36b1a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:41.409645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fb3cb-984a-44f5-891d-5b54ca36b1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:41.410111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fb3cb-984a-44f5-891d-5b54ca36b1a9 admin admin] PATH_INFO: `/v3/projects/0dbffb3dde854d7d85ddfc3649de8744/users/238debe9bbba49148cc31c5ce1b8139e/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:41.460798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869fb3cb-984a-44f5-891d-5b54ca36b1a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dbffb3dde854d7d85ddfc3649de8744, user_id=238debe9bbba49148cc31c5ce1b8139e, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:41.470275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869fb3cb-984a-44f5-891d-5b54ca36b1a9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:41.514560 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3438/6933] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:41 2022] PUT /identity/v3/projects/0dbffb3dde854d7d85ddfc3649de8744/users/238debe9bbba49148cc31c5ce1b8139e/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:41.519029 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1726f-5e02-4a0e-908e-a5f62e4a2687 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:41.558237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1726f-5e02-4a0e-908e-a5f62e4a2687 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:41.702534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4c499f-583e-407a-826f-6addff9c6624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:41.703568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c499f-583e-407a-826f-6addff9c6624 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:41.703944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c499f-583e-407a-826f-6addff9c6624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:41.704759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4c499f-583e-407a-826f-6addff9c6624 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:41.706326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c499f-583e-407a-826f-6addff9c6624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:41.709474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4c499f-583e-407a-826f-6addff9c6624 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:41.745702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fb3cb-984a-44f5-891d-5b54ca36b1a9 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:41.746556 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3496/6934] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:41.763514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fb3cb-984a-44f5-891d-5b54ca36b1a9 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:41.786032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbb413-eabb-44a0-b401-52d346a231f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:41.788543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbb413-eabb-44a0-b401-52d346a231f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:41.788543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbb413-eabb-44a0-b401-52d346a231f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:41.788862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbb413-eabb-44a0-b401-52d346a231f3 admin admin] PATH_INFO: `/v3/projects/0dbffb3dde854d7d85ddfc3649de8744/users/238debe9bbba49148cc31c5ce1b8139e/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:41.797789 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cbb413-eabb-44a0-b401-52d346a231f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dbffb3dde854d7d85ddfc3649de8744, user_id=238debe9bbba49148cc31c5ce1b8139e, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:41.805369 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cbb413-eabb-44a0-b401-52d346a231f3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:41.894859 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3439/6935] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:41 2022] PUT /identity/v3/projects/0dbffb3dde854d7d85ddfc3649de8744/users/238debe9bbba49148cc31c5ce1b8139e/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:41.909515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e837ca4-0e2c-47bb-a651-aa41fbf33f09 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:41.909800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e837ca4-0e2c-47bb-a651-aa41fbf33f09 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:41.910109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e837ca4-0e2c-47bb-a651-aa41fbf33f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:41.971966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-4e837ca4-0e2c-47bb-a651-aa41fbf33f09 None None] MFA Rules not processed for user `238debe9bbba49148cc31c5ce1b8139e`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:41.975541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4e837ca4-0e2c-47bb-a651-aa41fbf33f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:42.176341 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3497/6936] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:41 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:42.201490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbb413-eabb-44a0-b401-52d346a231f3 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:42.205875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-03cbb413-eabb-44a0-b401-52d346a231f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:42.392460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbb413-eabb-44a0-b401-52d346a231f3 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:42.404155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3517b134-7152-4d94-b088-c2d248f0c2df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:42.405680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517b134-7152-4d94-b088-c2d248f0c2df service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:42.405973 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517b134-7152-4d94-b088-c2d248f0c2df service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:42.406229 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3517b134-7152-4d94-b088-c2d248f0c2df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:42.435639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3517b134-7152-4d94-b088-c2d248f0c2df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:42.437190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3517b134-7152-4d94-b088-c2d248f0c2df service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:42.508439 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3440/6937] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:42 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:42.705588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e837ca4-0e2c-47bb-a651-aa41fbf33f09 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:42.724395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e837ca4-0e2c-47bb-a651-aa41fbf33f09 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:42.734013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d24a9-3041-4a95-a15b-fa005dfb486a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:42.734713 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d24a9-3041-4a95-a15b-fa005dfb486a service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:42.735132 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d24a9-3041-4a95-a15b-fa005dfb486a service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:42.735530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d24a9-3041-4a95-a15b-fa005dfb486a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:42.792339 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:42.855160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e53845-fa71-4b0e-99f8-6b135655f8e1 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:42.855440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e53845-fa71-4b0e-99f8-6b135655f8e1 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:42.855705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e53845-fa71-4b0e-99f8-6b135655f8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:42.860530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d24a9-3041-4a95-a15b-fa005dfb486a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:42.877324 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d24a9-3041-4a95-a15b-fa005dfb486a service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:42.895177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e1e53845-fa71-4b0e-99f8-6b135655f8e1 None None] MFA Rules not processed for user `68324eedf5c840f4806f4c4ae410774f`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:42.916806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e1e53845-fa71-4b0e-99f8-6b135655f8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:42.918231 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3498/6938] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:43.208061 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3441/6939] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:43.913474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d24a9-3041-4a95-a15b-fa005dfb486a service cinder] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:44.159953 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d24a9-3041-4a95-a15b-fa005dfb486a service cinder] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:44.179028 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8530171-e34f-46bc-be20-635b9f5679a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:44.179623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8530171-e34f-46bc-be20-635b9f5679a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:44.179924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8530171-e34f-46bc-be20-635b9f5679a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:44.180779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8530171-e34f-46bc-be20-635b9f5679a2 admin admin] PATH_INFO: `/v3/users/a17688cd961f45e39a4ed551a78f4aad` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:44.183607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8530171-e34f-46bc-be20-635b9f5679a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a17688cd961f45e39a4ed551a78f4aad)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:44.193785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8530171-e34f-46bc-be20-635b9f5679a2 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:44.342146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b8530171-e34f-46bc-be20-635b9f5679a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a17688cd961f45e39a4ed551a78f4aad'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:44.358482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b8530171-e34f-46bc-be20-635b9f5679a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a17688cd961f45e39a4ed551a78f4aad'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:44.393271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b8530171-e34f-46bc-be20-635b9f5679a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a17688cd961f45e39a4ed551a78f4aad'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:44.394061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b8530171-e34f-46bc-be20-635b9f5679a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a17688cd961f45e39a4ed551a78f4aad'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:44.413252 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b8530171-e34f-46bc-be20-635b9f5679a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a17688cd961f45e39a4ed551a78f4aad'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:44.439180 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3499/6940] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:42:43 2022] DELETE /identity/v3/users/a17688cd961f45e39a4ed551a78f4aad => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:44.443765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fe888-d82c-4d09-947b-4aae04555864 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:44.444778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fe888-d82c-4d09-947b-4aae04555864 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:44.445279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fe888-d82c-4d09-947b-4aae04555864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:44.491372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c23fe888-d82c-4d09-947b-4aae04555864 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:44.503244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c23fe888-d82c-4d09-947b-4aae04555864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:44.719852 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:44.755150 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3442/6941] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:44.802994 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8530171-e34f-46bc-be20-635b9f5679a2 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:44.805283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b8530171-e34f-46bc-be20-635b9f5679a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:45.056995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8530171-e34f-46bc-be20-635b9f5679a2 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:45.070219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0961f-b026-4ad8-85c2-9d6fab89b6c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:45.071207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0961f-b026-4ad8-85c2-9d6fab89b6c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:45.074666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0961f-b026-4ad8-85c2-9d6fab89b6c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:45.075140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0961f-b026-4ad8-85c2-9d6fab89b6c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:45.110862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d0961f-b026-4ad8-85c2-9d6fab89b6c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:45.119663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d0961f-b026-4ad8-85c2-9d6fab89b6c2 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:45.132625 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:45.152535 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3500/6942] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:45.468328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23fe888-d82c-4d09-947b-4aae04555864 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:45.471486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c23fe888-d82c-4d09-947b-4aae04555864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:45.508527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23fe888-d82c-4d09-947b-4aae04555864 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:45.535600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88726dc4-460f-411d-a85f-ae675f9da8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:45.542304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88726dc4-460f-411d-a85f-ae675f9da8af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:45.542787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88726dc4-460f-411d-a85f-ae675f9da8af admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:45.545207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88726dc4-460f-411d-a85f-ae675f9da8af admin admin] PATH_INFO: `/v3/users/9fc871740d3543ec85bb04cedbefdd00` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:45.551238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88726dc4-460f-411d-a85f-ae675f9da8af admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fc871740d3543ec85bb04cedbefdd00)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:45.556263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88726dc4-460f-411d-a85f-ae675f9da8af admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:45.718006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-88726dc4-460f-411d-a85f-ae675f9da8af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fc871740d3543ec85bb04cedbefdd00'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:45.729697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-88726dc4-460f-411d-a85f-ae675f9da8af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fc871740d3543ec85bb04cedbefdd00'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:45.767630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-88726dc4-460f-411d-a85f-ae675f9da8af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fc871740d3543ec85bb04cedbefdd00'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:45.770236 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-88726dc4-460f-411d-a85f-ae675f9da8af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fc871740d3543ec85bb04cedbefdd00'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:45.799528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-88726dc4-460f-411d-a85f-ae675f9da8af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fc871740d3543ec85bb04cedbefdd00'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:45.835538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a5093-ae48-4a57-b66c-0f860a286719 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:45.835945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a5093-ae48-4a57-b66c-0f860a286719 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:45.836191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a5093-ae48-4a57-b66c-0f860a286719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:45.839446 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3443/6943] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:42:45 2022] DELETE /identity/v3/users/9fc871740d3543ec85bb04cedbefdd00 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:45.868730 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-538a5093-ae48-4a57-b66c-0f860a286719 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:45.870153 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-538a5093-ae48-4a57-b66c-0f860a286719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:46.019654 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3501/6944] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:46.177676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88726dc4-460f-411d-a85f-ae675f9da8af admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:46.179635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-88726dc4-460f-411d-a85f-ae675f9da8af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:46.370131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88726dc4-460f-411d-a85f-ae675f9da8af admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:46.388391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efee28-b36a-43a5-8a9c-63ea2883df82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:46.400595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efee28-b36a-43a5-8a9c-63ea2883df82 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:46.400595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efee28-b36a-43a5-8a9c-63ea2883df82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:46.400898 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efee28-b36a-43a5-8a9c-63ea2883df82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:46.430505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17efee28-b36a-43a5-8a9c-63ea2883df82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:46.432004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17efee28-b36a-43a5-8a9c-63ea2883df82 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:46.456664 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3444/6945] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:46.492679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a5093-ae48-4a57-b66c-0f860a286719 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:46.494386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-538a5093-ae48-4a57-b66c-0f860a286719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:46.545949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a5093-ae48-4a57-b66c-0f860a286719 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:46.562259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75546ad9-7aad-45bc-a76a-96a87bba117d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:46.563335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75546ad9-7aad-45bc-a76a-96a87bba117d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:46.565259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75546ad9-7aad-45bc-a76a-96a87bba117d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:46.565897 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75546ad9-7aad-45bc-a76a-96a87bba117d admin admin] PATH_INFO: `/v3/projects/50f5f2c9ab9b4bc78bac5d420e31e290` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:46.568512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75546ad9-7aad-45bc-a76a-96a87bba117d admin admin] RBAC: Authorizing `identity:delete_project(project_id=50f5f2c9ab9b4bc78bac5d420e31e290)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:46.574795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75546ad9-7aad-45bc-a76a-96a87bba117d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:46.670764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-75546ad9-7aad-45bc-a76a-96a87bba117d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50f5f2c9ab9b4bc78bac5d420e31e290', 'request_id': 'req-75546ad9-7aad-45bc-a76a-96a87bba117d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:46.683295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-75546ad9-7aad-45bc-a76a-96a87bba117d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50f5f2c9ab9b4bc78bac5d420e31e290', 'request_id': 'req-75546ad9-7aad-45bc-a76a-96a87bba117d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:46.707569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-75546ad9-7aad-45bc-a76a-96a87bba117d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50f5f2c9ab9b4bc78bac5d420e31e290', 'request_id': 'req-75546ad9-7aad-45bc-a76a-96a87bba117d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:46.730258 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-75546ad9-7aad-45bc-a76a-96a87bba117d admin admin] The token cache is being invalidate because project 50f5f2c9ab9b4bc78bac5d420e31e290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:46.730786 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-75546ad9-7aad-45bc-a76a-96a87bba117d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:46.731839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-75546ad9-7aad-45bc-a76a-96a87bba117d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:46.737167 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3502/6946] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:46 2022] DELETE /identity/v3/projects/50f5f2c9ab9b4bc78bac5d420e31e290 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:46.738671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efee28-b36a-43a5-8a9c-63ea2883df82 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:46.750677 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efee28-b36a-43a5-8a9c-63ea2883df82 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:46.980253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb248bf1-bb3c-47d3-b167-09b75065da67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:46.980996 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb248bf1-bb3c-47d3-b167-09b75065da67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:46.981340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb248bf1-bb3c-47d3-b167-09b75065da67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:46.981694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb248bf1-bb3c-47d3-b167-09b75065da67 admin admin] PATH_INFO: `/v3/users/c840669e3667413bb3f48b06a1827b36` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:46.988108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb248bf1-bb3c-47d3-b167-09b75065da67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c840669e3667413bb3f48b06a1827b36)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:46.995482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb248bf1-bb3c-47d3-b167-09b75065da67 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:47.009108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75546ad9-7aad-45bc-a76a-96a87bba117d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:47.010650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-75546ad9-7aad-45bc-a76a-96a87bba117d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:47.039485 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75546ad9-7aad-45bc-a76a-96a87bba117d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:47.073614 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:47.074275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec6f74-9745-46b4-bfdb-d7554c9c75a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:47.074981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec6f74-9745-46b4-bfdb-d7554c9c75a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:47.075275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec6f74-9745-46b4-bfdb-d7554c9c75a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:47.075573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec6f74-9745-46b4-bfdb-d7554c9c75a3 admin admin] PATH_INFO: `/v3/users/63bf452bc67e48cba6e030497111503a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:47.079579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec6f74-9745-46b4-bfdb-d7554c9c75a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63bf452bc67e48cba6e030497111503a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:47.081777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec6f74-9745-46b4-bfdb-d7554c9c75a3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:47.179690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cb248bf1-bb3c-47d3-b167-09b75065da67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c840669e3667413bb3f48b06a1827b36'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:47.204407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cb248bf1-bb3c-47d3-b167-09b75065da67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c840669e3667413bb3f48b06a1827b36'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:47.237432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1dec6f74-9745-46b4-bfdb-d7554c9c75a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63bf452bc67e48cba6e030497111503a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:47.259613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1dec6f74-9745-46b4-bfdb-d7554c9c75a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63bf452bc67e48cba6e030497111503a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:47.260283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cb248bf1-bb3c-47d3-b167-09b75065da67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c840669e3667413bb3f48b06a1827b36'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:47.263375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cb248bf1-bb3c-47d3-b167-09b75065da67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c840669e3667413bb3f48b06a1827b36'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:47.286745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1dec6f74-9745-46b4-bfdb-d7554c9c75a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63bf452bc67e48cba6e030497111503a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:47.288887 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1dec6f74-9745-46b4-bfdb-d7554c9c75a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63bf452bc67e48cba6e030497111503a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:47.293456 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:47.301830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1dec6f74-9745-46b4-bfdb-d7554c9c75a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63bf452bc67e48cba6e030497111503a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:47.302651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cb248bf1-bb3c-47d3-b167-09b75065da67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c840669e3667413bb3f48b06a1827b36'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:47.315480 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3503/6947] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:42:47 2022] DELETE /identity/v3/users/63bf452bc67e48cba6e030497111503a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:47.320943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc9990-9e4d-4915-862c-e5f6420762fd None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:47.321880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc9990-9e4d-4915-862c-e5f6420762fd None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:47.322376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc9990-9e4d-4915-862c-e5f6420762fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:47.336582 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3445/6948] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:42:46 2022] DELETE /identity/v3/users/c840669e3667413bb3f48b06a1827b36 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:47.362904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-70dc9990-9e4d-4915-862c-e5f6420762fd None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:47.364570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-70dc9990-9e4d-4915-862c-e5f6420762fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:47.521168 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3504/6949] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:47.724284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb248bf1-bb3c-47d3-b167-09b75065da67 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:47.726398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cb248bf1-bb3c-47d3-b167-09b75065da67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:47.946850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb248bf1-bb3c-47d3-b167-09b75065da67 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:47.965550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2bdb3-0aec-4113-ae84-4416adc110df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:47.965550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2bdb3-0aec-4113-ae84-4416adc110df service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:47.965550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2bdb3-0aec-4113-ae84-4416adc110df service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:47.965550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2bdb3-0aec-4113-ae84-4416adc110df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:48.012270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a2bdb3-0aec-4113-ae84-4416adc110df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:48.014090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a2bdb3-0aec-4113-ae84-4416adc110df service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:48.059456 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3446/6950] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:48.653661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc9990-9e4d-4915-862c-e5f6420762fd None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:48.656059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-70dc9990-9e4d-4915-862c-e5f6420762fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:48.687048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc9990-9e4d-4915-862c-e5f6420762fd None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:48.703666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a6253-b164-490e-9929-81935085ceca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:48.704362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a6253-b164-490e-9929-81935085ceca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:48.704646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a6253-b164-490e-9929-81935085ceca admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:48.704926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a6253-b164-490e-9929-81935085ceca admin admin] PATH_INFO: `/v3/projects/344ac056616e401ea468c643140ad6dd` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:48.709382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a6253-b164-490e-9929-81935085ceca admin admin] RBAC: Authorizing `identity:delete_project(project_id=344ac056616e401ea468c643140ad6dd)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:48.711361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a6253-b164-490e-9929-81935085ceca admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:48.816800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7f8a6253-b164-490e-9929-81935085ceca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '344ac056616e401ea468c643140ad6dd', 'request_id': 'req-7f8a6253-b164-490e-9929-81935085ceca'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:48.826400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7f8a6253-b164-490e-9929-81935085ceca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '344ac056616e401ea468c643140ad6dd', 'request_id': 'req-7f8a6253-b164-490e-9929-81935085ceca'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:48.836530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7f8a6253-b164-490e-9929-81935085ceca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '344ac056616e401ea468c643140ad6dd', 'request_id': 'req-7f8a6253-b164-490e-9929-81935085ceca'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:48.853998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7f8a6253-b164-490e-9929-81935085ceca admin admin] The token cache is being invalidate because project 344ac056616e401ea468c643140ad6dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:48.854780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7f8a6253-b164-490e-9929-81935085ceca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:48.855777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7f8a6253-b164-490e-9929-81935085ceca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:48.862155 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3505/6951] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:48 2022] DELETE /identity/v3/projects/344ac056616e401ea468c643140ad6dd => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:48.863831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdd187-4b0f-4007-963d-84420549eaba None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:48.864148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdd187-4b0f-4007-963d-84420549eaba None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:48.864510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdd187-4b0f-4007-963d-84420549eaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:48.918391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-5abdd187-4b0f-4007-963d-84420549eaba None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:48.919796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5abdd187-4b0f-4007-963d-84420549eaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:49.099493 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3447/6952] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:49.110166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302163ab-8820-4407-9336-4a27bf0b01d2 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:49.110478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302163ab-8820-4407-9336-4a27bf0b01d2 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:49.110756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302163ab-8820-4407-9336-4a27bf0b01d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:49.156338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-302163ab-8820-4407-9336-4a27bf0b01d2 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:49.157556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-302163ab-8820-4407-9336-4a27bf0b01d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:49.178270 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3506/6953] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:42:49.183948 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abdd187-4b0f-4007-963d-84420549eaba None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:49.200101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abdd187-4b0f-4007-963d-84420549eaba None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:49.221509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ac97c-1091-4111-b925-a73af09f7400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:49.222147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ac97c-1091-4111-b925-a73af09f7400 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:49.222420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ac97c-1091-4111-b925-a73af09f7400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:49.222688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ac97c-1091-4111-b925-a73af09f7400 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:49.223362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ac97c-1091-4111-b925-a73af09f7400 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:42:49.223656 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ac97c-1091-4111-b925-a73af09f7400 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:49.225334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ac97c-1091-4111-b925-a73af09f7400 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:49.262691 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3448/6954] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:42:49.268125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302163ab-8820-4407-9336-4a27bf0b01d2 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:49.285530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302163ab-8820-4407-9336-4a27bf0b01d2 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:49.291023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35233de-e77c-4495-90a1-db534b66c5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:49.291661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35233de-e77c-4495-90a1-db534b66c5de admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:49.291952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35233de-e77c-4495-90a1-db534b66c5de admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:49.292353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35233de-e77c-4495-90a1-db534b66c5de admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:49.292999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35233de-e77c-4495-90a1-db534b66c5de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:49.294971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35233de-e77c-4495-90a1-db534b66c5de admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:49.358531 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3507/6955] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:42:49 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:49.363373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ac97c-1091-4111-b925-a73af09f7400 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:49.374693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ac97c-1091-4111-b925-a73af09f7400 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:49.399808 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:49.476670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637d692-4a43-4fc9-91c3-11f365d10c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:49.482016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637d692-4a43-4fc9-91c3-11f365d10c4d admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:49.482533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637d692-4a43-4fc9-91c3-11f365d10c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:49.483495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637d692-4a43-4fc9-91c3-11f365d10c4d admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:49.484360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637d692-4a43-4fc9-91c3-11f365d10c4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:49.490181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637d692-4a43-4fc9-91c3-11f365d10c4d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:49.540840 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3449/6956] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:42:49 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:42:49.544574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35233de-e77c-4495-90a1-db534b66c5de admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:49.557636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35233de-e77c-4495-90a1-db534b66c5de admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:49.565111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083d910-9a9a-4f48-b785-748306c87aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:49.566846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083d910-9a9a-4f48-b785-748306c87aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:49.567289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083d910-9a9a-4f48-b785-748306c87aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:49.567669 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083d910-9a9a-4f48-b785-748306c87aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:49.570955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083d910-9a9a-4f48-b785-748306c87aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:49.573838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083d910-9a9a-4f48-b785-748306c87aa0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:49.589558 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3508/6957] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:42:49.595165 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637d692-4a43-4fc9-91c3-11f365d10c4d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:49.611119 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637d692-4a43-4fc9-91c3-11f365d10c4d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:49.624983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc1990-870b-425b-903d-d659bc948d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:49.625921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc1990-870b-425b-903d-d659bc948d7a admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:49.629283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc1990-870b-425b-903d-d659bc948d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:49.629752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc1990-870b-425b-903d-d659bc948d7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:49.630613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc1990-870b-425b-903d-d659bc948d7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:49.632485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc1990-870b-425b-903d-d659bc948d7a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:49.671449 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3450/6958] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:49.677376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083d910-9a9a-4f48-b785-748306c87aa0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:49.693262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083d910-9a9a-4f48-b785-748306c87aa0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:49.699462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778ee50-026d-4e87-87a5-ad9f6e0506a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:49.700355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778ee50-026d-4e87-87a5-ad9f6e0506a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:49.700751 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778ee50-026d-4e87-87a5-ad9f6e0506a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:49.701124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778ee50-026d-4e87-87a5-ad9f6e0506a9 admin admin] PATH_INFO: `/v3/projects/11a1f9e4b922401aa96de5155bd7be99/users/37e91addb101485c9a80de707baf44ad/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:49.723746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778ee50-026d-4e87-87a5-ad9f6e0506a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11a1f9e4b922401aa96de5155bd7be99, user_id=37e91addb101485c9a80de707baf44ad, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:49.728774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c778ee50-026d-4e87-87a5-ad9f6e0506a9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:49.754410 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3509/6959] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:49 2022] PUT /identity/v3/projects/11a1f9e4b922401aa96de5155bd7be99/users/37e91addb101485c9a80de707baf44ad/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:49.766025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd43ca2-8234-4973-9ff1-63f142fb81c5 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:49.768403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd43ca2-8234-4973-9ff1-63f142fb81c5 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:49.768988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd43ca2-8234-4973-9ff1-63f142fb81c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:49.807227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778ee50-026d-4e87-87a5-ad9f6e0506a9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:49.810395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c778ee50-026d-4e87-87a5-ad9f6e0506a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:49.881292 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:49.899115 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-5dd43ca2-8234-4973-9ff1-63f142fb81c5 None None] MFA Rules not processed for user `37e91addb101485c9a80de707baf44ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:49.905957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5dd43ca2-8234-4973-9ff1-63f142fb81c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:50.051978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778ee50-026d-4e87-87a5-ad9f6e0506a9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:50.064348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8532a4-c10f-44b1-ae8a-01267b1e9f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:50.065837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8532a4-c10f-44b1-ae8a-01267b1e9f88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:50.066819 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8532a4-c10f-44b1-ae8a-01267b1e9f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:50.067093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8532a4-c10f-44b1-ae8a-01267b1e9f88 admin admin] PATH_INFO: `/v3/users/55849d5754b843268f1230bf7560d1e6` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:50.069427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8532a4-c10f-44b1-ae8a-01267b1e9f88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55849d5754b843268f1230bf7560d1e6)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:50.074514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8532a4-c10f-44b1-ae8a-01267b1e9f88 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:50.107484 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3451/6960] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:50.120395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd43ca2-8234-4973-9ff1-63f142fb81c5 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:50.122221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5dd43ca2-8234-4973-9ff1-63f142fb81c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:50.249598 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6b8532a4-c10f-44b1-ae8a-01267b1e9f88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55849d5754b843268f1230bf7560d1e6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:50.281203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6b8532a4-c10f-44b1-ae8a-01267b1e9f88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55849d5754b843268f1230bf7560d1e6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:50.318864 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6b8532a4-c10f-44b1-ae8a-01267b1e9f88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55849d5754b843268f1230bf7560d1e6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:50.322340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6b8532a4-c10f-44b1-ae8a-01267b1e9f88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55849d5754b843268f1230bf7560d1e6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:50.366762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6b8532a4-c10f-44b1-ae8a-01267b1e9f88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55849d5754b843268f1230bf7560d1e6'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:50.382247 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd43ca2-8234-4973-9ff1-63f142fb81c5 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:50.390705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cb027-0e2d-4fa2-81bd-5f108bc4086f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:50.392064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cb027-0e2d-4fa2-81bd-5f108bc4086f service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:50.392343 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cb027-0e2d-4fa2-81bd-5f108bc4086f service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:50.392617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cb027-0e2d-4fa2-81bd-5f108bc4086f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:50.394684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-676cb027-0e2d-4fa2-81bd-5f108bc4086f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:50.405780 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3510/6961] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:42:49 2022] DELETE /identity/v3/users/55849d5754b843268f1230bf7560d1e6 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:42:50.407028 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8532a4-c10f-44b1-ae8a-01267b1e9f88 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:50.414782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6b8532a4-c10f-44b1-ae8a-01267b1e9f88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:50.416324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676cb027-0e2d-4fa2-81bd-5f108bc4086f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:50.419143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676cb027-0e2d-4fa2-81bd-5f108bc4086f service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:50.439143 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3452/6962] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:50.463410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cb027-0e2d-4fa2-81bd-5f108bc4086f service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:50.468449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-676cb027-0e2d-4fa2-81bd-5f108bc4086f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:50.522441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cb027-0e2d-4fa2-81bd-5f108bc4086f service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:50.571100 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:50.682868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebf54e-ecb2-45a2-9748-036cc650372f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:50.684026 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebf54e-ecb2-45a2-9748-036cc650372f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:50.684744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebf54e-ecb2-45a2-9748-036cc650372f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:50.685244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebf54e-ecb2-45a2-9748-036cc650372f admin admin] PATH_INFO: `/v3/projects/cdaf2b486cfb41628de75dbd8cb92d2e` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:50.686746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebf54e-ecb2-45a2-9748-036cc650372f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdaf2b486cfb41628de75dbd8cb92d2e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:50.688942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebf54e-ecb2-45a2-9748-036cc650372f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:50.707612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8532a4-c10f-44b1-ae8a-01267b1e9f88 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:50.725020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3ff4c-2f40-48fd-8845-62663b2e6da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:50.726318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3ff4c-2f40-48fd-8845-62663b2e6da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:50.726606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3ff4c-2f40-48fd-8845-62663b2e6da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:50.726885 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3ff4c-2f40-48fd-8845-62663b2e6da4 admin admin] PATH_INFO: `/v3/projects/48b1dc9806ee48e799b8a4ba8eb778ca` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:50.734026 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3ff4c-2f40-48fd-8845-62663b2e6da4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48b1dc9806ee48e799b8a4ba8eb778ca)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:50.741182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3ff4c-2f40-48fd-8845-62663b2e6da4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:50.781071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-adebf54e-ecb2-45a2-9748-036cc650372f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdaf2b486cfb41628de75dbd8cb92d2e', 'request_id': 'req-adebf54e-ecb2-45a2-9748-036cc650372f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:50.805246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-adebf54e-ecb2-45a2-9748-036cc650372f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdaf2b486cfb41628de75dbd8cb92d2e', 'request_id': 'req-adebf54e-ecb2-45a2-9748-036cc650372f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:50.829023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-adebf54e-ecb2-45a2-9748-036cc650372f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdaf2b486cfb41628de75dbd8cb92d2e', 'request_id': 'req-adebf54e-ecb2-45a2-9748-036cc650372f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:50.901406 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:50.908935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-adebf54e-ecb2-45a2-9748-036cc650372f admin admin] The token cache is being invalidate because project cdaf2b486cfb41628de75dbd8cb92d2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:50.909290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-adebf54e-ecb2-45a2-9748-036cc650372f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:50.914136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-adebf54e-ecb2-45a2-9748-036cc650372f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:50.918031 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3453/6963] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:50 2022] DELETE /identity/v3/projects/cdaf2b486cfb41628de75dbd8cb92d2e => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:50.918492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebf54e-ecb2-45a2-9748-036cc650372f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:50.931430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-adebf54e-ecb2-45a2-9748-036cc650372f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:50.939691 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ddf3ff4c-2f40-48fd-8845-62663b2e6da4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48b1dc9806ee48e799b8a4ba8eb778ca', 'request_id': 'req-ddf3ff4c-2f40-48fd-8845-62663b2e6da4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:50.960597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ddf3ff4c-2f40-48fd-8845-62663b2e6da4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48b1dc9806ee48e799b8a4ba8eb778ca', 'request_id': 'req-ddf3ff4c-2f40-48fd-8845-62663b2e6da4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:50.994032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ddf3ff4c-2f40-48fd-8845-62663b2e6da4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48b1dc9806ee48e799b8a4ba8eb778ca', 'request_id': 'req-ddf3ff4c-2f40-48fd-8845-62663b2e6da4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:51.033464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ddf3ff4c-2f40-48fd-8845-62663b2e6da4 admin admin] The token cache is being invalidate because project 48b1dc9806ee48e799b8a4ba8eb778ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:51.035554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ddf3ff4c-2f40-48fd-8845-62663b2e6da4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:51.038924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ddf3ff4c-2f40-48fd-8845-62663b2e6da4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:51.041523 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3511/6964] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:50 2022] DELETE /identity/v3/projects/48b1dc9806ee48e799b8a4ba8eb778ca => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:51.053133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69096a9-1a51-4d5a-b089-1f3efbdc0e4b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:51.053815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69096a9-1a51-4d5a-b089-1f3efbdc0e4b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:51.054312 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69096a9-1a51-4d5a-b089-1f3efbdc0e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:51.102266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebf54e-ecb2-45a2-9748-036cc650372f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:51.158003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f69096a9-1a51-4d5a-b089-1f3efbdc0e4b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:51.160636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f69096a9-1a51-4d5a-b089-1f3efbdc0e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:51.190795 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:51.224330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed516bc-daa4-4d93-8287-14e32f1bce3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:51.224981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed516bc-daa4-4d93-8287-14e32f1bce3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:51.225258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed516bc-daa4-4d93-8287-14e32f1bce3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:51.225529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed516bc-daa4-4d93-8287-14e32f1bce3d admin admin] PATH_INFO: `/v3/users/07975cb480d2431bbe94a8ebfc88d792` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:51.226734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed516bc-daa4-4d93-8287-14e32f1bce3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=07975cb480d2431bbe94a8ebfc88d792)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:51.228809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed516bc-daa4-4d93-8287-14e32f1bce3d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:51.298378 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3512/6965] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:51.299341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69096a9-1a51-4d5a-b089-1f3efbdc0e4b None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:51.302846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f69096a9-1a51-4d5a-b089-1f3efbdc0e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:51.311957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2ed516bc-daa4-4d93-8287-14e32f1bce3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07975cb480d2431bbe94a8ebfc88d792'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:51.329759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2ed516bc-daa4-4d93-8287-14e32f1bce3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07975cb480d2431bbe94a8ebfc88d792'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:51.343703 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69096a9-1a51-4d5a-b089-1f3efbdc0e4b None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:51.349410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2ed516bc-daa4-4d93-8287-14e32f1bce3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07975cb480d2431bbe94a8ebfc88d792'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:51.350806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2ed516bc-daa4-4d93-8287-14e32f1bce3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07975cb480d2431bbe94a8ebfc88d792'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:51.351010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a4a16-f0d2-4f3e-9c69-0943e727431e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:51.351568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a4a16-f0d2-4f3e-9c69-0943e727431e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:51.351847 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a4a16-f0d2-4f3e-9c69-0943e727431e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:51.352146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a4a16-f0d2-4f3e-9c69-0943e727431e admin admin] PATH_INFO: `/v3/users/238debe9bbba49148cc31c5ce1b8139e` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:51.353653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a4a16-f0d2-4f3e-9c69-0943e727431e admin admin] RBAC: Authorizing `identity:delete_user(user_id=238debe9bbba49148cc31c5ce1b8139e)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:51.355843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a4a16-f0d2-4f3e-9c69-0943e727431e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:51.371856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2ed516bc-daa4-4d93-8287-14e32f1bce3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07975cb480d2431bbe94a8ebfc88d792'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:51.391048 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3454/6966] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:42:50 2022] DELETE /identity/v3/users/07975cb480d2431bbe94a8ebfc88d792 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:51.393623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022a8bf-99d1-4156-8a8b-e64d0c30f205 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:51.395677 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022a8bf-99d1-4156-8a8b-e64d0c30f205 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:51.396171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022a8bf-99d1-4156-8a8b-e64d0c30f205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:51.449924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3022a8bf-99d1-4156-8a8b-e64d0c30f205 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:51.453342 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3022a8bf-99d1-4156-8a8b-e64d0c30f205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:51.457631 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f51a4a16-f0d2-4f3e-9c69-0943e727431e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '238debe9bbba49148cc31c5ce1b8139e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:51.476504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f51a4a16-f0d2-4f3e-9c69-0943e727431e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '238debe9bbba49148cc31c5ce1b8139e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:51.511469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f51a4a16-f0d2-4f3e-9c69-0943e727431e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '238debe9bbba49148cc31c5ce1b8139e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:51.513729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f51a4a16-f0d2-4f3e-9c69-0943e727431e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '238debe9bbba49148cc31c5ce1b8139e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:51.539697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f51a4a16-f0d2-4f3e-9c69-0943e727431e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '238debe9bbba49148cc31c5ce1b8139e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:51.556209 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3513/6967] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:42:51 2022] DELETE /identity/v3/users/238debe9bbba49148cc31c5ce1b8139e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:51.558090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a4a16-f0d2-4f3e-9c69-0943e727431e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:51.564659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f51a4a16-f0d2-4f3e-9c69-0943e727431e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:51.635829 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3455/6968] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:51.637605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a8b23-e2bd-4edb-a743-78b693e61a2c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:51.638135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a8b23-e2bd-4edb-a743-78b693e61a2c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:51.638761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a8b23-e2bd-4edb-a743-78b693e61a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:51.660320 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:51.711770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-386a8b23-e2bd-4edb-a743-78b693e61a2c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:51.718483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-386a8b23-e2bd-4edb-a743-78b693e61a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:51.721982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a4a16-f0d2-4f3e-9c69-0943e727431e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:51.730411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1ff5d-4f1a-4df0-b8ae-c4b89b338238 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:51.732165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1ff5d-4f1a-4df0-b8ae-c4b89b338238 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:51.733013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1ff5d-4f1a-4df0-b8ae-c4b89b338238 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:51.734679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1ff5d-4f1a-4df0-b8ae-c4b89b338238 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:51.741204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-27a1ff5d-4f1a-4df0-b8ae-c4b89b338238 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:51.902454 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3456/6969] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:51.906780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267eb71f-5636-47f8-964e-a0b64dbf94f8 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:51.907560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267eb71f-5636-47f8-964e-a0b64dbf94f8 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:51.907703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267eb71f-5636-47f8-964e-a0b64dbf94f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:51.944630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1ff5d-4f1a-4df0-b8ae-c4b89b338238 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:51.946870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a1ff5d-4f1a-4df0-b8ae-c4b89b338238 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:51.957045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-267eb71f-5636-47f8-964e-a0b64dbf94f8 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:51.958262 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-267eb71f-5636-47f8-964e-a0b64dbf94f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:51.966388 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3514/6970] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:51.969880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1ff5d-4f1a-4df0-b8ae-c4b89b338238 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:51.982327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-27a1ff5d-4f1a-4df0-b8ae-c4b89b338238 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:51.987247 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3457/6971] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:51.991404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267eb71f-5636-47f8-964e-a0b64dbf94f8 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:52.009912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267eb71f-5636-47f8-964e-a0b64dbf94f8 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:52.017265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1ff5d-4f1a-4df0-b8ae-c4b89b338238 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:52.028610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927462b-07ed-4adf-8b0c-f47d2982ae94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:52.030470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927462b-07ed-4adf-8b0c-f47d2982ae94 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:52.031049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927462b-07ed-4adf-8b0c-f47d2982ae94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:52.031478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231c816-5ad4-48cb-96f5-4935069b5a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:52.031831 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927462b-07ed-4adf-8b0c-f47d2982ae94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:52.032121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231c816-5ad4-48cb-96f5-4935069b5a84 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:52.032395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231c816-5ad4-48cb-96f5-4935069b5a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:52.032659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231c816-5ad4-48cb-96f5-4935069b5a84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:52.033316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231c816-5ad4-48cb-96f5-4935069b5a84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:42:52.033609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231c816-5ad4-48cb-96f5-4935069b5a84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:52.037470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231c816-5ad4-48cb-96f5-4935069b5a84 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:52.047351 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:52.058652 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927462b-07ed-4adf-8b0c-f47d2982ae94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:52.061467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927462b-07ed-4adf-8b0c-f47d2982ae94 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:52.077407 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3458/6972] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:42:52.084391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231c816-5ad4-48cb-96f5-4935069b5a84 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:52.086581 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3515/6973] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:52.108437 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231c816-5ad4-48cb-96f5-4935069b5a84 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:52.121143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0e8d5-445d-4c97-a0e2-5f1bd106aebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:52.121769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0e8d5-445d-4c97-a0e2-5f1bd106aebb admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:52.122043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0e8d5-445d-4c97-a0e2-5f1bd106aebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:52.122310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0e8d5-445d-4c97-a0e2-5f1bd106aebb admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:52.123013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c0e8d5-445d-4c97-a0e2-5f1bd106aebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:52.125082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c0e8d5-445d-4c97-a0e2-5f1bd106aebb admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:52.193705 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3459/6974] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:42:52 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:52.195136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927462b-07ed-4adf-8b0c-f47d2982ae94 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:52.212757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927462b-07ed-4adf-8b0c-f47d2982ae94 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:52.427101 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085a906-3933-4576-b714-f23797a668a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:52.427738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085a906-3933-4576-b714-f23797a668a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:52.428042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085a906-3933-4576-b714-f23797a668a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:52.428312 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085a906-3933-4576-b714-f23797a668a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:52.429010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085a906-3933-4576-b714-f23797a668a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:52.438611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085a906-3933-4576-b714-f23797a668a2 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:52.480249 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3516/6975] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:42:52 2022] POST /identity/v3/users => generated 288 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:52.482639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0e8d5-445d-4c97-a0e2-5f1bd106aebb admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:52.503771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0e8d5-445d-4c97-a0e2-5f1bd106aebb admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:52.523107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4525e-8408-4a9e-b78e-077bc146efb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:52.523752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4525e-8408-4a9e-b78e-077bc146efb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:52.530822 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4525e-8408-4a9e-b78e-077bc146efb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:52.531205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4525e-8408-4a9e-b78e-077bc146efb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:52.532033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4525e-8408-4a9e-b78e-077bc146efb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:52.533712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4525e-8408-4a9e-b78e-077bc146efb1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:52.575160 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085a906-3933-4576-b714-f23797a668a2 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:52.580332 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3460/6976] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:52.592001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085a906-3933-4576-b714-f23797a668a2 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:52.611773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29fdd1-d203-402c-8a55-b4d14cc8a94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:52.611773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29fdd1-d203-402c-8a55-b4d14cc8a94c admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:52.611773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29fdd1-d203-402c-8a55-b4d14cc8a94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:52.611773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29fdd1-d203-402c-8a55-b4d14cc8a94c admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:52.612222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29fdd1-d203-402c-8a55-b4d14cc8a94c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:52.613987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af29fdd1-d203-402c-8a55-b4d14cc8a94c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:52.644054 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3517/6977] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:42:52.648014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4525e-8408-4a9e-b78e-077bc146efb1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:52.663594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4525e-8408-4a9e-b78e-077bc146efb1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:52.692534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa307c-732c-4858-81ba-1bc0284228ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:52.693649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa307c-732c-4858-81ba-1bc0284228ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:52.695491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa307c-732c-4858-81ba-1bc0284228ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:52.696837 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa307c-732c-4858-81ba-1bc0284228ff admin admin] PATH_INFO: `/v3/projects/81af5a598d11458c8fd8b2fa170799ab/users/abf09f11a55e4d349631e42266edd0e1/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:52.735005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa307c-732c-4858-81ba-1bc0284228ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=81af5a598d11458c8fd8b2fa170799ab, user_id=abf09f11a55e4d349631e42266edd0e1, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:52.740524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa307c-732c-4858-81ba-1bc0284228ff admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:52.765777 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3461/6978] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:52 2022] PUT /identity/v3/projects/81af5a598d11458c8fd8b2fa170799ab/users/abf09f11a55e4d349631e42266edd0e1/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:52.906380 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b356d-3e3b-4087-9769-832ad6647a2e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:52.907012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b356d-3e3b-4087-9769-832ad6647a2e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:52.907343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b356d-3e3b-4087-9769-832ad6647a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:52.932311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa307c-732c-4858-81ba-1bc0284228ff admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:52.934702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-12fa307c-732c-4858-81ba-1bc0284228ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:52.970830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ed9b356d-3e3b-4087-9769-832ad6647a2e None None] MFA Rules not processed for user `abf09f11a55e4d349631e42266edd0e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:52.972092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ed9b356d-3e3b-4087-9769-832ad6647a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:53.082133 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:53.089353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa307c-732c-4858-81ba-1bc0284228ff admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:53.119872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2f8c4-9465-4834-a912-e577e19a591e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:53.119872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2f8c4-9465-4834-a912-e577e19a591e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:53.119872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2f8c4-9465-4834-a912-e577e19a591e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:53.119872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2f8c4-9465-4834-a912-e577e19a591e admin admin] PATH_INFO: `/v3/projects/0dbffb3dde854d7d85ddfc3649de8744` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:53.125768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2f8c4-9465-4834-a912-e577e19a591e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dbffb3dde854d7d85ddfc3649de8744)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:53.125768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2f8c4-9465-4834-a912-e577e19a591e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:53.173939 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3518/6979] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:53.175731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b356d-3e3b-4087-9769-832ad6647a2e None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:53.190717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ed9b356d-3e3b-4087-9769-832ad6647a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:53.236600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b356d-3e3b-4087-9769-832ad6647a2e None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:53.249826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d7d2f8c4-9465-4834-a912-e577e19a591e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dbffb3dde854d7d85ddfc3649de8744', 'request_id': 'req-d7d2f8c4-9465-4834-a912-e577e19a591e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:53.262857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d7d2f8c4-9465-4834-a912-e577e19a591e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dbffb3dde854d7d85ddfc3649de8744', 'request_id': 'req-d7d2f8c4-9465-4834-a912-e577e19a591e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:53.276521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d7d2f8c4-9465-4834-a912-e577e19a591e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dbffb3dde854d7d85ddfc3649de8744', 'request_id': 'req-d7d2f8c4-9465-4834-a912-e577e19a591e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:53.299592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d7d2f8c4-9465-4834-a912-e577e19a591e admin admin] The token cache is being invalidate because project 0dbffb3dde854d7d85ddfc3649de8744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:53.300255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d7d2f8c4-9465-4834-a912-e577e19a591e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:53.300896 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d7d2f8c4-9465-4834-a912-e577e19a591e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:53.302740 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3462/6980] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:52 2022] DELETE /identity/v3/projects/0dbffb3dde854d7d85ddfc3649de8744 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:53.303863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2f8c4-9465-4834-a912-e577e19a591e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:53.307365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d7d2f8c4-9465-4834-a912-e577e19a591e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:53.358422 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:53.362015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8472b0-485a-4fa6-9cff-4ec26ad79eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:53.363003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8472b0-485a-4fa6-9cff-4ec26ad79eb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:53.363283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8472b0-485a-4fa6-9cff-4ec26ad79eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:53.363522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8472b0-485a-4fa6-9cff-4ec26ad79eb0 admin admin] PATH_INFO: `/v3/projects/e76dd5169f174474968731329fedd524` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:53.365964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8472b0-485a-4fa6-9cff-4ec26ad79eb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e76dd5169f174474968731329fedd524)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:53.370269 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8472b0-485a-4fa6-9cff-4ec26ad79eb0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:53.409708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2f8c4-9465-4834-a912-e577e19a591e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:53.414905 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98676fa9-439a-43ca-aa43-e691d5acd4c3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:53.415573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98676fa9-439a-43ca-aa43-e691d5acd4c3 service glance] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:53.416021 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98676fa9-439a-43ca-aa43-e691d5acd4c3 service glance] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:53.416276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98676fa9-439a-43ca-aa43-e691d5acd4c3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:53.418339 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-98676fa9-439a-43ca-aa43-e691d5acd4c3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:53.493734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dd8472b0-485a-4fa6-9cff-4ec26ad79eb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e76dd5169f174474968731329fedd524', 'request_id': 'req-dd8472b0-485a-4fa6-9cff-4ec26ad79eb0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:53.498918 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98676fa9-439a-43ca-aa43-e691d5acd4c3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:53.500571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98676fa9-439a-43ca-aa43-e691d5acd4c3 service glance] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:53.502041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dd8472b0-485a-4fa6-9cff-4ec26ad79eb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e76dd5169f174474968731329fedd524', 'request_id': 'req-dd8472b0-485a-4fa6-9cff-4ec26ad79eb0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:53.510712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dd8472b0-485a-4fa6-9cff-4ec26ad79eb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e76dd5169f174474968731329fedd524', 'request_id': 'req-dd8472b0-485a-4fa6-9cff-4ec26ad79eb0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:53.512656 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3463/6981] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:53.514856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801e9d9-efb9-4e67-ad31-b8103f0cc86c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:53.515144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801e9d9-efb9-4e67-ad31-b8103f0cc86c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:53.515415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801e9d9-efb9-4e67-ad31-b8103f0cc86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:53.529662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dd8472b0-485a-4fa6-9cff-4ec26ad79eb0 admin admin] The token cache is being invalidate because project e76dd5169f174474968731329fedd524 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:53.529999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dd8472b0-485a-4fa6-9cff-4ec26ad79eb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:53.530992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dd8472b0-485a-4fa6-9cff-4ec26ad79eb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:53.534131 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3519/6982] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:53 2022] DELETE /identity/v3/projects/e76dd5169f174474968731329fedd524 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:53.538202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8472b0-485a-4fa6-9cff-4ec26ad79eb0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:53.540148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dd8472b0-485a-4fa6-9cff-4ec26ad79eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:53.554506 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-5801e9d9-efb9-4e67-ad31-b8103f0cc86c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:53.555750 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5801e9d9-efb9-4e67-ad31-b8103f0cc86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:53.661423 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3464/6983] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:53.663477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801e9d9-efb9-4e67-ad31-b8103f0cc86c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:53.669927 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5801e9d9-efb9-4e67-ad31-b8103f0cc86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:53.692796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8472b0-485a-4fa6-9cff-4ec26ad79eb0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:53.699514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801e9d9-efb9-4e67-ad31-b8103f0cc86c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:53.705062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93aab9-860f-4760-b8f0-2276fef05334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:53.705869 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93aab9-860f-4760-b8f0-2276fef05334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:53.706148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93aab9-860f-4760-b8f0-2276fef05334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:53.706416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93aab9-860f-4760-b8f0-2276fef05334 admin admin] PATH_INFO: `/v3/projects/1f679c42ae044bd995302f19759362d3` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:53.710461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b54750-b89d-4863-bb04-222f9fcc3972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:53.710948 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93aab9-860f-4760-b8f0-2276fef05334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f679c42ae044bd995302f19759362d3)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:53.712973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93aab9-860f-4760-b8f0-2276fef05334 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:53.713366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b54750-b89d-4863-bb04-222f9fcc3972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:53.713650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b54750-b89d-4863-bb04-222f9fcc3972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:53.713915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b54750-b89d-4863-bb04-222f9fcc3972 admin admin] PATH_INFO: `/v3/users/2439eb84c3d547fb9d7959fe174ccdb5` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:53.715134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b54750-b89d-4863-bb04-222f9fcc3972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2439eb84c3d547fb9d7959fe174ccdb5)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:53.720021 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b54750-b89d-4863-bb04-222f9fcc3972 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:53.751562 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:53.843451 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b3b54750-b89d-4863-bb04-222f9fcc3972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2439eb84c3d547fb9d7959fe174ccdb5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:53.854377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0c93aab9-860f-4760-b8f0-2276fef05334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f679c42ae044bd995302f19759362d3', 'request_id': 'req-0c93aab9-860f-4760-b8f0-2276fef05334'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:53.864641 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b3b54750-b89d-4863-bb04-222f9fcc3972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2439eb84c3d547fb9d7959fe174ccdb5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:53.870512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0c93aab9-860f-4760-b8f0-2276fef05334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f679c42ae044bd995302f19759362d3', 'request_id': 'req-0c93aab9-860f-4760-b8f0-2276fef05334'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:53.889827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0c93aab9-860f-4760-b8f0-2276fef05334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f679c42ae044bd995302f19759362d3', 'request_id': 'req-0c93aab9-860f-4760-b8f0-2276fef05334'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:53.897348 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b3b54750-b89d-4863-bb04-222f9fcc3972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2439eb84c3d547fb9d7959fe174ccdb5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:53.898549 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b3b54750-b89d-4863-bb04-222f9fcc3972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2439eb84c3d547fb9d7959fe174ccdb5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:53.907097 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:53.918502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b3b54750-b89d-4863-bb04-222f9fcc3972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2439eb84c3d547fb9d7959fe174ccdb5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:53.933498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0c93aab9-860f-4760-b8f0-2276fef05334 admin admin] The token cache is being invalidate because project 1f679c42ae044bd995302f19759362d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:53.934067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0c93aab9-860f-4760-b8f0-2276fef05334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:53.934839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0c93aab9-860f-4760-b8f0-2276fef05334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:53.936067 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3465/6984] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:42:53 2022] DELETE /identity/v3/users/2439eb84c3d547fb9d7959fe174ccdb5 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:53.937865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd6925-7e72-467c-93f6-62c534385f8b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:53.944926 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3520/6985] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:53 2022] DELETE /identity/v3/projects/1f679c42ae044bd995302f19759362d3 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:53.945428 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd6925-7e72-467c-93f6-62c534385f8b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:53.945519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd6925-7e72-467c-93f6-62c534385f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:53.947141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93aab9-860f-4760-b8f0-2276fef05334 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:53.949775 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0c93aab9-860f-4760-b8f0-2276fef05334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:54.000507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-eddd6925-7e72-467c-93f6-62c534385f8b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:54.001839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-eddd6925-7e72-467c-93f6-62c534385f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:54.090820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93aab9-860f-4760-b8f0-2276fef05334 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:54.152109 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3466/6986] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:54.167351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd6925-7e72-467c-93f6-62c534385f8b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:54.181121 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ca552-cb5d-4267-9f34-db944b0d4ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:54.181786 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ca552-cb5d-4267-9f34-db944b0d4ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:54.182071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ca552-cb5d-4267-9f34-db944b0d4ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:54.182364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ca552-cb5d-4267-9f34-db944b0d4ce1 admin admin] PATH_INFO: `/v3/users/9644da44cce34b4cae9db4074dfd8ca0` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:54.183839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ca552-cb5d-4267-9f34-db944b0d4ce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9644da44cce34b4cae9db4074dfd8ca0)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:54.187550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ca552-cb5d-4267-9f34-db944b0d4ce1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:54.198599 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd6925-7e72-467c-93f6-62c534385f8b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:54.212660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae8cdf-edc2-4653-b732-f89ddf900316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:54.213834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae8cdf-edc2-4653-b732-f89ddf900316 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:54.214372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae8cdf-edc2-4653-b732-f89ddf900316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:54.214861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae8cdf-edc2-4653-b732-f89ddf900316 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:54.215764 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae8cdf-edc2-4653-b732-f89ddf900316 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:42:54.216329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae8cdf-edc2-4653-b732-f89ddf900316 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:54.220595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae8cdf-edc2-4653-b732-f89ddf900316 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:54.260354 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3467/6987] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:42:54.262026 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae8cdf-edc2-4653-b732-f89ddf900316 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:54.264368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-698ca552-cb5d-4267-9f34-db944b0d4ce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9644da44cce34b4cae9db4074dfd8ca0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:54.266863 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:54.284013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-698ca552-cb5d-4267-9f34-db944b0d4ce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9644da44cce34b4cae9db4074dfd8ca0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:54.285345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae8cdf-edc2-4653-b732-f89ddf900316 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:54.291219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda518d-8129-43ea-9f1c-6a956284c84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:54.292067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda518d-8129-43ea-9f1c-6a956284c84b admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:54.292542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda518d-8129-43ea-9f1c-6a956284c84b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:54.292817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda518d-8129-43ea-9f1c-6a956284c84b admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:54.293569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda518d-8129-43ea-9f1c-6a956284c84b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:54.295878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda518d-8129-43ea-9f1c-6a956284c84b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:54.303193 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-698ca552-cb5d-4267-9f34-db944b0d4ce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9644da44cce34b4cae9db4074dfd8ca0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:54.304673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-698ca552-cb5d-4267-9f34-db944b0d4ce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9644da44cce34b4cae9db4074dfd8ca0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:54.321594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-698ca552-cb5d-4267-9f34-db944b0d4ce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9644da44cce34b4cae9db4074dfd8ca0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:54.337341 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3521/6988] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:42:53 2022] DELETE /identity/v3/users/9644da44cce34b4cae9db4074dfd8ca0 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:54.343099 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3468/6989] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:42:54 2022] POST /identity/v3/projects => generated 393 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:54.348190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ca552-cb5d-4267-9f34-db944b0d4ce1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:54.352267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-698ca552-cb5d-4267-9f34-db944b0d4ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:54.466244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ca552-cb5d-4267-9f34-db944b0d4ce1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:54.636807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bbace-b826-44e9-a7e6-69acec2034cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:54.641537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bbace-b826-44e9-a7e6-69acec2034cc admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:54.642077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bbace-b826-44e9-a7e6-69acec2034cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:54.642602 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bbace-b826-44e9-a7e6-69acec2034cc admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:54.645805 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185bbace-b826-44e9-a7e6-69acec2034cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:54.649941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185bbace-b826-44e9-a7e6-69acec2034cc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:54.703535 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3522/6990] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:42:54 2022] POST /identity/v3/users => generated 297 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:54.708319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda518d-8129-43ea-9f1c-6a956284c84b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:54.724333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda518d-8129-43ea-9f1c-6a956284c84b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:54.742758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16362ff-70cf-4aa5-9f01-0121ac3a3f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:54.743436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16362ff-70cf-4aa5-9f01-0121ac3a3f67 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:54.743709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16362ff-70cf-4aa5-9f01-0121ac3a3f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:54.746142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16362ff-70cf-4aa5-9f01-0121ac3a3f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:54.746850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16362ff-70cf-4aa5-9f01-0121ac3a3f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:54.750789 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16362ff-70cf-4aa5-9f01-0121ac3a3f67 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:54.776161 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3469/6991] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:54.778941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bbace-b826-44e9-a7e6-69acec2034cc admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:54.796756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bbace-b826-44e9-a7e6-69acec2034cc admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:54.805378 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481a02f-52ae-4bb6-9754-eb9231fea181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:54.818637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481a02f-52ae-4bb6-9754-eb9231fea181 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:54.819005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481a02f-52ae-4bb6-9754-eb9231fea181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:54.821646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481a02f-52ae-4bb6-9754-eb9231fea181 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:54.822564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481a02f-52ae-4bb6-9754-eb9231fea181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:54.825192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481a02f-52ae-4bb6-9754-eb9231fea181 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:54.857046 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3523/6992] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:54.861271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16362ff-70cf-4aa5-9f01-0121ac3a3f67 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:54.880059 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16362ff-70cf-4aa5-9f01-0121ac3a3f67 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:54.892737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2440c-dc30-4924-a843-b6d8207364a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:54.893423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2440c-dc30-4924-a843-b6d8207364a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:54.893703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2440c-dc30-4924-a843-b6d8207364a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:54.894153 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2440c-dc30-4924-a843-b6d8207364a2 admin admin] PATH_INFO: `/v3/projects/2fbf3163292141a4abd872c2164eb172/users/0285118c54824726a6a581fc56684371/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:54.927939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2440c-dc30-4924-a843-b6d8207364a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fbf3163292141a4abd872c2164eb172, user_id=0285118c54824726a6a581fc56684371, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:54.931995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2440c-dc30-4924-a843-b6d8207364a2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:54.967971 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3470/6993] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:54 2022] PUT /identity/v3/projects/2fbf3163292141a4abd872c2164eb172/users/0285118c54824726a6a581fc56684371/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:54.984743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a153d-c1c5-4944-847d-9984d9e709b0 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:54.985857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a153d-c1c5-4944-847d-9984d9e709b0 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:54.986923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a153d-c1c5-4944-847d-9984d9e709b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:55.024198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-674a153d-c1c5-4944-847d-9984d9e709b0 None None] MFA Rules not processed for user `0285118c54824726a6a581fc56684371`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:55.026260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-674a153d-c1c5-4944-847d-9984d9e709b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:55.077582 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:55.111935 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3524/6994] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:55.117227 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2440c-dc30-4924-a843-b6d8207364a2 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:55.242327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2440c-dc30-4924-a843-b6d8207364a2 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:55.253536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5849f5-de79-494e-a3a3-afbc8c9c0261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:55.254206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5849f5-de79-494e-a3a3-afbc8c9c0261 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:55.254638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5849f5-de79-494e-a3a3-afbc8c9c0261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:55.255057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5849f5-de79-494e-a3a3-afbc8c9c0261 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:55.255775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5849f5-de79-494e-a3a3-afbc8c9c0261 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:55.270497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5849f5-de79-494e-a3a3-afbc8c9c0261 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:55.314275 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3471/6995] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:42:55 2022] POST /identity/v3/projects => generated 393 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:55.318515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a153d-c1c5-4944-847d-9984d9e709b0 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:55.335191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a153d-c1c5-4944-847d-9984d9e709b0 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:55.461774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5849f5-de79-494e-a3a3-afbc8c9c0261 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:55.464382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6a5849f5-de79-494e-a3a3-afbc8c9c0261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:55.471038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049c162-22d5-45d1-9718-44fcb759df11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:55.472694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049c162-22d5-45d1-9718-44fcb759df11 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:55.473343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049c162-22d5-45d1-9718-44fcb759df11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:55.473861 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049c162-22d5-45d1-9718-44fcb759df11 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:55.475023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049c162-22d5-45d1-9718-44fcb759df11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:55.479127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049c162-22d5-45d1-9718-44fcb759df11 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:55.498759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5849f5-de79-494e-a3a3-afbc8c9c0261 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:55.506290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e048af-0bea-4565-b6a9-7d95b4ce2521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:55.508617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e048af-0bea-4565-b6a9-7d95b4ce2521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:55.509182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e048af-0bea-4565-b6a9-7d95b4ce2521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:55.510673 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e048af-0bea-4565-b6a9-7d95b4ce2521 admin admin] PATH_INFO: `/v3/projects/aff7c011bdaa4c519c0344daec7a8a34` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:55.513088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e048af-0bea-4565-b6a9-7d95b4ce2521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aff7c011bdaa4c519c0344daec7a8a34)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:55.521448 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e048af-0bea-4565-b6a9-7d95b4ce2521 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:55.525730 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:55.530820 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3525/6996] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:42:55 2022] POST /identity/v3/users => generated 303 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:55.534592 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049c162-22d5-45d1-9718-44fcb759df11 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:55.555263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049c162-22d5-45d1-9718-44fcb759df11 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:55.566345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa009fdb-c5c3-4ee5-b2cc-6e4247cfe5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:55.568228 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa009fdb-c5c3-4ee5-b2cc-6e4247cfe5a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:55.568510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa009fdb-c5c3-4ee5-b2cc-6e4247cfe5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:55.571177 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa009fdb-c5c3-4ee5-b2cc-6e4247cfe5a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:55.571669 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa009fdb-c5c3-4ee5-b2cc-6e4247cfe5a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:55.575958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa009fdb-c5c3-4ee5-b2cc-6e4247cfe5a3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:55.599054 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3526/6997] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:55.600502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa009fdb-c5c3-4ee5-b2cc-6e4247cfe5a3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:55.625295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa009fdb-c5c3-4ee5-b2cc-6e4247cfe5a3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:55.646359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fada9a-438a-4596-b1b4-a74b643c59a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:55.647048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fada9a-438a-4596-b1b4-a74b643c59a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:55.647396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fada9a-438a-4596-b1b4-a74b643c59a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:55.647577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fada9a-438a-4596-b1b4-a74b643c59a4 admin admin] PATH_INFO: `/v3/projects/94fb04fbf396497594534215101b856b/users/13147f2e3dff4b6bbec260d9c9e5bd24/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:55.703095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fada9a-438a-4596-b1b4-a74b643c59a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94fb04fbf396497594534215101b856b, user_id=13147f2e3dff4b6bbec260d9c9e5bd24, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:55.709608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b8e048af-0bea-4565-b6a9-7d95b4ce2521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aff7c011bdaa4c519c0344daec7a8a34', 'request_id': 'req-b8e048af-0bea-4565-b6a9-7d95b4ce2521'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:55.713498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fada9a-438a-4596-b1b4-a74b643c59a4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:55.725612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b8e048af-0bea-4565-b6a9-7d95b4ce2521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aff7c011bdaa4c519c0344daec7a8a34', 'request_id': 'req-b8e048af-0bea-4565-b6a9-7d95b4ce2521'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:55.756304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b8e048af-0bea-4565-b6a9-7d95b4ce2521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aff7c011bdaa4c519c0344daec7a8a34', 'request_id': 'req-b8e048af-0bea-4565-b6a9-7d95b4ce2521'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:55.761815 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3527/6998] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:55 2022] PUT /identity/v3/projects/94fb04fbf396497594534215101b856b/users/13147f2e3dff4b6bbec260d9c9e5bd24/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:55.767432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fada9a-438a-4596-b1b4-a74b643c59a4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:55.794297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b8e048af-0bea-4565-b6a9-7d95b4ce2521 admin admin] The token cache is being invalidate because project aff7c011bdaa4c519c0344daec7a8a34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:55.794589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b8e048af-0bea-4565-b6a9-7d95b4ce2521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:55.796446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b8e048af-0bea-4565-b6a9-7d95b4ce2521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:55.799259 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3472/6999] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:55 2022] DELETE /identity/v3/projects/aff7c011bdaa4c519c0344daec7a8a34 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:55.804188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a2697-5468-41db-bc47-2b4a838c131a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:55.804693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a2697-5468-41db-bc47-2b4a838c131a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:55.804983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a2697-5468-41db-bc47-2b4a838c131a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:55.850066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c07a2697-5468-41db-bc47-2b4a838c131a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:55.851220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c07a2697-5468-41db-bc47-2b4a838c131a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:55.911012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fada9a-438a-4596-b1b4-a74b643c59a4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:55.916607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e005710-c681-49ea-9082-682a6a68da68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:55.917246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e005710-c681-49ea-9082-682a6a68da68 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:55.917527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e005710-c681-49ea-9082-682a6a68da68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:55.917803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e005710-c681-49ea-9082-682a6a68da68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:55.918475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e005710-c681-49ea-9082-682a6a68da68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:55.922574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e005710-c681-49ea-9082-682a6a68da68 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:55.934574 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3528/7000] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:55.938921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e005710-c681-49ea-9082-682a6a68da68 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:55.945590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5e005710-c681-49ea-9082-682a6a68da68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:55.986156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e005710-c681-49ea-9082-682a6a68da68 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:56.014349 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d156fc-1deb-4aab-a7ae-8e5b26e972af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:56.015630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d156fc-1deb-4aab-a7ae-8e5b26e972af admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:56.015941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d156fc-1deb-4aab-a7ae-8e5b26e972af admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:56.016228 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d156fc-1deb-4aab-a7ae-8e5b26e972af admin admin] PATH_INFO: `/v3/projects/94fb04fbf396497594534215101b856b/users/13147f2e3dff4b6bbec260d9c9e5bd24/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:56.020448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d156fc-1deb-4aab-a7ae-8e5b26e972af admin admin] RBAC: Authorizing `identity:create_grant(project_id=94fb04fbf396497594534215101b856b, user_id=13147f2e3dff4b6bbec260d9c9e5bd24, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:56.024732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d156fc-1deb-4aab-a7ae-8e5b26e972af admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:56.028199 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3473/7001] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:42:56.029374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a2697-5468-41db-bc47-2b4a838c131a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:56.030981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c07a2697-5468-41db-bc47-2b4a838c131a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:56.039837 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3529/7002] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:55 2022] PUT /identity/v3/projects/94fb04fbf396497594534215101b856b/users/13147f2e3dff4b6bbec260d9c9e5bd24/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:56.041320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0db77-c061-4747-a691-e67d68a483d9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:56.041652 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0db77-c061-4747-a691-e67d68a483d9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:56.041936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0db77-c061-4747-a691-e67d68a483d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:56.059475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a2697-5468-41db-bc47-2b4a838c131a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:56.109170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-16e0db77-c061-4747-a691-e67d68a483d9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:56.110427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-16e0db77-c061-4747-a691-e67d68a483d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:56.151128 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:56.255521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e752f-4ebc-46e3-aaae-858dca8ff437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:56.256219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e752f-4ebc-46e3-aaae-858dca8ff437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:56.256508 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e752f-4ebc-46e3-aaae-858dca8ff437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:56.257536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e752f-4ebc-46e3-aaae-858dca8ff437 admin admin] PATH_INFO: `/v3/projects/3ee54b9b9b1e4f44b708f5139cfc187f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:56.259004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e752f-4ebc-46e3-aaae-858dca8ff437 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ee54b9b9b1e4f44b708f5139cfc187f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:56.261173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e752f-4ebc-46e3-aaae-858dca8ff437 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:56.273192 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3530/7003] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:56.275170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764977a9-ebbc-46e9-b17b-96ace89a732d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:56.275449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764977a9-ebbc-46e9-b17b-96ace89a732d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:56.275720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764977a9-ebbc-46e9-b17b-96ace89a732d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:56.346469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-764977a9-ebbc-46e9-b17b-96ace89a732d None None] MFA Rules not processed for user `13147f2e3dff4b6bbec260d9c9e5bd24`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:56.347839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-764977a9-ebbc-46e9-b17b-96ace89a732d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:56.364421 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:56.386514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-759e752f-4ebc-46e3-aaae-858dca8ff437 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ee54b9b9b1e4f44b708f5139cfc187f', 'request_id': 'req-759e752f-4ebc-46e3-aaae-858dca8ff437'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:56.394969 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-759e752f-4ebc-46e3-aaae-858dca8ff437 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ee54b9b9b1e4f44b708f5139cfc187f', 'request_id': 'req-759e752f-4ebc-46e3-aaae-858dca8ff437'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:56.410859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-759e752f-4ebc-46e3-aaae-858dca8ff437 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ee54b9b9b1e4f44b708f5139cfc187f', 'request_id': 'req-759e752f-4ebc-46e3-aaae-858dca8ff437'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:56.435104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-759e752f-4ebc-46e3-aaae-858dca8ff437 admin admin] The token cache is being invalidate because project 3ee54b9b9b1e4f44b708f5139cfc187f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:42:56.435979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-759e752f-4ebc-46e3-aaae-858dca8ff437 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:56.436770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-759e752f-4ebc-46e3-aaae-858dca8ff437 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:42:56.443282 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3474/7004] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:42:56 2022] DELETE /identity/v3/projects/3ee54b9b9b1e4f44b708f5139cfc187f => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:56.444303 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e752f-4ebc-46e3-aaae-858dca8ff437 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:56.445772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-759e752f-4ebc-46e3-aaae-858dca8ff437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:56.514268 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3531/7005] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:56 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:56.519231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe6b4e-77f5-4e22-b64a-e686c6b73e00 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:56.519516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe6b4e-77f5-4e22-b64a-e686c6b73e00 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:56.519790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe6b4e-77f5-4e22-b64a-e686c6b73e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:56.561685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-98fe6b4e-77f5-4e22-b64a-e686c6b73e00 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:56.562957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-98fe6b4e-77f5-4e22-b64a-e686c6b73e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:56.573503 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3532/7006] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:42:56.582418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a7458-e4a2-4e9b-9bd1-950e9ca42f14 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:56.583030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a7458-e4a2-4e9b-9bd1-950e9ca42f14 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:56.584951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e752f-4ebc-46e3-aaae-858dca8ff437 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:56.585537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a7458-e4a2-4e9b-9bd1-950e9ca42f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:56.599487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd8cf4-dc8f-4c38-afe2-762d2a047d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:56.602004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd8cf4-dc8f-4c38-afe2-762d2a047d3f admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:56.602004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd8cf4-dc8f-4c38-afe2-762d2a047d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:56.604868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd8cf4-dc8f-4c38-afe2-762d2a047d3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:56.605274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd8cf4-dc8f-4c38-afe2-762d2a047d3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:42:56.605792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd8cf4-dc8f-4c38-afe2-762d2a047d3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:56.620590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd8cf4-dc8f-4c38-afe2-762d2a047d3f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:56.652536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-572a7458-e4a2-4e9b-9bd1-950e9ca42f14 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:56.661135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-572a7458-e4a2-4e9b-9bd1-950e9ca42f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:56.668221 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3475/7007] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:42:56.671207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd8cf4-dc8f-4c38-afe2-762d2a047d3f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:56.676230 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3533/7008] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:42:56.680576 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a7458-e4a2-4e9b-9bd1-950e9ca42f14 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:56.694171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd8cf4-dc8f-4c38-afe2-762d2a047d3f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:56.707600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30830530-349f-4e1c-84b1-604b557f4d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:56.708633 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30830530-349f-4e1c-84b1-604b557f4d79 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:56.709019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30830530-349f-4e1c-84b1-604b557f4d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:56.709390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30830530-349f-4e1c-84b1-604b557f4d79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:56.710148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30830530-349f-4e1c-84b1-604b557f4d79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:56.710643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a7458-e4a2-4e9b-9bd1-950e9ca42f14 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:56.713902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30830530-349f-4e1c-84b1-604b557f4d79 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:56.721830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac48e11-8a7d-4517-b387-5ce69a5d32e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:56.722457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac48e11-8a7d-4517-b387-5ce69a5d32e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:56.722733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac48e11-8a7d-4517-b387-5ce69a5d32e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:56.723002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac48e11-8a7d-4517-b387-5ce69a5d32e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:56.724679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac48e11-8a7d-4517-b387-5ce69a5d32e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:42:56.724880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac48e11-8a7d-4517-b387-5ce69a5d32e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:56.726411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac48e11-8a7d-4517-b387-5ce69a5d32e2 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:56.745956 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3534/7009] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:42:56.750729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac48e11-8a7d-4517-b387-5ce69a5d32e2 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:56.782468 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac48e11-8a7d-4517-b387-5ce69a5d32e2 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:56.799314 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3476/7010] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:42:56 2022] POST /identity/v3/projects => generated 367 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:56.802808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30830530-349f-4e1c-84b1-604b557f4d79 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:56.808999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff62a9-eeb1-4d92-bc29-a30bb7bba30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:56.809626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff62a9-eeb1-4d92-bc29-a30bb7bba30f admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:56.809904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff62a9-eeb1-4d92-bc29-a30bb7bba30f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:56.810181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff62a9-eeb1-4d92-bc29-a30bb7bba30f admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:56.813814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff62a9-eeb1-4d92-bc29-a30bb7bba30f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:56.817169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff62a9-eeb1-4d92-bc29-a30bb7bba30f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:56.896416 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3535/7011] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:42:56 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:56.899672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff62a9-eeb1-4d92-bc29-a30bb7bba30f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:56.981635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30830530-349f-4e1c-84b1-604b557f4d79 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:57.064828 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:57.080823 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:57.082343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff62a9-eeb1-4d92-bc29-a30bb7bba30f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:57.108794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83582d93-e125-4ad9-968a-3846d66955d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:57.109747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83582d93-e125-4ad9-968a-3846d66955d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:57.110257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83582d93-e125-4ad9-968a-3846d66955d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:57.110805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83582d93-e125-4ad9-968a-3846d66955d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:57.111382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a5bae-ea66-4192-8f67-d17f4d652e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:57.111857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83582d93-e125-4ad9-968a-3846d66955d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:57.112055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a5bae-ea66-4192-8f67-d17f4d652e26 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:57.112350 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a5bae-ea66-4192-8f67-d17f4d652e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:57.112630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a5bae-ea66-4192-8f67-d17f4d652e26 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:57.113273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a5bae-ea66-4192-8f67-d17f4d652e26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:57.115099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83582d93-e125-4ad9-968a-3846d66955d2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:57.116225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a5bae-ea66-4192-8f67-d17f4d652e26 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:57.158579 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3536/7012] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:42:56 2022] POST /identity/v3/users => generated 292 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:57.160084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a5bae-ea66-4192-8f67-d17f4d652e26 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:57.162083 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3477/7013] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:42:56 2022] POST /identity/v3/users => generated 284 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:57.172993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a5bae-ea66-4192-8f67-d17f4d652e26 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:57.176909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83582d93-e125-4ad9-968a-3846d66955d2 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:57.179341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522767d8-6079-462c-9bf0-d12026d0ae34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:57.180014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522767d8-6079-462c-9bf0-d12026d0ae34 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:57.180294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522767d8-6079-462c-9bf0-d12026d0ae34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:57.180564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522767d8-6079-462c-9bf0-d12026d0ae34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:57.181225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522767d8-6079-462c-9bf0-d12026d0ae34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:57.183491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522767d8-6079-462c-9bf0-d12026d0ae34 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:57.199936 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3537/7014] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:42:57.200685 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83582d93-e125-4ad9-968a-3846d66955d2 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:57.211732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e1ca6-cdc3-40ee-b396-4b246ab4ba46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:57.213253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e1ca6-cdc3-40ee-b396-4b246ab4ba46 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:57.213724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e1ca6-cdc3-40ee-b396-4b246ab4ba46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:57.214416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e1ca6-cdc3-40ee-b396-4b246ab4ba46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:57.215243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e1ca6-cdc3-40ee-b396-4b246ab4ba46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:57.218957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e1ca6-cdc3-40ee-b396-4b246ab4ba46 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:57.221829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522767d8-6079-462c-9bf0-d12026d0ae34 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:57.235075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522767d8-6079-462c-9bf0-d12026d0ae34 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:57.245911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4a4e0-25b5-4495-91c2-94aa61d47b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:57.246535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4a4e0-25b5-4495-91c2-94aa61d47b91 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:57.246809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4a4e0-25b5-4495-91c2-94aa61d47b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:57.247083 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4a4e0-25b5-4495-91c2-94aa61d47b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:57.249892 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4a4e0-25b5-4495-91c2-94aa61d47b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:57.254141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4a4e0-25b5-4495-91c2-94aa61d47b91 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:57.260312 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3478/7015] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:57.262536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e1ca6-cdc3-40ee-b396-4b246ab4ba46 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:57.285913 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3538/7016] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:57.286247 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e1ca6-cdc3-40ee-b396-4b246ab4ba46 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:57.287757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4a4e0-25b5-4495-91c2-94aa61d47b91 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:57.301222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3c9c9-201f-4662-8f53-257f079c0f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:57.301841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3c9c9-201f-4662-8f53-257f079c0f65 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:57.302119 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3c9c9-201f-4662-8f53-257f079c0f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:57.302387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3c9c9-201f-4662-8f53-257f079c0f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:57.303040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3c9c9-201f-4662-8f53-257f079c0f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:57.306543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4a4e0-25b5-4495-91c2-94aa61d47b91 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:57.307813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a3c9c9-201f-4662-8f53-257f079c0f65 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:57.322311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33341bc-24af-4fb3-8bf0-5362e09b6772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:57.322994 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33341bc-24af-4fb3-8bf0-5362e09b6772 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:57.323273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33341bc-24af-4fb3-8bf0-5362e09b6772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:57.323545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33341bc-24af-4fb3-8bf0-5362e09b6772 admin admin] PATH_INFO: `/v3/projects/11c230b991b04e8da7e4bdfa19b546e5/users/695bf6ad66ae44a1a9d84b638fe544d4/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:57.330106 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3479/7017] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:57.336328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3c9c9-201f-4662-8f53-257f079c0f65 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:57.350728 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a3c9c9-201f-4662-8f53-257f079c0f65 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:57.355400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33341bc-24af-4fb3-8bf0-5362e09b6772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11c230b991b04e8da7e4bdfa19b546e5, user_id=695bf6ad66ae44a1a9d84b638fe544d4, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:57.358953 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33341bc-24af-4fb3-8bf0-5362e09b6772 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:57.364907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4d5c0-0514-4591-ac9b-fe1fe029390d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:57.366912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4d5c0-0514-4591-ac9b-fe1fe029390d admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:57.367251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4d5c0-0514-4591-ac9b-fe1fe029390d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:57.367840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4d5c0-0514-4591-ac9b-fe1fe029390d admin admin] PATH_INFO: `/v3/projects/63c3006e54604cb19b1514d48dc3ff30/users/129623270c4242efbae8d862d31bc2a4/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:57.380220 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3539/7018] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:57 2022] PUT /identity/v3/projects/11c230b991b04e8da7e4bdfa19b546e5/users/695bf6ad66ae44a1a9d84b638fe544d4/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:57.393605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4d5c0-0514-4591-ac9b-fe1fe029390d admin admin] RBAC: Authorizing `identity:create_grant(project_id=63c3006e54604cb19b1514d48dc3ff30, user_id=129623270c4242efbae8d862d31bc2a4, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:57.396660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4d5c0-0514-4591-ac9b-fe1fe029390d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:57.398184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540c383-3498-4577-a426-4a37a1601e6a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:57.398936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540c383-3498-4577-a426-4a37a1601e6a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:57.399458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540c383-3498-4577-a426-4a37a1601e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:57.425904 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3480/7019] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:57 2022] PUT /identity/v3/projects/63c3006e54604cb19b1514d48dc3ff30/users/129623270c4242efbae8d862d31bc2a4/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:57.436825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b0f6b-cffe-4967-946b-073e703b72c5 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:57.438077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b0f6b-cffe-4967-946b-073e703b72c5 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:57.438077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b0f6b-cffe-4967-946b-073e703b72c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:57.471429 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2540c383-3498-4577-a426-4a37a1601e6a None None] MFA Rules not processed for user `695bf6ad66ae44a1a9d84b638fe544d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:57.473777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2540c383-3498-4577-a426-4a37a1601e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:57.500285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d00b0f6b-cffe-4967-946b-073e703b72c5 None None] MFA Rules not processed for user `129623270c4242efbae8d862d31bc2a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:57.502210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d00b0f6b-cffe-4967-946b-073e703b72c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:57.611076 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3540/7020] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:42:57.612462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540c383-3498-4577-a426-4a37a1601e6a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:57.634450 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3481/7021] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:42:57.639772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b0f6b-cffe-4967-946b-073e703b72c5 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:57.773534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540c383-3498-4577-a426-4a37a1601e6a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:57.784468 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ec854-23e0-4dfa-af43-a2d3ab01cd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:57.785577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ec854-23e0-4dfa-af43-a2d3ab01cd79 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:57.786455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ec854-23e0-4dfa-af43-a2d3ab01cd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:57.787056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ec854-23e0-4dfa-af43-a2d3ab01cd79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:57.788243 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ec854-23e0-4dfa-af43-a2d3ab01cd79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:57.791178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ec854-23e0-4dfa-af43-a2d3ab01cd79 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:57.812720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b0f6b-cffe-4967-946b-073e703b72c5 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:57.824824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efa346-c5e2-4b1b-abf5-ce70fa1c392c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:57.826142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efa346-c5e2-4b1b-abf5-ce70fa1c392c admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:57.826565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efa346-c5e2-4b1b-abf5-ce70fa1c392c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:57.826950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efa346-c5e2-4b1b-abf5-ce70fa1c392c admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:57.829719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6efa346-c5e2-4b1b-abf5-ce70fa1c392c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:57.833055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6efa346-c5e2-4b1b-abf5-ce70fa1c392c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:57.845538 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3541/7022] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:42:57 2022] POST /identity/v3/projects => generated 383 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:57.846673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ec854-23e0-4dfa-af43-a2d3ab01cd79 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:57.885149 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:57.900372 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3482/7023] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:42:57 2022] POST /identity/v3/projects => generated 369 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:42:57.900596 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:57.901944 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efa346-c5e2-4b1b-abf5-ce70fa1c392c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:57.979347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ec854-23e0-4dfa-af43-a2d3ab01cd79 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:58.050451 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efa346-c5e2-4b1b-abf5-ce70fa1c392c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:58.056514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ac114-c4c5-458b-9a55-6d4d70f4a378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:58.057485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ac114-c4c5-458b-9a55-6d4d70f4a378 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:58.058771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ac114-c4c5-458b-9a55-6d4d70f4a378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:58.059286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ac114-c4c5-458b-9a55-6d4d70f4a378 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:58.062998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ac114-c4c5-458b-9a55-6d4d70f4a378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:58.065457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ac114-c4c5-458b-9a55-6d4d70f4a378 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:58.108245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa309c-6724-439d-86c7-d7f139eca8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:58.108960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa309c-6724-439d-86c7-d7f139eca8fe admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:58.109210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa309c-6724-439d-86c7-d7f139eca8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:58.109496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa309c-6724-439d-86c7-d7f139eca8fe admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:58.112853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa309c-6724-439d-86c7-d7f139eca8fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:58.112853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa309c-6724-439d-86c7-d7f139eca8fe admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:58.115747 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3483/7024] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:42:57 2022] POST /identity/v3/users => generated 291 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:42:58.118734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ac114-c4c5-458b-9a55-6d4d70f4a378 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:58.161524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ac114-c4c5-458b-9a55-6d4d70f4a378 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:58.162328 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3542/7025] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:42:57 2022] POST /identity/v3/users => generated 298 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:42:58.163973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa309c-6724-439d-86c7-d7f139eca8fe admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:58.175397 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14b49b-d4bc-4c0e-a347-df251140a8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:58.176088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14b49b-d4bc-4c0e-a347-df251140a8f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:58.176369 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14b49b-d4bc-4c0e-a347-df251140a8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:58.177021 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14b49b-d4bc-4c0e-a347-df251140a8f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:58.177994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14b49b-d4bc-4c0e-a347-df251140a8f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:58.181373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14b49b-d4bc-4c0e-a347-df251140a8f6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:58.188854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa309c-6724-439d-86c7-d7f139eca8fe admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:58.202588 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3484/7026] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:58.206392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca71a1-c5b7-4631-858d-5d7aabffa4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:58.206805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14b49b-d4bc-4c0e-a347-df251140a8f6 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:58.207856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca71a1-c5b7-4631-858d-5d7aabffa4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:58.210611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca71a1-c5b7-4631-858d-5d7aabffa4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:58.211107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca71a1-c5b7-4631-858d-5d7aabffa4b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:58.212410 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca71a1-c5b7-4631-858d-5d7aabffa4b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:58.218994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14b49b-d4bc-4c0e-a347-df251140a8f6 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:58.219381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca71a1-c5b7-4631-858d-5d7aabffa4b1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:58.228286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ac4ba-1cb8-41b5-b9b2-34fd07afb483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:58.229257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ac4ba-1cb8-41b5-b9b2-34fd07afb483 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:58.229627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ac4ba-1cb8-41b5-b9b2-34fd07afb483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:58.229961 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ac4ba-1cb8-41b5-b9b2-34fd07afb483 admin admin] PATH_INFO: `/v3/projects/b07dbdc387eb41b69eb2b533f6c2a785/users/5dc0a4220f0a4e36937cf4589286bdd4/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:58.243665 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3543/7027] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:58.249515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca71a1-c5b7-4631-858d-5d7aabffa4b1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:58.254659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ac4ba-1cb8-41b5-b9b2-34fd07afb483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b07dbdc387eb41b69eb2b533f6c2a785, user_id=5dc0a4220f0a4e36937cf4589286bdd4, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:58.257681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ac4ba-1cb8-41b5-b9b2-34fd07afb483 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:58.271129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca71a1-c5b7-4631-858d-5d7aabffa4b1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:58.282318 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3485/7028] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:58 2022] PUT /identity/v3/projects/b07dbdc387eb41b69eb2b533f6c2a785/users/5dc0a4220f0a4e36937cf4589286bdd4/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:58.284778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ac4ba-1cb8-41b5-b9b2-34fd07afb483 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:58.393775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ac4ba-1cb8-41b5-b9b2-34fd07afb483 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:58.402766 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350384b-80a4-4943-a5fe-b4bed24fe833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:58.403523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350384b-80a4-4943-a5fe-b4bed24fe833 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:58.403871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350384b-80a4-4943-a5fe-b4bed24fe833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:58.404280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350384b-80a4-4943-a5fe-b4bed24fe833 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:58.405205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350384b-80a4-4943-a5fe-b4bed24fe833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:58.406963 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350384b-80a4-4943-a5fe-b4bed24fe833 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:58.425946 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3486/7029] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:58.430790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350384b-80a4-4943-a5fe-b4bed24fe833 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:58.436724 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e11264-5b9e-4952-aad1-4be6d5b427f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:58.437497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e11264-5b9e-4952-aad1-4be6d5b427f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:58.437816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e11264-5b9e-4952-aad1-4be6d5b427f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:58.438088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e11264-5b9e-4952-aad1-4be6d5b427f7 admin admin] PATH_INFO: `/v3/projects/157ce1fd06cc421ba881fe1055eff0b5/users/dbd16ee9afe4431cb37ad02e50fa69d2/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:58.461297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e11264-5b9e-4952-aad1-4be6d5b427f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=157ce1fd06cc421ba881fe1055eff0b5, user_id=dbd16ee9afe4431cb37ad02e50fa69d2, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:58.464113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e11264-5b9e-4952-aad1-4be6d5b427f7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:58.465034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350384b-80a4-4943-a5fe-b4bed24fe833 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:58.486044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7583b-df39-4772-abe9-8ba505fc58ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:58.486713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7583b-df39-4772-abe9-8ba505fc58ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:58.492542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7583b-df39-4772-abe9-8ba505fc58ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:58.492894 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7583b-df39-4772-abe9-8ba505fc58ff admin admin] PATH_INFO: `/v3/projects/b07dbdc387eb41b69eb2b533f6c2a785/users/5dc0a4220f0a4e36937cf4589286bdd4/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:58.496931 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3544/7030] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:58 2022] PUT /identity/v3/projects/157ce1fd06cc421ba881fe1055eff0b5/users/dbd16ee9afe4431cb37ad02e50fa69d2/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:58.501143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7583b-df39-4772-abe9-8ba505fc58ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b07dbdc387eb41b69eb2b533f6c2a785, user_id=5dc0a4220f0a4e36937cf4589286bdd4, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:58.501580 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e11264-5b9e-4952-aad1-4be6d5b427f7 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:58.503845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7583b-df39-4772-abe9-8ba505fc58ff admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:58.531637 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3487/7031] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:58 2022] PUT /identity/v3/projects/b07dbdc387eb41b69eb2b533f6c2a785/users/5dc0a4220f0a4e36937cf4589286bdd4/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:58.535355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b2b68-e869-41c6-b74b-fc271aa80538 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:58.535355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b2b68-e869-41c6-b74b-fc271aa80538 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:58.535355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b2b68-e869-41c6-b74b-fc271aa80538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:58.563772 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:58.589910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7b7b2b68-e869-41c6-b74b-fc271aa80538 None None] MFA Rules not processed for user `5dc0a4220f0a4e36937cf4589286bdd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:58.593322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7b7b2b68-e869-41c6-b74b-fc271aa80538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:58.664182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e11264-5b9e-4952-aad1-4be6d5b427f7 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:58.673658 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:42:58.775782 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3488/7032] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:42:58.788901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b2b68-e869-41c6-b74b-fc271aa80538 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:58.792877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7b7b2b68-e869-41c6-b74b-fc271aa80538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:58.795765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a85199-f391-49bc-8374-2b80f8358897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:58.796689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a85199-f391-49bc-8374-2b80f8358897 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:58.797166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a85199-f391-49bc-8374-2b80f8358897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:58.797602 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a85199-f391-49bc-8374-2b80f8358897 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:58.798427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a85199-f391-49bc-8374-2b80f8358897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:58.801160 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a85199-f391-49bc-8374-2b80f8358897 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:58.814840 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3545/7033] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:42:58.821752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a85199-f391-49bc-8374-2b80f8358897 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:42:58.839347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a85199-f391-49bc-8374-2b80f8358897 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:58.847371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a7370-4c63-45bf-8eda-41729b49a2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:58.848332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a7370-4c63-45bf-8eda-41729b49a2d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:58.848773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a7370-4c63-45bf-8eda-41729b49a2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:58.849249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a7370-4c63-45bf-8eda-41729b49a2d6 admin admin] PATH_INFO: `/v3/projects/157ce1fd06cc421ba881fe1055eff0b5/users/dbd16ee9afe4431cb37ad02e50fa69d2/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:58.852288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a7370-4c63-45bf-8eda-41729b49a2d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=157ce1fd06cc421ba881fe1055eff0b5, user_id=dbd16ee9afe4431cb37ad02e50fa69d2, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:58.856141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a7370-4c63-45bf-8eda-41729b49a2d6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:58.878211 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3546/7034] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:42:58 2022] PUT /identity/v3/projects/157ce1fd06cc421ba881fe1055eff0b5/users/dbd16ee9afe4431cb37ad02e50fa69d2/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:42:58.889159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c622fb4-999d-4c98-830d-8eacb07f29b6 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:58.889685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c622fb4-999d-4c98-830d-8eacb07f29b6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:58.890106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c622fb4-999d-4c98-830d-8eacb07f29b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:58.922536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b2b68-e869-41c6-b74b-fc271aa80538 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:42:59.003352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2c622fb4-999d-4c98-830d-8eacb07f29b6 None None] MFA Rules not processed for user `dbd16ee9afe4431cb37ad02e50fa69d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:42:59.004553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2c622fb4-999d-4c98-830d-8eacb07f29b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:42:59.065242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8622a7-b211-43c7-adf6-28af6e71d09f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:42:59.065960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8622a7-b211-43c7-adf6-28af6e71d09f service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:42:59.066315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8622a7-b211-43c7-adf6-28af6e71d09f service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:42:59.066663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8622a7-b211-43c7-adf6-28af6e71d09f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:42:59.243074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8622a7-b211-43c7-adf6-28af6e71d09f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:42:59.247063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8622a7-b211-43c7-adf6-28af6e71d09f service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:42:59.285221 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3489/7035] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:42:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:42:59.297701 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3547/7036] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:42:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:01.761775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8622a7-b211-43c7-adf6-28af6e71d09f service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:01.764078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9b8622a7-b211-43c7-adf6-28af6e71d09f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:01.823410 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:01.923686 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8622a7-b211-43c7-adf6-28af6e71d09f service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:01.937070 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef8612-c1ea-4ded-92e7-9e7bad76ee2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:01.937730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef8612-c1ea-4ded-92e7-9e7bad76ee2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:01.938006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef8612-c1ea-4ded-92e7-9e7bad76ee2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:01.938275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef8612-c1ea-4ded-92e7-9e7bad76ee2b admin admin] PATH_INFO: `/v3/users/37e91addb101485c9a80de707baf44ad` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:01.941233 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef8612-c1ea-4ded-92e7-9e7bad76ee2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=37e91addb101485c9a80de707baf44ad)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:01.950110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef8612-c1ea-4ded-92e7-9e7bad76ee2b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:02.057895 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5bef8612-c1ea-4ded-92e7-9e7bad76ee2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37e91addb101485c9a80de707baf44ad'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:02.070854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5bef8612-c1ea-4ded-92e7-9e7bad76ee2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37e91addb101485c9a80de707baf44ad'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:02.092887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5bef8612-c1ea-4ded-92e7-9e7bad76ee2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37e91addb101485c9a80de707baf44ad'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:02.094252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5bef8612-c1ea-4ded-92e7-9e7bad76ee2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37e91addb101485c9a80de707baf44ad'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:02.104663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5bef8612-c1ea-4ded-92e7-9e7bad76ee2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37e91addb101485c9a80de707baf44ad'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:02.129384 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3490/7037] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:43:01 2022] DELETE /identity/v3/users/37e91addb101485c9a80de707baf44ad => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:02.134797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202ad91-26f4-4822-9e62-4c7d721e6000 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:02.135334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202ad91-26f4-4822-9e62-4c7d721e6000 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:02.135417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202ad91-26f4-4822-9e62-4c7d721e6000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:02.207316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a202ad91-26f4-4822-9e62-4c7d721e6000 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:02.210583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a202ad91-26f4-4822-9e62-4c7d721e6000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:02.327431 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:02.426537 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3548/7038] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:02.469554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef8612-c1ea-4ded-92e7-9e7bad76ee2b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:02.471647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5bef8612-c1ea-4ded-92e7-9e7bad76ee2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:02.659679 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef8612-c1ea-4ded-92e7-9e7bad76ee2b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:02.682178 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f304c-5841-48a0-a91d-afe01e3d6e46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:02.682711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f304c-5841-48a0-a91d-afe01e3d6e46 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:02.682994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f304c-5841-48a0-a91d-afe01e3d6e46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:02.683285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f304c-5841-48a0-a91d-afe01e3d6e46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:02.730320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f304c-5841-48a0-a91d-afe01e3d6e46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:02.731806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f304c-5841-48a0-a91d-afe01e3d6e46 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:02.766415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202ad91-26f4-4822-9e62-4c7d721e6000 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:02.767422 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3491/7039] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:43:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:43:02.768865 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a202ad91-26f4-4822-9e62-4c7d721e6000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:02.859341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202ad91-26f4-4822-9e62-4c7d721e6000 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:02.868356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60994125-ee41-403d-9ab7-c5955b5fcd55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:02.869094 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60994125-ee41-403d-9ab7-c5955b5fcd55 service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:02.869571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60994125-ee41-403d-9ab7-c5955b5fcd55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:02.869923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60994125-ee41-403d-9ab7-c5955b5fcd55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:02.872486 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-60994125-ee41-403d-9ab7-c5955b5fcd55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:03.073149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60994125-ee41-403d-9ab7-c5955b5fcd55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:03.074636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60994125-ee41-403d-9ab7-c5955b5fcd55 service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:03.109941 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3549/7040] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:43:02 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:43:03.221056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f304c-5841-48a0-a91d-afe01e3d6e46 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:03.236632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f304c-5841-48a0-a91d-afe01e3d6e46 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:03.247480 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d23b4-9f8d-4fbf-9771-e5453c61cb5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:03.248657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d23b4-9f8d-4fbf-9771-e5453c61cb5a service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:03.248938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d23b4-9f8d-4fbf-9771-e5453c61cb5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:03.249238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d23b4-9f8d-4fbf-9771-e5453c61cb5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:03.257957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-af7d23b4-9f8d-4fbf-9771-e5453c61cb5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:03.362885 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:03.401497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d23b4-9f8d-4fbf-9771-e5453c61cb5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:03.403237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d23b4-9f8d-4fbf-9771-e5453c61cb5a service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:03.417418 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3492/7041] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:43:03 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:43:03.664140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60994125-ee41-403d-9ab7-c5955b5fcd55 service cinder] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:03.697816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60994125-ee41-403d-9ab7-c5955b5fcd55 service cinder] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:03.709707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010bccf-655a-4405-82af-c3c2faf91c40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:03.710560 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010bccf-655a-4405-82af-c3c2faf91c40 service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:03.710850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010bccf-655a-4405-82af-c3c2faf91c40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:03.711122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010bccf-655a-4405-82af-c3c2faf91c40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:03.718355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1010bccf-655a-4405-82af-c3c2faf91c40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:03.872279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010bccf-655a-4405-82af-c3c2faf91c40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:03.874486 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010bccf-655a-4405-82af-c3c2faf91c40 service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:03.897932 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3550/7042] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:43:03 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:43:04.875177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d23b4-9f8d-4fbf-9771-e5453c61cb5a service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:04.879397 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-af7d23b4-9f8d-4fbf-9771-e5453c61cb5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:04.906426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d23b4-9f8d-4fbf-9771-e5453c61cb5a service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:04.914864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ae8ba-896b-4a55-b32a-9c008fb6c043 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:04.914864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ae8ba-896b-4a55-b32a-9c008fb6c043 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:04.915068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ae8ba-896b-4a55-b32a-9c008fb6c043 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:04.915187 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ae8ba-896b-4a55-b32a-9c008fb6c043 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:04.917553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a75ae8ba-896b-4a55-b32a-9c008fb6c043 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:05.011054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010bccf-655a-4405-82af-c3c2faf91c40 service cinder] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:05.012666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1010bccf-655a-4405-82af-c3c2faf91c40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:05.058391 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010bccf-655a-4405-82af-c3c2faf91c40 service cinder] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:05.064814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ae8ba-896b-4a55-b32a-9c008fb6c043 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:05.066701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ae8ba-896b-4a55-b32a-9c008fb6c043 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:05.072686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c432470-c745-42a5-aace-395daebbff72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:05.073442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c432470-c745-42a5-aace-395daebbff72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:05.073787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c432470-c745-42a5-aace-395daebbff72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:05.074129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c432470-c745-42a5-aace-395daebbff72 admin admin] PATH_INFO: `/v3/projects/11a1f9e4b922401aa96de5155bd7be99` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:05.079207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c432470-c745-42a5-aace-395daebbff72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11a1f9e4b922401aa96de5155bd7be99)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:05.081306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c432470-c745-42a5-aace-395daebbff72 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:05.097627 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3493/7043] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:43:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:43:05.157179 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:05.228019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7c432470-c745-42a5-aace-395daebbff72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11a1f9e4b922401aa96de5155bd7be99', 'request_id': 'req-7c432470-c745-42a5-aace-395daebbff72'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:05.246186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7c432470-c745-42a5-aace-395daebbff72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11a1f9e4b922401aa96de5155bd7be99', 'request_id': 'req-7c432470-c745-42a5-aace-395daebbff72'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:05.262643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7c432470-c745-42a5-aace-395daebbff72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11a1f9e4b922401aa96de5155bd7be99', 'request_id': 'req-7c432470-c745-42a5-aace-395daebbff72'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:05.304914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7c432470-c745-42a5-aace-395daebbff72 admin admin] The token cache is being invalidate because project 11a1f9e4b922401aa96de5155bd7be99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:43:05.308012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7c432470-c745-42a5-aace-395daebbff72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:05.311783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7c432470-c745-42a5-aace-395daebbff72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:05.318268 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3551/7044] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:43:05 2022] DELETE /identity/v3/projects/11a1f9e4b922401aa96de5155bd7be99 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:05.324693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077072d8-8e99-4772-835d-0341f966acac None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:05.325013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077072d8-8e99-4772-835d-0341f966acac None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:05.325251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077072d8-8e99-4772-835d-0341f966acac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:05.394278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-077072d8-8e99-4772-835d-0341f966acac None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:05.395452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-077072d8-8e99-4772-835d-0341f966acac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:05.723144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183d3d7-c8e6-4d2a-b843-5684d40834eb None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:05.723928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183d3d7-c8e6-4d2a-b843-5684d40834eb None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:05.723928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183d3d7-c8e6-4d2a-b843-5684d40834eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:05.739628 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3494/7045] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:05.779577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d183d3d7-c8e6-4d2a-b843-5684d40834eb None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:05.782653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d183d3d7-c8e6-4d2a-b843-5684d40834eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:05.807603 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3552/7046] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:05.808362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077072d8-8e99-4772-835d-0341f966acac None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:05.829455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077072d8-8e99-4772-835d-0341f966acac None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:05.844122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe0ad5-be8a-45c7-9646-5785126fd057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:05.845354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe0ad5-be8a-45c7-9646-5785126fd057 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:05.848602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe0ad5-be8a-45c7-9646-5785126fd057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:05.848974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe0ad5-be8a-45c7-9646-5785126fd057 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:05.849784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe0ad5-be8a-45c7-9646-5785126fd057 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:43:05.850155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe0ad5-be8a-45c7-9646-5785126fd057 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:05.856326 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe0ad5-be8a-45c7-9646-5785126fd057 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:05.896712 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3495/7047] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:43:05.898145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183d3d7-c8e6-4d2a-b843-5684d40834eb None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:05.916133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183d3d7-c8e6-4d2a-b843-5684d40834eb None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:05.938541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260ac75-acca-4978-8d02-44006a37e9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:05.944443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260ac75-acca-4978-8d02-44006a37e9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:05.948344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260ac75-acca-4978-8d02-44006a37e9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:05.948559 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260ac75-acca-4978-8d02-44006a37e9f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:05.949250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260ac75-acca-4978-8d02-44006a37e9f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:05.957834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260ac75-acca-4978-8d02-44006a37e9f3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:06.083691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe0ad5-be8a-45c7-9646-5785126fd057 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:06.083931 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3553/7048] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:43:05 2022] POST /identity/v3/projects => generated 373 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:06.111684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe0ad5-be8a-45c7-9646-5785126fd057 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:06.304075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38619014-d35e-4c5a-8e9e-b10496a3080a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:06.304988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38619014-d35e-4c5a-8e9e-b10496a3080a admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:06.305374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38619014-d35e-4c5a-8e9e-b10496a3080a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:06.305854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38619014-d35e-4c5a-8e9e-b10496a3080a admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:06.306752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38619014-d35e-4c5a-8e9e-b10496a3080a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:06.309810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38619014-d35e-4c5a-8e9e-b10496a3080a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:06.347326 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:06.362071 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3496/7049] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:43:06 2022] POST /identity/v3/users => generated 287 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:43:06.362479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260ac75-acca-4978-8d02-44006a37e9f3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:06.378695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260ac75-acca-4978-8d02-44006a37e9f3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:06.388690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f753c-0be3-43f5-bea7-3bd0fda105c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:06.389332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f753c-0be3-43f5-bea7-3bd0fda105c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:06.389609 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f753c-0be3-43f5-bea7-3bd0fda105c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:06.389881 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f753c-0be3-43f5-bea7-3bd0fda105c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:06.390815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f753c-0be3-43f5-bea7-3bd0fda105c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:06.394840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f753c-0be3-43f5-bea7-3bd0fda105c2 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:06.422643 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3554/7050] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:06.426624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38619014-d35e-4c5a-8e9e-b10496a3080a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:06.440064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38619014-d35e-4c5a-8e9e-b10496a3080a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:06.451625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574ac6c-045c-46c8-992e-3b06a13d8294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:06.452763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574ac6c-045c-46c8-992e-3b06a13d8294 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:06.453458 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574ac6c-045c-46c8-992e-3b06a13d8294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:06.453886 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574ac6c-045c-46c8-992e-3b06a13d8294 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:06.455721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574ac6c-045c-46c8-992e-3b06a13d8294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:06.458108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574ac6c-045c-46c8-992e-3b06a13d8294 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:06.478741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f753c-0be3-43f5-bea7-3bd0fda105c2 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:06.482116 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3497/7051] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:06.491093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f753c-0be3-43f5-bea7-3bd0fda105c2 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:06.521744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523305d-264a-43f7-a4a7-cf193714f755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:06.522322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523305d-264a-43f7-a4a7-cf193714f755 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:06.522608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523305d-264a-43f7-a4a7-cf193714f755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:06.522880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523305d-264a-43f7-a4a7-cf193714f755 admin admin] PATH_INFO: `/v3/projects/ec1c5cf15df14834bb2aa7470da6f21e/users/38c8e37598f14f67b33547392348b7e8/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:06.549217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523305d-264a-43f7-a4a7-cf193714f755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec1c5cf15df14834bb2aa7470da6f21e, user_id=38c8e37598f14f67b33547392348b7e8, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:06.552015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523305d-264a-43f7-a4a7-cf193714f755 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:06.593410 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3555/7052] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:43:06 2022] PUT /identity/v3/projects/ec1c5cf15df14834bb2aa7470da6f21e/users/38c8e37598f14f67b33547392348b7e8/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:06.607745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d66cb-49e8-4f2b-b0c3-6718f93c84c4 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:06.608095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d66cb-49e8-4f2b-b0c3-6718f93c84c4 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:06.608333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d66cb-49e8-4f2b-b0c3-6718f93c84c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:06.675071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-687d66cb-49e8-4f2b-b0c3-6718f93c84c4 None None] MFA Rules not processed for user `38c8e37598f14f67b33547392348b7e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:06.676375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-687d66cb-49e8-4f2b-b0c3-6718f93c84c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:06.827846 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3498/7053] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:06.832824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523305d-264a-43f7-a4a7-cf193714f755 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:06.967919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523305d-264a-43f7-a4a7-cf193714f755 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:06.980754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4699a86-e171-4159-a6c6-3b6b435a4151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:06.981391 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4699a86-e171-4159-a6c6-3b6b435a4151 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:06.981676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4699a86-e171-4159-a6c6-3b6b435a4151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:06.981981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4699a86-e171-4159-a6c6-3b6b435a4151 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:06.982639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4699a86-e171-4159-a6c6-3b6b435a4151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:06.984600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4699a86-e171-4159-a6c6-3b6b435a4151 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:07.056118 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3556/7054] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:43:06 2022] POST /identity/v3/projects => generated 375 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:43:07.061147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d66cb-49e8-4f2b-b0c3-6718f93c84c4 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:07.080478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d66cb-49e8-4f2b-b0c3-6718f93c84c4 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:07.229336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b7c75-8f4e-4949-b5c0-0fec36586a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:07.234249 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b7c75-8f4e-4949-b5c0-0fec36586a28 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:07.234749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b7c75-8f4e-4949-b5c0-0fec36586a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:07.235190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b7c75-8f4e-4949-b5c0-0fec36586a28 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:07.236019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b7c75-8f4e-4949-b5c0-0fec36586a28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:07.238481 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b7c75-8f4e-4949-b5c0-0fec36586a28 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:07.276302 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3499/7055] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:43:07 2022] POST /identity/v3/users => generated 294 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:07.277234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4699a86-e171-4159-a6c6-3b6b435a4151 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:07.299133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4699a86-e171-4159-a6c6-3b6b435a4151 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:07.317967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02196c-b0a7-4b2a-8c8e-397e2ed5b7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:07.318604 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02196c-b0a7-4b2a-8c8e-397e2ed5b7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:07.319226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02196c-b0a7-4b2a-8c8e-397e2ed5b7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:07.319675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02196c-b0a7-4b2a-8c8e-397e2ed5b7c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:07.321314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02196c-b0a7-4b2a-8c8e-397e2ed5b7c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:07.323500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02196c-b0a7-4b2a-8c8e-397e2ed5b7c0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:07.348958 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b7c75-8f4e-4949-b5c0-0fec36586a28 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:07.360110 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3557/7056] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:07.379995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b7c75-8f4e-4949-b5c0-0fec36586a28 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:07.397210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabcc267-68b9-489e-8621-2f8a7be4db05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:07.397908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcc267-68b9-489e-8621-2f8a7be4db05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:07.398175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcc267-68b9-489e-8621-2f8a7be4db05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:07.398525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcc267-68b9-489e-8621-2f8a7be4db05 admin admin] PATH_INFO: `/v3/projects/1fac56a6d25f40cb89e267547580e6c9/users/501514b31f01414faa4c29abf8d4e2ec/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:07.474689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabcc267-68b9-489e-8621-2f8a7be4db05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fac56a6d25f40cb89e267547580e6c9, user_id=501514b31f01414faa4c29abf8d4e2ec, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:07.481160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabcc267-68b9-489e-8621-2f8a7be4db05 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:07.540528 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3500/7057] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:43:07 2022] PUT /identity/v3/projects/1fac56a6d25f40cb89e267547580e6c9/users/501514b31f01414faa4c29abf8d4e2ec/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:07.541820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02196c-b0a7-4b2a-8c8e-397e2ed5b7c0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:07.603586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02196c-b0a7-4b2a-8c8e-397e2ed5b7c0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:07.692054 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:07.813755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4ca84-c49c-4e24-b9e6-8a28a0622961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:07.817236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4ca84-c49c-4e24-b9e6-8a28a0622961 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:07.817619 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4ca84-c49c-4e24-b9e6-8a28a0622961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:07.818263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4ca84-c49c-4e24-b9e6-8a28a0622961 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:07.819034 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4ca84-c49c-4e24-b9e6-8a28a0622961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:07.823915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4ca84-c49c-4e24-b9e6-8a28a0622961 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:07.851934 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3558/7058] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:07.857473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabcc267-68b9-489e-8621-2f8a7be4db05 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:07.877485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabcc267-68b9-489e-8621-2f8a7be4db05 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:07.888288 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4629b56-a601-427b-babb-df4413036111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:07.889452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4629b56-a601-427b-babb-df4413036111 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:07.889833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4629b56-a601-427b-babb-df4413036111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:07.891478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4629b56-a601-427b-babb-df4413036111 admin admin] PATH_INFO: `/v3/projects/1fac56a6d25f40cb89e267547580e6c9/users/501514b31f01414faa4c29abf8d4e2ec/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:07.894308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4629b56-a601-427b-babb-df4413036111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fac56a6d25f40cb89e267547580e6c9, user_id=501514b31f01414faa4c29abf8d4e2ec, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:07.904440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4629b56-a601-427b-babb-df4413036111 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:07.932960 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3501/7059] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:43:07 2022] PUT /identity/v3/projects/1fac56a6d25f40cb89e267547580e6c9/users/501514b31f01414faa4c29abf8d4e2ec/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:07.943926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13629bb5-2074-4164-80bc-530655c1b3d7 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:07.944419 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13629bb5-2074-4164-80bc-530655c1b3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:07.944822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13629bb5-2074-4164-80bc-530655c1b3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:08.019460 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-13629bb5-2074-4164-80bc-530655c1b3d7 None None] MFA Rules not processed for user `501514b31f01414faa4c29abf8d4e2ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:08.021019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-13629bb5-2074-4164-80bc-530655c1b3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:08.266692 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3559/7060] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:08.269765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4629b56-a601-427b-babb-df4413036111 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:08.290481 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4629b56-a601-427b-babb-df4413036111 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:08.305311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884ae29-e56e-4840-be03-b961d086603b tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '501514b31f01414faa4c29abf8d4e2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fac56a6d25f40cb89e267547580e6c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:08.305937 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884ae29-e56e-4840-be03-b961d086603b tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:08.306466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884ae29-e56e-4840-be03-b961d086603b tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:08.306736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884ae29-e56e-4840-be03-b961d086603b tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:08.307368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884ae29-e56e-4840-be03-b961d086603b tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:08.311799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884ae29-e56e-4840-be03-b961d086603b tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:08.397011 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3502/7061] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Aug 7 01:43:08 2022] POST /identity/v3/projects => generated 348 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:08.397903 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13629bb5-2074-4164-80bc-530655c1b3d7 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:08.414744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13629bb5-2074-4164-80bc-530655c1b3d7 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:08.568015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023335c-9180-49cf-95f7-7fb2534651c3 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '501514b31f01414faa4c29abf8d4e2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fac56a6d25f40cb89e267547580e6c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:08.568454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023335c-9180-49cf-95f7-7fb2534651c3 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:08.568741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023335c-9180-49cf-95f7-7fb2534651c3 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:08.569022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5023335c-9180-49cf-95f7-7fb2534651c3 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:08.569672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023335c-9180-49cf-95f7-7fb2534651c3 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:08.586408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5023335c-9180-49cf-95f7-7fb2534651c3 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:08.706784 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3560/7062] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:43:08 2022] POST /identity/v3/projects => generated 351 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:08.710952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884ae29-e56e-4840-be03-b961d086603b tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:08.758655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884ae29-e56e-4840-be03-b961d086603b tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:08.781724 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:08.971495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70e4d6-c46e-4b8a-8b61-e8cb4e66c0f2 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '501514b31f01414faa4c29abf8d4e2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fac56a6d25f40cb89e267547580e6c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:08.972047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70e4d6-c46e-4b8a-8b61-e8cb4e66c0f2 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:08.972334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70e4d6-c46e-4b8a-8b61-e8cb4e66c0f2 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:08.972611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70e4d6-c46e-4b8a-8b61-e8cb4e66c0f2 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] PATH_INFO: `/v3/users/38c8e37598f14f67b33547392348b7e8` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:08.974541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70e4d6-c46e-4b8a-8b61-e8cb4e66c0f2 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorizing `identity:get_user(user_id=38c8e37598f14f67b33547392348b7e8)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:08.978998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70e4d6-c46e-4b8a-8b61-e8cb4e66c0f2 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:08.987632 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023335c-9180-49cf-95f7-7fb2534651c3 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:08.992302 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3503/7063] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Aug 7 01:43:08 2022] GET /identity/v3/users/38c8e37598f14f67b33547392348b7e8 => generated 287 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:43:09.018172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5023335c-9180-49cf-95f7-7fb2534651c3 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:09.030010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf5772-8540-473d-a876-5d26d2cbce19 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '501514b31f01414faa4c29abf8d4e2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fac56a6d25f40cb89e267547580e6c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:09.031039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf5772-8540-473d-a876-5d26d2cbce19 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:09.031330 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf5772-8540-473d-a876-5d26d2cbce19 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:09.031756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf5772-8540-473d-a876-5d26d2cbce19 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] PATH_INFO: `/v3/credentials` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:09.033528 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf5772-8540-473d-a876-5d26d2cbce19 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:09.036034 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf5772-8540-473d-a876-5d26d2cbce19 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:09.120024 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3561/7064] 10.222.0.39 () {60 vars in 1162 bytes} [Sun Aug 7 01:43:08 2022] POST /identity/v3/credentials => generated 430 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:09.120763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70e4d6-c46e-4b8a-8b61-e8cb4e66c0f2 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:09.141170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70e4d6-c46e-4b8a-8b61-e8cb4e66c0f2 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:09.159846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ecd23-2f71-40c0-93f0-fc9a013a0b36 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '501514b31f01414faa4c29abf8d4e2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fac56a6d25f40cb89e267547580e6c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:09.160635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ecd23-2f71-40c0-93f0-fc9a013a0b36 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:09.160981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ecd23-2f71-40c0-93f0-fc9a013a0b36 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:09.161328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ecd23-2f71-40c0-93f0-fc9a013a0b36 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] PATH_INFO: `/v3/credentials/ede48cd08819e6875d82bf5b3bfd246747cf4356e0e09dad26b6e559fc4a9ad7` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:09.164806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ecd23-2f71-40c0-93f0-fc9a013a0b36 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=ede48cd08819e6875d82bf5b3bfd246747cf4356e0e09dad26b6e559fc4a9ad7)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:09.170837 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ecd23-2f71-40c0-93f0-fc9a013a0b36 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:09.177864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ecd23-2f71-40c0-93f0-fc9a013a0b36 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=ede48cd08819e6875d82bf5b3bfd246747cf4356e0e09dad26b6e559fc4a9ad7)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:09.184633 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ecd23-2f71-40c0-93f0-fc9a013a0b36 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:09.218511 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3504/7065] 10.222.0.39 () {60 vars in 1358 bytes} [Sun Aug 7 01:43:09 2022] PATCH /identity/v3/credentials/ede48cd08819e6875d82bf5b3bfd246747cf4356e0e09dad26b6e559fc4a9ad7 => generated 437 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:43:09.226240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf5772-8540-473d-a876-5d26d2cbce19 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:09.247118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf5772-8540-473d-a876-5d26d2cbce19 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:09.295170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca495b7-2822-4469-8bd8-9822575dc693 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '501514b31f01414faa4c29abf8d4e2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fac56a6d25f40cb89e267547580e6c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:09.296298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca495b7-2822-4469-8bd8-9822575dc693 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:09.296734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca495b7-2822-4469-8bd8-9822575dc693 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:09.297151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca495b7-2822-4469-8bd8-9822575dc693 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] PATH_INFO: `/v3/credentials/ede48cd08819e6875d82bf5b3bfd246747cf4356e0e09dad26b6e559fc4a9ad7` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:09.301191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca495b7-2822-4469-8bd8-9822575dc693 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=ede48cd08819e6875d82bf5b3bfd246747cf4356e0e09dad26b6e559fc4a9ad7)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:09.303176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca495b7-2822-4469-8bd8-9822575dc693 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:09.310425 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3562/7066] 10.222.0.39 () {58 vars in 1335 bytes} [Sun Aug 7 01:43:09 2022] GET /identity/v3/credentials/ede48cd08819e6875d82bf5b3bfd246747cf4356e0e09dad26b6e559fc4a9ad7 => generated 437 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:43:09.314678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ecd23-2f71-40c0-93f0-fc9a013a0b36 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:09.327261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ecd23-2f71-40c0-93f0-fc9a013a0b36 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:09.333555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97709c-b020-4fa3-a8ea-c03dbfe69423 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '501514b31f01414faa4c29abf8d4e2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fac56a6d25f40cb89e267547580e6c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:09.334205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97709c-b020-4fa3-a8ea-c03dbfe69423 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:09.334486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97709c-b020-4fa3-a8ea-c03dbfe69423 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:09.334758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97709c-b020-4fa3-a8ea-c03dbfe69423 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] PATH_INFO: `/v3/credentials/ede48cd08819e6875d82bf5b3bfd246747cf4356e0e09dad26b6e559fc4a9ad7` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:09.339315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97709c-b020-4fa3-a8ea-c03dbfe69423 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=ede48cd08819e6875d82bf5b3bfd246747cf4356e0e09dad26b6e559fc4a9ad7)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:09.341665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97709c-b020-4fa3-a8ea-c03dbfe69423 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:09.412250 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3505/7067] 10.222.0.39 () {58 vars in 1338 bytes} [Sun Aug 7 01:43:09 2022] DELETE /identity/v3/credentials/ede48cd08819e6875d82bf5b3bfd246747cf4356e0e09dad26b6e559fc4a9ad7 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:43:09.417839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca495b7-2822-4469-8bd8-9822575dc693 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:09.431723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca495b7-2822-4469-8bd8-9822575dc693 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:09.444630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309178a-2b25-4490-9d8a-588b621ee944 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '501514b31f01414faa4c29abf8d4e2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fac56a6d25f40cb89e267547580e6c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:09.446622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309178a-2b25-4490-9d8a-588b621ee944 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:09.448671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309178a-2b25-4490-9d8a-588b621ee944 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:09.449482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309178a-2b25-4490-9d8a-588b621ee944 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] PATH_INFO: `/v3/credentials` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:09.453240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309178a-2b25-4490-9d8a-588b621ee944 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:09.459783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309178a-2b25-4490-9d8a-588b621ee944 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:09.516053 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:09.541369 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3563/7068] 10.222.0.39 () {60 vars in 1162 bytes} [Sun Aug 7 01:43:09 2022] POST /identity/v3/credentials => generated 431 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:09.544852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97709c-b020-4fa3-a8ea-c03dbfe69423 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:09.559465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97709c-b020-4fa3-a8ea-c03dbfe69423 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:09.578033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f33c65-3546-45fd-b1c9-401e41548101 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '501514b31f01414faa4c29abf8d4e2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fac56a6d25f40cb89e267547580e6c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:09.578974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f33c65-3546-45fd-b1c9-401e41548101 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:09.580147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f33c65-3546-45fd-b1c9-401e41548101 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:09.581210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f33c65-3546-45fd-b1c9-401e41548101 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] PATH_INFO: `/v3/credentials` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:09.582664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f33c65-3546-45fd-b1c9-401e41548101 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:09.604121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f33c65-3546-45fd-b1c9-401e41548101 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:09.679412 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3506/7069] 10.222.0.39 () {60 vars in 1162 bytes} [Sun Aug 7 01:43:09 2022] POST /identity/v3/credentials => generated 430 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:09.680421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309178a-2b25-4490-9d8a-588b621ee944 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:09.704772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309178a-2b25-4490-9d8a-588b621ee944 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:09.729707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b6c42-fbda-4b51-8cf1-2f445095ece4 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '501514b31f01414faa4c29abf8d4e2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fac56a6d25f40cb89e267547580e6c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:09.735167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b6c42-fbda-4b51-8cf1-2f445095ece4 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:09.735696 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b6c42-fbda-4b51-8cf1-2f445095ece4 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:09.738469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b6c42-fbda-4b51-8cf1-2f445095ece4 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] PATH_INFO: `/v3/credentials` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:09.740127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b6c42-fbda-4b51-8cf1-2f445095ece4 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:09.747990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b6c42-fbda-4b51-8cf1-2f445095ece4 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:09.791739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b6c42-fbda-4b51-8cf1-2f445095ece4 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:09.797707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b6c42-fbda-4b51-8cf1-2f445095ece4 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:09.819285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b6c42-fbda-4b51-8cf1-2f445095ece4 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:09.821357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b6c42-fbda-4b51-8cf1-2f445095ece4 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:09.844560 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3564/7070] 10.222.0.39 () {58 vars in 1140 bytes} [Sun Aug 7 01:43:09 2022] GET /identity/v3/credentials => generated 946 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:43:09.846485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f33c65-3546-45fd-b1c9-401e41548101 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:09.866809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f33c65-3546-45fd-b1c9-401e41548101 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:09.898436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfba52b-bdee-44eb-85ea-69d4bfbdc49e tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '501514b31f01414faa4c29abf8d4e2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fac56a6d25f40cb89e267547580e6c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:09.899106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfba52b-bdee-44eb-85ea-69d4bfbdc49e tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:09.899382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfba52b-bdee-44eb-85ea-69d4bfbdc49e tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:09.900537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfba52b-bdee-44eb-85ea-69d4bfbdc49e tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] PATH_INFO: `/v3/credentials/9d7699cffb334760f8bb872f3575829045ccd1183906e3f213ac1a84186a0542` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:09.905446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfba52b-bdee-44eb-85ea-69d4bfbdc49e tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=9d7699cffb334760f8bb872f3575829045ccd1183906e3f213ac1a84186a0542)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:09.911842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfba52b-bdee-44eb-85ea-69d4bfbdc49e tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:09.972962 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3507/7071] 10.222.0.39 () {58 vars in 1338 bytes} [Sun Aug 7 01:43:09 2022] DELETE /identity/v3/credentials/9d7699cffb334760f8bb872f3575829045ccd1183906e3f213ac1a84186a0542 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:09.983560 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b6c42-fbda-4b51-8cf1-2f445095ece4 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:09.995710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b6c42-fbda-4b51-8cf1-2f445095ece4 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:10.023961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62678a-066f-40b3-a07b-9da80ab04572 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '501514b31f01414faa4c29abf8d4e2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fac56a6d25f40cb89e267547580e6c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:10.024628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62678a-066f-40b3-a07b-9da80ab04572 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:10.024905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62678a-066f-40b3-a07b-9da80ab04572 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:10.025237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62678a-066f-40b3-a07b-9da80ab04572 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] PATH_INFO: `/v3/credentials/b72d0ac7b1243b7bc7bf2d0c872448079fd697c6160a3a5e86af90536249830a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:10.032589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62678a-066f-40b3-a07b-9da80ab04572 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=b72d0ac7b1243b7bc7bf2d0c872448079fd697c6160a3a5e86af90536249830a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:10.035710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62678a-066f-40b3-a07b-9da80ab04572 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:10.076510 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3565/7072] 10.222.0.39 () {58 vars in 1338 bytes} [Sun Aug 7 01:43:09 2022] DELETE /identity/v3/credentials/b72d0ac7b1243b7bc7bf2d0c872448079fd697c6160a3a5e86af90536249830a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:10.078848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfba52b-bdee-44eb-85ea-69d4bfbdc49e tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:10.103647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfba52b-bdee-44eb-85ea-69d4bfbdc49e tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:10.123818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07dffb2-395b-4a91-8632-55d42f644dc9 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '501514b31f01414faa4c29abf8d4e2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fac56a6d25f40cb89e267547580e6c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:10.124494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dffb2-395b-4a91-8632-55d42f644dc9 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:10.124779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dffb2-395b-4a91-8632-55d42f644dc9 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:10.125047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07dffb2-395b-4a91-8632-55d42f644dc9 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] PATH_INFO: `/v3/projects/96cb87be6adc44479aa9c4b3ff52e1df` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:10.129034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07dffb2-395b-4a91-8632-55d42f644dc9 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorizing `identity:delete_project(project_id=96cb87be6adc44479aa9c4b3ff52e1df)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:10.131721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07dffb2-395b-4a91-8632-55d42f644dc9 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:10.248485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b07dffb2-395b-4a91-8632-55d42f644dc9 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96cb87be6adc44479aa9c4b3ff52e1df', 'request_id': 'req-b07dffb2-395b-4a91-8632-55d42f644dc9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:10.264147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b07dffb2-395b-4a91-8632-55d42f644dc9 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96cb87be6adc44479aa9c4b3ff52e1df', 'request_id': 'req-b07dffb2-395b-4a91-8632-55d42f644dc9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:10.282228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b07dffb2-395b-4a91-8632-55d42f644dc9 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96cb87be6adc44479aa9c4b3ff52e1df', 'request_id': 'req-b07dffb2-395b-4a91-8632-55d42f644dc9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:10.316037 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b07dffb2-395b-4a91-8632-55d42f644dc9 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] The token cache is being invalidate because project 96cb87be6adc44479aa9c4b3ff52e1df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:43:10.316988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b07dffb2-395b-4a91-8632-55d42f644dc9 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:10.319088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b07dffb2-395b-4a91-8632-55d42f644dc9 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:10.328149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62678a-066f-40b3-a07b-9da80ab04572 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:10.329397 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3508/7073] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:43:10 2022] DELETE /identity/v3/projects/96cb87be6adc44479aa9c4b3ff52e1df => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:43:10.331241 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-af62678a-066f-40b3-a07b-9da80ab04572 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:10.361374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62678a-066f-40b3-a07b-9da80ab04572 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:10.534369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b963ac-a061-4222-a136-5b5e55827459 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '501514b31f01414faa4c29abf8d4e2ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fac56a6d25f40cb89e267547580e6c9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:10.535168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b963ac-a061-4222-a136-5b5e55827459 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:10.536049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b963ac-a061-4222-a136-5b5e55827459 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:10.537704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b963ac-a061-4222-a136-5b5e55827459 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] PATH_INFO: `/v3/projects/a12ff73a53114db0958102f36e86aa4b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:10.540586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b963ac-a061-4222-a136-5b5e55827459 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a12ff73a53114db0958102f36e86aa4b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:10.542973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b963ac-a061-4222-a136-5b5e55827459 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:10.661197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-04b963ac-a061-4222-a136-5b5e55827459 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a12ff73a53114db0958102f36e86aa4b', 'request_id': 'req-04b963ac-a061-4222-a136-5b5e55827459'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:10.675985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-04b963ac-a061-4222-a136-5b5e55827459 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a12ff73a53114db0958102f36e86aa4b', 'request_id': 'req-04b963ac-a061-4222-a136-5b5e55827459'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:10.691522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-04b963ac-a061-4222-a136-5b5e55827459 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a12ff73a53114db0958102f36e86aa4b', 'request_id': 'req-04b963ac-a061-4222-a136-5b5e55827459'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:10.722018 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-04b963ac-a061-4222-a136-5b5e55827459 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] The token cache is being invalidate because project a12ff73a53114db0958102f36e86aa4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:43:10.723094 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-04b963ac-a061-4222-a136-5b5e55827459 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:10.725013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-04b963ac-a061-4222-a136-5b5e55827459 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:10.733034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07dffb2-395b-4a91-8632-55d42f644dc9 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:10.733557 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3566/7074] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:43:10 2022] DELETE /identity/v3/projects/a12ff73a53114db0958102f36e86aa4b => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:10.734643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b07dffb2-395b-4a91-8632-55d42f644dc9 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:10.825998 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:10.860374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07dffb2-395b-4a91-8632-55d42f644dc9 tempest-CredentialsTestJSON-1486833967 tempest-CredentialsTestJSON-1486833967-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:11.074778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0bec0-521c-4784-a57c-1a881b25358b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:11.078374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0bec0-521c-4784-a57c-1a881b25358b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:11.078836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0bec0-521c-4784-a57c-1a881b25358b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:11.079341 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0bec0-521c-4784-a57c-1a881b25358b admin admin] PATH_INFO: `/v3/users/38c8e37598f14f67b33547392348b7e8` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:11.081828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0bec0-521c-4784-a57c-1a881b25358b admin admin] RBAC: Authorizing `identity:delete_user(user_id=38c8e37598f14f67b33547392348b7e8)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:11.084568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0bec0-521c-4784-a57c-1a881b25358b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:11.177583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-52b0bec0-521c-4784-a57c-1a881b25358b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38c8e37598f14f67b33547392348b7e8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:11.200877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-52b0bec0-521c-4784-a57c-1a881b25358b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38c8e37598f14f67b33547392348b7e8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:11.244114 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-52b0bec0-521c-4784-a57c-1a881b25358b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38c8e37598f14f67b33547392348b7e8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:11.252514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-52b0bec0-521c-4784-a57c-1a881b25358b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38c8e37598f14f67b33547392348b7e8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:11.267575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-52b0bec0-521c-4784-a57c-1a881b25358b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38c8e37598f14f67b33547392348b7e8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:11.278836 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3509/7075] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:43:10 2022] DELETE /identity/v3/users/38c8e37598f14f67b33547392348b7e8 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:11.283166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afa8ed-ce06-4148-adde-c85381a89ae2 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:11.283512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afa8ed-ce06-4148-adde-c85381a89ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:11.283785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9afa8ed-ce06-4148-adde-c85381a89ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:11.331703 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d9afa8ed-ce06-4148-adde-c85381a89ae2 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:11.334856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d9afa8ed-ce06-4148-adde-c85381a89ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:11.565275 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3567/7076] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:11.626161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0bec0-521c-4784-a57c-1a881b25358b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:11.627998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-52b0bec0-521c-4784-a57c-1a881b25358b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:11.892393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0bec0-521c-4784-a57c-1a881b25358b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:11.915288 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fd910-2159-4a4a-a4af-9539e5050f94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:11.916500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fd910-2159-4a4a-a4af-9539e5050f94 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:11.922079 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fd910-2159-4a4a-a4af-9539e5050f94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:11.925738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fd910-2159-4a4a-a4af-9539e5050f94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:11.981897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7fd910-2159-4a4a-a4af-9539e5050f94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:11.989631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7fd910-2159-4a4a-a4af-9539e5050f94 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:12.029011 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3510/7077] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:43:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:43:12.114763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9afa8ed-ce06-4148-adde-c85381a89ae2 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:12.116526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d9afa8ed-ce06-4148-adde-c85381a89ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:12.124613 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:12.235438 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9afa8ed-ce06-4148-adde-c85381a89ae2 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:12.242559 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8922a7c-6c4f-4e7c-820b-ed9f9fedd2a2 tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc0a4220f0a4e36937cf4589286bdd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b07dbdc387eb41b69eb2b533f6c2a785', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:12.243556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8922a7c-6c4f-4e7c-820b-ed9f9fedd2a2 tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:12.244114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8922a7c-6c4f-4e7c-820b-ed9f9fedd2a2 tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:12.244569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8922a7c-6c4f-4e7c-820b-ed9f9fedd2a2 tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:12.245443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8922a7c-6c4f-4e7c-820b-ed9f9fedd2a2 tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:43:12.246016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8922a7c-6c4f-4e7c-820b-ed9f9fedd2a2 tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:12.248938 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8922a7c-6c4f-4e7c-820b-ed9f9fedd2a2 tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:12.263988 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3568/7078] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:43:12.268399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fd910-2159-4a4a-a4af-9539e5050f94 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:12.289646 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7fd910-2159-4a4a-a4af-9539e5050f94 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:12.302467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901f7a9-f49f-4963-b7aa-199fb4df7001 tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc0a4220f0a4e36937cf4589286bdd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b07dbdc387eb41b69eb2b533f6c2a785', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:12.303143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901f7a9-f49f-4963-b7aa-199fb4df7001 tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:12.303484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901f7a9-f49f-4963-b7aa-199fb4df7001 tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:12.303806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901f7a9-f49f-4963-b7aa-199fb4df7001 tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:12.304639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901f7a9-f49f-4963-b7aa-199fb4df7001 tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:12.306782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901f7a9-f49f-4963-b7aa-199fb4df7001 tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:12.321840 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:12.370673 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3511/7079] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:43:12 2022] POST /identity/v3/projects => generated 348 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:12.374725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8922a7c-6c4f-4e7c-820b-ed9f9fedd2a2 tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:12.402409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8922a7c-6c4f-4e7c-820b-ed9f9fedd2a2 tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:12.552898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3637778-9a03-4caa-9ee0-66829deaeb3b tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc0a4220f0a4e36937cf4589286bdd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b07dbdc387eb41b69eb2b533f6c2a785', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:12.553667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3637778-9a03-4caa-9ee0-66829deaeb3b tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:12.555245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3637778-9a03-4caa-9ee0-66829deaeb3b tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:12.555714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3637778-9a03-4caa-9ee0-66829deaeb3b tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:12.557025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3637778-9a03-4caa-9ee0-66829deaeb3b tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:43:12.559368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3637778-9a03-4caa-9ee0-66829deaeb3b tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:12.561548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3637778-9a03-4caa-9ee0-66829deaeb3b tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:12.595507 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3569/7080] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:43:13.499113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901f7a9-f49f-4963-b7aa-199fb4df7001 tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:13.522274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901f7a9-f49f-4963-b7aa-199fb4df7001 tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:13.549617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d888e2-af60-44b8-8c61-dbefa6a3d819 tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dc0a4220f0a4e36937cf4589286bdd4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b07dbdc387eb41b69eb2b533f6c2a785', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:13.550296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d888e2-af60-44b8-8c61-dbefa6a3d819 tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:13.550579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d888e2-af60-44b8-8c61-dbefa6a3d819 tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:13.550851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d888e2-af60-44b8-8c61-dbefa6a3d819 tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] PATH_INFO: `/v3/projects/0e1963c61f714200affe9543b33c019e` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:13.554939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d888e2-af60-44b8-8c61-dbefa6a3d819 tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0e1963c61f714200affe9543b33c019e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:13.556941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d888e2-af60-44b8-8c61-dbefa6a3d819 tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:13.721273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-65d888e2-af60-44b8-8c61-dbefa6a3d819 tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e1963c61f714200affe9543b33c019e', 'request_id': 'req-65d888e2-af60-44b8-8c61-dbefa6a3d819'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:13.733474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-65d888e2-af60-44b8-8c61-dbefa6a3d819 tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e1963c61f714200affe9543b33c019e', 'request_id': 'req-65d888e2-af60-44b8-8c61-dbefa6a3d819'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:13.747557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-65d888e2-af60-44b8-8c61-dbefa6a3d819 tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e1963c61f714200affe9543b33c019e', 'request_id': 'req-65d888e2-af60-44b8-8c61-dbefa6a3d819'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:13.774263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-65d888e2-af60-44b8-8c61-dbefa6a3d819 tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] The token cache is being invalidate because project 0e1963c61f714200affe9543b33c019e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:43:13.774702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-65d888e2-af60-44b8-8c61-dbefa6a3d819 tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:13.775335 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-65d888e2-af60-44b8-8c61-dbefa6a3d819 tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:13.781477 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3512/7081] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:43:13 2022] DELETE /identity/v3/projects/0e1963c61f714200affe9543b33c019e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:13.791092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3637778-9a03-4caa-9ee0-66829deaeb3b tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:13.792899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d3637778-9a03-4caa-9ee0-66829deaeb3b tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:13.998549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3637778-9a03-4caa-9ee0-66829deaeb3b tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:14.029090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d888e2-af60-44b8-8c61-dbefa6a3d819 tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:14.031492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-65d888e2-af60-44b8-8c61-dbefa6a3d819 tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:14.257825 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:14.268615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d293dd-73f0-4c5f-b286-dc0ae646d7c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:14.269248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d293dd-73f0-4c5f-b286-dc0ae646d7c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:14.269513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d293dd-73f0-4c5f-b286-dc0ae646d7c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:14.269781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d293dd-73f0-4c5f-b286-dc0ae646d7c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:14.276063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-54d293dd-73f0-4c5f-b286-dc0ae646d7c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:14.332788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d888e2-af60-44b8-8c61-dbefa6a3d819 tempest-RoutersAdminTest-1473123381 tempest-RoutersAdminTest-1473123381-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:14.367832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e564c9-d458-4461-9dbf-adf97f24f56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:14.369447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e564c9-d458-4461-9dbf-adf97f24f56e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:14.370538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e564c9-d458-4461-9dbf-adf97f24f56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:14.373473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e564c9-d458-4461-9dbf-adf97f24f56e admin admin] PATH_INFO: `/v3/projects/ec1c5cf15df14834bb2aa7470da6f21e` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:14.379350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e564c9-d458-4461-9dbf-adf97f24f56e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec1c5cf15df14834bb2aa7470da6f21e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:14.386242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e564c9-d458-4461-9dbf-adf97f24f56e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:14.425410 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d293dd-73f0-4c5f-b286-dc0ae646d7c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:14.426896 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d293dd-73f0-4c5f-b286-dc0ae646d7c4 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:14.452332 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3570/7082] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:43:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:43:14.542206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-32e564c9-d458-4461-9dbf-adf97f24f56e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec1c5cf15df14834bb2aa7470da6f21e', 'request_id': 'req-32e564c9-d458-4461-9dbf-adf97f24f56e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:14.580248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-32e564c9-d458-4461-9dbf-adf97f24f56e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec1c5cf15df14834bb2aa7470da6f21e', 'request_id': 'req-32e564c9-d458-4461-9dbf-adf97f24f56e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:14.593045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-32e564c9-d458-4461-9dbf-adf97f24f56e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec1c5cf15df14834bb2aa7470da6f21e', 'request_id': 'req-32e564c9-d458-4461-9dbf-adf97f24f56e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:14.608849 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=83,keystone:INSERT=3,keystone:DELETE=14 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:14.616602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-32e564c9-d458-4461-9dbf-adf97f24f56e admin admin] The token cache is being invalidate because project ec1c5cf15df14834bb2aa7470da6f21e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:43:14.617159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-32e564c9-d458-4461-9dbf-adf97f24f56e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:14.618111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-32e564c9-d458-4461-9dbf-adf97f24f56e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:14.621190 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3513/7083] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:43:14 2022] DELETE /identity/v3/projects/ec1c5cf15df14834bb2aa7470da6f21e => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:14.624996 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d293dd-73f0-4c5f-b286-dc0ae646d7c4 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:14.642094 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d293dd-73f0-4c5f-b286-dc0ae646d7c4 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:14.735694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5685e-b66a-4456-98d9-0f2f01a226e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:14.736790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5685e-b66a-4456-98d9-0f2f01a226e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:14.737896 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5685e-b66a-4456-98d9-0f2f01a226e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:14.738690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5685e-b66a-4456-98d9-0f2f01a226e9 admin admin] PATH_INFO: `/v3/users/501514b31f01414faa4c29abf8d4e2ec` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:14.740524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5685e-b66a-4456-98d9-0f2f01a226e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=501514b31f01414faa4c29abf8d4e2ec)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:14.742964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5685e-b66a-4456-98d9-0f2f01a226e9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:14.825106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-34b5685e-b66a-4456-98d9-0f2f01a226e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '501514b31f01414faa4c29abf8d4e2ec'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:14.837284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-34b5685e-b66a-4456-98d9-0f2f01a226e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '501514b31f01414faa4c29abf8d4e2ec'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:14.854013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-34b5685e-b66a-4456-98d9-0f2f01a226e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '501514b31f01414faa4c29abf8d4e2ec'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:14.855428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-34b5685e-b66a-4456-98d9-0f2f01a226e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '501514b31f01414faa4c29abf8d4e2ec'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:14.867659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-34b5685e-b66a-4456-98d9-0f2f01a226e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '501514b31f01414faa4c29abf8d4e2ec'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:14.880132 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3571/7084] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:43:14 2022] DELETE /identity/v3/users/501514b31f01414faa4c29abf8d4e2ec => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:15.493291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e564c9-d458-4461-9dbf-adf97f24f56e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:15.495040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-32e564c9-d458-4461-9dbf-adf97f24f56e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:15.534834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e564c9-d458-4461-9dbf-adf97f24f56e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:15.536630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5685e-b66a-4456-98d9-0f2f01a226e9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:15.540500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-34b5685e-b66a-4456-98d9-0f2f01a226e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:15.648222 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:15.750975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43324e6-74f8-498e-ba4a-1fb52a84a900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:15.751686 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43324e6-74f8-498e-ba4a-1fb52a84a900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:15.751912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43324e6-74f8-498e-ba4a-1fb52a84a900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:15.752476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43324e6-74f8-498e-ba4a-1fb52a84a900 admin admin] PATH_INFO: `/v3/users/0285118c54824726a6a581fc56684371` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:15.753970 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43324e6-74f8-498e-ba4a-1fb52a84a900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0285118c54824726a6a581fc56684371)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:15.757374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43324e6-74f8-498e-ba4a-1fb52a84a900 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:15.804013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5685e-b66a-4456-98d9-0f2f01a226e9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:15.823789 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c0daa-0e0e-450e-88c8-507fb9b41a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:15.825633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c0daa-0e0e-450e-88c8-507fb9b41a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:15.826225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c0daa-0e0e-450e-88c8-507fb9b41a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:15.829364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c0daa-0e0e-450e-88c8-507fb9b41a2e admin admin] PATH_INFO: `/v3/users/695bf6ad66ae44a1a9d84b638fe544d4` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:15.832876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c0daa-0e0e-450e-88c8-507fb9b41a2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=695bf6ad66ae44a1a9d84b638fe544d4)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:15.835662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c0daa-0e0e-450e-88c8-507fb9b41a2e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:15.912799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a43324e6-74f8-498e-ba4a-1fb52a84a900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0285118c54824726a6a581fc56684371'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:15.936299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a43324e6-74f8-498e-ba4a-1fb52a84a900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0285118c54824726a6a581fc56684371'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:16.011128 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a43324e6-74f8-498e-ba4a-1fb52a84a900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0285118c54824726a6a581fc56684371'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:16.012736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a43324e6-74f8-498e-ba4a-1fb52a84a900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0285118c54824726a6a581fc56684371'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:16.017731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d17c0daa-0e0e-450e-88c8-507fb9b41a2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '695bf6ad66ae44a1a9d84b638fe544d4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:16.040355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a43324e6-74f8-498e-ba4a-1fb52a84a900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0285118c54824726a6a581fc56684371'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:16.061182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d17c0daa-0e0e-450e-88c8-507fb9b41a2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '695bf6ad66ae44a1a9d84b638fe544d4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:16.072977 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3514/7085] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:43:15 2022] DELETE /identity/v3/users/0285118c54824726a6a581fc56684371 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:16.077382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2d0c4-bdce-46f5-9773-4f07b3b856fb None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:16.077942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2d0c4-bdce-46f5-9773-4f07b3b856fb None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:16.078461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2d0c4-bdce-46f5-9773-4f07b3b856fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:16.096900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d17c0daa-0e0e-450e-88c8-507fb9b41a2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '695bf6ad66ae44a1a9d84b638fe544d4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:16.098077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d17c0daa-0e0e-450e-88c8-507fb9b41a2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '695bf6ad66ae44a1a9d84b638fe544d4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:16.119539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d17c0daa-0e0e-450e-88c8-507fb9b41a2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '695bf6ad66ae44a1a9d84b638fe544d4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:16.141846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-77d2d0c4-bdce-46f5-9773-4f07b3b856fb None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:16.144415 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3572/7086] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:43:15 2022] DELETE /identity/v3/users/695bf6ad66ae44a1a9d84b638fe544d4 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:16.146160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-77d2d0c4-bdce-46f5-9773-4f07b3b856fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:16.149664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20aac1-065b-4a03-b0a2-9dc0a1095af3 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:16.150795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20aac1-065b-4a03-b0a2-9dc0a1095af3 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:16.151632 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20aac1-065b-4a03-b0a2-9dc0a1095af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:16.224546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2e20aac1-065b-4a03-b0a2-9dc0a1095af3 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:16.230345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2e20aac1-065b-4a03-b0a2-9dc0a1095af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:16.339466 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3515/7087] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:16.378026 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3573/7088] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:16.435486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2d0c4-bdce-46f5-9773-4f07b3b856fb None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:16.437531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-77d2d0c4-bdce-46f5-9773-4f07b3b856fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:16.444655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20aac1-065b-4a03-b0a2-9dc0a1095af3 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:16.446844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2e20aac1-065b-4a03-b0a2-9dc0a1095af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:16.491031 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:16.586701 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:16.610857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2d0c4-bdce-46f5-9773-4f07b3b856fb None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:16.618756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20aac1-065b-4a03-b0a2-9dc0a1095af3 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:16.624658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ff223-0635-481a-951e-b1ab466c3820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:16.625629 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ff223-0635-481a-951e-b1ab466c3820 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:16.626714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ff223-0635-481a-951e-b1ab466c3820 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:16.627668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ff223-0635-481a-951e-b1ab466c3820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:16.628991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68132cfd-6b35-4551-8520-70125d3a1d57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:16.629631 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68132cfd-6b35-4551-8520-70125d3a1d57 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:16.629905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68132cfd-6b35-4551-8520-70125d3a1d57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:16.630180 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68132cfd-6b35-4551-8520-70125d3a1d57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:16.649205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68132cfd-6b35-4551-8520-70125d3a1d57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:16.652330 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68132cfd-6b35-4551-8520-70125d3a1d57 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:16.655670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ff223-0635-481a-951e-b1ab466c3820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:16.660355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ff223-0635-481a-951e-b1ab466c3820 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:16.681419 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3574/7089] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:43:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:43:16.690629 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3516/7090] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:43:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:43:18.155273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68132cfd-6b35-4551-8520-70125d3a1d57 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:18.157505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-68132cfd-6b35-4551-8520-70125d3a1d57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:18.185449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68132cfd-6b35-4551-8520-70125d3a1d57 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:18.199267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e9e84-5b92-4e6e-b3b4-131d5390b792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:18.201416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e9e84-5b92-4e6e-b3b4-131d5390b792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:18.203730 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e9e84-5b92-4e6e-b3b4-131d5390b792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:18.205600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e9e84-5b92-4e6e-b3b4-131d5390b792 admin admin] PATH_INFO: `/v3/projects/2fbf3163292141a4abd872c2164eb172` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:18.209550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e9e84-5b92-4e6e-b3b4-131d5390b792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fbf3163292141a4abd872c2164eb172)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:18.213723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e9e84-5b92-4e6e-b3b4-131d5390b792 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:18.359200 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-490e9e84-5b92-4e6e-b3b4-131d5390b792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fbf3163292141a4abd872c2164eb172', 'request_id': 'req-490e9e84-5b92-4e6e-b3b4-131d5390b792'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:18.389205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-490e9e84-5b92-4e6e-b3b4-131d5390b792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fbf3163292141a4abd872c2164eb172', 'request_id': 'req-490e9e84-5b92-4e6e-b3b4-131d5390b792'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:18.411327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-490e9e84-5b92-4e6e-b3b4-131d5390b792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fbf3163292141a4abd872c2164eb172', 'request_id': 'req-490e9e84-5b92-4e6e-b3b4-131d5390b792'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:18.449624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-490e9e84-5b92-4e6e-b3b4-131d5390b792 admin admin] The token cache is being invalidate because project 2fbf3163292141a4abd872c2164eb172 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:43:18.450473 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-490e9e84-5b92-4e6e-b3b4-131d5390b792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:18.451315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-490e9e84-5b92-4e6e-b3b4-131d5390b792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:18.457864 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3575/7091] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:43:18 2022] DELETE /identity/v3/projects/2fbf3163292141a4abd872c2164eb172 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:18.458566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ff223-0635-481a-951e-b1ab466c3820 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:18.479826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ff223-0635-481a-951e-b1ab466c3820 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:18.663251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e43603-b583-4a2b-a8eb-02d74a21c83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:18.664071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e43603-b583-4a2b-a8eb-02d74a21c83f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:18.664459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e43603-b583-4a2b-a8eb-02d74a21c83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:18.664831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e43603-b583-4a2b-a8eb-02d74a21c83f admin admin] PATH_INFO: `/v3/users/13147f2e3dff4b6bbec260d9c9e5bd24` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:18.686345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e43603-b583-4a2b-a8eb-02d74a21c83f admin admin] RBAC: Authorizing `identity:delete_user(user_id=13147f2e3dff4b6bbec260d9c9e5bd24)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:18.697473 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e9e84-5b92-4e6e-b3b4-131d5390b792 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:18.699212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-490e9e84-5b92-4e6e-b3b4-131d5390b792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:18.713582 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e43603-b583-4a2b-a8eb-02d74a21c83f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:18.751280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e9e84-5b92-4e6e-b3b4-131d5390b792 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:18.785045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472f9f8-9686-4fc4-ac43-b7c246d978c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:18.785725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472f9f8-9686-4fc4-ac43-b7c246d978c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:18.786003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472f9f8-9686-4fc4-ac43-b7c246d978c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:18.786279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472f9f8-9686-4fc4-ac43-b7c246d978c0 admin admin] PATH_INFO: `/v3/projects/1fac56a6d25f40cb89e267547580e6c9` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:18.788888 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472f9f8-9686-4fc4-ac43-b7c246d978c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fac56a6d25f40cb89e267547580e6c9)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:18.791620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472f9f8-9686-4fc4-ac43-b7c246d978c0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:18.900744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-58e43603-b583-4a2b-a8eb-02d74a21c83f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13147f2e3dff4b6bbec260d9c9e5bd24'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:18.927063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-58e43603-b583-4a2b-a8eb-02d74a21c83f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13147f2e3dff4b6bbec260d9c9e5bd24'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:18.938172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b472f9f8-9686-4fc4-ac43-b7c246d978c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fac56a6d25f40cb89e267547580e6c9', 'request_id': 'req-b472f9f8-9686-4fc4-ac43-b7c246d978c0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:18.976304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b472f9f8-9686-4fc4-ac43-b7c246d978c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fac56a6d25f40cb89e267547580e6c9', 'request_id': 'req-b472f9f8-9686-4fc4-ac43-b7c246d978c0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:18.993797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-58e43603-b583-4a2b-a8eb-02d74a21c83f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13147f2e3dff4b6bbec260d9c9e5bd24'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:18.997528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-58e43603-b583-4a2b-a8eb-02d74a21c83f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13147f2e3dff4b6bbec260d9c9e5bd24'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:19.004670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b472f9f8-9686-4fc4-ac43-b7c246d978c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fac56a6d25f40cb89e267547580e6c9', 'request_id': 'req-b472f9f8-9686-4fc4-ac43-b7c246d978c0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:19.026501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-58e43603-b583-4a2b-a8eb-02d74a21c83f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13147f2e3dff4b6bbec260d9c9e5bd24'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:19.047739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b472f9f8-9686-4fc4-ac43-b7c246d978c0 admin admin] The token cache is being invalidate because project 1fac56a6d25f40cb89e267547580e6c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:43:19.048105 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3517/7092] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:43:18 2022] DELETE /identity/v3/users/13147f2e3dff4b6bbec260d9c9e5bd24 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:43:19.048880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b472f9f8-9686-4fc4-ac43-b7c246d978c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:19.049788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b472f9f8-9686-4fc4-ac43-b7c246d978c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:19.053925 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3576/7093] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:43:18 2022] DELETE /identity/v3/projects/1fac56a6d25f40cb89e267547580e6c9 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:19.057910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74e9ae-bcb5-494a-9eb2-c820deeeb908 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:19.058382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74e9ae-bcb5-494a-9eb2-c820deeeb908 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:19.058668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74e9ae-bcb5-494a-9eb2-c820deeeb908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:19.151211 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7f74e9ae-bcb5-494a-9eb2-c820deeeb908 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:19.155618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7f74e9ae-bcb5-494a-9eb2-c820deeeb908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:19.292914 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:19.357133 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3518/7094] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:19.368286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef61df7-f420-440e-ae39-72f93548027a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:19.368861 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef61df7-f420-440e-ae39-72f93548027a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:19.368957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef61df7-f420-440e-ae39-72f93548027a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:19.430023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1ef61df7-f420-440e-ae39-72f93548027a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:19.432985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1ef61df7-f420-440e-ae39-72f93548027a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:19.479761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74e9ae-bcb5-494a-9eb2-c820deeeb908 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:19.481888 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7f74e9ae-bcb5-494a-9eb2-c820deeeb908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:19.511581 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3577/7095] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:19.513062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef61df7-f420-440e-ae39-72f93548027a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:19.534361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74e9ae-bcb5-494a-9eb2-c820deeeb908 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:19.555027 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef61df7-f420-440e-ae39-72f93548027a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:19.556750 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812483a-ab78-4b55-99b1-8c19ff9c1fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:19.558671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812483a-ab78-4b55-99b1-8c19ff9c1fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:19.558954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812483a-ab78-4b55-99b1-8c19ff9c1fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:19.559310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812483a-ab78-4b55-99b1-8c19ff9c1fd1 admin admin] PATH_INFO: `/v3/projects/11c230b991b04e8da7e4bdfa19b546e5` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:19.577012 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c812483a-ab78-4b55-99b1-8c19ff9c1fd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11c230b991b04e8da7e4bdfa19b546e5)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:19.581315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcaed9-30b7-48ce-afb4-7648f2db709b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:19.581823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcaed9-30b7-48ce-afb4-7648f2db709b admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:19.582117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcaed9-30b7-48ce-afb4-7648f2db709b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:19.582397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcaed9-30b7-48ce-afb4-7648f2db709b admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:19.583060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcaed9-30b7-48ce-afb4-7648f2db709b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:43:19.583376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcaed9-30b7-48ce-afb4-7648f2db709b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:19.585002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcaed9-30b7-48ce-afb4-7648f2db709b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:19.585838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c812483a-ab78-4b55-99b1-8c19ff9c1fd1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:19.637454 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3578/7096] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:43:19.640097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcaed9-30b7-48ce-afb4-7648f2db709b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:19.677894 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcaed9-30b7-48ce-afb4-7648f2db709b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:19.701924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ffffd-969a-4023-ab41-c27848a4cdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:19.705502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ffffd-969a-4023-ab41-c27848a4cdce admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:19.706120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ffffd-969a-4023-ab41-c27848a4cdce admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:19.706489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ffffd-969a-4023-ab41-c27848a4cdce admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:19.708240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ffffd-969a-4023-ab41-c27848a4cdce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:19.716893 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ffffd-969a-4023-ab41-c27848a4cdce admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:19.738898 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c812483a-ab78-4b55-99b1-8c19ff9c1fd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11c230b991b04e8da7e4bdfa19b546e5', 'request_id': 'req-c812483a-ab78-4b55-99b1-8c19ff9c1fd1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:19.747251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c812483a-ab78-4b55-99b1-8c19ff9c1fd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11c230b991b04e8da7e4bdfa19b546e5', 'request_id': 'req-c812483a-ab78-4b55-99b1-8c19ff9c1fd1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:19.755808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c812483a-ab78-4b55-99b1-8c19ff9c1fd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11c230b991b04e8da7e4bdfa19b546e5', 'request_id': 'req-c812483a-ab78-4b55-99b1-8c19ff9c1fd1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:19.775674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c812483a-ab78-4b55-99b1-8c19ff9c1fd1 admin admin] The token cache is being invalidate because project 11c230b991b04e8da7e4bdfa19b546e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:43:19.789967 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c812483a-ab78-4b55-99b1-8c19ff9c1fd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:19.792326 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c812483a-ab78-4b55-99b1-8c19ff9c1fd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:19.803059 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3519/7097] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:43:19 2022] DELETE /identity/v3/projects/11c230b991b04e8da7e4bdfa19b546e5 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:19.804161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812483a-ab78-4b55-99b1-8c19ff9c1fd1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:19.807115 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c812483a-ab78-4b55-99b1-8c19ff9c1fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:19.823290 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3579/7098] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:43:19 2022] POST /identity/v3/projects => generated 369 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:19.825463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ffffd-969a-4023-ab41-c27848a4cdce admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:19.828966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-678ffffd-969a-4023-ab41-c27848a4cdce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:19.847834 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:20.000407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ffffd-969a-4023-ab41-c27848a4cdce admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:20.004355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812483a-ab78-4b55-99b1-8c19ff9c1fd1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:20.006291 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78106c09-05de-4708-9617-582c3c795ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:20.007603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78106c09-05de-4708-9617-582c3c795ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:20.007932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78106c09-05de-4708-9617-582c3c795ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:20.008191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78106c09-05de-4708-9617-582c3c795ae2 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:20.008832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78106c09-05de-4708-9617-582c3c795ae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:20.012002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78106c09-05de-4708-9617-582c3c795ae2 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:20.021608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a87cb6-6f0a-4586-924b-42ec77fdc027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:20.022625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a87cb6-6f0a-4586-924b-42ec77fdc027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:20.022625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a87cb6-6f0a-4586-924b-42ec77fdc027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:20.022859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a87cb6-6f0a-4586-924b-42ec77fdc027 admin admin] PATH_INFO: `/v3/users/dbd16ee9afe4431cb37ad02e50fa69d2` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:20.024795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a87cb6-6f0a-4586-924b-42ec77fdc027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbd16ee9afe4431cb37ad02e50fa69d2)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:20.026795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a87cb6-6f0a-4586-924b-42ec77fdc027 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:20.043732 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3580/7099] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:43:19 2022] POST /identity/v3/users => generated 285 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:20.044989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78106c09-05de-4708-9617-582c3c795ae2 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:20.053145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-78106c09-05de-4708-9617-582c3c795ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:20.079791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78106c09-05de-4708-9617-582c3c795ae2 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:20.109816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243296e-2de8-4530-8ba7-3c9e14d0e458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:20.110465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243296e-2de8-4530-8ba7-3c9e14d0e458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:20.110755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243296e-2de8-4530-8ba7-3c9e14d0e458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:20.111007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243296e-2de8-4530-8ba7-3c9e14d0e458 admin admin] PATH_INFO: `/v3/projects/94fb04fbf396497594534215101b856b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:20.116802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243296e-2de8-4530-8ba7-3c9e14d0e458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94fb04fbf396497594534215101b856b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:20.123424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243296e-2de8-4530-8ba7-3c9e14d0e458 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:20.138339 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e2a87cb6-6f0a-4586-924b-42ec77fdc027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbd16ee9afe4431cb37ad02e50fa69d2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:20.154135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e2a87cb6-6f0a-4586-924b-42ec77fdc027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbd16ee9afe4431cb37ad02e50fa69d2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:20.167105 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:20.176487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e2a87cb6-6f0a-4586-924b-42ec77fdc027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbd16ee9afe4431cb37ad02e50fa69d2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:20.179300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e2a87cb6-6f0a-4586-924b-42ec77fdc027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbd16ee9afe4431cb37ad02e50fa69d2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:20.203150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e2a87cb6-6f0a-4586-924b-42ec77fdc027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbd16ee9afe4431cb37ad02e50fa69d2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:20.228938 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3520/7100] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:43:19 2022] DELETE /identity/v3/users/dbd16ee9afe4431cb37ad02e50fa69d2 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:20.230951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a87cb6-6f0a-4586-924b-42ec77fdc027 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:20.237081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e2a87cb6-6f0a-4586-924b-42ec77fdc027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:20.304560 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b243296e-2de8-4530-8ba7-3c9e14d0e458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94fb04fbf396497594534215101b856b', 'request_id': 'req-b243296e-2de8-4530-8ba7-3c9e14d0e458'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:20.336958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b243296e-2de8-4530-8ba7-3c9e14d0e458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94fb04fbf396497594534215101b856b', 'request_id': 'req-b243296e-2de8-4530-8ba7-3c9e14d0e458'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:20.365619 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b243296e-2de8-4530-8ba7-3c9e14d0e458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94fb04fbf396497594534215101b856b', 'request_id': 'req-b243296e-2de8-4530-8ba7-3c9e14d0e458'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:20.407417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b243296e-2de8-4530-8ba7-3c9e14d0e458 admin admin] The token cache is being invalidate because project 94fb04fbf396497594534215101b856b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:43:20.409251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b243296e-2de8-4530-8ba7-3c9e14d0e458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:20.411273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b243296e-2de8-4530-8ba7-3c9e14d0e458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:20.416209 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3581/7101] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:43:20 2022] DELETE /identity/v3/projects/94fb04fbf396497594534215101b856b => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:20.423067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1bf91-4ab6-432f-b454-60b391caf665 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:20.423606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1bf91-4ab6-432f-b454-60b391caf665 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:20.424203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1bf91-4ab6-432f-b454-60b391caf665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:20.427129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a87cb6-6f0a-4586-924b-42ec77fdc027 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:20.476115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-50e1bf91-4ab6-432f-b454-60b391caf665 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:20.477627 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-50e1bf91-4ab6-432f-b454-60b391caf665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:20.577311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc1833-3d0d-455a-ad50-64d72e04d49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:20.578713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc1833-3d0d-455a-ad50-64d72e04d49c admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:20.579098 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc1833-3d0d-455a-ad50-64d72e04d49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:20.580696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc1833-3d0d-455a-ad50-64d72e04d49c admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:20.586067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc1833-3d0d-455a-ad50-64d72e04d49c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:20.592134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc1833-3d0d-455a-ad50-64d72e04d49c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:20.629979 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3521/7102] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:20.631319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc1833-3d0d-455a-ad50-64d72e04d49c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:20.640131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-12fc1833-3d0d-455a-ad50-64d72e04d49c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:20.667749 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3582/7103] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:20.678043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36ecf7-6b66-4af9-bdf3-ac32018a35e8 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:20.678514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36ecf7-6b66-4af9-bdf3-ac32018a35e8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:20.678932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36ecf7-6b66-4af9-bdf3-ac32018a35e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:20.682654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc1833-3d0d-455a-ad50-64d72e04d49c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:20.705322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d06647-59c6-4004-a8a9-1d76f91e9aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:20.706277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d06647-59c6-4004-a8a9-1d76f91e9aac admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:20.706735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d06647-59c6-4004-a8a9-1d76f91e9aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:20.707181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d06647-59c6-4004-a8a9-1d76f91e9aac admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:20.708048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d06647-59c6-4004-a8a9-1d76f91e9aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:20.712675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d06647-59c6-4004-a8a9-1d76f91e9aac admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:20.734549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0a36ecf7-6b66-4af9-bdf3-ac32018a35e8 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:20.738967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0a36ecf7-6b66-4af9-bdf3-ac32018a35e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:20.746024 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3522/7104] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:20.752615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d06647-59c6-4004-a8a9-1d76f91e9aac admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:20.770071 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3583/7105] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:20.774268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36ecf7-6b66-4af9-bdf3-ac32018a35e8 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:20.781091 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d06647-59c6-4004-a8a9-1d76f91e9aac admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:20.796999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67fda77-ff29-4604-a155-39161d43c68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:20.797699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fda77-ff29-4604-a155-39161d43c68c admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:20.797980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fda77-ff29-4604-a155-39161d43c68c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:20.798256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fda77-ff29-4604-a155-39161d43c68c admin admin] PATH_INFO: `/v3/projects/53b35fdaf25b46ddb4fed99a4eba9dd3/users/e35a3bf8b67943ca9d9661728e3a6859/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:20.802299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36ecf7-6b66-4af9-bdf3-ac32018a35e8 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:20.822184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe712a7-65e5-4d5f-a782-e0503c6ab17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:20.825621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe712a7-65e5-4d5f-a782-e0503c6ab17c admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:20.826052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe712a7-65e5-4d5f-a782-e0503c6ab17c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:20.827198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe712a7-65e5-4d5f-a782-e0503c6ab17c admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:20.829647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe712a7-65e5-4d5f-a782-e0503c6ab17c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:43:20.830773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe712a7-65e5-4d5f-a782-e0503c6ab17c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:20.834581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe712a7-65e5-4d5f-a782-e0503c6ab17c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:20.850816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67fda77-ff29-4604-a155-39161d43c68c admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b35fdaf25b46ddb4fed99a4eba9dd3, user_id=e35a3bf8b67943ca9d9661728e3a6859, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:20.859088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67fda77-ff29-4604-a155-39161d43c68c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:20.875503 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3584/7106] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:43:20.885367 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3523/7107] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:43:20 2022] PUT /identity/v3/projects/53b35fdaf25b46ddb4fed99a4eba9dd3/users/e35a3bf8b67943ca9d9661728e3a6859/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:20.898763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8d0cd-3917-49bd-9865-ef6f6a8a4baf None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:20.899261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8d0cd-3917-49bd-9865-ef6f6a8a4baf None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:20.899420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe712a7-65e5-4d5f-a782-e0503c6ab17c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:20.899978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8d0cd-3917-49bd-9865-ef6f6a8a4baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:20.923650 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:20.935487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe712a7-65e5-4d5f-a782-e0503c6ab17c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:20.960209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-f2c8d0cd-3917-49bd-9865-ef6f6a8a4baf None None] MFA Rules not processed for user `e35a3bf8b67943ca9d9661728e3a6859`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:20.961905 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f2c8d0cd-3917-49bd-9865-ef6f6a8a4baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:21.060950 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4c5be-d4cc-4731-ad25-b726cbc28a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:21.062424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4c5be-d4cc-4731-ad25-b726cbc28a34 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:21.063581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4c5be-d4cc-4731-ad25-b726cbc28a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:21.064752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4c5be-d4cc-4731-ad25-b726cbc28a34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:21.065837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4c5be-d4cc-4731-ad25-b726cbc28a34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:21.073923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4c5be-d4cc-4731-ad25-b726cbc28a34 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:21.102143 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:21.164834 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3524/7108] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:43:21.166139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8d0cd-3917-49bd-9865-ef6f6a8a4baf None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:21.179734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8d0cd-3917-49bd-9865-ef6f6a8a4baf None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:21.187229 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392e337-d75c-4f8c-a890-8e85f86541e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:21.188141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392e337-d75c-4f8c-a890-8e85f86541e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:21.188422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392e337-d75c-4f8c-a890-8e85f86541e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:21.188694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392e337-d75c-4f8c-a890-8e85f86541e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:21.197075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392e337-d75c-4f8c-a890-8e85f86541e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:21.199234 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392e337-d75c-4f8c-a890-8e85f86541e2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:21.220488 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3585/7109] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:43:20 2022] POST /identity/v3/projects => generated 379 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:21.225998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4c5be-d4cc-4731-ad25-b726cbc28a34 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:21.313530 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3525/7110] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:43:21 2022] POST /identity/v3/projects => generated 367 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:21.314590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392e337-d75c-4f8c-a890-8e85f86541e2 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:21.441391 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4c5be-d4cc-4731-ad25-b726cbc28a34 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:21.523266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392e337-d75c-4f8c-a890-8e85f86541e2 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:21.531681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287636b-326e-4295-838f-c5629c61d087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:21.532348 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287636b-326e-4295-838f-c5629c61d087 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:21.532630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287636b-326e-4295-838f-c5629c61d087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:21.532901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287636b-326e-4295-838f-c5629c61d087 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:21.533879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287636b-326e-4295-838f-c5629c61d087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:21.535482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287636b-326e-4295-838f-c5629c61d087 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:21.598706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55bf28-d7bc-4adb-9532-c0235c68ac89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:21.599354 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55bf28-d7bc-4adb-9532-c0235c68ac89 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:21.599620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55bf28-d7bc-4adb-9532-c0235c68ac89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:21.599910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55bf28-d7bc-4adb-9532-c0235c68ac89 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:21.604553 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3526/7111] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:43:21 2022] POST /identity/v3/users => generated 290 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:21.605528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287636b-326e-4295-838f-c5629c61d087 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:21.606947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd55bf28-d7bc-4adb-9532-c0235c68ac89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:21.611694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd55bf28-d7bc-4adb-9532-c0235c68ac89 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:21.639070 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287636b-326e-4295-838f-c5629c61d087 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:21.655522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900ecab-867a-4cee-b4e1-469f4b07d371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:21.656185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900ecab-867a-4cee-b4e1-469f4b07d371 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:21.656465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900ecab-867a-4cee-b4e1-469f4b07d371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:21.656738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900ecab-867a-4cee-b4e1-469f4b07d371 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:21.657402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b900ecab-867a-4cee-b4e1-469f4b07d371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:21.659037 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b900ecab-867a-4cee-b4e1-469f4b07d371 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:21.688946 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3586/7112] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:43:21 2022] POST /identity/v3/users => generated 290 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:21.689971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55bf28-d7bc-4adb-9532-c0235c68ac89 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:21.707813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55bf28-d7bc-4adb-9532-c0235c68ac89 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:21.715896 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23979aac-b381-4ca6-811c-b844e7335e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:21.716930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23979aac-b381-4ca6-811c-b844e7335e38 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:21.717626 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3527/7113] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:21.718251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23979aac-b381-4ca6-811c-b844e7335e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:21.718567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23979aac-b381-4ca6-811c-b844e7335e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:21.720046 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23979aac-b381-4ca6-811c-b844e7335e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:21.722025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900ecab-867a-4cee-b4e1-469f4b07d371 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:21.722368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23979aac-b381-4ca6-811c-b844e7335e38 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:21.743783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900ecab-867a-4cee-b4e1-469f4b07d371 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:21.749972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157b472-08d5-4b45-8f1b-53485ca37e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:21.754700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157b472-08d5-4b45-8f1b-53485ca37e02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:21.755012 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3587/7114] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:21.758657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157b472-08d5-4b45-8f1b-53485ca37e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:21.759220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157b472-08d5-4b45-8f1b-53485ca37e02 admin admin] PATH_INFO: `/v3/projects/5766186388934b52bf2c54053d288856/users/d1c15e47c5694a2c8b58271cf731c565/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:21.763068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23979aac-b381-4ca6-811c-b844e7335e38 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:21.783848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157b472-08d5-4b45-8f1b-53485ca37e02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5766186388934b52bf2c54053d288856, user_id=d1c15e47c5694a2c8b58271cf731c565, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:21.787337 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157b472-08d5-4b45-8f1b-53485ca37e02 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:21.788358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23979aac-b381-4ca6-811c-b844e7335e38 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:21.805214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f7add-2a6a-4444-9a08-220f9bb94d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:21.805851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f7add-2a6a-4444-9a08-220f9bb94d86 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:21.807198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f7add-2a6a-4444-9a08-220f9bb94d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:21.807474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f7add-2a6a-4444-9a08-220f9bb94d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:21.810591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f7add-2a6a-4444-9a08-220f9bb94d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:21.814987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f7add-2a6a-4444-9a08-220f9bb94d86 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:21.815835 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3528/7115] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:43:21 2022] PUT /identity/v3/projects/5766186388934b52bf2c54053d288856/users/d1c15e47c5694a2c8b58271cf731c565/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:21.821085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157b472-08d5-4b45-8f1b-53485ca37e02 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:21.857247 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3588/7116] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:21.858175 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f7add-2a6a-4444-9a08-220f9bb94d86 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:21.909663 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:21.928900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f7add-2a6a-4444-9a08-220f9bb94d86 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:22.056179 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157b472-08d5-4b45-8f1b-53485ca37e02 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:22.066218 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb91b3-973a-4ef6-a4a0-17d523328d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:22.068580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb91b3-973a-4ef6-a4a0-17d523328d06 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:22.072201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb91b3-973a-4ef6-a4a0-17d523328d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:22.072435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb91b3-973a-4ef6-a4a0-17d523328d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:22.073913 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb91b3-973a-4ef6-a4a0-17d523328d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:22.074584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e2bc9-b982-4aa1-a53c-8037b001791d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:22.075838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e2bc9-b982-4aa1-a53c-8037b001791d admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:22.076161 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e2bc9-b982-4aa1-a53c-8037b001791d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:22.076582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e2bc9-b982-4aa1-a53c-8037b001791d admin admin] PATH_INFO: `/v3/projects/6004289d52cd45fb9507006657d80d74/users/71faaddbbbce4ecfa0f1f7494ccf37ef/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:22.077612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb91b3-973a-4ef6-a4a0-17d523328d06 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:22.097854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e2bc9-b982-4aa1-a53c-8037b001791d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6004289d52cd45fb9507006657d80d74, user_id=71faaddbbbce4ecfa0f1f7494ccf37ef, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:22.101071 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3529/7117] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:22.101071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb91b3-973a-4ef6-a4a0-17d523328d06 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:22.101342 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e2bc9-b982-4aa1-a53c-8037b001791d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:22.107670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-84cb91b3-973a-4ef6-a4a0-17d523328d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:22.137910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb91b3-973a-4ef6-a4a0-17d523328d06 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:22.140885 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3589/7118] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:43:21 2022] PUT /identity/v3/projects/6004289d52cd45fb9507006657d80d74/users/71faaddbbbce4ecfa0f1f7494ccf37ef/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:22.142152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e2bc9-b982-4aa1-a53c-8037b001791d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:22.167130 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:22.240908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c5898-0720-4cf1-8bd7-32ff4c3d58d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:22.241554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c5898-0720-4cf1-8bd7-32ff4c3d58d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:22.241941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c5898-0720-4cf1-8bd7-32ff4c3d58d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:22.242265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c5898-0720-4cf1-8bd7-32ff4c3d58d5 admin admin] PATH_INFO: `/v3/projects/157ce1fd06cc421ba881fe1055eff0b5` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:22.248634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c5898-0720-4cf1-8bd7-32ff4c3d58d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=157ce1fd06cc421ba881fe1055eff0b5)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:22.250745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c5898-0720-4cf1-8bd7-32ff4c3d58d5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:22.315199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e2bc9-b982-4aa1-a53c-8037b001791d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:22.352581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e29c5898-0720-4cf1-8bd7-32ff4c3d58d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '157ce1fd06cc421ba881fe1055eff0b5', 'request_id': 'req-e29c5898-0720-4cf1-8bd7-32ff4c3d58d5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:22.371692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e29c5898-0720-4cf1-8bd7-32ff4c3d58d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '157ce1fd06cc421ba881fe1055eff0b5', 'request_id': 'req-e29c5898-0720-4cf1-8bd7-32ff4c3d58d5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:22.390699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e29c5898-0720-4cf1-8bd7-32ff4c3d58d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '157ce1fd06cc421ba881fe1055eff0b5', 'request_id': 'req-e29c5898-0720-4cf1-8bd7-32ff4c3d58d5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:22.431158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e29c5898-0720-4cf1-8bd7-32ff4c3d58d5 admin admin] The token cache is being invalidate because project 157ce1fd06cc421ba881fe1055eff0b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:43:22.431409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e29c5898-0720-4cf1-8bd7-32ff4c3d58d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:22.435872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e29c5898-0720-4cf1-8bd7-32ff4c3d58d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:22.440926 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3530/7119] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:43:22 2022] DELETE /identity/v3/projects/157ce1fd06cc421ba881fe1055eff0b5 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:22.440926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7154dc-8c98-40bd-bcf6-84359e630082 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:22.440926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7154dc-8c98-40bd-bcf6-84359e630082 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:22.440926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7154dc-8c98-40bd-bcf6-84359e630082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:22.446136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0d630-4c6e-47aa-bda2-9e1bb66a54a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:22.446721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0d630-4c6e-47aa-bda2-9e1bb66a54a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:22.446721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0d630-4c6e-47aa-bda2-9e1bb66a54a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:22.446950 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0d630-4c6e-47aa-bda2-9e1bb66a54a3 admin admin] PATH_INFO: `/v3/projects/5766186388934b52bf2c54053d288856/users/d1c15e47c5694a2c8b58271cf731c565/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:22.450959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0d630-4c6e-47aa-bda2-9e1bb66a54a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5766186388934b52bf2c54053d288856, user_id=d1c15e47c5694a2c8b58271cf731c565, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:22.453693 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0d630-4c6e-47aa-bda2-9e1bb66a54a3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:22.476231 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3590/7120] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:43:22 2022] PUT /identity/v3/projects/5766186388934b52bf2c54053d288856/users/d1c15e47c5694a2c8b58271cf731c565/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:22.478046 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722046f9-e8d3-4ea0-9720-c51207ab10f0 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:22.478336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722046f9-e8d3-4ea0-9720-c51207ab10f0 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:22.478621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722046f9-e8d3-4ea0-9720-c51207ab10f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:22.485250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2a7154dc-8c98-40bd-bcf6-84359e630082 None None] MFA Rules not processed for user `71faaddbbbce4ecfa0f1f7494ccf37ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:22.487085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2a7154dc-8c98-40bd-bcf6-84359e630082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:22.511441 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-722046f9-e8d3-4ea0-9720-c51207ab10f0 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:22.514808 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-722046f9-e8d3-4ea0-9720-c51207ab10f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:22.564091 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:22.586998 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3531/7121] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:22.586998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a2aef-ebce-4d93-aa8e-32c4041bbce2 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:22.586998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a2aef-ebce-4d93-aa8e-32c4041bbce2 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:22.587457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a2aef-ebce-4d93-aa8e-32c4041bbce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:22.640263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-f90a2aef-ebce-4d93-aa8e-32c4041bbce2 None None] MFA Rules not processed for user `d1c15e47c5694a2c8b58271cf731c565`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:22.640263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f90a2aef-ebce-4d93-aa8e-32c4041bbce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:22.648578 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3591/7122] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:22.649436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722046f9-e8d3-4ea0-9720-c51207ab10f0 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:22.655990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-722046f9-e8d3-4ea0-9720-c51207ab10f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:22.673783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722046f9-e8d3-4ea0-9720-c51207ab10f0 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:22.674484 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:22.684889 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407dade-b7d1-42a9-8a45-6cac35c29755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:22.685879 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407dade-b7d1-42a9-8a45-6cac35c29755 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:22.686320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407dade-b7d1-42a9-8a45-6cac35c29755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:22.686890 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407dade-b7d1-42a9-8a45-6cac35c29755 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:22.687757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407dade-b7d1-42a9-8a45-6cac35c29755 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:22.690433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0407dade-b7d1-42a9-8a45-6cac35c29755 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:22.782619 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3592/7123] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:43:22 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:22.784990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691dafc-ea09-4786-8316-a35a7f94af9c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:22.785321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691dafc-ea09-4786-8316-a35a7f94af9c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:22.785600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691dafc-ea09-4786-8316-a35a7f94af9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:22.790041 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3532/7124] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:22 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:22.791197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a2aef-ebce-4d93-aa8e-32c4041bbce2 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:22.792936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f90a2aef-ebce-4d93-aa8e-32c4041bbce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:22.835738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9691dafc-ea09-4786-8316-a35a7f94af9c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:22.837301 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9691dafc-ea09-4786-8316-a35a7f94af9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:22.925199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a2aef-ebce-4d93-aa8e-32c4041bbce2 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:22.953274 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3593/7125] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:22.954453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691dafc-ea09-4786-8316-a35a7f94af9c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:22.976845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691dafc-ea09-4786-8316-a35a7f94af9c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:22.990960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f76811-5e65-4f7b-aa39-0071349ae251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:22.992252 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f76811-5e65-4f7b-aa39-0071349ae251 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:22.992252 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f76811-5e65-4f7b-aa39-0071349ae251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:22.992252 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f76811-5e65-4f7b-aa39-0071349ae251 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:22.992818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f76811-5e65-4f7b-aa39-0071349ae251 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:22.997879 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f76811-5e65-4f7b-aa39-0071349ae251 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:23.044168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51853f0b-ff86-42f9-b7e2-ab1a53ae8b9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:23.044877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51853f0b-ff86-42f9-b7e2-ab1a53ae8b9c service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:23.045224 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51853f0b-ff86-42f9-b7e2-ab1a53ae8b9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:23.045484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51853f0b-ff86-42f9-b7e2-ab1a53ae8b9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:23.050509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-51853f0b-ff86-42f9-b7e2-ab1a53ae8b9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:23.069390 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3594/7126] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:43:22 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:23.070395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f76811-5e65-4f7b-aa39-0071349ae251 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:23.194895 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51853f0b-ff86-42f9-b7e2-ab1a53ae8b9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:23.197362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51853f0b-ff86-42f9-b7e2-ab1a53ae8b9c service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:23.214532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f76811-5e65-4f7b-aa39-0071349ae251 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:23.225890 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dfc799-b589-4240-a5ae-65a3cdffecaa tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c15e47c5694a2c8b58271cf731c565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5766186388934b52bf2c54053d288856', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:23.227466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfc799-b589-4240-a5ae-65a3cdffecaa tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:23.227755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfc799-b589-4240-a5ae-65a3cdffecaa tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:23.228067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfc799-b589-4240-a5ae-65a3cdffecaa tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:23.228947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dfc799-b589-4240-a5ae-65a3cdffecaa tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:23.233010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dfc799-b589-4240-a5ae-65a3cdffecaa tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:23.247039 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3533/7127] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:43:22 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:43:23.249188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51853f0b-ff86-42f9-b7e2-ab1a53ae8b9c service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:23.261365 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3595/7128] 10.222.0.39 () {60 vars in 1152 bytes} [Sun Aug 7 01:43:23 2022] POST /identity/v3/services => generated 240 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:23.263106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dfc799-b589-4240-a5ae-65a3cdffecaa tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:23.279658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51853f0b-ff86-42f9-b7e2-ab1a53ae8b9c service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:23.319507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dfc799-b589-4240-a5ae-65a3cdffecaa tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:23.321811 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:23.328393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030a7f3-5c0a-4d31-b3ac-632bdebc323d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:23.329492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030a7f3-5c0a-4d31-b3ac-632bdebc323d admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:23.330527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030a7f3-5c0a-4d31-b3ac-632bdebc323d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:23.331263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030a7f3-5c0a-4d31-b3ac-632bdebc323d admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:23.331685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbad46-883a-46fb-9281-09c6a2c2a57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:23.332349 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbad46-883a-46fb-9281-09c6a2c2a57e admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:23.332627 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbad46-883a-46fb-9281-09c6a2c2a57e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:23.332892 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbad46-883a-46fb-9281-09c6a2c2a57e admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:23.333537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbad46-883a-46fb-9281-09c6a2c2a57e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:23.333749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030a7f3-5c0a-4d31-b3ac-632bdebc323d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:43:23.334222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030a7f3-5c0a-4d31-b3ac-632bdebc323d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:23.335145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbad46-883a-46fb-9281-09c6a2c2a57e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:23.336441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030a7f3-5c0a-4d31-b3ac-632bdebc323d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:23.353501 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3534/7129] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:43:23.358470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030a7f3-5c0a-4d31-b3ac-632bdebc323d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:23.367049 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3596/7130] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:23.372222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbad46-883a-46fb-9281-09c6a2c2a57e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:23.385078 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:23.400671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbad46-883a-46fb-9281-09c6a2c2a57e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:23.408846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030a7f3-5c0a-4d31-b3ac-632bdebc323d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:23.418031 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55e386-00a0-4a74-9418-7d532fbaf8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:23.418727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55e386-00a0-4a74-9418-7d532fbaf8ab admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:23.419005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55e386-00a0-4a74-9418-7d532fbaf8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:23.419842 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55e386-00a0-4a74-9418-7d532fbaf8ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:23.420221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d988a31-c493-4385-9548-ed8560cfa261 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c15e47c5694a2c8b58271cf731c565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5766186388934b52bf2c54053d288856', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:23.420702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55e386-00a0-4a74-9418-7d532fbaf8ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:23.421243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d988a31-c493-4385-9548-ed8560cfa261 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:23.421737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d988a31-c493-4385-9548-ed8560cfa261 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:23.422210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d988a31-c493-4385-9548-ed8560cfa261 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] PATH_INFO: `/v3/services/e42782aaf58c403084afcf4892f6cee3` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:23.422927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c55e386-00a0-4a74-9418-7d532fbaf8ab admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:23.424959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d988a31-c493-4385-9548-ed8560cfa261 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorizing `identity:delete_service(service_id=e42782aaf58c403084afcf4892f6cee3)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:23.430097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d988a31-c493-4385-9548-ed8560cfa261 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:23.487529 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3535/7131] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:43:23 2022] DELETE /identity/v3/services/e42782aaf58c403084afcf4892f6cee3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:23.488789 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d988a31-c493-4385-9548-ed8560cfa261 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:23.499152 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3597/7132] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:43:23 2022] POST /identity/v3/projects => generated 367 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:23.499152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55e386-00a0-4a74-9418-7d532fbaf8ab admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:23.546318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d988a31-c493-4385-9548-ed8560cfa261 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:23.636099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55e386-00a0-4a74-9418-7d532fbaf8ab admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:23.669847 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefbf46-8b41-4309-b0e6-f2157bf22368 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c15e47c5694a2c8b58271cf731c565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5766186388934b52bf2c54053d288856', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:23.670481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefbf46-8b41-4309-b0e6-f2157bf22368 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:23.670767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefbf46-8b41-4309-b0e6-f2157bf22368 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:23.671038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefbf46-8b41-4309-b0e6-f2157bf22368 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:23.671701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cefbf46-8b41-4309-b0e6-f2157bf22368 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:23.673475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cefbf46-8b41-4309-b0e6-f2157bf22368 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:23.703244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0c1ed-5dc0-40a1-9c38-a858c8176580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:23.703958 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0c1ed-5dc0-40a1-9c38-a858c8176580 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:23.704272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0c1ed-5dc0-40a1-9c38-a858c8176580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:23.704474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0c1ed-5dc0-40a1-9c38-a858c8176580 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:23.705127 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0c1ed-5dc0-40a1-9c38-a858c8176580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:23.708797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0c1ed-5dc0-40a1-9c38-a858c8176580 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:23.713898 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3598/7133] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:43:23 2022] POST /identity/v3/services => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:23.714869 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefbf46-8b41-4309-b0e6-f2157bf22368 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:23.737032 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3536/7134] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:23.738039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0c1ed-5dc0-40a1-9c38-a858c8176580 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:23.756629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefbf46-8b41-4309-b0e6-f2157bf22368 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:23.764473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0c1ed-5dc0-40a1-9c38-a858c8176580 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:23.770408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4c921-8343-4196-bc30-a1a7feaf5b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:23.771042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4c921-8343-4196-bc30-a1a7feaf5b4a admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:23.771325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4c921-8343-4196-bc30-a1a7feaf5b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:23.771600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4c921-8343-4196-bc30-a1a7feaf5b4a admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:23.772385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a4c921-8343-4196-bc30-a1a7feaf5b4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:23.774217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a4c921-8343-4196-bc30-a1a7feaf5b4a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:23.830568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d69559-3816-44dd-b8c4-ae5da251fd5e tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c15e47c5694a2c8b58271cf731c565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5766186388934b52bf2c54053d288856', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:23.831237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d69559-3816-44dd-b8c4-ae5da251fd5e tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:23.831525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d69559-3816-44dd-b8c4-ae5da251fd5e tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:23.832826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d69559-3816-44dd-b8c4-ae5da251fd5e tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] PATH_INFO: `/v3/services/d08cb162646a4dbd83b23d5d7ceb3c3a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:23.833529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d69559-3816-44dd-b8c4-ae5da251fd5e tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorizing `identity:update_service(service_id=d08cb162646a4dbd83b23d5d7ceb3c3a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:23.839479 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-c0d69559-3816-44dd-b8c4-ae5da251fd5e tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:43:23.839479 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:43:23.839479 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:43:23.841080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d69559-3816-44dd-b8c4-ae5da251fd5e tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:23.871472 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3599/7135] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:43:23 2022] POST /identity/v3/users => generated 284 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:23.872534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4c921-8343-4196-bc30-a1a7feaf5b4a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:23.913667 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3537/7136] 10.222.0.39 () {60 vars in 1252 bytes} [Sun Aug 7 01:43:23 2022] PATCH /identity/v3/services/d08cb162646a4dbd83b23d5d7ceb3c3a => generated 281 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:43:23.913667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d69559-3816-44dd-b8c4-ae5da251fd5e tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:23.926103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4c921-8343-4196-bc30-a1a7feaf5b4a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:23.939635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d69559-3816-44dd-b8c4-ae5da251fd5e tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:23.942418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8313aaa-246b-4afe-b2eb-69d1d97282a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:23.943624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8313aaa-246b-4afe-b2eb-69d1d97282a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:23.944041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8313aaa-246b-4afe-b2eb-69d1d97282a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:23.944454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8313aaa-246b-4afe-b2eb-69d1d97282a3 admin admin] PATH_INFO: `/v3/projects/5a970093a42141cb90e7f41cc0b2f7a7/users/78ba4a01c5474c1485fd160a46054b7d/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:23.944991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41af1b-33b6-4b31-85ae-dabcb24070c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:23.946587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41af1b-33b6-4b31-85ae-dabcb24070c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:23.947449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41af1b-33b6-4b31-85ae-dabcb24070c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:23.947449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41af1b-33b6-4b31-85ae-dabcb24070c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:23.948204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41af1b-33b6-4b31-85ae-dabcb24070c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:23.950846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41af1b-33b6-4b31-85ae-dabcb24070c4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:23.995412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8313aaa-246b-4afe-b2eb-69d1d97282a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a970093a42141cb90e7f41cc0b2f7a7, user_id=78ba4a01c5474c1485fd160a46054b7d, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:23.999483 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8313aaa-246b-4afe-b2eb-69d1d97282a3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:24.006738 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3538/7137] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:24.007721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41af1b-33b6-4b31-85ae-dabcb24070c4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:24.027086 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3600/7138] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:43:23 2022] PUT /identity/v3/projects/5a970093a42141cb90e7f41cc0b2f7a7/users/78ba4a01c5474c1485fd160a46054b7d/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:24.029939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8313aaa-246b-4afe-b2eb-69d1d97282a3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:24.072730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41af1b-33b6-4b31-85ae-dabcb24070c4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:24.156862 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:24.171221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0060412-761b-41b1-a4df-b261587db2ce tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c15e47c5694a2c8b58271cf731c565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5766186388934b52bf2c54053d288856', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:24.172519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0060412-761b-41b1-a4df-b261587db2ce tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:24.173628 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0060412-761b-41b1-a4df-b261587db2ce tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:24.174019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0060412-761b-41b1-a4df-b261587db2ce tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] PATH_INFO: `/v3/services/d08cb162646a4dbd83b23d5d7ceb3c3a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:24.175595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0060412-761b-41b1-a4df-b261587db2ce tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorizing `identity:get_service(service_id=d08cb162646a4dbd83b23d5d7ceb3c3a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:24.178157 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-d0060412-761b-41b1-a4df-b261587db2ce tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:43:24.178157 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:43:24.178157 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:43:24.179634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0060412-761b-41b1-a4df-b261587db2ce tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:24.193887 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3539/7139] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:43:24 2022] GET /identity/v3/services/d08cb162646a4dbd83b23d5d7ceb3c3a => generated 281 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:43:24.197148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b7064-b385-4e38-bcac-d5e455dea043 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:24.199049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b7064-b385-4e38-bcac-d5e455dea043 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:24.199539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b7064-b385-4e38-bcac-d5e455dea043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:24.205751 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8313aaa-246b-4afe-b2eb-69d1d97282a3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:24.220860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457ab20-52da-4c53-9f2d-769f3403c561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:24.224010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457ab20-52da-4c53-9f2d-769f3403c561 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:24.226443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457ab20-52da-4c53-9f2d-769f3403c561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:24.226863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457ab20-52da-4c53-9f2d-769f3403c561 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:24.227735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457ab20-52da-4c53-9f2d-769f3403c561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:24.229522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457ab20-52da-4c53-9f2d-769f3403c561 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:24.256832 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3601/7140] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:24.258343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457ab20-52da-4c53-9f2d-769f3403c561 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:24.299686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457ab20-52da-4c53-9f2d-769f3403c561 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:24.306614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e61b7064-b385-4e38-bcac-d5e455dea043 None None] MFA Rules not processed for user `78ba4a01c5474c1485fd160a46054b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:24.312184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e61b7064-b385-4e38-bcac-d5e455dea043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:24.316414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c07a42-6abd-49a6-aa61-0bf872c1570c tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c15e47c5694a2c8b58271cf731c565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5766186388934b52bf2c54053d288856', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:24.322878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c07a42-6abd-49a6-aa61-0bf872c1570c tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:24.323483 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c07a42-6abd-49a6-aa61-0bf872c1570c tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:24.323990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c07a42-6abd-49a6-aa61-0bf872c1570c tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] PATH_INFO: `/v3/services/d08cb162646a4dbd83b23d5d7ceb3c3a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:24.325473 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c07a42-6abd-49a6-aa61-0bf872c1570c tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d08cb162646a4dbd83b23d5d7ceb3c3a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:24.328752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c07a42-6abd-49a6-aa61-0bf872c1570c tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:24.338427 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:24.379322 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3602/7141] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:43:24 2022] DELETE /identity/v3/services/d08cb162646a4dbd83b23d5d7ceb3c3a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:24.380915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c07a42-6abd-49a6-aa61-0bf872c1570c tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:24.501188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c07a42-6abd-49a6-aa61-0bf872c1570c tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:24.512861 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db753bb-a41a-41a6-ae8c-6fa6baff3600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:24.513926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db753bb-a41a-41a6-ae8c-6fa6baff3600 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:24.514208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db753bb-a41a-41a6-ae8c-6fa6baff3600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:24.514485 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db753bb-a41a-41a6-ae8c-6fa6baff3600 admin admin] PATH_INFO: `/v3/projects/dfb58aa51c96407ba7a8aa072bfccaff/users/8a4abf0ce0a948ee87a945817bfe5454/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:24.532014 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3540/7142] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:24.534908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b7064-b385-4e38-bcac-d5e455dea043 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:24.537077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db753bb-a41a-41a6-ae8c-6fa6baff3600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfb58aa51c96407ba7a8aa072bfccaff, user_id=8a4abf0ce0a948ee87a945817bfe5454, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:24.541042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db753bb-a41a-41a6-ae8c-6fa6baff3600 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:24.572677 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3603/7143] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:43:24 2022] PUT /identity/v3/projects/dfb58aa51c96407ba7a8aa072bfccaff/users/8a4abf0ce0a948ee87a945817bfe5454/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:24.579377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db753bb-a41a-41a6-ae8c-6fa6baff3600 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:24.622828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b7064-b385-4e38-bcac-d5e455dea043 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:24.811416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db753bb-a41a-41a6-ae8c-6fa6baff3600 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:24.818743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6b57b-a070-46cf-bb5f-53dff5ec55d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:24.819772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6b57b-a070-46cf-bb5f-53dff5ec55d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:24.820278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6b57b-a070-46cf-bb5f-53dff5ec55d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:24.820770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6b57b-a070-46cf-bb5f-53dff5ec55d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:24.821882 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6b57b-a070-46cf-bb5f-53dff5ec55d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:24.827405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6b57b-a070-46cf-bb5f-53dff5ec55d6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:24.854930 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427dbc16-828c-44e5-a9c7-76403de3871e tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c15e47c5694a2c8b58271cf731c565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5766186388934b52bf2c54053d288856', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:24.856077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dbc16-828c-44e5-a9c7-76403de3871e tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:24.862883 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dbc16-828c-44e5-a9c7-76403de3871e tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:24.862883 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dbc16-828c-44e5-a9c7-76403de3871e tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] PATH_INFO: `/v3/services/d08cb162646a4dbd83b23d5d7ceb3c3a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:24.862883 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427dbc16-828c-44e5-a9c7-76403de3871e tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorizing `identity:get_service(service_id=d08cb162646a4dbd83b23d5d7ceb3c3a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:24.862883 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427dbc16-828c-44e5-a9c7-76403de3871e tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:24.893746 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-427dbc16-828c-44e5-a9c7-76403de3871e tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] Could not find service: d08cb162646a4dbd83b23d5d7ceb3c3a.: keystone.exception.ServiceNotFound: Could not find service: d08cb162646a4dbd83b23d5d7ceb3c3a. Aug 07 01:43:24.893746 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:43:24.893746 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 07 01:43:24.893746 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 07 01:43:24.893746 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 07 01:43:24.893746 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 07 01:43:24.893746 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 07 01:43:24.893746 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 01:43:24.893746 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: d08cb162646a4dbd83b23d5d7ceb3c3a. Aug 07 01:43:24.893746 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:43:24.893746 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:43:24.893746 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:43:24.893746 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:43:24.893746 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:43:24.893746 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:43:24.893746 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:43:24.897382 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:43:24.897382 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:43:24.897382 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:43:24.897382 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:43:24.897382 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:43:24.897382 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:43:24.897382 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:43:24.897382 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 07 01:43:24.897382 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 07 01:43:24.897382 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 07 01:43:24.897382 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 07 01:43:24.897382 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:43:24.897382 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:43:24.897382 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:43:24.897382 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:43:24.897382 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:43:24.897382 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:43:24.899273 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:43:24.899273 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 01:43:24.899273 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:43:24.899273 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:43:24.899273 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:43:24.899273 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:43:24.899273 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:43:24.899273 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:43:24.899273 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:43:24.899273 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:43:24.899273 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 07 01:43:24.899273 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 07 01:43:24.899273 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: d08cb162646a4dbd83b23d5d7ceb3c3a. Aug 07 01:43:24.899273 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:43:24.906836 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3541/7144] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:43:24 2022] GET /identity/v3/services/d08cb162646a4dbd83b23d5d7ceb3c3a => generated 113 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:43:24.912511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da779d-decc-4514-8e63-c83be7822c77 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:24.912511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da779d-decc-4514-8e63-c83be7822c77 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:24.912511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da779d-decc-4514-8e63-c83be7822c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:24.980577 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3604/7145] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:43:24 2022] POST /identity/v3/projects => generated 377 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:24.986087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6b57b-a070-46cf-bb5f-53dff5ec55d6 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:25.031482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-06da779d-decc-4514-8e63-c83be7822c77 None None] MFA Rules not processed for user `8a4abf0ce0a948ee87a945817bfe5454`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:25.036433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-06da779d-decc-4514-8e63-c83be7822c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:25.086068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6b57b-a070-46cf-bb5f-53dff5ec55d6 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:25.092236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154301e-76e5-4d26-b29c-a33a02bb3010 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c15e47c5694a2c8b58271cf731c565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5766186388934b52bf2c54053d288856', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:25.092714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154301e-76e5-4d26-b29c-a33a02bb3010 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:25.093003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154301e-76e5-4d26-b29c-a33a02bb3010 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:25.093275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154301e-76e5-4d26-b29c-a33a02bb3010 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:25.094136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154301e-76e5-4d26-b29c-a33a02bb3010 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:25.095792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154301e-76e5-4d26-b29c-a33a02bb3010 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:25.132772 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:25.139847 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3542/7146] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:24 2022] POST /identity/v3/auth/tokens => generated 3411 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:25.140781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da779d-decc-4514-8e63-c83be7822c77 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:25.146947 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3605/7147] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:43:24 2022] POST /identity/v3/services => generated 274 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:25.154779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154301e-76e5-4d26-b29c-a33a02bb3010 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:25.216221 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:25.286125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154301e-76e5-4d26-b29c-a33a02bb3010 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:25.292982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b232158-0fd5-47de-9737-965717510227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:25.294509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b232158-0fd5-47de-9737-965717510227 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:25.294975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b232158-0fd5-47de-9737-965717510227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:25.295740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b232158-0fd5-47de-9737-965717510227 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:25.296949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b232158-0fd5-47de-9737-965717510227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:25.300494 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b232158-0fd5-47de-9737-965717510227 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:25.303913 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da779d-decc-4514-8e63-c83be7822c77 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:25.321008 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a82ec0-d0e5-4a34-b3e1-18ce23153bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:25.327580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a82ec0-d0e5-4a34-b3e1-18ce23153bac admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:25.328255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a82ec0-d0e5-4a34-b3e1-18ce23153bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:25.328942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a82ec0-d0e5-4a34-b3e1-18ce23153bac admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:25.332311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a82ec0-d0e5-4a34-b3e1-18ce23153bac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:25.345667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a82ec0-d0e5-4a34-b3e1-18ce23153bac admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:25.346654 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3606/7148] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:43:25 2022] POST /identity/v3/projects => generated 365 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:25.347918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b232158-0fd5-47de-9737-965717510227 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:25.416026 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3543/7149] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:43:25 2022] POST /identity/v3/users => generated 295 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:25.422715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a82ec0-d0e5-4a34-b3e1-18ce23153bac admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:25.453873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a82ec0-d0e5-4a34-b3e1-18ce23153bac admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:25.487026 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b232158-0fd5-47de-9737-965717510227 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:25.503573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a02dc5-9e20-4a1f-bdad-47bf81b0c558 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c15e47c5694a2c8b58271cf731c565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5766186388934b52bf2c54053d288856', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:25.503573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a02dc5-9e20-4a1f-bdad-47bf81b0c558 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:25.505667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a02dc5-9e20-4a1f-bdad-47bf81b0c558 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:25.506134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a02dc5-9e20-4a1f-bdad-47bf81b0c558 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:25.507017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a02dc5-9e20-4a1f-bdad-47bf81b0c558 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:25.512284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a02dc5-9e20-4a1f-bdad-47bf81b0c558 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:25.554787 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3607/7150] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:43:25 2022] POST /identity/v3/services => generated 273 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:25.555575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a02dc5-9e20-4a1f-bdad-47bf81b0c558 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:25.662782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d474482-15ea-4225-acf7-f05a588f4879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:25.665212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d474482-15ea-4225-acf7-f05a588f4879 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:25.665629 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d474482-15ea-4225-acf7-f05a588f4879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:25.666719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d474482-15ea-4225-acf7-f05a588f4879 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:25.667528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d474482-15ea-4225-acf7-f05a588f4879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:25.673103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d474482-15ea-4225-acf7-f05a588f4879 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:25.738894 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a02dc5-9e20-4a1f-bdad-47bf81b0c558 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:25.739849 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3544/7151] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:43:25 2022] POST /identity/v3/users => generated 289 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:25.741445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d474482-15ea-4225-acf7-f05a588f4879 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:25.753662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59de3cd-3d92-4212-8b2c-5ebd08f9b95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:25.754310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59de3cd-3d92-4212-8b2c-5ebd08f9b95a admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:25.754596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59de3cd-3d92-4212-8b2c-5ebd08f9b95a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:25.754874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59de3cd-3d92-4212-8b2c-5ebd08f9b95a admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:25.755538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59de3cd-3d92-4212-8b2c-5ebd08f9b95a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:25.762678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59de3cd-3d92-4212-8b2c-5ebd08f9b95a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:25.800923 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3608/7152] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:25.802039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59de3cd-3d92-4212-8b2c-5ebd08f9b95a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:25.806577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d474482-15ea-4225-acf7-f05a588f4879 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:25.814337 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333fc3b-9d9e-479c-a006-6912fd452429 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c15e47c5694a2c8b58271cf731c565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5766186388934b52bf2c54053d288856', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:25.815181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333fc3b-9d9e-479c-a006-6912fd452429 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:25.815460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333fc3b-9d9e-479c-a006-6912fd452429 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:25.815724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333fc3b-9d9e-479c-a006-6912fd452429 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:25.816431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333fc3b-9d9e-479c-a006-6912fd452429 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:25.818448 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333fc3b-9d9e-479c-a006-6912fd452429 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:25.830811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59de3cd-3d92-4212-8b2c-5ebd08f9b95a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:25.840151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6729e-4744-40fe-bfac-868632e0f6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:25.841092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6729e-4744-40fe-bfac-868632e0f6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:25.841384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6729e-4744-40fe-bfac-868632e0f6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:25.841668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6729e-4744-40fe-bfac-868632e0f6d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:25.842553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c6729e-4744-40fe-bfac-868632e0f6d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:25.846651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c6729e-4744-40fe-bfac-868632e0f6d9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:25.857312 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3545/7153] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:43:25 2022] POST /identity/v3/services => generated 273 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:25.857911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333fc3b-9d9e-479c-a006-6912fd452429 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:25.871125 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3609/7154] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:25.875018 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6729e-4744-40fe-bfac-868632e0f6d9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:25.917172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6729e-4744-40fe-bfac-868632e0f6d9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:25.927695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333fc3b-9d9e-479c-a006-6912fd452429 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:25.935655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e681cff-d0f4-4e35-9fde-5af9020360c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:25.936391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e681cff-d0f4-4e35-9fde-5af9020360c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:25.936673 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e681cff-d0f4-4e35-9fde-5af9020360c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:25.936949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e681cff-d0f4-4e35-9fde-5af9020360c6 admin admin] PATH_INFO: `/v3/projects/4f2c7c681dce4c78b4e3bf1d6679970a/users/14a1aa14c6c04d68a46c3a8ef5c7db74/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:25.959716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098519d1-06f9-409e-842a-179964c628c0 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c15e47c5694a2c8b58271cf731c565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5766186388934b52bf2c54053d288856', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:25.960347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098519d1-06f9-409e-842a-179964c628c0 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:25.961364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098519d1-06f9-409e-842a-179964c628c0 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:25.961364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098519d1-06f9-409e-842a-179964c628c0 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:25.970595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e681cff-d0f4-4e35-9fde-5af9020360c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f2c7c681dce4c78b4e3bf1d6679970a, user_id=14a1aa14c6c04d68a46c3a8ef5c7db74, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:25.972440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098519d1-06f9-409e-842a-179964c628c0 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:25.973508 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-098519d1-06f9-409e-842a-179964c628c0 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:43:25.973508 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:43:25.973508 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:43:25.974352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e681cff-d0f4-4e35-9fde-5af9020360c6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:25.974480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098519d1-06f9-409e-842a-179964c628c0 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:26.011045 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3610/7155] 10.222.0.39 () {58 vars in 1131 bytes} [Sun Aug 7 01:43:25 2022] GET /identity/v3/services => generated 2975 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:26.013172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098519d1-06f9-409e-842a-179964c628c0 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:26.026180 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:26.035327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098519d1-06f9-409e-842a-179964c628c0 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:26.036559 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3546/7156] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:43:25 2022] PUT /identity/v3/projects/4f2c7c681dce4c78b4e3bf1d6679970a/users/14a1aa14c6c04d68a46c3a8ef5c7db74/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:26.039787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e681cff-d0f4-4e35-9fde-5af9020360c6 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:26.085576 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:26.202176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56765a06-fe18-4984-a7ac-b9980b1a4c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:26.203063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56765a06-fe18-4984-a7ac-b9980b1a4c67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:26.203482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56765a06-fe18-4984-a7ac-b9980b1a4c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:26.203873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56765a06-fe18-4984-a7ac-b9980b1a4c67 admin admin] PATH_INFO: `/v3/projects/8c81b6ecc96a47d586100493c124c2e1/users/8aff78baec5049aa98cb18344c4db9ce/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:26.220450 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e681cff-d0f4-4e35-9fde-5af9020360c6 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:26.233369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56765a06-fe18-4984-a7ac-b9980b1a4c67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c81b6ecc96a47d586100493c124c2e1, user_id=8aff78baec5049aa98cb18344c4db9ce, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:26.237568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56765a06-fe18-4984-a7ac-b9980b1a4c67 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:26.238317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00f6b5-bef5-427d-a9b4-53036cb0124c tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c15e47c5694a2c8b58271cf731c565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5766186388934b52bf2c54053d288856', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:26.241342 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00f6b5-bef5-427d-a9b4-53036cb0124c tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:26.241893 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00f6b5-bef5-427d-a9b4-53036cb0124c tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:26.243105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00f6b5-bef5-427d-a9b4-53036cb0124c tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:26.246096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00f6b5-bef5-427d-a9b4-53036cb0124c tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1536633646) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:43:26.247875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00f6b5-bef5-427d-a9b4-53036cb0124c tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:26.250971 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-ed00f6b5-bef5-427d-a9b4-53036cb0124c tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:43:26.250971 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:43:26.250971 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:43:26.254115 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00f6b5-bef5-427d-a9b4-53036cb0124c tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:26.273599 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3611/7157] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:43:26 2022] PUT /identity/v3/projects/8c81b6ecc96a47d586100493c124c2e1/users/8aff78baec5049aa98cb18344c4db9ce/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:26.273599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56765a06-fe18-4984-a7ac-b9980b1a4c67 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:26.275859 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3547/7158] 10.222.0.39 () {58 vars in 1222 bytes} [Sun Aug 7 01:43:26 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1536633646 => generated 417 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:43:26.277144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00f6b5-bef5-427d-a9b4-53036cb0124c tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:26.300774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00f6b5-bef5-427d-a9b4-53036cb0124c tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:26.442758 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56765a06-fe18-4984-a7ac-b9980b1a4c67 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:26.444989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef7a41-2111-4c0c-9ca3-2f2c705f7728 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c15e47c5694a2c8b58271cf731c565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5766186388934b52bf2c54053d288856', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:26.446568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef7a41-2111-4c0c-9ca3-2f2c705f7728 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:26.447322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef7a41-2111-4c0c-9ca3-2f2c705f7728 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:26.448067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef7a41-2111-4c0c-9ca3-2f2c705f7728 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] PATH_INFO: `/v3/services` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:26.450255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef7a41-2111-4c0c-9ca3-2f2c705f7728 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-87127531) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:43:26.451018 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef7a41-2111-4c0c-9ca3-2f2c705f7728 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:26.455415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef7a41-2111-4c0c-9ca3-2f2c705f7728 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:26.456690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c8cff-8169-4b99-937e-df01849800c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:26.458490 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c8cff-8169-4b99-937e-df01849800c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:26.459338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c8cff-8169-4b99-937e-df01849800c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:26.460073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c8cff-8169-4b99-937e-df01849800c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:26.461654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c8cff-8169-4b99-937e-df01849800c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:26.466206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c8cff-8169-4b99-937e-df01849800c7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:26.476306 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3548/7159] 10.222.0.39 () {58 vars in 1218 bytes} [Sun Aug 7 01:43:26 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-87127531 => generated 414 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:43:26.479642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef7a41-2111-4c0c-9ca3-2f2c705f7728 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:26.489554 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3612/7160] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:26.490608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c8cff-8169-4b99-937e-df01849800c7 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:26.503356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef7a41-2111-4c0c-9ca3-2f2c705f7728 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:26.515117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84415ffa-dcfd-43cc-8a02-af1b259f7cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:26.517313 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84415ffa-dcfd-43cc-8a02-af1b259f7cea admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:26.518482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84415ffa-dcfd-43cc-8a02-af1b259f7cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:26.519216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84415ffa-dcfd-43cc-8a02-af1b259f7cea admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:26.519848 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c8cff-8169-4b99-937e-df01849800c7 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:26.521824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84415ffa-dcfd-43cc-8a02-af1b259f7cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:26.527172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84415ffa-dcfd-43cc-8a02-af1b259f7cea admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:26.531451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b963646-e2f9-4b43-a154-cadb274d9286 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c15e47c5694a2c8b58271cf731c565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5766186388934b52bf2c54053d288856', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:26.532658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b963646-e2f9-4b43-a154-cadb274d9286 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:26.533477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b963646-e2f9-4b43-a154-cadb274d9286 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:26.534550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b963646-e2f9-4b43-a154-cadb274d9286 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] PATH_INFO: `/v3/services` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:26.536172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b963646-e2f9-4b43-a154-cadb274d9286 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-751524690) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:43:26.537381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b963646-e2f9-4b43-a154-cadb274d9286 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:26.540197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b963646-e2f9-4b43-a154-cadb274d9286 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:26.550105 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3549/7161] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:26 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:26.551371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84415ffa-dcfd-43cc-8a02-af1b259f7cea admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:26.557439 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3613/7162] 10.222.0.39 () {58 vars in 1220 bytes} [Sun Aug 7 01:43:26 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-751524690 => generated 415 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:43:26.557439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b963646-e2f9-4b43-a154-cadb274d9286 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:26.579636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b963646-e2f9-4b43-a154-cadb274d9286 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:26.584725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a151c0-c764-4194-98f4-362c56b66a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:26.584940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84415ffa-dcfd-43cc-8a02-af1b259f7cea admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:26.585411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a151c0-c764-4194-98f4-362c56b66a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:26.585688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a151c0-c764-4194-98f4-362c56b66a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:26.585957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a151c0-c764-4194-98f4-362c56b66a42 admin admin] PATH_INFO: `/v3/projects/8c81b6ecc96a47d586100493c124c2e1/users/8aff78baec5049aa98cb18344c4db9ce/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:26.588032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a151c0-c764-4194-98f4-362c56b66a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c81b6ecc96a47d586100493c124c2e1, user_id=8aff78baec5049aa98cb18344c4db9ce, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:26.590986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a151c0-c764-4194-98f4-362c56b66a42 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:26.599069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1b6b5-5cda-4181-91a1-5613a621a851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:26.602537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1b6b5-5cda-4181-91a1-5613a621a851 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:26.603651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1b6b5-5cda-4181-91a1-5613a621a851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:26.604089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1b6b5-5cda-4181-91a1-5613a621a851 admin admin] PATH_INFO: `/v3/projects/4f2c7c681dce4c78b4e3bf1d6679970a/users/14a1aa14c6c04d68a46c3a8ef5c7db74/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:26.611120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1b6b5-5cda-4181-91a1-5613a621a851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f2c7c681dce4c78b4e3bf1d6679970a, user_id=14a1aa14c6c04d68a46c3a8ef5c7db74, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:26.613901 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3614/7163] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:43:26 2022] PUT /identity/v3/projects/8c81b6ecc96a47d586100493c124c2e1/users/8aff78baec5049aa98cb18344c4db9ce/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:26.622768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1b6b5-5cda-4181-91a1-5613a621a851 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:26.622918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a151c0-c764-4194-98f4-362c56b66a42 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:26.645626 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3550/7164] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:43:26 2022] PUT /identity/v3/projects/4f2c7c681dce4c78b4e3bf1d6679970a/users/14a1aa14c6c04d68a46c3a8ef5c7db74/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:26.649084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff03ea5-772d-45d2-aefa-3d2b2e49a89e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:26.649777 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff03ea5-772d-45d2-aefa-3d2b2e49a89e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:26.650069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff03ea5-772d-45d2-aefa-3d2b2e49a89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:26.723692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-bff03ea5-772d-45d2-aefa-3d2b2e49a89e None None] MFA Rules not processed for user `8aff78baec5049aa98cb18344c4db9ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:26.733229 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bff03ea5-772d-45d2-aefa-3d2b2e49a89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:26.752614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a151c0-c764-4194-98f4-362c56b66a42 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:26.757566 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:26.829711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0fb77-f26d-451f-99ff-b71480058560 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c15e47c5694a2c8b58271cf731c565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5766186388934b52bf2c54053d288856', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:26.830624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0fb77-f26d-451f-99ff-b71480058560 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:26.831019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0fb77-f26d-451f-99ff-b71480058560 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:26.831427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0fb77-f26d-451f-99ff-b71480058560 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] PATH_INFO: `/v3/services/f191d67688514cd4b0b8b593ac4a81f9` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:26.832553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0fb77-f26d-451f-99ff-b71480058560 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorizing `identity:delete_service(service_id=f191d67688514cd4b0b8b593ac4a81f9)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:26.834542 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0fb77-f26d-451f-99ff-b71480058560 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:26.879936 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3615/7165] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:43:26 2022] DELETE /identity/v3/services/f191d67688514cd4b0b8b593ac4a81f9 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:26.879936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08a793-ce3f-4443-8910-45ef0781c5bb None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:26.881798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08a793-ce3f-4443-8910-45ef0781c5bb None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:26.882424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08a793-ce3f-4443-8910-45ef0781c5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:26.937283 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3551/7166] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:26 2022] POST /identity/v3/auth/tokens => generated 3642 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:26.938285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff03ea5-772d-45d2-aefa-3d2b2e49a89e None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:26.972803 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:26.974399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1e08a793-ce3f-4443-8910-45ef0781c5bb None None] MFA Rules not processed for user `14a1aa14c6c04d68a46c3a8ef5c7db74`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:26.975761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1e08a793-ce3f-4443-8910-45ef0781c5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:26.981073 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff03ea5-772d-45d2-aefa-3d2b2e49a89e None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:26.998142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0236ad6-4ffd-4dac-bcd0-445a50b61ef3 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c15e47c5694a2c8b58271cf731c565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5766186388934b52bf2c54053d288856', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:27.000015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0236ad6-4ffd-4dac-bcd0-445a50b61ef3 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:27.000015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0236ad6-4ffd-4dac-bcd0-445a50b61ef3 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:27.000231 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0236ad6-4ffd-4dac-bcd0-445a50b61ef3 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] PATH_INFO: `/v3/services/af9022e7c52f4bf0a6e465e79a7915cc` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:27.000927 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0236ad6-4ffd-4dac-bcd0-445a50b61ef3 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorizing `identity:delete_service(service_id=af9022e7c52f4bf0a6e465e79a7915cc)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:27.004859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0236ad6-4ffd-4dac-bcd0-445a50b61ef3 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:27.061790 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3552/7167] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:43:26 2022] DELETE /identity/v3/services/af9022e7c52f4bf0a6e465e79a7915cc => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:27.062678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0236ad6-4ffd-4dac-bcd0-445a50b61ef3 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:27.068018 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e0236ad6-4ffd-4dac-bcd0-445a50b61ef3 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:27.152800 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3616/7168] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:26 2022] POST /identity/v3/auth/tokens => generated 3488 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:27.153723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08a793-ce3f-4443-8910-45ef0781c5bb None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:27.190588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08a793-ce3f-4443-8910-45ef0781c5bb None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:27.205892 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1af2f3-aaf6-498e-90e7-012b52c58129 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1c15e47c5694a2c8b58271cf731c565', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5766186388934b52bf2c54053d288856', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:27.207162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1af2f3-aaf6-498e-90e7-012b52c58129 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:27.207469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1af2f3-aaf6-498e-90e7-012b52c58129 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:27.207734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1af2f3-aaf6-498e-90e7-012b52c58129 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] PATH_INFO: `/v3/services/c11331a631a94e8091e8ca699781e998` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:27.210708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1af2f3-aaf6-498e-90e7-012b52c58129 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorizing `identity:delete_service(service_id=c11331a631a94e8091e8ca699781e998)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:27.212706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1af2f3-aaf6-498e-90e7-012b52c58129 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:27.264212 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3617/7169] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:43:27 2022] DELETE /identity/v3/services/c11331a631a94e8091e8ca699781e998 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:27.268675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0236ad6-4ffd-4dac-bcd0-445a50b61ef3 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:27.269503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1af2f3-aaf6-498e-90e7-012b52c58129 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:27.274564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1f1af2f3-aaf6-498e-90e7-012b52c58129 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:27.364536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1bb78-078f-4d58-afdd-5acdbef35a71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:27.367050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1bb78-078f-4d58-afdd-5acdbef35a71 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:27.367557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1bb78-078f-4d58-afdd-5acdbef35a71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:27.371696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1bb78-078f-4d58-afdd-5acdbef35a71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:27.406846 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:27.436943 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1bb78-078f-4d58-afdd-5acdbef35a71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:27.445675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1bb78-078f-4d58-afdd-5acdbef35a71 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:27.476743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1af2f3-aaf6-498e-90e7-012b52c58129 tempest-ServicesTestJSON-877885248 tempest-ServicesTestJSON-877885248-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:27.482117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7fce9-cb8d-4e6e-ac5c-7cdb758ec0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:27.482778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7fce9-cb8d-4e6e-ac5c-7cdb758ec0cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:27.483059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7fce9-cb8d-4e6e-ac5c-7cdb758ec0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:27.483335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7fce9-cb8d-4e6e-ac5c-7cdb758ec0cb admin admin] PATH_INFO: `/v3/users/e35a3bf8b67943ca9d9661728e3a6859` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:27.485684 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7fce9-cb8d-4e6e-ac5c-7cdb758ec0cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e35a3bf8b67943ca9d9661728e3a6859)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:27.488561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7fce9-cb8d-4e6e-ac5c-7cdb758ec0cb admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:27.541931 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3553/7170] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:43:27 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:43:27.584846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7dc7fce9-cb8d-4e6e-ac5c-7cdb758ec0cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e35a3bf8b67943ca9d9661728e3a6859'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:27.609975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7dc7fce9-cb8d-4e6e-ac5c-7cdb758ec0cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e35a3bf8b67943ca9d9661728e3a6859'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:27.632418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1bb78-078f-4d58-afdd-5acdbef35a71 service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:27.637918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7dc7fce9-cb8d-4e6e-ac5c-7cdb758ec0cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e35a3bf8b67943ca9d9661728e3a6859'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:27.638961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7dc7fce9-cb8d-4e6e-ac5c-7cdb758ec0cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e35a3bf8b67943ca9d9661728e3a6859'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:27.661497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1bb78-078f-4d58-afdd-5acdbef35a71 service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:27.664370 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7dc7fce9-cb8d-4e6e-ac5c-7cdb758ec0cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e35a3bf8b67943ca9d9661728e3a6859'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:27.673413 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6b99d-c4d7-4b80-acb5-fb8d5f9b71a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:27.674118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6b99d-c4d7-4b80-acb5-fb8d5f9b71a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:27.674542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6b99d-c4d7-4b80-acb5-fb8d5f9b71a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:27.675408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6b99d-c4d7-4b80-acb5-fb8d5f9b71a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:27.679027 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3618/7171] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:43:27 2022] DELETE /identity/v3/users/e35a3bf8b67943ca9d9661728e3a6859 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:43:27.682924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb56fc-ba31-490c-8b99-88cd2d3d65d2 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:27.683219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb56fc-ba31-490c-8b99-88cd2d3d65d2 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:27.683501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb56fc-ba31-490c-8b99-88cd2d3d65d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:27.688938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-01b6b99d-c4d7-4b80-acb5-fb8d5f9b71a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:27.730993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a7eb56fc-ba31-490c-8b99-88cd2d3d65d2 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:27.734376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a7eb56fc-ba31-490c-8b99-88cd2d3d65d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:27.745594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6b99d-c4d7-4b80-acb5-fb8d5f9b71a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:27.748128 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6b99d-c4d7-4b80-acb5-fb8d5f9b71a0 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:27.813449 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3554/7172] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:43:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:43:27.942237 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3619/7173] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:27.970383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6b99d-c4d7-4b80-acb5-fb8d5f9b71a0 service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:27.972406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-01b6b99d-c4d7-4b80-acb5-fb8d5f9b71a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:28.004819 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb56fc-ba31-490c-8b99-88cd2d3d65d2 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:28.006881 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a7eb56fc-ba31-490c-8b99-88cd2d3d65d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:28.023050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6b99d-c4d7-4b80-acb5-fb8d5f9b71a0 service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:28.212436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08a0a6-7ddf-4f53-9a5c-1d659d46c3e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:28.213079 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08a0a6-7ddf-4f53-9a5c-1d659d46c3e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:28.213361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08a0a6-7ddf-4f53-9a5c-1d659d46c3e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:28.213635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08a0a6-7ddf-4f53-9a5c-1d659d46c3e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:28.215198 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:28.217466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2b08a0a6-7ddf-4f53-9a5c-1d659d46c3e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:28.235559 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb56fc-ba31-490c-8b99-88cd2d3d65d2 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:28.249717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e8223-b801-49b7-8a57-5887478b00d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:28.250356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e8223-b801-49b7-8a57-5887478b00d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:28.250630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e8223-b801-49b7-8a57-5887478b00d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:28.250897 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e8223-b801-49b7-8a57-5887478b00d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:28.281351 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e8223-b801-49b7-8a57-5887478b00d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:28.290187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e8223-b801-49b7-8a57-5887478b00d2 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:28.329271 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3620/7174] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:43:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:43:28.333904 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:28.370412 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b08a0a6-7ddf-4f53-9a5c-1d659d46c3e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:28.373343 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b08a0a6-7ddf-4f53-9a5c-1d659d46c3e1 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:28.422642 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3555/7175] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:43:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:43:28.644449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e8223-b801-49b7-8a57-5887478b00d2 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:28.665714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e8223-b801-49b7-8a57-5887478b00d2 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:28.678828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db0de8-3adf-450a-b83d-d5283e3cb3e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:28.680033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db0de8-3adf-450a-b83d-d5283e3cb3e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:28.680331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db0de8-3adf-450a-b83d-d5283e3cb3e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:28.680605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db0de8-3adf-450a-b83d-d5283e3cb3e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:28.685992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c3db0de8-3adf-450a-b83d-d5283e3cb3e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:28.907435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db0de8-3adf-450a-b83d-d5283e3cb3e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:28.920181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db0de8-3adf-450a-b83d-d5283e3cb3e8 service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:28.990036 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3621/7176] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:43:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:43:30.137878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08a0a6-7ddf-4f53-9a5c-1d659d46c3e1 service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:30.139586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2b08a0a6-7ddf-4f53-9a5c-1d659d46c3e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:30.179484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08a0a6-7ddf-4f53-9a5c-1d659d46c3e1 service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:30.196438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3458af6-dec7-4d53-a901-9c4aa00fcc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:30.197113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3458af6-dec7-4d53-a901-9c4aa00fcc84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:30.197389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3458af6-dec7-4d53-a901-9c4aa00fcc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:30.197656 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3458af6-dec7-4d53-a901-9c4aa00fcc84 admin admin] PATH_INFO: `/v3/projects/53b35fdaf25b46ddb4fed99a4eba9dd3` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:30.204174 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3458af6-dec7-4d53-a901-9c4aa00fcc84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53b35fdaf25b46ddb4fed99a4eba9dd3)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:30.207304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3458af6-dec7-4d53-a901-9c4aa00fcc84 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:30.374210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c3458af6-dec7-4d53-a901-9c4aa00fcc84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53b35fdaf25b46ddb4fed99a4eba9dd3', 'request_id': 'req-c3458af6-dec7-4d53-a901-9c4aa00fcc84'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:30.392669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c3458af6-dec7-4d53-a901-9c4aa00fcc84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53b35fdaf25b46ddb4fed99a4eba9dd3', 'request_id': 'req-c3458af6-dec7-4d53-a901-9c4aa00fcc84'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:30.426293 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c3458af6-dec7-4d53-a901-9c4aa00fcc84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53b35fdaf25b46ddb4fed99a4eba9dd3', 'request_id': 'req-c3458af6-dec7-4d53-a901-9c4aa00fcc84'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:30.463395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c3458af6-dec7-4d53-a901-9c4aa00fcc84 admin admin] The token cache is being invalidate because project 53b35fdaf25b46ddb4fed99a4eba9dd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:43:30.464011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c3458af6-dec7-4d53-a901-9c4aa00fcc84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:30.469045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c3458af6-dec7-4d53-a901-9c4aa00fcc84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:30.479375 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3556/7177] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:43:30 2022] DELETE /identity/v3/projects/53b35fdaf25b46ddb4fed99a4eba9dd3 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:30.483759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db0de8-3adf-450a-b83d-d5283e3cb3e8 service cinder] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:30.508918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db0de8-3adf-450a-b83d-d5283e3cb3e8 service cinder] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:30.729552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4248b-718d-4a81-982c-56785c7f62a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:30.730194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4248b-718d-4a81-982c-56785c7f62a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:30.731002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4248b-718d-4a81-982c-56785c7f62a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:30.731278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4248b-718d-4a81-982c-56785c7f62a6 admin admin] PATH_INFO: `/v3/users/d1c15e47c5694a2c8b58271cf731c565` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:30.737234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4248b-718d-4a81-982c-56785c7f62a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1c15e47c5694a2c8b58271cf731c565)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:30.744980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4248b-718d-4a81-982c-56785c7f62a6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:30.919425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d3e4248b-718d-4a81-982c-56785c7f62a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1c15e47c5694a2c8b58271cf731c565'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:30.937976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d3e4248b-718d-4a81-982c-56785c7f62a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1c15e47c5694a2c8b58271cf731c565'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:30.978015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d3e4248b-718d-4a81-982c-56785c7f62a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1c15e47c5694a2c8b58271cf731c565'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:30.978857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d3e4248b-718d-4a81-982c-56785c7f62a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1c15e47c5694a2c8b58271cf731c565'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:30.983977 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:30.992116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d3e4248b-718d-4a81-982c-56785c7f62a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1c15e47c5694a2c8b58271cf731c565'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:31.005954 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3622/7178] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:43:30 2022] DELETE /identity/v3/users/d1c15e47c5694a2c8b58271cf731c565 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:33.229782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3458af6-dec7-4d53-a901-9c4aa00fcc84 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:33.236823 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c3458af6-dec7-4d53-a901-9c4aa00fcc84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:33.280043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3458af6-dec7-4d53-a901-9c4aa00fcc84 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:33.539308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60186d86-b79b-4603-aa55-346951e03eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:33.540001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60186d86-b79b-4603-aa55-346951e03eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:33.540288 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60186d86-b79b-4603-aa55-346951e03eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:33.540647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60186d86-b79b-4603-aa55-346951e03eb1 admin admin] PATH_INFO: `/v3/projects/5766186388934b52bf2c54053d288856` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:33.547537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60186d86-b79b-4603-aa55-346951e03eb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5766186388934b52bf2c54053d288856)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:33.549521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60186d86-b79b-4603-aa55-346951e03eb1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:33.799901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-60186d86-b79b-4603-aa55-346951e03eb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5766186388934b52bf2c54053d288856', 'request_id': 'req-60186d86-b79b-4603-aa55-346951e03eb1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:33.813224 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-60186d86-b79b-4603-aa55-346951e03eb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5766186388934b52bf2c54053d288856', 'request_id': 'req-60186d86-b79b-4603-aa55-346951e03eb1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:33.844718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-60186d86-b79b-4603-aa55-346951e03eb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5766186388934b52bf2c54053d288856', 'request_id': 'req-60186d86-b79b-4603-aa55-346951e03eb1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:33.855526 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:33.888148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-60186d86-b79b-4603-aa55-346951e03eb1 admin admin] The token cache is being invalidate because project 5766186388934b52bf2c54053d288856 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:43:33.888448 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-60186d86-b79b-4603-aa55-346951e03eb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:33.894737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-60186d86-b79b-4603-aa55-346951e03eb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:33.904716 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3557/7179] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:43:33 2022] DELETE /identity/v3/projects/5766186388934b52bf2c54053d288856 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:33.906651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbeca4-9241-4158-937d-a1d49fcd11dc None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:33.907109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbeca4-9241-4158-937d-a1d49fcd11dc None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:33.907390 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbeca4-9241-4158-937d-a1d49fcd11dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:33.942974 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-13cbeca4-9241-4158-937d-a1d49fcd11dc None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:33.944322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-13cbeca4-9241-4158-937d-a1d49fcd11dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:34.112000 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3623/7180] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:34.120698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf3734-5394-4553-a448-32110760e84d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:34.122271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf3734-5394-4553-a448-32110760e84d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:34.122727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf3734-5394-4553-a448-32110760e84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:34.180475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1baf3734-5394-4553-a448-32110760e84d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:34.181731 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1baf3734-5394-4553-a448-32110760e84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:34.226585 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3558/7181] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:34.230938 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbeca4-9241-4158-937d-a1d49fcd11dc None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:34.245674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbeca4-9241-4158-937d-a1d49fcd11dc None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:34.259722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab750e-a11d-438c-a2fc-c5959e81976f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:34.260708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab750e-a11d-438c-a2fc-c5959e81976f admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:34.261155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab750e-a11d-438c-a2fc-c5959e81976f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:34.262781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab750e-a11d-438c-a2fc-c5959e81976f admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:34.263636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab750e-a11d-438c-a2fc-c5959e81976f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:43:34.265381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab750e-a11d-438c-a2fc-c5959e81976f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:34.268465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab750e-a11d-438c-a2fc-c5959e81976f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:34.326500 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3624/7182] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:43:34.330659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf3734-5394-4553-a448-32110760e84d None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:34.344956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf3734-5394-4553-a448-32110760e84d None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:34.357862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f3659-0286-46a6-b055-6261152a6a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:34.358504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f3659-0286-46a6-b055-6261152a6a0a admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:34.358782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f3659-0286-46a6-b055-6261152a6a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:34.359053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f3659-0286-46a6-b055-6261152a6a0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:34.359867 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f3659-0286-46a6-b055-6261152a6a0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:34.361880 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f3659-0286-46a6-b055-6261152a6a0a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:34.460401 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3559/7183] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:43:34 2022] POST /identity/v3/projects => generated 367 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:34.464674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab750e-a11d-438c-a2fc-c5959e81976f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:34.487176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab750e-a11d-438c-a2fc-c5959e81976f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:34.659909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8fe89f-d36c-41ff-afc6-c5bc07665687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:34.659909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fe89f-d36c-41ff-afc6-c5bc07665687 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:34.659909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fe89f-d36c-41ff-afc6-c5bc07665687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:34.659909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8fe89f-d36c-41ff-afc6-c5bc07665687 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:34.660387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8fe89f-d36c-41ff-afc6-c5bc07665687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:34.660387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8fe89f-d36c-41ff-afc6-c5bc07665687 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:34.712990 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3625/7184] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:43:34 2022] POST /identity/v3/users => generated 284 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:34.713496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f3659-0286-46a6-b055-6261152a6a0a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:34.733763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f3659-0286-46a6-b055-6261152a6a0a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:34.758570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00a5ed-03b8-4247-892a-77354436d153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:34.759208 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00a5ed-03b8-4247-892a-77354436d153 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:34.759484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00a5ed-03b8-4247-892a-77354436d153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:34.762498 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00a5ed-03b8-4247-892a-77354436d153 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:34.763195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00a5ed-03b8-4247-892a-77354436d153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:34.764866 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00a5ed-03b8-4247-892a-77354436d153 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:34.810273 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3560/7185] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:43:34.814228 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8fe89f-d36c-41ff-afc6-c5bc07665687 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:34.836489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8fe89f-d36c-41ff-afc6-c5bc07665687 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:34.852849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32297e98-d59f-4d55-8ec0-bb29ad597acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:34.853614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32297e98-d59f-4d55-8ec0-bb29ad597acd admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:34.853874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32297e98-d59f-4d55-8ec0-bb29ad597acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:34.854159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32297e98-d59f-4d55-8ec0-bb29ad597acd admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:34.854798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32297e98-d59f-4d55-8ec0-bb29ad597acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:34.860389 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32297e98-d59f-4d55-8ec0-bb29ad597acd admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:34.890957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00a5ed-03b8-4247-892a-77354436d153 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:34.897906 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3626/7186] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:43:34.909370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00a5ed-03b8-4247-892a-77354436d153 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:34.921100 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077c74d-2b51-4dc1-a5cc-3e8ae4a80118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:34.921821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077c74d-2b51-4dc1-a5cc-3e8ae4a80118 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:34.922054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077c74d-2b51-4dc1-a5cc-3e8ae4a80118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:34.922325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077c74d-2b51-4dc1-a5cc-3e8ae4a80118 admin admin] PATH_INFO: `/v3/projects/9772d7506e284037a7e7c5ce47779372/users/05ab2b68a83d46ff9dddc7f14f953f7b/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:34.960924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077c74d-2b51-4dc1-a5cc-3e8ae4a80118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9772d7506e284037a7e7c5ce47779372, user_id=05ab2b68a83d46ff9dddc7f14f953f7b, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:34.965800 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077c74d-2b51-4dc1-a5cc-3e8ae4a80118 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:35.008204 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3561/7187] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:43:34 2022] PUT /identity/v3/projects/9772d7506e284037a7e7c5ce47779372/users/05ab2b68a83d46ff9dddc7f14f953f7b/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:35.019843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d4364-e3f7-4c00-b155-90de3b96f518 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:35.020436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d4364-e3f7-4c00-b155-90de3b96f518 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:35.020436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d4364-e3f7-4c00-b155-90de3b96f518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:35.123923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-365d4364-e3f7-4c00-b155-90de3b96f518 None None] MFA Rules not processed for user `05ab2b68a83d46ff9dddc7f14f953f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:35.127005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-365d4364-e3f7-4c00-b155-90de3b96f518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:35.295765 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:35.353274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077c74d-2b51-4dc1-a5cc-3e8ae4a80118 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:35.355875 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3627/7188] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:35.569142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077c74d-2b51-4dc1-a5cc-3e8ae4a80118 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:35.591754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea33cd-9052-419a-871f-bce84b91d567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:35.592699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea33cd-9052-419a-871f-bce84b91d567 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:35.593164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea33cd-9052-419a-871f-bce84b91d567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:35.593610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea33cd-9052-419a-871f-bce84b91d567 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:35.594432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea33cd-9052-419a-871f-bce84b91d567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:35.596632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea33cd-9052-419a-871f-bce84b91d567 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:35.657004 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3562/7189] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:43:35 2022] POST /identity/v3/projects => generated 365 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:35.660463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d4364-e3f7-4c00-b155-90de3b96f518 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:35.680558 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d4364-e3f7-4c00-b155-90de3b96f518 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:35.866138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c29e5-415a-404f-b4ac-bcd9c4c57d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:35.868262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c29e5-415a-404f-b4ac-bcd9c4c57d95 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:35.868541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c29e5-415a-404f-b4ac-bcd9c4c57d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:35.868814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c29e5-415a-404f-b4ac-bcd9c4c57d95 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:35.869462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c29e5-415a-404f-b4ac-bcd9c4c57d95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:35.872151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c29e5-415a-404f-b4ac-bcd9c4c57d95 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:35.930025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea33cd-9052-419a-871f-bce84b91d567 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:35.932033 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3628/7190] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:43:35 2022] POST /identity/v3/users => generated 289 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:35.950201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea33cd-9052-419a-871f-bce84b91d567 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:35.976070 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a8756-da7e-46bb-922a-068559ff7837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:35.987386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a8756-da7e-46bb-922a-068559ff7837 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:35.987386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a8756-da7e-46bb-922a-068559ff7837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:35.987730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a8756-da7e-46bb-922a-068559ff7837 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:35.988447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a8756-da7e-46bb-922a-068559ff7837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:35.990225 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a8756-da7e-46bb-922a-068559ff7837 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:36.016584 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3563/7191] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:43:36.021748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c29e5-415a-404f-b4ac-bcd9c4c57d95 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:36.040016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c29e5-415a-404f-b4ac-bcd9c4c57d95 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:36.061750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2748cb72-51a5-4d5b-be4e-94397c760812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:36.062781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748cb72-51a5-4d5b-be4e-94397c760812 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:36.063250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748cb72-51a5-4d5b-be4e-94397c760812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:36.063673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748cb72-51a5-4d5b-be4e-94397c760812 admin admin] PATH_INFO: `/v3/projects/ce19c7cc002946598f9bdf954982caac/users/eeeb432a24b94e708b7e777d089547a2/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:36.088917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2748cb72-51a5-4d5b-be4e-94397c760812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce19c7cc002946598f9bdf954982caac, user_id=eeeb432a24b94e708b7e777d089547a2, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:36.092390 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2748cb72-51a5-4d5b-be4e-94397c760812 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:36.119327 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3629/7192] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:43:36 2022] PUT /identity/v3/projects/ce19c7cc002946598f9bdf954982caac/users/eeeb432a24b94e708b7e777d089547a2/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:36.120385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a8756-da7e-46bb-922a-068559ff7837 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:36.137106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a8756-da7e-46bb-922a-068559ff7837 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:36.380091 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e7de6-3380-4974-800a-e8f92f2a329d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:36.380805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e7de6-3380-4974-800a-e8f92f2a329d admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:36.383678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e7de6-3380-4974-800a-e8f92f2a329d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:36.384620 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e7de6-3380-4974-800a-e8f92f2a329d admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:36.388126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e7de6-3380-4974-800a-e8f92f2a329d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:36.389786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e7de6-3380-4974-800a-e8f92f2a329d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:36.414553 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:36.428489 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3564/7193] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:43:36.432491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2748cb72-51a5-4d5b-be4e-94397c760812 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:36.443573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2748cb72-51a5-4d5b-be4e-94397c760812 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:36.485446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085f956-712e-4a30-87ea-9fd6cbd116f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:36.486152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085f956-712e-4a30-87ea-9fd6cbd116f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:36.486424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085f956-712e-4a30-87ea-9fd6cbd116f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:36.486698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085f956-712e-4a30-87ea-9fd6cbd116f1 admin admin] PATH_INFO: `/v3/projects/ce19c7cc002946598f9bdf954982caac/users/eeeb432a24b94e708b7e777d089547a2/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:36.495324 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085f956-712e-4a30-87ea-9fd6cbd116f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce19c7cc002946598f9bdf954982caac, user_id=eeeb432a24b94e708b7e777d089547a2, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:36.507750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085f956-712e-4a30-87ea-9fd6cbd116f1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:36.562107 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3630/7194] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:43:36 2022] PUT /identity/v3/projects/ce19c7cc002946598f9bdf954982caac/users/eeeb432a24b94e708b7e777d089547a2/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:36.564756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc87199-89d7-41ac-afdd-0c032bb72410 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:36.565104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc87199-89d7-41ac-afdd-0c032bb72410 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:36.566300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc87199-89d7-41ac-afdd-0c032bb72410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:36.637459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3dc87199-89d7-41ac-afdd-0c032bb72410 None None] MFA Rules not processed for user `eeeb432a24b94e708b7e777d089547a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:36.639118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3dc87199-89d7-41ac-afdd-0c032bb72410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:36.791633 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3565/7195] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:36 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:36.793474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085f956-712e-4a30-87ea-9fd6cbd116f1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:36.810365 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085f956-712e-4a30-87ea-9fd6cbd116f1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:36.816869 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d34ff-880c-4f31-b1f8-ce285419481d tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:36.818003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d34ff-880c-4f31-b1f8-ce285419481d tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:36.818484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d34ff-880c-4f31-b1f8-ce285419481d tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:36.819054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d34ff-880c-4f31-b1f8-ce285419481d tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:36.820358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d34ff-880c-4f31-b1f8-ce285419481d tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:36.827538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d34ff-880c-4f31-b1f8-ce285419481d tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:36.925708 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3631/7196] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:43:36 2022] POST /identity/v3/projects => generated 359 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:36.931983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc87199-89d7-41ac-afdd-0c032bb72410 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:36.952369 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc87199-89d7-41ac-afdd-0c032bb72410 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:37.212154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9884db-a453-4aee-8f14-72b230df8966 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:37.213095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9884db-a453-4aee-8f14-72b230df8966 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:37.216528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9884db-a453-4aee-8f14-72b230df8966 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:37.217427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9884db-a453-4aee-8f14-72b230df8966 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:37.218035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9884db-a453-4aee-8f14-72b230df8966 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:37.224584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9884db-a453-4aee-8f14-72b230df8966 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:37.289218 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3566/7197] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:43:36 2022] POST /identity/v3/users => generated 371 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:37.292673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d34ff-880c-4f31-b1f8-ce285419481d tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:37.310041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d34ff-880c-4f31-b1f8-ce285419481d tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:37.322924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ef404-6b49-433a-b29a-2c97ee946e74 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:37.323589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ef404-6b49-433a-b29a-2c97ee946e74 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:37.324479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ef404-6b49-433a-b29a-2c97ee946e74 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:37.325032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ef404-6b49-433a-b29a-2c97ee946e74 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/users/f25f623f53044acfa75d3b40eebe83ed` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:37.364588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ef404-6b49-433a-b29a-2c97ee946e74 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:get_user(user_id=f25f623f53044acfa75d3b40eebe83ed)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:37.369222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ef404-6b49-433a-b29a-2c97ee946e74 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:37.374478 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3632/7198] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Aug 7 01:43:37 2022] GET /identity/v3/users/f25f623f53044acfa75d3b40eebe83ed => generated 371 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:43:37.377842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9884db-a453-4aee-8f14-72b230df8966 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:37.397752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9884db-a453-4aee-8f14-72b230df8966 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:37.410872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fda859-f5b1-4c4c-a428-a39654bf519a tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:37.413366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fda859-f5b1-4c4c-a428-a39654bf519a tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:37.414019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fda859-f5b1-4c4c-a428-a39654bf519a tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:37.415163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fda859-f5b1-4c4c-a428-a39654bf519a tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/users/f25f623f53044acfa75d3b40eebe83ed` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:37.420573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fda859-f5b1-4c4c-a428-a39654bf519a tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f25f623f53044acfa75d3b40eebe83ed)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:37.426234 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fda859-f5b1-4c4c-a428-a39654bf519a tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:37.530186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-99fda859-f5b1-4c4c-a428-a39654bf519a tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f25f623f53044acfa75d3b40eebe83ed'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:37.549465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-99fda859-f5b1-4c4c-a428-a39654bf519a tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f25f623f53044acfa75d3b40eebe83ed'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:37.576930 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:37.584223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-99fda859-f5b1-4c4c-a428-a39654bf519a tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f25f623f53044acfa75d3b40eebe83ed'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:37.585260 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-99fda859-f5b1-4c4c-a428-a39654bf519a tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f25f623f53044acfa75d3b40eebe83ed'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:37.616858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-99fda859-f5b1-4c4c-a428-a39654bf519a tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f25f623f53044acfa75d3b40eebe83ed'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:37.630710 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3567/7199] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:43:37 2022] DELETE /identity/v3/users/f25f623f53044acfa75d3b40eebe83ed => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:37.634999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ef404-6b49-433a-b29a-2c97ee946e74 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:37.637711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-889ef404-6b49-433a-b29a-2c97ee946e74 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:37.667916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ef404-6b49-433a-b29a-2c97ee946e74 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:37.823071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7620c5-a626-4ea7-93c5-f0135a81ec3f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:37.824548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7620c5-a626-4ea7-93c5-f0135a81ec3f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:37.824932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7620c5-a626-4ea7-93c5-f0135a81ec3f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:37.825827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7620c5-a626-4ea7-93c5-f0135a81ec3f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/projects/4f783038a9784568b2baaa70b7a18e1a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:37.828486 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7620c5-a626-4ea7-93c5-f0135a81ec3f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4f783038a9784568b2baaa70b7a18e1a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:37.834411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7620c5-a626-4ea7-93c5-f0135a81ec3f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:37.853054 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:38.023845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1a7620c5-a626-4ea7-93c5-f0135a81ec3f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f783038a9784568b2baaa70b7a18e1a', 'request_id': 'req-1a7620c5-a626-4ea7-93c5-f0135a81ec3f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:38.037536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1a7620c5-a626-4ea7-93c5-f0135a81ec3f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f783038a9784568b2baaa70b7a18e1a', 'request_id': 'req-1a7620c5-a626-4ea7-93c5-f0135a81ec3f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:38.049878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1a7620c5-a626-4ea7-93c5-f0135a81ec3f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f783038a9784568b2baaa70b7a18e1a', 'request_id': 'req-1a7620c5-a626-4ea7-93c5-f0135a81ec3f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:38.077935 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1a7620c5-a626-4ea7-93c5-f0135a81ec3f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] The token cache is being invalidate because project 4f783038a9784568b2baaa70b7a18e1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:43:38.078623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1a7620c5-a626-4ea7-93c5-f0135a81ec3f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:38.080337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1a7620c5-a626-4ea7-93c5-f0135a81ec3f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:38.083182 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3633/7200] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:43:37 2022] DELETE /identity/v3/projects/4f783038a9784568b2baaa70b7a18e1a => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:38.092028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fda859-f5b1-4c4c-a428-a39654bf519a tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:38.114578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fda859-f5b1-4c4c-a428-a39654bf519a tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:38.294933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29212c-e10e-4d2f-87d4-73419df2b460 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:38.295756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29212c-e10e-4d2f-87d4-73419df2b460 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:38.296181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29212c-e10e-4d2f-87d4-73419df2b460 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:38.296523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29212c-e10e-4d2f-87d4-73419df2b460 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:38.297229 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29212c-e10e-4d2f-87d4-73419df2b460 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:38.300665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29212c-e10e-4d2f-87d4-73419df2b460 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:38.398484 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3568/7201] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:43:38 2022] POST /identity/v3/projects => generated 359 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:38.400716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7620c5-a626-4ea7-93c5-f0135a81ec3f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:38.402982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1a7620c5-a626-4ea7-93c5-f0135a81ec3f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:38.426094 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7620c5-a626-4ea7-93c5-f0135a81ec3f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:38.579847 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285da28-d913-4700-b1e7-1d3020cc728d tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:38.584057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285da28-d913-4700-b1e7-1d3020cc728d tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:38.585174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285da28-d913-4700-b1e7-1d3020cc728d tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:38.586777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285da28-d913-4700-b1e7-1d3020cc728d tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:38.588924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7285da28-d913-4700-b1e7-1d3020cc728d tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:38.594564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7285da28-d913-4700-b1e7-1d3020cc728d tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:38.664117 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3634/7202] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:43:38 2022] POST /identity/v3/users => generated 417 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:38.665580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29212c-e10e-4d2f-87d4-73419df2b460 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:38.680607 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29212c-e10e-4d2f-87d4-73419df2b460 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:38.699947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cdbb0-4f12-41c3-bf7e-a4133f3ad8b1 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:38.701105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cdbb0-4f12-41c3-bf7e-a4133f3ad8b1 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:38.701456 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cdbb0-4f12-41c3-bf7e-a4133f3ad8b1 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:38.702298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cdbb0-4f12-41c3-bf7e-a4133f3ad8b1 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:38.703219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cdbb0-4f12-41c3-bf7e-a4133f3ad8b1 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:38.707818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cdbb0-4f12-41c3-bf7e-a4133f3ad8b1 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:38.743950 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3569/7203] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:43:38 2022] POST /identity/v3/roles => generated 240 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:43:38.750289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285da28-d913-4700-b1e7-1d3020cc728d tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:38.768578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285da28-d913-4700-b1e7-1d3020cc728d tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:38.780302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c1e67-ec43-4e1f-a3b0-f7f93415177b tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:38.782151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c1e67-ec43-4e1f-a3b0-f7f93415177b tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:38.782666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c1e67-ec43-4e1f-a3b0-f7f93415177b tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:38.783967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c1e67-ec43-4e1f-a3b0-f7f93415177b tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/users/ba47d5bc8b024982adf5952bcbf04738` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:38.836654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c1e67-ec43-4e1f-a3b0-f7f93415177b tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:get_user(user_id=ba47d5bc8b024982adf5952bcbf04738)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:38.839656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c1e67-ec43-4e1f-a3b0-f7f93415177b tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:38.843961 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3635/7204] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Aug 7 01:43:38 2022] GET /identity/v3/users/ba47d5bc8b024982adf5952bcbf04738 => generated 417 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:43:38.848457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cdbb0-4f12-41c3-bf7e-a4133f3ad8b1 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:38.865221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cdbb0-4f12-41c3-bf7e-a4133f3ad8b1 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:38.881432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae0ff9-5bf3-4609-8b1d-21b4e93083dd tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:38.882532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae0ff9-5bf3-4609-8b1d-21b4e93083dd tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:38.883126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae0ff9-5bf3-4609-8b1d-21b4e93083dd tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:38.883559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae0ff9-5bf3-4609-8b1d-21b4e93083dd tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/roles/f3f81df4dc9a41e7b83f509f9adedbf3` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:38.885865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae0ff9-5bf3-4609-8b1d-21b4e93083dd tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:get_role(role_id=f3f81df4dc9a41e7b83f509f9adedbf3)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:38.888472 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-f6ae0ff9-5bf3-4609-8b1d-21b4e93083dd tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:43:38.888472 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:43:38.888472 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:43:38.891154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae0ff9-5bf3-4609-8b1d-21b4e93083dd tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:38.895311 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3570/7205] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Aug 7 01:43:38 2022] GET /identity/v3/roles/f3f81df4dc9a41e7b83f509f9adedbf3 => generated 240 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:43:38.906677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c1e67-ec43-4e1f-a3b0-f7f93415177b tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:38.923168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c1e67-ec43-4e1f-a3b0-f7f93415177b tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:38.944688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bf4f7-4e41-4b8c-b78f-7ffca944b0fd tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:38.945323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bf4f7-4e41-4b8c-b78f-7ffca944b0fd tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:38.945738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bf4f7-4e41-4b8c-b78f-7ffca944b0fd tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:38.945968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bf4f7-4e41-4b8c-b78f-7ffca944b0fd tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:38.946615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6bf4f7-4e41-4b8c-b78f-7ffca944b0fd tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:38.953329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6bf4f7-4e41-4b8c-b78f-7ffca944b0fd tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:39.106457 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3636/7206] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:43:38 2022] POST /identity/v3/projects => generated 359 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:39.106674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae0ff9-5bf3-4609-8b1d-21b4e93083dd tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:39.123373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae0ff9-5bf3-4609-8b1d-21b4e93083dd tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:39.306010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80df28-dfc4-40ed-9aec-97a8fea41db8 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:39.307831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80df28-dfc4-40ed-9aec-97a8fea41db8 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:39.312648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80df28-dfc4-40ed-9aec-97a8fea41db8 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:39.312988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80df28-dfc4-40ed-9aec-97a8fea41db8 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/projects/3d62d86b053a46a88c519bea9a08adbd` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:39.318341 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80df28-dfc4-40ed-9aec-97a8fea41db8 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:get_project(project_id=3d62d86b053a46a88c519bea9a08adbd)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:39.325877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80df28-dfc4-40ed-9aec-97a8fea41db8 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:39.328107 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3571/7207] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:43:39 2022] GET /identity/v3/projects/3d62d86b053a46a88c519bea9a08adbd => generated 359 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:43:39.332541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bf4f7-4e41-4b8c-b78f-7ffca944b0fd tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:39.348377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bf4f7-4e41-4b8c-b78f-7ffca944b0fd tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:39.376833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3a16b-bc8a-46df-8a4b-84b8356518b2 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:39.377538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3a16b-bc8a-46df-8a4b-84b8356518b2 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:39.377817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3a16b-bc8a-46df-8a4b-84b8356518b2 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:39.378094 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3a16b-bc8a-46df-8a4b-84b8356518b2 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/projects/3d62d86b053a46a88c519bea9a08adbd/users/ba47d5bc8b024982adf5952bcbf04738/roles/f3f81df4dc9a41e7b83f509f9adedbf3` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:39.385044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3a16b-bc8a-46df-8a4b-84b8356518b2 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3d62d86b053a46a88c519bea9a08adbd, user_id=ba47d5bc8b024982adf5952bcbf04738, role_id=f3f81df4dc9a41e7b83f509f9adedbf3)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:39.393832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3a16b-bc8a-46df-8a4b-84b8356518b2 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:39.422460 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3637/7208] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:43:39 2022] PUT /identity/v3/projects/3d62d86b053a46a88c519bea9a08adbd/users/ba47d5bc8b024982adf5952bcbf04738/roles/f3f81df4dc9a41e7b83f509f9adedbf3 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:39.426784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80df28-dfc4-40ed-9aec-97a8fea41db8 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:39.448598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80df28-dfc4-40ed-9aec-97a8fea41db8 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:39.592041 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:39.621133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a99f5a-80ff-45bb-b2a8-64eb427eb587 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:39.622096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a99f5a-80ff-45bb-b2a8-64eb427eb587 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:39.623442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a99f5a-80ff-45bb-b2a8-64eb427eb587 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:39.623976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a99f5a-80ff-45bb-b2a8-64eb427eb587 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:39.624893 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a99f5a-80ff-45bb-b2a8-64eb427eb587 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:39.627137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a99f5a-80ff-45bb-b2a8-64eb427eb587 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:39.692046 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3572/7209] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:43:39 2022] POST /identity/v3/projects => generated 357 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:39.696352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3a16b-bc8a-46df-8a4b-84b8356518b2 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:39.712906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3a16b-bc8a-46df-8a4b-84b8356518b2 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:39.807483 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:39.899534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a59bf-edbc-488c-b295-0f57261eaac4 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:39.900252 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a59bf-edbc-488c-b295-0f57261eaac4 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:39.900657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a59bf-edbc-488c-b295-0f57261eaac4 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:39.901141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a59bf-edbc-488c-b295-0f57261eaac4 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/projects/63a8289e66584eabb323e09a3dec4801` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:39.905722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a59bf-edbc-488c-b295-0f57261eaac4 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:get_project(project_id=63a8289e66584eabb323e09a3dec4801)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:39.908854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a59bf-edbc-488c-b295-0f57261eaac4 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:39.914039 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3638/7210] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:43:39 2022] GET /identity/v3/projects/63a8289e66584eabb323e09a3dec4801 => generated 357 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:43:39.915767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a99f5a-80ff-45bb-b2a8-64eb427eb587 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:39.939369 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a99f5a-80ff-45bb-b2a8-64eb427eb587 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:39.981400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75848717-b619-4a58-a267-f1cc82bdeacf tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:39.984476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75848717-b619-4a58-a267-f1cc82bdeacf tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:39.985579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75848717-b619-4a58-a267-f1cc82bdeacf tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:39.992459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75848717-b619-4a58-a267-f1cc82bdeacf tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/projects/63a8289e66584eabb323e09a3dec4801/users/ba47d5bc8b024982adf5952bcbf04738/roles/f3f81df4dc9a41e7b83f509f9adedbf3` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:40.005953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75848717-b619-4a58-a267-f1cc82bdeacf tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:create_grant(project_id=63a8289e66584eabb323e09a3dec4801, user_id=ba47d5bc8b024982adf5952bcbf04738, role_id=f3f81df4dc9a41e7b83f509f9adedbf3)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:40.034558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75848717-b619-4a58-a267-f1cc82bdeacf tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:40.090680 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3573/7211] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:43:39 2022] PUT /identity/v3/projects/63a8289e66584eabb323e09a3dec4801/users/ba47d5bc8b024982adf5952bcbf04738/roles/f3f81df4dc9a41e7b83f509f9adedbf3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:43:40.092414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a59bf-edbc-488c-b295-0f57261eaac4 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:40.112385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a59bf-edbc-488c-b295-0f57261eaac4 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:40.356328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41d8c9-05d6-477c-9af8-b26f7f1365b7 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:40.356999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41d8c9-05d6-477c-9af8-b26f7f1365b7 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:40.357280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41d8c9-05d6-477c-9af8-b26f7f1365b7 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:40.358499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41d8c9-05d6-477c-9af8-b26f7f1365b7 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/users/ba47d5bc8b024982adf5952bcbf04738/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:40.359756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41d8c9-05d6-477c-9af8-b26f7f1365b7 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=ba47d5bc8b024982adf5952bcbf04738)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:40.365992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41d8c9-05d6-477c-9af8-b26f7f1365b7 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:40.455534 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3639/7212] 10.222.0.39 () {58 vars in 1248 bytes} [Sun Aug 7 01:43:40 2022] GET /identity/v3/users/ba47d5bc8b024982adf5952bcbf04738/projects => generated 840 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:43:40.460208 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75848717-b619-4a58-a267-f1cc82bdeacf tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:40.485020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75848717-b619-4a58-a267-f1cc82bdeacf tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:40.513032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611e89b-e992-42dd-8f05-b7088dbbc70f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:40.513690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611e89b-e992-42dd-8f05-b7088dbbc70f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:40.513992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611e89b-e992-42dd-8f05-b7088dbbc70f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:40.514253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611e89b-e992-42dd-8f05-b7088dbbc70f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/projects/63a8289e66584eabb323e09a3dec4801` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:40.523554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611e89b-e992-42dd-8f05-b7088dbbc70f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:delete_project(project_id=63a8289e66584eabb323e09a3dec4801)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:40.529660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611e89b-e992-42dd-8f05-b7088dbbc70f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:40.776049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d611e89b-e992-42dd-8f05-b7088dbbc70f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63a8289e66584eabb323e09a3dec4801', 'request_id': 'req-d611e89b-e992-42dd-8f05-b7088dbbc70f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:40.794786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d611e89b-e992-42dd-8f05-b7088dbbc70f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63a8289e66584eabb323e09a3dec4801', 'request_id': 'req-d611e89b-e992-42dd-8f05-b7088dbbc70f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:40.823575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d611e89b-e992-42dd-8f05-b7088dbbc70f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63a8289e66584eabb323e09a3dec4801', 'request_id': 'req-d611e89b-e992-42dd-8f05-b7088dbbc70f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:40.877371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d611e89b-e992-42dd-8f05-b7088dbbc70f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] The token cache is being invalidate because project 63a8289e66584eabb323e09a3dec4801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:43:40.877743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d611e89b-e992-42dd-8f05-b7088dbbc70f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:40.879323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d611e89b-e992-42dd-8f05-b7088dbbc70f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:40.891025 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3574/7213] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:43:40 2022] DELETE /identity/v3/projects/63a8289e66584eabb323e09a3dec4801 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:40.892598 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41d8c9-05d6-477c-9af8-b26f7f1365b7 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:40.895557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1c41d8c9-05d6-477c-9af8-b26f7f1365b7 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:40.951772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41d8c9-05d6-477c-9af8-b26f7f1365b7 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:41.335516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d5781-ad7b-4cbd-b588-87678982c323 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:41.336868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d5781-ad7b-4cbd-b588-87678982c323 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:41.339030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d5781-ad7b-4cbd-b588-87678982c323 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:41.339705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d5781-ad7b-4cbd-b588-87678982c323 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/projects/3d62d86b053a46a88c519bea9a08adbd` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:41.341558 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d5781-ad7b-4cbd-b588-87678982c323 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3d62d86b053a46a88c519bea9a08adbd)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:41.348191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d5781-ad7b-4cbd-b588-87678982c323 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:41.536178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-475d5781-ad7b-4cbd-b588-87678982c323 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d62d86b053a46a88c519bea9a08adbd', 'request_id': 'req-475d5781-ad7b-4cbd-b588-87678982c323'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:41.541696 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:41.571351 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-475d5781-ad7b-4cbd-b588-87678982c323 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d62d86b053a46a88c519bea9a08adbd', 'request_id': 'req-475d5781-ad7b-4cbd-b588-87678982c323'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:41.605617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-475d5781-ad7b-4cbd-b588-87678982c323 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d62d86b053a46a88c519bea9a08adbd', 'request_id': 'req-475d5781-ad7b-4cbd-b588-87678982c323'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:41.664810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-475d5781-ad7b-4cbd-b588-87678982c323 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] The token cache is being invalidate because project 3d62d86b053a46a88c519bea9a08adbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:43:41.667161 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-475d5781-ad7b-4cbd-b588-87678982c323 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:41.670831 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-475d5781-ad7b-4cbd-b588-87678982c323 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:41.680034 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3640/7214] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:43:40 2022] DELETE /identity/v3/projects/3d62d86b053a46a88c519bea9a08adbd => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:41.684549 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611e89b-e992-42dd-8f05-b7088dbbc70f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:41.712508 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611e89b-e992-42dd-8f05-b7088dbbc70f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:41.914704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e618c-3567-4d09-a824-55336ce60d54 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:41.915495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e618c-3567-4d09-a824-55336ce60d54 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:41.915863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e618c-3567-4d09-a824-55336ce60d54 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:41.916205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e618c-3567-4d09-a824-55336ce60d54 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/roles/f3f81df4dc9a41e7b83f509f9adedbf3` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:41.927217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e618c-3567-4d09-a824-55336ce60d54 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f3f81df4dc9a41e7b83f509f9adedbf3)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:41.938266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e618c-3567-4d09-a824-55336ce60d54 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:42.097017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8b6e618c-3567-4d09-a824-55336ce60d54 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invalidating the token cache because role f3f81df4dc9a41e7b83f509f9adedbf3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:43:42.097646 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8b6e618c-3567-4d09-a824-55336ce60d54 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:42.098951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8b6e618c-3567-4d09-a824-55336ce60d54 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:42.102109 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3575/7215] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:43:41 2022] DELETE /identity/v3/roles/f3f81df4dc9a41e7b83f509f9adedbf3 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:42.109503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d5781-ad7b-4cbd-b588-87678982c323 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:42.112842 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-475d5781-ad7b-4cbd-b588-87678982c323 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:42.177953 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d5781-ad7b-4cbd-b588-87678982c323 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:42.434126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81fc93-388b-476d-8016-bd3137a97434 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:42.435129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81fc93-388b-476d-8016-bd3137a97434 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:42.435579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81fc93-388b-476d-8016-bd3137a97434 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:42.436085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81fc93-388b-476d-8016-bd3137a97434 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/users/ba47d5bc8b024982adf5952bcbf04738` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:42.438809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81fc93-388b-476d-8016-bd3137a97434 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ba47d5bc8b024982adf5952bcbf04738)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:42.446212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed81fc93-388b-476d-8016-bd3137a97434 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:42.629140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ed81fc93-388b-476d-8016-bd3137a97434 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba47d5bc8b024982adf5952bcbf04738'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:42.650070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ed81fc93-388b-476d-8016-bd3137a97434 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba47d5bc8b024982adf5952bcbf04738'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:42.681623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ed81fc93-388b-476d-8016-bd3137a97434 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba47d5bc8b024982adf5952bcbf04738'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:42.687862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ed81fc93-388b-476d-8016-bd3137a97434 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba47d5bc8b024982adf5952bcbf04738'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:42.711232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ed81fc93-388b-476d-8016-bd3137a97434 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba47d5bc8b024982adf5952bcbf04738'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:42.726168 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3641/7216] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:43:42 2022] DELETE /identity/v3/users/ba47d5bc8b024982adf5952bcbf04738 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:42.730078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e618c-3567-4d09-a824-55336ce60d54 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:42.732956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8b6e618c-3567-4d09-a824-55336ce60d54 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:42.806707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e618c-3567-4d09-a824-55336ce60d54 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:42.861757 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:43.064312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd6d7f-ff77-47c0-bd6a-2acca2799054 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:43.065320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd6d7f-ff77-47c0-bd6a-2acca2799054 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:43.065880 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd6d7f-ff77-47c0-bd6a-2acca2799054 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:43.066412 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd6d7f-ff77-47c0-bd6a-2acca2799054 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/projects/88b4a251978042fc893a3db9665a5c3d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:43.074525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd6d7f-ff77-47c0-bd6a-2acca2799054 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:delete_project(project_id=88b4a251978042fc893a3db9665a5c3d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:43.076742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd6d7f-ff77-47c0-bd6a-2acca2799054 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:43.281617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c4cd6d7f-ff77-47c0-bd6a-2acca2799054 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88b4a251978042fc893a3db9665a5c3d', 'request_id': 'req-c4cd6d7f-ff77-47c0-bd6a-2acca2799054'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:43.300368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c4cd6d7f-ff77-47c0-bd6a-2acca2799054 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88b4a251978042fc893a3db9665a5c3d', 'request_id': 'req-c4cd6d7f-ff77-47c0-bd6a-2acca2799054'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:43.316121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c4cd6d7f-ff77-47c0-bd6a-2acca2799054 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88b4a251978042fc893a3db9665a5c3d', 'request_id': 'req-c4cd6d7f-ff77-47c0-bd6a-2acca2799054'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:43.343812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c4cd6d7f-ff77-47c0-bd6a-2acca2799054 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] The token cache is being invalidate because project 88b4a251978042fc893a3db9665a5c3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:43:43.347025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c4cd6d7f-ff77-47c0-bd6a-2acca2799054 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:43.347871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c4cd6d7f-ff77-47c0-bd6a-2acca2799054 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:43.353737 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3576/7217] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:43:42 2022] DELETE /identity/v3/projects/88b4a251978042fc893a3db9665a5c3d => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:43:43.359986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81fc93-388b-476d-8016-bd3137a97434 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:43.361993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ed81fc93-388b-476d-8016-bd3137a97434 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:43.394640 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81fc93-388b-476d-8016-bd3137a97434 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:43.547078 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:43.572117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16037c7-a090-4d97-a7c3-f0eed6f0f716 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:43.575932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16037c7-a090-4d97-a7c3-f0eed6f0f716 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:43.576685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16037c7-a090-4d97-a7c3-f0eed6f0f716 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:43.576685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16037c7-a090-4d97-a7c3-f0eed6f0f716 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/users/05ab2b68a83d46ff9dddc7f14f953f7b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:43.578702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16037c7-a090-4d97-a7c3-f0eed6f0f716 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:update_user(user_id=05ab2b68a83d46ff9dddc7f14f953f7b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:43.584962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16037c7-a090-4d97-a7c3-f0eed6f0f716 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:43.672218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c16037c7-a090-4d97-a7c3-f0eed6f0f716 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '05ab2b68a83d46ff9dddc7f14f953f7b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:43.690653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c16037c7-a090-4d97-a7c3-f0eed6f0f716 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invalidating the token cache because user 05ab2b68a83d46ff9dddc7f14f953f7b was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:43:43.691306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c16037c7-a090-4d97-a7c3-f0eed6f0f716 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:43.692556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c16037c7-a090-4d97-a7c3-f0eed6f0f716 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:43.697027 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3642/7218] 10.222.0.39 () {60 vars in 1243 bytes} [Sun Aug 7 01:43:43 2022] PATCH /identity/v3/users/05ab2b68a83d46ff9dddc7f14f953f7b => generated 297 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:43:43.700860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e6cb4-9254-43e0-b54a-41e15bd7a75b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:43.701154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e6cb4-9254-43e0-b54a-41e15bd7a75b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:43.701431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e6cb4-9254-43e0-b54a-41e15bd7a75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:43.782995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16037c7-a090-4d97-a7c3-f0eed6f0f716 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:43.784892 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c16037c7-a090-4d97-a7c3-f0eed6f0f716 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:43.807479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-cb7e6cb4-9254-43e0-b54a-41e15bd7a75b None None] MFA Rules not processed for user `05ab2b68a83d46ff9dddc7f14f953f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:43.809366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cb7e6cb4-9254-43e0-b54a-41e15bd7a75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:43.852601 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3577/7219] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:43 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 01:43:43.858126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e6cb4-9254-43e0-b54a-41e15bd7a75b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:43.863326 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cb7e6cb4-9254-43e0-b54a-41e15bd7a75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:43.925193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e6cb4-9254-43e0-b54a-41e15bd7a75b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:43.947420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fbec3-9b5b-4a74-9895-844b9c9fade4 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:43.948168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fbec3-9b5b-4a74-9895-844b9c9fade4 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:43.948515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fbec3-9b5b-4a74-9895-844b9c9fade4 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:43.948861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fbec3-9b5b-4a74-9895-844b9c9fade4 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/users/05ab2b68a83d46ff9dddc7f14f953f7b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:43.950303 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0fbec3-9b5b-4a74-9895-844b9c9fade4 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:update_user(user_id=05ab2b68a83d46ff9dddc7f14f953f7b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:43.958701 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-fd0fbec3-9b5b-4a74-9895-844b9c9fade4 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:43:43.958701 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:43:43.958701 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:43:43.962605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0fbec3-9b5b-4a74-9895-844b9c9fade4 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:44.065995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16037c7-a090-4d97-a7c3-f0eed6f0f716 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:44.081929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fd0fbec3-9b5b-4a74-9895-844b9c9fade4 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '05ab2b68a83d46ff9dddc7f14f953f7b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:44.096201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739667b8-e0e2-4502-8954-fed19d4027f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:44.096201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739667b8-e0e2-4502-8954-fed19d4027f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:44.096201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739667b8-e0e2-4502-8954-fed19d4027f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:44.096201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739667b8-e0e2-4502-8954-fed19d4027f1 admin admin] PATH_INFO: `/v3/users/71faaddbbbce4ecfa0f1f7494ccf37ef` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:44.096556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739667b8-e0e2-4502-8954-fed19d4027f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71faaddbbbce4ecfa0f1f7494ccf37ef)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:44.102131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739667b8-e0e2-4502-8954-fed19d4027f1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:44.111488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fd0fbec3-9b5b-4a74-9895-844b9c9fade4 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invalidating the token cache because user 05ab2b68a83d46ff9dddc7f14f953f7b was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:43:44.111826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fd0fbec3-9b5b-4a74-9895-844b9c9fade4 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:44.112718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fd0fbec3-9b5b-4a74-9895-844b9c9fade4 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:44.123274 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3578/7220] 10.222.0.39 () {60 vars in 1243 bytes} [Sun Aug 7 01:43:43 2022] PATCH /identity/v3/users/05ab2b68a83d46ff9dddc7f14f953f7b => generated 297 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:43:44.123274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fbec3-9b5b-4a74-9895-844b9c9fade4 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:44.123274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-fd0fbec3-9b5b-4a74-9895-844b9c9fade4 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:44.304091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-739667b8-e0e2-4502-8954-fed19d4027f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71faaddbbbce4ecfa0f1f7494ccf37ef'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:44.322965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-739667b8-e0e2-4502-8954-fed19d4027f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71faaddbbbce4ecfa0f1f7494ccf37ef'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:44.378218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-739667b8-e0e2-4502-8954-fed19d4027f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71faaddbbbce4ecfa0f1f7494ccf37ef'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:44.379346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-739667b8-e0e2-4502-8954-fed19d4027f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71faaddbbbce4ecfa0f1f7494ccf37ef'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:44.390325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-739667b8-e0e2-4502-8954-fed19d4027f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71faaddbbbce4ecfa0f1f7494ccf37ef'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:44.395462 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:44.436903 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3643/7221] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:43:43 2022] DELETE /identity/v3/users/71faaddbbbce4ecfa0f1f7494ccf37ef => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:44.440235 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739667b8-e0e2-4502-8954-fed19d4027f1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:44.445310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fbec3-9b5b-4a74-9895-844b9c9fade4 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:44.445937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-739667b8-e0e2-4502-8954-fed19d4027f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:44.610297 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=85,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=11 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:44.648633 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0bcd0-d2c0-4068-bf2f-5469633561b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:44.649382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0bcd0-d2c0-4068-bf2f-5469633561b0 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:44.649741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0bcd0-d2c0-4068-bf2f-5469633561b0 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:44.650165 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0bcd0-d2c0-4068-bf2f-5469633561b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:44.650312 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739667b8-e0e2-4502-8954-fed19d4027f1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:44.653194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-50e0bcd0-d2c0-4068-bf2f-5469633561b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:44.662512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109980c4-b66c-4ed1-9af6-7512698e58cb tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:44.663187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109980c4-b66c-4ed1-9af6-7512698e58cb tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:44.663473 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109980c4-b66c-4ed1-9af6-7512698e58cb tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:44.663752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109980c4-b66c-4ed1-9af6-7512698e58cb tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/users/05ab2b68a83d46ff9dddc7f14f953f7b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:44.693038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0bcd0-d2c0-4068-bf2f-5469633561b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:44.694937 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0bcd0-d2c0-4068-bf2f-5469633561b0 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:44.718092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109980c4-b66c-4ed1-9af6-7512698e58cb tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:update_user(user_id=05ab2b68a83d46ff9dddc7f14f953f7b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:44.720435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109980c4-b66c-4ed1-9af6-7512698e58cb tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:44.736829 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3579/7222] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:43:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:43:44.738488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5a248-96a2-4de1-be99-67157eafb77f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:44.738938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5a248-96a2-4de1-be99-67157eafb77f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:44.739284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5a248-96a2-4de1-be99-67157eafb77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:44.788560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-edf5a248-96a2-4de1-be99-67157eafb77f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:44.794328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-edf5a248-96a2-4de1-be99-67157eafb77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:44.799355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-109980c4-b66c-4ed1-9af6-7512698e58cb tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '05ab2b68a83d46ff9dddc7f14f953f7b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:44.831601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-109980c4-b66c-4ed1-9af6-7512698e58cb tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invalidating the token cache because user 05ab2b68a83d46ff9dddc7f14f953f7b was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:43:44.832306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-109980c4-b66c-4ed1-9af6-7512698e58cb tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:44.832671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-109980c4-b66c-4ed1-9af6-7512698e58cb tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:44.835392 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3644/7223] 10.222.0.39 () {60 vars in 1243 bytes} [Sun Aug 7 01:43:44 2022] PATCH /identity/v3/users/05ab2b68a83d46ff9dddc7f14f953f7b => generated 297 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:43:44.842773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08bae9d-efa9-4ee1-bb2f-5e37d741afd2 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:44.842773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08bae9d-efa9-4ee1-bb2f-5e37d741afd2 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:44.842773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08bae9d-efa9-4ee1-bb2f-5e37d741afd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:44.979631 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f08bae9d-efa9-4ee1-bb2f-5e37d741afd2 None None] MFA Rules not processed for user `05ab2b68a83d46ff9dddc7f14f953f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:44.982820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f08bae9d-efa9-4ee1-bb2f-5e37d741afd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:44.998127 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3645/7224] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:44 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 01:43:45.001966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08bae9d-efa9-4ee1-bb2f-5e37d741afd2 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:45.005181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f08bae9d-efa9-4ee1-bb2f-5e37d741afd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:45.044357 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3580/7225] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:45.052265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5a248-96a2-4de1-be99-67157eafb77f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:45.053688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-edf5a248-96a2-4de1-be99-67157eafb77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:45.069221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08bae9d-efa9-4ee1-bb2f-5e37d741afd2 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:45.084535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6ea81-71e6-4dcf-9068-cfd5e687db78 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:45.085361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6ea81-71e6-4dcf-9068-cfd5e687db78 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:45.085695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6ea81-71e6-4dcf-9068-cfd5e687db78 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:45.091984 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6ea81-71e6-4dcf-9068-cfd5e687db78 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/users/05ab2b68a83d46ff9dddc7f14f953f7b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:45.096063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6ea81-71e6-4dcf-9068-cfd5e687db78 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:update_user(user_id=05ab2b68a83d46ff9dddc7f14f953f7b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:45.097716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6ea81-71e6-4dcf-9068-cfd5e687db78 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:45.191303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-00d6ea81-71e6-4dcf-9068-cfd5e687db78 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '05ab2b68a83d46ff9dddc7f14f953f7b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:45.225561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-00d6ea81-71e6-4dcf-9068-cfd5e687db78 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invalidating the token cache because user 05ab2b68a83d46ff9dddc7f14f953f7b was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:43:45.225874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-00d6ea81-71e6-4dcf-9068-cfd5e687db78 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:45.226527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-00d6ea81-71e6-4dcf-9068-cfd5e687db78 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:45.228823 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3646/7226] 10.222.0.39 () {60 vars in 1243 bytes} [Sun Aug 7 01:43:45 2022] PATCH /identity/v3/users/05ab2b68a83d46ff9dddc7f14f953f7b => generated 297 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:43:45.235253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5a248-96a2-4de1-be99-67157eafb77f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:45.236945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6ea81-71e6-4dcf-9068-cfd5e687db78 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:45.239026 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-00d6ea81-71e6-4dcf-9068-cfd5e687db78 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:45.251328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ce04b-c880-4ee5-a9ce-824bc6512ab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:45.252074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ce04b-c880-4ee5-a9ce-824bc6512ab1 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:45.252353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ce04b-c880-4ee5-a9ce-824bc6512ab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:45.252646 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ce04b-c880-4ee5-a9ce-824bc6512ab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:45.263998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ca3ce04b-c880-4ee5-a9ce-824bc6512ab1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:45.280220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6ea81-71e6-4dcf-9068-cfd5e687db78 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:45.295685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0779f90-4e33-4a73-8505-41aaf671fb36 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:45.296489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0779f90-4e33-4a73-8505-41aaf671fb36 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:45.296797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0779f90-4e33-4a73-8505-41aaf671fb36 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:45.297065 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0779f90-4e33-4a73-8505-41aaf671fb36 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:45.299905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0779f90-4e33-4a73-8505-41aaf671fb36 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:45.302047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0779f90-4e33-4a73-8505-41aaf671fb36 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:45.303918 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ce04b-c880-4ee5-a9ce-824bc6512ab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:45.305758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ce04b-c880-4ee5-a9ce-824bc6512ab1 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:45.331746 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3581/7227] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:43:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:43:45.334687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ce04b-c880-4ee5-a9ce-824bc6512ab1 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:45.337331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ca3ce04b-c880-4ee5-a9ce-824bc6512ab1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:45.369365 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3647/7228] 10.222.0.39 () {60 vars in 1143 bytes} [Sun Aug 7 01:43:45 2022] POST /identity/v3/users => generated 264 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:45.377257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0779f90-4e33-4a73-8505-41aaf671fb36 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:45.380061 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ce04b-c880-4ee5-a9ce-824bc6512ab1 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:45.404570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d99c25-8558-45c2-9090-60a1ae2c1528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:45.407779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d99c25-8558-45c2-9090-60a1ae2c1528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:45.408183 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d99c25-8558-45c2-9090-60a1ae2c1528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:45.408499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d99c25-8558-45c2-9090-60a1ae2c1528 admin admin] PATH_INFO: `/v3/users/8a4abf0ce0a948ee87a945817bfe5454` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:45.410931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d99c25-8558-45c2-9090-60a1ae2c1528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a4abf0ce0a948ee87a945817bfe5454)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:45.419019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d99c25-8558-45c2-9090-60a1ae2c1528 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:45.421746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0779f90-4e33-4a73-8505-41aaf671fb36 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:45.436968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2476633-dff8-42a1-b3ea-49b5c1cdf3f0 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:45.437637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2476633-dff8-42a1-b3ea-49b5c1cdf3f0 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:45.438042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2476633-dff8-42a1-b3ea-49b5c1cdf3f0 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:45.438513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2476633-dff8-42a1-b3ea-49b5c1cdf3f0 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/users/c4f8fd7e198341339737fb1258c54a20/password` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:45.508597 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:45.625376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e5d99c25-8558-45c2-9090-60a1ae2c1528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a4abf0ce0a948ee87a945817bfe5454'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:45.664146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e5d99c25-8558-45c2-9090-60a1ae2c1528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a4abf0ce0a948ee87a945817bfe5454'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:45.664702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f2476633-dff8-42a1-b3ea-49b5c1cdf3f0 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c4f8fd7e198341339737fb1258c54a20'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:45.687204 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3648/7229] 10.222.0.39 () {60 vars in 1269 bytes} [Sun Aug 7 01:43:45 2022] POST /identity/v3/users/c4f8fd7e198341339737fb1258c54a20/password => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:45.719625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e5d99c25-8558-45c2-9090-60a1ae2c1528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a4abf0ce0a948ee87a945817bfe5454'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:45.720756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e5d99c25-8558-45c2-9090-60a1ae2c1528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a4abf0ce0a948ee87a945817bfe5454'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:45.753826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e5d99c25-8558-45c2-9090-60a1ae2c1528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a4abf0ce0a948ee87a945817bfe5454'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:45.776299 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3582/7230] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:43:45 2022] DELETE /identity/v3/users/8a4abf0ce0a948ee87a945817bfe5454 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:45.781992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69833fe7-652f-47cc-90a8-2683b2118ba2 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:45.782915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69833fe7-652f-47cc-90a8-2683b2118ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:45.782915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69833fe7-652f-47cc-90a8-2683b2118ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:45.840828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-69833fe7-652f-47cc-90a8-2683b2118ba2 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:45.846643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-69833fe7-652f-47cc-90a8-2683b2118ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:46.023994 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=83,keystone:UPDATE=3,keystone:INSERT=9,keystone:DELETE=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:46.067304 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3649/7231] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:43:46.087328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d99c25-8558-45c2-9090-60a1ae2c1528 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:46.090186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e5d99c25-8558-45c2-9090-60a1ae2c1528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:46.296686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69833fe7-652f-47cc-90a8-2683b2118ba2 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:46.298001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-69833fe7-652f-47cc-90a8-2683b2118ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:46.311998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d99c25-8558-45c2-9090-60a1ae2c1528 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:46.323855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ace91d-4c36-40f1-9ac6-1d5b3020a895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:46.324927 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ace91d-4c36-40f1-9ac6-1d5b3020a895 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:46.327052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ace91d-4c36-40f1-9ac6-1d5b3020a895 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:46.327598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ace91d-4c36-40f1-9ac6-1d5b3020a895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:46.331945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69833fe7-652f-47cc-90a8-2683b2118ba2 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:46.356933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1f946-b0f8-4152-b884-8595c943fb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:46.362035 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1f946-b0f8-4152-b884-8595c943fb2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:46.362198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1f946-b0f8-4152-b884-8595c943fb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:46.363348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1f946-b0f8-4152-b884-8595c943fb2c admin admin] PATH_INFO: `/v3/projects/6004289d52cd45fb9507006657d80d74` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:46.367967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1f946-b0f8-4152-b884-8595c943fb2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6004289d52cd45fb9507006657d80d74)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:46.378543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1f946-b0f8-4152-b884-8595c943fb2c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:46.386556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ace91d-4c36-40f1-9ac6-1d5b3020a895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:46.395584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ace91d-4c36-40f1-9ac6-1d5b3020a895 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:46.450565 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3583/7232] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:43:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:43:46.589974 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dcc1f946-b0f8-4152-b884-8595c943fb2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6004289d52cd45fb9507006657d80d74', 'request_id': 'req-dcc1f946-b0f8-4152-b884-8595c943fb2c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:46.607405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dcc1f946-b0f8-4152-b884-8595c943fb2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6004289d52cd45fb9507006657d80d74', 'request_id': 'req-dcc1f946-b0f8-4152-b884-8595c943fb2c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:46.625250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dcc1f946-b0f8-4152-b884-8595c943fb2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6004289d52cd45fb9507006657d80d74', 'request_id': 'req-dcc1f946-b0f8-4152-b884-8595c943fb2c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:46.667492 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dcc1f946-b0f8-4152-b884-8595c943fb2c admin admin] The token cache is being invalidate because project 6004289d52cd45fb9507006657d80d74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:43:46.668191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dcc1f946-b0f8-4152-b884-8595c943fb2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:46.674978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-dcc1f946-b0f8-4152-b884-8595c943fb2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:46.678049 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3650/7233] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:43:46 2022] DELETE /identity/v3/projects/6004289d52cd45fb9507006657d80d74 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:46.686306 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ace91d-4c36-40f1-9ac6-1d5b3020a895 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:46.694591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4744028-3da1-402b-a610-6c09d43bc7aa None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:46.700184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4744028-3da1-402b-a610-6c09d43bc7aa None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:46.701861 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4744028-3da1-402b-a610-6c09d43bc7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:46.716998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ace91d-4c36-40f1-9ac6-1d5b3020a895 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:46.769204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d4744028-3da1-402b-a610-6c09d43bc7aa None None] MFA Rules not processed for user `c4f8fd7e198341339737fb1258c54a20`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:46.773499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d4744028-3da1-402b-a610-6c09d43bc7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:46.782197 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3651/7234] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:46 2022] POST /identity/v3/auth/tokens => generated 329 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 01:43:46.785927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4744028-3da1-402b-a610-6c09d43bc7aa None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:46.792411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d4744028-3da1-402b-a610-6c09d43bc7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:46.881311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33976537-ab0b-422e-b583-b78ace0a61f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:46.882380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33976537-ab0b-422e-b583-b78ace0a61f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:46.882778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33976537-ab0b-422e-b583-b78ace0a61f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:46.883296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33976537-ab0b-422e-b583-b78ace0a61f8 admin admin] PATH_INFO: `/v3/users/78ba4a01c5474c1485fd160a46054b7d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:46.884805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33976537-ab0b-422e-b583-b78ace0a61f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78ba4a01c5474c1485fd160a46054b7d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:46.887645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33976537-ab0b-422e-b583-b78ace0a61f8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:47.021140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4744028-3da1-402b-a610-6c09d43bc7aa None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:47.025878 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:47.032645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-33976537-ab0b-422e-b583-b78ace0a61f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78ba4a01c5474c1485fd160a46054b7d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:47.034010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156aa82-7a1a-424d-b0a6-d3a1234f0e11 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:47.034919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156aa82-7a1a-424d-b0a6-d3a1234f0e11 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:47.035216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156aa82-7a1a-424d-b0a6-d3a1234f0e11 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:47.035497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156aa82-7a1a-424d-b0a6-d3a1234f0e11 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:47.052727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-33976537-ab0b-422e-b583-b78ace0a61f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78ba4a01c5474c1485fd160a46054b7d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:47.054400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156aa82-7a1a-424d-b0a6-d3a1234f0e11 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:47.056650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156aa82-7a1a-424d-b0a6-d3a1234f0e11 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:47.088172 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3652/7235] 10.222.0.39 () {56 vars in 1263 bytes} [Sun Aug 7 01:43:46 2022] GET /identity/v3/auth/tokens => generated 329 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 01:43:47.091943 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-33976537-ab0b-422e-b583-b78ace0a61f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78ba4a01c5474c1485fd160a46054b7d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:47.092897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-33976537-ab0b-422e-b583-b78ace0a61f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78ba4a01c5474c1485fd160a46054b7d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:47.093018 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156aa82-7a1a-424d-b0a6-d3a1234f0e11 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:47.109383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-33976537-ab0b-422e-b583-b78ace0a61f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78ba4a01c5474c1485fd160a46054b7d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:47.117491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156aa82-7a1a-424d-b0a6-d3a1234f0e11 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:47.121114 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3584/7236] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:43:46 2022] DELETE /identity/v3/users/78ba4a01c5474c1485fd160a46054b7d => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:47.130835 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509a8a7-8733-4875-aa27-71d68347a555 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:47.131499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509a8a7-8733-4875-aa27-71d68347a555 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:47.132729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509a8a7-8733-4875-aa27-71d68347a555 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:47.133037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4509a8a7-8733-4875-aa27-71d68347a555 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/users/c4f8fd7e198341339737fb1258c54a20` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:47.135181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4509a8a7-8733-4875-aa27-71d68347a555 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c4f8fd7e198341339737fb1258c54a20)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:47.137672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4509a8a7-8733-4875-aa27-71d68347a555 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:47.256054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4509a8a7-8733-4875-aa27-71d68347a555 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4f8fd7e198341339737fb1258c54a20'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:47.267259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4509a8a7-8733-4875-aa27-71d68347a555 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4f8fd7e198341339737fb1258c54a20'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:47.279147 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:47.291003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4509a8a7-8733-4875-aa27-71d68347a555 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4f8fd7e198341339737fb1258c54a20'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:47.294006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4509a8a7-8733-4875-aa27-71d68347a555 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4f8fd7e198341339737fb1258c54a20'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:47.306084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4509a8a7-8733-4875-aa27-71d68347a555 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4f8fd7e198341339737fb1258c54a20'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:47.323248 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3653/7237] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:43:47 2022] DELETE /identity/v3/users/c4f8fd7e198341339737fb1258c54a20 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:47.323519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33976537-ab0b-422e-b583-b78ace0a61f8 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:47.325187 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-33976537-ab0b-422e-b583-b78ace0a61f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:47.467556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33976537-ab0b-422e-b583-b78ace0a61f8 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:47.623639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e74b8-1e7b-4545-ad78-553b57d852d6 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:47.624737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e74b8-1e7b-4545-ad78-553b57d852d6 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:47.625207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e74b8-1e7b-4545-ad78-553b57d852d6 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:47.625661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e74b8-1e7b-4545-ad78-553b57d852d6 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:47.626718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e74b8-1e7b-4545-ad78-553b57d852d6 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:47.631038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e74b8-1e7b-4545-ad78-553b57d852d6 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:47.686194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509a8a7-8733-4875-aa27-71d68347a555 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:47.687806 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4509a8a7-8733-4875-aa27-71d68347a555 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:47.716817 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3585/7238] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:43:47 2022] POST /identity/v3/users => generated 367 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:43:47.718261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e74b8-1e7b-4545-ad78-553b57d852d6 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:47.723232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-db1e74b8-1e7b-4545-ad78-553b57d852d6 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:47.765002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e74b8-1e7b-4545-ad78-553b57d852d6 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:47.775060 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668aab73-da83-4fb4-ae02-ac8042d20fe0 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:47.777941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668aab73-da83-4fb4-ae02-ac8042d20fe0 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:47.779746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668aab73-da83-4fb4-ae02-ac8042d20fe0 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:47.780329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668aab73-da83-4fb4-ae02-ac8042d20fe0 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:47.781175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668aab73-da83-4fb4-ae02-ac8042d20fe0 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:47.783509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668aab73-da83-4fb4-ae02-ac8042d20fe0 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:47.857304 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3586/7239] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:43:47 2022] POST /identity/v3/projects => generated 359 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:47.861109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668aab73-da83-4fb4-ae02-ac8042d20fe0 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:47.930771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4509a8a7-8733-4875-aa27-71d68347a555 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:47.946332 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:48.001001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668aab73-da83-4fb4-ae02-ac8042d20fe0 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:48.012129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f111e-fc56-47cc-bd78-8e275bf36a75 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:48.012963 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f111e-fc56-47cc-bd78-8e275bf36a75 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:48.014020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f111e-fc56-47cc-bd78-8e275bf36a75 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:48.016052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f111e-fc56-47cc-bd78-8e275bf36a75 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/users/8781094827484c8db368399031d2ae81` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:48.060720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f111e-fc56-47cc-bd78-8e275bf36a75 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:update_user(user_id=8781094827484c8db368399031d2ae81)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:48.068341 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f111e-fc56-47cc-bd78-8e275bf36a75 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:48.092205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25676e1-0dd6-47ad-8d23-32f1c403d67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:48.092951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25676e1-0dd6-47ad-8d23-32f1c403d67a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:48.093153 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25676e1-0dd6-47ad-8d23-32f1c403d67a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:48.093430 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25676e1-0dd6-47ad-8d23-32f1c403d67a admin admin] PATH_INFO: `/v3/projects/dfb58aa51c96407ba7a8aa072bfccaff` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:48.096939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25676e1-0dd6-47ad-8d23-32f1c403d67a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfb58aa51c96407ba7a8aa072bfccaff)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:48.104004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25676e1-0dd6-47ad-8d23-32f1c403d67a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:48.155037 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3587/7240] 10.222.0.39 () {60 vars in 1244 bytes} [Sun Aug 7 01:43:47 2022] PATCH /identity/v3/users/8781094827484c8db368399031d2ae81 => generated 522 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:43:48.159751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f111e-fc56-47cc-bd78-8e275bf36a75 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:48.187575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f111e-fc56-47cc-bd78-8e275bf36a75 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:48.223734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e25676e1-0dd6-47ad-8d23-32f1c403d67a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfb58aa51c96407ba7a8aa072bfccaff', 'request_id': 'req-e25676e1-0dd6-47ad-8d23-32f1c403d67a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:48.232784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e25676e1-0dd6-47ad-8d23-32f1c403d67a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfb58aa51c96407ba7a8aa072bfccaff', 'request_id': 'req-e25676e1-0dd6-47ad-8d23-32f1c403d67a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:48.240088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e25676e1-0dd6-47ad-8d23-32f1c403d67a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfb58aa51c96407ba7a8aa072bfccaff', 'request_id': 'req-e25676e1-0dd6-47ad-8d23-32f1c403d67a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:48.263738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e25676e1-0dd6-47ad-8d23-32f1c403d67a admin admin] The token cache is being invalidate because project dfb58aa51c96407ba7a8aa072bfccaff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:43:48.263998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e25676e1-0dd6-47ad-8d23-32f1c403d67a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:48.264674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e25676e1-0dd6-47ad-8d23-32f1c403d67a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:48.266731 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3654/7241] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:43:47 2022] DELETE /identity/v3/projects/dfb58aa51c96407ba7a8aa072bfccaff => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:48.267857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25676e1-0dd6-47ad-8d23-32f1c403d67a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:48.270763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e25676e1-0dd6-47ad-8d23-32f1c403d67a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:48.298689 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:48.352395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362af9c-3064-4485-b530-e1f3bcea5b47 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:48.353368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362af9c-3064-4485-b530-e1f3bcea5b47 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:48.353833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362af9c-3064-4485-b530-e1f3bcea5b47 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:48.354390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362af9c-3064-4485-b530-e1f3bcea5b47 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/users/8781094827484c8db368399031d2ae81` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:48.391712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362af9c-3064-4485-b530-e1f3bcea5b47 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:get_user(user_id=8781094827484c8db368399031d2ae81)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:48.395871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362af9c-3064-4485-b530-e1f3bcea5b47 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:48.403611 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3588/7242] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Aug 7 01:43:48 2022] GET /identity/v3/users/8781094827484c8db368399031d2ae81 => generated 388 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:43:48.404765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362af9c-3064-4485-b530-e1f3bcea5b47 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:48.409864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8362af9c-3064-4485-b530-e1f3bcea5b47 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:48.503234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25676e1-0dd6-47ad-8d23-32f1c403d67a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:48.517757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25388f60-b7e8-4ddd-8088-d6ebf0e13de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:48.518720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25388f60-b7e8-4ddd-8088-d6ebf0e13de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:48.519162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25388f60-b7e8-4ddd-8088-d6ebf0e13de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:48.519769 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25388f60-b7e8-4ddd-8088-d6ebf0e13de4 admin admin] PATH_INFO: `/v3/projects/5a970093a42141cb90e7f41cc0b2f7a7` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:48.533503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25388f60-b7e8-4ddd-8088-d6ebf0e13de4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a970093a42141cb90e7f41cc0b2f7a7)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:48.536317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25388f60-b7e8-4ddd-8088-d6ebf0e13de4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:48.639180 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362af9c-3064-4485-b530-e1f3bcea5b47 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:48.667280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0a03b-b760-45f5-b134-b4b31b7b7906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:48.667980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0a03b-b760-45f5-b134-b4b31b7b7906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:48.668268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0a03b-b760-45f5-b134-b4b31b7b7906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:48.672856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0a03b-b760-45f5-b134-b4b31b7b7906 admin admin] PATH_INFO: `/v3/users/8aff78baec5049aa98cb18344c4db9ce` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:48.680286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0a03b-b760-45f5-b134-b4b31b7b7906 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8aff78baec5049aa98cb18344c4db9ce)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:48.687103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0a03b-b760-45f5-b134-b4b31b7b7906 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:48.701635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-25388f60-b7e8-4ddd-8088-d6ebf0e13de4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a970093a42141cb90e7f41cc0b2f7a7', 'request_id': 'req-25388f60-b7e8-4ddd-8088-d6ebf0e13de4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:48.720322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-25388f60-b7e8-4ddd-8088-d6ebf0e13de4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a970093a42141cb90e7f41cc0b2f7a7', 'request_id': 'req-25388f60-b7e8-4ddd-8088-d6ebf0e13de4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:48.730571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-25388f60-b7e8-4ddd-8088-d6ebf0e13de4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a970093a42141cb90e7f41cc0b2f7a7', 'request_id': 'req-25388f60-b7e8-4ddd-8088-d6ebf0e13de4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:48.754017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-25388f60-b7e8-4ddd-8088-d6ebf0e13de4 admin admin] The token cache is being invalidate because project 5a970093a42141cb90e7f41cc0b2f7a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:43:48.754328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-25388f60-b7e8-4ddd-8088-d6ebf0e13de4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:48.755118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-25388f60-b7e8-4ddd-8088-d6ebf0e13de4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:48.757299 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3655/7243] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:43:48 2022] DELETE /identity/v3/projects/5a970093a42141cb90e7f41cc0b2f7a7 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:48.760686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25388f60-b7e8-4ddd-8088-d6ebf0e13de4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:48.762296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-25388f60-b7e8-4ddd-8088-d6ebf0e13de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:48.870361 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:UPDATE=2,keystone:DELETE=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:48.893208 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c1e0a03b-b760-45f5-b134-b4b31b7b7906 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8aff78baec5049aa98cb18344c4db9ce'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:48.895297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25388f60-b7e8-4ddd-8088-d6ebf0e13de4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:48.904078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5314ab-306b-449f-abe2-b0581e97173f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:48.904765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5314ab-306b-449f-abe2-b0581e97173f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:48.905049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5314ab-306b-449f-abe2-b0581e97173f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:48.905509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5314ab-306b-449f-abe2-b0581e97173f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/projects/7106dfb79c8645abb694b79b5f43f138` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:48.907247 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5314ab-306b-449f-abe2-b0581e97173f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7106dfb79c8645abb694b79b5f43f138)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:48.909546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5314ab-306b-449f-abe2-b0581e97173f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:48.920785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c1e0a03b-b760-45f5-b134-b4b31b7b7906 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8aff78baec5049aa98cb18344c4db9ce'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:48.965704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c1e0a03b-b760-45f5-b134-b4b31b7b7906 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8aff78baec5049aa98cb18344c4db9ce'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:48.968675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c1e0a03b-b760-45f5-b134-b4b31b7b7906 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8aff78baec5049aa98cb18344c4db9ce'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:48.983992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c1e0a03b-b760-45f5-b134-b4b31b7b7906 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8aff78baec5049aa98cb18344c4db9ce'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:49.000273 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3589/7244] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:43:48 2022] DELETE /identity/v3/users/8aff78baec5049aa98cb18344c4db9ce => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:49.001353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0a03b-b760-45f5-b134-b4b31b7b7906 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:49.001733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7b5314ab-306b-449f-abe2-b0581e97173f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7106dfb79c8645abb694b79b5f43f138', 'request_id': 'req-7b5314ab-306b-449f-abe2-b0581e97173f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:49.003515 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:49.004608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c1e0a03b-b760-45f5-b134-b4b31b7b7906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:49.019314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7b5314ab-306b-449f-abe2-b0581e97173f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7106dfb79c8645abb694b79b5f43f138', 'request_id': 'req-7b5314ab-306b-449f-abe2-b0581e97173f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:49.029108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7b5314ab-306b-449f-abe2-b0581e97173f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7106dfb79c8645abb694b79b5f43f138', 'request_id': 'req-7b5314ab-306b-449f-abe2-b0581e97173f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:49.049198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7b5314ab-306b-449f-abe2-b0581e97173f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] The token cache is being invalidate because project 7106dfb79c8645abb694b79b5f43f138 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:43:49.049654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7b5314ab-306b-449f-abe2-b0581e97173f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:49.051265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7b5314ab-306b-449f-abe2-b0581e97173f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:49.058064 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3656/7245] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:43:48 2022] DELETE /identity/v3/projects/7106dfb79c8645abb694b79b5f43f138 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:49.060732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5314ab-306b-449f-abe2-b0581e97173f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:49.063173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7b5314ab-306b-449f-abe2-b0581e97173f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:49.195877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0a03b-b760-45f5-b134-b4b31b7b7906 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:49.199925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5314ab-306b-449f-abe2-b0581e97173f tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:49.210191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28848862-c704-4793-a7f3-349488c1ee02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:49.210976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28848862-c704-4793-a7f3-349488c1ee02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:49.211323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28848862-c704-4793-a7f3-349488c1ee02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:49.211725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28848862-c704-4793-a7f3-349488c1ee02 admin admin] PATH_INFO: `/v3/users/14a1aa14c6c04d68a46c3a8ef5c7db74` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:49.215191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28848862-c704-4793-a7f3-349488c1ee02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14a1aa14c6c04d68a46c3a8ef5c7db74)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:49.234395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28848862-c704-4793-a7f3-349488c1ee02 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:49.347530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-28848862-c704-4793-a7f3-349488c1ee02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14a1aa14c6c04d68a46c3a8ef5c7db74'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:49.364904 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-28848862-c704-4793-a7f3-349488c1ee02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14a1aa14c6c04d68a46c3a8ef5c7db74'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:49.382739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6b065-2673-456f-a804-8a61076f4f47 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eeeb432a24b94e708b7e777d089547a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce19c7cc002946598f9bdf954982caac', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:49.383547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6b065-2673-456f-a804-8a61076f4f47 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:49.383920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6b065-2673-456f-a804-8a61076f4f47 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:49.384329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6b065-2673-456f-a804-8a61076f4f47 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] PATH_INFO: `/v3/users/8781094827484c8db368399031d2ae81` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:49.390606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6b065-2673-456f-a804-8a61076f4f47 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8781094827484c8db368399031d2ae81)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:49.398086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6b065-2673-456f-a804-8a61076f4f47 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:49.431741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-28848862-c704-4793-a7f3-349488c1ee02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14a1aa14c6c04d68a46c3a8ef5c7db74'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:49.434954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-28848862-c704-4793-a7f3-349488c1ee02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14a1aa14c6c04d68a46c3a8ef5c7db74'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:49.454638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-28848862-c704-4793-a7f3-349488c1ee02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14a1aa14c6c04d68a46c3a8ef5c7db74'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:49.468482 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3590/7246] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:43:49 2022] DELETE /identity/v3/users/14a1aa14c6c04d68a46c3a8ef5c7db74 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:49.554828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-80d6b065-2673-456f-a804-8a61076f4f47 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8781094827484c8db368399031d2ae81'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:49.567945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-80d6b065-2673-456f-a804-8a61076f4f47 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8781094827484c8db368399031d2ae81'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:49.600083 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-80d6b065-2673-456f-a804-8a61076f4f47 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8781094827484c8db368399031d2ae81'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:49.602787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-80d6b065-2673-456f-a804-8a61076f4f47 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8781094827484c8db368399031d2ae81'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:49.618567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-80d6b065-2673-456f-a804-8a61076f4f47 tempest-UsersV3TestJSON-443760825 tempest-UsersV3TestJSON-443760825-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8781094827484c8db368399031d2ae81'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:49.647811 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3657/7247] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:43:49 2022] DELETE /identity/v3/users/8781094827484c8db368399031d2ae81 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:49.650746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28848862-c704-4793-a7f3-349488c1ee02 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:49.652216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-28848862-c704-4793-a7f3-349488c1ee02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:49.784044 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:49.848046 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28848862-c704-4793-a7f3-349488c1ee02 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:49.976447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2712ff3-a482-4d9d-8160-02fb7824fb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:49.976679 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2712ff3-a482-4d9d-8160-02fb7824fb76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:49.976784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2712ff3-a482-4d9d-8160-02fb7824fb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:49.977020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2712ff3-a482-4d9d-8160-02fb7824fb76 admin admin] PATH_INFO: `/v3/users/05ab2b68a83d46ff9dddc7f14f953f7b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:50.016522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2712ff3-a482-4d9d-8160-02fb7824fb76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05ab2b68a83d46ff9dddc7f14f953f7b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:50.018580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2712ff3-a482-4d9d-8160-02fb7824fb76 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:50.139569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c2712ff3-a482-4d9d-8160-02fb7824fb76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05ab2b68a83d46ff9dddc7f14f953f7b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:50.162857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c2712ff3-a482-4d9d-8160-02fb7824fb76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05ab2b68a83d46ff9dddc7f14f953f7b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:50.187520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c2712ff3-a482-4d9d-8160-02fb7824fb76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05ab2b68a83d46ff9dddc7f14f953f7b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:50.188239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c2712ff3-a482-4d9d-8160-02fb7824fb76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05ab2b68a83d46ff9dddc7f14f953f7b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:50.202341 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c2712ff3-a482-4d9d-8160-02fb7824fb76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05ab2b68a83d46ff9dddc7f14f953f7b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:50.213402 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3591/7248] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:43:49 2022] DELETE /identity/v3/users/05ab2b68a83d46ff9dddc7f14f953f7b => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:50.219134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f792e3-71a4-49ac-9aae-c75594ade87c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:50.219718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f792e3-71a4-49ac-9aae-c75594ade87c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:50.219906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f792e3-71a4-49ac-9aae-c75594ade87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:50.232277 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:50.273534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-74f792e3-71a4-49ac-9aae-c75594ade87c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:50.274355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-74f792e3-71a4-49ac-9aae-c75594ade87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:50.363000 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2712ff3-a482-4d9d-8160-02fb7824fb76 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:50.364758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c2712ff3-a482-4d9d-8160-02fb7824fb76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:50.449083 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3658/7249] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:50.469691 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f792e3-71a4-49ac-9aae-c75594ade87c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:50.471943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-74f792e3-71a4-49ac-9aae-c75594ade87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:50.561957 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:50.586886 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2712ff3-a482-4d9d-8160-02fb7824fb76 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:50.601654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026b671-8bf2-4943-a8b7-3bcc067d9f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:50.603510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026b671-8bf2-4943-a8b7-3bcc067d9f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:50.604032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026b671-8bf2-4943-a8b7-3bcc067d9f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:50.604495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026b671-8bf2-4943-a8b7-3bcc067d9f86 admin admin] PATH_INFO: `/v3/projects/4f2c7c681dce4c78b4e3bf1d6679970a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:50.608552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026b671-8bf2-4943-a8b7-3bcc067d9f86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f2c7c681dce4c78b4e3bf1d6679970a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:50.614880 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026b671-8bf2-4943-a8b7-3bcc067d9f86 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:50.654040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f792e3-71a4-49ac-9aae-c75594ade87c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:50.659673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe7e38-8ae2-4650-9c8f-00741d6597f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:50.661348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe7e38-8ae2-4650-9c8f-00741d6597f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:50.661968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe7e38-8ae2-4650-9c8f-00741d6597f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:50.668130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe7e38-8ae2-4650-9c8f-00741d6597f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:50.681380 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe7e38-8ae2-4650-9c8f-00741d6597f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:50.685225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe7e38-8ae2-4650-9c8f-00741d6597f6 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:50.720059 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3659/7250] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:43:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:43:50.738715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f026b671-8bf2-4943-a8b7-3bcc067d9f86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f2c7c681dce4c78b4e3bf1d6679970a', 'request_id': 'req-f026b671-8bf2-4943-a8b7-3bcc067d9f86'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:50.754347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f026b671-8bf2-4943-a8b7-3bcc067d9f86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f2c7c681dce4c78b4e3bf1d6679970a', 'request_id': 'req-f026b671-8bf2-4943-a8b7-3bcc067d9f86'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:50.774836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f026b671-8bf2-4943-a8b7-3bcc067d9f86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f2c7c681dce4c78b4e3bf1d6679970a', 'request_id': 'req-f026b671-8bf2-4943-a8b7-3bcc067d9f86'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:50.812221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f026b671-8bf2-4943-a8b7-3bcc067d9f86 admin admin] The token cache is being invalidate because project 4f2c7c681dce4c78b4e3bf1d6679970a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:43:50.812840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f026b671-8bf2-4943-a8b7-3bcc067d9f86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:50.814583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f026b671-8bf2-4943-a8b7-3bcc067d9f86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:50.824952 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3592/7251] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:43:50 2022] DELETE /identity/v3/projects/4f2c7c681dce4c78b4e3bf1d6679970a => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:43:50.831366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf030a-6977-4bfc-bb1a-b3af5774fcd6 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:50.832086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf030a-6977-4bfc-bb1a-b3af5774fcd6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:50.832440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf030a-6977-4bfc-bb1a-b3af5774fcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:50.879308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-99bf030a-6977-4bfc-bb1a-b3af5774fcd6 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:50.884335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-99bf030a-6977-4bfc-bb1a-b3af5774fcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:50.934930 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026b671-8bf2-4943-a8b7-3bcc067d9f86 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:50.937475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f026b671-8bf2-4943-a8b7-3bcc067d9f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:51.087069 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3660/7252] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:51.089560 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9eee5-ebe2-4c4e-a7cd-d527e687d41c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:51.089862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9eee5-ebe2-4c4e-a7cd-d527e687d41c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:51.090140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9eee5-ebe2-4c4e-a7cd-d527e687d41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:51.148097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-add9eee5-ebe2-4c4e-a7cd-d527e687d41c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:51.152966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-add9eee5-ebe2-4c4e-a7cd-d527e687d41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:51.169425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026b671-8bf2-4943-a8b7-3bcc067d9f86 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:51.185071 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3661/7253] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:43:51.188692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b3c42-85f8-478f-8720-5a5cc297f7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:51.188692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b3c42-85f8-478f-8720-5a5cc297f7f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:51.188692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b3c42-85f8-478f-8720-5a5cc297f7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:51.188692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b3c42-85f8-478f-8720-5a5cc297f7f2 admin admin] PATH_INFO: `/v3/users/abf09f11a55e4d349631e42266edd0e1` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:51.190075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9eee5-ebe2-4c4e-a7cd-d527e687d41c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:51.194938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b3c42-85f8-478f-8720-5a5cc297f7f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abf09f11a55e4d349631e42266edd0e1)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:51.200390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b3c42-85f8-478f-8720-5a5cc297f7f2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:51.216519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9eee5-ebe2-4c4e-a7cd-d527e687d41c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:51.232428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d75c1-0705-46ee-a7f3-f406715c9f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:51.234603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d75c1-0705-46ee-a7f3-f406715c9f80 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:51.235403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d75c1-0705-46ee-a7f3-f406715c9f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:51.236924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d75c1-0705-46ee-a7f3-f406715c9f80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:51.238193 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d75c1-0705-46ee-a7f3-f406715c9f80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:43:51.239313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d75c1-0705-46ee-a7f3-f406715c9f80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:51.248352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d75c1-0705-46ee-a7f3-f406715c9f80 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:51.324968 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3662/7254] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:43:51.325218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d75c1-0705-46ee-a7f3-f406715c9f80 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:51.329219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-bc9d75c1-0705-46ee-a7f3-f406715c9f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:51.364767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-163b3c42-85f8-478f-8720-5a5cc297f7f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abf09f11a55e4d349631e42266edd0e1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:51.373217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d75c1-0705-46ee-a7f3-f406715c9f80 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:51.389842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-163b3c42-85f8-478f-8720-5a5cc297f7f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abf09f11a55e4d349631e42266edd0e1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:51.390074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f03a18-0cf3-4d60-a785-02e40226187f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:51.390886 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f03a18-0cf3-4d60-a785-02e40226187f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:51.391153 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f03a18-0cf3-4d60-a785-02e40226187f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:51.391423 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f03a18-0cf3-4d60-a785-02e40226187f admin admin] PATH_INFO: `/v3/projects/8c81b6ecc96a47d586100493c124c2e1` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:51.396094 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f03a18-0cf3-4d60-a785-02e40226187f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c81b6ecc96a47d586100493c124c2e1)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:51.399725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f03a18-0cf3-4d60-a785-02e40226187f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:51.423979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-163b3c42-85f8-478f-8720-5a5cc297f7f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abf09f11a55e4d349631e42266edd0e1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:51.425383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-163b3c42-85f8-478f-8720-5a5cc297f7f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abf09f11a55e4d349631e42266edd0e1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:51.442255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-163b3c42-85f8-478f-8720-5a5cc297f7f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abf09f11a55e4d349631e42266edd0e1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:51.459705 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3593/7255] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:43:50 2022] DELETE /identity/v3/users/abf09f11a55e4d349631e42266edd0e1 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:51.460847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b3c42-85f8-478f-8720-5a5cc297f7f2 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:51.467454 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-163b3c42-85f8-478f-8720-5a5cc297f7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:51.475232 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:51.491846 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:51.529531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c3f03a18-0cf3-4d60-a785-02e40226187f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c81b6ecc96a47d586100493c124c2e1', 'request_id': 'req-c3f03a18-0cf3-4d60-a785-02e40226187f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:51.538958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c3f03a18-0cf3-4d60-a785-02e40226187f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c81b6ecc96a47d586100493c124c2e1', 'request_id': 'req-c3f03a18-0cf3-4d60-a785-02e40226187f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:51.551350 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c3f03a18-0cf3-4d60-a785-02e40226187f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c81b6ecc96a47d586100493c124c2e1', 'request_id': 'req-c3f03a18-0cf3-4d60-a785-02e40226187f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:51.569801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c3f03a18-0cf3-4d60-a785-02e40226187f admin admin] The token cache is being invalidate because project 8c81b6ecc96a47d586100493c124c2e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:43:51.570623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c3f03a18-0cf3-4d60-a785-02e40226187f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:51.571720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c3f03a18-0cf3-4d60-a785-02e40226187f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:51.576689 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3663/7256] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:43:51 2022] DELETE /identity/v3/projects/8c81b6ecc96a47d586100493c124c2e1 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:51.578377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1a0d5-21fc-4d36-b072-d667f83a9d83 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:51.578873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1a0d5-21fc-4d36-b072-d667f83a9d83 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:51.579355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1a0d5-21fc-4d36-b072-d667f83a9d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:51.627623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-70a1a0d5-21fc-4d36-b072-d667f83a9d83 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:51.640894 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-70a1a0d5-21fc-4d36-b072-d667f83a9d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:51.655427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b3c42-85f8-478f-8720-5a5cc297f7f2 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:51.753281 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3664/7257] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:51.755707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349fae5-9672-43d8-852c-3ef09ac7eaa8 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:51.756285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349fae5-9672-43d8-852c-3ef09ac7eaa8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:51.757073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349fae5-9672-43d8-852c-3ef09ac7eaa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:51.787193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752c8ed-ee2f-40d1-b624-ef86f96ccf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:51.788892 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-7349fae5-9672-43d8-852c-3ef09ac7eaa8 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:51.789309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752c8ed-ee2f-40d1-b624-ef86f96ccf01 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:51.790113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752c8ed-ee2f-40d1-b624-ef86f96ccf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:51.792468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752c8ed-ee2f-40d1-b624-ef86f96ccf01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:51.792716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7349fae5-9672-43d8-852c-3ef09ac7eaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:51.792883 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752c8ed-ee2f-40d1-b624-ef86f96ccf01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:51.798650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752c8ed-ee2f-40d1-b624-ef86f96ccf01 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:51.803189 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3665/7258] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:51.812024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa53ae8-15f6-4ee2-b9b5-f955c658a6f8 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:51.812708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa53ae8-15f6-4ee2-b9b5-f955c658a6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:51.813235 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa53ae8-15f6-4ee2-b9b5-f955c658a6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:51.844493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-efa53ae8-15f6-4ee2-b9b5-f955c658a6f8 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:51.846502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-efa53ae8-15f6-4ee2-b9b5-f955c658a6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:51.875039 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3594/7259] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:43:51 2022] POST /identity/v3/projects => generated 371 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:51.876048 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3666/7260] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:51.888602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752c8ed-ee2f-40d1-b624-ef86f96ccf01 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:51.889914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa53ae8-15f6-4ee2-b9b5-f955c658a6f8 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:51.891762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3752c8ed-ee2f-40d1-b624-ef86f96ccf01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:51.911315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa53ae8-15f6-4ee2-b9b5-f955c658a6f8 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:52.030269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752c8ed-ee2f-40d1-b624-ef86f96ccf01 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:52.034004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd26459-8259-436a-80a7-a03b080d2f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:52.035674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd26459-8259-436a-80a7-a03b080d2f85 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:52.036367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd26459-8259-436a-80a7-a03b080d2f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:52.036901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd26459-8259-436a-80a7-a03b080d2f85 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:52.037316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240aae3-55f2-4506-9378-517a879174fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:52.037949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd26459-8259-436a-80a7-a03b080d2f85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:43:52.038240 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240aae3-55f2-4506-9378-517a879174fa admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:52.038615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd26459-8259-436a-80a7-a03b080d2f85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:52.038751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240aae3-55f2-4506-9378-517a879174fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:52.039148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240aae3-55f2-4506-9378-517a879174fa admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:52.039919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240aae3-55f2-4506-9378-517a879174fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:52.041079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd26459-8259-436a-80a7-a03b080d2f85 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:52.044956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240aae3-55f2-4506-9378-517a879174fa admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:52.058237 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3667/7261] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:43:52.060228 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd26459-8259-436a-80a7-a03b080d2f85 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:52.063647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7cd26459-8259-436a-80a7-a03b080d2f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:52.086329 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3595/7262] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:43:51 2022] POST /identity/v3/users => generated 286 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:52.087559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240aae3-55f2-4506-9378-517a879174fa admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:52.102994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240aae3-55f2-4506-9378-517a879174fa admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:52.108930 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:52.112331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45174a03-2761-432c-94a2-8b1a65ed4558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:52.113264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45174a03-2761-432c-94a2-8b1a65ed4558 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:52.113936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45174a03-2761-432c-94a2-8b1a65ed4558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:52.116113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45174a03-2761-432c-94a2-8b1a65ed4558 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:52.117239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45174a03-2761-432c-94a2-8b1a65ed4558 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:52.122277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45174a03-2761-432c-94a2-8b1a65ed4558 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:52.142710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd26459-8259-436a-80a7-a03b080d2f85 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:52.148064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae81efc-c3f4-4b5a-b36e-f1e0e2e9e4cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:52.148852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae81efc-c3f4-4b5a-b36e-f1e0e2e9e4cb service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:52.149135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae81efc-c3f4-4b5a-b36e-f1e0e2e9e4cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:52.149448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae81efc-c3f4-4b5a-b36e-f1e0e2e9e4cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:52.167689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae81efc-c3f4-4b5a-b36e-f1e0e2e9e4cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:52.170648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae81efc-c3f4-4b5a-b36e-f1e0e2e9e4cb service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:52.188109 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3668/7263] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:43:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:43:52.189498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae81efc-c3f4-4b5a-b36e-f1e0e2e9e4cb service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:52.204506 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3596/7264] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:43:52 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:52.205752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45174a03-2761-432c-94a2-8b1a65ed4558 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:52.205882 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae81efc-c3f4-4b5a-b36e-f1e0e2e9e4cb service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:52.211477 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:52.317699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359affb6-9417-441c-b587-2a7b660cdad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:52.318582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359affb6-9417-441c-b587-2a7b660cdad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:52.320230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359affb6-9417-441c-b587-2a7b660cdad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:52.320569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359affb6-9417-441c-b587-2a7b660cdad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:52.321391 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359affb6-9417-441c-b587-2a7b660cdad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:52.323950 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359affb6-9417-441c-b587-2a7b660cdad1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:52.348303 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3669/7265] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:52.349906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359affb6-9417-441c-b587-2a7b660cdad1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:52.352426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-359affb6-9417-441c-b587-2a7b660cdad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:52.379729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45174a03-2761-432c-94a2-8b1a65ed4558 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:52.387293 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70daa1a-549a-44a0-a3ef-6dbffa099873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:52.388461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70daa1a-549a-44a0-a3ef-6dbffa099873 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:52.388830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70daa1a-549a-44a0-a3ef-6dbffa099873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:52.389171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70daa1a-549a-44a0-a3ef-6dbffa099873 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:52.399143 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359affb6-9417-441c-b587-2a7b660cdad1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:52.401102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70daa1a-549a-44a0-a3ef-6dbffa099873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:52.418228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70daa1a-549a-44a0-a3ef-6dbffa099873 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:52.424059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd677d7a-59ce-4017-bcc6-893d9a03a775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:52.424782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd677d7a-59ce-4017-bcc6-893d9a03a775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:52.426732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd677d7a-59ce-4017-bcc6-893d9a03a775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:52.427142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd677d7a-59ce-4017-bcc6-893d9a03a775 admin admin] PATH_INFO: `/v3/projects/9772d7506e284037a7e7c5ce47779372` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:52.432345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd677d7a-59ce-4017-bcc6-893d9a03a775 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9772d7506e284037a7e7c5ce47779372)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:52.436865 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd677d7a-59ce-4017-bcc6-893d9a03a775 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:52.489310 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3597/7266] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:43:52 2022] POST /identity/v3/users => generated 291 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:52.491637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70daa1a-549a-44a0-a3ef-6dbffa099873 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:52.523008 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70daa1a-549a-44a0-a3ef-6dbffa099873 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:52.563765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bd677d7a-59ce-4017-bcc6-893d9a03a775 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9772d7506e284037a7e7c5ce47779372', 'request_id': 'req-bd677d7a-59ce-4017-bcc6-893d9a03a775'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:52.572828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bd677d7a-59ce-4017-bcc6-893d9a03a775 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9772d7506e284037a7e7c5ce47779372', 'request_id': 'req-bd677d7a-59ce-4017-bcc6-893d9a03a775'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:52.583616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bd677d7a-59ce-4017-bcc6-893d9a03a775 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9772d7506e284037a7e7c5ce47779372', 'request_id': 'req-bd677d7a-59ce-4017-bcc6-893d9a03a775'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:52.614305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bd677d7a-59ce-4017-bcc6-893d9a03a775 admin admin] The token cache is being invalidate because project 9772d7506e284037a7e7c5ce47779372 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:43:52.615276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bd677d7a-59ce-4017-bcc6-893d9a03a775 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:52.617292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bd677d7a-59ce-4017-bcc6-893d9a03a775 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:52.620570 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3670/7267] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:43:52 2022] DELETE /identity/v3/projects/9772d7506e284037a7e7c5ce47779372 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:52.625513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd677d7a-59ce-4017-bcc6-893d9a03a775 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:52.629497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-bd677d7a-59ce-4017-bcc6-893d9a03a775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:52.653318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657efe7e-7004-4b34-be95-a11cd760b392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:52.654291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657efe7e-7004-4b34-be95-a11cd760b392 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:52.655125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657efe7e-7004-4b34-be95-a11cd760b392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:52.655367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657efe7e-7004-4b34-be95-a11cd760b392 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:52.656148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657efe7e-7004-4b34-be95-a11cd760b392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:52.658025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657efe7e-7004-4b34-be95-a11cd760b392 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:52.674498 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3598/7268] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:52.675373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657efe7e-7004-4b34-be95-a11cd760b392 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:52.680782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-657efe7e-7004-4b34-be95-a11cd760b392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:52.699808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657efe7e-7004-4b34-be95-a11cd760b392 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:52.708074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428370a-ffca-4bcc-b44f-66b198070131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:52.708860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428370a-ffca-4bcc-b44f-66b198070131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:52.709334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428370a-ffca-4bcc-b44f-66b198070131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:52.709662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428370a-ffca-4bcc-b44f-66b198070131 admin admin] PATH_INFO: `/v3/users/eeeb432a24b94e708b7e777d089547a2` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:52.717587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428370a-ffca-4bcc-b44f-66b198070131 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeeb432a24b94e708b7e777d089547a2)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:52.721163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428370a-ffca-4bcc-b44f-66b198070131 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:52.787510 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:52.804516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9428370a-ffca-4bcc-b44f-66b198070131 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeeb432a24b94e708b7e777d089547a2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:52.806544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd677d7a-59ce-4017-bcc6-893d9a03a775 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:52.819054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9428370a-ffca-4bcc-b44f-66b198070131 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeeb432a24b94e708b7e777d089547a2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:52.826323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57ccbd-8a89-462c-80f9-6cf28f5028c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:52.827325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57ccbd-8a89-462c-80f9-6cf28f5028c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:52.827790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57ccbd-8a89-462c-80f9-6cf28f5028c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:52.828216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57ccbd-8a89-462c-80f9-6cf28f5028c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:52.829221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57ccbd-8a89-462c-80f9-6cf28f5028c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:52.831532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57ccbd-8a89-462c-80f9-6cf28f5028c4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:52.839504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9428370a-ffca-4bcc-b44f-66b198070131 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeeb432a24b94e708b7e777d089547a2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:52.840745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9428370a-ffca-4bcc-b44f-66b198070131 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeeb432a24b94e708b7e777d089547a2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:52.846090 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3671/7269] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:52.847184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57ccbd-8a89-462c-80f9-6cf28f5028c4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:52.851088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0d57ccbd-8a89-462c-80f9-6cf28f5028c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:52.857774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9428370a-ffca-4bcc-b44f-66b198070131 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeeb432a24b94e708b7e777d089547a2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:52.861861 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:52.880366 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3599/7270] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:43:52 2022] DELETE /identity/v3/users/eeeb432a24b94e708b7e777d089547a2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:52.883139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428370a-ffca-4bcc-b44f-66b198070131 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:52.887837 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9428370a-ffca-4bcc-b44f-66b198070131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:52.894306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57ccbd-8a89-462c-80f9-6cf28f5028c4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:53.067224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554a4c8-3178-45f8-b1e1-2234c0f39d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:53.068118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554a4c8-3178-45f8-b1e1-2234c0f39d6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:53.068396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554a4c8-3178-45f8-b1e1-2234c0f39d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:53.068672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554a4c8-3178-45f8-b1e1-2234c0f39d6c admin admin] PATH_INFO: `/v3/projects/2da106fca0384c7da17b8c2b462f3b6d/users/df286c502d7c442391d2f0d728d84247/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:53.084712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428370a-ffca-4bcc-b44f-66b198070131 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:53.099665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca58cb-9329-448b-98c9-1c4e5ef72d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:53.100465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca58cb-9329-448b-98c9-1c4e5ef72d66 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:53.100748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca58cb-9329-448b-98c9-1c4e5ef72d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:53.102567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca58cb-9329-448b-98c9-1c4e5ef72d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:53.103283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca58cb-9329-448b-98c9-1c4e5ef72d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:53.103654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554a4c8-3178-45f8-b1e1-2234c0f39d6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2da106fca0384c7da17b8c2b462f3b6d, user_id=df286c502d7c442391d2f0d728d84247, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:53.105507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca58cb-9329-448b-98c9-1c4e5ef72d66 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:53.112892 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554a4c8-3178-45f8-b1e1-2234c0f39d6c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:53.144793 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3600/7271] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:53.145829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca58cb-9329-448b-98c9-1c4e5ef72d66 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:53.149450 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3672/7272] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:43:52 2022] PUT /identity/v3/projects/2da106fca0384c7da17b8c2b462f3b6d/users/df286c502d7c442391d2f0d728d84247/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:53.162854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070874cd-288d-4026-91fb-445c1a6ae9b6 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:53.163206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070874cd-288d-4026-91fb-445c1a6ae9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:53.163410 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070874cd-288d-4026-91fb-445c1a6ae9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:53.188238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca58cb-9329-448b-98c9-1c4e5ef72d66 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:53.237068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-070874cd-288d-4026-91fb-445c1a6ae9b6 None None] MFA Rules not processed for user `df286c502d7c442391d2f0d728d84247`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:53.238405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-070874cd-288d-4026-91fb-445c1a6ae9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:53.332479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c50163-4e17-4f85-a584-bf51fbdc7a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:53.334692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c50163-4e17-4f85-a584-bf51fbdc7a73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:53.334987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c50163-4e17-4f85-a584-bf51fbdc7a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:53.335301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c50163-4e17-4f85-a584-bf51fbdc7a73 admin admin] PATH_INFO: `/v3/projects/9430045c79904cda8ff7fdd5c1d1e926/users/3949526249bd4074acabbdfde008502c/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:53.395122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c50163-4e17-4f85-a584-bf51fbdc7a73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9430045c79904cda8ff7fdd5c1d1e926, user_id=3949526249bd4074acabbdfde008502c, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:53.398011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c50163-4e17-4f85-a584-bf51fbdc7a73 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:53.436794 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3673/7274] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:53.441409 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3601/7274] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:43:53 2022] PUT /identity/v3/projects/9430045c79904cda8ff7fdd5c1d1e926/users/3949526249bd4074acabbdfde008502c/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:53.451084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f070e-f8b2-4f2e-af15-cb74f71f3ac0 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:53.451292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f070e-f8b2-4f2e-af15-cb74f71f3ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:53.451633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f070e-f8b2-4f2e-af15-cb74f71f3ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:53.453551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c50163-4e17-4f85-a584-bf51fbdc7a73 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:53.456362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e1c50163-4e17-4f85-a584-bf51fbdc7a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:53.528685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-525f070e-f8b2-4f2e-af15-cb74f71f3ac0 None None] MFA Rules not processed for user `3949526249bd4074acabbdfde008502c`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:53.530035 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-525f070e-f8b2-4f2e-af15-cb74f71f3ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:53.589521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c50163-4e17-4f85-a584-bf51fbdc7a73 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:53.594471 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2586f-0340-4dc4-bab7-2a3a6b842e33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:53.595104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2586f-0340-4dc4-bab7-2a3a6b842e33 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:53.595385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2586f-0340-4dc4-bab7-2a3a6b842e33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:53.596057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2586f-0340-4dc4-bab7-2a3a6b842e33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:53.679458 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:53.684303 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:53.713370 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3674/7275] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:43:53.715374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f070e-f8b2-4f2e-af15-cb74f71f3ac0 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:53.746321 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2586f-0340-4dc4-bab7-2a3a6b842e33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:53.748088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2586f-0340-4dc4-bab7-2a3a6b842e33 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:53.774862 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3602/7276] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:43:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:43:53.800725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2586f-0340-4dc4-bab7-2a3a6b842e33 service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:53.802360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d4f2586f-0340-4dc4-bab7-2a3a6b842e33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:53.866665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f070e-f8b2-4f2e-af15-cb74f71f3ac0 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:53.880924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc622a-973c-4daf-b59e-8ada3bacade3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:53.881472 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc622a-973c-4daf-b59e-8ada3bacade3 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:53.882000 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc622a-973c-4daf-b59e-8ada3bacade3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:53.882270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc622a-973c-4daf-b59e-8ada3bacade3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:53.882907 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc622a-973c-4daf-b59e-8ada3bacade3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:53.885017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc622a-973c-4daf-b59e-8ada3bacade3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:53.933161 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3675/7277] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:43:53 2022] POST /identity/v3/projects => generated 379 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:43:53.937487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc622a-973c-4daf-b59e-8ada3bacade3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:53.954537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2586f-0340-4dc4-bab7-2a3a6b842e33 service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:54.089538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec4ea5-80cf-4315-98de-74188859dcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:54.092361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec4ea5-80cf-4315-98de-74188859dcc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:54.092645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec4ea5-80cf-4315-98de-74188859dcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:54.093196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec4ea5-80cf-4315-98de-74188859dcc0 admin admin] PATH_INFO: `/v3/users/df286c502d7c442391d2f0d728d84247` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:54.096218 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec4ea5-80cf-4315-98de-74188859dcc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df286c502d7c442391d2f0d728d84247)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:54.102682 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc622a-973c-4daf-b59e-8ada3bacade3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:54.104072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec4ea5-80cf-4315-98de-74188859dcc0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:54.120664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be347b66-2de0-4f00-9f8e-73eae57773de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:54.122917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be347b66-2de0-4f00-9f8e-73eae57773de admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:54.125030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be347b66-2de0-4f00-9f8e-73eae57773de admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:54.125470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be347b66-2de0-4f00-9f8e-73eae57773de admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:54.127873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be347b66-2de0-4f00-9f8e-73eae57773de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:54.137187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be347b66-2de0-4f00-9f8e-73eae57773de admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:54.270706 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3676/7278] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:43:53 2022] POST /identity/v3/users => generated 296 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:43:54.273364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be347b66-2de0-4f00-9f8e-73eae57773de admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:54.279463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-be347b66-2de0-4f00-9f8e-73eae57773de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:54.305284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0dec4ea5-80cf-4315-98de-74188859dcc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df286c502d7c442391d2f0d728d84247'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:54.307710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be347b66-2de0-4f00-9f8e-73eae57773de admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:54.318995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6629d4-d8d4-42ff-aceb-e7189aa46d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:54.320179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6629d4-d8d4-42ff-aceb-e7189aa46d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:54.320699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6629d4-d8d4-42ff-aceb-e7189aa46d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:54.321543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6629d4-d8d4-42ff-aceb-e7189aa46d30 admin admin] PATH_INFO: `/v3/projects/81af5a598d11458c8fd8b2fa170799ab` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:54.324119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6629d4-d8d4-42ff-aceb-e7189aa46d30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81af5a598d11458c8fd8b2fa170799ab)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:54.328132 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6629d4-d8d4-42ff-aceb-e7189aa46d30 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:54.329533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0dec4ea5-80cf-4315-98de-74188859dcc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df286c502d7c442391d2f0d728d84247'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:54.357707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0dec4ea5-80cf-4315-98de-74188859dcc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df286c502d7c442391d2f0d728d84247'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:54.360467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0dec4ea5-80cf-4315-98de-74188859dcc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df286c502d7c442391d2f0d728d84247'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:54.386886 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0dec4ea5-80cf-4315-98de-74188859dcc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df286c502d7c442391d2f0d728d84247'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:54.411711 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:54.441488 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3603/7279] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:43:53 2022] DELETE /identity/v3/users/df286c502d7c442391d2f0d728d84247 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:54.443164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec4ea5-80cf-4315-98de-74188859dcc0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:54.446032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0dec4ea5-80cf-4315-98de-74188859dcc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:54.533862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6d6629d4-d8d4-42ff-aceb-e7189aa46d30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81af5a598d11458c8fd8b2fa170799ab', 'request_id': 'req-6d6629d4-d8d4-42ff-aceb-e7189aa46d30'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:54.553648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6d6629d4-d8d4-42ff-aceb-e7189aa46d30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81af5a598d11458c8fd8b2fa170799ab', 'request_id': 'req-6d6629d4-d8d4-42ff-aceb-e7189aa46d30'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:54.577777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6d6629d4-d8d4-42ff-aceb-e7189aa46d30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81af5a598d11458c8fd8b2fa170799ab', 'request_id': 'req-6d6629d4-d8d4-42ff-aceb-e7189aa46d30'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:54.580427 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:54.609127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6d6629d4-d8d4-42ff-aceb-e7189aa46d30 admin admin] The token cache is being invalidate because project 81af5a598d11458c8fd8b2fa170799ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:43:54.609711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6d6629d4-d8d4-42ff-aceb-e7189aa46d30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:54.610700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6d6629d4-d8d4-42ff-aceb-e7189aa46d30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:54.614072 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3677/7280] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:43:54 2022] DELETE /identity/v3/projects/81af5a598d11458c8fd8b2fa170799ab => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:54.618124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab83794-8845-4fab-9aa3-6d2621784b30 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:54.618663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab83794-8845-4fab-9aa3-6d2621784b30 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:54.619152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab83794-8845-4fab-9aa3-6d2621784b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:54.641038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec4ea5-80cf-4315-98de-74188859dcc0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:54.650152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6ab83794-8845-4fab-9aa3-6d2621784b30 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:54.653921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6ab83794-8845-4fab-9aa3-6d2621784b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:54.761495 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3678/7281] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:54.765115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784528f-e111-47cc-8fef-c930e96b97fe None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:54.765578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784528f-e111-47cc-8fef-c930e96b97fe None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:54.765994 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2784528f-e111-47cc-8fef-c930e96b97fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:54.806650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2784528f-e111-47cc-8fef-c930e96b97fe None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:54.808312 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2784528f-e111-47cc-8fef-c930e96b97fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:54.823313 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3679/7282] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:54.824332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2784528f-e111-47cc-8fef-c930e96b97fe None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:54.826361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2784528f-e111-47cc-8fef-c930e96b97fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:54.843724 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2784528f-e111-47cc-8fef-c930e96b97fe None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:54.850044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18683e97-b0f6-4572-8c0d-2ceccf9e6594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:54.850896 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18683e97-b0f6-4572-8c0d-2ceccf9e6594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:54.851175 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18683e97-b0f6-4572-8c0d-2ceccf9e6594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:54.851481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18683e97-b0f6-4572-8c0d-2ceccf9e6594 admin admin] PATH_INFO: `/v3/projects/ce19c7cc002946598f9bdf954982caac` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:54.852785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18683e97-b0f6-4572-8c0d-2ceccf9e6594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce19c7cc002946598f9bdf954982caac)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:54.856575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18683e97-b0f6-4572-8c0d-2ceccf9e6594 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:54.876241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fd563-6711-4e6c-b07c-0475ab233f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:54.876881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fd563-6711-4e6c-b07c-0475ab233f32 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:54.877159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fd563-6711-4e6c-b07c-0475ab233f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:54.877433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fd563-6711-4e6c-b07c-0475ab233f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:54.878097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959fd563-6711-4e6c-b07c-0475ab233f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:54.879712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959fd563-6711-4e6c-b07c-0475ab233f32 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:54.899463 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3604/7283] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 454 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:54.899463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fd563-6711-4e6c-b07c-0475ab233f32 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:54.899807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-959fd563-6711-4e6c-b07c-0475ab233f32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:54.945112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-18683e97-b0f6-4572-8c0d-2ceccf9e6594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce19c7cc002946598f9bdf954982caac', 'request_id': 'req-18683e97-b0f6-4572-8c0d-2ceccf9e6594'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:54.962976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-18683e97-b0f6-4572-8c0d-2ceccf9e6594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce19c7cc002946598f9bdf954982caac', 'request_id': 'req-18683e97-b0f6-4572-8c0d-2ceccf9e6594'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:54.974203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fd563-6711-4e6c-b07c-0475ab233f32 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:54.975701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-18683e97-b0f6-4572-8c0d-2ceccf9e6594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce19c7cc002946598f9bdf954982caac', 'request_id': 'req-18683e97-b0f6-4572-8c0d-2ceccf9e6594'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:55.003349 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-18683e97-b0f6-4572-8c0d-2ceccf9e6594 admin admin] The token cache is being invalidate because project ce19c7cc002946598f9bdf954982caac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:43:55.004108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-18683e97-b0f6-4572-8c0d-2ceccf9e6594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:55.005088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-18683e97-b0f6-4572-8c0d-2ceccf9e6594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:55.007911 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3680/7284] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:43:54 2022] DELETE /identity/v3/projects/ce19c7cc002946598f9bdf954982caac => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:55.011372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230575b-a381-401c-9b67-9176ea939045 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:55.011773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230575b-a381-401c-9b67-9176ea939045 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:55.012183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230575b-a381-401c-9b67-9176ea939045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:55.055349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931cdf01-f7b5-4a24-bd32-ad29829858ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:55.056161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cdf01-f7b5-4a24-bd32-ad29829858ff service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:55.056442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cdf01-f7b5-4a24-bd32-ad29829858ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:55.056816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cdf01-f7b5-4a24-bd32-ad29829858ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:55.058690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-4230575b-a381-401c-9b67-9176ea939045 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:55.058933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-931cdf01-f7b5-4a24-bd32-ad29829858ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:55.059921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4230575b-a381-401c-9b67-9176ea939045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:55.078837 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:55.196138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931cdf01-f7b5-4a24-bd32-ad29829858ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:55.200560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931cdf01-f7b5-4a24-bd32-ad29829858ff service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:55.237200 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3681/7285] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:55.238680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230575b-a381-401c-9b67-9176ea939045 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:55.240012 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3605/7286] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:43:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:43:55.243531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354c739-6f81-4100-8c73-1b9b21f267ac None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:55.243729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354c739-6f81-4100-8c73-1b9b21f267ac None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:55.244087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354c739-6f81-4100-8c73-1b9b21f267ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:55.244666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4230575b-a381-401c-9b67-9176ea939045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:55.282539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230575b-a381-401c-9b67-9176ea939045 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:55.283637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3354c739-6f81-4100-8c73-1b9b21f267ac None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:55.285586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3354c739-6f81-4100-8c73-1b9b21f267ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:55.302965 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3606/7287] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:55.302965 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354c739-6f81-4100-8c73-1b9b21f267ac None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:55.307135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a6ca2-4648-4ce9-a82a-4e4a608d3e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:55.308239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a6ca2-4648-4ce9-a82a-4e4a608d3e58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:55.308806 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a6ca2-4648-4ce9-a82a-4e4a608d3e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:55.310846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a6ca2-4648-4ce9-a82a-4e4a608d3e58 admin admin] PATH_INFO: `/v3/projects/008c978ffe494c2eb56d28bcb2323b14/users/34117d9ecf4f464c8493341899a7f606/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:55.317715 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:55.346825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354c739-6f81-4100-8c73-1b9b21f267ac None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:55.352057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21907c7-6ee5-4d00-bd26-7031f32380cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:55.352781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21907c7-6ee5-4d00-bd26-7031f32380cb admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:55.353118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21907c7-6ee5-4d00-bd26-7031f32380cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:55.353394 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21907c7-6ee5-4d00-bd26-7031f32380cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:55.354870 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21907c7-6ee5-4d00-bd26-7031f32380cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:43:55.355196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21907c7-6ee5-4d00-bd26-7031f32380cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:55.357566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21907c7-6ee5-4d00-bd26-7031f32380cb admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:55.357713 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a6ca2-4648-4ce9-a82a-4e4a608d3e58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=008c978ffe494c2eb56d28bcb2323b14, user_id=34117d9ecf4f464c8493341899a7f606, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:55.360460 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a6ca2-4648-4ce9-a82a-4e4a608d3e58 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:55.378845 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3607/7288] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:43:55.378845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909b98e-e841-42b9-89ec-513ae383f33e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:55.378845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909b98e-e841-42b9-89ec-513ae383f33e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:55.378845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909b98e-e841-42b9-89ec-513ae383f33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:55.393082 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3682/7289] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:43:55 2022] PUT /identity/v3/projects/008c978ffe494c2eb56d28bcb2323b14/users/34117d9ecf4f464c8493341899a7f606/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:55.397089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a6ca2-4648-4ce9-a82a-4e4a608d3e58 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:55.421484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9909b98e-e841-42b9-89ec-513ae383f33e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:55.423966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9909b98e-e841-42b9-89ec-513ae383f33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:55.508468 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3608/7290] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:55.509847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909b98e-e841-42b9-89ec-513ae383f33e None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:55.522112 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909b98e-e841-42b9-89ec-513ae383f33e None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:55.532388 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb5ae0-b942-450d-8ee3-32a903c7dadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:55.533562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb5ae0-b942-450d-8ee3-32a903c7dadd admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:55.534077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb5ae0-b942-450d-8ee3-32a903c7dadd admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:55.534599 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb5ae0-b942-450d-8ee3-32a903c7dadd admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:55.535381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb5ae0-b942-450d-8ee3-32a903c7dadd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:55.541056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb5ae0-b942-450d-8ee3-32a903c7dadd admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:55.544576 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a6ca2-4648-4ce9-a82a-4e4a608d3e58 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:55.551648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9d8c3-78b9-4791-af94-e37ebe513475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:55.552400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9d8c3-78b9-4791-af94-e37ebe513475 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:55.553144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9d8c3-78b9-4791-af94-e37ebe513475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:55.553144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9d8c3-78b9-4791-af94-e37ebe513475 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:55.554489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9d8c3-78b9-4791-af94-e37ebe513475 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:55.556900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9d8c3-78b9-4791-af94-e37ebe513475 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:55.561373 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3609/7291] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:55.562819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb5ae0-b942-450d-8ee3-32a903c7dadd admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:55.567103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-84eb5ae0-b942-450d-8ee3-32a903c7dadd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:55.602560 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3683/7292] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:43:55 2022] POST /identity/v3/projects => generated 385 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:55.605135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9d8c3-78b9-4791-af94-e37ebe513475 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:55.743681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9d8c3-78b9-4791-af94-e37ebe513475 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:55.749498 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb5ae0-b942-450d-8ee3-32a903c7dadd admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:55.750219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fff89-6b81-4ab1-a082-533809c84f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:55.751186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fff89-6b81-4ab1-a082-533809c84f16 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:55.751686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fff89-6b81-4ab1-a082-533809c84f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:55.752165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fff89-6b81-4ab1-a082-533809c84f16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:55.753088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1fff89-6b81-4ab1-a082-533809c84f16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:43:55.753474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1fff89-6b81-4ab1-a082-533809c84f16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:55.755201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1fff89-6b81-4ab1-a082-533809c84f16 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:55.775092 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3684/7293] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:43:55.780139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fff89-6b81-4ab1-a082-533809c84f16 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:55.784821 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:55.799445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fff89-6b81-4ab1-a082-533809c84f16 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:55.813577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258eba7-500f-4549-a807-751c84e220b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:55.814683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258eba7-500f-4549-a807-751c84e220b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:55.816959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258eba7-500f-4549-a807-751c84e220b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:55.816959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258eba7-500f-4549-a807-751c84e220b3 admin admin] PATH_INFO: `/v3/projects/008c978ffe494c2eb56d28bcb2323b14/users/34117d9ecf4f464c8493341899a7f606/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:55.818736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258eba7-500f-4549-a807-751c84e220b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=008c978ffe494c2eb56d28bcb2323b14, user_id=34117d9ecf4f464c8493341899a7f606, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:55.823069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258eba7-500f-4549-a807-751c84e220b3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:55.860718 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3685/7294] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:43:55 2022] PUT /identity/v3/projects/008c978ffe494c2eb56d28bcb2323b14/users/34117d9ecf4f464c8493341899a7f606/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:55.862588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258eba7-500f-4549-a807-751c84e220b3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:55.890980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68547ed1-391e-43c9-89f6-e3896a5470b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:55.892121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68547ed1-391e-43c9-89f6-e3896a5470b7 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:55.892600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68547ed1-391e-43c9-89f6-e3896a5470b7 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:55.893599 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68547ed1-391e-43c9-89f6-e3896a5470b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:55.900312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-68547ed1-391e-43c9-89f6-e3896a5470b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:55.934279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68547ed1-391e-43c9-89f6-e3896a5470b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:55.939723 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68547ed1-391e-43c9-89f6-e3896a5470b7 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:55.969836 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3610/7295] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:43:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:43:55.974027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68547ed1-391e-43c9-89f6-e3896a5470b7 service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:55.991219 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:55.998689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68547ed1-391e-43c9-89f6-e3896a5470b7 service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:56.013118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432693d-f2a4-4a22-9214-6113d90ac93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:56.014147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432693d-f2a4-4a22-9214-6113d90ac93e admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:56.015556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432693d-f2a4-4a22-9214-6113d90ac93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:56.016900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432693d-f2a4-4a22-9214-6113d90ac93e admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:56.018939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432693d-f2a4-4a22-9214-6113d90ac93e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:56.020511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258eba7-500f-4549-a807-751c84e220b3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:56.023835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432693d-f2a4-4a22-9214-6113d90ac93e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:56.031319 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07cdb0-ea91-4231-b61e-a4e848ee62b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:56.032840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07cdb0-ea91-4231-b61e-a4e848ee62b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:56.035326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07cdb0-ea91-4231-b61e-a4e848ee62b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:56.035755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07cdb0-ea91-4231-b61e-a4e848ee62b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:56.036623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07cdb0-ea91-4231-b61e-a4e848ee62b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:56.043608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc07cdb0-ea91-4231-b61e-a4e848ee62b6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:56.120003 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3611/7296] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:43:55 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:56.125893 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797bc3c-9ac9-4f2e-9484-0ded194d5b45 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:56.130930 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3686/7297] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:43:55 2022] POST /identity/v3/users => generated 293 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:56.130930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07cdb0-ea91-4231-b61e-a4e848ee62b6 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:56.134047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797bc3c-9ac9-4f2e-9484-0ded194d5b45 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:56.138372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797bc3c-9ac9-4f2e-9484-0ded194d5b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:56.176148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07cdb0-ea91-4231-b61e-a4e848ee62b6 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:56.219765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b797bc3c-9ac9-4f2e-9484-0ded194d5b45 None None] MFA Rules not processed for user `34117d9ecf4f464c8493341899a7f606`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:56.222277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b797bc3c-9ac9-4f2e-9484-0ded194d5b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:56.335585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974b85d-a9aa-4824-a437-e687f60e43ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:56.336618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974b85d-a9aa-4824-a437-e687f60e43ef admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:56.336618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974b85d-a9aa-4824-a437-e687f60e43ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:56.337160 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974b85d-a9aa-4824-a437-e687f60e43ef admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:56.337623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974b85d-a9aa-4824-a437-e687f60e43ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:56.345519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974b85d-a9aa-4824-a437-e687f60e43ef admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:56.393452 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3687/7298] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:43:56 2022] POST /identity/v3/users => generated 287 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:56.397033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974b85d-a9aa-4824-a437-e687f60e43ef admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:56.399913 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3612/7299] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:56.401658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797bc3c-9ac9-4f2e-9484-0ded194d5b45 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:56.404947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b797bc3c-9ac9-4f2e-9484-0ded194d5b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:56.423469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974b85d-a9aa-4824-a437-e687f60e43ef admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:56.430191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797bc3c-9ac9-4f2e-9484-0ded194d5b45 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:56.437442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0d361-79df-494a-af98-27e8a1948ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:56.438120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0d361-79df-494a-af98-27e8a1948ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:56.438392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0d361-79df-494a-af98-27e8a1948ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:56.438667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d0d361-79df-494a-af98-27e8a1948ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:56.439325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0d361-79df-494a-af98-27e8a1948ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:56.440964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d0d361-79df-494a-af98-27e8a1948ae4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:56.445256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac9afd-8dba-4b8c-8beb-269e504eae09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:56.447600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac9afd-8dba-4b8c-8beb-269e504eae09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:56.448825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac9afd-8dba-4b8c-8beb-269e504eae09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:56.449169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac9afd-8dba-4b8c-8beb-269e504eae09 admin admin] PATH_INFO: `/v3/projects/2da106fca0384c7da17b8c2b462f3b6d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:56.450676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac9afd-8dba-4b8c-8beb-269e504eae09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2da106fca0384c7da17b8c2b462f3b6d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:56.454376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac9afd-8dba-4b8c-8beb-269e504eae09 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:56.469387 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3688/7300] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:56.469387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0d361-79df-494a-af98-27e8a1948ae4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:56.497404 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d0d361-79df-494a-af98-27e8a1948ae4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:56.508089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cee44-a091-479c-8aef-67b55c017ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:56.509695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cee44-a091-479c-8aef-67b55c017ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:56.510187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cee44-a091-479c-8aef-67b55c017ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:56.510840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cee44-a091-479c-8aef-67b55c017ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:56.511783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286cee44-a091-479c-8aef-67b55c017ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:56.514705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286cee44-a091-479c-8aef-67b55c017ad5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:56.539713 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3689/7301] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:56.542335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cee44-a091-479c-8aef-67b55c017ad5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:56.549753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-286cee44-a091-479c-8aef-67b55c017ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:56.551435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2dac9afd-8dba-4b8c-8beb-269e504eae09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2da106fca0384c7da17b8c2b462f3b6d', 'request_id': 'req-2dac9afd-8dba-4b8c-8beb-269e504eae09'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:56.568962 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2dac9afd-8dba-4b8c-8beb-269e504eae09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2da106fca0384c7da17b8c2b462f3b6d', 'request_id': 'req-2dac9afd-8dba-4b8c-8beb-269e504eae09'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:56.577487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2dac9afd-8dba-4b8c-8beb-269e504eae09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2da106fca0384c7da17b8c2b462f3b6d', 'request_id': 'req-2dac9afd-8dba-4b8c-8beb-269e504eae09'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:56.590147 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:56.602674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2dac9afd-8dba-4b8c-8beb-269e504eae09 admin admin] The token cache is being invalidate because project 2da106fca0384c7da17b8c2b462f3b6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:43:56.603720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2dac9afd-8dba-4b8c-8beb-269e504eae09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:56.605953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2dac9afd-8dba-4b8c-8beb-269e504eae09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:56.611570 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3613/7302] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:43:56 2022] DELETE /identity/v3/projects/2da106fca0384c7da17b8c2b462f3b6d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:56.611570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac9afd-8dba-4b8c-8beb-269e504eae09 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:56.614680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2dac9afd-8dba-4b8c-8beb-269e504eae09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:56.722616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cee44-a091-479c-8aef-67b55c017ad5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:56.770548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac9afd-8dba-4b8c-8beb-269e504eae09 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:56.785789 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b2975-ddd0-43af-8acf-4d4e8b9e29fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:56.787146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b2975-ddd0-43af-8acf-4d4e8b9e29fe admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:56.787676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b2975-ddd0-43af-8acf-4d4e8b9e29fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:56.788311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b2975-ddd0-43af-8acf-4d4e8b9e29fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:56.789487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b2975-ddd0-43af-8acf-4d4e8b9e29fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:56.791683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b2975-ddd0-43af-8acf-4d4e8b9e29fe admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:56.805273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84261e62-4a3d-4b18-81d2-235563f02c30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:56.805897 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84261e62-4a3d-4b18-81d2-235563f02c30 service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:56.806176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84261e62-4a3d-4b18-81d2-235563f02c30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:56.807103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84261e62-4a3d-4b18-81d2-235563f02c30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:56.807801 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3614/7303] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:56.808841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b2975-ddd0-43af-8acf-4d4e8b9e29fe admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:56.811768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-84261e62-4a3d-4b18-81d2-235563f02c30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:56.821758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-903b2975-ddd0-43af-8acf-4d4e8b9e29fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:56.824536 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:56.864988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b2975-ddd0-43af-8acf-4d4e8b9e29fe admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:56.874751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb21493-fbaf-4160-a479-0c43502a6644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:56.875763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb21493-fbaf-4160-a479-0c43502a6644 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:56.876239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb21493-fbaf-4160-a479-0c43502a6644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:56.877478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb21493-fbaf-4160-a479-0c43502a6644 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:56.878557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb21493-fbaf-4160-a479-0c43502a6644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:56.880704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb21493-fbaf-4160-a479-0c43502a6644 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:56.922357 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3615/7304] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:56.940074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79644b-a1f8-4e05-8fad-234b10911843 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:56.940421 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79644b-a1f8-4e05-8fad-234b10911843 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:56.940751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79644b-a1f8-4e05-8fad-234b10911843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:56.945246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84261e62-4a3d-4b18-81d2-235563f02c30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:56.946745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84261e62-4a3d-4b18-81d2-235563f02c30 service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:56.958992 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3690/7305] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:43:56 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:43:56.959831 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84261e62-4a3d-4b18-81d2-235563f02c30 service cinder] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:56.971339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84261e62-4a3d-4b18-81d2-235563f02c30 service cinder] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:56.989016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd5650-fe89-4734-90ed-644ab26ad5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:56.990111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd5650-fe89-4734-90ed-644ab26ad5be admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:56.990274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd5650-fe89-4734-90ed-644ab26ad5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:56.990912 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd5650-fe89-4734-90ed-644ab26ad5be admin admin] PATH_INFO: `/v3/projects/193bef3f4f464f9b80f65a1eb707db5d/users/32b28f75d4894451b0353f3b03b221db/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:57.003419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6a79644b-a1f8-4e05-8fad-234b10911843 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:57.004680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6a79644b-a1f8-4e05-8fad-234b10911843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:57.015536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd5650-fe89-4734-90ed-644ab26ad5be admin admin] RBAC: Authorizing `identity:create_grant(project_id=193bef3f4f464f9b80f65a1eb707db5d, user_id=32b28f75d4894451b0353f3b03b221db, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:57.018980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd5650-fe89-4734-90ed-644ab26ad5be admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:57.030375 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3616/7306] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:57.031696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79644b-a1f8-4e05-8fad-234b10911843 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:57.056082 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3691/7307] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:43:56 2022] PUT /identity/v3/projects/193bef3f4f464f9b80f65a1eb707db5d/users/32b28f75d4894451b0353f3b03b221db/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:57.058832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39354f08-4320-4b94-9f1c-d9f459c252d8 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:57.059114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39354f08-4320-4b94-9f1c-d9f459c252d8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:57.063481 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a79644b-a1f8-4e05-8fad-234b10911843 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:57.064546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39354f08-4320-4b94-9f1c-d9f459c252d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:57.098157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-39354f08-4320-4b94-9f1c-d9f459c252d8 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:57.100586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-39354f08-4320-4b94-9f1c-d9f459c252d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:57.188630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c75083-3cb4-40b2-ad81-bb85d88fc9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:57.189596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c75083-3cb4-40b2-ad81-bb85d88fc9c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:57.193430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c75083-3cb4-40b2-ad81-bb85d88fc9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:57.193835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c75083-3cb4-40b2-ad81-bb85d88fc9c4 admin admin] PATH_INFO: `/v3/projects/a755804e032045aab26a799cdbd161ce/users/9eb6b39f751e440988f7d46a04011455/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:57.226815 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c75083-3cb4-40b2-ad81-bb85d88fc9c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a755804e032045aab26a799cdbd161ce, user_id=9eb6b39f751e440988f7d46a04011455, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:57.232896 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c75083-3cb4-40b2-ad81-bb85d88fc9c4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:57.264276 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3692/7308] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:57.266048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52254c86-31ca-4241-821e-5297701972a4 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:57.269474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52254c86-31ca-4241-821e-5297701972a4 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:57.269998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52254c86-31ca-4241-821e-5297701972a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:57.286231 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3617/7309] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:43:57 2022] PUT /identity/v3/projects/a755804e032045aab26a799cdbd161ce/users/9eb6b39f751e440988f7d46a04011455/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:57.288320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c75083-3cb4-40b2-ad81-bb85d88fc9c4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:57.356905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-52254c86-31ca-4241-821e-5297701972a4 None None] MFA Rules not processed for user `32b28f75d4894451b0353f3b03b221db`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:57.360688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-52254c86-31ca-4241-821e-5297701972a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:57.445889 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c75083-3cb4-40b2-ad81-bb85d88fc9c4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:57.474003 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:57.501047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498e2c5-258c-4900-8a5a-5d16ee90c5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:57.501960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498e2c5-258c-4900-8a5a-5d16ee90c5e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:57.502245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498e2c5-258c-4900-8a5a-5d16ee90c5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:57.502511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498e2c5-258c-4900-8a5a-5d16ee90c5e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:57.503182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c498e2c5-258c-4900-8a5a-5d16ee90c5e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:43:57.503479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c498e2c5-258c-4900-8a5a-5d16ee90c5e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:57.505529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c498e2c5-258c-4900-8a5a-5d16ee90c5e4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:57.524395 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3618/7310] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:43:57.526325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1a08f-e262-4680-a59e-5249aff94bd5 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:57.531079 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1a08f-e262-4680-a59e-5249aff94bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:57.531079 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1a08f-e262-4680-a59e-5249aff94bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:57.583764 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:57.589245 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3693/7311] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:57.590816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52254c86-31ca-4241-821e-5297701972a4 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:57.606527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52254c86-31ca-4241-821e-5297701972a4 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:57.614665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d2863-9f47-4db6-a90a-035e3b5afd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:57.615670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d2863-9f47-4db6-a90a-035e3b5afd75 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:57.615818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-68a1a08f-e262-4680-a59e-5249aff94bd5 None None] MFA Rules not processed for user `9eb6b39f751e440988f7d46a04011455`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:57.616448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d2863-9f47-4db6-a90a-035e3b5afd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:57.616941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d2863-9f47-4db6-a90a-035e3b5afd75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:57.617071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-68a1a08f-e262-4680-a59e-5249aff94bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:57.618109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d2863-9f47-4db6-a90a-035e3b5afd75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:57.622662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d2863-9f47-4db6-a90a-035e3b5afd75 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:57.693063 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3694/7312] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:43:57 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:57.693063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d2863-9f47-4db6-a90a-035e3b5afd75 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:57.758862 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3619/7313] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:57.759771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1a08f-e262-4680-a59e-5249aff94bd5 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:57.781907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1a08f-e262-4680-a59e-5249aff94bd5 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:57.879171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d2863-9f47-4db6-a90a-035e3b5afd75 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:57.895379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3b09e-5bac-4d98-a346-92853281cfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:57.902131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3b09e-5bac-4d98-a346-92853281cfe5 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:57.902560 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3b09e-5bac-4d98-a346-92853281cfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:57.902745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3b09e-5bac-4d98-a346-92853281cfe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:57.903451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a3b09e-5bac-4d98-a346-92853281cfe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:57.905476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a3b09e-5bac-4d98-a346-92853281cfe5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:57.939941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f07f96-64ab-468b-ae87-e2211beaf778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:57.940695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f07f96-64ab-468b-ae87-e2211beaf778 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:57.941010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f07f96-64ab-468b-ae87-e2211beaf778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:57.941304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f07f96-64ab-468b-ae87-e2211beaf778 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:57.941877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f07f96-64ab-468b-ae87-e2211beaf778 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:57.943999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f07f96-64ab-468b-ae87-e2211beaf778 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:57.983033 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3695/7314] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:43:57 2022] POST /identity/v3/projects => generated 385 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:57.984049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3b09e-5bac-4d98-a346-92853281cfe5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:58.009982 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3620/7315] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:43:57 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:58.010833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f07f96-64ab-468b-ae87-e2211beaf778 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:58.015374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e0f07f96-64ab-468b-ae87-e2211beaf778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:58.048465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f07f96-64ab-468b-ae87-e2211beaf778 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:58.140295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3b09e-5bac-4d98-a346-92853281cfe5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:58.151224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d068151-19e9-425f-b520-2815a8a4a61d tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb6b39f751e440988f7d46a04011455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a755804e032045aab26a799cdbd161ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:58.152688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d068151-19e9-425f-b520-2815a8a4a61d tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:58.152995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d068151-19e9-425f-b520-2815a8a4a61d tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:58.153465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d068151-19e9-425f-b520-2815a8a4a61d tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] PATH_INFO: `/v3/users/9eb6b39f751e440988f7d46a04011455/credentials/OS-EC2` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:58.153858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d068151-19e9-425f-b520-2815a8a4a61d tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=9eb6b39f751e440988f7d46a04011455)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:58.159949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d068151-19e9-425f-b520-2815a8a4a61d tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:58.203361 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3696/7316] 10.222.0.39 () {60 vars in 1299 bytes} [Sun Aug 7 01:43:57 2022] POST /identity/v3/users/9eb6b39f751e440988f7d46a04011455/credentials/OS-EC2 => generated 367 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:58.203361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d068151-19e9-425f-b520-2815a8a4a61d tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:58.212574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f3986-c015-4453-af4b-724480fbfb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:58.214688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f3986-c015-4453-af4b-724480fbfb37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:58.215126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f3986-c015-4453-af4b-724480fbfb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:58.215506 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f3986-c015-4453-af4b-724480fbfb37 admin admin] PATH_INFO: `/v3/users/3949526249bd4074acabbdfde008502c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:58.217075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f3986-c015-4453-af4b-724480fbfb37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3949526249bd4074acabbdfde008502c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:58.219247 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f3986-c015-4453-af4b-724480fbfb37 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:58.229550 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:58.327945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2f4f3986-c015-4453-af4b-724480fbfb37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3949526249bd4074acabbdfde008502c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:58.337927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d068151-19e9-425f-b520-2815a8a4a61d tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:58.343740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707adf5-3074-49ee-acfa-efb56ea52d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:58.344532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707adf5-3074-49ee-acfa-efb56ea52d33 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:58.344675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2f4f3986-c015-4453-af4b-724480fbfb37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3949526249bd4074acabbdfde008502c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:58.344983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707adf5-3074-49ee-acfa-efb56ea52d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:58.345346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707adf5-3074-49ee-acfa-efb56ea52d33 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:58.346073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707adf5-3074-49ee-acfa-efb56ea52d33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:58.349090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707adf5-3074-49ee-acfa-efb56ea52d33 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:58.369690 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:58.397428 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2f4f3986-c015-4453-af4b-724480fbfb37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3949526249bd4074acabbdfde008502c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:58.398237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2f4f3986-c015-4453-af4b-724480fbfb37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3949526249bd4074acabbdfde008502c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:58.410998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2f4f3986-c015-4453-af4b-724480fbfb37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3949526249bd4074acabbdfde008502c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:43:58.422646 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3621/7317] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:43:58 2022] DELETE /identity/v3/users/3949526249bd4074acabbdfde008502c => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:58.425884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f3986-c015-4453-af4b-724480fbfb37 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:58.431248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2f4f3986-c015-4453-af4b-724480fbfb37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:58.447275 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3697/7318] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:43:58 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:58.449453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707adf5-3074-49ee-acfa-efb56ea52d33 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:58.457005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0707adf5-3074-49ee-acfa-efb56ea52d33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:58.492222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707adf5-3074-49ee-acfa-efb56ea52d33 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:58.654412 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f3986-c015-4453-af4b-724480fbfb37 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:58.665902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28c012-39eb-4904-947f-e71dad58cb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:58.667181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28c012-39eb-4904-947f-e71dad58cb46 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:58.667467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28c012-39eb-4904-947f-e71dad58cb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:58.667737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28c012-39eb-4904-947f-e71dad58cb46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:58.668433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28c012-39eb-4904-947f-e71dad58cb46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:58.670114 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28c012-39eb-4904-947f-e71dad58cb46 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:58.689994 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dacc7f-b3f6-4fcc-a487-8a6137db8aba tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb6b39f751e440988f7d46a04011455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a755804e032045aab26a799cdbd161ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:58.691927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dacc7f-b3f6-4fcc-a487-8a6137db8aba tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:58.693073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dacc7f-b3f6-4fcc-a487-8a6137db8aba tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:58.693446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dacc7f-b3f6-4fcc-a487-8a6137db8aba tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] PATH_INFO: `/v3/users/9eb6b39f751e440988f7d46a04011455/credentials/OS-EC2/105005d1091c4b00ab1e1fd6b46b0dca` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:58.704720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dacc7f-b3f6-4fcc-a487-8a6137db8aba tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=9eb6b39f751e440988f7d46a04011455, credential_id=105005d1091c4b00ab1e1fd6b46b0dca)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:58.708337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dacc7f-b3f6-4fcc-a487-8a6137db8aba tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:58.725115 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3622/7319] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:58.725115 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702c586-7640-409f-b84f-17e2e7eb03da None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:58.725115 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702c586-7640-409f-b84f-17e2e7eb03da None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:58.725115 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702c586-7640-409f-b84f-17e2e7eb03da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:58.748528 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3698/7320] 10.222.0.39 () {58 vars in 1380 bytes} [Sun Aug 7 01:43:58 2022] DELETE /identity/v3/users/9eb6b39f751e440988f7d46a04011455/credentials/OS-EC2/105005d1091c4b00ab1e1fd6b46b0dca => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:58.754011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dacc7f-b3f6-4fcc-a487-8a6137db8aba tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:58.759507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c2dacc7f-b3f6-4fcc-a487-8a6137db8aba tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:58.771722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-8702c586-7640-409f-b84f-17e2e7eb03da None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:58.774441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8702c586-7640-409f-b84f-17e2e7eb03da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:58.786090 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3623/7321] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:58.787368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702c586-7640-409f-b84f-17e2e7eb03da None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:58.795321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dacc7f-b3f6-4fcc-a487-8a6137db8aba tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:58.802929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702c586-7640-409f-b84f-17e2e7eb03da None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:58.805075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424bbbe-9bf8-49b4-9609-49729f7a692c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:58.806547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424bbbe-9bf8-49b4-9609-49729f7a692c admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:58.806826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424bbbe-9bf8-49b4-9609-49729f7a692c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:58.807190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424bbbe-9bf8-49b4-9609-49729f7a692c admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:58.807963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424bbbe-9bf8-49b4-9609-49729f7a692c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:58.814027 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424bbbe-9bf8-49b4-9609-49729f7a692c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:58.815831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29666cce-fa35-4618-b75e-0d70aa1b9918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:58.816743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29666cce-fa35-4618-b75e-0d70aa1b9918 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:58.817852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29666cce-fa35-4618-b75e-0d70aa1b9918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:58.818734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29666cce-fa35-4618-b75e-0d70aa1b9918 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:58.821274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29666cce-fa35-4618-b75e-0d70aa1b9918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:58.826036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29666cce-fa35-4618-b75e-0d70aa1b9918 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:58.843181 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3699/7322] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:58.843438 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424bbbe-9bf8-49b4-9609-49729f7a692c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:58.856764 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3624/7323] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:58.861237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29666cce-fa35-4618-b75e-0d70aa1b9918 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:58.869913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424bbbe-9bf8-49b4-9609-49729f7a692c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:58.874643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29666cce-fa35-4618-b75e-0d70aa1b9918 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:58.881493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc3888-1e4f-4c0b-b78e-5bf8b6572d17 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb6b39f751e440988f7d46a04011455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a755804e032045aab26a799cdbd161ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:58.882331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7540f-e497-4745-908c-e3f8689c6085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:58.882484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc3888-1e4f-4c0b-b78e-5bf8b6572d17 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:58.882700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc3888-1e4f-4c0b-b78e-5bf8b6572d17 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:58.882950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7540f-e497-4745-908c-e3f8689c6085 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:58.883089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc3888-1e4f-4c0b-b78e-5bf8b6572d17 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] PATH_INFO: `/v3/users/9eb6b39f751e440988f7d46a04011455/credentials/OS-EC2` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:58.883282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7540f-e497-4745-908c-e3f8689c6085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:58.883669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7540f-e497-4745-908c-e3f8689c6085 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:58.884534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d7540f-e497-4745-908c-e3f8689c6085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:58.886462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc3888-1e4f-4c0b-b78e-5bf8b6572d17 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=9eb6b39f751e440988f7d46a04011455)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:58.887657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d7540f-e497-4745-908c-e3f8689c6085 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:58.888074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc3888-1e4f-4c0b-b78e-5bf8b6572d17 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:58.906070 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3625/7324] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:43:58.908925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7540f-e497-4745-908c-e3f8689c6085 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:58.918552 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3700/7325] 10.222.0.39 () {60 vars in 1299 bytes} [Sun Aug 7 01:43:58 2022] POST /identity/v3/users/9eb6b39f751e440988f7d46a04011455/credentials/OS-EC2 => generated 367 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:43:58.922714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc3888-1e4f-4c0b-b78e-5bf8b6572d17 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:58.925909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7540f-e497-4745-908c-e3f8689c6085 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:58.931510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44eec3-ce35-4d30-9a5b-90c05e9991b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:58.933320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44eec3-ce35-4d30-9a5b-90c05e9991b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:58.933608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44eec3-ce35-4d30-9a5b-90c05e9991b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:58.933888 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44eec3-ce35-4d30-9a5b-90c05e9991b4 admin admin] PATH_INFO: `/v3/projects/9a98cfec613a48d486b084ac4f38182f/users/8051b935ea1143e8adad121c04c6de3d/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:58.942101 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc3888-1e4f-4c0b-b78e-5bf8b6572d17 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:58.948945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa2dab-b671-43c7-a70c-aa7fe3c02194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:58.949635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa2dab-b671-43c7-a70c-aa7fe3c02194 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:58.949911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa2dab-b671-43c7-a70c-aa7fe3c02194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:58.950181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa2dab-b671-43c7-a70c-aa7fe3c02194 admin admin] PATH_INFO: `/v3/projects/8abc21e325bb443db196fb4d34e6ddce/users/c844314ae626431da356b1a788a0593b/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:58.973392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa2dab-b671-43c7-a70c-aa7fe3c02194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8abc21e325bb443db196fb4d34e6ddce, user_id=c844314ae626431da356b1a788a0593b, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:58.976366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa2dab-b671-43c7-a70c-aa7fe3c02194 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:58.982607 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44eec3-ce35-4d30-9a5b-90c05e9991b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a98cfec613a48d486b084ac4f38182f, user_id=8051b935ea1143e8adad121c04c6de3d, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:58.991253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44eec3-ce35-4d30-9a5b-90c05e9991b4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:58.997796 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3701/7326] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:43:58 2022] PUT /identity/v3/projects/8abc21e325bb443db196fb4d34e6ddce/users/c844314ae626431da356b1a788a0593b/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:58.999128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa2dab-b671-43c7-a70c-aa7fe3c02194 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:59.009499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3baa2dab-b671-43c7-a70c-aa7fe3c02194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:59.040210 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3626/7327] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:43:58 2022] PUT /identity/v3/projects/9a98cfec613a48d486b084ac4f38182f/users/8051b935ea1143e8adad121c04c6de3d/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:59.042216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44eec3-ce35-4d30-9a5b-90c05e9991b4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:59.182966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa2dab-b671-43c7-a70c-aa7fe3c02194 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:59.207039 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:59.349517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101ca71-699d-42d9-a2f0-aeca810e3297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:59.357594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101ca71-699d-42d9-a2f0-aeca810e3297 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:59.358009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101ca71-699d-42d9-a2f0-aeca810e3297 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:59.358254 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101ca71-699d-42d9-a2f0-aeca810e3297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:59.377694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44eec3-ce35-4d30-9a5b-90c05e9991b4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:59.387015 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:INSERT=4,keystone:SELECT=95,keystone:DELETE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:43:59.398322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237000d3-6510-4529-9fb8-7cdefd78353e tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb6b39f751e440988f7d46a04011455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a755804e032045aab26a799cdbd161ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:59.401648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237000d3-6510-4529-9fb8-7cdefd78353e tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:59.403557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237000d3-6510-4529-9fb8-7cdefd78353e tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:59.403843 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237000d3-6510-4529-9fb8-7cdefd78353e tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] PATH_INFO: `/v3/users/9eb6b39f751e440988f7d46a04011455/credentials/OS-EC2/b9ce6cc502ee4bd48c3d2f4829864f63` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:59.411931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237000d3-6510-4529-9fb8-7cdefd78353e tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=9eb6b39f751e440988f7d46a04011455, credential_id=b9ce6cc502ee4bd48c3d2f4829864f63)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:59.418749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237000d3-6510-4529-9fb8-7cdefd78353e tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:59.452444 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3627/7328] 10.222.0.39 () {58 vars in 1380 bytes} [Sun Aug 7 01:43:59 2022] DELETE /identity/v3/users/9eb6b39f751e440988f7d46a04011455/credentials/OS-EC2/b9ce6cc502ee4bd48c3d2f4829864f63 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:43:59.453942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd820ec-c47e-4f43-88d4-00937a6aabf2 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:59.454239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd820ec-c47e-4f43-88d4-00937a6aabf2 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:59.454580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd820ec-c47e-4f43-88d4-00937a6aabf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:59.548276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2dd820ec-c47e-4f43-88d4-00937a6aabf2 None None] MFA Rules not processed for user `c844314ae626431da356b1a788a0593b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:59.555347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2dd820ec-c47e-4f43-88d4-00937a6aabf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:59.628832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101ca71-699d-42d9-a2f0-aeca810e3297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:59.630322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101ca71-699d-42d9-a2f0-aeca810e3297 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:43:59.652918 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3702/7329] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:43:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:43:59.656448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ae1a8-fcf8-4fd3-9da5-a6d346af2799 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:59.656448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ae1a8-fcf8-4fd3-9da5-a6d346af2799 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:59.656448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ae1a8-fcf8-4fd3-9da5-a6d346af2799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:59.706204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b73ae1a8-fcf8-4fd3-9da5-a6d346af2799 None None] MFA Rules not processed for user `8051b935ea1143e8adad121c04c6de3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:43:59.711674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b73ae1a8-fcf8-4fd3-9da5-a6d346af2799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:43:59.788876 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3628/7330] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:43:59.792000 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd820ec-c47e-4f43-88d4-00937a6aabf2 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:59.829008 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd820ec-c47e-4f43-88d4-00937a6aabf2 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:59.845940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8ca2d-0209-443c-877b-176e77a484d0 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb6b39f751e440988f7d46a04011455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a755804e032045aab26a799cdbd161ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:59.848632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8ca2d-0209-443c-877b-176e77a484d0 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:59.852493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8ca2d-0209-443c-877b-176e77a484d0 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:59.853305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8ca2d-0209-443c-877b-176e77a484d0 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] PATH_INFO: `/v3/users/9eb6b39f751e440988f7d46a04011455/credentials/OS-EC2/b9ce6cc502ee4bd48c3d2f4829864f63` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:59.903716 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-49c8ca2d-0209-443c-877b-176e77a484d0 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] Could not find credential: 2e72abb1f18be47ded68db2738887f459d2e4a211864face857ee7261e6e3a56.: keystone.exception.CredentialNotFound: Could not find credential: 2e72abb1f18be47ded68db2738887f459d2e4a211864face857ee7261e6e3a56. Aug 07 01:43:59.903716 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:43:59.903716 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:43:59.903716 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:43:59.903716 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:43:59.903716 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:43:59.903716 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:43:59.903716 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:43:59.903716 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:43:59.903716 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:43:59.903716 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:43:59.903716 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:43:59.903716 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Aug 07 01:43:59.903716 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Aug 07 01:43:59.904980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Aug 07 01:43:59.904980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Aug 07 01:43:59.904980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Aug 07 01:43:59.904980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Aug 07 01:43:59.904980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:43:59.904980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:43:59.904980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Aug 07 01:43:59.904980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Aug 07 01:43:59.904980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:43:59.904980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:43:59.904980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:43:59.904980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:43:59.904980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:43:59.904980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 01:43:59.904980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:43:59.904980 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:43:59.906340 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:43:59.906340 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:43:59.906340 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:43:59.906340 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:43:59.906340 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:43:59.906340 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:43:59.906340 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Aug 07 01:43:59.906340 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Aug 07 01:43:59.906340 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Aug 07 01:43:59.906340 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Aug 07 01:43:59.906340 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Aug 07 01:43:59.906340 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Aug 07 01:43:59.906340 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: 2e72abb1f18be47ded68db2738887f459d2e4a211864face857ee7261e6e3a56. Aug 07 01:43:59.906340 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:43:59.906340 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3629/7331] 10.222.0.39 () {58 vars in 1377 bytes} [Sun Aug 7 01:43:59 2022] GET /identity/v3/users/9eb6b39f751e440988f7d46a04011455/credentials/OS-EC2/b9ce6cc502ee4bd48c3d2f4829864f63 => generated 148 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:43:59.907371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8ca2d-0209-443c-877b-176e77a484d0 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:43:59.944346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8ca2d-0209-443c-877b-176e77a484d0 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:43:59.955383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1205b-4eb8-4d4b-8754-5f35740c3026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:43:59.956885 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1205b-4eb8-4d4b-8754-5f35740c3026 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:43:59.957320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1205b-4eb8-4d4b-8754-5f35740c3026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:43:59.957675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1205b-4eb8-4d4b-8754-5f35740c3026 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:43:59.958440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1205b-4eb8-4d4b-8754-5f35740c3026 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:43:59.970919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1205b-4eb8-4d4b-8754-5f35740c3026 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:00.027441 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3703/7332] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:43:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:00.028868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ae1a8-fcf8-4fd3-9da5-a6d346af2799 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:00.044338 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3630/7333] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:43:59 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:00.045278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1205b-4eb8-4d4b-8754-5f35740c3026 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:00.051118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-77f1205b-4eb8-4d4b-8754-5f35740c3026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:00.069158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ae1a8-fcf8-4fd3-9da5-a6d346af2799 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:00.199828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1205b-4eb8-4d4b-8754-5f35740c3026 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:00.204472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a11b0-2aa2-45f0-bc33-bb35f48460c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:00.205098 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a11b0-2aa2-45f0-bc33-bb35f48460c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:00.205376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a11b0-2aa2-45f0-bc33-bb35f48460c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:00.206279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a11b0-2aa2-45f0-bc33-bb35f48460c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:00.224741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e334c82-90b4-4f7d-b8bf-fa07099172b4 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb6b39f751e440988f7d46a04011455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a755804e032045aab26a799cdbd161ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:00.225665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e334c82-90b4-4f7d-b8bf-fa07099172b4 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:00.226347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e334c82-90b4-4f7d-b8bf-fa07099172b4 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:00.226605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e334c82-90b4-4f7d-b8bf-fa07099172b4 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] PATH_INFO: `/v3/users/9eb6b39f751e440988f7d46a04011455/credentials/OS-EC2` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:00.227242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e334c82-90b4-4f7d-b8bf-fa07099172b4 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=9eb6b39f751e440988f7d46a04011455)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:00.235011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e334c82-90b4-4f7d-b8bf-fa07099172b4 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:00.280412 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3704/7334] 10.222.0.39 () {60 vars in 1299 bytes} [Sun Aug 7 01:44:00 2022] POST /identity/v3/users/9eb6b39f751e440988f7d46a04011455/credentials/OS-EC2 => generated 367 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:00.281734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e334c82-90b4-4f7d-b8bf-fa07099172b4 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:00.317664 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:00.368816 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:00.369312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a11b0-2aa2-45f0-bc33-bb35f48460c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:00.370957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a11b0-2aa2-45f0-bc33-bb35f48460c2 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:00.390822 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3631/7335] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:44:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:44:00.392725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a11b0-2aa2-45f0-bc33-bb35f48460c2 service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:00.417555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a11b0-2aa2-45f0-bc33-bb35f48460c2 service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:00.428190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6170d8d-97e7-4b70-aee8-d216eec7a597 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb6b39f751e440988f7d46a04011455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a755804e032045aab26a799cdbd161ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:00.428851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6170d8d-97e7-4b70-aee8-d216eec7a597 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:00.429130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6170d8d-97e7-4b70-aee8-d216eec7a597 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:00.429443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6170d8d-97e7-4b70-aee8-d216eec7a597 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] PATH_INFO: `/v3/users/9eb6b39f751e440988f7d46a04011455/credentials/OS-EC2` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:00.430068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6170d8d-97e7-4b70-aee8-d216eec7a597 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=9eb6b39f751e440988f7d46a04011455)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:00.436987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6170d8d-97e7-4b70-aee8-d216eec7a597 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:00.448104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e334c82-90b4-4f7d-b8bf-fa07099172b4 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:00.463072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27f6b9-c749-4f3f-be6c-0fd280865379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:00.465016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27f6b9-c749-4f3f-be6c-0fd280865379 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:00.465358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27f6b9-c749-4f3f-be6c-0fd280865379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:00.466962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27f6b9-c749-4f3f-be6c-0fd280865379 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:00.467609 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27f6b9-c749-4f3f-be6c-0fd280865379 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:00.468363 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3632/7336] 10.222.0.39 () {60 vars in 1299 bytes} [Sun Aug 7 01:44:00 2022] POST /identity/v3/users/9eb6b39f751e440988f7d46a04011455/credentials/OS-EC2 => generated 367 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:00.471006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6170d8d-97e7-4b70-aee8-d216eec7a597 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:00.471525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27f6b9-c749-4f3f-be6c-0fd280865379 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:00.490839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6170d8d-97e7-4b70-aee8-d216eec7a597 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:00.504298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c30069-3dd2-48ed-b920-0c9e4993ff22 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb6b39f751e440988f7d46a04011455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a755804e032045aab26a799cdbd161ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:00.506237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c30069-3dd2-48ed-b920-0c9e4993ff22 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:00.508555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c30069-3dd2-48ed-b920-0c9e4993ff22 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:00.508864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c30069-3dd2-48ed-b920-0c9e4993ff22 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] PATH_INFO: `/v3/users/9eb6b39f751e440988f7d46a04011455/credentials/OS-EC2` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:00.510569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c30069-3dd2-48ed-b920-0c9e4993ff22 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=9eb6b39f751e440988f7d46a04011455)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:00.519457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c30069-3dd2-48ed-b920-0c9e4993ff22 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:00.536621 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3705/7337] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:44:00 2022] POST /identity/v3/users => generated 299 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:00.538491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27f6b9-c749-4f3f-be6c-0fd280865379 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:00.564767 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3633/7338] 10.222.0.39 () {58 vars in 1278 bytes} [Sun Aug 7 01:44:00 2022] GET /identity/v3/users/9eb6b39f751e440988f7d46a04011455/credentials/OS-EC2 => generated 865 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:44:00.577559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c30069-3dd2-48ed-b920-0c9e4993ff22 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:00.581774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27f6b9-c749-4f3f-be6c-0fd280865379 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:00.603989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bd8a8-3a4e-4e2f-80bb-d6f0011c8792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:00.606519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bd8a8-3a4e-4e2f-80bb-d6f0011c8792 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:00.606831 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bd8a8-3a4e-4e2f-80bb-d6f0011c8792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:00.607162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bd8a8-3a4e-4e2f-80bb-d6f0011c8792 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:00.607862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64bd8a8-3a4e-4e2f-80bb-d6f0011c8792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:00.609428 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c30069-3dd2-48ed-b920-0c9e4993ff22 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:00.609675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64bd8a8-3a4e-4e2f-80bb-d6f0011c8792 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:00.622075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974470e-80d9-4fab-9a0b-09374ff9f183 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb6b39f751e440988f7d46a04011455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a755804e032045aab26a799cdbd161ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:00.624355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974470e-80d9-4fab-9a0b-09374ff9f183 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:00.624937 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974470e-80d9-4fab-9a0b-09374ff9f183 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:00.625442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974470e-80d9-4fab-9a0b-09374ff9f183 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] PATH_INFO: `/v3/users/9eb6b39f751e440988f7d46a04011455/credentials/OS-EC2/c53bd5ee49314646b7983e4982bcfb3d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:00.631179 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974470e-80d9-4fab-9a0b-09374ff9f183 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=9eb6b39f751e440988f7d46a04011455, credential_id=c53bd5ee49314646b7983e4982bcfb3d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:00.636385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974470e-80d9-4fab-9a0b-09374ff9f183 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:00.658287 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3706/7339] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:44:00.659469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bd8a8-3a4e-4e2f-80bb-d6f0011c8792 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:00.702564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bd8a8-3a4e-4e2f-80bb-d6f0011c8792 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:00.724810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b71700-9d3b-4487-8506-0931ca074dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:00.725637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b71700-9d3b-4487-8506-0931ca074dd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:00.725851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b71700-9d3b-4487-8506-0931ca074dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:00.726124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b71700-9d3b-4487-8506-0931ca074dd8 admin admin] PATH_INFO: `/v3/projects/24213998425d4ae78a8a6bd221df6515/users/1da88a22f8844956813236292c13dfb7/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:00.732055 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3634/7340] 10.222.0.39 () {58 vars in 1380 bytes} [Sun Aug 7 01:44:00 2022] DELETE /identity/v3/users/9eb6b39f751e440988f7d46a04011455/credentials/OS-EC2/c53bd5ee49314646b7983e4982bcfb3d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:00.736988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974470e-80d9-4fab-9a0b-09374ff9f183 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:00.787668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974470e-80d9-4fab-9a0b-09374ff9f183 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:00.796692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b71700-9d3b-4487-8506-0931ca074dd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24213998425d4ae78a8a6bd221df6515, user_id=1da88a22f8844956813236292c13dfb7, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:00.803262 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18deed-6dc0-4e6f-be2a-72ecbc817b69 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb6b39f751e440988f7d46a04011455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a755804e032045aab26a799cdbd161ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:00.805657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18deed-6dc0-4e6f-be2a-72ecbc817b69 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:00.806558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18deed-6dc0-4e6f-be2a-72ecbc817b69 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:00.808280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18deed-6dc0-4e6f-be2a-72ecbc817b69 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] PATH_INFO: `/v3/users/9eb6b39f751e440988f7d46a04011455/credentials/OS-EC2/6fb1f190c5c942fd8aaa85b807b38156` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:00.812157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b71700-9d3b-4487-8506-0931ca074dd8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:00.814551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18deed-6dc0-4e6f-be2a-72ecbc817b69 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=9eb6b39f751e440988f7d46a04011455, credential_id=6fb1f190c5c942fd8aaa85b807b38156)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:00.816670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18deed-6dc0-4e6f-be2a-72ecbc817b69 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:00.853658 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3707/7341] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:44:00 2022] PUT /identity/v3/projects/24213998425d4ae78a8a6bd221df6515/users/1da88a22f8844956813236292c13dfb7/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:00.857644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b71700-9d3b-4487-8506-0931ca074dd8 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:00.859805 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3635/7342] 10.222.0.39 () {58 vars in 1380 bytes} [Sun Aug 7 01:44:00 2022] DELETE /identity/v3/users/9eb6b39f751e440988f7d46a04011455/credentials/OS-EC2/6fb1f190c5c942fd8aaa85b807b38156 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:00.865181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18deed-6dc0-4e6f-be2a-72ecbc817b69 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:00.887806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18deed-6dc0-4e6f-be2a-72ecbc817b69 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:01.080747 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b71700-9d3b-4487-8506-0931ca074dd8 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:01.096914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5305b9d-adb9-40cb-8f46-33fa1dd6b117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:01.099361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5305b9d-adb9-40cb-8f46-33fa1dd6b117 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:01.101217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5305b9d-adb9-40cb-8f46-33fa1dd6b117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:01.102498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5305b9d-adb9-40cb-8f46-33fa1dd6b117 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:01.104678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5305b9d-adb9-40cb-8f46-33fa1dd6b117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:01.108318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474d067-8d08-4002-a327-b8647576e3b3 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb6b39f751e440988f7d46a04011455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a755804e032045aab26a799cdbd161ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:01.109519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5305b9d-adb9-40cb-8f46-33fa1dd6b117 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:01.110035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474d067-8d08-4002-a327-b8647576e3b3 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:01.110325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474d067-8d08-4002-a327-b8647576e3b3 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:01.110605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474d067-8d08-4002-a327-b8647576e3b3 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] PATH_INFO: `/v3/users/9eb6b39f751e440988f7d46a04011455/credentials/OS-EC2` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:01.111241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474d067-8d08-4002-a327-b8647576e3b3 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=9eb6b39f751e440988f7d46a04011455)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:01.112789 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474d067-8d08-4002-a327-b8647576e3b3 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:01.143157 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3708/7343] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:44:01.150600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5305b9d-adb9-40cb-8f46-33fa1dd6b117 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:01.152040 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3636/7344] 10.222.0.39 () {60 vars in 1299 bytes} [Sun Aug 7 01:44:00 2022] POST /identity/v3/users/9eb6b39f751e440988f7d46a04011455/credentials/OS-EC2 => generated 367 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:01.153597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474d067-8d08-4002-a327-b8647576e3b3 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:01.199518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474d067-8d08-4002-a327-b8647576e3b3 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:01.226263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0bb2b-49a8-4b33-ae2c-cbaa2908041c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:01.227034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0bb2b-49a8-4b33-ae2c-cbaa2908041c admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:01.227320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0bb2b-49a8-4b33-ae2c-cbaa2908041c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:01.227596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0bb2b-49a8-4b33-ae2c-cbaa2908041c admin admin] PATH_INFO: `/v3/projects/24213998425d4ae78a8a6bd221df6515/users/1da88a22f8844956813236292c13dfb7/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:01.252255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0bb2b-49a8-4b33-ae2c-cbaa2908041c admin admin] RBAC: Authorizing `identity:create_grant(project_id=24213998425d4ae78a8a6bd221df6515, user_id=1da88a22f8844956813236292c13dfb7, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:01.259524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0bb2b-49a8-4b33-ae2c-cbaa2908041c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:01.311725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5305b9d-adb9-40cb-8f46-33fa1dd6b117 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:01.327649 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3637/7345] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:44:01 2022] PUT /identity/v3/projects/24213998425d4ae78a8a6bd221df6515/users/1da88a22f8844956813236292c13dfb7/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:01.335989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0bb2b-49a8-4b33-ae2c-cbaa2908041c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:01.407614 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:01.445410 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ab087-ee84-48fa-9e6f-7d7a13ce1533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:01.446207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ab087-ee84-48fa-9e6f-7d7a13ce1533 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:01.446582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ab087-ee84-48fa-9e6f-7d7a13ce1533 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:01.446956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ab087-ee84-48fa-9e6f-7d7a13ce1533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:01.449047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-962ab087-ee84-48fa-9e6f-7d7a13ce1533 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:01.593150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ab087-ee84-48fa-9e6f-7d7a13ce1533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:01.595136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ab087-ee84-48fa-9e6f-7d7a13ce1533 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:01.599919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0bb2b-49a8-4b33-ae2c-cbaa2908041c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:01.606471 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52088ffe-92c9-45ec-9a4c-903791186896 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb6b39f751e440988f7d46a04011455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a755804e032045aab26a799cdbd161ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:01.607915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52088ffe-92c9-45ec-9a4c-903791186896 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:01.607915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52088ffe-92c9-45ec-9a4c-903791186896 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:01.607915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52088ffe-92c9-45ec-9a4c-903791186896 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] PATH_INFO: `/v3/users/9eb6b39f751e440988f7d46a04011455/credentials/OS-EC2/a2ff39484f524fdca08f1b9a45ac4351` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:01.635815 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52088ffe-92c9-45ec-9a4c-903791186896 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=9eb6b39f751e440988f7d46a04011455, credential_id=a2ff39484f524fdca08f1b9a45ac4351)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:01.637812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52088ffe-92c9-45ec-9a4c-903791186896 tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:01.647934 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3638/7346] 10.222.0.39 () {58 vars in 1377 bytes} [Sun Aug 7 01:44:01 2022] GET /identity/v3/users/9eb6b39f751e440988f7d46a04011455/credentials/OS-EC2/a2ff39484f524fdca08f1b9a45ac4351 => generated 367 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:44:01.649333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5194f8-ddf0-456d-b9ac-231d0036ef21 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:01.649748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5194f8-ddf0-456d-b9ac-231d0036ef21 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:01.650025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5194f8-ddf0-456d-b9ac-231d0036ef21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:01.665718 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3709/7347] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:44:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:44:01.667078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ab087-ee84-48fa-9e6f-7d7a13ce1533 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:01.694778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ab087-ee84-48fa-9e6f-7d7a13ce1533 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:01.720892 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d9f44-e3d3-439c-b89c-dfe6cb8da0cf tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9eb6b39f751e440988f7d46a04011455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a755804e032045aab26a799cdbd161ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:01.722218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d9f44-e3d3-439c-b89c-dfe6cb8da0cf tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:01.722899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d9f44-e3d3-439c-b89c-dfe6cb8da0cf tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:01.725385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d9f44-e3d3-439c-b89c-dfe6cb8da0cf tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] PATH_INFO: `/v3/users/9eb6b39f751e440988f7d46a04011455/credentials/OS-EC2/a2ff39484f524fdca08f1b9a45ac4351` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:01.727939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-fc5194f8-ddf0-456d-b9ac-231d0036ef21 None None] MFA Rules not processed for user `1da88a22f8844956813236292c13dfb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:01.729219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-fc5194f8-ddf0-456d-b9ac-231d0036ef21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:01.730367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d9f44-e3d3-439c-b89c-dfe6cb8da0cf tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=9eb6b39f751e440988f7d46a04011455, credential_id=a2ff39484f524fdca08f1b9a45ac4351)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:01.735293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d9f44-e3d3-439c-b89c-dfe6cb8da0cf tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:01.736169 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:01.777340 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3710/7348] 10.222.0.39 () {58 vars in 1380 bytes} [Sun Aug 7 01:44:01 2022] DELETE /identity/v3/users/9eb6b39f751e440988f7d46a04011455/credentials/OS-EC2/a2ff39484f524fdca08f1b9a45ac4351 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:01.782683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d9f44-e3d3-439c-b89c-dfe6cb8da0cf tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:01.789868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-175d9f44-e3d3-439c-b89c-dfe6cb8da0cf tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:01.902387 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3639/7349] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:01.902387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5194f8-ddf0-456d-b9ac-231d0036ef21 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:01.902387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-fc5194f8-ddf0-456d-b9ac-231d0036ef21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:02.050548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d9f44-e3d3-439c-b89c-dfe6cb8da0cf tempest-EC2CredentialsTest-1390187184 tempest-EC2CredentialsTest-1390187184-project] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:02.057388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0944fa-e875-4f14-b648-e4a59d196410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:02.058169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0944fa-e875-4f14-b648-e4a59d196410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:02.058510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0944fa-e875-4f14-b648-e4a59d196410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:02.058951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0944fa-e875-4f14-b648-e4a59d196410 admin admin] PATH_INFO: `/v3/users/9eb6b39f751e440988f7d46a04011455` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:02.060323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5194f8-ddf0-456d-b9ac-231d0036ef21 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:02.061265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0944fa-e875-4f14-b648-e4a59d196410 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eb6b39f751e440988f7d46a04011455)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:02.064098 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0944fa-e875-4f14-b648-e4a59d196410 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:02.077934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c9024-322a-4cdb-bdbd-d6329abd60f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:02.081179 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c9024-322a-4cdb-bdbd-d6329abd60f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:02.083205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c9024-322a-4cdb-bdbd-d6329abd60f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:02.083956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c9024-322a-4cdb-bdbd-d6329abd60f9 admin admin] PATH_INFO: `/v3/projects/9430045c79904cda8ff7fdd5c1d1e926` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:02.089924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c9024-322a-4cdb-bdbd-d6329abd60f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9430045c79904cda8ff7fdd5c1d1e926)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:02.092375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c9024-322a-4cdb-bdbd-d6329abd60f9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:02.165708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-af0944fa-e875-4f14-b648-e4a59d196410 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eb6b39f751e440988f7d46a04011455'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:02.194281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-af0944fa-e875-4f14-b648-e4a59d196410 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eb6b39f751e440988f7d46a04011455'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:02.207566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cd5c9024-322a-4cdb-bdbd-d6329abd60f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9430045c79904cda8ff7fdd5c1d1e926', 'request_id': 'req-cd5c9024-322a-4cdb-bdbd-d6329abd60f9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:02.221382 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=10 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:02.223119 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cd5c9024-322a-4cdb-bdbd-d6329abd60f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9430045c79904cda8ff7fdd5c1d1e926', 'request_id': 'req-cd5c9024-322a-4cdb-bdbd-d6329abd60f9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:02.223253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-af0944fa-e875-4f14-b648-e4a59d196410 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eb6b39f751e440988f7d46a04011455'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:02.224224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-af0944fa-e875-4f14-b648-e4a59d196410 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eb6b39f751e440988f7d46a04011455'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:02.239614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-af0944fa-e875-4f14-b648-e4a59d196410 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eb6b39f751e440988f7d46a04011455'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:02.242812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cd5c9024-322a-4cdb-bdbd-d6329abd60f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9430045c79904cda8ff7fdd5c1d1e926', 'request_id': 'req-cd5c9024-322a-4cdb-bdbd-d6329abd60f9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:02.248846 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3711/7350] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:44:01 2022] DELETE /identity/v3/users/9eb6b39f751e440988f7d46a04011455 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:02.256779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0944fa-e875-4f14-b648-e4a59d196410 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:02.258645 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-af0944fa-e875-4f14-b648-e4a59d196410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:02.265563 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cd5c9024-322a-4cdb-bdbd-d6329abd60f9 admin admin] The token cache is being invalidate because project 9430045c79904cda8ff7fdd5c1d1e926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:44:02.266711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cd5c9024-322a-4cdb-bdbd-d6329abd60f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:02.266711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cd5c9024-322a-4cdb-bdbd-d6329abd60f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:02.268613 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3640/7351] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:44:01 2022] DELETE /identity/v3/projects/9430045c79904cda8ff7fdd5c1d1e926 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:02.269992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6701c-a61d-4c05-90e1-a0eaa3be141d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:02.270280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6701c-a61d-4c05-90e1-a0eaa3be141d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:02.270555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6701c-a61d-4c05-90e1-a0eaa3be141d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:02.304532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-37a6701c-a61d-4c05-90e1-a0eaa3be141d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:02.307501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-37a6701c-a61d-4c05-90e1-a0eaa3be141d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:02.353502 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:02.420207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0944fa-e875-4f14-b648-e4a59d196410 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:02.472559 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c4f1e-fe8a-4b23-afbb-8238052df451 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:02.474793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c4f1e-fe8a-4b23-afbb-8238052df451 service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:02.475080 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c4f1e-fe8a-4b23-afbb-8238052df451 service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:02.475493 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3641/7352] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:02.476551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6701c-a61d-4c05-90e1-a0eaa3be141d None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:02.477903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-37a6701c-a61d-4c05-90e1-a0eaa3be141d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:02.479745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c4f1e-fe8a-4b23-afbb-8238052df451 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:02.489176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c41c4f1e-fe8a-4b23-afbb-8238052df451 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:02.498254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6701c-a61d-4c05-90e1-a0eaa3be141d None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:02.504641 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26250af0-5c82-42be-902e-19c3d1704615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:02.506244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26250af0-5c82-42be-902e-19c3d1704615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:02.506957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26250af0-5c82-42be-902e-19c3d1704615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:02.507395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26250af0-5c82-42be-902e-19c3d1704615 admin admin] PATH_INFO: `/v3/users/34117d9ecf4f464c8493341899a7f606` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:02.509273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26250af0-5c82-42be-902e-19c3d1704615 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34117d9ecf4f464c8493341899a7f606)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:02.514359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26250af0-5c82-42be-902e-19c3d1704615 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:02.621351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-26250af0-5c82-42be-902e-19c3d1704615 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34117d9ecf4f464c8493341899a7f606'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:02.637972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-26250af0-5c82-42be-902e-19c3d1704615 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34117d9ecf4f464c8493341899a7f606'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:02.669149 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-26250af0-5c82-42be-902e-19c3d1704615 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34117d9ecf4f464c8493341899a7f606'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:02.670911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-26250af0-5c82-42be-902e-19c3d1704615 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34117d9ecf4f464c8493341899a7f606'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:02.682675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c4f1e-fe8a-4b23-afbb-8238052df451 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:02.685066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-26250af0-5c82-42be-902e-19c3d1704615 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34117d9ecf4f464c8493341899a7f606'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:02.688016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c4f1e-fe8a-4b23-afbb-8238052df451 service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:02.694277 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3642/7353] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:44:02 2022] DELETE /identity/v3/users/34117d9ecf4f464c8493341899a7f606 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:02.695192 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26250af0-5c82-42be-902e-19c3d1704615 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:02.697264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-26250af0-5c82-42be-902e-19c3d1704615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:02.717200 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3712/7354] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:44:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:44:02.870148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26250af0-5c82-42be-902e-19c3d1704615 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:02.892170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7221eef-7f9b-41a7-9ca5-bdf836d03046 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:02.892815 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7221eef-7f9b-41a7-9ca5-bdf836d03046 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:02.893100 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7221eef-7f9b-41a7-9ca5-bdf836d03046 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:02.893373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7221eef-7f9b-41a7-9ca5-bdf836d03046 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:02.909102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c7221eef-7f9b-41a7-9ca5-bdf836d03046 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:03.067179 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:03.073875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7221eef-7f9b-41a7-9ca5-bdf836d03046 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:03.076318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7221eef-7f9b-41a7-9ca5-bdf836d03046 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:03.112127 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3643/7355] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:44:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:44:04.992270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c4f1e-fe8a-4b23-afbb-8238052df451 service cinder] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:05.032941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c4f1e-fe8a-4b23-afbb-8238052df451 service cinder] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:05.042321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa8ee3-8e06-47f9-98e3-222afcd6a08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:05.042960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa8ee3-8e06-47f9-98e3-222afcd6a08f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:05.043247 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa8ee3-8e06-47f9-98e3-222afcd6a08f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:05.043521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa8ee3-8e06-47f9-98e3-222afcd6a08f admin admin] PATH_INFO: `/v3/projects/008c978ffe494c2eb56d28bcb2323b14` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:05.052837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa8ee3-8e06-47f9-98e3-222afcd6a08f admin admin] RBAC: Authorizing `identity:delete_project(project_id=008c978ffe494c2eb56d28bcb2323b14)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:05.061479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa8ee3-8e06-47f9-98e3-222afcd6a08f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:05.205459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-68aa8ee3-8e06-47f9-98e3-222afcd6a08f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '008c978ffe494c2eb56d28bcb2323b14', 'request_id': 'req-68aa8ee3-8e06-47f9-98e3-222afcd6a08f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:05.224708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-68aa8ee3-8e06-47f9-98e3-222afcd6a08f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '008c978ffe494c2eb56d28bcb2323b14', 'request_id': 'req-68aa8ee3-8e06-47f9-98e3-222afcd6a08f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:05.245811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-68aa8ee3-8e06-47f9-98e3-222afcd6a08f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '008c978ffe494c2eb56d28bcb2323b14', 'request_id': 'req-68aa8ee3-8e06-47f9-98e3-222afcd6a08f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:05.274436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-68aa8ee3-8e06-47f9-98e3-222afcd6a08f admin admin] The token cache is being invalidate because project 008c978ffe494c2eb56d28bcb2323b14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:44:05.274940 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-68aa8ee3-8e06-47f9-98e3-222afcd6a08f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:05.277285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-68aa8ee3-8e06-47f9-98e3-222afcd6a08f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:05.280151 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3713/7356] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:44:04 2022] DELETE /identity/v3/projects/008c978ffe494c2eb56d28bcb2323b14 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:05.285246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb8304-24eb-4554-b874-11ba46edb3e9 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:05.286112 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb8304-24eb-4554-b874-11ba46edb3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:05.286574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb8304-24eb-4554-b874-11ba46edb3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:05.347286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-94eb8304-24eb-4554-b874-11ba46edb3e9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:05.348571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-94eb8304-24eb-4554-b874-11ba46edb3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:05.493022 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3644/7357] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:05.502853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1627a5-8840-445c-b5ae-cb5aeadfde46 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:05.503506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1627a5-8840-445c-b5ae-cb5aeadfde46 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:05.504392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1627a5-8840-445c-b5ae-cb5aeadfde46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:05.531245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb8304-24eb-4554-b874-11ba46edb3e9 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:05.533361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-94eb8304-24eb-4554-b874-11ba46edb3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:05.539428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-da1627a5-8840-445c-b5ae-cb5aeadfde46 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:05.541298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-da1627a5-8840-445c-b5ae-cb5aeadfde46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:05.552568 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3714/7358] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:05.559080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb8304-24eb-4554-b874-11ba46edb3e9 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:05.559731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1627a5-8840-445c-b5ae-cb5aeadfde46 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:05.564055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4e8d34-dfec-4fe9-a179-a7b2732c8141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:05.564693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e8d34-dfec-4fe9-a179-a7b2732c8141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:05.564972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e8d34-dfec-4fe9-a179-a7b2732c8141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:05.565241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4e8d34-dfec-4fe9-a179-a7b2732c8141 admin admin] PATH_INFO: `/v3/projects/a755804e032045aab26a799cdbd161ce` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:05.566397 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e8d34-dfec-4fe9-a179-a7b2732c8141 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a755804e032045aab26a799cdbd161ce)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:05.569191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4e8d34-dfec-4fe9-a179-a7b2732c8141 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:05.582409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1627a5-8840-445c-b5ae-cb5aeadfde46 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:05.595624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2458b5b-dd10-4156-a4a5-c53b1fc0a1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:05.598671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2458b5b-dd10-4156-a4a5-c53b1fc0a1f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:05.599702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2458b5b-dd10-4156-a4a5-c53b1fc0a1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:05.600012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2458b5b-dd10-4156-a4a5-c53b1fc0a1f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:05.600703 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2458b5b-dd10-4156-a4a5-c53b1fc0a1f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:44:05.601006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2458b5b-dd10-4156-a4a5-c53b1fc0a1f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:05.604848 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2458b5b-dd10-4156-a4a5-c53b1fc0a1f1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:05.650921 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3715/7359] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:44:05.651928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2458b5b-dd10-4156-a4a5-c53b1fc0a1f1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:05.710765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5f4e8d34-dfec-4fe9-a179-a7b2732c8141 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a755804e032045aab26a799cdbd161ce', 'request_id': 'req-5f4e8d34-dfec-4fe9-a179-a7b2732c8141'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:05.724044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2458b5b-dd10-4156-a4a5-c53b1fc0a1f1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:05.727621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5f4e8d34-dfec-4fe9-a179-a7b2732c8141 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a755804e032045aab26a799cdbd161ce', 'request_id': 'req-5f4e8d34-dfec-4fe9-a179-a7b2732c8141'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:05.736316 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:05.742905 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5f4e8d34-dfec-4fe9-a179-a7b2732c8141 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a755804e032045aab26a799cdbd161ce', 'request_id': 'req-5f4e8d34-dfec-4fe9-a179-a7b2732c8141'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:05.773358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5f4e8d34-dfec-4fe9-a179-a7b2732c8141 admin admin] The token cache is being invalidate because project a755804e032045aab26a799cdbd161ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:44:05.773635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5f4e8d34-dfec-4fe9-a179-a7b2732c8141 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:05.776296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5f4e8d34-dfec-4fe9-a179-a7b2732c8141 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:05.780170 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3645/7360] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:44:05 2022] DELETE /identity/v3/projects/a755804e032045aab26a799cdbd161ce => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:05.786920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7ee9a-e38e-4449-a9e8-a8e033e71b61 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:05.787217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7ee9a-e38e-4449-a9e8-a8e033e71b61 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:05.787489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7ee9a-e38e-4449-a9e8-a8e033e71b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:05.851764 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d3b7ee9a-e38e-4449-a9e8-a8e033e71b61 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:05.853060 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d3b7ee9a-e38e-4449-a9e8-a8e033e71b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:05.983416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86f562-4eed-4bec-a451-e8519fab1422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:05.985894 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86f562-4eed-4bec-a451-e8519fab1422 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:05.986189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86f562-4eed-4bec-a451-e8519fab1422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:05.986450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86f562-4eed-4bec-a451-e8519fab1422 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:05.990715 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86f562-4eed-4bec-a451-e8519fab1422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:05.997905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86f562-4eed-4bec-a451-e8519fab1422 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:06.045127 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3646/7361] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:06.053526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5dbf1-d3e9-43c4-9c2c-793072fbc6a0 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:06.054057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5dbf1-d3e9-43c4-9c2c-793072fbc6a0 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:06.054492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5dbf1-d3e9-43c4-9c2c-793072fbc6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:06.083772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-69d5dbf1-d3e9-43c4-9c2c-793072fbc6a0 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:06.085414 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-69d5dbf1-d3e9-43c4-9c2c-793072fbc6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:06.106418 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3647/7362] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:44:06.110982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d5dbf1-d3e9-43c4-9c2c-793072fbc6a0 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:06.124235 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3716/7363] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:44:05 2022] POST /identity/v3/projects => generated 361 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:06.125302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86f562-4eed-4bec-a451-e8519fab1422 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:06.129456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8b86f562-4eed-4bec-a451-e8519fab1422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:06.140691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d5dbf1-d3e9-43c4-9c2c-793072fbc6a0 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:06.161509 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:06.241918 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab486fb-25c6-4428-95e1-fb14e44b5e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:06.242716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab486fb-25c6-4428-95e1-fb14e44b5e29 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:06.243107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab486fb-25c6-4428-95e1-fb14e44b5e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:06.243920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab486fb-25c6-4428-95e1-fb14e44b5e29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:06.245989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab486fb-25c6-4428-95e1-fb14e44b5e29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:44:06.246422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab486fb-25c6-4428-95e1-fb14e44b5e29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:06.248512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab486fb-25c6-4428-95e1-fb14e44b5e29 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:06.265397 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3648/7364] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:44:06.267058 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab486fb-25c6-4428-95e1-fb14e44b5e29 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:06.269331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0ab486fb-25c6-4428-95e1-fb14e44b5e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:06.337801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86f562-4eed-4bec-a451-e8519fab1422 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:06.356141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6735cf0-86f4-4845-809c-6e048f0d0cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:06.357085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6735cf0-86f4-4845-809c-6e048f0d0cab admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:06.357527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6735cf0-86f4-4845-809c-6e048f0d0cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:06.357975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6735cf0-86f4-4845-809c-6e048f0d0cab admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:06.358793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6735cf0-86f4-4845-809c-6e048f0d0cab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:06.362162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6735cf0-86f4-4845-809c-6e048f0d0cab admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:06.363770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab486fb-25c6-4428-95e1-fb14e44b5e29 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:06.374455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1637b-3411-416f-a952-50490663742f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:06.376115 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1637b-3411-416f-a952-50490663742f service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:06.377351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1637b-3411-416f-a952-50490663742f service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:06.378245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1637b-3411-416f-a952-50490663742f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:06.383139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c5e1637b-3411-416f-a952-50490663742f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:06.420103 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3717/7365] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:44:06 2022] POST /identity/v3/users => generated 281 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:06.422992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6735cf0-86f4-4845-809c-6e048f0d0cab admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:06.446400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6735cf0-86f4-4845-809c-6e048f0d0cab admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:06.470484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7d57f-a762-4d78-b4d8-492aa0a90e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:06.472603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7d57f-a762-4d78-b4d8-492aa0a90e09 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:06.473890 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7d57f-a762-4d78-b4d8-492aa0a90e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:06.490952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7d57f-a762-4d78-b4d8-492aa0a90e09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:06.491720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a7d57f-a762-4d78-b4d8-492aa0a90e09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:06.514341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a7d57f-a762-4d78-b4d8-492aa0a90e09 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:06.584912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1637b-3411-416f-a952-50490663742f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:06.586634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1637b-3411-416f-a952-50490663742f service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:06.599322 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3649/7366] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:44:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:44:06.600362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1637b-3411-416f-a952-50490663742f service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:06.613750 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1637b-3411-416f-a952-50490663742f service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:06.615466 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3718/7367] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:44:06 2022] POST /identity/v3/projects => generated 359 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:06.621407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7d57f-a762-4d78-b4d8-492aa0a90e09 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:06.761730 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:06.793222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7d57f-a762-4d78-b4d8-492aa0a90e09 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:06.807717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282c55b-959e-4fb6-8309-6695bc5291f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:06.808568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282c55b-959e-4fb6-8309-6695bc5291f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:06.810658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282c55b-959e-4fb6-8309-6695bc5291f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:06.811130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282c55b-959e-4fb6-8309-6695bc5291f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:06.815916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3282c55b-959e-4fb6-8309-6695bc5291f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:06.823779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3282c55b-959e-4fb6-8309-6695bc5291f0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:06.926396 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3719/7368] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:44:06 2022] POST /identity/v3/users => generated 280 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:06.933364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282c55b-959e-4fb6-8309-6695bc5291f0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:07.014711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282c55b-959e-4fb6-8309-6695bc5291f0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:07.028300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b84c2-051a-4a13-9c06-e0e5148da8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:07.029057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b84c2-051a-4a13-9c06-e0e5148da8e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:07.029402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b84c2-051a-4a13-9c06-e0e5148da8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:07.029764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b84c2-051a-4a13-9c06-e0e5148da8e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:07.030739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b84c2-051a-4a13-9c06-e0e5148da8e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:07.032523 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b84c2-051a-4a13-9c06-e0e5148da8e9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:07.045862 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3720/7369] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:44:07.046964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbadba-7b39-4015-bf93-f7fb6d781002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:07.047569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbadba-7b39-4015-bf93-f7fb6d781002 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:07.047850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbadba-7b39-4015-bf93-f7fb6d781002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:07.048146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbadba-7b39-4015-bf93-f7fb6d781002 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:07.048817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbadba-7b39-4015-bf93-f7fb6d781002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:07.050908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b84c2-051a-4a13-9c06-e0e5148da8e9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:07.059535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbadba-7b39-4015-bf93-f7fb6d781002 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:07.089695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b84c2-051a-4a13-9c06-e0e5148da8e9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:07.089695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94de3db-6697-4834-93b9-7dafc7b1c9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:07.089695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94de3db-6697-4834-93b9-7dafc7b1c9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:07.089695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94de3db-6697-4834-93b9-7dafc7b1c9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:07.090285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94de3db-6697-4834-93b9-7dafc7b1c9e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:07.091128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94de3db-6697-4834-93b9-7dafc7b1c9e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:07.093795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94de3db-6697-4834-93b9-7dafc7b1c9e7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:07.110680 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:07.132226 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3650/7370] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 532 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:44:07.136067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbadba-7b39-4015-bf93-f7fb6d781002 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:07.137951 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3721/7371] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:44:07.143494 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94de3db-6697-4834-93b9-7dafc7b1c9e7 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:07.169188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94de3db-6697-4834-93b9-7dafc7b1c9e7 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:07.175816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbadba-7b39-4015-bf93-f7fb6d781002 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:07.185243 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b92579-5fad-48fe-99bc-0e1df63f65d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:07.185921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b92579-5fad-48fe-99bc-0e1df63f65d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:07.186197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b92579-5fad-48fe-99bc-0e1df63f65d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:07.186469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b92579-5fad-48fe-99bc-0e1df63f65d4 admin admin] PATH_INFO: `/v3/projects/9fcc28e07f6e43fe9722aa1431b24bf5/users/5cc3a7ce036343a5bb1673e0e713561a/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:07.196210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6a47e-4e2c-493a-9ec4-078eceef107c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:07.197807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6a47e-4e2c-493a-9ec4-078eceef107c admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:07.202065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6a47e-4e2c-493a-9ec4-078eceef107c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:07.202802 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6a47e-4e2c-493a-9ec4-078eceef107c admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:07.207207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6a47e-4e2c-493a-9ec4-078eceef107c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:07.213795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6a47e-4e2c-493a-9ec4-078eceef107c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:07.232221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b92579-5fad-48fe-99bc-0e1df63f65d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fcc28e07f6e43fe9722aa1431b24bf5, user_id=5cc3a7ce036343a5bb1673e0e713561a, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:07.234936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b92579-5fad-48fe-99bc-0e1df63f65d4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:07.254275 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3651/7372] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:44:07.255569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6a47e-4e2c-493a-9ec4-078eceef107c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:07.263778 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3722/7373] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:44:07 2022] PUT /identity/v3/projects/9fcc28e07f6e43fe9722aa1431b24bf5/users/5cc3a7ce036343a5bb1673e0e713561a/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:07.274279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfc575-f6e7-4765-84d0-3c5fc126a540 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:07.277971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfc575-f6e7-4765-84d0-3c5fc126a540 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:07.279408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfc575-f6e7-4765-84d0-3c5fc126a540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:07.288558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6a47e-4e2c-493a-9ec4-078eceef107c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:07.378311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-bfcfc575-f6e7-4765-84d0-3c5fc126a540 None None] MFA Rules not processed for user `5cc3a7ce036343a5bb1673e0e713561a`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:07.382053 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-bfcfc575-f6e7-4765-84d0-3c5fc126a540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:07.459604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d036e1-b786-4913-83bb-fd8f590afe8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:07.460258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d036e1-b786-4913-83bb-fd8f590afe8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:07.460538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d036e1-b786-4913-83bb-fd8f590afe8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:07.460814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d036e1-b786-4913-83bb-fd8f590afe8a admin admin] PATH_INFO: `/v3/projects/a43b849a01a841e086fa9631bc8706a5/users/53195166bb6e4631b8b4d71592b27db5/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:07.518374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d036e1-b786-4913-83bb-fd8f590afe8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a43b849a01a841e086fa9631bc8706a5, user_id=53195166bb6e4631b8b4d71592b27db5, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:07.521188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d036e1-b786-4913-83bb-fd8f590afe8a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:07.577242 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3723/7374] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:07 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:07.588410 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3652/7375] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:44:07 2022] PUT /identity/v3/projects/a43b849a01a841e086fa9631bc8706a5/users/53195166bb6e4631b8b4d71592b27db5/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:07.592525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7873a-3fd6-41b2-b4a2-f76530b1b060 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:07.593368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7873a-3fd6-41b2-b4a2-f76530b1b060 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:07.594814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7873a-3fd6-41b2-b4a2-f76530b1b060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:07.598426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d036e1-b786-4913-83bb-fd8f590afe8a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:07.666676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d0c7873a-3fd6-41b2-b4a2-f76530b1b060 None None] MFA Rules not processed for user `53195166bb6e4631b8b4d71592b27db5`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:07.669003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d0c7873a-3fd6-41b2-b4a2-f76530b1b060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:07.745743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d036e1-b786-4913-83bb-fd8f590afe8a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:07.760922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd95c81-1429-494e-81dc-71ef6b5435c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:07.764467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd95c81-1429-494e-81dc-71ef6b5435c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:07.765950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd95c81-1429-494e-81dc-71ef6b5435c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:07.767282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd95c81-1429-494e-81dc-71ef6b5435c0 admin admin] PATH_INFO: `/v3/users/5cc3a7ce036343a5bb1673e0e713561a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:07.771792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd95c81-1429-494e-81dc-71ef6b5435c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cc3a7ce036343a5bb1673e0e713561a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:07.774446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd95c81-1429-494e-81dc-71ef6b5435c0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:07.864004 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3724/7376] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:07.898677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7873a-3fd6-41b2-b4a2-f76530b1b060 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:07.934627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-efd95c81-1429-494e-81dc-71ef6b5435c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cc3a7ce036343a5bb1673e0e713561a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:07.945677 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:07.953137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-efd95c81-1429-494e-81dc-71ef6b5435c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cc3a7ce036343a5bb1673e0e713561a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:07.985104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-efd95c81-1429-494e-81dc-71ef6b5435c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cc3a7ce036343a5bb1673e0e713561a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:07.985901 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:07.986806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-efd95c81-1429-494e-81dc-71ef6b5435c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cc3a7ce036343a5bb1673e0e713561a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:07.999598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-efd95c81-1429-494e-81dc-71ef6b5435c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cc3a7ce036343a5bb1673e0e713561a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:08.033111 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3653/7377] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:44:07 2022] DELETE /identity/v3/users/5cc3a7ce036343a5bb1673e0e713561a => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:44:08.039366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16319f-4875-4a5c-bf04-b7ac10c88ac3 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:08.039939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16319f-4875-4a5c-bf04-b7ac10c88ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:08.040362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16319f-4875-4a5c-bf04-b7ac10c88ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:08.071183 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3d16319f-4875-4a5c-bf04-b7ac10c88ac3 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:08.075464 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3d16319f-4875-4a5c-bf04-b7ac10c88ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:08.076791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7873a-3fd6-41b2-b4a2-f76530b1b060 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:08.180071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70020a15-229d-48c7-8491-8b103ce9a85e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:08.180899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70020a15-229d-48c7-8491-8b103ce9a85e service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:08.181187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70020a15-229d-48c7-8491-8b103ce9a85e service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:08.181670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70020a15-229d-48c7-8491-8b103ce9a85e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:08.184016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-70020a15-229d-48c7-8491-8b103ce9a85e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:08.202452 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3654/7378] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:08.203821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16319f-4875-4a5c-bf04-b7ac10c88ac3 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:08.205537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3d16319f-4875-4a5c-bf04-b7ac10c88ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:08.235055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16319f-4875-4a5c-bf04-b7ac10c88ac3 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:08.245457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec903d-3a15-48e0-b8fe-365fba6fff98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:08.246082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec903d-3a15-48e0-b8fe-365fba6fff98 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:08.246360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec903d-3a15-48e0-b8fe-365fba6fff98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:08.246982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec903d-3a15-48e0-b8fe-365fba6fff98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:08.254186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-35ec903d-3a15-48e0-b8fe-365fba6fff98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:08.337921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70020a15-229d-48c7-8491-8b103ce9a85e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:08.340825 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70020a15-229d-48c7-8491-8b103ce9a85e service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:08.391202 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3725/7379] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:44:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:44:08.392265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70020a15-229d-48c7-8491-8b103ce9a85e service cinder] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:08.397699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-70020a15-229d-48c7-8491-8b103ce9a85e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:08.463862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec903d-3a15-48e0-b8fe-365fba6fff98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:08.466438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec903d-3a15-48e0-b8fe-365fba6fff98 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:08.483394 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3655/7380] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:44:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:44:08.484459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec903d-3a15-48e0-b8fe-365fba6fff98 service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:08.500776 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-35ec903d-3a15-48e0-b8fe-365fba6fff98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:08.553191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec903d-3a15-48e0-b8fe-365fba6fff98 service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:08.568689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fca7f-9bd4-4ee0-8682-b277ce35e70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:08.569341 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fca7f-9bd4-4ee0-8682-b277ce35e70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:08.569771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fca7f-9bd4-4ee0-8682-b277ce35e70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:08.570076 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fca7f-9bd4-4ee0-8682-b277ce35e70b admin admin] PATH_INFO: `/v3/users/53195166bb6e4631b8b4d71592b27db5` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:08.570278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70020a15-229d-48c7-8491-8b103ce9a85e service cinder] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:08.571772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fca7f-9bd4-4ee0-8682-b277ce35e70b admin admin] RBAC: Authorizing `identity:delete_user(user_id=53195166bb6e4631b8b4d71592b27db5)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:08.582087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fca7f-9bd4-4ee0-8682-b277ce35e70b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:08.600741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed462a-92df-4094-b09b-734b084fd404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:08.602727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed462a-92df-4094-b09b-734b084fd404 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:08.605796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed462a-92df-4094-b09b-734b084fd404 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:08.606848 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed462a-92df-4094-b09b-734b084fd404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:08.649382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed462a-92df-4094-b09b-734b084fd404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:08.651681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed462a-92df-4094-b09b-734b084fd404 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:08.702841 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3726/7381] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:44:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:44:08.733036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-837fca7f-9bd4-4ee0-8682-b277ce35e70b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53195166bb6e4631b8b4d71592b27db5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:08.762809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-837fca7f-9bd4-4ee0-8682-b277ce35e70b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53195166bb6e4631b8b4d71592b27db5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:08.786159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-837fca7f-9bd4-4ee0-8682-b277ce35e70b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53195166bb6e4631b8b4d71592b27db5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:08.787076 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-837fca7f-9bd4-4ee0-8682-b277ce35e70b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53195166bb6e4631b8b4d71592b27db5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:08.799683 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:08.810412 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-837fca7f-9bd4-4ee0-8682-b277ce35e70b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53195166bb6e4631b8b4d71592b27db5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:08.827737 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3656/7382] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:44:08 2022] DELETE /identity/v3/users/53195166bb6e4631b8b4d71592b27db5 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:08.837598 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcf977-fd19-49ac-a6c8-df2491f67424 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:08.837893 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcf977-fd19-49ac-a6c8-df2491f67424 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:08.838173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcf977-fd19-49ac-a6c8-df2491f67424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:08.913950 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-7fdcf977-fd19-49ac-a6c8-df2491f67424 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:08.919062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7fdcf977-fd19-49ac-a6c8-df2491f67424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:08.955515 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:09.126424 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3727/7383] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:09.243597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fca7f-9bd4-4ee0-8682-b277ce35e70b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:09.245638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-837fca7f-9bd4-4ee0-8682-b277ce35e70b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:09.475318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fca7f-9bd4-4ee0-8682-b277ce35e70b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:09.485621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e15ba-d553-407b-bdec-9498586bcf53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:09.486346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e15ba-d553-407b-bdec-9498586bcf53 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:09.486961 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e15ba-d553-407b-bdec-9498586bcf53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:09.487237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e15ba-d553-407b-bdec-9498586bcf53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:09.512951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e15ba-d553-407b-bdec-9498586bcf53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:09.516965 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e15ba-d553-407b-bdec-9498586bcf53 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:09.554750 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3657/7384] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:44:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:44:11.016035 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdcf977-fd19-49ac-a6c8-df2491f67424 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:11.017522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7fdcf977-fd19-49ac-a6c8-df2491f67424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:11.033973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdcf977-fd19-49ac-a6c8-df2491f67424 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:11.058449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9fd6a0-d2b6-4d6d-923e-a090c68954bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:11.059434 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fd6a0-d2b6-4d6d-923e-a090c68954bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:11.059434 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fd6a0-d2b6-4d6d-923e-a090c68954bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:11.059715 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9fd6a0-d2b6-4d6d-923e-a090c68954bd admin admin] PATH_INFO: `/v3/projects/9fcc28e07f6e43fe9722aa1431b24bf5` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:11.061680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9fd6a0-d2b6-4d6d-923e-a090c68954bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fcc28e07f6e43fe9722aa1431b24bf5)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:11.063629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9fd6a0-d2b6-4d6d-923e-a090c68954bd admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:11.216723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2b9fd6a0-d2b6-4d6d-923e-a090c68954bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fcc28e07f6e43fe9722aa1431b24bf5', 'request_id': 'req-2b9fd6a0-d2b6-4d6d-923e-a090c68954bd'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:11.234033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2b9fd6a0-d2b6-4d6d-923e-a090c68954bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fcc28e07f6e43fe9722aa1431b24bf5', 'request_id': 'req-2b9fd6a0-d2b6-4d6d-923e-a090c68954bd'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:11.246243 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2b9fd6a0-d2b6-4d6d-923e-a090c68954bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fcc28e07f6e43fe9722aa1431b24bf5', 'request_id': 'req-2b9fd6a0-d2b6-4d6d-923e-a090c68954bd'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:11.273257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2b9fd6a0-d2b6-4d6d-923e-a090c68954bd admin admin] The token cache is being invalidate because project 9fcc28e07f6e43fe9722aa1431b24bf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:44:11.273920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2b9fd6a0-d2b6-4d6d-923e-a090c68954bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:11.274862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2b9fd6a0-d2b6-4d6d-923e-a090c68954bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:11.283109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d5b0b-5a1b-4e00-9bdc-39d4331aeeb6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:11.284010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d5b0b-5a1b-4e00-9bdc-39d4331aeeb6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:11.284501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d5b0b-5a1b-4e00-9bdc-39d4331aeeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:11.288136 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3728/7385] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:44:11 2022] DELETE /identity/v3/projects/9fcc28e07f6e43fe9722aa1431b24bf5 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:11.316515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-4a7d5b0b-5a1b-4e00-9bdc-39d4331aeeb6 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:11.317905 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4a7d5b0b-5a1b-4e00-9bdc-39d4331aeeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:11.413812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba899f-6bc7-4377-b2ac-3e5098122435 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:11.414243 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba899f-6bc7-4377-b2ac-3e5098122435 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:11.414599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba899f-6bc7-4377-b2ac-3e5098122435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:11.420334 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3658/7386] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:11.446548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1dba899f-6bc7-4377-b2ac-3e5098122435 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:11.450948 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1dba899f-6bc7-4377-b2ac-3e5098122435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:11.470850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d5b0b-5a1b-4e00-9bdc-39d4331aeeb6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:11.484286 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3729/7387] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:11.485664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d5b0b-5a1b-4e00-9bdc-39d4331aeeb6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:11.490985 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b742ad8-2b68-4c28-acee-d6bc50b473a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:11.491874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b742ad8-2b68-4c28-acee-d6bc50b473a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:11.492374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b742ad8-2b68-4c28-acee-d6bc50b473a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:11.492816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b742ad8-2b68-4c28-acee-d6bc50b473a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:11.493753 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b742ad8-2b68-4c28-acee-d6bc50b473a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:44:11.494387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b742ad8-2b68-4c28-acee-d6bc50b473a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:11.498776 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b742ad8-2b68-4c28-acee-d6bc50b473a8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:11.520145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba899f-6bc7-4377-b2ac-3e5098122435 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:11.530989 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3659/7388] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:44:11.532856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba899f-6bc7-4377-b2ac-3e5098122435 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:11.538678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2421ddd-581b-4bd4-9383-c757b87d57b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:11.539629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2421ddd-581b-4bd4-9383-c757b87d57b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:11.540146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2421ddd-581b-4bd4-9383-c757b87d57b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:11.540714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2421ddd-581b-4bd4-9383-c757b87d57b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:11.542136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2421ddd-581b-4bd4-9383-c757b87d57b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:11.544688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2421ddd-581b-4bd4-9383-c757b87d57b0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:11.587111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b742ad8-2b68-4c28-acee-d6bc50b473a8 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:11.600747 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3730/7389] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:44:11 2022] POST /identity/v3/projects => generated 389 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:44:11.604184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b742ad8-2b68-4c28-acee-d6bc50b473a8 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:11.694202 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db26336-06cc-4914-ad52-da5d7bd1df33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:11.694715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db26336-06cc-4914-ad52-da5d7bd1df33 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:11.694997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db26336-06cc-4914-ad52-da5d7bd1df33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:11.695269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db26336-06cc-4914-ad52-da5d7bd1df33 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:11.696726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db26336-06cc-4914-ad52-da5d7bd1df33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:11.701042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db26336-06cc-4914-ad52-da5d7bd1df33 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:11.766333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2421ddd-581b-4bd4-9383-c757b87d57b0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:11.768409 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3660/7390] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:44:11 2022] POST /identity/v3/users => generated 295 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:11.782009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2421ddd-581b-4bd4-9383-c757b87d57b0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:11.801370 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fa76d-cad8-4b3d-99c2-5a70d56e379b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:11.802068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fa76d-cad8-4b3d-99c2-5a70d56e379b admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:11.802363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fa76d-cad8-4b3d-99c2-5a70d56e379b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:11.802618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fa76d-cad8-4b3d-99c2-5a70d56e379b admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:11.803791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7fa76d-cad8-4b3d-99c2-5a70d56e379b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:11.811004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7fa76d-cad8-4b3d-99c2-5a70d56e379b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:11.840301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db26336-06cc-4914-ad52-da5d7bd1df33 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:11.852543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db26336-06cc-4914-ad52-da5d7bd1df33 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:11.855974 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3731/7391] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:44:11.878057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b7853-8aa0-4190-b3cc-e50ccda0f2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:11.878057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b7853-8aa0-4190-b3cc-e50ccda0f2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:11.878057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b7853-8aa0-4190-b3cc-e50ccda0f2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:11.878057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b7853-8aa0-4190-b3cc-e50ccda0f2b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:11.878666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b7853-8aa0-4190-b3cc-e50ccda0f2b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:11.882557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b7853-8aa0-4190-b3cc-e50ccda0f2b5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:11.927782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fa76d-cad8-4b3d-99c2-5a70d56e379b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:11.951365 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3661/7392] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:44:11.953945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fa76d-cad8-4b3d-99c2-5a70d56e379b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:11.959820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5722a12-4d00-4808-9f97-6a8a1c54bb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:11.960879 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5722a12-4d00-4808-9f97-6a8a1c54bb6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:11.961163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5722a12-4d00-4808-9f97-6a8a1c54bb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:11.961435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5722a12-4d00-4808-9f97-6a8a1c54bb6a admin admin] PATH_INFO: `/v3/projects/9223964196f74e84ac68fe735cda9571/users/fb6dd228d55d49a9b1498500178c4278/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:12.019236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5722a12-4d00-4808-9f97-6a8a1c54bb6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9223964196f74e84ac68fe735cda9571, user_id=fb6dd228d55d49a9b1498500178c4278, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:12.027302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5722a12-4d00-4808-9f97-6a8a1c54bb6a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:12.081044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04fac3-baae-436c-8156-2c1a30aec3d4 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:12.081327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04fac3-baae-436c-8156-2c1a30aec3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:12.081670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04fac3-baae-436c-8156-2c1a30aec3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:12.084494 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3732/7393] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:44:11 2022] PUT /identity/v3/projects/9223964196f74e84ac68fe735cda9571/users/fb6dd228d55d49a9b1498500178c4278/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:12.094023 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:12.157483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ff04fac3-baae-436c-8156-2c1a30aec3d4 None None] MFA Rules not processed for user `fb6dd228d55d49a9b1498500178c4278`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:12.163326 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ff04fac3-baae-436c-8156-2c1a30aec3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:12.295748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5722a12-4d00-4808-9f97-6a8a1c54bb6a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:12.298155 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3662/7394] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:12.344629 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:12.424005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5722a12-4d00-4808-9f97-6a8a1c54bb6a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:12.438479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47fa55-a8d4-4c91-af59-37bf2ece6249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:12.439118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47fa55-a8d4-4c91-af59-37bf2ece6249 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:12.439395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47fa55-a8d4-4c91-af59-37bf2ece6249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:12.439665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47fa55-a8d4-4c91-af59-37bf2ece6249 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:12.440328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47fa55-a8d4-4c91-af59-37bf2ece6249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:12.443015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47fa55-a8d4-4c91-af59-37bf2ece6249 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:12.525050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04fac3-baae-436c-8156-2c1a30aec3d4 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:12.530900 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3733/7395] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:44:12 2022] POST /identity/v3/projects => generated 389 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:12.545218 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04fac3-baae-436c-8156-2c1a30aec3d4 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:12.688605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c471243-1002-4932-9c76-f92b435ba409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:12.689527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c471243-1002-4932-9c76-f92b435ba409 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:12.689981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c471243-1002-4932-9c76-f92b435ba409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:12.690435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c471243-1002-4932-9c76-f92b435ba409 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:12.691387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c471243-1002-4932-9c76-f92b435ba409 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:12.696535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c471243-1002-4932-9c76-f92b435ba409 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:12.751819 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3663/7396] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:44:12 2022] POST /identity/v3/users => generated 301 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:12.753180 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47fa55-a8d4-4c91-af59-37bf2ece6249 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:12.771210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47fa55-a8d4-4c91-af59-37bf2ece6249 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:12.786867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34484232-be24-48bc-941b-62c63f441597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:12.788096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34484232-be24-48bc-941b-62c63f441597 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:12.788690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34484232-be24-48bc-941b-62c63f441597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:12.789124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34484232-be24-48bc-941b-62c63f441597 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:12.798835 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34484232-be24-48bc-941b-62c63f441597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:12.805290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34484232-be24-48bc-941b-62c63f441597 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:12.839707 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3734/7397] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:44:12.840340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c471243-1002-4932-9c76-f92b435ba409 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:12.856962 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c471243-1002-4932-9c76-f92b435ba409 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:12.879593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea17e8-7ae6-45db-b8ea-3eecc58e4e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:12.880330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea17e8-7ae6-45db-b8ea-3eecc58e4e9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:12.880609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea17e8-7ae6-45db-b8ea-3eecc58e4e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:12.880879 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea17e8-7ae6-45db-b8ea-3eecc58e4e9f admin admin] PATH_INFO: `/v3/projects/7b83ea1ccf7648748ae643abe7f29e88/users/c7fa383ba5764169a54b6ce1a164cec8/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:12.935484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea17e8-7ae6-45db-b8ea-3eecc58e4e9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b83ea1ccf7648748ae643abe7f29e88, user_id=c7fa383ba5764169a54b6ce1a164cec8, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:12.939668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ea17e8-7ae6-45db-b8ea-3eecc58e4e9f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:12.983766 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3664/7398] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:44:12 2022] PUT /identity/v3/projects/7b83ea1ccf7648748ae643abe7f29e88/users/c7fa383ba5764169a54b6ce1a164cec8/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:12.987729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34484232-be24-48bc-941b-62c63f441597 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:13.043823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34484232-be24-48bc-941b-62c63f441597 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:13.355922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296bd296-bbf7-4250-8916-caf7a2ea1ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:13.359745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bd296-bbf7-4250-8916-caf7a2ea1ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:13.361282 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bd296-bbf7-4250-8916-caf7a2ea1ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:13.362346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bd296-bbf7-4250-8916-caf7a2ea1ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:13.366694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296bd296-bbf7-4250-8916-caf7a2ea1ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:13.373623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296bd296-bbf7-4250-8916-caf7a2ea1ba7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:13.434494 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3735/7399] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 449 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:44:13.437042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea17e8-7ae6-45db-b8ea-3eecc58e4e9f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:13.455838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea17e8-7ae6-45db-b8ea-3eecc58e4e9f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:13.456884 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296bd296-bbf7-4250-8916-caf7a2ea1ba7 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:13.458893 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-296bd296-bbf7-4250-8916-caf7a2ea1ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:13.474374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296bd296-bbf7-4250-8916-caf7a2ea1ba7 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:13.481694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19abb0f-61d0-4f58-8c80-983ac93982f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:13.483199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19abb0f-61d0-4f58-8c80-983ac93982f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:13.484731 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19abb0f-61d0-4f58-8c80-983ac93982f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:13.485720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2696810-7685-44eb-9586-f91ad4daceab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:13.486909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19abb0f-61d0-4f58-8c80-983ac93982f1 admin admin] PATH_INFO: `/v3/projects/7b83ea1ccf7648748ae643abe7f29e88/users/c7fa383ba5764169a54b6ce1a164cec8/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:13.487923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2696810-7685-44eb-9586-f91ad4daceab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:13.489506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2696810-7685-44eb-9586-f91ad4daceab admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:13.490032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2696810-7685-44eb-9586-f91ad4daceab admin admin] PATH_INFO: `/v3/projects/a43b849a01a841e086fa9631bc8706a5` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:13.492644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2696810-7685-44eb-9586-f91ad4daceab admin admin] RBAC: Authorizing `identity:delete_project(project_id=a43b849a01a841e086fa9631bc8706a5)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:13.493088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19abb0f-61d0-4f58-8c80-983ac93982f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b83ea1ccf7648748ae643abe7f29e88, user_id=c7fa383ba5764169a54b6ce1a164cec8, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:13.498017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2696810-7685-44eb-9586-f91ad4daceab admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:13.501525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19abb0f-61d0-4f58-8c80-983ac93982f1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:13.558657 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3665/7400] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:44:13 2022] PUT /identity/v3/projects/7b83ea1ccf7648748ae643abe7f29e88/users/c7fa383ba5764169a54b6ce1a164cec8/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:13.569392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a326ec-09c8-4fb4-b2df-034d72af4efe None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:13.573277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a326ec-09c8-4fb4-b2df-034d72af4efe None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:13.575018 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a326ec-09c8-4fb4-b2df-034d72af4efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:13.663495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-35a326ec-09c8-4fb4-b2df-034d72af4efe None None] MFA Rules not processed for user `c7fa383ba5764169a54b6ce1a164cec8`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:13.668084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-35a326ec-09c8-4fb4-b2df-034d72af4efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:13.673666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c2696810-7685-44eb-9586-f91ad4daceab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a43b849a01a841e086fa9631bc8706a5', 'request_id': 'req-c2696810-7685-44eb-9586-f91ad4daceab'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:13.692546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c2696810-7685-44eb-9586-f91ad4daceab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a43b849a01a841e086fa9631bc8706a5', 'request_id': 'req-c2696810-7685-44eb-9586-f91ad4daceab'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:13.717905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c2696810-7685-44eb-9586-f91ad4daceab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a43b849a01a841e086fa9631bc8706a5', 'request_id': 'req-c2696810-7685-44eb-9586-f91ad4daceab'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:13.770242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c2696810-7685-44eb-9586-f91ad4daceab admin admin] The token cache is being invalidate because project a43b849a01a841e086fa9631bc8706a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:44:13.774218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c2696810-7685-44eb-9586-f91ad4daceab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:13.780408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c2696810-7685-44eb-9586-f91ad4daceab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:13.787193 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3736/7401] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:44:13 2022] DELETE /identity/v3/projects/a43b849a01a841e086fa9631bc8706a5 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:44:13.796795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb42d20-2c37-4ddd-b932-5c354b7232be None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:13.798840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb42d20-2c37-4ddd-b932-5c354b7232be None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:13.799309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb42d20-2c37-4ddd-b932-5c354b7232be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:13.820315 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:13.878735 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3666/7402] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:13 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:13.890449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a326ec-09c8-4fb4-b2df-034d72af4efe None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:13.892953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-35a326ec-09c8-4fb4-b2df-034d72af4efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:13.917003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5fb42d20-2c37-4ddd-b932-5c354b7232be None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:13.925520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5fb42d20-2c37-4ddd-b932-5c354b7232be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:13.986719 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:14.053268 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3737/7403] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:14.062519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2e28e-9319-4c3b-955f-635a5386dd57 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:14.066512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2e28e-9319-4c3b-955f-635a5386dd57 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:14.068473 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2e28e-9319-4c3b-955f-635a5386dd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:14.127027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a326ec-09c8-4fb4-b2df-034d72af4efe None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:14.140254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c66dfc-a2ce-444c-a123-1f4932a2e472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:14.141648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c66dfc-a2ce-444c-a123-1f4932a2e472 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:14.145531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c66dfc-a2ce-444c-a123-1f4932a2e472 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:14.146104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c66dfc-a2ce-444c-a123-1f4932a2e472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:14.150680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-44b2e28e-9319-4c3b-955f-635a5386dd57 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:14.154054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-51c66dfc-a2ce-444c-a123-1f4932a2e472 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:14.158659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-44b2e28e-9319-4c3b-955f-635a5386dd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:14.191593 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3738/7404] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:14.195015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2e28e-9319-4c3b-955f-635a5386dd57 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:14.237096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2e28e-9319-4c3b-955f-635a5386dd57 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:14.270226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75bcb7b-1275-4ef7-9128-eecbbb51abba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:14.272889 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bcb7b-1275-4ef7-9128-eecbbb51abba admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:14.277091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bcb7b-1275-4ef7-9128-eecbbb51abba admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:14.277685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bcb7b-1275-4ef7-9128-eecbbb51abba admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:14.278481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75bcb7b-1275-4ef7-9128-eecbbb51abba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:44:14.280077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75bcb7b-1275-4ef7-9128-eecbbb51abba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:14.284323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75bcb7b-1275-4ef7-9128-eecbbb51abba admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:14.338875 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3739/7405] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:44:14.342098 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75bcb7b-1275-4ef7-9128-eecbbb51abba admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:14.389827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75bcb7b-1275-4ef7-9128-eecbbb51abba admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:14.419274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa436e-0b1a-43df-b612-d693b05ca7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:14.420051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa436e-0b1a-43df-b612-d693b05ca7cb admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:14.420409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa436e-0b1a-43df-b612-d693b05ca7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:14.420757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa436e-0b1a-43df-b612-d693b05ca7cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:14.422248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa436e-0b1a-43df-b612-d693b05ca7cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:14.428878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa436e-0b1a-43df-b612-d693b05ca7cb admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:14.474756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c66dfc-a2ce-444c-a123-1f4932a2e472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:14.477241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c66dfc-a2ce-444c-a123-1f4932a2e472 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:14.512146 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3740/7406] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:44:14 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:14.513365 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa436e-0b1a-43df-b612-d693b05ca7cb admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:14.551698 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3667/7407] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:44:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:44:14.771102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa436e-0b1a-43df-b612-d693b05ca7cb admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:14.800832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61418a28-1ea3-491e-830b-866354dc7148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:14.802369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61418a28-1ea3-491e-830b-866354dc7148 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:14.802755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61418a28-1ea3-491e-830b-866354dc7148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:14.803704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61418a28-1ea3-491e-830b-866354dc7148 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:14.809008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61418a28-1ea3-491e-830b-866354dc7148 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:14.815323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61418a28-1ea3-491e-830b-866354dc7148 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:14.872706 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3741/7408] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:44:14 2022] POST /identity/v3/users => generated 289 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:14.875080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c66dfc-a2ce-444c-a123-1f4932a2e472 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:14.903274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c66dfc-a2ce-444c-a123-1f4932a2e472 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:14.921142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65424be7-dacb-416d-8306-7b76dc836e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:14.923492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65424be7-dacb-416d-8306-7b76dc836e58 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:14.924642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65424be7-dacb-416d-8306-7b76dc836e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:14.929854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65424be7-dacb-416d-8306-7b76dc836e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:14.930669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65424be7-dacb-416d-8306-7b76dc836e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:14.938603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65424be7-dacb-416d-8306-7b76dc836e58 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:14.991742 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3668/7409] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:44:14.996291 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61418a28-1ea3-491e-830b-866354dc7148 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:15.011326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61418a28-1ea3-491e-830b-866354dc7148 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:15.034871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fc520-983e-45d5-9dc6-90fdd70f20ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:15.035506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fc520-983e-45d5-9dc6-90fdd70f20ac admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:15.035969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fc520-983e-45d5-9dc6-90fdd70f20ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:15.036400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fc520-983e-45d5-9dc6-90fdd70f20ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:15.037148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fc520-983e-45d5-9dc6-90fdd70f20ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:15.038827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fc520-983e-45d5-9dc6-90fdd70f20ac admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:15.070837 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65424be7-dacb-416d-8306-7b76dc836e58 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:15.075716 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3742/7410] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:44:15.088554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65424be7-dacb-416d-8306-7b76dc836e58 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:15.104667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcd209-7c1a-475d-9903-6356a3576313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:15.105488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcd209-7c1a-475d-9903-6356a3576313 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:15.106158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcd209-7c1a-475d-9903-6356a3576313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:15.106158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcd209-7c1a-475d-9903-6356a3576313 admin admin] PATH_INFO: `/v3/projects/2d8e6062ab954d38a022cf27f2d77038/users/0d3a0af53f1243faafa179817e84a09f/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:15.183389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bcd209-7c1a-475d-9903-6356a3576313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d8e6062ab954d38a022cf27f2d77038, user_id=0d3a0af53f1243faafa179817e84a09f, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:15.186413 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bcd209-7c1a-475d-9903-6356a3576313 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:15.249617 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3669/7411] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:44:15 2022] PUT /identity/v3/projects/2d8e6062ab954d38a022cf27f2d77038/users/0d3a0af53f1243faafa179817e84a09f/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:15.264497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6ead9-52fb-49eb-adea-32387d0f08e0 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:15.264863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6ead9-52fb-49eb-adea-32387d0f08e0 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:15.265211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c6ead9-52fb-49eb-adea-32387d0f08e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:15.366782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b0c6ead9-52fb-49eb-adea-32387d0f08e0 None None] MFA Rules not processed for user `0d3a0af53f1243faafa179817e84a09f`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:15.374868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b0c6ead9-52fb-49eb-adea-32387d0f08e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:15.606393 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:15.630807 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3743/7412] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:15.651550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcd209-7c1a-475d-9903-6356a3576313 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:15.653348 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-74bcd209-7c1a-475d-9903-6356a3576313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:15.871800 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcd209-7c1a-475d-9903-6356a3576313 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:15.884919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c258bfc-33d3-461d-99e6-81a171605904 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:15.885572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c258bfc-33d3-461d-99e6-81a171605904 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:15.885854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c258bfc-33d3-461d-99e6-81a171605904 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:15.886128 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c258bfc-33d3-461d-99e6-81a171605904 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:15.894755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6ead9-52fb-49eb-adea-32387d0f08e0 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:15.918798 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:15.927583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c258bfc-33d3-461d-99e6-81a171605904 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:15.932741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c258bfc-33d3-461d-99e6-81a171605904 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:15.948203 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3670/7413] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:44:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:44:16.053152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c6ead9-52fb-49eb-adea-32387d0f08e0 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:16.068533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0eb52-fb51-4036-909f-30069de1b040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:16.070631 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0eb52-fb51-4036-909f-30069de1b040 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:16.072804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0eb52-fb51-4036-909f-30069de1b040 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:16.075026 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0eb52-fb51-4036-909f-30069de1b040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:16.087481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c4e0eb52-fb51-4036-909f-30069de1b040 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:16.347643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0eb52-fb51-4036-909f-30069de1b040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:16.363173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0eb52-fb51-4036-909f-30069de1b040 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:16.405922 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3744/7414] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:44:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:44:21.595639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c258bfc-33d3-461d-99e6-81a171605904 service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:21.597211 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7c258bfc-33d3-461d-99e6-81a171605904 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:21.630236 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c258bfc-33d3-461d-99e6-81a171605904 service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:21.645150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702e4a1-6d48-47bc-9402-b6d75f9df828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:21.645818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702e4a1-6d48-47bc-9402-b6d75f9df828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:21.646095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702e4a1-6d48-47bc-9402-b6d75f9df828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:21.646370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702e4a1-6d48-47bc-9402-b6d75f9df828 admin admin] PATH_INFO: `/v3/users/8051b935ea1143e8adad121c04c6de3d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:21.653840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702e4a1-6d48-47bc-9402-b6d75f9df828 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8051b935ea1143e8adad121c04c6de3d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:21.655912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702e4a1-6d48-47bc-9402-b6d75f9df828 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:21.816399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2702e4a1-6d48-47bc-9402-b6d75f9df828 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8051b935ea1143e8adad121c04c6de3d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:21.877039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2702e4a1-6d48-47bc-9402-b6d75f9df828 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8051b935ea1143e8adad121c04c6de3d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:21.950400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2702e4a1-6d48-47bc-9402-b6d75f9df828 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8051b935ea1143e8adad121c04c6de3d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:21.955067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2702e4a1-6d48-47bc-9402-b6d75f9df828 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8051b935ea1143e8adad121c04c6de3d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:21.982084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2702e4a1-6d48-47bc-9402-b6d75f9df828 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8051b935ea1143e8adad121c04c6de3d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:22.006567 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3671/7415] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:44:21 2022] DELETE /identity/v3/users/8051b935ea1143e8adad121c04c6de3d => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:22.010907 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1243b72-de42-4089-a61d-1be8287d8bd4 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:22.012102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1243b72-de42-4089-a61d-1be8287d8bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:22.012857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1243b72-de42-4089-a61d-1be8287d8bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:22.091966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d1243b72-de42-4089-a61d-1be8287d8bd4 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:22.094129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d1243b72-de42-4089-a61d-1be8287d8bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:22.268591 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3745/7416] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:22.346464 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702e4a1-6d48-47bc-9402-b6d75f9df828 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:22.348374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2702e4a1-6d48-47bc-9402-b6d75f9df828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:22.573331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702e4a1-6d48-47bc-9402-b6d75f9df828 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:22.586325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4762f-b766-488c-9d8f-dde329347a6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:22.589367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4762f-b766-488c-9d8f-dde329347a6d service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:22.590953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4762f-b766-488c-9d8f-dde329347a6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:22.591819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4762f-b766-488c-9d8f-dde329347a6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:22.620873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4762f-b766-488c-9d8f-dde329347a6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:22.624826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4762f-b766-488c-9d8f-dde329347a6d service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:22.660355 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3672/7417] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:44:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:44:24.686891 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1243b72-de42-4089-a61d-1be8287d8bd4 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:24.688960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d1243b72-de42-4089-a61d-1be8287d8bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:24.721548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1243b72-de42-4089-a61d-1be8287d8bd4 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:24.732887 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e93c6e-300c-4c4e-a618-f4cba4779bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:24.733636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e93c6e-300c-4c4e-a618-f4cba4779bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:24.734064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e93c6e-300c-4c4e-a618-f4cba4779bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:24.734290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e93c6e-300c-4c4e-a618-f4cba4779bc9 admin admin] PATH_INFO: `/v3/users/32b28f75d4894451b0353f3b03b221db` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:24.739876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e93c6e-300c-4c4e-a618-f4cba4779bc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32b28f75d4894451b0353f3b03b221db)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:24.744183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e93c6e-300c-4c4e-a618-f4cba4779bc9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:24.777523 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:24.890985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-63e93c6e-300c-4c4e-a618-f4cba4779bc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32b28f75d4894451b0353f3b03b221db'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:24.916770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-63e93c6e-300c-4c4e-a618-f4cba4779bc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32b28f75d4894451b0353f3b03b221db'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:24.975780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-63e93c6e-300c-4c4e-a618-f4cba4779bc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32b28f75d4894451b0353f3b03b221db'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:24.980839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-63e93c6e-300c-4c4e-a618-f4cba4779bc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32b28f75d4894451b0353f3b03b221db'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:25.025493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-63e93c6e-300c-4c4e-a618-f4cba4779bc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32b28f75d4894451b0353f3b03b221db'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:25.059559 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3746/7418] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:44:24 2022] DELETE /identity/v3/users/32b28f75d4894451b0353f3b03b221db => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:25.060890 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e7628-222f-42a1-8457-8ab24e947b99 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:25.061883 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e7628-222f-42a1-8457-8ab24e947b99 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:25.062375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e7628-222f-42a1-8457-8ab24e947b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:25.106835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c88e7628-222f-42a1-8457-8ab24e947b99 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:25.108189 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c88e7628-222f-42a1-8457-8ab24e947b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:25.356279 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:25.396345 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3673/7419] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:25.435507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e93c6e-300c-4c4e-a618-f4cba4779bc9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:25.437206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-63e93c6e-300c-4c4e-a618-f4cba4779bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:25.484038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e7628-222f-42a1-8457-8ab24e947b99 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:25.485512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c88e7628-222f-42a1-8457-8ab24e947b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:25.521960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e7628-222f-42a1-8457-8ab24e947b99 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:25.553697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd21433-56e1-46b9-8b71-dfec6cf9ff3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:25.554380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd21433-56e1-46b9-8b71-dfec6cf9ff3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:25.554651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd21433-56e1-46b9-8b71-dfec6cf9ff3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:25.554923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd21433-56e1-46b9-8b71-dfec6cf9ff3e admin admin] PATH_INFO: `/v3/projects/9a98cfec613a48d486b084ac4f38182f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:25.562235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd21433-56e1-46b9-8b71-dfec6cf9ff3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a98cfec613a48d486b084ac4f38182f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:25.567751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd21433-56e1-46b9-8b71-dfec6cf9ff3e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:25.667454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e93c6e-300c-4c4e-a618-f4cba4779bc9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:25.683698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e94f9-d8e5-4a2e-9240-01e28c5fcba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:25.684633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e94f9-d8e5-4a2e-9240-01e28c5fcba2 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:25.685184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e94f9-d8e5-4a2e-9240-01e28c5fcba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:25.685688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e94f9-d8e5-4a2e-9240-01e28c5fcba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:25.701810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e94f9-d8e5-4a2e-9240-01e28c5fcba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:25.705487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e94f9-d8e5-4a2e-9240-01e28c5fcba2 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:25.737686 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3747/7420] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:44:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:44:25.794936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4dd21433-56e1-46b9-8b71-dfec6cf9ff3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a98cfec613a48d486b084ac4f38182f', 'request_id': 'req-4dd21433-56e1-46b9-8b71-dfec6cf9ff3e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:25.839661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4dd21433-56e1-46b9-8b71-dfec6cf9ff3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a98cfec613a48d486b084ac4f38182f', 'request_id': 'req-4dd21433-56e1-46b9-8b71-dfec6cf9ff3e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:25.854087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4dd21433-56e1-46b9-8b71-dfec6cf9ff3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a98cfec613a48d486b084ac4f38182f', 'request_id': 'req-4dd21433-56e1-46b9-8b71-dfec6cf9ff3e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:25.894931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4dd21433-56e1-46b9-8b71-dfec6cf9ff3e admin admin] The token cache is being invalidate because project 9a98cfec613a48d486b084ac4f38182f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:44:25.895316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4dd21433-56e1-46b9-8b71-dfec6cf9ff3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:25.902557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4dd21433-56e1-46b9-8b71-dfec6cf9ff3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:25.905623 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3674/7421] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:44:25 2022] DELETE /identity/v3/projects/9a98cfec613a48d486b084ac4f38182f => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:25.910187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117db4d-3cc3-42fe-9d7f-cc664503367b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:25.910475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117db4d-3cc3-42fe-9d7f-cc664503367b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:25.910771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117db4d-3cc3-42fe-9d7f-cc664503367b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:26.115605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0117db4d-3cc3-42fe-9d7f-cc664503367b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:26.118807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0117db4d-3cc3-42fe-9d7f-cc664503367b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:26.295222 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3748/7422] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:26.296291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d8d2b-c97e-4fec-8b1d-8d9258c08b0c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:26.297363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d8d2b-c97e-4fec-8b1d-8d9258c08b0c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:26.297827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d8d2b-c97e-4fec-8b1d-8d9258c08b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:26.370760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-780d8d2b-c97e-4fec-8b1d-8d9258c08b0c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:26.375612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-780d8d2b-c97e-4fec-8b1d-8d9258c08b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:26.402104 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3675/7423] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:26.403429 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117db4d-3cc3-42fe-9d7f-cc664503367b None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:26.424820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117db4d-3cc3-42fe-9d7f-cc664503367b None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:26.444664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac42c87-5cfd-4c02-b2bf-b28b87a7f559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:26.445385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac42c87-5cfd-4c02-b2bf-b28b87a7f559 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:26.445671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac42c87-5cfd-4c02-b2bf-b28b87a7f559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:26.446804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac42c87-5cfd-4c02-b2bf-b28b87a7f559 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:26.448660 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac42c87-5cfd-4c02-b2bf-b28b87a7f559 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:44:26.449195 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac42c87-5cfd-4c02-b2bf-b28b87a7f559 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:26.451215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac42c87-5cfd-4c02-b2bf-b28b87a7f559 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:26.458319 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:26.531936 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3749/7424] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:44:26.534681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d8d2b-c97e-4fec-8b1d-8d9258c08b0c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:26.547422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d8d2b-c97e-4fec-8b1d-8d9258c08b0c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:26.572376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277baf7-1111-413a-b5fc-7e70c63f5fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:26.573304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277baf7-1111-413a-b5fc-7e70c63f5fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:26.573784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277baf7-1111-413a-b5fc-7e70c63f5fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:26.574264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277baf7-1111-413a-b5fc-7e70c63f5fb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:26.575549 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d277baf7-1111-413a-b5fc-7e70c63f5fb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:26.578354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d277baf7-1111-413a-b5fc-7e70c63f5fb9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:26.685775 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3676/7425] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:44:26 2022] POST /identity/v3/projects => generated 371 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:26.687074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac42c87-5cfd-4c02-b2bf-b28b87a7f559 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:26.700843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac42c87-5cfd-4c02-b2bf-b28b87a7f559 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:26.923763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e341e-901b-4475-92b6-fe206737a26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:26.924822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e341e-901b-4475-92b6-fe206737a26d admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:26.924822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e341e-901b-4475-92b6-fe206737a26d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:26.925052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e341e-901b-4475-92b6-fe206737a26d admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:26.925670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e341e-901b-4475-92b6-fe206737a26d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:26.927697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e341e-901b-4475-92b6-fe206737a26d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:26.989009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277baf7-1111-413a-b5fc-7e70c63f5fb9 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:26.991035 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3750/7426] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:44:26 2022] POST /identity/v3/users => generated 286 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:27.009162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277baf7-1111-413a-b5fc-7e70c63f5fb9 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:27.045266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ee2bf-1197-4834-aa8f-421b0789ca22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:27.046071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ee2bf-1197-4834-aa8f-421b0789ca22 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:27.046633 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ee2bf-1197-4834-aa8f-421b0789ca22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:27.047007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ee2bf-1197-4834-aa8f-421b0789ca22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:27.051442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ee2bf-1197-4834-aa8f-421b0789ca22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:27.056177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ee2bf-1197-4834-aa8f-421b0789ca22 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:27.096850 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3677/7427] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:44:27.101158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e341e-901b-4475-92b6-fe206737a26d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:27.128287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e341e-901b-4475-92b6-fe206737a26d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:27.153074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90329ba4-5c5b-410f-b343-d75e5b2e650d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:27.154827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90329ba4-5c5b-410f-b343-d75e5b2e650d admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:27.156183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90329ba4-5c5b-410f-b343-d75e5b2e650d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:27.159422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90329ba4-5c5b-410f-b343-d75e5b2e650d admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:27.162148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90329ba4-5c5b-410f-b343-d75e5b2e650d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:27.173129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90329ba4-5c5b-410f-b343-d75e5b2e650d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:27.223315 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3751/7428] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:44:27.226987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ee2bf-1197-4834-aa8f-421b0789ca22 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:27.252848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ee2bf-1197-4834-aa8f-421b0789ca22 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:27.278198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ddfef-49c2-4655-a647-8446754496ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:27.279647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ddfef-49c2-4655-a647-8446754496ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:27.280663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ddfef-49c2-4655-a647-8446754496ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:27.282187 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ddfef-49c2-4655-a647-8446754496ef admin admin] PATH_INFO: `/v3/projects/5e7d677cea9a4349bc788e6717763915/users/84e60500a5354328990e61423f46f381/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:27.328624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ddfef-49c2-4655-a647-8446754496ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e7d677cea9a4349bc788e6717763915, user_id=84e60500a5354328990e61423f46f381, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:27.341919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ddfef-49c2-4655-a647-8446754496ef admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:27.379682 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3678/7429] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:44:27 2022] PUT /identity/v3/projects/5e7d677cea9a4349bc788e6717763915/users/84e60500a5354328990e61423f46f381/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:27.381659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218f32a-f291-4ef7-9783-90e0d94c54bf None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:27.381853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218f32a-f291-4ef7-9783-90e0d94c54bf None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:27.382126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218f32a-f291-4ef7-9783-90e0d94c54bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:27.437519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1218f32a-f291-4ef7-9783-90e0d94c54bf None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:27.441742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1218f32a-f291-4ef7-9783-90e0d94c54bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:27.684582 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3752/7430] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:28.477976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ddfef-49c2-4655-a647-8446754496ef admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:28.479791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-807ddfef-49c2-4655-a647-8446754496ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:28.638238 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218f32a-f291-4ef7-9783-90e0d94c54bf None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:28.641741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1218f32a-f291-4ef7-9783-90e0d94c54bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:28.737200 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218f32a-f291-4ef7-9783-90e0d94c54bf None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:28.763493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ddfef-49c2-4655-a647-8446754496ef admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:28.815654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bad168-cfa5-4ec8-bf20-c1b27f52e8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:28.821883 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba01ec0-6ef4-4425-a698-8c7b1bdb1548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:28.823397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bad168-cfa5-4ec8-bf20-c1b27f52e8ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:28.826456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bad168-cfa5-4ec8-bf20-c1b27f52e8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:28.828116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bad168-cfa5-4ec8-bf20-c1b27f52e8ea admin admin] PATH_INFO: `/v3/projects/193bef3f4f464f9b80f65a1eb707db5d` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:28.829114 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba01ec0-6ef4-4425-a698-8c7b1bdb1548 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:28.831680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba01ec0-6ef4-4425-a698-8c7b1bdb1548 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:28.832303 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba01ec0-6ef4-4425-a698-8c7b1bdb1548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:28.834616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bad168-cfa5-4ec8-bf20-c1b27f52e8ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=193bef3f4f464f9b80f65a1eb707db5d)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:28.838925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bad168-cfa5-4ec8-bf20-c1b27f52e8ea admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:28.869786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba01ec0-6ef4-4425-a698-8c7b1bdb1548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:28.875223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba01ec0-6ef4-4425-a698-8c7b1bdb1548 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:28.901858 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3679/7431] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:44:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:44:29.084939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c4bad168-cfa5-4ec8-bf20-c1b27f52e8ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '193bef3f4f464f9b80f65a1eb707db5d', 'request_id': 'req-c4bad168-cfa5-4ec8-bf20-c1b27f52e8ea'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:29.105408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c4bad168-cfa5-4ec8-bf20-c1b27f52e8ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '193bef3f4f464f9b80f65a1eb707db5d', 'request_id': 'req-c4bad168-cfa5-4ec8-bf20-c1b27f52e8ea'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:29.124985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c4bad168-cfa5-4ec8-bf20-c1b27f52e8ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '193bef3f4f464f9b80f65a1eb707db5d', 'request_id': 'req-c4bad168-cfa5-4ec8-bf20-c1b27f52e8ea'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:29.145191 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:29.157254 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c4bad168-cfa5-4ec8-bf20-c1b27f52e8ea admin admin] The token cache is being invalidate because project 193bef3f4f464f9b80f65a1eb707db5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:44:29.158204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c4bad168-cfa5-4ec8-bf20-c1b27f52e8ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:29.162058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c4bad168-cfa5-4ec8-bf20-c1b27f52e8ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:29.164613 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3753/7432] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:44:28 2022] DELETE /identity/v3/projects/193bef3f4f464f9b80f65a1eb707db5d => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:29.169311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba01ec0-6ef4-4425-a698-8c7b1bdb1548 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:29.184732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba01ec0-6ef4-4425-a698-8c7b1bdb1548 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:29.218343 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:29.301820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bad168-cfa5-4ec8-bf20-c1b27f52e8ea admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:29.303317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c4bad168-cfa5-4ec8-bf20-c1b27f52e8ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:29.345140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30dc7b-1021-4a75-b222-67b9987f3424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:29.346075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30dc7b-1021-4a75-b222-67b9987f3424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:29.346519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30dc7b-1021-4a75-b222-67b9987f3424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:29.346980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30dc7b-1021-4a75-b222-67b9987f3424 admin admin] PATH_INFO: `/v3/users/c844314ae626431da356b1a788a0593b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:29.348868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c30dc7b-1021-4a75-b222-67b9987f3424 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c844314ae626431da356b1a788a0593b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:29.351829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c30dc7b-1021-4a75-b222-67b9987f3424 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:29.482597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bad168-cfa5-4ec8-bf20-c1b27f52e8ea admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:29.507543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7c30dc7b-1021-4a75-b222-67b9987f3424 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c844314ae626431da356b1a788a0593b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:29.508189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d08d3-e7b2-4be9-a432-9e5976849117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:29.508469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d08d3-e7b2-4be9-a432-9e5976849117 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:29.509425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d08d3-e7b2-4be9-a432-9e5976849117 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:29.509896 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d08d3-e7b2-4be9-a432-9e5976849117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:29.512737 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8e7d08d3-e7b2-4be9-a432-9e5976849117 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:29.527357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7c30dc7b-1021-4a75-b222-67b9987f3424 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c844314ae626431da356b1a788a0593b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:29.558712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7c30dc7b-1021-4a75-b222-67b9987f3424 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c844314ae626431da356b1a788a0593b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:29.560002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7c30dc7b-1021-4a75-b222-67b9987f3424 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c844314ae626431da356b1a788a0593b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:29.575255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7c30dc7b-1021-4a75-b222-67b9987f3424 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c844314ae626431da356b1a788a0593b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:29.593556 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3680/7433] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:44:29 2022] DELETE /identity/v3/users/c844314ae626431da356b1a788a0593b => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:29.723158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d08d3-e7b2-4be9-a432-9e5976849117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:29.729447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d08d3-e7b2-4be9-a432-9e5976849117 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:29.757400 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3754/7434] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:44:29 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:44:30.914180 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30dc7b-1021-4a75-b222-67b9987f3424 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:30.915561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7c30dc7b-1021-4a75-b222-67b9987f3424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:30.986727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d08d3-e7b2-4be9-a432-9e5976849117 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:30.990105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8e7d08d3-e7b2-4be9-a432-9e5976849117 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:31.020759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d08d3-e7b2-4be9-a432-9e5976849117 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:31.162973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7660c-164f-4ab2-8d5c-55980a3d0d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:31.163705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7660c-164f-4ab2-8d5c-55980a3d0d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:31.171476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7660c-164f-4ab2-8d5c-55980a3d0d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:31.171760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7660c-164f-4ab2-8d5c-55980a3d0d25 admin admin] PATH_INFO: `/v3/users/2d8e76eb694846cabc55fc8e825c8e43` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:31.181387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7660c-164f-4ab2-8d5c-55980a3d0d25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d8e76eb694846cabc55fc8e825c8e43)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:31.183845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7660c-164f-4ab2-8d5c-55980a3d0d25 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:31.241785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30dc7b-1021-4a75-b222-67b9987f3424 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:31.263754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03038bbf-95a5-4de7-bcd3-192d3cfe47bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:31.264562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03038bbf-95a5-4de7-bcd3-192d3cfe47bb service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:31.264852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03038bbf-95a5-4de7-bcd3-192d3cfe47bb service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:31.275979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03038bbf-95a5-4de7-bcd3-192d3cfe47bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:31.284311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-03038bbf-95a5-4de7-bcd3-192d3cfe47bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:31.299333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a6a7660c-164f-4ab2-8d5c-55980a3d0d25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d8e76eb694846cabc55fc8e825c8e43'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:31.302889 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:31.319474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a6a7660c-164f-4ab2-8d5c-55980a3d0d25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d8e76eb694846cabc55fc8e825c8e43'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:31.351171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a6a7660c-164f-4ab2-8d5c-55980a3d0d25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d8e76eb694846cabc55fc8e825c8e43'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:31.351995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a6a7660c-164f-4ab2-8d5c-55980a3d0d25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d8e76eb694846cabc55fc8e825c8e43'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:31.354241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03038bbf-95a5-4de7-bcd3-192d3cfe47bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:31.355897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03038bbf-95a5-4de7-bcd3-192d3cfe47bb service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:31.365463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a6a7660c-164f-4ab2-8d5c-55980a3d0d25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d8e76eb694846cabc55fc8e825c8e43'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:31.374428 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3755/7435] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:44:30 2022] DELETE /identity/v3/users/2d8e76eb694846cabc55fc8e825c8e43 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:31.421575 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3681/7436] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:44:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:44:33.101515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7660c-164f-4ab2-8d5c-55980a3d0d25 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:33.103051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a6a7660c-164f-4ab2-8d5c-55980a3d0d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:33.321984 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7660c-164f-4ab2-8d5c-55980a3d0d25 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:33.330665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afb571-a1fa-4d52-b315-374aa43eb42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:33.331690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afb571-a1fa-4d52-b315-374aa43eb42f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:33.332106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afb571-a1fa-4d52-b315-374aa43eb42f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:33.332643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afb571-a1fa-4d52-b315-374aa43eb42f admin admin] PATH_INFO: `/v3/projects/8abc21e325bb443db196fb4d34e6ddce` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:33.337305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afb571-a1fa-4d52-b315-374aa43eb42f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8abc21e325bb443db196fb4d34e6ddce)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:33.348301 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afb571-a1fa-4d52-b315-374aa43eb42f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:33.442982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-25afb571-a1fa-4d52-b315-374aa43eb42f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8abc21e325bb443db196fb4d34e6ddce', 'request_id': 'req-25afb571-a1fa-4d52-b315-374aa43eb42f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:33.457213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-25afb571-a1fa-4d52-b315-374aa43eb42f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8abc21e325bb443db196fb4d34e6ddce', 'request_id': 'req-25afb571-a1fa-4d52-b315-374aa43eb42f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:33.475202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-25afb571-a1fa-4d52-b315-374aa43eb42f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8abc21e325bb443db196fb4d34e6ddce', 'request_id': 'req-25afb571-a1fa-4d52-b315-374aa43eb42f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:33.504729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-25afb571-a1fa-4d52-b315-374aa43eb42f admin admin] The token cache is being invalidate because project 8abc21e325bb443db196fb4d34e6ddce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:44:33.505402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-25afb571-a1fa-4d52-b315-374aa43eb42f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:33.506564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-25afb571-a1fa-4d52-b315-374aa43eb42f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:33.508722 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3756/7437] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:44:33 2022] DELETE /identity/v3/projects/8abc21e325bb443db196fb4d34e6ddce => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:33.512849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03038bbf-95a5-4de7-bcd3-192d3cfe47bb service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:33.515230 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-03038bbf-95a5-4de7-bcd3-192d3cfe47bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:33.553599 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03038bbf-95a5-4de7-bcd3-192d3cfe47bb service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:33.625009 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:33.801497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0aa1a-06ba-4bb2-858e-7ad8e9f10948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:33.805216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0aa1a-06ba-4bb2-858e-7ad8e9f10948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:33.807821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0aa1a-06ba-4bb2-858e-7ad8e9f10948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:33.812813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0aa1a-06ba-4bb2-858e-7ad8e9f10948 admin admin] PATH_INFO: `/v3/users/1da88a22f8844956813236292c13dfb7` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:33.821635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d0aa1a-06ba-4bb2-858e-7ad8e9f10948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1da88a22f8844956813236292c13dfb7)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:33.831549 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d0aa1a-06ba-4bb2-858e-7ad8e9f10948 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:34.050164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f0d0aa1a-06ba-4bb2-858e-7ad8e9f10948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1da88a22f8844956813236292c13dfb7'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:34.090901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f0d0aa1a-06ba-4bb2-858e-7ad8e9f10948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1da88a22f8844956813236292c13dfb7'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:34.137947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f0d0aa1a-06ba-4bb2-858e-7ad8e9f10948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1da88a22f8844956813236292c13dfb7'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:34.138628 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f0d0aa1a-06ba-4bb2-858e-7ad8e9f10948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1da88a22f8844956813236292c13dfb7'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:34.167116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f0d0aa1a-06ba-4bb2-858e-7ad8e9f10948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1da88a22f8844956813236292c13dfb7'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:34.216481 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3682/7438] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:44:33 2022] DELETE /identity/v3/users/1da88a22f8844956813236292c13dfb7 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:34.244592 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afb571-a1fa-4d52-b315-374aa43eb42f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:34.251756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-25afb571-a1fa-4d52-b315-374aa43eb42f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:34.279867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afb571-a1fa-4d52-b315-374aa43eb42f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:34.282919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3e3b7-45b9-42a6-beb4-ee82e3eb86d9 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:34.282919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3e3b7-45b9-42a6-beb4-ee82e3eb86d9 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:34.282919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3e3b7-45b9-42a6-beb4-ee82e3eb86d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:34.437973 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2bd3e3b7-45b9-42a6-beb4-ee82e3eb86d9 None None] MFA Rules not processed for user `84e60500a5354328990e61423f46f381`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:34.439622 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2bd3e3b7-45b9-42a6-beb4-ee82e3eb86d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:34.476822 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:34.492115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6566a52-dff9-4db6-b19e-81ee38e91409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:34.495251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6566a52-dff9-4db6-b19e-81ee38e91409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:34.495539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6566a52-dff9-4db6-b19e-81ee38e91409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:34.495930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6566a52-dff9-4db6-b19e-81ee38e91409 admin admin] PATH_INFO: `/v3/projects/fd244ec665474b3896678f34d6491574` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:34.498259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6566a52-dff9-4db6-b19e-81ee38e91409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd244ec665474b3896678f34d6491574)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:34.501258 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6566a52-dff9-4db6-b19e-81ee38e91409 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:34.637151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f6566a52-dff9-4db6-b19e-81ee38e91409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd244ec665474b3896678f34d6491574', 'request_id': 'req-f6566a52-dff9-4db6-b19e-81ee38e91409'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:34.649929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f6566a52-dff9-4db6-b19e-81ee38e91409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd244ec665474b3896678f34d6491574', 'request_id': 'req-f6566a52-dff9-4db6-b19e-81ee38e91409'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:34.672959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f6566a52-dff9-4db6-b19e-81ee38e91409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd244ec665474b3896678f34d6491574', 'request_id': 'req-f6566a52-dff9-4db6-b19e-81ee38e91409'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:34.696276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f6566a52-dff9-4db6-b19e-81ee38e91409 admin admin] The token cache is being invalidate because project fd244ec665474b3896678f34d6491574 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:44:34.696870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f6566a52-dff9-4db6-b19e-81ee38e91409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:34.698821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f6566a52-dff9-4db6-b19e-81ee38e91409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:34.700689 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3757/7439] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:44:34 2022] DELETE /identity/v3/projects/fd244ec665474b3896678f34d6491574 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:34.712197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca06a9-e543-4c48-baa7-56ebb5c8d099 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:34.712918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca06a9-e543-4c48-baa7-56ebb5c8d099 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:34.730576 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca06a9-e543-4c48-baa7-56ebb5c8d099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:34.747911 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3683/7440] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:34.762183 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd3e3b7-45b9-42a6-beb4-ee82e3eb86d9 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:34.763318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d5ca06a9-e543-4c48-baa7-56ebb5c8d099 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:34.763608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2bd3e3b7-45b9-42a6-beb4-ee82e3eb86d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:34.765060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d5ca06a9-e543-4c48-baa7-56ebb5c8d099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:34.868211 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:34.888284 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3758/7441] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:34.900229 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aba609-5ccc-4910-8b3e-6f7fc455a013 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:34.901723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aba609-5ccc-4910-8b3e-6f7fc455a013 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:34.903943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aba609-5ccc-4910-8b3e-6f7fc455a013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:34.941622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d2aba609-5ccc-4910-8b3e-6f7fc455a013 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:34.943730 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d2aba609-5ccc-4910-8b3e-6f7fc455a013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:34.959233 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3759/7442] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:34.961459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd3e3b7-45b9-42a6-beb4-ee82e3eb86d9 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:34.966930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aba609-5ccc-4910-8b3e-6f7fc455a013 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:34.984272 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aba609-5ccc-4910-8b3e-6f7fc455a013 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:34.991822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15228e-85d9-46e5-8c1b-5b31efede161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:34.994960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15228e-85d9-46e5-8c1b-5b31efede161 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:34.995657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15228e-85d9-46e5-8c1b-5b31efede161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:34.996206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15228e-85d9-46e5-8c1b-5b31efede161 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:34.998079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15228e-85d9-46e5-8c1b-5b31efede161 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:44:34.998850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15228e-85d9-46e5-8c1b-5b31efede161 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:35.001969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15228e-85d9-46e5-8c1b-5b31efede161 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:35.045326 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3760/7443] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:44:35.052846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15228e-85d9-46e5-8c1b-5b31efede161 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:35.085149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15228e-85d9-46e5-8c1b-5b31efede161 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:35.098576 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea5f83-8fd2-4a46-8bc5-5a58edce955c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:35.101337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea5f83-8fd2-4a46-8bc5-5a58edce955c admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:35.102174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea5f83-8fd2-4a46-8bc5-5a58edce955c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:35.103928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea5f83-8fd2-4a46-8bc5-5a58edce955c admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:35.105320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea5f83-8fd2-4a46-8bc5-5a58edce955c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:35.119912 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea5f83-8fd2-4a46-8bc5-5a58edce955c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:35.140821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9b372-3ef3-4542-8879-d5d070e851c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:35.141457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9b372-3ef3-4542-8879-d5d070e851c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:35.141809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9b372-3ef3-4542-8879-d5d070e851c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:35.142006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9b372-3ef3-4542-8879-d5d070e851c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:35.154279 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3761/7444] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:44:35 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:35.157587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea5f83-8fd2-4a46-8bc5-5a58edce955c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:35.261600 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:35.302216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea5f83-8fd2-4a46-8bc5-5a58edce955c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:35.304192 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb9b372-3ef3-4542-8879-d5d070e851c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:35.306614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb9b372-3ef3-4542-8879-d5d070e851c9 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:35.311642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f671b-4759-44ae-98f4-29e99cd0c931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:35.312474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f671b-4759-44ae-98f4-29e99cd0c931 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:35.312860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f671b-4759-44ae-98f4-29e99cd0c931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:35.313239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f671b-4759-44ae-98f4-29e99cd0c931 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:35.314795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f671b-4759-44ae-98f4-29e99cd0c931 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:35.317419 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f671b-4759-44ae-98f4-29e99cd0c931 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:35.334175 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3684/7445] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:44:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:44:35.335212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9b372-3ef3-4542-8879-d5d070e851c9 service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:35.337438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8eb9b372-3ef3-4542-8879-d5d070e851c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:35.351955 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3762/7446] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:44:35 2022] POST /identity/v3/users => generated 284 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:35.355867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f671b-4759-44ae-98f4-29e99cd0c931 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:35.388035 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f671b-4759-44ae-98f4-29e99cd0c931 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:35.402006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43209338-51d7-4cfc-b5d9-439233a020a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:35.405698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43209338-51d7-4cfc-b5d9-439233a020a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:35.407663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43209338-51d7-4cfc-b5d9-439233a020a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:35.410396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43209338-51d7-4cfc-b5d9-439233a020a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:35.411842 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43209338-51d7-4cfc-b5d9-439233a020a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:35.421764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43209338-51d7-4cfc-b5d9-439233a020a8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:35.457076 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3763/7447] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:44:35.460493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43209338-51d7-4cfc-b5d9-439233a020a8 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:35.488426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9b372-3ef3-4542-8879-d5d070e851c9 service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:35.491314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43209338-51d7-4cfc-b5d9-439233a020a8 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:35.502407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76c014-b388-49b9-943d-bd8540312168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:35.503042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76c014-b388-49b9-943d-bd8540312168 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:35.503477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76c014-b388-49b9-943d-bd8540312168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:35.504034 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76c014-b388-49b9-943d-bd8540312168 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:35.504735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76c014-b388-49b9-943d-bd8540312168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:35.507076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76c014-b388-49b9-943d-bd8540312168 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:35.525594 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3764/7448] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:44:35.529842 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76c014-b388-49b9-943d-bd8540312168 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:35.544842 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76c014-b388-49b9-943d-bd8540312168 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:35.551579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12041d0f-543e-42a3-b0bc-d9316b22cf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:35.552302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12041d0f-543e-42a3-b0bc-d9316b22cf8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:35.552581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12041d0f-543e-42a3-b0bc-d9316b22cf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:35.552867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12041d0f-543e-42a3-b0bc-d9316b22cf8c admin admin] PATH_INFO: `/v3/projects/f3efa24d1ad2406fb7f8addd8ee2e29b/users/0e399e4d5e4d4d589ac5b4768543cd59/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:35.573774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12041d0f-543e-42a3-b0bc-d9316b22cf8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3efa24d1ad2406fb7f8addd8ee2e29b, user_id=0e399e4d5e4d4d589ac5b4768543cd59, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:35.577517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12041d0f-543e-42a3-b0bc-d9316b22cf8c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:35.605937 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3765/7449] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:44:35 2022] PUT /identity/v3/projects/f3efa24d1ad2406fb7f8addd8ee2e29b/users/0e399e4d5e4d4d589ac5b4768543cd59/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:35.616110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946ef19-bf91-4472-a89d-151ca9042ead None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:35.616740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946ef19-bf91-4472-a89d-151ca9042ead None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:35.617233 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946ef19-bf91-4472-a89d-151ca9042ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:35.667370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e0b3a-aabc-4fa2-b422-200408a57f38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:35.667941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e0b3a-aabc-4fa2-b422-200408a57f38 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:35.668971 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e0b3a-aabc-4fa2-b422-200408a57f38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:35.669407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e0b3a-aabc-4fa2-b422-200408a57f38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:35.689187 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-615e0b3a-aabc-4fa2-b422-200408a57f38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:35.710657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d946ef19-bf91-4472-a89d-151ca9042ead None None] MFA Rules not processed for user `0e399e4d5e4d4d589ac5b4768543cd59`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:35.713303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d946ef19-bf91-4472-a89d-151ca9042ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:35.716489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e0b3a-aabc-4fa2-b422-200408a57f38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:35.718114 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e0b3a-aabc-4fa2-b422-200408a57f38 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:35.722543 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:35.740691 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3685/7450] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:44:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:44:35.894168 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3766/7451] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:35.901465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e0b3a-aabc-4fa2-b422-200408a57f38 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:35.926636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e0b3a-aabc-4fa2-b422-200408a57f38 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:36.055875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946ef19-bf91-4472-a89d-151ca9042ead None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:36.062842 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d946ef19-bf91-4472-a89d-151ca9042ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:36.215767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363175b5-42a1-4094-a060-453ffc61c585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:36.216967 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363175b5-42a1-4094-a060-453ffc61c585 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:36.217493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363175b5-42a1-4094-a060-453ffc61c585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:36.218435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363175b5-42a1-4094-a060-453ffc61c585 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:36.221158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363175b5-42a1-4094-a060-453ffc61c585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:36.223477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363175b5-42a1-4094-a060-453ffc61c585 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:36.297070 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3686/7452] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:44:35 2022] POST /identity/v3/projects => generated 367 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:36.299474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363175b5-42a1-4094-a060-453ffc61c585 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:36.392176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946ef19-bf91-4472-a89d-151ca9042ead None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:36.409002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363175b5-42a1-4094-a060-453ffc61c585 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:36.417329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1373b-cb84-4d34-aa50-d58accc09882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:36.417964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1373b-cb84-4d34-aa50-d58accc09882 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:36.418999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1373b-cb84-4d34-aa50-d58accc09882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:36.419269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1373b-cb84-4d34-aa50-d58accc09882 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:36.423385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1373b-cb84-4d34-aa50-d58accc09882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:36.430014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9117c-00b0-4c8b-a7de-32866a03c380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:36.433201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1373b-cb84-4d34-aa50-d58accc09882 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:36.436628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9117c-00b0-4c8b-a7de-32866a03c380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:36.437183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9117c-00b0-4c8b-a7de-32866a03c380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:36.437637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9117c-00b0-4c8b-a7de-32866a03c380 admin admin] PATH_INFO: `/v3/projects/24213998425d4ae78a8a6bd221df6515` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:36.451248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9117c-00b0-4c8b-a7de-32866a03c380 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24213998425d4ae78a8a6bd221df6515)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:36.453497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9117c-00b0-4c8b-a7de-32866a03c380 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:36.500317 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3687/7453] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:44:36 2022] POST /identity/v3/users => generated 290 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:36.502843 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1373b-cb84-4d34-aa50-d58accc09882 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:36.532477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1373b-cb84-4d34-aa50-d58accc09882 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:36.535454 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:36.551332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917a8b9-5c66-478b-86a0-7373a92eea3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:36.554057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917a8b9-5c66-478b-86a0-7373a92eea3b admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:36.554377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917a8b9-5c66-478b-86a0-7373a92eea3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:36.554818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917a8b9-5c66-478b-86a0-7373a92eea3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:36.558355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5917a8b9-5c66-478b-86a0-7373a92eea3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:36.562138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5917a8b9-5c66-478b-86a0-7373a92eea3b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:36.597941 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3688/7454] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:44:36.598281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bbe9117c-00b0-4c8b-a7de-32866a03c380 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24213998425d4ae78a8a6bd221df6515', 'request_id': 'req-bbe9117c-00b0-4c8b-a7de-32866a03c380'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:36.601743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917a8b9-5c66-478b-86a0-7373a92eea3b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:36.612114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bbe9117c-00b0-4c8b-a7de-32866a03c380 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24213998425d4ae78a8a6bd221df6515', 'request_id': 'req-bbe9117c-00b0-4c8b-a7de-32866a03c380'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:36.624643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917a8b9-5c66-478b-86a0-7373a92eea3b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:36.630296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bbe9117c-00b0-4c8b-a7de-32866a03c380 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24213998425d4ae78a8a6bd221df6515', 'request_id': 'req-bbe9117c-00b0-4c8b-a7de-32866a03c380'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:36.661098 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bbe9117c-00b0-4c8b-a7de-32866a03c380 admin admin] The token cache is being invalidate because project 24213998425d4ae78a8a6bd221df6515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:44:36.661448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bbe9117c-00b0-4c8b-a7de-32866a03c380 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:36.664187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bbe9117c-00b0-4c8b-a7de-32866a03c380 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:36.666931 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3767/7455] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:44:36 2022] DELETE /identity/v3/projects/24213998425d4ae78a8a6bd221df6515 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:36.674789 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab23b1f-b87d-485d-bbe1-be76abe022db None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:36.675148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab23b1f-b87d-485d-bbe1-be76abe022db None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:36.676631 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab23b1f-b87d-485d-bbe1-be76abe022db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:36.762343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2ab23b1f-b87d-485d-bbe1-be76abe022db None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:36.763748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2ab23b1f-b87d-485d-bbe1-be76abe022db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:36.776708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb65373-cf04-422b-a397-0fcfef207a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:36.777305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb65373-cf04-422b-a397-0fcfef207a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:36.777583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb65373-cf04-422b-a397-0fcfef207a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:36.777857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb65373-cf04-422b-a397-0fcfef207a42 admin admin] PATH_INFO: `/v3/projects/8f4b6c5c18234e62ada399ef42e8a870/users/1f1490b225fc4f93b6eae46e3b9c2e09/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:36.789179 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:36.832625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb65373-cf04-422b-a397-0fcfef207a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f4b6c5c18234e62ada399ef42e8a870, user_id=1f1490b225fc4f93b6eae46e3b9c2e09, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:36.835301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb65373-cf04-422b-a397-0fcfef207a42 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:36.872850 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3768/7456] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:36.882490 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3689/7457] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:44:36 2022] PUT /identity/v3/projects/8f4b6c5c18234e62ada399ef42e8a870/users/1f1490b225fc4f93b6eae46e3b9c2e09/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:36.883877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adeb0b-0ec1-44f1-8fca-b2308c7015e9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:36.888133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adeb0b-0ec1-44f1-8fca-b2308c7015e9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:36.888290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adeb0b-0ec1-44f1-8fca-b2308c7015e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:36.892319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb65373-cf04-422b-a397-0fcfef207a42 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:36.898148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0eb65373-cf04-422b-a397-0fcfef207a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:36.946356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-57adeb0b-0ec1-44f1-8fca-b2308c7015e9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:36.948011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-57adeb0b-0ec1-44f1-8fca-b2308c7015e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:37.115259 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3769/7458] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:37.121523 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57adeb0b-0ec1-44f1-8fca-b2308c7015e9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:37.140070 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb65373-cf04-422b-a397-0fcfef207a42 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:37.142149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57adeb0b-0ec1-44f1-8fca-b2308c7015e9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:37.152778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff14eaa-2327-4994-b804-0a6e0f048a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:37.153408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff14eaa-2327-4994-b804-0a6e0f048a43 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:37.153686 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff14eaa-2327-4994-b804-0a6e0f048a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:37.155464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32342938-c77f-41cc-bf35-c723052ad6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:37.156129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32342938-c77f-41cc-bf35-c723052ad6ef admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:37.156420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32342938-c77f-41cc-bf35-c723052ad6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:37.156995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff14eaa-2327-4994-b804-0a6e0f048a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:37.157638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff14eaa-2327-4994-b804-0a6e0f048a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:37.158943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32342938-c77f-41cc-bf35-c723052ad6ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:37.159689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32342938-c77f-41cc-bf35-c723052ad6ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:44:37.160493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32342938-c77f-41cc-bf35-c723052ad6ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:37.162119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32342938-c77f-41cc-bf35-c723052ad6ef admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:37.166049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff14eaa-2327-4994-b804-0a6e0f048a43 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:37.193724 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3690/7459] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:44:37.202472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff14eaa-2327-4994-b804-0a6e0f048a43 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:37.207484 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3770/7460] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:44:37.211594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32342938-c77f-41cc-bf35-c723052ad6ef admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:37.234543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff14eaa-2327-4994-b804-0a6e0f048a43 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:37.245646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32342938-c77f-41cc-bf35-c723052ad6ef admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:37.249132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1ef7f-3803-488c-910a-15ee0fa2a1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:37.252242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1ef7f-3803-488c-910a-15ee0fa2a1f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:37.252526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1ef7f-3803-488c-910a-15ee0fa2a1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:37.252801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1ef7f-3803-488c-910a-15ee0fa2a1f5 admin admin] PATH_INFO: `/v3/projects/8f4b6c5c18234e62ada399ef42e8a870/users/1f1490b225fc4f93b6eae46e3b9c2e09/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:37.258011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b1ef7f-3803-488c-910a-15ee0fa2a1f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f4b6c5c18234e62ada399ef42e8a870, user_id=1f1490b225fc4f93b6eae46e3b9c2e09, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:37.261265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0a85b-7666-40ec-aa8d-753b824b73b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:37.262075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0a85b-7666-40ec-aa8d-753b824b73b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:37.262357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0a85b-7666-40ec-aa8d-753b824b73b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:37.262628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0a85b-7666-40ec-aa8d-753b824b73b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:37.263266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0a85b-7666-40ec-aa8d-753b824b73b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:37.266398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b1ef7f-3803-488c-910a-15ee0fa2a1f5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:37.270339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0a85b-7666-40ec-aa8d-753b824b73b7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:37.298962 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3691/7461] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:44:37 2022] PUT /identity/v3/projects/8f4b6c5c18234e62ada399ef42e8a870/users/1f1490b225fc4f93b6eae46e3b9c2e09/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:37.316726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89f6dd-6575-4d4c-b83b-9298974090f5 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:37.317073 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89f6dd-6575-4d4c-b83b-9298974090f5 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:37.317659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89f6dd-6575-4d4c-b83b-9298974090f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:37.333514 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3771/7462] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:44:37 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:37.334528 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0a85b-7666-40ec-aa8d-753b824b73b7 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:37.396150 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:37.497095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9b89f6dd-6575-4d4c-b83b-9298974090f5 None None] MFA Rules not processed for user `1f1490b225fc4f93b6eae46e3b9c2e09`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:37.510721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9b89f6dd-6575-4d4c-b83b-9298974090f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:37.563421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0a85b-7666-40ec-aa8d-753b824b73b7 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:37.580020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abbd31-e711-4fe6-af15-6314e9782498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:37.582951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abbd31-e711-4fe6-af15-6314e9782498 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:37.583462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abbd31-e711-4fe6-af15-6314e9782498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:37.583944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abbd31-e711-4fe6-af15-6314e9782498 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:37.585162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abbd31-e711-4fe6-af15-6314e9782498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:37.596521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abbd31-e711-4fe6-af15-6314e9782498 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:37.644307 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3772/7463] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:44:37 2022] POST /identity/v3/users => generated 286 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:37.650134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abbd31-e711-4fe6-af15-6314e9782498 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:37.670409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abbd31-e711-4fe6-af15-6314e9782498 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:37.683440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b7ce3-6cb3-47ef-aa65-c2c609bba346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:37.684293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b7ce3-6cb3-47ef-aa65-c2c609bba346 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:37.684575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b7ce3-6cb3-47ef-aa65-c2c609bba346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:37.684849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b7ce3-6cb3-47ef-aa65-c2c609bba346 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:37.685556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b7ce3-6cb3-47ef-aa65-c2c609bba346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:37.687202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b7ce3-6cb3-47ef-aa65-c2c609bba346 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:37.716689 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3773/7464] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:44:37.719207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b7ce3-6cb3-47ef-aa65-c2c609bba346 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:37.734224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b7ce3-6cb3-47ef-aa65-c2c609bba346 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:37.754213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755c0af-a789-4899-91a9-0d60b6188e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:37.756468 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755c0af-a789-4899-91a9-0d60b6188e50 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:37.757340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755c0af-a789-4899-91a9-0d60b6188e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:37.758610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0755c0af-a789-4899-91a9-0d60b6188e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:37.761297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0755c0af-a789-4899-91a9-0d60b6188e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:37.764392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0755c0af-a789-4899-91a9-0d60b6188e50 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:37.796730 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3774/7465] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:44:37.801595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755c0af-a789-4899-91a9-0d60b6188e50 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:37.813487 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3692/7466] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 498 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:44:37.817850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89f6dd-6575-4d4c-b83b-9298974090f5 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:37.831409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0755c0af-a789-4899-91a9-0d60b6188e50 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:37.842096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b53fd3-6979-4c78-b603-99b470bb935a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:37.844824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b53fd3-6979-4c78-b603-99b470bb935a admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:37.845060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b53fd3-6979-4c78-b603-99b470bb935a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:37.845338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b53fd3-6979-4c78-b603-99b470bb935a admin admin] PATH_INFO: `/v3/projects/7bbd14acc689493b84d8fa6d0137bdbf/users/fe0eddcab4c14931b7c20f86f3115981/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:37.846301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89f6dd-6575-4d4c-b83b-9298974090f5 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:37.858721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713ca21-4c97-4206-ba58-204301039be4 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:37.859372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713ca21-4c97-4206-ba58-204301039be4 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:37.859644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713ca21-4c97-4206-ba58-204301039be4 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:37.861563 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713ca21-4c97-4206-ba58-204301039be4 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:37.864361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8713ca21-4c97-4206-ba58-204301039be4 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:37.866027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8713ca21-4c97-4206-ba58-204301039be4 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:37.881940 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b53fd3-6979-4c78-b603-99b470bb935a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bbd14acc689493b84d8fa6d0137bdbf, user_id=fe0eddcab4c14931b7c20f86f3115981, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:37.885618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b53fd3-6979-4c78-b603-99b470bb935a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:37.901892 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3693/7467] 10.222.0.39 () {60 vars in 1150 bytes} [Sun Aug 7 01:44:37 2022] POST /identity/v3/domains => generated 277 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:37.905412 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713ca21-4c97-4206-ba58-204301039be4 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:37.926445 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3775/7468] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:44:37 2022] PUT /identity/v3/projects/7bbd14acc689493b84d8fa6d0137bdbf/users/fe0eddcab4c14931b7c20f86f3115981/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:44:37.936859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fdbaf-defb-46f1-9b78-648995906600 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:37.937222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fdbaf-defb-46f1-9b78-648995906600 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:37.937425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fdbaf-defb-46f1-9b78-648995906600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:38.034504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-124fdbaf-defb-46f1-9b78-648995906600 None None] MFA Rules not processed for user `fe0eddcab4c14931b7c20f86f3115981`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:38.036214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-124fdbaf-defb-46f1-9b78-648995906600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:38.047814 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:38.111877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713ca21-4c97-4206-ba58-204301039be4 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:38.264502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973c264-ee14-4d32-9a44-4e15eeb6f1fe tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:38.267344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973c264-ee14-4d32-9a44-4e15eeb6f1fe tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:38.267636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973c264-ee14-4d32-9a44-4e15eeb6f1fe tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:38.267929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973c264-ee14-4d32-9a44-4e15eeb6f1fe tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:38.271045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973c264-ee14-4d32-9a44-4e15eeb6f1fe tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:38.272765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973c264-ee14-4d32-9a44-4e15eeb6f1fe tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:38.294754 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3776/7469] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:44:38.312629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fdbaf-defb-46f1-9b78-648995906600 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:38.315155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-124fdbaf-defb-46f1-9b78-648995906600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:38.368099 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3694/7470] 10.222.0.39 () {60 vars in 1150 bytes} [Sun Aug 7 01:44:37 2022] POST /identity/v3/domains => generated 274 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:44:38.371694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973c264-ee14-4d32-9a44-4e15eeb6f1fe tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:38.483564 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:38.499833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fdbaf-defb-46f1-9b78-648995906600 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:38.573781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973c264-ee14-4d32-9a44-4e15eeb6f1fe tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:38.581251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd697290-5ea3-4bbf-88dc-ccfc74062fa5 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:38.582426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd697290-5ea3-4bbf-88dc-ccfc74062fa5 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:38.582952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd697290-5ea3-4bbf-88dc-ccfc74062fa5 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:38.583467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd697290-5ea3-4bbf-88dc-ccfc74062fa5 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:38.584436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd697290-5ea3-4bbf-88dc-ccfc74062fa5 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:38.586932 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd697290-5ea3-4bbf-88dc-ccfc74062fa5 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:38.642107 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3695/7471] 10.222.0.39 () {60 vars in 1150 bytes} [Sun Aug 7 01:44:38 2022] POST /identity/v3/domains => generated 278 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:38.650758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd697290-5ea3-4bbf-88dc-ccfc74062fa5 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:38.681597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed82f3-5861-419a-85eb-237b07e41077 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:38.682221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed82f3-5861-419a-85eb-237b07e41077 service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:38.682489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed82f3-5861-419a-85eb-237b07e41077 service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:38.683093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed82f3-5861-419a-85eb-237b07e41077 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:38.767459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd697290-5ea3-4bbf-88dc-ccfc74062fa5 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:38.773097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d1d61-38d0-4852-bb89-d9fe0a56edbf tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:38.774439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d1d61-38d0-4852-bb89-d9fe0a56edbf tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:38.774729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d1d61-38d0-4852-bb89-d9fe0a56edbf tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:38.776593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d1d61-38d0-4852-bb89-d9fe0a56edbf tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:38.777349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d1d61-38d0-4852-bb89-d9fe0a56edbf tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:38.779015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d1d61-38d0-4852-bb89-d9fe0a56edbf tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:38.829135 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3696/7472] 10.222.0.39 () {60 vars in 1150 bytes} [Sun Aug 7 01:44:38 2022] POST /identity/v3/domains => generated 278 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:38.833582 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d1d61-38d0-4852-bb89-d9fe0a56edbf tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:38.847576 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:38.863942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed82f3-5861-419a-85eb-237b07e41077 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:38.865542 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed82f3-5861-419a-85eb-237b07e41077 service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:38.912807 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3777/7473] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:44:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:44:38.959251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d1d61-38d0-4852-bb89-d9fe0a56edbf tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:38.971811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ea2fc-4e6c-4907-a1d9-6690f700638f tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:38.973125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ea2fc-4e6c-4907-a1d9-6690f700638f tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:38.973577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ea2fc-4e6c-4907-a1d9-6690f700638f tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:38.974011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ea2fc-4e6c-4907-a1d9-6690f700638f tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/domains/de8ac39c0d354c48ad8ea8913894c79d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:39.004364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ea2fc-4e6c-4907-a1d9-6690f700638f tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=de8ac39c0d354c48ad8ea8913894c79d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:39.012283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ea2fc-4e6c-4907-a1d9-6690f700638f tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:39.048499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2c7ea2fc-4e6c-4907-a1d9-6690f700638f tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'de8ac39c0d354c48ad8ea8913894c79d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:39.069324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2c7ea2fc-4e6c-4907-a1d9-6690f700638f tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'de8ac39c0d354c48ad8ea8913894c79d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:39.126038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2c7ea2fc-4e6c-4907-a1d9-6690f700638f tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de8ac39c0d354c48ad8ea8913894c79d', 'request_id': 'req-2c7ea2fc-4e6c-4907-a1d9-6690f700638f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:39.134258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2c7ea2fc-4e6c-4907-a1d9-6690f700638f tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de8ac39c0d354c48ad8ea8913894c79d', 'request_id': 'req-2c7ea2fc-4e6c-4907-a1d9-6690f700638f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:39.144833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2c7ea2fc-4e6c-4907-a1d9-6690f700638f tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de8ac39c0d354c48ad8ea8913894c79d', 'request_id': 'req-2c7ea2fc-4e6c-4907-a1d9-6690f700638f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:39.174373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2c7ea2fc-4e6c-4907-a1d9-6690f700638f tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] The token cache is being invalidate because project de8ac39c0d354c48ad8ea8913894c79d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:44:39.175228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2c7ea2fc-4e6c-4907-a1d9-6690f700638f tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:39.178924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2c7ea2fc-4e6c-4907-a1d9-6690f700638f tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:39.198370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2c7ea2fc-4e6c-4907-a1d9-6690f700638f tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'de8ac39c0d354c48ad8ea8913894c79d', 'request_id': 'req-2c7ea2fc-4e6c-4907-a1d9-6690f700638f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:39.199505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2c7ea2fc-4e6c-4907-a1d9-6690f700638f tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'de8ac39c0d354c48ad8ea8913894c79d', 'request_id': 'req-2c7ea2fc-4e6c-4907-a1d9-6690f700638f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:39.204143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2c7ea2fc-4e6c-4907-a1d9-6690f700638f tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'de8ac39c0d354c48ad8ea8913894c79d', 'request_id': 'req-2c7ea2fc-4e6c-4907-a1d9-6690f700638f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:39.212704 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3697/7474] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:44:38 2022] DELETE /identity/v3/domains/de8ac39c0d354c48ad8ea8913894c79d => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:39.219075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed82f3-5861-419a-85eb-237b07e41077 service cinder] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:39.236663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed82f3-5861-419a-85eb-237b07e41077 service cinder] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:39.326991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb2d5f-76c7-4307-a1eb-82e90800f816 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:39.328592 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb2d5f-76c7-4307-a1eb-82e90800f816 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:39.329096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb2d5f-76c7-4307-a1eb-82e90800f816 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:39.329673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb2d5f-76c7-4307-a1eb-82e90800f816 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:39.330784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb2d5f-76c7-4307-a1eb-82e90800f816 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:39.333554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb2d5f-76c7-4307-a1eb-82e90800f816 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:39.365325 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3778/7475] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Aug 7 01:44:39 2022] POST /identity/v3/domains => generated 249 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:39.369461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ea2fc-4e6c-4907-a1d9-6690f700638f tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:39.372047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2c7ea2fc-4e6c-4907-a1d9-6690f700638f tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:39.409041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ea2fc-4e6c-4907-a1d9-6690f700638f tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:39.495476 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:39.525514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595b30f-a805-4d28-b396-6982210beb85 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:39.525514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595b30f-a805-4d28-b396-6982210beb85 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:39.526082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595b30f-a805-4d28-b396-6982210beb85 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:39.527125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595b30f-a805-4d28-b396-6982210beb85 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/domains/4e8d5f221ec44274ac498607b6c6bb0a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:39.546279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f595b30f-a805-4d28-b396-6982210beb85 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4e8d5f221ec44274ac498607b6c6bb0a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:39.549030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f595b30f-a805-4d28-b396-6982210beb85 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:39.577850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f595b30f-a805-4d28-b396-6982210beb85 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4e8d5f221ec44274ac498607b6c6bb0a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:39.578715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f595b30f-a805-4d28-b396-6982210beb85 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4e8d5f221ec44274ac498607b6c6bb0a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:39.639782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f595b30f-a805-4d28-b396-6982210beb85 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4e8d5f221ec44274ac498607b6c6bb0a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:39.641669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f595b30f-a805-4d28-b396-6982210beb85 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4e8d5f221ec44274ac498607b6c6bb0a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:39.649589 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3698/7476] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:44:39 2022] PATCH /identity/v3/domains/4e8d5f221ec44274ac498607b6c6bb0a => generated 250 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:44:39.654129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb2d5f-76c7-4307-a1eb-82e90800f816 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:39.656379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5fbb2d5f-76c7-4307-a1eb-82e90800f816 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:39.683271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31924f9d-488e-4ee1-83a0-07b0766627eb None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:39.683763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31924f9d-488e-4ee1-83a0-07b0766627eb None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:39.684071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb2d5f-76c7-4307-a1eb-82e90800f816 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:39.684285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31924f9d-488e-4ee1-83a0-07b0766627eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:39.706892 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-31924f9d-488e-4ee1-83a0-07b0766627eb None None] MFA Rules not processed for user `84e60500a5354328990e61423f46f381`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:39.708473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-31924f9d-488e-4ee1-83a0-07b0766627eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:39.807952 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:39.828729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37662a2-2eec-467c-89df-6452531b5b45 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:39.832182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37662a2-2eec-467c-89df-6452531b5b45 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:39.832465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37662a2-2eec-467c-89df-6452531b5b45 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:39.832738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37662a2-2eec-467c-89df-6452531b5b45 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/domains/4e8d5f221ec44274ac498607b6c6bb0a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:39.868843 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3699/7477] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:44:39.895417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37662a2-2eec-467c-89df-6452531b5b45 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4e8d5f221ec44274ac498607b6c6bb0a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:39.902664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37662a2-2eec-467c-89df-6452531b5b45 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:39.974251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f37662a2-2eec-467c-89df-6452531b5b45 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4e8d5f221ec44274ac498607b6c6bb0a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:39.978069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31924f9d-488e-4ee1-83a0-07b0766627eb None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:39.980360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-31924f9d-488e-4ee1-83a0-07b0766627eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:40.015458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f37662a2-2eec-467c-89df-6452531b5b45 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4e8d5f221ec44274ac498607b6c6bb0a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:40.174133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f37662a2-2eec-467c-89df-6452531b5b45 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e8d5f221ec44274ac498607b6c6bb0a', 'request_id': 'req-f37662a2-2eec-467c-89df-6452531b5b45'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:40.199021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f37662a2-2eec-467c-89df-6452531b5b45 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e8d5f221ec44274ac498607b6c6bb0a', 'request_id': 'req-f37662a2-2eec-467c-89df-6452531b5b45'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:40.229198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f37662a2-2eec-467c-89df-6452531b5b45 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e8d5f221ec44274ac498607b6c6bb0a', 'request_id': 'req-f37662a2-2eec-467c-89df-6452531b5b45'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:40.235298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31924f9d-488e-4ee1-83a0-07b0766627eb None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:40.279821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f37662a2-2eec-467c-89df-6452531b5b45 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] The token cache is being invalidate because project 4e8d5f221ec44274ac498607b6c6bb0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:44:40.280777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f37662a2-2eec-467c-89df-6452531b5b45 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:40.282291 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f37662a2-2eec-467c-89df-6452531b5b45 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:40.298479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f37662a2-2eec-467c-89df-6452531b5b45 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4e8d5f221ec44274ac498607b6c6bb0a', 'request_id': 'req-f37662a2-2eec-467c-89df-6452531b5b45'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:40.306581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f37662a2-2eec-467c-89df-6452531b5b45 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4e8d5f221ec44274ac498607b6c6bb0a', 'request_id': 'req-f37662a2-2eec-467c-89df-6452531b5b45'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:40.307692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f37662a2-2eec-467c-89df-6452531b5b45 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4e8d5f221ec44274ac498607b6c6bb0a', 'request_id': 'req-f37662a2-2eec-467c-89df-6452531b5b45'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:40.328551 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3779/7478] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:44:39 2022] DELETE /identity/v3/domains/4e8d5f221ec44274ac498607b6c6bb0a => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:40.332318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37662a2-2eec-467c-89df-6452531b5b45 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:40.337227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f37662a2-2eec-467c-89df-6452531b5b45 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:40.362406 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:40.385985 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ef40a-3eec-4dc1-a779-0c8ae42df809 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:40.390725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ef40a-3eec-4dc1-a779-0c8ae42df809 service glance] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:40.391857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ef40a-3eec-4dc1-a779-0c8ae42df809 service glance] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:40.394200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ef40a-3eec-4dc1-a779-0c8ae42df809 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:40.402420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2c6ef40a-3eec-4dc1-a779-0c8ae42df809 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:40.548418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37662a2-2eec-467c-89df-6452531b5b45 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:40.561754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82524fa-dcdf-424f-9f64-ea5f985d3e1b tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:40.563975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82524fa-dcdf-424f-9f64-ea5f985d3e1b tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:40.566794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82524fa-dcdf-424f-9f64-ea5f985d3e1b tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:40.572407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82524fa-dcdf-424f-9f64-ea5f985d3e1b tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:40.573312 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82524fa-dcdf-424f-9f64-ea5f985d3e1b tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:40.576331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82524fa-dcdf-424f-9f64-ea5f985d3e1b tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:40.659736 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3780/7479] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Aug 7 01:44:40 2022] POST /identity/v3/domains => generated 278 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:40.662565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82524fa-dcdf-424f-9f64-ea5f985d3e1b tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:40.692420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ef40a-3eec-4dc1-a779-0c8ae42df809 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:40.696027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ef40a-3eec-4dc1-a779-0c8ae42df809 service glance] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:40.801031 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:40.811643 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3700/7480] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:44:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 834 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:44:40.813978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ef40a-3eec-4dc1-a779-0c8ae42df809 service glance] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:40.817545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2c6ef40a-3eec-4dc1-a779-0c8ae42df809 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:40.905953 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82524fa-dcdf-424f-9f64-ea5f985d3e1b tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:40.916758 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d520c-8dbb-493f-b9f3-fdbbde98feb2 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:40.917759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d520c-8dbb-493f-b9f3-fdbbde98feb2 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:40.918098 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d520c-8dbb-493f-b9f3-fdbbde98feb2 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:40.918315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d520c-8dbb-493f-b9f3-fdbbde98feb2 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/domains/22dcf9e9dc554e8aa7b2f2ae1c097710` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:40.957448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d520c-8dbb-493f-b9f3-fdbbde98feb2 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=22dcf9e9dc554e8aa7b2f2ae1c097710)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:40.959308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d520c-8dbb-493f-b9f3-fdbbde98feb2 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:40.968758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ef40a-3eec-4dc1-a779-0c8ae42df809 service glance] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:41.029840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-115d520c-8dbb-493f-b9f3-fdbbde98feb2 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '22dcf9e9dc554e8aa7b2f2ae1c097710'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:41.030892 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-115d520c-8dbb-493f-b9f3-fdbbde98feb2 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '22dcf9e9dc554e8aa7b2f2ae1c097710'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:41.047235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d26a7d-7839-4e78-af18-fe3c8ede1d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:41.048226 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d26a7d-7839-4e78-af18-fe3c8ede1d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:41.049070 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d26a7d-7839-4e78-af18-fe3c8ede1d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:41.051740 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d26a7d-7839-4e78-af18-fe3c8ede1d30 admin admin] PATH_INFO: `/v3/users/fb6dd228d55d49a9b1498500178c4278` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:41.053374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d26a7d-7839-4e78-af18-fe3c8ede1d30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb6dd228d55d49a9b1498500178c4278)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:41.062218 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d26a7d-7839-4e78-af18-fe3c8ede1d30 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:41.100441 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-115d520c-8dbb-493f-b9f3-fdbbde98feb2 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '22dcf9e9dc554e8aa7b2f2ae1c097710'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:41.101570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-115d520c-8dbb-493f-b9f3-fdbbde98feb2 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '22dcf9e9dc554e8aa7b2f2ae1c097710'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:41.111281 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3781/7481] 10.222.0.39 () {60 vars in 1250 bytes} [Sun Aug 7 01:44:40 2022] PATCH /identity/v3/domains/22dcf9e9dc554e8aa7b2f2ae1c097710 => generated 276 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:44:41.112584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d520c-8dbb-493f-b9f3-fdbbde98feb2 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:41.114077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-115d520c-8dbb-493f-b9f3-fdbbde98feb2 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:41.138697 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:41.194935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-87d26a7d-7839-4e78-af18-fe3c8ede1d30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb6dd228d55d49a9b1498500178c4278'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:41.213907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-87d26a7d-7839-4e78-af18-fe3c8ede1d30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb6dd228d55d49a9b1498500178c4278'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:41.245679 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-87d26a7d-7839-4e78-af18-fe3c8ede1d30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb6dd228d55d49a9b1498500178c4278'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:41.248085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-87d26a7d-7839-4e78-af18-fe3c8ede1d30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb6dd228d55d49a9b1498500178c4278'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:41.269937 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-87d26a7d-7839-4e78-af18-fe3c8ede1d30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb6dd228d55d49a9b1498500178c4278'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:41.281932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d520c-8dbb-493f-b9f3-fdbbde98feb2 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:41.285564 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3701/7482] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:44:40 2022] DELETE /identity/v3/users/fb6dd228d55d49a9b1498500178c4278 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:41.287004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a11c70-04b3-4675-a753-8228e71bcb01 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:41.287281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a11c70-04b3-4675-a753-8228e71bcb01 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:41.287559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a11c70-04b3-4675-a753-8228e71bcb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:41.322930 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-28a11c70-04b3-4675-a753-8228e71bcb01 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:41.324519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-28a11c70-04b3-4675-a753-8228e71bcb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:41.430234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872a45a-9ea8-478b-b620-96f590150b39 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:41.430899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872a45a-9ea8-478b-b620-96f590150b39 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:41.431182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872a45a-9ea8-478b-b620-96f590150b39 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:41.431458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872a45a-9ea8-478b-b620-96f590150b39 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/domains/22dcf9e9dc554e8aa7b2f2ae1c097710` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:41.453698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872a45a-9ea8-478b-b620-96f590150b39 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=22dcf9e9dc554e8aa7b2f2ae1c097710)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:41.455805 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872a45a-9ea8-478b-b620-96f590150b39 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:41.460295 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3782/7483] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Aug 7 01:44:41 2022] GET /identity/v3/domains/22dcf9e9dc554e8aa7b2f2ae1c097710 => generated 276 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:44:41.462245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872a45a-9ea8-478b-b620-96f590150b39 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:41.470097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e872a45a-9ea8-478b-b620-96f590150b39 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:41.495788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872a45a-9ea8-478b-b620-96f590150b39 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:41.511335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416d500-cb77-4219-9d84-54096e8c62d1 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:41.512424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416d500-cb77-4219-9d84-54096e8c62d1 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:41.512902 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416d500-cb77-4219-9d84-54096e8c62d1 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:41.513187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416d500-cb77-4219-9d84-54096e8c62d1 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/domains/22dcf9e9dc554e8aa7b2f2ae1c097710` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:41.514558 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416d500-cb77-4219-9d84-54096e8c62d1 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=22dcf9e9dc554e8aa7b2f2ae1c097710)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:41.516256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416d500-cb77-4219-9d84-54096e8c62d1 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:41.542044 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3702/7484] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:41.562633 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:41.571422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a11c70-04b3-4675-a753-8228e71bcb01 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:41.573409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-28a11c70-04b3-4675-a753-8228e71bcb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:41.576353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3416d500-cb77-4219-9d84-54096e8c62d1 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '22dcf9e9dc554e8aa7b2f2ae1c097710'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:41.599318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3416d500-cb77-4219-9d84-54096e8c62d1 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '22dcf9e9dc554e8aa7b2f2ae1c097710'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:41.700224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3416d500-cb77-4219-9d84-54096e8c62d1 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22dcf9e9dc554e8aa7b2f2ae1c097710', 'request_id': 'req-3416d500-cb77-4219-9d84-54096e8c62d1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:41.714289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3416d500-cb77-4219-9d84-54096e8c62d1 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22dcf9e9dc554e8aa7b2f2ae1c097710', 'request_id': 'req-3416d500-cb77-4219-9d84-54096e8c62d1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:41.730732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a11c70-04b3-4675-a753-8228e71bcb01 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:41.746914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3416d500-cb77-4219-9d84-54096e8c62d1 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22dcf9e9dc554e8aa7b2f2ae1c097710', 'request_id': 'req-3416d500-cb77-4219-9d84-54096e8c62d1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:41.785455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3416d500-cb77-4219-9d84-54096e8c62d1 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] The token cache is being invalidate because project 22dcf9e9dc554e8aa7b2f2ae1c097710 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:44:41.788467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3416d500-cb77-4219-9d84-54096e8c62d1 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:41.791379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3416d500-cb77-4219-9d84-54096e8c62d1 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:41.827800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3416d500-cb77-4219-9d84-54096e8c62d1 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '22dcf9e9dc554e8aa7b2f2ae1c097710', 'request_id': 'req-3416d500-cb77-4219-9d84-54096e8c62d1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:41.842616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3416d500-cb77-4219-9d84-54096e8c62d1 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '22dcf9e9dc554e8aa7b2f2ae1c097710', 'request_id': 'req-3416d500-cb77-4219-9d84-54096e8c62d1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:41.847865 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3416d500-cb77-4219-9d84-54096e8c62d1 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '22dcf9e9dc554e8aa7b2f2ae1c097710', 'request_id': 'req-3416d500-cb77-4219-9d84-54096e8c62d1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:41.868437 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3783/7485] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:44:41 2022] DELETE /identity/v3/domains/22dcf9e9dc554e8aa7b2f2ae1c097710 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:41.872440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416d500-cb77-4219-9d84-54096e8c62d1 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:41.878789 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3416d500-cb77-4219-9d84-54096e8c62d1 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:41.917963 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251391c-ad6d-4965-be15-162a49978115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:41.918570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251391c-ad6d-4965-be15-162a49978115 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:41.918986 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251391c-ad6d-4965-be15-162a49978115 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:41.919432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251391c-ad6d-4965-be15-162a49978115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:41.925419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0251391c-ad6d-4965-be15-162a49978115 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:41.966896 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:42.067814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416d500-cb77-4219-9d84-54096e8c62d1 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:42.076883 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8f5fe-0948-48e9-a7a2-bbca278cbc13 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:42.077529 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8f5fe-0948-48e9-a7a2-bbca278cbc13 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:42.077799 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8f5fe-0948-48e9-a7a2-bbca278cbc13 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:42.078076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8f5fe-0948-48e9-a7a2-bbca278cbc13 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:42.078872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8f5fe-0948-48e9-a7a2-bbca278cbc13 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:42.080588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8f5fe-0948-48e9-a7a2-bbca278cbc13 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:42.102862 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3784/7486] 10.222.0.39 () {58 vars in 1128 bytes} [Sun Aug 7 01:44:41 2022] GET /identity/v3/domains => generated 1347 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:44:42.104375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40dd4ce-58cc-462f-a118-da4f143f390b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:42.104661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40dd4ce-58cc-462f-a118-da4f143f390b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:42.104928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40dd4ce-58cc-462f-a118-da4f143f390b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:42.126796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e40dd4ce-58cc-462f-a118-da4f143f390b None None] MFA Rules not processed for user `fe0eddcab4c14931b7c20f86f3115981`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:42.128069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e40dd4ce-58cc-462f-a118-da4f143f390b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:42.188717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251391c-ad6d-4965-be15-162a49978115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:42.190129 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:42.207825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251391c-ad6d-4965-be15-162a49978115 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:42.210412 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3785/7487] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:42.212646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40dd4ce-58cc-462f-a118-da4f143f390b None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:42.230033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40dd4ce-58cc-462f-a118-da4f143f390b None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:42.235652 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87c6ee-aebf-440b-9b5b-a3556243aa92 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:42.237322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87c6ee-aebf-440b-9b5b-a3556243aa92 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:42.238291 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87c6ee-aebf-440b-9b5b-a3556243aa92 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:42.238882 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87c6ee-aebf-440b-9b5b-a3556243aa92 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/domains/22dcf9e9dc554e8aa7b2f2ae1c097710` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:42.247846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87c6ee-aebf-440b-9b5b-a3556243aa92 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:44:42.254187 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-6b87c6ee-aebf-440b-9b5b-a3556243aa92 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Could not find domain: 22dcf9e9dc554e8aa7b2f2ae1c097710.: keystone.exception.DomainNotFound: Could not find domain: 22dcf9e9dc554e8aa7b2f2ae1c097710. Aug 07 01:44:42.254187 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:44:42.254187 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 07 01:44:42.254187 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 07 01:44:42.254187 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 01:44:42.254187 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 01:44:42.254187 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 01:44:42.254187 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 01:44:42.254187 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 22dcf9e9dc554e8aa7b2f2ae1c097710. Aug 07 01:44:42.254187 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:44:42.254187 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:44:42.254187 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:44:42.254187 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:44:42.254187 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:44:42.254187 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:44:42.254187 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:44:42.255425 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:44:42.255425 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:44:42.255425 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:44:42.255425 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:44:42.255425 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:44:42.255425 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:44:42.255425 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:44:42.255425 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 07 01:44:42.255425 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 07 01:44:42.255425 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:44:42.255425 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:44:42.255425 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:44:42.255425 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:44:42.255425 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:44:42.255425 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:44:42.255425 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:44:42.256796 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:44:42.256796 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:44:42.256796 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:44:42.256796 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:44:42.256796 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 01:44:42.256796 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:44:42.256796 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:44:42.256796 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:44:42.256796 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:44:42.256796 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:44:42.256796 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:44:42.256796 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:44:42.256796 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:44:42.256796 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 07 01:44:42.256796 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:44:42.256796 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 22dcf9e9dc554e8aa7b2f2ae1c097710. Aug 07 01:44:42.256796 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:44:42.262553 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3786/7488] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:44:42 2022] PATCH /identity/v3/domains/22dcf9e9dc554e8aa7b2f2ae1c097710 => generated 112 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:44:42.268143 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87c6ee-aebf-440b-9b5b-a3556243aa92 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:42.279105 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3703/7489] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:44:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 709 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:44:42.282949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87c6ee-aebf-440b-9b5b-a3556243aa92 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:42.290779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6bf918-93d8-49ee-b3ab-a77e40b28974 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:42.291740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bf918-93d8-49ee-b3ab-a77e40b28974 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:42.292300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bf918-93d8-49ee-b3ab-a77e40b28974 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:42.293083 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bf918-93d8-49ee-b3ab-a77e40b28974 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:42.294146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6bf918-93d8-49ee-b3ab-a77e40b28974 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:42.296145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6bf918-93d8-49ee-b3ab-a77e40b28974 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:42.327834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251391c-ad6d-4965-be15-162a49978115 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:42.329515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0251391c-ad6d-4965-be15-162a49978115 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:42.360351 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3787/7490] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Aug 7 01:44:42 2022] POST /identity/v3/domains => generated 277 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:42.365566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6bf918-93d8-49ee-b3ab-a77e40b28974 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:42.483729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251391c-ad6d-4965-be15-162a49978115 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:42.534850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6bf918-93d8-49ee-b3ab-a77e40b28974 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:42.558553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a106a-3cf7-454a-8381-0124838e2bd3 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:42.561293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a106a-3cf7-454a-8381-0124838e2bd3 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:42.562216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a106a-3cf7-454a-8381-0124838e2bd3 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:42.562595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a106a-3cf7-454a-8381-0124838e2bd3 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:42.565073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a106a-3cf7-454a-8381-0124838e2bd3 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:42.571633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a106a-3cf7-454a-8381-0124838e2bd3 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:42.631018 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e1964-1e09-4c47-820a-d57da1352f1c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:42.633199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e1964-1e09-4c47-820a-d57da1352f1c service glance] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:42.633678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e1964-1e09-4c47-820a-d57da1352f1c service glance] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:42.634097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e1964-1e09-4c47-820a-d57da1352f1c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:42.647735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-559e1964-1e09-4c47-820a-d57da1352f1c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:42.659344 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3788/7491] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:44:42 2022] POST /identity/v3/users => generated 346 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:42.659344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a106a-3cf7-454a-8381-0124838e2bd3 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:42.664098 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-712a106a-3cf7-454a-8381-0124838e2bd3 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:42.855915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e1964-1e09-4c47-820a-d57da1352f1c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:42.863855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e1964-1e09-4c47-820a-d57da1352f1c service glance] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:42.895744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a106a-3cf7-454a-8381-0124838e2bd3 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:42.916932 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3704/7492] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:44:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:44:42.931350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e1964-1e09-4c47-820a-d57da1352f1c service glance] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:42.937612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9cb99-8ab7-41f8-bf11-5069f8b1f78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:42.938381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9cb99-8ab7-41f8-bf11-5069f8b1f78e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:42.938669 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9cb99-8ab7-41f8-bf11-5069f8b1f78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:42.938942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9cb99-8ab7-41f8-bf11-5069f8b1f78e admin admin] PATH_INFO: `/v3/projects/9223964196f74e84ac68fe735cda9571` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:42.947064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9cb99-8ab7-41f8-bf11-5069f8b1f78e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9223964196f74e84ac68fe735cda9571)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:42.949414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9cb99-8ab7-41f8-bf11-5069f8b1f78e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:42.975863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e1964-1e09-4c47-820a-d57da1352f1c service glance] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:42.992621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e4376-9909-4eff-9a41-c5c06c8f3224 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:42.993250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e4376-9909-4eff-9a41-c5c06c8f3224 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:42.993532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e4376-9909-4eff-9a41-c5c06c8f3224 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:42.993966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e4376-9909-4eff-9a41-c5c06c8f3224 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/groups` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:42.994445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e4376-9909-4eff-9a41-c5c06c8f3224 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:42.996453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e4376-9909-4eff-9a41-c5c06c8f3224 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:43.014001 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:43.047461 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3705/7493] 10.222.0.39 () {60 vars in 1147 bytes} [Sun Aug 7 01:44:42 2022] POST /identity/v3/groups => generated 324 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:43.047461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e4376-9909-4eff-9a41-c5c06c8f3224 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:43.074245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-392e4376-9909-4eff-9a41-c5c06c8f3224 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:43.145872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-caf9cb99-8ab7-41f8-bf11-5069f8b1f78e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9223964196f74e84ac68fe735cda9571', 'request_id': 'req-caf9cb99-8ab7-41f8-bf11-5069f8b1f78e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:43.162506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-caf9cb99-8ab7-41f8-bf11-5069f8b1f78e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9223964196f74e84ac68fe735cda9571', 'request_id': 'req-caf9cb99-8ab7-41f8-bf11-5069f8b1f78e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:43.167519 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:43.182478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-caf9cb99-8ab7-41f8-bf11-5069f8b1f78e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9223964196f74e84ac68fe735cda9571', 'request_id': 'req-caf9cb99-8ab7-41f8-bf11-5069f8b1f78e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:43.212035 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-caf9cb99-8ab7-41f8-bf11-5069f8b1f78e admin admin] The token cache is being invalidate because project 9223964196f74e84ac68fe735cda9571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:44:43.212359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-caf9cb99-8ab7-41f8-bf11-5069f8b1f78e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:43.220981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-caf9cb99-8ab7-41f8-bf11-5069f8b1f78e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:43.230674 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3789/7494] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:44:42 2022] DELETE /identity/v3/projects/9223964196f74e84ac68fe735cda9571 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:43.230674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9cb99-8ab7-41f8-bf11-5069f8b1f78e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:43.234089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e4376-9909-4eff-9a41-c5c06c8f3224 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:43.239190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-caf9cb99-8ab7-41f8-bf11-5069f8b1f78e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:43.367063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af037e02-1321-4186-a70b-2ce3abc6d4f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:43.367686 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af037e02-1321-4186-a70b-2ce3abc6d4f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:43.368082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af037e02-1321-4186-a70b-2ce3abc6d4f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:43.368418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af037e02-1321-4186-a70b-2ce3abc6d4f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:43.372457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-af037e02-1321-4186-a70b-2ce3abc6d4f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:43.400288 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af037e02-1321-4186-a70b-2ce3abc6d4f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:43.403197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af037e02-1321-4186-a70b-2ce3abc6d4f9 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:43.406937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9cb99-8ab7-41f8-bf11-5069f8b1f78e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:43.430025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f605bf-83ef-45f4-a569-a4cbe5070306 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:43.433247 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3706/7495] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:44:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:44:43.433794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f605bf-83ef-45f4-a569-a4cbe5070306 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:43.434333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f605bf-83ef-45f4-a569-a4cbe5070306 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:43.435456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f605bf-83ef-45f4-a569-a4cbe5070306 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/domains/f120bda07459427dbde37c70bcafaf46` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:43.435823 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af037e02-1321-4186-a70b-2ce3abc6d4f9 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:43.437559 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f605bf-83ef-45f4-a569-a4cbe5070306 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f120bda07459427dbde37c70bcafaf46)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:43.441589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-af037e02-1321-4186-a70b-2ce3abc6d4f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:43.442903 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f605bf-83ef-45f4-a569-a4cbe5070306 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:43.477474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-17f605bf-83ef-45f4-a569-a4cbe5070306 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f120bda07459427dbde37c70bcafaf46'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:43.479281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-17f605bf-83ef-45f4-a569-a4cbe5070306 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f120bda07459427dbde37c70bcafaf46'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:43.559367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-17f605bf-83ef-45f4-a569-a4cbe5070306 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f120bda07459427dbde37c70bcafaf46'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:43.562125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-17f605bf-83ef-45f4-a569-a4cbe5070306 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f120bda07459427dbde37c70bcafaf46'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:43.572021 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3790/7496] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:44:43 2022] PATCH /identity/v3/domains/f120bda07459427dbde37c70bcafaf46 => generated 278 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:44:43.576317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f605bf-83ef-45f4-a569-a4cbe5070306 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:43.579020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-17f605bf-83ef-45f4-a569-a4cbe5070306 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:43.604803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af037e02-1321-4186-a70b-2ce3abc6d4f9 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:43.742478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffde0a1-9858-48c8-9422-5e3a0dadf9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:43.743193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffde0a1-9858-48c8-9422-5e3a0dadf9be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:43.743550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffde0a1-9858-48c8-9422-5e3a0dadf9be admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:43.744707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffde0a1-9858-48c8-9422-5e3a0dadf9be admin admin] PATH_INFO: `/v3/users/c7fa383ba5764169a54b6ce1a164cec8` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:43.746917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffde0a1-9858-48c8-9422-5e3a0dadf9be admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7fa383ba5764169a54b6ce1a164cec8)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:43.750552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffde0a1-9858-48c8-9422-5e3a0dadf9be admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:43.756894 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:43.832163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f605bf-83ef-45f4-a569-a4cbe5070306 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:43.852125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4acb2d-1b2b-44c6-bbcf-82d41be18f51 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:43.852847 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4acb2d-1b2b-44c6-bbcf-82d41be18f51 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:43.853132 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4acb2d-1b2b-44c6-bbcf-82d41be18f51 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:43.853411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4acb2d-1b2b-44c6-bbcf-82d41be18f51 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/domains/f120bda07459427dbde37c70bcafaf46` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:43.870255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2ffde0a1-9858-48c8-9422-5e3a0dadf9be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7fa383ba5764169a54b6ce1a164cec8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:43.872924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4acb2d-1b2b-44c6-bbcf-82d41be18f51 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f120bda07459427dbde37c70bcafaf46)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:43.875429 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4acb2d-1b2b-44c6-bbcf-82d41be18f51 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:43.879221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2ffde0a1-9858-48c8-9422-5e3a0dadf9be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7fa383ba5764169a54b6ce1a164cec8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:43.893985 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2ffde0a1-9858-48c8-9422-5e3a0dadf9be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7fa383ba5764169a54b6ce1a164cec8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:43.897047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2ffde0a1-9858-48c8-9422-5e3a0dadf9be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7fa383ba5764169a54b6ce1a164cec8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:43.915427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2ffde0a1-9858-48c8-9422-5e3a0dadf9be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7fa383ba5764169a54b6ce1a164cec8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:43.926051 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3707/7497] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:44:43 2022] DELETE /identity/v3/users/c7fa383ba5764169a54b6ce1a164cec8 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:43.938857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-af4acb2d-1b2b-44c6-bbcf-82d41be18f51 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f120bda07459427dbde37c70bcafaf46'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:43.998064 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:44.220151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-af4acb2d-1b2b-44c6-bbcf-82d41be18f51 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b855e102eac4d629ce38c56282b3d78'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:44.239231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-af4acb2d-1b2b-44c6-bbcf-82d41be18f51 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b855e102eac4d629ce38c56282b3d78'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:44.274762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-af4acb2d-1b2b-44c6-bbcf-82d41be18f51 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b855e102eac4d629ce38c56282b3d78'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:44.275543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-af4acb2d-1b2b-44c6-bbcf-82d41be18f51 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b855e102eac4d629ce38c56282b3d78'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:44.288369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-af4acb2d-1b2b-44c6-bbcf-82d41be18f51 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b855e102eac4d629ce38c56282b3d78'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:44.296053 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-af4acb2d-1b2b-44c6-bbcf-82d41be18f51 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f120bda07459427dbde37c70bcafaf46'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:44.410040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-af4acb2d-1b2b-44c6-bbcf-82d41be18f51 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f120bda07459427dbde37c70bcafaf46', 'request_id': 'req-af4acb2d-1b2b-44c6-bbcf-82d41be18f51'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:44.436607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-af4acb2d-1b2b-44c6-bbcf-82d41be18f51 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f120bda07459427dbde37c70bcafaf46', 'request_id': 'req-af4acb2d-1b2b-44c6-bbcf-82d41be18f51'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:44.458777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-af4acb2d-1b2b-44c6-bbcf-82d41be18f51 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f120bda07459427dbde37c70bcafaf46', 'request_id': 'req-af4acb2d-1b2b-44c6-bbcf-82d41be18f51'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:44.482855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-af4acb2d-1b2b-44c6-bbcf-82d41be18f51 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] The token cache is being invalidate because project f120bda07459427dbde37c70bcafaf46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:44:44.483349 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-af4acb2d-1b2b-44c6-bbcf-82d41be18f51 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:44.486274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-af4acb2d-1b2b-44c6-bbcf-82d41be18f51 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:44.505526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-af4acb2d-1b2b-44c6-bbcf-82d41be18f51 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f120bda07459427dbde37c70bcafaf46', 'request_id': 'req-af4acb2d-1b2b-44c6-bbcf-82d41be18f51'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:44.510037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-af4acb2d-1b2b-44c6-bbcf-82d41be18f51 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f120bda07459427dbde37c70bcafaf46', 'request_id': 'req-af4acb2d-1b2b-44c6-bbcf-82d41be18f51'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:44.510804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-af4acb2d-1b2b-44c6-bbcf-82d41be18f51 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f120bda07459427dbde37c70bcafaf46', 'request_id': 'req-af4acb2d-1b2b-44c6-bbcf-82d41be18f51'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:44.521217 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3791/7498] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:44:43 2022] DELETE /identity/v3/domains/f120bda07459427dbde37c70bcafaf46 => generated 0 bytes in 943 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:44:44.522271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffde0a1-9858-48c8-9422-5e3a0dadf9be admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:44.523934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2ffde0a1-9858-48c8-9422-5e3a0dadf9be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:44.732954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffde0a1-9858-48c8-9422-5e3a0dadf9be admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:44.979697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d0451-d96b-4d32-a8ac-60de359e0dbb tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:44.980399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d0451-d96b-4d32-a8ac-60de359e0dbb tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:44.980686 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d0451-d96b-4d32-a8ac-60de359e0dbb tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:44.980972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d0451-d96b-4d32-a8ac-60de359e0dbb tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/domains/f120bda07459427dbde37c70bcafaf46` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:44.999993 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d0451-d96b-4d32-a8ac-60de359e0dbb tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=f120bda07459427dbde37c70bcafaf46)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:45.001910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d0451-d96b-4d32-a8ac-60de359e0dbb tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:45.059565 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-d91d0451-d96b-4d32-a8ac-60de359e0dbb tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Could not find domain: f120bda07459427dbde37c70bcafaf46.: keystone.exception.DomainNotFound: Could not find domain: f120bda07459427dbde37c70bcafaf46. Aug 07 01:44:45.059565 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:44:45.059565 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 07 01:44:45.059565 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 07 01:44:45.059565 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 01:44:45.059565 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 01:44:45.059565 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 01:44:45.059565 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 01:44:45.059565 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f120bda07459427dbde37c70bcafaf46. Aug 07 01:44:45.059565 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:44:45.059565 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:44:45.059565 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:44:45.059565 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:44:45.059565 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:44:45.059565 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:44:45.059565 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:44:45.061206 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:44:45.061206 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:44:45.061206 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:44:45.061206 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:44:45.061206 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:44:45.061206 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:44:45.061206 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:44:45.061206 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 07 01:44:45.061206 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 07 01:44:45.061206 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 07 01:44:45.061206 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 07 01:44:45.061206 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:44:45.061206 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:44:45.061206 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:44:45.061206 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:44:45.061206 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:44:45.061206 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:44:45.062343 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:44:45.062343 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 01:44:45.062343 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:44:45.062343 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:44:45.062343 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:44:45.062343 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:44:45.062343 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:44:45.062343 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:44:45.062343 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:44:45.062343 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:44:45.062343 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 07 01:44:45.062343 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:44:45.062343 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f120bda07459427dbde37c70bcafaf46. Aug 07 01:44:45.062343 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:44:45.062343 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3708/7499] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Aug 7 01:44:44 2022] GET /identity/v3/domains/f120bda07459427dbde37c70bcafaf46 => generated 112 bytes in 539 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 07 01:44:45.065920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4acb2d-1b2b-44c6-bbcf-82d41be18f51 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:45.068136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-af4acb2d-1b2b-44c6-bbcf-82d41be18f51 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:45.127333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4acb2d-1b2b-44c6-bbcf-82d41be18f51 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:45.170145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd01826-e956-4b49-b18a-2b4a625fd71d tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:45.171010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd01826-e956-4b49-b18a-2b4a625fd71d tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:45.171166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd01826-e956-4b49-b18a-2b4a625fd71d tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:45.171405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd01826-e956-4b49-b18a-2b4a625fd71d tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/users/2b855e102eac4d629ce38c56282b3d78` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:45.200379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd01826-e956-4b49-b18a-2b4a625fd71d tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorizing `identity:get_user(user_id=2b855e102eac4d629ce38c56282b3d78)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:45.202461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd01826-e956-4b49-b18a-2b4a625fd71d tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:45.206476 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=24,keystone:SELECT=74,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:45.253570 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-acd01826-e956-4b49-b18a-2b4a625fd71d tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Could not find user: 2b855e102eac4d629ce38c56282b3d78.: keystone.exception.UserNotFound: Could not find user: 2b855e102eac4d629ce38c56282b3d78. Aug 07 01:44:45.253570 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:44:45.253570 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:44:45.253570 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:44:45.253570 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:44:45.253570 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:44:45.253570 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:44:45.253570 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:44:45.253570 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:44:45.253570 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:44:45.253570 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:44:45.253570 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:44:45.253570 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 07 01:44:45.253570 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 07 01:44:45.253570 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 07 01:44:45.254619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 07 01:44:45.254619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:44:45.254619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:44:45.254619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 01:44:45.254619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 01:44:45.254619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 01:44:45.254619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 01:44:45.254619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:44:45.254619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:44:45.254619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:44:45.254619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:44:45.254619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:44:45.254619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 01:44:45.254619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:44:45.254619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:44:45.254619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:44:45.254619 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:44:45.256011 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:44:45.256011 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:44:45.256011 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:44:45.256011 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:44:45.256011 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 01:44:45.256011 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 01:44:45.256011 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 01:44:45.256011 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 01:44:45.256011 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 01:44:45.256011 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 01:44:45.256011 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 2b855e102eac4d629ce38c56282b3d78. Aug 07 01:44:45.256011 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:44:45.259668 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3792/7500] 10.222.0.39 () {58 vars in 1221 bytes} [Sun Aug 7 01:44:45 2022] GET /identity/v3/users/2b855e102eac4d629ce38c56282b3d78 => generated 110 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:44:45.261326 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d0451-d96b-4d32-a8ac-60de359e0dbb tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:45.284369 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d0451-d96b-4d32-a8ac-60de359e0dbb tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:45.303068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcba709-31f2-45f9-92ab-b248f89b4ce0 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:45.303928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcba709-31f2-45f9-92ab-b248f89b4ce0 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:45.304733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcba709-31f2-45f9-92ab-b248f89b4ce0 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:45.305026 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcba709-31f2-45f9-92ab-b248f89b4ce0 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/groups/708e0a225fff4d9984bdaa48b21a4a61` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:45.337198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcba709-31f2-45f9-92ab-b248f89b4ce0 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorizing `identity:get_group(group_id=708e0a225fff4d9984bdaa48b21a4a61)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:45.345266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcba709-31f2-45f9-92ab-b248f89b4ce0 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:45.390322 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-4fcba709-31f2-45f9-92ab-b248f89b4ce0 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Could not find group: 708e0a225fff4d9984bdaa48b21a4a61.: keystone.exception.GroupNotFound: Could not find group: 708e0a225fff4d9984bdaa48b21a4a61. Aug 07 01:44:45.390322 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:44:45.390322 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:44:45.390322 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:44:45.390322 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:44:45.390322 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:44:45.390322 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:44:45.390322 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:44:45.390322 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:44:45.390322 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:44:45.390322 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:44:45.390322 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:44:45.390322 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Aug 07 01:44:45.390322 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_group(group_id) Aug 07 01:44:45.390322 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Aug 07 01:44:45.391468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Aug 07 01:44:45.391468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:44:45.391468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:44:45.391468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 01:44:45.391468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 01:44:45.391468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 01:44:45.391468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 01:44:45.391468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:44:45.391468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:44:45.391468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:44:45.391468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:44:45.391468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:44:45.391468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 01:44:45.391468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:44:45.391468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:44:45.391468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:44:45.391468 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:44:45.392613 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:44:45.392613 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:44:45.392613 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:44:45.392613 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:44:45.392613 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Aug 07 01:44:45.392613 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Aug 07 01:44:45.392613 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Aug 07 01:44:45.392613 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Aug 07 01:44:45.392613 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Aug 07 01:44:45.392613 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Aug 07 01:44:45.392613 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 708e0a225fff4d9984bdaa48b21a4a61. Aug 07 01:44:45.392613 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:44:45.392613 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3709/7501] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:44:45 2022] GET /identity/v3/groups/708e0a225fff4d9984bdaa48b21a4a61 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:44:45.396029 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd01826-e956-4b49-b18a-2b4a625fd71d tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:45.411452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd01826-e956-4b49-b18a-2b4a625fd71d tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:45.431527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8922d4-70f1-49a2-9c7b-bf519d480a16 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:45.432524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8922d4-70f1-49a2-9c7b-bf519d480a16 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:45.436345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8922d4-70f1-49a2-9c7b-bf519d480a16 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:45.439660 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8922d4-70f1-49a2-9c7b-bf519d480a16 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/groups/708e0a225fff4d9984bdaa48b21a4a61` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:45.459606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8922d4-70f1-49a2-9c7b-bf519d480a16 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:44:45.491856 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-ed8922d4-70f1-49a2-9c7b-bf519d480a16 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Could not find group: 708e0a225fff4d9984bdaa48b21a4a61.: keystone.exception.GroupNotFound: Could not find group: 708e0a225fff4d9984bdaa48b21a4a61. Aug 07 01:44:45.491856 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:44:45.491856 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:44:45.491856 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:44:45.491856 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:44:45.491856 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:44:45.491856 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:44:45.491856 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:44:45.491856 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:44:45.491856 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:44:45.491856 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:44:45.491856 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:44:45.491856 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Aug 07 01:44:45.491856 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Aug 07 01:44:45.493066 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:44:45.493066 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:44:45.493066 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:44:45.493066 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:44:45.493066 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:44:45.493066 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:44:45.493066 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 01:44:45.493066 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 01:44:45.493066 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 01:44:45.493066 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 01:44:45.493066 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:44:45.493066 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:44:45.493066 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:44:45.493066 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:44:45.493066 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:44:45.493066 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 01:44:45.493066 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:44:45.494207 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:44:45.494207 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:44:45.494207 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:44:45.494207 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:44:45.494207 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:44:45.494207 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:44:45.494207 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:44:45.494207 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Aug 07 01:44:45.494207 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Aug 07 01:44:45.494207 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Aug 07 01:44:45.494207 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Aug 07 01:44:45.494207 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Aug 07 01:44:45.494207 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Aug 07 01:44:45.494207 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 708e0a225fff4d9984bdaa48b21a4a61. Aug 07 01:44:45.494207 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:44:45.506795 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3793/7502] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Aug 7 01:44:45 2022] DELETE /identity/v3/groups/708e0a225fff4d9984bdaa48b21a4a61 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:44:45.511360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcba709-31f2-45f9-92ab-b248f89b4ce0 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:45.553263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcba709-31f2-45f9-92ab-b248f89b4ce0 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:45.575603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e7526-55b0-46ac-b8d6-72364bbcbc40 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:45.576301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e7526-55b0-46ac-b8d6-72364bbcbc40 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:45.578717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e7526-55b0-46ac-b8d6-72364bbcbc40 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:45.580072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e7526-55b0-46ac-b8d6-72364bbcbc40 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/users/2b855e102eac4d629ce38c56282b3d78` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:45.584399 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:45.605547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e7526-55b0-46ac-b8d6-72364bbcbc40 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2b855e102eac4d629ce38c56282b3d78)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:45.610434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e7526-55b0-46ac-b8d6-72364bbcbc40 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:45.642530 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-559e7526-55b0-46ac-b8d6-72364bbcbc40 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Could not find user: 2b855e102eac4d629ce38c56282b3d78.: keystone.exception.UserNotFound: Could not find user: 2b855e102eac4d629ce38c56282b3d78. Aug 07 01:44:45.642530 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:44:45.642530 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:44:45.642530 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:44:45.642530 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:44:45.642530 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:44:45.642530 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:44:45.642530 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:44:45.642530 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:44:45.642530 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:44:45.642530 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:44:45.642530 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:44:45.642530 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Aug 07 01:44:45.642530 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Aug 07 01:44:45.643634 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:44:45.643634 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:44:45.643634 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 01:44:45.643634 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 01:44:45.643634 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 01:44:45.643634 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 01:44:45.643634 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Aug 07 01:44:45.643634 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Aug 07 01:44:45.643634 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:44:45.643634 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:44:45.643634 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 07 01:44:45.643634 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 01:44:45.643634 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 07 01:44:45.643634 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 07 01:44:45.643634 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:44:45.643634 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:44:45.643634 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:44:45.643634 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:44:45.644843 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:44:45.644843 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application with Lock( Aug 07 01:44:45.644843 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:44:45.644843 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:44:45.644843 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:44:45.644843 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:44:45.644843 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:44:45.644843 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:44:45.644843 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:44:45.644843 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:44:45.644843 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 07 01:44:45.644843 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 07 01:44:45.644843 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 07 01:44:45.644843 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 07 01:44:45.644843 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 07 01:44:45.644843 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 07 01:44:45.644843 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 2b855e102eac4d629ce38c56282b3d78. Aug 07 01:44:45.644843 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:44:45.659196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8922d4-70f1-49a2-9c7b-bf519d480a16 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:45.670185 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3710/7503] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:44:45 2022] DELETE /identity/v3/users/2b855e102eac4d629ce38c56282b3d78 => generated 110 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 07 01:44:45.672624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8922d4-70f1-49a2-9c7b-bf519d480a16 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:45.698420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05220f3-6ec3-423b-ba77-71e1258ced46 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:45.699690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05220f3-6ec3-423b-ba77-71e1258ced46 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:45.700381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05220f3-6ec3-423b-ba77-71e1258ced46 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:45.701836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05220f3-6ec3-423b-ba77-71e1258ced46 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/domains/f120bda07459427dbde37c70bcafaf46` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:45.733936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05220f3-6ec3-423b-ba77-71e1258ced46 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:44:45.758270 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-f05220f3-6ec3-423b-ba77-71e1258ced46 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Could not find domain: f120bda07459427dbde37c70bcafaf46.: keystone.exception.DomainNotFound: Could not find domain: f120bda07459427dbde37c70bcafaf46. Aug 07 01:44:45.758270 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:44:45.758270 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 07 01:44:45.758270 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 07 01:44:45.758270 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 01:44:45.758270 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 01:44:45.758270 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 01:44:45.758270 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 01:44:45.758270 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f120bda07459427dbde37c70bcafaf46. Aug 07 01:44:45.758270 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:44:45.758270 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:44:45.758270 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:44:45.758270 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:44:45.758270 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:44:45.758270 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:44:45.758270 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:44:45.760525 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:44:45.760525 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:44:45.760525 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:44:45.760525 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:44:45.760525 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:44:45.760525 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:44:45.760525 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:44:45.760525 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 07 01:44:45.760525 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 07 01:44:45.760525 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:44:45.760525 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:44:45.760525 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:44:45.760525 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:44:45.760525 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:44:45.760525 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:44:45.760525 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:44:45.762672 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:44:45.762672 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:44:45.762672 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:44:45.762672 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:44:45.762672 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 01:44:45.762672 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:44:45.762672 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:44:45.762672 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:44:45.762672 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:44:45.762672 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:44:45.762672 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:44:45.762672 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:44:45.762672 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:44:45.762672 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 07 01:44:45.762672 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:44:45.762672 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f120bda07459427dbde37c70bcafaf46. Aug 07 01:44:45.762672 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:44:45.769047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e7526-55b0-46ac-b8d6-72364bbcbc40 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:45.770214 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3794/7504] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:44:45 2022] PATCH /identity/v3/domains/f120bda07459427dbde37c70bcafaf46 => generated 112 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 07 01:44:45.793117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e7526-55b0-46ac-b8d6-72364bbcbc40 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:45.819337 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544b90d-b779-498c-ac71-8c0e73541750 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:45.820611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544b90d-b779-498c-ac71-8c0e73541750 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:45.820901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544b90d-b779-498c-ac71-8c0e73541750 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:45.821177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544b90d-b779-498c-ac71-8c0e73541750 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:45.825441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544b90d-b779-498c-ac71-8c0e73541750 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:45.833787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544b90d-b779-498c-ac71-8c0e73541750 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:45.883725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05220f3-6ec3-423b-ba77-71e1258ced46 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:45.892503 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3711/7505] 10.222.0.39 () {58 vars in 1128 bytes} [Sun Aug 7 01:44:45 2022] GET /identity/v3/domains => generated 1347 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:44:45.902950 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05220f3-6ec3-423b-ba77-71e1258ced46 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:45.919150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b317a0-e139-4f8b-aa6d-c406ed162b2d tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:45.919796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b317a0-e139-4f8b-aa6d-c406ed162b2d tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:45.920780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b317a0-e139-4f8b-aa6d-c406ed162b2d tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:45.921071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b317a0-e139-4f8b-aa6d-c406ed162b2d tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:45.929120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b317a0-e139-4f8b-aa6d-c406ed162b2d tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:44:45.933303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b317a0-e139-4f8b-aa6d-c406ed162b2d tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:45.935090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b317a0-e139-4f8b-aa6d-c406ed162b2d tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:45.997169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544b90d-b779-498c-ac71-8c0e73541750 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:46.019626 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3795/7506] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:44:45 2022] GET /identity/v3/domains?enabled=True => generated 1093 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:44:46.030121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544b90d-b779-498c-ac71-8c0e73541750 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:46.043054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d6591-9930-4464-911f-e1a92bf6c379 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:46.046399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d6591-9930-4464-911f-e1a92bf6c379 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:46.046988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d6591-9930-4464-911f-e1a92bf6c379 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:46.047468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d6591-9930-4464-911f-e1a92bf6c379 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:46.048408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d6591-9930-4464-911f-e1a92bf6c379 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-1274770208) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:44:46.050199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d6591-9930-4464-911f-e1a92bf6c379 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:46.053044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d6591-9930-4464-911f-e1a92bf6c379 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:46.114796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b317a0-e139-4f8b-aa6d-c406ed162b2d tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:46.133473 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b317a0-e139-4f8b-aa6d-c406ed162b2d tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:46.133701 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3712/7507] 10.222.0.39 () {58 vars in 1199 bytes} [Sun Aug 7 01:44:45 2022] GET /identity/v3/domains?name=tempest-test_domain-1274770208 => generated 409 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:44:46.150598 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd9635-95ef-42c8-83b6-9f952d8e034e tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:46.151358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd9635-95ef-42c8-83b6-9f952d8e034e tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:46.151722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd9635-95ef-42c8-83b6-9f952d8e034e tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:46.152712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd9635-95ef-42c8-83b6-9f952d8e034e tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/domains/f120bda07459427dbde37c70bcafaf46` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:46.177303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd9635-95ef-42c8-83b6-9f952d8e034e tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 07 01:44:46.196640 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-84dd9635-95ef-42c8-83b6-9f952d8e034e tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Could not find domain: f120bda07459427dbde37c70bcafaf46.: keystone.exception.DomainNotFound: Could not find domain: f120bda07459427dbde37c70bcafaf46. Aug 07 01:44:46.196640 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:44:46.196640 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 07 01:44:46.196640 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 07 01:44:46.196640 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 07 01:44:46.196640 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 07 01:44:46.196640 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 07 01:44:46.196640 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 07 01:44:46.196640 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f120bda07459427dbde37c70bcafaf46. Aug 07 01:44:46.196640 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:44:46.196640 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:44:46.196640 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:44:46.196640 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:44:46.196640 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:44:46.196640 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:44:46.196640 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:44:46.198144 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:44:46.198144 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:44:46.198144 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:44:46.198144 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:44:46.198144 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:44:46.198144 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:44:46.198144 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:44:46.198144 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Aug 07 01:44:46.198144 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Aug 07 01:44:46.198144 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 07 01:44:46.198144 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 07 01:44:46.198144 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 07 01:44:46.198144 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 07 01:44:46.198144 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:44:46.198144 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:44:46.198144 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 07 01:44:46.199377 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 07 01:44:46.199377 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 07 01:44:46.199377 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.get_or_create( Aug 07 01:44:46.199377 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 07 01:44:46.199377 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application with Lock( Aug 07 01:44:46.199377 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 07 01:44:46.199377 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self._enter() Aug 07 01:44:46.199377 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 07 01:44:46.199377 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 07 01:44:46.199377 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 07 01:44:46.199377 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.creator() Aug 07 01:44:46.199377 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 07 01:44:46.199377 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application created_value = creator( Aug 07 01:44:46.199377 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 07 01:44:46.199377 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 07 01:44:46.199377 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f120bda07459427dbde37c70bcafaf46. Aug 07 01:44:46.199377 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:44:46.205872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d6591-9930-4464-911f-e1a92bf6c379 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:46.216051 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3796/7508] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:44:46 2022] PATCH /identity/v3/domains/f120bda07459427dbde37c70bcafaf46 => generated 112 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Aug 07 01:44:46.219316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d6591-9930-4464-911f-e1a92bf6c379 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:46.230576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d930c-6d4b-464c-a115-23ad0b7e7963 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:46.231359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d930c-6d4b-464c-a115-23ad0b7e7963 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:46.231716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d930c-6d4b-464c-a115-23ad0b7e7963 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:46.232105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d930c-6d4b-464c-a115-23ad0b7e7963 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/domains/71618649ab744e7081947fc33aef85ae` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:46.301946 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d930c-6d4b-464c-a115-23ad0b7e7963 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=71618649ab744e7081947fc33aef85ae)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:46.310397 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d930c-6d4b-464c-a115-23ad0b7e7963 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:46.504536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd9635-95ef-42c8-83b6-9f952d8e034e tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:46.510936 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3713/7509] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:44:46 2022] PATCH /identity/v3/domains/71618649ab744e7081947fc33aef85ae => generated 278 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:44:46.519583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd9635-95ef-42c8-83b6-9f952d8e034e tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:46.550711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e06c66-7fa9-4861-bdad-b190ceb803cf tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:46.551745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e06c66-7fa9-4861-bdad-b190ceb803cf tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:46.552239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e06c66-7fa9-4861-bdad-b190ceb803cf tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:46.552680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e06c66-7fa9-4861-bdad-b190ceb803cf tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/domains/71618649ab744e7081947fc33aef85ae` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:46.600779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e06c66-7fa9-4861-bdad-b190ceb803cf tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=71618649ab744e7081947fc33aef85ae)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:46.603028 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e06c66-7fa9-4861-bdad-b190ceb803cf tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:46.686144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73e06c66-7fa9-4861-bdad-b190ceb803cf tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '71618649ab744e7081947fc33aef85ae'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:46.730583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73e06c66-7fa9-4861-bdad-b190ceb803cf tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '71618649ab744e7081947fc33aef85ae'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:46.862743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73e06c66-7fa9-4861-bdad-b190ceb803cf tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71618649ab744e7081947fc33aef85ae', 'request_id': 'req-73e06c66-7fa9-4861-bdad-b190ceb803cf'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:46.884440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73e06c66-7fa9-4861-bdad-b190ceb803cf tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71618649ab744e7081947fc33aef85ae', 'request_id': 'req-73e06c66-7fa9-4861-bdad-b190ceb803cf'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:46.901422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73e06c66-7fa9-4861-bdad-b190ceb803cf tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71618649ab744e7081947fc33aef85ae', 'request_id': 'req-73e06c66-7fa9-4861-bdad-b190ceb803cf'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:46.920102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73e06c66-7fa9-4861-bdad-b190ceb803cf tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] The token cache is being invalidate because project 71618649ab744e7081947fc33aef85ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:44:46.920489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73e06c66-7fa9-4861-bdad-b190ceb803cf tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:46.932504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73e06c66-7fa9-4861-bdad-b190ceb803cf tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:46.943425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73e06c66-7fa9-4861-bdad-b190ceb803cf tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '71618649ab744e7081947fc33aef85ae', 'request_id': 'req-73e06c66-7fa9-4861-bdad-b190ceb803cf'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:46.962041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73e06c66-7fa9-4861-bdad-b190ceb803cf tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '71618649ab744e7081947fc33aef85ae', 'request_id': 'req-73e06c66-7fa9-4861-bdad-b190ceb803cf'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:46.962838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-73e06c66-7fa9-4861-bdad-b190ceb803cf tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '71618649ab744e7081947fc33aef85ae', 'request_id': 'req-73e06c66-7fa9-4861-bdad-b190ceb803cf'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:46.978506 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3797/7510] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:44:46 2022] DELETE /identity/v3/domains/71618649ab744e7081947fc33aef85ae => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:44:46.985030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d930c-6d4b-464c-a115-23ad0b7e7963 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:46.989897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-867d930c-6d4b-464c-a115-23ad0b7e7963 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:47.015123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d930c-6d4b-464c-a115-23ad0b7e7963 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:47.091717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af761fca-d699-483a-abec-1d6fae377215 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:47.092791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af761fca-d699-483a-abec-1d6fae377215 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:47.093369 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af761fca-d699-483a-abec-1d6fae377215 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:47.093903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af761fca-d699-483a-abec-1d6fae377215 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/domains/5a2c44ac06de4cc4a6020fb75acaa605` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:47.113657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af761fca-d699-483a-abec-1d6fae377215 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5a2c44ac06de4cc4a6020fb75acaa605)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:47.115275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af761fca-d699-483a-abec-1d6fae377215 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:47.142340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-af761fca-d699-483a-abec-1d6fae377215 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5a2c44ac06de4cc4a6020fb75acaa605'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:47.143417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-af761fca-d699-483a-abec-1d6fae377215 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5a2c44ac06de4cc4a6020fb75acaa605'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:47.180294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-af761fca-d699-483a-abec-1d6fae377215 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5a2c44ac06de4cc4a6020fb75acaa605'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:47.181561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-af761fca-d699-483a-abec-1d6fae377215 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5a2c44ac06de4cc4a6020fb75acaa605'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:47.184525 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3714/7511] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:44:46 2022] PATCH /identity/v3/domains/5a2c44ac06de4cc4a6020fb75acaa605 => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:44:47.188643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e06c66-7fa9-4861-bdad-b190ceb803cf tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:47.218486 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e06c66-7fa9-4861-bdad-b190ceb803cf tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:47.287642 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:47.325710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086aa45-8405-42a8-962e-8a1a93dbf4c8 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:47.326587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086aa45-8405-42a8-962e-8a1a93dbf4c8 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:47.327021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086aa45-8405-42a8-962e-8a1a93dbf4c8 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:47.327400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086aa45-8405-42a8-962e-8a1a93dbf4c8 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/domains/5a2c44ac06de4cc4a6020fb75acaa605` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:47.343037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086aa45-8405-42a8-962e-8a1a93dbf4c8 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5a2c44ac06de4cc4a6020fb75acaa605)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:47.345685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086aa45-8405-42a8-962e-8a1a93dbf4c8 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:47.411874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5086aa45-8405-42a8-962e-8a1a93dbf4c8 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5a2c44ac06de4cc4a6020fb75acaa605'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:47.442628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5086aa45-8405-42a8-962e-8a1a93dbf4c8 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5a2c44ac06de4cc4a6020fb75acaa605'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:47.547150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5086aa45-8405-42a8-962e-8a1a93dbf4c8 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a2c44ac06de4cc4a6020fb75acaa605', 'request_id': 'req-5086aa45-8405-42a8-962e-8a1a93dbf4c8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:47.563225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5086aa45-8405-42a8-962e-8a1a93dbf4c8 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a2c44ac06de4cc4a6020fb75acaa605', 'request_id': 'req-5086aa45-8405-42a8-962e-8a1a93dbf4c8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:47.571819 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5086aa45-8405-42a8-962e-8a1a93dbf4c8 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a2c44ac06de4cc4a6020fb75acaa605', 'request_id': 'req-5086aa45-8405-42a8-962e-8a1a93dbf4c8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:47.593253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5086aa45-8405-42a8-962e-8a1a93dbf4c8 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] The token cache is being invalidate because project 5a2c44ac06de4cc4a6020fb75acaa605 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:44:47.593963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5086aa45-8405-42a8-962e-8a1a93dbf4c8 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:47.595471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5086aa45-8405-42a8-962e-8a1a93dbf4c8 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:47.613071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5086aa45-8405-42a8-962e-8a1a93dbf4c8 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5a2c44ac06de4cc4a6020fb75acaa605', 'request_id': 'req-5086aa45-8405-42a8-962e-8a1a93dbf4c8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:47.617495 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5086aa45-8405-42a8-962e-8a1a93dbf4c8 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5a2c44ac06de4cc4a6020fb75acaa605', 'request_id': 'req-5086aa45-8405-42a8-962e-8a1a93dbf4c8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:47.618511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5086aa45-8405-42a8-962e-8a1a93dbf4c8 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5a2c44ac06de4cc4a6020fb75acaa605', 'request_id': 'req-5086aa45-8405-42a8-962e-8a1a93dbf4c8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:47.638252 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3798/7512] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:44:47 2022] DELETE /identity/v3/domains/5a2c44ac06de4cc4a6020fb75acaa605 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:47.642977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af761fca-d699-483a-abec-1d6fae377215 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:47.645851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-af761fca-d699-483a-abec-1d6fae377215 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:47.691824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af761fca-d699-483a-abec-1d6fae377215 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:47.870614 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:47.933282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86117aa-c13a-4a84-8e18-1e79ab3aff97 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:47.934063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86117aa-c13a-4a84-8e18-1e79ab3aff97 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:47.934347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86117aa-c13a-4a84-8e18-1e79ab3aff97 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:47.934617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86117aa-c13a-4a84-8e18-1e79ab3aff97 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/domains/e36512804a90440596645ed927aefde0` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:47.992934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86117aa-c13a-4a84-8e18-1e79ab3aff97 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e36512804a90440596645ed927aefde0)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:47.995293 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86117aa-c13a-4a84-8e18-1e79ab3aff97 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:48.055272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b86117aa-c13a-4a84-8e18-1e79ab3aff97 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e36512804a90440596645ed927aefde0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:48.056542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b86117aa-c13a-4a84-8e18-1e79ab3aff97 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e36512804a90440596645ed927aefde0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:48.086980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086aa45-8405-42a8-962e-8a1a93dbf4c8 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:48.088866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5086aa45-8405-42a8-962e-8a1a93dbf4c8 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:48.097976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b86117aa-c13a-4a84-8e18-1e79ab3aff97 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e36512804a90440596645ed927aefde0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:48.099751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b86117aa-c13a-4a84-8e18-1e79ab3aff97 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e36512804a90440596645ed927aefde0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:48.110340 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3715/7513] 10.222.0.39 () {60 vars in 1249 bytes} [Sun Aug 7 01:44:47 2022] PATCH /identity/v3/domains/e36512804a90440596645ed927aefde0 => generated 278 bytes in 469 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:44:48.111314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86117aa-c13a-4a84-8e18-1e79ab3aff97 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:48.116093 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b86117aa-c13a-4a84-8e18-1e79ab3aff97 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:48.235006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86117aa-c13a-4a84-8e18-1e79ab3aff97 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:48.241524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75dc1ad-3df2-4f76-a565-8e9e99551faa tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1490b225fc4f93b6eae46e3b9c2e09', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4b6c5c18234e62ada399ef42e8a870', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:48.242244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75dc1ad-3df2-4f76-a565-8e9e99551faa tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:48.242527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75dc1ad-3df2-4f76-a565-8e9e99551faa tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:48.242807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75dc1ad-3df2-4f76-a565-8e9e99551faa tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] PATH_INFO: `/v3/domains/e36512804a90440596645ed927aefde0` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:48.265572 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086aa45-8405-42a8-962e-8a1a93dbf4c8 tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:48.299512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75dc1ad-3df2-4f76-a565-8e9e99551faa tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e36512804a90440596645ed927aefde0)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:48.307219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75dc1ad-3df2-4f76-a565-8e9e99551faa tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:48.311220 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:48.392067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43007bcb-03b5-4ce1-bed7-f066a9e6865e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:48.392728 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43007bcb-03b5-4ce1-bed7-f066a9e6865e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:48.393164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43007bcb-03b5-4ce1-bed7-f066a9e6865e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:48.393509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43007bcb-03b5-4ce1-bed7-f066a9e6865e admin admin] PATH_INFO: `/v3/projects/7b83ea1ccf7648748ae643abe7f29e88` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:48.408002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43007bcb-03b5-4ce1-bed7-f066a9e6865e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b83ea1ccf7648748ae643abe7f29e88)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:48.408002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43007bcb-03b5-4ce1-bed7-f066a9e6865e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:48.421034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b75dc1ad-3df2-4f76-a565-8e9e99551faa tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e36512804a90440596645ed927aefde0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:48.442446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b75dc1ad-3df2-4f76-a565-8e9e99551faa tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e36512804a90440596645ed927aefde0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:48.505285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b75dc1ad-3df2-4f76-a565-8e9e99551faa tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e36512804a90440596645ed927aefde0', 'request_id': 'req-b75dc1ad-3df2-4f76-a565-8e9e99551faa'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:48.513954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b75dc1ad-3df2-4f76-a565-8e9e99551faa tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e36512804a90440596645ed927aefde0', 'request_id': 'req-b75dc1ad-3df2-4f76-a565-8e9e99551faa'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:48.515775 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=93,keystone:UPDATE=1,keystone:DELETE=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:48.524637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b75dc1ad-3df2-4f76-a565-8e9e99551faa tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e36512804a90440596645ed927aefde0', 'request_id': 'req-b75dc1ad-3df2-4f76-a565-8e9e99551faa'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:48.526817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-43007bcb-03b5-4ce1-bed7-f066a9e6865e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b83ea1ccf7648748ae643abe7f29e88', 'request_id': 'req-43007bcb-03b5-4ce1-bed7-f066a9e6865e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:48.534369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-43007bcb-03b5-4ce1-bed7-f066a9e6865e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b83ea1ccf7648748ae643abe7f29e88', 'request_id': 'req-43007bcb-03b5-4ce1-bed7-f066a9e6865e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:48.545927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-43007bcb-03b5-4ce1-bed7-f066a9e6865e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b83ea1ccf7648748ae643abe7f29e88', 'request_id': 'req-43007bcb-03b5-4ce1-bed7-f066a9e6865e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:48.549981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b75dc1ad-3df2-4f76-a565-8e9e99551faa tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] The token cache is being invalidate because project e36512804a90440596645ed927aefde0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:44:48.550279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b75dc1ad-3df2-4f76-a565-8e9e99551faa tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:48.552311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b75dc1ad-3df2-4f76-a565-8e9e99551faa tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:48.573174 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b75dc1ad-3df2-4f76-a565-8e9e99551faa tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e36512804a90440596645ed927aefde0', 'request_id': 'req-b75dc1ad-3df2-4f76-a565-8e9e99551faa'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:48.574853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-43007bcb-03b5-4ce1-bed7-f066a9e6865e admin admin] The token cache is being invalidate because project 7b83ea1ccf7648748ae643abe7f29e88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:44:48.576099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b75dc1ad-3df2-4f76-a565-8e9e99551faa tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e36512804a90440596645ed927aefde0', 'request_id': 'req-b75dc1ad-3df2-4f76-a565-8e9e99551faa'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:48.578650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-43007bcb-03b5-4ce1-bed7-f066a9e6865e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:48.579553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-43007bcb-03b5-4ce1-bed7-f066a9e6865e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:48.593731 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3799/7514] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:44:48 2022] DELETE /identity/v3/projects/7b83ea1ccf7648748ae643abe7f29e88 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:44:48.597044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b75dc1ad-3df2-4f76-a565-8e9e99551faa tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e36512804a90440596645ed927aefde0', 'request_id': 'req-b75dc1ad-3df2-4f76-a565-8e9e99551faa'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:48.599640 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71117f6-9866-4d9e-91c5-2c72e9c590de None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:48.600131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71117f6-9866-4d9e-91c5-2c72e9c590de None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:48.600563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71117f6-9866-4d9e-91c5-2c72e9c590de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:48.613037 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3716/7515] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:44:48 2022] DELETE /identity/v3/domains/e36512804a90440596645ed927aefde0 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:48.623772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75dc1ad-3df2-4f76-a565-8e9e99551faa tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:48.626197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b75dc1ad-3df2-4f76-a565-8e9e99551faa tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:48.703148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e71117f6-9866-4d9e-91c5-2c72e9c590de None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:48.708058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e71117f6-9866-4d9e-91c5-2c72e9c590de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:48.864303 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75dc1ad-3df2-4f76-a565-8e9e99551faa tempest-DomainsTestJSON-1035395534 tempest-DomainsTestJSON-1035395534-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:48.911404 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3800/7516] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:48.911404 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7212b7b-6371-4df7-b8e4-1a87a3d66a10 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:48.911404 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7212b7b-6371-4df7-b8e4-1a87a3d66a10 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:48.911404 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7212b7b-6371-4df7-b8e4-1a87a3d66a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:48.978396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e7212b7b-6371-4df7-b8e4-1a87a3d66a10 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:48.980685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e7212b7b-6371-4df7-b8e4-1a87a3d66a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:48.995540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f1f7e-77f2-441f-9ad4-d1ce083e8fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:48.996490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f1f7e-77f2-441f-9ad4-d1ce083e8fcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:48.996823 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f1f7e-77f2-441f-9ad4-d1ce083e8fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:48.997368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f1f7e-77f2-441f-9ad4-d1ce083e8fcf admin admin] PATH_INFO: `/v3/users/0e399e4d5e4d4d589ac5b4768543cd59` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:48.998625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f1f7e-77f2-441f-9ad4-d1ce083e8fcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e399e4d5e4d4d589ac5b4768543cd59)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:49.002913 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f1f7e-77f2-441f-9ad4-d1ce083e8fcf admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:49.025289 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3801/7517] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:49.026581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7212b7b-6371-4df7-b8e4-1a87a3d66a10 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:49.039965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7212b7b-6371-4df7-b8e4-1a87a3d66a10 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:49.057251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b2a3f-44bb-428c-877a-ac6ed8a4094e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:49.058061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b2a3f-44bb-428c-877a-ac6ed8a4094e admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:49.058428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b2a3f-44bb-428c-877a-ac6ed8a4094e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:49.058800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b2a3f-44bb-428c-877a-ac6ed8a4094e admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:49.059565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b2a3f-44bb-428c-877a-ac6ed8a4094e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:44:49.060019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b2a3f-44bb-428c-877a-ac6ed8a4094e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:49.061736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b2a3f-44bb-428c-877a-ac6ed8a4094e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:49.081896 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-881f1f7e-77f2-441f-9ad4-d1ce083e8fcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e399e4d5e4d4d589ac5b4768543cd59'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:49.091562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-881f1f7e-77f2-441f-9ad4-d1ce083e8fcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e399e4d5e4d4d589ac5b4768543cd59'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:49.097622 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3802/7518] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:44:49.098838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b2a3f-44bb-428c-877a-ac6ed8a4094e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:49.106288 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-881f1f7e-77f2-441f-9ad4-d1ce083e8fcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e399e4d5e4d4d589ac5b4768543cd59'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:49.107040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-881f1f7e-77f2-441f-9ad4-d1ce083e8fcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e399e4d5e4d4d589ac5b4768543cd59'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:49.112478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b2a3f-44bb-428c-877a-ac6ed8a4094e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:49.114546 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=83,keystone:INSERT=2,keystone:DELETE=15 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:49.124839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-881f1f7e-77f2-441f-9ad4-d1ce083e8fcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e399e4d5e4d4d589ac5b4768543cd59'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:49.125581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c54026-7236-4b8a-b286-69d56a131f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:49.126446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c54026-7236-4b8a-b286-69d56a131f7a admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:49.126850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c54026-7236-4b8a-b286-69d56a131f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:49.127219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c54026-7236-4b8a-b286-69d56a131f7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:49.128564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c54026-7236-4b8a-b286-69d56a131f7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:49.141209 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3717/7519] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:44:48 2022] DELETE /identity/v3/users/0e399e4d5e4d4d589ac5b4768543cd59 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:49.141438 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c54026-7236-4b8a-b286-69d56a131f7a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:49.145285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2b2ed-3ba6-48ef-a058-c2d6f65135ab None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:49.145893 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2b2ed-3ba6-48ef-a058-c2d6f65135ab None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:49.146471 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2b2ed-3ba6-48ef-a058-c2d6f65135ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:49.208778 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3803/7520] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:44:49 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:49.209934 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c54026-7236-4b8a-b286-69d56a131f7a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:49.212444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a6c54026-7236-4b8a-b286-69d56a131f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:49.238730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d5b2b2ed-3ba6-48ef-a058-c2d6f65135ab None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:49.242310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d5b2b2ed-3ba6-48ef-a058-c2d6f65135ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:49.267539 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:49.388280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c54026-7236-4b8a-b286-69d56a131f7a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:49.393361 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3718/7521] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:49.404031 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235ebeb-f3a7-4d40-a7ab-44453714b63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:49.404676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235ebeb-f3a7-4d40-a7ab-44453714b63f admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:49.405091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235ebeb-f3a7-4d40-a7ab-44453714b63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:49.405217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235ebeb-f3a7-4d40-a7ab-44453714b63f admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:49.406108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235ebeb-f3a7-4d40-a7ab-44453714b63f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:49.409097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235ebeb-f3a7-4d40-a7ab-44453714b63f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:49.452148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2b2ed-3ba6-48ef-a058-c2d6f65135ab None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:49.454030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d5b2b2ed-3ba6-48ef-a058-c2d6f65135ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:49.488173 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3804/7522] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:44:49 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:49.489354 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235ebeb-f3a7-4d40-a7ab-44453714b63f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:49.507913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235ebeb-f3a7-4d40-a7ab-44453714b63f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:49.524059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188963c3-63ab-4874-b1a0-e3a824649ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:49.524963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188963c3-63ab-4874-b1a0-e3a824649ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:49.525348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188963c3-63ab-4874-b1a0-e3a824649ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:49.525726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188963c3-63ab-4874-b1a0-e3a824649ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:49.526529 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188963c3-63ab-4874-b1a0-e3a824649ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:49.528620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188963c3-63ab-4874-b1a0-e3a824649ba3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:49.544689 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3805/7523] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:44:49.548898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188963c3-63ab-4874-b1a0-e3a824649ba3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:49.562273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188963c3-63ab-4874-b1a0-e3a824649ba3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:49.568228 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a463c1-c1da-44c4-ae56-b375e263c80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:49.569173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a463c1-c1da-44c4-ae56-b375e263c80b admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:49.569564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a463c1-c1da-44c4-ae56-b375e263c80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:49.570663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a463c1-c1da-44c4-ae56-b375e263c80b admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:49.571430 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a463c1-c1da-44c4-ae56-b375e263c80b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:49.573847 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a463c1-c1da-44c4-ae56-b375e263c80b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:49.586844 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3806/7524] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:44:49.591157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a463c1-c1da-44c4-ae56-b375e263c80b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:49.594244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2b2ed-3ba6-48ef-a058-c2d6f65135ab None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:49.599985 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0d257-a269-42e4-9a39-2746d277190b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:49.601422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0d257-a269-42e4-9a39-2746d277190b service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:49.601779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0d257-a269-42e4-9a39-2746d277190b service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:49.602172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0d257-a269-42e4-9a39-2746d277190b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:49.606978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a463c1-c1da-44c4-ae56-b375e263c80b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:49.619976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0d257-a269-42e4-9a39-2746d277190b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:49.621479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4c55e-bd57-4c1b-97c7-b05f85e1a797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:49.621656 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0d257-a269-42e4-9a39-2746d277190b service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:49.621762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4c55e-bd57-4c1b-97c7-b05f85e1a797 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:49.622233 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4c55e-bd57-4c1b-97c7-b05f85e1a797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:49.622586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4c55e-bd57-4c1b-97c7-b05f85e1a797 admin admin] PATH_INFO: `/v3/projects/99fd8b243bbf4209ad01b13ce648307c/users/34a8a582d50c433e91d78abb3ada45a9/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:49.644525 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3719/7525] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:44:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:44:49.647561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4c55e-bd57-4c1b-97c7-b05f85e1a797 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99fd8b243bbf4209ad01b13ce648307c, user_id=34a8a582d50c433e91d78abb3ada45a9, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:49.652137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4c55e-bd57-4c1b-97c7-b05f85e1a797 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:49.673486 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3807/7526] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:44:49 2022] PUT /identity/v3/projects/99fd8b243bbf4209ad01b13ce648307c/users/34a8a582d50c433e91d78abb3ada45a9/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:49.774219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a6128-2023-4c2c-9fa9-53af901f5fa1 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:49.774483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a6128-2023-4c2c-9fa9-53af901f5fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:49.774765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a6128-2023-4c2c-9fa9-53af901f5fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:49.841012 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-934a6128-2023-4c2c-9fa9-53af901f5fa1 None None] MFA Rules not processed for user `34a8a582d50c433e91d78abb3ada45a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:49.842265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-934a6128-2023-4c2c-9fa9-53af901f5fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:50.032672 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3720/7527] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:50.039085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4c55e-bd57-4c1b-97c7-b05f85e1a797 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:50.215267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4c55e-bd57-4c1b-97c7-b05f85e1a797 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:50.225808 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993983dd-9d18-4f75-8db8-f9859b56be11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:50.226835 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993983dd-9d18-4f75-8db8-f9859b56be11 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:50.227175 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993983dd-9d18-4f75-8db8-f9859b56be11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:50.227516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993983dd-9d18-4f75-8db8-f9859b56be11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:50.229970 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993983dd-9d18-4f75-8db8-f9859b56be11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:50.233935 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993983dd-9d18-4f75-8db8-f9859b56be11 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:50.293282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a6128-2023-4c2c-9fa9-53af901f5fa1 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:50.305113 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3808/7528] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:44:50 2022] POST /identity/v3/projects => generated 381 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:50.319240 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a6128-2023-4c2c-9fa9-53af901f5fa1 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:50.375259 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:50.436837 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14042fb5-3a5f-4879-a116-cde3948e9913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:50.437445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14042fb5-3a5f-4879-a116-cde3948e9913 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:50.450342 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14042fb5-3a5f-4879-a116-cde3948e9913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:50.450716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14042fb5-3a5f-4879-a116-cde3948e9913 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:50.451431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14042fb5-3a5f-4879-a116-cde3948e9913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:50.469843 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14042fb5-3a5f-4879-a116-cde3948e9913 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:50.514696 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3721/7529] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:44:50 2022] POST /identity/v3/users => generated 297 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:50.526618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993983dd-9d18-4f75-8db8-f9859b56be11 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:50.553425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993983dd-9d18-4f75-8db8-f9859b56be11 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:50.568633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bc6bb-5331-4cdf-95fd-a981d37ae462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:50.569540 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bc6bb-5331-4cdf-95fd-a981d37ae462 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:50.570971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bc6bb-5331-4cdf-95fd-a981d37ae462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:50.571525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bc6bb-5331-4cdf-95fd-a981d37ae462 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:50.573475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2bc6bb-5331-4cdf-95fd-a981d37ae462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:50.577025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2bc6bb-5331-4cdf-95fd-a981d37ae462 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:50.599039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14042fb5-3a5f-4879-a116-cde3948e9913 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:50.600250 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3809/7530] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:44:50.613846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14042fb5-3a5f-4879-a116-cde3948e9913 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:50.625588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a1ede-f274-4b63-91da-a23a4ad259b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:50.627303 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a1ede-f274-4b63-91da-a23a4ad259b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:50.627833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a1ede-f274-4b63-91da-a23a4ad259b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:50.629892 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a1ede-f274-4b63-91da-a23a4ad259b1 admin admin] PATH_INFO: `/v3/projects/6a524892c42243f3a5e202ca279e9493/users/c75e81615d7d43f08963cccfa02251f1/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:50.711745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a1ede-f274-4b63-91da-a23a4ad259b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a524892c42243f3a5e202ca279e9493, user_id=c75e81615d7d43f08963cccfa02251f1, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:50.715047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a1ede-f274-4b63-91da-a23a4ad259b1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:50.754104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bc6bb-5331-4cdf-95fd-a981d37ae462 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:50.755936 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3722/7531] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:44:50 2022] PUT /identity/v3/projects/6a524892c42243f3a5e202ca279e9493/users/c75e81615d7d43f08963cccfa02251f1/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:44:50.771842 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bc6bb-5331-4cdf-95fd-a981d37ae462 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:50.878835 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:50.926290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c2f472-9804-4769-bfd2-4ddefe2ca374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:50.927306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2f472-9804-4769-bfd2-4ddefe2ca374 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:50.927686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2f472-9804-4769-bfd2-4ddefe2ca374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:50.928139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c2f472-9804-4769-bfd2-4ddefe2ca374 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:50.928974 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2f472-9804-4769-bfd2-4ddefe2ca374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:50.930937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c2f472-9804-4769-bfd2-4ddefe2ca374 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:50.953392 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3810/7532] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:44:50.954084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a1ede-f274-4b63-91da-a23a4ad259b1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:50.979922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a1ede-f274-4b63-91da-a23a4ad259b1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:50.999602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1971482-2dee-4eae-a314-e5e4c8dae7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:51.000378 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1971482-2dee-4eae-a314-e5e4c8dae7b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:51.000660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1971482-2dee-4eae-a314-e5e4c8dae7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:51.000934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1971482-2dee-4eae-a314-e5e4c8dae7b6 admin admin] PATH_INFO: `/v3/projects/6a524892c42243f3a5e202ca279e9493/users/c75e81615d7d43f08963cccfa02251f1/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:51.002891 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1971482-2dee-4eae-a314-e5e4c8dae7b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a524892c42243f3a5e202ca279e9493, user_id=c75e81615d7d43f08963cccfa02251f1, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:51.005869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1971482-2dee-4eae-a314-e5e4c8dae7b6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:51.059647 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3723/7533] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:44:50 2022] PUT /identity/v3/projects/6a524892c42243f3a5e202ca279e9493/users/c75e81615d7d43f08963cccfa02251f1/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:44:51.072740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f75f2f-5011-420a-9185-e8daec642871 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:51.073093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f75f2f-5011-420a-9185-e8daec642871 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:51.073311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f75f2f-5011-420a-9185-e8daec642871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:51.129725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-27f75f2f-5011-420a-9185-e8daec642871 None None] MFA Rules not processed for user `c75e81615d7d43f08963cccfa02251f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:51.145721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-27f75f2f-5011-420a-9185-e8daec642871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:51.324188 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3811/7534] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:51 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:51.353991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1971482-2dee-4eae-a314-e5e4c8dae7b6 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:51.371177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b1971482-2dee-4eae-a314-e5e4c8dae7b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:51.394035 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f75f2f-5011-420a-9185-e8daec642871 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:51.397501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-27f75f2f-5011-420a-9185-e8daec642871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:51.572151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1971482-2dee-4eae-a314-e5e4c8dae7b6 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:51.577489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59484967-30ea-43c0-beab-56ab73011896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:51.580127 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59484967-30ea-43c0-beab-56ab73011896 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:51.580792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59484967-30ea-43c0-beab-56ab73011896 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:51.581259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59484967-30ea-43c0-beab-56ab73011896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:51.596086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f75f2f-5011-420a-9185-e8daec642871 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:51.604542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59484967-30ea-43c0-beab-56ab73011896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:51.606152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59484967-30ea-43c0-beab-56ab73011896 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:51.611528 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fba80-3884-4c21-960e-85e060e03edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:51.612510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fba80-3884-4c21-960e-85e060e03edd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:51.612860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fba80-3884-4c21-960e-85e060e03edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:51.613213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fba80-3884-4c21-960e-85e060e03edd admin admin] PATH_INFO: `/v3/projects/f3efa24d1ad2406fb7f8addd8ee2e29b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:51.616338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0fba80-3884-4c21-960e-85e060e03edd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3efa24d1ad2406fb7f8addd8ee2e29b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:51.618941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0fba80-3884-4c21-960e-85e060e03edd admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:51.623831 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3724/7535] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:44:51 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:44:51.705667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-eb0fba80-3884-4c21-960e-85e060e03edd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3efa24d1ad2406fb7f8addd8ee2e29b', 'request_id': 'req-eb0fba80-3884-4c21-960e-85e060e03edd'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:51.715967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-eb0fba80-3884-4c21-960e-85e060e03edd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3efa24d1ad2406fb7f8addd8ee2e29b', 'request_id': 'req-eb0fba80-3884-4c21-960e-85e060e03edd'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:51.733577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-eb0fba80-3884-4c21-960e-85e060e03edd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3efa24d1ad2406fb7f8addd8ee2e29b', 'request_id': 'req-eb0fba80-3884-4c21-960e-85e060e03edd'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:51.737413 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:51.760253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-eb0fba80-3884-4c21-960e-85e060e03edd admin admin] The token cache is being invalidate because project f3efa24d1ad2406fb7f8addd8ee2e29b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:44:51.760836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-eb0fba80-3884-4c21-960e-85e060e03edd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:51.761583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-eb0fba80-3884-4c21-960e-85e060e03edd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:51.763918 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3812/7536] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:44:51 2022] DELETE /identity/v3/projects/f3efa24d1ad2406fb7f8addd8ee2e29b => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:51.767436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59484967-30ea-43c0-beab-56ab73011896 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:51.781955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59484967-30ea-43c0-beab-56ab73011896 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:51.895420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda2395-ecd8-415a-bfe6-0977f6ecb940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:51.900045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda2395-ecd8-415a-bfe6-0977f6ecb940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:51.900045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda2395-ecd8-415a-bfe6-0977f6ecb940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:51.900045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda2395-ecd8-415a-bfe6-0977f6ecb940 admin admin] PATH_INFO: `/v3/users/1f1490b225fc4f93b6eae46e3b9c2e09` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:51.900045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda2395-ecd8-415a-bfe6-0977f6ecb940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f1490b225fc4f93b6eae46e3b9c2e09)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:51.909870 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda2395-ecd8-415a-bfe6-0977f6ecb940 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:51.958339 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:51.995788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5dda2395-ecd8-415a-bfe6-0977f6ecb940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f1490b225fc4f93b6eae46e3b9c2e09'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:52.008572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5dda2395-ecd8-415a-bfe6-0977f6ecb940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f1490b225fc4f93b6eae46e3b9c2e09'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:52.031654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5dda2395-ecd8-415a-bfe6-0977f6ecb940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f1490b225fc4f93b6eae46e3b9c2e09'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:52.033141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5dda2395-ecd8-415a-bfe6-0977f6ecb940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f1490b225fc4f93b6eae46e3b9c2e09'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:52.053667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5dda2395-ecd8-415a-bfe6-0977f6ecb940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f1490b225fc4f93b6eae46e3b9c2e09'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:52.070371 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3725/7537] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:44:51 2022] DELETE /identity/v3/users/1f1490b225fc4f93b6eae46e3b9c2e09 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:53.080327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fba80-3884-4c21-960e-85e060e03edd admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:53.082022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-eb0fba80-3884-4c21-960e-85e060e03edd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:53.104080 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fba80-3884-4c21-960e-85e060e03edd admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:53.237258 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d599f6-5416-4490-b340-0c758cede177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:53.238102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d599f6-5416-4490-b340-0c758cede177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:53.238489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d599f6-5416-4490-b340-0c758cede177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:53.238928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d599f6-5416-4490-b340-0c758cede177 admin admin] PATH_INFO: `/v3/projects/8f4b6c5c18234e62ada399ef42e8a870` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:53.242450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d599f6-5416-4490-b340-0c758cede177 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f4b6c5c18234e62ada399ef42e8a870)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:53.246224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d599f6-5416-4490-b340-0c758cede177 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:53.350104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-51d599f6-5416-4490-b340-0c758cede177 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f4b6c5c18234e62ada399ef42e8a870', 'request_id': 'req-51d599f6-5416-4490-b340-0c758cede177'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:53.360161 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-51d599f6-5416-4490-b340-0c758cede177 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f4b6c5c18234e62ada399ef42e8a870', 'request_id': 'req-51d599f6-5416-4490-b340-0c758cede177'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:53.372711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-51d599f6-5416-4490-b340-0c758cede177 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f4b6c5c18234e62ada399ef42e8a870', 'request_id': 'req-51d599f6-5416-4490-b340-0c758cede177'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:53.398032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-51d599f6-5416-4490-b340-0c758cede177 admin admin] The token cache is being invalidate because project 8f4b6c5c18234e62ada399ef42e8a870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:44:53.399128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-51d599f6-5416-4490-b340-0c758cede177 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:53.400012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-51d599f6-5416-4490-b340-0c758cede177 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:53.407942 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3813/7538] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:44:53 2022] DELETE /identity/v3/projects/8f4b6c5c18234e62ada399ef42e8a870 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:53.408241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c55faf-cd94-4d02-98cd-edb128e358c3 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:53.408241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c55faf-cd94-4d02-98cd-edb128e358c3 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:53.408241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c55faf-cd94-4d02-98cd-edb128e358c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:53.448700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-a9c55faf-cd94-4d02-98cd-edb128e358c3 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:53.450379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a9c55faf-cd94-4d02-98cd-edb128e358c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:53.572140 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3726/7539] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:53.578144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b9939-f3cb-4175-81a5-e4285e74c022 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:53.578464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b9939-f3cb-4175-81a5-e4285e74c022 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:53.578719 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b9939-f3cb-4175-81a5-e4285e74c022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:53.607696 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e35b9939-f3cb-4175-81a5-e4285e74c022 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:53.609211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e35b9939-f3cb-4175-81a5-e4285e74c022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:53.649425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c55faf-cd94-4d02-98cd-edb128e358c3 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:53.650324 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3814/7540] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:53.667000 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c55faf-cd94-4d02-98cd-edb128e358c3 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:53.676555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4c856-6b2b-4049-afcb-86c933f22353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:53.677183 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4c856-6b2b-4049-afcb-86c933f22353 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:53.677465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4c856-6b2b-4049-afcb-86c933f22353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:53.677741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4c856-6b2b-4049-afcb-86c933f22353 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:53.678406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4c856-6b2b-4049-afcb-86c933f22353 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:44:53.678708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4c856-6b2b-4049-afcb-86c933f22353 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:53.680914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4c856-6b2b-4049-afcb-86c933f22353 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:53.716156 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3727/7541] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:44:53.717631 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b9939-f3cb-4175-81a5-e4285e74c022 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:53.732240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b9939-f3cb-4175-81a5-e4285e74c022 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:53.738046 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda7d7c-1cde-4139-92af-0bf1ad988d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:53.739141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda7d7c-1cde-4139-92af-0bf1ad988d8d admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:53.739674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda7d7c-1cde-4139-92af-0bf1ad988d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:53.740192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda7d7c-1cde-4139-92af-0bf1ad988d8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:53.741150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda7d7c-1cde-4139-92af-0bf1ad988d8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:53.743574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda7d7c-1cde-4139-92af-0bf1ad988d8d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:53.792323 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3815/7542] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:44:53 2022] POST /identity/v3/projects => generated 365 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:53.793750 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4c856-6b2b-4049-afcb-86c933f22353 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:53.806585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4c856-6b2b-4049-afcb-86c933f22353 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:53.887344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03709469-77cf-49d9-a7f9-cb32dcf30370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:53.888187 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03709469-77cf-49d9-a7f9-cb32dcf30370 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:53.888468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03709469-77cf-49d9-a7f9-cb32dcf30370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:53.888735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03709469-77cf-49d9-a7f9-cb32dcf30370 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:53.889379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03709469-77cf-49d9-a7f9-cb32dcf30370 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:53.891615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03709469-77cf-49d9-a7f9-cb32dcf30370 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:53.927850 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3728/7543] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:44:53 2022] POST /identity/v3/users => generated 283 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:44:53.932509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda7d7c-1cde-4139-92af-0bf1ad988d8d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:53.945850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda7d7c-1cde-4139-92af-0bf1ad988d8d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:53.952199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462de8d3-1ba4-4bc1-bd99-5be6174d88bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:53.952973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462de8d3-1ba4-4bc1-bd99-5be6174d88bc admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:53.953356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462de8d3-1ba4-4bc1-bd99-5be6174d88bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:53.954264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462de8d3-1ba4-4bc1-bd99-5be6174d88bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:53.954942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462de8d3-1ba4-4bc1-bd99-5be6174d88bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:53.958260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462de8d3-1ba4-4bc1-bd99-5be6174d88bc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:53.990117 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3816/7544] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:44:53.994401 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03709469-77cf-49d9-a7f9-cb32dcf30370 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:54.007597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03709469-77cf-49d9-a7f9-cb32dcf30370 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:54.014809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87277f-2e8a-49d0-9063-4d20795cc47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:54.015588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87277f-2e8a-49d0-9063-4d20795cc47d admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:54.016007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87277f-2e8a-49d0-9063-4d20795cc47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:54.016383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87277f-2e8a-49d0-9063-4d20795cc47d admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:54.017236 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87277f-2e8a-49d0-9063-4d20795cc47d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:54.019406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87277f-2e8a-49d0-9063-4d20795cc47d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:54.035305 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3729/7545] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:44:54.039865 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462de8d3-1ba4-4bc1-bd99-5be6174d88bc admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:54.051528 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462de8d3-1ba4-4bc1-bd99-5be6174d88bc admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:54.057243 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed958d-ef08-4b56-b437-bc701c597513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:54.057916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed958d-ef08-4b56-b437-bc701c597513 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:54.058188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed958d-ef08-4b56-b437-bc701c597513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:54.058458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed958d-ef08-4b56-b437-bc701c597513 admin admin] PATH_INFO: `/v3/projects/4ca7dc45e6b44d2380d73b825307738f/users/b4f8f2e9069f449796891a423ec0cb79/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:54.090423 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed958d-ef08-4b56-b437-bc701c597513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ca7dc45e6b44d2380d73b825307738f, user_id=b4f8f2e9069f449796891a423ec0cb79, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:54.093918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed958d-ef08-4b56-b437-bc701c597513 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:54.113758 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3817/7546] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:44:54 2022] PUT /identity/v3/projects/4ca7dc45e6b44d2380d73b825307738f/users/b4f8f2e9069f449796891a423ec0cb79/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:44:54.124997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2012116-a041-4c27-bf82-ef721249ab48 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:54.125407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2012116-a041-4c27-bf82-ef721249ab48 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:54.125684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2012116-a041-4c27-bf82-ef721249ab48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:54.155318 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:54.168485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b2012116-a041-4c27-bf82-ef721249ab48 None None] MFA Rules not processed for user `b4f8f2e9069f449796891a423ec0cb79`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:54.170746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b2012116-a041-4c27-bf82-ef721249ab48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:54.277376 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3730/7547] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:54.281836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed958d-ef08-4b56-b437-bc701c597513 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:54.314262 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:54.411803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed958d-ef08-4b56-b437-bc701c597513 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:54.425119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9dabc-0780-4da7-a744-069115b4d6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:54.425774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9dabc-0780-4da7-a744-069115b4d6a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:54.426055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9dabc-0780-4da7-a744-069115b4d6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:54.426327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9dabc-0780-4da7-a744-069115b4d6a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:54.426987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9dabc-0780-4da7-a744-069115b4d6a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:54.430080 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9dabc-0780-4da7-a744-069115b4d6a7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:54.488722 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3818/7548] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:44:54 2022] POST /identity/v3/projects => generated 367 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:54.493621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2012116-a041-4c27-bf82-ef721249ab48 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:54.514566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2012116-a041-4c27-bf82-ef721249ab48 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:54.637236 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93b499-fea8-4b3d-b3da-92e638506e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:54.638200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93b499-fea8-4b3d-b3da-92e638506e4c admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:54.638863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93b499-fea8-4b3d-b3da-92e638506e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:54.639466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93b499-fea8-4b3d-b3da-92e638506e4c admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:54.640513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93b499-fea8-4b3d-b3da-92e638506e4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:54.643032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93b499-fea8-4b3d-b3da-92e638506e4c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:54.673500 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3731/7549] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:44:54 2022] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:54.677136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9dabc-0780-4da7-a744-069115b4d6a7 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:54.690158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9dabc-0780-4da7-a744-069115b4d6a7 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:54.697217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947ea9b-adfe-4d1c-84e4-b2f982c6d594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:54.698064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947ea9b-adfe-4d1c-84e4-b2f982c6d594 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:54.698499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947ea9b-adfe-4d1c-84e4-b2f982c6d594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:54.700007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947ea9b-adfe-4d1c-84e4-b2f982c6d594 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:54.700860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d947ea9b-adfe-4d1c-84e4-b2f982c6d594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:54.703293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d947ea9b-adfe-4d1c-84e4-b2f982c6d594 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:54.724759 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3819/7550] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:44:54.728826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93b499-fea8-4b3d-b3da-92e638506e4c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:54.743003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93b499-fea8-4b3d-b3da-92e638506e4c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:54.749329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16b1fb-8825-48a7-92eb-b027e9a14be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:54.750655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16b1fb-8825-48a7-92eb-b027e9a14be8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:54.751474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16b1fb-8825-48a7-92eb-b027e9a14be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:54.752273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16b1fb-8825-48a7-92eb-b027e9a14be8 admin admin] PATH_INFO: `/v3/projects/bfade6b5db234d7ea7e18b9733558579/users/a359a23fdf0640caa779c1aa21136bfc/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:54.776868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16b1fb-8825-48a7-92eb-b027e9a14be8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfade6b5db234d7ea7e18b9733558579, user_id=a359a23fdf0640caa779c1aa21136bfc, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:54.780621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16b1fb-8825-48a7-92eb-b027e9a14be8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:54.805800 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3732/7551] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:44:54 2022] PUT /identity/v3/projects/bfade6b5db234d7ea7e18b9733558579/users/a359a23fdf0640caa779c1aa21136bfc/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:54.809677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947ea9b-adfe-4d1c-84e4-b2f982c6d594 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:54.826427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947ea9b-adfe-4d1c-84e4-b2f982c6d594 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:54.907628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8f578-94f1-4edb-b5f8-b4b5348110d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:54.909124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8f578-94f1-4edb-b5f8-b4b5348110d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:54.909502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8f578-94f1-4edb-b5f8-b4b5348110d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:54.909875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8f578-94f1-4edb-b5f8-b4b5348110d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:54.910807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8f578-94f1-4edb-b5f8-b4b5348110d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:54.913012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8f578-94f1-4edb-b5f8-b4b5348110d6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:54.925843 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3820/7552] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:44:54.930137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16b1fb-8825-48a7-92eb-b027e9a14be8 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:54.945825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16b1fb-8825-48a7-92eb-b027e9a14be8 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:54.957260 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4e4dc-8b41-480f-935f-818548490581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:54.959824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4e4dc-8b41-480f-935f-818548490581 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:54.960772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4e4dc-8b41-480f-935f-818548490581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:54.961056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4e4dc-8b41-480f-935f-818548490581 admin admin] PATH_INFO: `/v3/projects/bfade6b5db234d7ea7e18b9733558579/users/a359a23fdf0640caa779c1aa21136bfc/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:54.988719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4e4dc-8b41-480f-935f-818548490581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfade6b5db234d7ea7e18b9733558579, user_id=a359a23fdf0640caa779c1aa21136bfc, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:54.994568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd4e4dc-8b41-480f-935f-818548490581 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:55.039702 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3733/7553] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:44:54 2022] PUT /identity/v3/projects/bfade6b5db234d7ea7e18b9733558579/users/a359a23fdf0640caa779c1aa21136bfc/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:55.064838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb7e0a-1958-4811-b85b-4fae84027041 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:55.065399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb7e0a-1958-4811-b85b-4fae84027041 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:55.065782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb7e0a-1958-4811-b85b-4fae84027041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:55.141996 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-12eb7e0a-1958-4811-b85b-4fae84027041 None None] MFA Rules not processed for user `a359a23fdf0640caa779c1aa21136bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:55.144614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-12eb7e0a-1958-4811-b85b-4fae84027041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:55.318366 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3821/7554] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:55 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:55.322938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4e4dc-8b41-480f-935f-818548490581 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:55.345287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4e4dc-8b41-480f-935f-818548490581 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:55.357062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846321b-aab4-4035-abc5-91e79987e2d6 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a359a23fdf0640caa779c1aa21136bfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfade6b5db234d7ea7e18b9733558579', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:55.357719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846321b-aab4-4035-abc5-91e79987e2d6 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:55.358288 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846321b-aab4-4035-abc5-91e79987e2d6 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:55.358588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846321b-aab4-4035-abc5-91e79987e2d6 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] PATH_INFO: `/v3/regions` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:55.359235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9846321b-aab4-4035-abc5-91e79987e2d6 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:55.360348 n-d-master-1 devstack@keystone.service[80493]: WARNING py.warnings [None req-9846321b-aab4-4035-abc5-91e79987e2d6 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:44:55.360348 n-d-master-1 devstack@keystone.service[80493]: warnings.warn(msg) Aug 07 01:44:55.360348 n-d-master-1 devstack@keystone.service[80493]: Aug 07 01:44:55.361255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9846321b-aab4-4035-abc5-91e79987e2d6 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:55.408480 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3734/7555] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Aug 7 01:44:55 2022] POST /identity/v3/regions => generated 223 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:55.412185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb7e0a-1958-4811-b85b-4fae84027041 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:55.445678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb7e0a-1958-4811-b85b-4fae84027041 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:55.476681 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:55.486122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe4cb7-eb73-47b2-bf3c-6d2b8d1766d9 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a359a23fdf0640caa779c1aa21136bfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfade6b5db234d7ea7e18b9733558579', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:55.488422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe4cb7-eb73-47b2-bf3c-6d2b8d1766d9 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:55.489030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe4cb7-eb73-47b2-bf3c-6d2b8d1766d9 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:55.489620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe4cb7-eb73-47b2-bf3c-6d2b8d1766d9 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] PATH_INFO: `/v3/regions` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:55.490571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe4cb7-eb73-47b2-bf3c-6d2b8d1766d9 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:55.491986 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-2abe4cb7-eb73-47b2-bf3c-6d2b8d1766d9 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:44:55.491986 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:44:55.491986 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:44:55.493585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe4cb7-eb73-47b2-bf3c-6d2b8d1766d9 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:55.541308 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3822/7556] 10.222.0.39 () {60 vars in 1149 bytes} [Sun Aug 7 01:44:55 2022] POST /identity/v3/regions => generated 224 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:55.544941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846321b-aab4-4035-abc5-91e79987e2d6 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:55.560978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846321b-aab4-4035-abc5-91e79987e2d6 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:55.614863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c811f4-aee4-4157-9b58-f61df7f68ae3 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a359a23fdf0640caa779c1aa21136bfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfade6b5db234d7ea7e18b9733558579', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:55.615537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c811f4-aee4-4157-9b58-f61df7f68ae3 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:55.615829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c811f4-aee4-4157-9b58-f61df7f68ae3 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:55.616661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c811f4-aee4-4157-9b58-f61df7f68ae3 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] PATH_INFO: `/v3/regions/edd4d227-02b8-4935-ad31-02267c3864a0` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:55.617347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c811f4-aee4-4157-9b58-f61df7f68ae3 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Authorizing `identity:create_region(region_id=edd4d227-02b8-4935-ad31-02267c3864a0)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:55.619458 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c811f4-aee4-4157-9b58-f61df7f68ae3 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:55.670824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe4cb7-eb73-47b2-bf3c-6d2b8d1766d9 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:55.684947 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3735/7557] 10.222.0.39 () {60 vars in 1259 bytes} [Sun Aug 7 01:44:55 2022] PUT /identity/v3/regions/edd4d227-02b8-4935-ad31-02267c3864a0 => generated 232 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:44:55.711631 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe4cb7-eb73-47b2-bf3c-6d2b8d1766d9 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:55.774462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0354b13-1b65-4fd4-b3e5-50f86b8d39ea tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a359a23fdf0640caa779c1aa21136bfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfade6b5db234d7ea7e18b9733558579', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:55.775575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0354b13-1b65-4fd4-b3e5-50f86b8d39ea tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:55.776066 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0354b13-1b65-4fd4-b3e5-50f86b8d39ea tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:55.776435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0354b13-1b65-4fd4-b3e5-50f86b8d39ea tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] PATH_INFO: `/v3/regions/edd4d227-02b8-4935-ad31-02267c3864a0` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:55.777552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0354b13-1b65-4fd4-b3e5-50f86b8d39ea tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Authorizing `identity:delete_region(region_id=edd4d227-02b8-4935-ad31-02267c3864a0)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:55.781327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0354b13-1b65-4fd4-b3e5-50f86b8d39ea tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:55.826392 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3823/7558] 10.222.0.39 () {58 vars in 1242 bytes} [Sun Aug 7 01:44:55 2022] DELETE /identity/v3/regions/edd4d227-02b8-4935-ad31-02267c3864a0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:55.833593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c811f4-aee4-4157-9b58-f61df7f68ae3 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:55.848231 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c811f4-aee4-4157-9b58-f61df7f68ae3 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:55.865443 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:55.889352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1f0bb-c264-48c4-b194-231628f0fa77 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a359a23fdf0640caa779c1aa21136bfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfade6b5db234d7ea7e18b9733558579', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:55.890042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1f0bb-c264-48c4-b194-231628f0fa77 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:55.890253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1f0bb-c264-48c4-b194-231628f0fa77 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:55.890530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1f0bb-c264-48c4-b194-231628f0fa77 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] PATH_INFO: `/v3/regions` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:55.892527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1f0bb-c264-48c4-b194-231628f0fa77 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:55.899600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1f0bb-c264-48c4-b194-231628f0fa77 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:55.946164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0354b13-1b65-4fd4-b3e5-50f86b8d39ea tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:55.946758 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3736/7559] 10.222.0.39 () {60 vars in 1150 bytes} [Sun Aug 7 01:44:55 2022] POST /identity/v3/regions => generated 253 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:55.963998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0354b13-1b65-4fd4-b3e5-50f86b8d39ea tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:56.009451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca57c50-3014-4376-844d-ffde0c45254a tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a359a23fdf0640caa779c1aa21136bfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfade6b5db234d7ea7e18b9733558579', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:56.010110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca57c50-3014-4376-844d-ffde0c45254a tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:56.010394 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca57c50-3014-4376-844d-ffde0c45254a tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:56.010671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca57c50-3014-4376-844d-ffde0c45254a tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] PATH_INFO: `/v3/regions/cf5169be9ce44550b68a7b20183c18b1` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:56.011344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca57c50-3014-4376-844d-ffde0c45254a tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Authorizing `identity:update_region(region_id=cf5169be9ce44550b68a7b20183c18b1)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:56.025894 n-d-master-1 devstack@keystone.service[80492]: WARNING py.warnings [None req-dca57c50-3014-4376-844d-ffde0c45254a tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 07 01:44:56.025894 n-d-master-1 devstack@keystone.service[80492]: warnings.warn(msg) Aug 07 01:44:56.025894 n-d-master-1 devstack@keystone.service[80492]: Aug 07 01:44:56.027347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca57c50-3014-4376-844d-ffde0c45254a tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:56.089805 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3824/7560] 10.222.0.39 () {60 vars in 1250 bytes} [Sun Aug 7 01:44:55 2022] PATCH /identity/v3/regions/cf5169be9ce44550b68a7b20183c18b1 => generated 254 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:44:56.097655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1f0bb-c264-48c4-b194-231628f0fa77 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:56.129587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1f0bb-c264-48c4-b194-231628f0fa77 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:56.189897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677ed2d-6389-475b-877c-514d43a848b6 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a359a23fdf0640caa779c1aa21136bfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfade6b5db234d7ea7e18b9733558579', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:56.190747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677ed2d-6389-475b-877c-514d43a848b6 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:56.191265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677ed2d-6389-475b-877c-514d43a848b6 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:56.191645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677ed2d-6389-475b-877c-514d43a848b6 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] PATH_INFO: `/v3/regions/cf5169be9ce44550b68a7b20183c18b1` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:56.192406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677ed2d-6389-475b-877c-514d43a848b6 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Authorizing `identity:get_region(region_id=cf5169be9ce44550b68a7b20183c18b1)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:56.196520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677ed2d-6389-475b-877c-514d43a848b6 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:56.203616 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3737/7561] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Aug 7 01:44:56 2022] GET /identity/v3/regions/cf5169be9ce44550b68a7b20183c18b1 => generated 254 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:44:56.207487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca57c50-3014-4376-844d-ffde0c45254a tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:56.222437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca57c50-3014-4376-844d-ffde0c45254a tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:56.229435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ae399-2d25-4b30-9627-ee399f75a798 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a359a23fdf0640caa779c1aa21136bfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfade6b5db234d7ea7e18b9733558579', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:56.230097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ae399-2d25-4b30-9627-ee399f75a798 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:56.230414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ae399-2d25-4b30-9627-ee399f75a798 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:56.231268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ae399-2d25-4b30-9627-ee399f75a798 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] PATH_INFO: `/v3/regions/cf5169be9ce44550b68a7b20183c18b1` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:56.231985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ae399-2d25-4b30-9627-ee399f75a798 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Authorizing `identity:delete_region(region_id=cf5169be9ce44550b68a7b20183c18b1)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:56.234500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982ae399-2d25-4b30-9627-ee399f75a798 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:56.264258 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3825/7562] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:44:56 2022] DELETE /identity/v3/regions/cf5169be9ce44550b68a7b20183c18b1 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:44:56.266888 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677ed2d-6389-475b-877c-514d43a848b6 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:56.278813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677ed2d-6389-475b-877c-514d43a848b6 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:56.298665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07feebf5-aba3-4d28-82ad-40e15baca9cd tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a359a23fdf0640caa779c1aa21136bfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfade6b5db234d7ea7e18b9733558579', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:56.299476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07feebf5-aba3-4d28-82ad-40e15baca9cd tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:56.299967 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07feebf5-aba3-4d28-82ad-40e15baca9cd tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:56.300454 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07feebf5-aba3-4d28-82ad-40e15baca9cd tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] PATH_INFO: `/v3/regions` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:56.301235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07feebf5-aba3-4d28-82ad-40e15baca9cd tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:56.302980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07feebf5-aba3-4d28-82ad-40e15baca9cd tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:56.310445 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3738/7563] 10.222.0.39 () {58 vars in 1128 bytes} [Sun Aug 7 01:44:56 2022] GET /identity/v3/regions => generated 669 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:44:56.314348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ae399-2d25-4b30-9627-ee399f75a798 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:56.328133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ae399-2d25-4b30-9627-ee399f75a798 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:56.333971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2c5f9-0ed1-4030-a548-599070c92e45 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a359a23fdf0640caa779c1aa21136bfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfade6b5db234d7ea7e18b9733558579', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:56.335668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2c5f9-0ed1-4030-a548-599070c92e45 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:56.336186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2c5f9-0ed1-4030-a548-599070c92e45 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:56.336674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2c5f9-0ed1-4030-a548-599070c92e45 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] PATH_INFO: `/v3/regions/cf5169be9ce44550b68a7b20183c18b1` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:56.337585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2c5f9-0ed1-4030-a548-599070c92e45 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Authorizing `identity:delete_region(region_id=cf5169be9ce44550b68a7b20183c18b1)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:56.339408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2c5f9-0ed1-4030-a548-599070c92e45 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:56.360093 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application [None req-9bc2c5f9-0ed1-4030-a548-599070c92e45 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Could not find region: cf5169be9ce44550b68a7b20183c18b1.: keystone.exception.RegionNotFound: Could not find region: cf5169be9ce44550b68a7b20183c18b1. Aug 07 01:44:56.360093 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:44:56.360093 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Aug 07 01:44:56.360093 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Aug 07 01:44:56.360093 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Aug 07 01:44:56.360093 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Aug 07 01:44:56.360093 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Aug 07 01:44:56.360093 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Aug 07 01:44:56.360093 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: cf5169be9ce44550b68a7b20183c18b1. Aug 07 01:44:56.360093 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:44:56.360093 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 07 01:44:56.360093 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:44:56.360093 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:44:56.360093 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:44:56.360093 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:44:56.360093 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:44:56.362390 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:44:56.362390 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:44:56.362390 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:44:56.362390 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:44:56.362390 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:44:56.362390 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:44:56.362390 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:44:56.362390 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Aug 07 01:44:56.362390 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Aug 07 01:44:56.362390 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:44:56.362390 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:44:56.362390 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Aug 07 01:44:56.362390 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Aug 07 01:44:56.362390 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: cf5169be9ce44550b68a7b20183c18b1. Aug 07 01:44:56.362390 n-d-master-1 devstack@keystone.service[80492]: ERROR keystone.server.flask.application Aug 07 01:44:56.362390 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3826/7564] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:44:56 2022] DELETE /identity/v3/regions/cf5169be9ce44550b68a7b20183c18b1 => generated 112 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Aug 07 01:44:56.368342 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07feebf5-aba3-4d28-82ad-40e15baca9cd tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:56.393340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07feebf5-aba3-4d28-82ad-40e15baca9cd tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:56.412919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae28b43-c07d-4bd0-ae96-5c3b3d2614ba tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a359a23fdf0640caa779c1aa21136bfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfade6b5db234d7ea7e18b9733558579', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:56.414269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae28b43-c07d-4bd0-ae96-5c3b3d2614ba tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:56.414560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae28b43-c07d-4bd0-ae96-5c3b3d2614ba tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:56.414835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae28b43-c07d-4bd0-ae96-5c3b3d2614ba tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] PATH_INFO: `/v3/regions` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:56.415460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae28b43-c07d-4bd0-ae96-5c3b3d2614ba tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:56.416725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae28b43-c07d-4bd0-ae96-5c3b3d2614ba tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:56.424762 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3739/7565] 10.222.0.39 () {58 vars in 1128 bytes} [Sun Aug 7 01:44:56 2022] GET /identity/v3/regions => generated 669 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:44:56.429268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2c5f9-0ed1-4030-a548-599070c92e45 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:56.445070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2c5f9-0ed1-4030-a548-599070c92e45 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:56.450358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9a164-19e8-4f3b-825c-44bd03ee8a80 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a359a23fdf0640caa779c1aa21136bfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfade6b5db234d7ea7e18b9733558579', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:56.450980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9a164-19e8-4f3b-825c-44bd03ee8a80 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:56.451845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9a164-19e8-4f3b-825c-44bd03ee8a80 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:56.451845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9a164-19e8-4f3b-825c-44bd03ee8a80 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] PATH_INFO: `/v3/regions` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:56.452514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9a164-19e8-4f3b-825c-44bd03ee8a80 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:56.454279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f9a164-19e8-4f3b-825c-44bd03ee8a80 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:56.486554 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3827/7566] 10.222.0.39 () {60 vars in 1150 bytes} [Sun Aug 7 01:44:56 2022] POST /identity/v3/regions => generated 253 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:44:56.493655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae28b43-c07d-4bd0-ae96-5c3b3d2614ba tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:56.509522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae28b43-c07d-4bd0-ae96-5c3b3d2614ba tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:56.534865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd2bfc-496f-4f33-9a7b-60b0c4883421 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a359a23fdf0640caa779c1aa21136bfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfade6b5db234d7ea7e18b9733558579', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:56.536897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd2bfc-496f-4f33-9a7b-60b0c4883421 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:56.537418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd2bfc-496f-4f33-9a7b-60b0c4883421 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:56.539357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd2bfc-496f-4f33-9a7b-60b0c4883421 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] PATH_INFO: `/v3/regions` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:56.541539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd2bfc-496f-4f33-9a7b-60b0c4883421 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Adding query filter params (parent_region_id=d4a9385b4b73403099c34ecad30cf22b) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:44:56.543414 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd2bfc-496f-4f33-9a7b-60b0c4883421 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:56.547453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd2bfc-496f-4f33-9a7b-60b0c4883421 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:56.569534 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3740/7567] 10.222.0.39 () {58 vars in 1227 bytes} [Sun Aug 7 01:44:56 2022] GET /identity/v3/regions?parent_region_id=d4a9385b4b73403099c34ecad30cf22b => generated 399 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:44:56.573541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9a164-19e8-4f3b-825c-44bd03ee8a80 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:56.585812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9a164-19e8-4f3b-825c-44bd03ee8a80 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:56.591357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801cb6c-83b7-4f66-a031-ccc3f4de7723 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a359a23fdf0640caa779c1aa21136bfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfade6b5db234d7ea7e18b9733558579', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:56.592122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801cb6c-83b7-4f66-a031-ccc3f4de7723 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:56.592461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801cb6c-83b7-4f66-a031-ccc3f4de7723 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:56.592644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801cb6c-83b7-4f66-a031-ccc3f4de7723 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] PATH_INFO: `/v3/regions/82f3db7b80d54643ae7b4efd52dde5f6` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:56.593533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801cb6c-83b7-4f66-a031-ccc3f4de7723 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Authorizing `identity:delete_region(region_id=82f3db7b80d54643ae7b4efd52dde5f6)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:56.595451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9801cb6c-83b7-4f66-a031-ccc3f4de7723 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:56.624604 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3828/7568] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:44:56 2022] DELETE /identity/v3/regions/82f3db7b80d54643ae7b4efd52dde5f6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:56.630374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd2bfc-496f-4f33-9a7b-60b0c4883421 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:56.643925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd2bfc-496f-4f33-9a7b-60b0c4883421 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:56.662662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14c378-1b9d-4a02-9622-1c014c875b64 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a359a23fdf0640caa779c1aa21136bfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfade6b5db234d7ea7e18b9733558579', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:56.664408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14c378-1b9d-4a02-9622-1c014c875b64 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:56.665034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14c378-1b9d-4a02-9622-1c014c875b64 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:56.665758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14c378-1b9d-4a02-9622-1c014c875b64 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] PATH_INFO: `/v3/regions/36367fe67256433b965946f55158f6f5` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:56.666912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d14c378-1b9d-4a02-9622-1c014c875b64 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Authorizing `identity:delete_region(region_id=36367fe67256433b965946f55158f6f5)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:56.668648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d14c378-1b9d-4a02-9622-1c014c875b64 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:56.697308 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3741/7569] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:44:56 2022] DELETE /identity/v3/regions/36367fe67256433b965946f55158f6f5 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:56.698601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801cb6c-83b7-4f66-a031-ccc3f4de7723 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:56.712411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801cb6c-83b7-4f66-a031-ccc3f4de7723 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:56.749059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60810f38-a070-4a76-a1af-52ea16f5115f tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a359a23fdf0640caa779c1aa21136bfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfade6b5db234d7ea7e18b9733558579', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:56.752830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60810f38-a070-4a76-a1af-52ea16f5115f tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:56.752830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60810f38-a070-4a76-a1af-52ea16f5115f tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:56.752830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60810f38-a070-4a76-a1af-52ea16f5115f tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] PATH_INFO: `/v3/regions/d4a9385b4b73403099c34ecad30cf22b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:56.752830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60810f38-a070-4a76-a1af-52ea16f5115f tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Authorizing `identity:delete_region(region_id=d4a9385b4b73403099c34ecad30cf22b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:56.755829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60810f38-a070-4a76-a1af-52ea16f5115f tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:56.802042 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3829/7570] 10.222.0.39 () {58 vars in 1230 bytes} [Sun Aug 7 01:44:56 2022] DELETE /identity/v3/regions/d4a9385b4b73403099c34ecad30cf22b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:56.808444 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14c378-1b9d-4a02-9622-1c014c875b64 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:56.885074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60810f38-a070-4a76-a1af-52ea16f5115f tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:56.887340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-60810f38-a070-4a76-a1af-52ea16f5115f tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:56.948848 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:56.999919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14c378-1b9d-4a02-9622-1c014c875b64 tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:57.018612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aac6ea-02f9-4aa0-b84d-09cfb12b8453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:57.019156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aac6ea-02f9-4aa0-b84d-09cfb12b8453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:57.019432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aac6ea-02f9-4aa0-b84d-09cfb12b8453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:57.019698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aac6ea-02f9-4aa0-b84d-09cfb12b8453 admin admin] PATH_INFO: `/v3/users/b4f8f2e9069f449796891a423ec0cb79` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:57.020911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aac6ea-02f9-4aa0-b84d-09cfb12b8453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4f8f2e9069f449796891a423ec0cb79)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:57.023389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aac6ea-02f9-4aa0-b84d-09cfb12b8453 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:57.030628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60810f38-a070-4a76-a1af-52ea16f5115f tempest-RegionsTestJSON-1064425308 tempest-RegionsTestJSON-1064425308-project-admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:57.061293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d5a676-98f2-406d-afcd-5f00aad3eb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:57.061963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5a676-98f2-406d-afcd-5f00aad3eb0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:57.062238 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5a676-98f2-406d-afcd-5f00aad3eb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:57.062507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d5a676-98f2-406d-afcd-5f00aad3eb0b admin admin] PATH_INFO: `/v3/users/34a8a582d50c433e91d78abb3ada45a9` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:57.066374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5a676-98f2-406d-afcd-5f00aad3eb0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=34a8a582d50c433e91d78abb3ada45a9)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:57.073489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d5a676-98f2-406d-afcd-5f00aad3eb0b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:57.126640 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:57.209131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d7aac6ea-02f9-4aa0-b84d-09cfb12b8453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4f8f2e9069f449796891a423ec0cb79'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:57.242218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-99d5a676-98f2-406d-afcd-5f00aad3eb0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34a8a582d50c433e91d78abb3ada45a9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:57.251830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d7aac6ea-02f9-4aa0-b84d-09cfb12b8453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4f8f2e9069f449796891a423ec0cb79'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:57.261021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-99d5a676-98f2-406d-afcd-5f00aad3eb0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34a8a582d50c433e91d78abb3ada45a9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:57.287716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-99d5a676-98f2-406d-afcd-5f00aad3eb0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34a8a582d50c433e91d78abb3ada45a9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:57.291553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-99d5a676-98f2-406d-afcd-5f00aad3eb0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34a8a582d50c433e91d78abb3ada45a9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:57.297231 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d7aac6ea-02f9-4aa0-b84d-09cfb12b8453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4f8f2e9069f449796891a423ec0cb79'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:57.298951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d7aac6ea-02f9-4aa0-b84d-09cfb12b8453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4f8f2e9069f449796891a423ec0cb79'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:57.318626 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d7aac6ea-02f9-4aa0-b84d-09cfb12b8453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4f8f2e9069f449796891a423ec0cb79'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:57.324363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-99d5a676-98f2-406d-afcd-5f00aad3eb0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34a8a582d50c433e91d78abb3ada45a9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:57.333265 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3742/7571] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:44:56 2022] DELETE /identity/v3/users/b4f8f2e9069f449796891a423ec0cb79 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:57.337786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75697c8-de01-4fe1-87c1-a70e4848512c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:57.338091 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75697c8-de01-4fe1-87c1-a70e4848512c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:57.338337 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75697c8-de01-4fe1-87c1-a70e4848512c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:57.375994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d75697c8-de01-4fe1-87c1-a70e4848512c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:57.376438 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3830/7572] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:44:56 2022] DELETE /identity/v3/users/34a8a582d50c433e91d78abb3ada45a9 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:57.381105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d75697c8-de01-4fe1-87c1-a70e4848512c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:57.385014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658927d9-e395-4357-b411-3c921dabf15b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:57.385313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658927d9-e395-4357-b411-3c921dabf15b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:57.385571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658927d9-e395-4357-b411-3c921dabf15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:57.496653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-658927d9-e395-4357-b411-3c921dabf15b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:44:57.497901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-658927d9-e395-4357-b411-3c921dabf15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:57.609216 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3743/7573] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:57.692315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75697c8-de01-4fe1-87c1-a70e4848512c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:57.695641 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d75697c8-de01-4fe1-87c1-a70e4848512c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:57.695872 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3831/7574] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:44:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:44:57.841430 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658927d9-e395-4357-b411-3c921dabf15b None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:57.842325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-658927d9-e395-4357-b411-3c921dabf15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:57.965271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75697c8-de01-4fe1-87c1-a70e4848512c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:57.995141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c35e3c-66f6-4025-bea8-7b1b3744ef38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:57.996945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c35e3c-66f6-4025-bea8-7b1b3744ef38 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:57.999801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c35e3c-66f6-4025-bea8-7b1b3744ef38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:58.000130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c35e3c-66f6-4025-bea8-7b1b3744ef38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:58.043431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c35e3c-66f6-4025-bea8-7b1b3744ef38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:58.048049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c35e3c-66f6-4025-bea8-7b1b3744ef38 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:58.049471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658927d9-e395-4357-b411-3c921dabf15b None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:58.074038 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3744/7575] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:44:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:44:58.100810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37273289-0446-4c5f-bd0f-7f9a040d6e87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:58.101463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37273289-0446-4c5f-bd0f-7f9a040d6e87 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:58.104083 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37273289-0446-4c5f-bd0f-7f9a040d6e87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:58.104600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37273289-0446-4c5f-bd0f-7f9a040d6e87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:58.148638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37273289-0446-4c5f-bd0f-7f9a040d6e87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:58.157708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37273289-0446-4c5f-bd0f-7f9a040d6e87 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:58.167223 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:58.190758 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3832/7576] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:44:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:44:59.299376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c35e3c-66f6-4025-bea8-7b1b3744ef38 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:59.300900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-95c35e3c-66f6-4025-bea8-7b1b3744ef38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:59.361056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c35e3c-66f6-4025-bea8-7b1b3744ef38 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:59.393639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4d656-e598-4d4b-a095-fbe802259b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:59.396068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4d656-e598-4d4b-a095-fbe802259b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:59.396736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4d656-e598-4d4b-a095-fbe802259b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:59.397102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4d656-e598-4d4b-a095-fbe802259b73 admin admin] PATH_INFO: `/v3/projects/99fd8b243bbf4209ad01b13ce648307c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:59.399520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4d656-e598-4d4b-a095-fbe802259b73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99fd8b243bbf4209ad01b13ce648307c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:59.449285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4d656-e598-4d4b-a095-fbe802259b73 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:59.551853 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:44:59.566846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4ff4d656-e598-4d4b-a095-fbe802259b73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99fd8b243bbf4209ad01b13ce648307c', 'request_id': 'req-4ff4d656-e598-4d4b-a095-fbe802259b73'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:59.573067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4ff4d656-e598-4d4b-a095-fbe802259b73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99fd8b243bbf4209ad01b13ce648307c', 'request_id': 'req-4ff4d656-e598-4d4b-a095-fbe802259b73'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:59.580096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4ff4d656-e598-4d4b-a095-fbe802259b73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99fd8b243bbf4209ad01b13ce648307c', 'request_id': 'req-4ff4d656-e598-4d4b-a095-fbe802259b73'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:59.614292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4ff4d656-e598-4d4b-a095-fbe802259b73 admin admin] The token cache is being invalidate because project 99fd8b243bbf4209ad01b13ce648307c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:44:59.614523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4ff4d656-e598-4d4b-a095-fbe802259b73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:59.615319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4ff4d656-e598-4d4b-a095-fbe802259b73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:44:59.626541 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3745/7577] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:44:59 2022] DELETE /identity/v3/projects/99fd8b243bbf4209ad01b13ce648307c => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:44:59.627755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37273289-0446-4c5f-bd0f-7f9a040d6e87 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:59.642298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37273289-0446-4c5f-bd0f-7f9a040d6e87 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:59.839038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d1b6c-6d8b-4de9-bc97-9932b8a81a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:59.839714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d1b6c-6d8b-4de9-bc97-9932b8a81a3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:59.840023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d1b6c-6d8b-4de9-bc97-9932b8a81a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:59.840287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d1b6c-6d8b-4de9-bc97-9932b8a81a3c admin admin] PATH_INFO: `/v3/users/c75e81615d7d43f08963cccfa02251f1` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:59.841800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d1b6c-6d8b-4de9-bc97-9932b8a81a3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c75e81615d7d43f08963cccfa02251f1)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:59.843750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d1b6c-6d8b-4de9-bc97-9932b8a81a3c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:59.846043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4d656-e598-4d4b-a095-fbe802259b73 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:44:59.848238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4ff4d656-e598-4d4b-a095-fbe802259b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:44:59.927628 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4d656-e598-4d4b-a095-fbe802259b73 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:44:59.961459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f5761-e443-476a-b131-446702716643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:44:59.965582 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f5761-e443-476a-b131-446702716643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:44:59.966340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f5761-e443-476a-b131-446702716643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:44:59.968410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9f5761-e443-476a-b131-446702716643 admin admin] PATH_INFO: `/v3/projects/4ca7dc45e6b44d2380d73b825307738f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:44:59.974158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f5761-e443-476a-b131-446702716643 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ca7dc45e6b44d2380d73b825307738f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:44:59.994711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9f5761-e443-476a-b131-446702716643 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:44:59.999969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0a7d1b6c-6d8b-4de9-bc97-9932b8a81a3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c75e81615d7d43f08963cccfa02251f1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:00.049978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0a7d1b6c-6d8b-4de9-bc97-9932b8a81a3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c75e81615d7d43f08963cccfa02251f1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:00.141793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9e9f5761-e443-476a-b131-446702716643 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ca7dc45e6b44d2380d73b825307738f', 'request_id': 'req-9e9f5761-e443-476a-b131-446702716643'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:00.143280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0a7d1b6c-6d8b-4de9-bc97-9932b8a81a3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c75e81615d7d43f08963cccfa02251f1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:00.143640 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0a7d1b6c-6d8b-4de9-bc97-9932b8a81a3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c75e81615d7d43f08963cccfa02251f1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:00.169465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0a7d1b6c-6d8b-4de9-bc97-9932b8a81a3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c75e81615d7d43f08963cccfa02251f1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:00.171161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9e9f5761-e443-476a-b131-446702716643 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ca7dc45e6b44d2380d73b825307738f', 'request_id': 'req-9e9f5761-e443-476a-b131-446702716643'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:00.191649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9e9f5761-e443-476a-b131-446702716643 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ca7dc45e6b44d2380d73b825307738f', 'request_id': 'req-9e9f5761-e443-476a-b131-446702716643'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:00.218405 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9e9f5761-e443-476a-b131-446702716643 admin admin] The token cache is being invalidate because project 4ca7dc45e6b44d2380d73b825307738f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:45:00.219120 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3833/7578] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:44:59 2022] DELETE /identity/v3/users/c75e81615d7d43f08963cccfa02251f1 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:45:00.219528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9e9f5761-e443-476a-b131-446702716643 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:00.221500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9e9f5761-e443-476a-b131-446702716643 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:00.229559 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3746/7579] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:44:59 2022] DELETE /identity/v3/projects/4ca7dc45e6b44d2380d73b825307738f => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:45:00.230745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d1b6c-6d8b-4de9-bc97-9932b8a81a3c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:00.233135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0a7d1b6c-6d8b-4de9-bc97-9932b8a81a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:00.463232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d1b6c-6d8b-4de9-bc97-9932b8a81a3c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:00.478116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37800e0-8937-4494-985a-c115764d4aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:00.478789 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37800e0-8937-4494-985a-c115764d4aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:00.479071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37800e0-8937-4494-985a-c115764d4aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:00.479344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37800e0-8937-4494-985a-c115764d4aed admin admin] PATH_INFO: `/v3/users/a359a23fdf0640caa779c1aa21136bfc` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:00.482534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37800e0-8937-4494-985a-c115764d4aed admin admin] RBAC: Authorizing `identity:delete_user(user_id=a359a23fdf0640caa779c1aa21136bfc)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:00.485223 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37800e0-8937-4494-985a-c115764d4aed admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:00.544674 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:00.596817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b37800e0-8937-4494-985a-c115764d4aed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a359a23fdf0640caa779c1aa21136bfc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:00.614810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b37800e0-8937-4494-985a-c115764d4aed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a359a23fdf0640caa779c1aa21136bfc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:00.645787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b37800e0-8937-4494-985a-c115764d4aed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a359a23fdf0640caa779c1aa21136bfc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:00.648269 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b37800e0-8937-4494-985a-c115764d4aed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a359a23fdf0640caa779c1aa21136bfc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:00.665565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b37800e0-8937-4494-985a-c115764d4aed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a359a23fdf0640caa779c1aa21136bfc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:00.683104 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3834/7580] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:45:00 2022] DELETE /identity/v3/users/a359a23fdf0640caa779c1aa21136bfc => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:45:01.394493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f5761-e443-476a-b131-446702716643 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:01.398394 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9e9f5761-e443-476a-b131-446702716643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:01.633574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9f5761-e443-476a-b131-446702716643 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:01.802349 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:01.831875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c821c-7d9e-4196-9918-8ccef3773306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:01.834722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c821c-7d9e-4196-9918-8ccef3773306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:01.835007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c821c-7d9e-4196-9918-8ccef3773306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:01.835281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c821c-7d9e-4196-9918-8ccef3773306 admin admin] PATH_INFO: `/v3/projects/6a524892c42243f3a5e202ca279e9493` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:01.841458 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c821c-7d9e-4196-9918-8ccef3773306 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a524892c42243f3a5e202ca279e9493)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:01.850975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c821c-7d9e-4196-9918-8ccef3773306 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:02.058633 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c15c821c-7d9e-4196-9918-8ccef3773306 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a524892c42243f3a5e202ca279e9493', 'request_id': 'req-c15c821c-7d9e-4196-9918-8ccef3773306'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:02.088651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c15c821c-7d9e-4196-9918-8ccef3773306 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a524892c42243f3a5e202ca279e9493', 'request_id': 'req-c15c821c-7d9e-4196-9918-8ccef3773306'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:02.116976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c15c821c-7d9e-4196-9918-8ccef3773306 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a524892c42243f3a5e202ca279e9493', 'request_id': 'req-c15c821c-7d9e-4196-9918-8ccef3773306'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:02.181064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c15c821c-7d9e-4196-9918-8ccef3773306 admin admin] The token cache is being invalidate because project 6a524892c42243f3a5e202ca279e9493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:45:02.181358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c15c821c-7d9e-4196-9918-8ccef3773306 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:02.182269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c15c821c-7d9e-4196-9918-8ccef3773306 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:02.188115 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3747/7581] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:45:01 2022] DELETE /identity/v3/projects/6a524892c42243f3a5e202ca279e9493 => generated 0 bytes in 794 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:45:02.193458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c30bb7-037c-481e-883f-88e22af82cce None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:02.194550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c30bb7-037c-481e-883f-88e22af82cce None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:02.194550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c30bb7-037c-481e-883f-88e22af82cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:02.255611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-72c30bb7-037c-481e-883f-88e22af82cce None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:02.264582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-72c30bb7-037c-481e-883f-88e22af82cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:02.604391 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3835/7582] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:02.610121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acc4e2-0104-4c75-b601-7a683787bcf3 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:02.610584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acc4e2-0104-4c75-b601-7a683787bcf3 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:02.610682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acc4e2-0104-4c75-b601-7a683787bcf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:02.640386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b1acc4e2-0104-4c75-b601-7a683787bcf3 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:02.642206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b1acc4e2-0104-4c75-b601-7a683787bcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:02.653163 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3748/7583] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:02.657578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c30bb7-037c-481e-883f-88e22af82cce None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:02.671679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c30bb7-037c-481e-883f-88e22af82cce None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:02.697530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075e8ea-974b-4bf4-bc50-58cad29c1350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:02.698561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075e8ea-974b-4bf4-bc50-58cad29c1350 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:02.699057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075e8ea-974b-4bf4-bc50-58cad29c1350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:02.699742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075e8ea-974b-4bf4-bc50-58cad29c1350 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:02.700797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075e8ea-974b-4bf4-bc50-58cad29c1350 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:45:02.701202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075e8ea-974b-4bf4-bc50-58cad29c1350 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:02.702937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075e8ea-974b-4bf4-bc50-58cad29c1350 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:02.733241 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3836/7584] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:45:02.737678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1acc4e2-0104-4c75-b601-7a683787bcf3 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:02.760428 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1acc4e2-0104-4c75-b601-7a683787bcf3 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:02.789182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ec16b-8fb1-47a7-99ea-d8e45d9bdcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:02.791225 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ec16b-8fb1-47a7-99ea-d8e45d9bdcc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:02.791717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ec16b-8fb1-47a7-99ea-d8e45d9bdcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:02.792186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ec16b-8fb1-47a7-99ea-d8e45d9bdcc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:02.793004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ec16b-8fb1-47a7-99ea-d8e45d9bdcc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:02.795131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ec16b-8fb1-47a7-99ea-d8e45d9bdcc0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:02.871372 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3749/7585] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:45:02 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:45:02.872083 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075e8ea-974b-4bf4-bc50-58cad29c1350 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:02.885555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075e8ea-974b-4bf4-bc50-58cad29c1350 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:03.158103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da3e98-c29d-42bd-8f1e-2277d48a7557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:03.159098 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da3e98-c29d-42bd-8f1e-2277d48a7557 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:03.159616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da3e98-c29d-42bd-8f1e-2277d48a7557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:03.160358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da3e98-c29d-42bd-8f1e-2277d48a7557 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:03.161254 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da3e98-c29d-42bd-8f1e-2277d48a7557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:03.164455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da3e98-c29d-42bd-8f1e-2277d48a7557 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:03.208897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ec16b-8fb1-47a7-99ea-d8e45d9bdcc0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:03.226198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ec16b-8fb1-47a7-99ea-d8e45d9bdcc0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:03.226885 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3837/7586] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:45:02 2022] POST /identity/v3/users => generated 286 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:45:03.244928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3853785-d168-4740-a85d-8536d8212738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:03.245592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3853785-d168-4740-a85d-8536d8212738 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:03.245916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3853785-d168-4740-a85d-8536d8212738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:03.246245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3853785-d168-4740-a85d-8536d8212738 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:03.246987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3853785-d168-4740-a85d-8536d8212738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:03.249414 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3853785-d168-4740-a85d-8536d8212738 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:03.276894 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3750/7587] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:45:03.281557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da3e98-c29d-42bd-8f1e-2277d48a7557 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:03.294779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da3e98-c29d-42bd-8f1e-2277d48a7557 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:03.310111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3184728-97ad-44d4-b525-20994adf94d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:03.310747 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3184728-97ad-44d4-b525-20994adf94d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:03.311010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3184728-97ad-44d4-b525-20994adf94d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:03.311283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3184728-97ad-44d4-b525-20994adf94d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:03.311962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3184728-97ad-44d4-b525-20994adf94d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:03.313883 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3184728-97ad-44d4-b525-20994adf94d0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:03.343629 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3853785-d168-4740-a85d-8536d8212738 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:03.344277 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3838/7588] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:45:03.357914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3853785-d168-4740-a85d-8536d8212738 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:03.375398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e66e57-cc60-4fc4-9392-76d6c1d8e6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:03.376121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e66e57-cc60-4fc4-9392-76d6c1d8e6ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:03.376405 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e66e57-cc60-4fc4-9392-76d6c1d8e6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:03.376675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e66e57-cc60-4fc4-9392-76d6c1d8e6ca admin admin] PATH_INFO: `/v3/projects/325eaa3c5c9840b9aa7f466f690fe1ca/users/7b2c24fc11ac4826ae3cb94a407e2437/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:03.410210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e66e57-cc60-4fc4-9392-76d6c1d8e6ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=325eaa3c5c9840b9aa7f466f690fe1ca, user_id=7b2c24fc11ac4826ae3cb94a407e2437, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:03.413606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e66e57-cc60-4fc4-9392-76d6c1d8e6ca admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:03.454460 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3751/7589] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:45:03 2022] PUT /identity/v3/projects/325eaa3c5c9840b9aa7f466f690fe1ca/users/7b2c24fc11ac4826ae3cb94a407e2437/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:45:03.469000 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40651267-c7fb-4b35-98e9-6246c2bacff5 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:03.469543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40651267-c7fb-4b35-98e9-6246c2bacff5 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:03.469980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40651267-c7fb-4b35-98e9-6246c2bacff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:03.479697 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:03.522105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-40651267-c7fb-4b35-98e9-6246c2bacff5 None None] MFA Rules not processed for user `7b2c24fc11ac4826ae3cb94a407e2437`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:03.525732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-40651267-c7fb-4b35-98e9-6246c2bacff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:03.590897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e66e57-cc60-4fc4-9392-76d6c1d8e6ca admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:03.594150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-82e66e57-cc60-4fc4-9392-76d6c1d8e6ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:03.736652 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3839/7590] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:03.887117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e66e57-cc60-4fc4-9392-76d6c1d8e6ca admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:03.910654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2deffc-54c4-488b-b9d2-bc87728a0a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:03.911687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2deffc-54c4-488b-b9d2-bc87728a0a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:03.915416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2deffc-54c4-488b-b9d2-bc87728a0a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:03.915905 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2deffc-54c4-488b-b9d2-bc87728a0a2e admin admin] PATH_INFO: `/v3/projects/bfade6b5db234d7ea7e18b9733558579` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:03.920878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2deffc-54c4-488b-b9d2-bc87728a0a2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfade6b5db234d7ea7e18b9733558579)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:03.926698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2deffc-54c4-488b-b9d2-bc87728a0a2e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:04.026758 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:04.086420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ef2deffc-54c4-488b-b9d2-bc87728a0a2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfade6b5db234d7ea7e18b9733558579', 'request_id': 'req-ef2deffc-54c4-488b-b9d2-bc87728a0a2e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:04.094414 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ef2deffc-54c4-488b-b9d2-bc87728a0a2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfade6b5db234d7ea7e18b9733558579', 'request_id': 'req-ef2deffc-54c4-488b-b9d2-bc87728a0a2e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:04.102261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ef2deffc-54c4-488b-b9d2-bc87728a0a2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfade6b5db234d7ea7e18b9733558579', 'request_id': 'req-ef2deffc-54c4-488b-b9d2-bc87728a0a2e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:04.123121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ef2deffc-54c4-488b-b9d2-bc87728a0a2e admin admin] The token cache is being invalidate because project bfade6b5db234d7ea7e18b9733558579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:45:04.124518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ef2deffc-54c4-488b-b9d2-bc87728a0a2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:04.125856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ef2deffc-54c4-488b-b9d2-bc87728a0a2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:04.129109 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3752/7591] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:45:03 2022] DELETE /identity/v3/projects/bfade6b5db234d7ea7e18b9733558579 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:45:04.134915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf7c6c-2596-4c20-9857-707ae3b2ec07 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:04.135547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf7c6c-2596-4c20-9857-707ae3b2ec07 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:04.136007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf7c6c-2596-4c20-9857-707ae3b2ec07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:04.169464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a2bf7c6c-2596-4c20-9857-707ae3b2ec07 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:04.171353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a2bf7c6c-2596-4c20-9857-707ae3b2ec07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:04.184309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2deffc-54c4-488b-b9d2-bc87728a0a2e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:04.185943 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ef2deffc-54c4-488b-b9d2-bc87728a0a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:04.373572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2deffc-54c4-488b-b9d2-bc87728a0a2e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:04.391476 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3840/7592] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:04.393010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a6adc-a9ae-4ede-afa1-598c5f8e19b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:04.393882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a6adc-a9ae-4ede-afa1-598c5f8e19b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:04.394360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a6adc-a9ae-4ede-afa1-598c5f8e19b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:04.394752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a6adc-a9ae-4ede-afa1-598c5f8e19b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:04.400404 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d0bf8-3d6e-4ef2-b97a-c48ce42ad95e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:04.400600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-882a6adc-a9ae-4ede-afa1-598c5f8e19b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:04.401204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d0bf8-3d6e-4ef2-b97a-c48ce42ad95e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:04.407653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d0bf8-3d6e-4ef2-b97a-c48ce42ad95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:04.463828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-559d0bf8-3d6e-4ef2-b97a-c48ce42ad95e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:04.465368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-559d0bf8-3d6e-4ef2-b97a-c48ce42ad95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:04.485802 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3841/7593] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:04.491506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d0bf8-3d6e-4ef2-b97a-c48ce42ad95e None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:04.520267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d0bf8-3d6e-4ef2-b97a-c48ce42ad95e None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:04.556062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcddbf66-b40f-43bd-8dfb-fe04a02db181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:04.557556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddbf66-b40f-43bd-8dfb-fe04a02db181 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:04.557968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddbf66-b40f-43bd-8dfb-fe04a02db181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:04.558258 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcddbf66-b40f-43bd-8dfb-fe04a02db181 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:04.562474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcddbf66-b40f-43bd-8dfb-fe04a02db181 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:45:04.562785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcddbf66-b40f-43bd-8dfb-fe04a02db181 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:04.568650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcddbf66-b40f-43bd-8dfb-fe04a02db181 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:04.584806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a6adc-a9ae-4ede-afa1-598c5f8e19b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:04.586527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a6adc-a9ae-4ede-afa1-598c5f8e19b9 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:04.612222 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3842/7594] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:45:04.616999 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3753/7595] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:45:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:45:04.620906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcddbf66-b40f-43bd-8dfb-fe04a02db181 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:04.673485 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcddbf66-b40f-43bd-8dfb-fe04a02db181 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:04.758222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac465e-9951-4298-925e-aa2dccd77f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:04.759917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac465e-9951-4298-925e-aa2dccd77f62 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:04.760138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac465e-9951-4298-925e-aa2dccd77f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:04.760511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac465e-9951-4298-925e-aa2dccd77f62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:04.761031 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac465e-9951-4298-925e-aa2dccd77f62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:04.763020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac465e-9951-4298-925e-aa2dccd77f62 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:04.931865 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3843/7596] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:45:04 2022] POST /identity/v3/projects => generated 359 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:45:04.934272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a6adc-a9ae-4ede-afa1-598c5f8e19b9 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:04.956776 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a6adc-a9ae-4ede-afa1-598c5f8e19b9 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:05.081944 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed3eb7-0f6e-4da8-a663-f253f3e6d267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:05.082569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed3eb7-0f6e-4da8-a663-f253f3e6d267 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:05.082873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed3eb7-0f6e-4da8-a663-f253f3e6d267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:05.083138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed3eb7-0f6e-4da8-a663-f253f3e6d267 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:05.083770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed3eb7-0f6e-4da8-a663-f253f3e6d267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:05.086286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed3eb7-0f6e-4da8-a663-f253f3e6d267 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:05.113156 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:05.136264 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3754/7597] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:45:04 2022] POST /identity/v3/users => generated 280 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:45:05.138375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac465e-9951-4298-925e-aa2dccd77f62 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:05.165393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac465e-9951-4298-925e-aa2dccd77f62 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:05.173821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f1729-ccc7-4b02-b83c-b5a060b8ef3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:05.174286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f1729-ccc7-4b02-b83c-b5a060b8ef3a admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:05.174548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f1729-ccc7-4b02-b83c-b5a060b8ef3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:05.174822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f1729-ccc7-4b02-b83c-b5a060b8ef3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:05.175472 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f1729-ccc7-4b02-b83c-b5a060b8ef3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:05.177324 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f1729-ccc7-4b02-b83c-b5a060b8ef3a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:05.210308 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3844/7598] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:45:05.214322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed3eb7-0f6e-4da8-a663-f253f3e6d267 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:05.235917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed3eb7-0f6e-4da8-a663-f253f3e6d267 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:05.241246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7511d-697c-45ea-b516-bf631533dc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:05.241877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7511d-697c-45ea-b516-bf631533dc6b admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:05.242199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7511d-697c-45ea-b516-bf631533dc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:05.242471 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7511d-697c-45ea-b516-bf631533dc6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:05.243183 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7511d-697c-45ea-b516-bf631533dc6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:05.244863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7511d-697c-45ea-b516-bf631533dc6b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:05.258763 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3755/7599] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:45:05.262622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f1729-ccc7-4b02-b83c-b5a060b8ef3a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:05.277431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f1729-ccc7-4b02-b83c-b5a060b8ef3a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:05.296719 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8212e8-b967-4380-b33a-22d035eaa12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:05.297467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8212e8-b967-4380-b33a-22d035eaa12c admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:05.297749 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8212e8-b967-4380-b33a-22d035eaa12c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:05.298070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8212e8-b967-4380-b33a-22d035eaa12c admin admin] PATH_INFO: `/v3/projects/bc877231c83f4c918f60f1b9b9836fb9/users/e015883d51934723bef2082655569079/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:05.343023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8212e8-b967-4380-b33a-22d035eaa12c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc877231c83f4c918f60f1b9b9836fb9, user_id=e015883d51934723bef2082655569079, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:05.346947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8212e8-b967-4380-b33a-22d035eaa12c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:05.386149 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3845/7600] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:45:05 2022] PUT /identity/v3/projects/bc877231c83f4c918f60f1b9b9836fb9/users/e015883d51934723bef2082655569079/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:45:05.396695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fba44b-8caa-4d05-b6ac-bb9365609e69 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:05.397065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fba44b-8caa-4d05-b6ac-bb9365609e69 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:05.397440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fba44b-8caa-4d05-b6ac-bb9365609e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:05.421678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8212e8-b967-4380-b33a-22d035eaa12c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:05.423813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-af8212e8-b967-4380-b33a-22d035eaa12c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:05.480881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-77fba44b-8caa-4d05-b6ac-bb9365609e69 None None] MFA Rules not processed for user `e015883d51934723bef2082655569079`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:05.482132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-77fba44b-8caa-4d05-b6ac-bb9365609e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:05.509271 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:05.637904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8212e8-b967-4380-b33a-22d035eaa12c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:05.646703 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b36f23-f5f3-4716-af14-cdf83bd19337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:05.649571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b36f23-f5f3-4716-af14-cdf83bd19337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:05.650183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b36f23-f5f3-4716-af14-cdf83bd19337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:05.650743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b36f23-f5f3-4716-af14-cdf83bd19337 admin admin] PATH_INFO: `/v3/users/68324eedf5c840f4806f4c4ae410774f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:05.653436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b36f23-f5f3-4716-af14-cdf83bd19337 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68324eedf5c840f4806f4c4ae410774f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:05.656116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b36f23-f5f3-4716-af14-cdf83bd19337 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:05.685047 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3756/7601] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:05 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:05.690359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e9a85-1da5-405f-a3cb-d3bfc6dc9a87 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:05.690807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e9a85-1da5-405f-a3cb-d3bfc6dc9a87 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:05.691076 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e9a85-1da5-405f-a3cb-d3bfc6dc9a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:05.754067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a3b36f23-f5f3-4716-af14-cdf83bd19337 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68324eedf5c840f4806f4c4ae410774f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:05.758302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9b2e9a85-1da5-405f-a3cb-d3bfc6dc9a87 None None] MFA Rules not processed for user `e015883d51934723bef2082655569079`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:05.759764 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9b2e9a85-1da5-405f-a3cb-d3bfc6dc9a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:05.766732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a3b36f23-f5f3-4716-af14-cdf83bd19337 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68324eedf5c840f4806f4c4ae410774f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:05.769530 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3757/7602] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:05 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 01:45:05.774366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f6638-9f92-4b56-bbb4-e076eac5095e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:05.774906 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f6638-9f92-4b56-bbb4-e076eac5095e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:05.775358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f6638-9f92-4b56-bbb4-e076eac5095e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:05.805246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a3b36f23-f5f3-4716-af14-cdf83bd19337 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68324eedf5c840f4806f4c4ae410774f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:05.806290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a3b36f23-f5f3-4716-af14-cdf83bd19337 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68324eedf5c840f4806f4c4ae410774f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:05.821873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-993f6638-9f92-4b56-bbb4-e076eac5095e None None] MFA Rules not processed for user `e015883d51934723bef2082655569079`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:05.824426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a3b36f23-f5f3-4716-af14-cdf83bd19337 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68324eedf5c840f4806f4c4ae410774f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:05.825340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-993f6638-9f92-4b56-bbb4-e076eac5095e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:05.833325 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3846/7603] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:45:05 2022] DELETE /identity/v3/users/68324eedf5c840f4806f4c4ae410774f => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:45:05.837651 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3758/7604] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:05 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 07 01:45:05.839205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b36f23-f5f3-4716-af14-cdf83bd19337 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:05.841676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a3b36f23-f5f3-4716-af14-cdf83bd19337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:05.996724 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b36f23-f5f3-4716-af14-cdf83bd19337 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:06.002289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81533a8d-3888-4772-a57d-16ae4bb36537 tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e015883d51934723bef2082655569079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc877231c83f4c918f60f1b9b9836fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:06.002823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81533a8d-3888-4772-a57d-16ae4bb36537 tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] REQUEST_METHOD: `HEAD` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:06.003208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81533a8d-3888-4772-a57d-16ae4bb36537 tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:06.003683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81533a8d-3888-4772-a57d-16ae4bb36537 tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:06.012272 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81533a8d-3888-4772-a57d-16ae4bb36537 tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] RBAC: Authorizing `identity:check_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:06.014329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81533a8d-3888-4772-a57d-16ae4bb36537 tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:06.026666 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3847/7605] 10.222.0.39 () {56 vars in 1264 bytes} [Sun Aug 7 01:45:05 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Aug 07 01:45:06.028249 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f6638-9f92-4b56-bbb4-e076eac5095e None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:06.070922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f6638-9f92-4b56-bbb4-e076eac5095e None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:06.083432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed184716-f851-4448-98a0-29e96c7d11bd tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e015883d51934723bef2082655569079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc877231c83f4c918f60f1b9b9836fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:06.084249 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed184716-f851-4448-98a0-29e96c7d11bd tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:06.086197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed184716-f851-4448-98a0-29e96c7d11bd tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:06.086485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed184716-f851-4448-98a0-29e96c7d11bd tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:06.104030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed184716-f851-4448-98a0-29e96c7d11bd tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:06.107209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed184716-f851-4448-98a0-29e96c7d11bd tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:06.134883 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81533a8d-3888-4772-a57d-16ae4bb36537 tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:06.136948 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3759/7606] 10.222.0.39 () {56 vars in 1263 bytes} [Sun Aug 7 01:45:06 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 01:45:06.155960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81533a8d-3888-4772-a57d-16ae4bb36537 tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:06.172792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a414c44-d168-4acd-9748-0c0c4adb187b tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e015883d51934723bef2082655569079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc877231c83f4c918f60f1b9b9836fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:06.173436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a414c44-d168-4acd-9748-0c0c4adb187b tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:06.173701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a414c44-d168-4acd-9748-0c0c4adb187b tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:06.173977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a414c44-d168-4acd-9748-0c0c4adb187b tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:06.193647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a414c44-d168-4acd-9748-0c0c4adb187b tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:06.194702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a414c44-d168-4acd-9748-0c0c4adb187b tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:06.223114 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3848/7607] 10.222.0.39 () {56 vars in 1266 bytes} [Sun Aug 7 01:45:06 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:45:06.227608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed184716-f851-4448-98a0-29e96c7d11bd tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:06.244871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed184716-f851-4448-98a0-29e96c7d11bd tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:06.253010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173665a2-3965-4cbc-952f-b1dc41971085 tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e015883d51934723bef2082655569079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc877231c83f4c918f60f1b9b9836fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:06.253681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173665a2-3965-4cbc-952f-b1dc41971085 tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] REQUEST_METHOD: `HEAD` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:06.253940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173665a2-3965-4cbc-952f-b1dc41971085 tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:06.254216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173665a2-3965-4cbc-952f-b1dc41971085 tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:06.262020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-173665a2-3965-4cbc-952f-b1dc41971085 tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:06.286750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a414c44-d168-4acd-9748-0c0c4adb187b tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:06.289051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6a414c44-d168-4acd-9748-0c0c4adb187b tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:06.289217 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-173665a2-3965-4cbc-952f-b1dc41971085 tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 07 01:45:06.289217 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:45:06.289217 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:45:06.289217 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:45:06.289217 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:45:06.289217 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:45:06.289217 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:45:06.289217 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:45:06.289217 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:45:06.289217 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:45:06.289217 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:45:06.289217 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:45:06.289217 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Aug 07 01:45:06.289217 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Aug 07 01:45:06.289217 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Aug 07 01:45:06.290736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Aug 07 01:45:06.290736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Aug 07 01:45:06.290736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Aug 07 01:45:06.290736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:45:06.290736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:45:06.290736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 07 01:45:06.290736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 07 01:45:06.290736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 07 01:45:06.290736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 07 01:45:06.290736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:45:06.290736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:45:06.290736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 07 01:45:06.290736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 07 01:45:06.290736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:45:06.290736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:45:06.290736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 07 01:45:06.290736 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 07 01:45:06.292212 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:45:06.292212 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:45:06.292212 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 07 01:45:06.292212 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 07 01:45:06.292212 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 07 01:45:06.292212 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:45:06.295419 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3760/7608] 10.222.0.39 () {56 vars in 1264 bytes} [Sun Aug 7 01:45:06 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Aug 07 01:45:06.296944 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3db876-329e-433c-b851-1a76eae67061 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:06.301219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3db876-329e-433c-b851-1a76eae67061 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:06.301219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3db876-329e-433c-b851-1a76eae67061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:06.319972 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:06.384710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-dd3db876-329e-433c-b851-1a76eae67061 None None] MFA Rules not processed for user `e015883d51934723bef2082655569079`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:06.391300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-dd3db876-329e-433c-b851-1a76eae67061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:06.410149 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3761/7609] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:06 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 07 01:45:06.417038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3db876-329e-433c-b851-1a76eae67061 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:06.457237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3db876-329e-433c-b851-1a76eae67061 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:06.466318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01314b5-3165-4bf9-bd2b-2c2432b0f479 tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e015883d51934723bef2082655569079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc877231c83f4c918f60f1b9b9836fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:06.467077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01314b5-3165-4bf9-bd2b-2c2432b0f479 tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:06.467217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01314b5-3165-4bf9-bd2b-2c2432b0f479 tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:06.467477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01314b5-3165-4bf9-bd2b-2c2432b0f479 tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:06.474822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a414c44-d168-4acd-9748-0c0c4adb187b tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:06.478152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01314b5-3165-4bf9-bd2b-2c2432b0f479 tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:06.479951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01314b5-3165-4bf9-bd2b-2c2432b0f479 tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:06.488575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e123e-2d3d-4884-b227-c2c9fd6a5edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:06.489249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e123e-2d3d-4884-b227-c2c9fd6a5edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:06.489529 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e123e-2d3d-4884-b227-c2c9fd6a5edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:06.489794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e123e-2d3d-4884-b227-c2c9fd6a5edc admin admin] PATH_INFO: `/v3/projects/3139e77141f84e2485d2ba5d305f4ec7` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:06.493460 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3762/7610] 10.222.0.39 () {56 vars in 1263 bytes} [Sun Aug 7 01:45:06 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 07 01:45:06.494069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e123e-2d3d-4884-b227-c2c9fd6a5edc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3139e77141f84e2485d2ba5d305f4ec7)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:06.494383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01314b5-3165-4bf9-bd2b-2c2432b0f479 tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:06.496770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e123e-2d3d-4884-b227-c2c9fd6a5edc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:06.504283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01314b5-3165-4bf9-bd2b-2c2432b0f479 tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:06.512634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b03ff2-8d4a-471e-94ab-5859887005cb tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e015883d51934723bef2082655569079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc877231c83f4c918f60f1b9b9836fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:06.513265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b03ff2-8d4a-471e-94ab-5859887005cb tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:06.513546 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b03ff2-8d4a-471e-94ab-5859887005cb tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:06.513813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b03ff2-8d4a-471e-94ab-5859887005cb tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:06.527719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b03ff2-8d4a-471e-94ab-5859887005cb tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:06.529431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b03ff2-8d4a-471e-94ab-5859887005cb tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:06.564585 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3763/7611] 10.222.0.39 () {56 vars in 1266 bytes} [Sun Aug 7 01:45:06 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:45:06.568960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b03ff2-8d4a-471e-94ab-5859887005cb tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:06.604867 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b03ff2-8d4a-471e-94ab-5859887005cb tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:06.635104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c34e123e-2d3d-4884-b227-c2c9fd6a5edc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3139e77141f84e2485d2ba5d305f4ec7', 'request_id': 'req-c34e123e-2d3d-4884-b227-c2c9fd6a5edc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:06.649031 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c34e123e-2d3d-4884-b227-c2c9fd6a5edc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3139e77141f84e2485d2ba5d305f4ec7', 'request_id': 'req-c34e123e-2d3d-4884-b227-c2c9fd6a5edc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:06.661634 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c34e123e-2d3d-4884-b227-c2c9fd6a5edc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3139e77141f84e2485d2ba5d305f4ec7', 'request_id': 'req-c34e123e-2d3d-4884-b227-c2c9fd6a5edc'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:06.690373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c34e123e-2d3d-4884-b227-c2c9fd6a5edc admin admin] The token cache is being invalidate because project 3139e77141f84e2485d2ba5d305f4ec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:45:06.690722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c34e123e-2d3d-4884-b227-c2c9fd6a5edc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:06.691520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c34e123e-2d3d-4884-b227-c2c9fd6a5edc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:06.694581 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3849/7612] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:45:06 2022] DELETE /identity/v3/projects/3139e77141f84e2485d2ba5d305f4ec7 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:45:06.698711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e123e-2d3d-4884-b227-c2c9fd6a5edc admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:06.702670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c34e123e-2d3d-4884-b227-c2c9fd6a5edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:06.721141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90957d8a-d0d4-4978-a36c-5e142ee2a770 tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e015883d51934723bef2082655569079', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc877231c83f4c918f60f1b9b9836fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:06.721762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90957d8a-d0d4-4978-a36c-5e142ee2a770 tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:06.724549 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90957d8a-d0d4-4978-a36c-5e142ee2a770 tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:06.724851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90957d8a-d0d4-4978-a36c-5e142ee2a770 tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:06.732259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-90957d8a-d0d4-4978-a36c-5e142ee2a770 tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:06.765846 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application [None req-90957d8a-d0d4-4978-a36c-5e142ee2a770 tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Aug 07 01:45:06.765846 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 07 01:45:06.765846 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 07 01:45:06.765846 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 07 01:45:06.765846 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 07 01:45:06.765846 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 07 01:45:06.765846 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 07 01:45:06.765846 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 07 01:45:06.765846 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 07 01:45:06.765846 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 07 01:45:06.765846 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 07 01:45:06.765846 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 07 01:45:06.765846 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Aug 07 01:45:06.765846 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Aug 07 01:45:06.765846 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Aug 07 01:45:06.767389 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Aug 07 01:45:06.767389 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Aug 07 01:45:06.767389 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Aug 07 01:45:06.767389 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:45:06.767389 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:45:06.767389 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Aug 07 01:45:06.767389 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Aug 07 01:45:06.767389 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Aug 07 01:45:06.767389 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application self.check_revocation(token) Aug 07 01:45:06.767389 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:45:06.767389 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:45:06.767389 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Aug 07 01:45:06.767389 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Aug 07 01:45:06.767389 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:45:06.767389 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:45:06.767389 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Aug 07 01:45:06.767389 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Aug 07 01:45:06.768751 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 07 01:45:06.768751 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 07 01:45:06.768751 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Aug 07 01:45:06.768751 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Aug 07 01:45:06.768751 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Aug 07 01:45:06.768751 n-d-master-1 devstack@keystone.service[80493]: ERROR keystone.server.flask.application Aug 07 01:45:06.782188 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3764/7613] 10.222.0.39 () {56 vars in 1263 bytes} [Sun Aug 7 01:45:06 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 07 01:45:06.783591 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90957d8a-d0d4-4978-a36c-5e142ee2a770 tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:06.791327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-90957d8a-d0d4-4978-a36c-5e142ee2a770 tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:06.805417 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:06.901326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e123e-2d3d-4884-b227-c2c9fd6a5edc admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:06.916834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd7a3f-c851-4850-a48b-9a732b35ecfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:06.917775 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd7a3f-c851-4850-a48b-9a732b35ecfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:06.918205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd7a3f-c851-4850-a48b-9a732b35ecfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:06.918721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd7a3f-c851-4850-a48b-9a732b35ecfc admin admin] PATH_INFO: `/v3/users/b2335a63d136422fb118d46be7a01364` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:06.921337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd7a3f-c851-4850-a48b-9a732b35ecfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2335a63d136422fb118d46be7a01364)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:06.923455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd7a3f-c851-4850-a48b-9a732b35ecfc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:06.989759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90957d8a-d0d4-4978-a36c-5e142ee2a770 tempest-TokensV3Test-861332805 tempest-TokensV3Test-861332805-project] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:07.005691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef282339-f1b2-46f7-8582-0a6b57333a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:07.006907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef282339-f1b2-46f7-8582-0a6b57333a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:07.007194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef282339-f1b2-46f7-8582-0a6b57333a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:07.007453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef282339-f1b2-46f7-8582-0a6b57333a46 admin admin] PATH_INFO: `/v3/users/e015883d51934723bef2082655569079` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:07.009095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef282339-f1b2-46f7-8582-0a6b57333a46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e015883d51934723bef2082655569079)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:07.011280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef282339-f1b2-46f7-8582-0a6b57333a46 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:07.017792 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:07.019418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9abd7a3f-c851-4850-a48b-9a732b35ecfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2335a63d136422fb118d46be7a01364'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:07.041388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9abd7a3f-c851-4850-a48b-9a732b35ecfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2335a63d136422fb118d46be7a01364'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:07.075544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9abd7a3f-c851-4850-a48b-9a732b35ecfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2335a63d136422fb118d46be7a01364'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:07.076356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9abd7a3f-c851-4850-a48b-9a732b35ecfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2335a63d136422fb118d46be7a01364'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:07.086477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9abd7a3f-c851-4850-a48b-9a732b35ecfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2335a63d136422fb118d46be7a01364'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:07.106178 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3850/7614] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:45:06 2022] DELETE /identity/v3/users/b2335a63d136422fb118d46be7a01364 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:45:07.157396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ef282339-f1b2-46f7-8582-0a6b57333a46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e015883d51934723bef2082655569079'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:07.185107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ef282339-f1b2-46f7-8582-0a6b57333a46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e015883d51934723bef2082655569079'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:07.210475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ef282339-f1b2-46f7-8582-0a6b57333a46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e015883d51934723bef2082655569079'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:07.211310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ef282339-f1b2-46f7-8582-0a6b57333a46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e015883d51934723bef2082655569079'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:07.229828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ef282339-f1b2-46f7-8582-0a6b57333a46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e015883d51934723bef2082655569079'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:07.241800 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3765/7615] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:45:06 2022] DELETE /identity/v3/users/e015883d51934723bef2082655569079 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:45:07.246499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a408e-235a-456e-a040-923cdf641bed None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:07.246785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a408e-235a-456e-a040-923cdf641bed None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:07.247060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a408e-235a-456e-a040-923cdf641bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:07.278502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ff1a408e-235a-456e-a040-923cdf641bed None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:07.279731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ff1a408e-235a-456e-a040-923cdf641bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:07.450934 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3851/7616] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:07.472461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef282339-f1b2-46f7-8582-0a6b57333a46 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:07.474051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ef282339-f1b2-46f7-8582-0a6b57333a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:07.515919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a408e-235a-456e-a040-923cdf641bed None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:07.517414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ff1a408e-235a-456e-a040-923cdf641bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:07.553656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a408e-235a-456e-a040-923cdf641bed None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:07.579954 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44d2ac-9da4-4595-8660-5cfbec133fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:07.580624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44d2ac-9da4-4595-8660-5cfbec133fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:07.580902 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44d2ac-9da4-4595-8660-5cfbec133fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:07.581172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44d2ac-9da4-4595-8660-5cfbec133fd7 admin admin] PATH_INFO: `/v3/projects/70422b57cac5403c83e3ab1b59b8fc7c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:07.584873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44d2ac-9da4-4595-8660-5cfbec133fd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70422b57cac5403c83e3ab1b59b8fc7c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:07.586818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44d2ac-9da4-4595-8660-5cfbec133fd7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:07.658364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef282339-f1b2-46f7-8582-0a6b57333a46 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:07.669137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd76714-7b62-4171-a4a4-b893ab179afb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:07.670004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd76714-7b62-4171-a4a4-b893ab179afb service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:07.670482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd76714-7b62-4171-a4a4-b893ab179afb service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:07.670926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd76714-7b62-4171-a4a4-b893ab179afb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:07.693807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd76714-7b62-4171-a4a4-b893ab179afb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:07.695644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd76714-7b62-4171-a4a4-b893ab179afb service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:07.706832 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3766/7617] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:45:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:45:07.768972 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6d44d2ac-9da4-4595-8660-5cfbec133fd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70422b57cac5403c83e3ab1b59b8fc7c', 'request_id': 'req-6d44d2ac-9da4-4595-8660-5cfbec133fd7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:07.794803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6d44d2ac-9da4-4595-8660-5cfbec133fd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70422b57cac5403c83e3ab1b59b8fc7c', 'request_id': 'req-6d44d2ac-9da4-4595-8660-5cfbec133fd7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:07.814001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6d44d2ac-9da4-4595-8660-5cfbec133fd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70422b57cac5403c83e3ab1b59b8fc7c', 'request_id': 'req-6d44d2ac-9da4-4595-8660-5cfbec133fd7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:07.839528 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6d44d2ac-9da4-4595-8660-5cfbec133fd7 admin admin] The token cache is being invalidate because project 70422b57cac5403c83e3ab1b59b8fc7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:45:07.839828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6d44d2ac-9da4-4595-8660-5cfbec133fd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:07.848485 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6d44d2ac-9da4-4595-8660-5cfbec133fd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:07.850651 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3852/7618] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:45:07 2022] DELETE /identity/v3/projects/70422b57cac5403c83e3ab1b59b8fc7c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:45:08.369066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd76714-7b62-4171-a4a4-b893ab179afb service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:08.377354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6cd76714-7b62-4171-a4a4-b893ab179afb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:08.422874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd76714-7b62-4171-a4a4-b893ab179afb service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:08.453761 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:08.513990 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145184ea-caa4-469e-a134-8f3f7b68aff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:08.514711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145184ea-caa4-469e-a134-8f3f7b68aff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:08.514993 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145184ea-caa4-469e-a134-8f3f7b68aff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:08.515554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145184ea-caa4-469e-a134-8f3f7b68aff6 admin admin] PATH_INFO: `/v3/projects/bc877231c83f4c918f60f1b9b9836fb9` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:08.518398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145184ea-caa4-469e-a134-8f3f7b68aff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc877231c83f4c918f60f1b9b9836fb9)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:08.520770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145184ea-caa4-469e-a134-8f3f7b68aff6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:08.591805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-145184ea-caa4-469e-a134-8f3f7b68aff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc877231c83f4c918f60f1b9b9836fb9', 'request_id': 'req-145184ea-caa4-469e-a134-8f3f7b68aff6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:08.602195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-145184ea-caa4-469e-a134-8f3f7b68aff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc877231c83f4c918f60f1b9b9836fb9', 'request_id': 'req-145184ea-caa4-469e-a134-8f3f7b68aff6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:08.611191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-145184ea-caa4-469e-a134-8f3f7b68aff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc877231c83f4c918f60f1b9b9836fb9', 'request_id': 'req-145184ea-caa4-469e-a134-8f3f7b68aff6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:08.639751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-145184ea-caa4-469e-a134-8f3f7b68aff6 admin admin] The token cache is being invalidate because project bc877231c83f4c918f60f1b9b9836fb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:45:08.640349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-145184ea-caa4-469e-a134-8f3f7b68aff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:08.641599 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-145184ea-caa4-469e-a134-8f3f7b68aff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:08.644980 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3767/7619] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:45:08 2022] DELETE /identity/v3/projects/bc877231c83f4c918f60f1b9b9836fb9 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:45:08.650144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94310205-4d1c-41f3-a0bc-75240de8626d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:08.651002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94310205-4d1c-41f3-a0bc-75240de8626d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:08.651337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94310205-4d1c-41f3-a0bc-75240de8626d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:08.677745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-94310205-4d1c-41f3-a0bc-75240de8626d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:08.680041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-94310205-4d1c-41f3-a0bc-75240de8626d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:08.762240 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:08.789244 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3853/7620] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:08.798100 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730d658-4a63-40e0-af99-f747dfa2f318 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:08.798410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730d658-4a63-40e0-af99-f747dfa2f318 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:08.798690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730d658-4a63-40e0-af99-f747dfa2f318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:08.836039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9730d658-4a63-40e0-af99-f747dfa2f318 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:08.840076 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9730d658-4a63-40e0-af99-f747dfa2f318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:08.847548 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3768/7621] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:08.852222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94310205-4d1c-41f3-a0bc-75240de8626d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:08.866983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94310205-4d1c-41f3-a0bc-75240de8626d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:08.872115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b785b-cb59-44bf-88e8-bd03ec90aed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:08.873154 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b785b-cb59-44bf-88e8-bd03ec90aed4 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:08.873308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b785b-cb59-44bf-88e8-bd03ec90aed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:08.873740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b785b-cb59-44bf-88e8-bd03ec90aed4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:08.874581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b785b-cb59-44bf-88e8-bd03ec90aed4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:45:08.875708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b785b-cb59-44bf-88e8-bd03ec90aed4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:08.876781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b785b-cb59-44bf-88e8-bd03ec90aed4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:08.909503 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3854/7622] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:45:08.914156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730d658-4a63-40e0-af99-f747dfa2f318 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:08.931661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730d658-4a63-40e0-af99-f747dfa2f318 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:08.945387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa94c6-8c3d-41c8-be6c-a584aa47d3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:08.946415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa94c6-8c3d-41c8-be6c-a584aa47d3f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:08.946887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa94c6-8c3d-41c8-be6c-a584aa47d3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:08.947380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fa94c6-8c3d-41c8-be6c-a584aa47d3f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:08.948449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa94c6-8c3d-41c8-be6c-a584aa47d3f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:08.950918 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fa94c6-8c3d-41c8-be6c-a584aa47d3f3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:09.012655 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3769/7623] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:45:08 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:45:09.014064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b785b-cb59-44bf-88e8-bd03ec90aed4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:09.028380 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b785b-cb59-44bf-88e8-bd03ec90aed4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:09.143254 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012dcba6-a6c4-450c-a581-5d8bf4d3041c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:09.144555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dcba6-a6c4-450c-a581-5d8bf4d3041c admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:09.145216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dcba6-a6c4-450c-a581-5d8bf4d3041c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:09.145769 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dcba6-a6c4-450c-a581-5d8bf4d3041c admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:09.147297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012dcba6-a6c4-450c-a581-5d8bf4d3041c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:09.150401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012dcba6-a6c4-450c-a581-5d8bf4d3041c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:09.201685 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3855/7624] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:45:09 2022] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:45:09.205524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa94c6-8c3d-41c8-be6c-a584aa47d3f3 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:09.220601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fa94c6-8c3d-41c8-be6c-a584aa47d3f3 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:09.227723 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc1a7c-9839-403d-b3ac-c02536b5e9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:09.229545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc1a7c-9839-403d-b3ac-c02536b5e9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:09.230471 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc1a7c-9839-403d-b3ac-c02536b5e9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:09.230978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc1a7c-9839-403d-b3ac-c02536b5e9d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:09.231911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc1a7c-9839-403d-b3ac-c02536b5e9d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:09.233790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc1a7c-9839-403d-b3ac-c02536b5e9d4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:09.246713 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3770/7625] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:45:09.250545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012dcba6-a6c4-450c-a581-5d8bf4d3041c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:09.261934 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012dcba6-a6c4-450c-a581-5d8bf4d3041c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:09.267349 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f769505-4453-4d91-8852-6f92eeffe686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:09.267924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f769505-4453-4d91-8852-6f92eeffe686 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:09.268193 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f769505-4453-4d91-8852-6f92eeffe686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:09.268520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f769505-4453-4d91-8852-6f92eeffe686 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:09.269178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f769505-4453-4d91-8852-6f92eeffe686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:09.271004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f769505-4453-4d91-8852-6f92eeffe686 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:09.288482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc1a7c-9839-403d-b3ac-c02536b5e9d4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:09.289450 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3856/7626] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:45:09.299639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc1a7c-9839-403d-b3ac-c02536b5e9d4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:09.305006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b6654-bedf-4d58-bfed-76bebbc3b8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:09.305666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b6654-bedf-4d58-bfed-76bebbc3b8e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:09.305943 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b6654-bedf-4d58-bfed-76bebbc3b8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:09.306217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b6654-bedf-4d58-bfed-76bebbc3b8e4 admin admin] PATH_INFO: `/v3/projects/b33e862855ef450193a81af53765160e/users/bf1263aa83b8491390f8366b627ad164/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:09.324995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b6654-bedf-4d58-bfed-76bebbc3b8e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b33e862855ef450193a81af53765160e, user_id=bf1263aa83b8491390f8366b627ad164, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:09.328121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b6654-bedf-4d58-bfed-76bebbc3b8e4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:09.367313 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3771/7627] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:45:09 2022] PUT /identity/v3/projects/b33e862855ef450193a81af53765160e/users/bf1263aa83b8491390f8366b627ad164/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:45:09.370944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8058cef-bd27-4f67-8d9b-751fb6e879bb None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:09.371785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8058cef-bd27-4f67-8d9b-751fb6e879bb None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:09.372638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8058cef-bd27-4f67-8d9b-751fb6e879bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:09.429744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d8058cef-bd27-4f67-8d9b-751fb6e879bb None None] MFA Rules not processed for user `bf1263aa83b8491390f8366b627ad164`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:09.431987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d8058cef-bd27-4f67-8d9b-751fb6e879bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:09.534210 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3857/7628] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:09.540683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b6654-bedf-4d58-bfed-76bebbc3b8e4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:09.615437 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:09.630735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b6654-bedf-4d58-bfed-76bebbc3b8e4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:09.644699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266ff79-53a6-4df0-be8b-93fc597d01ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:09.646170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266ff79-53a6-4df0-be8b-93fc597d01ac admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:09.647548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266ff79-53a6-4df0-be8b-93fc597d01ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:09.648264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266ff79-53a6-4df0-be8b-93fc597d01ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:09.649702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266ff79-53a6-4df0-be8b-93fc597d01ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:09.653567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1266ff79-53a6-4df0-be8b-93fc597d01ac admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:09.743329 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3772/7629] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:45:09 2022] POST /identity/v3/projects => generated 377 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:45:09.743842 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8058cef-bd27-4f67-8d9b-751fb6e879bb None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:09.758074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8058cef-bd27-4f67-8d9b-751fb6e879bb None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:09.828818 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:09.852750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ce687-9c40-4f79-a815-f10da4bbb6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:09.853449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ce687-9c40-4f79-a815-f10da4bbb6ca admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:09.853731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ce687-9c40-4f79-a815-f10da4bbb6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:09.854006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ce687-9c40-4f79-a815-f10da4bbb6ca admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:09.854660 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ce687-9c40-4f79-a815-f10da4bbb6ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:09.862296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ce687-9c40-4f79-a815-f10da4bbb6ca admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:09.921052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266ff79-53a6-4df0-be8b-93fc597d01ac admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:09.932942 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3858/7630] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:45:09 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:45:09.945904 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266ff79-53a6-4df0-be8b-93fc597d01ac admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:09.959379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d215d-d6fb-4291-9e69-9daf416074ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:09.960455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d215d-d6fb-4291-9e69-9daf416074ca admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:09.960951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d215d-d6fb-4291-9e69-9daf416074ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:09.961436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d215d-d6fb-4291-9e69-9daf416074ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:09.962412 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d215d-d6fb-4291-9e69-9daf416074ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:09.965454 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d215d-d6fb-4291-9e69-9daf416074ca admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:09.991414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ce687-9c40-4f79-a815-f10da4bbb6ca admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:09.992894 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3773/7631] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:45:10.019930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ce687-9c40-4f79-a815-f10da4bbb6ca admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:10.028874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1418f9-bb6f-4896-a664-8cf02c18a012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:10.029931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1418f9-bb6f-4896-a664-8cf02c18a012 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:10.030506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1418f9-bb6f-4896-a664-8cf02c18a012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:10.031000 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1418f9-bb6f-4896-a664-8cf02c18a012 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:10.032516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1418f9-bb6f-4896-a664-8cf02c18a012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:10.035974 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1418f9-bb6f-4896-a664-8cf02c18a012 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:10.063817 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3859/7632] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:45:10.064766 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d215d-d6fb-4291-9e69-9daf416074ca admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:10.086632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d215d-d6fb-4291-9e69-9daf416074ca admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:10.096756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c1c18-c995-45f4-888d-ecfc959e7152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:10.098379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c1c18-c995-45f4-888d-ecfc959e7152 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:10.099416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c1c18-c995-45f4-888d-ecfc959e7152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:10.100332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c1c18-c995-45f4-888d-ecfc959e7152 admin admin] PATH_INFO: `/v3/projects/55394fbaa02f4ffea1fc1248acba33f3/users/379c2fd0c46e46779c80d48d98463af2/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:10.155091 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c1c18-c995-45f4-888d-ecfc959e7152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55394fbaa02f4ffea1fc1248acba33f3, user_id=379c2fd0c46e46779c80d48d98463af2, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:10.163268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c1c18-c995-45f4-888d-ecfc959e7152 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:10.222658 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3774/7633] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:45:10 2022] PUT /identity/v3/projects/55394fbaa02f4ffea1fc1248acba33f3/users/379c2fd0c46e46779c80d48d98463af2/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:45:10.242141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f99f98-6672-4b97-b7dd-bb3b0c438173 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:10.242595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f99f98-6672-4b97-b7dd-bb3b0c438173 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:10.243015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f99f98-6672-4b97-b7dd-bb3b0c438173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:10.314480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-13f99f98-6672-4b97-b7dd-bb3b0c438173 None None] MFA Rules not processed for user `379c2fd0c46e46779c80d48d98463af2`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:10.316582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-13f99f98-6672-4b97-b7dd-bb3b0c438173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:10.483197 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3860/7634] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:45:10.501647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c1c18-c995-45f4-888d-ecfc959e7152 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:10.507873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-da5c1c18-c995-45f4-888d-ecfc959e7152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:10.689866 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c1c18-c995-45f4-888d-ecfc959e7152 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:10.698785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13385a4c-7a1f-4343-a2c2-7c674a1601b2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:10.699409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13385a4c-7a1f-4343-a2c2-7c674a1601b2 service glance] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:10.699684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13385a4c-7a1f-4343-a2c2-7c674a1601b2 service glance] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:10.707508 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13385a4c-7a1f-4343-a2c2-7c674a1601b2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:10.852509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13385a4c-7a1f-4343-a2c2-7c674a1601b2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:10.855449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13385a4c-7a1f-4343-a2c2-7c674a1601b2 service glance] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:10.886115 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3775/7635] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:45:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:45:11.186065 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e01dfd-691f-4888-a20a-54590278fc87 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:11.186631 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e01dfd-691f-4888-a20a-54590278fc87 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:11.186869 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e01dfd-691f-4888-a20a-54590278fc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:11.336657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-23e01dfd-691f-4888-a20a-54590278fc87 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:11.338322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-23e01dfd-691f-4888-a20a-54590278fc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:11.515684 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3861/7636] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:45:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:11.572043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13385a4c-7a1f-4343-a2c2-7c674a1601b2 service glance] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:11.573697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-13385a4c-7a1f-4343-a2c2-7c674a1601b2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:11.672504 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:11.743363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13385a4c-7a1f-4343-a2c2-7c674a1601b2 service glance] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:11.751577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e962b3-7ff9-40e1-9ac1-f5afd52f594c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:11.752482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e962b3-7ff9-40e1-9ac1-f5afd52f594c service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:11.752935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e962b3-7ff9-40e1-9ac1-f5afd52f594c service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:11.753307 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e962b3-7ff9-40e1-9ac1-f5afd52f594c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:11.768966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e962b3-7ff9-40e1-9ac1-f5afd52f594c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:11.772808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e962b3-7ff9-40e1-9ac1-f5afd52f594c service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:11.807356 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3776/7637] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:45:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:45:12.186727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e01dfd-691f-4888-a20a-54590278fc87 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:12.190823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-23e01dfd-691f-4888-a20a-54590278fc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:12.237327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e01dfd-691f-4888-a20a-54590278fc87 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:12.248911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95729a-07f0-4958-a82e-9b623c1e44b9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:12.249200 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95729a-07f0-4958-a82e-9b623c1e44b9 service glance] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:12.249495 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95729a-07f0-4958-a82e-9b623c1e44b9 service glance] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:12.249769 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95729a-07f0-4958-a82e-9b623c1e44b9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:12.260978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e95729a-07f0-4958-a82e-9b623c1e44b9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:12.262646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e95729a-07f0-4958-a82e-9b623c1e44b9 service glance] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:12.268994 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:12.279000 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3862/7638] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:45:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:45:12.374513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968e826-cd41-4412-9b09-7762eb77a17b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:12.374818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968e826-cd41-4412-9b09-7762eb77a17b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:12.375096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968e826-cd41-4412-9b09-7762eb77a17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:12.413814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d968e826-cd41-4412-9b09-7762eb77a17b None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:12.415131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d968e826-cd41-4412-9b09-7762eb77a17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:12.439340 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3777/7639] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:45:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:12.457669 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95729a-07f0-4958-a82e-9b623c1e44b9 service glance] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:12.479507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95729a-07f0-4958-a82e-9b623c1e44b9 service glance] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:12.485441 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18759d-0e58-40dd-950c-273e44810f52 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:12.486072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18759d-0e58-40dd-950c-273e44810f52 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:12.486428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18759d-0e58-40dd-950c-273e44810f52 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:12.486689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18759d-0e58-40dd-950c-273e44810f52 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:12.500684 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18759d-0e58-40dd-950c-273e44810f52 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:12.503280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18759d-0e58-40dd-950c-273e44810f52 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:12.518091 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3863/7640] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:45:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:45:12.730664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968e826-cd41-4412-9b09-7762eb77a17b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:12.732203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18759d-0e58-40dd-950c-273e44810f52 service swift] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:12.733126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d968e826-cd41-4412-9b09-7762eb77a17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:12.869225 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968e826-cd41-4412-9b09-7762eb77a17b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:12.883854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc063e4d-8c9d-4116-a4d9-8ace20b8d1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:12.885118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc063e4d-8c9d-4116-a4d9-8ace20b8d1a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:12.885621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc063e4d-8c9d-4116-a4d9-8ace20b8d1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:12.886261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc063e4d-8c9d-4116-a4d9-8ace20b8d1a5 admin admin] PATH_INFO: `/v3/users/129623270c4242efbae8d862d31bc2a4` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:12.887944 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc063e4d-8c9d-4116-a4d9-8ace20b8d1a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=129623270c4242efbae8d862d31bc2a4)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:12.890136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc063e4d-8c9d-4116-a4d9-8ace20b8d1a5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:12.893185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18759d-0e58-40dd-950c-273e44810f52 service swift] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:12.906305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41da9c-6a47-4233-a6c4-db21250d41e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:12.912487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41da9c-6a47-4233-a6c4-db21250d41e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:12.912814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41da9c-6a47-4233-a6c4-db21250d41e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:12.913502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41da9c-6a47-4233-a6c4-db21250d41e7 admin admin] PATH_INFO: `/v3/users/bf1263aa83b8491390f8366b627ad164` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:12.914438 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41da9c-6a47-4233-a6c4-db21250d41e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf1263aa83b8491390f8366b627ad164)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:12.916430 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41da9c-6a47-4233-a6c4-db21250d41e7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:13.007565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fc063e4d-8c9d-4116-a4d9-8ace20b8d1a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '129623270c4242efbae8d862d31bc2a4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:13.040269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fc063e4d-8c9d-4116-a4d9-8ace20b8d1a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '129623270c4242efbae8d862d31bc2a4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:13.058378 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6e41da9c-6a47-4233-a6c4-db21250d41e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf1263aa83b8491390f8366b627ad164'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:13.079521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6e41da9c-6a47-4233-a6c4-db21250d41e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf1263aa83b8491390f8366b627ad164'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:13.087595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fc063e4d-8c9d-4116-a4d9-8ace20b8d1a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '129623270c4242efbae8d862d31bc2a4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:13.089763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fc063e4d-8c9d-4116-a4d9-8ace20b8d1a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '129623270c4242efbae8d862d31bc2a4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:13.107152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fc063e4d-8c9d-4116-a4d9-8ace20b8d1a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '129623270c4242efbae8d862d31bc2a4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:13.116570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6e41da9c-6a47-4233-a6c4-db21250d41e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf1263aa83b8491390f8366b627ad164'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:13.118828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6e41da9c-6a47-4233-a6c4-db21250d41e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf1263aa83b8491390f8366b627ad164'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:13.120894 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3778/7641] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:45:12 2022] DELETE /identity/v3/users/129623270c4242efbae8d862d31bc2a4 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:45:13.125852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e204243-f680-4c7d-9b70-ba39de50e58c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:13.126403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e204243-f680-4c7d-9b70-ba39de50e58c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:13.126903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e204243-f680-4c7d-9b70-ba39de50e58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:13.136190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6e41da9c-6a47-4233-a6c4-db21250d41e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf1263aa83b8491390f8366b627ad164'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:13.148127 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3864/7642] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:45:12 2022] DELETE /identity/v3/users/bf1263aa83b8491390f8366b627ad164 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:45:13.158945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcfde4-a35e-4971-a4cf-da456bccc8b6 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:13.162220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcfde4-a35e-4971-a4cf-da456bccc8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:13.162866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcfde4-a35e-4971-a4cf-da456bccc8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:13.180830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0e204243-f680-4c7d-9b70-ba39de50e58c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:13.183343 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0e204243-f680-4c7d-9b70-ba39de50e58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:13.207199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-91bcfde4-a35e-4971-a4cf-da456bccc8b6 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:13.211686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-91bcfde4-a35e-4971-a4cf-da456bccc8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:13.248939 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:13.349851 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3779/7643] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:13.390363 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3865/7644] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:13.424353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e204243-f680-4c7d-9b70-ba39de50e58c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:13.426117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0e204243-f680-4c7d-9b70-ba39de50e58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:13.433649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bcfde4-a35e-4971-a4cf-da456bccc8b6 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:13.435851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-91bcfde4-a35e-4971-a4cf-da456bccc8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:13.469655 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:13.613334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e204243-f680-4c7d-9b70-ba39de50e58c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:13.629124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bcfde4-a35e-4971-a4cf-da456bccc8b6 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:13.643469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf35e6-db0c-4fde-8099-51e3a624b53d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:13.644478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e79c0-bd32-42c8-a921-40974174afee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:13.645730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf35e6-db0c-4fde-8099-51e3a624b53d service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:13.646499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e79c0-bd32-42c8-a921-40974174afee service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:13.648010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf35e6-db0c-4fde-8099-51e3a624b53d service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:13.649897 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e79c0-bd32-42c8-a921-40974174afee service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:13.650300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf35e6-db0c-4fde-8099-51e3a624b53d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:13.650744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e79c0-bd32-42c8-a921-40974174afee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:13.697949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf35e6-db0c-4fde-8099-51e3a624b53d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:13.711952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e79c0-bd32-42c8-a921-40974174afee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:13.716310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e79c0-bd32-42c8-a921-40974174afee service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:13.726585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf35e6-db0c-4fde-8099-51e3a624b53d service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:13.751016 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3866/7645] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:45:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:45:13.767615 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3780/7646] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:45:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:45:14.720561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e79c0-bd32-42c8-a921-40974174afee service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:14.722181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f99e79c0-bd32-42c8-a921-40974174afee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:14.745876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e79c0-bd32-42c8-a921-40974174afee service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:14.763612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ff445-562c-4072-985a-555018ebc456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:14.764317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ff445-562c-4072-985a-555018ebc456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:14.764594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ff445-562c-4072-985a-555018ebc456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:14.764866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ff445-562c-4072-985a-555018ebc456 admin admin] PATH_INFO: `/v3/projects/b33e862855ef450193a81af53765160e` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:14.766077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ff445-562c-4072-985a-555018ebc456 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b33e862855ef450193a81af53765160e)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:14.768079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ff445-562c-4072-985a-555018ebc456 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:14.876022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-997ff445-562c-4072-985a-555018ebc456 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b33e862855ef450193a81af53765160e', 'request_id': 'req-997ff445-562c-4072-985a-555018ebc456'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:14.884003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-997ff445-562c-4072-985a-555018ebc456 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b33e862855ef450193a81af53765160e', 'request_id': 'req-997ff445-562c-4072-985a-555018ebc456'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:14.898980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-997ff445-562c-4072-985a-555018ebc456 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b33e862855ef450193a81af53765160e', 'request_id': 'req-997ff445-562c-4072-985a-555018ebc456'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:14.927121 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-997ff445-562c-4072-985a-555018ebc456 admin admin] The token cache is being invalidate because project b33e862855ef450193a81af53765160e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:45:14.927406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-997ff445-562c-4072-985a-555018ebc456 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:14.928305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-997ff445-562c-4072-985a-555018ebc456 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:14.932959 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3867/7647] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:45:14 2022] DELETE /identity/v3/projects/b33e862855ef450193a81af53765160e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:45:14.941566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf35e6-db0c-4fde-8099-51e3a624b53d service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:14.967509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf35e6-db0c-4fde-8099-51e3a624b53d service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:14.991553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ff445-562c-4072-985a-555018ebc456 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:14.993013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-997ff445-562c-4072-985a-555018ebc456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:15.072019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a441f-dd1c-4c07-bd7c-660c87560f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:15.074423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a441f-dd1c-4c07-bd7c-660c87560f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:15.074796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a441f-dd1c-4c07-bd7c-660c87560f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:15.075369 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a441f-dd1c-4c07-bd7c-660c87560f47 admin admin] PATH_INFO: `/v3/users/379c2fd0c46e46779c80d48d98463af2` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:15.077592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a441f-dd1c-4c07-bd7c-660c87560f47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=379c2fd0c46e46779c80d48d98463af2)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:15.080899 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a441f-dd1c-4c07-bd7c-660c87560f47 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:15.124635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ff445-562c-4072-985a-555018ebc456 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:15.138719 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e696864-80ea-4b0c-812a-5aafa0fa1e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:15.139854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e696864-80ea-4b0c-812a-5aafa0fa1e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:15.140378 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e696864-80ea-4b0c-812a-5aafa0fa1e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:15.140906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e696864-80ea-4b0c-812a-5aafa0fa1e72 admin admin] PATH_INFO: `/v3/projects/63c3006e54604cb19b1514d48dc3ff30` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:15.148534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e696864-80ea-4b0c-812a-5aafa0fa1e72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63c3006e54604cb19b1514d48dc3ff30)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:15.157665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e696864-80ea-4b0c-812a-5aafa0fa1e72 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:15.170414 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0c8a441f-dd1c-4c07-bd7c-660c87560f47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '379c2fd0c46e46779c80d48d98463af2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:15.191146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0c8a441f-dd1c-4c07-bd7c-660c87560f47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '379c2fd0c46e46779c80d48d98463af2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:15.223293 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0c8a441f-dd1c-4c07-bd7c-660c87560f47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '379c2fd0c46e46779c80d48d98463af2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:15.224935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0c8a441f-dd1c-4c07-bd7c-660c87560f47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '379c2fd0c46e46779c80d48d98463af2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:15.227167 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:15.235520 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:15.242961 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0c8a441f-dd1c-4c07-bd7c-660c87560f47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '379c2fd0c46e46779c80d48d98463af2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:15.260584 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3781/7648] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:45:14 2022] DELETE /identity/v3/users/379c2fd0c46e46779c80d48d98463af2 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:45:15.270127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0e696864-80ea-4b0c-812a-5aafa0fa1e72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63c3006e54604cb19b1514d48dc3ff30', 'request_id': 'req-0e696864-80ea-4b0c-812a-5aafa0fa1e72'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:15.287848 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0e696864-80ea-4b0c-812a-5aafa0fa1e72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63c3006e54604cb19b1514d48dc3ff30', 'request_id': 'req-0e696864-80ea-4b0c-812a-5aafa0fa1e72'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:15.297155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0e696864-80ea-4b0c-812a-5aafa0fa1e72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63c3006e54604cb19b1514d48dc3ff30', 'request_id': 'req-0e696864-80ea-4b0c-812a-5aafa0fa1e72'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:15.320208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0e696864-80ea-4b0c-812a-5aafa0fa1e72 admin admin] The token cache is being invalidate because project 63c3006e54604cb19b1514d48dc3ff30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:45:15.320608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0e696864-80ea-4b0c-812a-5aafa0fa1e72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:15.321345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0e696864-80ea-4b0c-812a-5aafa0fa1e72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:15.324436 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3868/7649] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:45:14 2022] DELETE /identity/v3/projects/63c3006e54604cb19b1514d48dc3ff30 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:45:15.329878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a441f-dd1c-4c07-bd7c-660c87560f47 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:15.332169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0c8a441f-dd1c-4c07-bd7c-660c87560f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:15.471534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a441f-dd1c-4c07-bd7c-660c87560f47 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:15.487096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b17c45-8a60-407c-ba39-231f4d8e6e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:15.490977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b17c45-8a60-407c-ba39-231f4d8e6e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:15.491264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b17c45-8a60-407c-ba39-231f4d8e6e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:15.491539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b17c45-8a60-407c-ba39-231f4d8e6e78 admin admin] PATH_INFO: `/v3/users/5dc0a4220f0a4e36937cf4589286bdd4` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:15.496340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b17c45-8a60-407c-ba39-231f4d8e6e78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dc0a4220f0a4e36937cf4589286bdd4)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:15.500865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b17c45-8a60-407c-ba39-231f4d8e6e78 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:15.592454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e696864-80ea-4b0c-812a-5aafa0fa1e72 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:15.594768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0e696864-80ea-4b0c-812a-5aafa0fa1e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:15.644604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-89b17c45-8a60-407c-ba39-231f4d8e6e78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dc0a4220f0a4e36937cf4589286bdd4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:15.657426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-89b17c45-8a60-407c-ba39-231f4d8e6e78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dc0a4220f0a4e36937cf4589286bdd4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:15.671328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-89b17c45-8a60-407c-ba39-231f4d8e6e78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dc0a4220f0a4e36937cf4589286bdd4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:15.672117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-89b17c45-8a60-407c-ba39-231f4d8e6e78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dc0a4220f0a4e36937cf4589286bdd4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:15.681828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-89b17c45-8a60-407c-ba39-231f4d8e6e78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dc0a4220f0a4e36937cf4589286bdd4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:15.692338 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3782/7650] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:45:15 2022] DELETE /identity/v3/users/5dc0a4220f0a4e36937cf4589286bdd4 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:45:15.843305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e696864-80ea-4b0c-812a-5aafa0fa1e72 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:15.953615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61302f27-dbde-4877-8e19-e9a80d636d8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:15.954381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61302f27-dbde-4877-8e19-e9a80d636d8a service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:15.954662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61302f27-dbde-4877-8e19-e9a80d636d8a service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:15.954932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61302f27-dbde-4877-8e19-e9a80d636d8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:15.957077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-61302f27-dbde-4877-8e19-e9a80d636d8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:15.971134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b17c45-8a60-407c-ba39-231f4d8e6e78 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:15.972617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-89b17c45-8a60-407c-ba39-231f4d8e6e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:16.015832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61302f27-dbde-4877-8e19-e9a80d636d8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:16.017998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61302f27-dbde-4877-8e19-e9a80d636d8a service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:16.073826 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3869/7651] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:45:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:45:16.160596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b17c45-8a60-407c-ba39-231f4d8e6e78 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:16.168939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cceb4f-95ac-42c6-8ef9-21c928c6f634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:16.169613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cceb4f-95ac-42c6-8ef9-21c928c6f634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:16.170031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cceb4f-95ac-42c6-8ef9-21c928c6f634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:16.170426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cceb4f-95ac-42c6-8ef9-21c928c6f634 admin admin] PATH_INFO: `/v3/projects/55394fbaa02f4ffea1fc1248acba33f3` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:16.173607 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cceb4f-95ac-42c6-8ef9-21c928c6f634 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55394fbaa02f4ffea1fc1248acba33f3)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:16.179581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cceb4f-95ac-42c6-8ef9-21c928c6f634 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:16.196354 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:16.262859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-34cceb4f-95ac-42c6-8ef9-21c928c6f634 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55394fbaa02f4ffea1fc1248acba33f3', 'request_id': 'req-34cceb4f-95ac-42c6-8ef9-21c928c6f634'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:16.277602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-34cceb4f-95ac-42c6-8ef9-21c928c6f634 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55394fbaa02f4ffea1fc1248acba33f3', 'request_id': 'req-34cceb4f-95ac-42c6-8ef9-21c928c6f634'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:16.291782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-34cceb4f-95ac-42c6-8ef9-21c928c6f634 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55394fbaa02f4ffea1fc1248acba33f3', 'request_id': 'req-34cceb4f-95ac-42c6-8ef9-21c928c6f634'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:16.314309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-34cceb4f-95ac-42c6-8ef9-21c928c6f634 admin admin] The token cache is being invalidate because project 55394fbaa02f4ffea1fc1248acba33f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:45:16.314604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-34cceb4f-95ac-42c6-8ef9-21c928c6f634 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:16.315336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-34cceb4f-95ac-42c6-8ef9-21c928c6f634 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:16.319171 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3783/7652] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:45:15 2022] DELETE /identity/v3/projects/55394fbaa02f4ffea1fc1248acba33f3 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:45:16.326426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24be5d-8c6b-4bd6-9d80-bca8ce32aabe None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:16.326647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24be5d-8c6b-4bd6-9d80-bca8ce32aabe None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:16.327054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24be5d-8c6b-4bd6-9d80-bca8ce32aabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:16.367085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ad24be5d-8c6b-4bd6-9d80-bca8ce32aabe None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:16.368513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ad24be5d-8c6b-4bd6-9d80-bca8ce32aabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:16.429906 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:16.468357 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3870/7653] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:16.478217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d949d-1e9e-4c42-986d-1b851683c342 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:16.478520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d949d-1e9e-4c42-986d-1b851683c342 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:16.478769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12d949d-1e9e-4c42-986d-1b851683c342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:16.499819 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24be5d-8c6b-4bd6-9d80-bca8ce32aabe None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:16.501404 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ad24be5d-8c6b-4bd6-9d80-bca8ce32aabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:16.531089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24be5d-8c6b-4bd6-9d80-bca8ce32aabe None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:16.534644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b12d949d-1e9e-4c42-986d-1b851683c342 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:16.535861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b12d949d-1e9e-4c42-986d-1b851683c342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:16.545711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd627eb-f3df-40b9-82fe-90193278f920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:16.546247 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd627eb-f3df-40b9-82fe-90193278f920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:16.549089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd627eb-f3df-40b9-82fe-90193278f920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:16.549349 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd627eb-f3df-40b9-82fe-90193278f920 admin admin] PATH_INFO: `/v3/projects/b07dbdc387eb41b69eb2b533f6c2a785` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:16.553439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd627eb-f3df-40b9-82fe-90193278f920 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b07dbdc387eb41b69eb2b533f6c2a785)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:16.557634 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd627eb-f3df-40b9-82fe-90193278f920 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:16.562086 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3784/7654] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:16.565921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d949d-1e9e-4c42-986d-1b851683c342 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:16.589671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12d949d-1e9e-4c42-986d-1b851683c342 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:16.601281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cebfaa8-bc88-4c4f-a95d-93acf9d93800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:16.601914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebfaa8-bc88-4c4f-a95d-93acf9d93800 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:16.602188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebfaa8-bc88-4c4f-a95d-93acf9d93800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:16.602459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebfaa8-bc88-4c4f-a95d-93acf9d93800 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:16.603124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cebfaa8-bc88-4c4f-a95d-93acf9d93800 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:45:16.603426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cebfaa8-bc88-4c4f-a95d-93acf9d93800 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:16.607313 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cebfaa8-bc88-4c4f-a95d-93acf9d93800 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:16.644212 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3785/7655] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:45:16.648727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cebfaa8-bc88-4c4f-a95d-93acf9d93800 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:16.674784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cebfaa8-bc88-4c4f-a95d-93acf9d93800 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:16.713336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6bd627eb-f3df-40b9-82fe-90193278f920 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b07dbdc387eb41b69eb2b533f6c2a785', 'request_id': 'req-6bd627eb-f3df-40b9-82fe-90193278f920'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:16.726468 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6bd627eb-f3df-40b9-82fe-90193278f920 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b07dbdc387eb41b69eb2b533f6c2a785', 'request_id': 'req-6bd627eb-f3df-40b9-82fe-90193278f920'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:16.737829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6bd627eb-f3df-40b9-82fe-90193278f920 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b07dbdc387eb41b69eb2b533f6c2a785', 'request_id': 'req-6bd627eb-f3df-40b9-82fe-90193278f920'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:16.765182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6bd627eb-f3df-40b9-82fe-90193278f920 admin admin] The token cache is being invalidate because project b07dbdc387eb41b69eb2b533f6c2a785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:45:16.765484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6bd627eb-f3df-40b9-82fe-90193278f920 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:16.768978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6bd627eb-f3df-40b9-82fe-90193278f920 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:16.772454 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3871/7656] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:45:16 2022] DELETE /identity/v3/projects/b07dbdc387eb41b69eb2b533f6c2a785 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:45:16.779219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66750d44-7bf8-466b-86a2-a20795bd6807 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:16.779567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66750d44-7bf8-466b-86a2-a20795bd6807 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:16.779806 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66750d44-7bf8-466b-86a2-a20795bd6807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:16.800749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f124040-6f79-4561-aaa5-e8a3287620d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:16.801688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f124040-6f79-4561-aaa5-e8a3287620d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:16.802181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f124040-6f79-4561-aaa5-e8a3287620d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:16.803180 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f124040-6f79-4561-aaa5-e8a3287620d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:16.804024 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f124040-6f79-4561-aaa5-e8a3287620d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:16.806169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f124040-6f79-4561-aaa5-e8a3287620d5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:16.830299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-66750d44-7bf8-466b-86a2-a20795bd6807 None None] MFA Rules not processed for user `84e60500a5354328990e61423f46f381`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:16.831760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-66750d44-7bf8-466b-86a2-a20795bd6807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:16.845565 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3786/7657] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:45:16 2022] POST /identity/v3/projects => generated 367 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:45:16.847280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c035c-b77f-405f-be1e-f3aeba483faa None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:16.847810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c035c-b77f-405f-be1e-f3aeba483faa None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:16.848363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c035c-b77f-405f-be1e-f3aeba483faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:16.874860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-516c035c-b77f-405f-be1e-f3aeba483faa None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:16.877324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-516c035c-b77f-405f-be1e-f3aeba483faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:16.965664 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3787/7658] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:16.967428 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c035c-b77f-405f-be1e-f3aeba483faa None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:16.975011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-516c035c-b77f-405f-be1e-f3aeba483faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:16.992009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c035c-b77f-405f-be1e-f3aeba483faa None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:16.998028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c434a-f5b0-4a85-b152-4a3fe45fd584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:16.998724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c434a-f5b0-4a85-b152-4a3fe45fd584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:16.999534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c434a-f5b0-4a85-b152-4a3fe45fd584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:16.999838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c434a-f5b0-4a85-b152-4a3fe45fd584 admin admin] PATH_INFO: `/v3/users/0d3a0af53f1243faafa179817e84a09f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:17.001560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c434a-f5b0-4a85-b152-4a3fe45fd584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d3a0af53f1243faafa179817e84a09f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:17.004474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c434a-f5b0-4a85-b152-4a3fe45fd584 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:17.009300 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3872/7659] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:17.009300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66750d44-7bf8-466b-86a2-a20795bd6807 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:17.011235 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:17.024505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-66750d44-7bf8-466b-86a2-a20795bd6807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:17.057540 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66750d44-7bf8-466b-86a2-a20795bd6807 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:17.080989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22769fca-bd4c-4c62-83e5-9fcea72d4480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:17.082393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22769fca-bd4c-4c62-83e5-9fcea72d4480 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:17.083633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22769fca-bd4c-4c62-83e5-9fcea72d4480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:17.085054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22769fca-bd4c-4c62-83e5-9fcea72d4480 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:17.085609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-671c434a-f5b0-4a85-b152-4a3fe45fd584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d3a0af53f1243faafa179817e84a09f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:17.086357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22769fca-bd4c-4c62-83e5-9fcea72d4480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:17.092773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22769fca-bd4c-4c62-83e5-9fcea72d4480 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:17.103987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-671c434a-f5b0-4a85-b152-4a3fe45fd584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d3a0af53f1243faafa179817e84a09f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:17.137975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-671c434a-f5b0-4a85-b152-4a3fe45fd584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d3a0af53f1243faafa179817e84a09f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:17.140243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-671c434a-f5b0-4a85-b152-4a3fe45fd584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d3a0af53f1243faafa179817e84a09f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:17.147233 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3873/7660] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:45:17 2022] POST /identity/v3/users => generated 284 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:45:17.149879 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cf2ae-7999-40cf-aece-c892d6c9ea0f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:17.150325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cf2ae-7999-40cf-aece-c892d6c9ea0f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:17.150879 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cf2ae-7999-40cf-aece-c892d6c9ea0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:17.155740 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-671c434a-f5b0-4a85-b152-4a3fe45fd584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d3a0af53f1243faafa179817e84a09f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:17.169510 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3788/7661] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:45:16 2022] DELETE /identity/v3/users/0d3a0af53f1243faafa179817e84a09f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:45:17.175687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c434a-f5b0-4a85-b152-4a3fe45fd584 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:17.182637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-671c434a-f5b0-4a85-b152-4a3fe45fd584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:17.204269 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-4c1cf2ae-7999-40cf-aece-c892d6c9ea0f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:17.205833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4c1cf2ae-7999-40cf-aece-c892d6c9ea0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:17.257431 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:17.305001 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3874/7662] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:17.307633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce8d00-1054-4b1c-a5a2-ff205761d71c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:17.310327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce8d00-1054-4b1c-a5a2-ff205761d71c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:17.311108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce8d00-1054-4b1c-a5a2-ff205761d71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:17.368352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d3ce8d00-1054-4b1c-a5a2-ff205761d71c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:17.369965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d3ce8d00-1054-4b1c-a5a2-ff205761d71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:17.370156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c434a-f5b0-4a85-b152-4a3fe45fd584 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:17.376383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee3502-28a4-419b-aa1e-c1f54874925c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:17.377349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee3502-28a4-419b-aa1e-c1f54874925c admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:17.377766 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee3502-28a4-419b-aa1e-c1f54874925c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:17.378106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee3502-28a4-419b-aa1e-c1f54874925c admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:17.381461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee3502-28a4-419b-aa1e-c1f54874925c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:17.383906 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee3502-28a4-419b-aa1e-c1f54874925c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:17.397673 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3789/7663] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:45:17.398604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee3502-28a4-419b-aa1e-c1f54874925c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:17.413208 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3875/7664] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:17.418774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce8d00-1054-4b1c-a5a2-ff205761d71c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:17.441709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee3502-28a4-419b-aa1e-c1f54874925c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:17.450870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce8d00-1054-4b1c-a5a2-ff205761d71c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:17.454393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2de8ee-e156-4656-870c-af28840bae3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:17.455387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2de8ee-e156-4656-870c-af28840bae3f admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:17.455849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2de8ee-e156-4656-870c-af28840bae3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:17.456791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2de8ee-e156-4656-870c-af28840bae3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:17.458207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2de8ee-e156-4656-870c-af28840bae3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:45:17.459656 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2de8ee-e156-4656-870c-af28840bae3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:17.464269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2de8ee-e156-4656-870c-af28840bae3f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:17.465004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc012f-3722-4c18-b948-9c80eb61e5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:17.468153 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc012f-3722-4c18-b948-9c80eb61e5ca admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:17.468806 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc012f-3722-4c18-b948-9c80eb61e5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:17.468988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc012f-3722-4c18-b948-9c80eb61e5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:17.470495 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc012f-3722-4c18-b948-9c80eb61e5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:17.476304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc012f-3722-4c18-b948-9c80eb61e5ca admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:17.505926 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3790/7665] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:45:17.505926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2de8ee-e156-4656-870c-af28840bae3f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:17.508871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-fb2de8ee-e156-4656-870c-af28840bae3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:17.513400 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3876/7666] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:45:17.515530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc012f-3722-4c18-b948-9c80eb61e5ca admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:17.539158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc012f-3722-4c18-b948-9c80eb61e5ca admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:17.554745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870218a-96c0-4d54-8773-6e480661c241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:17.555771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870218a-96c0-4d54-8773-6e480661c241 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:17.556280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870218a-96c0-4d54-8773-6e480661c241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:17.556754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870218a-96c0-4d54-8773-6e480661c241 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:17.557590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5870218a-96c0-4d54-8773-6e480661c241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:17.559775 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5870218a-96c0-4d54-8773-6e480661c241 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:17.592574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2de8ee-e156-4656-870c-af28840bae3f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:17.597543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e699c3-6f67-4f5b-9a4e-fd43a7e38577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:17.598335 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e699c3-6f67-4f5b-9a4e-fd43a7e38577 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:17.598670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e699c3-6f67-4f5b-9a4e-fd43a7e38577 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:17.599095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e699c3-6f67-4f5b-9a4e-fd43a7e38577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:17.615206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e699c3-6f67-4f5b-9a4e-fd43a7e38577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:17.617098 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e699c3-6f67-4f5b-9a4e-fd43a7e38577 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:17.631435 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3791/7667] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:45:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:45:17.632729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e699c3-6f67-4f5b-9a4e-fd43a7e38577 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:17.639177 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:17.642647 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3877/7668] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:45:17 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:45:17.647826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870218a-96c0-4d54-8773-6e480661c241 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:17.651077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e699c3-6f67-4f5b-9a4e-fd43a7e38577 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:17.779567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870218a-96c0-4d54-8773-6e480661c241 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:17.783040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd52ff-18bf-4c2e-a28b-9afc3eb6e595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:17.784045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd52ff-18bf-4c2e-a28b-9afc3eb6e595 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:17.784322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd52ff-18bf-4c2e-a28b-9afc3eb6e595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:17.784597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd52ff-18bf-4c2e-a28b-9afc3eb6e595 admin admin] PATH_INFO: `/v3/projects/f14fc725506e4929bd76c98702cb77b9/users/21f54369cc834e38829bf69b23438aea/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:17.789157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb5ae0-b8e0-483f-8448-8c8999e57f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:17.791469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb5ae0-b8e0-483f-8448-8c8999e57f0d admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:17.792153 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb5ae0-b8e0-483f-8448-8c8999e57f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:17.792688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb5ae0-b8e0-483f-8448-8c8999e57f0d admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:17.793753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb5ae0-b8e0-483f-8448-8c8999e57f0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:17.796859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb5ae0-b8e0-483f-8448-8c8999e57f0d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:17.820923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd52ff-18bf-4c2e-a28b-9afc3eb6e595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f14fc725506e4929bd76c98702cb77b9, user_id=21f54369cc834e38829bf69b23438aea, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:17.823505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd52ff-18bf-4c2e-a28b-9afc3eb6e595 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:17.848842 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3792/7669] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:45:17 2022] PUT /identity/v3/projects/f14fc725506e4929bd76c98702cb77b9/users/21f54369cc834e38829bf69b23438aea/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:45:17.850056 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3878/7670] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:45:17 2022] POST /identity/v3/users => generated 288 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:45:17.851205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd52ff-18bf-4c2e-a28b-9afc3eb6e595 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:17.857496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a90cb2-4406-4936-b4b3-a41fe2c35f23 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:17.857741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a90cb2-4406-4936-b4b3-a41fe2c35f23 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:17.858078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a90cb2-4406-4936-b4b3-a41fe2c35f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:17.933673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-41a90cb2-4406-4936-b4b3-a41fe2c35f23 None None] MFA Rules not processed for user `21f54369cc834e38829bf69b23438aea`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:17.935069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-41a90cb2-4406-4936-b4b3-a41fe2c35f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:18.019632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd52ff-18bf-4c2e-a28b-9afc3eb6e595 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:18.025298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03b0db-1192-4065-b107-afa5d1f127e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:18.026085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03b0db-1192-4065-b107-afa5d1f127e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:18.026265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03b0db-1192-4065-b107-afa5d1f127e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:18.026541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03b0db-1192-4065-b107-afa5d1f127e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:18.027348 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03b0db-1192-4065-b107-afa5d1f127e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:18.029251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03b0db-1192-4065-b107-afa5d1f127e9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:18.041579 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3793/7671] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:45:18.046407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03b0db-1192-4065-b107-afa5d1f127e9 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:18.060765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03b0db-1192-4065-b107-afa5d1f127e9 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:18.066555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd1b36-3b0f-4c27-ac97-ab81267c93f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:18.067180 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd1b36-3b0f-4c27-ac97-ab81267c93f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:18.067592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd1b36-3b0f-4c27-ac97-ab81267c93f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:18.067863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd1b36-3b0f-4c27-ac97-ab81267c93f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:18.069360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd1b36-3b0f-4c27-ac97-ab81267c93f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:18.071057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd1b36-3b0f-4c27-ac97-ab81267c93f0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:18.087915 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3794/7672] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:45:18.089061 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd1b36-3b0f-4c27-ac97-ab81267c93f0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:18.101629 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd1b36-3b0f-4c27-ac97-ab81267c93f0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:18.110488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546890ea-62c8-465d-8f35-ad725f2490f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:18.111064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546890ea-62c8-465d-8f35-ad725f2490f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:18.114252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546890ea-62c8-465d-8f35-ad725f2490f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:18.114543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546890ea-62c8-465d-8f35-ad725f2490f7 admin admin] PATH_INFO: `/v3/projects/07715d440b3841849359a228245c6d94/users/9359013ce46147aaac9355a2c7fab95b/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:18.129349 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3879/7673] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:18.136674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a90cb2-4406-4936-b4b3-a41fe2c35f23 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:18.158664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546890ea-62c8-465d-8f35-ad725f2490f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07715d440b3841849359a228245c6d94, user_id=9359013ce46147aaac9355a2c7fab95b, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:18.161413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a90cb2-4406-4936-b4b3-a41fe2c35f23 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:18.164211 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546890ea-62c8-465d-8f35-ad725f2490f7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:18.179142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe13ae-2618-43ab-a55e-fd4179ce7c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:18.181517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe13ae-2618-43ab-a55e-fd4179ce7c2d admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:18.181986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe13ae-2618-43ab-a55e-fd4179ce7c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:18.183202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe13ae-2618-43ab-a55e-fd4179ce7c2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:18.185151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe13ae-2618-43ab-a55e-fd4179ce7c2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:18.191937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe13ae-2618-43ab-a55e-fd4179ce7c2d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:18.204689 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3795/7674] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:45:18 2022] PUT /identity/v3/projects/07715d440b3841849359a228245c6d94/users/9359013ce46147aaac9355a2c7fab95b/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:45:18.207653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c2c1f-61be-4877-92eb-11269e3522c7 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:18.209712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c2c1f-61be-4877-92eb-11269e3522c7 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:18.209967 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c2c1f-61be-4877-92eb-11269e3522c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:18.257775 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:18.274806 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3880/7675] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:45:18 2022] POST /identity/v3/projects => generated 367 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:45:18.277704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe13ae-2618-43ab-a55e-fd4179ce7c2d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:18.298259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-706c2c1f-61be-4877-92eb-11269e3522c7 None None] MFA Rules not processed for user `9359013ce46147aaac9355a2c7fab95b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:18.299501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-706c2c1f-61be-4877-92eb-11269e3522c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:18.424001 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:18.499568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe13ae-2618-43ab-a55e-fd4179ce7c2d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:18.529774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708cceb-ee60-4275-8228-cac8094707b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:18.530243 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3796/7676] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:18.530463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708cceb-ee60-4275-8228-cac8094707b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:18.530687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708cceb-ee60-4275-8228-cac8094707b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:18.530956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708cceb-ee60-4275-8228-cac8094707b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:18.531964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708cceb-ee60-4275-8228-cac8094707b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:18.534266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708cceb-ee60-4275-8228-cac8094707b0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:18.537773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c2c1f-61be-4877-92eb-11269e3522c7 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:18.545126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-706c2c1f-61be-4877-92eb-11269e3522c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:18.584331 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3881/7677] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:45:18 2022] POST /identity/v3/users => generated 284 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:45:18.605881 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708cceb-ee60-4275-8228-cac8094707b0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:18.641557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708cceb-ee60-4275-8228-cac8094707b0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:18.654114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a1fa5-b1cf-4909-958b-957b75a5bc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:18.654775 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a1fa5-b1cf-4909-958b-957b75a5bc6f admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:18.655052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a1fa5-b1cf-4909-958b-957b75a5bc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:18.655323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a1fa5-b1cf-4909-958b-957b75a5bc6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:18.656278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a1fa5-b1cf-4909-958b-957b75a5bc6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:18.657756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a1fa5-b1cf-4909-958b-957b75a5bc6f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:18.699215 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3882/7678] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:45:18.700258 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a1fa5-b1cf-4909-958b-957b75a5bc6f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:18.702090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-792a1fa5-b1cf-4909-958b-957b75a5bc6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:18.759427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c2c1f-61be-4877-92eb-11269e3522c7 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:18.763323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1ed9c-c6d2-47aa-b679-c065c3de8ff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:18.763996 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1ed9c-c6d2-47aa-b679-c065c3de8ff0 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:18.764273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1ed9c-c6d2-47aa-b679-c065c3de8ff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:18.764543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1ed9c-c6d2-47aa-b679-c065c3de8ff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:18.766379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b6e1ed9c-c6d2-47aa-b679-c065c3de8ff0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:18.788190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1ed9c-c6d2-47aa-b679-c065c3de8ff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:18.789934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1ed9c-c6d2-47aa-b679-c065c3de8ff0 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:18.815594 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3797/7679] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:45:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:45:18.816291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1ed9c-c6d2-47aa-b679-c065c3de8ff0 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:18.834885 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a1fa5-b1cf-4909-958b-957b75a5bc6f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:18.840386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b7666-72dc-49fc-9143-512bafffa8e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:18.841018 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b7666-72dc-49fc-9143-512bafffa8e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:18.841299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b7666-72dc-49fc-9143-512bafffa8e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:18.841679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b7666-72dc-49fc-9143-512bafffa8e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:18.852635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1ed9c-c6d2-47aa-b679-c065c3de8ff0 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:18.857719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5cafef-acbd-4de9-b2e2-d04e9f2377e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:18.858347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cafef-acbd-4de9-b2e2-d04e9f2377e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:18.858626 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cafef-acbd-4de9-b2e2-d04e9f2377e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:18.858895 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cafef-acbd-4de9-b2e2-d04e9f2377e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:18.859554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5cafef-acbd-4de9-b2e2-d04e9f2377e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:18.861434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5cafef-acbd-4de9-b2e2-d04e9f2377e4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:18.867217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b7666-72dc-49fc-9143-512bafffa8e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:18.872992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b7666-72dc-49fc-9143-512bafffa8e9 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:18.885068 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3798/7680] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:45:18.889389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5cafef-acbd-4de9-b2e2-d04e9f2377e4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:18.897995 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3883/7681] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:45:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:45:18.912343 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5cafef-acbd-4de9-b2e2-d04e9f2377e4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:18.924874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce568a-d13c-4d22-b75d-52aa6b37d237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:18.925577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce568a-d13c-4d22-b75d-52aa6b37d237 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:18.925939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce568a-d13c-4d22-b75d-52aa6b37d237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:18.926133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce568a-d13c-4d22-b75d-52aa6b37d237 admin admin] PATH_INFO: `/v3/projects/3da6f7ec507a4eb88a87cb84b7f713e2/users/619694bebd29467390e76bd51ca898a2/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:18.970019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce568a-d13c-4d22-b75d-52aa6b37d237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3da6f7ec507a4eb88a87cb84b7f713e2, user_id=619694bebd29467390e76bd51ca898a2, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:18.975206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce568a-d13c-4d22-b75d-52aa6b37d237 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:19.003846 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3799/7682] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:45:18 2022] PUT /identity/v3/projects/3da6f7ec507a4eb88a87cb84b7f713e2/users/619694bebd29467390e76bd51ca898a2/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:45:19.014499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339d66d-922e-4dac-8341-4620639d1bd6 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:19.015716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339d66d-922e-4dac-8341-4620639d1bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:19.015716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339d66d-922e-4dac-8341-4620639d1bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:19.079386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b339d66d-922e-4dac-8341-4620639d1bd6 None None] MFA Rules not processed for user `619694bebd29467390e76bd51ca898a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:19.080873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b339d66d-922e-4dac-8341-4620639d1bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:19.206689 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3884/7683] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:19.220849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce568a-d13c-4d22-b75d-52aa6b37d237 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:19.223055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b5ce568a-d13c-4d22-b75d-52aa6b37d237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:19.339133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce568a-d13c-4d22-b75d-52aa6b37d237 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:19.350580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a602843-ed23-4771-b4bd-0dccf14f6941 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:19.351198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a602843-ed23-4771-b4bd-0dccf14f6941 service glance] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:19.353663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a602843-ed23-4771-b4bd-0dccf14f6941 service glance] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:19.353953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a602843-ed23-4771-b4bd-0dccf14f6941 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:19.525219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a602843-ed23-4771-b4bd-0dccf14f6941 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:19.526968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a602843-ed23-4771-b4bd-0dccf14f6941 service glance] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:19.532846 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:19.556932 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3800/7684] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:45:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:45:19.835969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339d66d-922e-4dac-8341-4620639d1bd6 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:19.866885 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339d66d-922e-4dac-8341-4620639d1bd6 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:19.874783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e1a641-b7e2-4856-8154-278121d539c2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:19.909536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1a641-b7e2-4856-8154-278121d539c2 service glance] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:19.910442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1a641-b7e2-4856-8154-278121d539c2 service glance] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:19.911071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1a641-b7e2-4856-8154-278121d539c2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:19.920483 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:19.925748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e1a641-b7e2-4856-8154-278121d539c2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:19.931090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e1a641-b7e2-4856-8154-278121d539c2 service glance] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:19.961051 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3885/7685] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:45:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:45:20.144551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a602843-ed23-4771-b4bd-0dccf14f6941 service glance] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:20.147212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4a602843-ed23-4771-b4bd-0dccf14f6941 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:20.355518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a602843-ed23-4771-b4bd-0dccf14f6941 service glance] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:20.360546 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c11b6-4673-4332-af9e-273c3c4c0914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:20.361426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c11b6-4673-4332-af9e-273c3c4c0914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:20.361566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c11b6-4673-4332-af9e-273c3c4c0914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:20.361855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c11b6-4673-4332-af9e-273c3c4c0914 admin admin] PATH_INFO: `/v3/projects/2d8e6062ab954d38a022cf27f2d77038` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:20.381339 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c11b6-4673-4332-af9e-273c3c4c0914 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d8e6062ab954d38a022cf27f2d77038)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:20.384695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c11b6-4673-4332-af9e-273c3c4c0914 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:20.547404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9a3c11b6-4673-4332-af9e-273c3c4c0914 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d8e6062ab954d38a022cf27f2d77038', 'request_id': 'req-9a3c11b6-4673-4332-af9e-273c3c4c0914'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:20.563541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9a3c11b6-4673-4332-af9e-273c3c4c0914 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d8e6062ab954d38a022cf27f2d77038', 'request_id': 'req-9a3c11b6-4673-4332-af9e-273c3c4c0914'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:20.581329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9a3c11b6-4673-4332-af9e-273c3c4c0914 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d8e6062ab954d38a022cf27f2d77038', 'request_id': 'req-9a3c11b6-4673-4332-af9e-273c3c4c0914'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:20.609567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9a3c11b6-4673-4332-af9e-273c3c4c0914 admin admin] The token cache is being invalidate because project 2d8e6062ab954d38a022cf27f2d77038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:45:20.610101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9a3c11b6-4673-4332-af9e-273c3c4c0914 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:20.612313 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-9a3c11b6-4673-4332-af9e-273c3c4c0914 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:20.623970 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3801/7686] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:45:20 2022] DELETE /identity/v3/projects/2d8e6062ab954d38a022cf27f2d77038 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:45:20.629410 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a11dc-453c-4af1-bed1-4733bece2237 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:20.630671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a11dc-453c-4af1-bed1-4733bece2237 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:20.631150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a11dc-453c-4af1-bed1-4733bece2237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:20.674856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d30a11dc-453c-4af1-bed1-4733bece2237 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:20.677945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d30a11dc-453c-4af1-bed1-4733bece2237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:20.807283 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3886/7687] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:20.826324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1e535-af08-4ecf-a261-c481ca8a43f9 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:20.826861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1e535-af08-4ecf-a261-c481ca8a43f9 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:20.827315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1e535-af08-4ecf-a261-c481ca8a43f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:20.885088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1bd1e535-af08-4ecf-a261-c481ca8a43f9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:20.886701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1bd1e535-af08-4ecf-a261-c481ca8a43f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:20.907566 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3802/7688] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:20.915144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a11dc-453c-4af1-bed1-4733bece2237 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:20.930391 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a11dc-453c-4af1-bed1-4733bece2237 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:20.949613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02cc5c-8f98-4262-bcb7-f37e41ef1987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:20.950334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02cc5c-8f98-4262-bcb7-f37e41ef1987 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:20.952488 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02cc5c-8f98-4262-bcb7-f37e41ef1987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:20.952794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02cc5c-8f98-4262-bcb7-f37e41ef1987 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:20.953511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd02cc5c-8f98-4262-bcb7-f37e41ef1987 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:45:20.956288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd02cc5c-8f98-4262-bcb7-f37e41ef1987 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:20.958593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd02cc5c-8f98-4262-bcb7-f37e41ef1987 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:21.015477 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3887/7689] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:45:21.019831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1e535-af08-4ecf-a261-c481ca8a43f9 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:21.031541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1e535-af08-4ecf-a261-c481ca8a43f9 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:21.054322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f368c-422d-489b-b911-4f96f7868dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:21.055183 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f368c-422d-489b-b911-4f96f7868dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:21.055491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f368c-422d-489b-b911-4f96f7868dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:21.056412 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f368c-422d-489b-b911-4f96f7868dd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:21.057080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f368c-422d-489b-b911-4f96f7868dd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:21.059040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f368c-422d-489b-b911-4f96f7868dd5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:21.159644 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3803/7690] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:45:21 2022] POST /identity/v3/projects => generated 369 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:45:21.163762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02cc5c-8f98-4262-bcb7-f37e41ef1987 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:21.181818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02cc5c-8f98-4262-bcb7-f37e41ef1987 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:21.266480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca990a-9930-4374-9c0b-2134a44773fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:21.267112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca990a-9930-4374-9c0b-2134a44773fa admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:21.267393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca990a-9930-4374-9c0b-2134a44773fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:21.267667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca990a-9930-4374-9c0b-2134a44773fa admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:21.268373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca990a-9930-4374-9c0b-2134a44773fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:21.270321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca990a-9930-4374-9c0b-2134a44773fa admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:21.377916 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3888/7691] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:45:21 2022] POST /identity/v3/users => generated 285 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:45:21.383262 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f368c-422d-489b-b911-4f96f7868dd5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:21.404817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f368c-422d-489b-b911-4f96f7868dd5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:21.425602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752f313-9a55-465c-ba0d-6cb0607dcaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:21.426904 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752f313-9a55-465c-ba0d-6cb0607dcaee admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:21.427416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752f313-9a55-465c-ba0d-6cb0607dcaee admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:21.432732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752f313-9a55-465c-ba0d-6cb0607dcaee admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:21.433469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6752f313-9a55-465c-ba0d-6cb0607dcaee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:21.479566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6752f313-9a55-465c-ba0d-6cb0607dcaee admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:21.544961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca990a-9930-4374-9c0b-2134a44773fa admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:21.560368 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3804/7692] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:45:21.568501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca990a-9930-4374-9c0b-2134a44773fa admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:21.586474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0f51f-f7aa-4e15-b28f-403066da5a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:21.587126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0f51f-f7aa-4e15-b28f-403066da5a01 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:21.587408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0f51f-f7aa-4e15-b28f-403066da5a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:21.587685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0f51f-f7aa-4e15-b28f-403066da5a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:21.588477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0f51f-f7aa-4e15-b28f-403066da5a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:21.602674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0f51f-f7aa-4e15-b28f-403066da5a01 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:21.621401 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3889/7693] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:45:21.625910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752f313-9a55-465c-ba0d-6cb0607dcaee admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:21.646673 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752f313-9a55-465c-ba0d-6cb0607dcaee admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:21.659861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e62dc-dcde-4289-88e6-09b59e048c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:21.670176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e62dc-dcde-4289-88e6-09b59e048c46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:21.670176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e62dc-dcde-4289-88e6-09b59e048c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:21.670176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e62dc-dcde-4289-88e6-09b59e048c46 admin admin] PATH_INFO: `/v3/projects/18642e6706f34ddb9c07bfe625e11a33/users/a6e1b719d99942a1ab96f1badffd7300/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:21.706310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e62dc-dcde-4289-88e6-09b59e048c46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18642e6706f34ddb9c07bfe625e11a33, user_id=a6e1b719d99942a1ab96f1badffd7300, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:21.709897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e62dc-dcde-4289-88e6-09b59e048c46 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:21.759980 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3805/7694] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:45:21 2022] PUT /identity/v3/projects/18642e6706f34ddb9c07bfe625e11a33/users/a6e1b719d99942a1ab96f1badffd7300/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:45:21.763470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d10962-eeb6-4a5d-bc1f-ef596e711295 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:21.764606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d10962-eeb6-4a5d-bc1f-ef596e711295 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:21.765123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d10962-eeb6-4a5d-bc1f-ef596e711295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:21.827275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f8d10962-eeb6-4a5d-bc1f-ef596e711295 None None] MFA Rules not processed for user `a6e1b719d99942a1ab96f1badffd7300`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:21.830546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f8d10962-eeb6-4a5d-bc1f-ef596e711295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:22.010308 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:22.049339 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3890/7695] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:22.070761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e62dc-dcde-4289-88e6-09b59e048c46 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:22.072741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-647e62dc-dcde-4289-88e6-09b59e048c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:22.146909 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:22.241052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e62dc-dcde-4289-88e6-09b59e048c46 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:22.246640 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac5d2e-295d-4ea9-b3ec-753bdea9d5b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:22.247473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac5d2e-295d-4ea9-b3ec-753bdea9d5b4 service glance] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:22.247955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac5d2e-295d-4ea9-b3ec-753bdea9d5b4 service glance] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:22.248427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac5d2e-295d-4ea9-b3ec-753bdea9d5b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:22.259549 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac5d2e-295d-4ea9-b3ec-753bdea9d5b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:22.261876 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac5d2e-295d-4ea9-b3ec-753bdea9d5b4 service glance] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:22.274312 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3806/7696] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:45:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:45:22.772639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d10962-eeb6-4a5d-bc1f-ef596e711295 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:22.774262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f8d10962-eeb6-4a5d-bc1f-ef596e711295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:22.950402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d10962-eeb6-4a5d-bc1f-ef596e711295 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:22.962124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5a414-82b4-4bdb-b1d6-cbb7aae0dff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:22.963107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5a414-82b4-4bdb-b1d6-cbb7aae0dff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:22.966012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5a414-82b4-4bdb-b1d6-cbb7aae0dff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:22.966461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5a414-82b4-4bdb-b1d6-cbb7aae0dff1 admin admin] PATH_INFO: `/v3/users/21f54369cc834e38829bf69b23438aea` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:22.968615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5a414-82b4-4bdb-b1d6-cbb7aae0dff1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21f54369cc834e38829bf69b23438aea)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:22.974329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5a414-82b4-4bdb-b1d6-cbb7aae0dff1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:23.165914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-00c5a414-82b4-4bdb-b1d6-cbb7aae0dff1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21f54369cc834e38829bf69b23438aea'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:23.210798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-00c5a414-82b4-4bdb-b1d6-cbb7aae0dff1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21f54369cc834e38829bf69b23438aea'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:23.262449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-00c5a414-82b4-4bdb-b1d6-cbb7aae0dff1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21f54369cc834e38829bf69b23438aea'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:23.264183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-00c5a414-82b4-4bdb-b1d6-cbb7aae0dff1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21f54369cc834e38829bf69b23438aea'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:23.292991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-00c5a414-82b4-4bdb-b1d6-cbb7aae0dff1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21f54369cc834e38829bf69b23438aea'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:23.317459 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3891/7697] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:45:22 2022] DELETE /identity/v3/users/21f54369cc834e38829bf69b23438aea => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:45:23.322576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f66001-ae0e-40a2-935d-06f8ac5089e2 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:23.323155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f66001-ae0e-40a2-935d-06f8ac5089e2 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:23.323155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f66001-ae0e-40a2-935d-06f8ac5089e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:23.382206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-97f66001-ae0e-40a2-935d-06f8ac5089e2 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:23.382206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-97f66001-ae0e-40a2-935d-06f8ac5089e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:23.622809 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3807/7698] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:45:23.649944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5a414-82b4-4bdb-b1d6-cbb7aae0dff1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:23.653885 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-00c5a414-82b4-4bdb-b1d6-cbb7aae0dff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:23.829237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5a414-82b4-4bdb-b1d6-cbb7aae0dff1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:23.834103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427e42b-ef89-4281-a0a1-8651294f4aee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:23.835015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427e42b-ef89-4281-a0a1-8651294f4aee service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:23.835515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427e42b-ef89-4281-a0a1-8651294f4aee service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:23.835900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427e42b-ef89-4281-a0a1-8651294f4aee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:23.864115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427e42b-ef89-4281-a0a1-8651294f4aee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:23.867182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427e42b-ef89-4281-a0a1-8651294f4aee service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:23.880908 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3892/7699] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:45:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:45:25.202248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f66001-ae0e-40a2-935d-06f8ac5089e2 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:25.203862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-97f66001-ae0e-40a2-935d-06f8ac5089e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:25.241189 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f66001-ae0e-40a2-935d-06f8ac5089e2 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:25.262724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f95526-0ae1-49a0-ab01-e93bc765aef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:25.264653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f95526-0ae1-49a0-ab01-e93bc765aef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:25.266760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f95526-0ae1-49a0-ab01-e93bc765aef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:25.268225 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f95526-0ae1-49a0-ab01-e93bc765aef6 admin admin] PATH_INFO: `/v3/projects/f14fc725506e4929bd76c98702cb77b9` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:25.272702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f95526-0ae1-49a0-ab01-e93bc765aef6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f14fc725506e4929bd76c98702cb77b9)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:25.296340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f95526-0ae1-49a0-ab01-e93bc765aef6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:25.479110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-39f95526-0ae1-49a0-ab01-e93bc765aef6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f14fc725506e4929bd76c98702cb77b9', 'request_id': 'req-39f95526-0ae1-49a0-ab01-e93bc765aef6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:25.500896 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-39f95526-0ae1-49a0-ab01-e93bc765aef6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f14fc725506e4929bd76c98702cb77b9', 'request_id': 'req-39f95526-0ae1-49a0-ab01-e93bc765aef6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:25.515472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-39f95526-0ae1-49a0-ab01-e93bc765aef6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f14fc725506e4929bd76c98702cb77b9', 'request_id': 'req-39f95526-0ae1-49a0-ab01-e93bc765aef6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:25.542673 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-39f95526-0ae1-49a0-ab01-e93bc765aef6 admin admin] The token cache is being invalidate because project f14fc725506e4929bd76c98702cb77b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:45:25.543265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-39f95526-0ae1-49a0-ab01-e93bc765aef6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:25.544113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-39f95526-0ae1-49a0-ab01-e93bc765aef6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:25.550581 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3808/7700] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:45:25 2022] DELETE /identity/v3/projects/f14fc725506e4929bd76c98702cb77b9 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:45:25.555327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427e42b-ef89-4281-a0a1-8651294f4aee service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:25.577321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427e42b-ef89-4281-a0a1-8651294f4aee service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:25.599964 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:25.719111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2a261-b88e-4ae9-ab5d-629d434d9fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:25.722300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2a261-b88e-4ae9-ab5d-629d434d9fc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:25.722620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2a261-b88e-4ae9-ab5d-629d434d9fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:25.727233 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2a261-b88e-4ae9-ab5d-629d434d9fc4 admin admin] PATH_INFO: `/v3/users/619694bebd29467390e76bd51ca898a2` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:25.728682 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2a261-b88e-4ae9-ab5d-629d434d9fc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=619694bebd29467390e76bd51ca898a2)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:25.731171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2a261-b88e-4ae9-ab5d-629d434d9fc4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:25.830723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b2a2a261-b88e-4ae9-ab5d-629d434d9fc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '619694bebd29467390e76bd51ca898a2'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:25.849195 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b2a2a261-b88e-4ae9-ab5d-629d434d9fc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '619694bebd29467390e76bd51ca898a2'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:25.881380 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b2a2a261-b88e-4ae9-ab5d-629d434d9fc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '619694bebd29467390e76bd51ca898a2'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:25.882372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b2a2a261-b88e-4ae9-ab5d-629d434d9fc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '619694bebd29467390e76bd51ca898a2'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:25.898396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b2a2a261-b88e-4ae9-ab5d-629d434d9fc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '619694bebd29467390e76bd51ca898a2'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:25.908603 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3893/7701] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:45:25 2022] DELETE /identity/v3/users/619694bebd29467390e76bd51ca898a2 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:45:27.159231 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f95526-0ae1-49a0-ab01-e93bc765aef6 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:27.160712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-39f95526-0ae1-49a0-ab01-e93bc765aef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:27.182196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f95526-0ae1-49a0-ab01-e93bc765aef6 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:27.392721 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:27.421740 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf6996-eaef-41b5-b520-a7f6d7b6863e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:27.425083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf6996-eaef-41b5-b520-a7f6d7b6863e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:27.439166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf6996-eaef-41b5-b520-a7f6d7b6863e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:27.448016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf6996-eaef-41b5-b520-a7f6d7b6863e admin admin] PATH_INFO: `/v3/projects/3da6f7ec507a4eb88a87cb84b7f713e2` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:27.456960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf6996-eaef-41b5-b520-a7f6d7b6863e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3da6f7ec507a4eb88a87cb84b7f713e2)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:27.466718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf6996-eaef-41b5-b520-a7f6d7b6863e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:27.664569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-eedf6996-eaef-41b5-b520-a7f6d7b6863e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3da6f7ec507a4eb88a87cb84b7f713e2', 'request_id': 'req-eedf6996-eaef-41b5-b520-a7f6d7b6863e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:27.678455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-eedf6996-eaef-41b5-b520-a7f6d7b6863e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3da6f7ec507a4eb88a87cb84b7f713e2', 'request_id': 'req-eedf6996-eaef-41b5-b520-a7f6d7b6863e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:27.696603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-eedf6996-eaef-41b5-b520-a7f6d7b6863e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3da6f7ec507a4eb88a87cb84b7f713e2', 'request_id': 'req-eedf6996-eaef-41b5-b520-a7f6d7b6863e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:27.742691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-eedf6996-eaef-41b5-b520-a7f6d7b6863e admin admin] The token cache is being invalidate because project 3da6f7ec507a4eb88a87cb84b7f713e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:45:27.743389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-eedf6996-eaef-41b5-b520-a7f6d7b6863e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:27.746613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-eedf6996-eaef-41b5-b520-a7f6d7b6863e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:27.765251 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3809/7702] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:45:27 2022] DELETE /identity/v3/projects/3da6f7ec507a4eb88a87cb84b7f713e2 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:45:27.773214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a0765-1c4c-4f6a-9d5f-478adae51d4d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:27.774115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a0765-1c4c-4f6a-9d5f-478adae51d4d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:27.774554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a0765-1c4c-4f6a-9d5f-478adae51d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:27.815028 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9b2a0765-1c4c-4f6a-9d5f-478adae51d4d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:27.816753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9b2a0765-1c4c-4f6a-9d5f-478adae51d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:27.985749 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3894/7703] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:28.011844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89ae01-c34b-4201-8ad4-d67356336f75 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:28.013944 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89ae01-c34b-4201-8ad4-d67356336f75 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:28.017750 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89ae01-c34b-4201-8ad4-d67356336f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:28.071855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3f89ae01-c34b-4201-8ad4-d67356336f75 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:28.073479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3f89ae01-c34b-4201-8ad4-d67356336f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:28.127316 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3810/7704] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:28.132778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a0765-1c4c-4f6a-9d5f-478adae51d4d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:28.149827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a0765-1c4c-4f6a-9d5f-478adae51d4d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:28.172543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465374c-1452-4f07-a6fe-af1a128ea44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:28.174785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465374c-1452-4f07-a6fe-af1a128ea44b admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:28.175811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465374c-1452-4f07-a6fe-af1a128ea44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:28.176929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465374c-1452-4f07-a6fe-af1a128ea44b admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:28.178989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465374c-1452-4f07-a6fe-af1a128ea44b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:45:28.180667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465374c-1452-4f07-a6fe-af1a128ea44b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:28.189951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3465374c-1452-4f07-a6fe-af1a128ea44b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:28.211838 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3895/7705] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:45:28.217666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89ae01-c34b-4201-8ad4-d67356336f75 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:28.237705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89ae01-c34b-4201-8ad4-d67356336f75 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:28.256534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20417049-e2ee-4d50-87fe-24a3cc6c0952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:28.257277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20417049-e2ee-4d50-87fe-24a3cc6c0952 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:28.257665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20417049-e2ee-4d50-87fe-24a3cc6c0952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:28.258137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20417049-e2ee-4d50-87fe-24a3cc6c0952 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:28.259167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20417049-e2ee-4d50-87fe-24a3cc6c0952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:28.261483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20417049-e2ee-4d50-87fe-24a3cc6c0952 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:28.357437 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3811/7706] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:45:28 2022] POST /identity/v3/projects => generated 363 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:45:28.363905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465374c-1452-4f07-a6fe-af1a128ea44b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:28.382398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465374c-1452-4f07-a6fe-af1a128ea44b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:28.474482 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:28.600703 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7ad24-f054-4b00-a33a-159d0aff6fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:28.601616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7ad24-f054-4b00-a33a-159d0aff6fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:28.604285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7ad24-f054-4b00-a33a-159d0aff6fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:28.604788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7ad24-f054-4b00-a33a-159d0aff6fd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:28.605652 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7ad24-f054-4b00-a33a-159d0aff6fd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:28.617574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7ad24-f054-4b00-a33a-159d0aff6fd8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:28.665973 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3896/7707] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:45:28 2022] POST /identity/v3/users => generated 282 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:45:28.670257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20417049-e2ee-4d50-87fe-24a3cc6c0952 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:28.725649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20417049-e2ee-4d50-87fe-24a3cc6c0952 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:28.750527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80304d80-3600-4572-a85f-b0f01e77c1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:28.751228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80304d80-3600-4572-a85f-b0f01e77c1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:28.751517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80304d80-3600-4572-a85f-b0f01e77c1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:28.751793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80304d80-3600-4572-a85f-b0f01e77c1a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:28.752548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80304d80-3600-4572-a85f-b0f01e77c1a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:28.754217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80304d80-3600-4572-a85f-b0f01e77c1a3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:28.783703 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3812/7708] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:45:28.787763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7ad24-f054-4b00-a33a-159d0aff6fd8 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:28.806022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7ad24-f054-4b00-a33a-159d0aff6fd8 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:28.834999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28355caa-e653-4fd6-85b4-a32229ac2bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:28.836117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28355caa-e653-4fd6-85b4-a32229ac2bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:28.836657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28355caa-e653-4fd6-85b4-a32229ac2bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:28.837177 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28355caa-e653-4fd6-85b4-a32229ac2bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:28.838261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28355caa-e653-4fd6-85b4-a32229ac2bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:28.843300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28355caa-e653-4fd6-85b4-a32229ac2bd0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:28.910846 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3897/7709] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:45:28.914510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80304d80-3600-4572-a85f-b0f01e77c1a3 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:28.941884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80304d80-3600-4572-a85f-b0f01e77c1a3 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:28.981096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c78f8-67fd-4a41-bc51-045e14048108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:28.982963 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c78f8-67fd-4a41-bc51-045e14048108 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:28.990271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c78f8-67fd-4a41-bc51-045e14048108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:28.990584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c78f8-67fd-4a41-bc51-045e14048108 admin admin] PATH_INFO: `/v3/projects/9a6687d9004a44478e9ac897116caaed/users/3ba55d11443440dd82fd0f84af76a828/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:29.068573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c78f8-67fd-4a41-bc51-045e14048108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a6687d9004a44478e9ac897116caaed, user_id=3ba55d11443440dd82fd0f84af76a828, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:29.089256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c78f8-67fd-4a41-bc51-045e14048108 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:29.146742 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3813/7710] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:45:28 2022] PUT /identity/v3/projects/9a6687d9004a44478e9ac897116caaed/users/3ba55d11443440dd82fd0f84af76a828/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:45:29.162462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1506fbf-3c7e-4b4c-b4be-c2f837dde3cd None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:29.164046 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1506fbf-3c7e-4b4c-b4be-c2f837dde3cd None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:29.164572 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1506fbf-3c7e-4b4c-b4be-c2f837dde3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:29.223292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e1506fbf-3c7e-4b4c-b4be-c2f837dde3cd None None] MFA Rules not processed for user `3ba55d11443440dd82fd0f84af76a828`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:29.225555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e1506fbf-3c7e-4b4c-b4be-c2f837dde3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:29.374796 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3898/7711] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:29.385271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c78f8-67fd-4a41-bc51-045e14048108 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:29.387763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6b7c78f8-67fd-4a41-bc51-045e14048108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:29.626194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c78f8-67fd-4a41-bc51-045e14048108 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:29.636836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96aca81-4e6a-4502-9702-f61b6a972dbb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:29.637476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96aca81-4e6a-4502-9702-f61b6a972dbb service glance] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:29.637758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96aca81-4e6a-4502-9702-f61b6a972dbb service glance] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:29.638031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96aca81-4e6a-4502-9702-f61b6a972dbb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:29.677304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96aca81-4e6a-4502-9702-f61b6a972dbb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:29.687933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96aca81-4e6a-4502-9702-f61b6a972dbb service glance] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:29.724798 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3814/7712] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:45:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:45:30.712266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1506fbf-3c7e-4b4c-b4be-c2f837dde3cd None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:31.010729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1506fbf-3c7e-4b4c-b4be-c2f837dde3cd None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:31.036272 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80377df-02fd-42bb-b282-aca7487d0207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:31.036974 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80377df-02fd-42bb-b282-aca7487d0207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:31.036974 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80377df-02fd-42bb-b282-aca7487d0207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:31.037393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80377df-02fd-42bb-b282-aca7487d0207 admin admin] PATH_INFO: `/v3/users/3ba55d11443440dd82fd0f84af76a828` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:31.040693 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80377df-02fd-42bb-b282-aca7487d0207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ba55d11443440dd82fd0f84af76a828)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:31.042665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80377df-02fd-42bb-b282-aca7487d0207 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:31.137595 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:31.227321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a80377df-02fd-42bb-b282-aca7487d0207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ba55d11443440dd82fd0f84af76a828'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:31.277699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a80377df-02fd-42bb-b282-aca7487d0207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ba55d11443440dd82fd0f84af76a828'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:31.323349 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a80377df-02fd-42bb-b282-aca7487d0207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ba55d11443440dd82fd0f84af76a828'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:31.324846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a80377df-02fd-42bb-b282-aca7487d0207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ba55d11443440dd82fd0f84af76a828'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:31.360957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a80377df-02fd-42bb-b282-aca7487d0207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ba55d11443440dd82fd0f84af76a828'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:31.398182 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3899/7713] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:45:30 2022] DELETE /identity/v3/users/3ba55d11443440dd82fd0f84af76a828 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:45:31.403019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c33de0-b207-4695-80a1-4fc614960812 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:31.403915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c33de0-b207-4695-80a1-4fc614960812 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:31.404380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c33de0-b207-4695-80a1-4fc614960812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:31.473193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-40c33de0-b207-4695-80a1-4fc614960812 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:31.475210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-40c33de0-b207-4695-80a1-4fc614960812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:31.529269 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:31.710452 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3815/7714] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:45:31.758746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80377df-02fd-42bb-b282-aca7487d0207 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:31.760350 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a80377df-02fd-42bb-b282-aca7487d0207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:31.961270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80377df-02fd-42bb-b282-aca7487d0207 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:31.976993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a86b98-816b-4fb6-91a6-fcde62f0fd5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:31.977257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a86b98-816b-4fb6-91a6-fcde62f0fd5e service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:31.979314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a86b98-816b-4fb6-91a6-fcde62f0fd5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:31.979639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a86b98-816b-4fb6-91a6-fcde62f0fd5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:32.037716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a86b98-816b-4fb6-91a6-fcde62f0fd5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:32.050208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a86b98-816b-4fb6-91a6-fcde62f0fd5e service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:32.091074 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3900/7715] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:45:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:45:34.048243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c33de0-b207-4695-80a1-4fc614960812 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:34.050670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-40c33de0-b207-4695-80a1-4fc614960812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:34.080039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c33de0-b207-4695-80a1-4fc614960812 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:34.100872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b2245-8d61-4b69-a2d0-bc9b5f5f0240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:34.101564 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b2245-8d61-4b69-a2d0-bc9b5f5f0240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:34.102051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b2245-8d61-4b69-a2d0-bc9b5f5f0240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:34.102505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b2245-8d61-4b69-a2d0-bc9b5f5f0240 admin admin] PATH_INFO: `/v3/projects/9a6687d9004a44478e9ac897116caaed` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:34.112725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b2245-8d61-4b69-a2d0-bc9b5f5f0240 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a6687d9004a44478e9ac897116caaed)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:34.117794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b2245-8d61-4b69-a2d0-bc9b5f5f0240 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:34.296719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d45b2245-8d61-4b69-a2d0-bc9b5f5f0240 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a6687d9004a44478e9ac897116caaed', 'request_id': 'req-d45b2245-8d61-4b69-a2d0-bc9b5f5f0240'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:34.333119 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d45b2245-8d61-4b69-a2d0-bc9b5f5f0240 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a6687d9004a44478e9ac897116caaed', 'request_id': 'req-d45b2245-8d61-4b69-a2d0-bc9b5f5f0240'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:34.352248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d45b2245-8d61-4b69-a2d0-bc9b5f5f0240 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a6687d9004a44478e9ac897116caaed', 'request_id': 'req-d45b2245-8d61-4b69-a2d0-bc9b5f5f0240'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:34.394578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d45b2245-8d61-4b69-a2d0-bc9b5f5f0240 admin admin] The token cache is being invalidate because project 9a6687d9004a44478e9ac897116caaed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:45:34.397437 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d45b2245-8d61-4b69-a2d0-bc9b5f5f0240 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:34.401883 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d45b2245-8d61-4b69-a2d0-bc9b5f5f0240 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:45:34.404043 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3816/7716] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:45:34 2022] DELETE /identity/v3/projects/9a6687d9004a44478e9ac897116caaed => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:45:34.409217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9f1f4-f350-45cb-86c7-0e9c0e8d9419 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:34.410005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9f1f4-f350-45cb-86c7-0e9c0e8d9419 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:34.410005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9f1f4-f350-45cb-86c7-0e9c0e8d9419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:34.466199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6dd9f1f4-f350-45cb-86c7-0e9c0e8d9419 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:34.474923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6dd9f1f4-f350-45cb-86c7-0e9c0e8d9419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:34.667743 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3901/7717] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:34.674745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bf1e8-b190-45e5-bb0e-f10d4a57a468 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:34.675083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bf1e8-b190-45e5-bb0e-f10d4a57a468 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:34.675289 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bf1e8-b190-45e5-bb0e-f10d4a57a468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:34.711023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-510bf1e8-b190-45e5-bb0e-f10d4a57a468 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:34.713344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-510bf1e8-b190-45e5-bb0e-f10d4a57a468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:34.737971 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3817/7718] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:34.742453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9f1f4-f350-45cb-86c7-0e9c0e8d9419 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:34.753927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9f1f4-f350-45cb-86c7-0e9c0e8d9419 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:34.783919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65d1f3-c82d-432b-92db-35486fcefc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:34.785696 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65d1f3-c82d-432b-92db-35486fcefc52 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:34.786005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65d1f3-c82d-432b-92db-35486fcefc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:34.788962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65d1f3-c82d-432b-92db-35486fcefc52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:34.790123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65d1f3-c82d-432b-92db-35486fcefc52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:45:34.793785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65d1f3-c82d-432b-92db-35486fcefc52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:34.797617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65d1f3-c82d-432b-92db-35486fcefc52 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:34.857866 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3902/7719] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:45:34.861145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510bf1e8-b190-45e5-bb0e-f10d4a57a468 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:34.878823 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510bf1e8-b190-45e5-bb0e-f10d4a57a468 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:34.890418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5817ea3-dec9-40a6-a6e8-cbeb8c7761d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:34.892347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5817ea3-dec9-40a6-a6e8-cbeb8c7761d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:34.892776 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5817ea3-dec9-40a6-a6e8-cbeb8c7761d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:34.893164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5817ea3-dec9-40a6-a6e8-cbeb8c7761d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:34.894049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5817ea3-dec9-40a6-a6e8-cbeb8c7761d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:34.898120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5817ea3-dec9-40a6-a6e8-cbeb8c7761d9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:35.058492 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3818/7720] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:45:34 2022] POST /identity/v3/projects => generated 407 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:45:35.063904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65d1f3-c82d-432b-92db-35486fcefc52 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:35.107343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65d1f3-c82d-432b-92db-35486fcefc52 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:35.267266 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:35.401732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117929db-8d35-4627-952c-b3a5ca5b3415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:35.402382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117929db-8d35-4627-952c-b3a5ca5b3415 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:35.402662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117929db-8d35-4627-952c-b3a5ca5b3415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:35.402953 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117929db-8d35-4627-952c-b3a5ca5b3415 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:35.403574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117929db-8d35-4627-952c-b3a5ca5b3415 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:35.411485 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117929db-8d35-4627-952c-b3a5ca5b3415 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:35.496632 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3903/7721] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:45:35 2022] POST /identity/v3/users => generated 304 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:45:35.501183 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5817ea3-dec9-40a6-a6e8-cbeb8c7761d9 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:35.517848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5817ea3-dec9-40a6-a6e8-cbeb8c7761d9 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:35.525368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763263c-bc0b-427a-90a2-bf79b061b14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:35.526071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763263c-bc0b-427a-90a2-bf79b061b14c admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:35.526427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763263c-bc0b-427a-90a2-bf79b061b14c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:35.526708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763263c-bc0b-427a-90a2-bf79b061b14c admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:35.527402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763263c-bc0b-427a-90a2-bf79b061b14c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:35.529280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763263c-bc0b-427a-90a2-bf79b061b14c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:35.553250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117929db-8d35-4627-952c-b3a5ca5b3415 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:35.563127 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3819/7722] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:45:35.578170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117929db-8d35-4627-952c-b3a5ca5b3415 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:35.586824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7067fa9-9a31-4e3b-9b3f-38fad0e07c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:35.587620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7067fa9-9a31-4e3b-9b3f-38fad0e07c00 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:35.588055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7067fa9-9a31-4e3b-9b3f-38fad0e07c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:35.588480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7067fa9-9a31-4e3b-9b3f-38fad0e07c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:35.590515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7067fa9-9a31-4e3b-9b3f-38fad0e07c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:35.592489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7067fa9-9a31-4e3b-9b3f-38fad0e07c00 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:35.620781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763263c-bc0b-427a-90a2-bf79b061b14c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:35.628748 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3904/7723] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:45:35.635715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763263c-bc0b-427a-90a2-bf79b061b14c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:35.660185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f67f9-ac24-4675-94f2-e26dd76fac2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:35.662970 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f67f9-ac24-4675-94f2-e26dd76fac2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:35.663695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f67f9-ac24-4675-94f2-e26dd76fac2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:35.665267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f67f9-ac24-4675-94f2-e26dd76fac2a admin admin] PATH_INFO: `/v3/projects/cc31667e76d34b32afa34b83badc65de/users/1cd3ee0d9420401e99ab8a331f744f0e/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:35.759689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f67f9-ac24-4675-94f2-e26dd76fac2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc31667e76d34b32afa34b83badc65de, user_id=1cd3ee0d9420401e99ab8a331f744f0e, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:35.762599 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f67f9-ac24-4675-94f2-e26dd76fac2a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:35.887239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c1dcf-dae5-472f-a1ff-8ba0e8331f6a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:35.887239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c1dcf-dae5-472f-a1ff-8ba0e8331f6a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:35.887701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c1dcf-dae5-472f-a1ff-8ba0e8331f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:35.897814 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3820/7724] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:45:35 2022] PUT /identity/v3/projects/cc31667e76d34b32afa34b83badc65de/users/1cd3ee0d9420401e99ab8a331f744f0e/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:45:35.960770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ee7c1dcf-dae5-472f-a1ff-8ba0e8331f6a None None] MFA Rules not processed for user `1cd3ee0d9420401e99ab8a331f744f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:35.967053 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ee7c1dcf-dae5-472f-a1ff-8ba0e8331f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:36.159291 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3905/7725] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:35 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:36.164211 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f67f9-ac24-4675-94f2-e26dd76fac2a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:36.319412 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:36.368388 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f67f9-ac24-4675-94f2-e26dd76fac2a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:36.373506 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2078816-9ca2-4df0-b7f6-d8c3df036e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:36.374999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2078816-9ca2-4df0-b7f6-d8c3df036e08 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:36.376194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2078816-9ca2-4df0-b7f6-d8c3df036e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:36.376518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2078816-9ca2-4df0-b7f6-d8c3df036e08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:36.379307 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2078816-9ca2-4df0-b7f6-d8c3df036e08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:36.382160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2078816-9ca2-4df0-b7f6-d8c3df036e08 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:36.466860 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3821/7726] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:45:36 2022] POST /identity/v3/projects => generated 405 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:45:36.470158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c1dcf-dae5-472f-a1ff-8ba0e8331f6a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:36.491454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c1dcf-dae5-472f-a1ff-8ba0e8331f6a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:36.613859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbfb0f-c097-4832-863d-bad71032de61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:36.615666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbfb0f-c097-4832-863d-bad71032de61 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:36.616274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbfb0f-c097-4832-863d-bad71032de61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:36.616800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbfb0f-c097-4832-863d-bad71032de61 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:36.617674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbfb0f-c097-4832-863d-bad71032de61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:36.621793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbfb0f-c097-4832-863d-bad71032de61 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:36.695977 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3906/7727] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:45:36 2022] POST /identity/v3/users => generated 309 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:45:36.699653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2078816-9ca2-4df0-b7f6-d8c3df036e08 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:36.713973 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2078816-9ca2-4df0-b7f6-d8c3df036e08 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:36.719848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5f78f-66e7-484d-bd49-a793c976f079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:36.720824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5f78f-66e7-484d-bd49-a793c976f079 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:36.721327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5f78f-66e7-484d-bd49-a793c976f079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:36.721910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5f78f-66e7-484d-bd49-a793c976f079 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:36.722793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b5f78f-66e7-484d-bd49-a793c976f079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:36.725558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b5f78f-66e7-484d-bd49-a793c976f079 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:36.739807 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3822/7728] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:45:36.743653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbfb0f-c097-4832-863d-bad71032de61 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:36.755583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbfb0f-c097-4832-863d-bad71032de61 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:36.763102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0ca52-939c-4add-b635-1fdbc82e9603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:36.764209 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0ca52-939c-4add-b635-1fdbc82e9603 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:36.764766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0ca52-939c-4add-b635-1fdbc82e9603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:36.765571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd0ca52-939c-4add-b635-1fdbc82e9603 admin admin] PATH_INFO: `/v3/projects/95f6de901ee1463e85c0cfc2deba8ffa/users/ece1d4397a5f47cb99134f3520a32af8/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:36.787506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd0ca52-939c-4add-b635-1fdbc82e9603 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f6de901ee1463e85c0cfc2deba8ffa, user_id=ece1d4397a5f47cb99134f3520a32af8, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:36.793360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd0ca52-939c-4add-b635-1fdbc82e9603 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:36.821150 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3907/7729] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:45:36 2022] PUT /identity/v3/projects/95f6de901ee1463e85c0cfc2deba8ffa/users/ece1d4397a5f47cb99134f3520a32af8/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:45:36.825152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5f78f-66e7-484d-bd49-a793c976f079 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:36.842868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5f78f-66e7-484d-bd49-a793c976f079 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:36.946244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c7d60-ae4c-4ad3-879d-b5f66bb9b46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:36.947192 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c7d60-ae4c-4ad3-879d-b5f66bb9b46a admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:36.947573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c7d60-ae4c-4ad3-879d-b5f66bb9b46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:36.949182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c7d60-ae4c-4ad3-879d-b5f66bb9b46a admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:36.950054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c7d60-ae4c-4ad3-879d-b5f66bb9b46a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:36.954534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c7d60-ae4c-4ad3-879d-b5f66bb9b46a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:36.967938 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3823/7730] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:45:36.972261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0ca52-939c-4add-b635-1fdbc82e9603 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:37.012597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd0ca52-939c-4add-b635-1fdbc82e9603 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:37.028480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992e68e-8052-46ea-80a7-76ec6b97cd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:37.030087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992e68e-8052-46ea-80a7-76ec6b97cd67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:37.031275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992e68e-8052-46ea-80a7-76ec6b97cd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:37.032388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992e68e-8052-46ea-80a7-76ec6b97cd67 admin admin] PATH_INFO: `/v3/projects/95f6de901ee1463e85c0cfc2deba8ffa/users/ece1d4397a5f47cb99134f3520a32af8/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:37.037498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992e68e-8052-46ea-80a7-76ec6b97cd67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f6de901ee1463e85c0cfc2deba8ffa, user_id=ece1d4397a5f47cb99134f3520a32af8, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:37.040468 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992e68e-8052-46ea-80a7-76ec6b97cd67 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:37.051678 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:37.059514 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3908/7731] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:45:36 2022] PUT /identity/v3/projects/95f6de901ee1463e85c0cfc2deba8ffa/users/ece1d4397a5f47cb99134f3520a32af8/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:45:37.070763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119d951-aa3f-4eb2-8d5c-8bccc32c642b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:37.071060 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119d951-aa3f-4eb2-8d5c-8bccc32c642b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:37.071337 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119d951-aa3f-4eb2-8d5c-8bccc32c642b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:37.129373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b119d951-aa3f-4eb2-8d5c-8bccc32c642b None None] MFA Rules not processed for user `ece1d4397a5f47cb99134f3520a32af8`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:37.140472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b119d951-aa3f-4eb2-8d5c-8bccc32c642b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:37.306451 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3824/7732] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:45:37 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:37.320547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992e68e-8052-46ea-80a7-76ec6b97cd67 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:37.322145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2992e68e-8052-46ea-80a7-76ec6b97cd67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:37.439968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992e68e-8052-46ea-80a7-76ec6b97cd67 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:37.447114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da2833-c9ff-49e8-b7cb-0386196418e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:37.448105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da2833-c9ff-49e8-b7cb-0386196418e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:37.448846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da2833-c9ff-49e8-b7cb-0386196418e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:37.449226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da2833-c9ff-49e8-b7cb-0386196418e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:37.555318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da2833-c9ff-49e8-b7cb-0386196418e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:37.557077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da2833-c9ff-49e8-b7cb-0386196418e7 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:37.582692 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3909/7733] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:45:37 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:45:38.686177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119d951-aa3f-4eb2-8d5c-8bccc32c642b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:38.687642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b119d951-aa3f-4eb2-8d5c-8bccc32c642b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:38.790852 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:38.867441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119d951-aa3f-4eb2-8d5c-8bccc32c642b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:38.887254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce9a1a-d9ea-4b7a-8b5b-f53044354274 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:38.887923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce9a1a-d9ea-4b7a-8b5b-f53044354274 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:38.888213 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce9a1a-d9ea-4b7a-8b5b-f53044354274 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:38.888491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce9a1a-d9ea-4b7a-8b5b-f53044354274 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:38.907373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce9a1a-d9ea-4b7a-8b5b-f53044354274 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:38.909071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce9a1a-d9ea-4b7a-8b5b-f53044354274 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:38.928401 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3825/7734] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:45:38 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:45:47.563781 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=49 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:48.921520 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=17 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:45:50.107485 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da2833-c9ff-49e8-b7cb-0386196418e7 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:50.109837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-47da2833-c9ff-49e8-b7cb-0386196418e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:50.341069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da2833-c9ff-49e8-b7cb-0386196418e7 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:50.349821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5369926-1bb8-41b8-b952-76e90831b48f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:50.350710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5369926-1bb8-41b8-b952-76e90831b48f service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:50.351173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5369926-1bb8-41b8-b952-76e90831b48f service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:50.351630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5369926-1bb8-41b8-b952-76e90831b48f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:50.353675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c5369926-1bb8-41b8-b952-76e90831b48f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:50.516140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5369926-1bb8-41b8-b952-76e90831b48f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:50.518238 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5369926-1bb8-41b8-b952-76e90831b48f service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:50.545623 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3910/7735] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:45:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:45:56.568444 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fb077-b908-4a8e-a9b7-baf56e0721c9 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:56.568975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fb077-b908-4a8e-a9b7-baf56e0721c9 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:56.569185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fb077-b908-4a8e-a9b7-baf56e0721c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:56.630418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c00fb077-b908-4a8e-a9b7-baf56e0721c9 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:45:56.635455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c00fb077-b908-4a8e-a9b7-baf56e0721c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:45:56.779117 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3826/7736] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:45:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:45:56.794894 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5369926-1bb8-41b8-b952-76e90831b48f service swift] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:45:56.819819 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5369926-1bb8-41b8-b952-76e90831b48f service swift] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:45:56.842437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc031ad5-21c8-495f-903a-eb6c27ef4333 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:45:56.848221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc031ad5-21c8-495f-903a-eb6c27ef4333 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:45:56.848902 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc031ad5-21c8-495f-903a-eb6c27ef4333 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:45:56.849720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc031ad5-21c8-495f-903a-eb6c27ef4333 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:45:56.862033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc031ad5-21c8-495f-903a-eb6c27ef4333 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:45:56.864999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc031ad5-21c8-495f-903a-eb6c27ef4333 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:45:56.876949 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3911/7737] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:45:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:46:04.856529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00fb077-b908-4a8e-a9b7-baf56e0721c9 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:05.036972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00fb077-b908-4a8e-a9b7-baf56e0721c9 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:05.088103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d645796-cda6-41a2-9b97-81f3cf33ff01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:05.095331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d645796-cda6-41a2-9b97-81f3cf33ff01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:05.095763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d645796-cda6-41a2-9b97-81f3cf33ff01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:05.096368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d645796-cda6-41a2-9b97-81f3cf33ff01 admin admin] PATH_INFO: `/v3/users/1cd3ee0d9420401e99ab8a331f744f0e` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:05.101994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d645796-cda6-41a2-9b97-81f3cf33ff01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cd3ee0d9420401e99ab8a331f744f0e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:05.110524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d645796-cda6-41a2-9b97-81f3cf33ff01 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:05.369110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1d645796-cda6-41a2-9b97-81f3cf33ff01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cd3ee0d9420401e99ab8a331f744f0e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:05.411432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1d645796-cda6-41a2-9b97-81f3cf33ff01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cd3ee0d9420401e99ab8a331f744f0e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:05.457459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1d645796-cda6-41a2-9b97-81f3cf33ff01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cd3ee0d9420401e99ab8a331f744f0e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:05.458311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1d645796-cda6-41a2-9b97-81f3cf33ff01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cd3ee0d9420401e99ab8a331f744f0e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:05.478085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1d645796-cda6-41a2-9b97-81f3cf33ff01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cd3ee0d9420401e99ab8a331f744f0e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:05.488947 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3827/7738] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:46:04 2022] DELETE /identity/v3/users/1cd3ee0d9420401e99ab8a331f744f0e => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:46:05.493151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4261a5a-b37c-49e6-bebe-c2d9847c0de9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:05.493704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4261a5a-b37c-49e6-bebe-c2d9847c0de9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:05.493704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4261a5a-b37c-49e6-bebe-c2d9847c0de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:05.524928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f4261a5a-b37c-49e6-bebe-c2d9847c0de9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:46:05.526445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f4261a5a-b37c-49e6-bebe-c2d9847c0de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:05.656865 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3912/7739] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:46:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:46:05.723459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d645796-cda6-41a2-9b97-81f3cf33ff01 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:05.725119 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1d645796-cda6-41a2-9b97-81f3cf33ff01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:05.810848 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:46:05.911935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d645796-cda6-41a2-9b97-81f3cf33ff01 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:05.973605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bdd857-55b2-42a8-b453-66d4894f0ef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:05.980556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdd857-55b2-42a8-b453-66d4894f0ef4 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:05.980894 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdd857-55b2-42a8-b453-66d4894f0ef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:05.981064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdd857-55b2-42a8-b453-66d4894f0ef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:06.048665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bdd857-55b2-42a8-b453-66d4894f0ef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:06.054878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bdd857-55b2-42a8-b453-66d4894f0ef4 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:06.069387 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3828/7740] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:46:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:46:07.412150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4261a5a-b37c-49e6-bebe-c2d9847c0de9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:07.413858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f4261a5a-b37c-49e6-bebe-c2d9847c0de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:07.449183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4261a5a-b37c-49e6-bebe-c2d9847c0de9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:07.474911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46086e-5dd5-4c95-99b6-fd23e7c0de3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:07.475574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46086e-5dd5-4c95-99b6-fd23e7c0de3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:07.475853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46086e-5dd5-4c95-99b6-fd23e7c0de3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:07.476203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46086e-5dd5-4c95-99b6-fd23e7c0de3d admin admin] PATH_INFO: `/v3/projects/cc31667e76d34b32afa34b83badc65de` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:07.477385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46086e-5dd5-4c95-99b6-fd23e7c0de3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc31667e76d34b32afa34b83badc65de)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:07.479297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46086e-5dd5-4c95-99b6-fd23e7c0de3d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:07.619951 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:46:07.729183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0c46086e-5dd5-4c95-99b6-fd23e7c0de3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc31667e76d34b32afa34b83badc65de', 'request_id': 'req-0c46086e-5dd5-4c95-99b6-fd23e7c0de3d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:07.762610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0c46086e-5dd5-4c95-99b6-fd23e7c0de3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc31667e76d34b32afa34b83badc65de', 'request_id': 'req-0c46086e-5dd5-4c95-99b6-fd23e7c0de3d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:07.797900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0c46086e-5dd5-4c95-99b6-fd23e7c0de3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc31667e76d34b32afa34b83badc65de', 'request_id': 'req-0c46086e-5dd5-4c95-99b6-fd23e7c0de3d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:07.869296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0c46086e-5dd5-4c95-99b6-fd23e7c0de3d admin admin] The token cache is being invalidate because project cc31667e76d34b32afa34b83badc65de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:46:07.869875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0c46086e-5dd5-4c95-99b6-fd23e7c0de3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:07.872079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-0c46086e-5dd5-4c95-99b6-fd23e7c0de3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:07.874891 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3913/7741] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:46:07 2022] DELETE /identity/v3/projects/cc31667e76d34b32afa34b83badc65de => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:46:07.879702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bdd857-55b2-42a8-b453-66d4894f0ef4 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:07.901604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bdd857-55b2-42a8-b453-66d4894f0ef4 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:08.248128 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd8f2c-13c9-482d-bf8e-01d1b0e71d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:08.253892 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd8f2c-13c9-482d-bf8e-01d1b0e71d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:08.256154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd8f2c-13c9-482d-bf8e-01d1b0e71d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:08.256714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd8f2c-13c9-482d-bf8e-01d1b0e71d7c admin admin] PATH_INFO: `/v3/users/ece1d4397a5f47cb99134f3520a32af8` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:08.260143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd8f2c-13c9-482d-bf8e-01d1b0e71d7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ece1d4397a5f47cb99134f3520a32af8)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:08.265753 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd8f2c-13c9-482d-bf8e-01d1b0e71d7c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:08.469796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a4bd8f2c-13c9-482d-bf8e-01d1b0e71d7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ece1d4397a5f47cb99134f3520a32af8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:08.515710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a4bd8f2c-13c9-482d-bf8e-01d1b0e71d7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ece1d4397a5f47cb99134f3520a32af8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:08.557220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a4bd8f2c-13c9-482d-bf8e-01d1b0e71d7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ece1d4397a5f47cb99134f3520a32af8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:08.558377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a4bd8f2c-13c9-482d-bf8e-01d1b0e71d7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ece1d4397a5f47cb99134f3520a32af8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:08.575471 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a4bd8f2c-13c9-482d-bf8e-01d1b0e71d7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ece1d4397a5f47cb99134f3520a32af8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:08.586578 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3829/7742] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:46:07 2022] DELETE /identity/v3/users/ece1d4397a5f47cb99134f3520a32af8 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:46:09.996821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46086e-5dd5-4c95-99b6-fd23e7c0de3d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:09.999782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0c46086e-5dd5-4c95-99b6-fd23e7c0de3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:10.037044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46086e-5dd5-4c95-99b6-fd23e7c0de3d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:10.185874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19a126-02d7-4232-94a3-8fe3076cd820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:10.186922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19a126-02d7-4232-94a3-8fe3076cd820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:10.187477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19a126-02d7-4232-94a3-8fe3076cd820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:10.187951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19a126-02d7-4232-94a3-8fe3076cd820 admin admin] PATH_INFO: `/v3/projects/95f6de901ee1463e85c0cfc2deba8ffa` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:10.192975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac19a126-02d7-4232-94a3-8fe3076cd820 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95f6de901ee1463e85c0cfc2deba8ffa)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:10.195367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac19a126-02d7-4232-94a3-8fe3076cd820 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:10.362567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ac19a126-02d7-4232-94a3-8fe3076cd820 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95f6de901ee1463e85c0cfc2deba8ffa', 'request_id': 'req-ac19a126-02d7-4232-94a3-8fe3076cd820'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:10.397964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ac19a126-02d7-4232-94a3-8fe3076cd820 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95f6de901ee1463e85c0cfc2deba8ffa', 'request_id': 'req-ac19a126-02d7-4232-94a3-8fe3076cd820'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:10.414537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ac19a126-02d7-4232-94a3-8fe3076cd820 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95f6de901ee1463e85c0cfc2deba8ffa', 'request_id': 'req-ac19a126-02d7-4232-94a3-8fe3076cd820'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:10.472877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ac19a126-02d7-4232-94a3-8fe3076cd820 admin admin] The token cache is being invalidate because project 95f6de901ee1463e85c0cfc2deba8ffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:46:10.473401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ac19a126-02d7-4232-94a3-8fe3076cd820 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:10.475412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ac19a126-02d7-4232-94a3-8fe3076cd820 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:10.483923 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3914/7743] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:46:09 2022] DELETE /identity/v3/projects/95f6de901ee1463e85c0cfc2deba8ffa => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:46:10.492061 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368a677-8b5d-4cee-a3ee-f66f9453a37b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:10.492650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368a677-8b5d-4cee-a3ee-f66f9453a37b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:10.492894 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368a677-8b5d-4cee-a3ee-f66f9453a37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:10.554635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d368a677-8b5d-4cee-a3ee-f66f9453a37b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:46:10.558966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d368a677-8b5d-4cee-a3ee-f66f9453a37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:10.804382 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:46:10.919400 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3830/7744] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:46:11.039388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4baedfe-d901-4066-9a3d-3db2172551c2 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:11.040293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4baedfe-d901-4066-9a3d-3db2172551c2 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:11.040845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4baedfe-d901-4066-9a3d-3db2172551c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:11.088037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d4baedfe-d901-4066-9a3d-3db2172551c2 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:46:11.091008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d4baedfe-d901-4066-9a3d-3db2172551c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:11.127849 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3915/7745] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:46:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:46:11.128612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368a677-8b5d-4cee-a3ee-f66f9453a37b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:11.149330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368a677-8b5d-4cee-a3ee-f66f9453a37b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:11.175376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd98ca3-3532-4334-9c6e-4cbed16f6996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:11.176336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd98ca3-3532-4334-9c6e-4cbed16f6996 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:11.176678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd98ca3-3532-4334-9c6e-4cbed16f6996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:11.176910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd98ca3-3532-4334-9c6e-4cbed16f6996 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:11.190223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd98ca3-3532-4334-9c6e-4cbed16f6996 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:46:11.190598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd98ca3-3532-4334-9c6e-4cbed16f6996 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:11.192236 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd98ca3-3532-4334-9c6e-4cbed16f6996 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:11.236160 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3831/7746] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:46:11.238336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4baedfe-d901-4066-9a3d-3db2172551c2 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:11.254657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4baedfe-d901-4066-9a3d-3db2172551c2 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:11.281348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf3467-514f-4d17-8fb8-a0e4afb435d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:11.282942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf3467-514f-4d17-8fb8-a0e4afb435d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:11.283360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf3467-514f-4d17-8fb8-a0e4afb435d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:11.283501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf3467-514f-4d17-8fb8-a0e4afb435d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:11.288859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf3467-514f-4d17-8fb8-a0e4afb435d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:11.290852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf3467-514f-4d17-8fb8-a0e4afb435d9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:11.370782 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3916/7747] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:46:11 2022] POST /identity/v3/projects => generated 397 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:46:11.371642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd98ca3-3532-4334-9c6e-4cbed16f6996 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:11.388496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd98ca3-3532-4334-9c6e-4cbed16f6996 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:11.681079 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9655d-ad62-482b-ad53-09e0a4f611f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:11.682705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9655d-ad62-482b-ad53-09e0a4f611f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:11.684249 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9655d-ad62-482b-ad53-09e0a4f611f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:11.685471 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9655d-ad62-482b-ad53-09e0a4f611f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:11.686871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9655d-ad62-482b-ad53-09e0a4f611f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:11.696318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9655d-ad62-482b-ad53-09e0a4f611f5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:11.745208 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3832/7748] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:46:11 2022] POST /identity/v3/users => generated 299 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:46:11.753228 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf3467-514f-4d17-8fb8-a0e4afb435d9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:11.774057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf3467-514f-4d17-8fb8-a0e4afb435d9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:11.800722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df89ac7-03fb-40de-9b26-cba7b81abf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:11.801355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df89ac7-03fb-40de-9b26-cba7b81abf53 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:11.801633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df89ac7-03fb-40de-9b26-cba7b81abf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:11.801898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df89ac7-03fb-40de-9b26-cba7b81abf53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:11.802567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df89ac7-03fb-40de-9b26-cba7b81abf53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:11.810566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df89ac7-03fb-40de-9b26-cba7b81abf53 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:11.860913 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3917/7749] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:46:11.861143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9655d-ad62-482b-ad53-09e0a4f611f5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:11.878530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9655d-ad62-482b-ad53-09e0a4f611f5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:11.904519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff154237-6f30-4ca6-b7b1-3209396db754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:11.905145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff154237-6f30-4ca6-b7b1-3209396db754 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:11.905420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff154237-6f30-4ca6-b7b1-3209396db754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:11.905691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff154237-6f30-4ca6-b7b1-3209396db754 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:11.906346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff154237-6f30-4ca6-b7b1-3209396db754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:11.914711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff154237-6f30-4ca6-b7b1-3209396db754 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:11.956285 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3833/7750] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:46:11 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:46:11.957539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df89ac7-03fb-40de-9b26-cba7b81abf53 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:11.968924 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:46:11.989743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df89ac7-03fb-40de-9b26-cba7b81abf53 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:12.006615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e151f-ff44-477e-b3a2-9ea5e4eaf450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:12.025403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e151f-ff44-477e-b3a2-9ea5e4eaf450 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:12.029015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e151f-ff44-477e-b3a2-9ea5e4eaf450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:12.038720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e151f-ff44-477e-b3a2-9ea5e4eaf450 admin admin] PATH_INFO: `/v3/projects/58e45c0010314de2baf90da2055b5bf5/users/0f03e31a52294d39afb68f6f6aaa51f4/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:12.112590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e151f-ff44-477e-b3a2-9ea5e4eaf450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58e45c0010314de2baf90da2055b5bf5, user_id=0f03e31a52294d39afb68f6f6aaa51f4, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:12.117250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e151f-ff44-477e-b3a2-9ea5e4eaf450 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:12.160106 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3918/7751] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:46:11 2022] PUT /identity/v3/projects/58e45c0010314de2baf90da2055b5bf5/users/0f03e31a52294d39afb68f6f6aaa51f4/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:46:12.175756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9ddc3-4ca2-4052-af4d-551855eb029c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:12.176234 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9ddc3-4ca2-4052-af4d-551855eb029c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:12.176446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9ddc3-4ca2-4052-af4d-551855eb029c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:12.269671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-93a9ddc3-4ca2-4052-af4d-551855eb029c None None] MFA Rules not processed for user `0f03e31a52294d39afb68f6f6aaa51f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:46:12.271121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-93a9ddc3-4ca2-4052-af4d-551855eb029c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:12.490336 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3834/7752] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:46:12 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:46:12.496871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e151f-ff44-477e-b3a2-9ea5e4eaf450 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:12.785739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9ddc3-4ca2-4052-af4d-551855eb029c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:12.788806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-93a9ddc3-4ca2-4052-af4d-551855eb029c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:12.840163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e151f-ff44-477e-b3a2-9ea5e4eaf450 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:12.866450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d96a93-264e-4fd0-bbfd-cfdc3aae3391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:12.873698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9ddc3-4ca2-4052-af4d-551855eb029c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:12.879371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d96a93-264e-4fd0-bbfd-cfdc3aae3391 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:12.879794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d96a93-264e-4fd0-bbfd-cfdc3aae3391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:12.880083 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d96a93-264e-4fd0-bbfd-cfdc3aae3391 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:12.880859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d96a93-264e-4fd0-bbfd-cfdc3aae3391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:12.882773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d96a93-264e-4fd0-bbfd-cfdc3aae3391 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:12.906927 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269cfadc-bd76-4e70-9f2b-522a121becec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:12.907514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cfadc-bd76-4e70-9f2b-522a121becec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:12.908286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cfadc-bd76-4e70-9f2b-522a121becec admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:12.908739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cfadc-bd76-4e70-9f2b-522a121becec admin admin] PATH_INFO: `/v3/users/9359013ce46147aaac9355a2c7fab95b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:12.918792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269cfadc-bd76-4e70-9f2b-522a121becec admin admin] RBAC: Authorizing `identity:delete_user(user_id=9359013ce46147aaac9355a2c7fab95b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:12.947492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269cfadc-bd76-4e70-9f2b-522a121becec admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:12.948576 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3919/7753] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:46:12 2022] POST /identity/v3/projects => generated 399 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:46:12.954802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d96a93-264e-4fd0-bbfd-cfdc3aae3391 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:13.097832 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:46:13.163093 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-269cfadc-bd76-4e70-9f2b-522a121becec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9359013ce46147aaac9355a2c7fab95b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:13.218155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-269cfadc-bd76-4e70-9f2b-522a121becec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9359013ce46147aaac9355a2c7fab95b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:13.245313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d96a93-264e-4fd0-bbfd-cfdc3aae3391 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:13.257242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2ef70-1883-4c42-a271-69ff675d9f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:13.259829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2ef70-1883-4c42-a271-69ff675d9f03 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:13.260476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2ef70-1883-4c42-a271-69ff675d9f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:13.260980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2ef70-1883-4c42-a271-69ff675d9f03 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:13.261643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2ef70-1883-4c42-a271-69ff675d9f03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:13.266547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d2ef70-1883-4c42-a271-69ff675d9f03 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:13.274153 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-269cfadc-bd76-4e70-9f2b-522a121becec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9359013ce46147aaac9355a2c7fab95b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:13.274153 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-269cfadc-bd76-4e70-9f2b-522a121becec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9359013ce46147aaac9355a2c7fab95b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:13.301754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-269cfadc-bd76-4e70-9f2b-522a121becec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9359013ce46147aaac9355a2c7fab95b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:13.311322 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3835/7754] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:46:12 2022] DELETE /identity/v3/users/9359013ce46147aaac9355a2c7fab95b => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:46:13.316421 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3920/7755] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:46:12 2022] POST /identity/v3/users => generated 306 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:46:13.318220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53273116-95a4-4e1c-9a81-68d73cbe446b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:13.319866 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53273116-95a4-4e1c-9a81-68d73cbe446b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:13.320181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53273116-95a4-4e1c-9a81-68d73cbe446b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:13.322093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2ef70-1883-4c42-a271-69ff675d9f03 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:13.336808 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-75d2ef70-1883-4c42-a271-69ff675d9f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:13.366802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2ef70-1883-4c42-a271-69ff675d9f03 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:13.492535 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:46:13.522132 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8489e-10e9-4e97-9c2a-c73bcd26dfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:13.524920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-53273116-95a4-4e1c-9a81-68d73cbe446b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:46:13.526610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8489e-10e9-4e97-9c2a-c73bcd26dfd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:13.526887 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8489e-10e9-4e97-9c2a-c73bcd26dfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:13.527186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8489e-10e9-4e97-9c2a-c73bcd26dfd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:13.527829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8489e-10e9-4e97-9c2a-c73bcd26dfd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:13.528902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-53273116-95a4-4e1c-9a81-68d73cbe446b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:13.529472 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8489e-10e9-4e97-9c2a-c73bcd26dfd0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:13.545811 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3836/7756] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:46:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:46:13.557001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53273116-95a4-4e1c-9a81-68d73cbe446b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:13.558652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-53273116-95a4-4e1c-9a81-68d73cbe446b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:13.586179 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3921/7757] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:46:13.587186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8489e-10e9-4e97-9c2a-c73bcd26dfd0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:13.616473 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8489e-10e9-4e97-9c2a-c73bcd26dfd0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:13.634766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7354c-5ea3-43b4-980f-b65f4bc543a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:13.635445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7354c-5ea3-43b4-980f-b65f4bc543a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:13.635715 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7354c-5ea3-43b4-980f-b65f4bc543a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:13.637517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7354c-5ea3-43b4-980f-b65f4bc543a7 admin admin] PATH_INFO: `/v3/projects/f627b73f82f14462b91fb613b410430e/users/d26add13ec9a4254abe63ccfe27f4b13/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:13.713957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7354c-5ea3-43b4-980f-b65f4bc543a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f627b73f82f14462b91fb613b410430e, user_id=d26add13ec9a4254abe63ccfe27f4b13, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:13.716734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7354c-5ea3-43b4-980f-b65f4bc543a7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:13.799061 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3922/7758] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:46:13 2022] PUT /identity/v3/projects/f627b73f82f14462b91fb613b410430e/users/d26add13ec9a4254abe63ccfe27f4b13/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:46:13.804420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7354c-5ea3-43b4-980f-b65f4bc543a7 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:13.814712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53273116-95a4-4e1c-9a81-68d73cbe446b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:13.914013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7354c-5ea3-43b4-980f-b65f4bc543a7 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:13.935574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280f6d1-ba32-4990-9358-5d2f7aca5847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:13.940097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280f6d1-ba32-4990-9358-5d2f7aca5847 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:13.940471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280f6d1-ba32-4990-9358-5d2f7aca5847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:13.942660 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280f6d1-ba32-4990-9358-5d2f7aca5847 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:13.945591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280f6d1-ba32-4990-9358-5d2f7aca5847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:13.953638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4280f6d1-ba32-4990-9358-5d2f7aca5847 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:14.006133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5791a22-e9f9-40a0-bcdd-4729653842dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:14.006754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5791a22-e9f9-40a0-bcdd-4729653842dc service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:14.007039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5791a22-e9f9-40a0-bcdd-4729653842dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:14.007316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5791a22-e9f9-40a0-bcdd-4729653842dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:14.040639 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3923/7759] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:46:14.044705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280f6d1-ba32-4990-9358-5d2f7aca5847 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:14.045062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5791a22-e9f9-40a0-bcdd-4729653842dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:14.046794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5791a22-e9f9-40a0-bcdd-4729653842dc service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:14.078831 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280f6d1-ba32-4990-9358-5d2f7aca5847 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:14.089741 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3837/7760] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:46:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:46:14.141817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3439ec0-9da1-46d8-900f-876820d14560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:14.147844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3439ec0-9da1-46d8-900f-876820d14560 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:14.169966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3439ec0-9da1-46d8-900f-876820d14560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:14.173776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3439ec0-9da1-46d8-900f-876820d14560 admin admin] PATH_INFO: `/v3/projects/f627b73f82f14462b91fb613b410430e/users/d26add13ec9a4254abe63ccfe27f4b13/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:14.192182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3439ec0-9da1-46d8-900f-876820d14560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f627b73f82f14462b91fb613b410430e, user_id=d26add13ec9a4254abe63ccfe27f4b13, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:14.223440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3439ec0-9da1-46d8-900f-876820d14560 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:14.273115 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3924/7761] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:46:14 2022] PUT /identity/v3/projects/f627b73f82f14462b91fb613b410430e/users/d26add13ec9a4254abe63ccfe27f4b13/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:46:14.285357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f18af-2fb5-4f90-9cae-18e0fcbdf00e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:14.286631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f18af-2fb5-4f90-9cae-18e0fcbdf00e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:14.287397 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f18af-2fb5-4f90-9cae-18e0fcbdf00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:14.375845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-229f18af-2fb5-4f90-9cae-18e0fcbdf00e None None] MFA Rules not processed for user `d26add13ec9a4254abe63ccfe27f4b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:46:14.377392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-229f18af-2fb5-4f90-9cae-18e0fcbdf00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:14.503370 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:46:14.565636 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3838/7762] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:46:14 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:46:14.623552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3439ec0-9da1-46d8-900f-876820d14560 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:14.625362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b3439ec0-9da1-46d8-900f-876820d14560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:14.835274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3439ec0-9da1-46d8-900f-876820d14560 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:14.853093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06cea0-2edc-446b-bdb6-b0d1f088175b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:14.856309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06cea0-2edc-446b-bdb6-b0d1f088175b service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:14.861479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06cea0-2edc-446b-bdb6-b0d1f088175b service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:14.862199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06cea0-2edc-446b-bdb6-b0d1f088175b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:14.888790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-aa06cea0-2edc-446b-bdb6-b0d1f088175b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:15.227907 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06cea0-2edc-446b-bdb6-b0d1f088175b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:15.232008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06cea0-2edc-446b-bdb6-b0d1f088175b service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:15.268514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f18af-2fb5-4f90-9cae-18e0fcbdf00e None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:15.270602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-229f18af-2fb5-4f90-9cae-18e0fcbdf00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:15.285542 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3925/7763] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:46:14 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:46:15.537711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f18af-2fb5-4f90-9cae-18e0fcbdf00e None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:15.542928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74368aa6-e4ac-47bf-879c-420484b00ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:15.543831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74368aa6-e4ac-47bf-879c-420484b00ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:15.544367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74368aa6-e4ac-47bf-879c-420484b00ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:15.544808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74368aa6-e4ac-47bf-879c-420484b00ace admin admin] PATH_INFO: `/v3/projects/07715d440b3841849359a228245c6d94` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:15.546981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74368aa6-e4ac-47bf-879c-420484b00ace admin admin] RBAC: Authorizing `identity:delete_project(project_id=07715d440b3841849359a228245c6d94)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:15.549988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74368aa6-e4ac-47bf-879c-420484b00ace admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:15.759803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-74368aa6-e4ac-47bf-879c-420484b00ace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07715d440b3841849359a228245c6d94', 'request_id': 'req-74368aa6-e4ac-47bf-879c-420484b00ace'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:15.777970 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-74368aa6-e4ac-47bf-879c-420484b00ace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07715d440b3841849359a228245c6d94', 'request_id': 'req-74368aa6-e4ac-47bf-879c-420484b00ace'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:15.795035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-74368aa6-e4ac-47bf-879c-420484b00ace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07715d440b3841849359a228245c6d94', 'request_id': 'req-74368aa6-e4ac-47bf-879c-420484b00ace'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:15.833102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-74368aa6-e4ac-47bf-879c-420484b00ace admin admin] The token cache is being invalidate because project 07715d440b3841849359a228245c6d94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:46:15.836750 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-74368aa6-e4ac-47bf-879c-420484b00ace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:15.842540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-74368aa6-e4ac-47bf-879c-420484b00ace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:15.845071 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3839/7764] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:46:15 2022] DELETE /identity/v3/projects/07715d440b3841849359a228245c6d94 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:46:15.850412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a645d1-a1b7-4fa9-b260-eb7c4cd5dcb4 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:15.850967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a645d1-a1b7-4fa9-b260-eb7c4cd5dcb4 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:15.851466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a645d1-a1b7-4fa9-b260-eb7c4cd5dcb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:15.863494 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:46:15.892059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c5a645d1-a1b7-4fa9-b260-eb7c4cd5dcb4 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:46:15.894316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c5a645d1-a1b7-4fa9-b260-eb7c4cd5dcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:16.129997 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3926/7765] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:46:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:46:16.138303 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393bc88-4124-4be9-a278-ff66a40e5864 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:16.138958 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393bc88-4124-4be9-a278-ff66a40e5864 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:16.139451 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393bc88-4124-4be9-a278-ff66a40e5864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:16.213552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7393bc88-4124-4be9-a278-ff66a40e5864 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:46:16.217694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7393bc88-4124-4be9-a278-ff66a40e5864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:16.246369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a645d1-a1b7-4fa9-b260-eb7c4cd5dcb4 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:16.261507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a645d1-a1b7-4fa9-b260-eb7c4cd5dcb4 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:16.262731 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3840/7766] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:46:16.279577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f5b04-69d7-449a-b0c0-c603d574f8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:16.280292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f5b04-69d7-449a-b0c0-c603d574f8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:16.280645 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f5b04-69d7-449a-b0c0-c603d574f8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:16.281093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f5b04-69d7-449a-b0c0-c603d574f8d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:16.281842 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f5b04-69d7-449a-b0c0-c603d574f8d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:46:16.282301 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f5b04-69d7-449a-b0c0-c603d574f8d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:16.288350 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f5b04-69d7-449a-b0c0-c603d574f8d4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:16.363973 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393bc88-4124-4be9-a278-ff66a40e5864 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:16.379633 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3927/7767] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:46:16.381544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393bc88-4124-4be9-a278-ff66a40e5864 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:16.411719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6691aac-60e8-4459-a8db-89d7da2cda92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:16.413051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6691aac-60e8-4459-a8db-89d7da2cda92 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:16.414051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6691aac-60e8-4459-a8db-89d7da2cda92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:16.414331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6691aac-60e8-4459-a8db-89d7da2cda92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:16.415000 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6691aac-60e8-4459-a8db-89d7da2cda92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:16.416968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6691aac-60e8-4459-a8db-89d7da2cda92 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:16.461494 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3841/7768] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:46:16 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:46:16.462981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f5b04-69d7-449a-b0c0-c603d574f8d4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:16.476558 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f5b04-69d7-449a-b0c0-c603d574f8d4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:16.697854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bf72c-5474-4c0d-bddd-a1050753cbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:16.698649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bf72c-5474-4c0d-bddd-a1050753cbaa admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:16.699041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bf72c-5474-4c0d-bddd-a1050753cbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:16.699436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bf72c-5474-4c0d-bddd-a1050753cbaa admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:16.700204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543bf72c-5474-4c0d-bddd-a1050753cbaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:16.702260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543bf72c-5474-4c0d-bddd-a1050753cbaa admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:16.775183 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3928/7769] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:46:16 2022] POST /identity/v3/users => generated 283 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:46:16.779208 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6691aac-60e8-4459-a8db-89d7da2cda92 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:16.796680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6691aac-60e8-4459-a8db-89d7da2cda92 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:16.815841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3379b4-d34a-4c5b-8c40-263f22788a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:16.824450 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3379b4-d34a-4c5b-8c40-263f22788a98 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:16.824713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3379b4-d34a-4c5b-8c40-263f22788a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:16.824812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3379b4-d34a-4c5b-8c40-263f22788a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:16.829071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3379b4-d34a-4c5b-8c40-263f22788a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:16.843404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3379b4-d34a-4c5b-8c40-263f22788a98 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:16.900173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bf72c-5474-4c0d-bddd-a1050753cbaa admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:16.900682 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3842/7770] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:46:16.915955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bf72c-5474-4c0d-bddd-a1050753cbaa admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:16.962807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18e916-8d7d-4cd5-8e99-1c54e108d7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:16.964030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18e916-8d7d-4cd5-8e99-1c54e108d7ce admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:16.968440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18e916-8d7d-4cd5-8e99-1c54e108d7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:16.969442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18e916-8d7d-4cd5-8e99-1c54e108d7ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:16.981746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18e916-8d7d-4cd5-8e99-1c54e108d7ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:16.984823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18e916-8d7d-4cd5-8e99-1c54e108d7ce admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:17.034496 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3929/7771] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:46:17.038942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3379b4-d34a-4c5b-8c40-263f22788a98 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:17.063512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3379b4-d34a-4c5b-8c40-263f22788a98 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:17.081693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df25924-cb9f-4a3e-b0f9-ac8f4b0c4bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:17.083385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df25924-cb9f-4a3e-b0f9-ac8f4b0c4bf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:17.083664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df25924-cb9f-4a3e-b0f9-ac8f4b0c4bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:17.083966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df25924-cb9f-4a3e-b0f9-ac8f4b0c4bf9 admin admin] PATH_INFO: `/v3/projects/63e0a5005c4c45eca9b1192cd6564864/users/6e82d5661e7a4d359e4f31d1dbd91db8/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:17.169530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df25924-cb9f-4a3e-b0f9-ac8f4b0c4bf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63e0a5005c4c45eca9b1192cd6564864, user_id=6e82d5661e7a4d359e4f31d1dbd91db8, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:17.178332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df25924-cb9f-4a3e-b0f9-ac8f4b0c4bf9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:17.260600 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3843/7772] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:46:17 2022] PUT /identity/v3/projects/63e0a5005c4c45eca9b1192cd6564864/users/6e82d5661e7a4d359e4f31d1dbd91db8/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:46:17.281726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e43ff9-36ee-4d9d-8e17-abd239979e36 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:17.282062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e43ff9-36ee-4d9d-8e17-abd239979e36 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:17.282283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e43ff9-36ee-4d9d-8e17-abd239979e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:17.419567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-53e43ff9-36ee-4d9d-8e17-abd239979e36 None None] MFA Rules not processed for user `6e82d5661e7a4d359e4f31d1dbd91db8`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:46:17.424404 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-53e43ff9-36ee-4d9d-8e17-abd239979e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:17.698927 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:46:17.719848 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3930/7773] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:46:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:46:17.726704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df25924-cb9f-4a3e-b0f9-ac8f4b0c4bf9 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:17.795195 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:46:17.825852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e43ff9-36ee-4d9d-8e17-abd239979e36 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:17.827310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-53e43ff9-36ee-4d9d-8e17-abd239979e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:17.959684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df25924-cb9f-4a3e-b0f9-ac8f4b0c4bf9 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:18.021939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471967c0-4979-4671-bccb-b9a08db69602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:18.022581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471967c0-4979-4671-bccb-b9a08db69602 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:18.022869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471967c0-4979-4671-bccb-b9a08db69602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:18.023146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471967c0-4979-4671-bccb-b9a08db69602 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:18.023792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471967c0-4979-4671-bccb-b9a08db69602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:18.030781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471967c0-4979-4671-bccb-b9a08db69602 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:18.189256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e43ff9-36ee-4d9d-8e17-abd239979e36 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:18.201153 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3844/7774] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:46:17 2022] POST /identity/v3/projects => generated 365 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:46:18.204762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90dd33-e6b2-45d4-b2ca-004805757009 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:18.205936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90dd33-e6b2-45d4-b2ca-004805757009 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:18.206216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90dd33-e6b2-45d4-b2ca-004805757009 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:18.206349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471967c0-4979-4671-bccb-b9a08db69602 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:18.206655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90dd33-e6b2-45d4-b2ca-004805757009 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:18.210217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8b90dd33-e6b2-45d4-b2ca-004805757009 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:18.403872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b90dd33-e6b2-45d4-b2ca-004805757009 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:18.407407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b90dd33-e6b2-45d4-b2ca-004805757009 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:18.432808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471967c0-4979-4671-bccb-b9a08db69602 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:18.444661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3e3fc-a33f-45c5-a912-bdbde84b69c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:18.446341 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3e3fc-a33f-45c5-a912-bdbde84b69c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:18.447083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3e3fc-a33f-45c5-a912-bdbde84b69c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:18.447387 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3931/7775] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:46:17 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:46:18.447908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3e3fc-a33f-45c5-a912-bdbde84b69c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:18.449370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e3e3fc-a33f-45c5-a912-bdbde84b69c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:18.452407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e3e3fc-a33f-45c5-a912-bdbde84b69c0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:18.587531 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3845/7776] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:46:18 2022] POST /identity/v3/users => generated 289 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:46:18.589939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90dd33-e6b2-45d4-b2ca-004805757009 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:18.607039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90dd33-e6b2-45d4-b2ca-004805757009 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:18.627613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453861c-d203-496f-929c-739a830a2815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:18.628532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453861c-d203-496f-929c-739a830a2815 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:18.629069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453861c-d203-496f-929c-739a830a2815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:18.631957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453861c-d203-496f-929c-739a830a2815 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:18.632735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453861c-d203-496f-929c-739a830a2815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:18.634342 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453861c-d203-496f-929c-739a830a2815 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:18.684510 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3932/7777] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:46:18.695789 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3e3fc-a33f-45c5-a912-bdbde84b69c0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:18.732735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3e3fc-a33f-45c5-a912-bdbde84b69c0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:18.758817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bcfb4-6ed0-47a9-8d27-4258f334cd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:18.759488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bcfb4-6ed0-47a9-8d27-4258f334cd63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:18.759768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bcfb4-6ed0-47a9-8d27-4258f334cd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:18.762059 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bcfb4-6ed0-47a9-8d27-4258f334cd63 admin admin] PATH_INFO: `/v3/projects/7e191cf4f553475f98352101ddf8875b/users/a6c9c860d3314131948c0947814d522f/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:18.822946 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531bcfb4-6ed0-47a9-8d27-4258f334cd63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e191cf4f553475f98352101ddf8875b, user_id=a6c9c860d3314131948c0947814d522f, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:18.825718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531bcfb4-6ed0-47a9-8d27-4258f334cd63 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:18.874745 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3846/7778] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:46:18 2022] PUT /identity/v3/projects/7e191cf4f553475f98352101ddf8875b/users/a6c9c860d3314131948c0947814d522f/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:46:18.880141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453861c-d203-496f-929c-739a830a2815 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:18.930850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453861c-d203-496f-929c-739a830a2815 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:19.198314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e2614-54d1-4729-a0e3-18ef31823463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:19.198955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e2614-54d1-4729-a0e3-18ef31823463 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:19.199231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e2614-54d1-4729-a0e3-18ef31823463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:19.199499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e2614-54d1-4729-a0e3-18ef31823463 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:19.200187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e2614-54d1-4729-a0e3-18ef31823463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:19.201841 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e2614-54d1-4729-a0e3-18ef31823463 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:19.242444 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3933/7779] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:46:19.244695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bcfb4-6ed0-47a9-8d27-4258f334cd63 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:19.262699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bcfb4-6ed0-47a9-8d27-4258f334cd63 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:19.286029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c3e2f-f958-4c71-ba35-c19d1048dafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:19.287159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c3e2f-f958-4c71-ba35-c19d1048dafa admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:19.289071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c3e2f-f958-4c71-ba35-c19d1048dafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:19.289387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c3e2f-f958-4c71-ba35-c19d1048dafa admin admin] PATH_INFO: `/v3/projects/7e191cf4f553475f98352101ddf8875b/users/a6c9c860d3314131948c0947814d522f/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:19.302656 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c3e2f-f958-4c71-ba35-c19d1048dafa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e191cf4f553475f98352101ddf8875b, user_id=a6c9c860d3314131948c0947814d522f, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:19.321246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c3e2f-f958-4c71-ba35-c19d1048dafa admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:19.392274 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3847/7780] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:46:19 2022] PUT /identity/v3/projects/7e191cf4f553475f98352101ddf8875b/users/a6c9c860d3314131948c0947814d522f/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:46:19.404012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c93401-3524-489d-8492-fc01e5a93c24 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:19.404381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c93401-3524-489d-8492-fc01e5a93c24 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:19.404594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c93401-3524-489d-8492-fc01e5a93c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:19.495013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-69c93401-3524-489d-8492-fc01e5a93c24 None None] MFA Rules not processed for user `a6c9c860d3314131948c0947814d522f`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:46:19.496395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-69c93401-3524-489d-8492-fc01e5a93c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:19.508386 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:46:19.698945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c3e2f-f958-4c71-ba35-c19d1048dafa admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:19.700381 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3934/7781] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:46:19 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:46:19.702506 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5d2c3e2f-f958-4c71-ba35-c19d1048dafa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:19.880328 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:46:19.892490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c3e2f-f958-4c71-ba35-c19d1048dafa admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:19.900102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230cdde-5408-41bb-a198-0fffc4415ed3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:19.900711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230cdde-5408-41bb-a198-0fffc4415ed3 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:19.900987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230cdde-5408-41bb-a198-0fffc4415ed3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:19.901281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230cdde-5408-41bb-a198-0fffc4415ed3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:19.926965 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f230cdde-5408-41bb-a198-0fffc4415ed3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:19.928484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f230cdde-5408-41bb-a198-0fffc4415ed3 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:19.953488 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3848/7782] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:46:19 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:46:20.249996 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c93401-3524-489d-8492-fc01e5a93c24 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:20.286398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c93401-3524-489d-8492-fc01e5a93c24 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:20.292290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38704a6-b106-421c-a4ea-6643fc5b36cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:20.293305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38704a6-b106-421c-a4ea-6643fc5b36cc service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:20.294149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38704a6-b106-421c-a4ea-6643fc5b36cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:20.294886 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38704a6-b106-421c-a4ea-6643fc5b36cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:20.476094 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38704a6-b106-421c-a4ea-6643fc5b36cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:20.477486 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38704a6-b106-421c-a4ea-6643fc5b36cc service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:20.496394 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3935/7783] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:46:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:46:29.938891 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:46:30.502558 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=55 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:46:40.600052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230cdde-5408-41bb-a198-0fffc4415ed3 service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:40.603864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f230cdde-5408-41bb-a198-0fffc4415ed3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:40.785006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230cdde-5408-41bb-a198-0fffc4415ed3 service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:40.798572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4fd60-df80-4b14-9e50-84cfb3962420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:40.799513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4fd60-df80-4b14-9e50-84cfb3962420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:40.800063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4fd60-df80-4b14-9e50-84cfb3962420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:40.800529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4fd60-df80-4b14-9e50-84cfb3962420 admin admin] PATH_INFO: `/v3/users/0f03e31a52294d39afb68f6f6aaa51f4` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:40.802482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4fd60-df80-4b14-9e50-84cfb3962420 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f03e31a52294d39afb68f6f6aaa51f4)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:40.805171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4fd60-df80-4b14-9e50-84cfb3962420 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:41.058818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cea4fd60-df80-4b14-9e50-84cfb3962420 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f03e31a52294d39afb68f6f6aaa51f4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:41.126836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cea4fd60-df80-4b14-9e50-84cfb3962420 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f03e31a52294d39afb68f6f6aaa51f4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:41.194391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cea4fd60-df80-4b14-9e50-84cfb3962420 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f03e31a52294d39afb68f6f6aaa51f4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:41.196439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cea4fd60-df80-4b14-9e50-84cfb3962420 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f03e31a52294d39afb68f6f6aaa51f4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:41.219086 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-cea4fd60-df80-4b14-9e50-84cfb3962420 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f03e31a52294d39afb68f6f6aaa51f4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:41.247189 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3849/7784] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:46:40 2022] DELETE /identity/v3/users/0f03e31a52294d39afb68f6f6aaa51f4 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:46:41.251811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20481f-877a-421b-b9fc-75d6778a6a4d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:41.252924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20481f-877a-421b-b9fc-75d6778a6a4d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:41.253724 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20481f-877a-421b-b9fc-75d6778a6a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:41.305327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0a20481f-877a-421b-b9fc-75d6778a6a4d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:46:41.308795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0a20481f-877a-421b-b9fc-75d6778a6a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:41.485982 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3936/7785] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:46:41.614992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4fd60-df80-4b14-9e50-84cfb3962420 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:41.617250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cea4fd60-df80-4b14-9e50-84cfb3962420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:41.845935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4fd60-df80-4b14-9e50-84cfb3962420 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:41.850370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc650e-bf64-4ba0-a580-c7b236dedcd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:41.851449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc650e-bf64-4ba0-a580-c7b236dedcd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:41.852020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc650e-bf64-4ba0-a580-c7b236dedcd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:41.852528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc650e-bf64-4ba0-a580-c7b236dedcd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:41.873083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc650e-bf64-4ba0-a580-c7b236dedcd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:41.874977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc650e-bf64-4ba0-a580-c7b236dedcd9 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:41.902464 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3850/7786] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:46:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:46:44.527635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a20481f-877a-421b-b9fc-75d6778a6a4d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:44.529136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0a20481f-877a-421b-b9fc-75d6778a6a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:44.554237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a20481f-877a-421b-b9fc-75d6778a6a4d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:44.565323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de96ff5-f226-4981-b486-9436eac4e79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:44.566486 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de96ff5-f226-4981-b486-9436eac4e79a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:44.566977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de96ff5-f226-4981-b486-9436eac4e79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:44.567428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de96ff5-f226-4981-b486-9436eac4e79a admin admin] PATH_INFO: `/v3/projects/58e45c0010314de2baf90da2055b5bf5` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:44.579167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de96ff5-f226-4981-b486-9436eac4e79a admin admin] RBAC: Authorizing `identity:delete_project(project_id=58e45c0010314de2baf90da2055b5bf5)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:44.582401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de96ff5-f226-4981-b486-9436eac4e79a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:44.824640 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1de96ff5-f226-4981-b486-9436eac4e79a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58e45c0010314de2baf90da2055b5bf5', 'request_id': 'req-1de96ff5-f226-4981-b486-9436eac4e79a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:44.885131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1de96ff5-f226-4981-b486-9436eac4e79a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58e45c0010314de2baf90da2055b5bf5', 'request_id': 'req-1de96ff5-f226-4981-b486-9436eac4e79a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:44.936778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1de96ff5-f226-4981-b486-9436eac4e79a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58e45c0010314de2baf90da2055b5bf5', 'request_id': 'req-1de96ff5-f226-4981-b486-9436eac4e79a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:45.004548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1de96ff5-f226-4981-b486-9436eac4e79a admin admin] The token cache is being invalidate because project 58e45c0010314de2baf90da2055b5bf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:46:45.004975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1de96ff5-f226-4981-b486-9436eac4e79a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:45.011172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1de96ff5-f226-4981-b486-9436eac4e79a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:45.019588 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3937/7787] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:46:44 2022] DELETE /identity/v3/projects/58e45c0010314de2baf90da2055b5bf5 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:46:45.027031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc650e-bf64-4ba0-a580-c7b236dedcd9 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:45.092245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc650e-bf64-4ba0-a580-c7b236dedcd9 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:45.264346 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:46:45.530447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9c743-f74a-4007-96d8-fdb00cb1ee98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:45.533158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9c743-f74a-4007-96d8-fdb00cb1ee98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:45.533562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9c743-f74a-4007-96d8-fdb00cb1ee98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:45.534050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9c743-f74a-4007-96d8-fdb00cb1ee98 admin admin] PATH_INFO: `/v3/users/d26add13ec9a4254abe63ccfe27f4b13` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:45.539564 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9c743-f74a-4007-96d8-fdb00cb1ee98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d26add13ec9a4254abe63ccfe27f4b13)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:45.546081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9c743-f74a-4007-96d8-fdb00cb1ee98 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:45.811744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-19c9c743-f74a-4007-96d8-fdb00cb1ee98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd26add13ec9a4254abe63ccfe27f4b13'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:45.860124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-19c9c743-f74a-4007-96d8-fdb00cb1ee98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd26add13ec9a4254abe63ccfe27f4b13'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:45.901059 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-19c9c743-f74a-4007-96d8-fdb00cb1ee98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd26add13ec9a4254abe63ccfe27f4b13'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:45.901807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-19c9c743-f74a-4007-96d8-fdb00cb1ee98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd26add13ec9a4254abe63ccfe27f4b13'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:45.920015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-19c9c743-f74a-4007-96d8-fdb00cb1ee98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd26add13ec9a4254abe63ccfe27f4b13'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:45.935357 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3851/7788] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:46:45 2022] DELETE /identity/v3/users/d26add13ec9a4254abe63ccfe27f4b13 => generated 0 bytes in 905 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:46:47.339706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de96ff5-f226-4981-b486-9436eac4e79a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:47.341909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1de96ff5-f226-4981-b486-9436eac4e79a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:47.407761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de96ff5-f226-4981-b486-9436eac4e79a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:47.675987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c102d79-e784-4866-929c-1b8e3121009c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:47.676845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c102d79-e784-4866-929c-1b8e3121009c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:47.677218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c102d79-e784-4866-929c-1b8e3121009c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:47.679712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c102d79-e784-4866-929c-1b8e3121009c admin admin] PATH_INFO: `/v3/projects/f627b73f82f14462b91fb613b410430e` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:47.683240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c102d79-e784-4866-929c-1b8e3121009c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f627b73f82f14462b91fb613b410430e)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:47.686852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c102d79-e784-4866-929c-1b8e3121009c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:47.838100 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:46:47.925397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3c102d79-e784-4866-929c-1b8e3121009c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f627b73f82f14462b91fb613b410430e', 'request_id': 'req-3c102d79-e784-4866-929c-1b8e3121009c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:47.960907 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3c102d79-e784-4866-929c-1b8e3121009c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f627b73f82f14462b91fb613b410430e', 'request_id': 'req-3c102d79-e784-4866-929c-1b8e3121009c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:47.992647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3c102d79-e784-4866-929c-1b8e3121009c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f627b73f82f14462b91fb613b410430e', 'request_id': 'req-3c102d79-e784-4866-929c-1b8e3121009c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:48.045030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3c102d79-e784-4866-929c-1b8e3121009c admin admin] The token cache is being invalidate because project f627b73f82f14462b91fb613b410430e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:46:48.045508 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3c102d79-e784-4866-929c-1b8e3121009c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:48.051270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3c102d79-e784-4866-929c-1b8e3121009c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:48.068109 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3938/7789] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:46:47 2022] DELETE /identity/v3/projects/f627b73f82f14462b91fb613b410430e => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:46:48.068650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbd385-9b48-46cf-83a8-36b5f4b8cdca None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:48.069154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbd385-9b48-46cf-83a8-36b5f4b8cdca None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:48.069154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbd385-9b48-46cf-83a8-36b5f4b8cdca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:48.127263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-dadbd385-9b48-46cf-83a8-36b5f4b8cdca None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:46:48.130354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-dadbd385-9b48-46cf-83a8-36b5f4b8cdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:48.495989 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3852/7790] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:46:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:46:48.517946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec86542-a4fb-4897-9b19-1eff0aa031d9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:48.519222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec86542-a4fb-4897-9b19-1eff0aa031d9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:48.520396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec86542-a4fb-4897-9b19-1eff0aa031d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:48.700620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-8ec86542-a4fb-4897-9b19-1eff0aa031d9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:46:48.707436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8ec86542-a4fb-4897-9b19-1eff0aa031d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:48.744844 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3939/7791] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:46:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:46:48.751064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbd385-9b48-46cf-83a8-36b5f4b8cdca None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:48.768969 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbd385-9b48-46cf-83a8-36b5f4b8cdca None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:48.816453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67c677-2ad5-450e-9e70-54f68aea749e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:48.817729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67c677-2ad5-450e-9e70-54f68aea749e admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:48.820775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67c677-2ad5-450e-9e70-54f68aea749e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:48.821285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67c677-2ad5-450e-9e70-54f68aea749e admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:48.822214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67c677-2ad5-450e-9e70-54f68aea749e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:46:48.822924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67c677-2ad5-450e-9e70-54f68aea749e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:48.830751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67c677-2ad5-450e-9e70-54f68aea749e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:48.887773 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3853/7792] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:46:48.891951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec86542-a4fb-4897-9b19-1eff0aa031d9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:48.907098 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec86542-a4fb-4897-9b19-1eff0aa031d9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:48.923234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d13b48-2c71-4a74-b301-bc7ffa8c56a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:48.925576 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d13b48-2c71-4a74-b301-bc7ffa8c56a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:48.928077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d13b48-2c71-4a74-b301-bc7ffa8c56a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:48.928645 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d13b48-2c71-4a74-b301-bc7ffa8c56a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:48.929561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d13b48-2c71-4a74-b301-bc7ffa8c56a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:48.943978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d13b48-2c71-4a74-b301-bc7ffa8c56a9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:49.071112 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3940/7793] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:46:48 2022] POST /identity/v3/projects => generated 391 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:46:49.075191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67c677-2ad5-450e-9e70-54f68aea749e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:49.091968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67c677-2ad5-450e-9e70-54f68aea749e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:49.290136 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:46:49.494953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3dbb6-dc5d-4c2e-a10a-e693e991415e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:49.496420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3dbb6-dc5d-4c2e-a10a-e693e991415e admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:49.498677 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3dbb6-dc5d-4c2e-a10a-e693e991415e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:49.499134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3dbb6-dc5d-4c2e-a10a-e693e991415e admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:49.501647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3dbb6-dc5d-4c2e-a10a-e693e991415e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:49.506457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3dbb6-dc5d-4c2e-a10a-e693e991415e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:49.587026 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3854/7794] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:46:49 2022] POST /identity/v3/users => generated 296 bytes in 512 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:46:49.587899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d13b48-2c71-4a74-b301-bc7ffa8c56a9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:49.631353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d13b48-2c71-4a74-b301-bc7ffa8c56a9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:49.669067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd05b63-8a2a-4362-aca4-567bd5f4fa2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:49.674045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd05b63-8a2a-4362-aca4-567bd5f4fa2c admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:49.676917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd05b63-8a2a-4362-aca4-567bd5f4fa2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:49.679219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd05b63-8a2a-4362-aca4-567bd5f4fa2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:49.684577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd05b63-8a2a-4362-aca4-567bd5f4fa2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:49.702299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd05b63-8a2a-4362-aca4-567bd5f4fa2c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:49.825725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3dbb6-dc5d-4c2e-a10a-e693e991415e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:49.826756 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3941/7795] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:46:49.839006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3dbb6-dc5d-4c2e-a10a-e693e991415e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:49.861019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75a37c-ee01-4ccb-adfe-8031bbda23e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:49.862079 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75a37c-ee01-4ccb-adfe-8031bbda23e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:49.862079 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75a37c-ee01-4ccb-adfe-8031bbda23e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:49.862079 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75a37c-ee01-4ccb-adfe-8031bbda23e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:49.864205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75a37c-ee01-4ccb-adfe-8031bbda23e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:49.864460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75a37c-ee01-4ccb-adfe-8031bbda23e4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:49.936491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd05b63-8a2a-4362-aca4-567bd5f4fa2c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:49.949230 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3855/7796] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:46:49.951456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd05b63-8a2a-4362-aca4-567bd5f4fa2c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:49.976593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767e87b-35f3-4ee8-8108-5678fc38e194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:49.977061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767e87b-35f3-4ee8-8108-5678fc38e194 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:49.977663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767e87b-35f3-4ee8-8108-5678fc38e194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:49.981954 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767e87b-35f3-4ee8-8108-5678fc38e194 admin admin] PATH_INFO: `/v3/projects/b2c09994b0e44b358e3fe183154f0dc5/users/e4db011a9c7a4ba588509b8273e8d95d/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:50.080830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b767e87b-35f3-4ee8-8108-5678fc38e194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2c09994b0e44b358e3fe183154f0dc5, user_id=e4db011a9c7a4ba588509b8273e8d95d, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:50.083536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b767e87b-35f3-4ee8-8108-5678fc38e194 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:50.143298 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3942/7797] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:46:49 2022] PUT /identity/v3/projects/b2c09994b0e44b358e3fe183154f0dc5/users/e4db011a9c7a4ba588509b8273e8d95d/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:46:50.153572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00038f43-d946-4eac-9571-21a2b7913b7a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:50.154471 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00038f43-d946-4eac-9571-21a2b7913b7a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:50.154928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00038f43-d946-4eac-9571-21a2b7913b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:50.296911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-00038f43-d946-4eac-9571-21a2b7913b7a None None] MFA Rules not processed for user `e4db011a9c7a4ba588509b8273e8d95d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:46:50.298816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-00038f43-d946-4eac-9571-21a2b7913b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:50.689253 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3856/7798] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:46:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 531 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:46:50.724907 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767e87b-35f3-4ee8-8108-5678fc38e194 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:50.727577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b767e87b-35f3-4ee8-8108-5678fc38e194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:50.988989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767e87b-35f3-4ee8-8108-5678fc38e194 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:51.006701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac863d53-badf-4441-b18a-a3e7990769ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:51.007361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac863d53-badf-4441-b18a-a3e7990769ff service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:51.008535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac863d53-badf-4441-b18a-a3e7990769ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:51.009537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac863d53-badf-4441-b18a-a3e7990769ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:51.082612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac863d53-badf-4441-b18a-a3e7990769ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:51.086805 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac863d53-badf-4441-b18a-a3e7990769ff service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:51.192868 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3943/7799] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:46:50 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:46:51.225800 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00038f43-d946-4eac-9571-21a2b7913b7a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:51.229757 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-00038f43-d946-4eac-9571-21a2b7913b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:51.276251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac863d53-badf-4441-b18a-a3e7990769ff service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:51.333483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00038f43-d946-4eac-9571-21a2b7913b7a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:51.364663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf0c02-9305-47eb-95f0-adf6b910c61d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:51.365304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf0c02-9305-47eb-95f0-adf6b910c61d service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:51.365585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf0c02-9305-47eb-95f0-adf6b910c61d service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:51.365853 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf0c02-9305-47eb-95f0-adf6b910c61d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:51.377672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-96cf0c02-9305-47eb-95f0-adf6b910c61d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:51.427037 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf0c02-9305-47eb-95f0-adf6b910c61d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:51.428542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf0c02-9305-47eb-95f0-adf6b910c61d service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:51.458026 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3857/7800] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:46:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:46:51.556460 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:46:51.584080 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac863d53-badf-4441-b18a-a3e7990769ff service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:51.591252 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a16244-bb82-4234-8f82-3cdd317cef5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:51.593531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a16244-bb82-4234-8f82-3cdd317cef5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:51.593531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a16244-bb82-4234-8f82-3cdd317cef5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:51.593531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a16244-bb82-4234-8f82-3cdd317cef5a admin admin] PATH_INFO: `/v3/users/e4db011a9c7a4ba588509b8273e8d95d` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:51.595139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a16244-bb82-4234-8f82-3cdd317cef5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4db011a9c7a4ba588509b8273e8d95d)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:51.597646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a16244-bb82-4234-8f82-3cdd317cef5a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:51.741875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e3a16244-bb82-4234-8f82-3cdd317cef5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4db011a9c7a4ba588509b8273e8d95d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:51.798626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e3a16244-bb82-4234-8f82-3cdd317cef5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4db011a9c7a4ba588509b8273e8d95d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:51.962011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e3a16244-bb82-4234-8f82-3cdd317cef5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4db011a9c7a4ba588509b8273e8d95d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:51.979266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e3a16244-bb82-4234-8f82-3cdd317cef5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4db011a9c7a4ba588509b8273e8d95d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:52.012803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e3a16244-bb82-4234-8f82-3cdd317cef5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4db011a9c7a4ba588509b8273e8d95d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:52.046729 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3944/7801] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:46:51 2022] DELETE /identity/v3/users/e4db011a9c7a4ba588509b8273e8d95d => generated 0 bytes in 767 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:46:52.061579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89000c2-aff4-455d-be9a-66f7211a5316 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:52.061904 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89000c2-aff4-455d-be9a-66f7211a5316 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:52.062188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89000c2-aff4-455d-be9a-66f7211a5316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:52.127571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-a89000c2-aff4-455d-be9a-66f7211a5316 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:46:52.135111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a89000c2-aff4-455d-be9a-66f7211a5316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:52.580498 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3858/7802] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 529 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:46:52.791638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a16244-bb82-4234-8f82-3cdd317cef5a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:52.795480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e3a16244-bb82-4234-8f82-3cdd317cef5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:53.039916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a16244-bb82-4234-8f82-3cdd317cef5a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:53.051033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6421a2e-3b0e-458f-a7ab-de77804bb299 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:53.054970 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6421a2e-3b0e-458f-a7ab-de77804bb299 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:53.055388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6421a2e-3b0e-458f-a7ab-de77804bb299 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:53.055786 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6421a2e-3b0e-458f-a7ab-de77804bb299 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:53.080188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6421a2e-3b0e-458f-a7ab-de77804bb299 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:53.082587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6421a2e-3b0e-458f-a7ab-de77804bb299 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:53.118531 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3945/7803] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:46:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:46:55.366472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275b377-33a3-4ffb-86f1-03a4b38d5979 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:55.367401 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275b377-33a3-4ffb-86f1-03a4b38d5979 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:55.367869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275b377-33a3-4ffb-86f1-03a4b38d5979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:55.456368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d275b377-33a3-4ffb-86f1-03a4b38d5979 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:46:55.458447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d275b377-33a3-4ffb-86f1-03a4b38d5979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:55.548919 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:46:55.802034 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3859/7804] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:46:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:46:55.827998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6421a2e-3b0e-458f-a7ab-de77804bb299 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:55.832510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b6421a2e-3b0e-458f-a7ab-de77804bb299 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:56.136053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275b377-33a3-4ffb-86f1-03a4b38d5979 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:56.138732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d275b377-33a3-4ffb-86f1-03a4b38d5979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:56.195243 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6421a2e-3b0e-458f-a7ab-de77804bb299 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:56.197838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275b377-33a3-4ffb-86f1-03a4b38d5979 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:56.202198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab361b-945e-4d41-a139-daef6b29a498 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:56.203176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab361b-945e-4d41-a139-daef6b29a498 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:56.204765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab361b-945e-4d41-a139-daef6b29a498 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:56.205387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab361b-945e-4d41-a139-daef6b29a498 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:56.224905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab361b-945e-4d41-a139-daef6b29a498 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:56.227045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab361b-945e-4d41-a139-daef6b29a498 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:56.238369 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3946/7805] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:46:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:46:56.276128 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a12bf8-96f5-4e64-8d74-62da49c68a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:56.279814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a12bf8-96f5-4e64-8d74-62da49c68a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:56.280404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a12bf8-96f5-4e64-8d74-62da49c68a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:56.280856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a12bf8-96f5-4e64-8d74-62da49c68a7a admin admin] PATH_INFO: `/v3/projects/b2c09994b0e44b358e3fe183154f0dc5` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:56.309874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a12bf8-96f5-4e64-8d74-62da49c68a7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2c09994b0e44b358e3fe183154f0dc5)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:56.337866 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a12bf8-96f5-4e64-8d74-62da49c68a7a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:56.478589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-19a12bf8-96f5-4e64-8d74-62da49c68a7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2c09994b0e44b358e3fe183154f0dc5', 'request_id': 'req-19a12bf8-96f5-4e64-8d74-62da49c68a7a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:56.498999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-19a12bf8-96f5-4e64-8d74-62da49c68a7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2c09994b0e44b358e3fe183154f0dc5', 'request_id': 'req-19a12bf8-96f5-4e64-8d74-62da49c68a7a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:56.524972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-19a12bf8-96f5-4e64-8d74-62da49c68a7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2c09994b0e44b358e3fe183154f0dc5', 'request_id': 'req-19a12bf8-96f5-4e64-8d74-62da49c68a7a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:56.552922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-19a12bf8-96f5-4e64-8d74-62da49c68a7a admin admin] The token cache is being invalidate because project b2c09994b0e44b358e3fe183154f0dc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:46:56.553219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-19a12bf8-96f5-4e64-8d74-62da49c68a7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:56.557149 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-19a12bf8-96f5-4e64-8d74-62da49c68a7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:46:56.569860 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3860/7806] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:46:56 2022] DELETE /identity/v3/projects/b2c09994b0e44b358e3fe183154f0dc5 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:46:56.570871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0396ba-6841-49ec-b000-0c2de5fcb995 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:56.571088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0396ba-6841-49ec-b000-0c2de5fcb995 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:56.571363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0396ba-6841-49ec-b000-0c2de5fcb995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:56.591090 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:46:56.621735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-cc0396ba-6841-49ec-b000-0c2de5fcb995 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:46:56.623414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-cc0396ba-6841-49ec-b000-0c2de5fcb995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:56.908930 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069936b7-50a5-4f20-b7f7-9ce196f9f502 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:56.909735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069936b7-50a5-4f20-b7f7-9ce196f9f502 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:56.910065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069936b7-50a5-4f20-b7f7-9ce196f9f502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:56.913483 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3947/7807] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:46:56.978302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-069936b7-50a5-4f20-b7f7-9ce196f9f502 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:46:56.979803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-069936b7-50a5-4f20-b7f7-9ce196f9f502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:57.007579 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3861/7808] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:46:57.016673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0396ba-6841-49ec-b000-0c2de5fcb995 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:57.029596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0396ba-6841-49ec-b000-0c2de5fcb995 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:57.041860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282f237-5d09-4e2c-97b0-13a446f299bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:57.043544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282f237-5d09-4e2c-97b0-13a446f299bb admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:57.044303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282f237-5d09-4e2c-97b0-13a446f299bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:57.045435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282f237-5d09-4e2c-97b0-13a446f299bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:57.047791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3282f237-5d09-4e2c-97b0-13a446f299bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:46:57.049188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3282f237-5d09-4e2c-97b0-13a446f299bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:57.053672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3282f237-5d09-4e2c-97b0-13a446f299bb admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:57.088030 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3948/7809] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:46:57.093004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069936b7-50a5-4f20-b7f7-9ce196f9f502 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:57.103416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069936b7-50a5-4f20-b7f7-9ce196f9f502 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:57.132296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b067f0-7c11-4916-966b-4c9b8440ce72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:57.132928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b067f0-7c11-4916-966b-4c9b8440ce72 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:57.134520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b067f0-7c11-4916-966b-4c9b8440ce72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:57.134798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b067f0-7c11-4916-966b-4c9b8440ce72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:57.151548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b067f0-7c11-4916-966b-4c9b8440ce72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:57.160982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b067f0-7c11-4916-966b-4c9b8440ce72 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:57.336687 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3862/7810] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:46:57 2022] POST /identity/v3/projects => generated 377 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:46:57.339115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282f237-5d09-4e2c-97b0-13a446f299bb admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:57.362985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282f237-5d09-4e2c-97b0-13a446f299bb admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:57.565651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53fdb3-42ea-4cfa-b99d-528bffbae1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:57.566289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53fdb3-42ea-4cfa-b99d-528bffbae1d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:57.566567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53fdb3-42ea-4cfa-b99d-528bffbae1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:57.566842 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53fdb3-42ea-4cfa-b99d-528bffbae1d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:57.567478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53fdb3-42ea-4cfa-b99d-528bffbae1d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:57.569505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53fdb3-42ea-4cfa-b99d-528bffbae1d6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:57.643250 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3949/7811] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:46:57 2022] POST /identity/v3/users => generated 289 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:46:57.644703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b067f0-7c11-4916-966b-4c9b8440ce72 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:57.673555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b067f0-7c11-4916-966b-4c9b8440ce72 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:57.705721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20364e-98cb-4ea1-aa74-272e55100ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:57.706360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20364e-98cb-4ea1-aa74-272e55100ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:57.706638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20364e-98cb-4ea1-aa74-272e55100ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:57.706910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20364e-98cb-4ea1-aa74-272e55100ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:57.707578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20364e-98cb-4ea1-aa74-272e55100ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:57.709305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20364e-98cb-4ea1-aa74-272e55100ca6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:57.759798 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3863/7812] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:46:57.767180 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53fdb3-42ea-4cfa-b99d-528bffbae1d6 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:57.795287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53fdb3-42ea-4cfa-b99d-528bffbae1d6 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:57.831820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2638593-9632-47d6-bfbb-8f9944fd9a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:57.832530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2638593-9632-47d6-bfbb-8f9944fd9a05 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:57.835110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2638593-9632-47d6-bfbb-8f9944fd9a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:57.837329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2638593-9632-47d6-bfbb-8f9944fd9a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:57.841220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2638593-9632-47d6-bfbb-8f9944fd9a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:57.850056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2638593-9632-47d6-bfbb-8f9944fd9a05 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:57.929620 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20364e-98cb-4ea1-aa74-272e55100ca6 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:57.941227 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3950/7813] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:46:57.950408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20364e-98cb-4ea1-aa74-272e55100ca6 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:58.023711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16947b3-d8bd-4ebd-9562-8e77f57c4602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:58.035700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16947b3-d8bd-4ebd-9562-8e77f57c4602 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:58.038951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16947b3-d8bd-4ebd-9562-8e77f57c4602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:58.038951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16947b3-d8bd-4ebd-9562-8e77f57c4602 admin admin] PATH_INFO: `/v3/projects/2193b215d72d4858bcfeaaccead01d4b/users/a51ed94295c644b2b7c22ab904af2774/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:58.123872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16947b3-d8bd-4ebd-9562-8e77f57c4602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2193b215d72d4858bcfeaaccead01d4b, user_id=a51ed94295c644b2b7c22ab904af2774, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:58.137400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16947b3-d8bd-4ebd-9562-8e77f57c4602 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:58.228971 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3864/7814] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:46:57 2022] PUT /identity/v3/projects/2193b215d72d4858bcfeaaccead01d4b/users/a51ed94295c644b2b7c22ab904af2774/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:46:58.242322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f8d34-7631-49b5-9b37-b6b58c0d1302 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:58.242868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f8d34-7631-49b5-9b37-b6b58c0d1302 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:58.243337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f8d34-7631-49b5-9b37-b6b58c0d1302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:58.332953 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-8a6f8d34-7631-49b5-9b37-b6b58c0d1302 None None] MFA Rules not processed for user `a51ed94295c644b2b7c22ab904af2774`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:46:58.334215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8a6f8d34-7631-49b5-9b37-b6b58c0d1302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:58.498029 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:46:58.511254 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3951/7815] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:46:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:46:58.552121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16947b3-d8bd-4ebd-9562-8e77f57c4602 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:46:58.554145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f16947b3-d8bd-4ebd-9562-8e77f57c4602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:46:58.697665 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:46:58.709548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16947b3-d8bd-4ebd-9562-8e77f57c4602 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:46:58.724049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76a173-17bf-4de8-8ea0-0e8fb8fe0c27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:46:58.725201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76a173-17bf-4de8-8ea0-0e8fb8fe0c27 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:46:58.725672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76a173-17bf-4de8-8ea0-0e8fb8fe0c27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:46:58.726116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76a173-17bf-4de8-8ea0-0e8fb8fe0c27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:46:58.752020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76a173-17bf-4de8-8ea0-0e8fb8fe0c27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:46:58.753974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76a173-17bf-4de8-8ea0-0e8fb8fe0c27 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:46:58.775360 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3865/7816] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:46:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:47:06.518619 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f8d34-7631-49b5-9b37-b6b58c0d1302 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:06.521949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8a6f8d34-7631-49b5-9b37-b6b58c0d1302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:06.765988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f8d34-7631-49b5-9b37-b6b58c0d1302 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:06.793679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec878e9-2bb2-487c-95d3-8aff67c96dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:06.794449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec878e9-2bb2-487c-95d3-8aff67c96dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:06.795126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec878e9-2bb2-487c-95d3-8aff67c96dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:06.795406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec878e9-2bb2-487c-95d3-8aff67c96dcf admin admin] PATH_INFO: `/v3/users/84e60500a5354328990e61423f46f381` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:06.797222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec878e9-2bb2-487c-95d3-8aff67c96dcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=84e60500a5354328990e61423f46f381)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:06.807426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec878e9-2bb2-487c-95d3-8aff67c96dcf admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:07.015309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1ec878e9-2bb2-487c-95d3-8aff67c96dcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84e60500a5354328990e61423f46f381'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:07.051653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1ec878e9-2bb2-487c-95d3-8aff67c96dcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84e60500a5354328990e61423f46f381'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:07.100732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1ec878e9-2bb2-487c-95d3-8aff67c96dcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84e60500a5354328990e61423f46f381'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:07.109619 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1ec878e9-2bb2-487c-95d3-8aff67c96dcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84e60500a5354328990e61423f46f381'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:07.132032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1ec878e9-2bb2-487c-95d3-8aff67c96dcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84e60500a5354328990e61423f46f381'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:07.177857 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3952/7817] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:47:06 2022] DELETE /identity/v3/users/84e60500a5354328990e61423f46f381 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:47:08.510199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76a173-17bf-4de8-8ea0-0e8fb8fe0c27 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:08.580501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76a173-17bf-4de8-8ea0-0e8fb8fe0c27 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:08.803056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bcf6a2-f375-4d81-bb32-17329c1ed1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:08.804773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcf6a2-f375-4d81-bb32-17329c1ed1c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:08.806494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcf6a2-f375-4d81-bb32-17329c1ed1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:08.807331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcf6a2-f375-4d81-bb32-17329c1ed1c0 admin admin] PATH_INFO: `/v3/projects/5e7d677cea9a4349bc788e6717763915` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:08.820130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bcf6a2-f375-4d81-bb32-17329c1ed1c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e7d677cea9a4349bc788e6717763915)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:08.823644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bcf6a2-f375-4d81-bb32-17329c1ed1c0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:09.072959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a8bcf6a2-f375-4d81-bb32-17329c1ed1c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e7d677cea9a4349bc788e6717763915', 'request_id': 'req-a8bcf6a2-f375-4d81-bb32-17329c1ed1c0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:09.090279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a8bcf6a2-f375-4d81-bb32-17329c1ed1c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e7d677cea9a4349bc788e6717763915', 'request_id': 'req-a8bcf6a2-f375-4d81-bb32-17329c1ed1c0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:09.133082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a8bcf6a2-f375-4d81-bb32-17329c1ed1c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e7d677cea9a4349bc788e6717763915', 'request_id': 'req-a8bcf6a2-f375-4d81-bb32-17329c1ed1c0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:09.182039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a8bcf6a2-f375-4d81-bb32-17329c1ed1c0 admin admin] The token cache is being invalidate because project 5e7d677cea9a4349bc788e6717763915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:47:09.184067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a8bcf6a2-f375-4d81-bb32-17329c1ed1c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:09.187257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a8bcf6a2-f375-4d81-bb32-17329c1ed1c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:09.204020 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3866/7818] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:47:08 2022] DELETE /identity/v3/projects/5e7d677cea9a4349bc788e6717763915 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:47:09.205803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f7081-bd9a-45b2-893b-474a952d971f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:09.206281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f7081-bd9a-45b2-893b-474a952d971f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:09.206411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f7081-bd9a-45b2-893b-474a952d971f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:09.306279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5b1f7081-bd9a-45b2-893b-474a952d971f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:47:09.307356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5b1f7081-bd9a-45b2-893b-474a952d971f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:09.722377 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3953/7819] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 517 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:47:09.734459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72ca82-786f-4aa1-b450-3ee2ace0ac4a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:09.735491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72ca82-786f-4aa1-b450-3ee2ace0ac4a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:09.736030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72ca82-786f-4aa1-b450-3ee2ace0ac4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:09.771167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-5f72ca82-786f-4aa1-b450-3ee2ace0ac4a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:47:09.773274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5f72ca82-786f-4aa1-b450-3ee2ace0ac4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:09.795096 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3867/7820] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:47:09.799614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f7081-bd9a-45b2-893b-474a952d971f None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:09.814037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f7081-bd9a-45b2-893b-474a952d971f None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:09.824498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634e754-f126-4449-b84f-ef21e90482ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:09.828092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634e754-f126-4449-b84f-ef21e90482ab admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:09.829599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634e754-f126-4449-b84f-ef21e90482ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:09.830067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634e754-f126-4449-b84f-ef21e90482ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:09.830953 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9634e754-f126-4449-b84f-ef21e90482ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:47:09.833499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9634e754-f126-4449-b84f-ef21e90482ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:09.836930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9634e754-f126-4449-b84f-ef21e90482ab admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:09.868870 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3954/7821] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:47:09.872609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72ca82-786f-4aa1-b450-3ee2ace0ac4a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:09.891461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72ca82-786f-4aa1-b450-3ee2ace0ac4a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:09.925313 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39301a84-0c23-4808-8578-67641b6682f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:09.926262 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39301a84-0c23-4808-8578-67641b6682f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:09.926722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39301a84-0c23-4808-8578-67641b6682f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:09.929569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39301a84-0c23-4808-8578-67641b6682f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:09.933216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39301a84-0c23-4808-8578-67641b6682f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:09.936642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39301a84-0c23-4808-8578-67641b6682f5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:10.007486 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3868/7822] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:47:09 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:47:10.015784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634e754-f126-4449-b84f-ef21e90482ab admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:10.040386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634e754-f126-4449-b84f-ef21e90482ab admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:10.056575 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:47:10.231386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b3a20-fa62-403f-928b-d6089a9644cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:10.232167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b3a20-fa62-403f-928b-d6089a9644cf admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:10.237578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b3a20-fa62-403f-928b-d6089a9644cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:10.238019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b3a20-fa62-403f-928b-d6089a9644cf admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:10.239735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b3a20-fa62-403f-928b-d6089a9644cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:10.241964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b3a20-fa62-403f-928b-d6089a9644cf admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:10.304423 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3955/7823] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:47:10 2022] POST /identity/v3/users => generated 289 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:47:10.310187 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39301a84-0c23-4808-8578-67641b6682f5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:10.338347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39301a84-0c23-4808-8578-67641b6682f5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:10.386116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c59fb-5d99-48d7-926b-fc7212be4741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:10.387065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c59fb-5d99-48d7-926b-fc7212be4741 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:10.387509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c59fb-5d99-48d7-926b-fc7212be4741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:10.396131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c59fb-5d99-48d7-926b-fc7212be4741 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:10.397541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c59fb-5d99-48d7-926b-fc7212be4741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:10.402810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c59fb-5d99-48d7-926b-fc7212be4741 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:10.485171 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3869/7824] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:47:10.489967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b3a20-fa62-403f-928b-d6089a9644cf admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:10.510849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b3a20-fa62-403f-928b-d6089a9644cf admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:10.530620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695246c-6a69-4351-8685-3fbd7ab9a55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:10.544442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695246c-6a69-4351-8685-3fbd7ab9a55a admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:10.544817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695246c-6a69-4351-8685-3fbd7ab9a55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:10.550656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695246c-6a69-4351-8685-3fbd7ab9a55a admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:10.551451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695246c-6a69-4351-8685-3fbd7ab9a55a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:10.562490 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695246c-6a69-4351-8685-3fbd7ab9a55a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:10.644048 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3956/7825] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:47:10.653577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c59fb-5d99-48d7-926b-fc7212be4741 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:10.712517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c59fb-5d99-48d7-926b-fc7212be4741 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:10.768579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c9ee2-44d0-4cf3-8f3e-eea1d86f1eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:10.769662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c9ee2-44d0-4cf3-8f3e-eea1d86f1eac admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:10.788701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c9ee2-44d0-4cf3-8f3e-eea1d86f1eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:10.789539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c9ee2-44d0-4cf3-8f3e-eea1d86f1eac admin admin] PATH_INFO: `/v3/projects/c7a3020a0ea949869381043d752b6db1/users/8a3a1c2ff40d4dcb989f21354f682f84/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:10.907760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c9ee2-44d0-4cf3-8f3e-eea1d86f1eac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7a3020a0ea949869381043d752b6db1, user_id=8a3a1c2ff40d4dcb989f21354f682f84, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:10.926793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c9ee2-44d0-4cf3-8f3e-eea1d86f1eac admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:10.977314 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3870/7826] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:47:10 2022] PUT /identity/v3/projects/c7a3020a0ea949869381043d752b6db1/users/8a3a1c2ff40d4dcb989f21354f682f84/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:47:10.996812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed040726-0135-48db-830a-23dd814ec1a5 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:10.997144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed040726-0135-48db-830a-23dd814ec1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:10.997631 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed040726-0135-48db-830a-23dd814ec1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:11.073964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ed040726-0135-48db-830a-23dd814ec1a5 None None] MFA Rules not processed for user `8a3a1c2ff40d4dcb989f21354f682f84`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:47:11.076080 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ed040726-0135-48db-830a-23dd814ec1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:11.281976 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3957/7827] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:47:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:47:11.290144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c9ee2-44d0-4cf3-8f3e-eea1d86f1eac admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:11.292265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-815c9ee2-44d0-4cf3-8f3e-eea1d86f1eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:11.397228 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:47:11.513065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c9ee2-44d0-4cf3-8f3e-eea1d86f1eac admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:11.529718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e54fa4-47c3-49a5-8fa4-2f05e83cdde7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:11.530975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e54fa4-47c3-49a5-8fa4-2f05e83cdde7 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:11.531271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e54fa4-47c3-49a5-8fa4-2f05e83cdde7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:11.531547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e54fa4-47c3-49a5-8fa4-2f05e83cdde7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:11.559683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e54fa4-47c3-49a5-8fa4-2f05e83cdde7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:11.561217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e54fa4-47c3-49a5-8fa4-2f05e83cdde7 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:11.602232 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3871/7828] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:47:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:47:17.613022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed040726-0135-48db-830a-23dd814ec1a5 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:17.614860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ed040726-0135-48db-830a-23dd814ec1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:17.951669 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed040726-0135-48db-830a-23dd814ec1a5 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:17.971389 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc73f31-8bc5-449c-8fb4-1b82319706d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:17.973508 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc73f31-8bc5-449c-8fb4-1b82319706d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:17.973812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc73f31-8bc5-449c-8fb4-1b82319706d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:17.974820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc73f31-8bc5-449c-8fb4-1b82319706d1 admin admin] PATH_INFO: `/v3/users/6e82d5661e7a4d359e4f31d1dbd91db8` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:17.979609 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc73f31-8bc5-449c-8fb4-1b82319706d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e82d5661e7a4d359e4f31d1dbd91db8)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:17.992706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc73f31-8bc5-449c-8fb4-1b82319706d1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:18.074561 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:47:18.188768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8bc73f31-8bc5-449c-8fb4-1b82319706d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e82d5661e7a4d359e4f31d1dbd91db8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:18.222914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8bc73f31-8bc5-449c-8fb4-1b82319706d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e82d5661e7a4d359e4f31d1dbd91db8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:18.272337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8bc73f31-8bc5-449c-8fb4-1b82319706d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e82d5661e7a4d359e4f31d1dbd91db8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:18.273990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8bc73f31-8bc5-449c-8fb4-1b82319706d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e82d5661e7a4d359e4f31d1dbd91db8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:18.298315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8bc73f31-8bc5-449c-8fb4-1b82319706d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e82d5661e7a4d359e4f31d1dbd91db8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:18.317511 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3958/7829] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:47:17 2022] DELETE /identity/v3/users/6e82d5661e7a4d359e4f31d1dbd91db8 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:47:18.323911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5c19a-1317-44d8-ad9e-1fc39f6304ab None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:18.324668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5c19a-1317-44d8-ad9e-1fc39f6304ab None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:18.324668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5c19a-1317-44d8-ad9e-1fc39f6304ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:18.380820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7ff5c19a-1317-44d8-ad9e-1fc39f6304ab None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:47:18.397709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7ff5c19a-1317-44d8-ad9e-1fc39f6304ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:18.605580 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3872/7830] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:47:18.676000 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc73f31-8bc5-449c-8fb4-1b82319706d1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:18.679605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8bc73f31-8bc5-449c-8fb4-1b82319706d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:19.000809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc73f31-8bc5-449c-8fb4-1b82319706d1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:19.024554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e875c8f-d0a2-4b9d-b5c8-a2cb9b58c7c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:19.025884 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e875c8f-d0a2-4b9d-b5c8-a2cb9b58c7c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:19.026499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e875c8f-d0a2-4b9d-b5c8-a2cb9b58c7c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:19.027074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e875c8f-d0a2-4b9d-b5c8-a2cb9b58c7c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:19.060438 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e875c8f-d0a2-4b9d-b5c8-a2cb9b58c7c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:19.063393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e875c8f-d0a2-4b9d-b5c8-a2cb9b58c7c0 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:19.147080 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3959/7831] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:47:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:47:21.880356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5c19a-1317-44d8-ad9e-1fc39f6304ab None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:21.881911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7ff5c19a-1317-44d8-ad9e-1fc39f6304ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:21.913847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5c19a-1317-44d8-ad9e-1fc39f6304ab None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:21.938971 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b28b30-c9c5-456c-b787-043f4f21de19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:21.940058 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b28b30-c9c5-456c-b787-043f4f21de19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:21.940594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b28b30-c9c5-456c-b787-043f4f21de19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:21.941207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b28b30-c9c5-456c-b787-043f4f21de19 admin admin] PATH_INFO: `/v3/users/e089b475c57a4879b9d28e656ab4fd76` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:21.942651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b28b30-c9c5-456c-b787-043f4f21de19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e089b475c57a4879b9d28e656ab4fd76)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:21.944657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b28b30-c9c5-456c-b787-043f4f21de19 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:22.128168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-58b28b30-c9c5-456c-b787-043f4f21de19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e089b475c57a4879b9d28e656ab4fd76'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:22.166831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-58b28b30-c9c5-456c-b787-043f4f21de19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e089b475c57a4879b9d28e656ab4fd76'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:22.235664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-58b28b30-c9c5-456c-b787-043f4f21de19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e089b475c57a4879b9d28e656ab4fd76'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:22.238017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-58b28b30-c9c5-456c-b787-043f4f21de19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e089b475c57a4879b9d28e656ab4fd76'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:22.263487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-58b28b30-c9c5-456c-b787-043f4f21de19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e089b475c57a4879b9d28e656ab4fd76'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:22.268844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e875c8f-d0a2-4b9d-b5c8-a2cb9b58c7c0 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:22.270343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4e875c8f-d0a2-4b9d-b5c8-a2cb9b58c7c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:22.274410 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3873/7832] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:47:21 2022] DELETE /identity/v3/users/e089b475c57a4879b9d28e656ab4fd76 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:47:22.276108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048468a-6c45-45bf-805c-f8f3dc4d2add None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:22.276585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048468a-6c45-45bf-805c-f8f3dc4d2add None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:22.277525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048468a-6c45-45bf-805c-f8f3dc4d2add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:22.303700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2048468a-6c45-45bf-805c-f8f3dc4d2add None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:47:22.305343 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2048468a-6c45-45bf-805c-f8f3dc4d2add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:22.307867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e875c8f-d0a2-4b9d-b5c8-a2cb9b58c7c0 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:22.373887 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:47:22.483502 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3874/7833] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:47:22.491823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9bc6e-5c60-4411-a2c7-9b1593c83fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:22.492612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9bc6e-5c60-4411-a2c7-9b1593c83fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:22.492895 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9bc6e-5c60-4411-a2c7-9b1593c83fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:22.493167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9bc6e-5c60-4411-a2c7-9b1593c83fb0 admin admin] PATH_INFO: `/v3/projects/63e0a5005c4c45eca9b1192cd6564864` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:22.494666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9bc6e-5c60-4411-a2c7-9b1593c83fb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63e0a5005c4c45eca9b1192cd6564864)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:22.497561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9bc6e-5c60-4411-a2c7-9b1593c83fb0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:22.514875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048468a-6c45-45bf-805c-f8f3dc4d2add None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:22.521635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2048468a-6c45-45bf-805c-f8f3dc4d2add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:22.650147 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:47:22.664238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048468a-6c45-45bf-805c-f8f3dc4d2add None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:22.700596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-aec9bc6e-5c60-4411-a2c7-9b1593c83fb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63e0a5005c4c45eca9b1192cd6564864', 'request_id': 'req-aec9bc6e-5c60-4411-a2c7-9b1593c83fb0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:22.718419 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-aec9bc6e-5c60-4411-a2c7-9b1593c83fb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63e0a5005c4c45eca9b1192cd6564864', 'request_id': 'req-aec9bc6e-5c60-4411-a2c7-9b1593c83fb0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:22.744218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-aec9bc6e-5c60-4411-a2c7-9b1593c83fb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63e0a5005c4c45eca9b1192cd6564864', 'request_id': 'req-aec9bc6e-5c60-4411-a2c7-9b1593c83fb0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:22.768444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-aec9bc6e-5c60-4411-a2c7-9b1593c83fb0 admin admin] The token cache is being invalidate because project 63e0a5005c4c45eca9b1192cd6564864 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:47:22.769171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-aec9bc6e-5c60-4411-a2c7-9b1593c83fb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:22.769483 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-aec9bc6e-5c60-4411-a2c7-9b1593c83fb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:22.774659 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3960/7834] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:47:22 2022] DELETE /identity/v3/projects/63e0a5005c4c45eca9b1192cd6564864 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:47:22.775731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9bc6e-5c60-4411-a2c7-9b1593c83fb0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:22.777638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-aec9bc6e-5c60-4411-a2c7-9b1593c83fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:22.784881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0dd9cd-0650-4433-9e43-f17ce833dba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:22.785932 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0dd9cd-0650-4433-9e43-f17ce833dba4 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:22.791118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0dd9cd-0650-4433-9e43-f17ce833dba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:22.791711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0dd9cd-0650-4433-9e43-f17ce833dba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:22.794425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-da0dd9cd-0650-4433-9e43-f17ce833dba4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:22.885711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9bc6e-5c60-4411-a2c7-9b1593c83fb0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:22.893877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7786645-72a4-4e1a-831b-2b0e73adeec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:22.894988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7786645-72a4-4e1a-831b-2b0e73adeec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:22.895742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7786645-72a4-4e1a-831b-2b0e73adeec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:22.896244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7786645-72a4-4e1a-831b-2b0e73adeec0 admin admin] PATH_INFO: `/v3/users/a6c9c860d3314131948c0947814d522f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:22.898187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7786645-72a4-4e1a-831b-2b0e73adeec0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6c9c860d3314131948c0947814d522f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:22.901072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7786645-72a4-4e1a-831b-2b0e73adeec0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:22.908959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0dd9cd-0650-4433-9e43-f17ce833dba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:22.910696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0dd9cd-0650-4433-9e43-f17ce833dba4 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:22.943743 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3875/7835] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:47:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:47:23.022363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a7786645-72a4-4e1a-831b-2b0e73adeec0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6c9c860d3314131948c0947814d522f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:23.043583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a7786645-72a4-4e1a-831b-2b0e73adeec0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6c9c860d3314131948c0947814d522f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:23.069965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a7786645-72a4-4e1a-831b-2b0e73adeec0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6c9c860d3314131948c0947814d522f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:23.071206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a7786645-72a4-4e1a-831b-2b0e73adeec0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6c9c860d3314131948c0947814d522f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:23.106560 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a7786645-72a4-4e1a-831b-2b0e73adeec0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6c9c860d3314131948c0947814d522f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:23.154489 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3961/7836] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:47:22 2022] DELETE /identity/v3/users/a6c9c860d3314131948c0947814d522f => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:47:23.781420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0dd9cd-0650-4433-9e43-f17ce833dba4 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:23.783264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-da0dd9cd-0650-4433-9e43-f17ce833dba4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:23.829564 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0dd9cd-0650-4433-9e43-f17ce833dba4 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:23.950300 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:47:24.030886 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b104a-8599-4d1d-895f-6892bfefe2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:24.031530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b104a-8599-4d1d-895f-6892bfefe2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:24.031809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b104a-8599-4d1d-895f-6892bfefe2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:24.032145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b104a-8599-4d1d-895f-6892bfefe2ce admin admin] PATH_INFO: `/v3/projects/996cb008efe4474c9f8e71d51fb285af` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:24.036842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b104a-8599-4d1d-895f-6892bfefe2ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=996cb008efe4474c9f8e71d51fb285af)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:24.044230 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b104a-8599-4d1d-895f-6892bfefe2ce admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:24.160823 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3b4b104a-8599-4d1d-895f-6892bfefe2ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '996cb008efe4474c9f8e71d51fb285af', 'request_id': 'req-3b4b104a-8599-4d1d-895f-6892bfefe2ce'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:24.181681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3b4b104a-8599-4d1d-895f-6892bfefe2ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '996cb008efe4474c9f8e71d51fb285af', 'request_id': 'req-3b4b104a-8599-4d1d-895f-6892bfefe2ce'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:24.194244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3b4b104a-8599-4d1d-895f-6892bfefe2ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '996cb008efe4474c9f8e71d51fb285af', 'request_id': 'req-3b4b104a-8599-4d1d-895f-6892bfefe2ce'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:24.224945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3b4b104a-8599-4d1d-895f-6892bfefe2ce admin admin] The token cache is being invalidate because project 996cb008efe4474c9f8e71d51fb285af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:47:24.226045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3b4b104a-8599-4d1d-895f-6892bfefe2ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:24.228297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3b4b104a-8599-4d1d-895f-6892bfefe2ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:24.239711 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3876/7837] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:47:23 2022] DELETE /identity/v3/projects/996cb008efe4474c9f8e71d51fb285af => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:47:24.245222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbc56f-cb58-473c-8e87-e24261ffcdbc None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:24.246332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbc56f-cb58-473c-8e87-e24261ffcdbc None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:24.246332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbc56f-cb58-473c-8e87-e24261ffcdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:24.289077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-91cbc56f-cb58-473c-8e87-e24261ffcdbc None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:47:24.290327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-91cbc56f-cb58-473c-8e87-e24261ffcdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:24.390529 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:47:24.437379 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3962/7838] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:47:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:47:24.446510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f4fbe-b50d-493a-a4b0-e9a1fb49ed74 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:24.446806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f4fbe-b50d-493a-a4b0-e9a1fb49ed74 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:24.447111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f4fbe-b50d-493a-a4b0-e9a1fb49ed74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:24.487024 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1d0f4fbe-b50d-493a-a4b0-e9a1fb49ed74 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:47:24.494350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1d0f4fbe-b50d-493a-a4b0-e9a1fb49ed74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:24.515832 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3877/7839] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:47:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:47:24.520157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbc56f-cb58-473c-8e87-e24261ffcdbc None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:24.544999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbc56f-cb58-473c-8e87-e24261ffcdbc None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:24.560521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502d7c5-6065-4ad6-ab50-a31110592d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:24.561560 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502d7c5-6065-4ad6-ab50-a31110592d6f admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:24.565504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502d7c5-6065-4ad6-ab50-a31110592d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:24.566073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502d7c5-6065-4ad6-ab50-a31110592d6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:24.566951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502d7c5-6065-4ad6-ab50-a31110592d6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:47:24.567456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502d7c5-6065-4ad6-ab50-a31110592d6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:24.573490 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502d7c5-6065-4ad6-ab50-a31110592d6f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:24.617410 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3963/7840] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:47:24.619241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f4fbe-b50d-493a-a4b0-e9a1fb49ed74 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:24.635130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f4fbe-b50d-493a-a4b0-e9a1fb49ed74 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:24.647944 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114d497-d2ba-459a-9ab5-236c088faea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:24.648576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114d497-d2ba-459a-9ab5-236c088faea1 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:24.648859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114d497-d2ba-459a-9ab5-236c088faea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:24.652848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114d497-d2ba-459a-9ab5-236c088faea1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:24.655203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114d497-d2ba-459a-9ab5-236c088faea1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:24.661268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114d497-d2ba-459a-9ab5-236c088faea1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:24.744865 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3878/7841] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:47:24 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:47:24.745726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502d7c5-6065-4ad6-ab50-a31110592d6f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:24.774041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502d7c5-6065-4ad6-ab50-a31110592d6f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:24.843365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114d497-d2ba-459a-9ab5-236c088faea1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:24.845672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1114d497-d2ba-459a-9ab5-236c088faea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:24.955664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88621f7f-ade5-4d7e-8d70-112cb318e871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:24.958321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88621f7f-ade5-4d7e-8d70-112cb318e871 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:24.958606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88621f7f-ade5-4d7e-8d70-112cb318e871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:24.958881 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88621f7f-ade5-4d7e-8d70-112cb318e871 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:24.959599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88621f7f-ade5-4d7e-8d70-112cb318e871 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:24.965708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88621f7f-ade5-4d7e-8d70-112cb318e871 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:25.027829 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3964/7842] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:47:24 2022] POST /identity/v3/users => generated 291 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:47:25.032830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88621f7f-ade5-4d7e-8d70-112cb318e871 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:25.114329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88621f7f-ade5-4d7e-8d70-112cb318e871 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:25.138623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114d497-d2ba-459a-9ab5-236c088faea1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:25.146846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c45bdc-c920-4a4a-9137-05faa3fa5859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:25.152042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c45bdc-c920-4a4a-9137-05faa3fa5859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:25.152548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c45bdc-c920-4a4a-9137-05faa3fa5859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:25.152835 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729663e-b1b2-41fe-8d4b-013d6c423dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:25.153213 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c45bdc-c920-4a4a-9137-05faa3fa5859 admin admin] PATH_INFO: `/v3/projects/7e191cf4f553475f98352101ddf8875b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:25.155487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729663e-b1b2-41fe-8d4b-013d6c423dbd admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:25.155774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729663e-b1b2-41fe-8d4b-013d6c423dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:25.156084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729663e-b1b2-41fe-8d4b-013d6c423dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:25.156695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c45bdc-c920-4a4a-9137-05faa3fa5859 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e191cf4f553475f98352101ddf8875b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:25.156850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729663e-b1b2-41fe-8d4b-013d6c423dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:25.159975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c45bdc-c920-4a4a-9137-05faa3fa5859 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:25.164674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729663e-b1b2-41fe-8d4b-013d6c423dbd admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:25.216979 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3965/7843] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:47:25.220069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729663e-b1b2-41fe-8d4b-013d6c423dbd admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:25.246674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729663e-b1b2-41fe-8d4b-013d6c423dbd admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:25.265405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9e563-a63c-40c4-913a-dfdcd334ffc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:25.266252 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9e563-a63c-40c4-913a-dfdcd334ffc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:25.266534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9e563-a63c-40c4-913a-dfdcd334ffc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:25.266804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9e563-a63c-40c4-913a-dfdcd334ffc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:25.267469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9e563-a63c-40c4-913a-dfdcd334ffc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:25.270202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9e563-a63c-40c4-913a-dfdcd334ffc3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:25.316792 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3966/7844] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:47:25.318089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9e563-a63c-40c4-913a-dfdcd334ffc3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:25.363926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9e563-a63c-40c4-913a-dfdcd334ffc3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:25.383910 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:47:25.392689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-28c45bdc-c920-4a4a-9137-05faa3fa5859 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e191cf4f553475f98352101ddf8875b', 'request_id': 'req-28c45bdc-c920-4a4a-9137-05faa3fa5859'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:25.413141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-28c45bdc-c920-4a4a-9137-05faa3fa5859 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e191cf4f553475f98352101ddf8875b', 'request_id': 'req-28c45bdc-c920-4a4a-9137-05faa3fa5859'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:25.433577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-28c45bdc-c920-4a4a-9137-05faa3fa5859 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e191cf4f553475f98352101ddf8875b', 'request_id': 'req-28c45bdc-c920-4a4a-9137-05faa3fa5859'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:25.463978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-28c45bdc-c920-4a4a-9137-05faa3fa5859 admin admin] The token cache is being invalidate because project 7e191cf4f553475f98352101ddf8875b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:47:25.464281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-28c45bdc-c920-4a4a-9137-05faa3fa5859 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:25.466888 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-28c45bdc-c920-4a4a-9137-05faa3fa5859 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:25.475106 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3879/7845] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:47:24 2022] DELETE /identity/v3/projects/7e191cf4f553475f98352101ddf8875b => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:47:25.481284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b2288-71f5-4d25-8efe-a289fce7422e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:25.481618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b2288-71f5-4d25-8efe-a289fce7422e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:25.481895 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b2288-71f5-4d25-8efe-a289fce7422e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:25.545867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e816c5-ffb9-4a7d-a8e6-9d3ef9cbbb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:25.546613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e816c5-ffb9-4a7d-a8e6-9d3ef9cbbb5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:25.546992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2a3b2288-71f5-4d25-8efe-a289fce7422e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:47:25.548352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e816c5-ffb9-4a7d-a8e6-9d3ef9cbbb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:25.548862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e816c5-ffb9-4a7d-a8e6-9d3ef9cbbb5a admin admin] PATH_INFO: `/v3/projects/e3675309071a4a9cbff7c401d6dd2774/users/18756b8a2dce465ab9d3280c929d60c7/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:25.550236 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2a3b2288-71f5-4d25-8efe-a289fce7422e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:25.574230 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3880/7846] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:47:25.583280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931189a7-51d7-4c86-9907-f1c5630f06df None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:25.584294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931189a7-51d7-4c86-9907-f1c5630f06df None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:25.584878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931189a7-51d7-4c86-9907-f1c5630f06df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:25.590912 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e816c5-ffb9-4a7d-a8e6-9d3ef9cbbb5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3675309071a4a9cbff7c401d6dd2774, user_id=18756b8a2dce465ab9d3280c929d60c7, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:25.599158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e816c5-ffb9-4a7d-a8e6-9d3ef9cbbb5a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:25.631328 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3967/7847] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:47:25 2022] PUT /identity/v3/projects/e3675309071a4a9cbff7c401d6dd2774/users/18756b8a2dce465ab9d3280c929d60c7/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:47:25.633228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-931189a7-51d7-4c86-9907-f1c5630f06df None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:47:25.634919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-931189a7-51d7-4c86-9907-f1c5630f06df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:25.642924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f9970-565c-4b35-994d-e81c1dd00f15 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:25.643211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f9970-565c-4b35-994d-e81c1dd00f15 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:25.643486 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f9970-565c-4b35-994d-e81c1dd00f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:25.726154 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f28f9970-565c-4b35-994d-e81c1dd00f15 None None] MFA Rules not processed for user `18756b8a2dce465ab9d3280c929d60c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:47:25.727727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f28f9970-565c-4b35-994d-e81c1dd00f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:25.751358 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:47:25.793514 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3881/7848] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:47:25.822352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931189a7-51d7-4c86-9907-f1c5630f06df None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:25.869505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931189a7-51d7-4c86-9907-f1c5630f06df None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:25.884992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ae149-816f-416a-b283-c070efab6903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:25.885640 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ae149-816f-416a-b283-c070efab6903 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:25.885924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ae149-816f-416a-b283-c070efab6903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:25.886624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ae149-816f-416a-b283-c070efab6903 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:25.886908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ae149-816f-416a-b283-c070efab6903 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:47:25.887172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ae149-816f-416a-b283-c070efab6903 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:25.888910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ae149-816f-416a-b283-c070efab6903 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:25.929578 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3968/7849] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:47:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:47:25.947227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f9970-565c-4b35-994d-e81c1dd00f15 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:25.948841 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f28f9970-565c-4b35-994d-e81c1dd00f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:25.952245 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3882/7850] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:47:25.958108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ae149-816f-416a-b283-c070efab6903 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:25.981682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ae149-816f-416a-b283-c070efab6903 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:26.012382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48047ea-ac95-4b0a-96e3-ad354bb60441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:26.013023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48047ea-ac95-4b0a-96e3-ad354bb60441 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:26.013307 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48047ea-ac95-4b0a-96e3-ad354bb60441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:26.013587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48047ea-ac95-4b0a-96e3-ad354bb60441 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:26.014278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48047ea-ac95-4b0a-96e3-ad354bb60441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:26.016479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48047ea-ac95-4b0a-96e3-ad354bb60441 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:26.083494 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3883/7851] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:47:25 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:47:26.088539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48047ea-ac95-4b0a-96e3-ad354bb60441 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:26.225567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f9970-565c-4b35-994d-e81c1dd00f15 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:26.334731 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48047ea-ac95-4b0a-96e3-ad354bb60441 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:26.340517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f829b2-f677-4ead-8c82-d1321e696d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:26.342051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f829b2-f677-4ead-8c82-d1321e696d50 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:26.342051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f829b2-f677-4ead-8c82-d1321e696d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:26.342051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f829b2-f677-4ead-8c82-d1321e696d50 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:26.342559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f829b2-f677-4ead-8c82-d1321e696d50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:26.354222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f829b2-f677-4ead-8c82-d1321e696d50 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:26.423670 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3884/7852] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:47:26 2022] POST /identity/v3/users => generated 289 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:47:26.429591 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f829b2-f677-4ead-8c82-d1321e696d50 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:26.462505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a718dcb-4731-4413-a541-849b0c27482d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:26.465101 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a718dcb-4731-4413-a541-849b0c27482d service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:26.468961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a718dcb-4731-4413-a541-849b0c27482d service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:26.471002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a718dcb-4731-4413-a541-849b0c27482d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:26.477601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f829b2-f677-4ead-8c82-d1321e696d50 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:26.490936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765e3b1-7643-4ebb-95cf-54bc36f7abd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:26.491574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765e3b1-7643-4ebb-95cf-54bc36f7abd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:26.491857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765e3b1-7643-4ebb-95cf-54bc36f7abd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:26.492255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765e3b1-7643-4ebb-95cf-54bc36f7abd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:26.493373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a765e3b1-7643-4ebb-95cf-54bc36f7abd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:26.494564 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a765e3b1-7643-4ebb-95cf-54bc36f7abd0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:26.542309 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3885/7853] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:47:26.555259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765e3b1-7643-4ebb-95cf-54bc36f7abd0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:26.588137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765e3b1-7643-4ebb-95cf-54bc36f7abd0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:26.608092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4b874-e8c0-4131-a8e3-6787435e553d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:26.609997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4b874-e8c0-4131-a8e3-6787435e553d admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:26.610953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4b874-e8c0-4131-a8e3-6787435e553d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:26.611817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4b874-e8c0-4131-a8e3-6787435e553d admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:26.613329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4b874-e8c0-4131-a8e3-6787435e553d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:26.622333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4b874-e8c0-4131-a8e3-6787435e553d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:26.629628 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:47:26.713919 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3886/7854] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:47:26.715712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4b874-e8c0-4131-a8e3-6787435e553d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:26.734426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4b874-e8c0-4131-a8e3-6787435e553d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:26.743449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e68532-bd77-4891-a5d1-0d8910d8efcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:26.745100 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e68532-bd77-4891-a5d1-0d8910d8efcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:26.745805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e68532-bd77-4891-a5d1-0d8910d8efcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:26.746526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e68532-bd77-4891-a5d1-0d8910d8efcd admin admin] PATH_INFO: `/v3/projects/934fedcb868e42cfa3c518eaae92b81f/users/8b98545e41b548678135b6cbb43d62ce/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:26.776566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e68532-bd77-4891-a5d1-0d8910d8efcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=934fedcb868e42cfa3c518eaae92b81f, user_id=8b98545e41b548678135b6cbb43d62ce, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:26.783657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e68532-bd77-4891-a5d1-0d8910d8efcd admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:26.820124 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3887/7855] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:47:26 2022] PUT /identity/v3/projects/934fedcb868e42cfa3c518eaae92b81f/users/8b98545e41b548678135b6cbb43d62ce/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:47:26.839154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c4147-e80b-4c60-a6d8-ade21736ff03 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:26.839619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c4147-e80b-4c60-a6d8-ade21736ff03 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:26.840139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c4147-e80b-4c60-a6d8-ade21736ff03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:26.888261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-f82c4147-e80b-4c60-a6d8-ade21736ff03 None None] MFA Rules not processed for user `8b98545e41b548678135b6cbb43d62ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:47:26.890322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f82c4147-e80b-4c60-a6d8-ade21736ff03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:26.897135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a718dcb-4731-4413-a541-849b0c27482d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:26.898615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a718dcb-4731-4413-a541-849b0c27482d service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:26.916040 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3969/7856] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:47:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 970 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:47:27.169454 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3888/7857] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:47:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:47:27.176200 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a718dcb-4731-4413-a541-849b0c27482d service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:27.194041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a718dcb-4731-4413-a541-849b0c27482d service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:27.318466 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:47:27.412381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac985f-5b66-4d67-8661-b87cfe49e339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:27.413094 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac985f-5b66-4d67-8661-b87cfe49e339 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:27.413410 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac985f-5b66-4d67-8661-b87cfe49e339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:27.413941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac985f-5b66-4d67-8661-b87cfe49e339 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:27.415167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac985f-5b66-4d67-8661-b87cfe49e339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:27.420063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ac985f-5b66-4d67-8661-b87cfe49e339 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:27.494217 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3970/7858] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:47:27 2022] POST /identity/v3/projects => generated 377 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:47:27.497939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c4147-e80b-4c60-a6d8-ade21736ff03 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:27.517011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c4147-e80b-4c60-a6d8-ade21736ff03 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:27.707493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b39cb-cb20-4ff2-b058-6c98eb383523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:27.708349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b39cb-cb20-4ff2-b058-6c98eb383523 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:27.708840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b39cb-cb20-4ff2-b058-6c98eb383523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:27.709320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b39cb-cb20-4ff2-b058-6c98eb383523 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:27.710302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b39cb-cb20-4ff2-b058-6c98eb383523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:27.712537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b39cb-cb20-4ff2-b058-6c98eb383523 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:27.766414 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3889/7859] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:47:27 2022] POST /identity/v3/users => generated 295 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:47:27.770826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac985f-5b66-4d67-8661-b87cfe49e339 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:27.786710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac985f-5b66-4d67-8661-b87cfe49e339 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:27.816073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3e1df-5a76-4cea-a8c6-863ee4d47348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:27.824171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3e1df-5a76-4cea-a8c6-863ee4d47348 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:27.824457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3e1df-5a76-4cea-a8c6-863ee4d47348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:27.824735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3e1df-5a76-4cea-a8c6-863ee4d47348 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:27.834158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3e1df-5a76-4cea-a8c6-863ee4d47348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:27.841901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d3e1df-5a76-4cea-a8c6-863ee4d47348 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:27.896539 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3971/7860] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:47:27.898042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b39cb-cb20-4ff2-b058-6c98eb383523 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:27.917967 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b39cb-cb20-4ff2-b058-6c98eb383523 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:27.932548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c423e3-640b-4d9b-b6f8-6a3585fb3895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:27.933618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c423e3-640b-4d9b-b6f8-6a3585fb3895 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:27.934128 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c423e3-640b-4d9b-b6f8-6a3585fb3895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:27.934607 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c423e3-640b-4d9b-b6f8-6a3585fb3895 admin admin] PATH_INFO: `/v3/projects/ccbda121f13c4cc88c32e439bb9a6c49/users/537f5984edef487db18cd55632cc5016/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:27.989670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c423e3-640b-4d9b-b6f8-6a3585fb3895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccbda121f13c4cc88c32e439bb9a6c49, user_id=537f5984edef487db18cd55632cc5016, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:27.996431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c423e3-640b-4d9b-b6f8-6a3585fb3895 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:28.028726 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3890/7861] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:47:27 2022] PUT /identity/v3/projects/ccbda121f13c4cc88c32e439bb9a6c49/users/537f5984edef487db18cd55632cc5016/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:47:28.033165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3e1df-5a76-4cea-a8c6-863ee4d47348 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:28.045488 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3e1df-5a76-4cea-a8c6-863ee4d47348 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:28.187474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6f34b-b722-48cb-bbd6-e25586afc9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:28.188140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6f34b-b722-48cb-bbd6-e25586afc9b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:28.188423 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6f34b-b722-48cb-bbd6-e25586afc9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:28.188680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6f34b-b722-48cb-bbd6-e25586afc9b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:28.189344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6f34b-b722-48cb-bbd6-e25586afc9b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:28.190987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6f34b-b722-48cb-bbd6-e25586afc9b9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:28.217541 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3972/7862] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:47:28.221822 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c423e3-640b-4d9b-b6f8-6a3585fb3895 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:28.238241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c423e3-640b-4d9b-b6f8-6a3585fb3895 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:28.255446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e88931-822b-42dc-974a-e9c4fc82ff77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:28.256592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e88931-822b-42dc-974a-e9c4fc82ff77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:28.257080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e88931-822b-42dc-974a-e9c4fc82ff77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:28.257519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e88931-822b-42dc-974a-e9c4fc82ff77 admin admin] PATH_INFO: `/v3/projects/ccbda121f13c4cc88c32e439bb9a6c49/users/537f5984edef487db18cd55632cc5016/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:28.260025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e88931-822b-42dc-974a-e9c4fc82ff77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccbda121f13c4cc88c32e439bb9a6c49, user_id=537f5984edef487db18cd55632cc5016, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:28.262939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e88931-822b-42dc-974a-e9c4fc82ff77 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:28.316279 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3891/7863] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:47:28 2022] PUT /identity/v3/projects/ccbda121f13c4cc88c32e439bb9a6c49/users/537f5984edef487db18cd55632cc5016/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:47:28.328022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c90e1-d736-4959-84e4-15bc5772c0ef None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:28.328259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c90e1-d736-4959-84e4-15bc5772c0ef None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:28.328481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c90e1-d736-4959-84e4-15bc5772c0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:28.417066 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-149c90e1-d736-4959-84e4-15bc5772c0ef None None] MFA Rules not processed for user `537f5984edef487db18cd55632cc5016`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:47:28.418276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-149c90e1-d736-4959-84e4-15bc5772c0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:28.606068 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3973/7864] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:47:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:47:28.619356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e88931-822b-42dc-974a-e9c4fc82ff77 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:28.621748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-05e88931-822b-42dc-974a-e9c4fc82ff77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:28.672746 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:47:28.789163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e88931-822b-42dc-974a-e9c4fc82ff77 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:28.799837 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62696f4-9c4c-4153-9809-f2e70f1f0d41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:28.800627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62696f4-9c4c-4153-9809-f2e70f1f0d41 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:28.800910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62696f4-9c4c-4153-9809-f2e70f1f0d41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:28.801184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62696f4-9c4c-4153-9809-f2e70f1f0d41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:28.939687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62696f4-9c4c-4153-9809-f2e70f1f0d41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:28.941226 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62696f4-9c4c-4153-9809-f2e70f1f0d41 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:28.972110 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3892/7865] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:47:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:47:29.905198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c90e1-d736-4959-84e4-15bc5772c0ef None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:29.908072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-149c90e1-d736-4959-84e4-15bc5772c0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:30.016480 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:47:30.174349 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c90e1-d736-4959-84e4-15bc5772c0ef None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:30.207248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371146bb-74f4-4faa-a47f-41dc1859450b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:30.210280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371146bb-74f4-4faa-a47f-41dc1859450b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:30.210568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371146bb-74f4-4faa-a47f-41dc1859450b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:30.210851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371146bb-74f4-4faa-a47f-41dc1859450b admin admin] PATH_INFO: `/v3/users/a6e1b719d99942a1ab96f1badffd7300` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:30.227456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371146bb-74f4-4faa-a47f-41dc1859450b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6e1b719d99942a1ab96f1badffd7300)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:30.232749 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371146bb-74f4-4faa-a47f-41dc1859450b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:30.366031 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-371146bb-74f4-4faa-a47f-41dc1859450b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6e1b719d99942a1ab96f1badffd7300'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:30.399617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-371146bb-74f4-4faa-a47f-41dc1859450b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6e1b719d99942a1ab96f1badffd7300'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:30.429926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-371146bb-74f4-4faa-a47f-41dc1859450b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6e1b719d99942a1ab96f1badffd7300'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:30.431296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-371146bb-74f4-4faa-a47f-41dc1859450b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6e1b719d99942a1ab96f1badffd7300'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:30.445613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-371146bb-74f4-4faa-a47f-41dc1859450b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6e1b719d99942a1ab96f1badffd7300'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:30.458646 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3974/7866] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:47:29 2022] DELETE /identity/v3/users/a6e1b719d99942a1ab96f1badffd7300 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:47:30.464224 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106346a-5f0d-43be-8319-d92f8f7aaf7d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:30.465186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106346a-5f0d-43be-8319-d92f8f7aaf7d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:30.465661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106346a-5f0d-43be-8319-d92f8f7aaf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:30.514989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7106346a-5f0d-43be-8319-d92f8f7aaf7d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:47:30.516384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7106346a-5f0d-43be-8319-d92f8f7aaf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:30.689294 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3893/7867] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:47:30.740096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371146bb-74f4-4faa-a47f-41dc1859450b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:30.741619 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-371146bb-74f4-4faa-a47f-41dc1859450b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:30.965801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371146bb-74f4-4faa-a47f-41dc1859450b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:30.995926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9164f8f-b2c9-4480-a061-c56bc6100c7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:30.996649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9164f8f-b2c9-4480-a061-c56bc6100c7a service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:30.996926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9164f8f-b2c9-4480-a061-c56bc6100c7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:30.997205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9164f8f-b2c9-4480-a061-c56bc6100c7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:31.017339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9164f8f-b2c9-4480-a061-c56bc6100c7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:31.020074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9164f8f-b2c9-4480-a061-c56bc6100c7a service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:31.044818 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3975/7868] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:47:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:47:32.711454 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106346a-5f0d-43be-8319-d92f8f7aaf7d None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:32.714205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7106346a-5f0d-43be-8319-d92f8f7aaf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:32.732153 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106346a-5f0d-43be-8319-d92f8f7aaf7d None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:32.753624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01a6cf-3ebc-40f0-9745-73613eb28947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:32.754547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01a6cf-3ebc-40f0-9745-73613eb28947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:32.754950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01a6cf-3ebc-40f0-9745-73613eb28947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:32.759319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01a6cf-3ebc-40f0-9745-73613eb28947 admin admin] PATH_INFO: `/v3/projects/18642e6706f34ddb9c07bfe625e11a33` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:32.764787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01a6cf-3ebc-40f0-9745-73613eb28947 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18642e6706f34ddb9c07bfe625e11a33)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:32.766887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01a6cf-3ebc-40f0-9745-73613eb28947 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:32.950529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ff01a6cf-3ebc-40f0-9745-73613eb28947 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18642e6706f34ddb9c07bfe625e11a33', 'request_id': 'req-ff01a6cf-3ebc-40f0-9745-73613eb28947'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:32.986462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ff01a6cf-3ebc-40f0-9745-73613eb28947 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18642e6706f34ddb9c07bfe625e11a33', 'request_id': 'req-ff01a6cf-3ebc-40f0-9745-73613eb28947'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:33.012638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ff01a6cf-3ebc-40f0-9745-73613eb28947 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18642e6706f34ddb9c07bfe625e11a33', 'request_id': 'req-ff01a6cf-3ebc-40f0-9745-73613eb28947'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:33.022769 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:47:33.052467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ff01a6cf-3ebc-40f0-9745-73613eb28947 admin admin] The token cache is being invalidate because project 18642e6706f34ddb9c07bfe625e11a33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:47:33.052753 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ff01a6cf-3ebc-40f0-9745-73613eb28947 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:33.055510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ff01a6cf-3ebc-40f0-9745-73613eb28947 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:33.061175 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3894/7869] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:47:32 2022] DELETE /identity/v3/projects/18642e6706f34ddb9c07bfe625e11a33 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:47:35.069855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9164f8f-b2c9-4480-a061-c56bc6100c7a service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:35.073315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c9164f8f-b2c9-4480-a061-c56bc6100c7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:35.192284 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:47:35.246032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9164f8f-b2c9-4480-a061-c56bc6100c7a service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:35.352566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18347a69-b2a5-443c-a48b-f2abba894eb2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:35.353646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18347a69-b2a5-443c-a48b-f2abba894eb2 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:35.354354 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18347a69-b2a5-443c-a48b-f2abba894eb2 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:35.354925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18347a69-b2a5-443c-a48b-f2abba894eb2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:35.357182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-18347a69-b2a5-443c-a48b-f2abba894eb2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:35.577936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18347a69-b2a5-443c-a48b-f2abba894eb2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:35.595265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18347a69-b2a5-443c-a48b-f2abba894eb2 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:35.631823 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3976/7870] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:47:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 663 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:47:38.345407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01a6cf-3ebc-40f0-9745-73613eb28947 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:38.349585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ff01a6cf-3ebc-40f0-9745-73613eb28947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:38.445935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01a6cf-3ebc-40f0-9745-73613eb28947 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:38.451225 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d611004-d347-400a-9c6f-a6fbcbb4bf35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:38.452271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d611004-d347-400a-9c6f-a6fbcbb4bf35 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:38.452925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d611004-d347-400a-9c6f-a6fbcbb4bf35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:38.453783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d611004-d347-400a-9c6f-a6fbcbb4bf35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:38.456117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7d611004-d347-400a-9c6f-a6fbcbb4bf35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:38.625437 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d611004-d347-400a-9c6f-a6fbcbb4bf35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:38.630088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d611004-d347-400a-9c6f-a6fbcbb4bf35 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:38.669400 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3895/7871] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:47:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:47:45.522320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18347a69-b2a5-443c-a48b-f2abba894eb2 service swift] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:45.524090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-18347a69-b2a5-443c-a48b-f2abba894eb2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:45.547374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d611004-d347-400a-9c6f-a6fbcbb4bf35 service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:45.549125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7d611004-d347-400a-9c6f-a6fbcbb4bf35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:45.716760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d611004-d347-400a-9c6f-a6fbcbb4bf35 service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:45.730357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07d13f-bc34-4998-95d4-5a413e3858e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:45.731014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07d13f-bc34-4998-95d4-5a413e3858e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:45.731350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07d13f-bc34-4998-95d4-5a413e3858e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:45.732266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07d13f-bc34-4998-95d4-5a413e3858e7 admin admin] PATH_INFO: `/v3/users/7b2c24fc11ac4826ae3cb94a407e2437` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:45.734578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07d13f-bc34-4998-95d4-5a413e3858e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b2c24fc11ac4826ae3cb94a407e2437)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:45.738453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07d13f-bc34-4998-95d4-5a413e3858e7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:45.774233 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18347a69-b2a5-443c-a48b-f2abba894eb2 service swift] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:45.781075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac98f27-1f78-4387-8267-deea97569f34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:45.786025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac98f27-1f78-4387-8267-deea97569f34 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:45.786348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac98f27-1f78-4387-8267-deea97569f34 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:45.786584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac98f27-1f78-4387-8267-deea97569f34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:45.793382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8ac98f27-1f78-4387-8267-deea97569f34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:45.836212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac98f27-1f78-4387-8267-deea97569f34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:45.853649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac98f27-1f78-4387-8267-deea97569f34 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:45.867159 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=8,keystone:SELECT=92 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:47:45.871716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fa07d13f-bc34-4998-95d4-5a413e3858e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b2c24fc11ac4826ae3cb94a407e2437'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:45.885678 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3977/7872] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:47:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:47:45.890185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fa07d13f-bc34-4998-95d4-5a413e3858e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b2c24fc11ac4826ae3cb94a407e2437'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:45.905683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fa07d13f-bc34-4998-95d4-5a413e3858e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b2c24fc11ac4826ae3cb94a407e2437'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:45.906575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fa07d13f-bc34-4998-95d4-5a413e3858e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b2c24fc11ac4826ae3cb94a407e2437'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:45.919606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fa07d13f-bc34-4998-95d4-5a413e3858e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b2c24fc11ac4826ae3cb94a407e2437'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:45.933846 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3896/7873] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:47:45 2022] DELETE /identity/v3/users/7b2c24fc11ac4826ae3cb94a407e2437 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:47:45.938366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d879627-e8ce-4386-9cfd-312a0ba3f7c7 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:45.938991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d879627-e8ce-4386-9cfd-312a0ba3f7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:45.939461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d879627-e8ce-4386-9cfd-312a0ba3f7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:45.955620 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:47:45.964299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6d879627-e8ce-4386-9cfd-312a0ba3f7c7 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:47:45.967082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6d879627-e8ce-4386-9cfd-312a0ba3f7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:46.067999 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3978/7874] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:47:46.138321 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07d13f-bc34-4998-95d4-5a413e3858e7 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:46.139759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-fa07d13f-bc34-4998-95d4-5a413e3858e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:46.315006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07d13f-bc34-4998-95d4-5a413e3858e7 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:46.318811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a359b9-db62-4bfd-be15-853d16fced0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:46.319607 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a359b9-db62-4bfd-be15-853d16fced0d service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:46.320029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a359b9-db62-4bfd-be15-853d16fced0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:46.320309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a359b9-db62-4bfd-be15-853d16fced0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:46.339788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a359b9-db62-4bfd-be15-853d16fced0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:46.343902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a359b9-db62-4bfd-be15-853d16fced0d service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:46.359291 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3897/7875] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:47:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:47:47.224980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d879627-e8ce-4386-9cfd-312a0ba3f7c7 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:47.227025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6d879627-e8ce-4386-9cfd-312a0ba3f7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:47.248263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d879627-e8ce-4386-9cfd-312a0ba3f7c7 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:47.288777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16128b0e-c166-4323-ae19-7d5eba0e4604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:47.289461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16128b0e-c166-4323-ae19-7d5eba0e4604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:47.289746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16128b0e-c166-4323-ae19-7d5eba0e4604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:47.290030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16128b0e-c166-4323-ae19-7d5eba0e4604 admin admin] PATH_INFO: `/v3/projects/325eaa3c5c9840b9aa7f466f690fe1ca` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:47.299102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16128b0e-c166-4323-ae19-7d5eba0e4604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=325eaa3c5c9840b9aa7f466f690fe1ca)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:47.303796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16128b0e-c166-4323-ae19-7d5eba0e4604 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:47.468484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-16128b0e-c166-4323-ae19-7d5eba0e4604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '325eaa3c5c9840b9aa7f466f690fe1ca', 'request_id': 'req-16128b0e-c166-4323-ae19-7d5eba0e4604'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:47.493041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-16128b0e-c166-4323-ae19-7d5eba0e4604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '325eaa3c5c9840b9aa7f466f690fe1ca', 'request_id': 'req-16128b0e-c166-4323-ae19-7d5eba0e4604'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:47.504851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-16128b0e-c166-4323-ae19-7d5eba0e4604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '325eaa3c5c9840b9aa7f466f690fe1ca', 'request_id': 'req-16128b0e-c166-4323-ae19-7d5eba0e4604'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:47.535656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-16128b0e-c166-4323-ae19-7d5eba0e4604 admin admin] The token cache is being invalidate because project 325eaa3c5c9840b9aa7f466f690fe1ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:47:47.535979 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-16128b0e-c166-4323-ae19-7d5eba0e4604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:47.539566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-16128b0e-c166-4323-ae19-7d5eba0e4604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:47.546953 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3979/7876] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:47:47 2022] DELETE /identity/v3/projects/325eaa3c5c9840b9aa7f466f690fe1ca => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:47:47.548730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b632f-63e7-4212-ad51-201a9774c72f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:47.549274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b632f-63e7-4212-ad51-201a9774c72f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:47.549389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b632f-63e7-4212-ad51-201a9774c72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:47.581549 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7c3b632f-63e7-4212-ad51-201a9774c72f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:47:47.583921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7c3b632f-63e7-4212-ad51-201a9774c72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:47.691684 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3898/7877] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:47:47.699512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb2de0-862e-4126-a45c-4459efea91a4 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:47.699946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb2de0-862e-4126-a45c-4459efea91a4 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:47.700290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb2de0-862e-4126-a45c-4459efea91a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:47.763979 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c4fb2de0-862e-4126-a45c-4459efea91a4 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:47:47.765457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c4fb2de0-862e-4126-a45c-4459efea91a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:47.776278 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3980/7878] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:47:47.780926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b632f-63e7-4212-ad51-201a9774c72f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:47.800377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b632f-63e7-4212-ad51-201a9774c72f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:47.808914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da6734-a0ea-4fd3-ae79-cf9de841d355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:47.809237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da6734-a0ea-4fd3-ae79-cf9de841d355 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:47.809524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da6734-a0ea-4fd3-ae79-cf9de841d355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:47.809795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da6734-a0ea-4fd3-ae79-cf9de841d355 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:47.810457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da6734-a0ea-4fd3-ae79-cf9de841d355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:47:47.810754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da6734-a0ea-4fd3-ae79-cf9de841d355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:47.812562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da6734-a0ea-4fd3-ae79-cf9de841d355 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:47.830396 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3899/7879] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:47:47.831574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb2de0-862e-4126-a45c-4459efea91a4 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:47.847983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb2de0-862e-4126-a45c-4459efea91a4 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:47.858469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349fe96f-b7c0-41c9-84e2-4157647add1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:47.859526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fe96f-b7c0-41c9-84e2-4157647add1d admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:47.860068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fe96f-b7c0-41c9-84e2-4157647add1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:47.860737 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fe96f-b7c0-41c9-84e2-4157647add1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:47.861917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349fe96f-b7c0-41c9-84e2-4157647add1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:47.865823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349fe96f-b7c0-41c9-84e2-4157647add1d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:47.908788 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3981/7880] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:47:47 2022] POST /identity/v3/projects => generated 389 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:47:47.912798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da6734-a0ea-4fd3-ae79-cf9de841d355 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:47.925850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da6734-a0ea-4fd3-ae79-cf9de841d355 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:48.048937 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:47:48.065977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dab1c3-ca0c-404a-aba4-fc14610a7029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:48.067264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dab1c3-ca0c-404a-aba4-fc14610a7029 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:48.067877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dab1c3-ca0c-404a-aba4-fc14610a7029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:48.068262 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dab1c3-ca0c-404a-aba4-fc14610a7029 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:48.069544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dab1c3-ca0c-404a-aba4-fc14610a7029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:48.072640 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dab1c3-ca0c-404a-aba4-fc14610a7029 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:48.145490 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3900/7881] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:47:47 2022] POST /identity/v3/users => generated 295 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:47:48.149570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349fe96f-b7c0-41c9-84e2-4157647add1d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:48.165981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349fe96f-b7c0-41c9-84e2-4157647add1d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:48.179664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87cc61-5fab-49db-b6d5-cad1e628e13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:48.180334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87cc61-5fab-49db-b6d5-cad1e628e13b admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:48.180618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87cc61-5fab-49db-b6d5-cad1e628e13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:48.181001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87cc61-5fab-49db-b6d5-cad1e628e13b admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:48.181666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87cc61-5fab-49db-b6d5-cad1e628e13b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:48.183299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87cc61-5fab-49db-b6d5-cad1e628e13b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:48.218792 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3982/7882] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:47:48.222489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dab1c3-ca0c-404a-aba4-fc14610a7029 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:48.238356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dab1c3-ca0c-404a-aba4-fc14610a7029 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:48.250094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e92c3-1647-4613-90f9-af4a8e64f63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:48.250900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e92c3-1647-4613-90f9-af4a8e64f63d admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:48.251294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e92c3-1647-4613-90f9-af4a8e64f63d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:48.251679 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e92c3-1647-4613-90f9-af4a8e64f63d admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:48.252849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e92c3-1647-4613-90f9-af4a8e64f63d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:48.254593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e92c3-1647-4613-90f9-af4a8e64f63d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:48.283520 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3901/7883] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:47:48.284769 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87cc61-5fab-49db-b6d5-cad1e628e13b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:48.300984 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87cc61-5fab-49db-b6d5-cad1e628e13b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:48.317825 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17cd6e-e229-4786-ac97-8532522c8aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:48.318689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17cd6e-e229-4786-ac97-8532522c8aea admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:48.319196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17cd6e-e229-4786-ac97-8532522c8aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:48.319702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17cd6e-e229-4786-ac97-8532522c8aea admin admin] PATH_INFO: `/v3/projects/b3fb02e4666745a7ac5cc1fde8621ba8/users/6843dd9f0e4644cc87de76482c0451f3/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:48.359808 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17cd6e-e229-4786-ac97-8532522c8aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3fb02e4666745a7ac5cc1fde8621ba8, user_id=6843dd9f0e4644cc87de76482c0451f3, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:48.366333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17cd6e-e229-4786-ac97-8532522c8aea admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:48.404885 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3983/7884] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:47:48 2022] PUT /identity/v3/projects/b3fb02e4666745a7ac5cc1fde8621ba8/users/6843dd9f0e4644cc87de76482c0451f3/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:47:48.416619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb41e3-ac16-4c22-a916-5c8ac68d1f49 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:48.417265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb41e3-ac16-4c22-a916-5c8ac68d1f49 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:48.417860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb41e3-ac16-4c22-a916-5c8ac68d1f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:48.453056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-a1cb41e3-ac16-4c22-a916-5c8ac68d1f49 None None] MFA Rules not processed for user `6843dd9f0e4644cc87de76482c0451f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:47:48.454462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a1cb41e3-ac16-4c22-a916-5c8ac68d1f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:48.610223 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3902/7885] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:47:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:47:48.634812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17cd6e-e229-4786-ac97-8532522c8aea admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:48.638858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2b17cd6e-e229-4786-ac97-8532522c8aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:48.701665 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:47:48.761040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17cd6e-e229-4786-ac97-8532522c8aea admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:48.773617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8d049-2154-4e17-aaac-3907b67a0b90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:48.774256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8d049-2154-4e17-aaac-3907b67a0b90 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:48.774536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8d049-2154-4e17-aaac-3907b67a0b90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:48.774812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8d049-2154-4e17-aaac-3907b67a0b90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:48.795330 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8d049-2154-4e17-aaac-3907b67a0b90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:48.796973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8d049-2154-4e17-aaac-3907b67a0b90 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:48.848971 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3984/7886] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:47:48 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:47:51.972194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb41e3-ac16-4c22-a916-5c8ac68d1f49 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:51.977409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a1cb41e3-ac16-4c22-a916-5c8ac68d1f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:52.197703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb41e3-ac16-4c22-a916-5c8ac68d1f49 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:52.212352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140509f7-3698-4392-a993-8be01abb55a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:52.213136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140509f7-3698-4392-a993-8be01abb55a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:52.213519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140509f7-3698-4392-a993-8be01abb55a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:52.213885 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140509f7-3698-4392-a993-8be01abb55a3 admin admin] PATH_INFO: `/v3/users/a51ed94295c644b2b7c22ab904af2774` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:52.216566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140509f7-3698-4392-a993-8be01abb55a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a51ed94295c644b2b7c22ab904af2774)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:52.218746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140509f7-3698-4392-a993-8be01abb55a3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:52.359007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-140509f7-3698-4392-a993-8be01abb55a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a51ed94295c644b2b7c22ab904af2774'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:52.369274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-140509f7-3698-4392-a993-8be01abb55a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a51ed94295c644b2b7c22ab904af2774'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:52.375338 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:47:52.388648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-140509f7-3698-4392-a993-8be01abb55a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a51ed94295c644b2b7c22ab904af2774'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:52.389939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-140509f7-3698-4392-a993-8be01abb55a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a51ed94295c644b2b7c22ab904af2774'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:52.406466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-140509f7-3698-4392-a993-8be01abb55a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a51ed94295c644b2b7c22ab904af2774'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:52.450251 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3903/7887] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:47:51 2022] DELETE /identity/v3/users/a51ed94295c644b2b7c22ab904af2774 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:47:52.456311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9e329-c581-4576-936d-fb2ecb41f74a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:52.457260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9e329-c581-4576-936d-fb2ecb41f74a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:52.457713 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9e329-c581-4576-936d-fb2ecb41f74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:52.527622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-61f9e329-c581-4576-936d-fb2ecb41f74a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:47:52.533551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-61f9e329-c581-4576-936d-fb2ecb41f74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:52.767558 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3985/7888] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:47:52.780938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140509f7-3698-4392-a993-8be01abb55a3 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:52.789389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-140509f7-3698-4392-a993-8be01abb55a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:52.956564 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140509f7-3698-4392-a993-8be01abb55a3 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:52.984829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2f670-729b-494f-96bf-caa39c3f740c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:52.984829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2f670-729b-494f-96bf-caa39c3f740c service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:52.984829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2f670-729b-494f-96bf-caa39c3f740c service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:52.984829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2f670-729b-494f-96bf-caa39c3f740c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:53.006033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2f670-729b-494f-96bf-caa39c3f740c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:53.007619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2f670-729b-494f-96bf-caa39c3f740c service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:53.029667 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3904/7889] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:47:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:47:54.360453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9e329-c581-4576-936d-fb2ecb41f74a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:54.362489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-61f9e329-c581-4576-936d-fb2ecb41f74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:54.395652 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9e329-c581-4576-936d-fb2ecb41f74a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:54.403639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a41237-f947-4658-8ca6-8ff14b7c8f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:54.404802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a41237-f947-4658-8ca6-8ff14b7c8f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:54.405223 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a41237-f947-4658-8ca6-8ff14b7c8f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:54.406832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a41237-f947-4658-8ca6-8ff14b7c8f35 admin admin] PATH_INFO: `/v3/projects/2193b215d72d4858bcfeaaccead01d4b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:54.408372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a41237-f947-4658-8ca6-8ff14b7c8f35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2193b215d72d4858bcfeaaccead01d4b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:54.410789 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a41237-f947-4658-8ca6-8ff14b7c8f35 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:54.643855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a4a41237-f947-4658-8ca6-8ff14b7c8f35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2193b215d72d4858bcfeaaccead01d4b', 'request_id': 'req-a4a41237-f947-4658-8ca6-8ff14b7c8f35'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:54.673735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a4a41237-f947-4658-8ca6-8ff14b7c8f35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2193b215d72d4858bcfeaaccead01d4b', 'request_id': 'req-a4a41237-f947-4658-8ca6-8ff14b7c8f35'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:54.719006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a4a41237-f947-4658-8ca6-8ff14b7c8f35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2193b215d72d4858bcfeaaccead01d4b', 'request_id': 'req-a4a41237-f947-4658-8ca6-8ff14b7c8f35'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:54.780839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a4a41237-f947-4658-8ca6-8ff14b7c8f35 admin admin] The token cache is being invalidate because project 2193b215d72d4858bcfeaaccead01d4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:47:54.781365 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a4a41237-f947-4658-8ca6-8ff14b7c8f35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:54.796415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a4a41237-f947-4658-8ca6-8ff14b7c8f35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:54.810064 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3986/7890] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:47:54 2022] DELETE /identity/v3/projects/2193b215d72d4858bcfeaaccead01d4b => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:47:54.817022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ae5dd-8997-4e98-a2fc-9d0902d5a326 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:54.817588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ae5dd-8997-4e98-a2fc-9d0902d5a326 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:54.817968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ae5dd-8997-4e98-a2fc-9d0902d5a326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:54.938623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7a1ae5dd-8997-4e98-a2fc-9d0902d5a326 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:47:54.952960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7a1ae5dd-8997-4e98-a2fc-9d0902d5a326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:55.268090 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3905/7891] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:47:55.275671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd69b6-16d8-4749-bdb7-a98b00abb106 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:55.276154 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd69b6-16d8-4749-bdb7-a98b00abb106 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:55.276403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd69b6-16d8-4749-bdb7-a98b00abb106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:55.351094 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-dcbd69b6-16d8-4749-bdb7-a98b00abb106 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:47:55.356397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dcbd69b6-16d8-4749-bdb7-a98b00abb106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:55.398154 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3987/7892] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:47:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:47:55.402244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ae5dd-8997-4e98-a2fc-9d0902d5a326 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:55.440245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1ae5dd-8997-4e98-a2fc-9d0902d5a326 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:55.478033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0edd2-a95f-449e-b482-deb00e0da113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:55.478941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0edd2-a95f-449e-b482-deb00e0da113 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:55.479367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0edd2-a95f-449e-b482-deb00e0da113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:55.479784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0edd2-a95f-449e-b482-deb00e0da113 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:55.483388 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d0edd2-a95f-449e-b482-deb00e0da113 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:47:55.502654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d0edd2-a95f-449e-b482-deb00e0da113 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:55.505612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d0edd2-a95f-449e-b482-deb00e0da113 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:55.570156 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3906/7893] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:47:55.575305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd69b6-16d8-4749-bdb7-a98b00abb106 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:55.609050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd69b6-16d8-4749-bdb7-a98b00abb106 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:55.656138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e470d-2e0f-4998-9f3e-d440d63799f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:55.657753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e470d-2e0f-4998-9f3e-d440d63799f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:55.662113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e470d-2e0f-4998-9f3e-d440d63799f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:55.662718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e470d-2e0f-4998-9f3e-d440d63799f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:55.670435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e470d-2e0f-4998-9f3e-d440d63799f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:55.680110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e470d-2e0f-4998-9f3e-d440d63799f6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:55.764403 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3988/7894] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:47:55 2022] POST /identity/v3/projects => generated 379 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:47:55.771571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0edd2-a95f-449e-b482-deb00e0da113 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:55.820246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0edd2-a95f-449e-b482-deb00e0da113 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:55.958094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0a796-91eb-4055-aeea-6b6fb7184f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:55.961084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0a796-91eb-4055-aeea-6b6fb7184f0b admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:55.961295 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0a796-91eb-4055-aeea-6b6fb7184f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:55.961505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0a796-91eb-4055-aeea-6b6fb7184f0b admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:55.962184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0a796-91eb-4055-aeea-6b6fb7184f0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:55.968845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0a796-91eb-4055-aeea-6b6fb7184f0b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:56.021104 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:47:56.040902 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3907/7895] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:47:55 2022] POST /identity/v3/users => generated 290 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:47:56.046960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e470d-2e0f-4998-9f3e-d440d63799f6 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:56.065528 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e470d-2e0f-4998-9f3e-d440d63799f6 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:56.091100 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a73f3-4ca2-40de-ae11-a3ea5e48b8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:56.091754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a73f3-4ca2-40de-ae11-a3ea5e48b8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:56.092073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a73f3-4ca2-40de-ae11-a3ea5e48b8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:56.094290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a73f3-4ca2-40de-ae11-a3ea5e48b8d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:56.095128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a73f3-4ca2-40de-ae11-a3ea5e48b8d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:56.100194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a73f3-4ca2-40de-ae11-a3ea5e48b8d0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:56.127554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0a796-91eb-4055-aeea-6b6fb7184f0b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:56.128641 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3989/7896] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:47:56.155194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0a796-91eb-4055-aeea-6b6fb7184f0b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:56.196541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0fb4a-6fe5-4111-826a-d220e07ef48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:56.197199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0fb4a-6fe5-4111-826a-d220e07ef48d admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:56.197485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0fb4a-6fe5-4111-826a-d220e07ef48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:56.197759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0fb4a-6fe5-4111-826a-d220e07ef48d admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:56.198443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0fb4a-6fe5-4111-826a-d220e07ef48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:56.200805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0fb4a-6fe5-4111-826a-d220e07ef48d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:56.281496 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3908/7897] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:47:56.283548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a73f3-4ca2-40de-ae11-a3ea5e48b8d0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:56.301303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a73f3-4ca2-40de-ae11-a3ea5e48b8d0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:56.314705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811d709-5f9c-4ea5-8e96-08271fd4d5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:56.315406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811d709-5f9c-4ea5-8e96-08271fd4d5f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:56.315685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811d709-5f9c-4ea5-8e96-08271fd4d5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:56.316017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811d709-5f9c-4ea5-8e96-08271fd4d5f0 admin admin] PATH_INFO: `/v3/projects/95980ee3e2e848e9b28cd82b49c6c8bb/users/1fdc89dfb0fa43c7858b0b9296e5f1c6/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:56.359015 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:47:56.378583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811d709-5f9c-4ea5-8e96-08271fd4d5f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95980ee3e2e848e9b28cd82b49c6c8bb, user_id=1fdc89dfb0fa43c7858b0b9296e5f1c6, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:56.386543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811d709-5f9c-4ea5-8e96-08271fd4d5f0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:56.418128 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3990/7898] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:47:56 2022] PUT /identity/v3/projects/95980ee3e2e848e9b28cd82b49c6c8bb/users/1fdc89dfb0fa43c7858b0b9296e5f1c6/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:47:56.437344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aacfbf-e2ed-4eb7-bb43-6cdca4b2c5a6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:56.437631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aacfbf-e2ed-4eb7-bb43-6cdca4b2c5a6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:56.438071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aacfbf-e2ed-4eb7-bb43-6cdca4b2c5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:56.589237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-54aacfbf-e2ed-4eb7-bb43-6cdca4b2c5a6 None None] MFA Rules not processed for user `1fdc89dfb0fa43c7858b0b9296e5f1c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:47:56.590605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-54aacfbf-e2ed-4eb7-bb43-6cdca4b2c5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:56.983343 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3909/7899] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:47:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 543 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:47:57.014175 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811d709-5f9c-4ea5-8e96-08271fd4d5f0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:57.014668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b811d709-5f9c-4ea5-8e96-08271fd4d5f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:57.191940 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811d709-5f9c-4ea5-8e96-08271fd4d5f0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:57.204829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e8f0a-f8f5-4bf1-a759-18ce763cbc7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:57.205574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e8f0a-f8f5-4bf1-a759-18ce763cbc7b service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:57.205856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e8f0a-f8f5-4bf1-a759-18ce763cbc7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:57.206323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e8f0a-f8f5-4bf1-a759-18ce763cbc7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:57.228478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e8f0a-f8f5-4bf1-a759-18ce763cbc7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:57.242139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e8f0a-f8f5-4bf1-a759-18ce763cbc7b service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:57.335009 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3991/7900] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:47:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:47:57.422321 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aacfbf-e2ed-4eb7-bb43-6cdca4b2c5a6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:57.665690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aacfbf-e2ed-4eb7-bb43-6cdca4b2c5a6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:57.681483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31333296-de62-4421-8b05-c6c902282eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:57.682156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31333296-de62-4421-8b05-c6c902282eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:57.682710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31333296-de62-4421-8b05-c6c902282eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:57.683009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31333296-de62-4421-8b05-c6c902282eff admin admin] PATH_INFO: `/v3/users/1fdc89dfb0fa43c7858b0b9296e5f1c6` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:57.686096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31333296-de62-4421-8b05-c6c902282eff admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fdc89dfb0fa43c7858b0b9296e5f1c6)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:57.688292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31333296-de62-4421-8b05-c6c902282eff admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:57.867617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-31333296-de62-4421-8b05-c6c902282eff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fdc89dfb0fa43c7858b0b9296e5f1c6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:57.903929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-31333296-de62-4421-8b05-c6c902282eff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fdc89dfb0fa43c7858b0b9296e5f1c6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:57.961841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-31333296-de62-4421-8b05-c6c902282eff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fdc89dfb0fa43c7858b0b9296e5f1c6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:57.964499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-31333296-de62-4421-8b05-c6c902282eff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fdc89dfb0fa43c7858b0b9296e5f1c6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:57.991755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-31333296-de62-4421-8b05-c6c902282eff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fdc89dfb0fa43c7858b0b9296e5f1c6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:47:57.998829 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:47:58.025915 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3910/7901] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:47:57 2022] DELETE /identity/v3/users/1fdc89dfb0fa43c7858b0b9296e5f1c6 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:47:58.032555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fefdb-f618-4ab9-afa9-99062dc0359b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:58.033321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fefdb-f618-4ab9-afa9-99062dc0359b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:58.033830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fefdb-f618-4ab9-afa9-99062dc0359b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:58.111366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-409fefdb-f618-4ab9-afa9-99062dc0359b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:47:58.113782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-409fefdb-f618-4ab9-afa9-99062dc0359b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:58.361579 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3992/7902] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:47:58.373072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31333296-de62-4421-8b05-c6c902282eff admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:47:58.374602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-31333296-de62-4421-8b05-c6c902282eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:47:58.637141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31333296-de62-4421-8b05-c6c902282eff admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:47:58.657041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fea41-0b7b-46be-916a-93a3bf4d16bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:47:58.657696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fea41-0b7b-46be-916a-93a3bf4d16bd service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:47:58.657971 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fea41-0b7b-46be-916a-93a3bf4d16bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:47:58.658248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fea41-0b7b-46be-916a-93a3bf4d16bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:47:58.696466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fea41-0b7b-46be-916a-93a3bf4d16bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:47:58.703546 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515fea41-0b7b-46be-916a-93a3bf4d16bd service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:47:58.738067 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3911/7903] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:47:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:48:00.767760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fefdb-f618-4ab9-afa9-99062dc0359b None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:00.769715 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-409fefdb-f618-4ab9-afa9-99062dc0359b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:00.790746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fefdb-f618-4ab9-afa9-99062dc0359b None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:00.815491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c3c98-37c9-4ca1-b51c-9751e4adf85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:00.815491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c3c98-37c9-4ca1-b51c-9751e4adf85c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:00.815491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c3c98-37c9-4ca1-b51c-9751e4adf85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:00.815491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c3c98-37c9-4ca1-b51c-9751e4adf85c admin admin] PATH_INFO: `/v3/projects/95980ee3e2e848e9b28cd82b49c6c8bb` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:00.816596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c3c98-37c9-4ca1-b51c-9751e4adf85c admin admin] RBAC: Authorizing `identity:delete_project(project_id=95980ee3e2e848e9b28cd82b49c6c8bb)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:00.818566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c3c98-37c9-4ca1-b51c-9751e4adf85c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:01.020734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-813c3c98-37c9-4ca1-b51c-9751e4adf85c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95980ee3e2e848e9b28cd82b49c6c8bb', 'request_id': 'req-813c3c98-37c9-4ca1-b51c-9751e4adf85c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:01.036097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-813c3c98-37c9-4ca1-b51c-9751e4adf85c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95980ee3e2e848e9b28cd82b49c6c8bb', 'request_id': 'req-813c3c98-37c9-4ca1-b51c-9751e4adf85c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:01.048853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-813c3c98-37c9-4ca1-b51c-9751e4adf85c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95980ee3e2e848e9b28cd82b49c6c8bb', 'request_id': 'req-813c3c98-37c9-4ca1-b51c-9751e4adf85c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:01.089807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-813c3c98-37c9-4ca1-b51c-9751e4adf85c admin admin] The token cache is being invalidate because project 95980ee3e2e848e9b28cd82b49c6c8bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:48:01.091298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-813c3c98-37c9-4ca1-b51c-9751e4adf85c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:01.093880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-813c3c98-37c9-4ca1-b51c-9751e4adf85c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:01.096546 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3993/7904] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:48:00 2022] DELETE /identity/v3/projects/95980ee3e2e848e9b28cd82b49c6c8bb => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:01.104652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3727c3e-2280-4648-9578-0e861e990686 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:01.107282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3727c3e-2280-4648-9578-0e861e990686 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:01.108047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3727c3e-2280-4648-9578-0e861e990686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:01.186348 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c3727c3e-2280-4648-9578-0e861e990686 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:01.192925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c3727c3e-2280-4648-9578-0e861e990686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:01.475278 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3912/7905] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:01.483977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bccd3c-aa5c-4b6d-8982-b73fa8b47448 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:01.484255 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bccd3c-aa5c-4b6d-8982-b73fa8b47448 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:01.484707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bccd3c-aa5c-4b6d-8982-b73fa8b47448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:01.519239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-37bccd3c-aa5c-4b6d-8982-b73fa8b47448 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:01.521104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-37bccd3c-aa5c-4b6d-8982-b73fa8b47448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:01.537383 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3994/7906] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:48:01.539602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3727c3e-2280-4648-9578-0e861e990686 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:01.556752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3727c3e-2280-4648-9578-0e861e990686 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:01.585455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a1c56-30ef-4d4f-9498-52b0ad83a832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:01.586574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a1c56-30ef-4d4f-9498-52b0ad83a832 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:01.586888 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a1c56-30ef-4d4f-9498-52b0ad83a832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:01.587165 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a1c56-30ef-4d4f-9498-52b0ad83a832 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:01.587848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a1c56-30ef-4d4f-9498-52b0ad83a832 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:48:01.589082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a1c56-30ef-4d4f-9498-52b0ad83a832 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:01.610671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a1c56-30ef-4d4f-9498-52b0ad83a832 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:01.645584 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3913/7907] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:48:01.646897 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bccd3c-aa5c-4b6d-8982-b73fa8b47448 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:01.665398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bccd3c-aa5c-4b6d-8982-b73fa8b47448 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:01.676245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf2244-741b-4e3f-a13c-3a7db6e76a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:01.678223 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf2244-741b-4e3f-a13c-3a7db6e76a4a admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:01.683128 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf2244-741b-4e3f-a13c-3a7db6e76a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:01.684505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf2244-741b-4e3f-a13c-3a7db6e76a4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:01.687515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf2244-741b-4e3f-a13c-3a7db6e76a4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:01.695042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf2244-741b-4e3f-a13c-3a7db6e76a4a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:01.711481 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:01.786798 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3995/7908] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:48:01 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:01.791674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a1c56-30ef-4d4f-9498-52b0ad83a832 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:01.824955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a1c56-30ef-4d4f-9498-52b0ad83a832 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:02.164760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98592407-b3b1-4b5d-99da-bd448addfb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:02.165928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98592407-b3b1-4b5d-99da-bd448addfb51 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:02.175942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98592407-b3b1-4b5d-99da-bd448addfb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:02.175942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98592407-b3b1-4b5d-99da-bd448addfb51 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:02.176913 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98592407-b3b1-4b5d-99da-bd448addfb51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:02.185126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98592407-b3b1-4b5d-99da-bd448addfb51 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:02.255743 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3914/7909] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:48:01 2022] POST /identity/v3/users => generated 292 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:02.264826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf2244-741b-4e3f-a13c-3a7db6e76a4a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:02.317213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf2244-741b-4e3f-a13c-3a7db6e76a4a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:02.336454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b57109-5a2b-4216-a24b-26115d4c8e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:02.338229 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b57109-5a2b-4216-a24b-26115d4c8e3f admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:02.339047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b57109-5a2b-4216-a24b-26115d4c8e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:02.339550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b57109-5a2b-4216-a24b-26115d4c8e3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:02.340718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b57109-5a2b-4216-a24b-26115d4c8e3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:02.342648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b57109-5a2b-4216-a24b-26115d4c8e3f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:02.373064 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3996/7910] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:02.377194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98592407-b3b1-4b5d-99da-bd448addfb51 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:02.395945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98592407-b3b1-4b5d-99da-bd448addfb51 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:02.404628 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a1acd-5eea-4591-8fe5-3df161b3561d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:02.405254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a1acd-5eea-4591-8fe5-3df161b3561d admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:02.405532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a1acd-5eea-4591-8fe5-3df161b3561d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:02.405800 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a1acd-5eea-4591-8fe5-3df161b3561d admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:02.406718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a1acd-5eea-4591-8fe5-3df161b3561d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:02.408424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a1acd-5eea-4591-8fe5-3df161b3561d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:02.433987 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3915/7911] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:48:02.435208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b57109-5a2b-4216-a24b-26115d4c8e3f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:02.450197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b57109-5a2b-4216-a24b-26115d4c8e3f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:02.459478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df953a1-7c04-4191-a657-cb4485f1cd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:02.461061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df953a1-7c04-4191-a657-cb4485f1cd22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:02.462479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df953a1-7c04-4191-a657-cb4485f1cd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:02.463115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df953a1-7c04-4191-a657-cb4485f1cd22 admin admin] PATH_INFO: `/v3/projects/6689ff69254e4390bbc6f4a61d3d6a91/users/9416f80d07e847dfae6b2512164ec990/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:02.500147 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df953a1-7c04-4191-a657-cb4485f1cd22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6689ff69254e4390bbc6f4a61d3d6a91, user_id=9416f80d07e847dfae6b2512164ec990, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:02.515246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df953a1-7c04-4191-a657-cb4485f1cd22 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:02.547118 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3997/7912] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:48:02 2022] PUT /identity/v3/projects/6689ff69254e4390bbc6f4a61d3d6a91/users/9416f80d07e847dfae6b2512164ec990/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:02.563863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108aa967-6a83-4380-aa5a-d7783ed834bf None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:02.564422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108aa967-6a83-4380-aa5a-d7783ed834bf None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:02.564968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108aa967-6a83-4380-aa5a-d7783ed834bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:02.598510 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:02.654334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-108aa967-6a83-4380-aa5a-d7783ed834bf None None] MFA Rules not processed for user `9416f80d07e847dfae6b2512164ec990`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:02.655587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-108aa967-6a83-4380-aa5a-d7783ed834bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:02.908730 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3916/7913] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:02.929685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df953a1-7c04-4191-a657-cb4485f1cd22 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:02.932366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5df953a1-7c04-4191-a657-cb4485f1cd22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:03.144704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df953a1-7c04-4191-a657-cb4485f1cd22 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:03.149450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff412d-90b3-427b-ba6d-a8b93c244326 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:03.150100 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff412d-90b3-427b-ba6d-a8b93c244326 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:03.150565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff412d-90b3-427b-ba6d-a8b93c244326 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:03.150699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff412d-90b3-427b-ba6d-a8b93c244326 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:03.178138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff412d-90b3-427b-ba6d-a8b93c244326 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:03.182440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff412d-90b3-427b-ba6d-a8b93c244326 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:03.240273 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3998/7914] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:48:12.891170 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=29 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:13.197567 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=46,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:17.115977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108aa967-6a83-4380-aa5a-d7783ed834bf None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:17.118220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-108aa967-6a83-4380-aa5a-d7783ed834bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:17.341379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108aa967-6a83-4380-aa5a-d7783ed834bf None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:17.349531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796bcbf-a04d-485e-9d5b-db5294dfca13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:17.350305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796bcbf-a04d-485e-9d5b-db5294dfca13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:17.350664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796bcbf-a04d-485e-9d5b-db5294dfca13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:17.351596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796bcbf-a04d-485e-9d5b-db5294dfca13 admin admin] PATH_INFO: `/v3/users/18756b8a2dce465ab9d3280c929d60c7` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:17.353674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0796bcbf-a04d-485e-9d5b-db5294dfca13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18756b8a2dce465ab9d3280c929d60c7)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:17.357086 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0796bcbf-a04d-485e-9d5b-db5294dfca13 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:17.486989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0796bcbf-a04d-485e-9d5b-db5294dfca13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18756b8a2dce465ab9d3280c929d60c7'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:17.524346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0796bcbf-a04d-485e-9d5b-db5294dfca13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18756b8a2dce465ab9d3280c929d60c7'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:17.532946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff412d-90b3-427b-ba6d-a8b93c244326 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:17.536702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5fff412d-90b3-427b-ba6d-a8b93c244326 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:17.567024 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0796bcbf-a04d-485e-9d5b-db5294dfca13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18756b8a2dce465ab9d3280c929d60c7'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:17.568124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0796bcbf-a04d-485e-9d5b-db5294dfca13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18756b8a2dce465ab9d3280c929d60c7'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:17.584206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0796bcbf-a04d-485e-9d5b-db5294dfca13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18756b8a2dce465ab9d3280c929d60c7'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:17.605547 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3917/7915] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:48:17 2022] DELETE /identity/v3/users/18756b8a2dce465ab9d3280c929d60c7 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:17.607265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5617b-d1cb-4403-bf28-cbd15deba374 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:17.608227 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5617b-d1cb-4403-bf28-cbd15deba374 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:17.609184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5617b-d1cb-4403-bf28-cbd15deba374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:17.621810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff412d-90b3-427b-ba6d-a8b93c244326 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:17.671703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-09e5617b-d1cb-4403-bf28-cbd15deba374 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:17.673265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-09e5617b-d1cb-4403-bf28-cbd15deba374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:17.779858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a1331-018e-42f8-9db5-fe041c4d9c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:17.781259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a1331-018e-42f8-9db5-fe041c4d9c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:17.781567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a1331-018e-42f8-9db5-fe041c4d9c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:17.781843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a1331-018e-42f8-9db5-fe041c4d9c61 admin admin] PATH_INFO: `/v3/users/6843dd9f0e4644cc87de76482c0451f3` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:17.784857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a1331-018e-42f8-9db5-fe041c4d9c61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6843dd9f0e4644cc87de76482c0451f3)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:17.788792 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3918/7916] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:17.789829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a1331-018e-42f8-9db5-fe041c4d9c61 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:17.801370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5617b-d1cb-4403-bf28-cbd15deba374 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:17.803789 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-09e5617b-d1cb-4403-bf28-cbd15deba374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:17.880384 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:17.969768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5617b-d1cb-4403-bf28-cbd15deba374 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:17.983931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01de72-5469-4332-9150-c2927c212500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:17.984974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01de72-5469-4332-9150-c2927c212500 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:17.996432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-571a1331-018e-42f8-9db5-fe041c4d9c61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6843dd9f0e4644cc87de76482c0451f3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:18.007427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01de72-5469-4332-9150-c2927c212500 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:18.014789 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-571a1331-018e-42f8-9db5-fe041c4d9c61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6843dd9f0e4644cc87de76482c0451f3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:18.015020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01de72-5469-4332-9150-c2927c212500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:18.038924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01de72-5469-4332-9150-c2927c212500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:18.040867 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01de72-5469-4332-9150-c2927c212500 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:18.047023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-571a1331-018e-42f8-9db5-fe041c4d9c61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6843dd9f0e4644cc87de76482c0451f3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:18.048280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-571a1331-018e-42f8-9db5-fe041c4d9c61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6843dd9f0e4644cc87de76482c0451f3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:18.058520 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3919/7917] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:48:18.088255 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-571a1331-018e-42f8-9db5-fe041c4d9c61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6843dd9f0e4644cc87de76482c0451f3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:18.110704 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 3999/7918] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:48:17 2022] DELETE /identity/v3/users/6843dd9f0e4644cc87de76482c0451f3 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:18.117499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c69db1-3251-4338-b1a3-1ea6fcb98264 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:18.118254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c69db1-3251-4338-b1a3-1ea6fcb98264 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:18.118254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c69db1-3251-4338-b1a3-1ea6fcb98264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:18.160402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-50c69db1-3251-4338-b1a3-1ea6fcb98264 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:18.162495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-50c69db1-3251-4338-b1a3-1ea6fcb98264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:18.385039 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3920/7919] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:18.400498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a1331-018e-42f8-9db5-fe041c4d9c61 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:18.403960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-571a1331-018e-42f8-9db5-fe041c4d9c61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:18.546154 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a1331-018e-42f8-9db5-fe041c4d9c61 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:18.557023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65d8ea-86d1-4019-99b8-61c0a3d4ce83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:18.557760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65d8ea-86d1-4019-99b8-61c0a3d4ce83 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:18.558073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65d8ea-86d1-4019-99b8-61c0a3d4ce83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:18.558344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65d8ea-86d1-4019-99b8-61c0a3d4ce83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:18.583604 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65d8ea-86d1-4019-99b8-61c0a3d4ce83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:18.590645 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65d8ea-86d1-4019-99b8-61c0a3d4ce83 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:18.603766 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c69db1-3251-4338-b1a3-1ea6fcb98264 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:18.607146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-50c69db1-3251-4338-b1a3-1ea6fcb98264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:18.632759 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4000/7920] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:48:18.643652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c69db1-3251-4338-b1a3-1ea6fcb98264 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:18.654999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469e187-060d-4a25-9a7c-1b7fea73e094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:18.656601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469e187-060d-4a25-9a7c-1b7fea73e094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:18.657337 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469e187-060d-4a25-9a7c-1b7fea73e094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:18.657919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469e187-060d-4a25-9a7c-1b7fea73e094 admin admin] PATH_INFO: `/v3/projects/e3675309071a4a9cbff7c401d6dd2774` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:18.660045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469e187-060d-4a25-9a7c-1b7fea73e094 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3675309071a4a9cbff7c401d6dd2774)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:18.662535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469e187-060d-4a25-9a7c-1b7fea73e094 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:18.789559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8469e187-060d-4a25-9a7c-1b7fea73e094 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3675309071a4a9cbff7c401d6dd2774', 'request_id': 'req-8469e187-060d-4a25-9a7c-1b7fea73e094'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:18.802768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8469e187-060d-4a25-9a7c-1b7fea73e094 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3675309071a4a9cbff7c401d6dd2774', 'request_id': 'req-8469e187-060d-4a25-9a7c-1b7fea73e094'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:18.824786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8469e187-060d-4a25-9a7c-1b7fea73e094 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3675309071a4a9cbff7c401d6dd2774', 'request_id': 'req-8469e187-060d-4a25-9a7c-1b7fea73e094'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:18.880756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8469e187-060d-4a25-9a7c-1b7fea73e094 admin admin] The token cache is being invalidate because project e3675309071a4a9cbff7c401d6dd2774 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:48:18.881315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8469e187-060d-4a25-9a7c-1b7fea73e094 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:18.884405 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8469e187-060d-4a25-9a7c-1b7fea73e094 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:18.895933 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3921/7921] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:48:18 2022] DELETE /identity/v3/projects/e3675309071a4a9cbff7c401d6dd2774 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:48:18.901021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34aafd2-a5b6-42c2-a91f-0dfc70b5500d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:18.902056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34aafd2-a5b6-42c2-a91f-0dfc70b5500d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:18.902549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34aafd2-a5b6-42c2-a91f-0dfc70b5500d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:19.033699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e34aafd2-a5b6-42c2-a91f-0dfc70b5500d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:19.038947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e34aafd2-a5b6-42c2-a91f-0dfc70b5500d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:19.097159 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:19.132324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469e187-060d-4a25-9a7c-1b7fea73e094 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:19.134747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8469e187-060d-4a25-9a7c-1b7fea73e094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:19.314455 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4001/7922] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:19.322871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045704c-e26d-4abb-ada2-d6d9fb732e8c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:19.324237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045704c-e26d-4abb-ada2-d6d9fb732e8c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:19.324794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045704c-e26d-4abb-ada2-d6d9fb732e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:19.403368 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:19.432548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c045704c-e26d-4abb-ada2-d6d9fb732e8c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:19.438612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c045704c-e26d-4abb-ada2-d6d9fb732e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:19.457375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469e187-060d-4a25-9a7c-1b7fea73e094 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:19.470093 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4002/7923] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:48:19.472623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3cd973-d416-418c-9198-0e37ace90c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:19.473244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045704c-e26d-4abb-ada2-d6d9fb732e8c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:19.484751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cd973-d416-418c-9198-0e37ace90c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:19.484751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cd973-d416-418c-9198-0e37ace90c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:19.484751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3cd973-d416-418c-9198-0e37ace90c74 admin admin] PATH_INFO: `/v3/projects/b3fb02e4666745a7ac5cc1fde8621ba8` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:19.484751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3cd973-d416-418c-9198-0e37ace90c74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3fb02e4666745a7ac5cc1fde8621ba8)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:19.484751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3cd973-d416-418c-9198-0e37ace90c74 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:19.497818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045704c-e26d-4abb-ada2-d6d9fb732e8c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:19.506561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777806d-3a1a-4865-b58b-2b16156e1630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:19.507207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777806d-3a1a-4865-b58b-2b16156e1630 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:19.507750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777806d-3a1a-4865-b58b-2b16156e1630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:19.508190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777806d-3a1a-4865-b58b-2b16156e1630 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:19.513202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777806d-3a1a-4865-b58b-2b16156e1630 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:48:19.513477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777806d-3a1a-4865-b58b-2b16156e1630 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:19.529691 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777806d-3a1a-4865-b58b-2b16156e1630 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:19.567619 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4003/7924] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:48:19.571156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777806d-3a1a-4865-b58b-2b16156e1630 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:19.574477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2777806d-3a1a-4865-b58b-2b16156e1630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:19.594018 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777806d-3a1a-4865-b58b-2b16156e1630 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:19.642260 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5f3cd973-d416-418c-9198-0e37ace90c74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3fb02e4666745a7ac5cc1fde8621ba8', 'request_id': 'req-5f3cd973-d416-418c-9198-0e37ace90c74'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:19.655363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5f3cd973-d416-418c-9198-0e37ace90c74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3fb02e4666745a7ac5cc1fde8621ba8', 'request_id': 'req-5f3cd973-d416-418c-9198-0e37ace90c74'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:19.671479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5f3cd973-d416-418c-9198-0e37ace90c74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3fb02e4666745a7ac5cc1fde8621ba8', 'request_id': 'req-5f3cd973-d416-418c-9198-0e37ace90c74'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:19.701494 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5f252-ecdf-4ec2-b46d-350d9e216447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:19.702446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5f252-ecdf-4ec2-b46d-350d9e216447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:19.702627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5f3cd973-d416-418c-9198-0e37ace90c74 admin admin] The token cache is being invalidate because project b3fb02e4666745a7ac5cc1fde8621ba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:48:19.702856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5f252-ecdf-4ec2-b46d-350d9e216447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:19.702993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5f252-ecdf-4ec2-b46d-350d9e216447 admin admin] PATH_INFO: `/v3/users/9416f80d07e847dfae6b2512164ec990` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:19.703131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5f3cd973-d416-418c-9198-0e37ace90c74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:19.704144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5f3cd973-d416-418c-9198-0e37ace90c74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:19.704378 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5f252-ecdf-4ec2-b46d-350d9e216447 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9416f80d07e847dfae6b2512164ec990)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:19.706644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5f252-ecdf-4ec2-b46d-350d9e216447 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:19.707237 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3922/7925] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:48:19 2022] DELETE /identity/v3/projects/b3fb02e4666745a7ac5cc1fde8621ba8 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:19.709896 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3cd973-d416-418c-9198-0e37ace90c74 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:19.713021 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5f3cd973-d416-418c-9198-0e37ace90c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:19.738681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3cd973-d416-418c-9198-0e37ace90c74 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:19.748466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2683fae-a2d0-4943-a158-6b39941821d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:19.749857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2683fae-a2d0-4943-a158-6b39941821d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:19.751719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2683fae-a2d0-4943-a158-6b39941821d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:19.752862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2683fae-a2d0-4943-a158-6b39941821d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:19.754138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2683fae-a2d0-4943-a158-6b39941821d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:19.756904 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2683fae-a2d0-4943-a158-6b39941821d1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:19.778025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-90c5f252-ecdf-4ec2-b46d-350d9e216447 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9416f80d07e847dfae6b2512164ec990'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:19.788570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-90c5f252-ecdf-4ec2-b46d-350d9e216447 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9416f80d07e847dfae6b2512164ec990'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:19.805836 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3923/7926] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:48:19 2022] POST /identity/v3/projects => generated 361 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:19.807322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55439f51-0cb0-461d-97e3-ef9319e88229 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:19.807778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55439f51-0cb0-461d-97e3-ef9319e88229 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:19.808140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55439f51-0cb0-461d-97e3-ef9319e88229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:19.811291 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-90c5f252-ecdf-4ec2-b46d-350d9e216447 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9416f80d07e847dfae6b2512164ec990'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:19.812426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-90c5f252-ecdf-4ec2-b46d-350d9e216447 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9416f80d07e847dfae6b2512164ec990'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:19.826671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-90c5f252-ecdf-4ec2-b46d-350d9e216447 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9416f80d07e847dfae6b2512164ec990'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:19.842017 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4004/7927] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:48:19 2022] DELETE /identity/v3/users/9416f80d07e847dfae6b2512164ec990 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:19.843197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5f252-ecdf-4ec2-b46d-350d9e216447 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:19.844759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-90c5f252-ecdf-4ec2-b46d-350d9e216447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:19.848968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-55439f51-0cb0-461d-97e3-ef9319e88229 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:19.850315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-55439f51-0cb0-461d-97e3-ef9319e88229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:19.913033 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:20.028989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5f252-ecdf-4ec2-b46d-350d9e216447 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:20.057129 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3924/7928] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:20.058537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85f843-ee0f-48f6-a835-117debf31208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:20.059462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85f843-ee0f-48f6-a835-117debf31208 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:20.059996 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85f843-ee0f-48f6-a835-117debf31208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:20.060118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5f1c6-2a96-4388-bd3d-9a1b33d325ba None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:20.060423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5f1c6-2a96-4388-bd3d-9a1b33d325ba None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:20.060811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5f1c6-2a96-4388-bd3d-9a1b33d325ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:20.060921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85f843-ee0f-48f6-a835-117debf31208 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:20.061794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c85f843-ee0f-48f6-a835-117debf31208 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:20.064298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c85f843-ee0f-48f6-a835-117debf31208 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:20.102509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-79b5f1c6-2a96-4388-bd3d-9a1b33d325ba None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:20.104868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-79b5f1c6-2a96-4388-bd3d-9a1b33d325ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:20.125535 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3925/7929] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:20.125719 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4005/7930] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:48:19 2022] POST /identity/v3/users => generated 281 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:20.125819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc6039-c037-4a54-930f-7b0f56b8aa1d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:20.125819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc6039-c037-4a54-930f-7b0f56b8aa1d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:20.126222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc6039-c037-4a54-930f-7b0f56b8aa1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:20.133482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85f843-ee0f-48f6-a835-117debf31208 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:20.167426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85f843-ee0f-48f6-a835-117debf31208 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:20.170474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-90fc6039-c037-4a54-930f-7b0f56b8aa1d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:20.171952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-90fc6039-c037-4a54-930f-7b0f56b8aa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:20.184252 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94926a-290c-44ef-a160-951b3f48bfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:20.185292 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3926/7931] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:20.190281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94926a-290c-44ef-a160-951b3f48bfd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:20.190281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94926a-290c-44ef-a160-951b3f48bfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:20.190593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc6039-c037-4a54-930f-7b0f56b8aa1d None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:20.190761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94926a-290c-44ef-a160-951b3f48bfd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:20.190761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94926a-290c-44ef-a160-951b3f48bfd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:20.190761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94926a-290c-44ef-a160-951b3f48bfd3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:20.192957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-90fc6039-c037-4a54-930f-7b0f56b8aa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:20.213321 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4006/7932] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:20.215500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94926a-290c-44ef-a160-951b3f48bfd3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:20.247676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94926a-290c-44ef-a160-951b3f48bfd3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:20.254176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2a070-891e-4e8c-bc57-865b602299a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:20.254906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2a070-891e-4e8c-bc57-865b602299a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:20.255258 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2a070-891e-4e8c-bc57-865b602299a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:20.255604 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2a070-891e-4e8c-bc57-865b602299a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:20.256409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2a070-891e-4e8c-bc57-865b602299a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:48:20.257138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2a070-891e-4e8c-bc57-865b602299a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:20.258937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2a070-891e-4e8c-bc57-865b602299a1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:20.259594 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:20.277303 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4007/7933] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:48:20.277303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2a070-891e-4e8c-bc57-865b602299a1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:20.283831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc6039-c037-4a54-930f-7b0f56b8aa1d None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:20.289785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc3c69-7fda-4bff-8eff-fcc28c3a98e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:20.290611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc3c69-7fda-4bff-8eff-fcc28c3a98e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:20.291386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc3c69-7fda-4bff-8eff-fcc28c3a98e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:20.291743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc3c69-7fda-4bff-8eff-fcc28c3a98e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:20.303348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2a070-891e-4e8c-bc57-865b602299a1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:20.305572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc3c69-7fda-4bff-8eff-fcc28c3a98e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:20.307167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc3c69-7fda-4bff-8eff-fcc28c3a98e2 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:20.309995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d536f38-3405-4f3d-91fd-97d9051a08a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:20.310712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d536f38-3405-4f3d-91fd-97d9051a08a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:20.311060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d536f38-3405-4f3d-91fd-97d9051a08a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:20.311402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d536f38-3405-4f3d-91fd-97d9051a08a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:20.312224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d536f38-3405-4f3d-91fd-97d9051a08a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:20.314084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d536f38-3405-4f3d-91fd-97d9051a08a6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:20.320567 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3927/7934] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:48:20.322245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc3c69-7fda-4bff-8eff-fcc28c3a98e2 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:20.331054 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4008/7935] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:20.334448 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc3c69-7fda-4bff-8eff-fcc28c3a98e2 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:20.337123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d536f38-3405-4f3d-91fd-97d9051a08a6 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:20.340658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db560f-3339-4c7a-ba30-c7152d219322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:20.341441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db560f-3339-4c7a-ba30-c7152d219322 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:20.341828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db560f-3339-4c7a-ba30-c7152d219322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:20.342327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db560f-3339-4c7a-ba30-c7152d219322 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:20.343122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db560f-3339-4c7a-ba30-c7152d219322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:20.345287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db560f-3339-4c7a-ba30-c7152d219322 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:20.375707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d536f38-3405-4f3d-91fd-97d9051a08a6 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:20.385295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397cc1b-49e5-4980-ab7b-40bc1fbefd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:20.387229 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397cc1b-49e5-4980-ab7b-40bc1fbefd66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:20.387717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397cc1b-49e5-4980-ab7b-40bc1fbefd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:20.388210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397cc1b-49e5-4980-ab7b-40bc1fbefd66 admin admin] PATH_INFO: `/v3/projects/487a1ab934f140ec92c398cb6eebc79e/users/76d65e02c38f4333bb9d47498b2d7a4b/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:20.392555 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3928/7936] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:48:20 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:20.395519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db560f-3339-4c7a-ba30-c7152d219322 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:20.455315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397cc1b-49e5-4980-ab7b-40bc1fbefd66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=487a1ab934f140ec92c398cb6eebc79e, user_id=76d65e02c38f4333bb9d47498b2d7a4b, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:20.466295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397cc1b-49e5-4980-ab7b-40bc1fbefd66 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:20.517417 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4009/7937] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:48:20 2022] PUT /identity/v3/projects/487a1ab934f140ec92c398cb6eebc79e/users/76d65e02c38f4333bb9d47498b2d7a4b/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:48:20.541771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107249d2-97f2-4e36-8b96-8ea150aba678 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:20.542635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107249d2-97f2-4e36-8b96-8ea150aba678 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:20.542916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107249d2-97f2-4e36-8b96-8ea150aba678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:20.572013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db560f-3339-4c7a-ba30-c7152d219322 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:20.617178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-107249d2-97f2-4e36-8b96-8ea150aba678 None None] MFA Rules not processed for user `76d65e02c38f4333bb9d47498b2d7a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:20.621909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-107249d2-97f2-4e36-8b96-8ea150aba678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:20.690009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d17f5-a4df-4fa8-a4cc-34307e4b658e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:20.690943 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d17f5-a4df-4fa8-a4cc-34307e4b658e admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:20.691550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d17f5-a4df-4fa8-a4cc-34307e4b658e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:20.692031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d17f5-a4df-4fa8-a4cc-34307e4b658e admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:20.692847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d17f5-a4df-4fa8-a4cc-34307e4b658e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:20.696065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d17f5-a4df-4fa8-a4cc-34307e4b658e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:20.729883 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3929/7938] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:48:20 2022] POST /identity/v3/users => generated 293 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:20.740478 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4010/7939] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:48:20.741787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d17f5-a4df-4fa8-a4cc-34307e4b658e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:20.756367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107249d2-97f2-4e36-8b96-8ea150aba678 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:20.771162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d17f5-a4df-4fa8-a4cc-34307e4b658e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:20.781078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd4312-2622-4911-8c14-aabd8827ed2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:20.781814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd4312-2622-4911-8c14-aabd8827ed2c admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:20.782112 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd4312-2622-4911-8c14-aabd8827ed2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:20.782375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd4312-2622-4911-8c14-aabd8827ed2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:20.783125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd4312-2622-4911-8c14-aabd8827ed2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:20.784807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd4312-2622-4911-8c14-aabd8827ed2c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:20.817394 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3930/7940] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:20.821391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd4312-2622-4911-8c14-aabd8827ed2c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:20.856050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd4312-2622-4911-8c14-aabd8827ed2c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:20.882975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7f207-b882-42a1-a3c3-79a5dd55c564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:20.883781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7f207-b882-42a1-a3c3-79a5dd55c564 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:20.884284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7f207-b882-42a1-a3c3-79a5dd55c564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:20.884787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7f207-b882-42a1-a3c3-79a5dd55c564 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:20.885926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7f207-b882-42a1-a3c3-79a5dd55c564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:20.888813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7f207-b882-42a1-a3c3-79a5dd55c564 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:20.899786 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:20.925523 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3931/7941] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:48:20.926602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7f207-b882-42a1-a3c3-79a5dd55c564 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:20.930159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-72d7f207-b882-42a1-a3c3-79a5dd55c564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:20.954071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107249d2-97f2-4e36-8b96-8ea150aba678 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:20.968126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01cfb86-2282-462e-b89f-f40f94500181 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:20.969124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01cfb86-2282-462e-b89f-f40f94500181 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:20.969573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01cfb86-2282-462e-b89f-f40f94500181 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:20.969998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01cfb86-2282-462e-b89f-f40f94500181 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:20.984756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7f207-b882-42a1-a3c3-79a5dd55c564 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:21.002247 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01cfb86-2282-462e-b89f-f40f94500181 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:21.003985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01cfb86-2282-462e-b89f-f40f94500181 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:21.006539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73ee4d-5410-46db-abff-c466e87282c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:21.008985 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73ee4d-5410-46db-abff-c466e87282c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:21.009336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73ee4d-5410-46db-abff-c466e87282c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:21.009878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73ee4d-5410-46db-abff-c466e87282c8 admin admin] PATH_INFO: `/v3/projects/6689ff69254e4390bbc6f4a61d3d6a91` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:21.013123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73ee4d-5410-46db-abff-c466e87282c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6689ff69254e4390bbc6f4a61d3d6a91)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:21.017943 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73ee4d-5410-46db-abff-c466e87282c8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:21.018191 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4011/7942] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:48:21.019141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01cfb86-2282-462e-b89f-f40f94500181 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:21.035370 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01cfb86-2282-462e-b89f-f40f94500181 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:21.045207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea84d87-e14f-4382-ae44-b2f4edd9d0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:21.045987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea84d87-e14f-4382-ae44-b2f4edd9d0b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:21.046336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea84d87-e14f-4382-ae44-b2f4edd9d0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:21.046682 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea84d87-e14f-4382-ae44-b2f4edd9d0b6 admin admin] PATH_INFO: `/v3/projects/7f4c65032bfe43d2bc5b417ca28c5057/users/e39efe367e5f4c65beff8ef7eb2a3862/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:21.082082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea84d87-e14f-4382-ae44-b2f4edd9d0b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4c65032bfe43d2bc5b417ca28c5057, user_id=e39efe367e5f4c65beff8ef7eb2a3862, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:21.097844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea84d87-e14f-4382-ae44-b2f4edd9d0b6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:21.133316 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:21.147973 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4012/7943] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:48:21 2022] PUT /identity/v3/projects/7f4c65032bfe43d2bc5b417ca28c5057/users/e39efe367e5f4c65beff8ef7eb2a3862/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:21.150826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1fcca-09ac-4d7c-94eb-33a322a7ee8c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:21.151170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1fcca-09ac-4d7c-94eb-33a322a7ee8c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:21.151527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1fcca-09ac-4d7c-94eb-33a322a7ee8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:21.190196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ed73ee4d-5410-46db-abff-c466e87282c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6689ff69254e4390bbc6f4a61d3d6a91', 'request_id': 'req-ed73ee4d-5410-46db-abff-c466e87282c8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:21.202846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ed73ee4d-5410-46db-abff-c466e87282c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6689ff69254e4390bbc6f4a61d3d6a91', 'request_id': 'req-ed73ee4d-5410-46db-abff-c466e87282c8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:21.218612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ed73ee4d-5410-46db-abff-c466e87282c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6689ff69254e4390bbc6f4a61d3d6a91', 'request_id': 'req-ed73ee4d-5410-46db-abff-c466e87282c8'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:21.246771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ed73ee4d-5410-46db-abff-c466e87282c8 admin admin] The token cache is being invalidate because project 6689ff69254e4390bbc6f4a61d3d6a91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:48:21.246771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ed73ee4d-5410-46db-abff-c466e87282c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:21.248507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ed73ee4d-5410-46db-abff-c466e87282c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:21.251251 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3932/7944] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:48:20 2022] DELETE /identity/v3/projects/6689ff69254e4390bbc6f4a61d3d6a91 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:21.254205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-47c1fcca-09ac-4d7c-94eb-33a322a7ee8c None None] MFA Rules not processed for user `e39efe367e5f4c65beff8ef7eb2a3862`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:21.257507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d303b-5407-4e7a-86d2-484d0aa0bea9 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:21.259795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-47c1fcca-09ac-4d7c-94eb-33a322a7ee8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:21.260172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d303b-5407-4e7a-86d2-484d0aa0bea9 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:21.261239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d303b-5407-4e7a-86d2-484d0aa0bea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:21.301003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9e2d303b-5407-4e7a-86d2-484d0aa0bea9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:21.302422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9e2d303b-5407-4e7a-86d2-484d0aa0bea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:21.427599 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4013/7945] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:48:21.439126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1fcca-09ac-4d7c-94eb-33a322a7ee8c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:21.441441 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-47c1fcca-09ac-4d7c-94eb-33a322a7ee8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:21.485843 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3933/7946] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:21.489700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839145c-66a0-49bc-9690-75df174e93b3 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:21.491165 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839145c-66a0-49bc-9690-75df174e93b3 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:21.492137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839145c-66a0-49bc-9690-75df174e93b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:21.562475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-4839145c-66a0-49bc-9690-75df174e93b3 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:21.562839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4839145c-66a0-49bc-9690-75df174e93b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:21.591698 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3934/7947] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:21.601929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839145c-66a0-49bc-9690-75df174e93b3 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:21.621817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839145c-66a0-49bc-9690-75df174e93b3 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:21.631049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1fcca-09ac-4d7c-94eb-33a322a7ee8c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:21.640653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0c73a-ad30-443d-af20-fb1cdd35cc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:21.641289 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0c73a-ad30-443d-af20-fb1cdd35cc72 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:21.642949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0c73a-ad30-443d-af20-fb1cdd35cc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:21.643249 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0c73a-ad30-443d-af20-fb1cdd35cc72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:21.643986 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0c73a-ad30-443d-af20-fb1cdd35cc72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:48:21.645744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446946b7-a248-42c2-9ed6-f4eba9e254da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:21.649617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0c73a-ad30-443d-af20-fb1cdd35cc72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:21.651826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0c73a-ad30-443d-af20-fb1cdd35cc72 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:21.652222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446946b7-a248-42c2-9ed6-f4eba9e254da service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:21.652634 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446946b7-a248-42c2-9ed6-f4eba9e254da service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:21.652909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446946b7-a248-42c2-9ed6-f4eba9e254da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:21.710643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446946b7-a248-42c2-9ed6-f4eba9e254da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:21.710643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446946b7-a248-42c2-9ed6-f4eba9e254da service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:21.728149 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3935/7948] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:48:21.728252 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4014/7949] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:48:21.732797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0c73a-ad30-443d-af20-fb1cdd35cc72 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:21.743464 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0c73a-ad30-443d-af20-fb1cdd35cc72 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:21.752034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd4345-313a-4d64-b237-9accee9d6ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:21.752859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd4345-313a-4d64-b237-9accee9d6ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:21.753131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd4345-313a-4d64-b237-9accee9d6ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:21.753579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd4345-313a-4d64-b237-9accee9d6ee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:21.754459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd4345-313a-4d64-b237-9accee9d6ee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:21.756526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd4345-313a-4d64-b237-9accee9d6ee8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:21.799582 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3936/7950] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:48:21 2022] POST /identity/v3/projects => generated 365 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:21.802562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446946b7-a248-42c2-9ed6-f4eba9e254da service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:21.842849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446946b7-a248-42c2-9ed6-f4eba9e254da service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:22.058564 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:22.091306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e809f00-3f45-4274-bf3f-82dec331e54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:22.092528 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e809f00-3f45-4274-bf3f-82dec331e54a admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:22.092528 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e809f00-3f45-4274-bf3f-82dec331e54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:22.092528 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e809f00-3f45-4274-bf3f-82dec331e54a admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:22.094142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e809f00-3f45-4274-bf3f-82dec331e54a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:22.101250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e809f00-3f45-4274-bf3f-82dec331e54a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:22.152888 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd4345-313a-4d64-b237-9accee9d6ee8 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:22.171514 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4015/7951] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:48:21 2022] POST /identity/v3/users => generated 283 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:22.175113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd4345-313a-4d64-b237-9accee9d6ee8 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:22.181337 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f806f-0460-4ac1-956b-72d1387dbd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:22.182069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f806f-0460-4ac1-956b-72d1387dbd97 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:22.182434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f806f-0460-4ac1-956b-72d1387dbd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:22.182765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f806f-0460-4ac1-956b-72d1387dbd97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:22.183524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f806f-0460-4ac1-956b-72d1387dbd97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:22.185911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f806f-0460-4ac1-956b-72d1387dbd97 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:22.234311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e809f00-3f45-4274-bf3f-82dec331e54a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:22.245190 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3937/7952] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:22.252333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e809f00-3f45-4274-bf3f-82dec331e54a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:22.273489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6115c1d-3979-4e23-b9f1-22476282ff02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:22.274141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6115c1d-3979-4e23-b9f1-22476282ff02 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:22.274415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6115c1d-3979-4e23-b9f1-22476282ff02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:22.274688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6115c1d-3979-4e23-b9f1-22476282ff02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:22.275645 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6115c1d-3979-4e23-b9f1-22476282ff02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:22.278677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6115c1d-3979-4e23-b9f1-22476282ff02 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:22.295963 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4016/7953] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:22.309006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f806f-0460-4ac1-956b-72d1387dbd97 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:22.321809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f806f-0460-4ac1-956b-72d1387dbd97 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:22.345480 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6675498f-0f05-482e-a346-4c323a5cbccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:22.346268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675498f-0f05-482e-a346-4c323a5cbccd admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:22.346548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675498f-0f05-482e-a346-4c323a5cbccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:22.346860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675498f-0f05-482e-a346-4c323a5cbccd admin admin] PATH_INFO: `/v3/projects/a9422253919a4530a5a379da9ccdad89/users/06314b3431dd459084828c4ee2e8c9d7/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:22.403844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6675498f-0f05-482e-a346-4c323a5cbccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9422253919a4530a5a379da9ccdad89, user_id=06314b3431dd459084828c4ee2e8c9d7, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:22.406161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6675498f-0f05-482e-a346-4c323a5cbccd admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:22.464693 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3938/7954] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:48:22 2022] PUT /identity/v3/projects/a9422253919a4530a5a379da9ccdad89/users/06314b3431dd459084828c4ee2e8c9d7/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:22.477256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6115c1d-3979-4e23-b9f1-22476282ff02 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:22.480254 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f6115c1d-3979-4e23-b9f1-22476282ff02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:22.482395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ec050-eb26-4d99-85cc-dc32c1f1a69b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:22.483109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ec050-eb26-4d99-85cc-dc32c1f1a69b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:22.486947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ec050-eb26-4d99-85cc-dc32c1f1a69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:22.506816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6115c1d-3979-4e23-b9f1-22476282ff02 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:22.641137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-843ec050-eb26-4d99-85cc-dc32c1f1a69b None None] MFA Rules not processed for user `06314b3431dd459084828c4ee2e8c9d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:22.648105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-843ec050-eb26-4d99-85cc-dc32c1f1a69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:22.660699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf4991-2e20-4849-b828-cce2e7cc89cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:22.661667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf4991-2e20-4849-b828-cce2e7cc89cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:22.661667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf4991-2e20-4849-b828-cce2e7cc89cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:22.662156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf4991-2e20-4849-b828-cce2e7cc89cc admin admin] PATH_INFO: `/v3/users/e39efe367e5f4c65beff8ef7eb2a3862` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:22.663131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf4991-2e20-4849-b828-cce2e7cc89cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e39efe367e5f4c65beff8ef7eb2a3862)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:22.665194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf4991-2e20-4849-b828-cce2e7cc89cc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:22.807106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-68bf4991-2e20-4849-b828-cce2e7cc89cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e39efe367e5f4c65beff8ef7eb2a3862'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:22.842887 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-68bf4991-2e20-4849-b828-cce2e7cc89cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e39efe367e5f4c65beff8ef7eb2a3862'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:22.891843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-68bf4991-2e20-4849-b828-cce2e7cc89cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e39efe367e5f4c65beff8ef7eb2a3862'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:22.894965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-68bf4991-2e20-4849-b828-cce2e7cc89cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e39efe367e5f4c65beff8ef7eb2a3862'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:22.899047 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:22.926595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-68bf4991-2e20-4849-b828-cce2e7cc89cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e39efe367e5f4c65beff8ef7eb2a3862'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:22.948861 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4017/7955] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:48:22 2022] DELETE /identity/v3/users/e39efe367e5f4c65beff8ef7eb2a3862 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:22.965095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3790220-15cd-4b9c-898e-c4cc86d5d12a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:22.965355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3790220-15cd-4b9c-898e-c4cc86d5d12a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:22.965640 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3790220-15cd-4b9c-898e-c4cc86d5d12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:23.038234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c3790220-15cd-4b9c-898e-c4cc86d5d12a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:23.039637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c3790220-15cd-4b9c-898e-c4cc86d5d12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:23.077176 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3939/7956] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 598 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:48:23.083172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ec050-eb26-4d99-85cc-dc32c1f1a69b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:23.089559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-843ec050-eb26-4d99-85cc-dc32c1f1a69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:23.136865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ec050-eb26-4d99-85cc-dc32c1f1a69b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:23.166478 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:23.256009 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4018/7957] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:23.274502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3790220-15cd-4b9c-898e-c4cc86d5d12a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:23.281048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c3790220-15cd-4b9c-898e-c4cc86d5d12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:23.390481 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156dc892-8a95-4b51-a5ab-8ecb29c2f844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:23.393127 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156dc892-8a95-4b51-a5ab-8ecb29c2f844 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:23.393430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156dc892-8a95-4b51-a5ab-8ecb29c2f844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:23.393721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156dc892-8a95-4b51-a5ab-8ecb29c2f844 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:23.394387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156dc892-8a95-4b51-a5ab-8ecb29c2f844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:23.396462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156dc892-8a95-4b51-a5ab-8ecb29c2f844 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:23.478266 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3940/7958] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:48:23 2022] POST /identity/v3/projects => generated 363 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:23.479835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156dc892-8a95-4b51-a5ab-8ecb29c2f844 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:23.523398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3790220-15cd-4b9c-898e-c4cc86d5d12a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:23.638917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156dc892-8a95-4b51-a5ab-8ecb29c2f844 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:23.640863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3ec29-828f-4cbe-b0d9-0c45fa23e548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:23.641735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3ec29-828f-4cbe-b0d9-0c45fa23e548 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:23.642183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3ec29-828f-4cbe-b0d9-0c45fa23e548 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:23.642601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3ec29-828f-4cbe-b0d9-0c45fa23e548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:23.654728 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3ec29-828f-4cbe-b0d9-0c45fa23e548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:23.656748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3ec29-828f-4cbe-b0d9-0c45fa23e548 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:23.667516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a6bc09-b81e-4c0b-93df-7749864a8e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:23.668609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6bc09-b81e-4c0b-93df-7749864a8e9a admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:23.669033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6bc09-b81e-4c0b-93df-7749864a8e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:23.669427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6bc09-b81e-4c0b-93df-7749864a8e9a admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:23.670615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a6bc09-b81e-4c0b-93df-7749864a8e9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:23.671444 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4019/7959] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:48:23.674328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a6bc09-b81e-4c0b-93df-7749864a8e9a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:23.733864 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3941/7960] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:48:23 2022] POST /identity/v3/users => generated 288 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:23.738526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3ec29-828f-4cbe-b0d9-0c45fa23e548 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:23.763767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3ec29-828f-4cbe-b0d9-0c45fa23e548 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:23.779434 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372820f-6ba7-4f65-8ab6-1c557228172c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:23.781623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372820f-6ba7-4f65-8ab6-1c557228172c admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:23.782278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372820f-6ba7-4f65-8ab6-1c557228172c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:23.783387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372820f-6ba7-4f65-8ab6-1c557228172c admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:23.784783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372820f-6ba7-4f65-8ab6-1c557228172c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:23.788398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372820f-6ba7-4f65-8ab6-1c557228172c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:23.827947 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4020/7961] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:23.836135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a6bc09-b81e-4c0b-93df-7749864a8e9a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:23.856489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a6bc09-b81e-4c0b-93df-7749864a8e9a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:23.864964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112f74b-ab29-4bee-982f-1c6f552f02cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:23.866189 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112f74b-ab29-4bee-982f-1c6f552f02cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:23.866647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112f74b-ab29-4bee-982f-1c6f552f02cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:23.867142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112f74b-ab29-4bee-982f-1c6f552f02cb admin admin] PATH_INFO: `/v3/projects/db1f3c78f3e94dbeaac4185828ae1815/users/9e2b2e1125574b64aff3de6dcd87559d/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:23.911605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112f74b-ab29-4bee-982f-1c6f552f02cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=db1f3c78f3e94dbeaac4185828ae1815, user_id=9e2b2e1125574b64aff3de6dcd87559d, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:23.911605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112f74b-ab29-4bee-982f-1c6f552f02cb admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:23.939727 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3942/7962] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:48:23 2022] PUT /identity/v3/projects/db1f3c78f3e94dbeaac4185828ae1815/users/9e2b2e1125574b64aff3de6dcd87559d/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:48:23.946147 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372820f-6ba7-4f65-8ab6-1c557228172c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:23.969308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372820f-6ba7-4f65-8ab6-1c557228172c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:24.175648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75dcb5-f0cd-4c7e-9bb6-b38ae7efbcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:24.178640 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75dcb5-f0cd-4c7e-9bb6-b38ae7efbcee admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:24.183114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75dcb5-f0cd-4c7e-9bb6-b38ae7efbcee admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:24.183563 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75dcb5-f0cd-4c7e-9bb6-b38ae7efbcee admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:24.187063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75dcb5-f0cd-4c7e-9bb6-b38ae7efbcee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:24.193976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75dcb5-f0cd-4c7e-9bb6-b38ae7efbcee admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:24.230156 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4021/7963] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:24.236026 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112f74b-ab29-4bee-982f-1c6f552f02cb admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:24.252535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112f74b-ab29-4bee-982f-1c6f552f02cb admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:24.288379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2be69b-42bd-44a8-a282-7e63a8998813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:24.289109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2be69b-42bd-44a8-a282-7e63a8998813 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:24.289389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2be69b-42bd-44a8-a282-7e63a8998813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:24.289661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2be69b-42bd-44a8-a282-7e63a8998813 admin admin] PATH_INFO: `/v3/projects/db1f3c78f3e94dbeaac4185828ae1815/users/9e2b2e1125574b64aff3de6dcd87559d/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:24.294148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2be69b-42bd-44a8-a282-7e63a8998813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db1f3c78f3e94dbeaac4185828ae1815, user_id=9e2b2e1125574b64aff3de6dcd87559d, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:24.297102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2be69b-42bd-44a8-a282-7e63a8998813 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:24.336992 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3943/7964] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:48:24 2022] PUT /identity/v3/projects/db1f3c78f3e94dbeaac4185828ae1815/users/9e2b2e1125574b64aff3de6dcd87559d/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:48:24.347743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602ba92-7577-49dc-92d7-5119e5908ca3 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:24.348334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602ba92-7577-49dc-92d7-5119e5908ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:24.348705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602ba92-7577-49dc-92d7-5119e5908ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:24.392518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2602ba92-7577-49dc-92d7-5119e5908ca3 None None] MFA Rules not processed for user `9e2b2e1125574b64aff3de6dcd87559d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:24.396173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2602ba92-7577-49dc-92d7-5119e5908ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:24.468414 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:24.563434 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4022/7965] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:24 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:48:24.564353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2be69b-42bd-44a8-a282-7e63a8998813 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:24.566396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2f2be69b-42bd-44a8-a282-7e63a8998813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:24.615836 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:24.627613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602ba92-7577-49dc-92d7-5119e5908ca3 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:24.629151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2602ba92-7577-49dc-92d7-5119e5908ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:24.764260 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2be69b-42bd-44a8-a282-7e63a8998813 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:24.772674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ecff0e-407a-4a8c-97ef-46df0829bbe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:24.773726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecff0e-407a-4a8c-97ef-46df0829bbe2 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:24.774223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecff0e-407a-4a8c-97ef-46df0829bbe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:24.774712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecff0e-407a-4a8c-97ef-46df0829bbe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:24.813735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ecff0e-407a-4a8c-97ef-46df0829bbe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:24.819549 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ecff0e-407a-4a8c-97ef-46df0829bbe2 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:24.855832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602ba92-7577-49dc-92d7-5119e5908ca3 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:24.865045 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3944/7966] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:24 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:48:24.867239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b2652-8c7d-4d39-b289-c4a397eb6234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:24.867818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b2652-8c7d-4d39-b289-c4a397eb6234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:24.868157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b2652-8c7d-4d39-b289-c4a397eb6234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:24.868427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b2652-8c7d-4d39-b289-c4a397eb6234 admin admin] PATH_INFO: `/v3/projects/7f4c65032bfe43d2bc5b417ca28c5057` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:24.871092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b2652-8c7d-4d39-b289-c4a397eb6234 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f4c65032bfe43d2bc5b417ca28c5057)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:24.873111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b2652-8c7d-4d39-b289-c4a397eb6234 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:25.036145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-068b2652-8c7d-4d39-b289-c4a397eb6234 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f4c65032bfe43d2bc5b417ca28c5057', 'request_id': 'req-068b2652-8c7d-4d39-b289-c4a397eb6234'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:25.056850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-068b2652-8c7d-4d39-b289-c4a397eb6234 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f4c65032bfe43d2bc5b417ca28c5057', 'request_id': 'req-068b2652-8c7d-4d39-b289-c4a397eb6234'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:25.065832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-068b2652-8c7d-4d39-b289-c4a397eb6234 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f4c65032bfe43d2bc5b417ca28c5057', 'request_id': 'req-068b2652-8c7d-4d39-b289-c4a397eb6234'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:25.133115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-068b2652-8c7d-4d39-b289-c4a397eb6234 admin admin] The token cache is being invalidate because project 7f4c65032bfe43d2bc5b417ca28c5057 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:48:25.137342 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-068b2652-8c7d-4d39-b289-c4a397eb6234 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:25.144221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-068b2652-8c7d-4d39-b289-c4a397eb6234 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:25.147153 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4023/7967] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:48:24 2022] DELETE /identity/v3/projects/7f4c65032bfe43d2bc5b417ca28c5057 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:48:25.153152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c6a70-d2b6-4411-aaf0-0754d7b590a1 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:25.153678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c6a70-d2b6-4411-aaf0-0754d7b590a1 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:25.154097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c6a70-d2b6-4411-aaf0-0754d7b590a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:25.212630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-191c6a70-d2b6-4411-aaf0-0754d7b590a1 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:25.216269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-191c6a70-d2b6-4411-aaf0-0754d7b590a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:25.234821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b2652-8c7d-4d39-b289-c4a397eb6234 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:25.236909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-068b2652-8c7d-4d39-b289-c4a397eb6234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:25.362548 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3945/7968] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:25.395978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee27256-930e-4c57-b905-74c75d9c0e2b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:25.395978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee27256-930e-4c57-b905-74c75d9c0e2b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:25.395978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee27256-930e-4c57-b905-74c75d9c0e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:25.477725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1ee27256-930e-4c57-b905-74c75d9c0e2b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:25.478966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1ee27256-930e-4c57-b905-74c75d9c0e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:25.499086 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3946/7969] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:25.503859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee27256-930e-4c57-b905-74c75d9c0e2b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:25.529760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee27256-930e-4c57-b905-74c75d9c0e2b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:25.541672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ec036-7fba-49c8-a6f9-832964a4e08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:25.542311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ec036-7fba-49c8-a6f9-832964a4e08e admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:25.542590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ec036-7fba-49c8-a6f9-832964a4e08e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:25.542864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ec036-7fba-49c8-a6f9-832964a4e08e admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:25.543540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ec036-7fba-49c8-a6f9-832964a4e08e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:48:25.543844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ec036-7fba-49c8-a6f9-832964a4e08e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:25.545552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ec036-7fba-49c8-a6f9-832964a4e08e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:25.567503 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:25.587986 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3947/7970] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:48:25.589529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ec036-7fba-49c8-a6f9-832964a4e08e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:25.634604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ec036-7fba-49c8-a6f9-832964a4e08e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:25.639755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b2652-8c7d-4d39-b289-c4a397eb6234 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:25.655182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce847e-4d24-43b6-a19d-f7276e8b78c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:25.655865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce847e-4d24-43b6-a19d-f7276e8b78c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:25.656095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce847e-4d24-43b6-a19d-f7276e8b78c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:25.656399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce847e-4d24-43b6-a19d-f7276e8b78c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:25.657902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce847e-4d24-43b6-a19d-f7276e8b78c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:25.658951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce847e-4d24-43b6-a19d-f7276e8b78c5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:25.660311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40fc9c-4bc4-4cee-840c-36bee8b95f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:25.661313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40fc9c-4bc4-4cee-840c-36bee8b95f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:25.662203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40fc9c-4bc4-4cee-840c-36bee8b95f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:25.662203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40fc9c-4bc4-4cee-840c-36bee8b95f53 admin admin] PATH_INFO: `/v3/users/8b98545e41b548678135b6cbb43d62ce` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:25.675569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40fc9c-4bc4-4cee-840c-36bee8b95f53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b98545e41b548678135b6cbb43d62ce)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:25.679172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40fc9c-4bc4-4cee-840c-36bee8b95f53 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:25.723402 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3948/7971] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:48:25 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:25.724501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce847e-4d24-43b6-a19d-f7276e8b78c5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:25.840760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ee40fc9c-4bc4-4cee-840c-36bee8b95f53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b98545e41b548678135b6cbb43d62ce'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:25.857348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ee40fc9c-4bc4-4cee-840c-36bee8b95f53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b98545e41b548678135b6cbb43d62ce'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:25.885668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce847e-4d24-43b6-a19d-f7276e8b78c5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:25.890678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ee40fc9c-4bc4-4cee-840c-36bee8b95f53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b98545e41b548678135b6cbb43d62ce'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:25.892763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ee40fc9c-4bc4-4cee-840c-36bee8b95f53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b98545e41b548678135b6cbb43d62ce'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:25.897779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82f1b7-8a45-4c1c-a521-390474489add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:25.898593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82f1b7-8a45-4c1c-a521-390474489add admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:25.900574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82f1b7-8a45-4c1c-a521-390474489add admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:25.900574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82f1b7-8a45-4c1c-a521-390474489add admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:25.902912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82f1b7-8a45-4c1c-a521-390474489add admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:25.906220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82f1b7-8a45-4c1c-a521-390474489add admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:25.914360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ee40fc9c-4bc4-4cee-840c-36bee8b95f53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b98545e41b548678135b6cbb43d62ce'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:25.927938 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4024/7972] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:48:25 2022] DELETE /identity/v3/users/8b98545e41b548678135b6cbb43d62ce => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:48:25.930793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953a2d1-e63c-4ff1-9e24-078712e00b5d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:25.931265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953a2d1-e63c-4ff1-9e24-078712e00b5d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:25.932025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953a2d1-e63c-4ff1-9e24-078712e00b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:25.957369 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3949/7973] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:48:25 2022] POST /identity/v3/users => generated 287 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:25.965233 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82f1b7-8a45-4c1c-a521-390474489add admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:25.971222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0c82f1b7-8a45-4c1c-a521-390474489add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:25.982532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3953a2d1-e63c-4ff1-9e24-078712e00b5d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:25.985378 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3953a2d1-e63c-4ff1-9e24-078712e00b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:25.992725 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:26.003515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82f1b7-8a45-4c1c-a521-390474489add admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:26.215485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b900c41-b696-4b3a-ab7a-cb7253812a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:26.216882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b900c41-b696-4b3a-ab7a-cb7253812a83 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:26.217415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b900c41-b696-4b3a-ab7a-cb7253812a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:26.217873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b900c41-b696-4b3a-ab7a-cb7253812a83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:26.218914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b900c41-b696-4b3a-ab7a-cb7253812a83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:26.222703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b900c41-b696-4b3a-ab7a-cb7253812a83 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:26.278761 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3950/7974] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:26.288975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b900c41-b696-4b3a-ab7a-cb7253812a83 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:26.325273 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4025/7975] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:26.334232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953a2d1-e63c-4ff1-9e24-078712e00b5d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:26.335737 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3953a2d1-e63c-4ff1-9e24-078712e00b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:26.362529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b900c41-b696-4b3a-ab7a-cb7253812a83 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:26.362786 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953a2d1-e63c-4ff1-9e24-078712e00b5d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:26.376878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de33c6-7b86-483b-b0c5-7c19fb5f29d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:26.378059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de33c6-7b86-483b-b0c5-7c19fb5f29d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:26.378531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de33c6-7b86-483b-b0c5-7c19fb5f29d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:26.378679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de33c6-7b86-483b-b0c5-7c19fb5f29d5 admin admin] PATH_INFO: `/v3/users/06314b3431dd459084828c4ee2e8c9d7` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:26.380523 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de33c6-7b86-483b-b0c5-7c19fb5f29d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06314b3431dd459084828c4ee2e8c9d7)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:26.382542 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de33c6-7b86-483b-b0c5-7c19fb5f29d5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:26.386639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85313b-3e43-427f-be1a-524920fff35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:26.387265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85313b-3e43-427f-be1a-524920fff35a admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:26.387559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85313b-3e43-427f-be1a-524920fff35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:26.387819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85313b-3e43-427f-be1a-524920fff35a admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:26.388500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c85313b-3e43-427f-be1a-524920fff35a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:26.394336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c85313b-3e43-427f-be1a-524920fff35a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:26.422141 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3951/7976] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:26.423950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85313b-3e43-427f-be1a-524920fff35a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:26.426217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8c85313b-3e43-427f-be1a-524920fff35a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:26.509818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d9de33c6-7b86-483b-b0c5-7c19fb5f29d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06314b3431dd459084828c4ee2e8c9d7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:26.525743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d9de33c6-7b86-483b-b0c5-7c19fb5f29d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06314b3431dd459084828c4ee2e8c9d7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:26.544184 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:26.557084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d9de33c6-7b86-483b-b0c5-7c19fb5f29d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06314b3431dd459084828c4ee2e8c9d7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:26.564060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d9de33c6-7b86-483b-b0c5-7c19fb5f29d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06314b3431dd459084828c4ee2e8c9d7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:26.602568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d9de33c6-7b86-483b-b0c5-7c19fb5f29d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06314b3431dd459084828c4ee2e8c9d7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:26.636700 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4026/7977] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:48:26 2022] DELETE /identity/v3/users/06314b3431dd459084828c4ee2e8c9d7 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:48:26.638752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de33c6-7b86-483b-b0c5-7c19fb5f29d5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:26.642253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d9de33c6-7b86-483b-b0c5-7c19fb5f29d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:26.688257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85313b-3e43-427f-be1a-524920fff35a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:26.829436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a75611-fa21-48e9-aefa-9711326d6be2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:26.830604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a75611-fa21-48e9-aefa-9711326d6be2 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:26.830986 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a75611-fa21-48e9-aefa-9711326d6be2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:26.831484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a75611-fa21-48e9-aefa-9711326d6be2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:26.835782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d4a75611-fa21-48e9-aefa-9711326d6be2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:26.927129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de33c6-7b86-483b-b0c5-7c19fb5f29d5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:26.938296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13c4ec-96d8-4ad0-885c-90198472d1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:26.938986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13c4ec-96d8-4ad0-885c-90198472d1b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:26.939267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13c4ec-96d8-4ad0-885c-90198472d1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:26.939539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13c4ec-96d8-4ad0-885c-90198472d1b2 admin admin] PATH_INFO: `/v3/projects/7eedd70c91ac400b94b27830550bbec0/users/82134d6077404bd186dcd7af1376a39e/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:26.970543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13c4ec-96d8-4ad0-885c-90198472d1b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eedd70c91ac400b94b27830550bbec0, user_id=82134d6077404bd186dcd7af1376a39e, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:26.973505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13c4ec-96d8-4ad0-885c-90198472d1b2 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:27.012314 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4027/7978] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:48:26 2022] PUT /identity/v3/projects/7eedd70c91ac400b94b27830550bbec0/users/82134d6077404bd186dcd7af1376a39e/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:27.012314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f74454-04a8-41a5-ab74-581b9e3f31e3 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:27.012314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f74454-04a8-41a5-ab74-581b9e3f31e3 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:27.012314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f74454-04a8-41a5-ab74-581b9e3f31e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:27.027038 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:27.050148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a75611-fa21-48e9-aefa-9711326d6be2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:27.053220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a75611-fa21-48e9-aefa-9711326d6be2 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:27.055539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e2f74454-04a8-41a5-ab74-581b9e3f31e3 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:27.056989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e2f74454-04a8-41a5-ab74-581b9e3f31e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:27.086133 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3952/7979] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:48:27.090425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fa92d-89f4-4931-84ed-7e728140c4bb None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:27.091612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fa92d-89f4-4931-84ed-7e728140c4bb None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:27.092193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fa92d-89f4-4931-84ed-7e728140c4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:27.214816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-358fa92d-89f4-4931-84ed-7e728140c4bb None None] MFA Rules not processed for user `82134d6077404bd186dcd7af1376a39e`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:27.217278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-358fa92d-89f4-4931-84ed-7e728140c4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:27.315258 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4028/7980] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:27.380569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f74454-04a8-41a5-ab74-581b9e3f31e3 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:27.383464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e2f74454-04a8-41a5-ab74-581b9e3f31e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:27.518651 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3953/7981] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:27.569878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fa92d-89f4-4931-84ed-7e728140c4bb None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:27.576668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-358fa92d-89f4-4931-84ed-7e728140c4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:27.601858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f74454-04a8-41a5-ab74-581b9e3f31e3 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:27.609048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290ef73-5cf8-40b3-8c2b-907a517835ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:27.616194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290ef73-5cf8-40b3-8c2b-907a517835ea service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:27.617129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290ef73-5cf8-40b3-8c2b-907a517835ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:27.617602 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290ef73-5cf8-40b3-8c2b-907a517835ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:27.631754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fa92d-89f4-4931-84ed-7e728140c4bb None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:27.636169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290ef73-5cf8-40b3-8c2b-907a517835ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:27.641302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290ef73-5cf8-40b3-8c2b-907a517835ea service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:27.651743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de98cb0-5937-4b18-a5b6-389bb7b78d22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:27.652856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de98cb0-5937-4b18-a5b6-389bb7b78d22 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:27.653337 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de98cb0-5937-4b18-a5b6-389bb7b78d22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:27.653818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de98cb0-5937-4b18-a5b6-389bb7b78d22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:27.658302 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4029/7982] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:48:27.690313 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de98cb0-5937-4b18-a5b6-389bb7b78d22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:27.693108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de98cb0-5937-4b18-a5b6-389bb7b78d22 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:27.722814 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3954/7983] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:48:28.026240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290ef73-5cf8-40b3-8c2b-907a517835ea service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:28.027870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d290ef73-5cf8-40b3-8c2b-907a517835ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:28.067762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290ef73-5cf8-40b3-8c2b-907a517835ea service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:28.075467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b63090-2ea1-4967-a2a7-134208ae6f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:28.076560 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b63090-2ea1-4967-a2a7-134208ae6f4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:28.077076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b63090-2ea1-4967-a2a7-134208ae6f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:28.077651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b63090-2ea1-4967-a2a7-134208ae6f4e admin admin] PATH_INFO: `/v3/projects/934fedcb868e42cfa3c518eaae92b81f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:28.091307 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b63090-2ea1-4967-a2a7-134208ae6f4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=934fedcb868e42cfa3c518eaae92b81f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:28.094842 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b63090-2ea1-4967-a2a7-134208ae6f4e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:28.112621 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:28.259532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f4b63090-2ea1-4967-a2a7-134208ae6f4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '934fedcb868e42cfa3c518eaae92b81f', 'request_id': 'req-f4b63090-2ea1-4967-a2a7-134208ae6f4e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:28.271821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f4b63090-2ea1-4967-a2a7-134208ae6f4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '934fedcb868e42cfa3c518eaae92b81f', 'request_id': 'req-f4b63090-2ea1-4967-a2a7-134208ae6f4e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:28.288753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f4b63090-2ea1-4967-a2a7-134208ae6f4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '934fedcb868e42cfa3c518eaae92b81f', 'request_id': 'req-f4b63090-2ea1-4967-a2a7-134208ae6f4e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:28.322554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f4b63090-2ea1-4967-a2a7-134208ae6f4e admin admin] The token cache is being invalidate because project 934fedcb868e42cfa3c518eaae92b81f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:48:28.324200 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f4b63090-2ea1-4967-a2a7-134208ae6f4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:28.327061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f4b63090-2ea1-4967-a2a7-134208ae6f4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:28.332225 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4030/7984] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:48:28 2022] DELETE /identity/v3/projects/934fedcb868e42cfa3c518eaae92b81f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:28.336832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de98cb0-5937-4b18-a5b6-389bb7b78d22 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:28.354162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de98cb0-5937-4b18-a5b6-389bb7b78d22 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:28.543704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbbcdf-a119-4c85-a19c-3e5564089fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:28.546726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbbcdf-a119-4c85-a19c-3e5564089fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:28.547065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbbcdf-a119-4c85-a19c-3e5564089fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:28.547353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbbcdf-a119-4c85-a19c-3e5564089fd0 admin admin] PATH_INFO: `/v3/users/537f5984edef487db18cd55632cc5016` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:28.554150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dbbcdf-a119-4c85-a19c-3e5564089fd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=537f5984edef487db18cd55632cc5016)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:28.560275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dbbcdf-a119-4c85-a19c-3e5564089fd0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:28.580491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b63090-2ea1-4967-a2a7-134208ae6f4e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:28.582230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f4b63090-2ea1-4967-a2a7-134208ae6f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:28.612819 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b63090-2ea1-4967-a2a7-134208ae6f4e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:28.628731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa59cfe-e1fe-47b3-9510-9cdd4f5dd2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:28.629864 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa59cfe-e1fe-47b3-9510-9cdd4f5dd2f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:28.630287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa59cfe-e1fe-47b3-9510-9cdd4f5dd2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:28.630691 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa59cfe-e1fe-47b3-9510-9cdd4f5dd2f3 admin admin] PATH_INFO: `/v3/projects/a9422253919a4530a5a379da9ccdad89` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:28.632518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa59cfe-e1fe-47b3-9510-9cdd4f5dd2f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9422253919a4530a5a379da9ccdad89)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:28.635914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa59cfe-e1fe-47b3-9510-9cdd4f5dd2f3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:28.700430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f9dbbcdf-a119-4c85-a19c-3e5564089fd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '537f5984edef487db18cd55632cc5016'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:28.711120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f9dbbcdf-a119-4c85-a19c-3e5564089fd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '537f5984edef487db18cd55632cc5016'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:28.752210 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:28.770612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f9dbbcdf-a119-4c85-a19c-3e5564089fd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '537f5984edef487db18cd55632cc5016'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:28.773582 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f9dbbcdf-a119-4c85-a19c-3e5564089fd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '537f5984edef487db18cd55632cc5016'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:28.797198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-afa59cfe-e1fe-47b3-9510-9cdd4f5dd2f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9422253919a4530a5a379da9ccdad89', 'request_id': 'req-afa59cfe-e1fe-47b3-9510-9cdd4f5dd2f3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:28.808153 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f9dbbcdf-a119-4c85-a19c-3e5564089fd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '537f5984edef487db18cd55632cc5016'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:28.813979 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-afa59cfe-e1fe-47b3-9510-9cdd4f5dd2f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9422253919a4530a5a379da9ccdad89', 'request_id': 'req-afa59cfe-e1fe-47b3-9510-9cdd4f5dd2f3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:28.825903 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3955/7985] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:48:28 2022] DELETE /identity/v3/users/537f5984edef487db18cd55632cc5016 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:48:28.835673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-afa59cfe-e1fe-47b3-9510-9cdd4f5dd2f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9422253919a4530a5a379da9ccdad89', 'request_id': 'req-afa59cfe-e1fe-47b3-9510-9cdd4f5dd2f3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:28.879516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-afa59cfe-e1fe-47b3-9510-9cdd4f5dd2f3 admin admin] The token cache is being invalidate because project a9422253919a4530a5a379da9ccdad89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:48:28.880033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-afa59cfe-e1fe-47b3-9510-9cdd4f5dd2f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:28.883457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-afa59cfe-e1fe-47b3-9510-9cdd4f5dd2f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:28.886501 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4031/7986] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:48:28 2022] DELETE /identity/v3/projects/a9422253919a4530a5a379da9ccdad89 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:48:28.892612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbbcdf-a119-4c85-a19c-3e5564089fd0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:28.894867 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f9dbbcdf-a119-4c85-a19c-3e5564089fd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:28.958151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa59cfe-e1fe-47b3-9510-9cdd4f5dd2f3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:28.960950 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-afa59cfe-e1fe-47b3-9510-9cdd4f5dd2f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:29.154208 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbbcdf-a119-4c85-a19c-3e5564089fd0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:29.179250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992b4bf-4022-4815-abd1-b0cebb9064ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:29.179955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992b4bf-4022-4815-abd1-b0cebb9064ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:29.180238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992b4bf-4022-4815-abd1-b0cebb9064ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:29.180508 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992b4bf-4022-4815-abd1-b0cebb9064ea admin admin] PATH_INFO: `/v3/users/9e2b2e1125574b64aff3de6dcd87559d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:29.187830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4992b4bf-4022-4815-abd1-b0cebb9064ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e2b2e1125574b64aff3de6dcd87559d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:29.194588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4992b4bf-4022-4815-abd1-b0cebb9064ea admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:29.204659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa59cfe-e1fe-47b3-9510-9cdd4f5dd2f3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:29.216590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1f2ec-ff25-4427-9523-ee28561d3259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:29.218040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1f2ec-ff25-4427-9523-ee28561d3259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:29.218761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1f2ec-ff25-4427-9523-ee28561d3259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:29.219344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1f2ec-ff25-4427-9523-ee28561d3259 admin admin] PATH_INFO: `/v3/users/82134d6077404bd186dcd7af1376a39e` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:29.221475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1f2ec-ff25-4427-9523-ee28561d3259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82134d6077404bd186dcd7af1376a39e)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:29.228260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d1f2ec-ff25-4427-9523-ee28561d3259 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:29.289984 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:29.337559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4992b4bf-4022-4815-abd1-b0cebb9064ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e2b2e1125574b64aff3de6dcd87559d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:29.407600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4992b4bf-4022-4815-abd1-b0cebb9064ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e2b2e1125574b64aff3de6dcd87559d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:29.426731 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4992b4bf-4022-4815-abd1-b0cebb9064ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e2b2e1125574b64aff3de6dcd87559d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:29.427449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4992b4bf-4022-4815-abd1-b0cebb9064ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e2b2e1125574b64aff3de6dcd87559d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:29.435429 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-86d1f2ec-ff25-4427-9523-ee28561d3259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82134d6077404bd186dcd7af1376a39e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:29.441445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4992b4bf-4022-4815-abd1-b0cebb9064ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e2b2e1125574b64aff3de6dcd87559d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:29.465110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-86d1f2ec-ff25-4427-9523-ee28561d3259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82134d6077404bd186dcd7af1376a39e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:29.472394 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3956/7987] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:48:28 2022] DELETE /identity/v3/users/9e2b2e1125574b64aff3de6dcd87559d => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:29.497132 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-86d1f2ec-ff25-4427-9523-ee28561d3259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82134d6077404bd186dcd7af1376a39e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:29.499233 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-86d1f2ec-ff25-4427-9523-ee28561d3259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82134d6077404bd186dcd7af1376a39e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:29.516437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-86d1f2ec-ff25-4427-9523-ee28561d3259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82134d6077404bd186dcd7af1376a39e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:29.558261 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4032/7988] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:48:28 2022] DELETE /identity/v3/users/82134d6077404bd186dcd7af1376a39e => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:48:29.561144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798f197-a9ea-4878-a7c6-81e6ea6812e3 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:29.561594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798f197-a9ea-4878-a7c6-81e6ea6812e3 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:29.562090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798f197-a9ea-4878-a7c6-81e6ea6812e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:29.616867 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9798f197-a9ea-4878-a7c6-81e6ea6812e3 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:29.619200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9798f197-a9ea-4878-a7c6-81e6ea6812e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:29.786709 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3957/7989] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:29.814071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1f2ec-ff25-4427-9523-ee28561d3259 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:29.817709 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-86d1f2ec-ff25-4427-9523-ee28561d3259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:29.953125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798f197-a9ea-4878-a7c6-81e6ea6812e3 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:29.955120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9798f197-a9ea-4878-a7c6-81e6ea6812e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:29.997137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798f197-a9ea-4878-a7c6-81e6ea6812e3 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:30.008884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88daea67-429e-4f6f-84c6-79127bb93f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:30.009608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daea67-429e-4f6f-84c6-79127bb93f78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:30.009934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daea67-429e-4f6f-84c6-79127bb93f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:30.010916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daea67-429e-4f6f-84c6-79127bb93f78 admin admin] PATH_INFO: `/v3/projects/ccbda121f13c4cc88c32e439bb9a6c49` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:30.026257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88daea67-429e-4f6f-84c6-79127bb93f78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccbda121f13c4cc88c32e439bb9a6c49)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:30.028315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88daea67-429e-4f6f-84c6-79127bb93f78 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:30.038074 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:30.143057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1f2ec-ff25-4427-9523-ee28561d3259 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:30.179196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-88daea67-429e-4f6f-84c6-79127bb93f78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccbda121f13c4cc88c32e439bb9a6c49', 'request_id': 'req-88daea67-429e-4f6f-84c6-79127bb93f78'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:30.200185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-88daea67-429e-4f6f-84c6-79127bb93f78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccbda121f13c4cc88c32e439bb9a6c49', 'request_id': 'req-88daea67-429e-4f6f-84c6-79127bb93f78'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:30.257849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-88daea67-429e-4f6f-84c6-79127bb93f78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccbda121f13c4cc88c32e439bb9a6c49', 'request_id': 'req-88daea67-429e-4f6f-84c6-79127bb93f78'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:30.313282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-88daea67-429e-4f6f-84c6-79127bb93f78 admin admin] The token cache is being invalidate because project ccbda121f13c4cc88c32e439bb9a6c49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:48:30.313791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-88daea67-429e-4f6f-84c6-79127bb93f78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:30.315047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-88daea67-429e-4f6f-84c6-79127bb93f78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:30.320975 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3958/7990] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:48:29 2022] DELETE /identity/v3/projects/ccbda121f13c4cc88c32e439bb9a6c49 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:30.323138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154673d-56f3-4304-bc75-316ed442affe None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:30.323323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154673d-56f3-4304-bc75-316ed442affe None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:30.323671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154673d-56f3-4304-bc75-316ed442affe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:30.350264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e154673d-56f3-4304-bc75-316ed442affe None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:30.350540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e154673d-56f3-4304-bc75-316ed442affe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:30.391431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1713b9f-c810-4c43-a97c-e05aac19ba7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:30.392823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1713b9f-c810-4c43-a97c-e05aac19ba7e service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:30.393227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1713b9f-c810-4c43-a97c-e05aac19ba7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:30.394568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1713b9f-c810-4c43-a97c-e05aac19ba7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:30.404878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f1713b9f-c810-4c43-a97c-e05aac19ba7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:30.473410 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3959/7991] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:30.477288 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154673d-56f3-4304-bc75-316ed442affe None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:30.480699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e154673d-56f3-4304-bc75-316ed442affe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:30.607745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154673d-56f3-4304-bc75-316ed442affe None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:30.627087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1713b9f-c810-4c43-a97c-e05aac19ba7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:30.630224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1713b9f-c810-4c43-a97c-e05aac19ba7e service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:30.630917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eed369-9421-4238-a1ea-5482ab3a95c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:30.634441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eed369-9421-4238-a1ea-5482ab3a95c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:30.634738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eed369-9421-4238-a1ea-5482ab3a95c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:30.635016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eed369-9421-4238-a1ea-5482ab3a95c4 admin admin] PATH_INFO: `/v3/projects/db1f3c78f3e94dbeaac4185828ae1815` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:30.651751 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:30.652244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eed369-9421-4238-a1ea-5482ab3a95c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db1f3c78f3e94dbeaac4185828ae1815)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:30.671590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eed369-9421-4238-a1ea-5482ab3a95c4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:30.745447 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4033/7992] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 934 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:48:30.756704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49258c-dd0c-4fc0-9826-c34abce8fa26 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:30.758056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49258c-dd0c-4fc0-9826-c34abce8fa26 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:30.758529 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49258c-dd0c-4fc0-9826-c34abce8fa26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:30.833269 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5e49258c-dd0c-4fc0-9826-c34abce8fa26 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:30.845878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5e49258c-dd0c-4fc0-9826-c34abce8fa26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:30.853926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-86eed369-9421-4238-a1ea-5482ab3a95c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db1f3c78f3e94dbeaac4185828ae1815', 'request_id': 'req-86eed369-9421-4238-a1ea-5482ab3a95c4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:30.918611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-86eed369-9421-4238-a1ea-5482ab3a95c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db1f3c78f3e94dbeaac4185828ae1815', 'request_id': 'req-86eed369-9421-4238-a1ea-5482ab3a95c4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:30.950955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-86eed369-9421-4238-a1ea-5482ab3a95c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db1f3c78f3e94dbeaac4185828ae1815', 'request_id': 'req-86eed369-9421-4238-a1ea-5482ab3a95c4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:30.997070 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-86eed369-9421-4238-a1ea-5482ab3a95c4 admin admin] The token cache is being invalidate because project db1f3c78f3e94dbeaac4185828ae1815 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:48:31.000989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-86eed369-9421-4238-a1ea-5482ab3a95c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:31.003770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-86eed369-9421-4238-a1ea-5482ab3a95c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:31.011515 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3960/7993] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:48:30 2022] DELETE /identity/v3/projects/db1f3c78f3e94dbeaac4185828ae1815 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:31.018274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea707b-ca8f-4279-8f56-5ece38497097 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:31.027072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea707b-ca8f-4279-8f56-5ece38497097 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:31.027072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea707b-ca8f-4279-8f56-5ece38497097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:31.058785 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4034/7994] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:31.063694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49258c-dd0c-4fc0-9826-c34abce8fa26 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:31.082849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49258c-dd0c-4fc0-9826-c34abce8fa26 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:31.093351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0aea707b-ca8f-4279-8f56-5ece38497097 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:31.094583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0aea707b-ca8f-4279-8f56-5ece38497097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:31.101127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de551edd-4aa0-4511-b0ea-862c9056b8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:31.102501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de551edd-4aa0-4511-b0ea-862c9056b8df admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:31.102940 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de551edd-4aa0-4511-b0ea-862c9056b8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:31.103361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de551edd-4aa0-4511-b0ea-862c9056b8df admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:31.108013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de551edd-4aa0-4511-b0ea-862c9056b8df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:48:31.108760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de551edd-4aa0-4511-b0ea-862c9056b8df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:31.110636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de551edd-4aa0-4511-b0ea-862c9056b8df admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:31.117961 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3961/7995] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:31.139957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ef2ab-8491-4890-8f09-6c6993dea224 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:31.140227 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ef2ab-8491-4890-8f09-6c6993dea224 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:31.140509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ef2ab-8491-4890-8f09-6c6993dea224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:31.161720 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4035/7996] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:48:31.163400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de551edd-4aa0-4511-b0ea-862c9056b8df admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:31.176280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-088ef2ab-8491-4890-8f09-6c6993dea224 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:31.177561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-088ef2ab-8491-4890-8f09-6c6993dea224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:31.184113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de551edd-4aa0-4511-b0ea-862c9056b8df admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:31.193502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e5bc0-46f9-48c8-992b-a672c9dcdc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:31.195070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e5bc0-46f9-48c8-992b-a672c9dcdc87 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:31.195980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e5bc0-46f9-48c8-992b-a672c9dcdc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:31.196763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e5bc0-46f9-48c8-992b-a672c9dcdc87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:31.198623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e5bc0-46f9-48c8-992b-a672c9dcdc87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:31.202325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e5bc0-46f9-48c8-992b-a672c9dcdc87 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:31.204512 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3962/7997] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:31.210454 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ef2ab-8491-4890-8f09-6c6993dea224 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:31.215963 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:31.235634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ef2ab-8491-4890-8f09-6c6993dea224 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:31.254041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546e605-a654-448b-acb2-512e9e8d542a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:31.256310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546e605-a654-448b-acb2-512e9e8d542a admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:31.256762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546e605-a654-448b-acb2-512e9e8d542a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:31.257013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546e605-a654-448b-acb2-512e9e8d542a admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:31.258011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546e605-a654-448b-acb2-512e9e8d542a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:48:31.258326 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546e605-a654-448b-acb2-512e9e8d542a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:31.260793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546e605-a654-448b-acb2-512e9e8d542a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:31.297765 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3963/7998] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:48:31.313786 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4036/7999] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:48:31 2022] POST /identity/v3/projects => generated 367 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:31.317576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546e605-a654-448b-acb2-512e9e8d542a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:31.323280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e5bc0-46f9-48c8-992b-a672c9dcdc87 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:31.382256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546e605-a654-448b-acb2-512e9e8d542a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:31.531603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e5bc0-46f9-48c8-992b-a672c9dcdc87 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:31.548772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21846ee1-64bc-4e85-a1b5-d4c4c2e8d88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:31.549371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21846ee1-64bc-4e85-a1b5-d4c4c2e8d88c admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:31.550773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21846ee1-64bc-4e85-a1b5-d4c4c2e8d88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:31.551081 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21846ee1-64bc-4e85-a1b5-d4c4c2e8d88c admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:31.551763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21846ee1-64bc-4e85-a1b5-d4c4c2e8d88c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:31.553239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50397333-9fee-4273-b895-7d1719803561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:31.553747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50397333-9fee-4273-b895-7d1719803561 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:31.554029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50397333-9fee-4273-b895-7d1719803561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:31.555166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50397333-9fee-4273-b895-7d1719803561 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:31.555166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50397333-9fee-4273-b895-7d1719803561 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:31.558750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21846ee1-64bc-4e85-a1b5-d4c4c2e8d88c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:31.568655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50397333-9fee-4273-b895-7d1719803561 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:31.633738 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4037/8000] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:48:31 2022] POST /identity/v3/users => generated 284 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:48:31.641999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21846ee1-64bc-4e85-a1b5-d4c4c2e8d88c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:31.642983 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3964/8001] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:48:31 2022] POST /identity/v3/projects => generated 387 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:31.649598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50397333-9fee-4273-b895-7d1719803561 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:31.665118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21846ee1-64bc-4e85-a1b5-d4c4c2e8d88c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:31.803043 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:31.824487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f45584-2814-40cd-9fd1-2d1ef92e680e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:31.825737 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f45584-2814-40cd-9fd1-2d1ef92e680e admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:31.826354 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f45584-2814-40cd-9fd1-2d1ef92e680e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:31.827006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f45584-2814-40cd-9fd1-2d1ef92e680e admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:31.828580 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f45584-2814-40cd-9fd1-2d1ef92e680e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:31.836963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f45584-2814-40cd-9fd1-2d1ef92e680e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:31.870951 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4038/8002] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:31.874899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f45584-2814-40cd-9fd1-2d1ef92e680e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:31.889742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f45584-2814-40cd-9fd1-2d1ef92e680e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:31.918669 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9d731-807c-471c-b885-779ac8e17a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:31.919608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9d731-807c-471c-b885-779ac8e17a75 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:31.920120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9d731-807c-471c-b885-779ac8e17a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:31.920596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9d731-807c-471c-b885-779ac8e17a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:31.921566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9d731-807c-471c-b885-779ac8e17a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:31.923683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9d731-807c-471c-b885-779ac8e17a75 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:31.960406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50397333-9fee-4273-b895-7d1719803561 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:31.996423 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4039/8003] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:31.999919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9d731-807c-471c-b885-779ac8e17a75 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:32.008446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b0a9d731-807c-471c-b885-779ac8e17a75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:32.013351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44033e71-e854-47cb-a71f-4f02b4055ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:32.020334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44033e71-e854-47cb-a71f-4f02b4055ee2 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:32.020334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44033e71-e854-47cb-a71f-4f02b4055ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:32.020334 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44033e71-e854-47cb-a71f-4f02b4055ee2 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:32.024173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44033e71-e854-47cb-a71f-4f02b4055ee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:32.034420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44033e71-e854-47cb-a71f-4f02b4055ee2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:32.105157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9d731-807c-471c-b885-779ac8e17a75 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:32.122218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ab708-826d-459b-899c-ac84c87680f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:32.125647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ab708-826d-459b-899c-ac84c87680f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:32.125919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ab708-826d-459b-899c-ac84c87680f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:32.126726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ab708-826d-459b-899c-ac84c87680f3 admin admin] PATH_INFO: `/v3/projects/7eedd70c91ac400b94b27830550bbec0` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:32.128309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ab708-826d-459b-899c-ac84c87680f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eedd70c91ac400b94b27830550bbec0)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:32.130472 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ab708-826d-459b-899c-ac84c87680f3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:32.144027 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3965/8004] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:48:31 2022] POST /identity/v3/users => generated 294 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:48:32.145056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44033e71-e854-47cb-a71f-4f02b4055ee2 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:32.173272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44033e71-e854-47cb-a71f-4f02b4055ee2 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:32.189791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec46f2-9e61-4068-9f5a-eeebe3069091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:32.190575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec46f2-9e61-4068-9f5a-eeebe3069091 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:32.190925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec46f2-9e61-4068-9f5a-eeebe3069091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:32.191267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec46f2-9e61-4068-9f5a-eeebe3069091 admin admin] PATH_INFO: `/v3/projects/4177856828e04964be60a88b92add369/users/14308613961a4ea7a5b95357a526366b/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:32.236542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec46f2-9e61-4068-9f5a-eeebe3069091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4177856828e04964be60a88b92add369, user_id=14308613961a4ea7a5b95357a526366b, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:32.239466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec46f2-9e61-4068-9f5a-eeebe3069091 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:32.246334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-665ab708-826d-459b-899c-ac84c87680f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eedd70c91ac400b94b27830550bbec0', 'request_id': 'req-665ab708-826d-459b-899c-ac84c87680f3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:32.259839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-665ab708-826d-459b-899c-ac84c87680f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eedd70c91ac400b94b27830550bbec0', 'request_id': 'req-665ab708-826d-459b-899c-ac84c87680f3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:32.276545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-665ab708-826d-459b-899c-ac84c87680f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eedd70c91ac400b94b27830550bbec0', 'request_id': 'req-665ab708-826d-459b-899c-ac84c87680f3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:32.288804 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3966/8005] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:48:32 2022] PUT /identity/v3/projects/4177856828e04964be60a88b92add369/users/14308613961a4ea7a5b95357a526366b/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:32.291837 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec46f2-9e61-4068-9f5a-eeebe3069091 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:32.314003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-665ab708-826d-459b-899c-ac84c87680f3 admin admin] The token cache is being invalidate because project 7eedd70c91ac400b94b27830550bbec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:48:32.314509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-665ab708-826d-459b-899c-ac84c87680f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:32.315355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-665ab708-826d-459b-899c-ac84c87680f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:32.317574 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4040/8006] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:48:31 2022] DELETE /identity/v3/projects/7eedd70c91ac400b94b27830550bbec0 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:32.319073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31338eca-c7a0-4d38-ac25-aa506c915bcb None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:32.319423 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31338eca-c7a0-4d38-ac25-aa506c915bcb None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:32.319756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31338eca-c7a0-4d38-ac25-aa506c915bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:32.364130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-31338eca-c7a0-4d38-ac25-aa506c915bcb None None] MFA Rules not processed for user `14308613961a4ea7a5b95357a526366b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:32.365996 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-31338eca-c7a0-4d38-ac25-aa506c915bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:32.449073 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:32.571557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec46f2-9e61-4068-9f5a-eeebe3069091 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:32.574499 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4041/8007] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:32.576912 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d1315-a3e4-49ae-ad0a-1f5647700509 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:32.578036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d1315-a3e4-49ae-ad0a-1f5647700509 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:32.578924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d1315-a3e4-49ae-ad0a-1f5647700509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:32.588674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27c8f6-8a2f-4a57-ade4-43d0435c8c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:32.589737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27c8f6-8a2f-4a57-ade4-43d0435c8c10 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:32.590662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27c8f6-8a2f-4a57-ade4-43d0435c8c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:32.591064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27c8f6-8a2f-4a57-ade4-43d0435c8c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:32.592516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27c8f6-8a2f-4a57-ade4-43d0435c8c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:32.595551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27c8f6-8a2f-4a57-ade4-43d0435c8c10 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:32.632635 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3967/8008] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:32.634946 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27c8f6-8a2f-4a57-ade4-43d0435c8c10 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:32.637749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ff27c8f6-8a2f-4a57-ade4-43d0435c8c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:32.645123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9b4d1315-a3e4-49ae-ad0a-1f5647700509 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:32.647065 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9b4d1315-a3e4-49ae-ad0a-1f5647700509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:32.656020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27c8f6-8a2f-4a57-ade4-43d0435c8c10 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:32.669524 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4042/8009] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:32.671271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d1315-a3e4-49ae-ad0a-1f5647700509 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:32.672836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9b4d1315-a3e4-49ae-ad0a-1f5647700509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:32.688615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d1315-a3e4-49ae-ad0a-1f5647700509 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:32.690964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dccc2f-6367-4bca-9dc5-b6b43f777c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:32.692802 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dccc2f-6367-4bca-9dc5-b6b43f777c4b admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:32.693475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dccc2f-6367-4bca-9dc5-b6b43f777c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:32.693992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dccc2f-6367-4bca-9dc5-b6b43f777c4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:32.695217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d16e4-71fc-4b83-b4d9-2e8c1a021213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:32.696040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d16e4-71fc-4b83-b4d9-2e8c1a021213 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:32.696516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d16e4-71fc-4b83-b4d9-2e8c1a021213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:32.696726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d16e4-71fc-4b83-b4d9-2e8c1a021213 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:32.697819 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d16e4-71fc-4b83-b4d9-2e8c1a021213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:32.698093 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dccc2f-6367-4bca-9dc5-b6b43f777c4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:32.700610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dccc2f-6367-4bca-9dc5-b6b43f777c4b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:32.700870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d16e4-71fc-4b83-b4d9-2e8c1a021213 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:32.717878 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4043/8010] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:32.719950 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc834b33-157f-4552-b59b-bbf2ea5ae839 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:32.720562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc834b33-157f-4552-b59b-bbf2ea5ae839 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:32.720947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc834b33-157f-4552-b59b-bbf2ea5ae839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:32.774090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-dc834b33-157f-4552-b59b-bbf2ea5ae839 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:32.806372 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3968/8011] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:48:32 2022] POST /identity/v3/projects => generated 367 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:32.808603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dc834b33-157f-4552-b59b-bbf2ea5ae839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:32.809083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dccc2f-6367-4bca-9dc5-b6b43f777c4b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:32.950770 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:33.170014 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4044/8012] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:33.174505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dccc2f-6367-4bca-9dc5-b6b43f777c4b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:33.175721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc834b33-157f-4552-b59b-bbf2ea5ae839 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:33.196422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3aea0-e9f3-4bab-9d8e-75cd075d9278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:33.204494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3aea0-e9f3-4bab-9d8e-75cd075d9278 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:33.205151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3aea0-e9f3-4bab-9d8e-75cd075d9278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:33.205887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3aea0-e9f3-4bab-9d8e-75cd075d9278 admin admin] PATH_INFO: `/v3/projects/ae53c6d9dde64945bad57a0acd3e9cb9/users/74bda0e5e2af438abdb4481542eee23d/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:33.207763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc834b33-157f-4552-b59b-bbf2ea5ae839 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:33.254703 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5ae78-aba9-40fe-8679-91313d621411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:33.257015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5ae78-aba9-40fe-8679-91313d621411 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:33.257458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5ae78-aba9-40fe-8679-91313d621411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:33.261596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5ae78-aba9-40fe-8679-91313d621411 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:33.262840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5ae78-aba9-40fe-8679-91313d621411 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:33.268115 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3aea0-e9f3-4bab-9d8e-75cd075d9278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae53c6d9dde64945bad57a0acd3e9cb9, user_id=74bda0e5e2af438abdb4481542eee23d, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:33.273418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b3aea0-e9f3-4bab-9d8e-75cd075d9278 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:33.283870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5ae78-aba9-40fe-8679-91313d621411 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:33.320756 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3969/8013] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:48:32 2022] PUT /identity/v3/projects/ae53c6d9dde64945bad57a0acd3e9cb9/users/74bda0e5e2af438abdb4481542eee23d/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:33.324141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3aea0-e9f3-4bab-9d8e-75cd075d9278 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:33.370879 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4045/8014] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:48:33 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:33.372523 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de5d72-5323-4572-b9f2-26abacced1c8 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:33.372987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de5d72-5323-4572-b9f2-26abacced1c8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:33.383070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de5d72-5323-4572-b9f2-26abacced1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:33.492886 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c1de5d72-5323-4572-b9f2-26abacced1c8 None None] MFA Rules not processed for user `74bda0e5e2af438abdb4481542eee23d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:33.495718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c1de5d72-5323-4572-b9f2-26abacced1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:33.525995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3aea0-e9f3-4bab-9d8e-75cd075d9278 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:33.535435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faabe6e4-fc6c-42e7-9a50-1c23257162d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:33.536116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabe6e4-fc6c-42e7-9a50-1c23257162d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:33.536724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabe6e4-fc6c-42e7-9a50-1c23257162d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:33.537096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faabe6e4-fc6c-42e7-9a50-1c23257162d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:33.537861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faabe6e4-fc6c-42e7-9a50-1c23257162d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:48:33.538175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faabe6e4-fc6c-42e7-9a50-1c23257162d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:33.542386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faabe6e4-fc6c-42e7-9a50-1c23257162d5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:33.589681 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3970/8015] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:48:33.591405 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faabe6e4-fc6c-42e7-9a50-1c23257162d5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:33.626685 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faabe6e4-fc6c-42e7-9a50-1c23257162d5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:33.633953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdff864-e2fa-40e4-974f-611eb08edaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:33.634658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdff864-e2fa-40e4-974f-611eb08edaa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:33.635055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdff864-e2fa-40e4-974f-611eb08edaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:33.635874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdff864-e2fa-40e4-974f-611eb08edaa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:33.636760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdff864-e2fa-40e4-974f-611eb08edaa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:33.638645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdff864-e2fa-40e4-974f-611eb08edaa0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:33.653195 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3971/8016] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:33.660486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdff864-e2fa-40e4-974f-611eb08edaa0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:33.676428 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4046/8017] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:33.677444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de5d72-5323-4572-b9f2-26abacced1c8 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:33.687453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdff864-e2fa-40e4-974f-611eb08edaa0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:33.700324 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de5d72-5323-4572-b9f2-26abacced1c8 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:33.705934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e251b1-bf76-4651-97fc-2364d29518d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:33.711292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e251b1-bf76-4651-97fc-2364d29518d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:33.713938 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e251b1-bf76-4651-97fc-2364d29518d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:33.714758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e251b1-bf76-4651-97fc-2364d29518d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:33.717688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e251b1-bf76-4651-97fc-2364d29518d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:33.722365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e251b1-bf76-4651-97fc-2364d29518d1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:33.725551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c14d1f-41e6-46bf-a3cb-ebf1571077b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:33.727199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c14d1f-41e6-46bf-a3cb-ebf1571077b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:33.728079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c14d1f-41e6-46bf-a3cb-ebf1571077b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:33.729052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c14d1f-41e6-46bf-a3cb-ebf1571077b7 admin admin] PATH_INFO: `/v3/projects/dc7d44901cc74bffaefc8684553f72cb/users/f992c582b2124cc58c17fbfaed553a81/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:33.784895 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c14d1f-41e6-46bf-a3cb-ebf1571077b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc7d44901cc74bffaefc8684553f72cb, user_id=f992c582b2124cc58c17fbfaed553a81, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:33.792137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c14d1f-41e6-46bf-a3cb-ebf1571077b7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:33.815584 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:33.832602 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4047/8018] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:48:33 2022] PUT /identity/v3/projects/dc7d44901cc74bffaefc8684553f72cb/users/f992c582b2124cc58c17fbfaed553a81/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:33.834218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c14d1f-41e6-46bf-a3cb-ebf1571077b7 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:33.842469 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3972/8019] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:48:33 2022] POST /identity/v3/projects => generated 351 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:33.846928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e251b1-bf76-4651-97fc-2364d29518d1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:33.960294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c14d1f-41e6-46bf-a3cb-ebf1571077b7 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:34.014261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e251b1-bf76-4651-97fc-2364d29518d1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:34.022622 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e012e6-cefd-4ee7-bbe5-42537cdd75ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:34.023331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e012e6-cefd-4ee7-bbe5-42537cdd75ab admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:34.023638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e012e6-cefd-4ee7-bbe5-42537cdd75ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:34.024795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e012e6-cefd-4ee7-bbe5-42537cdd75ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:34.026923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e012e6-cefd-4ee7-bbe5-42537cdd75ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:34.032605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e012e6-cefd-4ee7-bbe5-42537cdd75ab admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:34.036304 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:34.050883 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3973/8020] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:34.050883 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e012e6-cefd-4ee7-bbe5-42537cdd75ab admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:34.076073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c41ee4-40d5-4182-a6e2-285bf77af37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:34.076796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c41ee4-40d5-4182-a6e2-285bf77af37f admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:34.077309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c41ee4-40d5-4182-a6e2-285bf77af37f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:34.077621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c41ee4-40d5-4182-a6e2-285bf77af37f admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:34.078343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c41ee4-40d5-4182-a6e2-285bf77af37f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:34.080826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c41ee4-40d5-4182-a6e2-285bf77af37f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:34.095594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e012e6-cefd-4ee7-bbe5-42537cdd75ab admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:34.106584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9fa94-bedc-4112-b974-a4dae77df6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:34.107411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9fa94-bedc-4112-b974-a4dae77df6e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:34.107695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9fa94-bedc-4112-b974-a4dae77df6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:34.108149 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9fa94-bedc-4112-b974-a4dae77df6e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:34.108817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9fa94-bedc-4112-b974-a4dae77df6e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:34.111295 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9fa94-bedc-4112-b974-a4dae77df6e2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:34.123411 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4048/8021] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:48:33 2022] POST /identity/v3/projects => generated 385 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:34.124668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c41ee4-40d5-4182-a6e2-285bf77af37f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:34.140616 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3974/8022] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:48:34 2022] POST /identity/v3/users => generated 276 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:34.144951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9fa94-bedc-4112-b974-a4dae77df6e2 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:34.161226 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9fa94-bedc-4112-b974-a4dae77df6e2 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:34.281361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c41ee4-40d5-4182-a6e2-285bf77af37f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:34.287718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93515fd-2540-4714-b192-97a3317451ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:34.288935 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93515fd-2540-4714-b192-97a3317451ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:34.289501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93515fd-2540-4714-b192-97a3317451ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:34.290053 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93515fd-2540-4714-b192-97a3317451ee admin admin] PATH_INFO: `/v3/projects/dc7d44901cc74bffaefc8684553f72cb/users/f992c582b2124cc58c17fbfaed553a81/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:34.293839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93515fd-2540-4714-b192-97a3317451ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc7d44901cc74bffaefc8684553f72cb, user_id=f992c582b2124cc58c17fbfaed553a81, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:34.298134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93515fd-2540-4714-b192-97a3317451ee admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:34.313688 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4049/8023] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:48:34 2022] PUT /identity/v3/projects/dc7d44901cc74bffaefc8684553f72cb/users/f992c582b2124cc58c17fbfaed553a81/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:34.314686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93515fd-2540-4714-b192-97a3317451ee admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:34.350308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca63c3-a5db-47f8-84dd-7efb9b46db81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:34.351501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca63c3-a5db-47f8-84dd-7efb9b46db81 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:34.352638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca63c3-a5db-47f8-84dd-7efb9b46db81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:34.353177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca63c3-a5db-47f8-84dd-7efb9b46db81 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:34.358204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca63c3-a5db-47f8-84dd-7efb9b46db81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:34.365114 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca63c3-a5db-47f8-84dd-7efb9b46db81 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:34.430773 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3975/8024] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:48:34 2022] POST /identity/v3/users => generated 299 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:34.430773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce4d9a-1236-45f8-9652-345de972c2e6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:34.430773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce4d9a-1236-45f8-9652-345de972c2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:34.430773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce4d9a-1236-45f8-9652-345de972c2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:34.473596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-19ce4d9a-1236-45f8-9652-345de972c2e6 None None] MFA Rules not processed for user `f992c582b2124cc58c17fbfaed553a81`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:34.474984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-19ce4d9a-1236-45f8-9652-345de972c2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:34.478258 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93515fd-2540-4714-b192-97a3317451ee admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:34.498102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86a54e-1300-4581-a903-b2bfc08687ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:34.499353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86a54e-1300-4581-a903-b2bfc08687ba admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:34.499788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86a54e-1300-4581-a903-b2bfc08687ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:34.500644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86a54e-1300-4581-a903-b2bfc08687ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:34.500882 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86a54e-1300-4581-a903-b2bfc08687ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:34.503906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86a54e-1300-4581-a903-b2bfc08687ba admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:34.538821 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4050/8025] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:34.540868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86a54e-1300-4581-a903-b2bfc08687ba admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:34.562568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86a54e-1300-4581-a903-b2bfc08687ba admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:34.571203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a06cd-352b-4b86-ac4f-5f8d2fb97e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:34.572276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a06cd-352b-4b86-ac4f-5f8d2fb97e8c admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:34.572789 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a06cd-352b-4b86-ac4f-5f8d2fb97e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:34.573740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a06cd-352b-4b86-ac4f-5f8d2fb97e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:34.574496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a06cd-352b-4b86-ac4f-5f8d2fb97e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:34.577263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a06cd-352b-4b86-ac4f-5f8d2fb97e8c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:34.601798 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4051/8026] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:34.604381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a06cd-352b-4b86-ac4f-5f8d2fb97e8c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:34.618855 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:34.638100 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a06cd-352b-4b86-ac4f-5f8d2fb97e8c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:34.661307 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a432aee-c23e-4327-b51e-7dde443b6d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:34.662159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a432aee-c23e-4327-b51e-7dde443b6d56 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:34.662469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a432aee-c23e-4327-b51e-7dde443b6d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:34.662804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a432aee-c23e-4327-b51e-7dde443b6d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:34.663449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a432aee-c23e-4327-b51e-7dde443b6d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:34.665265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a432aee-c23e-4327-b51e-7dde443b6d56 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:34.671196 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3976/8027] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:34.675685 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce4d9a-1236-45f8-9652-345de972c2e6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:34.695841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce4d9a-1236-45f8-9652-345de972c2e6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:34.701768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d1046-2a2e-4015-b22f-ad3d7fb45f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:34.702505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d1046-2a2e-4015-b22f-ad3d7fb45f11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:34.702818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d1046-2a2e-4015-b22f-ad3d7fb45f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:34.703125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d1046-2a2e-4015-b22f-ad3d7fb45f11 admin admin] PATH_INFO: `/v3/projects/56bc427810d34fc28f824d4a4edd77ca/users/a788a4c3f7124a56b397a7b11666722d/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:34.707642 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4052/8028] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:34.712902 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a432aee-c23e-4327-b51e-7dde443b6d56 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:34.716052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1a432aee-c23e-4327-b51e-7dde443b6d56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:34.727709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d1046-2a2e-4015-b22f-ad3d7fb45f11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56bc427810d34fc28f824d4a4edd77ca, user_id=a788a4c3f7124a56b397a7b11666722d, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:34.736094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d1046-2a2e-4015-b22f-ad3d7fb45f11 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:34.768245 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:34.780884 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3977/8029] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:48:34 2022] PUT /identity/v3/projects/56bc427810d34fc28f824d4a4edd77ca/users/a788a4c3f7124a56b397a7b11666722d/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:34.788541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d1046-2a2e-4015-b22f-ad3d7fb45f11 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:34.859222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a432aee-c23e-4327-b51e-7dde443b6d56 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:34.948035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d1046-2a2e-4015-b22f-ad3d7fb45f11 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:34.964101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab5316-eac1-4195-ba3e-7f65fbf4e758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:34.966100 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab5316-eac1-4195-ba3e-7f65fbf4e758 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:34.966764 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab5316-eac1-4195-ba3e-7f65fbf4e758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:34.967530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab5316-eac1-4195-ba3e-7f65fbf4e758 admin admin] PATH_INFO: `/v3/projects/75a972c50889448e8d4c1932d13f5609/users/70bfbcf8522945f5a1843466bb90a603/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:35.018691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab5316-eac1-4195-ba3e-7f65fbf4e758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75a972c50889448e8d4c1932d13f5609, user_id=70bfbcf8522945f5a1843466bb90a603, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:35.033954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab5316-eac1-4195-ba3e-7f65fbf4e758 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:35.034229 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bce000-e47f-44f6-91ed-082f8a78f946 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:35.035145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bce000-e47f-44f6-91ed-082f8a78f946 service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:35.035666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bce000-e47f-44f6-91ed-082f8a78f946 service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:35.036184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bce000-e47f-44f6-91ed-082f8a78f946 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:35.081942 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3978/8030] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:48:34 2022] PUT /identity/v3/projects/75a972c50889448e8d4c1932d13f5609/users/70bfbcf8522945f5a1843466bb90a603/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:35.083229 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab5316-eac1-4195-ba3e-7f65fbf4e758 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:35.117669 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bce000-e47f-44f6-91ed-082f8a78f946 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:35.119834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bce000-e47f-44f6-91ed-082f8a78f946 service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:35.133169 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4053/8031] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:34 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:48:35.135567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02709ec5-b733-4b0e-9b1d-68ecdda18f4a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:35.136087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02709ec5-b733-4b0e-9b1d-68ecdda18f4a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:35.138911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02709ec5-b733-4b0e-9b1d-68ecdda18f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:35.184706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-02709ec5-b733-4b0e-9b1d-68ecdda18f4a None None] MFA Rules not processed for user `70bfbcf8522945f5a1843466bb90a603`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:35.186140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-02709ec5-b733-4b0e-9b1d-68ecdda18f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:35.223281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab5316-eac1-4195-ba3e-7f65fbf4e758 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:35.232005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ba949-5435-4ce2-970d-8397897692dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:35.233107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ba949-5435-4ce2-970d-8397897692dd admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:35.233601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ba949-5435-4ce2-970d-8397897692dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:35.234078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ba949-5435-4ce2-970d-8397897692dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:35.235350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ba949-5435-4ce2-970d-8397897692dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:35.238590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ba949-5435-4ce2-970d-8397897692dd admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:35.281590 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3979/8032] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:35.285381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ba949-5435-4ce2-970d-8397897692dd admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:35.296636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-244ba949-5435-4ce2-970d-8397897692dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:35.320516 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4054/8033] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:35 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:35.321636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02709ec5-b733-4b0e-9b1d-68ecdda18f4a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:35.338964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02709ec5-b733-4b0e-9b1d-68ecdda18f4a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:35.345453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30659c2b-dc1c-44eb-b093-56a7fcbbec5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:35.346139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30659c2b-dc1c-44eb-b093-56a7fcbbec5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:35.346417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30659c2b-dc1c-44eb-b093-56a7fcbbec5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:35.346690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30659c2b-dc1c-44eb-b093-56a7fcbbec5f admin admin] PATH_INFO: `/v3/projects/56bc427810d34fc28f824d4a4edd77ca/users/a788a4c3f7124a56b397a7b11666722d/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:35.349438 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30659c2b-dc1c-44eb-b093-56a7fcbbec5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=56bc427810d34fc28f824d4a4edd77ca, user_id=a788a4c3f7124a56b397a7b11666722d, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:35.352945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30659c2b-dc1c-44eb-b093-56a7fcbbec5f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:35.370343 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4055/8034] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:48:35 2022] PUT /identity/v3/projects/56bc427810d34fc28f824d4a4edd77ca/users/a788a4c3f7124a56b397a7b11666722d/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:35.371053 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30659c2b-dc1c-44eb-b093-56a7fcbbec5f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:35.373577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-30659c2b-dc1c-44eb-b093-56a7fcbbec5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:35.394861 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:35.435743 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:35.463630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ba949-5435-4ce2-970d-8397897692dd admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:35.512408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30659c2b-dc1c-44eb-b093-56a7fcbbec5f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:35.518109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd08e98-f537-41ae-8e3e-1186385e44b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:35.519252 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd08e98-f537-41ae-8e3e-1186385e44b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:35.519252 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd08e98-f537-41ae-8e3e-1186385e44b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:35.519721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd08e98-f537-41ae-8e3e-1186385e44b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:35.605656 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88751f-c226-41ac-8123-186ac5048f6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:35.606448 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88751f-c226-41ac-8123-186ac5048f6c service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:35.606736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88751f-c226-41ac-8123-186ac5048f6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:35.607011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88751f-c226-41ac-8123-186ac5048f6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:35.698215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd08e98-f537-41ae-8e3e-1186385e44b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:35.699868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd08e98-f537-41ae-8e3e-1186385e44b9 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:35.714958 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4056/8035] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:35 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:48:35.717095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6deb8-fbe8-4116-a2be-3f5495fe6b3e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:35.717457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6deb8-fbe8-4116-a2be-3f5495fe6b3e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:35.717718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6deb8-fbe8-4116-a2be-3f5495fe6b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:35.758358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3ee6deb8-fbe8-4116-a2be-3f5495fe6b3e None None] MFA Rules not processed for user `a788a4c3f7124a56b397a7b11666722d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:35.759510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3ee6deb8-fbe8-4116-a2be-3f5495fe6b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:35.812165 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88751f-c226-41ac-8123-186ac5048f6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:35.820296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88751f-c226-41ac-8123-186ac5048f6c service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:35.875320 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3980/8036] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:48:35.988166 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4057/8037] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:35 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:36.000486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88751f-c226-41ac-8123-186ac5048f6c service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:36.048116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88751f-c226-41ac-8123-186ac5048f6c service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:36.058828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabc8e4-274a-4187-95a8-ac6a3433f7ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:36.060147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabc8e4-274a-4187-95a8-ac6a3433f7ac service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:36.060720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabc8e4-274a-4187-95a8-ac6a3433f7ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:36.061320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabc8e4-274a-4187-95a8-ac6a3433f7ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:36.093343 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aabc8e4-274a-4187-95a8-ac6a3433f7ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:36.115168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aabc8e4-274a-4187-95a8-ac6a3433f7ac service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:36.161433 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3981/8038] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:35 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:48:36.620104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6deb8-fbe8-4116-a2be-3f5495fe6b3e None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:36.805112 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:36.830503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6deb8-fbe8-4116-a2be-3f5495fe6b3e None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:36.848289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d44228-c1ac-4208-94be-b3760bdc8416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:36.849426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d44228-c1ac-4208-94be-b3760bdc8416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:36.849931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d44228-c1ac-4208-94be-b3760bdc8416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:36.850438 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d44228-c1ac-4208-94be-b3760bdc8416 admin admin] PATH_INFO: `/v3/users/74bda0e5e2af438abdb4481542eee23d` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:36.852705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d44228-c1ac-4208-94be-b3760bdc8416 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74bda0e5e2af438abdb4481542eee23d)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:36.857970 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d44228-c1ac-4208-94be-b3760bdc8416 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:37.002672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-85d44228-c1ac-4208-94be-b3760bdc8416 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74bda0e5e2af438abdb4481542eee23d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:37.022220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-85d44228-c1ac-4208-94be-b3760bdc8416 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74bda0e5e2af438abdb4481542eee23d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:37.058139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-85d44228-c1ac-4208-94be-b3760bdc8416 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74bda0e5e2af438abdb4481542eee23d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:37.062990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-85d44228-c1ac-4208-94be-b3760bdc8416 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74bda0e5e2af438abdb4481542eee23d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:37.084761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-85d44228-c1ac-4208-94be-b3760bdc8416 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74bda0e5e2af438abdb4481542eee23d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:37.112927 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1a37f-8a5b-4389-a512-cdac5b087e5d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:37.113686 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4058/8039] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:48:36 2022] DELETE /identity/v3/users/74bda0e5e2af438abdb4481542eee23d => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:37.113835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1a37f-8a5b-4389-a512-cdac5b087e5d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:37.113835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1a37f-8a5b-4389-a512-cdac5b087e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:37.159620 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3fc1a37f-8a5b-4389-a512-cdac5b087e5d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:37.160922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3fc1a37f-8a5b-4389-a512-cdac5b087e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:37.370712 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3982/8040] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:37.431983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d44228-c1ac-4208-94be-b3760bdc8416 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:37.436005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-85d44228-c1ac-4208-94be-b3760bdc8416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:37.558300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d44228-c1ac-4208-94be-b3760bdc8416 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:37.564544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f457352-f381-4643-90ec-8e370270b36a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:37.565539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f457352-f381-4643-90ec-8e370270b36a service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:37.566097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f457352-f381-4643-90ec-8e370270b36a service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:37.566977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f457352-f381-4643-90ec-8e370270b36a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:37.581094 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f457352-f381-4643-90ec-8e370270b36a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:37.583148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f457352-f381-4643-90ec-8e370270b36a service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:37.601051 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4059/8041] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:48:38.631104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1a37f-8a5b-4389-a512-cdac5b087e5d None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:38.635743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3fc1a37f-8a5b-4389-a512-cdac5b087e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:38.684068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1a37f-8a5b-4389-a512-cdac5b087e5d None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:38.705848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3772fb-6d4b-4636-bd5f-121a69629b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:38.709291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3772fb-6d4b-4636-bd5f-121a69629b21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:38.714141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3772fb-6d4b-4636-bd5f-121a69629b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:38.715348 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3772fb-6d4b-4636-bd5f-121a69629b21 admin admin] PATH_INFO: `/v3/projects/ae53c6d9dde64945bad57a0acd3e9cb9` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:38.721533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3772fb-6d4b-4636-bd5f-121a69629b21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae53c6d9dde64945bad57a0acd3e9cb9)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:38.730992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3772fb-6d4b-4636-bd5f-121a69629b21 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:38.893783 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:38.920664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1a3772fb-6d4b-4636-bd5f-121a69629b21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae53c6d9dde64945bad57a0acd3e9cb9', 'request_id': 'req-1a3772fb-6d4b-4636-bd5f-121a69629b21'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:38.937729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1a3772fb-6d4b-4636-bd5f-121a69629b21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae53c6d9dde64945bad57a0acd3e9cb9', 'request_id': 'req-1a3772fb-6d4b-4636-bd5f-121a69629b21'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:38.958704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1a3772fb-6d4b-4636-bd5f-121a69629b21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae53c6d9dde64945bad57a0acd3e9cb9', 'request_id': 'req-1a3772fb-6d4b-4636-bd5f-121a69629b21'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:38.988066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1a3772fb-6d4b-4636-bd5f-121a69629b21 admin admin] The token cache is being invalidate because project ae53c6d9dde64945bad57a0acd3e9cb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:48:38.988794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1a3772fb-6d4b-4636-bd5f-121a69629b21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:38.990035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1a3772fb-6d4b-4636-bd5f-121a69629b21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:39.002989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f457352-f381-4643-90ec-8e370270b36a service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:39.017933 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3983/8042] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:48:38 2022] DELETE /identity/v3/projects/ae53c6d9dde64945bad57a0acd3e9cb9 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:39.033502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f457352-f381-4643-90ec-8e370270b36a service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:39.128389 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b76e25-dade-43cb-a60c-9c0ed8b5222b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:39.129142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b76e25-dade-43cb-a60c-9c0ed8b5222b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:39.129450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b76e25-dade-43cb-a60c-9c0ed8b5222b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:39.129757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b76e25-dade-43cb-a60c-9c0ed8b5222b admin admin] PATH_INFO: `/v3/users/a788a4c3f7124a56b397a7b11666722d` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:39.131175 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b76e25-dade-43cb-a60c-9c0ed8b5222b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a788a4c3f7124a56b397a7b11666722d)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:39.135322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b76e25-dade-43cb-a60c-9c0ed8b5222b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:39.154271 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:39.246190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-12b76e25-dade-43cb-a60c-9c0ed8b5222b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a788a4c3f7124a56b397a7b11666722d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:39.260639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-12b76e25-dade-43cb-a60c-9c0ed8b5222b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a788a4c3f7124a56b397a7b11666722d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:39.280138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-12b76e25-dade-43cb-a60c-9c0ed8b5222b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a788a4c3f7124a56b397a7b11666722d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:39.281071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-12b76e25-dade-43cb-a60c-9c0ed8b5222b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a788a4c3f7124a56b397a7b11666722d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:39.292129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-12b76e25-dade-43cb-a60c-9c0ed8b5222b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a788a4c3f7124a56b397a7b11666722d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:39.301559 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4060/8043] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:48:39 2022] DELETE /identity/v3/users/a788a4c3f7124a56b397a7b11666722d => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:40.154752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3772fb-6d4b-4636-bd5f-121a69629b21 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:40.157734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1a3772fb-6d4b-4636-bd5f-121a69629b21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:40.228988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3772fb-6d4b-4636-bd5f-121a69629b21 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:40.418702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a549e-66d7-4353-bcbd-47acb5053d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:40.419585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a549e-66d7-4353-bcbd-47acb5053d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:40.420036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a549e-66d7-4353-bcbd-47acb5053d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:40.420563 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a549e-66d7-4353-bcbd-47acb5053d22 admin admin] PATH_INFO: `/v3/users/70bfbcf8522945f5a1843466bb90a603` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:40.422120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a549e-66d7-4353-bcbd-47acb5053d22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70bfbcf8522945f5a1843466bb90a603)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:40.424740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b76e25-dade-43cb-a60c-9c0ed8b5222b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:40.425249 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a549e-66d7-4353-bcbd-47acb5053d22 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:40.427308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-12b76e25-dade-43cb-a60c-9c0ed8b5222b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:40.459972 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b76e25-dade-43cb-a60c-9c0ed8b5222b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:40.478033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c6310-7206-4278-b692-11e60288ea7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:40.479119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c6310-7206-4278-b692-11e60288ea7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:40.479788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c6310-7206-4278-b692-11e60288ea7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:40.480109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c6310-7206-4278-b692-11e60288ea7e admin admin] PATH_INFO: `/v3/projects/56bc427810d34fc28f824d4a4edd77ca` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:40.481635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c6310-7206-4278-b692-11e60288ea7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=56bc427810d34fc28f824d4a4edd77ca)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:40.483724 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c6310-7206-4278-b692-11e60288ea7e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:40.546974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a82a549e-66d7-4353-bcbd-47acb5053d22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70bfbcf8522945f5a1843466bb90a603'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:40.561454 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a82a549e-66d7-4353-bcbd-47acb5053d22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70bfbcf8522945f5a1843466bb90a603'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:40.606420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a34c6310-7206-4278-b692-11e60288ea7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56bc427810d34fc28f824d4a4edd77ca', 'request_id': 'req-a34c6310-7206-4278-b692-11e60288ea7e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:40.609290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a82a549e-66d7-4353-bcbd-47acb5053d22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70bfbcf8522945f5a1843466bb90a603'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:40.610149 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a82a549e-66d7-4353-bcbd-47acb5053d22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70bfbcf8522945f5a1843466bb90a603'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:40.615264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a34c6310-7206-4278-b692-11e60288ea7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56bc427810d34fc28f824d4a4edd77ca', 'request_id': 'req-a34c6310-7206-4278-b692-11e60288ea7e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:40.626390 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a34c6310-7206-4278-b692-11e60288ea7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56bc427810d34fc28f824d4a4edd77ca', 'request_id': 'req-a34c6310-7206-4278-b692-11e60288ea7e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:40.630285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a82a549e-66d7-4353-bcbd-47acb5053d22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70bfbcf8522945f5a1843466bb90a603'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:40.647084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a34c6310-7206-4278-b692-11e60288ea7e admin admin] The token cache is being invalidate because project 56bc427810d34fc28f824d4a4edd77ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:48:40.647626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a34c6310-7206-4278-b692-11e60288ea7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:40.648637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a34c6310-7206-4278-b692-11e60288ea7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:40.654406 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4061/8044] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:48:40 2022] DELETE /identity/v3/projects/56bc427810d34fc28f824d4a4edd77ca => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:40.656691 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46f7c0-6dd2-4223-bcf0-08cc910fcd0b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:40.657211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46f7c0-6dd2-4223-bcf0-08cc910fcd0b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:40.657642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46f7c0-6dd2-4223-bcf0-08cc910fcd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:40.659065 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3984/8045] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:48:40 2022] DELETE /identity/v3/users/70bfbcf8522945f5a1843466bb90a603 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:40.673293 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fafb06-6e61-41e9-8ae3-c4505b5855af None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:40.673724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fafb06-6e61-41e9-8ae3-c4505b5855af None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:40.674085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fafb06-6e61-41e9-8ae3-c4505b5855af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:40.705060 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-65fafb06-6e61-41e9-8ae3-c4505b5855af None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:40.706996 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-65fafb06-6e61-41e9-8ae3-c4505b5855af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:40.739347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-8c46f7c0-6dd2-4223-bcf0-08cc910fcd0b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:40.742954 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8c46f7c0-6dd2-4223-bcf0-08cc910fcd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:40.785289 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:40.831252 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3985/8046] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:40.852478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fafb06-6e61-41e9-8ae3-c4505b5855af None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:40.854658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-65fafb06-6e61-41e9-8ae3-c4505b5855af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:40.935995 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4062/8047] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:40.943345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb17d6-eeb0-4641-9e96-da24e1c23ab1 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:40.946877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb17d6-eeb0-4641-9e96-da24e1c23ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:40.948735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb17d6-eeb0-4641-9e96-da24e1c23ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:41.000728 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fafb06-6e61-41e9-8ae3-c4505b5855af None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:41.009093 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019309a9-a6f0-4f83-be3a-671185a5aafb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:41.010565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019309a9-a6f0-4f83-be3a-671185a5aafb service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:41.011151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019309a9-a6f0-4f83-be3a-671185a5aafb service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:41.011623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019309a9-a6f0-4f83-be3a-671185a5aafb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:41.019611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5afb17d6-eeb0-4641-9e96-da24e1c23ab1 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:41.020910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5afb17d6-eeb0-4641-9e96-da24e1c23ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:41.033436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019309a9-a6f0-4f83-be3a-671185a5aafb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:41.035080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019309a9-a6f0-4f83-be3a-671185a5aafb service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:41.036215 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4063/8048] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:41.044586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb17d6-eeb0-4641-9e96-da24e1c23ab1 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:41.058903 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:41.064287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb17d6-eeb0-4641-9e96-da24e1c23ab1 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:41.074264 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3986/8049] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:48:41.113376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e82c3-e7c1-4785-a040-71e20ac9dbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:41.114033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e82c3-e7c1-4785-a040-71e20ac9dbc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:41.114323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e82c3-e7c1-4785-a040-71e20ac9dbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:41.114605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e82c3-e7c1-4785-a040-71e20ac9dbc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:41.115405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e82c3-e7c1-4785-a040-71e20ac9dbc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:48:41.115734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e82c3-e7c1-4785-a040-71e20ac9dbc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:41.117653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e82c3-e7c1-4785-a040-71e20ac9dbc4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:41.138930 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4064/8050] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:48:41.142450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e82c3-e7c1-4785-a040-71e20ac9dbc4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:41.143565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019309a9-a6f0-4f83-be3a-671185a5aafb service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:41.147554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7d5e82c3-e7c1-4785-a040-71e20ac9dbc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:41.168139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019309a9-a6f0-4f83-be3a-671185a5aafb service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:41.177331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53cdb8-72d7-480d-a18b-1c0a9eb0637e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:41.178670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e82c3-e7c1-4785-a040-71e20ac9dbc4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:41.184535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53cdb8-72d7-480d-a18b-1c0a9eb0637e admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:41.184972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53cdb8-72d7-480d-a18b-1c0a9eb0637e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:41.185250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53cdb8-72d7-480d-a18b-1c0a9eb0637e admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:41.186388 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53cdb8-72d7-480d-a18b-1c0a9eb0637e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:41.188676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53cdb8-72d7-480d-a18b-1c0a9eb0637e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:41.196729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead4609-0ed4-4aaf-a964-c2925dcd696c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:41.198833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead4609-0ed4-4aaf-a964-c2925dcd696c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:41.199426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead4609-0ed4-4aaf-a964-c2925dcd696c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:41.200189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead4609-0ed4-4aaf-a964-c2925dcd696c admin admin] PATH_INFO: `/v3/users/14308613961a4ea7a5b95357a526366b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:41.202799 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead4609-0ed4-4aaf-a964-c2925dcd696c admin admin] RBAC: Authorizing `identity:delete_user(user_id=14308613961a4ea7a5b95357a526366b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:41.208071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead4609-0ed4-4aaf-a964-c2925dcd696c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:41.249109 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3987/8051] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:48:41 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:41.249109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53cdb8-72d7-480d-a18b-1c0a9eb0637e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:41.254606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9b53cdb8-72d7-480d-a18b-1c0a9eb0637e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:41.324990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5ead4609-0ed4-4aaf-a964-c2925dcd696c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14308613961a4ea7a5b95357a526366b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:41.343999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5ead4609-0ed4-4aaf-a964-c2925dcd696c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14308613961a4ea7a5b95357a526366b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:41.371497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53cdb8-72d7-480d-a18b-1c0a9eb0637e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:41.372015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5ead4609-0ed4-4aaf-a964-c2925dcd696c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14308613961a4ea7a5b95357a526366b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:41.373963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5ead4609-0ed4-4aaf-a964-c2925dcd696c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14308613961a4ea7a5b95357a526366b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:41.378106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc686c4-e9ee-431a-a188-41d8657e8e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:41.378804 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc686c4-e9ee-431a-a188-41d8657e8e21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:41.379090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc686c4-e9ee-431a-a188-41d8657e8e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:41.379439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc686c4-e9ee-431a-a188-41d8657e8e21 admin admin] PATH_INFO: `/v3/users/76d65e02c38f4333bb9d47498b2d7a4b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:41.381383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc686c4-e9ee-431a-a188-41d8657e8e21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76d65e02c38f4333bb9d47498b2d7a4b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:41.383312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc686c4-e9ee-431a-a188-41d8657e8e21 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:41.391963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5ead4609-0ed4-4aaf-a964-c2925dcd696c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14308613961a4ea7a5b95357a526366b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:41.406621 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4065/8052] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:48:41 2022] DELETE /identity/v3/users/14308613961a4ea7a5b95357a526366b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:41.410214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead4609-0ed4-4aaf-a964-c2925dcd696c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:41.412717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5ead4609-0ed4-4aaf-a964-c2925dcd696c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:41.539857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bfc686c4-e9ee-431a-a188-41d8657e8e21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76d65e02c38f4333bb9d47498b2d7a4b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:41.555996 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bfc686c4-e9ee-431a-a188-41d8657e8e21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76d65e02c38f4333bb9d47498b2d7a4b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:41.571308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead4609-0ed4-4aaf-a964-c2925dcd696c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:41.579058 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:41.581572 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872cf4f-3dde-4947-9223-84828c10a033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:41.582722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872cf4f-3dde-4947-9223-84828c10a033 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:41.583198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872cf4f-3dde-4947-9223-84828c10a033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:41.583702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872cf4f-3dde-4947-9223-84828c10a033 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:41.584791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872cf4f-3dde-4947-9223-84828c10a033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:41.585150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bfc686c4-e9ee-431a-a188-41d8657e8e21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76d65e02c38f4333bb9d47498b2d7a4b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:41.587187 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bfc686c4-e9ee-431a-a188-41d8657e8e21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76d65e02c38f4333bb9d47498b2d7a4b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:41.589019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872cf4f-3dde-4947-9223-84828c10a033 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:41.603952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-bfc686c4-e9ee-431a-a188-41d8657e8e21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76d65e02c38f4333bb9d47498b2d7a4b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:41.619507 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3988/8053] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:48:41 2022] DELETE /identity/v3/users/76d65e02c38f4333bb9d47498b2d7a4b => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:41.619507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc04b53-c594-4708-a3e4-2a23011dc8d1 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:41.619507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc04b53-c594-4708-a3e4-2a23011dc8d1 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:41.619507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc04b53-c594-4708-a3e4-2a23011dc8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:41.632088 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4066/8054] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:48:41 2022] POST /identity/v3/users => generated 286 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:41.632088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872cf4f-3dde-4947-9223-84828c10a033 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:41.635424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8872cf4f-3dde-4947-9223-84828c10a033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:41.656204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6bc04b53-c594-4708-a3e4-2a23011dc8d1 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:41.658484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6bc04b53-c594-4708-a3e4-2a23011dc8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:41.658634 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872cf4f-3dde-4947-9223-84828c10a033 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:41.750040 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:41.777777 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3989/8055] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:41.779301 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728c92a-1b56-496d-ad09-11ba8bb8ffd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:41.780213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728c92a-1b56-496d-ad09-11ba8bb8ffd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:41.780648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728c92a-1b56-496d-ad09-11ba8bb8ffd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:41.781068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728c92a-1b56-496d-ad09-11ba8bb8ffd4 admin admin] PATH_INFO: `/v3/projects/75a972c50889448e8d4c1932d13f5609` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:41.782514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728c92a-1b56-496d-ad09-11ba8bb8ffd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75a972c50889448e8d4c1932d13f5609)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:41.784968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728c92a-1b56-496d-ad09-11ba8bb8ffd4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:41.788598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853a926-c057-4355-a473-674fcc9d7ee7 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:41.788882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853a926-c057-4355-a473-674fcc9d7ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:41.789204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853a926-c057-4355-a473-674fcc9d7ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:41.813781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-a853a926-c057-4355-a473-674fcc9d7ee7 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:41.815624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a853a926-c057-4355-a473-674fcc9d7ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:41.829987 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3990/8056] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:41.832809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853a926-c057-4355-a473-674fcc9d7ee7 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:41.846702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a853a926-c057-4355-a473-674fcc9d7ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:41.864734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853a926-c057-4355-a473-674fcc9d7ee7 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:41.883080 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9728c92a-1b56-496d-ad09-11ba8bb8ffd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75a972c50889448e8d4c1932d13f5609', 'request_id': 'req-9728c92a-1b56-496d-ad09-11ba8bb8ffd4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:41.892956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9728c92a-1b56-496d-ad09-11ba8bb8ffd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75a972c50889448e8d4c1932d13f5609', 'request_id': 'req-9728c92a-1b56-496d-ad09-11ba8bb8ffd4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:41.907496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9728c92a-1b56-496d-ad09-11ba8bb8ffd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75a972c50889448e8d4c1932d13f5609', 'request_id': 'req-9728c92a-1b56-496d-ad09-11ba8bb8ffd4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:41.936369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9728c92a-1b56-496d-ad09-11ba8bb8ffd4 admin admin] The token cache is being invalidate because project 75a972c50889448e8d4c1932d13f5609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:48:41.936809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9728c92a-1b56-496d-ad09-11ba8bb8ffd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:41.938344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9728c92a-1b56-496d-ad09-11ba8bb8ffd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:41.941423 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4067/8057] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:48:41 2022] DELETE /identity/v3/projects/75a972c50889448e8d4c1932d13f5609 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:41.942794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728c92a-1b56-496d-ad09-11ba8bb8ffd4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:41.948602 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9728c92a-1b56-496d-ad09-11ba8bb8ffd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:41.988578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfd053-cdd0-45cb-b218-822c2bbe0ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:41.989969 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfd053-cdd0-45cb-b218-822c2bbe0ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:41.989969 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfd053-cdd0-45cb-b218-822c2bbe0ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:41.990359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfd053-cdd0-45cb-b218-822c2bbe0ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:41.991419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdfd053-cdd0-45cb-b218-822c2bbe0ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:41.994179 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdfd053-cdd0-45cb-b218-822c2bbe0ab2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:42.011583 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3991/8058] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:42.011809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfd053-cdd0-45cb-b218-822c2bbe0ab2 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:42.015271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0cdfd053-cdd0-45cb-b218-822c2bbe0ab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:42.065369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728c92a-1b56-496d-ad09-11ba8bb8ffd4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:42.071044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67f8c3-b220-40ea-89a1-936e53b05f25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:42.072794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67f8c3-b220-40ea-89a1-936e53b05f25 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:42.073271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67f8c3-b220-40ea-89a1-936e53b05f25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:42.073700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67f8c3-b220-40ea-89a1-936e53b05f25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:42.076812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7b67f8c3-b220-40ea-89a1-936e53b05f25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:42.095387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b67f8c3-b220-40ea-89a1-936e53b05f25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:42.098126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b67f8c3-b220-40ea-89a1-936e53b05f25 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:42.107720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfd053-cdd0-45cb-b218-822c2bbe0ab2 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:42.114158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a51235-3190-4a84-9603-9cafb5bef7d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:42.115446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a51235-3190-4a84-9603-9cafb5bef7d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:42.115949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a51235-3190-4a84-9603-9cafb5bef7d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:42.116417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a51235-3190-4a84-9603-9cafb5bef7d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:42.117148 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4068/8059] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:48:42.119934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a7a51235-3190-4a84-9603-9cafb5bef7d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:42.120129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1222b2-ee2f-4b2c-a3ed-119a5e0a8291 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:42.120659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1222b2-ee2f-4b2c-a3ed-119a5e0a8291 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:42.121176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1222b2-ee2f-4b2c-a3ed-119a5e0a8291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:42.142647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a51235-3190-4a84-9603-9cafb5bef7d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:42.145834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a51235-3190-4a84-9603-9cafb5bef7d2 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:42.157829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-4f1222b2-ee2f-4b2c-a3ed-119a5e0a8291 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:42.160463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4f1222b2-ee2f-4b2c-a3ed-119a5e0a8291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:42.185558 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3992/8060] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:48:42.189179 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4069/8061] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:42.193315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a51235-3190-4a84-9603-9cafb5bef7d2 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:42.197910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a7a51235-3190-4a84-9603-9cafb5bef7d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:42.206285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39757d-cf9e-47d3-8c7e-bc8fe40b07a2 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:42.206584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39757d-cf9e-47d3-8c7e-bc8fe40b07a2 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:42.207347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39757d-cf9e-47d3-8c7e-bc8fe40b07a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:42.228525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a51235-3190-4a84-9603-9cafb5bef7d2 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:42.237358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bede5-c604-48dc-a4d6-1cfe2b7b031f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:42.238518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bede5-c604-48dc-a4d6-1cfe2b7b031f admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:42.239032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bede5-c604-48dc-a4d6-1cfe2b7b031f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:42.239937 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bede5-c604-48dc-a4d6-1cfe2b7b031f admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:42.240736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6bede5-c604-48dc-a4d6-1cfe2b7b031f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:42.246874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2c39757d-cf9e-47d3-8c7e-bc8fe40b07a2 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:42.248532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6bede5-c604-48dc-a4d6-1cfe2b7b031f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:42.249371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2c39757d-cf9e-47d3-8c7e-bc8fe40b07a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:42.272521 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4070/8062] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:42.274625 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c39757d-cf9e-47d3-8c7e-bc8fe40b07a2 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:42.283296 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3993/8063] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:42.297163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c39757d-cf9e-47d3-8c7e-bc8fe40b07a2 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:42.305863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43de17e-08c9-4bb2-9854-4e7dba457b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:42.307063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43de17e-08c9-4bb2-9854-4e7dba457b34 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:42.307679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43de17e-08c9-4bb2-9854-4e7dba457b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:42.308321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43de17e-08c9-4bb2-9854-4e7dba457b34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:42.309990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43de17e-08c9-4bb2-9854-4e7dba457b34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:48:42.310465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43de17e-08c9-4bb2-9854-4e7dba457b34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:42.313794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43de17e-08c9-4bb2-9854-4e7dba457b34 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:42.318520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bede5-c604-48dc-a4d6-1cfe2b7b031f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:42.349716 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4071/8064] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:48:42.351742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43de17e-08c9-4bb2-9854-4e7dba457b34 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:42.373134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43de17e-08c9-4bb2-9854-4e7dba457b34 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:42.383985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290b2c8-de92-4058-879c-f220b1fb8348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:42.386467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290b2c8-de92-4058-879c-f220b1fb8348 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:42.388757 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bede5-c604-48dc-a4d6-1cfe2b7b031f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:42.397334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290b2c8-de92-4058-879c-f220b1fb8348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:42.397988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290b2c8-de92-4058-879c-f220b1fb8348 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:42.403915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290b2c8-de92-4058-879c-f220b1fb8348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:42.408853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290b2c8-de92-4058-879c-f220b1fb8348 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:42.417221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1691c1-08c0-486c-a3e5-aad142a00abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:42.418319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1691c1-08c0-486c-a3e5-aad142a00abd admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:42.418783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1691c1-08c0-486c-a3e5-aad142a00abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:42.423483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1691c1-08c0-486c-a3e5-aad142a00abd admin admin] PATH_INFO: `/v3/projects/1a9db9d793594df2aa9c2658abad18c3/users/aa475ec9a7ff4bc999bc83c53eb1f5eb/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:42.435656 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:42.498400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1691c1-08c0-486c-a3e5-aad142a00abd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a9db9d793594df2aa9c2658abad18c3, user_id=aa475ec9a7ff4bc999bc83c53eb1f5eb, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:42.505821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1691c1-08c0-486c-a3e5-aad142a00abd admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:42.508379 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4072/8065] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:48:42 2022] POST /identity/v3/projects => generated 403 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:42.512296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290b2c8-de92-4058-879c-f220b1fb8348 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:42.542235 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3994/8066] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:48:42 2022] PUT /identity/v3/projects/1a9db9d793594df2aa9c2658abad18c3/users/aa475ec9a7ff4bc999bc83c53eb1f5eb/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:42.545017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51163c0f-0150-488a-bffc-ff46a768d7bd None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:42.545958 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51163c0f-0150-488a-bffc-ff46a768d7bd None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:42.546695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51163c0f-0150-488a-bffc-ff46a768d7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:42.584936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-51163c0f-0150-488a-bffc-ff46a768d7bd None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:42.587860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-51163c0f-0150-488a-bffc-ff46a768d7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:42.675961 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:42.717678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290b2c8-de92-4058-879c-f220b1fb8348 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:42.754097 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3995/8067] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:42.762220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51163c0f-0150-488a-bffc-ff46a768d7bd None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:42.765390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-51163c0f-0150-488a-bffc-ff46a768d7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:42.811766 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51163c0f-0150-488a-bffc-ff46a768d7bd None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:42.828935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd66e0a-290e-4e69-85d5-81b6a03eabba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:42.828935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd66e0a-290e-4e69-85d5-81b6a03eabba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:42.828935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd66e0a-290e-4e69-85d5-81b6a03eabba admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:42.828935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd66e0a-290e-4e69-85d5-81b6a03eabba admin admin] PATH_INFO: `/v3/projects/4177856828e04964be60a88b92add369` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:42.829500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd66e0a-290e-4e69-85d5-81b6a03eabba admin admin] RBAC: Authorizing `identity:delete_project(project_id=4177856828e04964be60a88b92add369)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:42.830356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd66e0a-290e-4e69-85d5-81b6a03eabba admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:42.855390 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fdc463-b742-4908-83b2-26bbc7f10018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:42.856178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdc463-b742-4908-83b2-26bbc7f10018 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:42.856527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdc463-b742-4908-83b2-26bbc7f10018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:42.856872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdc463-b742-4908-83b2-26bbc7f10018 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:42.857580 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fdc463-b742-4908-83b2-26bbc7f10018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:42.860039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fdc463-b742-4908-83b2-26bbc7f10018 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:42.900403 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4073/8068] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:48:42 2022] POST /identity/v3/users => generated 302 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:42.902319 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fdc463-b742-4908-83b2-26bbc7f10018 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:42.904294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-27fdc463-b742-4908-83b2-26bbc7f10018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:42.924847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dbd66e0a-290e-4e69-85d5-81b6a03eabba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4177856828e04964be60a88b92add369', 'request_id': 'req-dbd66e0a-290e-4e69-85d5-81b6a03eabba'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:42.938719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dbd66e0a-290e-4e69-85d5-81b6a03eabba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4177856828e04964be60a88b92add369', 'request_id': 'req-dbd66e0a-290e-4e69-85d5-81b6a03eabba'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:42.951819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dbd66e0a-290e-4e69-85d5-81b6a03eabba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4177856828e04964be60a88b92add369', 'request_id': 'req-dbd66e0a-290e-4e69-85d5-81b6a03eabba'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:42.975903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dbd66e0a-290e-4e69-85d5-81b6a03eabba admin admin] The token cache is being invalidate because project 4177856828e04964be60a88b92add369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:48:42.976555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dbd66e0a-290e-4e69-85d5-81b6a03eabba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:42.977624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dbd66e0a-290e-4e69-85d5-81b6a03eabba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:42.980958 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3996/8069] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:48:42 2022] DELETE /identity/v3/projects/4177856828e04964be60a88b92add369 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:42.982170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd66e0a-290e-4e69-85d5-81b6a03eabba admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:42.984631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-dbd66e0a-290e-4e69-85d5-81b6a03eabba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:43.013963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fdc463-b742-4908-83b2-26bbc7f10018 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:43.076801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd66e0a-290e-4e69-85d5-81b6a03eabba admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:43.078352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457abb6-7e0b-420b-afdf-f89b9c2cf0f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:43.078941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457abb6-7e0b-420b-afdf-f89b9c2cf0f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:43.079220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457abb6-7e0b-420b-afdf-f89b9c2cf0f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:43.079500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457abb6-7e0b-420b-afdf-f89b9c2cf0f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:43.081626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3457abb6-7e0b-420b-afdf-f89b9c2cf0f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:43.082310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e5267-4095-4093-b89c-3f8908f7adf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:43.082937 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e5267-4095-4093-b89c-3f8908f7adf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:43.083212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e5267-4095-4093-b89c-3f8908f7adf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:43.083485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e5267-4095-4093-b89c-3f8908f7adf3 admin admin] PATH_INFO: `/v3/projects/487a1ab934f140ec92c398cb6eebc79e` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:43.084634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e5267-4095-4093-b89c-3f8908f7adf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=487a1ab934f140ec92c398cb6eebc79e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:43.086535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e5267-4095-4093-b89c-3f8908f7adf3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:43.098137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457abb6-7e0b-420b-afdf-f89b9c2cf0f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:43.099417 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:43.099857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457abb6-7e0b-420b-afdf-f89b9c2cf0f7 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:43.111685 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4074/8070] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:48:43.112546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457abb6-7e0b-420b-afdf-f89b9c2cf0f7 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:43.113931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3457abb6-7e0b-420b-afdf-f89b9c2cf0f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:43.128019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457abb6-7e0b-420b-afdf-f89b9c2cf0f7 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:43.135535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182f3c7-0a50-4782-8388-786b0ef5e6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:43.136284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182f3c7-0a50-4782-8388-786b0ef5e6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:43.136654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182f3c7-0a50-4782-8388-786b0ef5e6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:43.136983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182f3c7-0a50-4782-8388-786b0ef5e6d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:43.137732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182f3c7-0a50-4782-8388-786b0ef5e6d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:43.139444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182f3c7-0a50-4782-8388-786b0ef5e6d5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:43.160381 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4075/8071] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:43.161758 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182f3c7-0a50-4782-8388-786b0ef5e6d5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:43.164829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7182f3c7-0a50-4782-8388-786b0ef5e6d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:43.168831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0a6e5267-4095-4093-b89c-3f8908f7adf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '487a1ab934f140ec92c398cb6eebc79e', 'request_id': 'req-0a6e5267-4095-4093-b89c-3f8908f7adf3'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:43.177771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0a6e5267-4095-4093-b89c-3f8908f7adf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '487a1ab934f140ec92c398cb6eebc79e', 'request_id': 'req-0a6e5267-4095-4093-b89c-3f8908f7adf3'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:43.183491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182f3c7-0a50-4782-8388-786b0ef5e6d5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:43.187264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0a6e5267-4095-4093-b89c-3f8908f7adf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '487a1ab934f140ec92c398cb6eebc79e', 'request_id': 'req-0a6e5267-4095-4093-b89c-3f8908f7adf3'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:43.209477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0a6e5267-4095-4093-b89c-3f8908f7adf3 admin admin] The token cache is being invalidate because project 487a1ab934f140ec92c398cb6eebc79e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:48:43.209693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0a6e5267-4095-4093-b89c-3f8908f7adf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:43.210909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0a6e5267-4095-4093-b89c-3f8908f7adf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:43.213136 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:43.215929 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3997/8072] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:48:42 2022] DELETE /identity/v3/projects/487a1ab934f140ec92c398cb6eebc79e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:43.216391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e5267-4095-4093-b89c-3f8908f7adf3 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:43.218815 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0a6e5267-4095-4093-b89c-3f8908f7adf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:43.297622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b9d2c-6570-4472-959e-43584ed0acb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:43.298721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b9d2c-6570-4472-959e-43584ed0acb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:43.299199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b9d2c-6570-4472-959e-43584ed0acb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:43.299697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b9d2c-6570-4472-959e-43584ed0acb0 admin admin] PATH_INFO: `/v3/users/f992c582b2124cc58c17fbfaed553a81` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:43.303165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b9d2c-6570-4472-959e-43584ed0acb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f992c582b2124cc58c17fbfaed553a81)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:43.306157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b9d2c-6570-4472-959e-43584ed0acb0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:43.355342 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e5267-4095-4093-b89c-3f8908f7adf3 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:43.361826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee002904-3df4-435d-b220-5278a3bc468e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:43.362488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee002904-3df4-435d-b220-5278a3bc468e admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:43.362770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee002904-3df4-435d-b220-5278a3bc468e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:43.363070 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee002904-3df4-435d-b220-5278a3bc468e admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:43.363754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee002904-3df4-435d-b220-5278a3bc468e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:43.365539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee002904-3df4-435d-b220-5278a3bc468e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:43.383507 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3998/8073] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:43.383507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706d346-66df-470f-883e-bb218bb8f217 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:43.383507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706d346-66df-470f-883e-bb218bb8f217 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:43.383927 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e706d346-66df-470f-883e-bb218bb8f217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:43.410117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e706d346-66df-470f-883e-bb218bb8f217 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:43.411933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e706d346-66df-470f-883e-bb218bb8f217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:43.427759 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 3999/8074] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:43.441433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706d346-66df-470f-883e-bb218bb8f217 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:43.465012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ae5b9d2c-6570-4472-959e-43584ed0acb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f992c582b2124cc58c17fbfaed553a81'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:43.465321 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e706d346-66df-470f-883e-bb218bb8f217 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:43.476602 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ae5b9d2c-6570-4472-959e-43584ed0acb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f992c582b2124cc58c17fbfaed553a81'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:43.479115 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ed49b-3c46-49cc-85e2-0de33298aa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:43.480742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ed49b-3c46-49cc-85e2-0de33298aa91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:43.481682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ed49b-3c46-49cc-85e2-0de33298aa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:43.482439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ed49b-3c46-49cc-85e2-0de33298aa91 admin admin] PATH_INFO: `/v3/projects/b45a53f450fb4866b5ffe1820b6d5da7/users/e2ae4431ecc942eb9d7df988fd41ca7c/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:43.496517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ae5b9d2c-6570-4472-959e-43584ed0acb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f992c582b2124cc58c17fbfaed553a81'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:43.497793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ae5b9d2c-6570-4472-959e-43584ed0acb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f992c582b2124cc58c17fbfaed553a81'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:43.514502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ae5b9d2c-6570-4472-959e-43584ed0acb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f992c582b2124cc58c17fbfaed553a81'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:43.524668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ed49b-3c46-49cc-85e2-0de33298aa91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b45a53f450fb4866b5ffe1820b6d5da7, user_id=e2ae4431ecc942eb9d7df988fd41ca7c, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:43.529337 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ed49b-3c46-49cc-85e2-0de33298aa91 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:43.533218 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4076/8075] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:48:43 2022] DELETE /identity/v3/users/f992c582b2124cc58c17fbfaed553a81 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:43.537636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789ca93-3b0b-4dcf-a686-3def4b4c849c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:43.538003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789ca93-3b0b-4dcf-a686-3def4b4c849c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:43.538694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789ca93-3b0b-4dcf-a686-3def4b4c849c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:43.568544 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4000/8076] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:48:43 2022] PUT /identity/v3/projects/b45a53f450fb4866b5ffe1820b6d5da7/users/e2ae4431ecc942eb9d7df988fd41ca7c/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:43.582249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-4789ca93-3b0b-4dcf-a686-3def4b4c849c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:43.583416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0307f-88f1-4060-8f10-eadd074e4081 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:43.583698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4789ca93-3b0b-4dcf-a686-3def4b4c849c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:43.585361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0307f-88f1-4060-8f10-eadd074e4081 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:43.586855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0307f-88f1-4060-8f10-eadd074e4081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:43.662300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c3e0307f-88f1-4060-8f10-eadd074e4081 None None] MFA Rules not processed for user `e2ae4431ecc942eb9d7df988fd41ca7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:43.667907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c3e0307f-88f1-4060-8f10-eadd074e4081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:43.741603 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4077/8077] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:43.743636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789ca93-3b0b-4dcf-a686-3def4b4c849c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:43.758830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789ca93-3b0b-4dcf-a686-3def4b4c849c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:43.769242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1d94c-88aa-48fe-8bcf-d83d961e5cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:43.770052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1d94c-88aa-48fe-8bcf-d83d961e5cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:43.770375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1d94c-88aa-48fe-8bcf-d83d961e5cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:43.770801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a1d94c-88aa-48fe-8bcf-d83d961e5cf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:43.773425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1d94c-88aa-48fe-8bcf-d83d961e5cf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:48:43.774289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1d94c-88aa-48fe-8bcf-d83d961e5cf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:43.792633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a1d94c-88aa-48fe-8bcf-d83d961e5cf6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:43.828107 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4078/8078] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:48:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:48:43.829772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1d94c-88aa-48fe-8bcf-d83d961e5cf6 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:43.844213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a1d94c-88aa-48fe-8bcf-d83d961e5cf6 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:43.845723 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:43.857979 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097113b-4dd9-41b4-8944-231a0fa94310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:43.859028 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097113b-4dd9-41b4-8944-231a0fa94310 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:43.859419 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097113b-4dd9-41b4-8944-231a0fa94310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:43.859757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097113b-4dd9-41b4-8944-231a0fa94310 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:43.863348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097113b-4dd9-41b4-8944-231a0fa94310 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:43.867406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097113b-4dd9-41b4-8944-231a0fa94310 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:43.882893 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4001/8079] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:43 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:43.887866 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0307f-88f1-4060-8f10-eadd074e4081 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:43.889612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c3e0307f-88f1-4060-8f10-eadd074e4081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:43.906839 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4079/8080] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:48:43 2022] POST /identity/v3/projects => generated 377 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:43.913076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097113b-4dd9-41b4-8944-231a0fa94310 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:43.926473 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:43.930059 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0307f-88f1-4060-8f10-eadd074e4081 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:44.006257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097113b-4dd9-41b4-8944-231a0fa94310 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:44.014054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867e35b-cc24-46e4-bf0a-e02163390624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:44.016008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867e35b-cc24-46e4-bf0a-e02163390624 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:44.016292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867e35b-cc24-46e4-bf0a-e02163390624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:44.016567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867e35b-cc24-46e4-bf0a-e02163390624 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:44.017225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867e35b-cc24-46e4-bf0a-e02163390624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:44.019206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867e35b-cc24-46e4-bf0a-e02163390624 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:44.045427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a1f8c-8799-4082-a377-1843ef06e201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:44.046375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a1f8c-8799-4082-a377-1843ef06e201 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:44.046662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a1f8c-8799-4082-a377-1843ef06e201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:44.046995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a1f8c-8799-4082-a377-1843ef06e201 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:44.048253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a1f8c-8799-4082-a377-1843ef06e201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:44.050390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a1f8c-8799-4082-a377-1843ef06e201 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:44.055513 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4080/8081] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:48:43 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:44.061196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867e35b-cc24-46e4-bf0a-e02163390624 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:44.109348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867e35b-cc24-46e4-bf0a-e02163390624 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:44.122062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73ac95-0ae0-4d57-bbcf-56b4ace18dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:44.122706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73ac95-0ae0-4d57-bbcf-56b4ace18dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:44.122990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73ac95-0ae0-4d57-bbcf-56b4ace18dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:44.123267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73ac95-0ae0-4d57-bbcf-56b4ace18dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:44.123951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73ac95-0ae0-4d57-bbcf-56b4ace18dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:44.125597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73ac95-0ae0-4d57-bbcf-56b4ace18dc5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:44.132201 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4002/8082] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:48:43 2022] POST /identity/v3/projects => generated 405 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:44.133534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a1f8c-8799-4082-a377-1843ef06e201 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:44.154168 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4081/8083] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:48:44.155252 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73ac95-0ae0-4d57-bbcf-56b4ace18dc5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:44.173613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73ac95-0ae0-4d57-bbcf-56b4ace18dc5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:44.262993 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a1f8c-8799-4082-a377-1843ef06e201 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:44.268096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031dd9f-c807-42ca-b4c9-9a76040a979e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:44.269166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031dd9f-c807-42ca-b4c9-9a76040a979e admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:44.269166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031dd9f-c807-42ca-b4c9-9a76040a979e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:44.269357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031dd9f-c807-42ca-b4c9-9a76040a979e admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:44.270129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031dd9f-c807-42ca-b4c9-9a76040a979e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:44.272493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031dd9f-c807-42ca-b4c9-9a76040a979e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:44.302048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb998f-cbf4-438f-bfd1-0774709a0ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:44.304163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb998f-cbf4-438f-bfd1-0774709a0ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:44.304453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb998f-cbf4-438f-bfd1-0774709a0ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:44.307159 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4003/8084] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:48:44 2022] POST /identity/v3/users => generated 309 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:44.310255 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb998f-cbf4-438f-bfd1-0774709a0ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:44.311430 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb998f-cbf4-438f-bfd1-0774709a0ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:44.312904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb998f-cbf4-438f-bfd1-0774709a0ce9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:44.314611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031dd9f-c807-42ca-b4c9-9a76040a979e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:44.326457 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4082/8085] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:44.334165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb998f-cbf4-438f-bfd1-0774709a0ce9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:44.340062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031dd9f-c807-42ca-b4c9-9a76040a979e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:44.349721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a2194-5cf9-4c24-8582-9e3547f404c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:44.350620 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a2194-5cf9-4c24-8582-9e3547f404c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:44.351000 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a2194-5cf9-4c24-8582-9e3547f404c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:44.351424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a2194-5cf9-4c24-8582-9e3547f404c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:44.352251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a2194-5cf9-4c24-8582-9e3547f404c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:44.356479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a2194-5cf9-4c24-8582-9e3547f404c2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:44.356887 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb998f-cbf4-438f-bfd1-0774709a0ce9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:44.369628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880b861-5883-4dd0-8b2b-5f6d54ce2ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:44.370325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880b861-5883-4dd0-8b2b-5f6d54ce2ba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:44.370603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880b861-5883-4dd0-8b2b-5f6d54ce2ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:44.370873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880b861-5883-4dd0-8b2b-5f6d54ce2ba6 admin admin] PATH_INFO: `/v3/projects/030fd2eaf12240029750dc0272308b35/users/a390615eb1224884977dec7e2752f609/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:44.372665 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4004/8086] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:48:44.378279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a2194-5cf9-4c24-8582-9e3547f404c2 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:44.392569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a2194-5cf9-4c24-8582-9e3547f404c2 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:44.399244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04dec20-1e77-42a0-a8fc-9e621aac4762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:44.401098 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04dec20-1e77-42a0-a8fc-9e621aac4762 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:44.401494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04dec20-1e77-42a0-a8fc-9e621aac4762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:44.401873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04dec20-1e77-42a0-a8fc-9e621aac4762 admin admin] PATH_INFO: `/v3/projects/cb33369bbc8b4996bb1c935099080764/users/d3265315a94a4891b32389566b9b8eb4/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:44.405007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880b861-5883-4dd0-8b2b-5f6d54ce2ba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=030fd2eaf12240029750dc0272308b35, user_id=a390615eb1224884977dec7e2752f609, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:44.408600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880b861-5883-4dd0-8b2b-5f6d54ce2ba6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:44.428766 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04dec20-1e77-42a0-a8fc-9e621aac4762 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb33369bbc8b4996bb1c935099080764, user_id=d3265315a94a4891b32389566b9b8eb4, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:44.440597 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4083/8087] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:48:44 2022] PUT /identity/v3/projects/030fd2eaf12240029750dc0272308b35/users/a390615eb1224884977dec7e2752f609/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:44.440803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04dec20-1e77-42a0-a8fc-9e621aac4762 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:44.443615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f648d9-7004-4dff-8f69-a7f76712b58d None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:44.444060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f648d9-7004-4dff-8f69-a7f76712b58d None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:44.444452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f648d9-7004-4dff-8f69-a7f76712b58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:44.452585 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4005/8088] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:48:44 2022] PUT /identity/v3/projects/cb33369bbc8b4996bb1c935099080764/users/d3265315a94a4891b32389566b9b8eb4/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:44.456860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04dec20-1e77-42a0-a8fc-9e621aac4762 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:44.497721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e6f648d9-7004-4dff-8f69-a7f76712b58d None None] MFA Rules not processed for user `a390615eb1224884977dec7e2752f609`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:44.499930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e6f648d9-7004-4dff-8f69-a7f76712b58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:44.523990 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:44.596786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04dec20-1e77-42a0-a8fc-9e621aac4762 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:44.616266 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:44.629702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90dd10-e1ba-4ec7-954f-d55c4750a718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:44.630561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90dd10-e1ba-4ec7-954f-d55c4750a718 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:44.631030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90dd10-e1ba-4ec7-954f-d55c4750a718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:44.631814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90dd10-e1ba-4ec7-954f-d55c4750a718 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:44.632798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90dd10-e1ba-4ec7-954f-d55c4750a718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:44.644312 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4084/8089] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:48:44.645506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f648d9-7004-4dff-8f69-a7f76712b58d None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:44.646928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e6f648d9-7004-4dff-8f69-a7f76712b58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:44.653628 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c90dd10-e1ba-4ec7-954f-d55c4750a718 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:44.662447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f648d9-7004-4dff-8f69-a7f76712b58d None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:44.667185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b5a7a-dcda-41f7-b3c3-3c60f919036f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:44.667827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b5a7a-dcda-41f7-b3c3-3c60f919036f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:44.668138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b5a7a-dcda-41f7-b3c3-3c60f919036f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:44.668412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b5a7a-dcda-41f7-b3c3-3c60f919036f admin admin] PATH_INFO: `/v3/projects/dc7d44901cc74bffaefc8684553f72cb` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:44.669505 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4006/8090] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:44.670027 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b5a7a-dcda-41f7-b3c3-3c60f919036f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc7d44901cc74bffaefc8684553f72cb)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:44.671002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e179f-9710-43f2-b598-ff8a47f62174 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:44.672059 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e179f-9710-43f2-b598-ff8a47f62174 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:44.672398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b5a7a-dcda-41f7-b3c3-3c60f919036f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:44.672963 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e179f-9710-43f2-b598-ff8a47f62174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:44.721337 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2d7e179f-9710-43f2-b598-ff8a47f62174 None None] MFA Rules not processed for user `aa475ec9a7ff4bc999bc83c53eb1f5eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:44.722798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2d7e179f-9710-43f2-b598-ff8a47f62174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:44.732913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-100b5a7a-dcda-41f7-b3c3-3c60f919036f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc7d44901cc74bffaefc8684553f72cb', 'request_id': 'req-100b5a7a-dcda-41f7-b3c3-3c60f919036f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:44.747132 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-100b5a7a-dcda-41f7-b3c3-3c60f919036f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc7d44901cc74bffaefc8684553f72cb', 'request_id': 'req-100b5a7a-dcda-41f7-b3c3-3c60f919036f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:44.755867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-100b5a7a-dcda-41f7-b3c3-3c60f919036f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc7d44901cc74bffaefc8684553f72cb', 'request_id': 'req-100b5a7a-dcda-41f7-b3c3-3c60f919036f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:44.773550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-100b5a7a-dcda-41f7-b3c3-3c60f919036f admin admin] The token cache is being invalidate because project dc7d44901cc74bffaefc8684553f72cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:48:44.774149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-100b5a7a-dcda-41f7-b3c3-3c60f919036f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:44.776061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-100b5a7a-dcda-41f7-b3c3-3c60f919036f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:44.777941 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4085/8091] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:48:44 2022] DELETE /identity/v3/projects/dc7d44901cc74bffaefc8684553f72cb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:44.782528 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b5a7a-dcda-41f7-b3c3-3c60f919036f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:44.784199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-100b5a7a-dcda-41f7-b3c3-3c60f919036f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:44.812723 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4007/8092] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:44.813905 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e179f-9710-43f2-b598-ff8a47f62174 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:44.816263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2d7e179f-9710-43f2-b598-ff8a47f62174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:44.862600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b5a7a-dcda-41f7-b3c3-3c60f919036f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:44.866804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54ef2e-53b5-494b-beb2-4487b08e75eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:44.867463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54ef2e-53b5-494b-beb2-4487b08e75eb service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:44.867747 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54ef2e-53b5-494b-beb2-4487b08e75eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:44.868183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54ef2e-53b5-494b-beb2-4487b08e75eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:44.871333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6b54ef2e-53b5-494b-beb2-4487b08e75eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:44.923322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e179f-9710-43f2-b598-ff8a47f62174 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:44.930270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0916052-221f-4b08-9c26-6a61eeede0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:44.932150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0916052-221f-4b08-9c26-6a61eeede0a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:44.932150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0916052-221f-4b08-9c26-6a61eeede0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:44.932564 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0916052-221f-4b08-9c26-6a61eeede0a3 admin admin] PATH_INFO: `/v3/projects/cb33369bbc8b4996bb1c935099080764/users/d3265315a94a4891b32389566b9b8eb4/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:44.935867 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0916052-221f-4b08-9c26-6a61eeede0a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb33369bbc8b4996bb1c935099080764, user_id=d3265315a94a4891b32389566b9b8eb4, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:44.939919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0916052-221f-4b08-9c26-6a61eeede0a3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:44.961680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54ef2e-53b5-494b-beb2-4487b08e75eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:44.963405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54ef2e-53b5-494b-beb2-4487b08e75eb service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:44.972811 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4008/8093] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:48:44 2022] PUT /identity/v3/projects/cb33369bbc8b4996bb1c935099080764/users/d3265315a94a4891b32389566b9b8eb4/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:44.974962 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801ade9-267c-4602-8edf-5d5f47e7c919 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:44.975329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801ade9-267c-4602-8edf-5d5f47e7c919 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:44.975627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801ade9-267c-4602-8edf-5d5f47e7c919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:44.976578 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4086/8094] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:48:44.977268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54ef2e-53b5-494b-beb2-4487b08e75eb service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:44.978816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6b54ef2e-53b5-494b-beb2-4487b08e75eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:44.999727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54ef2e-53b5-494b-beb2-4487b08e75eb service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:45.010876 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d801ade9-267c-4602-8edf-5d5f47e7c919 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:45.014705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d801ade9-267c-4602-8edf-5d5f47e7c919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:45.033811 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:45.084720 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:45.106156 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4009/8095] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:45.107669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c372a-a6c9-4d11-8ca9-8fa4ad5e1459 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:45.108069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c372a-a6c9-4d11-8ca9-8fa4ad5e1459 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:45.108397 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c372a-a6c9-4d11-8ca9-8fa4ad5e1459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:45.116004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6db951-d6aa-47f5-852c-8056a3617ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:45.116575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6db951-d6aa-47f5-852c-8056a3617ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:45.116904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6db951-d6aa-47f5-852c-8056a3617ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:45.117173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6db951-d6aa-47f5-852c-8056a3617ea1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:45.118015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6db951-d6aa-47f5-852c-8056a3617ea1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:45.120245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6db951-d6aa-47f5-852c-8056a3617ea1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:45.151589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-654c372a-a6c9-4d11-8ca9-8fa4ad5e1459 None None] MFA Rules not processed for user `d3265315a94a4891b32389566b9b8eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:45.153231 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-654c372a-a6c9-4d11-8ca9-8fa4ad5e1459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:45.159716 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4087/8096] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:48:44 2022] POST /identity/v3/projects => generated 371 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:45.161818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2b95c-aeab-4c52-b40a-8688cc396f08 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:45.162173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2b95c-aeab-4c52-b40a-8688cc396f08 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:45.162628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2b95c-aeab-4c52-b40a-8688cc396f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:45.190054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ead2b95c-aeab-4c52-b40a-8688cc396f08 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:45.191414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ead2b95c-aeab-4c52-b40a-8688cc396f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:45.269241 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4010/8097] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:45 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:45.270375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c372a-a6c9-4d11-8ca9-8fa4ad5e1459 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:45.279821 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4088/8098] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:45.284993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2b95c-aeab-4c52-b40a-8688cc396f08 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:45.297911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c372a-a6c9-4d11-8ca9-8fa4ad5e1459 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:45.298116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2b95c-aeab-4c52-b40a-8688cc396f08 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:45.302845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7354e82-034b-49d7-a1d7-b6d2f1028225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:45.303466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7354e82-034b-49d7-a1d7-b6d2f1028225 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:45.303756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7354e82-034b-49d7-a1d7-b6d2f1028225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:45.304202 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7354e82-034b-49d7-a1d7-b6d2f1028225 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:45.304817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7354e82-034b-49d7-a1d7-b6d2f1028225 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:45.305017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56a5ca-0d9b-4e20-8ea1-137809544924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:45.305960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56a5ca-0d9b-4e20-8ea1-137809544924 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:45.306541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56a5ca-0d9b-4e20-8ea1-137809544924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:45.306889 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7354e82-034b-49d7-a1d7-b6d2f1028225 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:45.307190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f56a5ca-0d9b-4e20-8ea1-137809544924 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:45.308883 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56a5ca-0d9b-4e20-8ea1-137809544924 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:48:45.324246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56a5ca-0d9b-4e20-8ea1-137809544924 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:45.326837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f56a5ca-0d9b-4e20-8ea1-137809544924 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:45.341166 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4011/8099] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:48:45 2022] POST /identity/v3/users => generated 292 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:45.342372 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4089/8100] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:48:45.348159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56a5ca-0d9b-4e20-8ea1-137809544924 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:45.348931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7354e82-034b-49d7-a1d7-b6d2f1028225 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:45.350954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f7354e82-034b-49d7-a1d7-b6d2f1028225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:45.362902 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f56a5ca-0d9b-4e20-8ea1-137809544924 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:45.369580 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a1d00-9d98-46cf-ba9a-384fa8674e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:45.370453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a1d00-9d98-46cf-ba9a-384fa8674e99 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:45.371021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a1d00-9d98-46cf-ba9a-384fa8674e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:45.371360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a1d00-9d98-46cf-ba9a-384fa8674e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:45.372539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a1d00-9d98-46cf-ba9a-384fa8674e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:45.374603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a1d00-9d98-46cf-ba9a-384fa8674e99 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:45.392839 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4090/8101] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:45.392839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a1d00-9d98-46cf-ba9a-384fa8674e99 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:45.405076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a1d00-9d98-46cf-ba9a-384fa8674e99 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:45.412323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453eb5ff-ac63-4291-a388-ac113561dce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:45.412977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453eb5ff-ac63-4291-a388-ac113561dce9 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:45.413369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453eb5ff-ac63-4291-a388-ac113561dce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:45.413571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453eb5ff-ac63-4291-a388-ac113561dce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:45.414328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453eb5ff-ac63-4291-a388-ac113561dce9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:45.417182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453eb5ff-ac63-4291-a388-ac113561dce9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:45.453491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7354e82-034b-49d7-a1d7-b6d2f1028225 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:45.457364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94123b-7343-4898-a838-aa6a28f91e31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:45.457989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94123b-7343-4898-a838-aa6a28f91e31 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:45.458259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94123b-7343-4898-a838-aa6a28f91e31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:45.459022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94123b-7343-4898-a838-aa6a28f91e31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:45.469205 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4091/8102] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:48:45 2022] POST /identity/v3/projects => generated 409 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:45.470951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453eb5ff-ac63-4291-a388-ac113561dce9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:45.556079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453eb5ff-ac63-4291-a388-ac113561dce9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:45.566084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8c937-a73e-49e9-ba78-056d5958d7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:45.566084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8c937-a73e-49e9-ba78-056d5958d7b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:45.566084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8c937-a73e-49e9-ba78-056d5958d7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:45.566084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8c937-a73e-49e9-ba78-056d5958d7b4 admin admin] PATH_INFO: `/v3/projects/906b7ffb92b84af48b60ec941a58cf1a/users/ded2ee9c08524abda640d5fa451a178e/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:45.566556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94123b-7343-4898-a838-aa6a28f91e31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:45.569041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94123b-7343-4898-a838-aa6a28f91e31 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:45.579099 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:45.591493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8c937-a73e-49e9-ba78-056d5958d7b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=906b7ffb92b84af48b60ec941a58cf1a, user_id=ded2ee9c08524abda640d5fa451a178e, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:45.595205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8c937-a73e-49e9-ba78-056d5958d7b4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:45.604329 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4012/8103] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:45 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:48:45.606476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94123b-7343-4898-a838-aa6a28f91e31 service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:45.646201 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4092/8104] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:48:45 2022] PUT /identity/v3/projects/906b7ffb92b84af48b60ec941a58cf1a/users/ded2ee9c08524abda640d5fa451a178e/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:45.648003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8c937-a73e-49e9-ba78-056d5958d7b4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:45.648329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94123b-7343-4898-a838-aa6a28f91e31 service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:45.672744 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:45.776808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6353c06-26a1-4714-bc39-b3dad51e3c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:45.777463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6353c06-26a1-4714-bc39-b3dad51e3c13 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:45.777748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6353c06-26a1-4714-bc39-b3dad51e3c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:45.778028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6353c06-26a1-4714-bc39-b3dad51e3c13 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:45.778978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6353c06-26a1-4714-bc39-b3dad51e3c13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:45.782440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6353c06-26a1-4714-bc39-b3dad51e3c13 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:45.801556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8c937-a73e-49e9-ba78-056d5958d7b4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:45.814145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2824190-d830-4fdb-8597-3b8729508710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:45.815531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2824190-d830-4fdb-8597-3b8729508710 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:45.816209 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2824190-d830-4fdb-8597-3b8729508710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:45.816858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2824190-d830-4fdb-8597-3b8729508710 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:45.820961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2824190-d830-4fdb-8597-3b8729508710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:45.824520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2824190-d830-4fdb-8597-3b8729508710 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:45.835746 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4013/8105] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:48:45 2022] POST /identity/v3/users => generated 305 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:45.841440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6353c06-26a1-4714-bc39-b3dad51e3c13 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:45.859419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6353c06-26a1-4714-bc39-b3dad51e3c13 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:45.865367 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4093/8106] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:45.866461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2824190-d830-4fdb-8597-3b8729508710 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:45.881146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6c7c6-b8d9-4f9f-9d77-9405caaf31bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:45.883848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6c7c6-b8d9-4f9f-9d77-9405caaf31bf admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:45.884803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6c7c6-b8d9-4f9f-9d77-9405caaf31bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:45.885389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6c7c6-b8d9-4f9f-9d77-9405caaf31bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:45.886280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6c7c6-b8d9-4f9f-9d77-9405caaf31bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:45.889574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2824190-d830-4fdb-8597-3b8729508710 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:45.889759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6c7c6-b8d9-4f9f-9d77-9405caaf31bf admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:45.897899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966379a-6da7-4fdf-a56d-dc4a6038d645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:45.898992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966379a-6da7-4fdf-a56d-dc4a6038d645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:45.899488 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966379a-6da7-4fdf-a56d-dc4a6038d645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:45.900021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966379a-6da7-4fdf-a56d-dc4a6038d645 admin admin] PATH_INFO: `/v3/users/e2ae4431ecc942eb9d7df988fd41ca7c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:45.902977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966379a-6da7-4fdf-a56d-dc4a6038d645 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2ae4431ecc942eb9d7df988fd41ca7c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:45.907257 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4014/8107] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:45.909439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6c7c6-b8d9-4f9f-9d77-9405caaf31bf admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:45.912385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966379a-6da7-4fdf-a56d-dc4a6038d645 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:45.925746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6c7c6-b8d9-4f9f-9d77-9405caaf31bf admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:45.932381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce128ecf-c3a3-46e4-a5ab-fbfa032d91e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:45.933313 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce128ecf-c3a3-46e4-a5ab-fbfa032d91e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:45.934207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce128ecf-c3a3-46e4-a5ab-fbfa032d91e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:45.934660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce128ecf-c3a3-46e4-a5ab-fbfa032d91e1 admin admin] PATH_INFO: `/v3/projects/906b7ffb92b84af48b60ec941a58cf1a/users/ded2ee9c08524abda640d5fa451a178e/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:45.937705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce128ecf-c3a3-46e4-a5ab-fbfa032d91e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=906b7ffb92b84af48b60ec941a58cf1a, user_id=ded2ee9c08524abda640d5fa451a178e, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:45.941802 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce128ecf-c3a3-46e4-a5ab-fbfa032d91e1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:45.989456 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4015/8108] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:48:45 2022] PUT /identity/v3/projects/906b7ffb92b84af48b60ec941a58cf1a/users/ded2ee9c08524abda640d5fa451a178e/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:45.994425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce128ecf-c3a3-46e4-a5ab-fbfa032d91e1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:46.021304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5966379a-6da7-4fdf-a56d-dc4a6038d645 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2ae4431ecc942eb9d7df988fd41ca7c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:46.036686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5966379a-6da7-4fdf-a56d-dc4a6038d645 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2ae4431ecc942eb9d7df988fd41ca7c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:46.069998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5966379a-6da7-4fdf-a56d-dc4a6038d645 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2ae4431ecc942eb9d7df988fd41ca7c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:46.070961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5966379a-6da7-4fdf-a56d-dc4a6038d645 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2ae4431ecc942eb9d7df988fd41ca7c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:46.085630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-5966379a-6da7-4fdf-a56d-dc4a6038d645 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2ae4431ecc942eb9d7df988fd41ca7c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:46.095358 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4094/8109] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:48:45 2022] DELETE /identity/v3/users/e2ae4431ecc942eb9d7df988fd41ca7c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:46.101612 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74035fb8-7451-4459-b3e8-45013440b5d9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:46.101891 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74035fb8-7451-4459-b3e8-45013440b5d9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:46.102173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74035fb8-7451-4459-b3e8-45013440b5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:46.148613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-74035fb8-7451-4459-b3e8-45013440b5d9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:46.149817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-74035fb8-7451-4459-b3e8-45013440b5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:46.159692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce128ecf-c3a3-46e4-a5ab-fbfa032d91e1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:46.284053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee68a7e-da9b-4dd9-afb7-e32021e52567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:46.284920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee68a7e-da9b-4dd9-afb7-e32021e52567 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:46.284920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee68a7e-da9b-4dd9-afb7-e32021e52567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:46.285208 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee68a7e-da9b-4dd9-afb7-e32021e52567 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:46.285884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee68a7e-da9b-4dd9-afb7-e32021e52567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:46.287532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee68a7e-da9b-4dd9-afb7-e32021e52567 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:46.290718 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:46.319109 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4016/8110] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:46.320842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee68a7e-da9b-4dd9-afb7-e32021e52567 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:46.325943 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-fee68a7e-da9b-4dd9-afb7-e32021e52567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:46.333226 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4095/8111] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:48:46.350208 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee68a7e-da9b-4dd9-afb7-e32021e52567 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:46.357860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7805a428-d419-4f71-9339-20f92c5bfdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:46.359104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805a428-d419-4f71-9339-20f92c5bfdcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:46.359695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805a428-d419-4f71-9339-20f92c5bfdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:46.360277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7805a428-d419-4f71-9339-20f92c5bfdcc admin admin] PATH_INFO: `/v3/projects/5927cf3d972542768a09cdb281dcce53/users/243cda462af54e9db53fa176c1cb8d82/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:46.377858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74035fb8-7451-4459-b3e8-45013440b5d9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:46.380268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-74035fb8-7451-4459-b3e8-45013440b5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:46.413528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805a428-d419-4f71-9339-20f92c5bfdcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5927cf3d972542768a09cdb281dcce53, user_id=243cda462af54e9db53fa176c1cb8d82, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:46.425945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7805a428-d419-4f71-9339-20f92c5bfdcc admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:46.437652 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:46.461660 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4017/8112] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:48:46 2022] PUT /identity/v3/projects/5927cf3d972542768a09cdb281dcce53/users/243cda462af54e9db53fa176c1cb8d82/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:46.474379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bfb9a-720d-45e0-956e-20f6c065349f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:46.475086 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bfb9a-720d-45e0-956e-20f6c065349f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:46.476109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bfb9a-720d-45e0-956e-20f6c065349f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:46.513264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74035fb8-7451-4459-b3e8-45013440b5d9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:46.541417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-f39bfb9a-720d-45e0-956e-20f6c065349f None None] MFA Rules not processed for user `243cda462af54e9db53fa176c1cb8d82`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:46.543771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f39bfb9a-720d-45e0-956e-20f6c065349f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:46.617424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f052c-5f1e-49dd-ae46-b12c4838dfc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:46.620087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f052c-5f1e-49dd-ae46-b12c4838dfc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:46.620748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f052c-5f1e-49dd-ae46-b12c4838dfc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:46.621377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f052c-5f1e-49dd-ae46-b12c4838dfc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:46.669363 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4018/8113] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:46 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:46.675122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39bfb9a-720d-45e0-956e-20f6c065349f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:46.774583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f052c-5f1e-49dd-ae46-b12c4838dfc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:46.776589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f052c-5f1e-49dd-ae46-b12c4838dfc9 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:46.791969 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4096/8114] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:48:46.819307 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39bfb9a-720d-45e0-956e-20f6c065349f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:46.826155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47978289-90e3-4343-9a18-263d0155cc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:46.827206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47978289-90e3-4343-9a18-263d0155cc35 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:46.827567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47978289-90e3-4343-9a18-263d0155cc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:46.828302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47978289-90e3-4343-9a18-263d0155cc35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:46.829096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47978289-90e3-4343-9a18-263d0155cc35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:46.833708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47978289-90e3-4343-9a18-263d0155cc35 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:46.923153 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4019/8115] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:48:46 2022] POST /identity/v3/projects => generated 409 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:46.927591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f052c-5f1e-49dd-ae46-b12c4838dfc9 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:46.942063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f052c-5f1e-49dd-ae46-b12c4838dfc9 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:47.139868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709d62e-7241-4f7c-b552-dcc8be1a4565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:47.141472 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709d62e-7241-4f7c-b552-dcc8be1a4565 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:47.141632 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709d62e-7241-4f7c-b552-dcc8be1a4565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:47.142063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709d62e-7241-4f7c-b552-dcc8be1a4565 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:47.143277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709d62e-7241-4f7c-b552-dcc8be1a4565 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:47.149050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709d62e-7241-4f7c-b552-dcc8be1a4565 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:47.166535 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:47.201934 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4097/8116] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:48:46 2022] POST /identity/v3/users => generated 311 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:47.204690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47978289-90e3-4343-9a18-263d0155cc35 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:47.236456 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47978289-90e3-4343-9a18-263d0155cc35 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:47.248897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770a67c-a6ad-40e1-baee-bb9a82b35361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:47.249767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770a67c-a6ad-40e1-baee-bb9a82b35361 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:47.250346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770a67c-a6ad-40e1-baee-bb9a82b35361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:47.250346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770a67c-a6ad-40e1-baee-bb9a82b35361 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:47.253465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770a67c-a6ad-40e1-baee-bb9a82b35361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:47.258729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770a67c-a6ad-40e1-baee-bb9a82b35361 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:47.284889 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4020/8117] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:47.288113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709d62e-7241-4f7c-b552-dcc8be1a4565 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:47.360447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869f86e-c7b2-479b-8a69-f76ee211340e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:47.360812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869f86e-c7b2-479b-8a69-f76ee211340e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:47.361237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869f86e-c7b2-479b-8a69-f76ee211340e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:47.361681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709d62e-7241-4f7c-b552-dcc8be1a4565 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:47.380726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7a886-f82b-41d5-9b62-186e65aa4d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:47.381637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7a886-f82b-41d5-9b62-186e65aa4d93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:47.381907 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7a886-f82b-41d5-9b62-186e65aa4d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:47.382174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7a886-f82b-41d5-9b62-186e65aa4d93 admin admin] PATH_INFO: `/v3/projects/3c91432d69bf408188c70a03d2fc539c/users/64bc280262fe4fc9aab8cf3a907f0bbc/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:47.425877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7a886-f82b-41d5-9b62-186e65aa4d93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c91432d69bf408188c70a03d2fc539c, user_id=64bc280262fe4fc9aab8cf3a907f0bbc, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:47.429215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7a886-f82b-41d5-9b62-186e65aa4d93 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:47.440069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2869f86e-c7b2-479b-8a69-f76ee211340e None None] MFA Rules not processed for user `ded2ee9c08524abda640d5fa451a178e`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:47.448925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2869f86e-c7b2-479b-8a69-f76ee211340e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:47.450628 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4098/8118] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:48:47 2022] PUT /identity/v3/projects/3c91432d69bf408188c70a03d2fc539c/users/64bc280262fe4fc9aab8cf3a907f0bbc/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:47.454620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7a886-f82b-41d5-9b62-186e65aa4d93 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:47.577840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7a886-f82b-41d5-9b62-186e65aa4d93 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:47.591266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795698ab-43e2-4a5e-b7dc-1b4b6aedd0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:47.591943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795698ab-43e2-4a5e-b7dc-1b4b6aedd0cc admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:47.592241 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795698ab-43e2-4a5e-b7dc-1b4b6aedd0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:47.594268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795698ab-43e2-4a5e-b7dc-1b4b6aedd0cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:47.596505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795698ab-43e2-4a5e-b7dc-1b4b6aedd0cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:47.601556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795698ab-43e2-4a5e-b7dc-1b4b6aedd0cc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:47.636173 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4099/8119] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:47.640172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795698ab-43e2-4a5e-b7dc-1b4b6aedd0cc admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:47.645556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-795698ab-43e2-4a5e-b7dc-1b4b6aedd0cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:47.659196 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:47.694743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795698ab-43e2-4a5e-b7dc-1b4b6aedd0cc admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:47.700419 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4021/8120] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:47.701549 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869f86e-c7b2-479b-8a69-f76ee211340e None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:47.725471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e2ad2-a992-49f1-adbd-e9b14da8d84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:47.726212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e2ad2-a992-49f1-adbd-e9b14da8d84f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:47.726481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e2ad2-a992-49f1-adbd-e9b14da8d84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:47.727336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e2ad2-a992-49f1-adbd-e9b14da8d84f admin admin] PATH_INFO: `/v3/projects/b45a53f450fb4866b5ffe1820b6d5da7` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:47.729220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e2ad2-a992-49f1-adbd-e9b14da8d84f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b45a53f450fb4866b5ffe1820b6d5da7)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:47.731190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e2ad2-a992-49f1-adbd-e9b14da8d84f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:47.747323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869f86e-c7b2-479b-8a69-f76ee211340e None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:47.761303 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36075c-34e9-4149-9149-83c9be8502c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:47.762147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36075c-34e9-4149-9149-83c9be8502c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:47.762494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36075c-34e9-4149-9149-83c9be8502c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:47.763103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36075c-34e9-4149-9149-83c9be8502c2 admin admin] PATH_INFO: `/v3/projects/3c91432d69bf408188c70a03d2fc539c/users/64bc280262fe4fc9aab8cf3a907f0bbc/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:47.766561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36075c-34e9-4149-9149-83c9be8502c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c91432d69bf408188c70a03d2fc539c, user_id=64bc280262fe4fc9aab8cf3a907f0bbc, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:47.770104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36075c-34e9-4149-9149-83c9be8502c2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:47.796003 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4022/8121] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:48:47 2022] PUT /identity/v3/projects/3c91432d69bf408188c70a03d2fc539c/users/64bc280262fe4fc9aab8cf3a907f0bbc/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:47.796003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debf9c3-7063-40c3-b377-19b0ee7ffc1b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:47.796003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debf9c3-7063-40c3-b377-19b0ee7ffc1b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:47.796003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debf9c3-7063-40c3-b377-19b0ee7ffc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:47.823075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-5debf9c3-7063-40c3-b377-19b0ee7ffc1b None None] MFA Rules not processed for user `aa475ec9a7ff4bc999bc83c53eb1f5eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:47.824395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5debf9c3-7063-40c3-b377-19b0ee7ffc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:47.832904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2d8e2ad2-a992-49f1-adbd-e9b14da8d84f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b45a53f450fb4866b5ffe1820b6d5da7', 'request_id': 'req-2d8e2ad2-a992-49f1-adbd-e9b14da8d84f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:47.857412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2d8e2ad2-a992-49f1-adbd-e9b14da8d84f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b45a53f450fb4866b5ffe1820b6d5da7', 'request_id': 'req-2d8e2ad2-a992-49f1-adbd-e9b14da8d84f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:47.878825 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2d8e2ad2-a992-49f1-adbd-e9b14da8d84f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b45a53f450fb4866b5ffe1820b6d5da7', 'request_id': 'req-2d8e2ad2-a992-49f1-adbd-e9b14da8d84f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:47.912143 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2d8e2ad2-a992-49f1-adbd-e9b14da8d84f admin admin] The token cache is being invalidate because project b45a53f450fb4866b5ffe1820b6d5da7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:48:47.912492 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2d8e2ad2-a992-49f1-adbd-e9b14da8d84f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:47.914235 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2d8e2ad2-a992-49f1-adbd-e9b14da8d84f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:47.919607 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4100/8122] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:48:47 2022] DELETE /identity/v3/projects/b45a53f450fb4866b5ffe1820b6d5da7 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:47.920762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ecf94-6d74-4305-b3f6-ed6d50d5a8d5 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:47.921050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ecf94-6d74-4305-b3f6-ed6d50d5a8d5 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:47.921326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ecf94-6d74-4305-b3f6-ed6d50d5a8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:47.924523 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4023/8123] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:47.929372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debf9c3-7063-40c3-b377-19b0ee7ffc1b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:47.929372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5debf9c3-7063-40c3-b377-19b0ee7ffc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:48.009009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e99ecf94-6d74-4305-b3f6-ed6d50d5a8d5 None None] MFA Rules not processed for user `64bc280262fe4fc9aab8cf3a907f0bbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:48.010860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e99ecf94-6d74-4305-b3f6-ed6d50d5a8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:48.077942 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:48.111532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debf9c3-7063-40c3-b377-19b0ee7ffc1b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:48.126183 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b890da-aec6-4784-8933-4885768a36ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:48.127188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b890da-aec6-4784-8933-4885768a36ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:48.127669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b890da-aec6-4784-8933-4885768a36ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:48.128418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b890da-aec6-4784-8933-4885768a36ed admin admin] PATH_INFO: `/v3/users/d3265315a94a4891b32389566b9b8eb4` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:48.130103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b890da-aec6-4784-8933-4885768a36ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3265315a94a4891b32389566b9b8eb4)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:48.132783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b890da-aec6-4784-8933-4885768a36ed admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:48.185387 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4101/8124] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:47 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:48.188788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ecf94-6d74-4305-b3f6-ed6d50d5a8d5 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:48.194761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e99ecf94-6d74-4305-b3f6-ed6d50d5a8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:48.236128 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-90b890da-aec6-4784-8933-4885768a36ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3265315a94a4891b32389566b9b8eb4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:48.245405 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-90b890da-aec6-4784-8933-4885768a36ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3265315a94a4891b32389566b9b8eb4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:48.289892 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-90b890da-aec6-4784-8933-4885768a36ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3265315a94a4891b32389566b9b8eb4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:48.294280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-90b890da-aec6-4784-8933-4885768a36ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3265315a94a4891b32389566b9b8eb4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:48.308094 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:48.325383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-90b890da-aec6-4784-8933-4885768a36ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3265315a94a4891b32389566b9b8eb4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:48.355135 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4024/8125] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:48:47 2022] DELETE /identity/v3/users/d3265315a94a4891b32389566b9b8eb4 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:48.357079 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b890da-aec6-4784-8933-4885768a36ed admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:48.377534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-90b890da-aec6-4784-8933-4885768a36ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:48.468639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ecf94-6d74-4305-b3f6-ed6d50d5a8d5 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:48.614315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c58b01-2bac-4d06-a51f-e3cf8f271854 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:48.615268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c58b01-2bac-4d06-a51f-e3cf8f271854 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:48.615758 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c58b01-2bac-4d06-a51f-e3cf8f271854 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:48.616198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c58b01-2bac-4d06-a51f-e3cf8f271854 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:48.618993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a9c58b01-2bac-4d06-a51f-e3cf8f271854 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:48.643599 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b890da-aec6-4784-8933-4885768a36ed admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:48.665382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51f5c9-61bf-4489-acf6-a91f3995636d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:48.666503 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51f5c9-61bf-4489-acf6-a91f3995636d service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:48.666783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51f5c9-61bf-4489-acf6-a91f3995636d service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:48.667051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51f5c9-61bf-4489-acf6-a91f3995636d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:48.677574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3a51f5c9-61bf-4489-acf6-a91f3995636d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:48.808183 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:48.811324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51f5c9-61bf-4489-acf6-a91f3995636d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:48.817538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51f5c9-61bf-4489-acf6-a91f3995636d service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:48.842159 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4025/8126] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:48 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:48:48.860898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c58b01-2bac-4d06-a51f-e3cf8f271854 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:48.862599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c58b01-2bac-4d06-a51f-e3cf8f271854 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:48.896362 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4102/8127] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 710 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:48:49.355763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51f5c9-61bf-4489-acf6-a91f3995636d service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:49.373994 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c58b01-2bac-4d06-a51f-e3cf8f271854 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:49.375521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a9c58b01-2bac-4d06-a51f-e3cf8f271854 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:49.380625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51f5c9-61bf-4489-acf6-a91f3995636d service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:49.409139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5b17f-0b59-4e17-a3da-f9401b19c5dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:49.409786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5b17f-0b59-4e17-a3da-f9401b19c5dd service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:49.410062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5b17f-0b59-4e17-a3da-f9401b19c5dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:49.410329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5b17f-0b59-4e17-a3da-f9401b19c5dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:49.413399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-14b5b17f-0b59-4e17-a3da-f9401b19c5dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:49.581469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c58b01-2bac-4d06-a51f-e3cf8f271854 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:49.593184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b5b17f-0b59-4e17-a3da-f9401b19c5dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:49.594611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b5b17f-0b59-4e17-a3da-f9401b19c5dd service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:49.595929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c96466-aa8a-42a7-951c-cdce7a3b634b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:49.596592 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c96466-aa8a-42a7-951c-cdce7a3b634b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:49.596894 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c96466-aa8a-42a7-951c-cdce7a3b634b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:49.597201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c96466-aa8a-42a7-951c-cdce7a3b634b admin admin] PATH_INFO: `/v3/projects/cb33369bbc8b4996bb1c935099080764` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:49.606674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c96466-aa8a-42a7-951c-cdce7a3b634b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb33369bbc8b4996bb1c935099080764)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:49.609040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c96466-aa8a-42a7-951c-cdce7a3b634b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:49.630251 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4026/8128] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:49 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:48:49.631449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5b17f-0b59-4e17-a3da-f9401b19c5dd service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:49.640153 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-14b5b17f-0b59-4e17-a3da-f9401b19c5dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:49.705807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-89c96466-aa8a-42a7-951c-cdce7a3b634b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb33369bbc8b4996bb1c935099080764', 'request_id': 'req-89c96466-aa8a-42a7-951c-cdce7a3b634b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:49.721744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-89c96466-aa8a-42a7-951c-cdce7a3b634b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb33369bbc8b4996bb1c935099080764', 'request_id': 'req-89c96466-aa8a-42a7-951c-cdce7a3b634b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:49.752451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-89c96466-aa8a-42a7-951c-cdce7a3b634b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb33369bbc8b4996bb1c935099080764', 'request_id': 'req-89c96466-aa8a-42a7-951c-cdce7a3b634b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:49.779351 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-89c96466-aa8a-42a7-951c-cdce7a3b634b admin admin] The token cache is being invalidate because project cb33369bbc8b4996bb1c935099080764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:48:49.779742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-89c96466-aa8a-42a7-951c-cdce7a3b634b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:49.781216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-89c96466-aa8a-42a7-951c-cdce7a3b634b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:49.790616 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:49.791699 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4103/8129] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:48:49 2022] DELETE /identity/v3/projects/cb33369bbc8b4996bb1c935099080764 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:49.793575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408ff05-1115-42c3-9eb3-8a2375ba427e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:49.793939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408ff05-1115-42c3-9eb3-8a2375ba427e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:49.794281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408ff05-1115-42c3-9eb3-8a2375ba427e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:49.845959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f408ff05-1115-42c3-9eb3-8a2375ba427e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:49.847265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f408ff05-1115-42c3-9eb3-8a2375ba427e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:49.945915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5b17f-0b59-4e17-a3da-f9401b19c5dd service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:50.032446 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4104/8130] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:50.049107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbecf9-b93f-45e3-a35f-e40b823e9bd8 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:50.049530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbecf9-b93f-45e3-a35f-e40b823e9bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:50.049993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbecf9-b93f-45e3-a35f-e40b823e9bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:50.159643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e4cbecf9-b93f-45e3-a35f-e40b823e9bd8 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:50.161817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e4cbecf9-b93f-45e3-a35f-e40b823e9bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:50.222081 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4105/8131] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:50.227725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbecf9-b93f-45e3-a35f-e40b823e9bd8 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:50.258791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbecf9-b93f-45e3-a35f-e40b823e9bd8 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:50.267543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3447a13-544f-476f-b499-d55bf9bb6951 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:50.268823 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3447a13-544f-476f-b499-d55bf9bb6951 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:50.269378 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3447a13-544f-476f-b499-d55bf9bb6951 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:50.270052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3447a13-544f-476f-b499-d55bf9bb6951 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:50.273264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f3447a13-544f-476f-b499-d55bf9bb6951 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:50.276517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a5703-c84d-48a1-8560-887a32ae12e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:50.278366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a5703-c84d-48a1-8560-887a32ae12e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:50.281348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a5703-c84d-48a1-8560-887a32ae12e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:50.281665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a5703-c84d-48a1-8560-887a32ae12e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:50.283364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a5703-c84d-48a1-8560-887a32ae12e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:48:50.283795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a5703-c84d-48a1-8560-887a32ae12e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:50.288722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a5703-c84d-48a1-8560-887a32ae12e2 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:50.295329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3447a13-544f-476f-b499-d55bf9bb6951 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:50.297556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3447a13-544f-476f-b499-d55bf9bb6951 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:50.317359 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:50.331342 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4027/8132] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:48:50.334103 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4106/8133] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:48:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:48:50.341013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3447a13-544f-476f-b499-d55bf9bb6951 service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:50.366756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3447a13-544f-476f-b499-d55bf9bb6951 service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:50.373452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9d958-44ab-4851-b11c-fffdcdf2e1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:50.375261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9d958-44ab-4851-b11c-fffdcdf2e1b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:50.375935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9d958-44ab-4851-b11c-fffdcdf2e1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:50.376308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9d958-44ab-4851-b11c-fffdcdf2e1b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:50.377365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9d958-44ab-4851-b11c-fffdcdf2e1b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:50.380143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9d958-44ab-4851-b11c-fffdcdf2e1b1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:50.429864 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4028/8134] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:48:50 2022] POST /identity/v3/projects => generated 373 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:48:50.435779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a5703-c84d-48a1-8560-887a32ae12e2 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:50.452899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a5703-c84d-48a1-8560-887a32ae12e2 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:50.663546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c21f5-70ee-4e72-ae76-02c9bc117de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:50.692878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c21f5-70ee-4e72-ae76-02c9bc117de1 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:50.693711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c21f5-70ee-4e72-ae76-02c9bc117de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:50.713365 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c21f5-70ee-4e72-ae76-02c9bc117de1 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:50.719752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c21f5-70ee-4e72-ae76-02c9bc117de1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:50.739768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c21f5-70ee-4e72-ae76-02c9bc117de1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:50.848928 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4107/8135] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:48:50 2022] POST /identity/v3/users => generated 287 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:48:50.856161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9d958-44ab-4851-b11c-fffdcdf2e1b1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:50.894614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9d958-44ab-4851-b11c-fffdcdf2e1b1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:50.907979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef969d-d44a-45f0-9fa1-84b2fc05e1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:50.916637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef969d-d44a-45f0-9fa1-84b2fc05e1ed admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:50.916930 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef969d-d44a-45f0-9fa1-84b2fc05e1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:50.922552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef969d-d44a-45f0-9fa1-84b2fc05e1ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:50.923297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef969d-d44a-45f0-9fa1-84b2fc05e1ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:50.938682 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c21f5-70ee-4e72-ae76-02c9bc117de1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:50.941086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-016c21f5-70ee-4e72-ae76-02c9bc117de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:50.960475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef969d-d44a-45f0-9fa1-84b2fc05e1ed admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:51.013756 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4029/8136] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:48:51.018965 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef969d-d44a-45f0-9fa1-84b2fc05e1ed admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:51.056797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef969d-d44a-45f0-9fa1-84b2fc05e1ed admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:51.074821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d620b-57bf-433c-ba6c-a48dd1175639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:51.076810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d620b-57bf-433c-ba6c-a48dd1175639 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:51.077133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d620b-57bf-433c-ba6c-a48dd1175639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:51.077407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d620b-57bf-433c-ba6c-a48dd1175639 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:51.085366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d620b-57bf-433c-ba6c-a48dd1175639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:51.085366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d620b-57bf-433c-ba6c-a48dd1175639 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:51.113118 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4030/8137] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:48:51.118068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d620b-57bf-433c-ba6c-a48dd1175639 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:51.132788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d620b-57bf-433c-ba6c-a48dd1175639 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:51.140450 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd05c6-c80f-4fde-8bac-2dc691821d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:51.141484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd05c6-c80f-4fde-8bac-2dc691821d55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:51.141979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd05c6-c80f-4fde-8bac-2dc691821d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:51.142474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd05c6-c80f-4fde-8bac-2dc691821d55 admin admin] PATH_INFO: `/v3/projects/af2ec23a1ad44b758d114dd4be231a0c/users/6d07b15f0f124389927b3afd111639a1/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:51.166620 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd05c6-c80f-4fde-8bac-2dc691821d55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af2ec23a1ad44b758d114dd4be231a0c, user_id=6d07b15f0f124389927b3afd111639a1, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:51.169862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd05c6-c80f-4fde-8bac-2dc691821d55 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:51.194776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c21f5-70ee-4e72-ae76-02c9bc117de1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:51.199716 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4031/8138] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:48:51 2022] PUT /identity/v3/projects/af2ec23a1ad44b758d114dd4be231a0c/users/6d07b15f0f124389927b3afd111639a1/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:51.211650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f108a8f-b44d-4177-b925-5565961aa238 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:51.211757 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f108a8f-b44d-4177-b925-5565961aa238 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:51.212319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f108a8f-b44d-4177-b925-5565961aa238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:51.265257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-4f108a8f-b44d-4177-b925-5565961aa238 None None] MFA Rules not processed for user `6d07b15f0f124389927b3afd111639a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:51.267198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4f108a8f-b44d-4177-b925-5565961aa238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:51.336847 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752a327-09f4-44c7-98f1-f8a1937e77bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:51.337671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752a327-09f4-44c7-98f1-f8a1937e77bc service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:51.338192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752a327-09f4-44c7-98f1-f8a1937e77bc service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:51.338506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752a327-09f4-44c7-98f1-f8a1937e77bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:51.343607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6752a327-09f4-44c7-98f1-f8a1937e77bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:51.373043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6752a327-09f4-44c7-98f1-f8a1937e77bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:51.375147 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6752a327-09f4-44c7-98f1-f8a1937e77bc service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:51.388353 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:51.416275 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4108/8139] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:48:51.480099 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4032/8140] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:48:51.484219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752a327-09f4-44c7-98f1-f8a1937e77bc service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:51.599942 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:51.716237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752a327-09f4-44c7-98f1-f8a1937e77bc service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:51.731522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92268cc-2405-4a70-95a8-b1b039f34ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:51.735206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92268cc-2405-4a70-95a8-b1b039f34ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:51.735469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92268cc-2405-4a70-95a8-b1b039f34ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:51.735781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92268cc-2405-4a70-95a8-b1b039f34ba3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:51.736752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92268cc-2405-4a70-95a8-b1b039f34ba3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:51.741700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92268cc-2405-4a70-95a8-b1b039f34ba3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:51.807277 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4109/8141] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:48:51 2022] POST /identity/v3/projects => generated 373 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:51.811517 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f108a8f-b44d-4177-b925-5565961aa238 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:51.834555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f108a8f-b44d-4177-b925-5565961aa238 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:51.927736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb63e2f-ed02-49cf-bde7-2c5163f6e759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:51.928614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb63e2f-ed02-49cf-bde7-2c5163f6e759 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:51.929137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb63e2f-ed02-49cf-bde7-2c5163f6e759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:51.929810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb63e2f-ed02-49cf-bde7-2c5163f6e759 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:51.931776 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb63e2f-ed02-49cf-bde7-2c5163f6e759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:51.934194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb63e2f-ed02-49cf-bde7-2c5163f6e759 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:52.065647 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4033/8142] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:48:51 2022] POST /identity/v3/users => generated 293 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:48:52.070251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92268cc-2405-4a70-95a8-b1b039f34ba3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:52.110091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92268cc-2405-4a70-95a8-b1b039f34ba3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:52.122864 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25a90d-197f-4f68-b079-77dde91b7495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:52.124092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25a90d-197f-4f68-b079-77dde91b7495 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:52.124717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25a90d-197f-4f68-b079-77dde91b7495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:52.125316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25a90d-197f-4f68-b079-77dde91b7495 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:52.126606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb25a90d-197f-4f68-b079-77dde91b7495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:52.129377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb25a90d-197f-4f68-b079-77dde91b7495 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:52.362232 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4110/8143] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:52.366762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb63e2f-ed02-49cf-bde7-2c5163f6e759 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:52.381568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb63e2f-ed02-49cf-bde7-2c5163f6e759 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:52.389126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7f8ae-e91c-4240-84c6-1790f8d428ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:52.390408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7f8ae-e91c-4240-84c6-1790f8d428ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:52.391170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7f8ae-e91c-4240-84c6-1790f8d428ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:52.391747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7f8ae-e91c-4240-84c6-1790f8d428ff admin admin] PATH_INFO: `/v3/projects/36f2cc1ae09f4cbfa915dfde4187e96a/users/c20ec59e967e48c1ba0d7d96f81befb2/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:52.415160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7f8ae-e91c-4240-84c6-1790f8d428ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=36f2cc1ae09f4cbfa915dfde4187e96a, user_id=c20ec59e967e48c1ba0d7d96f81befb2, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:52.419425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7f8ae-e91c-4240-84c6-1790f8d428ff admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:52.456184 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4034/8144] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:48:52 2022] PUT /identity/v3/projects/36f2cc1ae09f4cbfa915dfde4187e96a/users/c20ec59e967e48c1ba0d7d96f81befb2/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:48:52.460262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25a90d-197f-4f68-b079-77dde91b7495 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:52.476365 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25a90d-197f-4f68-b079-77dde91b7495 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:52.598187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af5a84-4534-41c0-b51b-c45d8293c99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:52.599273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af5a84-4534-41c0-b51b-c45d8293c99c admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:52.599273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af5a84-4534-41c0-b51b-c45d8293c99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:52.599778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af5a84-4534-41c0-b51b-c45d8293c99c admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:52.601650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af5a84-4534-41c0-b51b-c45d8293c99c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:52.604414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af5a84-4534-41c0-b51b-c45d8293c99c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:52.629323 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4111/8145] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:48:52.633339 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7f8ae-e91c-4240-84c6-1790f8d428ff admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:52.674193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7f8ae-e91c-4240-84c6-1790f8d428ff admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:52.691707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd45a3e-a450-4dc6-86aa-1dd7ed0fbb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:52.695857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd45a3e-a450-4dc6-86aa-1dd7ed0fbb54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:52.733758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd45a3e-a450-4dc6-86aa-1dd7ed0fbb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:52.733953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd45a3e-a450-4dc6-86aa-1dd7ed0fbb54 admin admin] PATH_INFO: `/v3/projects/36f2cc1ae09f4cbfa915dfde4187e96a/users/c20ec59e967e48c1ba0d7d96f81befb2/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:52.740756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd45a3e-a450-4dc6-86aa-1dd7ed0fbb54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36f2cc1ae09f4cbfa915dfde4187e96a, user_id=c20ec59e967e48c1ba0d7d96f81befb2, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:52.753864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd45a3e-a450-4dc6-86aa-1dd7ed0fbb54 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:52.791985 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4035/8146] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:48:52 2022] PUT /identity/v3/projects/36f2cc1ae09f4cbfa915dfde4187e96a/users/c20ec59e967e48c1ba0d7d96f81befb2/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:52.807203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249e84c-6590-4c9b-aabc-6bc7c3064f4b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:52.807447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249e84c-6590-4c9b-aabc-6bc7c3064f4b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:52.807654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9249e84c-6590-4c9b-aabc-6bc7c3064f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:52.877129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9249e84c-6590-4c9b-aabc-6bc7c3064f4b None None] MFA Rules not processed for user `c20ec59e967e48c1ba0d7d96f81befb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:52.881898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9249e84c-6590-4c9b-aabc-6bc7c3064f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:52.995733 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4112/8147] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:53.008472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd45a3e-a450-4dc6-86aa-1dd7ed0fbb54 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:53.010980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8dd45a3e-a450-4dc6-86aa-1dd7ed0fbb54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:53.146843 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd45a3e-a450-4dc6-86aa-1dd7ed0fbb54 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:53.159666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f45212-4995-4064-be32-a23e9e6afb6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:53.161616 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f45212-4995-4064-be32-a23e9e6afb6f service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:53.163144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f45212-4995-4064-be32-a23e9e6afb6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:53.163871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f45212-4995-4064-be32-a23e9e6afb6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:53.210050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f45212-4995-4064-be32-a23e9e6afb6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:53.228688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f45212-4995-4064-be32-a23e9e6afb6f service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:53.270455 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4036/8148] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:48:54.300384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9249e84c-6590-4c9b-aabc-6bc7c3064f4b None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:54.408121 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:54.497133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f45212-4995-4064-be32-a23e9e6afb6f service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:54.499943 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-11f45212-4995-4064-be32-a23e9e6afb6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:54.513754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9249e84c-6590-4c9b-aabc-6bc7c3064f4b None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:54.523578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5af16-8b7c-41e2-9318-cf299027883b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:54.524395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5af16-8b7c-41e2-9318-cf299027883b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:54.524712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5af16-8b7c-41e2-9318-cf299027883b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:54.525042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5af16-8b7c-41e2-9318-cf299027883b admin admin] PATH_INFO: `/v3/users/6d07b15f0f124389927b3afd111639a1` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:54.526443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5af16-8b7c-41e2-9318-cf299027883b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d07b15f0f124389927b3afd111639a1)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:54.532654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5af16-8b7c-41e2-9318-cf299027883b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:54.569085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f45212-4995-4064-be32-a23e9e6afb6f service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:54.583826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9056e-dd9f-46d1-bfc4-3e60cc652a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:54.584862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9056e-dd9f-46d1-bfc4-3e60cc652a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:54.585541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9056e-dd9f-46d1-bfc4-3e60cc652a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:54.586051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9056e-dd9f-46d1-bfc4-3e60cc652a2b admin admin] PATH_INFO: `/v3/users/a390615eb1224884977dec7e2752f609` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:54.596170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9056e-dd9f-46d1-bfc4-3e60cc652a2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a390615eb1224884977dec7e2752f609)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:54.598185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9056e-dd9f-46d1-bfc4-3e60cc652a2b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:54.691581 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:54.694678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9bd5af16-8b7c-41e2-9318-cf299027883b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d07b15f0f124389927b3afd111639a1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:54.707085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9bd5af16-8b7c-41e2-9318-cf299027883b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d07b15f0f124389927b3afd111639a1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:54.712131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5de9056e-dd9f-46d1-bfc4-3e60cc652a2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a390615eb1224884977dec7e2752f609'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:54.726588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5de9056e-dd9f-46d1-bfc4-3e60cc652a2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a390615eb1224884977dec7e2752f609'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:54.734816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9bd5af16-8b7c-41e2-9318-cf299027883b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d07b15f0f124389927b3afd111639a1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:54.735958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9bd5af16-8b7c-41e2-9318-cf299027883b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d07b15f0f124389927b3afd111639a1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:54.747299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5de9056e-dd9f-46d1-bfc4-3e60cc652a2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a390615eb1224884977dec7e2752f609'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:54.748715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5de9056e-dd9f-46d1-bfc4-3e60cc652a2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a390615eb1224884977dec7e2752f609'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:54.755168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-9bd5af16-8b7c-41e2-9318-cf299027883b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d07b15f0f124389927b3afd111639a1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:54.765642 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4113/8149] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:48:54 2022] DELETE /identity/v3/users/6d07b15f0f124389927b3afd111639a1 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:54.770718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fddc2-fa7a-4148-b2b2-384ffd3f1ad6 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:54.771490 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fddc2-fa7a-4148-b2b2-384ffd3f1ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:54.773440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-5de9056e-dd9f-46d1-bfc4-3e60cc652a2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a390615eb1224884977dec7e2752f609'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:54.773970 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fddc2-fa7a-4148-b2b2-384ffd3f1ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:54.791733 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4037/8150] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:48:54 2022] DELETE /identity/v3/users/a390615eb1224884977dec7e2752f609 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:48:54.796395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936a1b3-ef56-48cc-8b68-9f5941b0242a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:54.796681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936a1b3-ef56-48cc-8b68-9f5941b0242a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:54.796954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936a1b3-ef56-48cc-8b68-9f5941b0242a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:54.858751 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b64fddc2-fa7a-4148-b2b2-384ffd3f1ad6 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:54.860211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b64fddc2-fa7a-4148-b2b2-384ffd3f1ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:54.917527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6936a1b3-ef56-48cc-8b68-9f5941b0242a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:54.920155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6936a1b3-ef56-48cc-8b68-9f5941b0242a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:55.107424 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4038/8151] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:55.133131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936a1b3-ef56-48cc-8b68-9f5941b0242a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:55.137412 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6936a1b3-ef56-48cc-8b68-9f5941b0242a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:55.189948 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4114/8152] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:48:55.201596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fddc2-fa7a-4148-b2b2-384ffd3f1ad6 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:55.205113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b64fddc2-fa7a-4148-b2b2-384ffd3f1ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:55.369376 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:55.391608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936a1b3-ef56-48cc-8b68-9f5941b0242a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:55.401903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542f50e-4e82-437a-b831-8362eee1962d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:55.404171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542f50e-4e82-437a-b831-8362eee1962d service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:55.404171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542f50e-4e82-437a-b831-8362eee1962d service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:55.404171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542f50e-4e82-437a-b831-8362eee1962d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:55.425113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fddc2-fa7a-4148-b2b2-384ffd3f1ad6 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:55.432226 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542f50e-4e82-437a-b831-8362eee1962d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:55.434597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542f50e-4e82-437a-b831-8362eee1962d service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:55.436888 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f31c39-a56c-42b6-94fa-4c6078e8086f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:55.437531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f31c39-a56c-42b6-94fa-4c6078e8086f service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:55.437806 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f31c39-a56c-42b6-94fa-4c6078e8086f service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:55.438072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f31c39-a56c-42b6-94fa-4c6078e8086f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:55.462818 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4039/8153] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:48:55.463043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f31c39-a56c-42b6-94fa-4c6078e8086f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:55.464805 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f31c39-a56c-42b6-94fa-4c6078e8086f service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:55.480485 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4115/8154] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:48:56.075070 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542f50e-4e82-437a-b831-8362eee1962d service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:56.077032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4542f50e-4e82-437a-b831-8362eee1962d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:56.096835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542f50e-4e82-437a-b831-8362eee1962d service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:56.105369 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48da3c-95a7-4166-a90b-a5a24152e5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:56.106374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48da3c-95a7-4166-a90b-a5a24152e5e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:56.106883 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48da3c-95a7-4166-a90b-a5a24152e5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:56.107356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48da3c-95a7-4166-a90b-a5a24152e5e7 admin admin] PATH_INFO: `/v3/projects/af2ec23a1ad44b758d114dd4be231a0c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:56.109842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48da3c-95a7-4166-a90b-a5a24152e5e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af2ec23a1ad44b758d114dd4be231a0c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:56.121323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48da3c-95a7-4166-a90b-a5a24152e5e7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:56.165294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f31c39-a56c-42b6-94fa-4c6078e8086f service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:56.167648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c2f31c39-a56c-42b6-94fa-4c6078e8086f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:56.186234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f31c39-a56c-42b6-94fa-4c6078e8086f service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:56.229770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6a48da3c-95a7-4166-a90b-a5a24152e5e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af2ec23a1ad44b758d114dd4be231a0c', 'request_id': 'req-6a48da3c-95a7-4166-a90b-a5a24152e5e7'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:56.232957 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:56.245144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6a48da3c-95a7-4166-a90b-a5a24152e5e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af2ec23a1ad44b758d114dd4be231a0c', 'request_id': 'req-6a48da3c-95a7-4166-a90b-a5a24152e5e7'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:56.265431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6a48da3c-95a7-4166-a90b-a5a24152e5e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af2ec23a1ad44b758d114dd4be231a0c', 'request_id': 'req-6a48da3c-95a7-4166-a90b-a5a24152e5e7'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:56.358732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6a48da3c-95a7-4166-a90b-a5a24152e5e7 admin admin] The token cache is being invalidate because project af2ec23a1ad44b758d114dd4be231a0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:48:56.359031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6a48da3c-95a7-4166-a90b-a5a24152e5e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:56.361163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6a48da3c-95a7-4166-a90b-a5a24152e5e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:56.366286 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4040/8155] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:48:56 2022] DELETE /identity/v3/projects/af2ec23a1ad44b758d114dd4be231a0c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:56.370833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48da3c-95a7-4166-a90b-a5a24152e5e7 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:56.372525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6a48da3c-95a7-4166-a90b-a5a24152e5e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:56.405909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b60b13-2242-44d0-ac84-2473605ba01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:56.406571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b60b13-2242-44d0-ac84-2473605ba01f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:56.406855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b60b13-2242-44d0-ac84-2473605ba01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:56.407126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b60b13-2242-44d0-ac84-2473605ba01f admin admin] PATH_INFO: `/v3/projects/030fd2eaf12240029750dc0272308b35` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:56.408581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b60b13-2242-44d0-ac84-2473605ba01f admin admin] RBAC: Authorizing `identity:delete_project(project_id=030fd2eaf12240029750dc0272308b35)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:56.410588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b60b13-2242-44d0-ac84-2473605ba01f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:56.478454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-86b60b13-2242-44d0-ac84-2473605ba01f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '030fd2eaf12240029750dc0272308b35', 'request_id': 'req-86b60b13-2242-44d0-ac84-2473605ba01f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:56.485333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-86b60b13-2242-44d0-ac84-2473605ba01f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '030fd2eaf12240029750dc0272308b35', 'request_id': 'req-86b60b13-2242-44d0-ac84-2473605ba01f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:56.493965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-86b60b13-2242-44d0-ac84-2473605ba01f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '030fd2eaf12240029750dc0272308b35', 'request_id': 'req-86b60b13-2242-44d0-ac84-2473605ba01f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:56.521133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-86b60b13-2242-44d0-ac84-2473605ba01f admin admin] The token cache is being invalidate because project 030fd2eaf12240029750dc0272308b35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:48:56.521451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-86b60b13-2242-44d0-ac84-2473605ba01f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:56.523402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-86b60b13-2242-44d0-ac84-2473605ba01f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:56.526252 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4116/8156] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:48:56 2022] DELETE /identity/v3/projects/030fd2eaf12240029750dc0272308b35 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:56.532190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63eec4-f6ce-45b8-80f1-9413bfc82f26 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:56.543931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63eec4-f6ce-45b8-80f1-9413bfc82f26 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:56.544234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63eec4-f6ce-45b8-80f1-9413bfc82f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:56.553785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48da3c-95a7-4166-a90b-a5a24152e5e7 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:56.600291 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5c63eec4-f6ce-45b8-80f1-9413bfc82f26 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:56.601821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5c63eec4-f6ce-45b8-80f1-9413bfc82f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:56.712824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ef08b-1e0c-4fda-a5f5-9e516019f4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:56.713099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ef08b-1e0c-4fda-a5f5-9e516019f4e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:56.713294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ef08b-1e0c-4fda-a5f5-9e516019f4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:56.713577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ef08b-1e0c-4fda-a5f5-9e516019f4e6 admin admin] PATH_INFO: `/v3/users/c20ec59e967e48c1ba0d7d96f81befb2` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:56.714922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ef08b-1e0c-4fda-a5f5-9e516019f4e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c20ec59e967e48c1ba0d7d96f81befb2)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:56.716829 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4117/8157] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:56.725129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ef08b-1e0c-4fda-a5f5-9e516019f4e6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:56.729641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87184893-0670-4799-b6be-91bf662e7cfa None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:56.731167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87184893-0670-4799-b6be-91bf662e7cfa None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:56.732099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87184893-0670-4799-b6be-91bf662e7cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:56.802601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-87184893-0670-4799-b6be-91bf662e7cfa None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:56.804021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-87184893-0670-4799-b6be-91bf662e7cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:56.814617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a05ef08b-1e0c-4fda-a5f5-9e516019f4e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c20ec59e967e48c1ba0d7d96f81befb2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:56.825546 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a05ef08b-1e0c-4fda-a5f5-9e516019f4e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c20ec59e967e48c1ba0d7d96f81befb2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:56.825782 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4118/8158] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:56.830591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87184893-0670-4799-b6be-91bf662e7cfa None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:56.842220 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:56.849172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87184893-0670-4799-b6be-91bf662e7cfa None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:56.859775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a05ef08b-1e0c-4fda-a5f5-9e516019f4e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c20ec59e967e48c1ba0d7d96f81befb2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:56.860574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a05ef08b-1e0c-4fda-a5f5-9e516019f4e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c20ec59e967e48c1ba0d7d96f81befb2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:56.876448 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a05ef08b-1e0c-4fda-a5f5-9e516019f4e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c20ec59e967e48c1ba0d7d96f81befb2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:56.878554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7daa0-a582-4101-aa76-bebd18435c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:56.879241 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7daa0-a582-4101-aa76-bebd18435c83 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:56.879655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7daa0-a582-4101-aa76-bebd18435c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:56.879968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7daa0-a582-4101-aa76-bebd18435c83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:56.880636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d7daa0-a582-4101-aa76-bebd18435c83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:48:56.880939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d7daa0-a582-4101-aa76-bebd18435c83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:56.882597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d7daa0-a582-4101-aa76-bebd18435c83 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:56.886084 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4041/8159] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:48:56 2022] DELETE /identity/v3/users/c20ec59e967e48c1ba0d7d96f81befb2 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:56.908915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ef08b-1e0c-4fda-a5f5-9e516019f4e6 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:56.910350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a05ef08b-1e0c-4fda-a5f5-9e516019f4e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:56.914314 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4119/8160] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:48:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:48:56.922698 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:57.073156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ef08b-1e0c-4fda-a5f5-9e516019f4e6 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:57.091038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70122a0e-99f8-4da1-a318-230988e70e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:57.091760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70122a0e-99f8-4da1-a318-230988e70e93 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:57.091760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70122a0e-99f8-4da1-a318-230988e70e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:57.091760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70122a0e-99f8-4da1-a318-230988e70e93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:57.092472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70122a0e-99f8-4da1-a318-230988e70e93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:57.094445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70122a0e-99f8-4da1-a318-230988e70e93 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:57.139573 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4042/8161] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:48:56 2022] POST /identity/v3/projects => generated 405 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:57.143544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7daa0-a582-4101-aa76-bebd18435c83 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:57.155632 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7daa0-a582-4101-aa76-bebd18435c83 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:57.351208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6d55f-e07c-4fa0-8467-a45d318fa1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:57.353555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6d55f-e07c-4fa0-8467-a45d318fa1d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:57.354251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6d55f-e07c-4fa0-8467-a45d318fa1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:57.355405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6d55f-e07c-4fa0-8467-a45d318fa1d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:57.356879 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6d55f-e07c-4fa0-8467-a45d318fa1d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:57.363045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6d55f-e07c-4fa0-8467-a45d318fa1d7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:57.426967 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4120/8162] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:48:57 2022] POST /identity/v3/users => generated 303 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:57.431949 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70122a0e-99f8-4da1-a318-230988e70e93 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:57.443338 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70122a0e-99f8-4da1-a318-230988e70e93 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:57.466664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5a6b9-de43-4d70-80bc-ad5703f25097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:57.467301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5a6b9-de43-4d70-80bc-ad5703f25097 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:57.467580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5a6b9-de43-4d70-80bc-ad5703f25097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:57.467853 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5a6b9-de43-4d70-80bc-ad5703f25097 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:57.468572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5a6b9-de43-4d70-80bc-ad5703f25097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:57.470208 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5a6b9-de43-4d70-80bc-ad5703f25097 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:57.503048 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4043/8163] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:57.503996 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6d55f-e07c-4fa0-8467-a45d318fa1d7 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:57.517493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6d55f-e07c-4fa0-8467-a45d318fa1d7 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:57.532860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29164c-6143-4ade-b5d6-6ddfad0380ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:57.534141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29164c-6143-4ade-b5d6-6ddfad0380ae admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:57.536514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29164c-6143-4ade-b5d6-6ddfad0380ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:57.544456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29164c-6143-4ade-b5d6-6ddfad0380ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:57.544456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29164c-6143-4ade-b5d6-6ddfad0380ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:57.556219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29164c-6143-4ade-b5d6-6ddfad0380ae admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:57.575009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5a6b9-de43-4d70-80bc-ad5703f25097 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:57.577124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-02f5a6b9-de43-4d70-80bc-ad5703f25097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:57.580129 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4121/8164] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:48:57.589568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29164c-6143-4ade-b5d6-6ddfad0380ae admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:57.597794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5a6b9-de43-4d70-80bc-ad5703f25097 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:57.612749 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29164c-6143-4ade-b5d6-6ddfad0380ae admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:57.618182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e181e-8e22-4073-bf20-27bb14c70dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:57.619214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e181e-8e22-4073-bf20-27bb14c70dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:57.619322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa033f40-35b1-40e3-9264-cec5aa19240a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:57.619710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e181e-8e22-4073-bf20-27bb14c70dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:57.620035 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e181e-8e22-4073-bf20-27bb14c70dc2 admin admin] PATH_INFO: `/v3/projects/f39ae74e533a4c069bbe7ff12da7f1c2/users/6450b1d36db046de8984227994bf6276/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:57.620138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa033f40-35b1-40e3-9264-cec5aa19240a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:57.620402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa033f40-35b1-40e3-9264-cec5aa19240a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:57.620683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa033f40-35b1-40e3-9264-cec5aa19240a admin admin] PATH_INFO: `/v3/projects/36f2cc1ae09f4cbfa915dfde4187e96a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:57.622891 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa033f40-35b1-40e3-9264-cec5aa19240a admin admin] RBAC: Authorizing `identity:delete_project(project_id=36f2cc1ae09f4cbfa915dfde4187e96a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:57.625060 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa033f40-35b1-40e3-9264-cec5aa19240a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:57.662652 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e181e-8e22-4073-bf20-27bb14c70dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f39ae74e533a4c069bbe7ff12da7f1c2, user_id=6450b1d36db046de8984227994bf6276, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:57.672472 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e181e-8e22-4073-bf20-27bb14c70dc2 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:57.712622 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4122/8165] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:48:57 2022] PUT /identity/v3/projects/f39ae74e533a4c069bbe7ff12da7f1c2/users/6450b1d36db046de8984227994bf6276/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:57.718476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fb7b8-374e-4921-a580-461761da6b46 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:57.720153 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fb7b8-374e-4921-a580-461761da6b46 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:57.720968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fb7b8-374e-4921-a580-461761da6b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:57.726425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aa033f40-35b1-40e3-9264-cec5aa19240a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36f2cc1ae09f4cbfa915dfde4187e96a', 'request_id': 'req-aa033f40-35b1-40e3-9264-cec5aa19240a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:57.738769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aa033f40-35b1-40e3-9264-cec5aa19240a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36f2cc1ae09f4cbfa915dfde4187e96a', 'request_id': 'req-aa033f40-35b1-40e3-9264-cec5aa19240a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:57.751837 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aa033f40-35b1-40e3-9264-cec5aa19240a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36f2cc1ae09f4cbfa915dfde4187e96a', 'request_id': 'req-aa033f40-35b1-40e3-9264-cec5aa19240a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:57.773551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aa033f40-35b1-40e3-9264-cec5aa19240a admin admin] The token cache is being invalidate because project 36f2cc1ae09f4cbfa915dfde4187e96a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:48:57.774506 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aa033f40-35b1-40e3-9264-cec5aa19240a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:57.775356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aa033f40-35b1-40e3-9264-cec5aa19240a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:48:57.777086 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4044/8166] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:48:57 2022] DELETE /identity/v3/projects/36f2cc1ae09f4cbfa915dfde4187e96a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:48:57.784630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-700fb7b8-374e-4921-a580-461761da6b46 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:57.785103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfea3e-3af3-4146-a103-aa7adee6daa2 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:57.785474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfea3e-3af3-4146-a103-aa7adee6daa2 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:57.786864 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-700fb7b8-374e-4921-a580-461761da6b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:57.787311 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfea3e-3af3-4146-a103-aa7adee6daa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:57.840313 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-50bfea3e-3af3-4146-a103-aa7adee6daa2 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:57.841738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-50bfea3e-3af3-4146-a103-aa7adee6daa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:57.910867 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4123/8167] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:57.921424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fb7b8-374e-4921-a580-461761da6b46 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:57.922969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-700fb7b8-374e-4921-a580-461761da6b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:57.955019 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4045/8168] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:57.965826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f0b02-1df4-47cc-b974-e663100917f3 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:57.966413 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f0b02-1df4-47cc-b974-e663100917f3 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:57.966983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f0b02-1df4-47cc-b974-e663100917f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:57.989508 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:58.034143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ec6f0b02-1df4-47cc-b974-e663100917f3 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:58.041085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ec6f0b02-1df4-47cc-b974-e663100917f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:58.062603 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4046/8169] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:58.064576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f0b02-1df4-47cc-b974-e663100917f3 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:58.085086 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f0b02-1df4-47cc-b974-e663100917f3 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:58.098300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc7fe8-4b5f-4d8f-a99c-b382003922e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:58.098896 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:58.099161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc7fe8-4b5f-4d8f-a99c-b382003922e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:58.099443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc7fe8-4b5f-4d8f-a99c-b382003922e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:58.099711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc7fe8-4b5f-4d8f-a99c-b382003922e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:58.100525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc7fe8-4b5f-4d8f-a99c-b382003922e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:48:58.100827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc7fe8-4b5f-4d8f-a99c-b382003922e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:58.113197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc7fe8-4b5f-4d8f-a99c-b382003922e1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:58.126351 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fb7b8-374e-4921-a580-461761da6b46 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:58.130357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6e55c-d32a-451b-985e-51e6ef0eb322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:58.130993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6e55c-d32a-451b-985e-51e6ef0eb322 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:58.131270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6e55c-d32a-451b-985e-51e6ef0eb322 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:58.131542 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6e55c-d32a-451b-985e-51e6ef0eb322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:58.141308 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4047/8170] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:48:58.143483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc7fe8-4b5f-4d8f-a99c-b382003922e1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:58.154738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6e55c-d32a-451b-985e-51e6ef0eb322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:58.156312 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6e55c-d32a-451b-985e-51e6ef0eb322 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:58.169696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc7fe8-4b5f-4d8f-a99c-b382003922e1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:58.182527 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4124/8171] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:48:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:48:58.182731 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc1659-0c09-4b6c-a9c5-9f712f4f33b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:58.183271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc1659-0c09-4b6c-a9c5-9f712f4f33b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:58.183565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc1659-0c09-4b6c-a9c5-9f712f4f33b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:58.183821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc1659-0c09-4b6c-a9c5-9f712f4f33b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:58.184614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc1659-0c09-4b6c-a9c5-9f712f4f33b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:58.191273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc1659-0c09-4b6c-a9c5-9f712f4f33b6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:58.253081 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4048/8172] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:48:58 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:58.256473 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6e55c-d32a-451b-985e-51e6ef0eb322 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:58.289143 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6e55c-d32a-451b-985e-51e6ef0eb322 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:58.445469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2834ac-4133-4c78-9695-b51d1e062779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:58.447424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2834ac-4133-4c78-9695-b51d1e062779 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:58.447831 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2834ac-4133-4c78-9695-b51d1e062779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:58.448507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2834ac-4133-4c78-9695-b51d1e062779 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:58.449418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2834ac-4133-4c78-9695-b51d1e062779 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:58.452084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2834ac-4133-4c78-9695-b51d1e062779 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:58.494223 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4125/8173] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:48:58 2022] POST /identity/v3/users => generated 291 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:58.495921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc1659-0c09-4b6c-a9c5-9f712f4f33b6 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:58.512569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc1659-0c09-4b6c-a9c5-9f712f4f33b6 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:58.521252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b132c85-b45a-40fa-886b-a3884aca3cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:58.521882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b132c85-b45a-40fa-886b-a3884aca3cfd admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:58.522156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b132c85-b45a-40fa-886b-a3884aca3cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:58.522422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b132c85-b45a-40fa-886b-a3884aca3cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:58.523080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b132c85-b45a-40fa-886b-a3884aca3cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:58.530669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b132c85-b45a-40fa-886b-a3884aca3cfd admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:58.553477 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4049/8174] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:58.558315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2834ac-4133-4c78-9695-b51d1e062779 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:58.582349 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2834ac-4133-4c78-9695-b51d1e062779 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:58.587458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381caa86-a19a-4adb-a1ca-c006e7b98e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:58.588103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381caa86-a19a-4adb-a1ca-c006e7b98e9c admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:58.588385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381caa86-a19a-4adb-a1ca-c006e7b98e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:58.588659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381caa86-a19a-4adb-a1ca-c006e7b98e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:58.589315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381caa86-a19a-4adb-a1ca-c006e7b98e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:58.590917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381caa86-a19a-4adb-a1ca-c006e7b98e9c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:58.635930 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4126/8175] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:58.640667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b132c85-b45a-40fa-886b-a3884aca3cfd admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:58.655032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b132c85-b45a-40fa-886b-a3884aca3cfd admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:58.663009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a08d9c-5062-4f83-a7bd-e303d589d159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:58.663689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a08d9c-5062-4f83-a7bd-e303d589d159 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:58.663996 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a08d9c-5062-4f83-a7bd-e303d589d159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:58.664268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a08d9c-5062-4f83-a7bd-e303d589d159 admin admin] PATH_INFO: `/v3/projects/cdb0d9ea2b90459e87c7970afd228690/users/406422e3e58c44159ee3e8462c6e5af4/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:58.682700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a08d9c-5062-4f83-a7bd-e303d589d159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb0d9ea2b90459e87c7970afd228690, user_id=406422e3e58c44159ee3e8462c6e5af4, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:58.685554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a08d9c-5062-4f83-a7bd-e303d589d159 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:58.711378 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4050/8176] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:48:58 2022] PUT /identity/v3/projects/cdb0d9ea2b90459e87c7970afd228690/users/406422e3e58c44159ee3e8462c6e5af4/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:48:58.724436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695a7d2-d533-4327-ad1a-bacc714d71bf None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:58.724725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695a7d2-d533-4327-ad1a-bacc714d71bf None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:58.725052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695a7d2-d533-4327-ad1a-bacc714d71bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:58.769299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-4695a7d2-d533-4327-ad1a-bacc714d71bf None None] MFA Rules not processed for user `406422e3e58c44159ee3e8462c6e5af4`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:58.770525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4695a7d2-d533-4327-ad1a-bacc714d71bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:58.895704 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4127/8177] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:48:58.901497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a08d9c-5062-4f83-a7bd-e303d589d159 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:59.022010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a08d9c-5062-4f83-a7bd-e303d589d159 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:59.035767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0baa72-d7da-49c5-8ab8-d4bab4b24fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:59.037694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0baa72-d7da-49c5-8ab8-d4bab4b24fea admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:59.038161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0baa72-d7da-49c5-8ab8-d4bab4b24fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:59.038882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0baa72-d7da-49c5-8ab8-d4bab4b24fea admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:59.040570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0baa72-d7da-49c5-8ab8-d4bab4b24fea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:59.046104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0baa72-d7da-49c5-8ab8-d4bab4b24fea admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:59.127092 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4051/8178] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:48:58 2022] POST /identity/v3/projects => generated 383 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:59.131858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695a7d2-d533-4327-ad1a-bacc714d71bf None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:59.173491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695a7d2-d533-4327-ad1a-bacc714d71bf None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:59.306281 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:59.339012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60d351-ea97-45c6-b935-248e3d80d9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:59.340723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60d351-ea97-45c6-b935-248e3d80d9c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:59.341183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60d351-ea97-45c6-b935-248e3d80d9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:59.342997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60d351-ea97-45c6-b935-248e3d80d9c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:59.344573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60d351-ea97-45c6-b935-248e3d80d9c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:59.349750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee60d351-ea97-45c6-b935-248e3d80d9c4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:59.398327 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4128/8179] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:48:59 2022] POST /identity/v3/users => generated 298 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:48:59.402669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0baa72-d7da-49c5-8ab8-d4bab4b24fea admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:59.417831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0baa72-d7da-49c5-8ab8-d4bab4b24fea admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:59.435197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cdcb89-c25f-4a9b-97dc-2539de709d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:59.436039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdcb89-c25f-4a9b-97dc-2539de709d03 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:59.436373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdcb89-c25f-4a9b-97dc-2539de709d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:59.436657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdcb89-c25f-4a9b-97dc-2539de709d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:59.437719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cdcb89-c25f-4a9b-97dc-2539de709d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:59.442698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cdcb89-c25f-4a9b-97dc-2539de709d03 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:59.472189 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4052/8180] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:59.476275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60d351-ea97-45c6-b935-248e3d80d9c4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:59.490985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60d351-ea97-45c6-b935-248e3d80d9c4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:59.502532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e96154-8423-4a85-a0d3-0dbf9c2df563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:59.503224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e96154-8423-4a85-a0d3-0dbf9c2df563 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:59.503507 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e96154-8423-4a85-a0d3-0dbf9c2df563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:59.503784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e96154-8423-4a85-a0d3-0dbf9c2df563 admin admin] PATH_INFO: `/v3/projects/e8723c5e1909415b89cb76b299ef96b2/users/4ddead9ceadf4d45bccc089bf89758e1/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:59.548153 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e96154-8423-4a85-a0d3-0dbf9c2df563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8723c5e1909415b89cb76b299ef96b2, user_id=4ddead9ceadf4d45bccc089bf89758e1, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:59.550923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e96154-8423-4a85-a0d3-0dbf9c2df563 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:59.577758 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4129/8181] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:48:59 2022] PUT /identity/v3/projects/e8723c5e1909415b89cb76b299ef96b2/users/4ddead9ceadf4d45bccc089bf89758e1/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:48:59.581845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cdcb89-c25f-4a9b-97dc-2539de709d03 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:59.592863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cdcb89-c25f-4a9b-97dc-2539de709d03 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:59.672475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267abf33-9f64-4fde-9f4f-7d0bd60de774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:59.673265 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267abf33-9f64-4fde-9f4f-7d0bd60de774 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:59.673647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267abf33-9f64-4fde-9f4f-7d0bd60de774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:59.674055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267abf33-9f64-4fde-9f4f-7d0bd60de774 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:59.674820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267abf33-9f64-4fde-9f4f-7d0bd60de774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:59.676611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267abf33-9f64-4fde-9f4f-7d0bd60de774 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:59.679458 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:48:59.690729 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4053/8182] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:48:59.694543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e96154-8423-4a85-a0d3-0dbf9c2df563 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:48:59.718845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e96154-8423-4a85-a0d3-0dbf9c2df563 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:48:59.737579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cb1c6-c994-4d8d-8280-72fc3a7c1766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:48:59.738800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cb1c6-c994-4d8d-8280-72fc3a7c1766 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:59.739281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cb1c6-c994-4d8d-8280-72fc3a7c1766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:59.739782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cb1c6-c994-4d8d-8280-72fc3a7c1766 admin admin] PATH_INFO: `/v3/projects/e8723c5e1909415b89cb76b299ef96b2/users/4ddead9ceadf4d45bccc089bf89758e1/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:59.745264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737cb1c6-c994-4d8d-8280-72fc3a7c1766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8723c5e1909415b89cb76b299ef96b2, user_id=4ddead9ceadf4d45bccc089bf89758e1, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:48:59.770943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737cb1c6-c994-4d8d-8280-72fc3a7c1766 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:48:59.812622 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4130/8183] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:48:59 2022] PUT /identity/v3/projects/e8723c5e1909415b89cb76b299ef96b2/users/4ddead9ceadf4d45bccc089bf89758e1/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:48:59.823790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f1feb-71a1-4beb-ae8e-28bd17f9b2d9 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:59.824274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f1feb-71a1-4beb-ae8e-28bd17f9b2d9 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:59.824864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f1feb-71a1-4beb-ae8e-28bd17f9b2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:48:59.906992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-563f1feb-71a1-4beb-ae8e-28bd17f9b2d9 None None] MFA Rules not processed for user `4ddead9ceadf4d45bccc089bf89758e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:48:59.908257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-563f1feb-71a1-4beb-ae8e-28bd17f9b2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:48:59.923220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2dae9-155d-452c-b4ce-71ba6d1a50d8 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:48:59.923519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2dae9-155d-452c-b4ce-71ba6d1a50d8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:48:59.923782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2dae9-155d-452c-b4ce-71ba6d1a50d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:00.013755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-82a2dae9-155d-452c-b4ce-71ba6d1a50d8 None None] MFA Rules not processed for user `6450b1d36db046de8984227994bf6276`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:00.013755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-82a2dae9-155d-452c-b4ce-71ba6d1a50d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:00.140071 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4054/8184] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:00.184275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f1feb-71a1-4beb-ae8e-28bd17f9b2d9 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:00.189619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-563f1feb-71a1-4beb-ae8e-28bd17f9b2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:00.230459 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4131/8185] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:48:59 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:00.232468 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2dae9-155d-452c-b4ce-71ba6d1a50d8 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:00.234143 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-82a2dae9-155d-452c-b4ce-71ba6d1a50d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:00.357671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f1feb-71a1-4beb-ae8e-28bd17f9b2d9 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:00.362868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c261672-acff-48af-a42a-a09ed32175a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:00.363540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c261672-acff-48af-a42a-a09ed32175a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:00.363936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c261672-acff-48af-a42a-a09ed32175a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:00.364397 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c261672-acff-48af-a42a-a09ed32175a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:00.380355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c261672-acff-48af-a42a-a09ed32175a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:00.381960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c261672-acff-48af-a42a-a09ed32175a8 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:00.398479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2dae9-155d-452c-b4ce-71ba6d1a50d8 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:00.401049 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4055/8186] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:49:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:49:00.407462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c95d7-e341-47fe-91fd-96908f5d2079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:00.416011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c95d7-e341-47fe-91fd-96908f5d2079 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:00.417837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c95d7-e341-47fe-91fd-96908f5d2079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:00.418557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c95d7-e341-47fe-91fd-96908f5d2079 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:00.419503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c95d7-e341-47fe-91fd-96908f5d2079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:00.422664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c95d7-e341-47fe-91fd-96908f5d2079 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:00.469769 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4132/8187] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:49:00 2022] POST /identity/v3/projects => generated 403 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:49:00.470622 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c261672-acff-48af-a42a-a09ed32175a8 service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:00.489108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c261672-acff-48af-a42a-a09ed32175a8 service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:00.526489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c95d7-e341-47fe-91fd-96908f5d2079 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:00.606205 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:00.633314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6706b8c-c108-4a25-a855-fa0f97eaea54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:00.633314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6706b8c-c108-4a25-a855-fa0f97eaea54 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:00.634383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6706b8c-c108-4a25-a855-fa0f97eaea54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:00.634737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6706b8c-c108-4a25-a855-fa0f97eaea54 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:00.635984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6706b8c-c108-4a25-a855-fa0f97eaea54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:00.639531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6706b8c-c108-4a25-a855-fa0f97eaea54 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:00.678110 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4056/8188] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:49:00 2022] POST /identity/v3/users => generated 308 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:49:00.680425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6706b8c-c108-4a25-a855-fa0f97eaea54 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:00.701217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c95d7-e341-47fe-91fd-96908f5d2079 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:00.704479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6706b8c-c108-4a25-a855-fa0f97eaea54 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:00.706259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a7124-04e5-4356-ac37-6e847acf4394 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:00.708157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a7124-04e5-4356-ac37-6e847acf4394 service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:00.708157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a7124-04e5-4356-ac37-6e847acf4394 service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:00.708559 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a7124-04e5-4356-ac37-6e847acf4394 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:00.740199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb5887-a0aa-4d7e-9a4c-9a52f78a0bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:00.741594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb5887-a0aa-4d7e-9a4c-9a52f78a0bec admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:00.744795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb5887-a0aa-4d7e-9a4c-9a52f78a0bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:00.745410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb5887-a0aa-4d7e-9a4c-9a52f78a0bec admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:00.747019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb5887-a0aa-4d7e-9a4c-9a52f78a0bec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:00.751868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb5887-a0aa-4d7e-9a4c-9a52f78a0bec admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:00.796400 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4057/8189] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:49:00.798135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb5887-a0aa-4d7e-9a4c-9a52f78a0bec admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:00.800681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a7124-04e5-4356-ac37-6e847acf4394 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:00.801321 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-09fb5887-a0aa-4d7e-9a4c-9a52f78a0bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:00.802314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a7124-04e5-4356-ac37-6e847acf4394 service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:00.815649 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4133/8190] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:49:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:49:00.816584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a7124-04e5-4356-ac37-6e847acf4394 service cinder] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:00.833300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a7124-04e5-4356-ac37-6e847acf4394 service cinder] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:00.840063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21313b4f-2643-4518-b49d-fdeb642a6566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:00.841038 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:00.843143 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21313b4f-2643-4518-b49d-fdeb642a6566 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:00.843768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21313b4f-2643-4518-b49d-fdeb642a6566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:00.844904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21313b4f-2643-4518-b49d-fdeb642a6566 admin admin] PATH_INFO: `/v3/projects/fcd01c21e5dd4a19b4d378198af9aa25/users/f3b064f287a042e089d2b6f0bbae5735/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:00.852870 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb5887-a0aa-4d7e-9a4c-9a52f78a0bec admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:00.866839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb27df0-f8c1-4634-ac11-88e21c11ff4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:00.868009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb27df0-f8c1-4634-ac11-88e21c11ff4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:00.872347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb27df0-f8c1-4634-ac11-88e21c11ff4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:00.872809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb27df0-f8c1-4634-ac11-88e21c11ff4e admin admin] PATH_INFO: `/v3/users/8a3a1c2ff40d4dcb989f21354f682f84` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:00.874845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb27df0-f8c1-4634-ac11-88e21c11ff4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a3a1c2ff40d4dcb989f21354f682f84)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:00.889448 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb27df0-f8c1-4634-ac11-88e21c11ff4e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:00.892084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21313b4f-2643-4518-b49d-fdeb642a6566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcd01c21e5dd4a19b4d378198af9aa25, user_id=f3b064f287a042e089d2b6f0bbae5735, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:00.897929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21313b4f-2643-4518-b49d-fdeb642a6566 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:00.929236 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4134/8191] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:49:00 2022] PUT /identity/v3/projects/fcd01c21e5dd4a19b4d378198af9aa25/users/f3b064f287a042e089d2b6f0bbae5735/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:00.933778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21313b4f-2643-4518-b49d-fdeb642a6566 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:01.054380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3bb27df0-f8c1-4634-ac11-88e21c11ff4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a3a1c2ff40d4dcb989f21354f682f84'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:01.121593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3bb27df0-f8c1-4634-ac11-88e21c11ff4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a3a1c2ff40d4dcb989f21354f682f84'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:01.188609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3bb27df0-f8c1-4634-ac11-88e21c11ff4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a3a1c2ff40d4dcb989f21354f682f84'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:01.196670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3bb27df0-f8c1-4634-ac11-88e21c11ff4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a3a1c2ff40d4dcb989f21354f682f84'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:01.214551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21313b4f-2643-4518-b49d-fdeb642a6566 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:01.225446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3bb27df0-f8c1-4634-ac11-88e21c11ff4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a3a1c2ff40d4dcb989f21354f682f84'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:01.240994 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fd80d-bb69-4eb1-9a70-461a2f1adef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:01.247866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fd80d-bb69-4eb1-9a70-461a2f1adef2 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:01.248192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fd80d-bb69-4eb1-9a70-461a2f1adef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:01.249541 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4058/8192] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:49:00 2022] DELETE /identity/v3/users/8a3a1c2ff40d4dcb989f21354f682f84 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:01.249679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fd80d-bb69-4eb1-9a70-461a2f1adef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:01.251341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367fd80d-bb69-4eb1-9a70-461a2f1adef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:01.255469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacdca6-e72c-4041-a2b5-a2027adb1440 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:01.255831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacdca6-e72c-4041-a2b5-a2027adb1440 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:01.256086 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacdca6-e72c-4041-a2b5-a2027adb1440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:01.261123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367fd80d-bb69-4eb1-9a70-461a2f1adef2 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:01.290841 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4135/8193] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:49:01.291363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fd80d-bb69-4eb1-9a70-461a2f1adef2 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:01.294198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-367fd80d-bb69-4eb1-9a70-461a2f1adef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:01.319502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7dacdca6-e72c-4041-a2b5-a2027adb1440 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:01.327254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7dacdca6-e72c-4041-a2b5-a2027adb1440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:01.339797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fd80d-bb69-4eb1-9a70-461a2f1adef2 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:01.483693 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:01.500694 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4059/8194] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:01.502038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacdca6-e72c-4041-a2b5-a2027adb1440 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:01.512560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7dacdca6-e72c-4041-a2b5-a2027adb1440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:01.513107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf24a42-4760-458a-9a79-24097e36735d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:01.515460 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf24a42-4760-458a-9a79-24097e36735d admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:01.516996 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf24a42-4760-458a-9a79-24097e36735d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:01.519716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf24a42-4760-458a-9a79-24097e36735d admin admin] PATH_INFO: `/v3/projects/fcd01c21e5dd4a19b4d378198af9aa25/users/f3b064f287a042e089d2b6f0bbae5735/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:01.527595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf24a42-4760-458a-9a79-24097e36735d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcd01c21e5dd4a19b4d378198af9aa25, user_id=f3b064f287a042e089d2b6f0bbae5735, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:01.532336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf24a42-4760-458a-9a79-24097e36735d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:01.545045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacdca6-e72c-4041-a2b5-a2027adb1440 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:01.559951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d9cdb-a126-414e-aac5-1a2b8a87f27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:01.560617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d9cdb-a126-414e-aac5-1a2b8a87f27b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:01.560894 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d9cdb-a126-414e-aac5-1a2b8a87f27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:01.561167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d9cdb-a126-414e-aac5-1a2b8a87f27b admin admin] PATH_INFO: `/v3/users/406422e3e58c44159ee3e8462c6e5af4` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:01.568834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d9cdb-a126-414e-aac5-1a2b8a87f27b admin admin] RBAC: Authorizing `identity:delete_user(user_id=406422e3e58c44159ee3e8462c6e5af4)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:01.570931 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4136/8195] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:49:01 2022] PUT /identity/v3/projects/fcd01c21e5dd4a19b4d378198af9aa25/users/f3b064f287a042e089d2b6f0bbae5735/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:01.572913 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d9cdb-a126-414e-aac5-1a2b8a87f27b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:01.585761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf24a42-4760-458a-9a79-24097e36735d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:01.589500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-caf24a42-4760-458a-9a79-24097e36735d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:01.672564 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-198d9cdb-a126-414e-aac5-1a2b8a87f27b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '406422e3e58c44159ee3e8462c6e5af4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:01.691320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-198d9cdb-a126-414e-aac5-1a2b8a87f27b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '406422e3e58c44159ee3e8462c6e5af4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:01.721785 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:01.723402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-198d9cdb-a126-414e-aac5-1a2b8a87f27b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '406422e3e58c44159ee3e8462c6e5af4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:01.724304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-198d9cdb-a126-414e-aac5-1a2b8a87f27b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '406422e3e58c44159ee3e8462c6e5af4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:01.739435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-198d9cdb-a126-414e-aac5-1a2b8a87f27b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '406422e3e58c44159ee3e8462c6e5af4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:01.768731 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4060/8196] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:49:01 2022] DELETE /identity/v3/users/406422e3e58c44159ee3e8462c6e5af4 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:01.773244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d9cdb-a126-414e-aac5-1a2b8a87f27b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:01.776173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-198d9cdb-a126-414e-aac5-1a2b8a87f27b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:01.781718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf24a42-4760-458a-9a79-24097e36735d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:01.891852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d172bd-1955-4420-b01c-11a613e1949f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:01.892509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d172bd-1955-4420-b01c-11a613e1949f service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:01.892794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d172bd-1955-4420-b01c-11a613e1949f service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:01.893253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d172bd-1955-4420-b01c-11a613e1949f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:01.895009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-68d172bd-1955-4420-b01c-11a613e1949f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:01.926727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d9cdb-a126-414e-aac5-1a2b8a87f27b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:01.945316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad48e0-2cd6-44db-976c-0494c84c664b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:01.946872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad48e0-2cd6-44db-976c-0494c84c664b service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:01.946872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad48e0-2cd6-44db-976c-0494c84c664b service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:01.947221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad48e0-2cd6-44db-976c-0494c84c664b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:01.951342 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ddad48e0-2cd6-44db-976c-0494c84c664b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:01.974236 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad48e0-2cd6-44db-976c-0494c84c664b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:01.979942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad48e0-2cd6-44db-976c-0494c84c664b service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:02.002413 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4061/8197] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:49:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:49:02.003545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef454305-e78f-424f-b112-8f4bebc364f4 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:02.003827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef454305-e78f-424f-b112-8f4bebc364f4 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:02.006274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef454305-e78f-424f-b112-8f4bebc364f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:02.025829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d172bd-1955-4420-b01c-11a613e1949f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:02.027321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d172bd-1955-4420-b01c-11a613e1949f service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:02.051190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ef454305-e78f-424f-b112-8f4bebc364f4 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:02.051561 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4137/8198] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:49:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:49:02.052872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ef454305-e78f-424f-b112-8f4bebc364f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:02.062720 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4062/8199] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:02.074301 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d172bd-1955-4420-b01c-11a613e1949f service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:02.075724 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-68d172bd-1955-4420-b01c-11a613e1949f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:02.104756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d172bd-1955-4420-b01c-11a613e1949f service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:02.113138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6942a-07ef-486d-a56f-8afc6195dfb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:02.114831 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6942a-07ef-486d-a56f-8afc6195dfb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:02.115671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6942a-07ef-486d-a56f-8afc6195dfb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:02.116478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed6942a-07ef-486d-a56f-8afc6195dfb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:02.142267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6942a-07ef-486d-a56f-8afc6195dfb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:02.145103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed6942a-07ef-486d-a56f-8afc6195dfb8 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:02.206479 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4138/8200] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:49:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:49:02.928204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef454305-e78f-424f-b112-8f4bebc364f4 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:02.934189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6942a-07ef-486d-a56f-8afc6195dfb8 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:02.934753 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ef454305-e78f-424f-b112-8f4bebc364f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:02.936785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6ed6942a-07ef-486d-a56f-8afc6195dfb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:02.963413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed6942a-07ef-486d-a56f-8afc6195dfb8 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:02.974628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f883afa-bb33-4abd-917a-ba075cc840c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:02.977633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f883afa-bb33-4abd-917a-ba075cc840c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:02.978155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f883afa-bb33-4abd-917a-ba075cc840c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:02.978641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f883afa-bb33-4abd-917a-ba075cc840c1 admin admin] PATH_INFO: `/v3/projects/c7a3020a0ea949869381043d752b6db1` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:02.983514 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f883afa-bb33-4abd-917a-ba075cc840c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7a3020a0ea949869381043d752b6db1)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:02.991261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f883afa-bb33-4abd-917a-ba075cc840c1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:03.117417 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:03.152333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4f883afa-bb33-4abd-917a-ba075cc840c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7a3020a0ea949869381043d752b6db1', 'request_id': 'req-4f883afa-bb33-4abd-917a-ba075cc840c1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:03.162962 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef454305-e78f-424f-b112-8f4bebc364f4 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:03.171516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4f883afa-bb33-4abd-917a-ba075cc840c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7a3020a0ea949869381043d752b6db1', 'request_id': 'req-4f883afa-bb33-4abd-917a-ba075cc840c1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:03.187353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4f883afa-bb33-4abd-917a-ba075cc840c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7a3020a0ea949869381043d752b6db1', 'request_id': 'req-4f883afa-bb33-4abd-917a-ba075cc840c1'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:03.214466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4f883afa-bb33-4abd-917a-ba075cc840c1 admin admin] The token cache is being invalidate because project c7a3020a0ea949869381043d752b6db1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:49:03.216627 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4f883afa-bb33-4abd-917a-ba075cc840c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:03.218628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4f883afa-bb33-4abd-917a-ba075cc840c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:03.221349 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4139/8201] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:49:02 2022] DELETE /identity/v3/projects/c7a3020a0ea949869381043d752b6db1 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:49:03.230426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf3a7e-312f-4a35-bbf8-d8f1f031bcb6 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:03.231018 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf3a7e-312f-4a35-bbf8-d8f1f031bcb6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:03.231476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf3a7e-312f-4a35-bbf8-d8f1f031bcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:03.284234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-96cf3a7e-312f-4a35-bbf8-d8f1f031bcb6 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:03.285609 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-96cf3a7e-312f-4a35-bbf8-d8f1f031bcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:03.319969 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758909bc-ccf2-4d33-a833-5e5a2851d235 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:03.321496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758909bc-ccf2-4d33-a833-5e5a2851d235 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:03.321860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758909bc-ccf2-4d33-a833-5e5a2851d235 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:03.322245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758909bc-ccf2-4d33-a833-5e5a2851d235 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:03.324359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-758909bc-ccf2-4d33-a833-5e5a2851d235 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:03.339816 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:03.352699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758909bc-ccf2-4d33-a833-5e5a2851d235 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:03.356758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758909bc-ccf2-4d33-a833-5e5a2851d235 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:03.408416 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4063/8202] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:49:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:49:03.472711 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4140/8203] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:03.478965 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e456ef-e67c-4859-9e76-a5aea1e5ba45 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:03.479250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e456ef-e67c-4859-9e76-a5aea1e5ba45 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:03.479524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e456ef-e67c-4859-9e76-a5aea1e5ba45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:03.526794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c6e456ef-e67c-4859-9e76-a5aea1e5ba45 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:03.528357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c6e456ef-e67c-4859-9e76-a5aea1e5ba45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:03.545196 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4064/8204] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:03.549235 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf3a7e-312f-4a35-bbf8-d8f1f031bcb6 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:03.575982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf3a7e-312f-4a35-bbf8-d8f1f031bcb6 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:03.600258 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485438a-c7c2-4e7f-8b94-839c7b0dc99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:03.601344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485438a-c7c2-4e7f-8b94-839c7b0dc99b admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:03.601855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485438a-c7c2-4e7f-8b94-839c7b0dc99b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:03.602386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5485438a-c7c2-4e7f-8b94-839c7b0dc99b admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:03.606762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485438a-c7c2-4e7f-8b94-839c7b0dc99b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:49:03.607636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485438a-c7c2-4e7f-8b94-839c7b0dc99b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:03.610417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5485438a-c7c2-4e7f-8b94-839c7b0dc99b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:03.647660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afd6f9-d855-4b0e-9280-0f46d7854878 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:03.648186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afd6f9-d855-4b0e-9280-0f46d7854878 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:03.648711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afd6f9-d855-4b0e-9280-0f46d7854878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:03.661334 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4141/8205] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:49:03.666350 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485438a-c7c2-4e7f-8b94-839c7b0dc99b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:03.687407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5485438a-c7c2-4e7f-8b94-839c7b0dc99b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:03.699673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dcb912-1401-4ff0-b6b4-cdff30f48bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:03.700638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dcb912-1401-4ff0-b6b4-cdff30f48bdc admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:03.701424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dcb912-1401-4ff0-b6b4-cdff30f48bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:03.702004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dcb912-1401-4ff0-b6b4-cdff30f48bdc admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:03.703124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dcb912-1401-4ff0-b6b4-cdff30f48bdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:03.708710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dcb912-1401-4ff0-b6b4-cdff30f48bdc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:03.721839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-72afd6f9-d855-4b0e-9280-0f46d7854878 None None] MFA Rules not processed for user `f3b064f287a042e089d2b6f0bbae5735`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:03.724537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-72afd6f9-d855-4b0e-9280-0f46d7854878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:03.797994 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4142/8206] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:49:03 2022] POST /identity/v3/projects => generated 365 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:49:03.802549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dcb912-1401-4ff0-b6b4-cdff30f48bdc admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:03.887688 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4065/8207] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:03 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:03.905104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72afd6f9-d855-4b0e-9280-0f46d7854878 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:03.908276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-72afd6f9-d855-4b0e-9280-0f46d7854878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:03.927071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72afd6f9-d855-4b0e-9280-0f46d7854878 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:03.992431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dcb912-1401-4ff0-b6b4-cdff30f48bdc admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:03.999036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aae1ab-e288-4cd5-96a0-62884bff8471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:03.999930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aae1ab-e288-4cd5-96a0-62884bff8471 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:04.000211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aae1ab-e288-4cd5-96a0-62884bff8471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:04.000807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aae1ab-e288-4cd5-96a0-62884bff8471 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:04.001513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aae1ab-e288-4cd5-96a0-62884bff8471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:04.003618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aae1ab-e288-4cd5-96a0-62884bff8471 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:04.047936 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4143/8208] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:49:03 2022] POST /identity/v3/users => generated 283 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:49:04.053625 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aae1ab-e288-4cd5-96a0-62884bff8471 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:04.068001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be0eaf-05a7-4e55-8ba0-26d1b8bc61c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:04.068754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be0eaf-05a7-4e55-8ba0-26d1b8bc61c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:04.069091 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be0eaf-05a7-4e55-8ba0-26d1b8bc61c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:04.069418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be0eaf-05a7-4e55-8ba0-26d1b8bc61c1 admin admin] PATH_INFO: `/v3/projects/cdb0d9ea2b90459e87c7970afd228690` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:04.071651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be0eaf-05a7-4e55-8ba0-26d1b8bc61c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdb0d9ea2b90459e87c7970afd228690)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:04.075239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be0eaf-05a7-4e55-8ba0-26d1b8bc61c1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:04.077730 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aae1ab-e288-4cd5-96a0-62884bff8471 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:04.082706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f50bc-825e-4976-8870-86066018944d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:04.083401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f50bc-825e-4976-8870-86066018944d admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:04.083774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f50bc-825e-4976-8870-86066018944d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:04.084148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f50bc-825e-4976-8870-86066018944d admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:04.084873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f50bc-825e-4976-8870-86066018944d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:04.087357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f50bc-825e-4976-8870-86066018944d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:04.099383 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4144/8209] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:49:04.104906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f50bc-825e-4976-8870-86066018944d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:04.115467 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:04.128211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f50bc-825e-4976-8870-86066018944d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:04.141471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5c159-7d9d-4b26-91a9-7b2a63afe4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:04.142114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5c159-7d9d-4b26-91a9-7b2a63afe4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:04.142433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5c159-7d9d-4b26-91a9-7b2a63afe4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:04.142796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5c159-7d9d-4b26-91a9-7b2a63afe4d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:04.143529 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5c159-7d9d-4b26-91a9-7b2a63afe4d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:04.145124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5c159-7d9d-4b26-91a9-7b2a63afe4d3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:04.179997 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4145/8210] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:49:04.182731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5c159-7d9d-4b26-91a9-7b2a63afe4d3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:04.192305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-85be0eaf-05a7-4e55-8ba0-26d1b8bc61c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdb0d9ea2b90459e87c7970afd228690', 'request_id': 'req-85be0eaf-05a7-4e55-8ba0-26d1b8bc61c1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:04.202323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5c159-7d9d-4b26-91a9-7b2a63afe4d3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:04.203594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-85be0eaf-05a7-4e55-8ba0-26d1b8bc61c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdb0d9ea2b90459e87c7970afd228690', 'request_id': 'req-85be0eaf-05a7-4e55-8ba0-26d1b8bc61c1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:04.252486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-85be0eaf-05a7-4e55-8ba0-26d1b8bc61c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdb0d9ea2b90459e87c7970afd228690', 'request_id': 'req-85be0eaf-05a7-4e55-8ba0-26d1b8bc61c1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:04.287446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-85be0eaf-05a7-4e55-8ba0-26d1b8bc61c1 admin admin] The token cache is being invalidate because project cdb0d9ea2b90459e87c7970afd228690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:49:04.287446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-85be0eaf-05a7-4e55-8ba0-26d1b8bc61c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:04.288305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-85be0eaf-05a7-4e55-8ba0-26d1b8bc61c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:04.293871 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4066/8211] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:49:03 2022] DELETE /identity/v3/projects/cdb0d9ea2b90459e87c7970afd228690 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:04.297798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be0eaf-05a7-4e55-8ba0-26d1b8bc61c1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:04.300570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-85be0eaf-05a7-4e55-8ba0-26d1b8bc61c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:04.313969 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:04.333062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df3daf-ff09-4958-9de8-4a0327202316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:04.344286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df3daf-ff09-4958-9de8-4a0327202316 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:04.345607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df3daf-ff09-4958-9de8-4a0327202316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:04.347277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df3daf-ff09-4958-9de8-4a0327202316 admin admin] PATH_INFO: `/v3/projects/af1f780a60424bff93b7b1b3d8051893/users/2b0cd6516ba64030b2369714f0efd36c/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:04.384836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df3daf-ff09-4958-9de8-4a0327202316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af1f780a60424bff93b7b1b3d8051893, user_id=2b0cd6516ba64030b2369714f0efd36c, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:04.389370 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df3daf-ff09-4958-9de8-4a0327202316 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:04.456181 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4146/8212] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:49:04 2022] PUT /identity/v3/projects/af1f780a60424bff93b7b1b3d8051893/users/2b0cd6516ba64030b2369714f0efd36c/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:04.462174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634f079-b71b-452f-b77f-46b46dc5b271 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:04.462503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634f079-b71b-452f-b77f-46b46dc5b271 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:04.462722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634f079-b71b-452f-b77f-46b46dc5b271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:04.499966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be0eaf-05a7-4e55-8ba0-26d1b8bc61c1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:04.523928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6634f079-b71b-452f-b77f-46b46dc5b271 None None] MFA Rules not processed for user `2b0cd6516ba64030b2369714f0efd36c`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:04.525509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6634f079-b71b-452f-b77f-46b46dc5b271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:04.592275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88dc5c4-8680-42db-8813-b9140123ff44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:04.593087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88dc5c4-8680-42db-8813-b9140123ff44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:04.593468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88dc5c4-8680-42db-8813-b9140123ff44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:04.593976 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88dc5c4-8680-42db-8813-b9140123ff44 admin admin] PATH_INFO: `/v3/users/4ddead9ceadf4d45bccc089bf89758e1` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:04.595351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88dc5c4-8680-42db-8813-b9140123ff44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ddead9ceadf4d45bccc089bf89758e1)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:04.597823 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88dc5c4-8680-42db-8813-b9140123ff44 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:04.655960 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4147/8213] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:49:04.669790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634f079-b71b-452f-b77f-46b46dc5b271 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:04.673528 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6634f079-b71b-452f-b77f-46b46dc5b271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:04.697117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d88dc5c4-8680-42db-8813-b9140123ff44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ddead9ceadf4d45bccc089bf89758e1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:04.707388 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d88dc5c4-8680-42db-8813-b9140123ff44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ddead9ceadf4d45bccc089bf89758e1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:04.724797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d88dc5c4-8680-42db-8813-b9140123ff44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ddead9ceadf4d45bccc089bf89758e1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:04.725861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d88dc5c4-8680-42db-8813-b9140123ff44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ddead9ceadf4d45bccc089bf89758e1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:04.738160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d88dc5c4-8680-42db-8813-b9140123ff44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ddead9ceadf4d45bccc089bf89758e1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:04.750847 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4067/8214] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:49:04 2022] DELETE /identity/v3/users/4ddead9ceadf4d45bccc089bf89758e1 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:49:04.836920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634f079-b71b-452f-b77f-46b46dc5b271 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:04.880653 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:05.049987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a461630-be6b-4129-a1ff-e6ff80330216 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:05.051961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a461630-be6b-4129-a1ff-e6ff80330216 service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:05.052406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a461630-be6b-4129-a1ff-e6ff80330216 service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:05.052828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a461630-be6b-4129-a1ff-e6ff80330216 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:05.081743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4a461630-be6b-4129-a1ff-e6ff80330216 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:05.265892 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a461630-be6b-4129-a1ff-e6ff80330216 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:05.267589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a461630-be6b-4129-a1ff-e6ff80330216 service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:05.282011 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4148/8215] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:49:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:49:05.601333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88dc5c4-8680-42db-8813-b9140123ff44 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:05.603585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d88dc5c4-8680-42db-8813-b9140123ff44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:05.675660 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:05.855811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88dc5c4-8680-42db-8813-b9140123ff44 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:05.876359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff31f2-2e37-4f3a-ae90-0fcefdc14c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:05.885123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff31f2-2e37-4f3a-ae90-0fcefdc14c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:05.885516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff31f2-2e37-4f3a-ae90-0fcefdc14c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:05.885897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff31f2-2e37-4f3a-ae90-0fcefdc14c7f admin admin] PATH_INFO: `/v3/projects/e8723c5e1909415b89cb76b299ef96b2` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:05.893083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff31f2-2e37-4f3a-ae90-0fcefdc14c7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8723c5e1909415b89cb76b299ef96b2)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:05.896264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff31f2-2e37-4f3a-ae90-0fcefdc14c7f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:05.935267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a461630-be6b-4129-a1ff-e6ff80330216 service cinder] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:05.937043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4a461630-be6b-4129-a1ff-e6ff80330216 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:06.003449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a461630-be6b-4129-a1ff-e6ff80330216 service cinder] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:06.013997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-61ff31f2-2e37-4f3a-ae90-0fcefdc14c7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8723c5e1909415b89cb76b299ef96b2', 'request_id': 'req-61ff31f2-2e37-4f3a-ae90-0fcefdc14c7f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:06.029002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-61ff31f2-2e37-4f3a-ae90-0fcefdc14c7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8723c5e1909415b89cb76b299ef96b2', 'request_id': 'req-61ff31f2-2e37-4f3a-ae90-0fcefdc14c7f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:06.043921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-61ff31f2-2e37-4f3a-ae90-0fcefdc14c7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8723c5e1909415b89cb76b299ef96b2', 'request_id': 'req-61ff31f2-2e37-4f3a-ae90-0fcefdc14c7f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:06.068783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-61ff31f2-2e37-4f3a-ae90-0fcefdc14c7f admin admin] The token cache is being invalidate because project e8723c5e1909415b89cb76b299ef96b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:49:06.069237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-61ff31f2-2e37-4f3a-ae90-0fcefdc14c7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:06.071221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-61ff31f2-2e37-4f3a-ae90-0fcefdc14c7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:06.074803 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4068/8216] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:49:05 2022] DELETE /identity/v3/projects/e8723c5e1909415b89cb76b299ef96b2 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:06.079585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05629fe3-7eb6-40c2-88b3-382cbab70a77 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:06.079878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05629fe3-7eb6-40c2-88b3-382cbab70a77 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:06.080185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05629fe3-7eb6-40c2-88b3-382cbab70a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:06.151135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-05629fe3-7eb6-40c2-88b3-382cbab70a77 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:06.156217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-05629fe3-7eb6-40c2-88b3-382cbab70a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:06.168818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a93c72-7526-421d-a36f-2b4bc6375586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:06.170434 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a93c72-7526-421d-a36f-2b4bc6375586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:06.170743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a93c72-7526-421d-a36f-2b4bc6375586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:06.170987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a93c72-7526-421d-a36f-2b4bc6375586 admin admin] PATH_INFO: `/v3/users/243cda462af54e9db53fa176c1cb8d82` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:06.173026 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a93c72-7526-421d-a36f-2b4bc6375586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=243cda462af54e9db53fa176c1cb8d82)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:06.185401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a93c72-7526-421d-a36f-2b4bc6375586 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:06.191632 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4069/8217] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:06.199029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e003f66-07b2-4ab3-b471-2fa4a4a7f710 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:06.199388 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e003f66-07b2-4ab3-b471-2fa4a4a7f710 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:06.199696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e003f66-07b2-4ab3-b471-2fa4a4a7f710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:06.249543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6e003f66-07b2-4ab3-b471-2fa4a4a7f710 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:06.253767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6e003f66-07b2-4ab3-b471-2fa4a4a7f710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:06.276300 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4070/8218] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:06.281746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e003f66-07b2-4ab3-b471-2fa4a4a7f710 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:06.300547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e003f66-07b2-4ab3-b471-2fa4a4a7f710 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:06.318897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0207ad-2d80-4d3e-ab99-155699fe0c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:06.324150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0207ad-2d80-4d3e-ab99-155699fe0c88 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:06.325085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f6a93c72-7526-421d-a36f-2b4bc6375586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '243cda462af54e9db53fa176c1cb8d82'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:06.325664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0207ad-2d80-4d3e-ab99-155699fe0c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:06.328655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0207ad-2d80-4d3e-ab99-155699fe0c88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:06.330869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0207ad-2d80-4d3e-ab99-155699fe0c88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:49:06.332991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0207ad-2d80-4d3e-ab99-155699fe0c88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:06.344091 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0207ad-2d80-4d3e-ab99-155699fe0c88 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:06.351846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f6a93c72-7526-421d-a36f-2b4bc6375586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '243cda462af54e9db53fa176c1cb8d82'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:06.389022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f6a93c72-7526-421d-a36f-2b4bc6375586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '243cda462af54e9db53fa176c1cb8d82'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:06.390537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f6a93c72-7526-421d-a36f-2b4bc6375586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '243cda462af54e9db53fa176c1cb8d82'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:06.402457 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:06.412186 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4071/8219] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:49:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:49:06.412739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f6a93c72-7526-421d-a36f-2b4bc6375586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '243cda462af54e9db53fa176c1cb8d82'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:06.422833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0207ad-2d80-4d3e-ab99-155699fe0c88 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:06.425814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1e0207ad-2d80-4d3e-ab99-155699fe0c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:06.439139 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4149/8220] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:49:05 2022] DELETE /identity/v3/users/243cda462af54e9db53fa176c1cb8d82 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:06.444587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad597233-0351-47d4-b8fc-5fc673454b74 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:06.445019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad597233-0351-47d4-b8fc-5fc673454b74 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:06.445299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad597233-0351-47d4-b8fc-5fc673454b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:06.490466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0207ad-2d80-4d3e-ab99-155699fe0c88 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:06.553160 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ad597233-0351-47d4-b8fc-5fc673454b74 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:06.554420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ad597233-0351-47d4-b8fc-5fc673454b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:06.734783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893dc29-222b-4880-aaaf-b68d90dc8c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:06.735442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893dc29-222b-4880-aaaf-b68d90dc8c5e admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:06.735728 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893dc29-222b-4880-aaaf-b68d90dc8c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:06.736045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893dc29-222b-4880-aaaf-b68d90dc8c5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:06.736712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893dc29-222b-4880-aaaf-b68d90dc8c5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:06.745935 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4150/8221] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:06.747872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad597233-0351-47d4-b8fc-5fc673454b74 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:06.752022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ad597233-0351-47d4-b8fc-5fc673454b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:06.758937 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893dc29-222b-4880-aaaf-b68d90dc8c5e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:06.779518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad597233-0351-47d4-b8fc-5fc673454b74 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:06.787142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2662a84-c198-45c6-8176-84404908543e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:06.788116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2662a84-c198-45c6-8176-84404908543e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:06.788551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2662a84-c198-45c6-8176-84404908543e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:06.789006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2662a84-c198-45c6-8176-84404908543e admin admin] PATH_INFO: `/v3/users/6450b1d36db046de8984227994bf6276` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:06.790724 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2662a84-c198-45c6-8176-84404908543e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6450b1d36db046de8984227994bf6276)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:06.793405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2662a84-c198-45c6-8176-84404908543e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:06.832310 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4072/8222] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:49:06 2022] POST /identity/v3/projects => generated 383 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:49:06.833790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893dc29-222b-4880-aaaf-b68d90dc8c5e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:06.838766 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0893dc29-222b-4880-aaaf-b68d90dc8c5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:06.890614 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:06.922437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d2662a84-c198-45c6-8176-84404908543e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6450b1d36db046de8984227994bf6276'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:06.933758 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d2662a84-c198-45c6-8176-84404908543e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6450b1d36db046de8984227994bf6276'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:06.968024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d2662a84-c198-45c6-8176-84404908543e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6450b1d36db046de8984227994bf6276'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:06.969230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d2662a84-c198-45c6-8176-84404908543e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6450b1d36db046de8984227994bf6276'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:06.985161 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d2662a84-c198-45c6-8176-84404908543e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6450b1d36db046de8984227994bf6276'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:06.996484 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4151/8223] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:49:06 2022] DELETE /identity/v3/users/6450b1d36db046de8984227994bf6276 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:06.997712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2662a84-c198-45c6-8176-84404908543e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:07.006759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d2662a84-c198-45c6-8176-84404908543e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:07.030592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893dc29-222b-4880-aaaf-b68d90dc8c5e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:07.160016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2662a84-c198-45c6-8176-84404908543e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:07.174543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da1231-9729-4ea1-96dc-15b19c55e85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:07.175197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da1231-9729-4ea1-96dc-15b19c55e85c admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:07.175464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da1231-9729-4ea1-96dc-15b19c55e85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:07.175743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da1231-9729-4ea1-96dc-15b19c55e85c admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:07.177541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da1231-9729-4ea1-96dc-15b19c55e85c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:07.179539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da1231-9729-4ea1-96dc-15b19c55e85c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:07.221062 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:07.221940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca214643-e19e-49a9-b10d-84cdfd4866f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:07.222637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca214643-e19e-49a9-b10d-84cdfd4866f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:07.223078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca214643-e19e-49a9-b10d-84cdfd4866f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:07.223391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca214643-e19e-49a9-b10d-84cdfd4866f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:07.227155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ca214643-e19e-49a9-b10d-84cdfd4866f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:07.239536 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4152/8224] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:49:06 2022] POST /identity/v3/users => generated 292 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:49:07.241944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da1231-9729-4ea1-96dc-15b19c55e85c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:07.262525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca214643-e19e-49a9-b10d-84cdfd4866f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:07.264259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca214643-e19e-49a9-b10d-84cdfd4866f5 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:07.272414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da1231-9729-4ea1-96dc-15b19c55e85c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:07.286749 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94232cfa-287c-4ff2-a1ad-4935e8a2ff44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:07.287696 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94232cfa-287c-4ff2-a1ad-4935e8a2ff44 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:07.288165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94232cfa-287c-4ff2-a1ad-4935e8a2ff44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:07.288597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94232cfa-287c-4ff2-a1ad-4935e8a2ff44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:07.289480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94232cfa-287c-4ff2-a1ad-4935e8a2ff44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:07.291419 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94232cfa-287c-4ff2-a1ad-4935e8a2ff44 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:07.308232 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4073/8225] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:49:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:49:07.328552 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4153/8226] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:49:07.329568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca214643-e19e-49a9-b10d-84cdfd4866f5 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:07.361680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca214643-e19e-49a9-b10d-84cdfd4866f5 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:07.375748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1286cae8-3d50-4eca-9b37-4da4f828470d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:07.376452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286cae8-3d50-4eca-9b37-4da4f828470d admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:07.376734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286cae8-3d50-4eca-9b37-4da4f828470d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:07.376999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1286cae8-3d50-4eca-9b37-4da4f828470d admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:07.377661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1286cae8-3d50-4eca-9b37-4da4f828470d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:07.379330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1286cae8-3d50-4eca-9b37-4da4f828470d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:07.412685 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4074/8227] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:49:07.413491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94232cfa-287c-4ff2-a1ad-4935e8a2ff44 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:07.434372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94232cfa-287c-4ff2-a1ad-4935e8a2ff44 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:07.448582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8fc94-6fa3-412e-ae4b-6a4102daac38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:07.449587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8fc94-6fa3-412e-ae4b-6a4102daac38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:07.451768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8fc94-6fa3-412e-ae4b-6a4102daac38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:07.452573 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8fc94-6fa3-412e-ae4b-6a4102daac38 admin admin] PATH_INFO: `/v3/projects/496cbeb3f54d443fb4dd070c16cc5b47/users/0ea202a26e6042678d01974000b35a1d/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:07.528006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8fc94-6fa3-412e-ae4b-6a4102daac38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=496cbeb3f54d443fb4dd070c16cc5b47, user_id=0ea202a26e6042678d01974000b35a1d, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:07.537904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8fc94-6fa3-412e-ae4b-6a4102daac38 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:07.582580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1286cae8-3d50-4eca-9b37-4da4f828470d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:07.584351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1286cae8-3d50-4eca-9b37-4da4f828470d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:07.592877 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4154/8228] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:49:07 2022] PUT /identity/v3/projects/496cbeb3f54d443fb4dd070c16cc5b47/users/0ea202a26e6042678d01974000b35a1d/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:49:07.616503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612f58e-3057-4206-9854-13d9b22dd90e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:07.616940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1286cae8-3d50-4eca-9b37-4da4f828470d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:07.617057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612f58e-3057-4206-9854-13d9b22dd90e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:07.618212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612f58e-3057-4206-9854-13d9b22dd90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:07.689135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a612f58e-3057-4206-9854-13d9b22dd90e None None] MFA Rules not processed for user `0ea202a26e6042678d01974000b35a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:07.690711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a612f58e-3057-4206-9854-13d9b22dd90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:07.835267 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4155/8229] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:07.841775 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612f58e-3057-4206-9854-13d9b22dd90e None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:07.878792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2b054-4b39-4bff-ab22-2fbce6b6a7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:07.879729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2b054-4b39-4bff-ab22-2fbce6b6a7b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:07.880204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2b054-4b39-4bff-ab22-2fbce6b6a7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:07.880618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2b054-4b39-4bff-ab22-2fbce6b6a7b5 admin admin] PATH_INFO: `/v3/projects/f39ae74e533a4c069bbe7ff12da7f1c2` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:07.892848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2b054-4b39-4bff-ab22-2fbce6b6a7b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f39ae74e533a4c069bbe7ff12da7f1c2)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:07.901108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2b054-4b39-4bff-ab22-2fbce6b6a7b5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:08.011307 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612f58e-3057-4206-9854-13d9b22dd90e None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:08.018554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade16119-44c8-47d2-a0b6-c0c9cb51563f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:08.019206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade16119-44c8-47d2-a0b6-c0c9cb51563f admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:08.019483 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade16119-44c8-47d2-a0b6-c0c9cb51563f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:08.019752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade16119-44c8-47d2-a0b6-c0c9cb51563f admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:08.020590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade16119-44c8-47d2-a0b6-c0c9cb51563f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:08.022877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade16119-44c8-47d2-a0b6-c0c9cb51563f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:08.079622 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4156/8230] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:49:07 2022] POST /identity/v3/projects => generated 383 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:49:08.084093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade16119-44c8-47d2-a0b6-c0c9cb51563f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:08.090016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ade16119-44c8-47d2-a0b6-c0c9cb51563f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:08.128772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a5d2b054-4b39-4bff-ab22-2fbce6b6a7b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f39ae74e533a4c069bbe7ff12da7f1c2', 'request_id': 'req-a5d2b054-4b39-4bff-ab22-2fbce6b6a7b5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:08.151100 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a5d2b054-4b39-4bff-ab22-2fbce6b6a7b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f39ae74e533a4c069bbe7ff12da7f1c2', 'request_id': 'req-a5d2b054-4b39-4bff-ab22-2fbce6b6a7b5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:08.158369 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:08.178718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a5d2b054-4b39-4bff-ab22-2fbce6b6a7b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f39ae74e533a4c069bbe7ff12da7f1c2', 'request_id': 'req-a5d2b054-4b39-4bff-ab22-2fbce6b6a7b5'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:08.203221 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:08.215998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a5d2b054-4b39-4bff-ab22-2fbce6b6a7b5 admin admin] The token cache is being invalidate because project f39ae74e533a4c069bbe7ff12da7f1c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:49:08.215998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a5d2b054-4b39-4bff-ab22-2fbce6b6a7b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:08.215998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a5d2b054-4b39-4bff-ab22-2fbce6b6a7b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:08.215998 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4075/8231] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:49:07 2022] DELETE /identity/v3/projects/f39ae74e533a4c069bbe7ff12da7f1c2 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:08.215998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2b054-4b39-4bff-ab22-2fbce6b6a7b5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:08.221814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade16119-44c8-47d2-a0b6-c0c9cb51563f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:08.224004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a5d2b054-4b39-4bff-ab22-2fbce6b6a7b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:08.232966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be074a93-25a7-44c8-b5ac-7d773ba363f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:08.233625 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be074a93-25a7-44c8-b5ac-7d773ba363f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:08.233902 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be074a93-25a7-44c8-b5ac-7d773ba363f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:08.234173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be074a93-25a7-44c8-b5ac-7d773ba363f8 admin admin] PATH_INFO: `/v3/projects/5927cf3d972542768a09cdb281dcce53` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:08.235575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be074a93-25a7-44c8-b5ac-7d773ba363f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5927cf3d972542768a09cdb281dcce53)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:08.237850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be074a93-25a7-44c8-b5ac-7d773ba363f8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:08.314658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-be074a93-25a7-44c8-b5ac-7d773ba363f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5927cf3d972542768a09cdb281dcce53', 'request_id': 'req-be074a93-25a7-44c8-b5ac-7d773ba363f8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:08.325149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-be074a93-25a7-44c8-b5ac-7d773ba363f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5927cf3d972542768a09cdb281dcce53', 'request_id': 'req-be074a93-25a7-44c8-b5ac-7d773ba363f8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:08.337716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-be074a93-25a7-44c8-b5ac-7d773ba363f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5927cf3d972542768a09cdb281dcce53', 'request_id': 'req-be074a93-25a7-44c8-b5ac-7d773ba363f8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:08.366407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-be074a93-25a7-44c8-b5ac-7d773ba363f8 admin admin] The token cache is being invalidate because project 5927cf3d972542768a09cdb281dcce53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:49:08.366997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-be074a93-25a7-44c8-b5ac-7d773ba363f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:08.368422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-be074a93-25a7-44c8-b5ac-7d773ba363f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:08.372170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2b054-4b39-4bff-ab22-2fbce6b6a7b5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:08.373820 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4157/8232] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:49:08 2022] DELETE /identity/v3/projects/5927cf3d972542768a09cdb281dcce53 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:08.377101 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be074a93-25a7-44c8-b5ac-7d773ba363f8 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:08.381330 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-be074a93-25a7-44c8-b5ac-7d773ba363f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:08.506666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be074a93-25a7-44c8-b5ac-7d773ba363f8 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:08.537044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de0a6a-1d38-4d25-9ffa-2b20c87ee284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:08.537834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de0a6a-1d38-4d25-9ffa-2b20c87ee284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:08.538139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de0a6a-1d38-4d25-9ffa-2b20c87ee284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:08.538465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de0a6a-1d38-4d25-9ffa-2b20c87ee284 admin admin] PATH_INFO: `/v3/users/f3b064f287a042e089d2b6f0bbae5735` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:08.540780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de0a6a-1d38-4d25-9ffa-2b20c87ee284 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3b064f287a042e089d2b6f0bbae5735)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:08.549127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de0a6a-1d38-4d25-9ffa-2b20c87ee284 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:08.553922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e41dcc-52d0-473b-9c0e-98c1a9c7e2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:08.554572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e41dcc-52d0-473b-9c0e-98c1a9c7e2ea admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:08.554887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e41dcc-52d0-473b-9c0e-98c1a9c7e2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:08.555321 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e41dcc-52d0-473b-9c0e-98c1a9c7e2ea admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:08.556362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e41dcc-52d0-473b-9c0e-98c1a9c7e2ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:08.558374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e41dcc-52d0-473b-9c0e-98c1a9c7e2ea admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:08.593886 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4076/8233] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:49:08 2022] POST /identity/v3/users => generated 298 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:49:08.595538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e41dcc-52d0-473b-9c0e-98c1a9c7e2ea admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:08.598007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c0e41dcc-52d0-473b-9c0e-98c1a9c7e2ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:08.615257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e41dcc-52d0-473b-9c0e-98c1a9c7e2ea admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:08.622613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e94be3-0af6-4eda-aa13-1daa9443cb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:08.623353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e94be3-0af6-4eda-aa13-1daa9443cb35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:08.623725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e94be3-0af6-4eda-aa13-1daa9443cb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:08.624838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e94be3-0af6-4eda-aa13-1daa9443cb35 admin admin] PATH_INFO: `/v3/users/64bc280262fe4fc9aab8cf3a907f0bbc` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:08.626841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e94be3-0af6-4eda-aa13-1daa9443cb35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64bc280262fe4fc9aab8cf3a907f0bbc)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:08.629173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e94be3-0af6-4eda-aa13-1daa9443cb35 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:08.700598 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-82de0a6a-1d38-4d25-9ffa-2b20c87ee284 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3b064f287a042e089d2b6f0bbae5735'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:08.720392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-02e94be3-0af6-4eda-aa13-1daa9443cb35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64bc280262fe4fc9aab8cf3a907f0bbc'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:08.726638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-82de0a6a-1d38-4d25-9ffa-2b20c87ee284 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3b064f287a042e089d2b6f0bbae5735'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:08.739479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-02e94be3-0af6-4eda-aa13-1daa9443cb35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64bc280262fe4fc9aab8cf3a907f0bbc'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:08.747267 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:08.751812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-82de0a6a-1d38-4d25-9ffa-2b20c87ee284 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3b064f287a042e089d2b6f0bbae5735'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:08.754622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-82de0a6a-1d38-4d25-9ffa-2b20c87ee284 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3b064f287a042e089d2b6f0bbae5735'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:08.775692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-02e94be3-0af6-4eda-aa13-1daa9443cb35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64bc280262fe4fc9aab8cf3a907f0bbc'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:08.777219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-02e94be3-0af6-4eda-aa13-1daa9443cb35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64bc280262fe4fc9aab8cf3a907f0bbc'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:08.788718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-82de0a6a-1d38-4d25-9ffa-2b20c87ee284 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3b064f287a042e089d2b6f0bbae5735'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:08.796368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-02e94be3-0af6-4eda-aa13-1daa9443cb35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64bc280262fe4fc9aab8cf3a907f0bbc'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:08.799929 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4158/8234] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:49:08 2022] DELETE /identity/v3/users/f3b064f287a042e089d2b6f0bbae5735 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:08.801693 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de0a6a-1d38-4d25-9ffa-2b20c87ee284 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:08.809175 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4077/8235] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:49:08 2022] DELETE /identity/v3/users/64bc280262fe4fc9aab8cf3a907f0bbc => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:08.810246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-82de0a6a-1d38-4d25-9ffa-2b20c87ee284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:08.974555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de0a6a-1d38-4d25-9ffa-2b20c87ee284 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:09.102542 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2f33d-85de-439f-b1c1-3988afb7e78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:09.103738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2f33d-85de-439f-b1c1-3988afb7e78c admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:09.104258 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2f33d-85de-439f-b1c1-3988afb7e78c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:09.104917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2f33d-85de-439f-b1c1-3988afb7e78c admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:09.106030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2f33d-85de-439f-b1c1-3988afb7e78c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:09.108597 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2f33d-85de-439f-b1c1-3988afb7e78c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:09.131621 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4159/8236] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:49:09.142558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e94be3-0af6-4eda-aa13-1daa9443cb35 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:09.145024 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-02e94be3-0af6-4eda-aa13-1daa9443cb35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:09.178212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e94be3-0af6-4eda-aa13-1daa9443cb35 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:09.192639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603133f-fd3e-4e74-8bf7-49452ee2593e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:09.196181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603133f-fd3e-4e74-8bf7-49452ee2593e admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:09.198710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603133f-fd3e-4e74-8bf7-49452ee2593e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:09.199557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603133f-fd3e-4e74-8bf7-49452ee2593e admin admin] PATH_INFO: `/v3/projects/40817fdf68694085909512c0a6a74d98/users/2daaf07fba6a4e739f6b219865920fcf/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:09.205975 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:09.247290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603133f-fd3e-4e74-8bf7-49452ee2593e admin admin] RBAC: Authorizing `identity:create_grant(project_id=40817fdf68694085909512c0a6a74d98, user_id=2daaf07fba6a4e739f6b219865920fcf, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:09.253998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603133f-fd3e-4e74-8bf7-49452ee2593e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:09.342282 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4078/8237] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:49:09 2022] PUT /identity/v3/projects/40817fdf68694085909512c0a6a74d98/users/2daaf07fba6a4e739f6b219865920fcf/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:09.346291 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2f33d-85de-439f-b1c1-3988afb7e78c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:09.371689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2f33d-85de-439f-b1c1-3988afb7e78c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:09.381554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603133f-fd3e-4e74-8bf7-49452ee2593e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:09.383995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1603133f-fd3e-4e74-8bf7-49452ee2593e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:09.530127 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603133f-fd3e-4e74-8bf7-49452ee2593e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:09.540759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bfd68-f919-4173-a23a-32f3ee384dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:09.541433 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bfd68-f919-4173-a23a-32f3ee384dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:09.541715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bfd68-f919-4173-a23a-32f3ee384dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:09.541992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bfd68-f919-4173-a23a-32f3ee384dab admin admin] PATH_INFO: `/v3/projects/fcd01c21e5dd4a19b4d378198af9aa25` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:09.543308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019bfd68-f919-4173-a23a-32f3ee384dab admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcd01c21e5dd4a19b4d378198af9aa25)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:09.545301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019bfd68-f919-4173-a23a-32f3ee384dab admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:09.595446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece51bac-4917-4a43-b14c-26bbfd2dbd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:09.597940 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece51bac-4917-4a43-b14c-26bbfd2dbd13 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:09.598238 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece51bac-4917-4a43-b14c-26bbfd2dbd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:09.598519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece51bac-4917-4a43-b14c-26bbfd2dbd13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:09.600384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece51bac-4917-4a43-b14c-26bbfd2dbd13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:09.606482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece51bac-4917-4a43-b14c-26bbfd2dbd13 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:09.644308 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4160/8238] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:49:09.644308 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece51bac-4917-4a43-b14c-26bbfd2dbd13 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:09.658466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ece51bac-4917-4a43-b14c-26bbfd2dbd13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:09.677958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece51bac-4917-4a43-b14c-26bbfd2dbd13 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:09.686468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-019bfd68-f919-4173-a23a-32f3ee384dab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcd01c21e5dd4a19b4d378198af9aa25', 'request_id': 'req-019bfd68-f919-4173-a23a-32f3ee384dab'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:09.694445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-019bfd68-f919-4173-a23a-32f3ee384dab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcd01c21e5dd4a19b4d378198af9aa25', 'request_id': 'req-019bfd68-f919-4173-a23a-32f3ee384dab'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:09.705615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-019bfd68-f919-4173-a23a-32f3ee384dab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcd01c21e5dd4a19b4d378198af9aa25', 'request_id': 'req-019bfd68-f919-4173-a23a-32f3ee384dab'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:09.725268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-019bfd68-f919-4173-a23a-32f3ee384dab admin admin] The token cache is being invalidate because project fcd01c21e5dd4a19b4d378198af9aa25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:49:09.725886 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-019bfd68-f919-4173-a23a-32f3ee384dab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:09.727567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-019bfd68-f919-4173-a23a-32f3ee384dab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:09.729732 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4079/8239] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:49:09 2022] DELETE /identity/v3/projects/fcd01c21e5dd4a19b4d378198af9aa25 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:49:09.730727 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bfd68-f919-4173-a23a-32f3ee384dab admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:09.732419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-019bfd68-f919-4173-a23a-32f3ee384dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:09.751997 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:09.821353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36441fd1-0d7a-41f5-8aab-f98076001963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:09.822448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36441fd1-0d7a-41f5-8aab-f98076001963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:09.822942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36441fd1-0d7a-41f5-8aab-f98076001963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:09.823466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36441fd1-0d7a-41f5-8aab-f98076001963 admin admin] PATH_INFO: `/v3/projects/3c91432d69bf408188c70a03d2fc539c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:09.826220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36441fd1-0d7a-41f5-8aab-f98076001963 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c91432d69bf408188c70a03d2fc539c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:09.830465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36441fd1-0d7a-41f5-8aab-f98076001963 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:09.845344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bfd68-f919-4173-a23a-32f3ee384dab admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:09.851281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70207ef1-e6f3-4c82-8931-2740b293319a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:09.852870 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70207ef1-e6f3-4c82-8931-2740b293319a admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:09.853228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70207ef1-e6f3-4c82-8931-2740b293319a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:09.853575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70207ef1-e6f3-4c82-8931-2740b293319a admin admin] PATH_INFO: `/v3/projects/40817fdf68694085909512c0a6a74d98/users/2daaf07fba6a4e739f6b219865920fcf/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:09.855738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70207ef1-e6f3-4c82-8931-2740b293319a admin admin] RBAC: Authorizing `identity:create_grant(project_id=40817fdf68694085909512c0a6a74d98, user_id=2daaf07fba6a4e739f6b219865920fcf, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:09.861146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70207ef1-e6f3-4c82-8931-2740b293319a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:09.876032 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4080/8240] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:49:09 2022] PUT /identity/v3/projects/40817fdf68694085909512c0a6a74d98/users/2daaf07fba6a4e739f6b219865920fcf/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:09.877194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70207ef1-e6f3-4c82-8931-2740b293319a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:09.879074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-70207ef1-e6f3-4c82-8931-2740b293319a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:09.893679 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:09.906192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-36441fd1-0d7a-41f5-8aab-f98076001963 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c91432d69bf408188c70a03d2fc539c', 'request_id': 'req-36441fd1-0d7a-41f5-8aab-f98076001963'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:09.913567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-36441fd1-0d7a-41f5-8aab-f98076001963 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c91432d69bf408188c70a03d2fc539c', 'request_id': 'req-36441fd1-0d7a-41f5-8aab-f98076001963'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:09.923605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-36441fd1-0d7a-41f5-8aab-f98076001963 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c91432d69bf408188c70a03d2fc539c', 'request_id': 'req-36441fd1-0d7a-41f5-8aab-f98076001963'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:09.940560 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-36441fd1-0d7a-41f5-8aab-f98076001963 admin admin] The token cache is being invalidate because project 3c91432d69bf408188c70a03d2fc539c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:49:09.941003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-36441fd1-0d7a-41f5-8aab-f98076001963 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:09.941915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-36441fd1-0d7a-41f5-8aab-f98076001963 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:09.943671 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4161/8241] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:49:09 2022] DELETE /identity/v3/projects/3c91432d69bf408188c70a03d2fc539c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:09.945170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defb9a3-7093-408f-95d7-832159047837 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:09.946215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defb9a3-7093-408f-95d7-832159047837 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:09.946492 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defb9a3-7093-408f-95d7-832159047837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:09.980115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2defb9a3-7093-408f-95d7-832159047837 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:09.980115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2defb9a3-7093-408f-95d7-832159047837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:09.994767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70207ef1-e6f3-4c82-8931-2740b293319a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:10.057980 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4162/8242] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:10.059623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04552d-d3cd-4812-9501-6eff42be981a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:10.060119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04552d-d3cd-4812-9501-6eff42be981a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:10.060409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04552d-d3cd-4812-9501-6eff42be981a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:10.073080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468a757-e2ed-41d8-9352-ce640c7a2603 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:10.074160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468a757-e2ed-41d8-9352-ce640c7a2603 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:10.074673 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468a757-e2ed-41d8-9352-ce640c7a2603 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:10.075150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468a757-e2ed-41d8-9352-ce640c7a2603 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:10.077787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7468a757-e2ed-41d8-9352-ce640c7a2603 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:10.104194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-da04552d-d3cd-4812-9501-6eff42be981a None None] MFA Rules not processed for user `2daaf07fba6a4e739f6b219865920fcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:10.105518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-da04552d-d3cd-4812-9501-6eff42be981a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:10.172285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468a757-e2ed-41d8-9352-ce640c7a2603 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:10.173214 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:10.173697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468a757-e2ed-41d8-9352-ce640c7a2603 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:10.188065 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4081/8243] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:49:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:49:10.189468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d631e4-00f5-48c3-bda9-1ec450719921 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:10.189755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d631e4-00f5-48c3-bda9-1ec450719921 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:10.190029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d631e4-00f5-48c3-bda9-1ec450719921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:10.216671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d6d631e4-00f5-48c3-bda9-1ec450719921 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:10.217911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d6d631e4-00f5-48c3-bda9-1ec450719921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:10.229656 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4082/8244] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:10.230973 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c9369-e807-4adf-8bf0-451ca4b0a7ba None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:10.231299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c9369-e807-4adf-8bf0-451ca4b0a7ba None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:10.231584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c9369-e807-4adf-8bf0-451ca4b0a7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:10.254183 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-972c9369-e807-4adf-8bf0-451ca4b0a7ba None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:10.255748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-972c9369-e807-4adf-8bf0-451ca4b0a7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:10.265118 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4163/8245] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:10.266658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989be53-e6be-4310-86b8-7eb12b617b53 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:10.267049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989be53-e6be-4310-86b8-7eb12b617b53 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:10.267424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989be53-e6be-4310-86b8-7eb12b617b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:10.272364 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4083/8246] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:10.276876 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c9369-e807-4adf-8bf0-451ca4b0a7ba None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:10.288851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c9369-e807-4adf-8bf0-451ca4b0a7ba None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:10.294240 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1dbb76-43bc-4875-9645-199b45461826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:10.294877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1dbb76-43bc-4875-9645-199b45461826 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:10.295160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1dbb76-43bc-4875-9645-199b45461826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:10.295432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1dbb76-43bc-4875-9645-199b45461826 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:10.296171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1dbb76-43bc-4875-9645-199b45461826 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:49:10.296469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1dbb76-43bc-4875-9645-199b45461826 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:10.298119 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1dbb76-43bc-4875-9645-199b45461826 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:10.309833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3989be53-e6be-4310-86b8-7eb12b617b53 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:10.311391 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3989be53-e6be-4310-86b8-7eb12b617b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:10.317565 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4084/8247] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:49:10.319800 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1dbb76-43bc-4875-9645-199b45461826 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:10.327309 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4164/8248] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:10.332021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989be53-e6be-4310-86b8-7eb12b617b53 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:10.334258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ba1dbb76-43bc-4875-9645-199b45461826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:10.363797 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989be53-e6be-4310-86b8-7eb12b617b53 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:10.369670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158ac7d-cbf6-4f8f-bddf-f2329753948f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:10.370300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158ac7d-cbf6-4f8f-bddf-f2329753948f admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:10.370574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158ac7d-cbf6-4f8f-bddf-f2329753948f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:10.370844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158ac7d-cbf6-4f8f-bddf-f2329753948f admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:10.371484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1dbb76-43bc-4875-9645-199b45461826 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:10.371603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4158ac7d-cbf6-4f8f-bddf-f2329753948f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:10.373785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4158ac7d-cbf6-4f8f-bddf-f2329753948f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:10.378765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89323dd-0fa9-4cfa-b026-1c4e1bee4013 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:10.380782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89323dd-0fa9-4cfa-b026-1c4e1bee4013 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:10.381294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89323dd-0fa9-4cfa-b026-1c4e1bee4013 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:10.381805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89323dd-0fa9-4cfa-b026-1c4e1bee4013 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:10.390764 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e89323dd-0fa9-4cfa-b026-1c4e1bee4013 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:10.421055 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4165/8249] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:49:10 2022] POST /identity/v3/projects => generated 377 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:49:10.422041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158ac7d-cbf6-4f8f-bddf-f2329753948f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:10.528721 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:10.563659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158ac7d-cbf6-4f8f-bddf-f2329753948f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:10.569945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7774cc6-ac6f-427c-ad62-f72f5b493589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:10.572723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7774cc6-ac6f-427c-ad62-f72f5b493589 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:10.573011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7774cc6-ac6f-427c-ad62-f72f5b493589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:10.573289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7774cc6-ac6f-427c-ad62-f72f5b493589 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:10.574403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7774cc6-ac6f-427c-ad62-f72f5b493589 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:49:10.574782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7774cc6-ac6f-427c-ad62-f72f5b493589 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:10.576654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7774cc6-ac6f-427c-ad62-f72f5b493589 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:10.582339 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89323dd-0fa9-4cfa-b026-1c4e1bee4013 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:10.585215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89323dd-0fa9-4cfa-b026-1c4e1bee4013 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:10.593106 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4166/8250] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:49:10.593106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7774cc6-ac6f-427c-ad62-f72f5b493589 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:10.607744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7774cc6-ac6f-427c-ad62-f72f5b493589 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:10.612805 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a9e1e-942c-4fcc-8e8f-d75aa1795fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:10.613435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a9e1e-942c-4fcc-8e8f-d75aa1795fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:10.613709 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a9e1e-942c-4fcc-8e8f-d75aa1795fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:10.613983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4a9e1e-942c-4fcc-8e8f-d75aa1795fa5 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:10.614616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a9e1e-942c-4fcc-8e8f-d75aa1795fa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:10.616690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4a9e1e-942c-4fcc-8e8f-d75aa1795fa5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:10.621346 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4085/8251] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:49:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:49:10.621957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89323dd-0fa9-4cfa-b026-1c4e1bee4013 service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:10.646698 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4167/8252] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:49:10 2022] POST /identity/v3/users => generated 289 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:49:10.653169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a9e1e-942c-4fcc-8e8f-d75aa1795fa5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:10.658289 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89323dd-0fa9-4cfa-b026-1c4e1bee4013 service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:10.670884 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4a9e1e-942c-4fcc-8e8f-d75aa1795fa5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:10.676907 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59a76b-54a4-44a7-ae8c-f771433541e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:10.678998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59a76b-54a4-44a7-ae8c-f771433541e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:10.683048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59a76b-54a4-44a7-ae8c-f771433541e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:10.683480 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423456db-180b-48c9-bc9b-feafda1569c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:10.684152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59a76b-54a4-44a7-ae8c-f771433541e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:10.684700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423456db-180b-48c9-bc9b-feafda1569c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:10.685093 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423456db-180b-48c9-bc9b-feafda1569c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:10.685587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423456db-180b-48c9-bc9b-feafda1569c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:10.686669 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59a76b-54a4-44a7-ae8c-f771433541e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:10.686812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423456db-180b-48c9-bc9b-feafda1569c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:10.690665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423456db-180b-48c9-bc9b-feafda1569c1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:10.691163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59a76b-54a4-44a7-ae8c-f771433541e3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:10.722502 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4168/8253] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:49:10.730142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59a76b-54a4-44a7-ae8c-f771433541e3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:10.762174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59a76b-54a4-44a7-ae8c-f771433541e3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:10.785683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca3fbe-b83d-414c-b792-f805fbb10db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:10.792445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca3fbe-b83d-414c-b792-f805fbb10db1 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:10.792936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca3fbe-b83d-414c-b792-f805fbb10db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:10.794765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca3fbe-b83d-414c-b792-f805fbb10db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:10.799065 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca3fbe-b83d-414c-b792-f805fbb10db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:10.811755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca3fbe-b83d-414c-b792-f805fbb10db1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:10.821231 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4086/8254] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:49:10 2022] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:49:10.823021 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423456db-180b-48c9-bc9b-feafda1569c1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:10.855239 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4169/8255] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:49:10.861546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca3fbe-b83d-414c-b792-f805fbb10db1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:10.910778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca3fbe-b83d-414c-b792-f805fbb10db1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:11.087742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423456db-180b-48c9-bc9b-feafda1569c1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:11.096878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f6800-ec35-4e33-9295-36dc207a3307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:11.098641 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f6800-ec35-4e33-9295-36dc207a3307 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:11.099204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f6800-ec35-4e33-9295-36dc207a3307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:11.099984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f6800-ec35-4e33-9295-36dc207a3307 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:11.102881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f6800-ec35-4e33-9295-36dc207a3307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:11.106495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f6800-ec35-4e33-9295-36dc207a3307 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:11.124788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30db199-7e03-4de0-8da0-1462fcb98503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:11.127164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30db199-7e03-4de0-8da0-1462fcb98503 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:11.129835 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30db199-7e03-4de0-8da0-1462fcb98503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:11.130820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30db199-7e03-4de0-8da0-1462fcb98503 admin admin] PATH_INFO: `/v3/projects/4f7944bf672946f7968804b09a68a442/users/9f958198e73848e28c5832468a48abc7/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:11.154780 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4087/8256] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:49:10 2022] POST /identity/v3/users => generated 292 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:49:11.160006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f6800-ec35-4e33-9295-36dc207a3307 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:11.192747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f6800-ec35-4e33-9295-36dc207a3307 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:11.193738 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:11.200293 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c41bba-15c2-49dd-9bec-53ecf0e83200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:11.202307 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c41bba-15c2-49dd-9bec-53ecf0e83200 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:11.203794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c41bba-15c2-49dd-9bec-53ecf0e83200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:11.204175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c41bba-15c2-49dd-9bec-53ecf0e83200 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:11.205053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c41bba-15c2-49dd-9bec-53ecf0e83200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:11.207960 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30db199-7e03-4de0-8da0-1462fcb98503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7944bf672946f7968804b09a68a442, user_id=9f958198e73848e28c5832468a48abc7, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:11.208783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c41bba-15c2-49dd-9bec-53ecf0e83200 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:11.224790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30db199-7e03-4de0-8da0-1462fcb98503 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:11.227572 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4088/8257] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:49:11.234546 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c41bba-15c2-49dd-9bec-53ecf0e83200 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:11.274060 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4170/8258] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:49:10 2022] PUT /identity/v3/projects/4f7944bf672946f7968804b09a68a442/users/9f958198e73848e28c5832468a48abc7/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:11.284929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f539d9c-ad99-4c89-8ab9-5ca8ce2bd397 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:11.285922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f539d9c-ad99-4c89-8ab9-5ca8ce2bd397 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:11.286368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f539d9c-ad99-4c89-8ab9-5ca8ce2bd397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:11.290322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c41bba-15c2-49dd-9bec-53ecf0e83200 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:11.342140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0f539d9c-ad99-4c89-8ab9-5ca8ce2bd397 None None] MFA Rules not processed for user `9f958198e73848e28c5832468a48abc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:11.343562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0f539d9c-ad99-4c89-8ab9-5ca8ce2bd397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:11.465389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49633d91-511c-44c7-884c-d3f19a33e91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:11.466098 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49633d91-511c-44c7-884c-d3f19a33e91c admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:11.466403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49633d91-511c-44c7-884c-d3f19a33e91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:11.466730 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49633d91-511c-44c7-884c-d3f19a33e91c admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:11.467442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49633d91-511c-44c7-884c-d3f19a33e91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:11.469369 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49633d91-511c-44c7-884c-d3f19a33e91c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:11.493547 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4089/8259] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:49:11.497786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49633d91-511c-44c7-884c-d3f19a33e91c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:11.522117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49633d91-511c-44c7-884c-d3f19a33e91c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:11.535320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbeece-0d78-49be-ac49-bafcd8733995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:11.536713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbeece-0d78-49be-ac49-bafcd8733995 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:11.537241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbeece-0d78-49be-ac49-bafcd8733995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:11.537772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbeece-0d78-49be-ac49-bafcd8733995 admin admin] PATH_INFO: `/v3/projects/3070e633e1c04daa807a05af4d202db2/users/4a58962064fa46d282e3897eb3d6d65c/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:11.547666 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4171/8260] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:49:11.563672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f539d9c-ad99-4c89-8ab9-5ca8ce2bd397 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:11.587160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbeece-0d78-49be-ac49-bafcd8733995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3070e633e1c04daa807a05af4d202db2, user_id=4a58962064fa46d282e3897eb3d6d65c, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:11.598513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f539d9c-ad99-4c89-8ab9-5ca8ce2bd397 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:11.605031 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbeece-0d78-49be-ac49-bafcd8733995 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:11.629186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dda5be-b71f-4b87-8f09-fae64f5b4cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:11.629831 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dda5be-b71f-4b87-8f09-fae64f5b4cc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:11.630160 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dda5be-b71f-4b87-8f09-fae64f5b4cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:11.630505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dda5be-b71f-4b87-8f09-fae64f5b4cc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:11.635990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dda5be-b71f-4b87-8f09-fae64f5b4cc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:11.636335 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4090/8261] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:49:11 2022] PUT /identity/v3/projects/3070e633e1c04daa807a05af4d202db2/users/4a58962064fa46d282e3897eb3d6d65c/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:11.636414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dda5be-b71f-4b87-8f09-fae64f5b4cc9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:11.649355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714d03a-11c5-46c2-b8ef-0510965dccae None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:11.649982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714d03a-11c5-46c2-b8ef-0510965dccae None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:11.650509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714d03a-11c5-46c2-b8ef-0510965dccae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:11.702733 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4172/8262] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:49:11 2022] POST /identity/v3/projects => generated 379 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:49:11.704023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dda5be-b71f-4b87-8f09-fae64f5b4cc9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:11.706834 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:11.721140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d714d03a-11c5-46c2-b8ef-0510965dccae None None] MFA Rules not processed for user `4a58962064fa46d282e3897eb3d6d65c`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:11.723337 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d714d03a-11c5-46c2-b8ef-0510965dccae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:11.870202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dda5be-b71f-4b87-8f09-fae64f5b4cc9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:11.882758 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa61e59-3f57-466d-b9c9-7e4aee3fb288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:11.884136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa61e59-3f57-466d-b9c9-7e4aee3fb288 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:11.885025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa61e59-3f57-466d-b9c9-7e4aee3fb288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:11.885412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa61e59-3f57-466d-b9c9-7e4aee3fb288 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:11.886250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa61e59-3f57-466d-b9c9-7e4aee3fb288 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:11.888664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa61e59-3f57-466d-b9c9-7e4aee3fb288 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:11.939602 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4173/8263] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:49:11 2022] POST /identity/v3/users => generated 296 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:49:11.943649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa61e59-3f57-466d-b9c9-7e4aee3fb288 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:11.994650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa61e59-3f57-466d-b9c9-7e4aee3fb288 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:11.999014 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4091/8264] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:49:12.026567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714d03a-11c5-46c2-b8ef-0510965dccae None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:12.028341 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d714d03a-11c5-46c2-b8ef-0510965dccae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:12.034801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91350e57-4e72-458f-94cd-a6d6b8667e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:12.036213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91350e57-4e72-458f-94cd-a6d6b8667e1e admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:12.036780 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91350e57-4e72-458f-94cd-a6d6b8667e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:12.037653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91350e57-4e72-458f-94cd-a6d6b8667e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:12.039694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91350e57-4e72-458f-94cd-a6d6b8667e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:12.042872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91350e57-4e72-458f-94cd-a6d6b8667e1e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:12.090963 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4174/8265] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:49:12.096082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91350e57-4e72-458f-94cd-a6d6b8667e1e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:12.150001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91350e57-4e72-458f-94cd-a6d6b8667e1e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:12.169285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff76e05-2581-415a-8426-56343f3b6068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:12.170424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff76e05-2581-415a-8426-56343f3b6068 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:12.170901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff76e05-2581-415a-8426-56343f3b6068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:12.171405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff76e05-2581-415a-8426-56343f3b6068 admin admin] PATH_INFO: `/v3/projects/a9ad7e6b298944bb9b719d5094ba8ff8/users/2269405218c84547be6a9d353aae694d/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:12.223455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff76e05-2581-415a-8426-56343f3b6068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ad7e6b298944bb9b719d5094ba8ff8, user_id=2269405218c84547be6a9d353aae694d, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:12.230090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff76e05-2581-415a-8426-56343f3b6068 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:12.254408 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4175/8266] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:49:12 2022] PUT /identity/v3/projects/a9ad7e6b298944bb9b719d5094ba8ff8/users/2269405218c84547be6a9d353aae694d/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:12.258270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff76e05-2581-415a-8426-56343f3b6068 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:12.282074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714d03a-11c5-46c2-b8ef-0510965dccae None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:12.283797 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:12.394079 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e51af-533c-4a4d-9034-713b882413a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:12.395741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e51af-533c-4a4d-9034-713b882413a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:12.396053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e51af-533c-4a4d-9034-713b882413a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:12.396326 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e51af-533c-4a4d-9034-713b882413a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:12.427314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff76e05-2581-415a-8426-56343f3b6068 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:12.442453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e2171-7919-4918-bc08-cc93a08b814a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:12.442561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e2171-7919-4918-bc08-cc93a08b814a admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:12.442821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e2171-7919-4918-bc08-cc93a08b814a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:12.443086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e2171-7919-4918-bc08-cc93a08b814a admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:12.443926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e2171-7919-4918-bc08-cc93a08b814a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:12.446708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e2171-7919-4918-bc08-cc93a08b814a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:12.476008 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4176/8267] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:49:12.477942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e2171-7919-4918-bc08-cc93a08b814a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:12.493702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e2171-7919-4918-bc08-cc93a08b814a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:12.508585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a191619-a712-4dda-80e9-9c28103914a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:12.509268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a191619-a712-4dda-80e9-9c28103914a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:12.509539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a191619-a712-4dda-80e9-9c28103914a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:12.509811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a191619-a712-4dda-80e9-9c28103914a9 admin admin] PATH_INFO: `/v3/projects/a9ad7e6b298944bb9b719d5094ba8ff8/users/2269405218c84547be6a9d353aae694d/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:12.518044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a191619-a712-4dda-80e9-9c28103914a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ad7e6b298944bb9b719d5094ba8ff8, user_id=2269405218c84547be6a9d353aae694d, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:12.520971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a191619-a712-4dda-80e9-9c28103914a9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:12.544558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e51af-533c-4a4d-9034-713b882413a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:12.548697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e51af-533c-4a4d-9034-713b882413a0 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:12.549868 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4177/8268] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:49:12 2022] PUT /identity/v3/projects/a9ad7e6b298944bb9b719d5094ba8ff8/users/2269405218c84547be6a9d353aae694d/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:12.571057 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4092/8269] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:49:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:49:12.572331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01395cd-cc79-4ac8-9ded-58facc8c1eda None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:12.572688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01395cd-cc79-4ac8-9ded-58facc8c1eda None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:12.572942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01395cd-cc79-4ac8-9ded-58facc8c1eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:12.632663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f01395cd-cc79-4ac8-9ded-58facc8c1eda None None] MFA Rules not processed for user `2269405218c84547be6a9d353aae694d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:12.634725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f01395cd-cc79-4ac8-9ded-58facc8c1eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:12.839248 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4178/8270] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:12 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:12.854022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e51af-533c-4a4d-9034-713b882413a0 service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:12.866653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e51af-533c-4a4d-9034-713b882413a0 service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:12.899919 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:13.000903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1746e0-84a9-4bbd-9157-bf138378095a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:13.004441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1746e0-84a9-4bbd-9157-bf138378095a service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:13.004945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1746e0-84a9-4bbd-9157-bf138378095a service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:13.006766 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1746e0-84a9-4bbd-9157-bf138378095a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:13.156955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1746e0-84a9-4bbd-9157-bf138378095a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:13.159405 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1746e0-84a9-4bbd-9157-bf138378095a service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:13.190471 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4093/8271] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:49:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:49:15.993690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01395cd-cc79-4ac8-9ded-58facc8c1eda None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:16.012152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01395cd-cc79-4ac8-9ded-58facc8c1eda None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:16.016344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9135ae5-e6ed-4d99-83f0-70a90690fdcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:16.017102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9135ae5-e6ed-4d99-83f0-70a90690fdcd service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:16.017698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9135ae5-e6ed-4d99-83f0-70a90690fdcd service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:16.018438 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9135ae5-e6ed-4d99-83f0-70a90690fdcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:16.030883 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9135ae5-e6ed-4d99-83f0-70a90690fdcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:16.032487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9135ae5-e6ed-4d99-83f0-70a90690fdcd service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:16.043539 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4179/8272] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:49:15 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:49:19.560588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1746e0-84a9-4bbd-9157-bf138378095a service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:19.575671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1746e0-84a9-4bbd-9157-bf138378095a service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:19.581364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bffccd-44ba-4003-a660-7390bade77ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:19.582294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bffccd-44ba-4003-a660-7390bade77ff service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:19.582915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bffccd-44ba-4003-a660-7390bade77ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:19.583338 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bffccd-44ba-4003-a660-7390bade77ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:19.711053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bffccd-44ba-4003-a660-7390bade77ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:19.715245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bffccd-44ba-4003-a660-7390bade77ff service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:19.752037 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4094/8273] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:49:19 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:49:20.170652 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9135ae5-e6ed-4d99-83f0-70a90690fdcd service cinder] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:20.357705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9135ae5-e6ed-4d99-83f0-70a90690fdcd service cinder] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:20.375541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d3160-c006-4dd6-8e32-ad3e12d31354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:20.376628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d3160-c006-4dd6-8e32-ad3e12d31354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:20.377390 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d3160-c006-4dd6-8e32-ad3e12d31354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:20.377827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d3160-c006-4dd6-8e32-ad3e12d31354 admin admin] PATH_INFO: `/v3/users/4a58962064fa46d282e3897eb3d6d65c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:20.379386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d3160-c006-4dd6-8e32-ad3e12d31354 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a58962064fa46d282e3897eb3d6d65c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:20.381978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d3160-c006-4dd6-8e32-ad3e12d31354 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:20.404207 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:20.490743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-602d3160-c006-4dd6-8e32-ad3e12d31354 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a58962064fa46d282e3897eb3d6d65c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:20.499402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-602d3160-c006-4dd6-8e32-ad3e12d31354 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a58962064fa46d282e3897eb3d6d65c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:20.544801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-602d3160-c006-4dd6-8e32-ad3e12d31354 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a58962064fa46d282e3897eb3d6d65c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:20.546078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-602d3160-c006-4dd6-8e32-ad3e12d31354 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a58962064fa46d282e3897eb3d6d65c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:20.564221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-602d3160-c006-4dd6-8e32-ad3e12d31354 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a58962064fa46d282e3897eb3d6d65c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:20.578749 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4180/8274] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:49:20 2022] DELETE /identity/v3/users/4a58962064fa46d282e3897eb3d6d65c => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:20.580786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530655d-016e-4e75-8a29-4da213977ca9 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:20.581875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530655d-016e-4e75-8a29-4da213977ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:20.582488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530655d-016e-4e75-8a29-4da213977ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:20.639106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2530655d-016e-4e75-8a29-4da213977ca9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:20.645258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2530655d-016e-4e75-8a29-4da213977ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:20.749331 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4095/8275] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:49:20.759228 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d3160-c006-4dd6-8e32-ad3e12d31354 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:20.760771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-602d3160-c006-4dd6-8e32-ad3e12d31354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:20.924649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d3160-c006-4dd6-8e32-ad3e12d31354 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:20.929764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29802209-1545-4756-81b7-7cf42133f37b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:20.930579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29802209-1545-4756-81b7-7cf42133f37b service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:20.931005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29802209-1545-4756-81b7-7cf42133f37b service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:20.931292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29802209-1545-4756-81b7-7cf42133f37b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:20.942893 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29802209-1545-4756-81b7-7cf42133f37b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:20.944625 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29802209-1545-4756-81b7-7cf42133f37b service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:20.960216 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4181/8276] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:49:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:49:21.416494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530655d-016e-4e75-8a29-4da213977ca9 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:21.423465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2530655d-016e-4e75-8a29-4da213977ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:21.433692 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:21.441933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530655d-016e-4e75-8a29-4da213977ca9 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:21.447078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d81ea-aba0-42c0-8bd7-a91d3da87737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:21.447859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d81ea-aba0-42c0-8bd7-a91d3da87737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:21.448263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d81ea-aba0-42c0-8bd7-a91d3da87737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:21.448616 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d81ea-aba0-42c0-8bd7-a91d3da87737 admin admin] PATH_INFO: `/v3/projects/3070e633e1c04daa807a05af4d202db2` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:21.466010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d81ea-aba0-42c0-8bd7-a91d3da87737 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3070e633e1c04daa807a05af4d202db2)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:21.471214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d81ea-aba0-42c0-8bd7-a91d3da87737 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:21.562731 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-727d81ea-aba0-42c0-8bd7-a91d3da87737 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3070e633e1c04daa807a05af4d202db2', 'request_id': 'req-727d81ea-aba0-42c0-8bd7-a91d3da87737'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:21.577668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-727d81ea-aba0-42c0-8bd7-a91d3da87737 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3070e633e1c04daa807a05af4d202db2', 'request_id': 'req-727d81ea-aba0-42c0-8bd7-a91d3da87737'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:21.591774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-727d81ea-aba0-42c0-8bd7-a91d3da87737 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3070e633e1c04daa807a05af4d202db2', 'request_id': 'req-727d81ea-aba0-42c0-8bd7-a91d3da87737'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:21.616247 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-727d81ea-aba0-42c0-8bd7-a91d3da87737 admin admin] The token cache is being invalidate because project 3070e633e1c04daa807a05af4d202db2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:49:21.616968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-727d81ea-aba0-42c0-8bd7-a91d3da87737 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:21.618358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-727d81ea-aba0-42c0-8bd7-a91d3da87737 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:21.621467 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4096/8277] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:49:21 2022] DELETE /identity/v3/projects/3070e633e1c04daa807a05af4d202db2 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:21.626722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7523c-2cbf-455a-a98f-b01feeed1048 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:21.627326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7523c-2cbf-455a-a98f-b01feeed1048 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:21.627326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7523c-2cbf-455a-a98f-b01feeed1048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:21.670951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5ea7523c-2cbf-455a-a98f-b01feeed1048 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:21.675143 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5ea7523c-2cbf-455a-a98f-b01feeed1048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:21.841448 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4182/8278] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:21.849335 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5161c1-82d9-41ca-a171-34fa7ef5a49a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:21.849670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5161c1-82d9-41ca-a171-34fa7ef5a49a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:21.849885 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5161c1-82d9-41ca-a171-34fa7ef5a49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:21.915618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9d5161c1-82d9-41ca-a171-34fa7ef5a49a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:21.921825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9d5161c1-82d9-41ca-a171-34fa7ef5a49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:21.950255 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4097/8279] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:21.968164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7523c-2cbf-455a-a98f-b01feeed1048 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:22.014882 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7523c-2cbf-455a-a98f-b01feeed1048 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:22.036953 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c1651-36ca-41d2-a81d-c124fec743c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:22.037592 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c1651-36ca-41d2-a81d-c124fec743c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:22.037865 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c1651-36ca-41d2-a81d-c124fec743c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:22.044030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c1651-36ca-41d2-a81d-c124fec743c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:22.046882 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c1651-36ca-41d2-a81d-c124fec743c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:49:22.047197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c1651-36ca-41d2-a81d-c124fec743c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:22.048887 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c1651-36ca-41d2-a81d-c124fec743c5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:22.105963 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4183/8280] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:49:22.111240 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5161c1-82d9-41ca-a171-34fa7ef5a49a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:22.128452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5161c1-82d9-41ca-a171-34fa7ef5a49a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:22.144582 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ad220-e0c9-4e31-a762-68cfe51374f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:22.152634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ad220-e0c9-4e31-a762-68cfe51374f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:22.152996 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ad220-e0c9-4e31-a762-68cfe51374f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:22.153274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ad220-e0c9-4e31-a762-68cfe51374f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:22.154524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ad220-e0c9-4e31-a762-68cfe51374f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:22.165032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390ad220-e0c9-4e31-a762-68cfe51374f0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:22.276223 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4098/8281] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:49:22 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:49:22.280413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c1651-36ca-41d2-a81d-c124fec743c5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:22.302498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c1651-36ca-41d2-a81d-c124fec743c5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:22.339862 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:22.556723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e904004-b9f4-4826-9aaf-fa3da7272142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:22.557773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e904004-b9f4-4826-9aaf-fa3da7272142 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:22.558284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e904004-b9f4-4826-9aaf-fa3da7272142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:22.559719 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e904004-b9f4-4826-9aaf-fa3da7272142 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:22.560729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e904004-b9f4-4826-9aaf-fa3da7272142 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:22.562953 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e904004-b9f4-4826-9aaf-fa3da7272142 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:22.635494 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4184/8282] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:49:22 2022] POST /identity/v3/users => generated 288 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:49:22.639980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ad220-e0c9-4e31-a762-68cfe51374f0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:22.657959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390ad220-e0c9-4e31-a762-68cfe51374f0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:22.672043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bd961-f8d6-415a-8cc0-a469aaf455e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:22.677169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bd961-f8d6-415a-8cc0-a469aaf455e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:22.677459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bd961-f8d6-415a-8cc0-a469aaf455e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:22.677738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bd961-f8d6-415a-8cc0-a469aaf455e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:22.679687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3bd961-f8d6-415a-8cc0-a469aaf455e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:22.687357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3bd961-f8d6-415a-8cc0-a469aaf455e1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:22.722598 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4099/8283] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:49:22.726826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e904004-b9f4-4826-9aaf-fa3da7272142 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:22.738018 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e904004-b9f4-4826-9aaf-fa3da7272142 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:22.763383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac483155-9746-4ac3-9aab-4ab27c56cb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:22.764226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac483155-9746-4ac3-9aab-4ab27c56cb02 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:22.764608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac483155-9746-4ac3-9aab-4ab27c56cb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:22.765009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac483155-9746-4ac3-9aab-4ab27c56cb02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:22.765841 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac483155-9746-4ac3-9aab-4ab27c56cb02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:22.767646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac483155-9746-4ac3-9aab-4ab27c56cb02 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:22.820460 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4185/8284] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:49:22.824482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bd961-f8d6-415a-8cc0-a469aaf455e1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:22.837697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bd961-f8d6-415a-8cc0-a469aaf455e1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:22.853070 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c6694-1c53-44c3-8111-3df0ef05bac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:22.853903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c6694-1c53-44c3-8111-3df0ef05bac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:22.854280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c6694-1c53-44c3-8111-3df0ef05bac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:22.854657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c6694-1c53-44c3-8111-3df0ef05bac6 admin admin] PATH_INFO: `/v3/projects/00b8ea4beba1443888c4b66bbf29dd10/users/f7e3cd7266b84c62bf644c9307edb763/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:22.909328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c6694-1c53-44c3-8111-3df0ef05bac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00b8ea4beba1443888c4b66bbf29dd10, user_id=f7e3cd7266b84c62bf644c9307edb763, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:22.912236 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c6694-1c53-44c3-8111-3df0ef05bac6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:22.955049 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4100/8285] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:49:22 2022] PUT /identity/v3/projects/00b8ea4beba1443888c4b66bbf29dd10/users/f7e3cd7266b84c62bf644c9307edb763/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:22.965768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a87215-1717-44a8-abde-1fdafa5c1a39 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:22.966214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a87215-1717-44a8-abde-1fdafa5c1a39 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:22.966539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a87215-1717-44a8-abde-1fdafa5c1a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:23.036665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a3a87215-1717-44a8-abde-1fdafa5c1a39 None None] MFA Rules not processed for user `f7e3cd7266b84c62bf644c9307edb763`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:23.038153 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a3a87215-1717-44a8-abde-1fdafa5c1a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:23.223534 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4186/8286] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:23.235877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c6694-1c53-44c3-8111-3df0ef05bac6 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:23.237898 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e36c6694-1c53-44c3-8111-3df0ef05bac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:23.370048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c6694-1c53-44c3-8111-3df0ef05bac6 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:23.374918 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28fd48-15cf-4c70-8994-38198d5addd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:23.376085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28fd48-15cf-4c70-8994-38198d5addd2 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:23.376589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28fd48-15cf-4c70-8994-38198d5addd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:23.377057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28fd48-15cf-4c70-8994-38198d5addd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:23.406830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28fd48-15cf-4c70-8994-38198d5addd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:23.408646 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28fd48-15cf-4c70-8994-38198d5addd2 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:23.451760 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4101/8287] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:49:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:49:27.756221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a87215-1717-44a8-abde-1fdafa5c1a39 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:27.757744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a3a87215-1717-44a8-abde-1fdafa5c1a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:27.908565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a87215-1717-44a8-abde-1fdafa5c1a39 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:27.916609 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d53b60-794e-4c4e-9a3c-f30bceecde76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:27.917418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d53b60-794e-4c4e-9a3c-f30bceecde76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:27.917808 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d53b60-794e-4c4e-9a3c-f30bceecde76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:27.918190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d53b60-794e-4c4e-9a3c-f30bceecde76 admin admin] PATH_INFO: `/v3/users/9f958198e73848e28c5832468a48abc7` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:27.919575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d53b60-794e-4c4e-9a3c-f30bceecde76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f958198e73848e28c5832468a48abc7)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:27.921962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d53b60-794e-4c4e-9a3c-f30bceecde76 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:28.010234 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:28.082977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b5d53b60-794e-4c4e-9a3c-f30bceecde76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f958198e73848e28c5832468a48abc7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:28.092446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b5d53b60-794e-4c4e-9a3c-f30bceecde76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f958198e73848e28c5832468a48abc7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:28.124163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b5d53b60-794e-4c4e-9a3c-f30bceecde76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f958198e73848e28c5832468a48abc7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:28.125274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b5d53b60-794e-4c4e-9a3c-f30bceecde76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f958198e73848e28c5832468a48abc7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:28.165646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b5d53b60-794e-4c4e-9a3c-f30bceecde76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f958198e73848e28c5832468a48abc7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:28.185416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178f1fa-4669-4116-941b-76247156072e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:28.186081 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4187/8288] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:49:27 2022] DELETE /identity/v3/users/9f958198e73848e28c5832468a48abc7 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:28.186919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178f1fa-4669-4116-941b-76247156072e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:28.187340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178f1fa-4669-4116-941b-76247156072e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:28.225290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-a178f1fa-4669-4116-941b-76247156072e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:28.229228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a178f1fa-4669-4116-941b-76247156072e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:28.293365 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:28.355216 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4102/8289] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:49:28.363304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d53b60-794e-4c4e-9a3c-f30bceecde76 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:28.364781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b5d53b60-794e-4c4e-9a3c-f30bceecde76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:28.576352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d53b60-794e-4c4e-9a3c-f30bceecde76 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:28.605519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c9e8b-343d-4866-88df-59d2876f9562 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:28.606909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c9e8b-343d-4866-88df-59d2876f9562 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:28.607332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c9e8b-343d-4866-88df-59d2876f9562 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:28.608282 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c9e8b-343d-4866-88df-59d2876f9562 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:28.619610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c9e8b-343d-4866-88df-59d2876f9562 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:28.621466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c9e8b-343d-4866-88df-59d2876f9562 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:28.635762 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4188/8290] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:49:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:49:29.334613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178f1fa-4669-4116-941b-76247156072e None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:29.337627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a178f1fa-4669-4116-941b-76247156072e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:29.363373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178f1fa-4669-4116-941b-76247156072e None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:29.380810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9bed08-cd4e-4a19-a008-64badd936ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:29.381880 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bed08-cd4e-4a19-a008-64badd936ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:29.384095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bed08-cd4e-4a19-a008-64badd936ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:29.385325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bed08-cd4e-4a19-a008-64badd936ffb admin admin] PATH_INFO: `/v3/projects/4f7944bf672946f7968804b09a68a442` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:29.388191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9bed08-cd4e-4a19-a008-64badd936ffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f7944bf672946f7968804b09a68a442)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:29.401413 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9bed08-cd4e-4a19-a008-64badd936ffb admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:29.592030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1c9bed08-cd4e-4a19-a008-64badd936ffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f7944bf672946f7968804b09a68a442', 'request_id': 'req-1c9bed08-cd4e-4a19-a008-64badd936ffb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:29.634804 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1c9bed08-cd4e-4a19-a008-64badd936ffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f7944bf672946f7968804b09a68a442', 'request_id': 'req-1c9bed08-cd4e-4a19-a008-64badd936ffb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:29.670755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1c9bed08-cd4e-4a19-a008-64badd936ffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f7944bf672946f7968804b09a68a442', 'request_id': 'req-1c9bed08-cd4e-4a19-a008-64badd936ffb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:29.712929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1c9bed08-cd4e-4a19-a008-64badd936ffb admin admin] The token cache is being invalidate because project 4f7944bf672946f7968804b09a68a442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:49:29.715209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1c9bed08-cd4e-4a19-a008-64badd936ffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:29.724314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1c9bed08-cd4e-4a19-a008-64badd936ffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:29.726737 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4103/8291] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:49:29 2022] DELETE /identity/v3/projects/4f7944bf672946f7968804b09a68a442 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:29.730509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c9e8b-343d-4866-88df-59d2876f9562 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:29.752604 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c9e8b-343d-4866-88df-59d2876f9562 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:29.879250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2402e-0b2b-4ea3-8d5e-8b80b435c08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:29.881907 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2402e-0b2b-4ea3-8d5e-8b80b435c08d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:29.882425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2402e-0b2b-4ea3-8d5e-8b80b435c08d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:29.883600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2402e-0b2b-4ea3-8d5e-8b80b435c08d admin admin] PATH_INFO: `/v3/users/2269405218c84547be6a9d353aae694d` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:29.886416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2402e-0b2b-4ea3-8d5e-8b80b435c08d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2269405218c84547be6a9d353aae694d)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:29.890259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2402e-0b2b-4ea3-8d5e-8b80b435c08d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:30.013316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d0c2402e-0b2b-4ea3-8d5e-8b80b435c08d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2269405218c84547be6a9d353aae694d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:30.016681 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:30.031086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d0c2402e-0b2b-4ea3-8d5e-8b80b435c08d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2269405218c84547be6a9d353aae694d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:30.061207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d0c2402e-0b2b-4ea3-8d5e-8b80b435c08d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2269405218c84547be6a9d353aae694d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:30.062145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d0c2402e-0b2b-4ea3-8d5e-8b80b435c08d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2269405218c84547be6a9d353aae694d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:30.079181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d0c2402e-0b2b-4ea3-8d5e-8b80b435c08d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2269405218c84547be6a9d353aae694d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:30.095909 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4189/8292] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:49:29 2022] DELETE /identity/v3/users/2269405218c84547be6a9d353aae694d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:30.969736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9bed08-cd4e-4a19-a008-64badd936ffb admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:30.972079 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1c9bed08-cd4e-4a19-a008-64badd936ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:31.011565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9bed08-cd4e-4a19-a008-64badd936ffb admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:31.265230 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c4db8-f623-4083-8b28-8998165db70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:31.267807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c4db8-f623-4083-8b28-8998165db70e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:31.268541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c4db8-f623-4083-8b28-8998165db70e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:31.269809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c4db8-f623-4083-8b28-8998165db70e admin admin] PATH_INFO: `/v3/projects/a9ad7e6b298944bb9b719d5094ba8ff8` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:31.280781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c4db8-f623-4083-8b28-8998165db70e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9ad7e6b298944bb9b719d5094ba8ff8)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:31.292105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c4db8-f623-4083-8b28-8998165db70e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:31.486221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-961c4db8-f623-4083-8b28-8998165db70e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9ad7e6b298944bb9b719d5094ba8ff8', 'request_id': 'req-961c4db8-f623-4083-8b28-8998165db70e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:31.491214 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:31.513324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-961c4db8-f623-4083-8b28-8998165db70e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9ad7e6b298944bb9b719d5094ba8ff8', 'request_id': 'req-961c4db8-f623-4083-8b28-8998165db70e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:31.545278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-961c4db8-f623-4083-8b28-8998165db70e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9ad7e6b298944bb9b719d5094ba8ff8', 'request_id': 'req-961c4db8-f623-4083-8b28-8998165db70e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:31.598111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-961c4db8-f623-4083-8b28-8998165db70e admin admin] The token cache is being invalidate because project a9ad7e6b298944bb9b719d5094ba8ff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:49:31.601373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-961c4db8-f623-4083-8b28-8998165db70e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:31.604358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-961c4db8-f623-4083-8b28-8998165db70e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:31.610291 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4104/8293] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:49:30 2022] DELETE /identity/v3/projects/a9ad7e6b298944bb9b719d5094ba8ff8 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:31.615238 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb758b74-ff1d-4f30-b597-8342969d4a07 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:31.616417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb758b74-ff1d-4f30-b597-8342969d4a07 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:31.616521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb758b74-ff1d-4f30-b597-8342969d4a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:31.676376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-eb758b74-ff1d-4f30-b597-8342969d4a07 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:31.689406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-eb758b74-ff1d-4f30-b597-8342969d4a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:31.879364 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4190/8294] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:31.888087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232059e-d1c1-4c7d-bb19-c047b944d115 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:31.888533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232059e-d1c1-4c7d-bb19-c047b944d115 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:31.888921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232059e-d1c1-4c7d-bb19-c047b944d115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:31.922133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3232059e-d1c1-4c7d-bb19-c047b944d115 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:31.927195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3232059e-d1c1-4c7d-bb19-c047b944d115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:31.965454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb758b74-ff1d-4f30-b597-8342969d4a07 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:31.977495 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4105/8295] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:31.978784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb758b74-ff1d-4f30-b597-8342969d4a07 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:31.998557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e898c-b84b-4005-8a9f-16e66ff8a020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:32.002058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e898c-b84b-4005-8a9f-16e66ff8a020 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:32.002680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e898c-b84b-4005-8a9f-16e66ff8a020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:32.004436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e898c-b84b-4005-8a9f-16e66ff8a020 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:32.007065 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e898c-b84b-4005-8a9f-16e66ff8a020 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:49:32.007750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e898c-b84b-4005-8a9f-16e66ff8a020 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:32.010692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e898c-b84b-4005-8a9f-16e66ff8a020 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:32.066263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232059e-d1c1-4c7d-bb19-c047b944d115 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:32.072477 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4191/8296] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:49:32.078355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232059e-d1c1-4c7d-bb19-c047b944d115 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:32.086676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06529d-ab30-424d-89c0-42b4658f765e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:32.089776 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06529d-ab30-424d-89c0-42b4658f765e admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:32.090155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06529d-ab30-424d-89c0-42b4658f765e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:32.090549 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06529d-ab30-424d-89c0-42b4658f765e admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:32.091309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06529d-ab30-424d-89c0-42b4658f765e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:32.096558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06529d-ab30-424d-89c0-42b4658f765e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:32.160793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e898c-b84b-4005-8a9f-16e66ff8a020 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:32.170168 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4106/8297] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:49:32 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:49:32.172809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e898c-b84b-4005-8a9f-16e66ff8a020 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:32.315727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b948fb3-9538-4331-af8d-a457a8a021cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:32.316566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b948fb3-9538-4331-af8d-a457a8a021cd admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:32.316956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b948fb3-9538-4331-af8d-a457a8a021cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:32.321936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b948fb3-9538-4331-af8d-a457a8a021cd admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:32.322791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b948fb3-9538-4331-af8d-a457a8a021cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:32.324900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b948fb3-9538-4331-af8d-a457a8a021cd admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:32.368615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06529d-ab30-424d-89c0-42b4658f765e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:32.381054 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4192/8298] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:49:32 2022] POST /identity/v3/users => generated 288 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:49:32.385201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06529d-ab30-424d-89c0-42b4658f765e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:32.394684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de3a98-c2a7-4ba3-88f9-77f4304723a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:32.395509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de3a98-c2a7-4ba3-88f9-77f4304723a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:32.395962 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de3a98-c2a7-4ba3-88f9-77f4304723a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:32.396356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de3a98-c2a7-4ba3-88f9-77f4304723a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:32.398100 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de3a98-c2a7-4ba3-88f9-77f4304723a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:32.403506 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de3a98-c2a7-4ba3-88f9-77f4304723a6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:32.438318 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4107/8299] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:49:32.439706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b948fb3-9538-4331-af8d-a457a8a021cd admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:32.450947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b948fb3-9538-4331-af8d-a457a8a021cd admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:32.468103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880ca8e-134f-4410-b51e-b205d8f6f9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:32.469070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880ca8e-134f-4410-b51e-b205d8f6f9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:32.469568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880ca8e-134f-4410-b51e-b205d8f6f9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:32.470053 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880ca8e-134f-4410-b51e-b205d8f6f9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:32.470916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880ca8e-134f-4410-b51e-b205d8f6f9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:32.474322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880ca8e-134f-4410-b51e-b205d8f6f9a1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:32.499746 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4193/8300] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:49:32.504627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de3a98-c2a7-4ba3-88f9-77f4304723a6 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:32.526502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de3a98-c2a7-4ba3-88f9-77f4304723a6 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:32.532432 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e755ca0-4deb-4938-b3ae-b3e8de8246e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:32.533526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e755ca0-4deb-4938-b3ae-b3e8de8246e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:32.534101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e755ca0-4deb-4938-b3ae-b3e8de8246e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:32.534597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e755ca0-4deb-4938-b3ae-b3e8de8246e2 admin admin] PATH_INFO: `/v3/projects/9bf11846d56842f98bab7b593bbd12d6/users/efd07bfe6e2d4c938f34385f42a62b95/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:32.575259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e755ca0-4deb-4938-b3ae-b3e8de8246e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bf11846d56842f98bab7b593bbd12d6, user_id=efd07bfe6e2d4c938f34385f42a62b95, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:32.578363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e755ca0-4deb-4938-b3ae-b3e8de8246e2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:32.624194 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4108/8301] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:49:32 2022] PUT /identity/v3/projects/9bf11846d56842f98bab7b593bbd12d6/users/efd07bfe6e2d4c938f34385f42a62b95/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:32.634936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd0a28-68bd-4f51-b29a-853670de6b03 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:32.635380 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd0a28-68bd-4f51-b29a-853670de6b03 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:32.635480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd0a28-68bd-4f51-b29a-853670de6b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:32.715420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-82dd0a28-68bd-4f51-b29a-853670de6b03 None None] MFA Rules not processed for user `efd07bfe6e2d4c938f34385f42a62b95`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:32.717122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-82dd0a28-68bd-4f51-b29a-853670de6b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:32.796372 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:32.908301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e755ca0-4deb-4938-b3ae-b3e8de8246e2 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:32.913446 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4194/8302] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:33.061606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e755ca0-4deb-4938-b3ae-b3e8de8246e2 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:33.083717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb636c44-e03f-4d59-8eaa-2492d0b71c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:33.084454 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb636c44-e03f-4d59-8eaa-2492d0b71c49 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:33.085797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb636c44-e03f-4d59-8eaa-2492d0b71c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:33.086088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb636c44-e03f-4d59-8eaa-2492d0b71c49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:33.086733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb636c44-e03f-4d59-8eaa-2492d0b71c49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:33.088704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb636c44-e03f-4d59-8eaa-2492d0b71c49 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:33.178804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd0a28-68bd-4f51-b29a-853670de6b03 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:33.197271 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4109/8303] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:49:32 2022] POST /identity/v3/projects => generated 375 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:49:33.198393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd0a28-68bd-4f51-b29a-853670de6b03 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:33.329073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071b654-4982-4f0c-bf65-8abe5d8c37cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:33.329699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071b654-4982-4f0c-bf65-8abe5d8c37cc admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:33.329979 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071b654-4982-4f0c-bf65-8abe5d8c37cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:33.330255 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071b654-4982-4f0c-bf65-8abe5d8c37cc admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:33.330889 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071b654-4982-4f0c-bf65-8abe5d8c37cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:33.332948 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071b654-4982-4f0c-bf65-8abe5d8c37cc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:33.387246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb636c44-e03f-4d59-8eaa-2492d0b71c49 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:33.401810 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4195/8304] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:49:33 2022] POST /identity/v3/users => generated 294 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:49:33.405793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb636c44-e03f-4d59-8eaa-2492d0b71c49 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:33.411294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2f714-25b3-4b98-ad58-758d5a3f78bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:33.411947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2f714-25b3-4b98-ad58-758d5a3f78bb admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:33.412239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2f714-25b3-4b98-ad58-758d5a3f78bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:33.412516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2f714-25b3-4b98-ad58-758d5a3f78bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:33.413219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2f714-25b3-4b98-ad58-758d5a3f78bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:33.414855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2f714-25b3-4b98-ad58-758d5a3f78bb admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:33.471365 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4110/8305] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:49:33.475922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071b654-4982-4f0c-bf65-8abe5d8c37cc admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:33.494982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071b654-4982-4f0c-bf65-8abe5d8c37cc admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:33.500237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbc1a6-d866-4bd9-95bd-3988f3ff5273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:33.500930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbc1a6-d866-4bd9-95bd-3988f3ff5273 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:33.501213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbc1a6-d866-4bd9-95bd-3988f3ff5273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:33.501496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbc1a6-d866-4bd9-95bd-3988f3ff5273 admin admin] PATH_INFO: `/v3/projects/5ecf512c6a4e4c07b638d91271adfe7a/users/12cf77a929fc41c6908763216d86d04a/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:33.519630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbc1a6-d866-4bd9-95bd-3988f3ff5273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ecf512c6a4e4c07b638d91271adfe7a, user_id=12cf77a929fc41c6908763216d86d04a, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:33.522995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbc1a6-d866-4bd9-95bd-3988f3ff5273 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:33.550977 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4196/8306] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:49:33 2022] PUT /identity/v3/projects/5ecf512c6a4e4c07b638d91271adfe7a/users/12cf77a929fc41c6908763216d86d04a/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:33.555648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2f714-25b3-4b98-ad58-758d5a3f78bb admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:33.586380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2f714-25b3-4b98-ad58-758d5a3f78bb admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:33.702949 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:33.742232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27a6a6-dc7f-42c1-9461-8763ea665654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:33.742872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27a6a6-dc7f-42c1-9461-8763ea665654 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:33.743259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27a6a6-dc7f-42c1-9461-8763ea665654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:33.744125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27a6a6-dc7f-42c1-9461-8763ea665654 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:33.745674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f27a6a6-dc7f-42c1-9461-8763ea665654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:33.752052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f27a6a6-dc7f-42c1-9461-8763ea665654 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:33.795008 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4111/8307] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:49:33.796531 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbc1a6-d866-4bd9-95bd-3988f3ff5273 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:33.827247 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbc1a6-d866-4bd9-95bd-3988f3ff5273 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:33.875339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271e035-31e0-4f9d-9b42-5d54ec2559b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:33.876075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271e035-31e0-4f9d-9b42-5d54ec2559b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:33.876346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271e035-31e0-4f9d-9b42-5d54ec2559b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:33.876624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3271e035-31e0-4f9d-9b42-5d54ec2559b2 admin admin] PATH_INFO: `/v3/projects/5ecf512c6a4e4c07b638d91271adfe7a/users/12cf77a929fc41c6908763216d86d04a/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:33.885386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3271e035-31e0-4f9d-9b42-5d54ec2559b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ecf512c6a4e4c07b638d91271adfe7a, user_id=12cf77a929fc41c6908763216d86d04a, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:33.888099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3271e035-31e0-4f9d-9b42-5d54ec2559b2 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:33.940685 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4197/8308] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:49:33 2022] PUT /identity/v3/projects/5ecf512c6a4e4c07b638d91271adfe7a/users/12cf77a929fc41c6908763216d86d04a/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:34.070312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f8c8b-6aae-44c2-9fab-755440eea154 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:34.073633 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f8c8b-6aae-44c2-9fab-755440eea154 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:34.074228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f8c8b-6aae-44c2-9fab-755440eea154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:34.112858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-476f8c8b-6aae-44c2-9fab-755440eea154 None None] MFA Rules not processed for user `12cf77a929fc41c6908763216d86d04a`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:34.115304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-476f8c8b-6aae-44c2-9fab-755440eea154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:34.274434 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4112/8309] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:34.287149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271e035-31e0-4f9d-9b42-5d54ec2559b2 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:34.289851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3271e035-31e0-4f9d-9b42-5d54ec2559b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:34.459041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3271e035-31e0-4f9d-9b42-5d54ec2559b2 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:34.469310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d96ab-1d95-4808-b614-5e677506dfbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:34.472799 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d96ab-1d95-4808-b614-5e677506dfbf service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:34.473347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d96ab-1d95-4808-b614-5e677506dfbf service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:34.473705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d96ab-1d95-4808-b614-5e677506dfbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:34.558886 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:34.665012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d96ab-1d95-4808-b614-5e677506dfbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:34.666564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d96ab-1d95-4808-b614-5e677506dfbf service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:34.706827 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4198/8310] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:49:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:49:39.275959 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f8c8b-6aae-44c2-9fab-755440eea154 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:39.277924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-476f8c8b-6aae-44c2-9fab-755440eea154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:39.308710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f8c8b-6aae-44c2-9fab-755440eea154 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:39.323828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cad4d4-b778-4153-ac66-73338b4efa23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:39.324655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cad4d4-b778-4153-ac66-73338b4efa23 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:39.324933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cad4d4-b778-4153-ac66-73338b4efa23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:39.325270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cad4d4-b778-4153-ac66-73338b4efa23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:39.327057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-04cad4d4-b778-4153-ac66-73338b4efa23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:39.651453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cad4d4-b778-4153-ac66-73338b4efa23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:39.656933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cad4d4-b778-4153-ac66-73338b4efa23 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:39.721101 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4113/8311] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:49:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:49:40.718392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d96ab-1d95-4808-b614-5e677506dfbf service cinder] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:40.720020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-514d96ab-1d95-4808-b614-5e677506dfbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:40.904113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d96ab-1d95-4808-b614-5e677506dfbf service cinder] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:40.914450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e792bc-cced-45a9-8db6-1ccbd787fd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:40.915182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e792bc-cced-45a9-8db6-1ccbd787fd2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:40.916237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e792bc-cced-45a9-8db6-1ccbd787fd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:40.916620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e792bc-cced-45a9-8db6-1ccbd787fd2a admin admin] PATH_INFO: `/v3/users/0ea202a26e6042678d01974000b35a1d` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:40.919680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e792bc-cced-45a9-8db6-1ccbd787fd2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ea202a26e6042678d01974000b35a1d)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:40.926779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e792bc-cced-45a9-8db6-1ccbd787fd2a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:41.051680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a2e792bc-cced-45a9-8db6-1ccbd787fd2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ea202a26e6042678d01974000b35a1d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:41.080936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a2e792bc-cced-45a9-8db6-1ccbd787fd2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ea202a26e6042678d01974000b35a1d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:41.105926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a2e792bc-cced-45a9-8db6-1ccbd787fd2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ea202a26e6042678d01974000b35a1d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:41.107109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a2e792bc-cced-45a9-8db6-1ccbd787fd2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ea202a26e6042678d01974000b35a1d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:41.130543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a2e792bc-cced-45a9-8db6-1ccbd787fd2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ea202a26e6042678d01974000b35a1d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:41.138321 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4199/8312] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:49:40 2022] DELETE /identity/v3/users/0ea202a26e6042678d01974000b35a1d => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:41.142737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6c1b4-4714-498d-88cc-331da435b403 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:41.143236 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6c1b4-4714-498d-88cc-331da435b403 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:41.143328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6c1b4-4714-498d-88cc-331da435b403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:41.192678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-18d6c1b4-4714-498d-88cc-331da435b403 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:41.195628 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-18d6c1b4-4714-498d-88cc-331da435b403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:41.401154 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:41.444610 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4114/8313] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:41.464114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e792bc-cced-45a9-8db6-1ccbd787fd2a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:41.465702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a2e792bc-cced-45a9-8db6-1ccbd787fd2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:41.622019 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:41.638992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e792bc-cced-45a9-8db6-1ccbd787fd2a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:41.651666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60f931-33fd-4e91-b7a3-4d3fd594e00d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:41.652362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60f931-33fd-4e91-b7a3-4d3fd594e00d service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:41.652764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60f931-33fd-4e91-b7a3-4d3fd594e00d service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:41.653043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60f931-33fd-4e91-b7a3-4d3fd594e00d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:41.673182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c60f931-33fd-4e91-b7a3-4d3fd594e00d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:41.681359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c60f931-33fd-4e91-b7a3-4d3fd594e00d service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:41.709844 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4200/8314] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:49:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:49:42.926568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6c1b4-4714-498d-88cc-331da435b403 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:42.928331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-18d6c1b4-4714-498d-88cc-331da435b403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:42.949615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6c1b4-4714-498d-88cc-331da435b403 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:42.960811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209b202-aefe-47f6-8182-6435d4462201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:42.961548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209b202-aefe-47f6-8182-6435d4462201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:42.961827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209b202-aefe-47f6-8182-6435d4462201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:42.968197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209b202-aefe-47f6-8182-6435d4462201 admin admin] PATH_INFO: `/v3/projects/496cbeb3f54d443fb4dd070c16cc5b47` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:42.968197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e209b202-aefe-47f6-8182-6435d4462201 admin admin] RBAC: Authorizing `identity:delete_project(project_id=496cbeb3f54d443fb4dd070c16cc5b47)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:42.973613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e209b202-aefe-47f6-8182-6435d4462201 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:43.108754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e209b202-aefe-47f6-8182-6435d4462201 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '496cbeb3f54d443fb4dd070c16cc5b47', 'request_id': 'req-e209b202-aefe-47f6-8182-6435d4462201'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:43.168296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e209b202-aefe-47f6-8182-6435d4462201 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '496cbeb3f54d443fb4dd070c16cc5b47', 'request_id': 'req-e209b202-aefe-47f6-8182-6435d4462201'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:43.198842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e209b202-aefe-47f6-8182-6435d4462201 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '496cbeb3f54d443fb4dd070c16cc5b47', 'request_id': 'req-e209b202-aefe-47f6-8182-6435d4462201'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:43.259469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e209b202-aefe-47f6-8182-6435d4462201 admin admin] The token cache is being invalidate because project 496cbeb3f54d443fb4dd070c16cc5b47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:49:43.259773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e209b202-aefe-47f6-8182-6435d4462201 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:43.262662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-e209b202-aefe-47f6-8182-6435d4462201 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:43.267145 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4115/8315] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:49:42 2022] DELETE /identity/v3/projects/496cbeb3f54d443fb4dd070c16cc5b47 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:43.271150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60f931-33fd-4e91-b7a3-4d3fd594e00d service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:43.285459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60f931-33fd-4e91-b7a3-4d3fd594e00d service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:43.516561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ede015-8798-472e-8f9f-4a724dafd9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:43.517265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ede015-8798-472e-8f9f-4a724dafd9a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:43.517592 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ede015-8798-472e-8f9f-4a724dafd9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:43.520011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ede015-8798-472e-8f9f-4a724dafd9a1 admin admin] PATH_INFO: `/v3/users/2daaf07fba6a4e739f6b219865920fcf` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:43.527415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ede015-8798-472e-8f9f-4a724dafd9a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2daaf07fba6a4e739f6b219865920fcf)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:43.540345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ede015-8798-472e-8f9f-4a724dafd9a1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:43.741830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-65ede015-8798-472e-8f9f-4a724dafd9a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2daaf07fba6a4e739f6b219865920fcf'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:43.779930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-65ede015-8798-472e-8f9f-4a724dafd9a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2daaf07fba6a4e739f6b219865920fcf'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:43.864771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-65ede015-8798-472e-8f9f-4a724dafd9a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2daaf07fba6a4e739f6b219865920fcf'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:43.868063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-65ede015-8798-472e-8f9f-4a724dafd9a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2daaf07fba6a4e739f6b219865920fcf'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:43.911951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-65ede015-8798-472e-8f9f-4a724dafd9a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2daaf07fba6a4e739f6b219865920fcf'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:43.931169 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4201/8316] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:49:43 2022] DELETE /identity/v3/users/2daaf07fba6a4e739f6b219865920fcf => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:43.955119 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209b202-aefe-47f6-8182-6435d4462201 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:43.956881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e209b202-aefe-47f6-8182-6435d4462201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:43.989127 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209b202-aefe-47f6-8182-6435d4462201 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:44.218795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89702c4e-d7c9-49d4-a0a7-c00cfab67d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:44.219509 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89702c4e-d7c9-49d4-a0a7-c00cfab67d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:44.219850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89702c4e-d7c9-49d4-a0a7-c00cfab67d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:44.220021 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89702c4e-d7c9-49d4-a0a7-c00cfab67d80 admin admin] PATH_INFO: `/v3/users/efd07bfe6e2d4c938f34385f42a62b95` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:44.226042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89702c4e-d7c9-49d4-a0a7-c00cfab67d80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efd07bfe6e2d4c938f34385f42a62b95)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:44.228562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89702c4e-d7c9-49d4-a0a7-c00cfab67d80 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:44.373082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-89702c4e-d7c9-49d4-a0a7-c00cfab67d80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efd07bfe6e2d4c938f34385f42a62b95'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:44.415456 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-89702c4e-d7c9-49d4-a0a7-c00cfab67d80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efd07bfe6e2d4c938f34385f42a62b95'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:44.442897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-89702c4e-d7c9-49d4-a0a7-c00cfab67d80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efd07bfe6e2d4c938f34385f42a62b95'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:44.450502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-89702c4e-d7c9-49d4-a0a7-c00cfab67d80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efd07bfe6e2d4c938f34385f42a62b95'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:44.463996 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-89702c4e-d7c9-49d4-a0a7-c00cfab67d80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efd07bfe6e2d4c938f34385f42a62b95'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:44.473207 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4116/8317] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:49:43 2022] DELETE /identity/v3/users/efd07bfe6e2d4c938f34385f42a62b95 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:44.477642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeaec7d-1dc6-4dc3-a8ad-fb1faa4b90d3 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:44.478398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeaec7d-1dc6-4dc3-a8ad-fb1faa4b90d3 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:44.478863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeaec7d-1dc6-4dc3-a8ad-fb1faa4b90d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:44.532718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ffeaec7d-1dc6-4dc3-a8ad-fb1faa4b90d3 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:44.536767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ffeaec7d-1dc6-4dc3-a8ad-fb1faa4b90d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:44.731921 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4202/8318] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:44.732345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89702c4e-d7c9-49d4-a0a7-c00cfab67d80 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:44.733963 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-89702c4e-d7c9-49d4-a0a7-c00cfab67d80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:44.739979 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:44.776899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeaec7d-1dc6-4dc3-a8ad-fb1faa4b90d3 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:44.778448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ffeaec7d-1dc6-4dc3-a8ad-fb1faa4b90d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:44.834980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeaec7d-1dc6-4dc3-a8ad-fb1faa4b90d3 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:44.865372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e299c6-2520-4d56-bed2-29341e42be16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:44.866126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e299c6-2520-4d56-bed2-29341e42be16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:44.866415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e299c6-2520-4d56-bed2-29341e42be16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:44.866688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e299c6-2520-4d56-bed2-29341e42be16 admin admin] PATH_INFO: `/v3/projects/40817fdf68694085909512c0a6a74d98` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:44.874499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e299c6-2520-4d56-bed2-29341e42be16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40817fdf68694085909512c0a6a74d98)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:44.885448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e299c6-2520-4d56-bed2-29341e42be16 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:44.906016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89702c4e-d7c9-49d4-a0a7-c00cfab67d80 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:44.917466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55887b9f-f39f-47c3-972e-aa870100fc7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:44.918092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55887b9f-f39f-47c3-972e-aa870100fc7b service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:44.918372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55887b9f-f39f-47c3-972e-aa870100fc7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:44.919099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55887b9f-f39f-47c3-972e-aa870100fc7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:44.924757 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:44.941541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55887b9f-f39f-47c3-972e-aa870100fc7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:44.947256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55887b9f-f39f-47c3-972e-aa870100fc7b service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:44.976536 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4117/8319] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:49:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:49:45.036497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-46e299c6-2520-4d56-bed2-29341e42be16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40817fdf68694085909512c0a6a74d98', 'request_id': 'req-46e299c6-2520-4d56-bed2-29341e42be16'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:45.050833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-46e299c6-2520-4d56-bed2-29341e42be16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40817fdf68694085909512c0a6a74d98', 'request_id': 'req-46e299c6-2520-4d56-bed2-29341e42be16'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:45.062289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-46e299c6-2520-4d56-bed2-29341e42be16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40817fdf68694085909512c0a6a74d98', 'request_id': 'req-46e299c6-2520-4d56-bed2-29341e42be16'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:45.111259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-46e299c6-2520-4d56-bed2-29341e42be16 admin admin] The token cache is being invalidate because project 40817fdf68694085909512c0a6a74d98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:49:45.111977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-46e299c6-2520-4d56-bed2-29341e42be16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:45.113688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-46e299c6-2520-4d56-bed2-29341e42be16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:45.121822 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4203/8320] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:49:44 2022] DELETE /identity/v3/projects/40817fdf68694085909512c0a6a74d98 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:49:45.122834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac854aa8-36f1-48ba-b124-80c627e0298d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:45.123125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac854aa8-36f1-48ba-b124-80c627e0298d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:45.123582 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac854aa8-36f1-48ba-b124-80c627e0298d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:45.157624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ac854aa8-36f1-48ba-b124-80c627e0298d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:45.160320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ac854aa8-36f1-48ba-b124-80c627e0298d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:45.287742 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4118/8321] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:45.297790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6a1cf-c44c-48e5-9de9-4155f09aada6 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:45.298138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6a1cf-c44c-48e5-9de9-4155f09aada6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:45.298482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6a1cf-c44c-48e5-9de9-4155f09aada6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:45.345030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-8ac6a1cf-c44c-48e5-9de9-4155f09aada6 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:45.349112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8ac6a1cf-c44c-48e5-9de9-4155f09aada6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:45.370601 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4204/8322] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:45.371645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac854aa8-36f1-48ba-b124-80c627e0298d None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:45.383476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac854aa8-36f1-48ba-b124-80c627e0298d None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:45.409046 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac6a26-3226-4bef-90a0-9196942b51b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:45.410020 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac6a26-3226-4bef-90a0-9196942b51b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:45.410485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac6a26-3226-4bef-90a0-9196942b51b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:45.410900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac6a26-3226-4bef-90a0-9196942b51b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:45.411810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac6a26-3226-4bef-90a0-9196942b51b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:49:45.412351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac6a26-3226-4bef-90a0-9196942b51b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:45.414173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac6a26-3226-4bef-90a0-9196942b51b4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:45.430067 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4119/8323] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:49:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:49:45.434285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6a1cf-c44c-48e5-9de9-4155f09aada6 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:45.458185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6a1cf-c44c-48e5-9de9-4155f09aada6 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:45.472463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac63e4c-ff1f-4127-844f-56ec0becb6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:45.473117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac63e4c-ff1f-4127-844f-56ec0becb6e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:45.473392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac63e4c-ff1f-4127-844f-56ec0becb6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:45.473658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac63e4c-ff1f-4127-844f-56ec0becb6e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:45.474323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac63e4c-ff1f-4127-844f-56ec0becb6e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:45.476992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac63e4c-ff1f-4127-844f-56ec0becb6e1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:45.549836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac6a26-3226-4bef-90a0-9196942b51b4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:45.553163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f6ac6a26-3226-4bef-90a0-9196942b51b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:45.558595 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4205/8324] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:49:45 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:49:45.561571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac63e4c-ff1f-4127-844f-56ec0becb6e1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:45.588256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac6a26-3226-4bef-90a0-9196942b51b4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:45.712204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac63e4c-ff1f-4127-844f-56ec0becb6e1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:45.725544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996a3c1-8a23-4181-9640-320166dfdf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:45.727824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996a3c1-8a23-4181-9640-320166dfdf3c admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:45.728508 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996a3c1-8a23-4181-9640-320166dfdf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:45.728785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996a3c1-8a23-4181-9640-320166dfdf3c admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:45.730134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996a3c1-8a23-4181-9640-320166dfdf3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:45.731460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fe2d0-70bd-4bd4-8f52-906e9f82b828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:45.732151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fe2d0-70bd-4bd4-8f52-906e9f82b828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:45.732443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fe2d0-70bd-4bd4-8f52-906e9f82b828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:45.732779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fe2d0-70bd-4bd4-8f52-906e9f82b828 admin admin] PATH_INFO: `/v3/projects/9bf11846d56842f98bab7b593bbd12d6` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:45.735067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996a3c1-8a23-4181-9640-320166dfdf3c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:45.736374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fe2d0-70bd-4bd4-8f52-906e9f82b828 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bf11846d56842f98bab7b593bbd12d6)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:45.746884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fe2d0-70bd-4bd4-8f52-906e9f82b828 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:45.784280 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4206/8325] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:49:45 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:49:45.785958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996a3c1-8a23-4181-9640-320166dfdf3c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:45.806767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996a3c1-8a23-4181-9640-320166dfdf3c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:45.819972 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a2ac2-c25a-4ca3-ba02-1fd9f028e3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:45.820600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a2ac2-c25a-4ca3-ba02-1fd9f028e3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:45.820875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a2ac2-c25a-4ca3-ba02-1fd9f028e3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:45.821142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a2ac2-c25a-4ca3-ba02-1fd9f028e3a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:45.821794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a2ac2-c25a-4ca3-ba02-1fd9f028e3a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:45.824687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a2ac2-c25a-4ca3-ba02-1fd9f028e3a8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:45.827454 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:45.845352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8f1fe2d0-70bd-4bd4-8f52-906e9f82b828 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bf11846d56842f98bab7b593bbd12d6', 'request_id': 'req-8f1fe2d0-70bd-4bd4-8f52-906e9f82b828'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:45.854621 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4207/8326] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:49:45.855496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a2ac2-c25a-4ca3-ba02-1fd9f028e3a8 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:45.859605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8f1fe2d0-70bd-4bd4-8f52-906e9f82b828 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bf11846d56842f98bab7b593bbd12d6', 'request_id': 'req-8f1fe2d0-70bd-4bd4-8f52-906e9f82b828'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:45.873353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8f1fe2d0-70bd-4bd4-8f52-906e9f82b828 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bf11846d56842f98bab7b593bbd12d6', 'request_id': 'req-8f1fe2d0-70bd-4bd4-8f52-906e9f82b828'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:45.886996 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a2ac2-c25a-4ca3-ba02-1fd9f028e3a8 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:45.930570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8f1fe2d0-70bd-4bd4-8f52-906e9f82b828 admin admin] The token cache is being invalidate because project 9bf11846d56842f98bab7b593bbd12d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:49:45.930868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8f1fe2d0-70bd-4bd4-8f52-906e9f82b828 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:45.931592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8f1fe2d0-70bd-4bd4-8f52-906e9f82b828 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:45.933541 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4120/8327] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:49:45 2022] DELETE /identity/v3/projects/9bf11846d56842f98bab7b593bbd12d6 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:45.937197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fe2d0-70bd-4bd4-8f52-906e9f82b828 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:45.938549 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8f1fe2d0-70bd-4bd4-8f52-906e9f82b828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:45.992968 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:46.029726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b8dcc-8554-47f0-a74a-ecc969dfb3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:46.030357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b8dcc-8554-47f0-a74a-ecc969dfb3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:46.030635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b8dcc-8554-47f0-a74a-ecc969dfb3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:46.030907 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b8dcc-8554-47f0-a74a-ecc969dfb3f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:46.032561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b8dcc-8554-47f0-a74a-ecc969dfb3f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:46.035741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b8dcc-8554-47f0-a74a-ecc969dfb3f6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:46.064582 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4208/8328] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:49:46.065991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b8dcc-8554-47f0-a74a-ecc969dfb3f6 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:46.072393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a87b8dcc-8554-47f0-a74a-ecc969dfb3f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:46.079141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fe2d0-70bd-4bd4-8f52-906e9f82b828 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:46.097686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b8dcc-8554-47f0-a74a-ecc969dfb3f6 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:46.101154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c9dde-3a56-4ea7-bc69-c2627e74fa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:46.101940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c9dde-3a56-4ea7-bc69-c2627e74fa99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:46.102325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c9dde-3a56-4ea7-bc69-c2627e74fa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:46.102692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c9dde-3a56-4ea7-bc69-c2627e74fa99 admin admin] PATH_INFO: `/v3/users/12cf77a929fc41c6908763216d86d04a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:46.105210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c9dde-3a56-4ea7-bc69-c2627e74fa99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12cf77a929fc41c6908763216d86d04a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:46.111371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86996b-c827-423e-9d7b-79e7ceace2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:46.111809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c9dde-3a56-4ea7-bc69-c2627e74fa99 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:46.112143 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86996b-c827-423e-9d7b-79e7ceace2b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:46.112419 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86996b-c827-423e-9d7b-79e7ceace2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:46.112689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86996b-c827-423e-9d7b-79e7ceace2b0 admin admin] PATH_INFO: `/v3/projects/3bb25b60d7a944389c7c1ff8e1faa668/users/08b85419977b457fbc7965854cf8c3d3/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:46.161297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86996b-c827-423e-9d7b-79e7ceace2b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bb25b60d7a944389c7c1ff8e1faa668, user_id=08b85419977b457fbc7965854cf8c3d3, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:46.166401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86996b-c827-423e-9d7b-79e7ceace2b0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:46.205094 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4209/8329] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:49:46 2022] PUT /identity/v3/projects/3bb25b60d7a944389c7c1ff8e1faa668/users/08b85419977b457fbc7965854cf8c3d3/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:46.206874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e72563-2f3f-4453-b8e6-0af3dc7a79e1 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:46.207158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e72563-2f3f-4453-b8e6-0af3dc7a79e1 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:46.207431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e72563-2f3f-4453-b8e6-0af3dc7a79e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:46.263051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-25e72563-2f3f-4453-b8e6-0af3dc7a79e1 None None] MFA Rules not processed for user `08b85419977b457fbc7965854cf8c3d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:46.265484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-25e72563-2f3f-4453-b8e6-0af3dc7a79e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:46.296297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-534c9dde-3a56-4ea7-bc69-c2627e74fa99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12cf77a929fc41c6908763216d86d04a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:46.315038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-534c9dde-3a56-4ea7-bc69-c2627e74fa99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12cf77a929fc41c6908763216d86d04a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:46.357165 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-534c9dde-3a56-4ea7-bc69-c2627e74fa99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12cf77a929fc41c6908763216d86d04a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:46.357974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-534c9dde-3a56-4ea7-bc69-c2627e74fa99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12cf77a929fc41c6908763216d86d04a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:46.370984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-534c9dde-3a56-4ea7-bc69-c2627e74fa99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12cf77a929fc41c6908763216d86d04a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:46.382706 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4121/8330] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:49:45 2022] DELETE /identity/v3/users/12cf77a929fc41c6908763216d86d04a => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:49:46.404225 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4210/8331] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:49:46.415527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c9dde-3a56-4ea7-bc69-c2627e74fa99 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:46.420092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-534c9dde-3a56-4ea7-bc69-c2627e74fa99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:46.522419 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:46.552724 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c9dde-3a56-4ea7-bc69-c2627e74fa99 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:46.564068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda144b9-3196-468f-bd5f-6c90877ec90f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:46.564823 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda144b9-3196-468f-bd5f-6c90877ec90f service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:46.565191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda144b9-3196-468f-bd5f-6c90877ec90f service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:46.565569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda144b9-3196-468f-bd5f-6c90877ec90f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:46.572469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-eda144b9-3196-468f-bd5f-6c90877ec90f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:46.774668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda144b9-3196-468f-bd5f-6c90877ec90f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:46.777068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda144b9-3196-468f-bd5f-6c90877ec90f service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:46.864590 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4122/8332] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:49:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:49:46.887932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e72563-2f3f-4453-b8e6-0af3dc7a79e1 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:46.995214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda144b9-3196-468f-bd5f-6c90877ec90f service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:46.997403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-eda144b9-3196-468f-bd5f-6c90877ec90f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:47.090037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e72563-2f3f-4453-b8e6-0af3dc7a79e1 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:47.130528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda144b9-3196-468f-bd5f-6c90877ec90f service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:47.135986 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59070fd6-b751-417e-9a89-e33f0f982d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:47.136972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59070fd6-b751-417e-9a89-e33f0f982d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:47.137117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59070fd6-b751-417e-9a89-e33f0f982d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:47.137408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59070fd6-b751-417e-9a89-e33f0f982d0f admin admin] PATH_INFO: `/v3/projects/5ecf512c6a4e4c07b638d91271adfe7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:47.138807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59070fd6-b751-417e-9a89-e33f0f982d0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ecf512c6a4e4c07b638d91271adfe7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:47.141891 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59070fd6-b751-417e-9a89-e33f0f982d0f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:47.184477 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:47.207733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee13c2-5dd5-417c-befe-42b3bd5a9749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:47.215179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee13c2-5dd5-417c-befe-42b3bd5a9749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:47.215179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee13c2-5dd5-417c-befe-42b3bd5a9749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:47.215179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee13c2-5dd5-417c-befe-42b3bd5a9749 admin admin] PATH_INFO: `/v3/users/08b85419977b457fbc7965854cf8c3d3` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:47.215179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee13c2-5dd5-417c-befe-42b3bd5a9749 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08b85419977b457fbc7965854cf8c3d3)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:47.218670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee13c2-5dd5-417c-befe-42b3bd5a9749 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:47.278460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-59070fd6-b751-417e-9a89-e33f0f982d0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ecf512c6a4e4c07b638d91271adfe7a', 'request_id': 'req-59070fd6-b751-417e-9a89-e33f0f982d0f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:47.297195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-59070fd6-b751-417e-9a89-e33f0f982d0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ecf512c6a4e4c07b638d91271adfe7a', 'request_id': 'req-59070fd6-b751-417e-9a89-e33f0f982d0f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:47.314041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-59070fd6-b751-417e-9a89-e33f0f982d0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ecf512c6a4e4c07b638d91271adfe7a', 'request_id': 'req-59070fd6-b751-417e-9a89-e33f0f982d0f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:47.345412 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-59070fd6-b751-417e-9a89-e33f0f982d0f admin admin] The token cache is being invalidate because project 5ecf512c6a4e4c07b638d91271adfe7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:49:47.346702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-59070fd6-b751-417e-9a89-e33f0f982d0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:47.349131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-59070fd6-b751-417e-9a89-e33f0f982d0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:47.353704 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4123/8333] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:49:46 2022] DELETE /identity/v3/projects/5ecf512c6a4e4c07b638d91271adfe7a => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:47.359317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ade767-2bff-492f-b694-ab0c9d31b2a8 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:47.360082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ade767-2bff-492f-b694-ab0c9d31b2a8 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:47.363081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ade767-2bff-492f-b694-ab0c9d31b2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:47.367020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cfee13c2-5dd5-417c-befe-42b3bd5a9749 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08b85419977b457fbc7965854cf8c3d3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:47.388277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-26ade767-2bff-492f-b694-ab0c9d31b2a8 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:47.389933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-26ade767-2bff-492f-b694-ab0c9d31b2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:47.393089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cfee13c2-5dd5-417c-befe-42b3bd5a9749 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08b85419977b457fbc7965854cf8c3d3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:47.420294 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:47.420522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cfee13c2-5dd5-417c-befe-42b3bd5a9749 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08b85419977b457fbc7965854cf8c3d3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:47.421517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cfee13c2-5dd5-417c-befe-42b3bd5a9749 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08b85419977b457fbc7965854cf8c3d3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:47.433133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cfee13c2-5dd5-417c-befe-42b3bd5a9749 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08b85419977b457fbc7965854cf8c3d3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:47.447065 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4211/8334] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:49:46 2022] DELETE /identity/v3/users/08b85419977b457fbc7965854cf8c3d3 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:47.449470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa834c-7968-47b9-a161-f73650847842 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:47.449753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa834c-7968-47b9-a161-f73650847842 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:47.450027 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa834c-7968-47b9-a161-f73650847842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:47.490599 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4124/8335] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:49:47.495148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-81aa834c-7968-47b9-a161-f73650847842 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:47.496659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-81aa834c-7968-47b9-a161-f73650847842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:47.497862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75cbee-c44b-4bec-9cac-c93c3e53a49d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:47.498306 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75cbee-c44b-4bec-9cac-c93c3e53a49d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:47.499366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75cbee-c44b-4bec-9cac-c93c3e53a49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:47.554693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9b75cbee-c44b-4bec-9cac-c93c3e53a49d None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:47.555960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9b75cbee-c44b-4bec-9cac-c93c3e53a49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:47.621940 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4212/8336] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:47.629162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa834c-7968-47b9-a161-f73650847842 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:47.630906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-81aa834c-7968-47b9-a161-f73650847842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:47.712693 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4125/8337] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:49:47.713648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75cbee-c44b-4bec-9cac-c93c3e53a49d None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:47.723286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75cbee-c44b-4bec-9cac-c93c3e53a49d None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:47.728880 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b30e5-45ee-4ac2-af97-1081335e4638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:47.729510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b30e5-45ee-4ac2-af97-1081335e4638 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:47.729793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b30e5-45ee-4ac2-af97-1081335e4638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:47.730064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b30e5-45ee-4ac2-af97-1081335e4638 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:47.730744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b30e5-45ee-4ac2-af97-1081335e4638 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:49:47.731049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b30e5-45ee-4ac2-af97-1081335e4638 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:47.732751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b30e5-45ee-4ac2-af97-1081335e4638 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:47.752088 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4126/8338] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:49:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:49:47.753122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b30e5-45ee-4ac2-af97-1081335e4638 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:47.760405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aa834c-7968-47b9-a161-f73650847842 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:47.764760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e009a0d-80a9-45c9-8631-4307432db6ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:47.766534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e009a0d-80a9-45c9-8631-4307432db6ec service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:47.767031 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e009a0d-80a9-45c9-8631-4307432db6ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:47.767502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e009a0d-80a9-45c9-8631-4307432db6ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:47.778545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b30e5-45ee-4ac2-af97-1081335e4638 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:47.785067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092896b-4194-4bdf-ab1f-c44598e593a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:47.786438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092896b-4194-4bdf-ab1f-c44598e593a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:47.787448 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092896b-4194-4bdf-ab1f-c44598e593a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:47.787944 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092896b-4194-4bdf-ab1f-c44598e593a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:47.788779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092896b-4194-4bdf-ab1f-c44598e593a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:47.792828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092896b-4194-4bdf-ab1f-c44598e593a7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:47.795523 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e009a0d-80a9-45c9-8631-4307432db6ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:47.797893 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e009a0d-80a9-45c9-8631-4307432db6ec service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:47.822764 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4213/8339] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:49:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:49:47.870002 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4127/8340] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:49:47 2022] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:49:47.871348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e009a0d-80a9-45c9-8631-4307432db6ec service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:47.884704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e009a0d-80a9-45c9-8631-4307432db6ec service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:47.910005 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:48.101677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2c67c-9447-4dca-88a2-040dc59b8eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:48.102293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2c67c-9447-4dca-88a2-040dc59b8eec admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:48.102566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2c67c-9447-4dca-88a2-040dc59b8eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:48.102834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2c67c-9447-4dca-88a2-040dc59b8eec admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:48.103460 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e2c67c-9447-4dca-88a2-040dc59b8eec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:48.110899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e2c67c-9447-4dca-88a2-040dc59b8eec admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:48.203943 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4214/8341] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:49:47 2022] POST /identity/v3/users => generated 285 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:49:48.204252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092896b-4194-4bdf-ab1f-c44598e593a7 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:48.210960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092896b-4194-4bdf-ab1f-c44598e593a7 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:48.220573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8221d2a-8fb8-422e-a7c6-4e0156c0b6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:48.222284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8221d2a-8fb8-422e-a7c6-4e0156c0b6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:48.222284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8221d2a-8fb8-422e-a7c6-4e0156c0b6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:48.222485 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8221d2a-8fb8-422e-a7c6-4e0156c0b6d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:48.223179 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8221d2a-8fb8-422e-a7c6-4e0156c0b6d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:48.227823 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8221d2a-8fb8-422e-a7c6-4e0156c0b6d2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:48.263095 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4128/8342] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:49:48.266888 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2c67c-9447-4dca-88a2-040dc59b8eec admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:48.282544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2c67c-9447-4dca-88a2-040dc59b8eec admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:48.299216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8866e17-c133-41d9-91d9-998f2976aacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:48.300050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8866e17-c133-41d9-91d9-998f2976aacc admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:48.300330 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8866e17-c133-41d9-91d9-998f2976aacc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:48.300727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8866e17-c133-41d9-91d9-998f2976aacc admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:48.305864 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8866e17-c133-41d9-91d9-998f2976aacc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:48.307809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8866e17-c133-41d9-91d9-998f2976aacc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:48.348875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8221d2a-8fb8-422e-a7c6-4e0156c0b6d2 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:48.350749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e8221d2a-8fb8-422e-a7c6-4e0156c0b6d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:48.357405 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4215/8343] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:49:48.361270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8866e17-c133-41d9-91d9-998f2976aacc admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:48.382856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8866e17-c133-41d9-91d9-998f2976aacc admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:48.388360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8221d2a-8fb8-422e-a7c6-4e0156c0b6d2 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:48.393055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a94790-b79d-4702-9c91-4427f5d77492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:48.394120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a94790-b79d-4702-9c91-4427f5d77492 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:48.394943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a94790-b79d-4702-9c91-4427f5d77492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:48.395764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a94790-b79d-4702-9c91-4427f5d77492 admin admin] PATH_INFO: `/v3/projects/42f020a5225e486a93f808c84cae809f/users/0f43ad9ff4b34d0ebfabc7d50e14e470/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:48.400903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab45dbd-7c85-4860-942f-a65176c0baa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:48.401725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab45dbd-7c85-4860-942f-a65176c0baa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:48.403212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab45dbd-7c85-4860-942f-a65176c0baa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:48.403328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab45dbd-7c85-4860-942f-a65176c0baa6 admin admin] PATH_INFO: `/v3/projects/3bb25b60d7a944389c7c1ff8e1faa668` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:48.424404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab45dbd-7c85-4860-942f-a65176c0baa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bb25b60d7a944389c7c1ff8e1faa668)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:48.426446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab45dbd-7c85-4860-942f-a65176c0baa6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:48.446642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a94790-b79d-4702-9c91-4427f5d77492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42f020a5225e486a93f808c84cae809f, user_id=0f43ad9ff4b34d0ebfabc7d50e14e470, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:48.449332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a94790-b79d-4702-9c91-4427f5d77492 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:48.472850 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4216/8344] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:49:48 2022] PUT /identity/v3/projects/42f020a5225e486a93f808c84cae809f/users/0f43ad9ff4b34d0ebfabc7d50e14e470/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:48.484273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dee668-a627-4224-bec5-ed59bd4dbbe6 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:48.484854 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dee668-a627-4224-bec5-ed59bd4dbbe6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:48.485317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dee668-a627-4224-bec5-ed59bd4dbbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:48.552323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7ab45dbd-7c85-4860-942f-a65176c0baa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bb25b60d7a944389c7c1ff8e1faa668', 'request_id': 'req-7ab45dbd-7c85-4860-942f-a65176c0baa6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:48.560078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7ab45dbd-7c85-4860-942f-a65176c0baa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bb25b60d7a944389c7c1ff8e1faa668', 'request_id': 'req-7ab45dbd-7c85-4860-942f-a65176c0baa6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:48.571833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-70dee668-a627-4224-bec5-ed59bd4dbbe6 None None] MFA Rules not processed for user `0f43ad9ff4b34d0ebfabc7d50e14e470`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:48.573136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-70dee668-a627-4224-bec5-ed59bd4dbbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:48.579560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7ab45dbd-7c85-4860-942f-a65176c0baa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bb25b60d7a944389c7c1ff8e1faa668', 'request_id': 'req-7ab45dbd-7c85-4860-942f-a65176c0baa6'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:48.600559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7ab45dbd-7c85-4860-942f-a65176c0baa6 admin admin] The token cache is being invalidate because project 3bb25b60d7a944389c7c1ff8e1faa668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:49:48.600928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7ab45dbd-7c85-4860-942f-a65176c0baa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:48.603454 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7ab45dbd-7c85-4860-942f-a65176c0baa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:48.610982 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4129/8345] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:49:48 2022] DELETE /identity/v3/projects/3bb25b60d7a944389c7c1ff8e1faa668 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:49:48.612361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5729fab-34ed-4d08-8343-6f7e8b8bc62c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:48.612647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5729fab-34ed-4d08-8343-6f7e8b8bc62c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:48.612931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5729fab-34ed-4d08-8343-6f7e8b8bc62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:48.638112 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:48.658241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b5729fab-34ed-4d08-8343-6f7e8b8bc62c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:48.659614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b5729fab-34ed-4d08-8343-6f7e8b8bc62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:48.772290 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4217/8346] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:49:48.788030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dee668-a627-4224-bec5-ed59bd4dbbe6 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:48.791168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-70dee668-a627-4224-bec5-ed59bd4dbbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:48.810589 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4130/8347] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:48.812746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a958e4-d330-47e3-b3f9-55eccf6ceda6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:48.813038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a958e4-d330-47e3-b3f9-55eccf6ceda6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:48.813315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a958e4-d330-47e3-b3f9-55eccf6ceda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:48.853539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e9a958e4-d330-47e3-b3f9-55eccf6ceda6 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:48.855475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e9a958e4-d330-47e3-b3f9-55eccf6ceda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:48.885335 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4131/8348] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:48.886381 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a958e4-d330-47e3-b3f9-55eccf6ceda6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:48.909775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a958e4-d330-47e3-b3f9-55eccf6ceda6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:48.922044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca576fcd-1b19-461d-8eba-157b1a6ce0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:48.922699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca576fcd-1b19-461d-8eba-157b1a6ce0ec admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:48.923181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca576fcd-1b19-461d-8eba-157b1a6ce0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:48.923530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca576fcd-1b19-461d-8eba-157b1a6ce0ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:48.925709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca576fcd-1b19-461d-8eba-157b1a6ce0ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:49:48.926074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca576fcd-1b19-461d-8eba-157b1a6ce0ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:48.929654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca576fcd-1b19-461d-8eba-157b1a6ce0ec admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:48.936189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dee668-a627-4224-bec5-ed59bd4dbbe6 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:48.940185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8705b2-e3a3-47d0-baa9-d177222a62c5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:48.940926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8705b2-e3a3-47d0-baa9-d177222a62c5 service glance] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:48.941297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8705b2-e3a3-47d0-baa9-d177222a62c5 service glance] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:48.941710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8705b2-e3a3-47d0-baa9-d177222a62c5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:48.983670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8705b2-e3a3-47d0-baa9-d177222a62c5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:48.991579 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4132/8349] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:49:48.992325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8705b2-e3a3-47d0-baa9-d177222a62c5 service glance] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:48.996023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca576fcd-1b19-461d-8eba-157b1a6ce0ec admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:49.020339 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4218/8350] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:49:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:49:49.021555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca576fcd-1b19-461d-8eba-157b1a6ce0ec admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:49.042568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1d54b-5529-4d97-95cd-5739fcb52254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:49.043629 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1d54b-5529-4d97-95cd-5739fcb52254 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:49.044237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1d54b-5529-4d97-95cd-5739fcb52254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:49.044916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1d54b-5529-4d97-95cd-5739fcb52254 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:49.049534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1d54b-5529-4d97-95cd-5739fcb52254 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:49.055439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1d54b-5529-4d97-95cd-5739fcb52254 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:49.144393 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4133/8351] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:49:48 2022] POST /identity/v3/projects => generated 389 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:49:49.149011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8705b2-e3a3-47d0-baa9-d177222a62c5 service glance] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:49.161377 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:49.177109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8705b2-e3a3-47d0-baa9-d177222a62c5 service glance] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:49.352919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee202938-d213-4b90-a7d8-76b6f7c0c1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:49.353539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee202938-d213-4b90-a7d8-76b6f7c0c1fc admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:49.353822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee202938-d213-4b90-a7d8-76b6f7c0c1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:49.354098 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee202938-d213-4b90-a7d8-76b6f7c0c1fc admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:49.354721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee202938-d213-4b90-a7d8-76b6f7c0c1fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:49.356759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee202938-d213-4b90-a7d8-76b6f7c0c1fc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:49.394509 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4219/8352] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:49:49 2022] POST /identity/v3/users => generated 295 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:49:49.398940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1d54b-5529-4d97-95cd-5739fcb52254 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:49.410995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1d54b-5529-4d97-95cd-5739fcb52254 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:49.419118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb84f2b-7b06-4f0b-ad74-b903441f0f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:49.419745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb84f2b-7b06-4f0b-ad74-b903441f0f38 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:49.420078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb84f2b-7b06-4f0b-ad74-b903441f0f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:49.420351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb84f2b-7b06-4f0b-ad74-b903441f0f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:49.421022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb84f2b-7b06-4f0b-ad74-b903441f0f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:49.422713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb84f2b-7b06-4f0b-ad74-b903441f0f38 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:49.437483 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4134/8353] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:49:49.439282 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee202938-d213-4b90-a7d8-76b6f7c0c1fc admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:49.483217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee202938-d213-4b90-a7d8-76b6f7c0c1fc admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:49.503434 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb14118-c105-4453-9dae-2f8673b328b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:49.504253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb14118-c105-4453-9dae-2f8673b328b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:49.504684 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb14118-c105-4453-9dae-2f8673b328b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:49.505123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb14118-c105-4453-9dae-2f8673b328b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:49.507230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb14118-c105-4453-9dae-2f8673b328b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:49.509007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb14118-c105-4453-9dae-2f8673b328b7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:49.534299 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4220/8354] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:49:49.535470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb84f2b-7b06-4f0b-ad74-b903441f0f38 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:49.546772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb84f2b-7b06-4f0b-ad74-b903441f0f38 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:49.562604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b2137-af2d-4038-a423-64f08ebb0931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:49.563221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b2137-af2d-4038-a423-64f08ebb0931 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:49.563502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b2137-af2d-4038-a423-64f08ebb0931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:49.563775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b2137-af2d-4038-a423-64f08ebb0931 admin admin] PATH_INFO: `/v3/projects/f786741ee3614e0b944ecf0c4dc5d609/users/0cf674104cde4c8584045e030716af9b/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:49.604155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b2137-af2d-4038-a423-64f08ebb0931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f786741ee3614e0b944ecf0c4dc5d609, user_id=0cf674104cde4c8584045e030716af9b, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:49.606877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b2137-af2d-4038-a423-64f08ebb0931 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:49.644966 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4135/8355] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:49:49 2022] PUT /identity/v3/projects/f786741ee3614e0b944ecf0c4dc5d609/users/0cf674104cde4c8584045e030716af9b/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:49.647609 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de774f3-dc7c-4d90-a8b8-5437db6805e4 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:49.648120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de774f3-dc7c-4d90-a8b8-5437db6805e4 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:49.648443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de774f3-dc7c-4d90-a8b8-5437db6805e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:49.687441 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-8de774f3-dc7c-4d90-a8b8-5437db6805e4 None None] MFA Rules not processed for user `0cf674104cde4c8584045e030716af9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:49.688900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8de774f3-dc7c-4d90-a8b8-5437db6805e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:49.814046 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4221/8356] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:49.833799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b2137-af2d-4038-a423-64f08ebb0931 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:49.835637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-188b2137-af2d-4038-a423-64f08ebb0931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:49.995465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b2137-af2d-4038-a423-64f08ebb0931 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:50.005350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc17be-1248-4acb-8509-cba0276c8370 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:50.006279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc17be-1248-4acb-8509-cba0276c8370 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:50.006570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc17be-1248-4acb-8509-cba0276c8370 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:50.006925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc17be-1248-4acb-8509-cba0276c8370 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:50.027213 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc17be-1248-4acb-8509-cba0276c8370 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:50.028797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc17be-1248-4acb-8509-cba0276c8370 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:50.050712 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4136/8357] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:49:49 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:49:56.297140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de774f3-dc7c-4d90-a8b8-5437db6805e4 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:56.299427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8de774f3-dc7c-4d90-a8b8-5437db6805e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:56.532451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de774f3-dc7c-4d90-a8b8-5437db6805e4 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:56.567475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965c3e7-1247-4711-8da8-8b5118722366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:56.570590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965c3e7-1247-4711-8da8-8b5118722366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:56.572467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965c3e7-1247-4711-8da8-8b5118722366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:56.572916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965c3e7-1247-4711-8da8-8b5118722366 admin admin] PATH_INFO: `/v3/users/f7e3cd7266b84c62bf644c9307edb763` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:56.574552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965c3e7-1247-4711-8da8-8b5118722366 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7e3cd7266b84c62bf644c9307edb763)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:56.576668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965c3e7-1247-4711-8da8-8b5118722366 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:56.608907 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:56.713097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7965c3e7-1247-4711-8da8-8b5118722366 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7e3cd7266b84c62bf644c9307edb763'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:56.732097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7965c3e7-1247-4711-8da8-8b5118722366 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7e3cd7266b84c62bf644c9307edb763'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:56.818428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7965c3e7-1247-4711-8da8-8b5118722366 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7e3cd7266b84c62bf644c9307edb763'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:56.822375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7965c3e7-1247-4711-8da8-8b5118722366 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7e3cd7266b84c62bf644c9307edb763'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:56.849362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7965c3e7-1247-4711-8da8-8b5118722366 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7e3cd7266b84c62bf644c9307edb763'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:56.872204 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4222/8358] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:49:56 2022] DELETE /identity/v3/users/f7e3cd7266b84c62bf644c9307edb763 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:49:56.876796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6e91e-193a-4adb-9f3a-ff4030336898 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:56.877320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6e91e-193a-4adb-9f3a-ff4030336898 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:56.877401 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6e91e-193a-4adb-9f3a-ff4030336898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:56.931814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-76c6e91e-193a-4adb-9f3a-ff4030336898 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:49:56.933542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-76c6e91e-193a-4adb-9f3a-ff4030336898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:56.996314 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:49:57.063956 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4137/8359] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:49:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:49:57.074043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965c3e7-1247-4711-8da8-8b5118722366 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:57.075799 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7965c3e7-1247-4711-8da8-8b5118722366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:57.229455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965c3e7-1247-4711-8da8-8b5118722366 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:57.244253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48473e57-1ec1-4b09-bbbf-6b3e86c67fb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:57.244891 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48473e57-1ec1-4b09-bbbf-6b3e86c67fb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:57.245165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48473e57-1ec1-4b09-bbbf-6b3e86c67fb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:57.245436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48473e57-1ec1-4b09-bbbf-6b3e86c67fb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:57.264747 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48473e57-1ec1-4b09-bbbf-6b3e86c67fb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:57.272107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48473e57-1ec1-4b09-bbbf-6b3e86c67fb9 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:57.314232 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4223/8360] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:49:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:49:57.852953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6e91e-193a-4adb-9f3a-ff4030336898 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:49:57.854951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-76c6e91e-193a-4adb-9f3a-ff4030336898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:49:57.883696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6e91e-193a-4adb-9f3a-ff4030336898 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:49:57.900057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167402a-d9a1-4e16-a691-9fa6ab4cd073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:49:57.904301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167402a-d9a1-4e16-a691-9fa6ab4cd073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:49:57.904817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167402a-d9a1-4e16-a691-9fa6ab4cd073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:49:57.905443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167402a-d9a1-4e16-a691-9fa6ab4cd073 admin admin] PATH_INFO: `/v3/projects/00b8ea4beba1443888c4b66bbf29dd10` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:49:57.910201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167402a-d9a1-4e16-a691-9fa6ab4cd073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00b8ea4beba1443888c4b66bbf29dd10)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:49:57.916398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167402a-d9a1-4e16-a691-9fa6ab4cd073 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:49:58.065914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6167402a-d9a1-4e16-a691-9fa6ab4cd073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00b8ea4beba1443888c4b66bbf29dd10', 'request_id': 'req-6167402a-d9a1-4e16-a691-9fa6ab4cd073'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:58.082368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6167402a-d9a1-4e16-a691-9fa6ab4cd073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00b8ea4beba1443888c4b66bbf29dd10', 'request_id': 'req-6167402a-d9a1-4e16-a691-9fa6ab4cd073'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:58.092422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6167402a-d9a1-4e16-a691-9fa6ab4cd073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00b8ea4beba1443888c4b66bbf29dd10', 'request_id': 'req-6167402a-d9a1-4e16-a691-9fa6ab4cd073'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:58.108691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6167402a-d9a1-4e16-a691-9fa6ab4cd073 admin admin] The token cache is being invalidate because project 00b8ea4beba1443888c4b66bbf29dd10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:49:58.108989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6167402a-d9a1-4e16-a691-9fa6ab4cd073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:58.109737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6167402a-d9a1-4e16-a691-9fa6ab4cd073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:49:58.124964 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4138/8361] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:49:57 2022] DELETE /identity/v3/projects/00b8ea4beba1443888c4b66bbf29dd10 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:50:05.006820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48473e57-1ec1-4b09-bbbf-6b3e86c67fb9 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:05.008427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-48473e57-1ec1-4b09-bbbf-6b3e86c67fb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:05.174857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48473e57-1ec1-4b09-bbbf-6b3e86c67fb9 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:05.232574 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:50:05.312872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c4cd4-7963-463a-b62b-f7e2dcc27ab3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:05.313609 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c4cd4-7963-463a-b62b-f7e2dcc27ab3 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:05.314491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c4cd4-7963-463a-b62b-f7e2dcc27ab3 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:05.314912 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c4cd4-7963-463a-b62b-f7e2dcc27ab3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:05.319860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b00c4cd4-7963-463a-b62b-f7e2dcc27ab3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:05.343356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c4cd4-7963-463a-b62b-f7e2dcc27ab3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:05.346029 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c4cd4-7963-463a-b62b-f7e2dcc27ab3 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:05.388401 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4224/8362] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:50:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:50:05.914247 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167402a-d9a1-4e16-a691-9fa6ab4cd073 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:05.916426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6167402a-d9a1-4e16-a691-9fa6ab4cd073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:06.100732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167402a-d9a1-4e16-a691-9fa6ab4cd073 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:06.106083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b377b-0d70-4bab-af5e-9f58fda00aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:06.106887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b377b-0d70-4bab-af5e-9f58fda00aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:06.107335 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b377b-0d70-4bab-af5e-9f58fda00aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:06.107608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b377b-0d70-4bab-af5e-9f58fda00aa7 admin admin] PATH_INFO: `/v3/users/aa475ec9a7ff4bc999bc83c53eb1f5eb` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:06.108787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b377b-0d70-4bab-af5e-9f58fda00aa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa475ec9a7ff4bc999bc83c53eb1f5eb)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:06.110721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b377b-0d70-4bab-af5e-9f58fda00aa7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:06.193472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1a8b377b-0d70-4bab-af5e-9f58fda00aa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa475ec9a7ff4bc999bc83c53eb1f5eb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:06.226305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1a8b377b-0d70-4bab-af5e-9f58fda00aa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa475ec9a7ff4bc999bc83c53eb1f5eb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:06.228330 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:50:06.253505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1a8b377b-0d70-4bab-af5e-9f58fda00aa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa475ec9a7ff4bc999bc83c53eb1f5eb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:06.255738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1a8b377b-0d70-4bab-af5e-9f58fda00aa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa475ec9a7ff4bc999bc83c53eb1f5eb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:06.268929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1a8b377b-0d70-4bab-af5e-9f58fda00aa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa475ec9a7ff4bc999bc83c53eb1f5eb'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:06.288380 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4139/8363] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:50:05 2022] DELETE /identity/v3/users/aa475ec9a7ff4bc999bc83c53eb1f5eb => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:50:06.568722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c4cd4-7963-463a-b62b-f7e2dcc27ab3 service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:06.592082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c4cd4-7963-463a-b62b-f7e2dcc27ab3 service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:06.677644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b196c30-d78a-41ba-a179-bfc2f6b490cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:06.678740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b196c30-d78a-41ba-a179-bfc2f6b490cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:06.679021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b196c30-d78a-41ba-a179-bfc2f6b490cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:06.679291 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b196c30-d78a-41ba-a179-bfc2f6b490cd admin admin] PATH_INFO: `/v3/projects/1a9db9d793594df2aa9c2658abad18c3` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:06.680923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b196c30-d78a-41ba-a179-bfc2f6b490cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a9db9d793594df2aa9c2658abad18c3)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:06.684289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b196c30-d78a-41ba-a179-bfc2f6b490cd admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:06.764478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8b196c30-d78a-41ba-a179-bfc2f6b490cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a9db9d793594df2aa9c2658abad18c3', 'request_id': 'req-8b196c30-d78a-41ba-a179-bfc2f6b490cd'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:06.771751 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8b196c30-d78a-41ba-a179-bfc2f6b490cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a9db9d793594df2aa9c2658abad18c3', 'request_id': 'req-8b196c30-d78a-41ba-a179-bfc2f6b490cd'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:06.780184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8b196c30-d78a-41ba-a179-bfc2f6b490cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a9db9d793594df2aa9c2658abad18c3', 'request_id': 'req-8b196c30-d78a-41ba-a179-bfc2f6b490cd'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:06.803554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8b196c30-d78a-41ba-a179-bfc2f6b490cd admin admin] The token cache is being invalidate because project 1a9db9d793594df2aa9c2658abad18c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:50:06.804046 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8b196c30-d78a-41ba-a179-bfc2f6b490cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:06.805103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8b196c30-d78a-41ba-a179-bfc2f6b490cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:06.807220 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4225/8364] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:50:06 2022] DELETE /identity/v3/projects/1a9db9d793594df2aa9c2658abad18c3 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:50:06.811225 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b377b-0d70-4bab-af5e-9f58fda00aa7 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:06.812916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1a8b377b-0d70-4bab-af5e-9f58fda00aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:06.833124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b377b-0d70-4bab-af5e-9f58fda00aa7 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:06.943449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9a9405-8218-402e-a015-e952b9944b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:06.945510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a9405-8218-402e-a015-e952b9944b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:06.946180 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a9405-8218-402e-a015-e952b9944b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:06.946881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a9405-8218-402e-a015-e952b9944b9e admin admin] PATH_INFO: `/v3/users/ded2ee9c08524abda640d5fa451a178e` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:06.948270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a9405-8218-402e-a015-e952b9944b9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ded2ee9c08524abda640d5fa451a178e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:06.951032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9a9405-8218-402e-a015-e952b9944b9e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:07.021913 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4e9a9405-8218-402e-a015-e952b9944b9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ded2ee9c08524abda640d5fa451a178e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:07.035269 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4e9a9405-8218-402e-a015-e952b9944b9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ded2ee9c08524abda640d5fa451a178e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:07.053142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4e9a9405-8218-402e-a015-e952b9944b9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ded2ee9c08524abda640d5fa451a178e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:07.053945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4e9a9405-8218-402e-a015-e952b9944b9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ded2ee9c08524abda640d5fa451a178e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:07.066859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-4e9a9405-8218-402e-a015-e952b9944b9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ded2ee9c08524abda640d5fa451a178e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:07.077984 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4140/8365] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:50:06 2022] DELETE /identity/v3/users/ded2ee9c08524abda640d5fa451a178e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:50:07.394198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b196c30-d78a-41ba-a179-bfc2f6b490cd admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:07.395693 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8b196c30-d78a-41ba-a179-bfc2f6b490cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:07.423264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b196c30-d78a-41ba-a179-bfc2f6b490cd admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:07.509738 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:50:07.524628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4940a00-c156-4feb-b0bb-d5bc2aebf070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:07.524628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4940a00-c156-4feb-b0bb-d5bc2aebf070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:07.525880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4940a00-c156-4feb-b0bb-d5bc2aebf070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:07.526262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4940a00-c156-4feb-b0bb-d5bc2aebf070 admin admin] PATH_INFO: `/v3/projects/906b7ffb92b84af48b60ec941a58cf1a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:07.527676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4940a00-c156-4feb-b0bb-d5bc2aebf070 admin admin] RBAC: Authorizing `identity:delete_project(project_id=906b7ffb92b84af48b60ec941a58cf1a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:07.529793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4940a00-c156-4feb-b0bb-d5bc2aebf070 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:07.601788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b4940a00-c156-4feb-b0bb-d5bc2aebf070 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '906b7ffb92b84af48b60ec941a58cf1a', 'request_id': 'req-b4940a00-c156-4feb-b0bb-d5bc2aebf070'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:07.619024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b4940a00-c156-4feb-b0bb-d5bc2aebf070 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '906b7ffb92b84af48b60ec941a58cf1a', 'request_id': 'req-b4940a00-c156-4feb-b0bb-d5bc2aebf070'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:07.619024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b4940a00-c156-4feb-b0bb-d5bc2aebf070 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '906b7ffb92b84af48b60ec941a58cf1a', 'request_id': 'req-b4940a00-c156-4feb-b0bb-d5bc2aebf070'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:07.640611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b4940a00-c156-4feb-b0bb-d5bc2aebf070 admin admin] The token cache is being invalidate because project 906b7ffb92b84af48b60ec941a58cf1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:50:07.640986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b4940a00-c156-4feb-b0bb-d5bc2aebf070 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:07.641701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b4940a00-c156-4feb-b0bb-d5bc2aebf070 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:07.646779 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4226/8366] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:50:07 2022] DELETE /identity/v3/projects/906b7ffb92b84af48b60ec941a58cf1a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:50:07.648531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cff365-8c2d-4956-95c1-20d2ffb6b861 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:07.648882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cff365-8c2d-4956-95c1-20d2ffb6b861 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:07.649238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cff365-8c2d-4956-95c1-20d2ffb6b861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:07.679791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b6cff365-8c2d-4956-95c1-20d2ffb6b861 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:50:07.679791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b6cff365-8c2d-4956-95c1-20d2ffb6b861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:07.773572 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:50:07.804791 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4141/8367] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:50:07.899918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19d052-e798-42a6-8df9-08f1dec25e6f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:07.900214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19d052-e798-42a6-8df9-08f1dec25e6f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:07.900497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19d052-e798-42a6-8df9-08f1dec25e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:07.929882 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5f19d052-e798-42a6-8df9-08f1dec25e6f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:50:07.932332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5f19d052-e798-42a6-8df9-08f1dec25e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:07.948174 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4227/8368] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:50:07.948912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cff365-8c2d-4956-95c1-20d2ffb6b861 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:07.960359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cff365-8c2d-4956-95c1-20d2ffb6b861 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:07.976085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf1feb-b185-4142-867a-6e121ce26a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:07.983810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf1feb-b185-4142-867a-6e121ce26a0c admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:07.984133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf1feb-b185-4142-867a-6e121ce26a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:07.984409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf1feb-b185-4142-867a-6e121ce26a0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:07.985109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cf1feb-b185-4142-867a-6e121ce26a0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:50:07.985415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cf1feb-b185-4142-867a-6e121ce26a0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:07.987056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cf1feb-b185-4142-867a-6e121ce26a0c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:08.002900 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4142/8369] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:50:08.007152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19d052-e798-42a6-8df9-08f1dec25e6f None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:08.017722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19d052-e798-42a6-8df9-08f1dec25e6f None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:08.023160 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14aee0-966b-4364-b209-d1342d632015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:08.024489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14aee0-966b-4364-b209-d1342d632015 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:08.035008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14aee0-966b-4364-b209-d1342d632015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:08.035447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14aee0-966b-4364-b209-d1342d632015 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:08.036810 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14aee0-966b-4364-b209-d1342d632015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:08.039933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14aee0-966b-4364-b209-d1342d632015 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:08.089794 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4228/8370] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:50:08 2022] POST /identity/v3/projects => generated 375 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:50:08.092839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf1feb-b185-4142-867a-6e121ce26a0c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:08.110113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf1feb-b185-4142-867a-6e121ce26a0c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:08.202287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85363a-9975-4f6c-9207-ecb44e664c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:08.205765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85363a-9975-4f6c-9207-ecb44e664c76 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:08.206085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85363a-9975-4f6c-9207-ecb44e664c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:08.207437 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85363a-9975-4f6c-9207-ecb44e664c76 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:08.211014 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85363a-9975-4f6c-9207-ecb44e664c76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:08.214266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85363a-9975-4f6c-9207-ecb44e664c76 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:08.242373 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4143/8371] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:50:08 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:50:08.246669 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14aee0-966b-4364-b209-d1342d632015 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:08.260013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14aee0-966b-4364-b209-d1342d632015 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:08.265190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84841f-3dc2-4adc-88b1-e81bbd440182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:08.265894 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84841f-3dc2-4adc-88b1-e81bbd440182 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:08.266250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84841f-3dc2-4adc-88b1-e81bbd440182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:08.266585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84841f-3dc2-4adc-88b1-e81bbd440182 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:08.267310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b84841f-3dc2-4adc-88b1-e81bbd440182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:08.270775 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b84841f-3dc2-4adc-88b1-e81bbd440182 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:08.292576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85363a-9975-4f6c-9207-ecb44e664c76 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:08.293531 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4229/8372] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:50:08.316832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85363a-9975-4f6c-9207-ecb44e664c76 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:08.324592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6dc17-3663-4275-ba67-0de3f6155fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:08.326011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6dc17-3663-4275-ba67-0de3f6155fbe admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:08.326839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6dc17-3663-4275-ba67-0de3f6155fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:08.327273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6dc17-3663-4275-ba67-0de3f6155fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:08.328470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6dc17-3663-4275-ba67-0de3f6155fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:08.330671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6dc17-3663-4275-ba67-0de3f6155fbe admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:08.410224 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4144/8373] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:50:08.417348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84841f-3dc2-4adc-88b1-e81bbd440182 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:08.429947 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84841f-3dc2-4adc-88b1-e81bbd440182 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:08.434868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b0523-d1a0-47e5-a56c-5e7318539a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:08.435546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b0523-d1a0-47e5-a56c-5e7318539a2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:08.435842 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b0523-d1a0-47e5-a56c-5e7318539a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:08.436244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b0523-d1a0-47e5-a56c-5e7318539a2b admin admin] PATH_INFO: `/v3/projects/690a291e09364d959f63dbfdb6b9abee/users/42b7b03044284a51a8183ef1ffe917a2/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:08.461346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b0523-d1a0-47e5-a56c-5e7318539a2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=690a291e09364d959f63dbfdb6b9abee, user_id=42b7b03044284a51a8183ef1ffe917a2, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:08.464067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b0523-d1a0-47e5-a56c-5e7318539a2b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:08.492004 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4230/8374] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:50:08 2022] PUT /identity/v3/projects/690a291e09364d959f63dbfdb6b9abee/users/42b7b03044284a51a8183ef1ffe917a2/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:50:08.495597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437fefd-4382-4c53-afd5-734bc3236aa1 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:08.495922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437fefd-4382-4c53-afd5-734bc3236aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:08.505643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437fefd-4382-4c53-afd5-734bc3236aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:08.542001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-f437fefd-4382-4c53-afd5-734bc3236aa1 None None] MFA Rules not processed for user `42b7b03044284a51a8183ef1ffe917a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:50:08.543357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f437fefd-4382-4c53-afd5-734bc3236aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:08.663051 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4145/8375] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:50:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:50:08.667787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b0523-d1a0-47e5-a56c-5e7318539a2b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:08.745059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b0523-d1a0-47e5-a56c-5e7318539a2b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:08.749981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96a256-ae2d-47ed-8c09-119a5cd67c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:08.750615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96a256-ae2d-47ed-8c09-119a5cd67c2e admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:08.750884 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96a256-ae2d-47ed-8c09-119a5cd67c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:08.751148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96a256-ae2d-47ed-8c09-119a5cd67c2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:08.751764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96a256-ae2d-47ed-8c09-119a5cd67c2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:08.753707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96a256-ae2d-47ed-8c09-119a5cd67c2e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:08.793163 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4231/8376] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:50:08 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:50:08.794423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437fefd-4382-4c53-afd5-734bc3236aa1 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:08.809468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437fefd-4382-4c53-afd5-734bc3236aa1 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:08.859096 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:50:08.881312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5054b-ce12-4795-9567-70c720392adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:08.881930 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5054b-ce12-4795-9567-70c720392adf admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:08.882207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5054b-ce12-4795-9567-70c720392adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:08.882476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5054b-ce12-4795-9567-70c720392adf admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:08.883103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5054b-ce12-4795-9567-70c720392adf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:08.885220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5054b-ce12-4795-9567-70c720392adf admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:08.920091 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4146/8377] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:50:08 2022] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:50:08.924299 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96a256-ae2d-47ed-8c09-119a5cd67c2e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:08.941423 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96a256-ae2d-47ed-8c09-119a5cd67c2e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:08.948262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234af5e6-0e2f-42b7-9519-bf181359c8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:08.949040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234af5e6-0e2f-42b7-9519-bf181359c8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:08.949348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234af5e6-0e2f-42b7-9519-bf181359c8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:08.949641 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234af5e6-0e2f-42b7-9519-bf181359c8d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:08.950302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234af5e6-0e2f-42b7-9519-bf181359c8d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:08.952029 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234af5e6-0e2f-42b7-9519-bf181359c8d8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:08.955056 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:50:08.991978 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4232/8378] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:50:08.992962 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5054b-ce12-4795-9567-70c720392adf admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:09.009056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5054b-ce12-4795-9567-70c720392adf admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:09.016690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e2db7-93ed-406e-a3c1-de80506707df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:09.017309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e2db7-93ed-406e-a3c1-de80506707df admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:09.017728 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e2db7-93ed-406e-a3c1-de80506707df admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:09.018102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e2db7-93ed-406e-a3c1-de80506707df admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:09.018669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e2db7-93ed-406e-a3c1-de80506707df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:09.020358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e2db7-93ed-406e-a3c1-de80506707df admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:09.036562 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4147/8379] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:50:09.040853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234af5e6-0e2f-42b7-9519-bf181359c8d8 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:09.053463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234af5e6-0e2f-42b7-9519-bf181359c8d8 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:09.059997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7194ab3-320c-4419-8666-aa121de8b702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:09.061349 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7194ab3-320c-4419-8666-aa121de8b702 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:09.061675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7194ab3-320c-4419-8666-aa121de8b702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:09.062029 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7194ab3-320c-4419-8666-aa121de8b702 admin admin] PATH_INFO: `/v3/projects/8d77e869c475406f8ba3906efe957164/users/69105323a38041de98f4702c2e63c6a9/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:09.080024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7194ab3-320c-4419-8666-aa121de8b702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d77e869c475406f8ba3906efe957164, user_id=69105323a38041de98f4702c2e63c6a9, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:09.084230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7194ab3-320c-4419-8666-aa121de8b702 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:09.112422 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4233/8380] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:50:09 2022] PUT /identity/v3/projects/8d77e869c475406f8ba3906efe957164/users/69105323a38041de98f4702c2e63c6a9/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:50:09.120424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028df60-24e8-46da-83d7-6954a1d55d4a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:09.120709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028df60-24e8-46da-83d7-6954a1d55d4a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:09.120984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028df60-24e8-46da-83d7-6954a1d55d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:09.155544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-8028df60-24e8-46da-83d7-6954a1d55d4a None None] MFA Rules not processed for user `69105323a38041de98f4702c2e63c6a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:50:09.156804 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8028df60-24e8-46da-83d7-6954a1d55d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:09.244379 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4148/8381] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:50:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:50:09.246261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7194ab3-320c-4419-8666-aa121de8b702 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:09.344452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7194ab3-320c-4419-8666-aa121de8b702 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:09.350586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd598a3c-0728-462c-b011-65c2de06c91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:09.351280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd598a3c-0728-462c-b011-65c2de06c91b admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:09.351623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd598a3c-0728-462c-b011-65c2de06c91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:09.351987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd598a3c-0728-462c-b011-65c2de06c91b admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:09.354849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd598a3c-0728-462c-b011-65c2de06c91b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:09.356381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd598a3c-0728-462c-b011-65c2de06c91b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:09.398605 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4234/8382] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:50:09 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:50:09.400272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028df60-24e8-46da-83d7-6954a1d55d4a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:09.415950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028df60-24e8-46da-83d7-6954a1d55d4a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:09.537259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd3afe-214b-4874-a8cc-a77af81150e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:09.537993 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd3afe-214b-4874-a8cc-a77af81150e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:09.538351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd3afe-214b-4874-a8cc-a77af81150e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:09.538698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd3afe-214b-4874-a8cc-a77af81150e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:09.539423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd3afe-214b-4874-a8cc-a77af81150e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:09.541497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd3afe-214b-4874-a8cc-a77af81150e1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:09.571630 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4149/8383] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:50:09 2022] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:50:09.575547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd598a3c-0728-462c-b011-65c2de06c91b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:09.588145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd598a3c-0728-462c-b011-65c2de06c91b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:09.593384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7401e-c9ee-4958-b9c4-4748b0a08625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:09.594118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7401e-c9ee-4958-b9c4-4748b0a08625 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:09.594528 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7401e-c9ee-4958-b9c4-4748b0a08625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:09.594874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7401e-c9ee-4958-b9c4-4748b0a08625 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:09.595596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7401e-c9ee-4958-b9c4-4748b0a08625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:09.597456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7401e-c9ee-4958-b9c4-4748b0a08625 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:09.609484 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4235/8384] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:50:09.613928 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd3afe-214b-4874-a8cc-a77af81150e1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:09.719904 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd3afe-214b-4874-a8cc-a77af81150e1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:09.729442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d6b43-cd55-40dd-bd11-1a9b29ea9beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:09.730617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d6b43-cd55-40dd-bd11-1a9b29ea9beb admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:09.730964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d6b43-cd55-40dd-bd11-1a9b29ea9beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:09.731819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d6b43-cd55-40dd-bd11-1a9b29ea9beb admin admin] PATH_INFO: `/v3/projects/6db603a8313c4c899c415204272cd56a/users/a3210f49d04642a88a22ea9f2e310bf4/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:09.780490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d6b43-cd55-40dd-bd11-1a9b29ea9beb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6db603a8313c4c899c415204272cd56a, user_id=a3210f49d04642a88a22ea9f2e310bf4, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:09.783532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d6b43-cd55-40dd-bd11-1a9b29ea9beb admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:09.809668 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4150/8385] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:50:09 2022] PUT /identity/v3/projects/6db603a8313c4c899c415204272cd56a/users/a3210f49d04642a88a22ea9f2e310bf4/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:50:09.813665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7401e-c9ee-4958-b9c4-4748b0a08625 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:09.826700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7401e-c9ee-4958-b9c4-4748b0a08625 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:09.900919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1d5ad-40ea-4cc2-9e10-8c42e88226e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:09.901530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1d5ad-40ea-4cc2-9e10-8c42e88226e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:09.901803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1d5ad-40ea-4cc2-9e10-8c42e88226e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:09.902074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1d5ad-40ea-4cc2-9e10-8c42e88226e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:09.902712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1d5ad-40ea-4cc2-9e10-8c42e88226e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:09.905013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1d5ad-40ea-4cc2-9e10-8c42e88226e4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:09.918947 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4236/8386] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:50:09.923134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d6b43-cd55-40dd-bd11-1a9b29ea9beb admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:09.942626 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d6b43-cd55-40dd-bd11-1a9b29ea9beb admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:09.953779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7564ecb-ccc8-4a35-8298-7f1fe4f53246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:09.954952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7564ecb-ccc8-4a35-8298-7f1fe4f53246 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:09.955367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7564ecb-ccc8-4a35-8298-7f1fe4f53246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:09.955737 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7564ecb-ccc8-4a35-8298-7f1fe4f53246 admin admin] PATH_INFO: `/v3/projects/6db603a8313c4c899c415204272cd56a/users/a3210f49d04642a88a22ea9f2e310bf4/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:09.959869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7564ecb-ccc8-4a35-8298-7f1fe4f53246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6db603a8313c4c899c415204272cd56a, user_id=a3210f49d04642a88a22ea9f2e310bf4, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:09.963362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7564ecb-ccc8-4a35-8298-7f1fe4f53246 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:09.987946 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4151/8387] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:50:09 2022] PUT /identity/v3/projects/6db603a8313c4c899c415204272cd56a/users/a3210f49d04642a88a22ea9f2e310bf4/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:50:09.993939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c483ef-0ea5-4b42-a202-fab071081066 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:09.994225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c483ef-0ea5-4b42-a202-fab071081066 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:09.994500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c483ef-0ea5-4b42-a202-fab071081066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:10.061142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-99c483ef-0ea5-4b42-a202-fab071081066 None None] MFA Rules not processed for user `a3210f49d04642a88a22ea9f2e310bf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:50:10.062021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-99c483ef-0ea5-4b42-a202-fab071081066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:10.118870 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:50:10.193020 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4237/8388] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:50:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:50:10.205462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7564ecb-ccc8-4a35-8298-7f1fe4f53246 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:10.207291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a7564ecb-ccc8-4a35-8298-7f1fe4f53246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:10.219260 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:50:10.295570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7564ecb-ccc8-4a35-8298-7f1fe4f53246 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:10.305874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd7703-84e9-45dd-b26f-cd21d7fe7009 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:10.306979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd7703-84e9-45dd-b26f-cd21d7fe7009 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:10.307490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd7703-84e9-45dd-b26f-cd21d7fe7009 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:10.308033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd7703-84e9-45dd-b26f-cd21d7fe7009 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:10.395617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd7703-84e9-45dd-b26f-cd21d7fe7009 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:10.398073 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd7703-84e9-45dd-b26f-cd21d7fe7009 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:10.425762 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4152/8389] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:50:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:50:13.294800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c483ef-0ea5-4b42-a202-fab071081066 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:13.296407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-99c483ef-0ea5-4b42-a202-fab071081066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:13.314275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c483ef-0ea5-4b42-a202-fab071081066 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:13.318495 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca9b5a-6093-4ff1-8ed7-ecffc5ad01e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:13.319246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca9b5a-6093-4ff1-8ed7-ecffc5ad01e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:13.319583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca9b5a-6093-4ff1-8ed7-ecffc5ad01e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:13.320102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca9b5a-6093-4ff1-8ed7-ecffc5ad01e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:13.442274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca9b5a-6093-4ff1-8ed7-ecffc5ad01e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:13.448924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca9b5a-6093-4ff1-8ed7-ecffc5ad01e7 service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:13.463655 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4238/8390] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:50:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:50:14.276368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd7703-84e9-45dd-b26f-cd21d7fe7009 service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:14.293331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd7703-84e9-45dd-b26f-cd21d7fe7009 service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:14.297769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b19b4-ae3f-41e7-97a8-ecec23b41b07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:14.298393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b19b4-ae3f-41e7-97a8-ecec23b41b07 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:14.298672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b19b4-ae3f-41e7-97a8-ecec23b41b07 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:14.298951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b19b4-ae3f-41e7-97a8-ecec23b41b07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:14.317103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b19b4-ae3f-41e7-97a8-ecec23b41b07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:14.318808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b19b4-ae3f-41e7-97a8-ecec23b41b07 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:14.338844 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4153/8391] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:50:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:50:14.489243 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca9b5a-6093-4ff1-8ed7-ecffc5ad01e7 service cinder] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:14.501449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-caca9b5a-6093-4ff1-8ed7-ecffc5ad01e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:14.632313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca9b5a-6093-4ff1-8ed7-ecffc5ad01e7 service cinder] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:14.639411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b6307-ee9e-4971-bf9b-f79342dee2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:14.640496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b6307-ee9e-4971-bf9b-f79342dee2c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:14.641056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b6307-ee9e-4971-bf9b-f79342dee2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:14.641640 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b6307-ee9e-4971-bf9b-f79342dee2c1 admin admin] PATH_INFO: `/v3/users/0cf674104cde4c8584045e030716af9b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:14.645228 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b6307-ee9e-4971-bf9b-f79342dee2c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cf674104cde4c8584045e030716af9b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:14.648896 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b6307-ee9e-4971-bf9b-f79342dee2c1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:14.757323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4b3b6307-ee9e-4971-bf9b-f79342dee2c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cf674104cde4c8584045e030716af9b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:14.773756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4b3b6307-ee9e-4971-bf9b-f79342dee2c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cf674104cde4c8584045e030716af9b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:14.790444 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:50:14.800793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4b3b6307-ee9e-4971-bf9b-f79342dee2c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cf674104cde4c8584045e030716af9b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:14.803039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4b3b6307-ee9e-4971-bf9b-f79342dee2c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cf674104cde4c8584045e030716af9b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:14.815145 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-4b3b6307-ee9e-4971-bf9b-f79342dee2c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cf674104cde4c8584045e030716af9b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:14.827514 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4239/8392] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:50:14 2022] DELETE /identity/v3/users/0cf674104cde4c8584045e030716af9b => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:50:14.832342 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa4cc5-c487-4220-83ef-ca638789a11e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:14.833097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa4cc5-c487-4220-83ef-ca638789a11e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:14.833925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa4cc5-c487-4220-83ef-ca638789a11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:14.937298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-f1fa4cc5-c487-4220-83ef-ca638789a11e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:50:14.939813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f1fa4cc5-c487-4220-83ef-ca638789a11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:15.132182 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4154/8393] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:50:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:50:15.140084 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b6307-ee9e-4971-bf9b-f79342dee2c1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:15.141547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4b3b6307-ee9e-4971-bf9b-f79342dee2c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:15.304538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b6307-ee9e-4971-bf9b-f79342dee2c1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:15.316411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1cbde3-3f37-4925-9754-368a3c65d47d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:15.317467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cbde3-3f37-4925-9754-368a3c65d47d service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:15.317751 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cbde3-3f37-4925-9754-368a3c65d47d service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:15.318028 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cbde3-3f37-4925-9754-368a3c65d47d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:15.339283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1cbde3-3f37-4925-9754-368a3c65d47d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:15.348619 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1cbde3-3f37-4925-9754-368a3c65d47d service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:15.371604 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4240/8394] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:50:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:50:15.741514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa4cc5-c487-4220-83ef-ca638789a11e None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:15.744488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f1fa4cc5-c487-4220-83ef-ca638789a11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:15.809816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa4cc5-c487-4220-83ef-ca638789a11e None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:15.825935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f6a23-cfec-4203-b253-d87031ee018c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:15.826601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f6a23-cfec-4203-b253-d87031ee018c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:15.826882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f6a23-cfec-4203-b253-d87031ee018c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:15.827164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f6a23-cfec-4203-b253-d87031ee018c admin admin] PATH_INFO: `/v3/projects/f786741ee3614e0b944ecf0c4dc5d609` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:15.833242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f6a23-cfec-4203-b253-d87031ee018c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f786741ee3614e0b944ecf0c4dc5d609)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:15.839024 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f6a23-cfec-4203-b253-d87031ee018c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:15.954360 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:50:15.958520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-298f6a23-cfec-4203-b253-d87031ee018c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f786741ee3614e0b944ecf0c4dc5d609', 'request_id': 'req-298f6a23-cfec-4203-b253-d87031ee018c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:15.967786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-298f6a23-cfec-4203-b253-d87031ee018c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f786741ee3614e0b944ecf0c4dc5d609', 'request_id': 'req-298f6a23-cfec-4203-b253-d87031ee018c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:15.975198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-298f6a23-cfec-4203-b253-d87031ee018c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f786741ee3614e0b944ecf0c4dc5d609', 'request_id': 'req-298f6a23-cfec-4203-b253-d87031ee018c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:15.994420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-298f6a23-cfec-4203-b253-d87031ee018c admin admin] The token cache is being invalidate because project f786741ee3614e0b944ecf0c4dc5d609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:50:15.994717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-298f6a23-cfec-4203-b253-d87031ee018c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:15.995422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-298f6a23-cfec-4203-b253-d87031ee018c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:15.997143 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4155/8395] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:50:15 2022] DELETE /identity/v3/projects/f786741ee3614e0b944ecf0c4dc5d609 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:50:16.002650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e2934-ef40-4cde-9295-2c94ae9dcc7f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:16.003153 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e2934-ef40-4cde-9295-2c94ae9dcc7f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:16.003292 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e2934-ef40-4cde-9295-2c94ae9dcc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:16.042787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0e4e2934-ef40-4cde-9295-2c94ae9dcc7f None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:50:16.045639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0e4e2934-ef40-4cde-9295-2c94ae9dcc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:16.149487 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4241/8396] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:50:16.150525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13e663-8734-4e42-9e6c-8c6b6f5e9a36 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:16.150525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13e663-8734-4e42-9e6c-8c6b6f5e9a36 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:16.150751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13e663-8734-4e42-9e6c-8c6b6f5e9a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:16.193044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-bd13e663-8734-4e42-9e6c-8c6b6f5e9a36 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:50:16.194278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bd13e663-8734-4e42-9e6c-8c6b6f5e9a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:16.213080 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4156/8397] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:50:16.217728 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e2934-ef40-4cde-9295-2c94ae9dcc7f None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:16.229945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e2934-ef40-4cde-9295-2c94ae9dcc7f None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:16.236901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c11c5-c390-4dc9-b97a-d1890d54dc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:16.237529 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c11c5-c390-4dc9-b97a-d1890d54dc19 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:16.237808 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c11c5-c390-4dc9-b97a-d1890d54dc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:16.238377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c11c5-c390-4dc9-b97a-d1890d54dc19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:16.239050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c11c5-c390-4dc9-b97a-d1890d54dc19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:50:16.239600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c11c5-c390-4dc9-b97a-d1890d54dc19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:16.241614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c11c5-c390-4dc9-b97a-d1890d54dc19 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:16.270378 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13e663-8734-4e42-9e6c-8c6b6f5e9a36 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:16.292256 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4242/8398] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:50:16.303215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13e663-8734-4e42-9e6c-8c6b6f5e9a36 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:16.309212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2fe0e-dd66-4076-9351-adf6356260b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:16.310246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2fe0e-dd66-4076-9351-adf6356260b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:16.310691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2fe0e-dd66-4076-9351-adf6356260b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:16.311352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2fe0e-dd66-4076-9351-adf6356260b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:16.312556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2fe0e-dd66-4076-9351-adf6356260b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:16.314708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2fe0e-dd66-4076-9351-adf6356260b7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:16.381607 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4157/8399] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:50:16 2022] POST /identity/v3/projects => generated 397 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:50:16.383188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c11c5-c390-4dc9-b97a-d1890d54dc19 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:16.403058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c11c5-c390-4dc9-b97a-d1890d54dc19 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:16.524405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1c65c-5953-4998-8b29-735d15ef084d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:16.526677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1c65c-5953-4998-8b29-735d15ef084d admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:16.526994 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1c65c-5953-4998-8b29-735d15ef084d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:16.527495 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1c65c-5953-4998-8b29-735d15ef084d admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:16.528214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1c65c-5953-4998-8b29-735d15ef084d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:16.532228 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1c65c-5953-4998-8b29-735d15ef084d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:16.579292 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4243/8400] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:50:16 2022] POST /identity/v3/users => generated 299 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:50:16.586144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2fe0e-dd66-4076-9351-adf6356260b7 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:16.618932 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2fe0e-dd66-4076-9351-adf6356260b7 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:16.641419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5b871-784d-4847-afa5-21c784cf29da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:16.649178 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5b871-784d-4847-afa5-21c784cf29da admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:16.649178 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5b871-784d-4847-afa5-21c784cf29da admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:16.649178 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5b871-784d-4847-afa5-21c784cf29da admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:16.649178 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5b871-784d-4847-afa5-21c784cf29da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:16.650525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5b871-784d-4847-afa5-21c784cf29da admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:16.680542 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4158/8401] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:50:16.684325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1c65c-5953-4998-8b29-735d15ef084d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:16.690806 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:50:16.703953 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1c65c-5953-4998-8b29-735d15ef084d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:16.713415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f435d5-aa21-4d35-92a8-0674a3bd4b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:16.714433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f435d5-aa21-4d35-92a8-0674a3bd4b20 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:16.715955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f435d5-aa21-4d35-92a8-0674a3bd4b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:16.716479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f435d5-aa21-4d35-92a8-0674a3bd4b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:16.717475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f435d5-aa21-4d35-92a8-0674a3bd4b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:16.719316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f435d5-aa21-4d35-92a8-0674a3bd4b20 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:16.743220 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4244/8402] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:50:16.747534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5b871-784d-4847-afa5-21c784cf29da admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:16.762621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5b871-784d-4847-afa5-21c784cf29da admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:16.781494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d58ce3-51b9-479a-89cb-c1b0267aa75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:16.782513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d58ce3-51b9-479a-89cb-c1b0267aa75e admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:16.783665 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d58ce3-51b9-479a-89cb-c1b0267aa75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:16.784205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d58ce3-51b9-479a-89cb-c1b0267aa75e admin admin] PATH_INFO: `/v3/projects/c3fe05bbc8424c18831f36e2ed9e6052/users/99c72c5a23094569b7efbb446f2d5d1b/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:16.824125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d58ce3-51b9-479a-89cb-c1b0267aa75e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3fe05bbc8424c18831f36e2ed9e6052, user_id=99c72c5a23094569b7efbb446f2d5d1b, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:16.830445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d58ce3-51b9-479a-89cb-c1b0267aa75e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:16.873345 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4159/8403] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:50:16 2022] PUT /identity/v3/projects/c3fe05bbc8424c18831f36e2ed9e6052/users/99c72c5a23094569b7efbb446f2d5d1b/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:50:16.984768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878160d2-b22e-40f6-b9ed-3bb115cfb5d9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:16.985057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878160d2-b22e-40f6-b9ed-3bb115cfb5d9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:16.985334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878160d2-b22e-40f6-b9ed-3bb115cfb5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:17.038865 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-878160d2-b22e-40f6-b9ed-3bb115cfb5d9 None None] MFA Rules not processed for user `99c72c5a23094569b7efbb446f2d5d1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:50:17.040171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-878160d2-b22e-40f6-b9ed-3bb115cfb5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:17.155923 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4245/8404] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:50:16 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:50:17.165140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d58ce3-51b9-479a-89cb-c1b0267aa75e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:17.167087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-19d58ce3-51b9-479a-89cb-c1b0267aa75e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:17.303961 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d58ce3-51b9-479a-89cb-c1b0267aa75e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:17.308232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46457a7b-2788-453b-bba0-c883c5826c42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:17.309897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46457a7b-2788-453b-bba0-c883c5826c42 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:17.310186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46457a7b-2788-453b-bba0-c883c5826c42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:17.310460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46457a7b-2788-453b-bba0-c883c5826c42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:17.321605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46457a7b-2788-453b-bba0-c883c5826c42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:17.323067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46457a7b-2788-453b-bba0-c883c5826c42 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:17.338905 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4160/8405] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:50:17 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:50:25.772613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878160d2-b22e-40f6-b9ed-3bb115cfb5d9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:25.774327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-878160d2-b22e-40f6-b9ed-3bb115cfb5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:25.938764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878160d2-b22e-40f6-b9ed-3bb115cfb5d9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:25.973496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8270d-0bd4-4677-9099-981a896ae31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:25.981527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8270d-0bd4-4677-9099-981a896ae31e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:25.981527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8270d-0bd4-4677-9099-981a896ae31e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:25.981527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8270d-0bd4-4677-9099-981a896ae31e admin admin] PATH_INFO: `/v3/users/42b7b03044284a51a8183ef1ffe917a2` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:25.989193 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8270d-0bd4-4677-9099-981a896ae31e admin admin] RBAC: Authorizing `identity:delete_user(user_id=42b7b03044284a51a8183ef1ffe917a2)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:25.990723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba8270d-0bd4-4677-9099-981a896ae31e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:26.145617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bba8270d-0bd4-4677-9099-981a896ae31e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42b7b03044284a51a8183ef1ffe917a2'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:26.168438 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bba8270d-0bd4-4677-9099-981a896ae31e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42b7b03044284a51a8183ef1ffe917a2'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:26.186670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bba8270d-0bd4-4677-9099-981a896ae31e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42b7b03044284a51a8183ef1ffe917a2'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:26.187740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bba8270d-0bd4-4677-9099-981a896ae31e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42b7b03044284a51a8183ef1ffe917a2'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:26.210153 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bba8270d-0bd4-4677-9099-981a896ae31e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42b7b03044284a51a8183ef1ffe917a2'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:26.221904 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4246/8406] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:50:25 2022] DELETE /identity/v3/users/42b7b03044284a51a8183ef1ffe917a2 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:50:26.226332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510382b-9086-415b-bc27-eaa98dd59b53 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:26.226900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510382b-9086-415b-bc27-eaa98dd59b53 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:26.227180 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510382b-9086-415b-bc27-eaa98dd59b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:26.251725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b510382b-9086-415b-bc27-eaa98dd59b53 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:50:26.253841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b510382b-9086-415b-bc27-eaa98dd59b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:26.368492 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4161/8407] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:50:26.379424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8270d-0bd4-4677-9099-981a896ae31e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:26.381108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-bba8270d-0bd4-4677-9099-981a896ae31e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:26.389466 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:50:26.506411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8270d-0bd4-4677-9099-981a896ae31e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:26.528465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb8bf0-6639-4bbc-9427-670dd44b1067 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:26.531258 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb8bf0-6639-4bbc-9427-670dd44b1067 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:26.531735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb8bf0-6639-4bbc-9427-670dd44b1067 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:26.532212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb8bf0-6639-4bbc-9427-670dd44b1067 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:26.556186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb8bf0-6639-4bbc-9427-670dd44b1067 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:26.557982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb8bf0-6639-4bbc-9427-670dd44b1067 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:26.595067 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4247/8408] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:50:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:50:27.058301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510382b-9086-415b-bc27-eaa98dd59b53 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:27.060114 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b510382b-9086-415b-bc27-eaa98dd59b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:27.087024 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510382b-9086-415b-bc27-eaa98dd59b53 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:27.101539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9d56d-654a-42f8-b2e6-5fa5aeb7a4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:27.102210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9d56d-654a-42f8-b2e6-5fa5aeb7a4c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:27.102490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9d56d-654a-42f8-b2e6-5fa5aeb7a4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:27.102765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9d56d-654a-42f8-b2e6-5fa5aeb7a4c1 admin admin] PATH_INFO: `/v3/projects/690a291e09364d959f63dbfdb6b9abee` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:27.109717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9d56d-654a-42f8-b2e6-5fa5aeb7a4c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=690a291e09364d959f63dbfdb6b9abee)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:27.111819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9d56d-654a-42f8-b2e6-5fa5aeb7a4c1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:27.126502 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:50:27.197593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7ff9d56d-654a-42f8-b2e6-5fa5aeb7a4c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '690a291e09364d959f63dbfdb6b9abee', 'request_id': 'req-7ff9d56d-654a-42f8-b2e6-5fa5aeb7a4c1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:27.208280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7ff9d56d-654a-42f8-b2e6-5fa5aeb7a4c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '690a291e09364d959f63dbfdb6b9abee', 'request_id': 'req-7ff9d56d-654a-42f8-b2e6-5fa5aeb7a4c1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:27.215545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7ff9d56d-654a-42f8-b2e6-5fa5aeb7a4c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '690a291e09364d959f63dbfdb6b9abee', 'request_id': 'req-7ff9d56d-654a-42f8-b2e6-5fa5aeb7a4c1'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:27.231657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7ff9d56d-654a-42f8-b2e6-5fa5aeb7a4c1 admin admin] The token cache is being invalidate because project 690a291e09364d959f63dbfdb6b9abee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:50:27.232291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7ff9d56d-654a-42f8-b2e6-5fa5aeb7a4c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:27.232716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7ff9d56d-654a-42f8-b2e6-5fa5aeb7a4c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:27.234687 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4162/8409] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:50:27 2022] DELETE /identity/v3/projects/690a291e09364d959f63dbfdb6b9abee => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:50:27.238665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb8bf0-6639-4bbc-9427-670dd44b1067 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:27.250884 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb8bf0-6639-4bbc-9427-670dd44b1067 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:27.432657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f6ae6-9d53-4b2a-9fad-512c0891ebd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:27.435517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f6ae6-9d53-4b2a-9fad-512c0891ebd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:27.436071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f6ae6-9d53-4b2a-9fad-512c0891ebd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:27.436569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f6ae6-9d53-4b2a-9fad-512c0891ebd1 admin admin] PATH_INFO: `/v3/users/69105323a38041de98f4702c2e63c6a9` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:27.439876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f6ae6-9d53-4b2a-9fad-512c0891ebd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69105323a38041de98f4702c2e63c6a9)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:27.442626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f6ae6-9d53-4b2a-9fad-512c0891ebd1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:27.520223 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-657f6ae6-9d53-4b2a-9fad-512c0891ebd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69105323a38041de98f4702c2e63c6a9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:27.529354 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-657f6ae6-9d53-4b2a-9fad-512c0891ebd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69105323a38041de98f4702c2e63c6a9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:27.546368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-657f6ae6-9d53-4b2a-9fad-512c0891ebd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69105323a38041de98f4702c2e63c6a9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:27.547157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-657f6ae6-9d53-4b2a-9fad-512c0891ebd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69105323a38041de98f4702c2e63c6a9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:27.559384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-657f6ae6-9d53-4b2a-9fad-512c0891ebd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69105323a38041de98f4702c2e63c6a9'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:27.568913 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4248/8410] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:50:27 2022] DELETE /identity/v3/users/69105323a38041de98f4702c2e63c6a9 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:50:28.044732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9d56d-654a-42f8-b2e6-5fa5aeb7a4c1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:28.046424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7ff9d56d-654a-42f8-b2e6-5fa5aeb7a4c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:28.066892 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9d56d-654a-42f8-b2e6-5fa5aeb7a4c1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:28.164469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccde73-a82e-48ad-995a-14e3cae6d12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:28.165296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccde73-a82e-48ad-995a-14e3cae6d12c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:28.165820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccde73-a82e-48ad-995a-14e3cae6d12c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:28.166239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccde73-a82e-48ad-995a-14e3cae6d12c admin admin] PATH_INFO: `/v3/projects/8d77e869c475406f8ba3906efe957164` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:28.167914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaccde73-a82e-48ad-995a-14e3cae6d12c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d77e869c475406f8ba3906efe957164)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:28.170556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaccde73-a82e-48ad-995a-14e3cae6d12c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:28.259006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-eaccde73-a82e-48ad-995a-14e3cae6d12c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d77e869c475406f8ba3906efe957164', 'request_id': 'req-eaccde73-a82e-48ad-995a-14e3cae6d12c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:28.273263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-eaccde73-a82e-48ad-995a-14e3cae6d12c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d77e869c475406f8ba3906efe957164', 'request_id': 'req-eaccde73-a82e-48ad-995a-14e3cae6d12c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:28.283494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-eaccde73-a82e-48ad-995a-14e3cae6d12c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d77e869c475406f8ba3906efe957164', 'request_id': 'req-eaccde73-a82e-48ad-995a-14e3cae6d12c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:28.311635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-eaccde73-a82e-48ad-995a-14e3cae6d12c admin admin] The token cache is being invalidate because project 8d77e869c475406f8ba3906efe957164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:50:28.312399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-eaccde73-a82e-48ad-995a-14e3cae6d12c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:28.313857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-eaccde73-a82e-48ad-995a-14e3cae6d12c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:28.321294 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4163/8411] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:50:28 2022] DELETE /identity/v3/projects/8d77e869c475406f8ba3906efe957164 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:50:28.325610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f6ae6-9d53-4b2a-9fad-512c0891ebd1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:28.327059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-657f6ae6-9d53-4b2a-9fad-512c0891ebd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:28.346596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f6ae6-9d53-4b2a-9fad-512c0891ebd1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:28.386702 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:50:28.450489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcd0dd-e1ab-4168-b9e7-d66e2b5ea780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:28.451402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcd0dd-e1ab-4168-b9e7-d66e2b5ea780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:28.451842 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcd0dd-e1ab-4168-b9e7-d66e2b5ea780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:28.452290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcd0dd-e1ab-4168-b9e7-d66e2b5ea780 admin admin] PATH_INFO: `/v3/users/a3210f49d04642a88a22ea9f2e310bf4` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:28.453655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcd0dd-e1ab-4168-b9e7-d66e2b5ea780 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3210f49d04642a88a22ea9f2e310bf4)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:28.455749 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcd0dd-e1ab-4168-b9e7-d66e2b5ea780 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:28.524481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-16dcd0dd-e1ab-4168-b9e7-d66e2b5ea780 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3210f49d04642a88a22ea9f2e310bf4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:28.533497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-16dcd0dd-e1ab-4168-b9e7-d66e2b5ea780 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3210f49d04642a88a22ea9f2e310bf4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:28.549082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-16dcd0dd-e1ab-4168-b9e7-d66e2b5ea780 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3210f49d04642a88a22ea9f2e310bf4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:28.550028 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-16dcd0dd-e1ab-4168-b9e7-d66e2b5ea780 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3210f49d04642a88a22ea9f2e310bf4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:28.570871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-16dcd0dd-e1ab-4168-b9e7-d66e2b5ea780 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3210f49d04642a88a22ea9f2e310bf4'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:28.582452 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4249/8412] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:50:28 2022] DELETE /identity/v3/users/a3210f49d04642a88a22ea9f2e310bf4 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:50:28.996630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccde73-a82e-48ad-995a-14e3cae6d12c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:28.998347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-eaccde73-a82e-48ad-995a-14e3cae6d12c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:29.019619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccde73-a82e-48ad-995a-14e3cae6d12c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:29.071220 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:50:29.118160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651edb19-0f92-4082-85ec-f64be7fd9578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:29.119391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651edb19-0f92-4082-85ec-f64be7fd9578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:29.120003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651edb19-0f92-4082-85ec-f64be7fd9578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:29.120592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651edb19-0f92-4082-85ec-f64be7fd9578 admin admin] PATH_INFO: `/v3/projects/6db603a8313c4c899c415204272cd56a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:29.122393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651edb19-0f92-4082-85ec-f64be7fd9578 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6db603a8313c4c899c415204272cd56a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:29.124932 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651edb19-0f92-4082-85ec-f64be7fd9578 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:29.186375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-651edb19-0f92-4082-85ec-f64be7fd9578 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6db603a8313c4c899c415204272cd56a', 'request_id': 'req-651edb19-0f92-4082-85ec-f64be7fd9578'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:29.194409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-651edb19-0f92-4082-85ec-f64be7fd9578 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6db603a8313c4c899c415204272cd56a', 'request_id': 'req-651edb19-0f92-4082-85ec-f64be7fd9578'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:29.202677 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-651edb19-0f92-4082-85ec-f64be7fd9578 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6db603a8313c4c899c415204272cd56a', 'request_id': 'req-651edb19-0f92-4082-85ec-f64be7fd9578'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:29.223740 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-651edb19-0f92-4082-85ec-f64be7fd9578 admin admin] The token cache is being invalidate because project 6db603a8313c4c899c415204272cd56a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:50:29.224366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-651edb19-0f92-4082-85ec-f64be7fd9578 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:29.225159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-651edb19-0f92-4082-85ec-f64be7fd9578 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:29.227156 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4164/8413] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:50:28 2022] DELETE /identity/v3/projects/6db603a8313c4c899c415204272cd56a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:50:29.232561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f889e8a-9746-4fda-9800-80cbdd12b1f7 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:29.233132 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f889e8a-9746-4fda-9800-80cbdd12b1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:29.233569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f889e8a-9746-4fda-9800-80cbdd12b1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:29.281587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-8f889e8a-9746-4fda-9800-80cbdd12b1f7 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:50:29.283020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8f889e8a-9746-4fda-9800-80cbdd12b1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:29.399948 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4250/8414] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:50:29.409314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3496f-18fa-43ec-9e7a-7f52bd7f5563 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:29.410104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3496f-18fa-43ec-9e7a-7f52bd7f5563 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:29.410718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3496f-18fa-43ec-9e7a-7f52bd7f5563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:29.439439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3ef3496f-18fa-43ec-9e7a-7f52bd7f5563 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:50:29.441355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3ef3496f-18fa-43ec-9e7a-7f52bd7f5563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:29.461234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f889e8a-9746-4fda-9800-80cbdd12b1f7 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:29.461644 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4165/8415] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:50:29.474695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f889e8a-9746-4fda-9800-80cbdd12b1f7 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:29.480644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b66f24-bdcb-47ff-90d8-4d81e7dbdcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:29.481289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b66f24-bdcb-47ff-90d8-4d81e7dbdcac admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:29.481736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b66f24-bdcb-47ff-90d8-4d81e7dbdcac admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:29.482012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b66f24-bdcb-47ff-90d8-4d81e7dbdcac admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:29.482700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b66f24-bdcb-47ff-90d8-4d81e7dbdcac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:50:29.482998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b66f24-bdcb-47ff-90d8-4d81e7dbdcac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:29.484733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b66f24-bdcb-47ff-90d8-4d81e7dbdcac admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:29.506271 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4251/8416] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:50:29.507352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3496f-18fa-43ec-9e7a-7f52bd7f5563 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:29.523449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3496f-18fa-43ec-9e7a-7f52bd7f5563 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:29.528883 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bba216-04f9-4afe-8ba1-acda5a87c849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:29.529886 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bba216-04f9-4afe-8ba1-acda5a87c849 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:29.530228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bba216-04f9-4afe-8ba1-acda5a87c849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:29.530588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bba216-04f9-4afe-8ba1-acda5a87c849 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:29.531297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bba216-04f9-4afe-8ba1-acda5a87c849 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:29.533704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bba216-04f9-4afe-8ba1-acda5a87c849 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:29.573189 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4166/8417] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:50:29 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:50:29.577049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b66f24-bdcb-47ff-90d8-4d81e7dbdcac admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:29.592914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b66f24-bdcb-47ff-90d8-4d81e7dbdcac admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:29.649828 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:50:29.705568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbc7eb-547e-4dce-aafb-f02dd2bf2353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:29.706324 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbc7eb-547e-4dce-aafb-f02dd2bf2353 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:29.706634 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbc7eb-547e-4dce-aafb-f02dd2bf2353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:29.706907 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbc7eb-547e-4dce-aafb-f02dd2bf2353 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:29.707717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbc7eb-547e-4dce-aafb-f02dd2bf2353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:29.709883 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debbc7eb-547e-4dce-aafb-f02dd2bf2353 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:29.739242 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4252/8418] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:50:29 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:50:29.743420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bba216-04f9-4afe-8ba1-acda5a87c849 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:29.759871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bba216-04f9-4afe-8ba1-acda5a87c849 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:29.766580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7842a-d899-49ce-875c-0058b4bbf86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:29.767209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7842a-d899-49ce-875c-0058b4bbf86e admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:29.767497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7842a-d899-49ce-875c-0058b4bbf86e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:29.767758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7842a-d899-49ce-875c-0058b4bbf86e admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:29.768474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7842a-d899-49ce-875c-0058b4bbf86e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:29.778852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7842a-d899-49ce-875c-0058b4bbf86e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:29.804723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbc7eb-547e-4dce-aafb-f02dd2bf2353 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:29.820139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbc7eb-547e-4dce-aafb-f02dd2bf2353 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:29.821516 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4167/8419] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:50:29.822444 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7842a-d899-49ce-875c-0058b4bbf86e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:29.825227 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0fd7842a-d899-49ce-875c-0058b4bbf86e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:29.831613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fbe0aa-935a-46dc-b28a-c3e939293453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:29.832315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbe0aa-935a-46dc-b28a-c3e939293453 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:29.832588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbe0aa-935a-46dc-b28a-c3e939293453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:29.832870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbe0aa-935a-46dc-b28a-c3e939293453 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:29.833527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fbe0aa-935a-46dc-b28a-c3e939293453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:29.835160 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fbe0aa-935a-46dc-b28a-c3e939293453 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:29.853626 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7842a-d899-49ce-875c-0058b4bbf86e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:29.858110 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4253/8420] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:50:29.863695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fbe0aa-935a-46dc-b28a-c3e939293453 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:29.873130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f363cf-cfa8-4165-bfd4-ba9343715bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:29.874043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f363cf-cfa8-4165-bfd4-ba9343715bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:29.874318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f363cf-cfa8-4165-bfd4-ba9343715bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:29.874590 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f363cf-cfa8-4165-bfd4-ba9343715bc9 admin admin] PATH_INFO: `/v3/users/99c72c5a23094569b7efbb446f2d5d1b` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:29.877280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f363cf-cfa8-4165-bfd4-ba9343715bc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99c72c5a23094569b7efbb446f2d5d1b)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:29.879281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f363cf-cfa8-4165-bfd4-ba9343715bc9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:29.888120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fbe0aa-935a-46dc-b28a-c3e939293453 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:29.904512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57292f7d-a5c1-4a6b-8357-e56aad5880bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:29.905188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57292f7d-a5c1-4a6b-8357-e56aad5880bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:29.905464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57292f7d-a5c1-4a6b-8357-e56aad5880bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:29.905735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57292f7d-a5c1-4a6b-8357-e56aad5880bc admin admin] PATH_INFO: `/v3/projects/da2650b8d88f4992a09bcf0048bcc4c2/users/cc27d58f027d4fc3b398f6c184911e2e/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:29.933311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57292f7d-a5c1-4a6b-8357-e56aad5880bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=da2650b8d88f4992a09bcf0048bcc4c2, user_id=cc27d58f027d4fc3b398f6c184911e2e, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:29.937568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57292f7d-a5c1-4a6b-8357-e56aad5880bc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:29.973595 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4254/8421] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:50:29 2022] PUT /identity/v3/projects/da2650b8d88f4992a09bcf0048bcc4c2/users/cc27d58f027d4fc3b398f6c184911e2e/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:50:29.979876 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb761eb5-84ee-46fb-a706-440ddbee7029 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:29.981796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb761eb5-84ee-46fb-a706-440ddbee7029 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:29.982198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb761eb5-84ee-46fb-a706-440ddbee7029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:29.984425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-91f363cf-cfa8-4165-bfd4-ba9343715bc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99c72c5a23094569b7efbb446f2d5d1b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:30.006286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-91f363cf-cfa8-4165-bfd4-ba9343715bc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99c72c5a23094569b7efbb446f2d5d1b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:30.030141 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:50:30.031742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-91f363cf-cfa8-4165-bfd4-ba9343715bc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99c72c5a23094569b7efbb446f2d5d1b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:30.032603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-91f363cf-cfa8-4165-bfd4-ba9343715bc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99c72c5a23094569b7efbb446f2d5d1b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:30.042747 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-bb761eb5-84ee-46fb-a706-440ddbee7029 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:50:30.044119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-bb761eb5-84ee-46fb-a706-440ddbee7029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:30.066140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-91f363cf-cfa8-4165-bfd4-ba9343715bc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99c72c5a23094569b7efbb446f2d5d1b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:30.078172 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4168/8422] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:50:29 2022] DELETE /identity/v3/users/99c72c5a23094569b7efbb446f2d5d1b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:50:30.081267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f832a0c-aaef-4b11-99e0-eb383d586d16 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:30.082878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f832a0c-aaef-4b11-99e0-eb383d586d16 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:30.083229 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f832a0c-aaef-4b11-99e0-eb383d586d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:30.130697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-5f832a0c-aaef-4b11-99e0-eb383d586d16 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:50:30.132557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5f832a0c-aaef-4b11-99e0-eb383d586d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:30.237823 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4255/8423] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:50:30.244913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb761eb5-84ee-46fb-a706-440ddbee7029 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:30.246798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-bb761eb5-84ee-46fb-a706-440ddbee7029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:30.260513 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4169/8424] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:50:30.273232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f832a0c-aaef-4b11-99e0-eb383d586d16 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:30.275163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5f832a0c-aaef-4b11-99e0-eb383d586d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:30.377120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb761eb5-84ee-46fb-a706-440ddbee7029 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:30.383760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f832a0c-aaef-4b11-99e0-eb383d586d16 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:30.391771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf45089-bf15-40b5-a4f6-e137710d5ff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:30.392464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf45089-bf15-40b5-a4f6-e137710d5ff7 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:30.392746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf45089-bf15-40b5-a4f6-e137710d5ff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:30.393021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf45089-bf15-40b5-a4f6-e137710d5ff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:30.400141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aabf87-0827-4e11-81d5-cf82d26e1023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:30.404422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aabf87-0827-4e11-81d5-cf82d26e1023 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:30.405041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aabf87-0827-4e11-81d5-cf82d26e1023 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:30.407580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aabf87-0827-4e11-81d5-cf82d26e1023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:30.413523 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf45089-bf15-40b5-a4f6-e137710d5ff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:30.415005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf45089-bf15-40b5-a4f6-e137710d5ff7 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:30.431140 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4256/8425] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:50:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:50:30.439587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aabf87-0827-4e11-81d5-cf82d26e1023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:30.442808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aabf87-0827-4e11-81d5-cf82d26e1023 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:30.461562 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4170/8426] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:50:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:50:31.470140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf45089-bf15-40b5-a4f6-e137710d5ff7 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:31.472016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6cf45089-bf15-40b5-a4f6-e137710d5ff7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:31.502385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf45089-bf15-40b5-a4f6-e137710d5ff7 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:31.516031 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23b292-c923-47f3-9316-d49a689a84b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:31.516738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23b292-c923-47f3-9316-d49a689a84b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:31.517017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23b292-c923-47f3-9316-d49a689a84b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:31.517287 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23b292-c923-47f3-9316-d49a689a84b5 admin admin] PATH_INFO: `/v3/projects/c3fe05bbc8424c18831f36e2ed9e6052` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:31.518437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23b292-c923-47f3-9316-d49a689a84b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3fe05bbc8424c18831f36e2ed9e6052)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:31.528550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23b292-c923-47f3-9316-d49a689a84b5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:31.693152 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:50:31.815945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ae23b292-c923-47f3-9316-d49a689a84b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3fe05bbc8424c18831f36e2ed9e6052', 'request_id': 'req-ae23b292-c923-47f3-9316-d49a689a84b5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:31.886798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ae23b292-c923-47f3-9316-d49a689a84b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3fe05bbc8424c18831f36e2ed9e6052', 'request_id': 'req-ae23b292-c923-47f3-9316-d49a689a84b5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:31.910104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ae23b292-c923-47f3-9316-d49a689a84b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3fe05bbc8424c18831f36e2ed9e6052', 'request_id': 'req-ae23b292-c923-47f3-9316-d49a689a84b5'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:32.035772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ae23b292-c923-47f3-9316-d49a689a84b5 admin admin] The token cache is being invalidate because project c3fe05bbc8424c18831f36e2ed9e6052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:50:32.036235 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ae23b292-c923-47f3-9316-d49a689a84b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:32.045543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ae23b292-c923-47f3-9316-d49a689a84b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:32.083925 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4257/8427] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:50:31 2022] DELETE /identity/v3/projects/c3fe05bbc8424c18831f36e2ed9e6052 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:50:32.090803 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e87633-1525-4088-827b-9b41b619cc36 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:32.091389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e87633-1525-4088-827b-9b41b619cc36 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:32.091389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e87633-1525-4088-827b-9b41b619cc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:32.149430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-54e87633-1525-4088-827b-9b41b619cc36 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:50:32.150701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-54e87633-1525-4088-827b-9b41b619cc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:32.361863 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4171/8428] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:50:32.370347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f58d2-5af0-4c3f-bc30-de350a464935 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:32.370666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f58d2-5af0-4c3f-bc30-de350a464935 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:32.370899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f58d2-5af0-4c3f-bc30-de350a464935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:32.413093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5d6f58d2-5af0-4c3f-bc30-de350a464935 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:50:32.416424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5d6f58d2-5af0-4c3f-bc30-de350a464935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:32.442937 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4258/8429] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:50:32.448427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e87633-1525-4088-827b-9b41b619cc36 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:32.460187 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e87633-1525-4088-827b-9b41b619cc36 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:32.476103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bca17-3298-4f17-b8ac-05242c0bb287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:32.477255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bca17-3298-4f17-b8ac-05242c0bb287 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:32.479139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bca17-3298-4f17-b8ac-05242c0bb287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:32.480142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bca17-3298-4f17-b8ac-05242c0bb287 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:32.480868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652bca17-3298-4f17-b8ac-05242c0bb287 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:50:32.482649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652bca17-3298-4f17-b8ac-05242c0bb287 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:32.489177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652bca17-3298-4f17-b8ac-05242c0bb287 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:32.527068 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4172/8430] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:50:32.531378 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f58d2-5af0-4c3f-bc30-de350a464935 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:32.548677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f58d2-5af0-4c3f-bc30-de350a464935 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:32.564086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabde4fb-7854-4108-9cf0-e59ac6edb5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:32.566601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabde4fb-7854-4108-9cf0-e59ac6edb5ec admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:32.567170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabde4fb-7854-4108-9cf0-e59ac6edb5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:32.568578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabde4fb-7854-4108-9cf0-e59ac6edb5ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:32.569579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabde4fb-7854-4108-9cf0-e59ac6edb5ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:32.576896 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabde4fb-7854-4108-9cf0-e59ac6edb5ec admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:32.648764 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4259/8431] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:50:32 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:50:32.653074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bca17-3298-4f17-b8ac-05242c0bb287 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:32.703465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bca17-3298-4f17-b8ac-05242c0bb287 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:32.712523 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659beb9-5913-4257-970f-06f2099a551f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:32.712887 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659beb9-5913-4257-970f-06f2099a551f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:32.713066 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659beb9-5913-4257-970f-06f2099a551f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:32.783900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-4659beb9-5913-4257-970f-06f2099a551f None None] MFA Rules not processed for user `cc27d58f027d4fc3b398f6c184911e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:50:32.785231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4659beb9-5913-4257-970f-06f2099a551f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:32.787566 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:50:32.932705 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4260/8432] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:50:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:50:32.944555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659beb9-5913-4257-970f-06f2099a551f None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:32.946910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4659beb9-5913-4257-970f-06f2099a551f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:32.957227 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f8a33-d404-49af-9fc1-0acc4e86484e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:32.958618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f8a33-d404-49af-9fc1-0acc4e86484e admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:32.959092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f8a33-d404-49af-9fc1-0acc4e86484e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:32.959552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f8a33-d404-49af-9fc1-0acc4e86484e admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:32.960603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f8a33-d404-49af-9fc1-0acc4e86484e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:32.973704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f8a33-d404-49af-9fc1-0acc4e86484e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:33.026715 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4173/8433] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:50:32 2022] POST /identity/v3/users => generated 294 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:50:33.032786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f8a33-d404-49af-9fc1-0acc4e86484e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:33.060876 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f8a33-d404-49af-9fc1-0acc4e86484e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:33.070421 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b89b1f-d16e-498f-a39e-696d3f9ed383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:33.072985 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b89b1f-d16e-498f-a39e-696d3f9ed383 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:33.073351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b89b1f-d16e-498f-a39e-696d3f9ed383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:33.074564 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b89b1f-d16e-498f-a39e-696d3f9ed383 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:33.075792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b89b1f-d16e-498f-a39e-696d3f9ed383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:33.085946 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b89b1f-d16e-498f-a39e-696d3f9ed383 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:33.134046 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4174/8434] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:50:33.138411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b89b1f-d16e-498f-a39e-696d3f9ed383 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:33.179008 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b89b1f-d16e-498f-a39e-696d3f9ed383 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:33.182771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659beb9-5913-4257-970f-06f2099a551f None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:33.195368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba9428-18a6-4a39-9d17-9781c8011d6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:33.196416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba9428-18a6-4a39-9d17-9781c8011d6a service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:33.197063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba9428-18a6-4a39-9d17-9781c8011d6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:33.197791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba9428-18a6-4a39-9d17-9781c8011d6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:33.200275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f8f77-a447-4803-a981-974c462ed221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:33.201274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f8f77-a447-4803-a981-974c462ed221 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:33.203196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f8f77-a447-4803-a981-974c462ed221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:33.207253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f8f77-a447-4803-a981-974c462ed221 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:33.211355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f8f77-a447-4803-a981-974c462ed221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:33.213472 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba9428-18a6-4a39-9d17-9781c8011d6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:33.214792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f8f77-a447-4803-a981-974c462ed221 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:33.215276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba9428-18a6-4a39-9d17-9781c8011d6a service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:33.245288 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4175/8435] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:50:33.253670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f8f77-a447-4803-a981-974c462ed221 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:33.270744 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4261/8436] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:50:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:50:33.316505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f8f77-a447-4803-a981-974c462ed221 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:33.336975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1816ed-076d-4f89-ae17-1427476839ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:33.338419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1816ed-076d-4f89-ae17-1427476839ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:33.339027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1816ed-076d-4f89-ae17-1427476839ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:33.341753 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1816ed-076d-4f89-ae17-1427476839ce admin admin] PATH_INFO: `/v3/projects/5c74b3b1ac1946e88b575d9ead4bb1b0/users/afc093d1d5144a92b6750b465e11d396/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:33.379945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1816ed-076d-4f89-ae17-1427476839ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c74b3b1ac1946e88b575d9ead4bb1b0, user_id=afc093d1d5144a92b6750b465e11d396, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:33.391663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1816ed-076d-4f89-ae17-1427476839ce admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:33.425567 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4176/8437] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:50:33 2022] PUT /identity/v3/projects/5c74b3b1ac1946e88b575d9ead4bb1b0/users/afc093d1d5144a92b6750b465e11d396/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:50:33.436159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269aab07-7f3e-413e-88d9-0de2e57d6531 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:33.436969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269aab07-7f3e-413e-88d9-0de2e57d6531 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:33.437257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269aab07-7f3e-413e-88d9-0de2e57d6531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:33.533884 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-269aab07-7f3e-413e-88d9-0de2e57d6531 None None] MFA Rules not processed for user `afc093d1d5144a92b6750b465e11d396`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:50:33.536814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-269aab07-7f3e-413e-88d9-0de2e57d6531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:33.552165 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:50:33.708809 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4262/8438] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:50:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:50:33.710078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1816ed-076d-4f89-ae17-1427476839ce admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:33.889141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1816ed-076d-4f89-ae17-1427476839ce admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:33.900349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53832fa-ba75-43cf-ad1a-d3d62aa4368f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:33.901157 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53832fa-ba75-43cf-ad1a-d3d62aa4368f admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:33.901631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53832fa-ba75-43cf-ad1a-d3d62aa4368f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:33.902065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53832fa-ba75-43cf-ad1a-d3d62aa4368f admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:33.903124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53832fa-ba75-43cf-ad1a-d3d62aa4368f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:33.909809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53832fa-ba75-43cf-ad1a-d3d62aa4368f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:33.974870 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4177/8439] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:50:33 2022] POST /identity/v3/projects => generated 385 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:50:33.975775 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269aab07-7f3e-413e-88d9-0de2e57d6531 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:33.997994 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269aab07-7f3e-413e-88d9-0de2e57d6531 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:34.145203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265cfda7-4e8d-4f8b-870d-25cdf1e8ef2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:34.146348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cfda7-4e8d-4f8b-870d-25cdf1e8ef2a admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:34.146860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cfda7-4e8d-4f8b-870d-25cdf1e8ef2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:34.147340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cfda7-4e8d-4f8b-870d-25cdf1e8ef2a admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:34.148651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265cfda7-4e8d-4f8b-870d-25cdf1e8ef2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:34.152284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265cfda7-4e8d-4f8b-870d-25cdf1e8ef2a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:34.194132 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4263/8440] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:50:33 2022] POST /identity/v3/users => generated 300 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:50:34.198771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53832fa-ba75-43cf-ad1a-d3d62aa4368f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:34.217528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53832fa-ba75-43cf-ad1a-d3d62aa4368f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:34.227115 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbbc99-6027-46a7-8404-4e3dc635077f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:34.228446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbbc99-6027-46a7-8404-4e3dc635077f admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:34.228994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbbc99-6027-46a7-8404-4e3dc635077f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:34.229480 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbbc99-6027-46a7-8404-4e3dc635077f admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:34.230484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dbbc99-6027-46a7-8404-4e3dc635077f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:34.232812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dbbc99-6027-46a7-8404-4e3dc635077f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:34.265200 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4178/8441] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:50:34.270823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265cfda7-4e8d-4f8b-870d-25cdf1e8ef2a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:34.317277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265cfda7-4e8d-4f8b-870d-25cdf1e8ef2a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:34.334825 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e32a7b-250d-4288-b5c8-82857b1dd692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:34.336016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e32a7b-250d-4288-b5c8-82857b1dd692 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:34.337328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e32a7b-250d-4288-b5c8-82857b1dd692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:34.337642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e32a7b-250d-4288-b5c8-82857b1dd692 admin admin] PATH_INFO: `/v3/projects/0633b75fecd943a7a7aec78a5f276c4d/users/a3a5592a564c40218e43ec33a340f334/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:34.367985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e32a7b-250d-4288-b5c8-82857b1dd692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0633b75fecd943a7a7aec78a5f276c4d, user_id=a3a5592a564c40218e43ec33a340f334, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:34.372188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e32a7b-250d-4288-b5c8-82857b1dd692 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:34.437244 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4264/8442] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:50:34 2022] PUT /identity/v3/projects/0633b75fecd943a7a7aec78a5f276c4d/users/a3a5592a564c40218e43ec33a340f334/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:50:34.437539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2c679-3ae5-4025-815a-7ea526990456 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:34.437708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2c679-3ae5-4025-815a-7ea526990456 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:34.437864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2c679-3ae5-4025-815a-7ea526990456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:34.545201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-35a2c679-3ae5-4025-815a-7ea526990456 None None] MFA Rules not processed for user `a3a5592a564c40218e43ec33a340f334`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:50:34.567385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-35a2c679-3ae5-4025-815a-7ea526990456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:34.652447 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:50:34.802869 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4179/8443] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:50:34 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:50:34.849972 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e32a7b-250d-4288-b5c8-82857b1dd692 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:34.851929 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-69e32a7b-250d-4288-b5c8-82857b1dd692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:35.046486 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e32a7b-250d-4288-b5c8-82857b1dd692 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:35.061787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1b051-294b-4eb1-8b2b-61b9221fd1b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:35.062678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1b051-294b-4eb1-8b2b-61b9221fd1b0 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:35.063037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1b051-294b-4eb1-8b2b-61b9221fd1b0 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:35.063384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1b051-294b-4eb1-8b2b-61b9221fd1b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:35.082343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1b051-294b-4eb1-8b2b-61b9221fd1b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:35.084118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1b051-294b-4eb1-8b2b-61b9221fd1b0 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:35.093901 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:50:35.109871 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4265/8444] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:50:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 678 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:50:36.293203 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2c679-3ae5-4025-815a-7ea526990456 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:36.412008 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2c679-3ae5-4025-815a-7ea526990456 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:36.417147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933edb2-0fd4-42b5-95b1-1cba9bd421ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:36.417799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933edb2-0fd4-42b5-95b1-1cba9bd421ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:36.418085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933edb2-0fd4-42b5-95b1-1cba9bd421ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:36.418366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933edb2-0fd4-42b5-95b1-1cba9bd421ed admin admin] PATH_INFO: `/v3/users/afc093d1d5144a92b6750b465e11d396` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:36.419555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933edb2-0fd4-42b5-95b1-1cba9bd421ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=afc093d1d5144a92b6750b465e11d396)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:36.421552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933edb2-0fd4-42b5-95b1-1cba9bd421ed admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:36.509223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2933edb2-0fd4-42b5-95b1-1cba9bd421ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afc093d1d5144a92b6750b465e11d396'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:36.526187 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2933edb2-0fd4-42b5-95b1-1cba9bd421ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afc093d1d5144a92b6750b465e11d396'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:36.561581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2933edb2-0fd4-42b5-95b1-1cba9bd421ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afc093d1d5144a92b6750b465e11d396'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:36.562676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2933edb2-0fd4-42b5-95b1-1cba9bd421ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afc093d1d5144a92b6750b465e11d396'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:36.580034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-2933edb2-0fd4-42b5-95b1-1cba9bd421ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afc093d1d5144a92b6750b465e11d396'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:36.604651 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4180/8445] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:50:36 2022] DELETE /identity/v3/users/afc093d1d5144a92b6750b465e11d396 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:50:36.609759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd183dc-f060-4dc7-a198-e4320bc75604 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:36.610276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd183dc-f060-4dc7-a198-e4320bc75604 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:36.610723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd183dc-f060-4dc7-a198-e4320bc75604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:36.638304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-edd183dc-f060-4dc7-a198-e4320bc75604 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:50:36.639669 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-edd183dc-f060-4dc7-a198-e4320bc75604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:36.749592 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4266/8446] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:50:36.762089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933edb2-0fd4-42b5-95b1-1cba9bd421ed admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:36.763714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2933edb2-0fd4-42b5-95b1-1cba9bd421ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:36.825471 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:50:36.835798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933edb2-0fd4-42b5-95b1-1cba9bd421ed admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:36.842859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfcf84-ca83-4fbe-865d-d5adcd139482 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:36.844116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfcf84-ca83-4fbe-865d-d5adcd139482 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:36.844479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfcf84-ca83-4fbe-865d-d5adcd139482 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:36.845252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfcf84-ca83-4fbe-865d-d5adcd139482 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:36.859703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfcf84-ca83-4fbe-865d-d5adcd139482 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:36.861729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfcf84-ca83-4fbe-865d-d5adcd139482 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:36.874833 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4181/8447] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:50:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:50:37.412643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd183dc-f060-4dc7-a198-e4320bc75604 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:37.415352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-edd183dc-f060-4dc7-a198-e4320bc75604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:37.454971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd183dc-f060-4dc7-a198-e4320bc75604 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:37.469860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d84fb7-6ba6-4f53-9970-78598b6bd53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:37.470628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d84fb7-6ba6-4f53-9970-78598b6bd53b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:37.472059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d84fb7-6ba6-4f53-9970-78598b6bd53b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:37.473357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d84fb7-6ba6-4f53-9970-78598b6bd53b admin admin] PATH_INFO: `/v3/projects/5c74b3b1ac1946e88b575d9ead4bb1b0` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:37.478104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d84fb7-6ba6-4f53-9970-78598b6bd53b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c74b3b1ac1946e88b575d9ead4bb1b0)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:37.480934 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d84fb7-6ba6-4f53-9970-78598b6bd53b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:37.615502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-53d84fb7-6ba6-4f53-9970-78598b6bd53b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c74b3b1ac1946e88b575d9ead4bb1b0', 'request_id': 'req-53d84fb7-6ba6-4f53-9970-78598b6bd53b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:37.632638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-53d84fb7-6ba6-4f53-9970-78598b6bd53b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c74b3b1ac1946e88b575d9ead4bb1b0', 'request_id': 'req-53d84fb7-6ba6-4f53-9970-78598b6bd53b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:37.650371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-53d84fb7-6ba6-4f53-9970-78598b6bd53b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c74b3b1ac1946e88b575d9ead4bb1b0', 'request_id': 'req-53d84fb7-6ba6-4f53-9970-78598b6bd53b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:37.691586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-53d84fb7-6ba6-4f53-9970-78598b6bd53b admin admin] The token cache is being invalidate because project 5c74b3b1ac1946e88b575d9ead4bb1b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:50:37.692399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-53d84fb7-6ba6-4f53-9970-78598b6bd53b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:37.694942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-53d84fb7-6ba6-4f53-9970-78598b6bd53b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:37.697474 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4267/8448] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:50:37 2022] DELETE /identity/v3/projects/5c74b3b1ac1946e88b575d9ead4bb1b0 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:50:37.701821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfcf84-ca83-4fbe-865d-d5adcd139482 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:37.714801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfcf84-ca83-4fbe-865d-d5adcd139482 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:37.860845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d7be6-6760-4395-8382-daf7309b3965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:37.861551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d7be6-6760-4395-8382-daf7309b3965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:37.862047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d7be6-6760-4395-8382-daf7309b3965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:37.863018 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d7be6-6760-4395-8382-daf7309b3965 admin admin] PATH_INFO: `/v3/users/a3a5592a564c40218e43ec33a340f334` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:37.864577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d7be6-6760-4395-8382-daf7309b3965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a5592a564c40218e43ec33a340f334)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:37.866806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d7be6-6760-4395-8382-daf7309b3965 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:37.940586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d45d7be6-6760-4395-8382-daf7309b3965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a5592a564c40218e43ec33a340f334'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:37.961554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d45d7be6-6760-4395-8382-daf7309b3965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a5592a564c40218e43ec33a340f334'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:38.017222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d45d7be6-6760-4395-8382-daf7309b3965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a5592a564c40218e43ec33a340f334'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:38.018016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d45d7be6-6760-4395-8382-daf7309b3965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a5592a564c40218e43ec33a340f334'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:38.034457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d45d7be6-6760-4395-8382-daf7309b3965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a5592a564c40218e43ec33a340f334'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:38.044433 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4182/8449] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:50:37 2022] DELETE /identity/v3/users/a3a5592a564c40218e43ec33a340f334 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:50:38.554637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d84fb7-6ba6-4f53-9970-78598b6bd53b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:38.556853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-53d84fb7-6ba6-4f53-9970-78598b6bd53b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:38.608286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d84fb7-6ba6-4f53-9970-78598b6bd53b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:38.799649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae5763-44be-452d-ae7c-25a8f86812c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:38.802484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae5763-44be-452d-ae7c-25a8f86812c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:38.803274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae5763-44be-452d-ae7c-25a8f86812c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:38.803866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae5763-44be-452d-ae7c-25a8f86812c8 admin admin] PATH_INFO: `/v3/projects/0633b75fecd943a7a7aec78a5f276c4d` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:38.806522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae5763-44be-452d-ae7c-25a8f86812c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0633b75fecd943a7a7aec78a5f276c4d)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:38.809489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae5763-44be-452d-ae7c-25a8f86812c8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:38.853115 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:50:38.882685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ccae5763-44be-452d-ae7c-25a8f86812c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0633b75fecd943a7a7aec78a5f276c4d', 'request_id': 'req-ccae5763-44be-452d-ae7c-25a8f86812c8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:38.892022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ccae5763-44be-452d-ae7c-25a8f86812c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0633b75fecd943a7a7aec78a5f276c4d', 'request_id': 'req-ccae5763-44be-452d-ae7c-25a8f86812c8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:38.902471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ccae5763-44be-452d-ae7c-25a8f86812c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0633b75fecd943a7a7aec78a5f276c4d', 'request_id': 'req-ccae5763-44be-452d-ae7c-25a8f86812c8'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:38.932425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ccae5763-44be-452d-ae7c-25a8f86812c8 admin admin] The token cache is being invalidate because project 0633b75fecd943a7a7aec78a5f276c4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:50:38.932880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ccae5763-44be-452d-ae7c-25a8f86812c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:38.933738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-ccae5763-44be-452d-ae7c-25a8f86812c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:38.939135 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4268/8450] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:50:38 2022] DELETE /identity/v3/projects/0633b75fecd943a7a7aec78a5f276c4d => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:50:38.941473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ad10e-66da-423c-942d-48f890dde029 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:38.942010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ad10e-66da-423c-942d-48f890dde029 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:38.942010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ad10e-66da-423c-942d-48f890dde029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:38.980651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-398ad10e-66da-423c-942d-48f890dde029 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:50:38.982085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-398ad10e-66da-423c-942d-48f890dde029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:39.078502 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4183/8451] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:50:39.087150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115b829-c4bb-498e-a662-48a5abc5bc33 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:39.087429 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115b829-c4bb-498e-a662-48a5abc5bc33 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:39.087711 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115b829-c4bb-498e-a662-48a5abc5bc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:39.135317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3115b829-c4bb-498e-a662-48a5abc5bc33 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:50:39.138425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3115b829-c4bb-498e-a662-48a5abc5bc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:39.160105 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4269/8452] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:50:39.162746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ad10e-66da-423c-942d-48f890dde029 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:39.178615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ad10e-66da-423c-942d-48f890dde029 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:39.197526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc957151-aba9-45d3-916c-dd3b54046b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:39.198516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc957151-aba9-45d3-916c-dd3b54046b55 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:39.199039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc957151-aba9-45d3-916c-dd3b54046b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:39.199543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc957151-aba9-45d3-916c-dd3b54046b55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:39.200396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc957151-aba9-45d3-916c-dd3b54046b55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:50:39.200985 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc957151-aba9-45d3-916c-dd3b54046b55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:39.203010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc957151-aba9-45d3-916c-dd3b54046b55 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:39.208202 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:50:39.234097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115b829-c4bb-498e-a662-48a5abc5bc33 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:39.241672 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4184/8453] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:50:39.246325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115b829-c4bb-498e-a662-48a5abc5bc33 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:39.252768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2cae9-bfd6-462d-a053-58416a24c3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:39.254321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2cae9-bfd6-462d-a053-58416a24c3c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:39.255075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2cae9-bfd6-462d-a053-58416a24c3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:39.255816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2cae9-bfd6-462d-a053-58416a24c3c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:39.257022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2cae9-bfd6-462d-a053-58416a24c3c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:39.259300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2cae9-bfd6-462d-a053-58416a24c3c6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:39.324480 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4270/8454] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:50:39 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:50:39.331842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc957151-aba9-45d3-916c-dd3b54046b55 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:39.371661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc957151-aba9-45d3-916c-dd3b54046b55 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:39.468364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731f0f4-feb3-4dd7-8c0f-f07551131f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:39.469139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731f0f4-feb3-4dd7-8c0f-f07551131f49 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:39.469427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731f0f4-feb3-4dd7-8c0f-f07551131f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:39.469698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731f0f4-feb3-4dd7-8c0f-f07551131f49 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:39.470508 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731f0f4-feb3-4dd7-8c0f-f07551131f49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:39.473514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731f0f4-feb3-4dd7-8c0f-f07551131f49 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:39.508319 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4185/8455] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:50:39 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:50:39.510002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2cae9-bfd6-462d-a053-58416a24c3c6 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:39.532018 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2cae9-bfd6-462d-a053-58416a24c3c6 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:39.548633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f732f64-1289-4d43-b70e-8fd702ca7d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:39.549747 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f732f64-1289-4d43-b70e-8fd702ca7d3a admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:39.550358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f732f64-1289-4d43-b70e-8fd702ca7d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:39.550917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f732f64-1289-4d43-b70e-8fd702ca7d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:39.552259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f732f64-1289-4d43-b70e-8fd702ca7d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:39.555816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f732f64-1289-4d43-b70e-8fd702ca7d3a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:39.579162 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4271/8456] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:50:39.584644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731f0f4-feb3-4dd7-8c0f-f07551131f49 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:39.600829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731f0f4-feb3-4dd7-8c0f-f07551131f49 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:39.606970 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2803c8-e705-497a-a5d6-13ff408134e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:39.607700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2803c8-e705-497a-a5d6-13ff408134e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:39.608081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2803c8-e705-497a-a5d6-13ff408134e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:39.608422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2803c8-e705-497a-a5d6-13ff408134e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:39.609195 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2803c8-e705-497a-a5d6-13ff408134e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:39.611262 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2803c8-e705-497a-a5d6-13ff408134e8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:39.625413 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4186/8457] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:50:39.629978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f732f64-1289-4d43-b70e-8fd702ca7d3a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:39.641505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f732f64-1289-4d43-b70e-8fd702ca7d3a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:39.647067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57199b02-4f1d-4d7d-835c-a74a17d76c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:39.647925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57199b02-4f1d-4d7d-835c-a74a17d76c8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:39.648211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57199b02-4f1d-4d7d-835c-a74a17d76c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:39.648485 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57199b02-4f1d-4d7d-835c-a74a17d76c8a admin admin] PATH_INFO: `/v3/projects/bf36f5153ba648008cdaceb9dc538e53/users/661f6c9aa7da4e348a9b0d91840078c2/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:39.666091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57199b02-4f1d-4d7d-835c-a74a17d76c8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf36f5153ba648008cdaceb9dc538e53, user_id=661f6c9aa7da4e348a9b0d91840078c2, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:39.668742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57199b02-4f1d-4d7d-835c-a74a17d76c8a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:39.690944 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4272/8458] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:50:39 2022] PUT /identity/v3/projects/bf36f5153ba648008cdaceb9dc538e53/users/661f6c9aa7da4e348a9b0d91840078c2/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:50:39.697413 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff92c6-b2f5-40b0-9320-6d59485414bc None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:39.698091 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff92c6-b2f5-40b0-9320-6d59485414bc None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:39.698740 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff92c6-b2f5-40b0-9320-6d59485414bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:39.725087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-01ff92c6-b2f5-40b0-9320-6d59485414bc None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:50:39.726316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-01ff92c6-b2f5-40b0-9320-6d59485414bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:39.829136 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4187/8459] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:50:39.835613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57199b02-4f1d-4d7d-835c-a74a17d76c8a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:39.837695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-57199b02-4f1d-4d7d-835c-a74a17d76c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:39.948718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57199b02-4f1d-4d7d-835c-a74a17d76c8a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:39.951837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a97fe-1782-4465-8bee-765c399b185f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:39.952560 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a97fe-1782-4465-8bee-765c399b185f service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:39.952873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a97fe-1782-4465-8bee-765c399b185f service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:39.953184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a97fe-1782-4465-8bee-765c399b185f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:39.972448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a97fe-1782-4465-8bee-765c399b185f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:39.974260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a97fe-1782-4465-8bee-765c399b185f service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:39.987531 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4273/8460] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:50:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:50:49.814948 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=63,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:50:49.982277 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=6,keystone:SELECT=67,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:50:50.125410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c4469-27c1-4996-8ea4-7be794564076 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:50.125703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c4469-27c1-4996-8ea4-7be794564076 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:50.126013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c4469-27c1-4996-8ea4-7be794564076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:50.229722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-8e1c4469-27c1-4996-8ea4-7be794564076 None None] MFA Rules not processed for user `661f6c9aa7da4e348a9b0d91840078c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:50:50.230943 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8e1c4469-27c1-4996-8ea4-7be794564076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:50.475582 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4188/8461] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:50:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:50:50.482860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a97fe-1782-4465-8bee-765c399b185f service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:50.496791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a97fe-1782-4465-8bee-765c399b185f service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:50.510232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc8e3a-460c-47dd-aa00-0f4ff05097a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:50.511274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc8e3a-460c-47dd-aa00-0f4ff05097a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:50.511458 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc8e3a-460c-47dd-aa00-0f4ff05097a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:50.511716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc8e3a-460c-47dd-aa00-0f4ff05097a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:50.512392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc8e3a-460c-47dd-aa00-0f4ff05097a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:50.514301 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc8e3a-460c-47dd-aa00-0f4ff05097a4 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:50.551773 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4274/8462] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:50:50 2022] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:50:50.556042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c4469-27c1-4996-8ea4-7be794564076 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:50.572172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c4469-27c1-4996-8ea4-7be794564076 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:50.699844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fe8f0-3930-4203-9dea-951a606215fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:50.699844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fe8f0-3930-4203-9dea-951a606215fd admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:50.699844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fe8f0-3930-4203-9dea-951a606215fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:50.699844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fe8f0-3930-4203-9dea-951a606215fd admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:50.700220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683fe8f0-3930-4203-9dea-951a606215fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:50.700220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683fe8f0-3930-4203-9dea-951a606215fd admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:50.740145 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4189/8463] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:50:50 2022] POST /identity/v3/users => generated 295 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:50:50.743225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc8e3a-460c-47dd-aa00-0f4ff05097a4 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:50.758232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc8e3a-460c-47dd-aa00-0f4ff05097a4 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:50.765369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11529a4c-f36b-4450-a165-b9eea7085c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:50.772873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11529a4c-f36b-4450-a165-b9eea7085c38 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:50.773303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11529a4c-f36b-4450-a165-b9eea7085c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:50.773645 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11529a4c-f36b-4450-a165-b9eea7085c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:50.774495 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11529a4c-f36b-4450-a165-b9eea7085c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:50.777794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11529a4c-f36b-4450-a165-b9eea7085c38 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:50.800865 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4275/8464] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:50:50.805424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fe8f0-3930-4203-9dea-951a606215fd admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:50.835725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fe8f0-3930-4203-9dea-951a606215fd admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:50.875030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5318a8-0bd7-4582-86ec-fbd576510033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:50.875914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5318a8-0bd7-4582-86ec-fbd576510033 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:50.876343 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5318a8-0bd7-4582-86ec-fbd576510033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:50.876765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5318a8-0bd7-4582-86ec-fbd576510033 admin admin] PATH_INFO: `/v3/projects/7caf3c02c68d4c718f35cf3683b3a567/users/56d8bcf448eb47ea8d50e38bd30e60a0/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:50.905027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5318a8-0bd7-4582-86ec-fbd576510033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7caf3c02c68d4c718f35cf3683b3a567, user_id=56d8bcf448eb47ea8d50e38bd30e60a0, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:50.908653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5318a8-0bd7-4582-86ec-fbd576510033 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:50.935802 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4190/8465] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:50:50 2022] PUT /identity/v3/projects/7caf3c02c68d4c718f35cf3683b3a567/users/56d8bcf448eb47ea8d50e38bd30e60a0/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:50:50.940189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11529a4c-f36b-4450-a165-b9eea7085c38 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:50.956487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11529a4c-f36b-4450-a165-b9eea7085c38 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:51.099073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37bfb1-a733-4b5d-b0ea-3546e6947c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:51.100345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37bfb1-a733-4b5d-b0ea-3546e6947c7c admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:51.100848 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37bfb1-a733-4b5d-b0ea-3546e6947c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:51.101116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37bfb1-a733-4b5d-b0ea-3546e6947c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:51.101900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37bfb1-a733-4b5d-b0ea-3546e6947c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:51.103649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37bfb1-a733-4b5d-b0ea-3546e6947c7c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:51.148991 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4276/8466] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:50:51.150113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5318a8-0bd7-4582-86ec-fbd576510033 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:51.162990 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5318a8-0bd7-4582-86ec-fbd576510033 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:51.178920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d651a3-19d1-4f76-939b-37b5fbf79c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:51.179606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d651a3-19d1-4f76-939b-37b5fbf79c2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:51.179904 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d651a3-19d1-4f76-939b-37b5fbf79c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:51.180166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d651a3-19d1-4f76-939b-37b5fbf79c2e admin admin] PATH_INFO: `/v3/projects/7caf3c02c68d4c718f35cf3683b3a567/users/56d8bcf448eb47ea8d50e38bd30e60a0/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:51.191836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d651a3-19d1-4f76-939b-37b5fbf79c2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7caf3c02c68d4c718f35cf3683b3a567, user_id=56d8bcf448eb47ea8d50e38bd30e60a0, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:51.200131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d651a3-19d1-4f76-939b-37b5fbf79c2e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:51.244905 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4191/8467] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:50:51 2022] PUT /identity/v3/projects/7caf3c02c68d4c718f35cf3683b3a567/users/56d8bcf448eb47ea8d50e38bd30e60a0/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:50:56.123601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37bfb1-a733-4b5d-b0ea-3546e6947c7c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:56.129855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5a37bfb1-a733-4b5d-b0ea-3546e6947c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:56.164096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37bfb1-a733-4b5d-b0ea-3546e6947c7c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:56.288538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463fd88-85fc-40fd-9e50-2653d282cd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:56.289367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463fd88-85fc-40fd-9e50-2653d282cd95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:56.289763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463fd88-85fc-40fd-9e50-2653d282cd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:56.290207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463fd88-85fc-40fd-9e50-2653d282cd95 admin admin] PATH_INFO: `/v3/users/2b0cd6516ba64030b2369714f0efd36c` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:56.291694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e463fd88-85fc-40fd-9e50-2653d282cd95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b0cd6516ba64030b2369714f0efd36c)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:56.294366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e463fd88-85fc-40fd-9e50-2653d282cd95 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:56.399859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e463fd88-85fc-40fd-9e50-2653d282cd95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b0cd6516ba64030b2369714f0efd36c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:56.434668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e463fd88-85fc-40fd-9e50-2653d282cd95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b0cd6516ba64030b2369714f0efd36c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:56.466480 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:50:56.484721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e463fd88-85fc-40fd-9e50-2653d282cd95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b0cd6516ba64030b2369714f0efd36c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:56.488848 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e463fd88-85fc-40fd-9e50-2653d282cd95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b0cd6516ba64030b2369714f0efd36c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:56.514167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e463fd88-85fc-40fd-9e50-2653d282cd95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b0cd6516ba64030b2369714f0efd36c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:56.535781 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4277/8468] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:50:56 2022] DELETE /identity/v3/users/2b0cd6516ba64030b2369714f0efd36c => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:50:56.541178 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a51482-ac57-4d08-b17a-d00d08a52b56 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:56.541672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a51482-ac57-4d08-b17a-d00d08a52b56 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:56.541776 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a51482-ac57-4d08-b17a-d00d08a52b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:56.625179 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-21a51482-ac57-4d08-b17a-d00d08a52b56 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:50:56.626375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-21a51482-ac57-4d08-b17a-d00d08a52b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:56.683698 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:50:56.761720 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4192/8469] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:50:56.772863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463fd88-85fc-40fd-9e50-2653d282cd95 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:56.776143 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e463fd88-85fc-40fd-9e50-2653d282cd95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:56.980818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463fd88-85fc-40fd-9e50-2653d282cd95 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:56.992157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90880f1-9dfb-4722-82f0-e643ec7235b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:56.993303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90880f1-9dfb-4722-82f0-e643ec7235b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:56.993680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90880f1-9dfb-4722-82f0-e643ec7235b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:56.994053 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90880f1-9dfb-4722-82f0-e643ec7235b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:57.024036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90880f1-9dfb-4722-82f0-e643ec7235b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:57.035323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90880f1-9dfb-4722-82f0-e643ec7235b3 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:57.078633 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4278/8470] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:50:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:50:57.137923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a51482-ac57-4d08-b17a-d00d08a52b56 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:57.139409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-21a51482-ac57-4d08-b17a-d00d08a52b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:57.194678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a51482-ac57-4d08-b17a-d00d08a52b56 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:57.217261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd73166-cee7-4ebf-9fea-526c8c02399c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:57.217935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd73166-cee7-4ebf-9fea-526c8c02399c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:57.218219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd73166-cee7-4ebf-9fea-526c8c02399c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:57.218495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd73166-cee7-4ebf-9fea-526c8c02399c admin admin] PATH_INFO: `/v3/users/0f43ad9ff4b34d0ebfabc7d50e14e470` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:57.222788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd73166-cee7-4ebf-9fea-526c8c02399c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f43ad9ff4b34d0ebfabc7d50e14e470)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:57.224955 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd73166-cee7-4ebf-9fea-526c8c02399c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:57.419307 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fbd73166-cee7-4ebf-9fea-526c8c02399c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f43ad9ff4b34d0ebfabc7d50e14e470'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:57.443427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fbd73166-cee7-4ebf-9fea-526c8c02399c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f43ad9ff4b34d0ebfabc7d50e14e470'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:57.494702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fbd73166-cee7-4ebf-9fea-526c8c02399c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f43ad9ff4b34d0ebfabc7d50e14e470'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:57.496452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fbd73166-cee7-4ebf-9fea-526c8c02399c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f43ad9ff4b34d0ebfabc7d50e14e470'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:57.518826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-fbd73166-cee7-4ebf-9fea-526c8c02399c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f43ad9ff4b34d0ebfabc7d50e14e470'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:57.539100 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4193/8471] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:50:57 2022] DELETE /identity/v3/users/0f43ad9ff4b34d0ebfabc7d50e14e470 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:50:57.543167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b9638-bd82-463a-becc-dba90d0bfa2a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:57.543669 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b9638-bd82-463a-becc-dba90d0bfa2a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:57.543787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b9638-bd82-463a-becc-dba90d0bfa2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:57.604088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-341b9638-bd82-463a-becc-dba90d0bfa2a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:50:57.605552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-341b9638-bd82-463a-becc-dba90d0bfa2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:57.771984 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4279/8472] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:50:57.878152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd73166-cee7-4ebf-9fea-526c8c02399c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:57.879873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-fbd73166-cee7-4ebf-9fea-526c8c02399c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:57.906819 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b9638-bd82-463a-becc-dba90d0bfa2a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:57.908850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-341b9638-bd82-463a-becc-dba90d0bfa2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:57.948591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b9638-bd82-463a-becc-dba90d0bfa2a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:57.974952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b232a-4ab7-4175-ba10-fb30c197099d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:57.975913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b232a-4ab7-4175-ba10-fb30c197099d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:57.977058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b232a-4ab7-4175-ba10-fb30c197099d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:57.978861 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b232a-4ab7-4175-ba10-fb30c197099d admin admin] PATH_INFO: `/v3/projects/af1f780a60424bff93b7b1b3d8051893` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:57.980918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b232a-4ab7-4175-ba10-fb30c197099d admin admin] RBAC: Authorizing `identity:delete_project(project_id=af1f780a60424bff93b7b1b3d8051893)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:57.985328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b232a-4ab7-4175-ba10-fb30c197099d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:58.138039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd73166-cee7-4ebf-9fea-526c8c02399c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:58.213870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f71b232a-4ab7-4175-ba10-fb30c197099d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af1f780a60424bff93b7b1b3d8051893', 'request_id': 'req-f71b232a-4ab7-4175-ba10-fb30c197099d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:58.236016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f71b232a-4ab7-4175-ba10-fb30c197099d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af1f780a60424bff93b7b1b3d8051893', 'request_id': 'req-f71b232a-4ab7-4175-ba10-fb30c197099d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:58.276240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f71b232a-4ab7-4175-ba10-fb30c197099d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af1f780a60424bff93b7b1b3d8051893', 'request_id': 'req-f71b232a-4ab7-4175-ba10-fb30c197099d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:58.341023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f71b232a-4ab7-4175-ba10-fb30c197099d admin admin] The token cache is being invalidate because project af1f780a60424bff93b7b1b3d8051893 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:50:58.341517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f71b232a-4ab7-4175-ba10-fb30c197099d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:58.351197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f71b232a-4ab7-4175-ba10-fb30c197099d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:58.352706 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4280/8473] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:50:57 2022] DELETE /identity/v3/projects/af1f780a60424bff93b7b1b3d8051893 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:50:58.358065 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b232a-4ab7-4175-ba10-fb30c197099d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:58.368532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f71b232a-4ab7-4175-ba10-fb30c197099d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:58.402035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6d63b-5859-45d7-961f-8fde01bf98e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:58.402674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6d63b-5859-45d7-961f-8fde01bf98e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:58.403129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6d63b-5859-45d7-961f-8fde01bf98e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:58.408417 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:50:58.408983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6d63b-5859-45d7-961f-8fde01bf98e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:58.415743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-02a6d63b-5859-45d7-961f-8fde01bf98e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:58.467948 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:50:58.561002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a6d63b-5859-45d7-961f-8fde01bf98e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:58.562477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a6d63b-5859-45d7-961f-8fde01bf98e2 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:58.618415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b232a-4ab7-4175-ba10-fb30c197099d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:58.621518 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4194/8474] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:50:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 744 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:50:58.622854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd01b62-5295-4266-9d05-9bd71230542e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:58.622989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd01b62-5295-4266-9d05-9bd71230542e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:58.623484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd01b62-5295-4266-9d05-9bd71230542e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:58.647478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9f17e-e561-47d0-91e6-1b5d8902e6b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:58.648383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3cd01b62-5295-4266-9d05-9bd71230542e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:50:58.649916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9f17e-e561-47d0-91e6-1b5d8902e6b5 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:58.650357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9f17e-e561-47d0-91e6-1b5d8902e6b5 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:58.650488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3cd01b62-5295-4266-9d05-9bd71230542e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:58.652686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9f17e-e561-47d0-91e6-1b5d8902e6b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:58.666113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-96e9f17e-e561-47d0-91e6-1b5d8902e6b5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:58.668925 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4195/8475] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:50:58.682318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836ce39-9177-44e2-b75a-30e8cd5866b3 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:58.683420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836ce39-9177-44e2-b75a-30e8cd5866b3 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:58.685103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836ce39-9177-44e2-b75a-30e8cd5866b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:58.745533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-5836ce39-9177-44e2-b75a-30e8cd5866b3 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:50:58.754901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5836ce39-9177-44e2-b75a-30e8cd5866b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:58.788602 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4196/8476] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:50:58.793245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836ce39-9177-44e2-b75a-30e8cd5866b3 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:58.829062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836ce39-9177-44e2-b75a-30e8cd5866b3 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:58.849466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f47f2-79dc-4817-88d0-8c5d447dd20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:58.850518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f47f2-79dc-4817-88d0-8c5d447dd20e admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:58.854297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f47f2-79dc-4817-88d0-8c5d447dd20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:58.854297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f47f2-79dc-4817-88d0-8c5d447dd20e admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:58.854945 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f47f2-79dc-4817-88d0-8c5d447dd20e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:50:58.855980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f47f2-79dc-4817-88d0-8c5d447dd20e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:58.861425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f47f2-79dc-4817-88d0-8c5d447dd20e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:58.894874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9f17e-e561-47d0-91e6-1b5d8902e6b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:58.900502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9f17e-e561-47d0-91e6-1b5d8902e6b5 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:58.914147 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4197/8477] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:50:58.918312 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f47f2-79dc-4817-88d0-8c5d447dd20e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:58.930418 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4281/8478] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:50:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:50:59.025478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f47f2-79dc-4817-88d0-8c5d447dd20e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:59.025478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171f21c-ec42-4ac4-99fe-c16952ec15d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:59.025478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171f21c-ec42-4ac4-99fe-c16952ec15d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:59.025478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171f21c-ec42-4ac4-99fe-c16952ec15d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:59.026151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171f21c-ec42-4ac4-99fe-c16952ec15d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:59.026151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171f21c-ec42-4ac4-99fe-c16952ec15d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:59.026151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171f21c-ec42-4ac4-99fe-c16952ec15d3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:59.136213 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4198/8479] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:50:58 2022] POST /identity/v3/projects => generated 375 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:50:59.138898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9f17e-e561-47d0-91e6-1b5d8902e6b5 service swift] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:59.138898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9f17e-e561-47d0-91e6-1b5d8902e6b5 service swift] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:59.310750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae10292-7e39-4470-a744-e6119f6fcc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:59.311498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae10292-7e39-4470-a744-e6119f6fcc2a admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:59.312130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae10292-7e39-4470-a744-e6119f6fcc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:59.312490 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae10292-7e39-4470-a744-e6119f6fcc2a admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:59.313389 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae10292-7e39-4470-a744-e6119f6fcc2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:59.316272 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae10292-7e39-4470-a744-e6119f6fcc2a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:59.416268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171f21c-ec42-4ac4-99fe-c16952ec15d3 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:59.432741 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4282/8480] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:50:59 2022] POST /identity/v3/users => generated 288 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:50:59.434797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171f21c-ec42-4ac4-99fe-c16952ec15d3 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:59.467075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69498e2b-2605-4997-8ecb-713256b0355e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:59.477320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69498e2b-2605-4997-8ecb-713256b0355e admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:59.481697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69498e2b-2605-4997-8ecb-713256b0355e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:59.484408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69498e2b-2605-4997-8ecb-713256b0355e admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:59.485229 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69498e2b-2605-4997-8ecb-713256b0355e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:59.487474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69498e2b-2605-4997-8ecb-713256b0355e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:59.519641 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4199/8481] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:50:59.524189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae10292-7e39-4470-a744-e6119f6fcc2a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:59.538290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae10292-7e39-4470-a744-e6119f6fcc2a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:59.543925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3000a52-89fa-4fca-8817-7d0cdf7caf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:59.544586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3000a52-89fa-4fca-8817-7d0cdf7caf07 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:59.544932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3000a52-89fa-4fca-8817-7d0cdf7caf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:59.545271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3000a52-89fa-4fca-8817-7d0cdf7caf07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:59.546178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3000a52-89fa-4fca-8817-7d0cdf7caf07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:59.547866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3000a52-89fa-4fca-8817-7d0cdf7caf07 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:59.563311 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4283/8482] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:50:59.567735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69498e2b-2605-4997-8ecb-713256b0355e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:59.585175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69498e2b-2605-4997-8ecb-713256b0355e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:59.602720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c59aad-8b6d-494d-aa28-62cf72c1481b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:59.603747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c59aad-8b6d-494d-aa28-62cf72c1481b admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:59.604304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c59aad-8b6d-494d-aa28-62cf72c1481b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:59.604695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c59aad-8b6d-494d-aa28-62cf72c1481b admin admin] PATH_INFO: `/v3/projects/2bd8662019804060a7b712456d095ad2/users/073f0cff787a466a9fbf9fb43b03b726/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:59.635442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3000a52-89fa-4fca-8817-7d0cdf7caf07 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:50:59.637457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d3000a52-89fa-4fca-8817-7d0cdf7caf07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:59.680467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3000a52-89fa-4fca-8817-7d0cdf7caf07 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:50:59.688052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c59aad-8b6d-494d-aa28-62cf72c1481b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bd8662019804060a7b712456d095ad2, user_id=073f0cff787a466a9fbf9fb43b03b726, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:59.698205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c59aad-8b6d-494d-aa28-62cf72c1481b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:59.718870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920913a4-9134-4048-a665-6cbf6d0e5370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:50:59.721338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920913a4-9134-4048-a665-6cbf6d0e5370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:59.725055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920913a4-9134-4048-a665-6cbf6d0e5370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:59.726014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920913a4-9134-4048-a665-6cbf6d0e5370 admin admin] PATH_INFO: `/v3/projects/42f020a5225e486a93f808c84cae809f` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:59.731479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920913a4-9134-4048-a665-6cbf6d0e5370 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42f020a5225e486a93f808c84cae809f)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:50:59.738950 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920913a4-9134-4048-a665-6cbf6d0e5370 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:50:59.752223 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4200/8483] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:50:59 2022] PUT /identity/v3/projects/2bd8662019804060a7b712456d095ad2/users/073f0cff787a466a9fbf9fb43b03b726/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:50:59.766427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d69eb-573b-4384-bf7f-bb3a867de1f4 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:59.767549 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d69eb-573b-4384-bf7f-bb3a867de1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:59.768032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d69eb-573b-4384-bf7f-bb3a867de1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:59.808485 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:50:59.846600 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-235d69eb-573b-4384-bf7f-bb3a867de1f4 None None] MFA Rules not processed for user `073f0cff787a466a9fbf9fb43b03b726`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:50:59.848971 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-235d69eb-573b-4384-bf7f-bb3a867de1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:50:59.860444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-920913a4-9134-4048-a665-6cbf6d0e5370 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42f020a5225e486a93f808c84cae809f', 'request_id': 'req-920913a4-9134-4048-a665-6cbf6d0e5370'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:59.873657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-920913a4-9134-4048-a665-6cbf6d0e5370 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42f020a5225e486a93f808c84cae809f', 'request_id': 'req-920913a4-9134-4048-a665-6cbf6d0e5370'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:59.894302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-920913a4-9134-4048-a665-6cbf6d0e5370 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42f020a5225e486a93f808c84cae809f', 'request_id': 'req-920913a4-9134-4048-a665-6cbf6d0e5370'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:59.919674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-920913a4-9134-4048-a665-6cbf6d0e5370 admin admin] The token cache is being invalidate because project 42f020a5225e486a93f808c84cae809f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:50:59.920067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-920913a4-9134-4048-a665-6cbf6d0e5370 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:59.922374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-920913a4-9134-4048-a665-6cbf6d0e5370 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:50:59.925225 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4284/8484] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:50:59 2022] DELETE /identity/v3/projects/42f020a5225e486a93f808c84cae809f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:50:59.931019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f882d9-c276-44a3-8b1b-29d094a80e6b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:50:59.931490 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f882d9-c276-44a3-8b1b-29d094a80e6b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:50:59.931865 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f882d9-c276-44a3-8b1b-29d094a80e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:50:59.978303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-02f882d9-c276-44a3-8b1b-29d094a80e6b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:50:59.981466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-02f882d9-c276-44a3-8b1b-29d094a80e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:00.025452 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4201/8485] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:50:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:51:00.031005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d69eb-573b-4384-bf7f-bb3a867de1f4 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:00.036661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-235d69eb-573b-4384-bf7f-bb3a867de1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:00.129243 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:00.154335 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4285/8486] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:51:00.162384 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d93aef-de79-4b22-b44a-641649aa4948 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:00.162803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d93aef-de79-4b22-b44a-641649aa4948 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:00.163174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d93aef-de79-4b22-b44a-641649aa4948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:00.216248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d69eb-573b-4384-bf7f-bb3a867de1f4 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:00.221734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-95d93aef-de79-4b22-b44a-641649aa4948 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:51:00.223752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-95d93aef-de79-4b22-b44a-641649aa4948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:00.224616 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb71e2a-b013-490c-96ee-7311ddd34a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:00.225446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb71e2a-b013-490c-96ee-7311ddd34a52 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:00.225574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb71e2a-b013-490c-96ee-7311ddd34a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:00.225800 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb71e2a-b013-490c-96ee-7311ddd34a52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:00.226447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb71e2a-b013-490c-96ee-7311ddd34a52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:00.229245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb71e2a-b013-490c-96ee-7311ddd34a52 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:00.248935 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4286/8487] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:51:00.252888 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d93aef-de79-4b22-b44a-641649aa4948 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:00.300432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d93aef-de79-4b22-b44a-641649aa4948 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:00.321957 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4202/8488] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:51:00 2022] POST /identity/v3/projects => generated 375 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:51:00.326521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb71e2a-b013-490c-96ee-7311ddd34a52 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:00.331168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94089c-3cab-4ca0-b729-93c73217aeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:00.332785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94089c-3cab-4ca0-b729-93c73217aeb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:00.333362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94089c-3cab-4ca0-b729-93c73217aeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:00.333637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94089c-3cab-4ca0-b729-93c73217aeb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:00.334367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94089c-3cab-4ca0-b729-93c73217aeb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:51:00.334678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94089c-3cab-4ca0-b729-93c73217aeb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:00.336614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94089c-3cab-4ca0-b729-93c73217aeb0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:00.354197 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4287/8489] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:51:00.358982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94089c-3cab-4ca0-b729-93c73217aeb0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:00.388471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94089c-3cab-4ca0-b729-93c73217aeb0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:00.482404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb71e2a-b013-490c-96ee-7311ddd34a52 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:00.498270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1b5af-cc2d-4999-b171-4a409fedc876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:00.499349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1b5af-cc2d-4999-b171-4a409fedc876 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:00.499349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1b5af-cc2d-4999-b171-4a409fedc876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:00.508363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1b5af-cc2d-4999-b171-4a409fedc876 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:00.509306 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1b5af-cc2d-4999-b171-4a409fedc876 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:00.513862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1b5af-cc2d-4999-b171-4a409fedc876 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:00.572325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89beff-3a5c-4605-8c8e-9b98939767a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:00.573167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89beff-3a5c-4605-8c8e-9b98939767a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:00.573453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89beff-3a5c-4605-8c8e-9b98939767a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:00.573725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89beff-3a5c-4605-8c8e-9b98939767a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:00.582238 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89beff-3a5c-4605-8c8e-9b98939767a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:00.584631 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4203/8490] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:51:00 2022] POST /identity/v3/users => generated 294 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:51:00.585226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89beff-3a5c-4605-8c8e-9b98939767a6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:00.586729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1b5af-cc2d-4999-b171-4a409fedc876 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:00.631154 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1b5af-cc2d-4999-b171-4a409fedc876 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:00.653893 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4288/8491] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:51:00 2022] POST /identity/v3/projects => generated 373 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:51:00.656708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3265ed-c9d5-4abe-a68f-8b158caaa95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:00.657411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89beff-3a5c-4605-8c8e-9b98939767a6 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:00.662688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3265ed-c9d5-4abe-a68f-8b158caaa95d admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:00.666680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3265ed-c9d5-4abe-a68f-8b158caaa95d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:00.668113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3265ed-c9d5-4abe-a68f-8b158caaa95d admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:00.669087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3265ed-c9d5-4abe-a68f-8b158caaa95d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:00.677345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3265ed-c9d5-4abe-a68f-8b158caaa95d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:00.707033 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4204/8492] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:51:00.715219 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:00.729224 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3265ed-c9d5-4abe-a68f-8b158caaa95d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:00.765903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3265ed-c9d5-4abe-a68f-8b158caaa95d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:00.807802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89beff-3a5c-4605-8c8e-9b98939767a6 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:00.823061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580cd21-cff1-4fb0-ab05-2746c5aa174f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:00.823918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580cd21-cff1-4fb0-ab05-2746c5aa174f admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:00.824307 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580cd21-cff1-4fb0-ab05-2746c5aa174f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:00.824683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580cd21-cff1-4fb0-ab05-2746c5aa174f admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:00.825420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580cd21-cff1-4fb0-ab05-2746c5aa174f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:00.828279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580cd21-cff1-4fb0-ab05-2746c5aa174f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:00.856525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31870cb-bf26-4b82-97d1-1021d31b4648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:00.859409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31870cb-bf26-4b82-97d1-1021d31b4648 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:00.859971 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31870cb-bf26-4b82-97d1-1021d31b4648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:00.860454 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31870cb-bf26-4b82-97d1-1021d31b4648 admin admin] PATH_INFO: `/v3/projects/bcb7e4473b5d46bf9231103e1f8e1b4b/users/82d128ecd4864274ac86b10bc99e0a04/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:00.891552 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4289/8493] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:51:00 2022] POST /identity/v3/users => generated 287 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:51:00.892945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580cd21-cff1-4fb0-ab05-2746c5aa174f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:00.893776 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31870cb-bf26-4b82-97d1-1021d31b4648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcb7e4473b5d46bf9231103e1f8e1b4b, user_id=82d128ecd4864274ac86b10bc99e0a04, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:00.897084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31870cb-bf26-4b82-97d1-1021d31b4648 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:00.910522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580cd21-cff1-4fb0-ab05-2746c5aa174f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:00.921583 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4205/8494] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:51:00 2022] PUT /identity/v3/projects/bcb7e4473b5d46bf9231103e1f8e1b4b/users/82d128ecd4864274ac86b10bc99e0a04/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:51:00.926591 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31870cb-bf26-4b82-97d1-1021d31b4648 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:00.989529 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:01.006099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52497c5-23c5-40c6-b695-a380bfb1008d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:01.006843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52497c5-23c5-40c6-b695-a380bfb1008d admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:01.007192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52497c5-23c5-40c6-b695-a380bfb1008d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:01.007537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52497c5-23c5-40c6-b695-a380bfb1008d admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:01.008343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52497c5-23c5-40c6-b695-a380bfb1008d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:01.010165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52497c5-23c5-40c6-b695-a380bfb1008d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:01.029292 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4290/8495] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:51:01.033544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52497c5-23c5-40c6-b695-a380bfb1008d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:01.046466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52497c5-23c5-40c6-b695-a380bfb1008d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:01.055556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0035eee-1ca3-4050-92bb-09fbb375998e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:01.056431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0035eee-1ca3-4050-92bb-09fbb375998e admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:01.056650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0035eee-1ca3-4050-92bb-09fbb375998e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:01.057014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0035eee-1ca3-4050-92bb-09fbb375998e admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:01.057774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0035eee-1ca3-4050-92bb-09fbb375998e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:01.059484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0035eee-1ca3-4050-92bb-09fbb375998e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:01.078566 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4291/8496] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:51:01.080353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0035eee-1ca3-4050-92bb-09fbb375998e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:01.096459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0035eee-1ca3-4050-92bb-09fbb375998e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:01.101941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f966fe2-d143-4427-b5b4-f81eaf1e6fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:01.102705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f966fe2-d143-4427-b5b4-f81eaf1e6fea admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:01.103074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f966fe2-d143-4427-b5b4-f81eaf1e6fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:01.103415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f966fe2-d143-4427-b5b4-f81eaf1e6fea admin admin] PATH_INFO: `/v3/projects/bd305a2d869b463e93216bda3ce7584d/users/44781e4b968449b7b7d545450db56527/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:01.113860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31870cb-bf26-4b82-97d1-1021d31b4648 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:01.120856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddf80a-0924-431d-89f5-9049ff68b676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:01.121719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddf80a-0924-431d-89f5-9049ff68b676 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:01.122183 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddf80a-0924-431d-89f5-9049ff68b676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:01.122749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddf80a-0924-431d-89f5-9049ff68b676 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:01.123789 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f966fe2-d143-4427-b5b4-f81eaf1e6fea admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd305a2d869b463e93216bda3ce7584d, user_id=44781e4b968449b7b7d545450db56527, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:01.124207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dddf80a-0924-431d-89f5-9049ff68b676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:01.126593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dddf80a-0924-431d-89f5-9049ff68b676 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:01.127555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f966fe2-d143-4427-b5b4-f81eaf1e6fea admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:01.161102 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4292/8497] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:51:01 2022] PUT /identity/v3/projects/bd305a2d869b463e93216bda3ce7584d/users/44781e4b968449b7b7d545450db56527/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:51:01.166134 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4206/8498] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:51:01.167347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f966fe2-d143-4427-b5b4-f81eaf1e6fea admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:01.173808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c1ded-1f83-440a-be8d-06a23e078403 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:01.174108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c1ded-1f83-440a-be8d-06a23e078403 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:01.175855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c1ded-1f83-440a-be8d-06a23e078403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:01.266321 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-cd1c1ded-1f83-440a-be8d-06a23e078403 None None] MFA Rules not processed for user `44781e4b968449b7b7d545450db56527`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:51:01.267920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cd1c1ded-1f83-440a-be8d-06a23e078403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:01.401202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f966fe2-d143-4427-b5b4-f81eaf1e6fea admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:01.420343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570cceb-7a57-4f78-9152-fd84aed6b860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:01.421233 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570cceb-7a57-4f78-9152-fd84aed6b860 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:01.421362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570cceb-7a57-4f78-9152-fd84aed6b860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:01.421575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570cceb-7a57-4f78-9152-fd84aed6b860 admin admin] PATH_INFO: `/v3/projects/bcb7e4473b5d46bf9231103e1f8e1b4b/users/82d128ecd4864274ac86b10bc99e0a04/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:01.423728 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570cceb-7a57-4f78-9152-fd84aed6b860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcb7e4473b5d46bf9231103e1f8e1b4b, user_id=82d128ecd4864274ac86b10bc99e0a04, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:01.430812 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4207/8499] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:51:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:51:01.430955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570cceb-7a57-4f78-9152-fd84aed6b860 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:01.442764 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c1ded-1f83-440a-be8d-06a23e078403 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:01.446005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cd1c1ded-1f83-440a-be8d-06a23e078403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:01.469552 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4293/8500] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:51:01 2022] PUT /identity/v3/projects/bcb7e4473b5d46bf9231103e1f8e1b4b/users/82d128ecd4864274ac86b10bc99e0a04/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:51:01.473368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e299b67-5537-4a8c-bd90-3b704fc601bf None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:01.473700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e299b67-5537-4a8c-bd90-3b704fc601bf None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:01.473982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e299b67-5537-4a8c-bd90-3b704fc601bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:01.482901 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:01.556158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0e299b67-5537-4a8c-bd90-3b704fc601bf None None] MFA Rules not processed for user `82d128ecd4864274ac86b10bc99e0a04`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:51:01.565690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0e299b67-5537-4a8c-bd90-3b704fc601bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:01.589065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c1ded-1f83-440a-be8d-06a23e078403 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:01.712980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa6b03-5b2c-42b4-8750-c894b1dc713b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:01.713766 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa6b03-5b2c-42b4-8750-c894b1dc713b service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:01.714052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa6b03-5b2c-42b4-8750-c894b1dc713b service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:01.714328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa6b03-5b2c-42b4-8750-c894b1dc713b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:01.736326 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:01.847748 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4294/8501] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:51:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:51:01.854569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e299b67-5537-4a8c-bd90-3b704fc601bf None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:01.855388 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa6b03-5b2c-42b4-8750-c894b1dc713b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:01.856987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0e299b67-5537-4a8c-bd90-3b704fc601bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:01.863054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa6b03-5b2c-42b4-8750-c894b1dc713b service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:01.892552 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4208/8502] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:51:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:51:01.911652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d08e27-520f-41e9-a66f-e8c653001023 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:01.912006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d08e27-520f-41e9-a66f-e8c653001023 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:01.912396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d08e27-520f-41e9-a66f-e8c653001023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:01.976036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-05d08e27-520f-41e9-a66f-e8c653001023 None None] MFA Rules not processed for user `56d8bcf448eb47ea8d50e38bd30e60a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:51:01.978231 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-05d08e27-520f-41e9-a66f-e8c653001023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:02.030152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e299b67-5537-4a8c-bd90-3b704fc601bf None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:02.038707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70a784-4b59-4da3-bba4-df801c205329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:02.040257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70a784-4b59-4da3-bba4-df801c205329 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:02.040257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70a784-4b59-4da3-bba4-df801c205329 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:02.040257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70a784-4b59-4da3-bba4-df801c205329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:02.126648 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4209/8503] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:51:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:51:02.126648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d08e27-520f-41e9-a66f-e8c653001023 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:02.151150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70a784-4b59-4da3-bba4-df801c205329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:02.152774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70a784-4b59-4da3-bba4-df801c205329 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:02.189379 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4295/8504] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:51:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:51:02.190639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70a784-4b59-4da3-bba4-df801c205329 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:02.194650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5d70a784-4b59-4da3-bba4-df801c205329 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:02.234999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70a784-4b59-4da3-bba4-df801c205329 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:02.240223 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05061e8-9c75-4a26-b122-c380f64a861b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:02.240873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05061e8-9c75-4a26-b122-c380f64a861b service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:02.241142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05061e8-9c75-4a26-b122-c380f64a861b service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:02.241417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05061e8-9c75-4a26-b122-c380f64a861b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:02.285192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05061e8-9c75-4a26-b122-c380f64a861b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:02.286959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05061e8-9c75-4a26-b122-c380f64a861b service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:02.300094 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4296/8505] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:51:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:51:02.578945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05061e8-9c75-4a26-b122-c380f64a861b service cinder] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:02.594374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05061e8-9c75-4a26-b122-c380f64a861b service cinder] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:02.605878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389f6de-c70a-4610-a6c8-9c54f6b6c07c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:02.609255 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389f6de-c70a-4610-a6c8-9c54f6b6c07c service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:02.612385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389f6de-c70a-4610-a6c8-9c54f6b6c07c service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:02.613340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389f6de-c70a-4610-a6c8-9c54f6b6c07c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:02.621503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3389f6de-c70a-4610-a6c8-9c54f6b6c07c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:02.675066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d08e27-520f-41e9-a66f-e8c653001023 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:02.693634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea377750-f9c1-45dc-869b-111a97407cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:02.694640 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea377750-f9c1-45dc-869b-111a97407cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:02.695362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea377750-f9c1-45dc-869b-111a97407cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:02.696036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea377750-f9c1-45dc-869b-111a97407cdf admin admin] PATH_INFO: `/v3/users/44781e4b968449b7b7d545450db56527` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:02.697423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea377750-f9c1-45dc-869b-111a97407cdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=44781e4b968449b7b7d545450db56527)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:02.699578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea377750-f9c1-45dc-869b-111a97407cdf admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:02.735346 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:02.772439 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:02.808513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ea377750-f9c1-45dc-869b-111a97407cdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44781e4b968449b7b7d545450db56527'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:51:02.828186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ea377750-f9c1-45dc-869b-111a97407cdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44781e4b968449b7b7d545450db56527'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:51:02.844298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389f6de-c70a-4610-a6c8-9c54f6b6c07c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:02.847041 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389f6de-c70a-4610-a6c8-9c54f6b6c07c service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:02.859794 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4297/8506] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:51:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:51:02.869500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ea377750-f9c1-45dc-869b-111a97407cdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44781e4b968449b7b7d545450db56527'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:51:02.870521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ea377750-f9c1-45dc-869b-111a97407cdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44781e4b968449b7b7d545450db56527'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:51:02.893327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ea377750-f9c1-45dc-869b-111a97407cdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44781e4b968449b7b7d545450db56527'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:51:02.916262 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4210/8507] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:51:02 2022] DELETE /identity/v3/users/44781e4b968449b7b7d545450db56527 => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:51:02.920818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f115c0c-9830-42b4-ad53-b7f7e5e96955 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:02.921469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f115c0c-9830-42b4-ad53-b7f7e5e96955 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:02.921958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f115c0c-9830-42b4-ad53-b7f7e5e96955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:03.009705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6f115c0c-9830-42b4-ad53-b7f7e5e96955 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:51:03.012251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6f115c0c-9830-42b4-ad53-b7f7e5e96955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:03.154411 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4298/8508] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:51:03.165256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea377750-f9c1-45dc-869b-111a97407cdf admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:03.166792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ea377750-f9c1-45dc-869b-111a97407cdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:03.349894 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea377750-f9c1-45dc-869b-111a97407cdf admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:03.361499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ccfbc-a018-4ddb-b770-60fd0eb7aa02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:03.362113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ccfbc-a018-4ddb-b770-60fd0eb7aa02 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:03.363025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ccfbc-a018-4ddb-b770-60fd0eb7aa02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:03.363025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ccfbc-a018-4ddb-b770-60fd0eb7aa02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:03.375052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ccfbc-a018-4ddb-b770-60fd0eb7aa02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:03.376405 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ccfbc-a018-4ddb-b770-60fd0eb7aa02 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:03.399904 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4211/8509] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:51:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:51:03.995323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f115c0c-9830-42b4-ad53-b7f7e5e96955 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:03.996815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6f115c0c-9830-42b4-ad53-b7f7e5e96955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:04.020313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f115c0c-9830-42b4-ad53-b7f7e5e96955 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:04.026079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7d346-ab04-4149-b7bd-08448cb0a29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:04.026423 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7d346-ab04-4149-b7bd-08448cb0a29f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:04.026703 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7d346-ab04-4149-b7bd-08448cb0a29f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:04.026976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7d346-ab04-4149-b7bd-08448cb0a29f admin admin] PATH_INFO: `/v3/projects/bd305a2d869b463e93216bda3ce7584d` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:04.028182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7d346-ab04-4149-b7bd-08448cb0a29f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd305a2d869b463e93216bda3ce7584d)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:04.030729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7d346-ab04-4149-b7bd-08448cb0a29f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:04.106691 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-15b7d346-ab04-4149-b7bd-08448cb0a29f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd305a2d869b463e93216bda3ce7584d', 'request_id': 'req-15b7d346-ab04-4149-b7bd-08448cb0a29f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:51:04.147874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-15b7d346-ab04-4149-b7bd-08448cb0a29f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd305a2d869b463e93216bda3ce7584d', 'request_id': 'req-15b7d346-ab04-4149-b7bd-08448cb0a29f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:51:04.162106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-15b7d346-ab04-4149-b7bd-08448cb0a29f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd305a2d869b463e93216bda3ce7584d', 'request_id': 'req-15b7d346-ab04-4149-b7bd-08448cb0a29f'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:51:04.187494 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-15b7d346-ab04-4149-b7bd-08448cb0a29f admin admin] The token cache is being invalidate because project bd305a2d869b463e93216bda3ce7584d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:51:04.187742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-15b7d346-ab04-4149-b7bd-08448cb0a29f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:51:04.189936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-15b7d346-ab04-4149-b7bd-08448cb0a29f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:51:04.196744 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4299/8510] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:51:03 2022] DELETE /identity/v3/projects/bd305a2d869b463e93216bda3ce7584d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:51:04.198052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a5c7d-d70d-400a-b8fe-57d2972c1190 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:04.199533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a5c7d-d70d-400a-b8fe-57d2972c1190 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:04.200025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a5c7d-d70d-400a-b8fe-57d2972c1190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:04.235486 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-de7a5c7d-d70d-400a-b8fe-57d2972c1190 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:51:04.237543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-de7a5c7d-d70d-400a-b8fe-57d2972c1190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:04.307831 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4212/8511] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:51:04.316958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204454f-ac66-47c0-b9ad-141752d1015a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:04.320750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204454f-ac66-47c0-b9ad-141752d1015a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:04.321202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204454f-ac66-47c0-b9ad-141752d1015a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:04.357856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-7204454f-ac66-47c0-b9ad-141752d1015a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:51:04.359196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7204454f-ac66-47c0-b9ad-141752d1015a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:04.369080 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4300/8512] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:51:04.374469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a5c7d-d70d-400a-b8fe-57d2972c1190 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:04.387139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a5c7d-d70d-400a-b8fe-57d2972c1190 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:04.399849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c1212-9d9e-43e8-b909-d43652135a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:04.400578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c1212-9d9e-43e8-b909-d43652135a5c admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:04.400931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c1212-9d9e-43e8-b909-d43652135a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:04.401274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c1212-9d9e-43e8-b909-d43652135a5c admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:04.402363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c1212-9d9e-43e8-b909-d43652135a5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:51:04.403079 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c1212-9d9e-43e8-b909-d43652135a5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:04.405623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c1212-9d9e-43e8-b909-d43652135a5c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:04.435577 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4213/8513] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:51:04.440744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204454f-ac66-47c0-b9ad-141752d1015a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:04.454385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204454f-ac66-47c0-b9ad-141752d1015a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:04.469236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed2ca4-f065-4b58-8beb-0b3390a2a71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:04.470614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed2ca4-f065-4b58-8beb-0b3390a2a71f admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:04.472339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed2ca4-f065-4b58-8beb-0b3390a2a71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:04.472694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed2ca4-f065-4b58-8beb-0b3390a2a71f admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:04.476061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed2ca4-f065-4b58-8beb-0b3390a2a71f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:04.481054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed2ca4-f065-4b58-8beb-0b3390a2a71f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:04.547563 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4301/8514] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:51:04 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:51:04.552193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c1212-9d9e-43e8-b909-d43652135a5c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:04.567330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c1212-9d9e-43e8-b909-d43652135a5c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:04.707244 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:04.731135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e364fc1-8eea-41c0-b005-ce4fd9d5f0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:04.731779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e364fc1-8eea-41c0-b005-ce4fd9d5f0ca admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:04.732092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e364fc1-8eea-41c0-b005-ce4fd9d5f0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:04.732377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e364fc1-8eea-41c0-b005-ce4fd9d5f0ca admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:04.732998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e364fc1-8eea-41c0-b005-ce4fd9d5f0ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:04.734952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e364fc1-8eea-41c0-b005-ce4fd9d5f0ca admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:04.819761 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4214/8515] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:51:04 2022] POST /identity/v3/users => generated 291 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:51:04.825021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed2ca4-f065-4b58-8beb-0b3390a2a71f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:04.845757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed2ca4-f065-4b58-8beb-0b3390a2a71f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:04.872743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88263a8a-5f06-4d3d-93e7-4a9261d70601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:04.873807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88263a8a-5f06-4d3d-93e7-4a9261d70601 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:04.874092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88263a8a-5f06-4d3d-93e7-4a9261d70601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:04.874362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88263a8a-5f06-4d3d-93e7-4a9261d70601 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:04.875024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88263a8a-5f06-4d3d-93e7-4a9261d70601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:04.876825 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88263a8a-5f06-4d3d-93e7-4a9261d70601 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:04.902376 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4302/8516] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:51:04.906291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e364fc1-8eea-41c0-b005-ce4fd9d5f0ca admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:04.917842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e364fc1-8eea-41c0-b005-ce4fd9d5f0ca admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:04.922748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574009d7-d630-43e4-90e6-4db336760029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:04.923389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574009d7-d630-43e4-90e6-4db336760029 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:04.923664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574009d7-d630-43e4-90e6-4db336760029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:04.923960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574009d7-d630-43e4-90e6-4db336760029 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:04.924671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574009d7-d630-43e4-90e6-4db336760029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:04.926440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574009d7-d630-43e4-90e6-4db336760029 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:04.943142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88263a8a-5f06-4d3d-93e7-4a9261d70601 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:04.955309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88263a8a-5f06-4d3d-93e7-4a9261d70601 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:04.955997 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4215/8517] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:51:04.993249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edfefdb-4ad0-411f-825a-8d7973cbb635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:04.997358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfefdb-4ad0-411f-825a-8d7973cbb635 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:04.998253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfefdb-4ad0-411f-825a-8d7973cbb635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:04.998253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfefdb-4ad0-411f-825a-8d7973cbb635 admin admin] PATH_INFO: `/v3/projects/d55c960c7d2941069c7d09120b6de3e3/users/ac8868e4dd7b434da512a14d1df59609/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:05.015929 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:05.054343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edfefdb-4ad0-411f-825a-8d7973cbb635 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d55c960c7d2941069c7d09120b6de3e3, user_id=ac8868e4dd7b434da512a14d1df59609, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:05.057358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edfefdb-4ad0-411f-825a-8d7973cbb635 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:05.097435 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4303/8518] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:51:04 2022] PUT /identity/v3/projects/d55c960c7d2941069c7d09120b6de3e3/users/ac8868e4dd7b434da512a14d1df59609/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:51:05.102606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10f7af-7e55-4ff2-a028-16e59023abab None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:05.103078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10f7af-7e55-4ff2-a028-16e59023abab None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:05.103428 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10f7af-7e55-4ff2-a028-16e59023abab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:05.130894 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3c10f7af-7e55-4ff2-a028-16e59023abab None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:51:05.132539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3c10f7af-7e55-4ff2-a028-16e59023abab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:05.344239 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4216/8519] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:51:05.354199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edfefdb-4ad0-411f-825a-8d7973cbb635 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:05.356380 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6edfefdb-4ad0-411f-825a-8d7973cbb635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:05.491862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10f7af-7e55-4ff2-a028-16e59023abab None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:05.496248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3c10f7af-7e55-4ff2-a028-16e59023abab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:05.529733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edfefdb-4ad0-411f-825a-8d7973cbb635 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:05.540160 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb44d5-471f-47d7-8920-56959eb4f6c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:05.540803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb44d5-471f-47d7-8920-56959eb4f6c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:05.541083 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb44d5-471f-47d7-8920-56959eb4f6c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:05.541393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb44d5-471f-47d7-8920-56959eb4f6c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:05.571138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb44d5-471f-47d7-8920-56959eb4f6c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:05.572817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eb44d5-471f-47d7-8920-56959eb4f6c6 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:05.600953 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4304/8520] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:51:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:51:05.664810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10f7af-7e55-4ff2-a028-16e59023abab None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:05.676673 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277364e-b21e-4723-9750-24fe08774b1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:05.679159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277364e-b21e-4723-9750-24fe08774b1c service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:05.680056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277364e-b21e-4723-9750-24fe08774b1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:05.680865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277364e-b21e-4723-9750-24fe08774b1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:05.684237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2277364e-b21e-4723-9750-24fe08774b1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:05.835355 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277364e-b21e-4723-9750-24fe08774b1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:05.840788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2277364e-b21e-4723-9750-24fe08774b1c service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:05.874988 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4217/8521] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:51:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:51:06.200359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78e3a2-bcee-410b-967a-b8264f6f8da8 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:06.201672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78e3a2-bcee-410b-967a-b8264f6f8da8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:06.203223 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78e3a2-bcee-410b-967a-b8264f6f8da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:06.282387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ee78e3a2-bcee-410b-967a-b8264f6f8da8 None None] MFA Rules not processed for user `661f6c9aa7da4e348a9b0d91840078c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:51:06.284890 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ee78e3a2-bcee-410b-967a-b8264f6f8da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:06.502486 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4305/8522] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:51:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:51:06.647422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277364e-b21e-4723-9750-24fe08774b1c service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:06.649770 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2277364e-b21e-4723-9750-24fe08774b1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:06.669737 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:06.761283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277364e-b21e-4723-9750-24fe08774b1c service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:06.777473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076edeb-d1bd-414d-afd9-da7ba88aba0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:06.778121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076edeb-d1bd-414d-afd9-da7ba88aba0d service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:06.778504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076edeb-d1bd-414d-afd9-da7ba88aba0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:06.778678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076edeb-d1bd-414d-afd9-da7ba88aba0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:06.787030 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3076edeb-d1bd-414d-afd9-da7ba88aba0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:06.920539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076edeb-d1bd-414d-afd9-da7ba88aba0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:06.922395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076edeb-d1bd-414d-afd9-da7ba88aba0d service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:06.943544 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4218/8523] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:51:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:51:07.452624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78e3a2-bcee-410b-967a-b8264f6f8da8 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:07.455363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ee78e3a2-bcee-410b-967a-b8264f6f8da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:07.481621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78e3a2-bcee-410b-967a-b8264f6f8da8 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:07.493387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b0126-de26-435b-9a1f-303728823c07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:07.494127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b0126-de26-435b-9a1f-303728823c07 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:07.494415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b0126-de26-435b-9a1f-303728823c07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:07.494692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b0126-de26-435b-9a1f-303728823c07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:07.499649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dc7b0126-de26-435b-9a1f-303728823c07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:07.533865 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b0126-de26-435b-9a1f-303728823c07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:07.535429 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b0126-de26-435b-9a1f-303728823c07 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:07.562171 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4306/8524] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:51:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:51:08.786123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076edeb-d1bd-414d-afd9-da7ba88aba0d service cinder] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:08.800848 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b0126-de26-435b-9a1f-303728823c07 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:08.803349 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dc7b0126-de26-435b-9a1f-303728823c07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:08.821319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076edeb-d1bd-414d-afd9-da7ba88aba0d service cinder] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:08.837491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66578cb-11c0-4707-ab8d-c150c624bf3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:08.842082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66578cb-11c0-4707-ab8d-c150c624bf3c service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:08.845642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66578cb-11c0-4707-ab8d-c150c624bf3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:08.852364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66578cb-11c0-4707-ab8d-c150c624bf3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:08.860918 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c66578cb-11c0-4707-ab8d-c150c624bf3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:08.896368 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66578cb-11c0-4707-ab8d-c150c624bf3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:08.898236 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66578cb-11c0-4707-ab8d-c150c624bf3c service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:08.949001 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4219/8525] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:51:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:51:09.002989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b0126-de26-435b-9a1f-303728823c07 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:09.009448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610524c-2a9f-4075-b888-f37a821dae98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:09.010664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610524c-2a9f-4075-b888-f37a821dae98 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:09.010956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610524c-2a9f-4075-b888-f37a821dae98 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:09.011234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610524c-2a9f-4075-b888-f37a821dae98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:09.033310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9610524c-2a9f-4075-b888-f37a821dae98 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:09.081161 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:09.161907 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610524c-2a9f-4075-b888-f37a821dae98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:09.166256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610524c-2a9f-4075-b888-f37a821dae98 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:09.189233 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4307/8526] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:51:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:51:17.199261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462398d1-d335-4668-8ad0-e3b823afec41 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:17.200811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462398d1-d335-4668-8ad0-e3b823afec41 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:17.201257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462398d1-d335-4668-8ad0-e3b823afec41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:17.282017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-462398d1-d335-4668-8ad0-e3b823afec41 None None] MFA Rules not processed for user `ac8868e4dd7b434da512a14d1df59609`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:51:17.285068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-462398d1-d335-4668-8ad0-e3b823afec41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:17.480809 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4220/8527] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:51:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:51:17.485996 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610524c-2a9f-4075-b888-f37a821dae98 service swift] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:17.523201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610524c-2a9f-4075-b888-f37a821dae98 service swift] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:17.574003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab9c13-6b7b-4d70-b965-0a170e8735a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:17.574766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab9c13-6b7b-4d70-b965-0a170e8735a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:17.575074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab9c13-6b7b-4d70-b965-0a170e8735a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:17.575354 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab9c13-6b7b-4d70-b965-0a170e8735a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:17.576048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab9c13-6b7b-4d70-b965-0a170e8735a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:17.578054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab9c13-6b7b-4d70-b965-0a170e8735a0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:17.687405 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4308/8528] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:51:17 2022] POST /identity/v3/projects => generated 381 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:51:17.691962 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462398d1-d335-4668-8ad0-e3b823afec41 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:17.747141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462398d1-d335-4668-8ad0-e3b823afec41 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:17.832638 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:17.953650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c25a89-aad9-4e4a-b316-80e091d38440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:17.955015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c25a89-aad9-4e4a-b316-80e091d38440 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:17.955304 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c25a89-aad9-4e4a-b316-80e091d38440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:17.955582 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c25a89-aad9-4e4a-b316-80e091d38440 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:17.956905 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c25a89-aad9-4e4a-b316-80e091d38440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:17.958903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c25a89-aad9-4e4a-b316-80e091d38440 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:18.049210 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4221/8529] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:51:17 2022] POST /identity/v3/users => generated 297 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:51:18.053358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab9c13-6b7b-4d70-b965-0a170e8735a0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:18.075066 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab9c13-6b7b-4d70-b965-0a170e8735a0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:18.089583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec3eb6-a1e6-42a7-ae83-30e6637931ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:18.090498 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec3eb6-a1e6-42a7-ae83-30e6637931ce admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:18.091067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec3eb6-a1e6-42a7-ae83-30e6637931ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:18.091504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec3eb6-a1e6-42a7-ae83-30e6637931ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:18.092489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec3eb6-a1e6-42a7-ae83-30e6637931ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:18.094577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec3eb6-a1e6-42a7-ae83-30e6637931ce admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:18.117073 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4309/8530] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:51:18.121003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c25a89-aad9-4e4a-b316-80e091d38440 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:18.135458 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c25a89-aad9-4e4a-b316-80e091d38440 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:18.144092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5a994-8306-42e2-8874-3c51e0ede9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:18.146064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5a994-8306-42e2-8874-3c51e0ede9fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:18.146543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5a994-8306-42e2-8874-3c51e0ede9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:18.147123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5a994-8306-42e2-8874-3c51e0ede9fe admin admin] PATH_INFO: `/v3/projects/8dad25d99539478eb1468515e79b46ca/users/21953f6c2ae54d01b2e0922bf40f0e55/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:18.179326 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5a994-8306-42e2-8874-3c51e0ede9fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dad25d99539478eb1468515e79b46ca, user_id=21953f6c2ae54d01b2e0922bf40f0e55, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:18.182806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5a994-8306-42e2-8874-3c51e0ede9fe admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:18.230003 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4222/8531] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:51:18 2022] PUT /identity/v3/projects/8dad25d99539478eb1468515e79b46ca/users/21953f6c2ae54d01b2e0922bf40f0e55/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:51:18.235275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec3eb6-a1e6-42a7-ae83-30e6637931ce admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:18.269133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec3eb6-a1e6-42a7-ae83-30e6637931ce admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:18.495297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2d133-8ba3-44a1-9344-fceb9299dcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:18.496118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2d133-8ba3-44a1-9344-fceb9299dcf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:18.496401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2d133-8ba3-44a1-9344-fceb9299dcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:18.496673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2d133-8ba3-44a1-9344-fceb9299dcf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:18.497333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b2d133-8ba3-44a1-9344-fceb9299dcf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:18.499211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b2d133-8ba3-44a1-9344-fceb9299dcf5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:18.560435 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4310/8532] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:51:18.565356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5a994-8306-42e2-8874-3c51e0ede9fe admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:18.586112 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5a994-8306-42e2-8874-3c51e0ede9fe admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:18.649831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341086c-2c52-424f-a445-80121c180f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:18.655386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341086c-2c52-424f-a445-80121c180f1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:18.657072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341086c-2c52-424f-a445-80121c180f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:18.657438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341086c-2c52-424f-a445-80121c180f1d admin admin] PATH_INFO: `/v3/projects/8dad25d99539478eb1468515e79b46ca/users/21953f6c2ae54d01b2e0922bf40f0e55/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:18.673931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341086c-2c52-424f-a445-80121c180f1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dad25d99539478eb1468515e79b46ca, user_id=21953f6c2ae54d01b2e0922bf40f0e55, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:18.684116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341086c-2c52-424f-a445-80121c180f1d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:18.735852 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4223/8533] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:51:18 2022] PUT /identity/v3/projects/8dad25d99539478eb1468515e79b46ca/users/21953f6c2ae54d01b2e0922bf40f0e55/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:51:20.641656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2d133-8ba3-44a1-9344-fceb9299dcf5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:20.644454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b6b2d133-8ba3-44a1-9344-fceb9299dcf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:20.844462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2d133-8ba3-44a1-9344-fceb9299dcf5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:20.969175 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:21.057396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f5e78-e532-48ff-9e11-d9ce81c26103 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:21.057884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f5e78-e532-48ff-9e11-d9ce81c26103 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:21.058166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f5e78-e532-48ff-9e11-d9ce81c26103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:21.118629 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2c6f5e78-e532-48ff-9e11-d9ce81c26103 None None] MFA Rules not processed for user `073f0cff787a466a9fbf9fb43b03b726`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:51:21.120526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2c6f5e78-e532-48ff-9e11-d9ce81c26103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:21.185310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84df97d-43ca-48b9-82c3-36db0ab67d40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:21.186024 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84df97d-43ca-48b9-82c3-36db0ab67d40 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:21.190220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84df97d-43ca-48b9-82c3-36db0ab67d40 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:21.190469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84df97d-43ca-48b9-82c3-36db0ab67d40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:21.200874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c84df97d-43ca-48b9-82c3-36db0ab67d40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:21.284928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84df97d-43ca-48b9-82c3-36db0ab67d40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:21.292393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84df97d-43ca-48b9-82c3-36db0ab67d40 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:21.343132 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4311/8534] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:51:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:51:21.392058 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4224/8535] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:51:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:51:29.096888 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84df97d-43ca-48b9-82c3-36db0ab67d40 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:29.286349 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84df97d-43ca-48b9-82c3-36db0ab67d40 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:29.292894 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65de3f-55c3-45b9-8c3d-5fa156009fe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:29.293534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65de3f-55c3-45b9-8c3d-5fa156009fe3 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:29.293906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65de3f-55c3-45b9-8c3d-5fa156009fe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:29.294181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65de3f-55c3-45b9-8c3d-5fa156009fe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:29.308100 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-da65de3f-55c3-45b9-8c3d-5fa156009fe3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:29.342849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65de3f-55c3-45b9-8c3d-5fa156009fe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:29.344526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65de3f-55c3-45b9-8c3d-5fa156009fe3 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:29.404429 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4312/8536] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:51:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:51:30.062853 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7eecf2-a233-47fe-9f74-58486b294ece None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:30.063763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7eecf2-a233-47fe-9f74-58486b294ece None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:30.064217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7eecf2-a233-47fe-9f74-58486b294ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:30.145447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2b7eecf2-a233-47fe-9f74-58486b294ece None None] MFA Rules not processed for user `21953f6c2ae54d01b2e0922bf40f0e55`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:51:30.146881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2b7eecf2-a233-47fe-9f74-58486b294ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:30.415759 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4225/8537] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:51:30 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:51:30.426624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65de3f-55c3-45b9-8c3d-5fa156009fe3 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:30.428220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-da65de3f-55c3-45b9-8c3d-5fa156009fe3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:30.454491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65de3f-55c3-45b9-8c3d-5fa156009fe3 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:30.469578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11b8eb-9a88-4fa6-a4ec-67e7eb5378ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:30.470409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11b8eb-9a88-4fa6-a4ec-67e7eb5378ed service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:30.470872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11b8eb-9a88-4fa6-a4ec-67e7eb5378ed service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:30.472020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11b8eb-9a88-4fa6-a4ec-67e7eb5378ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:30.491979 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11b8eb-9a88-4fa6-a4ec-67e7eb5378ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:30.495219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11b8eb-9a88-4fa6-a4ec-67e7eb5378ed service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:30.513319 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4313/8538] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:51:30 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:51:30.956479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7eecf2-a233-47fe-9f74-58486b294ece None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:30.958232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2b7eecf2-a233-47fe-9f74-58486b294ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:30.992943 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:31.136552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7eecf2-a233-47fe-9f74-58486b294ece None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:31.142248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789c5f7-55c3-45ed-a76f-19715bcd6512 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:31.142915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789c5f7-55c3-45ed-a76f-19715bcd6512 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:31.143202 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789c5f7-55c3-45ed-a76f-19715bcd6512 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:31.143479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789c5f7-55c3-45ed-a76f-19715bcd6512 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:31.145467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4789c5f7-55c3-45ed-a76f-19715bcd6512 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:31.166578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789c5f7-55c3-45ed-a76f-19715bcd6512 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:31.168241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789c5f7-55c3-45ed-a76f-19715bcd6512 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:31.182776 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4226/8539] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:51:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:51:31.399788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11b8eb-9a88-4fa6-a4ec-67e7eb5378ed service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:31.430860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11b8eb-9a88-4fa6-a4ec-67e7eb5378ed service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:31.450230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c651bc3-f4d1-4b49-b43a-8529cd4aa6e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:31.451176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c651bc3-f4d1-4b49-b43a-8529cd4aa6e0 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:31.452990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c651bc3-f4d1-4b49-b43a-8529cd4aa6e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:31.453501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c651bc3-f4d1-4b49-b43a-8529cd4aa6e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:31.460214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7c651bc3-f4d1-4b49-b43a-8529cd4aa6e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:31.494437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c651bc3-f4d1-4b49-b43a-8529cd4aa6e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:31.496582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c651bc3-f4d1-4b49-b43a-8529cd4aa6e0 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:31.517153 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4314/8540] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:51:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:51:32.188442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789c5f7-55c3-45ed-a76f-19715bcd6512 service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:32.193672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4789c5f7-55c3-45ed-a76f-19715bcd6512 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:32.231183 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789c5f7-55c3-45ed-a76f-19715bcd6512 service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:32.255572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb10730-5f70-468f-a8f5-a2d2df58eca4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:32.256338 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb10730-5f70-468f-a8f5-a2d2df58eca4 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:32.256731 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb10730-5f70-468f-a8f5-a2d2df58eca4 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:32.258207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb10730-5f70-468f-a8f5-a2d2df58eca4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:32.261931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8fb10730-5f70-468f-a8f5-a2d2df58eca4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:32.313423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb10730-5f70-468f-a8f5-a2d2df58eca4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:32.318542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb10730-5f70-468f-a8f5-a2d2df58eca4 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:32.368207 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4227/8541] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:51:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:51:41.506676 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=61 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:42.335832 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=32 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:45.609199 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c651bc3-f4d1-4b49-b43a-8529cd4aa6e0 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:45.689151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c651bc3-f4d1-4b49-b43a-8529cd4aa6e0 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:45.695932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120abd5-9aee-4bde-a948-e0b2d2273251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:45.695932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120abd5-9aee-4bde-a948-e0b2d2273251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:45.696208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120abd5-9aee-4bde-a948-e0b2d2273251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:45.696335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120abd5-9aee-4bde-a948-e0b2d2273251 admin admin] PATH_INFO: `/v3/users/ac8868e4dd7b434da512a14d1df59609` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:45.697634 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120abd5-9aee-4bde-a948-e0b2d2273251 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac8868e4dd7b434da512a14d1df59609)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:45.700516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b120abd5-9aee-4bde-a948-e0b2d2273251 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:45.772083 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b120abd5-9aee-4bde-a948-e0b2d2273251 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac8868e4dd7b434da512a14d1df59609'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:51:45.781365 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b120abd5-9aee-4bde-a948-e0b2d2273251 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac8868e4dd7b434da512a14d1df59609'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:51:45.798170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b120abd5-9aee-4bde-a948-e0b2d2273251 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac8868e4dd7b434da512a14d1df59609'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:51:45.799049 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b120abd5-9aee-4bde-a948-e0b2d2273251 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac8868e4dd7b434da512a14d1df59609'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:51:45.820950 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-b120abd5-9aee-4bde-a948-e0b2d2273251 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac8868e4dd7b434da512a14d1df59609'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:51:45.844369 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4315/8542] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:51:45 2022] DELETE /identity/v3/users/ac8868e4dd7b434da512a14d1df59609 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:51:46.080670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb10730-5f70-468f-a8f5-a2d2df58eca4 service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:46.096810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb10730-5f70-468f-a8f5-a2d2df58eca4 service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:46.203632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b073a9-2875-4af5-a8bb-874aa9d637fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:46.204342 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b073a9-2875-4af5-a8bb-874aa9d637fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:46.204621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b073a9-2875-4af5-a8bb-874aa9d637fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:46.204900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b073a9-2875-4af5-a8bb-874aa9d637fe admin admin] PATH_INFO: `/v3/projects/d55c960c7d2941069c7d09120b6de3e3` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:46.206314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b073a9-2875-4af5-a8bb-874aa9d637fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d55c960c7d2941069c7d09120b6de3e3)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:46.208747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b073a9-2875-4af5-a8bb-874aa9d637fe admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:46.310547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-70b073a9-2875-4af5-a8bb-874aa9d637fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd55c960c7d2941069c7d09120b6de3e3', 'request_id': 'req-70b073a9-2875-4af5-a8bb-874aa9d637fe'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:51:46.318341 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-70b073a9-2875-4af5-a8bb-874aa9d637fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd55c960c7d2941069c7d09120b6de3e3', 'request_id': 'req-70b073a9-2875-4af5-a8bb-874aa9d637fe'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:51:46.326688 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-70b073a9-2875-4af5-a8bb-874aa9d637fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd55c960c7d2941069c7d09120b6de3e3', 'request_id': 'req-70b073a9-2875-4af5-a8bb-874aa9d637fe'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:51:46.348297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-70b073a9-2875-4af5-a8bb-874aa9d637fe admin admin] The token cache is being invalidate because project d55c960c7d2941069c7d09120b6de3e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:51:46.348807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-70b073a9-2875-4af5-a8bb-874aa9d637fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:51:46.349860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-70b073a9-2875-4af5-a8bb-874aa9d637fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:51:46.352430 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4228/8543] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:51:46 2022] DELETE /identity/v3/projects/d55c960c7d2941069c7d09120b6de3e3 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:51:46.356632 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120abd5-9aee-4bde-a948-e0b2d2273251 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:46.358195 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b120abd5-9aee-4bde-a948-e0b2d2273251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:46.374943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b120abd5-9aee-4bde-a948-e0b2d2273251 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:46.461942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62fb990-fd56-433b-bbc5-c5d32acbf9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:46.462852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fb990-fd56-433b-bbc5-c5d32acbf9de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:46.462959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fb990-fd56-433b-bbc5-c5d32acbf9de admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:46.463375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62fb990-fd56-433b-bbc5-c5d32acbf9de admin admin] PATH_INFO: `/v3/users/21953f6c2ae54d01b2e0922bf40f0e55` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:46.464834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62fb990-fd56-433b-bbc5-c5d32acbf9de admin admin] RBAC: Authorizing `identity:delete_user(user_id=21953f6c2ae54d01b2e0922bf40f0e55)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:46.466845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62fb990-fd56-433b-bbc5-c5d32acbf9de admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:46.497705 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:46.537499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c62fb990-fd56-433b-bbc5-c5d32acbf9de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21953f6c2ae54d01b2e0922bf40f0e55'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:51:46.546420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c62fb990-fd56-433b-bbc5-c5d32acbf9de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21953f6c2ae54d01b2e0922bf40f0e55'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:51:46.574055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c62fb990-fd56-433b-bbc5-c5d32acbf9de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21953f6c2ae54d01b2e0922bf40f0e55'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:51:46.574908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c62fb990-fd56-433b-bbc5-c5d32acbf9de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21953f6c2ae54d01b2e0922bf40f0e55'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:51:46.587857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c62fb990-fd56-433b-bbc5-c5d32acbf9de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21953f6c2ae54d01b2e0922bf40f0e55'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:51:46.599400 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4316/8544] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:51:46 2022] DELETE /identity/v3/users/21953f6c2ae54d01b2e0922bf40f0e55 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:51:46.876224 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b073a9-2875-4af5-a8bb-874aa9d637fe admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:46.878451 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-70b073a9-2875-4af5-a8bb-874aa9d637fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:46.914514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b073a9-2875-4af5-a8bb-874aa9d637fe admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:47.016435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c057d-27a8-4ce9-8c30-fda0b9568c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:47.017104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c057d-27a8-4ce9-8c30-fda0b9568c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:47.017410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c057d-27a8-4ce9-8c30-fda0b9568c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:47.017687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c057d-27a8-4ce9-8c30-fda0b9568c7b admin admin] PATH_INFO: `/v3/projects/8dad25d99539478eb1468515e79b46ca` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:47.019039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c057d-27a8-4ce9-8c30-fda0b9568c7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dad25d99539478eb1468515e79b46ca)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:47.021364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c057d-27a8-4ce9-8c30-fda0b9568c7b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:47.086894 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:47.122642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0e4c057d-27a8-4ce9-8c30-fda0b9568c7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dad25d99539478eb1468515e79b46ca', 'request_id': 'req-0e4c057d-27a8-4ce9-8c30-fda0b9568c7b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:51:47.148147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0e4c057d-27a8-4ce9-8c30-fda0b9568c7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dad25d99539478eb1468515e79b46ca', 'request_id': 'req-0e4c057d-27a8-4ce9-8c30-fda0b9568c7b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:51:47.156293 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0e4c057d-27a8-4ce9-8c30-fda0b9568c7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dad25d99539478eb1468515e79b46ca', 'request_id': 'req-0e4c057d-27a8-4ce9-8c30-fda0b9568c7b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:51:47.178040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0e4c057d-27a8-4ce9-8c30-fda0b9568c7b admin admin] The token cache is being invalidate because project 8dad25d99539478eb1468515e79b46ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:51:47.179214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0e4c057d-27a8-4ce9-8c30-fda0b9568c7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:51:47.180686 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0e4c057d-27a8-4ce9-8c30-fda0b9568c7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:51:47.193053 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4229/8545] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:51:46 2022] DELETE /identity/v3/projects/8dad25d99539478eb1468515e79b46ca => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:51:47.195700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d3a43-6633-4209-87c4-b4ef0a635187 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:47.196312 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d3a43-6633-4209-87c4-b4ef0a635187 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:47.196710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d3a43-6633-4209-87c4-b4ef0a635187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:47.284169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-320d3a43-6633-4209-87c4-b4ef0a635187 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:51:47.286098 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-320d3a43-6633-4209-87c4-b4ef0a635187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:47.422548 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4317/8546] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:51:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:51:47.431532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80864096-f16e-44ab-8b78-27712cbfdd43 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:47.432294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80864096-f16e-44ab-8b78-27712cbfdd43 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:47.433005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80864096-f16e-44ab-8b78-27712cbfdd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:47.462165 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-80864096-f16e-44ab-8b78-27712cbfdd43 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:51:47.463621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-80864096-f16e-44ab-8b78-27712cbfdd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:47.478572 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d3a43-6633-4209-87c4-b4ef0a635187 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:47.485127 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4230/8547] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:51:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:51:47.493123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d3a43-6633-4209-87c4-b4ef0a635187 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:47.500726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361c86c-59d0-4413-9281-770c56542365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:47.501379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361c86c-59d0-4413-9281-770c56542365 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:47.501661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361c86c-59d0-4413-9281-770c56542365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:47.501937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361c86c-59d0-4413-9281-770c56542365 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:47.502636 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361c86c-59d0-4413-9281-770c56542365 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:51:47.502938 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361c86c-59d0-4413-9281-770c56542365 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:47.504913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361c86c-59d0-4413-9281-770c56542365 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:47.523931 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4318/8548] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:51:47.526103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80864096-f16e-44ab-8b78-27712cbfdd43 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:47.542104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80864096-f16e-44ab-8b78-27712cbfdd43 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:47.548579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a9f69-a6b2-47ce-9e99-ce0a1cc1da54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:47.549200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a9f69-a6b2-47ce-9e99-ce0a1cc1da54 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:47.549475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a9f69-a6b2-47ce-9e99-ce0a1cc1da54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:47.549739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a9f69-a6b2-47ce-9e99-ce0a1cc1da54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:47.550702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a9f69-a6b2-47ce-9e99-ce0a1cc1da54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:47.552647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a9f69-a6b2-47ce-9e99-ce0a1cc1da54 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:47.584893 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4231/8549] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:51:47 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:51:47.589513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361c86c-59d0-4413-9281-770c56542365 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:47.601289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361c86c-59d0-4413-9281-770c56542365 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:47.661638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1987a0-73ec-4da9-8380-793021a9b217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:47.662255 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1987a0-73ec-4da9-8380-793021a9b217 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:47.662537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1987a0-73ec-4da9-8380-793021a9b217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:47.662809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1987a0-73ec-4da9-8380-793021a9b217 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:47.663447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1987a0-73ec-4da9-8380-793021a9b217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:47.665454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1987a0-73ec-4da9-8380-793021a9b217 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:47.688435 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4319/8550] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:51:47 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:51:47.692473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a9f69-a6b2-47ce-9e99-ce0a1cc1da54 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:47.703706 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a9f69-a6b2-47ce-9e99-ce0a1cc1da54 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:47.710764 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5487aaf-4864-40f3-abdd-763f7234d55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:47.711460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5487aaf-4864-40f3-abdd-763f7234d55d admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:47.711826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5487aaf-4864-40f3-abdd-763f7234d55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:47.712190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5487aaf-4864-40f3-abdd-763f7234d55d admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:47.713077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5487aaf-4864-40f3-abdd-763f7234d55d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:47.714974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5487aaf-4864-40f3-abdd-763f7234d55d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:47.729461 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4232/8551] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:51:47.730942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1987a0-73ec-4da9-8380-793021a9b217 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:47.742282 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1987a0-73ec-4da9-8380-793021a9b217 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:47.747290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd6d47-e0a6-47af-ba8a-23f9fa1a052d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:47.747909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd6d47-e0a6-47af-ba8a-23f9fa1a052d admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:47.748228 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd6d47-e0a6-47af-ba8a-23f9fa1a052d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:47.748506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd6d47-e0a6-47af-ba8a-23f9fa1a052d admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:47.749713 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd6d47-e0a6-47af-ba8a-23f9fa1a052d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:47.751310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd6d47-e0a6-47af-ba8a-23f9fa1a052d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:47.763434 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4320/8552] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:51:47.768410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5487aaf-4864-40f3-abdd-763f7234d55d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:47.778956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5487aaf-4864-40f3-abdd-763f7234d55d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:47.784809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c265a-64fc-4788-8d33-8806fae6bb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:47.785491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c265a-64fc-4788-8d33-8806fae6bb1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:47.785947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c265a-64fc-4788-8d33-8806fae6bb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:47.786313 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c265a-64fc-4788-8d33-8806fae6bb1d admin admin] PATH_INFO: `/v3/projects/5001c6dfc09f4b03b4d29836165eddc1/users/efb5f9eb544a4785908e9f35ce065a37/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:47.806610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c265a-64fc-4788-8d33-8806fae6bb1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5001c6dfc09f4b03b4d29836165eddc1, user_id=efb5f9eb544a4785908e9f35ce065a37, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:47.809372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c265a-64fc-4788-8d33-8806fae6bb1d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:47.828019 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4233/8553] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:51:47 2022] PUT /identity/v3/projects/5001c6dfc09f4b03b4d29836165eddc1/users/efb5f9eb544a4785908e9f35ce065a37/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:51:47.833167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed637e68-d40f-4800-b19c-306931ab1fb8 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:47.833457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed637e68-d40f-4800-b19c-306931ab1fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:47.833765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed637e68-d40f-4800-b19c-306931ab1fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:47.842177 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:47.853964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ed637e68-d40f-4800-b19c-306931ab1fb8 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:51:47.855265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ed637e68-d40f-4800-b19c-306931ab1fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:47.939713 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4321/8554] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:51:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:51:47.950504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c265a-64fc-4788-8d33-8806fae6bb1d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:47.952863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-aa1c265a-64fc-4788-8d33-8806fae6bb1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:48.045408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c265a-64fc-4788-8d33-8806fae6bb1d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:48.055328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930b551-3c56-467b-aa0d-403d31b84b72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:48.056201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930b551-3c56-467b-aa0d-403d31b84b72 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:48.056482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930b551-3c56-467b-aa0d-403d31b84b72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:48.056998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930b551-3c56-467b-aa0d-403d31b84b72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:48.074100 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930b551-3c56-467b-aa0d-403d31b84b72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:48.076348 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930b551-3c56-467b-aa0d-403d31b84b72 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:48.097201 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4234/8555] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:51:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:51:49.057315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016a972-5ee7-4ed8-853c-c71dcac2e053 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:49.058369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016a972-5ee7-4ed8-853c-c71dcac2e053 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:49.059685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4016a972-5ee7-4ed8-853c-c71dcac2e053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:49.130977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-4016a972-5ee7-4ed8-853c-c71dcac2e053 None None] MFA Rules not processed for user `efb5f9eb544a4785908e9f35ce065a37`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:51:49.134503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4016a972-5ee7-4ed8-853c-c71dcac2e053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:49.266338 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4322/8556] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:51:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:51:49.270934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930b551-3c56-467b-aa0d-403d31b84b72 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:49.286251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930b551-3c56-467b-aa0d-403d31b84b72 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:49.321941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2bdc6-de5d-47b1-b13f-edcc91e3ea61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:49.322569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2bdc6-de5d-47b1-b13f-edcc91e3ea61 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:49.322846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2bdc6-de5d-47b1-b13f-edcc91e3ea61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:49.323114 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2bdc6-de5d-47b1-b13f-edcc91e3ea61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:49.323762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2bdc6-de5d-47b1-b13f-edcc91e3ea61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:49.328987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2bdc6-de5d-47b1-b13f-edcc91e3ea61 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:49.382100 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4235/8557] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:51:49 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:51:49.386401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016a972-5ee7-4ed8-853c-c71dcac2e053 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:49.433178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4016a972-5ee7-4ed8-853c-c71dcac2e053 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:49.517529 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8564f6-5047-4530-9998-6daa42cd939c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:49.518173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8564f6-5047-4530-9998-6daa42cd939c admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:49.518453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8564f6-5047-4530-9998-6daa42cd939c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:49.518919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8564f6-5047-4530-9998-6daa42cd939c admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:49.519570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8564f6-5047-4530-9998-6daa42cd939c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:49.521870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8564f6-5047-4530-9998-6daa42cd939c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:49.552015 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4323/8558] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:51:49 2022] POST /identity/v3/users => generated 296 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:51:49.553415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2bdc6-de5d-47b1-b13f-edcc91e3ea61 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:49.579140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2bdc6-de5d-47b1-b13f-edcc91e3ea61 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:49.590009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f80b15-c183-4814-90a3-86fe3cde9429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:49.591543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f80b15-c183-4814-90a3-86fe3cde9429 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:49.595403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f80b15-c183-4814-90a3-86fe3cde9429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:49.595952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f80b15-c183-4814-90a3-86fe3cde9429 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:49.596875 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f80b15-c183-4814-90a3-86fe3cde9429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:49.598797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f80b15-c183-4814-90a3-86fe3cde9429 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:49.615859 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4236/8559] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:51:49.616903 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8564f6-5047-4530-9998-6daa42cd939c admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:49.630288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8564f6-5047-4530-9998-6daa42cd939c admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:49.635938 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e4429-c922-4521-9976-eb50b40ff317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:49.636766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e4429-c922-4521-9976-eb50b40ff317 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:49.637331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e4429-c922-4521-9976-eb50b40ff317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:49.637683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e4429-c922-4521-9976-eb50b40ff317 admin admin] PATH_INFO: `/v3/projects/eaad0e44323a49078b2b7ebf8c7397b5/users/75291a0a8481492fa90af995f375d726/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:49.659479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e4429-c922-4521-9976-eb50b40ff317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaad0e44323a49078b2b7ebf8c7397b5, user_id=75291a0a8481492fa90af995f375d726, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:49.665214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e4429-c922-4521-9976-eb50b40ff317 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:49.676252 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:49.683925 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4324/8560] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:51:49 2022] PUT /identity/v3/projects/eaad0e44323a49078b2b7ebf8c7397b5/users/75291a0a8481492fa90af995f375d726/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:51:49.686925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f80b15-c183-4814-90a3-86fe3cde9429 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:49.700120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f80b15-c183-4814-90a3-86fe3cde9429 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:49.761131 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:51:49.807107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bac22-4684-40fc-b37a-9bbe995d7b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:49.807748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bac22-4684-40fc-b37a-9bbe995d7b2a admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:49.808131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bac22-4684-40fc-b37a-9bbe995d7b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:49.808479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bac22-4684-40fc-b37a-9bbe995d7b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:49.809467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bac22-4684-40fc-b37a-9bbe995d7b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:49.812058 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bac22-4684-40fc-b37a-9bbe995d7b2a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:49.825307 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4237/8561] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:51:49.829860 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e4429-c922-4521-9976-eb50b40ff317 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:49.843119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e4429-c922-4521-9976-eb50b40ff317 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:49.848816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfeab43-2307-4e0e-aaa5-42b016e59ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:49.849971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfeab43-2307-4e0e-aaa5-42b016e59ee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:49.850083 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfeab43-2307-4e0e-aaa5-42b016e59ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:49.850433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfeab43-2307-4e0e-aaa5-42b016e59ee2 admin admin] PATH_INFO: `/v3/projects/eaad0e44323a49078b2b7ebf8c7397b5/users/75291a0a8481492fa90af995f375d726/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:49.853448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfeab43-2307-4e0e-aaa5-42b016e59ee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaad0e44323a49078b2b7ebf8c7397b5, user_id=75291a0a8481492fa90af995f375d726, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:49.856433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfeab43-2307-4e0e-aaa5-42b016e59ee2 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:49.871615 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4325/8562] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:51:49 2022] PUT /identity/v3/projects/eaad0e44323a49078b2b7ebf8c7397b5/users/75291a0a8481492fa90af995f375d726/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:51:51.319755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12db16-0e24-4cb3-b017-155855aee963 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:51.320286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12db16-0e24-4cb3-b017-155855aee963 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:51.320371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12db16-0e24-4cb3-b017-155855aee963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:51.391914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-8e12db16-0e24-4cb3-b017-155855aee963 None None] MFA Rules not processed for user `75291a0a8481492fa90af995f375d726`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:51:51.393069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8e12db16-0e24-4cb3-b017-155855aee963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:51.544046 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4238/8563] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:51:51 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:51:51.546371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97884b0a-34b0-4ca1-8ea9-ee579f2a6ec7 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:51.546864 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97884b0a-34b0-4ca1-8ea9-ee579f2a6ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:51.546864 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97884b0a-34b0-4ca1-8ea9-ee579f2a6ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:51.570032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-97884b0a-34b0-4ca1-8ea9-ee579f2a6ec7 None None] MFA Rules not processed for user `efb5f9eb544a4785908e9f35ce065a37`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:51:51.571277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-97884b0a-34b0-4ca1-8ea9-ee579f2a6ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:51.661070 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4326/8564] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:51:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:51:51.674067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12db16-0e24-4cb3-b017-155855aee963 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:51.675499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8e12db16-0e24-4cb3-b017-155855aee963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:51.796924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12db16-0e24-4cb3-b017-155855aee963 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:51.803042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9449cb4-ec2e-4f33-8f41-6c17a96ca324 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:51.803676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9449cb4-ec2e-4f33-8f41-6c17a96ca324 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:51.804034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9449cb4-ec2e-4f33-8f41-6c17a96ca324 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:51.804303 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9449cb4-ec2e-4f33-8f41-6c17a96ca324 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:51.814025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9449cb4-ec2e-4f33-8f41-6c17a96ca324 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:51.815623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9449cb4-ec2e-4f33-8f41-6c17a96ca324 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:51.832246 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4239/8565] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:51:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:51:52.137497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97884b0a-34b0-4ca1-8ea9-ee579f2a6ec7 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:51:52.245812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97884b0a-34b0-4ca1-8ea9-ee579f2a6ec7 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:51:52.250192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657b300-39ab-4f0d-ae28-77e91eabaae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:51:52.250911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657b300-39ab-4f0d-ae28-77e91eabaae8 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:51:52.251296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657b300-39ab-4f0d-ae28-77e91eabaae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:51:52.251673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657b300-39ab-4f0d-ae28-77e91eabaae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:51:52.254260 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4657b300-39ab-4f0d-ae28-77e91eabaae8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:51:52.274196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657b300-39ab-4f0d-ae28-77e91eabaae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:51:52.275973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657b300-39ab-4f0d-ae28-77e91eabaae8 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:51:52.288612 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4327/8566] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:51:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:52:01.700313 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c4318-62ed-49db-beaa-bdae9b1c8d83 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:52:01.700874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c4318-62ed-49db-beaa-bdae9b1c8d83 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:52:01.700874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c4318-62ed-49db-beaa-bdae9b1c8d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:52:01.722496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-da2c4318-62ed-49db-beaa-bdae9b1c8d83 None None] MFA Rules not processed for user `661f6c9aa7da4e348a9b0d91840078c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:52:01.723707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-da2c4318-62ed-49db-beaa-bdae9b1c8d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:52:01.755942 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:01.810243 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4240/8567] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:52:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:52:02.281682 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=56,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:05.441133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657b300-39ab-4f0d-ae28-77e91eabaae8 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:52:05.442690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4657b300-39ab-4f0d-ae28-77e91eabaae8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:52:05.460266 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657b300-39ab-4f0d-ae28-77e91eabaae8 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:52:05.464743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb907af3-4b96-4a5b-b80a-5d0d3b03e6ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:52:05.465722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb907af3-4b96-4a5b-b80a-5d0d3b03e6ec service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:52:05.466055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb907af3-4b96-4a5b-b80a-5d0d3b03e6ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:52:05.466355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb907af3-4b96-4a5b-b80a-5d0d3b03e6ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:52:05.469143 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-cb907af3-4b96-4a5b-b80a-5d0d3b03e6ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:52:05.486652 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb907af3-4b96-4a5b-b80a-5d0d3b03e6ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:52:05.494248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb907af3-4b96-4a5b-b80a-5d0d3b03e6ec service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:52:05.510107 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4328/8568] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:52:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:52:10.425250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ff848-072e-4e64-bda5-e684042d4c0f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:52:10.425705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ff848-072e-4e64-bda5-e684042d4c0f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:52:10.425979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ff848-072e-4e64-bda5-e684042d4c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:52:10.447011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-a08ff848-072e-4e64-bda5-e684042d4c0f None None] MFA Rules not processed for user `cc27d58f027d4fc3b398f6c184911e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:52:10.448308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a08ff848-072e-4e64-bda5-e684042d4c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:52:10.514652 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4241/8569] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:52:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:52:15.500165 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:18.348521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb907af3-4b96-4a5b-b80a-5d0d3b03e6ec service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:52:18.449542 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb907af3-4b96-4a5b-b80a-5d0d3b03e6ec service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:52:18.457216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f7541-28e8-4aaa-a0bc-9821fd2bbad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:52:18.457892 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f7541-28e8-4aaa-a0bc-9821fd2bbad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:52:18.458169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f7541-28e8-4aaa-a0bc-9821fd2bbad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:52:18.458689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f7541-28e8-4aaa-a0bc-9821fd2bbad2 admin admin] PATH_INFO: `/v3/users/efb5f9eb544a4785908e9f35ce065a37` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:52:18.460383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f7541-28e8-4aaa-a0bc-9821fd2bbad2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efb5f9eb544a4785908e9f35ce065a37)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:52:18.462708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f7541-28e8-4aaa-a0bc-9821fd2bbad2 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:52:18.529703 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-015f7541-28e8-4aaa-a0bc-9821fd2bbad2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efb5f9eb544a4785908e9f35ce065a37'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:52:18.537803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-015f7541-28e8-4aaa-a0bc-9821fd2bbad2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efb5f9eb544a4785908e9f35ce065a37'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:52:18.572643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-015f7541-28e8-4aaa-a0bc-9821fd2bbad2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efb5f9eb544a4785908e9f35ce065a37'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:52:18.573403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-015f7541-28e8-4aaa-a0bc-9821fd2bbad2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efb5f9eb544a4785908e9f35ce065a37'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:52:18.584338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-015f7541-28e8-4aaa-a0bc-9821fd2bbad2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efb5f9eb544a4785908e9f35ce065a37'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:52:18.593581 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4329/8570] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:52:18 2022] DELETE /identity/v3/users/efb5f9eb544a4785908e9f35ce065a37 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:52:18.925133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ff848-072e-4e64-bda5-e684042d4c0f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:52:18.942919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ff848-072e-4e64-bda5-e684042d4c0f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:52:19.037926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a6c8e-5f7e-44e2-bf18-3e59687d44fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:52:19.038591 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a6c8e-5f7e-44e2-bf18-3e59687d44fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:52:19.038868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a6c8e-5f7e-44e2-bf18-3e59687d44fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:52:19.039301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a6c8e-5f7e-44e2-bf18-3e59687d44fe admin admin] PATH_INFO: `/v3/projects/5001c6dfc09f4b03b4d29836165eddc1` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:52:19.040604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a6c8e-5f7e-44e2-bf18-3e59687d44fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=5001c6dfc09f4b03b4d29836165eddc1)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:52:19.042558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a6c8e-5f7e-44e2-bf18-3e59687d44fe admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:52:19.111468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-057a6c8e-5f7e-44e2-bf18-3e59687d44fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5001c6dfc09f4b03b4d29836165eddc1', 'request_id': 'req-057a6c8e-5f7e-44e2-bf18-3e59687d44fe'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:52:19.117565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-057a6c8e-5f7e-44e2-bf18-3e59687d44fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5001c6dfc09f4b03b4d29836165eddc1', 'request_id': 'req-057a6c8e-5f7e-44e2-bf18-3e59687d44fe'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:52:19.125107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-057a6c8e-5f7e-44e2-bf18-3e59687d44fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5001c6dfc09f4b03b4d29836165eddc1', 'request_id': 'req-057a6c8e-5f7e-44e2-bf18-3e59687d44fe'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:52:19.138705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-057a6c8e-5f7e-44e2-bf18-3e59687d44fe admin admin] The token cache is being invalidate because project 5001c6dfc09f4b03b4d29836165eddc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:52:19.139011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-057a6c8e-5f7e-44e2-bf18-3e59687d44fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:52:19.139755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-057a6c8e-5f7e-44e2-bf18-3e59687d44fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:52:19.141555 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4242/8571] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:52:18 2022] DELETE /identity/v3/projects/5001c6dfc09f4b03b4d29836165eddc1 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:52:19.145449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f7541-28e8-4aaa-a0bc-9821fd2bbad2 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:52:19.146902 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-015f7541-28e8-4aaa-a0bc-9821fd2bbad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:52:19.160650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f7541-28e8-4aaa-a0bc-9821fd2bbad2 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:52:19.235116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e4cb7-2a8e-495e-aecd-f7c0756988be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:52:19.236505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e4cb7-2a8e-495e-aecd-f7c0756988be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:52:19.236882 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e4cb7-2a8e-495e-aecd-f7c0756988be admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:52:19.237172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e4cb7-2a8e-495e-aecd-f7c0756988be admin admin] PATH_INFO: `/v3/users/75291a0a8481492fa90af995f375d726` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:52:19.238413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e4cb7-2a8e-495e-aecd-f7c0756988be admin admin] RBAC: Authorizing `identity:delete_user(user_id=75291a0a8481492fa90af995f375d726)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:52:19.240469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e4cb7-2a8e-495e-aecd-f7c0756988be admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:52:19.267721 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:19.335496 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-955e4cb7-2a8e-495e-aecd-f7c0756988be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75291a0a8481492fa90af995f375d726'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:52:19.345822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-955e4cb7-2a8e-495e-aecd-f7c0756988be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75291a0a8481492fa90af995f375d726'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:52:19.359752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-955e4cb7-2a8e-495e-aecd-f7c0756988be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75291a0a8481492fa90af995f375d726'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:52:19.361637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-955e4cb7-2a8e-495e-aecd-f7c0756988be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75291a0a8481492fa90af995f375d726'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:52:19.373438 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-955e4cb7-2a8e-495e-aecd-f7c0756988be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75291a0a8481492fa90af995f375d726'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:52:19.380603 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4330/8572] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:52:19 2022] DELETE /identity/v3/users/75291a0a8481492fa90af995f375d726 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:52:19.613318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a6c8e-5f7e-44e2-bf18-3e59687d44fe admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:52:19.615911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-057a6c8e-5f7e-44e2-bf18-3e59687d44fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:52:19.644439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a6c8e-5f7e-44e2-bf18-3e59687d44fe admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:52:19.670779 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:19.748454 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1659ea88-8875-4248-ba64-7a3db47aea8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:52:19.749117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659ea88-8875-4248-ba64-7a3db47aea8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:52:19.749395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659ea88-8875-4248-ba64-7a3db47aea8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:52:19.749669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1659ea88-8875-4248-ba64-7a3db47aea8f admin admin] PATH_INFO: `/v3/projects/eaad0e44323a49078b2b7ebf8c7397b5` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:52:19.750849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1659ea88-8875-4248-ba64-7a3db47aea8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaad0e44323a49078b2b7ebf8c7397b5)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:52:19.753975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1659ea88-8875-4248-ba64-7a3db47aea8f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:52:19.818561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1659ea88-8875-4248-ba64-7a3db47aea8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaad0e44323a49078b2b7ebf8c7397b5', 'request_id': 'req-1659ea88-8875-4248-ba64-7a3db47aea8f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:52:19.825370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1659ea88-8875-4248-ba64-7a3db47aea8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaad0e44323a49078b2b7ebf8c7397b5', 'request_id': 'req-1659ea88-8875-4248-ba64-7a3db47aea8f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:52:19.834867 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1659ea88-8875-4248-ba64-7a3db47aea8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaad0e44323a49078b2b7ebf8c7397b5', 'request_id': 'req-1659ea88-8875-4248-ba64-7a3db47aea8f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:52:19.853644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1659ea88-8875-4248-ba64-7a3db47aea8f admin admin] The token cache is being invalidate because project eaad0e44323a49078b2b7ebf8c7397b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:52:19.854087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1659ea88-8875-4248-ba64-7a3db47aea8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:52:19.855587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1659ea88-8875-4248-ba64-7a3db47aea8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:52:19.877858 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4243/8573] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:52:19 2022] DELETE /identity/v3/projects/eaad0e44323a49078b2b7ebf8c7397b5 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:52:21.694642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620655d-7b9e-4b43-b261-c10079febd21 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:52:21.695802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620655d-7b9e-4b43-b261-c10079febd21 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:52:21.697280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620655d-7b9e-4b43-b261-c10079febd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:52:21.757482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5620655d-7b9e-4b43-b261-c10079febd21 None None] MFA Rules not processed for user `073f0cff787a466a9fbf9fb43b03b726`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:52:21.758859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5620655d-7b9e-4b43-b261-c10079febd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:52:21.919391 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4331/8574] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:52:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:52:29.849257 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=45,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:52:31.867332 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=7,keystone:SELECT=45,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:53:03.955752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad79c2-c38a-4844-822f-b4ef2811ec63 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:53:03.956361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad79c2-c38a-4844-822f-b4ef2811ec63 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:53:03.956361 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad79c2-c38a-4844-822f-b4ef2811ec63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:53:03.989038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-eaad79c2-c38a-4844-822f-b4ef2811ec63 None None] MFA Rules not processed for user `661f6c9aa7da4e348a9b0d91840078c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:53:03.990586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-eaad79c2-c38a-4844-822f-b4ef2811ec63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:53:04.063216 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4244/8575] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:53:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:53:14.055419 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=25 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:53:18.629300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620655d-7b9e-4b43-b261-c10079febd21 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:53:18.630801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5620655d-7b9e-4b43-b261-c10079febd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:53:18.876943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620655d-7b9e-4b43-b261-c10079febd21 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:53:18.885324 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc85ff2-5d83-468f-974e-ec49e810e3ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:53:18.885975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc85ff2-5d83-468f-974e-ec49e810e3ce service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:53:18.886259 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc85ff2-5d83-468f-974e-ec49e810e3ce service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:53:18.886535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc85ff2-5d83-468f-974e-ec49e810e3ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:53:18.889163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4bc85ff2-5d83-468f-974e-ec49e810e3ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:53:18.912791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc85ff2-5d83-468f-974e-ec49e810e3ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:53:18.916170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc85ff2-5d83-468f-974e-ec49e810e3ce service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:53:18.944495 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4332/8576] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:53:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:53:28.325637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0163727-a505-473b-b1bc-99b344d82e52 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:53:28.326810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0163727-a505-473b-b1bc-99b344d82e52 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:53:28.327282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0163727-a505-473b-b1bc-99b344d82e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:53:28.348318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-f0163727-a505-473b-b1bc-99b344d82e52 None None] MFA Rules not processed for user `073f0cff787a466a9fbf9fb43b03b726`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:53:28.349447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f0163727-a505-473b-b1bc-99b344d82e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:53:28.357438 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4245/8577] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:53:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:53:28.934832 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=32 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:53:34.958830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc85ff2-5d83-468f-974e-ec49e810e3ce service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:53:34.961139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4bc85ff2-5d83-468f-974e-ec49e810e3ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:53:35.051158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc85ff2-5d83-468f-974e-ec49e810e3ce service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:53:35.057272 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d875d-0174-4061-93eb-a492f2129cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:53:35.058079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d875d-0174-4061-93eb-a492f2129cb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:53:35.058366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d875d-0174-4061-93eb-a492f2129cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:53:35.058642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d875d-0174-4061-93eb-a492f2129cb2 admin admin] PATH_INFO: `/v3/users/fe0eddcab4c14931b7c20f86f3115981` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:53:35.060017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d875d-0174-4061-93eb-a492f2129cb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe0eddcab4c14931b7c20f86f3115981)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:53:35.062064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d875d-0174-4061-93eb-a492f2129cb2 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:53:35.121607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-503d875d-0174-4061-93eb-a492f2129cb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe0eddcab4c14931b7c20f86f3115981'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:53:35.131066 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-503d875d-0174-4061-93eb-a492f2129cb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe0eddcab4c14931b7c20f86f3115981'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:53:35.148340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-503d875d-0174-4061-93eb-a492f2129cb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe0eddcab4c14931b7c20f86f3115981'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:53:35.149917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-503d875d-0174-4061-93eb-a492f2129cb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe0eddcab4c14931b7c20f86f3115981'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:53:35.162357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-503d875d-0174-4061-93eb-a492f2129cb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe0eddcab4c14931b7c20f86f3115981'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:53:35.171646 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4333/8578] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:53:34 2022] DELETE /identity/v3/users/fe0eddcab4c14931b7c20f86f3115981 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:53:35.175951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d4f3b-6620-40aa-a102-b9d12e73c768 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:53:35.176502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d4f3b-6620-40aa-a102-b9d12e73c768 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:53:35.176502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600d4f3b-6620-40aa-a102-b9d12e73c768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:53:35.207046 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-600d4f3b-6620-40aa-a102-b9d12e73c768 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:53:35.209636 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-600d4f3b-6620-40aa-a102-b9d12e73c768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:53:35.295412 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4246/8579] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:53:35.305811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d875d-0174-4061-93eb-a492f2129cb2 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:53:35.307341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-503d875d-0174-4061-93eb-a492f2129cb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:53:35.392543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d875d-0174-4061-93eb-a492f2129cb2 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:53:35.396249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfaf4e-e5c3-4201-a843-6c4c4b372266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:53:35.396855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfaf4e-e5c3-4201-a843-6c4c4b372266 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:53:35.397131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfaf4e-e5c3-4201-a843-6c4c4b372266 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:53:35.397401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfaf4e-e5c3-4201-a843-6c4c4b372266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:53:35.407566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dfaf4e-e5c3-4201-a843-6c4c4b372266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:53:35.409031 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dfaf4e-e5c3-4201-a843-6c4c4b372266 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:53:35.418597 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4334/8580] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:53:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:53:35.605473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d4f3b-6620-40aa-a102-b9d12e73c768 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:53:35.607228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-600d4f3b-6620-40aa-a102-b9d12e73c768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:53:35.622910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600d4f3b-6620-40aa-a102-b9d12e73c768 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:53:35.628119 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362ca13-af66-47f8-b887-b3aea3b9cd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:53:35.628871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362ca13-af66-47f8-b887-b3aea3b9cd90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:53:35.629240 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362ca13-af66-47f8-b887-b3aea3b9cd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:53:35.629580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362ca13-af66-47f8-b887-b3aea3b9cd90 admin admin] PATH_INFO: `/v3/projects/7bbd14acc689493b84d8fa6d0137bdbf` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:53:35.630977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362ca13-af66-47f8-b887-b3aea3b9cd90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bbd14acc689493b84d8fa6d0137bdbf)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:53:35.634001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362ca13-af66-47f8-b887-b3aea3b9cd90 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:53:35.685755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8362ca13-af66-47f8-b887-b3aea3b9cd90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bbd14acc689493b84d8fa6d0137bdbf', 'request_id': 'req-8362ca13-af66-47f8-b887-b3aea3b9cd90'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:53:35.691786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8362ca13-af66-47f8-b887-b3aea3b9cd90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bbd14acc689493b84d8fa6d0137bdbf', 'request_id': 'req-8362ca13-af66-47f8-b887-b3aea3b9cd90'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:53:35.701149 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8362ca13-af66-47f8-b887-b3aea3b9cd90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bbd14acc689493b84d8fa6d0137bdbf', 'request_id': 'req-8362ca13-af66-47f8-b887-b3aea3b9cd90'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:53:35.751901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8362ca13-af66-47f8-b887-b3aea3b9cd90 admin admin] The token cache is being invalidate because project 7bbd14acc689493b84d8fa6d0137bdbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:53:35.752197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8362ca13-af66-47f8-b887-b3aea3b9cd90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:53:35.755069 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-8362ca13-af66-47f8-b887-b3aea3b9cd90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:53:35.763201 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4247/8581] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:53:35 2022] DELETE /identity/v3/projects/7bbd14acc689493b84d8fa6d0137bdbf => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:53:35.765220 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac25ee-9417-4fdf-975d-ecd9770b093b None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:53:35.765814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac25ee-9417-4fdf-975d-ecd9770b093b None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:53:35.766246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac25ee-9417-4fdf-975d-ecd9770b093b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:53:35.792866 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-50ac25ee-9417-4fdf-975d-ecd9770b093b None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:53:35.794399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-50ac25ee-9417-4fdf-975d-ecd9770b093b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:53:35.817180 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:53:35.937141 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4335/8582] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:53:35.945135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fe18b-bcaf-4471-8dc8-34f623abe1e1 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:53:35.945460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fe18b-bcaf-4471-8dc8-34f623abe1e1 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:53:35.946255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0fe18b-bcaf-4471-8dc8-34f623abe1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:53:35.972648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1d0fe18b-bcaf-4471-8dc8-34f623abe1e1 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:53:35.974004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1d0fe18b-bcaf-4471-8dc8-34f623abe1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:53:35.992807 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4248/8583] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:53:35.997321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac25ee-9417-4fdf-975d-ecd9770b093b None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:53:36.013302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac25ee-9417-4fdf-975d-ecd9770b093b None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:53:36.018770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee4bbe-4899-449d-92b8-f4ddd0019593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:53:36.019085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee4bbe-4899-449d-92b8-f4ddd0019593 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:53:36.019289 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee4bbe-4899-449d-92b8-f4ddd0019593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:53:36.019556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee4bbe-4899-449d-92b8-f4ddd0019593 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:53:36.020256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee4bbe-4899-449d-92b8-f4ddd0019593 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:53:36.020556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee4bbe-4899-449d-92b8-f4ddd0019593 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:53:36.022167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee4bbe-4899-449d-92b8-f4ddd0019593 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:53:36.047350 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4336/8584] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:53:36.051775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fe18b-bcaf-4471-8dc8-34f623abe1e1 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:53:36.062604 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0fe18b-bcaf-4471-8dc8-34f623abe1e1 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:53:36.067621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39864060-9d1c-41fb-8a76-a1cdea727da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:53:36.068278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39864060-9d1c-41fb-8a76-a1cdea727da7 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:53:36.068553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39864060-9d1c-41fb-8a76-a1cdea727da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:53:36.068824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39864060-9d1c-41fb-8a76-a1cdea727da7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:53:36.069469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39864060-9d1c-41fb-8a76-a1cdea727da7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:53:36.072084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39864060-9d1c-41fb-8a76-a1cdea727da7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:53:36.109382 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4249/8585] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:53:36 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:53:36.113485 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee4bbe-4899-449d-92b8-f4ddd0019593 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:53:36.134232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee4bbe-4899-449d-92b8-f4ddd0019593 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:53:36.211508 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ecb51-c622-483a-aa14-8ae1f8a4b399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:53:36.212211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ecb51-c622-483a-aa14-8ae1f8a4b399 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:53:36.212489 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ecb51-c622-483a-aa14-8ae1f8a4b399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:53:36.212758 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ecb51-c622-483a-aa14-8ae1f8a4b399 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:53:36.213375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ecb51-c622-483a-aa14-8ae1f8a4b399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:53:36.215311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ecb51-c622-483a-aa14-8ae1f8a4b399 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:53:36.238055 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4337/8586] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:53:36 2022] POST /identity/v3/users => generated 287 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:53:36.242152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39864060-9d1c-41fb-8a76-a1cdea727da7 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:53:36.254152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39864060-9d1c-41fb-8a76-a1cdea727da7 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:53:36.265870 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e2646-9a34-4326-9490-ec4ed1e30107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:53:36.266434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e2646-9a34-4326-9490-ec4ed1e30107 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:53:36.266711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e2646-9a34-4326-9490-ec4ed1e30107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:53:36.266980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e2646-9a34-4326-9490-ec4ed1e30107 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:53:36.267634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e2646-9a34-4326-9490-ec4ed1e30107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:53:36.269349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e2646-9a34-4326-9490-ec4ed1e30107 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:53:36.279878 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4250/8587] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:53:36.284010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ecb51-c622-483a-aa14-8ae1f8a4b399 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:53:36.295269 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ecb51-c622-483a-aa14-8ae1f8a4b399 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:53:36.301120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6e5cc-9fdd-485f-b72a-deb50ebf1e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:53:36.301941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6e5cc-9fdd-485f-b72a-deb50ebf1e38 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:53:36.302222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6e5cc-9fdd-485f-b72a-deb50ebf1e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:53:36.302492 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6e5cc-9fdd-485f-b72a-deb50ebf1e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:53:36.303151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6e5cc-9fdd-485f-b72a-deb50ebf1e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:53:36.305430 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6e5cc-9fdd-485f-b72a-deb50ebf1e38 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:53:36.319336 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4338/8588] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:53:36.324682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e2646-9a34-4326-9490-ec4ed1e30107 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:53:36.335834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e2646-9a34-4326-9490-ec4ed1e30107 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:53:36.340963 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d2401-c99a-4ade-9d7c-ab562c5de834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:53:36.341638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d2401-c99a-4ade-9d7c-ab562c5de834 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:53:36.341916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d2401-c99a-4ade-9d7c-ab562c5de834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:53:36.342185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d2401-c99a-4ade-9d7c-ab562c5de834 admin admin] PATH_INFO: `/v3/projects/e4c73cd4714f4b34bf5f7f6f15989b52/users/2bc4703b0111425f9a46d1fee4884278/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:53:36.359545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d2401-c99a-4ade-9d7c-ab562c5de834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4c73cd4714f4b34bf5f7f6f15989b52, user_id=2bc4703b0111425f9a46d1fee4884278, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:53:36.362480 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d2401-c99a-4ade-9d7c-ab562c5de834 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:53:36.379097 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4251/8589] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:53:36 2022] PUT /identity/v3/projects/e4c73cd4714f4b34bf5f7f6f15989b52/users/2bc4703b0111425f9a46d1fee4884278/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:53:36.392210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc756e5c-652f-4825-bf87-f26da438b4bd None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:53:36.392500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc756e5c-652f-4825-bf87-f26da438b4bd None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:53:36.392775 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc756e5c-652f-4825-bf87-f26da438b4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:53:36.427076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-cc756e5c-652f-4825-bf87-f26da438b4bd None None] MFA Rules not processed for user `2bc4703b0111425f9a46d1fee4884278`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:53:36.428336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-cc756e5c-652f-4825-bf87-f26da438b4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:53:36.508231 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4339/8590] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:53:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:53:36.519103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d2401-c99a-4ade-9d7c-ab562c5de834 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:53:36.520796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-639d2401-c99a-4ade-9d7c-ab562c5de834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:53:36.538546 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:53:36.597297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d2401-c99a-4ade-9d7c-ab562c5de834 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:53:36.600994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdb760-bb9c-4d50-8b8c-109ec407e381 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:53:36.601603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdb760-bb9c-4d50-8b8c-109ec407e381 service cinder] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:53:36.602387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdb760-bb9c-4d50-8b8c-109ec407e381 service cinder] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:53:36.602658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdb760-bb9c-4d50-8b8c-109ec407e381 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:53:36.610870 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdb760-bb9c-4d50-8b8c-109ec407e381 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:53:36.612387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdb760-bb9c-4d50-8b8c-109ec407e381 service cinder] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:53:36.621977 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4252/8591] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:53:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:53:38.001521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a614f4e-982e-42f1-93d9-99de354a8ef7 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:53:38.001967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a614f4e-982e-42f1-93d9-99de354a8ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:53:38.001967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a614f4e-982e-42f1-93d9-99de354a8ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:53:38.025245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3a614f4e-982e-42f1-93d9-99de354a8ef7 None None] MFA Rules not processed for user `2bc4703b0111425f9a46d1fee4884278`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:53:38.026470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3a614f4e-982e-42f1-93d9-99de354a8ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:53:38.033754 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4340/8592] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:53:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:53:39.174319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f4877-db5a-4ee4-9416-c7f8dd5dc4b0 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:53:39.175224 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f4877-db5a-4ee4-9416-c7f8dd5dc4b0 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:53:39.175673 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f4877-db5a-4ee4-9416-c7f8dd5dc4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:53:39.198152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-071f4877-db5a-4ee4-9416-c7f8dd5dc4b0 None None] MFA Rules not processed for user `cc27d58f027d4fc3b398f6c184911e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:53:39.199586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-071f4877-db5a-4ee4-9416-c7f8dd5dc4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:53:39.266711 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4253/8593] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:53:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:53:48.018185 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:53:49.256371 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=50 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:53:53.390849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a614f4e-982e-42f1-93d9-99de354a8ef7 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:53:53.392481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3a614f4e-982e-42f1-93d9-99de354a8ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:53:53.484186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a614f4e-982e-42f1-93d9-99de354a8ef7 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:53:53.489226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d6c1f-d383-4a8e-9a89-fbc4cc2c7da4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:53:53.489783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d6c1f-d383-4a8e-9a89-fbc4cc2c7da4 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:53:53.490056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d6c1f-d383-4a8e-9a89-fbc4cc2c7da4 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:53:53.490325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d6c1f-d383-4a8e-9a89-fbc4cc2c7da4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:53:53.494901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-740d6c1f-d383-4a8e-9a89-fbc4cc2c7da4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:53:53.510951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d6c1f-d383-4a8e-9a89-fbc4cc2c7da4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:53:53.512742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d6c1f-d383-4a8e-9a89-fbc4cc2c7da4 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:53:53.544925 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4341/8594] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:53:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:53:57.066907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a74ba-b781-4e9b-a713-14b15b07c308 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:53:57.067502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a74ba-b781-4e9b-a713-14b15b07c308 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:53:57.067502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a74ba-b781-4e9b-a713-14b15b07c308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:53:57.102505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-342a74ba-b781-4e9b-a713-14b15b07c308 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:53:57.103940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-342a74ba-b781-4e9b-a713-14b15b07c308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:53:57.168398 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4254/8595] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:53:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:53:57.219491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d6c1f-d383-4a8e-9a89-fbc4cc2c7da4 service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:53:57.221427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-740d6c1f-d383-4a8e-9a89-fbc4cc2c7da4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:53:57.310658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d6c1f-d383-4a8e-9a89-fbc4cc2c7da4 service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:53:57.316252 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1de79b-e935-4576-93c2-088999e1d6dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:53:57.316968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1de79b-e935-4576-93c2-088999e1d6dd service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:53:57.317465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1de79b-e935-4576-93c2-088999e1d6dd service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:53:57.317877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1de79b-e935-4576-93c2-088999e1d6dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:53:57.335442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1de79b-e935-4576-93c2-088999e1d6dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:53:57.337752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1de79b-e935-4576-93c2-088999e1d6dd service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:53:57.346918 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4342/8596] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:53:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:53:57.918009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ed428-af26-4fe8-aacb-f0b8d6ff45fd None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:53:57.918404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ed428-af26-4fe8-aacb-f0b8d6ff45fd None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:53:57.918754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5ed428-af26-4fe8-aacb-f0b8d6ff45fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:53:57.940200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-8b5ed428-af26-4fe8-aacb-f0b8d6ff45fd None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:53:57.941544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8b5ed428-af26-4fe8-aacb-f0b8d6ff45fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:53:57.954745 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4255/8597] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:53:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:53:57.971547 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1de79b-e935-4576-93c2-088999e1d6dd service swift] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:53:58.016567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1de79b-e935-4576-93c2-088999e1d6dd service swift] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:53:58.022031 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a76f6-43d5-407d-a993-62a8e3d15efb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:53:58.022729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a76f6-43d5-407d-a993-62a8e3d15efb service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:53:58.023014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a76f6-43d5-407d-a993-62a8e3d15efb service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:53:58.023285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a76f6-43d5-407d-a993-62a8e3d15efb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:53:58.033725 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a76f6-43d5-407d-a993-62a8e3d15efb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:53:58.035495 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a76f6-43d5-407d-a993-62a8e3d15efb service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:53:58.045629 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4343/8598] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:53:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:53:58.296390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff27db-2499-4c1b-8c4b-5a1b5ec537a0 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:53:58.296907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff27db-2499-4c1b-8c4b-5a1b5ec537a0 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:53:58.297010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff27db-2499-4c1b-8c4b-5a1b5ec537a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:53:58.318692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6cff27db-2499-4c1b-8c4b-5a1b5ec537a0 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:53:58.320376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6cff27db-2499-4c1b-8c4b-5a1b5ec537a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:53:58.329083 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4256/8599] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:53:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:53:58.343474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a76f6-43d5-407d-a993-62a8e3d15efb service swift] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:53:58.357851 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a76f6-43d5-407d-a993-62a8e3d15efb service swift] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:53:58.364055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bb922-46bd-4e9c-ba09-267b7d2e1835 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:53:58.364687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bb922-46bd-4e9c-ba09-267b7d2e1835 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:53:58.364963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bb922-46bd-4e9c-ba09-267b7d2e1835 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:53:58.365230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801bb922-46bd-4e9c-ba09-267b7d2e1835 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:53:58.375078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801bb922-46bd-4e9c-ba09-267b7d2e1835 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:53:58.376699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801bb922-46bd-4e9c-ba09-267b7d2e1835 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:53:58.386340 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4344/8600] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:53:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 07 01:53:58.733734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc60b9-8436-43c5-b3b1-4c1ecd405b04 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:53:58.734095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc60b9-8436-43c5-b3b1-4c1ecd405b04 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:53:58.734375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc60b9-8436-43c5-b3b1-4c1ecd405b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:53:58.754435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-36bc60b9-8436-43c5-b3b1-4c1ecd405b04 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:53:58.755629 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-36bc60b9-8436-43c5-b3b1-4c1ecd405b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:53:58.763060 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4257/8601] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:53:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:53:58.776117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bb922-46bd-4e9c-ba09-267b7d2e1835 service swift] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:53:58.789846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801bb922-46bd-4e9c-ba09-267b7d2e1835 service swift] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:53:58.795061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2873927-22fc-432c-ac20-35b5bf959ce3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:53:58.795660 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2873927-22fc-432c-ac20-35b5bf959ce3 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:53:58.795965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2873927-22fc-432c-ac20-35b5bf959ce3 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:53:58.796237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2873927-22fc-432c-ac20-35b5bf959ce3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:53:58.804799 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2873927-22fc-432c-ac20-35b5bf959ce3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:53:58.806368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2873927-22fc-432c-ac20-35b5bf959ce3 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:53:58.814381 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4345/8602] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:53:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:54:02.094539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc60b9-8436-43c5-b3b1-4c1ecd405b04 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:02.171023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc60b9-8436-43c5-b3b1-4c1ecd405b04 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:02.175829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713db21b-87ad-463e-a7ac-f5d98817ea7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:02.176674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713db21b-87ad-463e-a7ac-f5d98817ea7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:02.177052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713db21b-87ad-463e-a7ac-f5d98817ea7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:02.177455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713db21b-87ad-463e-a7ac-f5d98817ea7f admin admin] PATH_INFO: `/v3/users/2bc4703b0111425f9a46d1fee4884278` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:02.179252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713db21b-87ad-463e-a7ac-f5d98817ea7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc4703b0111425f9a46d1fee4884278)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:02.181374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713db21b-87ad-463e-a7ac-f5d98817ea7f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:02.231798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-713db21b-87ad-463e-a7ac-f5d98817ea7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc4703b0111425f9a46d1fee4884278'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:54:02.239502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-713db21b-87ad-463e-a7ac-f5d98817ea7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc4703b0111425f9a46d1fee4884278'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:54:02.256167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-713db21b-87ad-463e-a7ac-f5d98817ea7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc4703b0111425f9a46d1fee4884278'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:54:02.257066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-713db21b-87ad-463e-a7ac-f5d98817ea7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc4703b0111425f9a46d1fee4884278'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:54:02.259407 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:54:02.267223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-713db21b-87ad-463e-a7ac-f5d98817ea7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc4703b0111425f9a46d1fee4884278'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:54:02.276013 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4258/8603] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:54:02 2022] DELETE /identity/v3/users/2bc4703b0111425f9a46d1fee4884278 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:54:02.279647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac173ed-18ea-456a-b8f9-4f33c7025ddb None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:02.280214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac173ed-18ea-456a-b8f9-4f33c7025ddb None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:02.280214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac173ed-18ea-456a-b8f9-4f33c7025ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:02.301212 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-4ac173ed-18ea-456a-b8f9-4f33c7025ddb None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:54:02.302409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4ac173ed-18ea-456a-b8f9-4f33c7025ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:02.313018 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:54:02.371155 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4346/8604] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:54:02.383063 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713db21b-87ad-463e-a7ac-f5d98817ea7f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:02.384605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-713db21b-87ad-463e-a7ac-f5d98817ea7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:02.453648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713db21b-87ad-463e-a7ac-f5d98817ea7f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:02.457345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89834575-d7e1-4bfe-8162-65c0e4ba4124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:02.457941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89834575-d7e1-4bfe-8162-65c0e4ba4124 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:02.458215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89834575-d7e1-4bfe-8162-65c0e4ba4124 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:02.458484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89834575-d7e1-4bfe-8162-65c0e4ba4124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:02.467644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89834575-d7e1-4bfe-8162-65c0e4ba4124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:02.469097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89834575-d7e1-4bfe-8162-65c0e4ba4124 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:02.478958 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4259/8605] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:54:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:54:02.679662 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac173ed-18ea-456a-b8f9-4f33c7025ddb None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:02.681886 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4ac173ed-18ea-456a-b8f9-4f33c7025ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:02.703055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac173ed-18ea-456a-b8f9-4f33c7025ddb None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:02.711488 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1f537-de96-483a-bcfb-da38316f0773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:02.712670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1f537-de96-483a-bcfb-da38316f0773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:02.713148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1f537-de96-483a-bcfb-da38316f0773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:02.713782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1f537-de96-483a-bcfb-da38316f0773 admin admin] PATH_INFO: `/v3/projects/e4c73cd4714f4b34bf5f7f6f15989b52` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:02.716389 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1f537-de96-483a-bcfb-da38316f0773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4c73cd4714f4b34bf5f7f6f15989b52)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:02.722427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1f537-de96-483a-bcfb-da38316f0773 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:02.792123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c8a1f537-de96-483a-bcfb-da38316f0773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4c73cd4714f4b34bf5f7f6f15989b52', 'request_id': 'req-c8a1f537-de96-483a-bcfb-da38316f0773'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:54:02.801986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c8a1f537-de96-483a-bcfb-da38316f0773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4c73cd4714f4b34bf5f7f6f15989b52', 'request_id': 'req-c8a1f537-de96-483a-bcfb-da38316f0773'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:54:02.812012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c8a1f537-de96-483a-bcfb-da38316f0773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4c73cd4714f4b34bf5f7f6f15989b52', 'request_id': 'req-c8a1f537-de96-483a-bcfb-da38316f0773'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:54:02.828509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c8a1f537-de96-483a-bcfb-da38316f0773 admin admin] The token cache is being invalidate because project e4c73cd4714f4b34bf5f7f6f15989b52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:54:02.828922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c8a1f537-de96-483a-bcfb-da38316f0773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:54:02.829556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c8a1f537-de96-483a-bcfb-da38316f0773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:54:02.835281 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4347/8606] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:54:02 2022] DELETE /identity/v3/projects/e4c73cd4714f4b34bf5f7f6f15989b52 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:54:02.836931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76fd90-96bf-4aa0-9da0-68d88666b484 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:02.837219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76fd90-96bf-4aa0-9da0-68d88666b484 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:02.837493 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76fd90-96bf-4aa0-9da0-68d88666b484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:02.857356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ff76fd90-96bf-4aa0-9da0-68d88666b484 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:54:02.858555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ff76fd90-96bf-4aa0-9da0-68d88666b484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:02.922350 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4260/8607] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:54:02.930754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab29a65-e50c-484f-9268-9bb88a0c6a14 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:02.931056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab29a65-e50c-484f-9268-9bb88a0c6a14 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:02.931321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab29a65-e50c-484f-9268-9bb88a0c6a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:02.952344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6ab29a65-e50c-484f-9268-9bb88a0c6a14 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:54:02.953559 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6ab29a65-e50c-484f-9268-9bb88a0c6a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:02.965494 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4348/8608] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:54:02.972025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76fd90-96bf-4aa0-9da0-68d88666b484 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:02.985049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76fd90-96bf-4aa0-9da0-68d88666b484 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:02.990558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5edd14-d5ec-41d0-ab58-2deb79109d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:02.991811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5edd14-d5ec-41d0-ab58-2deb79109d6d admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:02.992124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5edd14-d5ec-41d0-ab58-2deb79109d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:02.992396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5edd14-d5ec-41d0-ab58-2deb79109d6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:02.993052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5edd14-d5ec-41d0-ab58-2deb79109d6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:54:02.993353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5edd14-d5ec-41d0-ab58-2deb79109d6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:02.995302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5edd14-d5ec-41d0-ab58-2deb79109d6d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:03.012714 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4261/8609] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:54:03.013919 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab29a65-e50c-484f-9268-9bb88a0c6a14 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:03.024719 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab29a65-e50c-484f-9268-9bb88a0c6a14 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:03.029648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfc1e4-ec1a-4b65-aa1b-51c5ec72f703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:03.030357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfc1e4-ec1a-4b65-aa1b-51c5ec72f703 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:03.030762 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfc1e4-ec1a-4b65-aa1b-51c5ec72f703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:03.031106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfc1e4-ec1a-4b65-aa1b-51c5ec72f703 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:03.032042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cfc1e4-ec1a-4b65-aa1b-51c5ec72f703 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:03.034194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cfc1e4-ec1a-4b65-aa1b-51c5ec72f703 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:03.066008 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4349/8610] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:54:03 2022] POST /identity/v3/projects => generated 393 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:54:03.069968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5edd14-d5ec-41d0-ab58-2deb79109d6d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:03.081120 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5edd14-d5ec-41d0-ab58-2deb79109d6d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:03.149092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3024cf-b9f9-4f35-b341-00eb00d01456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:03.149861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3024cf-b9f9-4f35-b341-00eb00d01456 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:03.150097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3024cf-b9f9-4f35-b341-00eb00d01456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:03.150219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3024cf-b9f9-4f35-b341-00eb00d01456 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:03.150825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3024cf-b9f9-4f35-b341-00eb00d01456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:03.152800 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3024cf-b9f9-4f35-b341-00eb00d01456 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:03.184118 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4262/8611] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:54:03 2022] POST /identity/v3/users => generated 297 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:54:03.185462 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfc1e4-ec1a-4b65-aa1b-51c5ec72f703 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:03.197581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfc1e4-ec1a-4b65-aa1b-51c5ec72f703 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:03.202726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00204c03-311d-4131-8590-fcccc3d4be9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:03.203451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00204c03-311d-4131-8590-fcccc3d4be9b admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:03.203799 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00204c03-311d-4131-8590-fcccc3d4be9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:03.204192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00204c03-311d-4131-8590-fcccc3d4be9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:03.204930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00204c03-311d-4131-8590-fcccc3d4be9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:03.206722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00204c03-311d-4131-8590-fcccc3d4be9b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:03.221733 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4350/8612] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:54:03.223275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3024cf-b9f9-4f35-b341-00eb00d01456 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:03.235633 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3024cf-b9f9-4f35-b341-00eb00d01456 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:03.240818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7ebb5-b099-4eb1-a618-a59fda3849aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:03.241466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7ebb5-b099-4eb1-a618-a59fda3849aa admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:03.241746 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7ebb5-b099-4eb1-a618-a59fda3849aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:03.242046 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7ebb5-b099-4eb1-a618-a59fda3849aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:03.242704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7ebb5-b099-4eb1-a618-a59fda3849aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:03.247418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7ebb5-b099-4eb1-a618-a59fda3849aa admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:03.254490 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:54:03.263160 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4263/8613] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:54:03.267248 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00204c03-311d-4131-8590-fcccc3d4be9b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:03.281870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00204c03-311d-4131-8590-fcccc3d4be9b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:03.288345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02667ea7-d05c-448f-b164-f4c67ca21097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:03.289309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02667ea7-d05c-448f-b164-f4c67ca21097 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:03.289907 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02667ea7-d05c-448f-b164-f4c67ca21097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:03.290123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02667ea7-d05c-448f-b164-f4c67ca21097 admin admin] PATH_INFO: `/v3/projects/d37d8c916412400ba4b57ea10fceb39e/users/830639b9b39a43a7b714b74c26fdf52c/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:03.307577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02667ea7-d05c-448f-b164-f4c67ca21097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d37d8c916412400ba4b57ea10fceb39e, user_id=830639b9b39a43a7b714b74c26fdf52c, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:03.310419 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02667ea7-d05c-448f-b164-f4c67ca21097 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:03.324416 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4351/8614] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:54:03 2022] PUT /identity/v3/projects/d37d8c916412400ba4b57ea10fceb39e/users/830639b9b39a43a7b714b74c26fdf52c/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:54:03.335997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530571a-da14-41ad-8205-fd4cb6af8101 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:03.336283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530571a-da14-41ad-8205-fd4cb6af8101 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:03.336575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530571a-da14-41ad-8205-fd4cb6af8101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:03.368123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b530571a-da14-41ad-8205-fd4cb6af8101 None None] MFA Rules not processed for user `830639b9b39a43a7b714b74c26fdf52c`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:54:03.369593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b530571a-da14-41ad-8205-fd4cb6af8101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:03.454405 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4264/8615] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:54:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:54:03.458752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02667ea7-d05c-448f-b164-f4c67ca21097 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:03.520681 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:54:03.556246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02667ea7-d05c-448f-b164-f4c67ca21097 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:03.563535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49df15-14ee-4fc4-8832-d2c4ef54c3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:03.564178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49df15-14ee-4fc4-8832-d2c4ef54c3b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:03.565381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49df15-14ee-4fc4-8832-d2c4ef54c3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:03.565673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49df15-14ee-4fc4-8832-d2c4ef54c3b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:03.566373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49df15-14ee-4fc4-8832-d2c4ef54c3b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:03.568396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49df15-14ee-4fc4-8832-d2c4ef54c3b3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:03.609126 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4352/8616] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:54:03 2022] POST /identity/v3/projects => generated 393 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:54:03.613129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530571a-da14-41ad-8205-fd4cb6af8101 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:03.626528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530571a-da14-41ad-8205-fd4cb6af8101 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:03.705167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e3451-2420-44e0-8c00-2960afcf7039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:03.705760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e3451-2420-44e0-8c00-2960afcf7039 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:03.706199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e3451-2420-44e0-8c00-2960afcf7039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:03.706559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e3451-2420-44e0-8c00-2960afcf7039 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:03.707351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e3451-2420-44e0-8c00-2960afcf7039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:03.710104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e3451-2420-44e0-8c00-2960afcf7039 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:03.741662 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4265/8617] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:54:03 2022] POST /identity/v3/users => generated 303 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:54:03.743449 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49df15-14ee-4fc4-8832-d2c4ef54c3b3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:03.756408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49df15-14ee-4fc4-8832-d2c4ef54c3b3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:03.762668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84daf7-b7aa-40b6-a2b5-a7dccc10b98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:03.763284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84daf7-b7aa-40b6-a2b5-a7dccc10b98f admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:03.763561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84daf7-b7aa-40b6-a2b5-a7dccc10b98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:03.763832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84daf7-b7aa-40b6-a2b5-a7dccc10b98f admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:03.764570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84daf7-b7aa-40b6-a2b5-a7dccc10b98f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:03.766173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84daf7-b7aa-40b6-a2b5-a7dccc10b98f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:03.779571 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4353/8618] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:54:03.784143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e3451-2420-44e0-8c00-2960afcf7039 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:03.796617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e3451-2420-44e0-8c00-2960afcf7039 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:03.810685 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3434a-a500-4b1e-97a3-ddf8d6af0e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:03.811654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3434a-a500-4b1e-97a3-ddf8d6af0e05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:03.812646 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3434a-a500-4b1e-97a3-ddf8d6af0e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:03.812991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3434a-a500-4b1e-97a3-ddf8d6af0e05 admin admin] PATH_INFO: `/v3/projects/2569e52ed8a440daa867d62aa63f95d5/users/2fde507388124f7e8d3449239f674c5e/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:03.836540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3434a-a500-4b1e-97a3-ddf8d6af0e05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2569e52ed8a440daa867d62aa63f95d5, user_id=2fde507388124f7e8d3449239f674c5e, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:03.839586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3434a-a500-4b1e-97a3-ddf8d6af0e05 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:03.853950 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4266/8619] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:54:03 2022] PUT /identity/v3/projects/2569e52ed8a440daa867d62aa63f95d5/users/2fde507388124f7e8d3449239f674c5e/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:54:03.858306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84daf7-b7aa-40b6-a2b5-a7dccc10b98f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:03.869501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84daf7-b7aa-40b6-a2b5-a7dccc10b98f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:03.970702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085dc67-e1e4-46c5-8c42-10083fa55c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:03.971336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085dc67-e1e4-46c5-8c42-10083fa55c8e admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:03.971611 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085dc67-e1e4-46c5-8c42-10083fa55c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:03.971900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085dc67-e1e4-46c5-8c42-10083fa55c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:03.972615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085dc67-e1e4-46c5-8c42-10083fa55c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:03.974210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085dc67-e1e4-46c5-8c42-10083fa55c8e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:03.989101 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4354/8620] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:54:03.990268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3434a-a500-4b1e-97a3-ddf8d6af0e05 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:04.009037 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3434a-a500-4b1e-97a3-ddf8d6af0e05 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:04.023831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849a753-ccfe-4638-8513-63abd01caa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:04.024841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849a753-ccfe-4638-8513-63abd01caa1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:04.025166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849a753-ccfe-4638-8513-63abd01caa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:04.025540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849a753-ccfe-4638-8513-63abd01caa1e admin admin] PATH_INFO: `/v3/projects/2569e52ed8a440daa867d62aa63f95d5/users/2fde507388124f7e8d3449239f674c5e/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:04.032188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849a753-ccfe-4638-8513-63abd01caa1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2569e52ed8a440daa867d62aa63f95d5, user_id=2fde507388124f7e8d3449239f674c5e, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:04.035035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849a753-ccfe-4638-8513-63abd01caa1e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:04.061068 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4267/8621] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:54:03 2022] PUT /identity/v3/projects/2569e52ed8a440daa867d62aa63f95d5/users/2fde507388124f7e8d3449239f674c5e/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:54:04.072800 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6470e79-dba3-42d0-8c59-b9004606d3e2 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:04.073504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6470e79-dba3-42d0-8c59-b9004606d3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:04.073751 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6470e79-dba3-42d0-8c59-b9004606d3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:04.107205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d6470e79-dba3-42d0-8c59-b9004606d3e2 None None] MFA Rules not processed for user `2fde507388124f7e8d3449239f674c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:54:04.109047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d6470e79-dba3-42d0-8c59-b9004606d3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:04.193076 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4355/8622] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:54:04 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:54:04.207538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849a753-ccfe-4638-8513-63abd01caa1e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:04.209870 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9849a753-ccfe-4638-8513-63abd01caa1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:04.261285 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:54:04.307207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849a753-ccfe-4638-8513-63abd01caa1e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:04.314188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028afdc-ba83-4fdf-a029-59978f2d3f66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:04.315152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028afdc-ba83-4fdf-a029-59978f2d3f66 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:04.315627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028afdc-ba83-4fdf-a029-59978f2d3f66 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:04.316057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028afdc-ba83-4fdf-a029-59978f2d3f66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:04.394883 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9028afdc-ba83-4fdf-a029-59978f2d3f66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:04.397581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9028afdc-ba83-4fdf-a029-59978f2d3f66 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:04.415949 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4268/8623] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:54:04 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:54:07.415943 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6470e79-dba3-42d0-8c59-b9004606d3e2 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:07.419108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d6470e79-dba3-42d0-8c59-b9004606d3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:07.474277 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:54:07.551477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6470e79-dba3-42d0-8c59-b9004606d3e2 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:07.561217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a636d8d-eed6-42a4-b51d-a0211667adcb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:07.563004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a636d8d-eed6-42a4-b51d-a0211667adcb service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:07.566632 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a636d8d-eed6-42a4-b51d-a0211667adcb service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:07.567207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a636d8d-eed6-42a4-b51d-a0211667adcb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:07.569311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0a636d8d-eed6-42a4-b51d-a0211667adcb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:07.585011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a636d8d-eed6-42a4-b51d-a0211667adcb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:07.586901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a636d8d-eed6-42a4-b51d-a0211667adcb service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:07.602109 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4356/8624] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:54:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:54:08.317627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028afdc-ba83-4fdf-a029-59978f2d3f66 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:08.319795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9028afdc-ba83-4fdf-a029-59978f2d3f66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:08.418642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028afdc-ba83-4fdf-a029-59978f2d3f66 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:08.422913 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59e0cf-335e-4cfb-836c-a77041199b23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:08.423698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59e0cf-335e-4cfb-836c-a77041199b23 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:08.424004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59e0cf-335e-4cfb-836c-a77041199b23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:08.424350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59e0cf-335e-4cfb-836c-a77041199b23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:08.434301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59e0cf-335e-4cfb-836c-a77041199b23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:08.437075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59e0cf-335e-4cfb-836c-a77041199b23 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:08.447921 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4269/8625] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:54:08 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:54:11.847826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb7e65-a0e9-458c-8c9d-6491cbe609e6 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:11.848655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb7e65-a0e9-458c-8c9d-6491cbe609e6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:11.849082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb7e65-a0e9-458c-8c9d-6491cbe609e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:11.876239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-06fb7e65-a0e9-458c-8c9d-6491cbe609e6 None None] MFA Rules not processed for user `830639b9b39a43a7b714b74c26fdf52c`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:54:11.878006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-06fb7e65-a0e9-458c-8c9d-6491cbe609e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:11.909522 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4357/8626] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:54:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:54:13.203132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59e0cf-335e-4cfb-836c-a77041199b23 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:13.205546 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3e59e0cf-335e-4cfb-836c-a77041199b23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:13.245742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59e0cf-335e-4cfb-836c-a77041199b23 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:13.260046 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04947e07-2538-4d7b-ba2e-c1d9d09b49b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:13.260829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04947e07-2538-4d7b-ba2e-c1d9d09b49b7 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:13.261210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04947e07-2538-4d7b-ba2e-c1d9d09b49b7 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:13.261573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04947e07-2538-4d7b-ba2e-c1d9d09b49b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:13.273125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-04947e07-2538-4d7b-ba2e-c1d9d09b49b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:13.333283 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04947e07-2538-4d7b-ba2e-c1d9d09b49b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:13.334990 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04947e07-2538-4d7b-ba2e-c1d9d09b49b7 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:13.359630 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4270/8627] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:54:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:54:21.872745 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=25 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:54:23.346722 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=76 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:54:24.451047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb7e65-a0e9-458c-8c9d-6491cbe609e6 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:24.496728 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb7e65-a0e9-458c-8c9d-6491cbe609e6 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:24.503741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff67f8-7fef-464e-a8b0-a484fc201d60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:24.504908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff67f8-7fef-464e-a8b0-a484fc201d60 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:24.505447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff67f8-7fef-464e-a8b0-a484fc201d60 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:24.505991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff67f8-7fef-464e-a8b0-a484fc201d60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:24.508784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9fff67f8-7fef-464e-a8b0-a484fc201d60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:24.542608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff67f8-7fef-464e-a8b0-a484fc201d60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:24.544562 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff67f8-7fef-464e-a8b0-a484fc201d60 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:24.580195 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4358/8628] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:54:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:54:24.648317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04947e07-2538-4d7b-ba2e-c1d9d09b49b7 service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:24.649784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-04947e07-2538-4d7b-ba2e-c1d9d09b49b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:24.830808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04947e07-2538-4d7b-ba2e-c1d9d09b49b7 service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:24.836305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5a1ee-0f3c-4460-a9c4-4138f7a8cdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:24.836946 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5a1ee-0f3c-4460-a9c4-4138f7a8cdf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:24.837428 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5a1ee-0f3c-4460-a9c4-4138f7a8cdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:24.837702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5a1ee-0f3c-4460-a9c4-4138f7a8cdf6 admin admin] PATH_INFO: `/v3/users/073f0cff787a466a9fbf9fb43b03b726` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:24.838888 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5a1ee-0f3c-4460-a9c4-4138f7a8cdf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=073f0cff787a466a9fbf9fb43b03b726)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:24.841399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5a1ee-0f3c-4460-a9c4-4138f7a8cdf6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:24.897466 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a5b5a1ee-0f3c-4460-a9c4-4138f7a8cdf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '073f0cff787a466a9fbf9fb43b03b726'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:54:24.905192 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a5b5a1ee-0f3c-4460-a9c4-4138f7a8cdf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '073f0cff787a466a9fbf9fb43b03b726'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:54:24.918645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a5b5a1ee-0f3c-4460-a9c4-4138f7a8cdf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '073f0cff787a466a9fbf9fb43b03b726'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:54:24.919387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a5b5a1ee-0f3c-4460-a9c4-4138f7a8cdf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '073f0cff787a466a9fbf9fb43b03b726'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:54:24.930209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a5b5a1ee-0f3c-4460-a9c4-4138f7a8cdf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '073f0cff787a466a9fbf9fb43b03b726'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:54:24.937565 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4271/8629] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:54:24 2022] DELETE /identity/v3/users/073f0cff787a466a9fbf9fb43b03b726 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:54:24.942494 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a10efd-b88c-42a1-8a8d-42248790c2f8 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:24.942926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a10efd-b88c-42a1-8a8d-42248790c2f8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:24.943635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a10efd-b88c-42a1-8a8d-42248790c2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:24.987715 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c7a10efd-b88c-42a1-8a8d-42248790c2f8 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:54:24.989101 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c7a10efd-b88c-42a1-8a8d-42248790c2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:25.075977 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4359/8630] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:54:25.086148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5a1ee-0f3c-4460-a9c4-4138f7a8cdf6 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:25.087578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a5b5a1ee-0f3c-4460-a9c4-4138f7a8cdf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:25.197101 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:54:25.204844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5a1ee-0f3c-4460-a9c4-4138f7a8cdf6 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:25.210077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42e17c-4d50-4370-8c93-66d5e464222c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:25.210701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42e17c-4d50-4370-8c93-66d5e464222c service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:25.211105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42e17c-4d50-4370-8c93-66d5e464222c service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:25.211606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42e17c-4d50-4370-8c93-66d5e464222c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:25.221457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e42e17c-4d50-4370-8c93-66d5e464222c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:25.223019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e42e17c-4d50-4370-8c93-66d5e464222c service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:25.233179 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4272/8631] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:54:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:54:25.416195 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a10efd-b88c-42a1-8a8d-42248790c2f8 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:25.417764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c7a10efd-b88c-42a1-8a8d-42248790c2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:25.431476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a10efd-b88c-42a1-8a8d-42248790c2f8 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:25.437761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d95a1-6ca8-4870-b915-311ea92d954d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:25.438744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d95a1-6ca8-4870-b915-311ea92d954d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:25.439195 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d95a1-6ca8-4870-b915-311ea92d954d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:25.439672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d95a1-6ca8-4870-b915-311ea92d954d admin admin] PATH_INFO: `/v3/projects/2bd8662019804060a7b712456d095ad2` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:25.441018 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d95a1-6ca8-4870-b915-311ea92d954d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bd8662019804060a7b712456d095ad2)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:25.444110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d95a1-6ca8-4870-b915-311ea92d954d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:25.498465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-268d95a1-6ca8-4870-b915-311ea92d954d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bd8662019804060a7b712456d095ad2', 'request_id': 'req-268d95a1-6ca8-4870-b915-311ea92d954d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:54:25.504134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-268d95a1-6ca8-4870-b915-311ea92d954d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bd8662019804060a7b712456d095ad2', 'request_id': 'req-268d95a1-6ca8-4870-b915-311ea92d954d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:54:25.511078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-268d95a1-6ca8-4870-b915-311ea92d954d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bd8662019804060a7b712456d095ad2', 'request_id': 'req-268d95a1-6ca8-4870-b915-311ea92d954d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:54:25.524959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-268d95a1-6ca8-4870-b915-311ea92d954d admin admin] The token cache is being invalidate because project 2bd8662019804060a7b712456d095ad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:54:25.525246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-268d95a1-6ca8-4870-b915-311ea92d954d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:54:25.525881 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-268d95a1-6ca8-4870-b915-311ea92d954d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:54:25.527552 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4360/8632] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:54:25 2022] DELETE /identity/v3/projects/2bd8662019804060a7b712456d095ad2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:54:25.531553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42e17c-4d50-4370-8c93-66d5e464222c service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:25.541998 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42e17c-4d50-4370-8c93-66d5e464222c service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:25.600772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cdae5c-7ad6-45b6-a732-f5b170cbd784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:25.601404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdae5c-7ad6-45b6-a732-f5b170cbd784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:25.601683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdae5c-7ad6-45b6-a732-f5b170cbd784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:25.601958 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdae5c-7ad6-45b6-a732-f5b170cbd784 admin admin] PATH_INFO: `/v3/users/82d128ecd4864274ac86b10bc99e0a04` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:25.603092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cdae5c-7ad6-45b6-a732-f5b170cbd784 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82d128ecd4864274ac86b10bc99e0a04)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:25.605158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cdae5c-7ad6-45b6-a732-f5b170cbd784 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:25.665394 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-28cdae5c-7ad6-45b6-a732-f5b170cbd784 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82d128ecd4864274ac86b10bc99e0a04'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:54:25.683826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-28cdae5c-7ad6-45b6-a732-f5b170cbd784 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82d128ecd4864274ac86b10bc99e0a04'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:54:25.700444 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-28cdae5c-7ad6-45b6-a732-f5b170cbd784 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82d128ecd4864274ac86b10bc99e0a04'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:54:25.701259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-28cdae5c-7ad6-45b6-a732-f5b170cbd784 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82d128ecd4864274ac86b10bc99e0a04'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:54:25.712970 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-28cdae5c-7ad6-45b6-a732-f5b170cbd784 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82d128ecd4864274ac86b10bc99e0a04'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:54:25.720627 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4273/8633] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:54:25 2022] DELETE /identity/v3/users/82d128ecd4864274ac86b10bc99e0a04 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:54:26.148906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d95a1-6ca8-4870-b915-311ea92d954d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:26.150328 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-268d95a1-6ca8-4870-b915-311ea92d954d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:26.168414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d95a1-6ca8-4870-b915-311ea92d954d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:26.261095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd17f4-7bed-4804-a2d7-7046bfffc91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:26.261838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd17f4-7bed-4804-a2d7-7046bfffc91a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:26.262147 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd17f4-7bed-4804-a2d7-7046bfffc91a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:26.262445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd17f4-7bed-4804-a2d7-7046bfffc91a admin admin] PATH_INFO: `/v3/projects/bcb7e4473b5d46bf9231103e1f8e1b4b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:26.264236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd17f4-7bed-4804-a2d7-7046bfffc91a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcb7e4473b5d46bf9231103e1f8e1b4b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:26.267101 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd17f4-7bed-4804-a2d7-7046bfffc91a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:26.277424 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:54:26.341215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-49dd17f4-7bed-4804-a2d7-7046bfffc91a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcb7e4473b5d46bf9231103e1f8e1b4b', 'request_id': 'req-49dd17f4-7bed-4804-a2d7-7046bfffc91a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:54:26.349543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-49dd17f4-7bed-4804-a2d7-7046bfffc91a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcb7e4473b5d46bf9231103e1f8e1b4b', 'request_id': 'req-49dd17f4-7bed-4804-a2d7-7046bfffc91a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:54:26.357063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-49dd17f4-7bed-4804-a2d7-7046bfffc91a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcb7e4473b5d46bf9231103e1f8e1b4b', 'request_id': 'req-49dd17f4-7bed-4804-a2d7-7046bfffc91a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:54:26.374326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-49dd17f4-7bed-4804-a2d7-7046bfffc91a admin admin] The token cache is being invalidate because project bcb7e4473b5d46bf9231103e1f8e1b4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:54:26.374618 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-49dd17f4-7bed-4804-a2d7-7046bfffc91a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:54:26.379361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-49dd17f4-7bed-4804-a2d7-7046bfffc91a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:54:26.379361 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4361/8634] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:54:26 2022] DELETE /identity/v3/projects/bcb7e4473b5d46bf9231103e1f8e1b4b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:54:26.386551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df8590-37a6-4e17-8852-50e72ce1a7ad None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:26.386881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df8590-37a6-4e17-8852-50e72ce1a7ad None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:26.387105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df8590-37a6-4e17-8852-50e72ce1a7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:26.455430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-39df8590-37a6-4e17-8852-50e72ce1a7ad None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:54:26.457160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-39df8590-37a6-4e17-8852-50e72ce1a7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:26.512559 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:54:26.540877 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4274/8635] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:54:26.549891 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb6909-c18d-441f-b6ef-700f5185cf96 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:26.550362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb6909-c18d-441f-b6ef-700f5185cf96 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:26.550574 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb6909-c18d-441f-b6ef-700f5185cf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:26.591767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6cbb6909-c18d-441f-b6ef-700f5185cf96 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:54:26.593470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6cbb6909-c18d-441f-b6ef-700f5185cf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:26.602552 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4362/8636] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:54:26.606440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df8590-37a6-4e17-8852-50e72ce1a7ad None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:26.617817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df8590-37a6-4e17-8852-50e72ce1a7ad None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:26.623563 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96eb39e-ab07-46fb-abb5-eab484e43de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:26.624221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96eb39e-ab07-46fb-abb5-eab484e43de5 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:26.624501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96eb39e-ab07-46fb-abb5-eab484e43de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:26.625411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96eb39e-ab07-46fb-abb5-eab484e43de5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:26.625411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96eb39e-ab07-46fb-abb5-eab484e43de5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:54:26.625848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96eb39e-ab07-46fb-abb5-eab484e43de5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:26.627594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96eb39e-ab07-46fb-abb5-eab484e43de5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:26.646429 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4275/8637] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 01:54:26.647857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb6909-c18d-441f-b6ef-700f5185cf96 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:26.657872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb6909-c18d-441f-b6ef-700f5185cf96 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:26.663526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fede16-8781-4524-a2a3-b9ac7f47b9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:26.664185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fede16-8781-4524-a2a3-b9ac7f47b9b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:26.664465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fede16-8781-4524-a2a3-b9ac7f47b9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:26.664741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fede16-8781-4524-a2a3-b9ac7f47b9b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:26.665401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fede16-8781-4524-a2a3-b9ac7f47b9b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:26.667416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fede16-8781-4524-a2a3-b9ac7f47b9b3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:26.742744 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4363/8638] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:54:26 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:54:26.746624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96eb39e-ab07-46fb-abb5-eab484e43de5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:26.758287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96eb39e-ab07-46fb-abb5-eab484e43de5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:26.831656 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7661618-d3de-4f1f-a8b4-1727735b8e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:26.832563 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7661618-d3de-4f1f-a8b4-1727735b8e95 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:26.832837 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7661618-d3de-4f1f-a8b4-1727735b8e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:26.834557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7661618-d3de-4f1f-a8b4-1727735b8e95 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:26.835399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7661618-d3de-4f1f-a8b4-1727735b8e95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:26.837717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7661618-d3de-4f1f-a8b4-1727735b8e95 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:26.867215 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4276/8639] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:54:26 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:54:26.867840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fede16-8781-4524-a2a3-b9ac7f47b9b3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:26.879115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fede16-8781-4524-a2a3-b9ac7f47b9b3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:26.884351 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef6872-8487-41e2-92ef-9ee781107c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:26.885085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef6872-8487-41e2-92ef-9ee781107c2b admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:26.885467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef6872-8487-41e2-92ef-9ee781107c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:26.885846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef6872-8487-41e2-92ef-9ee781107c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:26.886600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef6872-8487-41e2-92ef-9ee781107c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:26.888347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef6872-8487-41e2-92ef-9ee781107c2b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:26.920017 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4364/8640] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:54:26.921714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7661618-d3de-4f1f-a8b4-1727735b8e95 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:26.933569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7661618-d3de-4f1f-a8b4-1727735b8e95 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:26.938919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f504fe8-ad5a-4c4e-a948-7a45e97d1f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:26.939660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f504fe8-ad5a-4c4e-a948-7a45e97d1f31 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:26.939964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f504fe8-ad5a-4c4e-a948-7a45e97d1f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:26.940824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f504fe8-ad5a-4c4e-a948-7a45e97d1f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:26.940926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f504fe8-ad5a-4c4e-a948-7a45e97d1f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:26.942534 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f504fe8-ad5a-4c4e-a948-7a45e97d1f31 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:26.955923 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4277/8641] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:54:26.960456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef6872-8487-41e2-92ef-9ee781107c2b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:26.981300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef6872-8487-41e2-92ef-9ee781107c2b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:26.991076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762df8a-e464-4678-862c-16fbf1c52a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:26.991857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762df8a-e464-4678-862c-16fbf1c52a31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:26.992394 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762df8a-e464-4678-862c-16fbf1c52a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:26.992745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762df8a-e464-4678-862c-16fbf1c52a31 admin admin] PATH_INFO: `/v3/projects/7df97238e4904914ba19be69db5e228b/users/2ea9eff758654d1e8b7d02e6b4153a73/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:27.012386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762df8a-e464-4678-862c-16fbf1c52a31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7df97238e4904914ba19be69db5e228b, user_id=2ea9eff758654d1e8b7d02e6b4153a73, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:27.015813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762df8a-e464-4678-862c-16fbf1c52a31 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:27.045930 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4365/8642] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:54:26 2022] PUT /identity/v3/projects/7df97238e4904914ba19be69db5e228b/users/2ea9eff758654d1e8b7d02e6b4153a73/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:54:27.051520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67678c-f67a-467e-8370-c773093d88a0 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:27.051952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67678c-f67a-467e-8370-c773093d88a0 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:27.052238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67678c-f67a-467e-8370-c773093d88a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:27.077037 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6b67678c-f67a-467e-8370-c773093d88a0 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:54:27.078303 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6b67678c-f67a-467e-8370-c773093d88a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:27.167909 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4278/8643] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:54:27.178532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762df8a-e464-4678-862c-16fbf1c52a31 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:27.180472 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6762df8a-e464-4678-862c-16fbf1c52a31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:27.255769 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762df8a-e464-4678-862c-16fbf1c52a31 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:27.259714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15d6f5-0c24-4df8-912d-6fa0acc2604d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:27.260473 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15d6f5-0c24-4df8-912d-6fa0acc2604d service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:27.260822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15d6f5-0c24-4df8-912d-6fa0acc2604d service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:27.261171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15d6f5-0c24-4df8-912d-6fa0acc2604d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:27.272553 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15d6f5-0c24-4df8-912d-6fa0acc2604d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:27.274135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15d6f5-0c24-4df8-912d-6fa0acc2604d service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:27.285230 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4366/8644] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:54:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:54:28.149578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cff347-475c-4e9e-82f0-b66160053037 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:28.150625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cff347-475c-4e9e-82f0-b66160053037 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:28.150905 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cff347-475c-4e9e-82f0-b66160053037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:28.175989 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-82cff347-475c-4e9e-82f0-b66160053037 None None] MFA Rules not processed for user `661f6c9aa7da4e348a9b0d91840078c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:54:28.177521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-82cff347-475c-4e9e-82f0-b66160053037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:28.227444 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:54:28.237365 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4279/8645] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:54:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:54:35.163774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ceeabc-12e0-4dc9-8abf-90304387e360 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:35.164702 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ceeabc-12e0-4dc9-8abf-90304387e360 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:35.165141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ceeabc-12e0-4dc9-8abf-90304387e360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:35.264758 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-00ceeabc-12e0-4dc9-8abf-90304387e360 None None] MFA Rules not processed for user `2ea9eff758654d1e8b7d02e6b4153a73`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:54:35.269118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-00ceeabc-12e0-4dc9-8abf-90304387e360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:35.288143 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:54:35.404266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cff347-475c-4e9e-82f0-b66160053037 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:35.404853 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4367/8646] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:54:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:54:35.433037 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cff347-475c-4e9e-82f0-b66160053037 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:35.446995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd2190-c969-4cc3-9f1a-98f83e7916a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:35.447642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd2190-c969-4cc3-9f1a-98f83e7916a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:35.449359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd2190-c969-4cc3-9f1a-98f83e7916a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:35.450395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd2190-c969-4cc3-9f1a-98f83e7916a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:35.453670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd2190-c969-4cc3-9f1a-98f83e7916a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:35.457156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd2190-c969-4cc3-9f1a-98f83e7916a5 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:35.505579 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4280/8647] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:54:35 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:54:35.507767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ceeabc-12e0-4dc9-8abf-90304387e360 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:35.520267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ceeabc-12e0-4dc9-8abf-90304387e360 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:35.634731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84b765-f37f-4a55-b1d0-993b9c4a35f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:35.635483 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84b765-f37f-4a55-b1d0-993b9c4a35f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:35.635868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84b765-f37f-4a55-b1d0-993b9c4a35f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:35.636267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84b765-f37f-4a55-b1d0-993b9c4a35f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:35.637020 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84b765-f37f-4a55-b1d0-993b9c4a35f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:35.644668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84b765-f37f-4a55-b1d0-993b9c4a35f1 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:35.683535 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4368/8648] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:54:35 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:54:35.687497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd2190-c969-4cc3-9f1a-98f83e7916a5 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:35.710041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd2190-c969-4cc3-9f1a-98f83e7916a5 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:35.724145 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd507a-6a84-4638-88af-d32f8fc0de7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:35.724930 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd507a-6a84-4638-88af-d32f8fc0de7e admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:35.725212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd507a-6a84-4638-88af-d32f8fc0de7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:35.725484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd507a-6a84-4638-88af-d32f8fc0de7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:35.726149 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd507a-6a84-4638-88af-d32f8fc0de7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:35.728200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd507a-6a84-4638-88af-d32f8fc0de7e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:35.757029 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4281/8649] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:54:35.758271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84b765-f37f-4a55-b1d0-993b9c4a35f1 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:35.773301 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84b765-f37f-4a55-b1d0-993b9c4a35f1 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:35.779104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5ca98-a3aa-4871-a8b6-87f07660dcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:35.779912 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5ca98-a3aa-4871-a8b6-87f07660dcaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:35.780245 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5ca98-a3aa-4871-a8b6-87f07660dcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:35.780532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a5ca98-a3aa-4871-a8b6-87f07660dcaf admin admin] PATH_INFO: `/v3/projects/53bcb0ce6a124bbb969a5bcfdfd9e054/users/bb5f8c162b3943dc9233d21f62ddab38/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:35.805958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5ca98-a3aa-4871-a8b6-87f07660dcaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=53bcb0ce6a124bbb969a5bcfdfd9e054, user_id=bb5f8c162b3943dc9233d21f62ddab38, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:35.809138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a5ca98-a3aa-4871-a8b6-87f07660dcaf admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:35.836377 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4369/8650] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:54:35 2022] PUT /identity/v3/projects/53bcb0ce6a124bbb969a5bcfdfd9e054/users/bb5f8c162b3943dc9233d21f62ddab38/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:54:35.838672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd507a-6a84-4638-88af-d32f8fc0de7e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:35.864870 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd507a-6a84-4638-88af-d32f8fc0de7e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:35.981079 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a38c64-106b-405d-abb0-1fb9bf0cfc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:35.982583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a38c64-106b-405d-abb0-1fb9bf0cfc4e admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:35.983205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a38c64-106b-405d-abb0-1fb9bf0cfc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:35.983780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a38c64-106b-405d-abb0-1fb9bf0cfc4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:35.985873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a38c64-106b-405d-abb0-1fb9bf0cfc4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:35.987863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a38c64-106b-405d-abb0-1fb9bf0cfc4e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:36.031597 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4282/8651] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:54:36.033188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5ca98-a3aa-4871-a8b6-87f07660dcaf admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:36.045472 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a5ca98-a3aa-4871-a8b6-87f07660dcaf admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:36.052107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196acea6-17be-4b73-b735-31917ff8830a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:36.053031 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196acea6-17be-4b73-b735-31917ff8830a admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:36.054088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196acea6-17be-4b73-b735-31917ff8830a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:36.054466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196acea6-17be-4b73-b735-31917ff8830a admin admin] PATH_INFO: `/v3/projects/53bcb0ce6a124bbb969a5bcfdfd9e054/users/bb5f8c162b3943dc9233d21f62ddab38/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:36.056643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196acea6-17be-4b73-b735-31917ff8830a admin admin] RBAC: Authorizing `identity:create_grant(project_id=53bcb0ce6a124bbb969a5bcfdfd9e054, user_id=bb5f8c162b3943dc9233d21f62ddab38, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:36.060930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196acea6-17be-4b73-b735-31917ff8830a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:36.077278 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4370/8652] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:54:36 2022] PUT /identity/v3/projects/53bcb0ce6a124bbb969a5bcfdfd9e054/users/bb5f8c162b3943dc9233d21f62ddab38/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:54:42.914586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72669f5a-af86-4e52-8270-732b6278b940 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:42.915094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72669f5a-af86-4e52-8270-732b6278b940 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:42.915290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72669f5a-af86-4e52-8270-732b6278b940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:42.984687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-72669f5a-af86-4e52-8270-732b6278b940 None None] MFA Rules not processed for user `bb5f8c162b3943dc9233d21f62ddab38`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:54:42.990952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-72669f5a-af86-4e52-8270-732b6278b940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:43.170996 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4283/8653] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:54:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:54:43.181234 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196acea6-17be-4b73-b735-31917ff8830a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:43.183802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-196acea6-17be-4b73-b735-31917ff8830a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:43.328037 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:54:43.342965 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196acea6-17be-4b73-b735-31917ff8830a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:43.353120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f15ee-75e9-40d4-8e86-709f31fa2303 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:43.353738 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f15ee-75e9-40d4-8e86-709f31fa2303 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:43.354016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f15ee-75e9-40d4-8e86-709f31fa2303 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:43.354286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f15ee-75e9-40d4-8e86-709f31fa2303 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:43.427795 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f15ee-75e9-40d4-8e86-709f31fa2303 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:43.429774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f15ee-75e9-40d4-8e86-709f31fa2303 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:43.440058 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4371/8654] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:54:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:54:44.907484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468177a-8f37-4a5a-869b-3ff9b156b206 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:44.908090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468177a-8f37-4a5a-869b-3ff9b156b206 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:44.908176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468177a-8f37-4a5a-869b-3ff9b156b206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:44.937533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-8468177a-8f37-4a5a-869b-3ff9b156b206 None None] MFA Rules not processed for user `2ea9eff758654d1e8b7d02e6b4153a73`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:54:44.938838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8468177a-8f37-4a5a-869b-3ff9b156b206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:44.950920 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4284/8655] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:54:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:54:52.808134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041575f6-4da8-4464-b69a-1b007cb1544f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:52.809338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041575f6-4da8-4464-b69a-1b007cb1544f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:52.810867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041575f6-4da8-4464-b69a-1b007cb1544f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:52.842745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-041575f6-4da8-4464-b69a-1b007cb1544f None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:54:52.844315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-041575f6-4da8-4464-b69a-1b007cb1544f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:52.944259 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4372/8656] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 01:54:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:54:52.963102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468177a-8f37-4a5a-869b-3ff9b156b206 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:52.965663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8468177a-8f37-4a5a-869b-3ff9b156b206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:53.026502 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:54:53.083855 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468177a-8f37-4a5a-869b-3ff9b156b206 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:53.096940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712bf6a-3638-4665-881a-5b99fa062221 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:53.098581 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712bf6a-3638-4665-881a-5b99fa062221 service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:53.099089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712bf6a-3638-4665-881a-5b99fa062221 service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:53.099615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712bf6a-3638-4665-881a-5b99fa062221 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:53.112713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d712bf6a-3638-4665-881a-5b99fa062221 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:53.115117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d712bf6a-3638-4665-881a-5b99fa062221 service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:53.125147 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4285/8657] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:54:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:54:54.453582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d40400-60ff-43b8-9d7f-ceb3e3d8e6c5 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:54.454161 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d40400-60ff-43b8-9d7f-ceb3e3d8e6c5 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:54.454420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d40400-60ff-43b8-9d7f-ceb3e3d8e6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:54.475821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-c5d40400-60ff-43b8-9d7f-ceb3e3d8e6c5 None None] MFA Rules not processed for user `661f6c9aa7da4e348a9b0d91840078c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:54:54.477174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c5d40400-60ff-43b8-9d7f-ceb3e3d8e6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:54:54.556008 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4373/8658] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:54:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:54:57.804394 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712bf6a-3638-4665-881a-5b99fa062221 service swift] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:54:57.921435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d712bf6a-3638-4665-881a-5b99fa062221 service swift] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:54:57.928909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35c962-052c-4390-82ad-d9d3c35c49fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:54:57.930608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35c962-052c-4390-82ad-d9d3c35c49fc service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:54:57.931060 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35c962-052c-4390-82ad-d9d3c35c49fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:54:57.931500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35c962-052c-4390-82ad-d9d3c35c49fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:54:57.951475 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35c962-052c-4390-82ad-d9d3c35c49fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:54:57.953153 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35c962-052c-4390-82ad-d9d3c35c49fc service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:54:57.983494 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4286/8659] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:54:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:55:04.327017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d40400-60ff-43b8-9d7f-ceb3e3d8e6c5 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:55:04.328671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c5d40400-60ff-43b8-9d7f-ceb3e3d8e6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:55:04.427329 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:55:04.470685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d40400-60ff-43b8-9d7f-ceb3e3d8e6c5 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:55:04.479830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70819b-5868-4df8-bff9-1b9b262dcb76 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:55:04.480729 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70819b-5868-4df8-bff9-1b9b262dcb76 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:04.481209 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70819b-5868-4df8-bff9-1b9b262dcb76 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:04.481572 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70819b-5868-4df8-bff9-1b9b262dcb76 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:04.485620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-da70819b-5868-4df8-bff9-1b9b262dcb76 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:55:04.524250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70819b-5868-4df8-bff9-1b9b262dcb76 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:55:04.526589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70819b-5868-4df8-bff9-1b9b262dcb76 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:55:04.553457 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4374/8660] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:55:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:55:04.812707 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35c962-052c-4390-82ad-d9d3c35c49fc service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:55:04.814290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-da35c962-052c-4390-82ad-d9d3c35c49fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:55:04.850777 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35c962-052c-4390-82ad-d9d3c35c49fc service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:55:04.855011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5fa32-a1e4-4c6a-84d7-fd385fa178e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:55:04.855632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5fa32-a1e4-4c6a-84d7-fd385fa178e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:04.855996 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5fa32-a1e4-4c6a-84d7-fd385fa178e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:04.856452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5fa32-a1e4-4c6a-84d7-fd385fa178e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:04.858279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-79c5fa32-a1e4-4c6a-84d7-fd385fa178e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:55:04.872067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5fa32-a1e4-4c6a-84d7-fd385fa178e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:55:04.874446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5fa32-a1e4-4c6a-84d7-fd385fa178e3 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:55:04.902729 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4287/8661] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:55:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:55:05.047989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51853ef0-a24e-4157-a89d-6687daa695f8 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:05.048296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51853ef0-a24e-4157-a89d-6687daa695f8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:05.048541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51853ef0-a24e-4157-a89d-6687daa695f8 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:05.050784 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4375/8662] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 01:55:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:55:05.057659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a81e1-7326-4ecb-8971-1a80df655c3c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:05.057659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a81e1-7326-4ecb-8971-1a80df655c3c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:05.057904 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a81e1-7326-4ecb-8971-1a80df655c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:05.117651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e84a81e1-7326-4ecb-8971-1a80df655c3c None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:55:05.119060 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e84a81e1-7326-4ecb-8971-1a80df655c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:55:05.131438 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4288/8663] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 01:55:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:55:05.179545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51853ef0-a24e-4157-a89d-6687daa695f8 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:55:05.198116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51853ef0-a24e-4157-a89d-6687daa695f8 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:55:05.206687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce56759-792b-4159-bebe-536717a5fd9a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:55:05.207490 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce56759-792b-4159-bebe-536717a5fd9a service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:05.208380 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce56759-792b-4159-bebe-536717a5fd9a service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:05.226253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce56759-792b-4159-bebe-536717a5fd9a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:05.248279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce56759-792b-4159-bebe-536717a5fd9a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:55:05.252052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce56759-792b-4159-bebe-536717a5fd9a service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:55:05.265148 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4376/8664] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:55:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:55:05.605747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a81e1-7326-4ecb-8971-1a80df655c3c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:55:05.625631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a81e1-7326-4ecb-8971-1a80df655c3c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:55:05.633468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2e127-fb91-4ce4-b399-b03f35121fb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:55:05.633975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2e127-fb91-4ce4-b399-b03f35121fb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:05.634251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2e127-fb91-4ce4-b399-b03f35121fb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:05.634533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2e127-fb91-4ce4-b399-b03f35121fb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:05.637190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-64d2e127-fb91-4ce4-b399-b03f35121fb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:55:05.675138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d2e127-fb91-4ce4-b399-b03f35121fb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:55:05.677023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d2e127-fb91-4ce4-b399-b03f35121fb0 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:55:05.698031 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4289/8665] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:55:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:55:15.259910 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=14 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:55:15.691482 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=65 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:55:26.022695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce56759-792b-4159-bebe-536717a5fd9a service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:55:26.024273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5ce56759-792b-4159-bebe-536717a5fd9a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:55:26.119120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce56759-792b-4159-bebe-536717a5fd9a service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:55:26.124110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e3b68-ee98-4ba1-8733-5725a4855ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:55:26.125046 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e3b68-ee98-4ba1-8733-5725a4855ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:26.125416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e3b68-ee98-4ba1-8733-5725a4855ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:26.125727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e3b68-ee98-4ba1-8733-5725a4855ef7 admin admin] PATH_INFO: `/v3/users/cc27d58f027d4fc3b398f6c184911e2e` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:26.127538 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e3b68-ee98-4ba1-8733-5725a4855ef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc27d58f027d4fc3b398f6c184911e2e)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:55:26.129716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e3b68-ee98-4ba1-8733-5725a4855ef7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:55:26.196760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-197e3b68-ee98-4ba1-8733-5725a4855ef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc27d58f027d4fc3b398f6c184911e2e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:55:26.205642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-197e3b68-ee98-4ba1-8733-5725a4855ef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc27d58f027d4fc3b398f6c184911e2e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:55:26.223106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-197e3b68-ee98-4ba1-8733-5725a4855ef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc27d58f027d4fc3b398f6c184911e2e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:55:26.224110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-197e3b68-ee98-4ba1-8733-5725a4855ef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc27d58f027d4fc3b398f6c184911e2e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:55:26.234307 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-197e3b68-ee98-4ba1-8733-5725a4855ef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc27d58f027d4fc3b398f6c184911e2e'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:55:26.242025 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4377/8666] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:55:26 2022] DELETE /identity/v3/users/cc27d58f027d4fc3b398f6c184911e2e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:55:26.452279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2e127-fb91-4ce4-b399-b03f35121fb0 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:55:26.484569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2e127-fb91-4ce4-b399-b03f35121fb0 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:55:26.557640 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0a280-2c70-4ac4-a144-88fe09cda60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:55:26.558814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0a280-2c70-4ac4-a144-88fe09cda60d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:26.559097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0a280-2c70-4ac4-a144-88fe09cda60d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:26.559408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0a280-2c70-4ac4-a144-88fe09cda60d admin admin] PATH_INFO: `/v3/projects/da2650b8d88f4992a09bcf0048bcc4c2` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:26.560815 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd0a280-2c70-4ac4-a144-88fe09cda60d admin admin] RBAC: Authorizing `identity:delete_project(project_id=da2650b8d88f4992a09bcf0048bcc4c2)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:55:26.562943 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd0a280-2c70-4ac4-a144-88fe09cda60d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:55:26.620484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dfd0a280-2c70-4ac4-a144-88fe09cda60d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da2650b8d88f4992a09bcf0048bcc4c2', 'request_id': 'req-dfd0a280-2c70-4ac4-a144-88fe09cda60d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:55:26.628208 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dfd0a280-2c70-4ac4-a144-88fe09cda60d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da2650b8d88f4992a09bcf0048bcc4c2', 'request_id': 'req-dfd0a280-2c70-4ac4-a144-88fe09cda60d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:55:26.638095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dfd0a280-2c70-4ac4-a144-88fe09cda60d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da2650b8d88f4992a09bcf0048bcc4c2', 'request_id': 'req-dfd0a280-2c70-4ac4-a144-88fe09cda60d'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:55:26.656395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dfd0a280-2c70-4ac4-a144-88fe09cda60d admin admin] The token cache is being invalidate because project da2650b8d88f4992a09bcf0048bcc4c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:55:26.656953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dfd0a280-2c70-4ac4-a144-88fe09cda60d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:55:26.658552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-dfd0a280-2c70-4ac4-a144-88fe09cda60d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:55:26.661683 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4290/8667] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:55:26 2022] DELETE /identity/v3/projects/da2650b8d88f4992a09bcf0048bcc4c2 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:55:26.667177 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479e921-a692-496e-ac6a-1ae7f1316d36 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:26.667493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479e921-a692-496e-ac6a-1ae7f1316d36 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:26.667793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479e921-a692-496e-ac6a-1ae7f1316d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:26.690184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d479e921-a692-496e-ac6a-1ae7f1316d36 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:55:26.691804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d479e921-a692-496e-ac6a-1ae7f1316d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:55:26.761726 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4378/8668] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:55:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:55:26.770241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e09b5-7761-41a6-949f-b5700aad1e2a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:26.770681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e09b5-7761-41a6-949f-b5700aad1e2a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:26.771082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e09b5-7761-41a6-949f-b5700aad1e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:26.794416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e00e09b5-7761-41a6-949f-b5700aad1e2a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:55:26.795655 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e00e09b5-7761-41a6-949f-b5700aad1e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:55:26.804608 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4291/8669] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:55:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:55:26.808665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479e921-a692-496e-ac6a-1ae7f1316d36 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:55:26.819433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479e921-a692-496e-ac6a-1ae7f1316d36 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:55:26.824985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1104c7f-a219-4e75-8014-9de3945033f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:55:26.825807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1104c7f-a219-4e75-8014-9de3945033f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:26.826079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1104c7f-a219-4e75-8014-9de3945033f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:26.826342 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1104c7f-a219-4e75-8014-9de3945033f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:26.827007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1104c7f-a219-4e75-8014-9de3945033f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:55:26.828069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1104c7f-a219-4e75-8014-9de3945033f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:55:26.830240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1104c7f-a219-4e75-8014-9de3945033f9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:55:26.837624 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:55:26.846289 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4379/8670] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:55:26.849479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e09b5-7761-41a6-949f-b5700aad1e2a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:55:26.859008 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e09b5-7761-41a6-949f-b5700aad1e2a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:55:26.863947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de39274-5011-4747-a4d2-12dbd9b7c729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:55:26.864548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de39274-5011-4747-a4d2-12dbd9b7c729 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:26.864826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de39274-5011-4747-a4d2-12dbd9b7c729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:26.865101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de39274-5011-4747-a4d2-12dbd9b7c729 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:26.865884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de39274-5011-4747-a4d2-12dbd9b7c729 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:55:26.868373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de39274-5011-4747-a4d2-12dbd9b7c729 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:55:26.900651 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4292/8671] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:55:26 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:55:26.902150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1104c7f-a219-4e75-8014-9de3945033f9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:55:26.913263 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1104c7f-a219-4e75-8014-9de3945033f9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:55:26.980300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837630b-2987-4e1b-8a2c-10f232de35be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:55:26.981092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837630b-2987-4e1b-8a2c-10f232de35be admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:26.981422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837630b-2987-4e1b-8a2c-10f232de35be admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:26.981691 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837630b-2987-4e1b-8a2c-10f232de35be admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:26.982372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837630b-2987-4e1b-8a2c-10f232de35be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:55:26.984345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837630b-2987-4e1b-8a2c-10f232de35be admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:55:27.009787 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4380/8672] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:55:26 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:55:27.012296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de39274-5011-4747-a4d2-12dbd9b7c729 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:55:27.023548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de39274-5011-4747-a4d2-12dbd9b7c729 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:55:27.028583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75a47b-a0f9-47a9-99ea-c157efe9b8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:55:27.029257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75a47b-a0f9-47a9-99ea-c157efe9b8f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:27.029542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75a47b-a0f9-47a9-99ea-c157efe9b8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:27.029816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75a47b-a0f9-47a9-99ea-c157efe9b8f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:27.030504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75a47b-a0f9-47a9-99ea-c157efe9b8f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:55:27.032193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75a47b-a0f9-47a9-99ea-c157efe9b8f3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:55:27.044403 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4293/8673] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:55:27.048827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837630b-2987-4e1b-8a2c-10f232de35be admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:55:27.060143 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837630b-2987-4e1b-8a2c-10f232de35be admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:55:27.065521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120248e-4100-478a-9369-46c1e2eac522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:55:27.066131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120248e-4100-478a-9369-46c1e2eac522 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:27.066412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120248e-4100-478a-9369-46c1e2eac522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:27.066688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120248e-4100-478a-9369-46c1e2eac522 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:27.067348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e120248e-4100-478a-9369-46c1e2eac522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:55:27.069106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e120248e-4100-478a-9369-46c1e2eac522 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:55:27.086835 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4381/8674] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:55:27.090602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75a47b-a0f9-47a9-99ea-c157efe9b8f3 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:55:27.102986 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75a47b-a0f9-47a9-99ea-c157efe9b8f3 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:55:27.108301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62f33c-de47-4ca8-90e4-c355c059c5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:55:27.108958 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62f33c-de47-4ca8-90e4-c355c059c5f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:27.109242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62f33c-de47-4ca8-90e4-c355c059c5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:27.109516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62f33c-de47-4ca8-90e4-c355c059c5f6 admin admin] PATH_INFO: `/v3/projects/0a860ae0e0f84931893591f9d4b7b7a1/users/8e40c219d69d4769b6a957ecce6103b9/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:27.126838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62f33c-de47-4ca8-90e4-c355c059c5f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a860ae0e0f84931893591f9d4b7b7a1, user_id=8e40c219d69d4769b6a957ecce6103b9, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:55:27.130129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b62f33c-de47-4ca8-90e4-c355c059c5f6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:55:27.147721 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4294/8675] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:55:27 2022] PUT /identity/v3/projects/0a860ae0e0f84931893591f9d4b7b7a1/users/8e40c219d69d4769b6a957ecce6103b9/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:55:27.160763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ada6b-dfff-4d63-816b-395d9768242f None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:27.161030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ada6b-dfff-4d63-816b-395d9768242f None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:27.161305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ada6b-dfff-4d63-816b-395d9768242f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:27.193615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-708ada6b-dfff-4d63-816b-395d9768242f None None] MFA Rules not processed for user `8e40c219d69d4769b6a957ecce6103b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:55:27.194829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-708ada6b-dfff-4d63-816b-395d9768242f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:55:27.276282 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4382/8676] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:55:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:55:27.277578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62f33c-de47-4ca8-90e4-c355c059c5f6 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:55:27.313674 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:55:27.356815 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62f33c-de47-4ca8-90e4-c355c059c5f6 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:55:27.366105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88041bd2-f438-4133-a69d-4d97b1fe544e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:55:27.366716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88041bd2-f438-4133-a69d-4d97b1fe544e admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:27.367004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88041bd2-f438-4133-a69d-4d97b1fe544e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:27.367277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88041bd2-f438-4133-a69d-4d97b1fe544e admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:27.368211 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88041bd2-f438-4133-a69d-4d97b1fe544e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:55:27.370162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88041bd2-f438-4133-a69d-4d97b1fe544e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:55:27.406699 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4295/8677] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:55:27 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:55:27.408592 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ada6b-dfff-4d63-816b-395d9768242f None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:55:27.419536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ada6b-dfff-4d63-816b-395d9768242f None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:55:27.478191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eac282-4601-4a69-82b0-325495480b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:55:27.480549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eac282-4601-4a69-82b0-325495480b62 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:27.480840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eac282-4601-4a69-82b0-325495480b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:27.481122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eac282-4601-4a69-82b0-325495480b62 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:27.481834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eac282-4601-4a69-82b0-325495480b62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:55:27.483770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eac282-4601-4a69-82b0-325495480b62 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:55:27.495557 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:55:27.507138 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4383/8678] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:55:27 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:55:27.511190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88041bd2-f438-4133-a69d-4d97b1fe544e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:55:27.522207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88041bd2-f438-4133-a69d-4d97b1fe544e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:55:27.527436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70d733-f18d-466d-95de-683a56f84937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:55:27.528017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70d733-f18d-466d-95de-683a56f84937 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:27.528318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70d733-f18d-466d-95de-683a56f84937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:27.528591 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70d733-f18d-466d-95de-683a56f84937 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:27.529263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70d733-f18d-466d-95de-683a56f84937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:55:27.530876 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70d733-f18d-466d-95de-683a56f84937 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:55:27.543233 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4296/8679] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:55:27.547198 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eac282-4601-4a69-82b0-325495480b62 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:55:27.558054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eac282-4601-4a69-82b0-325495480b62 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:55:27.563179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f854d-d56c-4bfe-ba9f-19a37b7eca52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:55:27.563783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f854d-d56c-4bfe-ba9f-19a37b7eca52 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:27.564177 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f854d-d56c-4bfe-ba9f-19a37b7eca52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:27.564412 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f854d-d56c-4bfe-ba9f-19a37b7eca52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:27.565087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f854d-d56c-4bfe-ba9f-19a37b7eca52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:55:27.566671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f854d-d56c-4bfe-ba9f-19a37b7eca52 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:55:27.577074 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4384/8680] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:55:27.581908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70d733-f18d-466d-95de-683a56f84937 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:55:27.592290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70d733-f18d-466d-95de-683a56f84937 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:55:27.598185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c1810-8d79-4116-a55d-ee81ee41388c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:55:27.598848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c1810-8d79-4116-a55d-ee81ee41388c admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:27.599129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c1810-8d79-4116-a55d-ee81ee41388c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:27.599406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c1810-8d79-4116-a55d-ee81ee41388c admin admin] PATH_INFO: `/v3/projects/3ca6612959684e5a8c1188a3b368409d/users/eb06bb12cb75489d9428e2fff9f19f6b/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:27.614564 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c1810-8d79-4116-a55d-ee81ee41388c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ca6612959684e5a8c1188a3b368409d, user_id=eb06bb12cb75489d9428e2fff9f19f6b, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:55:27.617308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c1810-8d79-4116-a55d-ee81ee41388c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:55:27.631436 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4297/8681] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:55:27 2022] PUT /identity/v3/projects/3ca6612959684e5a8c1188a3b368409d/users/eb06bb12cb75489d9428e2fff9f19f6b/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:55:27.641997 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9ca7e-82a9-4157-a96b-908743c786b3 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:27.642837 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9ca7e-82a9-4157-a96b-908743c786b3 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:27.643122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9ca7e-82a9-4157-a96b-908743c786b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:27.678171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9be9ca7e-82a9-4157-a96b-908743c786b3 None None] MFA Rules not processed for user `eb06bb12cb75489d9428e2fff9f19f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:55:27.679420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9be9ca7e-82a9-4157-a96b-908743c786b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:55:27.747255 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4385/8682] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:55:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:55:27.751821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c1810-8d79-4116-a55d-ee81ee41388c admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:55:27.816962 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c1810-8d79-4116-a55d-ee81ee41388c admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:55:27.821675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913cbe5-5d84-4386-85d5-1979e0bb09a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:55:27.822282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913cbe5-5d84-4386-85d5-1979e0bb09a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:27.822561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913cbe5-5d84-4386-85d5-1979e0bb09a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:27.822832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913cbe5-5d84-4386-85d5-1979e0bb09a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:27.823470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913cbe5-5d84-4386-85d5-1979e0bb09a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:55:27.825476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913cbe5-5d84-4386-85d5-1979e0bb09a1 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:55:27.854805 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4298/8683] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:55:27 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:55:27.858903 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9ca7e-82a9-4157-a96b-908743c786b3 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:55:27.870582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9ca7e-82a9-4157-a96b-908743c786b3 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:55:27.926432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368e306-b97f-4c82-b918-c37dd4dc57f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:55:27.927043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368e306-b97f-4c82-b918-c37dd4dc57f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:27.927321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368e306-b97f-4c82-b918-c37dd4dc57f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:27.927594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368e306-b97f-4c82-b918-c37dd4dc57f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:27.928249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368e306-b97f-4c82-b918-c37dd4dc57f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:55:27.930164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368e306-b97f-4c82-b918-c37dd4dc57f5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:55:27.951796 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4386/8684] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:55:27 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:55:27.956872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913cbe5-5d84-4386-85d5-1979e0bb09a1 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:55:27.968545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913cbe5-5d84-4386-85d5-1979e0bb09a1 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:55:27.973386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419009c-b391-44e1-83b1-06b75d517db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:55:27.973990 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419009c-b391-44e1-83b1-06b75d517db6 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:27.974272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419009c-b391-44e1-83b1-06b75d517db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:27.974545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419009c-b391-44e1-83b1-06b75d517db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:27.975191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419009c-b391-44e1-83b1-06b75d517db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:55:27.976833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419009c-b391-44e1-83b1-06b75d517db6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:55:27.989180 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4299/8685] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:55:27.993915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368e306-b97f-4c82-b918-c37dd4dc57f5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:55:28.004491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368e306-b97f-4c82-b918-c37dd4dc57f5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:55:28.009090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b04a5-dc2d-496c-ae68-b6550d6a7952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:55:28.009730 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b04a5-dc2d-496c-ae68-b6550d6a7952 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:28.010005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b04a5-dc2d-496c-ae68-b6550d6a7952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:28.010276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b04a5-dc2d-496c-ae68-b6550d6a7952 admin admin] PATH_INFO: `/v3/projects/ff39abfe70de48a49fc9fbd59e74e0fc/users/ca9408a47e7e4132a0ba24d660516f96/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:28.026403 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b04a5-dc2d-496c-ae68-b6550d6a7952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff39abfe70de48a49fc9fbd59e74e0fc, user_id=ca9408a47e7e4132a0ba24d660516f96, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:55:28.029748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b04a5-dc2d-496c-ae68-b6550d6a7952 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:55:28.046270 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4387/8686] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:55:27 2022] PUT /identity/v3/projects/ff39abfe70de48a49fc9fbd59e74e0fc/users/ca9408a47e7e4132a0ba24d660516f96/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:55:28.050152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419009c-b391-44e1-83b1-06b75d517db6 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:55:28.060700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419009c-b391-44e1-83b1-06b75d517db6 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:55:28.111456 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:55:28.123242 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2e459-555e-426b-9109-9c4aca01fb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:55:28.123851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2e459-555e-426b-9109-9c4aca01fb3f admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:28.124163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2e459-555e-426b-9109-9c4aca01fb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:28.124436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2e459-555e-426b-9109-9c4aca01fb3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:28.125088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2e459-555e-426b-9109-9c4aca01fb3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:55:28.127249 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2e459-555e-426b-9109-9c4aca01fb3f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:55:28.137666 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4300/8687] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:55:28.141767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b04a5-dc2d-496c-ae68-b6550d6a7952 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:55:28.153061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b04a5-dc2d-496c-ae68-b6550d6a7952 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:55:28.158215 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35347f29-9098-4cf5-af08-67286715189f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:55:28.159130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35347f29-9098-4cf5-af08-67286715189f admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:28.159406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35347f29-9098-4cf5-af08-67286715189f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:28.159713 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35347f29-9098-4cf5-af08-67286715189f admin admin] PATH_INFO: `/v3/projects/ff39abfe70de48a49fc9fbd59e74e0fc/users/ca9408a47e7e4132a0ba24d660516f96/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:28.161723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35347f29-9098-4cf5-af08-67286715189f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff39abfe70de48a49fc9fbd59e74e0fc, user_id=ca9408a47e7e4132a0ba24d660516f96, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:55:28.164416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35347f29-9098-4cf5-af08-67286715189f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:55:28.178903 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4388/8688] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:55:28 2022] PUT /identity/v3/projects/ff39abfe70de48a49fc9fbd59e74e0fc/users/ca9408a47e7e4132a0ba24d660516f96/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:55:28.187478 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037fc8c-6979-4141-9993-17209f57d51d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:28.187760 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037fc8c-6979-4141-9993-17209f57d51d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:28.188070 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037fc8c-6979-4141-9993-17209f57d51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:28.218676 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b037fc8c-6979-4141-9993-17209f57d51d None None] MFA Rules not processed for user `ca9408a47e7e4132a0ba24d660516f96`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:55:28.219925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b037fc8c-6979-4141-9993-17209f57d51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:55:28.298155 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4301/8689] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:55:28 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:55:28.313190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35347f29-9098-4cf5-af08-67286715189f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:55:28.315482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-35347f29-9098-4cf5-af08-67286715189f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:55:28.350846 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:55:28.407700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35347f29-9098-4cf5-af08-67286715189f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:55:28.413374 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08866ef3-d958-46ca-8a50-788115ece109 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:55:28.413980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08866ef3-d958-46ca-8a50-788115ece109 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:28.414255 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08866ef3-d958-46ca-8a50-788115ece109 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:28.414526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08866ef3-d958-46ca-8a50-788115ece109 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:28.469355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08866ef3-d958-46ca-8a50-788115ece109 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:55:28.470945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08866ef3-d958-46ca-8a50-788115ece109 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:55:28.479864 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4389/8690] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:55:28 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:55:31.694207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037fc8c-6979-4141-9993-17209f57d51d None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:55:31.695992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b037fc8c-6979-4141-9993-17209f57d51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:55:31.773624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037fc8c-6979-4141-9993-17209f57d51d None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:55:31.778613 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae3072-7a22-4b2a-8bcc-385592090a1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:55:31.779251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae3072-7a22-4b2a-8bcc-385592090a1c service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:31.779529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae3072-7a22-4b2a-8bcc-385592090a1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:31.779804 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae3072-7a22-4b2a-8bcc-385592090a1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:31.795156 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae3072-7a22-4b2a-8bcc-385592090a1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:55:31.796577 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae3072-7a22-4b2a-8bcc-385592090a1c service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:55:31.810986 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4302/8691] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:55:31 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:55:36.373269 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c292b17-5883-418f-94d5-dd15ec028138 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:36.373817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c292b17-5883-418f-94d5-dd15ec028138 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:36.373817 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c292b17-5883-418f-94d5-dd15ec028138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:36.397152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-6c292b17-5883-418f-94d5-dd15ec028138 None None] MFA Rules not processed for user `8e40c219d69d4769b6a957ecce6103b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:55:36.398656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6c292b17-5883-418f-94d5-dd15ec028138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:55:36.406770 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4390/8692] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:55:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:55:36.567089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae3072-7a22-4b2a-8bcc-385592090a1c service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:55:36.569302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ebae3072-7a22-4b2a-8bcc-385592090a1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:55:36.586605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae3072-7a22-4b2a-8bcc-385592090a1c service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:55:36.590615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b91716-01b7-49b1-9f71-ca609053bb31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:55:36.591535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b91716-01b7-49b1-9f71-ca609053bb31 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:36.591824 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b91716-01b7-49b1-9f71-ca609053bb31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:36.592137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b91716-01b7-49b1-9f71-ca609053bb31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:36.594264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-85b91716-01b7-49b1-9f71-ca609053bb31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:55:36.613383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b91716-01b7-49b1-9f71-ca609053bb31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:55:36.615142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b91716-01b7-49b1-9f71-ca609053bb31 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:55:36.630183 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4303/8693] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:55:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:55:46.389510 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=51 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:55:46.621841 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=72 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:55:52.370367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc8cb6-c2b1-4ba4-b609-771aebb58640 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:52.370964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc8cb6-c2b1-4ba4-b609-771aebb58640 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:52.371280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc8cb6-c2b1-4ba4-b609-771aebb58640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:52.483392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-56fc8cb6-c2b1-4ba4-b609-771aebb58640 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:55:52.485635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-56fc8cb6-c2b1-4ba4-b609-771aebb58640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:55:52.574077 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4391/8694] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 01:55:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:55:52.597468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b91716-01b7-49b1-9f71-ca609053bb31 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:55:52.598970 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-85b91716-01b7-49b1-9f71-ca609053bb31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:55:52.709704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b91716-01b7-49b1-9f71-ca609053bb31 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:55:52.715168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059376bc-548c-4f8d-bcbc-8d3f5cf11102 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:55:52.715781 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059376bc-548c-4f8d-bcbc-8d3f5cf11102 service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:55:52.717454 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059376bc-548c-4f8d-bcbc-8d3f5cf11102 service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:55:52.717736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059376bc-548c-4f8d-bcbc-8d3f5cf11102 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:55:52.727732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059376bc-548c-4f8d-bcbc-8d3f5cf11102 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:55:52.729652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059376bc-548c-4f8d-bcbc-8d3f5cf11102 service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:55:52.741413 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4304/8695] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 01:55:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 01:56:02.572786 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=44 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:56:02.736092 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=41 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:56:02.930217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc8cb6-c2b1-4ba4-b609-771aebb58640 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:56:02.931918 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-56fc8cb6-c2b1-4ba4-b609-771aebb58640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:56:03.024535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc8cb6-c2b1-4ba4-b609-771aebb58640 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:56:03.028560 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92800f6e-39d9-4d97-9622-94e522e4ebaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:56:03.030076 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92800f6e-39d9-4d97-9622-94e522e4ebaf service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:03.030670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92800f6e-39d9-4d97-9622-94e522e4ebaf service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:03.031743 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92800f6e-39d9-4d97-9622-94e522e4ebaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:03.034481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-92800f6e-39d9-4d97-9622-94e522e4ebaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:56:03.111082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92800f6e-39d9-4d97-9622-94e522e4ebaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:56:03.112669 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92800f6e-39d9-4d97-9622-94e522e4ebaf service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:56:03.123169 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4392/8696] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:56:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:56:10.701545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de99b51-7e0d-4f5e-965b-6e1f0279c85f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:10.702176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de99b51-7e0d-4f5e-965b-6e1f0279c85f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:10.702176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de99b51-7e0d-4f5e-965b-6e1f0279c85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:10.721245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-8de99b51-7e0d-4f5e-965b-6e1f0279c85f None None] MFA Rules not processed for user `661f6c9aa7da4e348a9b0d91840078c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:56:10.722455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8de99b51-7e0d-4f5e-965b-6e1f0279c85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:56:10.729836 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4305/8697] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:56:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:56:10.769060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92800f6e-39d9-4d97-9622-94e522e4ebaf service cinder] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:56:10.770695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-92800f6e-39d9-4d97-9622-94e522e4ebaf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:56:10.784643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92800f6e-39d9-4d97-9622-94e522e4ebaf service cinder] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:56:10.788833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe8ad3-70b2-44ca-a7ab-48c59e550bf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:56:10.789448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe8ad3-70b2-44ca-a7ab-48c59e550bf7 service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:10.789726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe8ad3-70b2-44ca-a7ab-48c59e550bf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:10.789998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe8ad3-70b2-44ca-a7ab-48c59e550bf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:10.791752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d4fe8ad3-70b2-44ca-a7ab-48c59e550bf7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:56:10.808668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe8ad3-70b2-44ca-a7ab-48c59e550bf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:56:10.810106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe8ad3-70b2-44ca-a7ab-48c59e550bf7 service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:56:10.824491 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4393/8698] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:56:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:56:11.755193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de99b51-7e0d-4f5e-965b-6e1f0279c85f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:56:11.776182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de99b51-7e0d-4f5e-965b-6e1f0279c85f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:56:11.782701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0f248-4033-4590-a142-654c26627936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:56:11.784270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0f248-4033-4590-a142-654c26627936 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:11.784694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0f248-4033-4590-a142-654c26627936 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:11.785225 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0f248-4033-4590-a142-654c26627936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:11.788510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bbc0f248-4033-4590-a142-654c26627936 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:56:11.819366 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc0f248-4033-4590-a142-654c26627936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:56:11.821550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc0f248-4033-4590-a142-654c26627936 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:56:11.850006 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4306/8699] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:56:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:56:15.262994 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e3e31-2233-4d47-bf7e-337bfa7285ba None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:15.263871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e3e31-2233-4d47-bf7e-337bfa7285ba None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:15.264926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e3e31-2233-4d47-bf7e-337bfa7285ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:15.314756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-4d0e3e31-2233-4d47-bf7e-337bfa7285ba None None] MFA Rules not processed for user `830639b9b39a43a7b714b74c26fdf52c`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:56:15.316078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4d0e3e31-2233-4d47-bf7e-337bfa7285ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:56:15.511170 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4394/8700] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:56:15 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:56:16.061292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0f248-4033-4590-a142-654c26627936 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:56:16.081813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0f248-4033-4590-a142-654c26627936 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:56:16.088511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b11ba6-f646-4ebd-9f3d-4a88522bb89b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:56:16.089371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b11ba6-f646-4ebd-9f3d-4a88522bb89b service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:16.089820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b11ba6-f646-4ebd-9f3d-4a88522bb89b service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:16.090258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b11ba6-f646-4ebd-9f3d-4a88522bb89b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:16.093934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-78b11ba6-f646-4ebd-9f3d-4a88522bb89b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:56:16.133653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b11ba6-f646-4ebd-9f3d-4a88522bb89b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:56:16.139132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b11ba6-f646-4ebd-9f3d-4a88522bb89b service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:56:16.157686 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4307/8701] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:56:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:56:25.489824 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=79 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:56:26.146517 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=15 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:56:29.851267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c184503-5e44-4a30-a797-3f9b8b9405bb None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:29.852452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c184503-5e44-4a30-a797-3f9b8b9405bb None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:29.854088 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c184503-5e44-4a30-a797-3f9b8b9405bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:29.876642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5c184503-5e44-4a30-a797-3f9b8b9405bb None None] MFA Rules not processed for user `8e40c219d69d4769b6a957ecce6103b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:56:29.877865 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5c184503-5e44-4a30-a797-3f9b8b9405bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:56:29.885238 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4395/8702] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:56:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:56:32.947804 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b11ba6-f646-4ebd-9f3d-4a88522bb89b service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:56:32.950344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-78b11ba6-f646-4ebd-9f3d-4a88522bb89b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:56:32.972127 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b11ba6-f646-4ebd-9f3d-4a88522bb89b service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:56:32.979003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0546b-6dfa-4bbc-b3e1-a74282c1c060 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:56:32.980132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0546b-6dfa-4bbc-b3e1-a74282c1c060 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:32.980601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0546b-6dfa-4bbc-b3e1-a74282c1c060 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:32.981053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0546b-6dfa-4bbc-b3e1-a74282c1c060 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:32.985220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5af0546b-6dfa-4bbc-b3e1-a74282c1c060 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:56:33.006094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0546b-6dfa-4bbc-b3e1-a74282c1c060 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:56:33.007870 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0546b-6dfa-4bbc-b3e1-a74282c1c060 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:56:33.074411 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4308/8703] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:56:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:56:33.181695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88261693-ab92-47dd-b5a7-4a43acf0b7e8 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:33.184619 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88261693-ab92-47dd-b5a7-4a43acf0b7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:33.185123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88261693-ab92-47dd-b5a7-4a43acf0b7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:33.256710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-88261693-ab92-47dd-b5a7-4a43acf0b7e8 None None] MFA Rules not processed for user `b219e01934fa477fbaa053cca586f01b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:56:33.258416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-88261693-ab92-47dd-b5a7-4a43acf0b7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:56:33.288109 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4396/8704] 10.222.0.39 () {58 vars in 1062 bytes} [Sun Aug 7 01:56:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:56:33.307556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0546b-6dfa-4bbc-b3e1-a74282c1c060 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:56:33.321237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88261693-ab92-47dd-b5a7-4a43acf0b7e8 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:56:33.322377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0546b-6dfa-4bbc-b3e1-a74282c1c060 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:56:33.327011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d49b63-3b71-417d-9596-680ff67a8720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:56:33.327906 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d49b63-3b71-417d-9596-680ff67a8720 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:33.328542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d49b63-3b71-417d-9596-680ff67a8720 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:33.328983 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d49b63-3b71-417d-9596-680ff67a8720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:33.331331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-79d49b63-3b71-417d-9596-680ff67a8720 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:56:33.331688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88261693-ab92-47dd-b5a7-4a43acf0b7e8 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:56:33.347946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc2955-8173-400a-8688-747df45b2137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:56:33.350275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d49b63-3b71-417d-9596-680ff67a8720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:56:33.350986 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc2955-8173-400a-8688-747df45b2137 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:33.351347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc2955-8173-400a-8688-747df45b2137 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:33.351701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc2955-8173-400a-8688-747df45b2137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:33.352505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d49b63-3b71-417d-9596-680ff67a8720 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:56:33.355979 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f0dc2955-8173-400a-8688-747df45b2137 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:56:33.373966 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4309/8705] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:56:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:56:33.510359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc2955-8173-400a-8688-747df45b2137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:56:33.511838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dc2955-8173-400a-8688-747df45b2137 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:56:33.532408 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4397/8706] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:56:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:56:35.227801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d49b63-3b71-417d-9596-680ff67a8720 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:56:35.250684 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d49b63-3b71-417d-9596-680ff67a8720 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:56:35.261544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628bc323-7afd-412d-97cc-2420a46711cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:56:35.262404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bc323-7afd-412d-97cc-2420a46711cb service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:35.262784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bc323-7afd-412d-97cc-2420a46711cb service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:35.263201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628bc323-7afd-412d-97cc-2420a46711cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:35.265919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-628bc323-7afd-412d-97cc-2420a46711cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:56:35.283482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628bc323-7afd-412d-97cc-2420a46711cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:56:35.285137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628bc323-7afd-412d-97cc-2420a46711cb service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:56:35.299515 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4310/8707] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:56:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:56:43.526638 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=42 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:56:45.291906 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=18 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:56:57.189624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc2955-8173-400a-8688-747df45b2137 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:56:57.191067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f0dc2955-8173-400a-8688-747df45b2137 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:56:57.293630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc2955-8173-400a-8688-747df45b2137 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:56:57.295301 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628bc323-7afd-412d-97cc-2420a46711cb service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:56:57.299544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b73a1-9097-4ea0-8450-54137a32f1e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:56:57.300251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b73a1-9097-4ea0-8450-54137a32f1e7 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:57.300608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b73a1-9097-4ea0-8450-54137a32f1e7 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:57.300989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b73a1-9097-4ea0-8450-54137a32f1e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:57.302852 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f94b73a1-9097-4ea0-8450-54137a32f1e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:56:57.317426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b73a1-9097-4ea0-8450-54137a32f1e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:56:57.319059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b73a1-9097-4ea0-8450-54137a32f1e7 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:56:57.332813 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4398/8708] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:56:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:56:57.373741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628bc323-7afd-412d-97cc-2420a46711cb service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:56:57.379332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d22179-e508-42c6-8fe4-9e7fe47a6b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:56:57.380089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d22179-e508-42c6-8fe4-9e7fe47a6b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:57.380296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d22179-e508-42c6-8fe4-9e7fe47a6b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:57.380566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d22179-e508-42c6-8fe4-9e7fe47a6b9f admin admin] PATH_INFO: `/v3/users/8e40c219d69d4769b6a957ecce6103b9` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:57.381884 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d22179-e508-42c6-8fe4-9e7fe47a6b9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e40c219d69d4769b6a957ecce6103b9)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:56:57.384067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d22179-e508-42c6-8fe4-9e7fe47a6b9f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:56:57.435838 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f7d22179-e508-42c6-8fe4-9e7fe47a6b9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e40c219d69d4769b6a957ecce6103b9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:56:57.443853 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f7d22179-e508-42c6-8fe4-9e7fe47a6b9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e40c219d69d4769b6a957ecce6103b9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:56:57.456118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f7d22179-e508-42c6-8fe4-9e7fe47a6b9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e40c219d69d4769b6a957ecce6103b9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:56:57.456849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f7d22179-e508-42c6-8fe4-9e7fe47a6b9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e40c219d69d4769b6a957ecce6103b9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:56:57.467018 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f7d22179-e508-42c6-8fe4-9e7fe47a6b9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e40c219d69d4769b6a957ecce6103b9'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:56:57.473084 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4311/8709] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:56:57 2022] DELETE /identity/v3/users/8e40c219d69d4769b6a957ecce6103b9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:56:57.478224 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254bd62-4c62-42a8-8974-0be3cce39538 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:57.478506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254bd62-4c62-42a8-8974-0be3cce39538 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:57.478788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254bd62-4c62-42a8-8974-0be3cce39538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:57.499877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e254bd62-4c62-42a8-8974-0be3cce39538 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:56:57.501714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e254bd62-4c62-42a8-8974-0be3cce39538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:56:57.560771 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4399/8710] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:56:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:56:57.570712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5531d87-5ed8-429d-b8a1-e33198288d9b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:57.570997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5531d87-5ed8-429d-b8a1-e33198288d9b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:57.571267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5531d87-5ed8-429d-b8a1-e33198288d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:57.591085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c5531d87-5ed8-429d-b8a1-e33198288d9b None None] MFA Rules not processed for user `b219e01934fa477fbaa053cca586f01b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:56:57.592237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c5531d87-5ed8-429d-b8a1-e33198288d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:56:57.644607 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4312/8711] 10.222.0.39 () {58 vars in 1062 bytes} [Sun Aug 7 01:56:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:56:57.650635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254bd62-4c62-42a8-8974-0be3cce39538 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:56:57.660595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254bd62-4c62-42a8-8974-0be3cce39538 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:56:57.664201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902cebd-5051-409e-9f6e-10315008db21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:56:57.664790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902cebd-5051-409e-9f6e-10315008db21 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:57.665067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902cebd-5051-409e-9f6e-10315008db21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:57.665446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902cebd-5051-409e-9f6e-10315008db21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:57.674961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902cebd-5051-409e-9f6e-10315008db21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:56:57.676448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902cebd-5051-409e-9f6e-10315008db21 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:56:57.685741 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4400/8712] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:56:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:56:57.863135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5531d87-5ed8-429d-b8a1-e33198288d9b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:56:57.864614 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c5531d87-5ed8-429d-b8a1-e33198288d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:56:57.881510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5531d87-5ed8-429d-b8a1-e33198288d9b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:56:57.887656 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ceb7d3-f7a6-4a7b-9584-aeafc2db3e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:56:57.888346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ceb7d3-f7a6-4a7b-9584-aeafc2db3e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:57.888650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ceb7d3-f7a6-4a7b-9584-aeafc2db3e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:57.889066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ceb7d3-f7a6-4a7b-9584-aeafc2db3e85 admin admin] PATH_INFO: `/v3/projects/0a860ae0e0f84931893591f9d4b7b7a1` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:57.890268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ceb7d3-f7a6-4a7b-9584-aeafc2db3e85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a860ae0e0f84931893591f9d4b7b7a1)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:56:57.892964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ceb7d3-f7a6-4a7b-9584-aeafc2db3e85 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:56:57.930518 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:56:57.956209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-07ceb7d3-f7a6-4a7b-9584-aeafc2db3e85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a860ae0e0f84931893591f9d4b7b7a1', 'request_id': 'req-07ceb7d3-f7a6-4a7b-9584-aeafc2db3e85'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:56:57.961850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-07ceb7d3-f7a6-4a7b-9584-aeafc2db3e85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a860ae0e0f84931893591f9d4b7b7a1', 'request_id': 'req-07ceb7d3-f7a6-4a7b-9584-aeafc2db3e85'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:56:57.969045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-07ceb7d3-f7a6-4a7b-9584-aeafc2db3e85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a860ae0e0f84931893591f9d4b7b7a1', 'request_id': 'req-07ceb7d3-f7a6-4a7b-9584-aeafc2db3e85'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:56:57.982401 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-07ceb7d3-f7a6-4a7b-9584-aeafc2db3e85 admin admin] The token cache is being invalidate because project 0a860ae0e0f84931893591f9d4b7b7a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:56:57.982773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-07ceb7d3-f7a6-4a7b-9584-aeafc2db3e85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:56:57.984006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-07ceb7d3-f7a6-4a7b-9584-aeafc2db3e85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:56:57.985103 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4313/8713] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:56:57 2022] DELETE /identity/v3/projects/0a860ae0e0f84931893591f9d4b7b7a1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:56:57.989733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902cebd-5051-409e-9f6e-10315008db21 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:56:57.999688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902cebd-5051-409e-9f6e-10315008db21 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:56:58.061126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f96df-7f7f-47df-a8ad-f5c5f3af0117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:56:58.061681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f96df-7f7f-47df-a8ad-f5c5f3af0117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:58.061959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f96df-7f7f-47df-a8ad-f5c5f3af0117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:58.062229 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f96df-7f7f-47df-a8ad-f5c5f3af0117 admin admin] PATH_INFO: `/v3/users/eb06bb12cb75489d9428e2fff9f19f6b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:58.063378 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f96df-7f7f-47df-a8ad-f5c5f3af0117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb06bb12cb75489d9428e2fff9f19f6b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:56:58.065464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f96df-7f7f-47df-a8ad-f5c5f3af0117 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:56:58.087220 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:56:58.115310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-621f96df-7f7f-47df-a8ad-f5c5f3af0117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb06bb12cb75489d9428e2fff9f19f6b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:56:58.123178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-621f96df-7f7f-47df-a8ad-f5c5f3af0117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb06bb12cb75489d9428e2fff9f19f6b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:56:58.136327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-621f96df-7f7f-47df-a8ad-f5c5f3af0117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb06bb12cb75489d9428e2fff9f19f6b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:56:58.137093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-621f96df-7f7f-47df-a8ad-f5c5f3af0117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb06bb12cb75489d9428e2fff9f19f6b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:56:58.146019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-621f96df-7f7f-47df-a8ad-f5c5f3af0117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb06bb12cb75489d9428e2fff9f19f6b'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:56:58.153041 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4401/8714] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:56:57 2022] DELETE /identity/v3/users/eb06bb12cb75489d9428e2fff9f19f6b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:56:58.451000 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ceb7d3-f7a6-4a7b-9584-aeafc2db3e85 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:56:58.452527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-07ceb7d3-f7a6-4a7b-9584-aeafc2db3e85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:56:58.466553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ceb7d3-f7a6-4a7b-9584-aeafc2db3e85 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:56:58.525544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad80535-ffc6-4d0d-a8da-f3f7224f00f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:56:58.526170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad80535-ffc6-4d0d-a8da-f3f7224f00f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:58.526447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad80535-ffc6-4d0d-a8da-f3f7224f00f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:58.526722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad80535-ffc6-4d0d-a8da-f3f7224f00f0 admin admin] PATH_INFO: `/v3/projects/3ca6612959684e5a8c1188a3b368409d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:58.527833 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad80535-ffc6-4d0d-a8da-f3f7224f00f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ca6612959684e5a8c1188a3b368409d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:56:58.529765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad80535-ffc6-4d0d-a8da-f3f7224f00f0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:56:58.582011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0ad80535-ffc6-4d0d-a8da-f3f7224f00f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ca6612959684e5a8c1188a3b368409d', 'request_id': 'req-0ad80535-ffc6-4d0d-a8da-f3f7224f00f0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:56:58.588367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0ad80535-ffc6-4d0d-a8da-f3f7224f00f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ca6612959684e5a8c1188a3b368409d', 'request_id': 'req-0ad80535-ffc6-4d0d-a8da-f3f7224f00f0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:56:58.594968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0ad80535-ffc6-4d0d-a8da-f3f7224f00f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ca6612959684e5a8c1188a3b368409d', 'request_id': 'req-0ad80535-ffc6-4d0d-a8da-f3f7224f00f0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:56:58.608626 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0ad80535-ffc6-4d0d-a8da-f3f7224f00f0 admin admin] The token cache is being invalidate because project 3ca6612959684e5a8c1188a3b368409d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:56:58.608931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0ad80535-ffc6-4d0d-a8da-f3f7224f00f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:56:58.609709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-0ad80535-ffc6-4d0d-a8da-f3f7224f00f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:56:58.611355 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4314/8715] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:56:58 2022] DELETE /identity/v3/projects/3ca6612959684e5a8c1188a3b368409d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:56:58.615718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f96df-7f7f-47df-a8ad-f5c5f3af0117 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:56:58.617272 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-621f96df-7f7f-47df-a8ad-f5c5f3af0117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:56:58.630532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f96df-7f7f-47df-a8ad-f5c5f3af0117 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:56:58.686828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d81e8-aaa5-4821-80f3-677b3fe26050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:56:58.687456 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d81e8-aaa5-4821-80f3-677b3fe26050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:58.687733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d81e8-aaa5-4821-80f3-677b3fe26050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:58.688565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d81e8-aaa5-4821-80f3-677b3fe26050 admin admin] PATH_INFO: `/v3/users/ca9408a47e7e4132a0ba24d660516f96` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:58.689708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d81e8-aaa5-4821-80f3-677b3fe26050 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca9408a47e7e4132a0ba24d660516f96)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:56:58.691624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d81e8-aaa5-4821-80f3-677b3fe26050 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:56:58.739604 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7c5d81e8-aaa5-4821-80f3-677b3fe26050 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca9408a47e7e4132a0ba24d660516f96'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:56:58.747542 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7c5d81e8-aaa5-4821-80f3-677b3fe26050 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca9408a47e7e4132a0ba24d660516f96'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:56:58.768300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7c5d81e8-aaa5-4821-80f3-677b3fe26050 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca9408a47e7e4132a0ba24d660516f96'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:56:58.769236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7c5d81e8-aaa5-4821-80f3-677b3fe26050 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca9408a47e7e4132a0ba24d660516f96'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:56:58.779077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7c5d81e8-aaa5-4821-80f3-677b3fe26050 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca9408a47e7e4132a0ba24d660516f96'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:56:58.786278 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4402/8716] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:56:58 2022] DELETE /identity/v3/users/ca9408a47e7e4132a0ba24d660516f96 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:56:58.986520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad80535-ffc6-4d0d-a8da-f3f7224f00f0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:56:58.989279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0ad80535-ffc6-4d0d-a8da-f3f7224f00f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:56:59.026141 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad80535-ffc6-4d0d-a8da-f3f7224f00f0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:56:59.077245 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:56:59.096174 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ccad9-3c3a-4347-bfe2-37ed2af8a580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:56:59.096973 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ccad9-3c3a-4347-bfe2-37ed2af8a580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:59.097632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ccad9-3c3a-4347-bfe2-37ed2af8a580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:59.097632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ccad9-3c3a-4347-bfe2-37ed2af8a580 admin admin] PATH_INFO: `/v3/projects/ff39abfe70de48a49fc9fbd59e74e0fc` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:59.098935 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ccad9-3c3a-4347-bfe2-37ed2af8a580 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff39abfe70de48a49fc9fbd59e74e0fc)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:56:59.101302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ccad9-3c3a-4347-bfe2-37ed2af8a580 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:56:59.152233 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ad5ccad9-3c3a-4347-bfe2-37ed2af8a580 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff39abfe70de48a49fc9fbd59e74e0fc', 'request_id': 'req-ad5ccad9-3c3a-4347-bfe2-37ed2af8a580'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:56:59.158729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ad5ccad9-3c3a-4347-bfe2-37ed2af8a580 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff39abfe70de48a49fc9fbd59e74e0fc', 'request_id': 'req-ad5ccad9-3c3a-4347-bfe2-37ed2af8a580'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:56:59.165853 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ad5ccad9-3c3a-4347-bfe2-37ed2af8a580 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff39abfe70de48a49fc9fbd59e74e0fc', 'request_id': 'req-ad5ccad9-3c3a-4347-bfe2-37ed2af8a580'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:56:59.182427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ad5ccad9-3c3a-4347-bfe2-37ed2af8a580 admin admin] The token cache is being invalidate because project ff39abfe70de48a49fc9fbd59e74e0fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:56:59.182734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ad5ccad9-3c3a-4347-bfe2-37ed2af8a580 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:56:59.183390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ad5ccad9-3c3a-4347-bfe2-37ed2af8a580 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:56:59.185071 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4315/8717] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:56:58 2022] DELETE /identity/v3/projects/ff39abfe70de48a49fc9fbd59e74e0fc => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:56:59.190455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b52169-8a47-4e56-a262-03b50d8d3497 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:59.190774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b52169-8a47-4e56-a262-03b50d8d3497 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:59.191051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b52169-8a47-4e56-a262-03b50d8d3497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:59.212648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-41b52169-8a47-4e56-a262-03b50d8d3497 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:56:59.214352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-41b52169-8a47-4e56-a262-03b50d8d3497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:56:59.226415 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:56:59.284307 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4403/8718] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:56:59.291860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63bdc0-3f0c-4f48-9f07-2f6e8cd43a95 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:59.292196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63bdc0-3f0c-4f48-9f07-2f6e8cd43a95 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:59.292544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63bdc0-3f0c-4f48-9f07-2f6e8cd43a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:59.315007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0b63bdc0-3f0c-4f48-9f07-2f6e8cd43a95 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:56:59.316314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0b63bdc0-3f0c-4f48-9f07-2f6e8cd43a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:56:59.324601 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4316/8719] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:56:59.329130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b52169-8a47-4e56-a262-03b50d8d3497 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:56:59.339779 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b52169-8a47-4e56-a262-03b50d8d3497 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:56:59.345182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221c41d-b28b-492f-a658-251b6e1027e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:56:59.345798 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221c41d-b28b-492f-a658-251b6e1027e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:59.346097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221c41d-b28b-492f-a658-251b6e1027e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:59.346582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221c41d-b28b-492f-a658-251b6e1027e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:59.347093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221c41d-b28b-492f-a658-251b6e1027e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 01:56:59.347397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221c41d-b28b-492f-a658-251b6e1027e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:56:59.349059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221c41d-b28b-492f-a658-251b6e1027e0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:56:59.363246 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4404/8720] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 01:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 01:56:59.368287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63bdc0-3f0c-4f48-9f07-2f6e8cd43a95 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:56:59.378344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63bdc0-3f0c-4f48-9f07-2f6e8cd43a95 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:56:59.383298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6965e8-e1c1-4687-97d0-850ee3abf6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:56:59.383908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6965e8-e1c1-4687-97d0-850ee3abf6b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:59.384209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6965e8-e1c1-4687-97d0-850ee3abf6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:59.384524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6965e8-e1c1-4687-97d0-850ee3abf6b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:59.385162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6965e8-e1c1-4687-97d0-850ee3abf6b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:56:59.387111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6965e8-e1c1-4687-97d0-850ee3abf6b8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:56:59.415751 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4317/8721] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:56:59 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:56:59.420710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221c41d-b28b-492f-a658-251b6e1027e0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:56:59.432984 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221c41d-b28b-492f-a658-251b6e1027e0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:56:59.492037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f3d48-2424-4480-8f65-6b3cc3d6d1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:56:59.492629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f3d48-2424-4480-8f65-6b3cc3d6d1ac admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:59.492908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f3d48-2424-4480-8f65-6b3cc3d6d1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:59.493181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f3d48-2424-4480-8f65-6b3cc3d6d1ac admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:59.493812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f3d48-2424-4480-8f65-6b3cc3d6d1ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:56:59.495764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f3d48-2424-4480-8f65-6b3cc3d6d1ac admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:56:59.521150 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4405/8722] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:56:59 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 01:56:59.526376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6965e8-e1c1-4687-97d0-850ee3abf6b8 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:56:59.538587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6965e8-e1c1-4687-97d0-850ee3abf6b8 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:56:59.543791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7ed96-8cfc-4807-abcd-196466d55b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:56:59.544528 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7ed96-8cfc-4807-abcd-196466d55b55 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:59.544807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7ed96-8cfc-4807-abcd-196466d55b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:59.545079 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7ed96-8cfc-4807-abcd-196466d55b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:59.545725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd7ed96-8cfc-4807-abcd-196466d55b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:56:59.547487 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd7ed96-8cfc-4807-abcd-196466d55b55 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:56:59.558597 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4318/8723] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:56:59.563058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f3d48-2424-4480-8f65-6b3cc3d6d1ac admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:56:59.576426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f3d48-2424-4480-8f65-6b3cc3d6d1ac admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:56:59.582914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69fafe-38ba-401d-b575-009977f4b6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:56:59.583843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69fafe-38ba-401d-b575-009977f4b6fb admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:59.584187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69fafe-38ba-401d-b575-009977f4b6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:59.584499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69fafe-38ba-401d-b575-009977f4b6fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:59.585177 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69fafe-38ba-401d-b575-009977f4b6fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:56:59.587655 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69fafe-38ba-401d-b575-009977f4b6fb admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:56:59.603488 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4406/8724] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:56:59.607734 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7ed96-8cfc-4807-abcd-196466d55b55 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:56:59.618148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7ed96-8cfc-4807-abcd-196466d55b55 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:56:59.623001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2baf420-0cc5-48f4-a0ca-d179fe677946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:56:59.623663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2baf420-0cc5-48f4-a0ca-d179fe677946 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:59.624053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2baf420-0cc5-48f4-a0ca-d179fe677946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:59.624321 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2baf420-0cc5-48f4-a0ca-d179fe677946 admin admin] PATH_INFO: `/v3/projects/65e98465a7404152b4c24e0afa285048/users/bcc37843577e483cae4949e8562c8ba0/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:59.639277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2baf420-0cc5-48f4-a0ca-d179fe677946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65e98465a7404152b4c24e0afa285048, user_id=bcc37843577e483cae4949e8562c8ba0, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:56:59.642483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2baf420-0cc5-48f4-a0ca-d179fe677946 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:56:59.655231 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4319/8725] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:56:59 2022] PUT /identity/v3/projects/65e98465a7404152b4c24e0afa285048/users/bcc37843577e483cae4949e8562c8ba0/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:56:59.661122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e085b-fde3-480b-b2d6-82704a9682f7 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:59.661647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e085b-fde3-480b-b2d6-82704a9682f7 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:59.661767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e085b-fde3-480b-b2d6-82704a9682f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:59.681274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-044e085b-fde3-480b-b2d6-82704a9682f7 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:56:59.682476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-044e085b-fde3-480b-b2d6-82704a9682f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:56:59.746913 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4407/8726] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:56:59.757052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2baf420-0cc5-48f4-a0ca-d179fe677946 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:56:59.758883 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a2baf420-0cc5-48f4-a0ca-d179fe677946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:56:59.822106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2baf420-0cc5-48f4-a0ca-d179fe677946 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:56:59.826126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85996ccc-9327-4584-81b5-411c0fa97eb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:56:59.826783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85996ccc-9327-4584-81b5-411c0fa97eb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:56:59.827056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85996ccc-9327-4584-81b5-411c0fa97eb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:56:59.827409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85996ccc-9327-4584-81b5-411c0fa97eb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:56:59.839256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85996ccc-9327-4584-81b5-411c0fa97eb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:56:59.841109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85996ccc-9327-4584-81b5-411c0fa97eb1 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:56:59.853319 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4320/8727] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:56:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:57:03.231651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e085b-fde3-480b-b2d6-82704a9682f7 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:57:03.233809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-044e085b-fde3-480b-b2d6-82704a9682f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:57:03.267973 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:57:03.360828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e085b-fde3-480b-b2d6-82704a9682f7 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:57:03.367242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7d2fd-3b0d-46e0-9700-f4dcc3a1d5b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:57:03.368407 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7d2fd-3b0d-46e0-9700-f4dcc3a1d5b6 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:57:03.368921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7d2fd-3b0d-46e0-9700-f4dcc3a1d5b6 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:57:03.369422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7d2fd-3b0d-46e0-9700-f4dcc3a1d5b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:57:03.371589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-19a7d2fd-3b0d-46e0-9700-f4dcc3a1d5b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:57:03.389944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7d2fd-3b0d-46e0-9700-f4dcc3a1d5b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:57:03.392095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7d2fd-3b0d-46e0-9700-f4dcc3a1d5b6 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:57:03.410803 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4408/8728] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:57:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:57:03.655650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85996ccc-9327-4584-81b5-411c0fa97eb1 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:57:03.658480 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-85996ccc-9327-4584-81b5-411c0fa97eb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:57:03.678681 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85996ccc-9327-4584-81b5-411c0fa97eb1 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:57:03.685501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a20dd-9a65-44e6-b402-49420dfa78d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:57:03.685501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a20dd-9a65-44e6-b402-49420dfa78d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:57:03.685501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a20dd-9a65-44e6-b402-49420dfa78d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:57:03.685934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a20dd-9a65-44e6-b402-49420dfa78d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:57:03.687583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b81a20dd-9a65-44e6-b402-49420dfa78d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:57:03.704118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a20dd-9a65-44e6-b402-49420dfa78d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:57:03.706029 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a20dd-9a65-44e6-b402-49420dfa78d0 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:57:03.711247 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:57:03.726055 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4321/8729] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:57:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:57:03.867595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acfb80-57d1-49a3-b803-e2c4617775e3 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:57:03.868022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acfb80-57d1-49a3-b803-e2c4617775e3 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:57:03.868398 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acfb80-57d1-49a3-b803-e2c4617775e3 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:57:03.870191 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4409/8730] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 01:57:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:57:03.876165 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc49d3-6423-4cf5-b4f3-430259a9dea8 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:57:03.876591 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc49d3-6423-4cf5-b4f3-430259a9dea8 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:57:03.877384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc49d3-6423-4cf5-b4f3-430259a9dea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:57:03.897556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-eabc49d3-6423-4cf5-b4f3-430259a9dea8 None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:57:03.899048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-eabc49d3-6423-4cf5-b4f3-430259a9dea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:57:03.910928 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4322/8731] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 01:57:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:57:03.936226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acfb80-57d1-49a3-b803-e2c4617775e3 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:57:03.973096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acfb80-57d1-49a3-b803-e2c4617775e3 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:57:03.981484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6eb679-0821-449c-a1b7-f4cfba2b01a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:57:03.982281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6eb679-0821-449c-a1b7-f4cfba2b01a5 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:57:03.982661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6eb679-0821-449c-a1b7-f4cfba2b01a5 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:57:03.983032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6eb679-0821-449c-a1b7-f4cfba2b01a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:57:03.994030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6eb679-0821-449c-a1b7-f4cfba2b01a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:57:03.996082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6eb679-0821-449c-a1b7-f4cfba2b01a5 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:57:04.008376 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4410/8732] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:57:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:57:04.258298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc49d3-6423-4cf5-b4f3-430259a9dea8 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:57:04.272944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a5a50-5295-4b67-8ce0-dd0aa542336c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:57:04.272944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a5a50-5295-4b67-8ce0-dd0aa542336c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:57:04.273808 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a5a50-5295-4b67-8ce0-dd0aa542336c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:57:04.277050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc49d3-6423-4cf5-b4f3-430259a9dea8 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:57:04.280716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e015d9-df6e-47e1-a7e7-37f37a7e2037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:57:04.281399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e015d9-df6e-47e1-a7e7-37f37a7e2037 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:57:04.282339 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e015d9-df6e-47e1-a7e7-37f37a7e2037 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:57:04.282694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e015d9-df6e-47e1-a7e7-37f37a7e2037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:57:04.284561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a4e015d9-df6e-47e1-a7e7-37f37a7e2037 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:57:04.308881 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-2e9a5a50-5295-4b67-8ce0-dd0aa542336c None None] MFA Rules not processed for user `bcc37843577e483cae4949e8562c8ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:57:04.310195 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2e9a5a50-5295-4b67-8ce0-dd0aa542336c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:57:04.406370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e015d9-df6e-47e1-a7e7-37f37a7e2037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:57:04.408919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e015d9-df6e-47e1-a7e7-37f37a7e2037 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:57:04.410346 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4411/8733] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:57:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:57:04.415132 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a5a50-5295-4b67-8ce0-dd0aa542336c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:57:04.429454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a5a50-5295-4b67-8ce0-dd0aa542336c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:57:04.434418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5fb523-4752-4003-a32a-ac37819780e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:57:04.435261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fb523-4752-4003-a32a-ac37819780e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:57:04.435643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fb523-4752-4003-a32a-ac37819780e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:57:04.436206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5fb523-4752-4003-a32a-ac37819780e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:57:04.436752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5fb523-4752-4003-a32a-ac37819780e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:57:04.436949 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4323/8734] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:57:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:57:04.439494 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5fb523-4752-4003-a32a-ac37819780e8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:57:04.470984 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4412/8735] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 01:57:04 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:57:04.475302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e015d9-df6e-47e1-a7e7-37f37a7e2037 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:57:04.476524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6792a7-34d8-4d68-a056-80ea3814ea54 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:57:04.476862 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6792a7-34d8-4d68-a056-80ea3814ea54 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:57:04.477168 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6792a7-34d8-4d68-a056-80ea3814ea54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:57:04.487356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e015d9-df6e-47e1-a7e7-37f37a7e2037 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:57:04.497649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-de6792a7-34d8-4d68-a056-80ea3814ea54 None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:57:04.498962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-de6792a7-34d8-4d68-a056-80ea3814ea54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:57:04.551406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6721b-a4dc-47f9-885d-7cf1e132ccd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:57:04.552118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6721b-a4dc-47f9-885d-7cf1e132ccd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:57:04.552398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6721b-a4dc-47f9-885d-7cf1e132ccd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:57:04.552667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6721b-a4dc-47f9-885d-7cf1e132ccd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:57:04.553291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6721b-a4dc-47f9-885d-7cf1e132ccd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:57:04.555321 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6721b-a4dc-47f9-885d-7cf1e132ccd7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:57:04.573580 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4413/8736] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 01:57:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:57:04.585900 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4324/8737] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 01:57:04 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 01:57:04.587296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6792a7-34d8-4d68-a056-80ea3814ea54 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:57:04.599594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6721b-a4dc-47f9-885d-7cf1e132ccd7 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:57:04.606373 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:57:04.614859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6792a7-34d8-4d68-a056-80ea3814ea54 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:57:04.626709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6721b-a4dc-47f9-885d-7cf1e132ccd7 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:57:04.627070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d671d9-4b5c-48c7-bd56-44a5210e559a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:57:04.628089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d671d9-4b5c-48c7-bd56-44a5210e559a admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:57:04.628648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d671d9-4b5c-48c7-bd56-44a5210e559a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:57:04.628922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d671d9-4b5c-48c7-bd56-44a5210e559a admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:57:04.629616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d671d9-4b5c-48c7-bd56-44a5210e559a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:57:04.631232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d671d9-4b5c-48c7-bd56-44a5210e559a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:57:04.632323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5c459-1409-4226-951e-4b01b42ed8db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:57:04.632997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5c459-1409-4226-951e-4b01b42ed8db service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:57:04.633336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5c459-1409-4226-951e-4b01b42ed8db service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:57:04.633682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5c459-1409-4226-951e-4b01b42ed8db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:57:04.643286 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4414/8738] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 01:57:04.643491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5c459-1409-4226-951e-4b01b42ed8db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:57:04.645013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5c459-1409-4226-951e-4b01b42ed8db service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:57:04.647590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d671d9-4b5c-48c7-bd56-44a5210e559a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:57:04.661100 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4325/8739] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:57:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:57:04.663438 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d671d9-4b5c-48c7-bd56-44a5210e559a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:57:04.668771 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a9621-395f-4a31-b040-b36d01fe0524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:57:04.669522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a9621-395f-4a31-b040-b36d01fe0524 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:57:04.669865 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a9621-395f-4a31-b040-b36d01fe0524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:57:04.670235 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a9621-395f-4a31-b040-b36d01fe0524 admin admin] PATH_INFO: `/v3/projects/8c0975684af442a3ae7a012fa13b2645/users/86d384f3ab5949b0bddc35f6bdb7fac0/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:57:04.687278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a9621-395f-4a31-b040-b36d01fe0524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c0975684af442a3ae7a012fa13b2645, user_id=86d384f3ab5949b0bddc35f6bdb7fac0, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:57:04.690700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850a9621-395f-4a31-b040-b36d01fe0524 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:57:04.712137 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4415/8740] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:57:04 2022] PUT /identity/v3/projects/8c0975684af442a3ae7a012fa13b2645/users/86d384f3ab5949b0bddc35f6bdb7fac0/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 01:57:04.716464 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5c459-1409-4226-951e-4b01b42ed8db service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:57:04.729849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5c459-1409-4226-951e-4b01b42ed8db service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:57:04.803001 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:57:04.812170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ace681-f7e3-4e71-a665-8003701c1220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:57:04.813715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ace681-f7e3-4e71-a665-8003701c1220 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:57:04.814153 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ace681-f7e3-4e71-a665-8003701c1220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:57:04.814527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ace681-f7e3-4e71-a665-8003701c1220 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:57:04.815560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ace681-f7e3-4e71-a665-8003701c1220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:57:04.817340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ace681-f7e3-4e71-a665-8003701c1220 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:57:04.832796 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4326/8741] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 01:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 01:57:04.833783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a9621-395f-4a31-b040-b36d01fe0524 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:57:04.845007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a9621-395f-4a31-b040-b36d01fe0524 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:57:04.858712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d54689-5416-4c17-933b-01efb396802d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:57:04.860335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d54689-5416-4c17-933b-01efb396802d admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:57:04.860687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d54689-5416-4c17-933b-01efb396802d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:57:04.861033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d54689-5416-4c17-933b-01efb396802d admin admin] PATH_INFO: `/v3/projects/8c0975684af442a3ae7a012fa13b2645/users/86d384f3ab5949b0bddc35f6bdb7fac0/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:57:04.863298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d54689-5416-4c17-933b-01efb396802d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c0975684af442a3ae7a012fa13b2645, user_id=86d384f3ab5949b0bddc35f6bdb7fac0, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:57:04.866526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d54689-5416-4c17-933b-01efb396802d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:57:04.884240 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4416/8742] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 01:57:04 2022] PUT /identity/v3/projects/8c0975684af442a3ae7a012fa13b2645/users/86d384f3ab5949b0bddc35f6bdb7fac0/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:57:09.946107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9116465-c0c5-4c06-9128-b3e00f2c3684 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:57:09.946720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9116465-c0c5-4c06-9128-b3e00f2c3684 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:57:09.946720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9116465-c0c5-4c06-9128-b3e00f2c3684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:57:09.981351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c9116465-c0c5-4c06-9128-b3e00f2c3684 None None] MFA Rules not processed for user `86d384f3ab5949b0bddc35f6bdb7fac0`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:57:09.982915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c9116465-c0c5-4c06-9128-b3e00f2c3684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:57:10.058392 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4327/8743] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:57:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:57:10.070364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d54689-5416-4c17-933b-01efb396802d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:57:10.072073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-12d54689-5416-4c17-933b-01efb396802d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:57:10.182448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d54689-5416-4c17-933b-01efb396802d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:57:10.188392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d50f39-3249-45cd-8daa-bc5020c43899 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:57:10.189006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d50f39-3249-45cd-8daa-bc5020c43899 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:57:10.189439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d50f39-3249-45cd-8daa-bc5020c43899 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:57:10.189559 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d50f39-3249-45cd-8daa-bc5020c43899 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:57:10.199062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d50f39-3249-45cd-8daa-bc5020c43899 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:57:10.203790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d50f39-3249-45cd-8daa-bc5020c43899 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:57:10.220695 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4417/8744] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:57:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:57:10.287254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5800f-8655-404a-a8b3-8a1b3e970d03 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:57:10.287947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5800f-8655-404a-a8b3-8a1b3e970d03 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:57:10.288386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5800f-8655-404a-a8b3-8a1b3e970d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:57:10.337076 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-96a5800f-8655-404a-a8b3-8a1b3e970d03 None None] MFA Rules not processed for user `bcc37843577e483cae4949e8562c8ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:57:10.338664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-96a5800f-8655-404a-a8b3-8a1b3e970d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:57:10.482160 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4328/8745] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:57:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:57:11.150596 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de386c-25f9-4622-b9b4-5bb53aefea4c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:57:11.151185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de386c-25f9-4622-b9b4-5bb53aefea4c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:57:11.151185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de386c-25f9-4622-b9b4-5bb53aefea4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:57:11.174376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-40de386c-25f9-4622-b9b4-5bb53aefea4c None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:57:11.175600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-40de386c-25f9-4622-b9b4-5bb53aefea4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:57:11.241482 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4418/8746] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 01:57:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:57:11.253697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5800f-8655-404a-a8b3-8a1b3e970d03 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:57:11.255067 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-96a5800f-8655-404a-a8b3-8a1b3e970d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:57:11.273135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5800f-8655-404a-a8b3-8a1b3e970d03 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:57:11.278193 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b69d3-afd9-4918-8c65-ece9aa8f8c5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:57:11.278786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b69d3-afd9-4918-8c65-ece9aa8f8c5f service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:57:11.279106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b69d3-afd9-4918-8c65-ece9aa8f8c5f service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:57:11.279327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b69d3-afd9-4918-8c65-ece9aa8f8c5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:57:11.287831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b69d3-afd9-4918-8c65-ece9aa8f8c5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:57:11.289421 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b69d3-afd9-4918-8c65-ece9aa8f8c5f service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:57:11.299211 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4329/8747] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:57:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:57:13.055376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de386c-25f9-4622-b9b4-5bb53aefea4c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:57:13.107192 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:57:13.131820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de386c-25f9-4622-b9b4-5bb53aefea4c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:57:13.135736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b4237c-fc92-455a-b1d2-d221c4adf988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:57:13.136603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4237c-fc92-455a-b1d2-d221c4adf988 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:57:13.136917 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4237c-fc92-455a-b1d2-d221c4adf988 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:57:13.137383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b4237c-fc92-455a-b1d2-d221c4adf988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:57:13.139678 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c8b4237c-fc92-455a-b1d2-d221c4adf988 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:57:13.155309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b4237c-fc92-455a-b1d2-d221c4adf988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:57:13.158577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b4237c-fc92-455a-b1d2-d221c4adf988 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:57:13.175699 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4419/8748] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:57:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:57:21.294939 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=70 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:57:22.061729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1bab1-ccca-48dc-92ce-0378d7fd5d53 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:57:22.062718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1bab1-ccca-48dc-92ce-0378d7fd5d53 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:57:22.063182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1bab1-ccca-48dc-92ce-0378d7fd5d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:57:22.082843 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-a9c1bab1-ccca-48dc-92ce-0378d7fd5d53 None None] MFA Rules not processed for user `bcc37843577e483cae4949e8562c8ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:57:22.084082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a9c1bab1-ccca-48dc-92ce-0378d7fd5d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:57:22.090953 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4330/8749] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:57:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:57:23.167376 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=10 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:57:32.077825 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:57:47.698628 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b4237c-fc92-455a-b1d2-d221c4adf988 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:57:47.772141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b4237c-fc92-455a-b1d2-d221c4adf988 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:57:47.776676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e9b6a-4e32-49ed-8c87-1317980e7f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:57:47.777295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e9b6a-4e32-49ed-8c87-1317980e7f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:57:47.777567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e9b6a-4e32-49ed-8c87-1317980e7f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:57:47.777834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e9b6a-4e32-49ed-8c87-1317980e7f3d admin admin] PATH_INFO: `/v3/users/bcc37843577e483cae4949e8562c8ba0` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:57:47.778952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e9b6a-4e32-49ed-8c87-1317980e7f3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcc37843577e483cae4949e8562c8ba0)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:57:47.781840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e9b6a-4e32-49ed-8c87-1317980e7f3d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:57:47.831477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f72e9b6a-4e32-49ed-8c87-1317980e7f3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcc37843577e483cae4949e8562c8ba0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:57:47.838598 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f72e9b6a-4e32-49ed-8c87-1317980e7f3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcc37843577e483cae4949e8562c8ba0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:57:47.854090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f72e9b6a-4e32-49ed-8c87-1317980e7f3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcc37843577e483cae4949e8562c8ba0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:57:47.854903 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f72e9b6a-4e32-49ed-8c87-1317980e7f3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcc37843577e483cae4949e8562c8ba0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:57:47.863040 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f72e9b6a-4e32-49ed-8c87-1317980e7f3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcc37843577e483cae4949e8562c8ba0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:57:47.869288 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4420/8750] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:57:47 2022] DELETE /identity/v3/users/bcc37843577e483cae4949e8562c8ba0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:57:48.052693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1bab1-ccca-48dc-92ce-0378d7fd5d53 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:57:48.066033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1bab1-ccca-48dc-92ce-0378d7fd5d53 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:57:48.130611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85dee17-2ea3-4dc7-b06a-e170abc45d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:57:48.131250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85dee17-2ea3-4dc7-b06a-e170abc45d07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:57:48.131533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85dee17-2ea3-4dc7-b06a-e170abc45d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:57:48.131812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85dee17-2ea3-4dc7-b06a-e170abc45d07 admin admin] PATH_INFO: `/v3/projects/65e98465a7404152b4c24e0afa285048` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:57:48.132981 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85dee17-2ea3-4dc7-b06a-e170abc45d07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65e98465a7404152b4c24e0afa285048)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:57:48.135444 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85dee17-2ea3-4dc7-b06a-e170abc45d07 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:57:48.188714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a85dee17-2ea3-4dc7-b06a-e170abc45d07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65e98465a7404152b4c24e0afa285048', 'request_id': 'req-a85dee17-2ea3-4dc7-b06a-e170abc45d07'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:57:48.195074 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a85dee17-2ea3-4dc7-b06a-e170abc45d07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65e98465a7404152b4c24e0afa285048', 'request_id': 'req-a85dee17-2ea3-4dc7-b06a-e170abc45d07'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:57:48.201925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a85dee17-2ea3-4dc7-b06a-e170abc45d07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65e98465a7404152b4c24e0afa285048', 'request_id': 'req-a85dee17-2ea3-4dc7-b06a-e170abc45d07'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:57:48.216285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a85dee17-2ea3-4dc7-b06a-e170abc45d07 admin admin] The token cache is being invalidate because project 65e98465a7404152b4c24e0afa285048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:57:48.216572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a85dee17-2ea3-4dc7-b06a-e170abc45d07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:57:48.217216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a85dee17-2ea3-4dc7-b06a-e170abc45d07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:57:48.219484 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4331/8751] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:57:48 2022] DELETE /identity/v3/projects/65e98465a7404152b4c24e0afa285048 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:57:48.223844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e9b6a-4e32-49ed-8c87-1317980e7f3d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:57:48.225330 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f72e9b6a-4e32-49ed-8c87-1317980e7f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:57:48.239670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e9b6a-4e32-49ed-8c87-1317980e7f3d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:57:48.304693 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd531b4-36aa-4997-a137-17be638e3fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:57:48.305368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd531b4-36aa-4997-a137-17be638e3fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:57:48.305643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd531b4-36aa-4997-a137-17be638e3fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:57:48.305935 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd531b4-36aa-4997-a137-17be638e3fad admin admin] PATH_INFO: `/v3/users/86d384f3ab5949b0bddc35f6bdb7fac0` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:57:48.307074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd531b4-36aa-4997-a137-17be638e3fad admin admin] RBAC: Authorizing `identity:delete_user(user_id=86d384f3ab5949b0bddc35f6bdb7fac0)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:57:48.309125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd531b4-36aa-4997-a137-17be638e3fad admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:57:48.333249 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:57:48.362545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-abd531b4-36aa-4997-a137-17be638e3fad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86d384f3ab5949b0bddc35f6bdb7fac0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:57:48.374185 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-abd531b4-36aa-4997-a137-17be638e3fad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86d384f3ab5949b0bddc35f6bdb7fac0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:57:48.387009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-abd531b4-36aa-4997-a137-17be638e3fad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86d384f3ab5949b0bddc35f6bdb7fac0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:57:48.387775 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-abd531b4-36aa-4997-a137-17be638e3fad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86d384f3ab5949b0bddc35f6bdb7fac0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:57:48.396182 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-abd531b4-36aa-4997-a137-17be638e3fad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86d384f3ab5949b0bddc35f6bdb7fac0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:57:48.402911 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4421/8752] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:57:48 2022] DELETE /identity/v3/users/86d384f3ab5949b0bddc35f6bdb7fac0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:57:48.587996 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85dee17-2ea3-4dc7-b06a-e170abc45d07 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:57:48.589468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a85dee17-2ea3-4dc7-b06a-e170abc45d07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:57:48.603687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85dee17-2ea3-4dc7-b06a-e170abc45d07 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:57:48.662455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631a233-be31-4ea2-9aa7-0db972ad5703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:57:48.663087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631a233-be31-4ea2-9aa7-0db972ad5703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:57:48.663365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631a233-be31-4ea2-9aa7-0db972ad5703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:57:48.663637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631a233-be31-4ea2-9aa7-0db972ad5703 admin admin] PATH_INFO: `/v3/projects/8c0975684af442a3ae7a012fa13b2645` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:57:48.664812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631a233-be31-4ea2-9aa7-0db972ad5703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c0975684af442a3ae7a012fa13b2645)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:57:48.666762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631a233-be31-4ea2-9aa7-0db972ad5703 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:57:48.703258 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:57:48.717183 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d631a233-be31-4ea2-9aa7-0db972ad5703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c0975684af442a3ae7a012fa13b2645', 'request_id': 'req-d631a233-be31-4ea2-9aa7-0db972ad5703'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:57:48.722735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d631a233-be31-4ea2-9aa7-0db972ad5703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c0975684af442a3ae7a012fa13b2645', 'request_id': 'req-d631a233-be31-4ea2-9aa7-0db972ad5703'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:57:48.729215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d631a233-be31-4ea2-9aa7-0db972ad5703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c0975684af442a3ae7a012fa13b2645', 'request_id': 'req-d631a233-be31-4ea2-9aa7-0db972ad5703'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:57:48.741365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d631a233-be31-4ea2-9aa7-0db972ad5703 admin admin] The token cache is being invalidate because project 8c0975684af442a3ae7a012fa13b2645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:57:48.741657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d631a233-be31-4ea2-9aa7-0db972ad5703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:57:48.742315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-d631a233-be31-4ea2-9aa7-0db972ad5703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:57:48.743838 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4332/8753] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:57:48 2022] DELETE /identity/v3/projects/8c0975684af442a3ae7a012fa13b2645 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:57:58.398922 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:57:58.737952 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:58:21.885579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc25a4e-b67b-42db-b697-400ae15ad5f3 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:58:21.886442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc25a4e-b67b-42db-b697-400ae15ad5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:58:21.886916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc25a4e-b67b-42db-b697-400ae15ad5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:58:21.912106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-fdc25a4e-b67b-42db-b697-400ae15ad5f3 None None] MFA Rules not processed for user `830639b9b39a43a7b714b74c26fdf52c`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:58:21.913707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fdc25a4e-b67b-42db-b697-400ae15ad5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:58:21.980956 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4422/8754] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:58:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:58:31.972951 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=25 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:58:40.980623 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ae84b-5c54-4276-90e3-7f4723f621aa None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:58:40.981136 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ae84b-5c54-4276-90e3-7f4723f621aa None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:58:40.981258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ae84b-5c54-4276-90e3-7f4723f621aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:58:41.000978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-380ae84b-5c54-4276-90e3-7f4723f621aa None None] MFA Rules not processed for user `661f6c9aa7da4e348a9b0d91840078c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:58:41.002182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-380ae84b-5c54-4276-90e3-7f4723f621aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:58:41.058367 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4333/8755] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:58:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:58:51.051464 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=25 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:58:59.437720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc25a4e-b67b-42db-b697-400ae15ad5f3 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:58:59.439253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fdc25a4e-b67b-42db-b697-400ae15ad5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:58:59.532222 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc25a4e-b67b-42db-b697-400ae15ad5f3 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:58:59.537761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275220b-a717-4a9f-acc5-ef5a83867049 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:58:59.538364 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275220b-a717-4a9f-acc5-ef5a83867049 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:58:59.538646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275220b-a717-4a9f-acc5-ef5a83867049 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:58:59.538906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e275220b-a717-4a9f-acc5-ef5a83867049 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:58:59.540635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e275220b-a717-4a9f-acc5-ef5a83867049 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:58:59.554397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e275220b-a717-4a9f-acc5-ef5a83867049 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:58:59.555989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e275220b-a717-4a9f-acc5-ef5a83867049 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:58:59.568320 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4423/8756] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:58:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 01:59:08.541477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ae84b-5c54-4276-90e3-7f4723f621aa None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:59:08.542917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-380ae84b-5c54-4276-90e3-7f4723f621aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:59:08.636160 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ae84b-5c54-4276-90e3-7f4723f621aa None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:59:08.641739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd94213-2a77-4d5c-b9a9-88d341a0e6e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:59:08.642340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd94213-2a77-4d5c-b9a9-88d341a0e6e3 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:59:08.642618 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd94213-2a77-4d5c-b9a9-88d341a0e6e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:59:08.642897 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd94213-2a77-4d5c-b9a9-88d341a0e6e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:59:08.645152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cfd94213-2a77-4d5c-b9a9-88d341a0e6e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:59:08.655404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd94213-2a77-4d5c-b9a9-88d341a0e6e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:59:08.657002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd94213-2a77-4d5c-b9a9-88d341a0e6e3 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:59:08.666540 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4334/8757] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:59:08 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:59:09.115382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275220b-a717-4a9f-acc5-ef5a83867049 service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:59:09.131055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e275220b-a717-4a9f-acc5-ef5a83867049 service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:59:09.136592 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563d15b-2d10-4672-8f41-8b395b5d0f15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:59:09.137190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563d15b-2d10-4672-8f41-8b395b5d0f15 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:59:09.137471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563d15b-2d10-4672-8f41-8b395b5d0f15 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:59:09.137744 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563d15b-2d10-4672-8f41-8b395b5d0f15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:59:09.139438 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b563d15b-2d10-4672-8f41-8b395b5d0f15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:59:09.201931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563d15b-2d10-4672-8f41-8b395b5d0f15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:59:09.203541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563d15b-2d10-4672-8f41-8b395b5d0f15 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:59:09.213925 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4424/8758] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:59:09 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:59:10.578108 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6430d-51a7-47fb-b4a3-735a78e48478 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:59:10.578700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6430d-51a7-47fb-b4a3-735a78e48478 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:59:10.578700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6430d-51a7-47fb-b4a3-735a78e48478 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:59:10.580124 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4335/8759] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 01:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 01:59:10.585905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707f06e-1215-4e3f-8e3b-bd3d63489e74 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:59:10.586356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707f06e-1215-4e3f-8e3b-bd3d63489e74 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:59:10.586471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707f06e-1215-4e3f-8e3b-bd3d63489e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:59:10.607079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1707f06e-1215-4e3f-8e3b-bd3d63489e74 None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:59:10.608332 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1707f06e-1215-4e3f-8e3b-bd3d63489e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:59:10.617839 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4425/8760] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 01:59:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 01:59:10.638643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6430d-51a7-47fb-b4a3-735a78e48478 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:59:10.655453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6430d-51a7-47fb-b4a3-735a78e48478 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:59:10.660508 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418cd61-e525-414a-8aaa-8ad56f7b35b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:59:10.661116 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418cd61-e525-414a-8aaa-8ad56f7b35b8 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:59:10.662077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418cd61-e525-414a-8aaa-8ad56f7b35b8 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:59:10.662351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418cd61-e525-414a-8aaa-8ad56f7b35b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:59:10.670859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418cd61-e525-414a-8aaa-8ad56f7b35b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:59:10.672465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418cd61-e525-414a-8aaa-8ad56f7b35b8 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:59:10.682151 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4336/8761] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:59:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:59:11.328336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707f06e-1215-4e3f-8e3b-bd3d63489e74 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:59:11.329649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1707f06e-1215-4e3f-8e3b-bd3d63489e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:59:11.345727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707f06e-1215-4e3f-8e3b-bd3d63489e74 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:59:11.351329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da430c-d2aa-4a9e-a2b8-db2b90bc731c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:59:11.351973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da430c-d2aa-4a9e-a2b8-db2b90bc731c service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:59:11.352256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da430c-d2aa-4a9e-a2b8-db2b90bc731c service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:59:11.352557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da430c-d2aa-4a9e-a2b8-db2b90bc731c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:59:11.354300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d3da430c-d2aa-4a9e-a2b8-db2b90bc731c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:59:11.369358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da430c-d2aa-4a9e-a2b8-db2b90bc731c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:59:11.370934 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da430c-d2aa-4a9e-a2b8-db2b90bc731c service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:59:11.384171 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4426/8762] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:59:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:59:20.678059 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=48 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:59:21.376794 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=80 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:59:29.197367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418cd61-e525-414a-8aaa-8ad56f7b35b8 service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:59:29.212276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418cd61-e525-414a-8aaa-8ad56f7b35b8 service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:59:29.217835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685c41e-ec1a-4fad-b3b3-d163cad7ac58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:59:29.218448 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685c41e-ec1a-4fad-b3b3-d163cad7ac58 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:59:29.218722 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685c41e-ec1a-4fad-b3b3-d163cad7ac58 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:59:29.218991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685c41e-ec1a-4fad-b3b3-d163cad7ac58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:59:29.220888 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0685c41e-ec1a-4fad-b3b3-d163cad7ac58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:59:29.238421 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685c41e-ec1a-4fad-b3b3-d163cad7ac58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:59:29.240218 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685c41e-ec1a-4fad-b3b3-d163cad7ac58 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:59:29.256975 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4337/8763] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:59:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:59:35.457018 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fd9a4-e391-4db4-aeba-61054af30335 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:59:35.457900 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fd9a4-e391-4db4-aeba-61054af30335 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:59:35.458179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fd9a4-e391-4db4-aeba-61054af30335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:59:35.481595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d15fd9a4-e391-4db4-aeba-61054af30335 None None] MFA Rules not processed for user `830639b9b39a43a7b714b74c26fdf52c`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 01:59:35.483822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d15fd9a4-e391-4db4-aeba-61054af30335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:59:35.495019 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4427/8764] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 01:59:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 01:59:35.924782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685c41e-ec1a-4fad-b3b3-d163cad7ac58 service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:59:35.926276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0685c41e-ec1a-4fad-b3b3-d163cad7ac58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:59:35.997744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685c41e-ec1a-4fad-b3b3-d163cad7ac58 service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:59:36.002646 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80667a80-7f80-48eb-9385-1092f9494196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:59:36.003513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80667a80-7f80-48eb-9385-1092f9494196 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:59:36.004038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80667a80-7f80-48eb-9385-1092f9494196 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:59:36.004531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80667a80-7f80-48eb-9385-1092f9494196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:59:36.006652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-80667a80-7f80-48eb-9385-1092f9494196 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:59:36.020934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80667a80-7f80-48eb-9385-1092f9494196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:59:36.022940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80667a80-7f80-48eb-9385-1092f9494196 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:59:36.048351 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4338/8765] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:59:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:59:43.624714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fd9a4-e391-4db4-aeba-61054af30335 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:59:43.626584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d15fd9a4-e391-4db4-aeba-61054af30335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:59:43.647564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fd9a4-e391-4db4-aeba-61054af30335 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:59:43.653963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75682d-c309-477d-a6af-19d6fe365b62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:59:43.654707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75682d-c309-477d-a6af-19d6fe365b62 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:59:43.654865 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75682d-c309-477d-a6af-19d6fe365b62 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:59:43.655112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75682d-c309-477d-a6af-19d6fe365b62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:59:43.656877 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fb75682d-c309-477d-a6af-19d6fe365b62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:59:43.727045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb75682d-c309-477d-a6af-19d6fe365b62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:59:43.729227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb75682d-c309-477d-a6af-19d6fe365b62 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:59:43.758194 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4428/8766] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:59:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:59:45.748469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80667a80-7f80-48eb-9385-1092f9494196 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:59:45.758467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80667a80-7f80-48eb-9385-1092f9494196 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:59:45.762802 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663e558-7994-4874-b069-4c23fd5ec5e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:59:45.763415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663e558-7994-4874-b069-4c23fd5ec5e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:59:45.764089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663e558-7994-4874-b069-4c23fd5ec5e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:59:45.764089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663e558-7994-4874-b069-4c23fd5ec5e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:59:45.765921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2663e558-7994-4874-b069-4c23fd5ec5e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:59:45.836597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663e558-7994-4874-b069-4c23fd5ec5e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:59:45.838090 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663e558-7994-4874-b069-4c23fd5ec5e1 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:59:45.849726 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4339/8767] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:59:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:59:45.861646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75682d-c309-477d-a6af-19d6fe365b62 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:59:45.886104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75682d-c309-477d-a6af-19d6fe365b62 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:59:45.892395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6c4a9-1b3f-4625-8ce9-479da0e2069b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:59:45.894461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6c4a9-1b3f-4625-8ce9-479da0e2069b service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:59:45.895445 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6c4a9-1b3f-4625-8ce9-479da0e2069b service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:59:45.896578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c6c4a9-1b3f-4625-8ce9-479da0e2069b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:59:45.900828 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b3c6c4a9-1b3f-4625-8ce9-479da0e2069b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:59:45.927442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6c4a9-1b3f-4625-8ce9-479da0e2069b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:59:45.931293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c6c4a9-1b3f-4625-8ce9-479da0e2069b service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:59:45.946862 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4429/8768] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 01:59:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 01:59:53.145804 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663e558-7994-4874-b069-4c23fd5ec5e1 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:59:53.148102 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2663e558-7994-4874-b069-4c23fd5ec5e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:59:53.162435 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=63 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:59:53.167107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663e558-7994-4874-b069-4c23fd5ec5e1 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:59:53.172175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fd702-1bf2-4cf0-b3db-5bbf58c3df0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:59:53.172849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fd702-1bf2-4cf0-b3db-5bbf58c3df0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:59:53.173148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fd702-1bf2-4cf0-b3db-5bbf58c3df0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:59:53.173431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fd702-1bf2-4cf0-b3db-5bbf58c3df0e admin admin] PATH_INFO: `/v3/users/2ea9eff758654d1e8b7d02e6b4153a73` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:59:53.174657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2fd702-1bf2-4cf0-b3db-5bbf58c3df0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ea9eff758654d1e8b7d02e6b4153a73)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:59:53.176701 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2fd702-1bf2-4cf0-b3db-5bbf58c3df0e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:59:53.227345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-db2fd702-1bf2-4cf0-b3db-5bbf58c3df0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ea9eff758654d1e8b7d02e6b4153a73'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:59:53.235266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-db2fd702-1bf2-4cf0-b3db-5bbf58c3df0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ea9eff758654d1e8b7d02e6b4153a73'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:59:53.251907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-db2fd702-1bf2-4cf0-b3db-5bbf58c3df0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ea9eff758654d1e8b7d02e6b4153a73'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:59:53.252658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-db2fd702-1bf2-4cf0-b3db-5bbf58c3df0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ea9eff758654d1e8b7d02e6b4153a73'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:59:53.260871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-db2fd702-1bf2-4cf0-b3db-5bbf58c3df0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ea9eff758654d1e8b7d02e6b4153a73'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:59:53.268095 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4340/8769] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:59:53 2022] DELETE /identity/v3/users/2ea9eff758654d1e8b7d02e6b4153a73 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:59:53.457566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6c4a9-1b3f-4625-8ce9-479da0e2069b service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:59:53.470112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c6c4a9-1b3f-4625-8ce9-479da0e2069b service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:59:53.528072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97337ee2-a1b9-4406-99bc-c4b51b9ee0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:59:53.528707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97337ee2-a1b9-4406-99bc-c4b51b9ee0cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:59:53.528984 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97337ee2-a1b9-4406-99bc-c4b51b9ee0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:59:53.529256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97337ee2-a1b9-4406-99bc-c4b51b9ee0cb admin admin] PATH_INFO: `/v3/projects/7df97238e4904914ba19be69db5e228b` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:59:53.530367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97337ee2-a1b9-4406-99bc-c4b51b9ee0cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7df97238e4904914ba19be69db5e228b)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:59:53.532315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97337ee2-a1b9-4406-99bc-c4b51b9ee0cb admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:59:53.580532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-97337ee2-a1b9-4406-99bc-c4b51b9ee0cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7df97238e4904914ba19be69db5e228b', 'request_id': 'req-97337ee2-a1b9-4406-99bc-c4b51b9ee0cb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:59:53.586099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-97337ee2-a1b9-4406-99bc-c4b51b9ee0cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7df97238e4904914ba19be69db5e228b', 'request_id': 'req-97337ee2-a1b9-4406-99bc-c4b51b9ee0cb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:59:53.592559 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-97337ee2-a1b9-4406-99bc-c4b51b9ee0cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7df97238e4904914ba19be69db5e228b', 'request_id': 'req-97337ee2-a1b9-4406-99bc-c4b51b9ee0cb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:59:53.606073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-97337ee2-a1b9-4406-99bc-c4b51b9ee0cb admin admin] The token cache is being invalidate because project 7df97238e4904914ba19be69db5e228b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:59:53.606365 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-97337ee2-a1b9-4406-99bc-c4b51b9ee0cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:59:53.607006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-97337ee2-a1b9-4406-99bc-c4b51b9ee0cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:59:53.608572 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4430/8770] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:59:53 2022] DELETE /identity/v3/projects/7df97238e4904914ba19be69db5e228b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:59:53.612953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fd702-1bf2-4cf0-b3db-5bbf58c3df0e admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:59:53.614406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-db2fd702-1bf2-4cf0-b3db-5bbf58c3df0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:59:53.628348 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fd702-1bf2-4cf0-b3db-5bbf58c3df0e admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:59:53.686740 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a1d99-76ba-42f3-a99b-888849d0165a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:59:53.687371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a1d99-76ba-42f3-a99b-888849d0165a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:59:53.687650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a1d99-76ba-42f3-a99b-888849d0165a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:59:53.687953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a1d99-76ba-42f3-a99b-888849d0165a admin admin] PATH_INFO: `/v3/users/bb5f8c162b3943dc9233d21f62ddab38` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:59:53.689080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a1d99-76ba-42f3-a99b-888849d0165a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb5f8c162b3943dc9233d21f62ddab38)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:59:53.691007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a1d99-76ba-42f3-a99b-888849d0165a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:59:53.735692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-848a1d99-76ba-42f3-a99b-888849d0165a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb5f8c162b3943dc9233d21f62ddab38'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:59:53.743649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-848a1d99-76ba-42f3-a99b-888849d0165a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb5f8c162b3943dc9233d21f62ddab38'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:59:53.755561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-848a1d99-76ba-42f3-a99b-888849d0165a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb5f8c162b3943dc9233d21f62ddab38'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:59:53.756248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-848a1d99-76ba-42f3-a99b-888849d0165a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb5f8c162b3943dc9233d21f62ddab38'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:59:53.758753 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:59:53.764188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-848a1d99-76ba-42f3-a99b-888849d0165a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb5f8c162b3943dc9233d21f62ddab38'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:59:53.771352 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4341/8771] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 01:59:53 2022] DELETE /identity/v3/users/bb5f8c162b3943dc9233d21f62ddab38 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 01:59:53.951849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97337ee2-a1b9-4406-99bc-c4b51b9ee0cb admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 01:59:53.953335 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-97337ee2-a1b9-4406-99bc-c4b51b9ee0cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 01:59:53.966124 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97337ee2-a1b9-4406-99bc-c4b51b9ee0cb admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 01:59:53.971007 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 01:59:54.028617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56cf12d-a14f-421d-a494-0588d2b30fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 01:59:54.029255 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cf12d-a14f-421d-a494-0588d2b30fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 01:59:54.029535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cf12d-a14f-421d-a494-0588d2b30fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 01:59:54.029808 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cf12d-a14f-421d-a494-0588d2b30fc7 admin admin] PATH_INFO: `/v3/projects/53bcb0ce6a124bbb969a5bcfdfd9e054` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 01:59:54.030961 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56cf12d-a14f-421d-a494-0588d2b30fc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53bcb0ce6a124bbb969a5bcfdfd9e054)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 01:59:54.032956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56cf12d-a14f-421d-a494-0588d2b30fc7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 01:59:54.078425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c56cf12d-a14f-421d-a494-0588d2b30fc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53bcb0ce6a124bbb969a5bcfdfd9e054', 'request_id': 'req-c56cf12d-a14f-421d-a494-0588d2b30fc7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:59:54.084054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c56cf12d-a14f-421d-a494-0588d2b30fc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53bcb0ce6a124bbb969a5bcfdfd9e054', 'request_id': 'req-c56cf12d-a14f-421d-a494-0588d2b30fc7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:59:54.090204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c56cf12d-a14f-421d-a494-0588d2b30fc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53bcb0ce6a124bbb969a5bcfdfd9e054', 'request_id': 'req-c56cf12d-a14f-421d-a494-0588d2b30fc7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:59:54.102921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c56cf12d-a14f-421d-a494-0588d2b30fc7 admin admin] The token cache is being invalidate because project 53bcb0ce6a124bbb969a5bcfdfd9e054 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 01:59:54.103209 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c56cf12d-a14f-421d-a494-0588d2b30fc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:59:54.103902 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c56cf12d-a14f-421d-a494-0588d2b30fc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 01:59:54.105420 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4431/8772] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 01:59:53 2022] DELETE /identity/v3/projects/53bcb0ce6a124bbb969a5bcfdfd9e054 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:00:03.769538 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=1,keystone:SELECT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:00:04.099634 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:00:49.872602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc39625-afea-4e72-99e6-4fb52fbea553 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:00:49.873140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc39625-afea-4e72-99e6-4fb52fbea553 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:00:49.873140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc39625-afea-4e72-99e6-4fb52fbea553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:00:49.912663 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-1cc39625-afea-4e72-99e6-4fb52fbea553 None None] MFA Rules not processed for user `661f6c9aa7da4e348a9b0d91840078c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:00:49.913844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1cc39625-afea-4e72-99e6-4fb52fbea553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:00:49.968386 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4342/8773] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:00:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:00:59.960904 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=34 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:01:02.395230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56cf12d-a14f-421d-a494-0588d2b30fc7 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:01:02.396677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c56cf12d-a14f-421d-a494-0588d2b30fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:01:02.472001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56cf12d-a14f-421d-a494-0588d2b30fc7 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:01:02.478161 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83e5a7-64e8-4f69-9157-e0699a5a693c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:01:02.478759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83e5a7-64e8-4f69-9157-e0699a5a693c service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:01:02.479036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83e5a7-64e8-4f69-9157-e0699a5a693c service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:01:02.479306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83e5a7-64e8-4f69-9157-e0699a5a693c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:01:02.481037 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5b83e5a7-64e8-4f69-9157-e0699a5a693c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:01:02.492162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83e5a7-64e8-4f69-9157-e0699a5a693c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:01:02.493733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83e5a7-64e8-4f69-9157-e0699a5a693c service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:01:02.512445 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4432/8774] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:01:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:01:12.509725 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=38 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:01:19.536852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc39625-afea-4e72-99e6-4fb52fbea553 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:01:19.538288 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1cc39625-afea-4e72-99e6-4fb52fbea553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:01:19.601134 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc39625-afea-4e72-99e6-4fb52fbea553 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:01:19.605340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c308c3f-d9e2-46cb-ac76-2c4f0d248d6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:01:19.606130 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c308c3f-d9e2-46cb-ac76-2c4f0d248d6d service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:01:19.606507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c308c3f-d9e2-46cb-ac76-2c4f0d248d6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:01:19.606878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c308c3f-d9e2-46cb-ac76-2c4f0d248d6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:01:19.608864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6c308c3f-d9e2-46cb-ac76-2c4f0d248d6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:01:19.627452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c308c3f-d9e2-46cb-ac76-2c4f0d248d6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:01:19.628931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c308c3f-d9e2-46cb-ac76-2c4f0d248d6d service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:01:19.644571 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4343/8775] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:01:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:01:20.845792 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83e5a7-64e8-4f69-9157-e0699a5a693c service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:01:20.847868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5b83e5a7-64e8-4f69-9157-e0699a5a693c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:01:20.865140 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83e5a7-64e8-4f69-9157-e0699a5a693c service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:01:20.870682 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa7392-df45-4a90-8a9d-236067942101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:01:20.871682 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa7392-df45-4a90-8a9d-236067942101 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:01:20.871988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa7392-df45-4a90-8a9d-236067942101 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:01:20.872304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa7392-df45-4a90-8a9d-236067942101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:01:20.874666 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-90aa7392-df45-4a90-8a9d-236067942101 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:01:20.890931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa7392-df45-4a90-8a9d-236067942101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:01:20.892408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa7392-df45-4a90-8a9d-236067942101 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:01:20.906245 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4433/8776] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:01:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:01:25.545010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c308c3f-d9e2-46cb-ac76-2c4f0d248d6d service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:01:25.546678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6c308c3f-d9e2-46cb-ac76-2c4f0d248d6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:01:25.619124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c308c3f-d9e2-46cb-ac76-2c4f0d248d6d service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:01:25.624122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba333463-51d4-4bfa-a085-a59fb37df639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:01:25.624753 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba333463-51d4-4bfa-a085-a59fb37df639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:01:25.625026 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba333463-51d4-4bfa-a085-a59fb37df639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:01:25.625297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba333463-51d4-4bfa-a085-a59fb37df639 admin admin] PATH_INFO: `/v3/users/830639b9b39a43a7b714b74c26fdf52c` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:01:25.626401 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba333463-51d4-4bfa-a085-a59fb37df639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=830639b9b39a43a7b714b74c26fdf52c)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:01:25.628370 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba333463-51d4-4bfa-a085-a59fb37df639 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:01:25.676634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ba333463-51d4-4bfa-a085-a59fb37df639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '830639b9b39a43a7b714b74c26fdf52c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:01:25.684851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ba333463-51d4-4bfa-a085-a59fb37df639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '830639b9b39a43a7b714b74c26fdf52c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:01:25.697198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ba333463-51d4-4bfa-a085-a59fb37df639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '830639b9b39a43a7b714b74c26fdf52c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:01:25.697926 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ba333463-51d4-4bfa-a085-a59fb37df639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '830639b9b39a43a7b714b74c26fdf52c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:01:25.705473 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ba333463-51d4-4bfa-a085-a59fb37df639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '830639b9b39a43a7b714b74c26fdf52c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:01:25.711747 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4344/8777] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 02:01:25 2022] DELETE /identity/v3/users/830639b9b39a43a7b714b74c26fdf52c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 02:01:25.717217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61be3d2-f826-4ea9-bb61-d97e5fb11ed2 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:01:25.717716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61be3d2-f826-4ea9-bb61-d97e5fb11ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:01:25.717831 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61be3d2-f826-4ea9-bb61-d97e5fb11ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:01:25.737585 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f61be3d2-f826-4ea9-bb61-d97e5fb11ed2 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:01:25.738783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f61be3d2-f826-4ea9-bb61-d97e5fb11ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:01:25.799289 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4434/8778] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:01:25.809201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba333463-51d4-4bfa-a085-a59fb37df639 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:01:25.810605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ba333463-51d4-4bfa-a085-a59fb37df639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:01:25.838876 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:01:25.875470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba333463-51d4-4bfa-a085-a59fb37df639 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:01:25.879202 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd87340-4402-4118-9302-9708778c4e2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:01:25.879799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd87340-4402-4118-9302-9708778c4e2a service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:01:25.880101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd87340-4402-4118-9302-9708778c4e2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:01:25.880367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd87340-4402-4118-9302-9708778c4e2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:01:25.889710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd87340-4402-4118-9302-9708778c4e2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:01:25.891128 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd87340-4402-4118-9302-9708778c4e2a service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:01:25.901528 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4345/8779] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:01:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:01:26.084939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61be3d2-f826-4ea9-bb61-d97e5fb11ed2 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:01:26.086426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f61be3d2-f826-4ea9-bb61-d97e5fb11ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:01:26.099756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61be3d2-f826-4ea9-bb61-d97e5fb11ed2 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:01:26.104829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8672b-aefa-45fa-b1b1-58370a305fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:01:26.105529 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8672b-aefa-45fa-b1b1-58370a305fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:01:26.105812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8672b-aefa-45fa-b1b1-58370a305fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:01:26.106085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8672b-aefa-45fa-b1b1-58370a305fda admin admin] PATH_INFO: `/v3/projects/d37d8c916412400ba4b57ea10fceb39e` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:01:26.108183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8672b-aefa-45fa-b1b1-58370a305fda admin admin] RBAC: Authorizing `identity:delete_project(project_id=d37d8c916412400ba4b57ea10fceb39e)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:01:26.110728 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8672b-aefa-45fa-b1b1-58370a305fda admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:01:26.162559 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bde8672b-aefa-45fa-b1b1-58370a305fda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd37d8c916412400ba4b57ea10fceb39e', 'request_id': 'req-bde8672b-aefa-45fa-b1b1-58370a305fda'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:01:26.169404 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bde8672b-aefa-45fa-b1b1-58370a305fda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd37d8c916412400ba4b57ea10fceb39e', 'request_id': 'req-bde8672b-aefa-45fa-b1b1-58370a305fda'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:01:26.176884 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bde8672b-aefa-45fa-b1b1-58370a305fda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd37d8c916412400ba4b57ea10fceb39e', 'request_id': 'req-bde8672b-aefa-45fa-b1b1-58370a305fda'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:01:26.190019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bde8672b-aefa-45fa-b1b1-58370a305fda admin admin] The token cache is being invalidate because project d37d8c916412400ba4b57ea10fceb39e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 02:01:26.190818 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bde8672b-aefa-45fa-b1b1-58370a305fda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:01:26.191474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-bde8672b-aefa-45fa-b1b1-58370a305fda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:01:26.193015 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4435/8780] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 02:01:26 2022] DELETE /identity/v3/projects/d37d8c916412400ba4b57ea10fceb39e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:01:26.197658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd87340-4402-4118-9302-9708778c4e2a service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:01:26.208157 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd87340-4402-4118-9302-9708778c4e2a service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:01:26.278013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a21d6b-e2a8-41e8-b23e-fa92d9e135d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:01:26.278735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a21d6b-e2a8-41e8-b23e-fa92d9e135d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:01:26.279017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a21d6b-e2a8-41e8-b23e-fa92d9e135d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:01:26.279376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a21d6b-e2a8-41e8-b23e-fa92d9e135d6 admin admin] PATH_INFO: `/v3/users/2fde507388124f7e8d3449239f674c5e` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:01:26.280558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a21d6b-e2a8-41e8-b23e-fa92d9e135d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fde507388124f7e8d3449239f674c5e)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:01:26.282714 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a21d6b-e2a8-41e8-b23e-fa92d9e135d6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:01:26.338373 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-94a21d6b-e2a8-41e8-b23e-fa92d9e135d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fde507388124f7e8d3449239f674c5e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:01:26.345898 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-94a21d6b-e2a8-41e8-b23e-fa92d9e135d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fde507388124f7e8d3449239f674c5e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:01:26.359376 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-94a21d6b-e2a8-41e8-b23e-fa92d9e135d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fde507388124f7e8d3449239f674c5e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:01:26.360336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-94a21d6b-e2a8-41e8-b23e-fa92d9e135d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fde507388124f7e8d3449239f674c5e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:01:26.370104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-94a21d6b-e2a8-41e8-b23e-fa92d9e135d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fde507388124f7e8d3449239f674c5e'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:01:26.376433 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4346/8781] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 02:01:26 2022] DELETE /identity/v3/users/2fde507388124f7e8d3449239f674c5e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 02:01:26.569874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8672b-aefa-45fa-b1b1-58370a305fda admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:01:26.571310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-bde8672b-aefa-45fa-b1b1-58370a305fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:01:26.587348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8672b-aefa-45fa-b1b1-58370a305fda admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:01:26.645320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31d884-0114-469a-a9cd-2c113e679552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:01:26.645987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31d884-0114-469a-a9cd-2c113e679552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:01:26.646296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31d884-0114-469a-a9cd-2c113e679552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:01:26.646572 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31d884-0114-469a-a9cd-2c113e679552 admin admin] PATH_INFO: `/v3/projects/2569e52ed8a440daa867d62aa63f95d5` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:01:26.647703 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31d884-0114-469a-a9cd-2c113e679552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2569e52ed8a440daa867d62aa63f95d5)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:01:26.649648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31d884-0114-469a-a9cd-2c113e679552 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:01:26.660852 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:01:26.697439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fe31d884-0114-469a-a9cd-2c113e679552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2569e52ed8a440daa867d62aa63f95d5', 'request_id': 'req-fe31d884-0114-469a-a9cd-2c113e679552'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:01:26.702931 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fe31d884-0114-469a-a9cd-2c113e679552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2569e52ed8a440daa867d62aa63f95d5', 'request_id': 'req-fe31d884-0114-469a-a9cd-2c113e679552'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:01:26.709115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fe31d884-0114-469a-a9cd-2c113e679552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2569e52ed8a440daa867d62aa63f95d5', 'request_id': 'req-fe31d884-0114-469a-a9cd-2c113e679552'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:01:26.721946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fe31d884-0114-469a-a9cd-2c113e679552 admin admin] The token cache is being invalidate because project 2569e52ed8a440daa867d62aa63f95d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 02:01:26.722561 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fe31d884-0114-469a-a9cd-2c113e679552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:01:26.722879 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fe31d884-0114-469a-a9cd-2c113e679552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:01:26.724400 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4436/8782] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 02:01:26 2022] DELETE /identity/v3/projects/2569e52ed8a440daa867d62aa63f95d5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:01:36.372586 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=69,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:01:36.718476 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:02:40.745846 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a21d6b-e2a8-41e8-b23e-fa92d9e135d6 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:02:40.747345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-94a21d6b-e2a8-41e8-b23e-fa92d9e135d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:02:40.831329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a21d6b-e2a8-41e8-b23e-fa92d9e135d6 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:02:40.918626 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838376d-2a57-4127-9d75-4d2751a4f059 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:02:40.919384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838376d-2a57-4127-9d75-4d2751a4f059 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:02:40.919788 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838376d-2a57-4127-9d75-4d2751a4f059 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:02:40.920206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838376d-2a57-4127-9d75-4d2751a4f059 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:02:40.922075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0838376d-2a57-4127-9d75-4d2751a4f059 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:02:40.937413 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838376d-2a57-4127-9d75-4d2751a4f059 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:02:40.939267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838376d-2a57-4127-9d75-4d2751a4f059 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:02:40.954566 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4347/8783] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:02:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:02:41.983509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31d884-0114-469a-a9cd-2c113e679552 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:02:41.985005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fe31d884-0114-469a-a9cd-2c113e679552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:02:42.043913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31d884-0114-469a-a9cd-2c113e679552 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:02:42.047692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e13c6ab-e2f9-494f-83ff-3be7897f7d54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:02:42.048330 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13c6ab-e2f9-494f-83ff-3be7897f7d54 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:02:42.048604 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13c6ab-e2f9-494f-83ff-3be7897f7d54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:02:42.048868 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13c6ab-e2f9-494f-83ff-3be7897f7d54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:02:42.050578 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3e13c6ab-e2f9-494f-83ff-3be7897f7d54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:02:42.062714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e13c6ab-e2f9-494f-83ff-3be7897f7d54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:02:42.064157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e13c6ab-e2f9-494f-83ff-3be7897f7d54 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:02:42.074370 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4437/8784] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:02:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:02:43.005703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838376d-2a57-4127-9d75-4d2751a4f059 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:02:43.007535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0838376d-2a57-4127-9d75-4d2751a4f059 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:02:43.024094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838376d-2a57-4127-9d75-4d2751a4f059 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:02:43.030644 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd89201-ceea-497a-b46c-09daa7fc86a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:02:43.031359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd89201-ceea-497a-b46c-09daa7fc86a0 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:02:43.031650 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd89201-ceea-497a-b46c-09daa7fc86a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:02:43.031946 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd89201-ceea-497a-b46c-09daa7fc86a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:02:43.033683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ddd89201-ceea-497a-b46c-09daa7fc86a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:02:43.049434 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd89201-ceea-497a-b46c-09daa7fc86a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:02:43.051006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd89201-ceea-497a-b46c-09daa7fc86a0 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:02:43.065848 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4348/8785] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:02:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:02:52.068486 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=26 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:02:53.060158 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=68 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:04.865302 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e13c6ab-e2f9-494f-83ff-3be7897f7d54 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:04.874281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e13c6ab-e2f9-494f-83ff-3be7897f7d54 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:04.877897 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcd60e-cd0d-4e3f-8031-4eeafffe989a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:04.878497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcd60e-cd0d-4e3f-8031-4eeafffe989a service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:04.878981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcd60e-cd0d-4e3f-8031-4eeafffe989a service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:04.879255 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbcd60e-cd0d-4e3f-8031-4eeafffe989a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:04.881014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6bbcd60e-cd0d-4e3f-8031-4eeafffe989a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:04.945605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcd60e-cd0d-4e3f-8031-4eeafffe989a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:04.947043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbcd60e-cd0d-4e3f-8031-4eeafffe989a service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:04.959431 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4438/8786] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:03:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:03:08.066408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd89201-ceea-497a-b46c-09daa7fc86a0 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:08.069173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ddd89201-ceea-497a-b46c-09daa7fc86a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:08.161862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd89201-ceea-497a-b46c-09daa7fc86a0 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:08.167910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb234b1f-6749-402e-98e8-58ee0734118d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:08.168524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb234b1f-6749-402e-98e8-58ee0734118d service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:08.168801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb234b1f-6749-402e-98e8-58ee0734118d service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:08.169070 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb234b1f-6749-402e-98e8-58ee0734118d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:08.170899 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-eb234b1f-6749-402e-98e8-58ee0734118d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:08.185461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb234b1f-6749-402e-98e8-58ee0734118d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:08.187247 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb234b1f-6749-402e-98e8-58ee0734118d service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:08.204629 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4349/8787] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:03:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:03:11.354045 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcd60e-cd0d-4e3f-8031-4eeafffe989a service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:11.355546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6bbcd60e-cd0d-4e3f-8031-4eeafffe989a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:11.371643 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbcd60e-cd0d-4e3f-8031-4eeafffe989a service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:11.376338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c109919-b0d1-47da-9401-bf03bdb21acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:11.376971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c109919-b0d1-47da-9401-bf03bdb21acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:11.377250 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c109919-b0d1-47da-9401-bf03bdb21acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:11.377522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c109919-b0d1-47da-9401-bf03bdb21acc admin admin] PATH_INFO: `/v3/users/661f6c9aa7da4e348a9b0d91840078c2` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:11.378647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c109919-b0d1-47da-9401-bf03bdb21acc admin admin] RBAC: Authorizing `identity:delete_user(user_id=661f6c9aa7da4e348a9b0d91840078c2)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:11.380686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c109919-b0d1-47da-9401-bf03bdb21acc admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:11.428060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2c109919-b0d1-47da-9401-bf03bdb21acc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '661f6c9aa7da4e348a9b0d91840078c2'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:11.435387 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2c109919-b0d1-47da-9401-bf03bdb21acc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '661f6c9aa7da4e348a9b0d91840078c2'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:11.447071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2c109919-b0d1-47da-9401-bf03bdb21acc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '661f6c9aa7da4e348a9b0d91840078c2'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:11.448399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2c109919-b0d1-47da-9401-bf03bdb21acc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '661f6c9aa7da4e348a9b0d91840078c2'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:11.455775 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-2c109919-b0d1-47da-9401-bf03bdb21acc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '661f6c9aa7da4e348a9b0d91840078c2'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:11.461881 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4439/8788] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 02:03:11 2022] DELETE /identity/v3/users/661f6c9aa7da4e348a9b0d91840078c2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:03:11.635462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb234b1f-6749-402e-98e8-58ee0734118d service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:11.646763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb234b1f-6749-402e-98e8-58ee0734118d service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:11.706181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a645b-4b11-44d4-9115-d1883b71ea9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:11.706815 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a645b-4b11-44d4-9115-d1883b71ea9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:11.707094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a645b-4b11-44d4-9115-d1883b71ea9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:11.707396 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a645b-4b11-44d4-9115-d1883b71ea9b admin admin] PATH_INFO: `/v3/projects/bf36f5153ba648008cdaceb9dc538e53` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:11.708553 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a645b-4b11-44d4-9115-d1883b71ea9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf36f5153ba648008cdaceb9dc538e53)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:11.710461 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a645b-4b11-44d4-9115-d1883b71ea9b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:11.757749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-204a645b-4b11-44d4-9115-d1883b71ea9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf36f5153ba648008cdaceb9dc538e53', 'request_id': 'req-204a645b-4b11-44d4-9115-d1883b71ea9b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:11.763365 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-204a645b-4b11-44d4-9115-d1883b71ea9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf36f5153ba648008cdaceb9dc538e53', 'request_id': 'req-204a645b-4b11-44d4-9115-d1883b71ea9b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:11.769617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-204a645b-4b11-44d4-9115-d1883b71ea9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf36f5153ba648008cdaceb9dc538e53', 'request_id': 'req-204a645b-4b11-44d4-9115-d1883b71ea9b'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:11.781038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-204a645b-4b11-44d4-9115-d1883b71ea9b admin admin] The token cache is being invalidate because project bf36f5153ba648008cdaceb9dc538e53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 02:03:11.781324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-204a645b-4b11-44d4-9115-d1883b71ea9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:11.781941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-204a645b-4b11-44d4-9115-d1883b71ea9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:11.783466 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4350/8789] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 02:03:11 2022] DELETE /identity/v3/projects/bf36f5153ba648008cdaceb9dc538e53 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:03:11.787477 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c109919-b0d1-47da-9401-bf03bdb21acc admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:11.788930 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2c109919-b0d1-47da-9401-bf03bdb21acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:11.802416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c109919-b0d1-47da-9401-bf03bdb21acc admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:11.857998 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b45b3f-e930-477e-942b-36473b3706a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:11.858634 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b45b3f-e930-477e-942b-36473b3706a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:11.858916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b45b3f-e930-477e-942b-36473b3706a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:11.859190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b45b3f-e930-477e-942b-36473b3706a8 admin admin] PATH_INFO: `/v3/users/56d8bcf448eb47ea8d50e38bd30e60a0` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:11.869878 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:11.874769 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b45b3f-e930-477e-942b-36473b3706a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56d8bcf448eb47ea8d50e38bd30e60a0)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:11.877154 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b45b3f-e930-477e-942b-36473b3706a8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:11.924815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f8b45b3f-e930-477e-942b-36473b3706a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56d8bcf448eb47ea8d50e38bd30e60a0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:11.931629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f8b45b3f-e930-477e-942b-36473b3706a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56d8bcf448eb47ea8d50e38bd30e60a0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:11.943414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f8b45b3f-e930-477e-942b-36473b3706a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56d8bcf448eb47ea8d50e38bd30e60a0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:11.944131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f8b45b3f-e930-477e-942b-36473b3706a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56d8bcf448eb47ea8d50e38bd30e60a0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:11.952969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-f8b45b3f-e930-477e-942b-36473b3706a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56d8bcf448eb47ea8d50e38bd30e60a0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:11.964961 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4440/8790] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 02:03:11 2022] DELETE /identity/v3/users/56d8bcf448eb47ea8d50e38bd30e60a0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:03:12.141043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a645b-4b11-44d4-9115-d1883b71ea9b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:12.142607 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-204a645b-4b11-44d4-9115-d1883b71ea9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:12.156281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a645b-4b11-44d4-9115-d1883b71ea9b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:12.173578 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:12.215540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4cf942-607f-4a86-9896-9574245dc4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:12.216125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cf942-607f-4a86-9896-9574245dc4b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:12.216452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cf942-607f-4a86-9896-9574245dc4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:12.216705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4cf942-607f-4a86-9896-9574245dc4b0 admin admin] PATH_INFO: `/v3/projects/7caf3c02c68d4c718f35cf3683b3a567` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:12.227094 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4cf942-607f-4a86-9896-9574245dc4b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7caf3c02c68d4c718f35cf3683b3a567)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:12.229051 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4cf942-607f-4a86-9896-9574245dc4b0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:12.275908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6e4cf942-607f-4a86-9896-9574245dc4b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7caf3c02c68d4c718f35cf3683b3a567', 'request_id': 'req-6e4cf942-607f-4a86-9896-9574245dc4b0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:12.281857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6e4cf942-607f-4a86-9896-9574245dc4b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7caf3c02c68d4c718f35cf3683b3a567', 'request_id': 'req-6e4cf942-607f-4a86-9896-9574245dc4b0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:12.288454 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6e4cf942-607f-4a86-9896-9574245dc4b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7caf3c02c68d4c718f35cf3683b3a567', 'request_id': 'req-6e4cf942-607f-4a86-9896-9574245dc4b0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:12.300221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6e4cf942-607f-4a86-9896-9574245dc4b0 admin admin] The token cache is being invalidate because project 7caf3c02c68d4c718f35cf3683b3a567 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 02:03:12.300501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6e4cf942-607f-4a86-9896-9574245dc4b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:12.301113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6e4cf942-607f-4a86-9896-9574245dc4b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:12.302581 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4351/8791] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 02:03:12 2022] DELETE /identity/v3/projects/7caf3c02c68d4c718f35cf3683b3a567 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:03:21.832057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f63d0f-69d4-4bda-808e-51f4f5e859f8 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:21.832557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f63d0f-69d4-4bda-808e-51f4f5e859f8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:21.832639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f63d0f-69d4-4bda-808e-51f4f5e859f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:21.852111 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a9f63d0f-69d4-4bda-808e-51f4f5e859f8 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:03:21.853290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a9f63d0f-69d4-4bda-808e-51f4f5e859f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:21.911783 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4441/8792] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:03:21.920832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c86833-681c-45d8-9ec2-90af460cecf0 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:21.921278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c86833-681c-45d8-9ec2-90af460cecf0 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:21.921387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c86833-681c-45d8-9ec2-90af460cecf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:21.940891 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-93c86833-681c-45d8-9ec2-90af460cecf0 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:03:21.942093 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-93c86833-681c-45d8-9ec2-90af460cecf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:21.950697 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4352/8793] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:03:21.955336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f63d0f-69d4-4bda-808e-51f4f5e859f8 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:21.970203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f63d0f-69d4-4bda-808e-51f4f5e859f8 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:21.974839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5ac62-ae69-4506-b672-c88e149f4f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:21.975448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5ac62-ae69-4506-b672-c88e149f4f05 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:21.975728 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5ac62-ae69-4506-b672-c88e149f4f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:21.976057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5ac62-ae69-4506-b672-c88e149f4f05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:21.980687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5ac62-ae69-4506-b672-c88e149f4f05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 02:03:21.980687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5ac62-ae69-4506-b672-c88e149f4f05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:21.980687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5ac62-ae69-4506-b672-c88e149f4f05 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:21.991344 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4442/8794] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 02:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 02:03:22.005903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c86833-681c-45d8-9ec2-90af460cecf0 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:22.016105 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c86833-681c-45d8-9ec2-90af460cecf0 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:22.020741 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463188e-ce39-4175-b143-8ee906f443b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:22.021348 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463188e-ce39-4175-b143-8ee906f443b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:22.021639 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463188e-ce39-4175-b143-8ee906f443b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:22.021962 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463188e-ce39-4175-b143-8ee906f443b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:22.022659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463188e-ce39-4175-b143-8ee906f443b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:22.024587 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463188e-ce39-4175-b143-8ee906f443b4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:22.051195 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4353/8795] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 02:03:22 2022] POST /identity/v3/projects => generated 393 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 02:03:22.055454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5ac62-ae69-4506-b672-c88e149f4f05 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:22.066188 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5ac62-ae69-4506-b672-c88e149f4f05 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:22.121731 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c40eb-f7c0-42d9-a3c8-0e443f21e145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:22.122288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c40eb-f7c0-42d9-a3c8-0e443f21e145 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:22.122571 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c40eb-f7c0-42d9-a3c8-0e443f21e145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:22.122845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c40eb-f7c0-42d9-a3c8-0e443f21e145 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:22.123472 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c40eb-f7c0-42d9-a3c8-0e443f21e145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:22.125583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c40eb-f7c0-42d9-a3c8-0e443f21e145 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:22.134286 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:22.147867 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4443/8796] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 02:03:22 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 02:03:22.151912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463188e-ce39-4175-b143-8ee906f443b4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:22.162185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463188e-ce39-4175-b143-8ee906f443b4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:22.167053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99037686-057c-4d74-ae9c-28297a4a1f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:22.168175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99037686-057c-4d74-ae9c-28297a4a1f33 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:22.168520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99037686-057c-4d74-ae9c-28297a4a1f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:22.168787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99037686-057c-4d74-ae9c-28297a4a1f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:22.169422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99037686-057c-4d74-ae9c-28297a4a1f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:22.171010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99037686-057c-4d74-ae9c-28297a4a1f33 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:22.181071 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4354/8797] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 02:03:22.185468 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c40eb-f7c0-42d9-a3c8-0e443f21e145 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:22.195487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c40eb-f7c0-42d9-a3c8-0e443f21e145 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:22.200155 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11929e3a-f371-4d97-b390-1b35e8e8373a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:22.200746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11929e3a-f371-4d97-b390-1b35e8e8373a admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:22.201030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11929e3a-f371-4d97-b390-1b35e8e8373a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:22.201306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11929e3a-f371-4d97-b390-1b35e8e8373a admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:22.201949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11929e3a-f371-4d97-b390-1b35e8e8373a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:22.203529 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11929e3a-f371-4d97-b390-1b35e8e8373a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:22.214091 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4444/8798] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 02:03:22.218077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99037686-057c-4d74-ae9c-28297a4a1f33 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:22.227811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99037686-057c-4d74-ae9c-28297a4a1f33 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:22.233291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71884d1e-45cc-4950-a289-821e49549d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:22.234009 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71884d1e-45cc-4950-a289-821e49549d0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:22.234305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71884d1e-45cc-4950-a289-821e49549d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:22.234573 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71884d1e-45cc-4950-a289-821e49549d0b admin admin] PATH_INFO: `/v3/projects/0ac14163d1ba44d08784c186c8006680/users/5384b291c32042858c6a4ae404085dfd/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:22.250568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71884d1e-45cc-4950-a289-821e49549d0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ac14163d1ba44d08784c186c8006680, user_id=5384b291c32042858c6a4ae404085dfd, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:22.253254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71884d1e-45cc-4950-a289-821e49549d0b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:22.265654 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4355/8799] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 02:03:22 2022] PUT /identity/v3/projects/0ac14163d1ba44d08784c186c8006680/users/5384b291c32042858c6a4ae404085dfd/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:03:22.278656 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb69f65-e82b-469f-96a1-369712c399ac None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:22.278940 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb69f65-e82b-469f-96a1-369712c399ac None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:22.279214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb69f65-e82b-469f-96a1-369712c399ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:22.306887 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-deb69f65-e82b-469f-96a1-369712c399ac None None] MFA Rules not processed for user `5384b291c32042858c6a4ae404085dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:03:22.308201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-deb69f65-e82b-469f-96a1-369712c399ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:22.372377 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4445/8800] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:03:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:03:22.377005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71884d1e-45cc-4950-a289-821e49549d0b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:22.418094 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:22.440507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71884d1e-45cc-4950-a289-821e49549d0b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:22.445165 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3580d-392d-4786-9c6f-58ece36f817f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:22.445762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3580d-392d-4786-9c6f-58ece36f817f admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:22.446033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3580d-392d-4786-9c6f-58ece36f817f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:22.446308 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3580d-392d-4786-9c6f-58ece36f817f admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:22.446951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3580d-392d-4786-9c6f-58ece36f817f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:22.449507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3580d-392d-4786-9c6f-58ece36f817f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:22.475591 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4356/8801] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 02:03:22 2022] POST /identity/v3/projects => generated 391 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 02:03:22.479502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb69f65-e82b-469f-96a1-369712c399ac None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:22.490357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb69f65-e82b-469f-96a1-369712c399ac None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:22.546672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43ee09-bfe1-45b4-ba02-f7288befcd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:22.547270 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43ee09-bfe1-45b4-ba02-f7288befcd0d admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:22.547554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43ee09-bfe1-45b4-ba02-f7288befcd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:22.547823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43ee09-bfe1-45b4-ba02-f7288befcd0d admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:22.548464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43ee09-bfe1-45b4-ba02-f7288befcd0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:22.550373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43ee09-bfe1-45b4-ba02-f7288befcd0d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:22.574294 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4446/8802] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 02:03:22 2022] POST /identity/v3/users => generated 302 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 02:03:22.575585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3580d-392d-4786-9c6f-58ece36f817f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:22.586231 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3580d-392d-4786-9c6f-58ece36f817f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:22.590925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b17c2f-483c-43d4-92d6-a13191b91865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:22.591527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b17c2f-483c-43d4-92d6-a13191b91865 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:22.591807 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b17c2f-483c-43d4-92d6-a13191b91865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:22.592115 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b17c2f-483c-43d4-92d6-a13191b91865 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:22.592761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b17c2f-483c-43d4-92d6-a13191b91865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:22.594393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b17c2f-483c-43d4-92d6-a13191b91865 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:22.604855 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4357/8803] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 02:03:22.609104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43ee09-bfe1-45b4-ba02-f7288befcd0d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:22.619118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43ee09-bfe1-45b4-ba02-f7288befcd0d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:22.624386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b5689-fe7d-4ba1-adf6-ac7dfa3ab9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:22.624967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b5689-fe7d-4ba1-adf6-ac7dfa3ab9b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:22.625241 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b5689-fe7d-4ba1-adf6-ac7dfa3ab9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:22.625511 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b5689-fe7d-4ba1-adf6-ac7dfa3ab9b2 admin admin] PATH_INFO: `/v3/projects/1e01ff8fff8c4201a8611847af0cb1d7/users/b4d34308938a4d47abc305ba7865c246/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:22.642064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b5689-fe7d-4ba1-adf6-ac7dfa3ab9b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e01ff8fff8c4201a8611847af0cb1d7, user_id=b4d34308938a4d47abc305ba7865c246, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:22.644825 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b5689-fe7d-4ba1-adf6-ac7dfa3ab9b2 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:22.657231 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4447/8804] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 02:03:22 2022] PUT /identity/v3/projects/1e01ff8fff8c4201a8611847af0cb1d7/users/b4d34308938a4d47abc305ba7865c246/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:03:22.661101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b17c2f-483c-43d4-92d6-a13191b91865 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:22.672359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b17c2f-483c-43d4-92d6-a13191b91865 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:22.727464 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c0db2-dd19-4834-bc9b-2cdcad5e696e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:22.728099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c0db2-dd19-4834-bc9b-2cdcad5e696e admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:22.728424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c0db2-dd19-4834-bc9b-2cdcad5e696e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:22.728659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c0db2-dd19-4834-bc9b-2cdcad5e696e admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:22.729404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c0db2-dd19-4834-bc9b-2cdcad5e696e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:22.731039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c0db2-dd19-4834-bc9b-2cdcad5e696e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:22.741118 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4358/8805] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 02:03:22.745071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b5689-fe7d-4ba1-adf6-ac7dfa3ab9b2 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:22.755568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b5689-fe7d-4ba1-adf6-ac7dfa3ab9b2 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:22.760186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189788a9-4278-43f3-a8e0-fac61f855e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:22.760821 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189788a9-4278-43f3-a8e0-fac61f855e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:22.761093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189788a9-4278-43f3-a8e0-fac61f855e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:22.761946 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189788a9-4278-43f3-a8e0-fac61f855e10 admin admin] PATH_INFO: `/v3/projects/1e01ff8fff8c4201a8611847af0cb1d7/users/b4d34308938a4d47abc305ba7865c246/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:22.763844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189788a9-4278-43f3-a8e0-fac61f855e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e01ff8fff8c4201a8611847af0cb1d7, user_id=b4d34308938a4d47abc305ba7865c246, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:22.766476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189788a9-4278-43f3-a8e0-fac61f855e10 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:22.776621 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4448/8806] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 02:03:22 2022] PUT /identity/v3/projects/1e01ff8fff8c4201a8611847af0cb1d7/users/b4d34308938a4d47abc305ba7865c246/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:03:22.786344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87013138-28b2-4611-9d5d-49cfea4bb9f8 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:22.786729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87013138-28b2-4611-9d5d-49cfea4bb9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:22.787008 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87013138-28b2-4611-9d5d-49cfea4bb9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:22.815144 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-87013138-28b2-4611-9d5d-49cfea4bb9f8 None None] MFA Rules not processed for user `b4d34308938a4d47abc305ba7865c246`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:03:22.816382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-87013138-28b2-4611-9d5d-49cfea4bb9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:22.883906 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4359/8807] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:03:22 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:03:22.895586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf532a7-3d78-4acb-91b3-cb38cea8281e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:22.896067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf532a7-3d78-4acb-91b3-cb38cea8281e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:22.896170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf532a7-3d78-4acb-91b3-cb38cea8281e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:22.914760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-adf532a7-3d78-4acb-91b3-cb38cea8281e None None] MFA Rules not processed for user `5384b291c32042858c6a4ae404085dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:03:22.915978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-adf532a7-3d78-4acb-91b3-cb38cea8281e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:22.932545 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:22.974631 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4449/8808] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:03:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:03:22.988900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87013138-28b2-4611-9d5d-49cfea4bb9f8 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:22.990480 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-87013138-28b2-4611-9d5d-49cfea4bb9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:23.026589 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:23.068778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87013138-28b2-4611-9d5d-49cfea4bb9f8 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:23.074411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f25c8f-dbb9-40a4-9684-f09096fdba85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:23.075013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f25c8f-dbb9-40a4-9684-f09096fdba85 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:23.075293 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f25c8f-dbb9-40a4-9684-f09096fdba85 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:23.075606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f25c8f-dbb9-40a4-9684-f09096fdba85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:23.083459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f25c8f-dbb9-40a4-9684-f09096fdba85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:23.085065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f25c8f-dbb9-40a4-9684-f09096fdba85 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:23.093828 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4360/8809] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:03:22 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 02:03:23.476301 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf532a7-3d78-4acb-91b3-cb38cea8281e None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:23.477801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-adf532a7-3d78-4acb-91b3-cb38cea8281e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:23.566719 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf532a7-3d78-4acb-91b3-cb38cea8281e None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:23.572159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df10568-2c21-42dc-b886-3e5d9327a368 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:23.572823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df10568-2c21-42dc-b886-3e5d9327a368 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:23.573142 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df10568-2c21-42dc-b886-3e5d9327a368 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:23.573418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df10568-2c21-42dc-b886-3e5d9327a368 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:23.575694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7df10568-2c21-42dc-b886-3e5d9327a368 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:23.586879 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df10568-2c21-42dc-b886-3e5d9327a368 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:23.588504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df10568-2c21-42dc-b886-3e5d9327a368 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:23.598941 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4450/8810] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:03:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:03:33.090127 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=19 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:33.594840 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=47 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:34.080880 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f25c8f-dbb9-40a4-9684-f09096fdba85 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:34.094484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f25c8f-dbb9-40a4-9684-f09096fdba85 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:34.100056 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae9645-fb37-483e-b214-b5b33a0f8019 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:34.100649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae9645-fb37-483e-b214-b5b33a0f8019 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:34.100929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae9645-fb37-483e-b214-b5b33a0f8019 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:34.101202 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae9645-fb37-483e-b214-b5b33a0f8019 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:34.110147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae9645-fb37-483e-b214-b5b33a0f8019 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:34.111697 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae9645-fb37-483e-b214-b5b33a0f8019 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:34.121730 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4361/8811] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:03:34 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:03:34.136276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd566f5-7e88-4459-91e0-c1af77580584 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:34.136556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd566f5-7e88-4459-91e0-c1af77580584 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:34.136830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd566f5-7e88-4459-91e0-c1af77580584 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:34.138232 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4451/8812] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 02:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 02:03:34.142535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae9645-fb37-483e-b214-b5b33a0f8019 service nova] Authenticating service token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 02:03:34.156288 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae9645-fb37-483e-b214-b5b33a0f8019 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:34.164610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae9645-fb37-483e-b214-b5b33a0f8019 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:34.169668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499bbbe-1b71-40ed-8a4f-2d2d7ee9f539 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d34308938a4d47abc305ba7865c246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e01ff8fff8c4201a8611847af0cb1d7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:34.170281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499bbbe-1b71-40ed-8a4f-2d2d7ee9f539 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:34.170562 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499bbbe-1b71-40ed-8a4f-2d2d7ee9f539 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:34.170836 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499bbbe-1b71-40ed-8a4f-2d2d7ee9f539 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] PATH_INFO: `/v3/projects/1e01ff8fff8c4201a8611847af0cb1d7` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:34.172001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499bbbe-1b71-40ed-8a4f-2d2d7ee9f539 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] RBAC: Authorizing `identity:get_project(project_id=1e01ff8fff8c4201a8611847af0cb1d7)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:34.173771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0499bbbe-1b71-40ed-8a4f-2d2d7ee9f539 tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:34.175475 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4362/8813] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 02:03:34 2022] GET /identity/v3/projects/1e01ff8fff8c4201a8611847af0cb1d7 => generated 391 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 02:03:34.335788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd566f5-7e88-4459-91e0-c1af77580584 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:34.337577 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ebd566f5-7e88-4459-91e0-c1af77580584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:34.395132 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd566f5-7e88-4459-91e0-c1af77580584 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:34.398734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d09ee-a1c0-4b05-be2f-7e189ce7b5bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:34.399334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d09ee-a1c0-4b05-be2f-7e189ce7b5bf service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:34.399613 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d09ee-a1c0-4b05-be2f-7e189ce7b5bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:34.399906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d09ee-a1c0-4b05-be2f-7e189ce7b5bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:34.402122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5c7d09ee-a1c0-4b05-be2f-7e189ce7b5bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:34.413934 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d09ee-a1c0-4b05-be2f-7e189ce7b5bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:34.415317 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d09ee-a1c0-4b05-be2f-7e189ce7b5bf service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:34.426362 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4452/8814] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:03:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:03:34.580786 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587a0d0-6ff4-4cab-a1ba-76da312adbcb None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:34.581101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587a0d0-6ff4-4cab-a1ba-76da312adbcb None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:34.581420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587a0d0-6ff4-4cab-a1ba-76da312adbcb None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:34.583000 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4363/8815] 10.222.0.39 () {54 vars in 912 bytes} [Sun Aug 7 02:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 02:03:34.587687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d09ee-a1c0-4b05-be2f-7e189ce7b5bf service neutron] Authenticating service token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 07 02:03:34.589712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5c7d09ee-a1c0-4b05-be2f-7e189ce7b5bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:34.609011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d09ee-a1c0-4b05-be2f-7e189ce7b5bf service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:34.618241 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d09ee-a1c0-4b05-be2f-7e189ce7b5bf service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:34.622914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3066019-ec66-4aaf-8d19-6efa9d88167a tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4d34308938a4d47abc305ba7865c246', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e01ff8fff8c4201a8611847af0cb1d7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:34.623520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3066019-ec66-4aaf-8d19-6efa9d88167a tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:34.623807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3066019-ec66-4aaf-8d19-6efa9d88167a tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:34.624137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3066019-ec66-4aaf-8d19-6efa9d88167a tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] PATH_INFO: `/v3/projects/1e01ff8fff8c4201a8611847af0cb1d7` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:34.625322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3066019-ec66-4aaf-8d19-6efa9d88167a tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] RBAC: Authorizing `identity:get_project(project_id=1e01ff8fff8c4201a8611847af0cb1d7)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:34.627122 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3066019-ec66-4aaf-8d19-6efa9d88167a tempest-ServersAdminNegativeTestJSON-288036669 tempest-ServersAdminNegativeTestJSON-288036669-project-admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:34.628776 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4453/8816] 10.222.0.39 () {58 vars in 1443 bytes} [Sun Aug 7 02:03:34 2022] GET /identity/v3/projects/1e01ff8fff8c4201a8611847af0cb1d7 => generated 391 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 02:03:38.567213 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587a0d0-6ff4-4cab-a1ba-76da312adbcb None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:38.629966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587a0d0-6ff4-4cab-a1ba-76da312adbcb None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:38.634280 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b301da-b8da-4699-9f6c-24ab08a76139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:38.634894 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b301da-b8da-4699-9f6c-24ab08a76139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:38.635174 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b301da-b8da-4699-9f6c-24ab08a76139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:38.635440 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b301da-b8da-4699-9f6c-24ab08a76139 admin admin] PATH_INFO: `/v3/users/5384b291c32042858c6a4ae404085dfd` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:38.636624 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b301da-b8da-4699-9f6c-24ab08a76139 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5384b291c32042858c6a4ae404085dfd)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:38.638518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b301da-b8da-4699-9f6c-24ab08a76139 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:38.683357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-39b301da-b8da-4699-9f6c-24ab08a76139 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5384b291c32042858c6a4ae404085dfd'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:38.690216 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-39b301da-b8da-4699-9f6c-24ab08a76139 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5384b291c32042858c6a4ae404085dfd'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:38.701999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-39b301da-b8da-4699-9f6c-24ab08a76139 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5384b291c32042858c6a4ae404085dfd'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:38.702670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-39b301da-b8da-4699-9f6c-24ab08a76139 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5384b291c32042858c6a4ae404085dfd'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:38.709182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-39b301da-b8da-4699-9f6c-24ab08a76139 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5384b291c32042858c6a4ae404085dfd'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:38.715013 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4364/8817] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 02:03:38 2022] DELETE /identity/v3/users/5384b291c32042858c6a4ae404085dfd => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:03:38.719552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72c70e-69be-4694-8a52-626c970a9ee9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:38.720018 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72c70e-69be-4694-8a52-626c970a9ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:38.720144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72c70e-69be-4694-8a52-626c970a9ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:38.739537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0d72c70e-69be-4694-8a52-626c970a9ee9 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:03:38.740772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0d72c70e-69be-4694-8a52-626c970a9ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:38.798726 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4454/8818] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:03:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:03:38.809950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b301da-b8da-4699-9f6c-24ab08a76139 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:38.811371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-39b301da-b8da-4699-9f6c-24ab08a76139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:38.868390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b301da-b8da-4699-9f6c-24ab08a76139 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:38.876530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc26de4-ac60-4544-bed8-b80c2885822c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:38.877133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc26de4-ac60-4544-bed8-b80c2885822c service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:38.877407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc26de4-ac60-4544-bed8-b80c2885822c service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:38.877674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc26de4-ac60-4544-bed8-b80c2885822c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:38.888037 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc26de4-ac60-4544-bed8-b80c2885822c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:38.889413 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc26de4-ac60-4544-bed8-b80c2885822c service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:38.894684 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:38.900116 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4365/8819] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:03:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:03:39.072439 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72c70e-69be-4694-8a52-626c970a9ee9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:39.073926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0d72c70e-69be-4694-8a52-626c970a9ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:39.085992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72c70e-69be-4694-8a52-626c970a9ee9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:39.091363 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a41eb9-5cfe-485a-b274-efdee0eb06d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:39.092149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a41eb9-5cfe-485a-b274-efdee0eb06d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:39.092431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a41eb9-5cfe-485a-b274-efdee0eb06d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:39.092706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a41eb9-5cfe-485a-b274-efdee0eb06d3 admin admin] PATH_INFO: `/v3/projects/0ac14163d1ba44d08784c186c8006680` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:39.093846 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a41eb9-5cfe-485a-b274-efdee0eb06d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ac14163d1ba44d08784c186c8006680)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:39.095778 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a41eb9-5cfe-485a-b274-efdee0eb06d3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:39.143815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c0a41eb9-5cfe-485a-b274-efdee0eb06d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ac14163d1ba44d08784c186c8006680', 'request_id': 'req-c0a41eb9-5cfe-485a-b274-efdee0eb06d3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:39.149183 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c0a41eb9-5cfe-485a-b274-efdee0eb06d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ac14163d1ba44d08784c186c8006680', 'request_id': 'req-c0a41eb9-5cfe-485a-b274-efdee0eb06d3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:39.155993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c0a41eb9-5cfe-485a-b274-efdee0eb06d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ac14163d1ba44d08784c186c8006680', 'request_id': 'req-c0a41eb9-5cfe-485a-b274-efdee0eb06d3'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:39.169910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c0a41eb9-5cfe-485a-b274-efdee0eb06d3 admin admin] The token cache is being invalidate because project 0ac14163d1ba44d08784c186c8006680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 02:03:39.170352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c0a41eb9-5cfe-485a-b274-efdee0eb06d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:39.171284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-c0a41eb9-5cfe-485a-b274-efdee0eb06d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:39.173617 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4455/8820] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 02:03:39 2022] DELETE /identity/v3/projects/0ac14163d1ba44d08784c186c8006680 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:03:39.177652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc26de4-ac60-4544-bed8-b80c2885822c service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:39.188106 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc26de4-ac60-4544-bed8-b80c2885822c service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:39.244828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05fbce-ff3a-4280-844e-fe5cc90a4192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:39.245491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05fbce-ff3a-4280-844e-fe5cc90a4192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:39.245763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05fbce-ff3a-4280-844e-fe5cc90a4192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:39.246278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05fbce-ff3a-4280-844e-fe5cc90a4192 admin admin] PATH_INFO: `/v3/users/b4d34308938a4d47abc305ba7865c246` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:39.247550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05fbce-ff3a-4280-844e-fe5cc90a4192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4d34308938a4d47abc305ba7865c246)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:39.249496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05fbce-ff3a-4280-844e-fe5cc90a4192 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:39.294843 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ec05fbce-ff3a-4280-844e-fe5cc90a4192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4d34308938a4d47abc305ba7865c246'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:39.301643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ec05fbce-ff3a-4280-844e-fe5cc90a4192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4d34308938a4d47abc305ba7865c246'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:39.314117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ec05fbce-ff3a-4280-844e-fe5cc90a4192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4d34308938a4d47abc305ba7865c246'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:39.314783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ec05fbce-ff3a-4280-844e-fe5cc90a4192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4d34308938a4d47abc305ba7865c246'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:39.322462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-ec05fbce-ff3a-4280-844e-fe5cc90a4192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4d34308938a4d47abc305ba7865c246'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:39.329064 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4366/8821] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 02:03:39 2022] DELETE /identity/v3/users/b4d34308938a4d47abc305ba7865c246 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:03:39.608035 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a41eb9-5cfe-485a-b274-efdee0eb06d3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:39.609543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-c0a41eb9-5cfe-485a-b274-efdee0eb06d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:39.623030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a41eb9-5cfe-485a-b274-efdee0eb06d3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:39.635520 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:39.681952 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2cd8e7-21d8-4587-8861-0f21c752c693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:39.682503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2cd8e7-21d8-4587-8861-0f21c752c693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:39.683283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2cd8e7-21d8-4587-8861-0f21c752c693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:39.683552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2cd8e7-21d8-4587-8861-0f21c752c693 admin admin] PATH_INFO: `/v3/projects/1e01ff8fff8c4201a8611847af0cb1d7` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:39.684708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2cd8e7-21d8-4587-8861-0f21c752c693 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e01ff8fff8c4201a8611847af0cb1d7)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:39.686606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2cd8e7-21d8-4587-8861-0f21c752c693 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:39.732203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6b2cd8e7-21d8-4587-8861-0f21c752c693 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e01ff8fff8c4201a8611847af0cb1d7', 'request_id': 'req-6b2cd8e7-21d8-4587-8861-0f21c752c693'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:39.737712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6b2cd8e7-21d8-4587-8861-0f21c752c693 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e01ff8fff8c4201a8611847af0cb1d7', 'request_id': 'req-6b2cd8e7-21d8-4587-8861-0f21c752c693'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:39.744051 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6b2cd8e7-21d8-4587-8861-0f21c752c693 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e01ff8fff8c4201a8611847af0cb1d7', 'request_id': 'req-6b2cd8e7-21d8-4587-8861-0f21c752c693'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:39.756277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6b2cd8e7-21d8-4587-8861-0f21c752c693 admin admin] The token cache is being invalidate because project 1e01ff8fff8c4201a8611847af0cb1d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 02:03:39.756564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6b2cd8e7-21d8-4587-8861-0f21c752c693 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:39.757186 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6b2cd8e7-21d8-4587-8861-0f21c752c693 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:03:39.758680 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4456/8822] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 02:03:39 2022] DELETE /identity/v3/projects/1e01ff8fff8c4201a8611847af0cb1d7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:03:39.765499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c4a4d-ac8f-4dd2-b84b-f207e0a0f1e0 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:39.765985 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c4a4d-ac8f-4dd2-b84b-f207e0a0f1e0 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:39.766072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c4a4d-ac8f-4dd2-b84b-f207e0a0f1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:39.786876 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-981c4a4d-ac8f-4dd2-b84b-f207e0a0f1e0 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:03:39.788143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-981c4a4d-ac8f-4dd2-b84b-f207e0a0f1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:39.851870 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4367/8823] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:03:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:03:39.860878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e7d92-e064-4bea-b6a4-3526c0674cfb None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:39.861164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e7d92-e064-4bea-b6a4-3526c0674cfb None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:39.861440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e7d92-e064-4bea-b6a4-3526c0674cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:39.881347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e87e7d92-e064-4bea-b6a4-3526c0674cfb None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:03:39.882543 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e87e7d92-e064-4bea-b6a4-3526c0674cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:39.891130 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4457/8824] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:03:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:03:39.895268 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c4a4d-ac8f-4dd2-b84b-f207e0a0f1e0 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:39.904941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c4a4d-ac8f-4dd2-b84b-f207e0a0f1e0 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:39.909492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00adaebd-6d3c-4a49-acd4-cb0b30ef4a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:39.910080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adaebd-6d3c-4a49-acd4-cb0b30ef4a12 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:39.910358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adaebd-6d3c-4a49-acd4-cb0b30ef4a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:39.910627 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adaebd-6d3c-4a49-acd4-cb0b30ef4a12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:39.911271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00adaebd-6d3c-4a49-acd4-cb0b30ef4a12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 02:03:39.911569 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00adaebd-6d3c-4a49-acd4-cb0b30ef4a12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:39.913223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00adaebd-6d3c-4a49-acd4-cb0b30ef4a12 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:39.924556 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4368/8825] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 02:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 02:03:39.928614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e7d92-e064-4bea-b6a4-3526c0674cfb None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:39.938510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e7d92-e064-4bea-b6a4-3526c0674cfb None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:39.943120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fe301-f605-4bf8-9041-8968c5b00671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:39.943714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fe301-f605-4bf8-9041-8968c5b00671 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:39.944035 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fe301-f605-4bf8-9041-8968c5b00671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:39.944315 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fe301-f605-4bf8-9041-8968c5b00671 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:39.944951 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fe301-f605-4bf8-9041-8968c5b00671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:39.946829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fe301-f605-4bf8-9041-8968c5b00671 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:39.974137 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4458/8826] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 02:03:39 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 02:03:39.978458 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00adaebd-6d3c-4a49-acd4-cb0b30ef4a12 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:39.988827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00adaebd-6d3c-4a49-acd4-cb0b30ef4a12 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:39.992391 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:40.047811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f0e35-6e5d-4488-a4da-86cbb91dca85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:40.048439 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f0e35-6e5d-4488-a4da-86cbb91dca85 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:40.048742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f0e35-6e5d-4488-a4da-86cbb91dca85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:40.049011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f0e35-6e5d-4488-a4da-86cbb91dca85 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:40.049680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f0e35-6e5d-4488-a4da-86cbb91dca85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:40.051610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f0e35-6e5d-4488-a4da-86cbb91dca85 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:40.073003 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4369/8827] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 02:03:39 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 02:03:40.077355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fe301-f605-4bf8-9041-8968c5b00671 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:40.087670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fe301-f605-4bf8-9041-8968c5b00671 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:40.093330 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3650a-4e83-4d7c-b683-333a29e33c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:40.094059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3650a-4e83-4d7c-b683-333a29e33c63 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:40.094344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3650a-4e83-4d7c-b683-333a29e33c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:40.094675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3650a-4e83-4d7c-b683-333a29e33c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:40.095334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3650a-4e83-4d7c-b683-333a29e33c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:40.097181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3650a-4e83-4d7c-b683-333a29e33c63 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:40.111785 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4459/8828] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 02:03:40.116016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f0e35-6e5d-4488-a4da-86cbb91dca85 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:40.127690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f0e35-6e5d-4488-a4da-86cbb91dca85 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:40.134725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad21ff-2971-40c8-9fe7-ee1e8a81063f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:40.135576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad21ff-2971-40c8-9fe7-ee1e8a81063f admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:40.135966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad21ff-2971-40c8-9fe7-ee1e8a81063f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:40.136254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad21ff-2971-40c8-9fe7-ee1e8a81063f admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:40.136912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad21ff-2971-40c8-9fe7-ee1e8a81063f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:40.138552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad21ff-2971-40c8-9fe7-ee1e8a81063f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:40.152882 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4370/8829] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 02:03:40.157274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3650a-4e83-4d7c-b683-333a29e33c63 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:40.167754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3650a-4e83-4d7c-b683-333a29e33c63 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:40.172402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adce17a-b4d2-4030-b1bf-ada081d82962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:40.173044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adce17a-b4d2-4030-b1bf-ada081d82962 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:40.173324 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adce17a-b4d2-4030-b1bf-ada081d82962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:40.173598 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adce17a-b4d2-4030-b1bf-ada081d82962 admin admin] PATH_INFO: `/v3/projects/b0ca203fa389466e842ed965f1140524/users/19fc9bbd5d8045e5b558de2386d73d93/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:40.189569 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adce17a-b4d2-4030-b1bf-ada081d82962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0ca203fa389466e842ed965f1140524, user_id=19fc9bbd5d8045e5b558de2386d73d93, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:40.192197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adce17a-b4d2-4030-b1bf-ada081d82962 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:40.205221 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4460/8830] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 02:03:40 2022] PUT /identity/v3/projects/b0ca203fa389466e842ed965f1140524/users/19fc9bbd5d8045e5b558de2386d73d93/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 02:03:40.210219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7e29a-c9df-4bf2-89be-5cf36e9d2775 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:40.210504 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7e29a-c9df-4bf2-89be-5cf36e9d2775 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:40.210805 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7e29a-c9df-4bf2-89be-5cf36e9d2775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:40.230073 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d1a7e29a-c9df-4bf2-89be-5cf36e9d2775 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:03:40.231259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d1a7e29a-c9df-4bf2-89be-5cf36e9d2775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:40.288447 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4371/8831] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:03:40.298493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adce17a-b4d2-4030-b1bf-ada081d82962 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:40.300191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6adce17a-b4d2-4030-b1bf-ada081d82962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:40.346148 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:40.358642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adce17a-b4d2-4030-b1bf-ada081d82962 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:40.362381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00b0cc-9b7a-477b-9cae-be587616720a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:40.362976 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00b0cc-9b7a-477b-9cae-be587616720a service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:40.363249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00b0cc-9b7a-477b-9cae-be587616720a service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:40.363515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00b0cc-9b7a-477b-9cae-be587616720a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:40.374027 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d00b0cc-9b7a-477b-9cae-be587616720a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:40.375443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d00b0cc-9b7a-477b-9cae-be587616720a service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:40.384655 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4461/8832] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:03:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:03:44.465987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09867f71-dbad-4166-b668-6536164ccd66 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:44.466514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09867f71-dbad-4166-b668-6536164ccd66 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:44.466514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09867f71-dbad-4166-b668-6536164ccd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:44.503787 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-09867f71-dbad-4166-b668-6536164ccd66 None None] MFA Rules not processed for user `19fc9bbd5d8045e5b558de2386d73d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:03:44.505503 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-09867f71-dbad-4166-b668-6536164ccd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:44.587674 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4372/8833] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:03:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:03:44.600576 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c67449-5bad-4d4d-a978-8f28be9df86a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:44.601127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c67449-5bad-4d4d-a978-8f28be9df86a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:44.601127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c67449-5bad-4d4d-a978-8f28be9df86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:44.621890 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a1c67449-5bad-4d4d-a978-8f28be9df86a None None] MFA Rules not processed for user `19fc9bbd5d8045e5b558de2386d73d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:03:44.623118 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a1c67449-5bad-4d4d-a978-8f28be9df86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:44.630278 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4462/8834] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:03:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:03:44.647194 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09867f71-dbad-4166-b668-6536164ccd66 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:44.649086 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-09867f71-dbad-4166-b668-6536164ccd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:44.670983 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:44.738298 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09867f71-dbad-4166-b668-6536164ccd66 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:44.744184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f11fc-2d6c-40a1-baa8-244a31278442 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:44.745511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f11fc-2d6c-40a1-baa8-244a31278442 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:44.745864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f11fc-2d6c-40a1-baa8-244a31278442 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:44.746198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f11fc-2d6c-40a1-baa8-244a31278442 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:44.755260 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f11fc-2d6c-40a1-baa8-244a31278442 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:44.757054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f11fc-2d6c-40a1-baa8-244a31278442 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:44.768211 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4373/8835] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:03:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:03:45.362370 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c67449-5bad-4d4d-a978-8f28be9df86a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:45.363937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a1c67449-5bad-4d4d-a978-8f28be9df86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:45.443490 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c67449-5bad-4d4d-a978-8f28be9df86a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:45.448975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc26a6-d1e5-4edd-acdd-c7cb4a253104 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:45.449610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc26a6-d1e5-4edd-acdd-c7cb4a253104 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:45.449912 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc26a6-d1e5-4edd-acdd-c7cb4a253104 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:45.450179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc26a6-d1e5-4edd-acdd-c7cb4a253104 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:45.451921 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d7dc26a6-d1e5-4edd-acdd-c7cb4a253104 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:45.463219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc26a6-d1e5-4edd-acdd-c7cb4a253104 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:45.465494 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc26a6-d1e5-4edd-acdd-c7cb4a253104 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:45.475170 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4463/8836] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:03:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:03:54.763745 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=27 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:55.470995 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=41 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:03:56.214146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f11fc-2d6c-40a1-baa8-244a31278442 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:56.215579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1e4f11fc-2d6c-40a1-baa8-244a31278442 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:56.230080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f11fc-2d6c-40a1-baa8-244a31278442 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:56.234540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a94b2f-2d0d-4185-8ddd-b85ef7aee9cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:56.235222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a94b2f-2d0d-4185-8ddd-b85ef7aee9cd service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:56.235626 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a94b2f-2d0d-4185-8ddd-b85ef7aee9cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:56.236036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a94b2f-2d0d-4185-8ddd-b85ef7aee9cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:56.237913 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a2a94b2f-2d0d-4185-8ddd-b85ef7aee9cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:56.251584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a94b2f-2d0d-4185-8ddd-b85ef7aee9cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:56.253082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a94b2f-2d0d-4185-8ddd-b85ef7aee9cd service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:56.264507 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4374/8837] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:03:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:03:56.364144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567553d4-8333-4f70-89e0-1e4448a87d30 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:56.364431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567553d4-8333-4f70-89e0-1e4448a87d30 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:56.364709 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567553d4-8333-4f70-89e0-1e4448a87d30 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:56.366077 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4464/8838] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 02:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 02:03:56.371159 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b2159-9e17-4a98-abac-a06016ee2a43 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:56.371471 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b2159-9e17-4a98-abac-a06016ee2a43 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:56.371747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b2159-9e17-4a98-abac-a06016ee2a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:56.393310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-813b2159-9e17-4a98-abac-a06016ee2a43 None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:03:56.394554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-813b2159-9e17-4a98-abac-a06016ee2a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:56.403752 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4375/8839] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 02:03:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:03:56.424739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567553d4-8333-4f70-89e0-1e4448a87d30 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:56.426513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-567553d4-8333-4f70-89e0-1e4448a87d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:56.445783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567553d4-8333-4f70-89e0-1e4448a87d30 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:56.450706 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc242765-8352-41ea-bf14-a92b9fd2a027 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:56.451293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc242765-8352-41ea-bf14-a92b9fd2a027 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:56.451566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc242765-8352-41ea-bf14-a92b9fd2a027 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:56.451833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc242765-8352-41ea-bf14-a92b9fd2a027 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:56.459935 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc242765-8352-41ea-bf14-a92b9fd2a027 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:56.461488 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc242765-8352-41ea-bf14-a92b9fd2a027 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:56.471433 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4465/8840] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:03:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:03:56.641481 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b2159-9e17-4a98-abac-a06016ee2a43 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:03:56.650889 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b2159-9e17-4a98-abac-a06016ee2a43 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:03:56.654704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b7332-5c08-45fe-8641-4bd2fe1922ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:03:56.655289 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b7332-5c08-45fe-8641-4bd2fe1922ef service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:03:56.655561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b7332-5c08-45fe-8641-4bd2fe1922ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:03:56.655825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b7332-5c08-45fe-8641-4bd2fe1922ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:03:56.657601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c28b7332-5c08-45fe-8641-4bd2fe1922ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:03:56.673870 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b7332-5c08-45fe-8641-4bd2fe1922ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:03:56.675279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b7332-5c08-45fe-8641-4bd2fe1922ef service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:03:56.688624 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4376/8841] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:03:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:04:01.500557 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc242765-8352-41ea-bf14-a92b9fd2a027 service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:04:01.530226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc242765-8352-41ea-bf14-a92b9fd2a027 service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:04:01.535409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db57d7-a9b0-45df-897c-034781684b64 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:04:01.536038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db57d7-a9b0-45df-897c-034781684b64 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:04:01.536321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db57d7-a9b0-45df-897c-034781684b64 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:04:01.536590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db57d7-a9b0-45df-897c-034781684b64 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:04:01.538316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-02db57d7-a9b0-45df-897c-034781684b64 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:04:01.562912 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db57d7-a9b0-45df-897c-034781684b64 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:04:01.564506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db57d7-a9b0-45df-897c-034781684b64 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:04:01.576961 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4466/8842] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:04:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:04:06.681562 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=15 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:04:11.570171 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=24 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:04:16.375582 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b7332-5c08-45fe-8641-4bd2fe1922ef service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:04:16.421017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b7332-5c08-45fe-8641-4bd2fe1922ef service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:04:16.426299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38585e21-6e93-435c-88fc-4dbb43743cbd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:04:16.426931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38585e21-6e93-435c-88fc-4dbb43743cbd service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:04:16.427209 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38585e21-6e93-435c-88fc-4dbb43743cbd service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:04:16.427480 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38585e21-6e93-435c-88fc-4dbb43743cbd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:04:16.429287 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-38585e21-6e93-435c-88fc-4dbb43743cbd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:04:16.453862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38585e21-6e93-435c-88fc-4dbb43743cbd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:04:16.455455 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38585e21-6e93-435c-88fc-4dbb43743cbd service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:04:16.467828 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4377/8843] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:04:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:04:25.141783 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db57d7-a9b0-45df-897c-034781684b64 service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:04:25.158867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db57d7-a9b0-45df-897c-034781684b64 service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:04:25.162460 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abb921-6d6e-4fd6-b73f-7bdfb11c282d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:04:25.163059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abb921-6d6e-4fd6-b73f-7bdfb11c282d service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:04:25.163342 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abb921-6d6e-4fd6-b73f-7bdfb11c282d service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:04:25.163616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abb921-6d6e-4fd6-b73f-7bdfb11c282d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:04:25.165353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-47abb921-6d6e-4fd6-b73f-7bdfb11c282d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:04:25.189910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47abb921-6d6e-4fd6-b73f-7bdfb11c282d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:04:25.191342 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47abb921-6d6e-4fd6-b73f-7bdfb11c282d service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:04:25.202581 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4467/8844] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:04:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:04:26.461191 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=24 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:04:35.195905 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=14 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:04:35.633049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38585e21-6e93-435c-88fc-4dbb43743cbd service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:04:35.644430 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38585e21-6e93-435c-88fc-4dbb43743cbd service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:04:35.649211 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa591b3-d78c-47cb-9cd1-cfecd01a584e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:04:35.649881 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa591b3-d78c-47cb-9cd1-cfecd01a584e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:04:35.650161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa591b3-d78c-47cb-9cd1-cfecd01a584e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:04:35.650598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa591b3-d78c-47cb-9cd1-cfecd01a584e admin admin] PATH_INFO: `/v3/users/19fc9bbd5d8045e5b558de2386d73d93` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:04:35.651800 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa591b3-d78c-47cb-9cd1-cfecd01a584e admin admin] RBAC: Authorizing `identity:delete_user(user_id=19fc9bbd5d8045e5b558de2386d73d93)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:04:35.654403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa591b3-d78c-47cb-9cd1-cfecd01a584e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:04:35.704733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aaa591b3-d78c-47cb-9cd1-cfecd01a584e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19fc9bbd5d8045e5b558de2386d73d93'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:04:35.711874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aaa591b3-d78c-47cb-9cd1-cfecd01a584e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19fc9bbd5d8045e5b558de2386d73d93'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:04:35.724917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aaa591b3-d78c-47cb-9cd1-cfecd01a584e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19fc9bbd5d8045e5b558de2386d73d93'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:04:35.725648 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aaa591b3-d78c-47cb-9cd1-cfecd01a584e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19fc9bbd5d8045e5b558de2386d73d93'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:04:35.737053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-aaa591b3-d78c-47cb-9cd1-cfecd01a584e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19fc9bbd5d8045e5b558de2386d73d93'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:04:35.743601 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4378/8845] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 02:04:35 2022] DELETE /identity/v3/users/19fc9bbd5d8045e5b558de2386d73d93 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:04:35.919540 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abb921-6d6e-4fd6-b73f-7bdfb11c282d service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:04:35.931181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abb921-6d6e-4fd6-b73f-7bdfb11c282d service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:04:35.999654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c61275-3666-4829-9a37-ff2e7f15eb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:04:36.000337 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c61275-3666-4829-9a37-ff2e7f15eb18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:04:36.000615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c61275-3666-4829-9a37-ff2e7f15eb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:04:36.000886 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c61275-3666-4829-9a37-ff2e7f15eb18 admin admin] PATH_INFO: `/v3/projects/b0ca203fa389466e842ed965f1140524` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:04:36.002016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c61275-3666-4829-9a37-ff2e7f15eb18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0ca203fa389466e842ed965f1140524)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:04:36.003966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c61275-3666-4829-9a37-ff2e7f15eb18 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:04:36.049509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d5c61275-3666-4829-9a37-ff2e7f15eb18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0ca203fa389466e842ed965f1140524', 'request_id': 'req-d5c61275-3666-4829-9a37-ff2e7f15eb18'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:04:36.055269 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d5c61275-3666-4829-9a37-ff2e7f15eb18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0ca203fa389466e842ed965f1140524', 'request_id': 'req-d5c61275-3666-4829-9a37-ff2e7f15eb18'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:04:36.062038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d5c61275-3666-4829-9a37-ff2e7f15eb18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0ca203fa389466e842ed965f1140524', 'request_id': 'req-d5c61275-3666-4829-9a37-ff2e7f15eb18'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:04:36.086572 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d5c61275-3666-4829-9a37-ff2e7f15eb18 admin admin] The token cache is being invalidate because project b0ca203fa389466e842ed965f1140524 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 02:04:36.086855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d5c61275-3666-4829-9a37-ff2e7f15eb18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:04:36.087474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-d5c61275-3666-4829-9a37-ff2e7f15eb18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:04:36.088968 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4468/8846] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 02:04:35 2022] DELETE /identity/v3/projects/b0ca203fa389466e842ed965f1140524 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:04:36.094112 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248af786-2b2a-47ed-926f-4df240fff39a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:04:36.094403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248af786-2b2a-47ed-926f-4df240fff39a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:04:36.094736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248af786-2b2a-47ed-926f-4df240fff39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:04:36.153920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-248af786-2b2a-47ed-926f-4df240fff39a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:04:36.155121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-248af786-2b2a-47ed-926f-4df240fff39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:04:36.212994 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4379/8847] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:04:36.220739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71676f-7f2d-4687-9f4e-18a14d7ab920 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:04:36.221203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71676f-7f2d-4687-9f4e-18a14d7ab920 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:04:36.221301 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71676f-7f2d-4687-9f4e-18a14d7ab920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:04:36.241027 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9e71676f-7f2d-4687-9f4e-18a14d7ab920 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:04:36.242208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9e71676f-7f2d-4687-9f4e-18a14d7ab920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:04:36.250723 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4469/8848] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:04:36.254761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248af786-2b2a-47ed-926f-4df240fff39a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:04:36.264547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248af786-2b2a-47ed-926f-4df240fff39a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:04:36.269117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e091e35-04aa-41e2-ad00-6ca8eedbdc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:04:36.269705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e091e35-04aa-41e2-ad00-6ca8eedbdc18 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:04:36.269984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e091e35-04aa-41e2-ad00-6ca8eedbdc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:04:36.270255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e091e35-04aa-41e2-ad00-6ca8eedbdc18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:04:36.270899 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e091e35-04aa-41e2-ad00-6ca8eedbdc18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 02:04:36.271202 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e091e35-04aa-41e2-ad00-6ca8eedbdc18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:04:36.272828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e091e35-04aa-41e2-ad00-6ca8eedbdc18 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:04:36.284595 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4380/8849] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 02:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 02:04:36.288534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71676f-7f2d-4687-9f4e-18a14d7ab920 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:04:36.298257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71676f-7f2d-4687-9f4e-18a14d7ab920 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:04:36.302895 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a162b81-e38d-4952-b558-b349b002d6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:04:36.303421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a162b81-e38d-4952-b558-b349b002d6a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:04:36.303701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a162b81-e38d-4952-b558-b349b002d6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:04:36.304002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a162b81-e38d-4952-b558-b349b002d6a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:04:36.304624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a162b81-e38d-4952-b558-b349b002d6a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:04:36.306515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a162b81-e38d-4952-b558-b349b002d6a0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:04:36.342403 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4470/8850] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 02:04:36 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 02:04:36.346494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e091e35-04aa-41e2-ad00-6ca8eedbdc18 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:04:36.357557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e091e35-04aa-41e2-ad00-6ca8eedbdc18 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:04:36.385182 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:04:36.419667 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ae238-1337-4fc9-86da-12c78d0cc74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:04:36.420300 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ae238-1337-4fc9-86da-12c78d0cc74b admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:04:36.420583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ae238-1337-4fc9-86da-12c78d0cc74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:04:36.420860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ae238-1337-4fc9-86da-12c78d0cc74b admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:04:36.421490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ae238-1337-4fc9-86da-12c78d0cc74b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:04:36.423415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8ae238-1337-4fc9-86da-12c78d0cc74b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:04:36.450102 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4381/8851] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 02:04:36 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 02:04:36.451504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a162b81-e38d-4952-b558-b349b002d6a0 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:04:36.462305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a162b81-e38d-4952-b558-b349b002d6a0 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:04:36.468447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15f0e9-517e-427a-a9cd-c9a9f14494c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:04:36.469060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15f0e9-517e-427a-a9cd-c9a9f14494c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:04:36.469394 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15f0e9-517e-427a-a9cd-c9a9f14494c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:04:36.469606 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15f0e9-517e-427a-a9cd-c9a9f14494c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:04:36.471019 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15f0e9-517e-427a-a9cd-c9a9f14494c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:04:36.471835 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e15f0e9-517e-427a-a9cd-c9a9f14494c8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:04:36.485832 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4471/8852] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 02:04:36.487080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ae238-1337-4fc9-86da-12c78d0cc74b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:04:36.498832 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ae238-1337-4fc9-86da-12c78d0cc74b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:04:36.503823 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05287b05-c404-47b6-a905-6d65e717474e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:04:36.504575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05287b05-c404-47b6-a905-6d65e717474e admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:04:36.504850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05287b05-c404-47b6-a905-6d65e717474e admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:04:36.505119 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05287b05-c404-47b6-a905-6d65e717474e admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:04:36.505763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05287b05-c404-47b6-a905-6d65e717474e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:04:36.507379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05287b05-c404-47b6-a905-6d65e717474e admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:04:36.518295 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4382/8853] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 02:04:36.522580 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15f0e9-517e-427a-a9cd-c9a9f14494c8 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:04:36.533318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15f0e9-517e-427a-a9cd-c9a9f14494c8 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:04:36.537927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5df1c2-c6c8-4cf8-9ab0-f9b4ab270dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:04:36.538575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5df1c2-c6c8-4cf8-9ab0-f9b4ab270dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:04:36.538855 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5df1c2-c6c8-4cf8-9ab0-f9b4ab270dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:04:36.539137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5df1c2-c6c8-4cf8-9ab0-f9b4ab270dd3 admin admin] PATH_INFO: `/v3/projects/b5313574dcf84819b58af883ac6cb768/users/bbf878e8b08d4c85bb3fb925db315ac4/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:04:36.554077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5df1c2-c6c8-4cf8-9ab0-f9b4ab270dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5313574dcf84819b58af883ac6cb768, user_id=bbf878e8b08d4c85bb3fb925db315ac4, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:04:36.557007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5df1c2-c6c8-4cf8-9ab0-f9b4ab270dd3 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:04:36.566035 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:04:36.572094 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4472/8854] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 02:04:36 2022] PUT /identity/v3/projects/b5313574dcf84819b58af883ac6cb768/users/bbf878e8b08d4c85bb3fb925db315ac4/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:04:36.577710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aee189-b13f-4b80-b552-77fcef604a2a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:04:36.577993 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aee189-b13f-4b80-b552-77fcef604a2a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:04:36.578263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aee189-b13f-4b80-b552-77fcef604a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:04:36.597599 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-37aee189-b13f-4b80-b552-77fcef604a2a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:04:36.598793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-37aee189-b13f-4b80-b552-77fcef604a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:04:36.656864 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4383/8855] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:04:36.666683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5df1c2-c6c8-4cf8-9ab0-f9b4ab270dd3 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:04:36.668455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-bb5df1c2-c6c8-4cf8-9ab0-f9b4ab270dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:04:36.727907 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5df1c2-c6c8-4cf8-9ab0-f9b4ab270dd3 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:04:36.732497 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158a1f9-7b75-4d91-bc0e-dca119182542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:04:36.733102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158a1f9-7b75-4d91-bc0e-dca119182542 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:04:36.733400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158a1f9-7b75-4d91-bc0e-dca119182542 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:04:36.733668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158a1f9-7b75-4d91-bc0e-dca119182542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:04:36.742474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7158a1f9-7b75-4d91-bc0e-dca119182542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:04:36.743908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7158a1f9-7b75-4d91-bc0e-dca119182542 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:04:36.753210 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4473/8856] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:04:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:04:40.735124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64afaf-8c1c-45b8-a24e-2e2f54d27026 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:04:40.735632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64afaf-8c1c-45b8-a24e-2e2f54d27026 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:04:40.735841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64afaf-8c1c-45b8-a24e-2e2f54d27026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:04:40.765749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-cb64afaf-8c1c-45b8-a24e-2e2f54d27026 None None] MFA Rules not processed for user `bbf878e8b08d4c85bb3fb925db315ac4`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:04:40.766968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cb64afaf-8c1c-45b8-a24e-2e2f54d27026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:04:40.840471 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4384/8857] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:04:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:04:40.850720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd171cf6-3373-4a5c-bc55-dfb464ea5c86 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:04:40.851190 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd171cf6-3373-4a5c-bc55-dfb464ea5c86 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:04:40.851293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd171cf6-3373-4a5c-bc55-dfb464ea5c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:04:40.876615 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-bd171cf6-3373-4a5c-bc55-dfb464ea5c86 None None] MFA Rules not processed for user `bbf878e8b08d4c85bb3fb925db315ac4`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:04:40.877983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-bd171cf6-3373-4a5c-bc55-dfb464ea5c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:04:40.885364 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4474/8858] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:04:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:04:40.897234 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64afaf-8c1c-45b8-a24e-2e2f54d27026 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:04:40.898694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cb64afaf-8c1c-45b8-a24e-2e2f54d27026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:04:40.947708 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:04:41.003704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64afaf-8c1c-45b8-a24e-2e2f54d27026 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:04:41.018435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f6d8d-0b6a-4e14-b6ed-f0afdde50cd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:04:41.019146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f6d8d-0b6a-4e14-b6ed-f0afdde50cd0 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:04:41.019525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f6d8d-0b6a-4e14-b6ed-f0afdde50cd0 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:04:41.019975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f6d8d-0b6a-4e14-b6ed-f0afdde50cd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:04:41.035637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f6d8d-0b6a-4e14-b6ed-f0afdde50cd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:04:41.037598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f6d8d-0b6a-4e14-b6ed-f0afdde50cd0 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:04:41.047321 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4385/8859] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:04:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:04:49.221658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd171cf6-3373-4a5c-bc55-dfb464ea5c86 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:04:49.223205 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-bd171cf6-3373-4a5c-bc55-dfb464ea5c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:04:49.243067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd171cf6-3373-4a5c-bc55-dfb464ea5c86 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:04:49.248595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8522e3-f5be-4935-95b5-37c2ec0a53d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:04:49.249201 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8522e3-f5be-4935-95b5-37c2ec0a53d1 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:04:49.249480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8522e3-f5be-4935-95b5-37c2ec0a53d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:04:49.249750 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8522e3-f5be-4935-95b5-37c2ec0a53d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:04:49.251486 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ae8522e3-f5be-4935-95b5-37c2ec0a53d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:04:49.266256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8522e3-f5be-4935-95b5-37c2ec0a53d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:04:49.267833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8522e3-f5be-4935-95b5-37c2ec0a53d1 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:04:49.281671 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4475/8860] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:04:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:04:51.043464 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=17 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:04:52.009597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c571e-4e6e-47cd-aada-35dc4870fc61 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:04:52.009885 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c571e-4e6e-47cd-aada-35dc4870fc61 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:04:52.010163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c571e-4e6e-47cd-aada-35dc4870fc61 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:04:52.011557 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4386/8861] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 02:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 02:04:52.017420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225da1c4-4501-4a02-92c8-ef844f48b12e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:04:52.017937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225da1c4-4501-4a02-92c8-ef844f48b12e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:04:52.018044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225da1c4-4501-4a02-92c8-ef844f48b12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:04:52.044203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-225da1c4-4501-4a02-92c8-ef844f48b12e None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:04:52.045992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-225da1c4-4501-4a02-92c8-ef844f48b12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:04:52.112021 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4476/8862] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 02:04:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:04:52.132851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c571e-4e6e-47cd-aada-35dc4870fc61 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:04:52.134542 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-934c571e-4e6e-47cd-aada-35dc4870fc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:04:52.153448 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c571e-4e6e-47cd-aada-35dc4870fc61 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:04:52.158503 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6cc1a-fc23-4f76-a6aa-733a26e0a6e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:04:52.159089 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6cc1a-fc23-4f76-a6aa-733a26e0a6e0 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:04:52.159364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6cc1a-fc23-4f76-a6aa-733a26e0a6e0 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:04:52.159634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6cc1a-fc23-4f76-a6aa-733a26e0a6e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:04:52.168385 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6cc1a-fc23-4f76-a6aa-733a26e0a6e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:04:52.170011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d6cc1a-fc23-4f76-a6aa-733a26e0a6e0 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:04:52.179871 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4387/8863] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:04:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:05:02.102861 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=65 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:05:02.175654 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:05:18.354102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a987d-fd53-425b-81b7-a58f8c2aa5ae None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:05:18.354939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a987d-fd53-425b-81b7-a58f8c2aa5ae None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:05:18.354939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a987d-fd53-425b-81b7-a58f8c2aa5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:05:18.393345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d30a987d-fd53-425b-81b7-a58f8c2aa5ae None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:05:18.394558 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d30a987d-fd53-425b-81b7-a58f8c2aa5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:05:18.403928 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4477/8864] 10.222.0.50 () {58 vars in 1015 bytes} [Sun Aug 7 02:05:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:05:18.416808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6cc1a-fc23-4f76-a6aa-733a26e0a6e0 service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:05:18.418189 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a4d6cc1a-fc23-4f76-a6aa-733a26e0a6e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:05:18.434912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6cc1a-fc23-4f76-a6aa-733a26e0a6e0 service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:05:18.440066 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a991091b-9975-402a-a392-539aec7574e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:05:18.440694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991091b-9975-402a-a392-539aec7574e3 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:05:18.440970 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991091b-9975-402a-a392-539aec7574e3 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:05:18.441241 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a991091b-9975-402a-a392-539aec7574e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:05:18.450315 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991091b-9975-402a-a392-539aec7574e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:05:18.451916 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a991091b-9975-402a-a392-539aec7574e3 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:05:18.461552 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4388/8865] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:05:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:05:26.297127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677789fa-ee82-498a-b716-8de1a08c64e2 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:05:26.297676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677789fa-ee82-498a-b716-8de1a08c64e2 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:05:26.297676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677789fa-ee82-498a-b716-8de1a08c64e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:05:26.316942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-677789fa-ee82-498a-b716-8de1a08c64e2 None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:05:26.318120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-677789fa-ee82-498a-b716-8de1a08c64e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:05:26.329514 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4478/8866] 10.222.0.25 () {58 vars in 1015 bytes} [Sun Aug 7 02:05:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:05:26.340309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96200e0a-06b9-4ba7-9174-293e3b3aaced None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:05:26.340753 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96200e0a-06b9-4ba7-9174-293e3b3aaced None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:05:26.340919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96200e0a-06b9-4ba7-9174-293e3b3aaced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:05:26.361775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-96200e0a-06b9-4ba7-9174-293e3b3aaced None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:05:26.362901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-96200e0a-06b9-4ba7-9174-293e3b3aaced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:05:26.372774 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4389/8867] 10.222.0.39 () {58 vars in 1058 bytes} [Sun Aug 7 02:05:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:05:26.379089 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677789fa-ee82-498a-b716-8de1a08c64e2 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:05:26.391013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677789fa-ee82-498a-b716-8de1a08c64e2 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:05:26.396437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4d562-f5b7-46be-937b-f3046361ecef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:05:26.397052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4d562-f5b7-46be-937b-f3046361ecef service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:05:26.397329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4d562-f5b7-46be-937b-f3046361ecef service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:05:26.397595 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4d562-f5b7-46be-937b-f3046361ecef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:05:26.407050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4d562-f5b7-46be-937b-f3046361ecef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:05:26.408707 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4d562-f5b7-46be-937b-f3046361ecef service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:05:26.418802 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4479/8868] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:05:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:05:28.216369 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100524e-02dc-48d5-bea1-4782eec90d28 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:05:28.216889 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100524e-02dc-48d5-bea1-4782eec90d28 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:05:28.216889 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100524e-02dc-48d5-bea1-4782eec90d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:05:28.236651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9100524e-02dc-48d5-bea1-4782eec90d28 None None] MFA Rules not processed for user `bbf878e8b08d4c85bb3fb925db315ac4`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:05:28.237852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9100524e-02dc-48d5-bea1-4782eec90d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:05:28.244728 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4390/8869] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:05:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:05:36.415008 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=18 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:05:38.231353 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=12 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:05:38.661602 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffeb57-5e3e-47f6-bbfd-49cc676fbd82 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:05:38.662131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffeb57-5e3e-47f6-bbfd-49cc676fbd82 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:05:38.662131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffeb57-5e3e-47f6-bbfd-49cc676fbd82 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:05:38.663676 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4480/8870] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 02:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 02:05:38.669491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f03660-e8dc-4d28-b396-2c854fd89089 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:05:38.669782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f03660-e8dc-4d28-b396-2c854fd89089 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:05:38.670053 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f03660-e8dc-4d28-b396-2c854fd89089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:05:38.690725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-e6f03660-e8dc-4d28-b396-2c854fd89089 None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:05:38.691964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e6f03660-e8dc-4d28-b396-2c854fd89089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:05:38.700561 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4391/8871] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 02:05:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:05:38.721443 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffeb57-5e3e-47f6-bbfd-49cc676fbd82 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:05:38.735696 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffeb57-5e3e-47f6-bbfd-49cc676fbd82 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:05:38.740694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d76e9b-b082-4bab-bc32-64d839f9045a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:05:38.741285 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d76e9b-b082-4bab-bc32-64d839f9045a service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:05:38.741564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d76e9b-b082-4bab-bc32-64d839f9045a service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:05:38.741836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d76e9b-b082-4bab-bc32-64d839f9045a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:05:38.749938 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d76e9b-b082-4bab-bc32-64d839f9045a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:05:38.751536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d76e9b-b082-4bab-bc32-64d839f9045a service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:05:38.761071 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4481/8872] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:05:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:05:48.684233 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:05:48.757067 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:06:19.946708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f03660-e8dc-4d28-b396-2c854fd89089 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:06:19.978762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f03660-e8dc-4d28-b396-2c854fd89089 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:06:19.986672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a7bf5-c8b8-4e66-b561-73def60a309b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:06:19.986672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a7bf5-c8b8-4e66-b561-73def60a309b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:06:19.986672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a7bf5-c8b8-4e66-b561-73def60a309b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:06:19.986672 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a7bf5-c8b8-4e66-b561-73def60a309b admin admin] PATH_INFO: `/v3/users/bbf878e8b08d4c85bb3fb925db315ac4` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:06:19.987026 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a7bf5-c8b8-4e66-b561-73def60a309b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbf878e8b08d4c85bb3fb925db315ac4)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:06:19.988726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a7bf5-c8b8-4e66-b561-73def60a309b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:06:20.037188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-054a7bf5-c8b8-4e66-b561-73def60a309b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbf878e8b08d4c85bb3fb925db315ac4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:06:20.044527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-054a7bf5-c8b8-4e66-b561-73def60a309b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbf878e8b08d4c85bb3fb925db315ac4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:06:20.056168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-054a7bf5-c8b8-4e66-b561-73def60a309b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbf878e8b08d4c85bb3fb925db315ac4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:06:20.056839 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-054a7bf5-c8b8-4e66-b561-73def60a309b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbf878e8b08d4c85bb3fb925db315ac4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:06:20.064052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-054a7bf5-c8b8-4e66-b561-73def60a309b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbf878e8b08d4c85bb3fb925db315ac4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:06:20.070015 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4392/8873] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 02:06:19 2022] DELETE /identity/v3/users/bbf878e8b08d4c85bb3fb925db315ac4 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:06:20.239179 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d76e9b-b082-4bab-bc32-64d839f9045a service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:06:20.250512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d76e9b-b082-4bab-bc32-64d839f9045a service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:06:20.317095 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7477e8-0697-45a4-adb8-ca67205847b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:06:20.317728 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7477e8-0697-45a4-adb8-ca67205847b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:06:20.318006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7477e8-0697-45a4-adb8-ca67205847b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:06:20.318275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7477e8-0697-45a4-adb8-ca67205847b0 admin admin] PATH_INFO: `/v3/projects/b5313574dcf84819b58af883ac6cb768` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:06:20.319385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7477e8-0697-45a4-adb8-ca67205847b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5313574dcf84819b58af883ac6cb768)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:06:20.321352 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7477e8-0697-45a4-adb8-ca67205847b0 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:06:20.371011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1d7477e8-0697-45a4-adb8-ca67205847b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5313574dcf84819b58af883ac6cb768', 'request_id': 'req-1d7477e8-0697-45a4-adb8-ca67205847b0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:06:20.376566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1d7477e8-0697-45a4-adb8-ca67205847b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5313574dcf84819b58af883ac6cb768', 'request_id': 'req-1d7477e8-0697-45a4-adb8-ca67205847b0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:06:20.383174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1d7477e8-0697-45a4-adb8-ca67205847b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5313574dcf84819b58af883ac6cb768', 'request_id': 'req-1d7477e8-0697-45a4-adb8-ca67205847b0'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:06:20.396378 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1d7477e8-0697-45a4-adb8-ca67205847b0 admin admin] The token cache is being invalidate because project b5313574dcf84819b58af883ac6cb768 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 02:06:20.396686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1d7477e8-0697-45a4-adb8-ca67205847b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:06:20.397303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-1d7477e8-0697-45a4-adb8-ca67205847b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:06:20.398778 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4482/8874] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 02:06:20 2022] DELETE /identity/v3/projects/b5313574dcf84819b58af883ac6cb768 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:06:20.404594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbc6ea-6a80-4db9-908e-d56741f79ac3 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:06:20.404882 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbc6ea-6a80-4db9-908e-d56741f79ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:06:20.405174 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbc6ea-6a80-4db9-908e-d56741f79ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:06:20.424679 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-fffbc6ea-6a80-4db9-908e-d56741f79ac3 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:06:20.425862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-fffbc6ea-6a80-4db9-908e-d56741f79ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:06:20.487378 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4393/8875] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:06:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:06:20.495187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e862c-2268-4fe9-bc80-970cb092dacf None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:06:20.495564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e862c-2268-4fe9-bc80-970cb092dacf None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:06:20.495915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e862c-2268-4fe9-bc80-970cb092dacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:06:20.516334 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-af2e862c-2268-4fe9-bc80-970cb092dacf None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:06:20.517853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-af2e862c-2268-4fe9-bc80-970cb092dacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:06:20.526988 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4483/8876] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:06:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:06:20.531078 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffbc6ea-6a80-4db9-908e-d56741f79ac3 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:06:20.541201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffbc6ea-6a80-4db9-908e-d56741f79ac3 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:06:20.546305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da124894-2df8-4da8-83ad-ed0c8fb308e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:06:20.547073 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da124894-2df8-4da8-83ad-ed0c8fb308e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:06:20.547358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da124894-2df8-4da8-83ad-ed0c8fb308e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:06:20.547634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da124894-2df8-4da8-83ad-ed0c8fb308e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:06:20.548393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da124894-2df8-4da8-83ad-ed0c8fb308e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 02:06:20.548700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da124894-2df8-4da8-83ad-ed0c8fb308e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:06:20.550330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da124894-2df8-4da8-83ad-ed0c8fb308e6 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:06:20.562779 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4394/8877] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 02:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 02:06:20.567125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e862c-2268-4fe9-bc80-970cb092dacf None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:06:20.577005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e862c-2268-4fe9-bc80-970cb092dacf None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:06:20.581720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546d238-309e-4414-8380-87906f6e3d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:06:20.582314 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546d238-309e-4414-8380-87906f6e3d14 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:06:20.582594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546d238-309e-4414-8380-87906f6e3d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:06:20.582865 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546d238-309e-4414-8380-87906f6e3d14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:06:20.583484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546d238-309e-4414-8380-87906f6e3d14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:06:20.585416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546d238-309e-4414-8380-87906f6e3d14 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:06:20.612990 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4484/8878] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 02:06:20 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 02:06:20.617206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da124894-2df8-4da8-83ad-ed0c8fb308e6 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:06:20.627850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da124894-2df8-4da8-83ad-ed0c8fb308e6 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:06:20.673880 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:06:20.685563 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c74a39-d59f-4edc-94e9-7d5e89eae0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:06:20.686173 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c74a39-d59f-4edc-94e9-7d5e89eae0a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:06:20.686483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c74a39-d59f-4edc-94e9-7d5e89eae0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:06:20.686754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c74a39-d59f-4edc-94e9-7d5e89eae0a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:06:20.687388 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c74a39-d59f-4edc-94e9-7d5e89eae0a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:06:20.689411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c74a39-d59f-4edc-94e9-7d5e89eae0a7 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:06:20.710104 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4395/8879] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 02:06:20 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 02:06:20.714255 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546d238-309e-4414-8380-87906f6e3d14 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:06:20.724589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546d238-309e-4414-8380-87906f6e3d14 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:06:20.729483 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8c882-8241-488a-a948-f021ee6ac592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:06:20.730075 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8c882-8241-488a-a948-f021ee6ac592 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:06:20.730354 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8c882-8241-488a-a948-f021ee6ac592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:06:20.730627 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8c882-8241-488a-a948-f021ee6ac592 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:06:20.731274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8c882-8241-488a-a948-f021ee6ac592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:06:20.732916 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8c882-8241-488a-a948-f021ee6ac592 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:06:20.742769 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4485/8880] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 02:06:20.746986 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c74a39-d59f-4edc-94e9-7d5e89eae0a7 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:06:20.756900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c74a39-d59f-4edc-94e9-7d5e89eae0a7 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:06:20.762107 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e4d98-3852-4c4b-9c90-218c14cbb5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:06:20.762678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e4d98-3852-4c4b-9c90-218c14cbb5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:06:20.762956 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e4d98-3852-4c4b-9c90-218c14cbb5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:06:20.763228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e4d98-3852-4c4b-9c90-218c14cbb5e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:06:20.763912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e4d98-3852-4c4b-9c90-218c14cbb5e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:06:20.765498 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e4d98-3852-4c4b-9c90-218c14cbb5e9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:06:20.776234 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4396/8881] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 02:06:20.780003 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8c882-8241-488a-a948-f021ee6ac592 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:06:20.789820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8c882-8241-488a-a948-f021ee6ac592 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:06:20.794441 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a615213-d85e-47ad-b6ed-c002f8c987a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:06:20.795073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a615213-d85e-47ad-b6ed-c002f8c987a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:06:20.795357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a615213-d85e-47ad-b6ed-c002f8c987a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:06:20.795627 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a615213-d85e-47ad-b6ed-c002f8c987a9 admin admin] PATH_INFO: `/v3/projects/435945eeab2f42d386f48f7374bbd488/users/09cb536a0a584f5f96bec5fca7afa3b4/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:06:20.810330 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a615213-d85e-47ad-b6ed-c002f8c987a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=435945eeab2f42d386f48f7374bbd488, user_id=09cb536a0a584f5f96bec5fca7afa3b4, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:06:20.813021 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a615213-d85e-47ad-b6ed-c002f8c987a9 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:06:20.826355 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4486/8882] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 02:06:20 2022] PUT /identity/v3/projects/435945eeab2f42d386f48f7374bbd488/users/09cb536a0a584f5f96bec5fca7afa3b4/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:06:20.831415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2d450-6820-4b00-84a4-188481ddb22a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:06:20.831696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2d450-6820-4b00-84a4-188481ddb22a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:06:20.832006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2d450-6820-4b00-84a4-188481ddb22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:06:20.850422 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6cf2d450-6820-4b00-84a4-188481ddb22a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:06:20.851611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6cf2d450-6820-4b00-84a4-188481ddb22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:06:20.910003 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4397/8883] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:06:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:06:20.919671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a615213-d85e-47ad-b6ed-c002f8c987a9 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:06:20.921419 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1a615213-d85e-47ad-b6ed-c002f8c987a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:06:20.952076 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:06:20.988914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a615213-d85e-47ad-b6ed-c002f8c987a9 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:06:20.992581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f2b50-48b3-4d28-8410-95c5f0a88b31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:06:20.993225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f2b50-48b3-4d28-8410-95c5f0a88b31 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:06:20.993452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f2b50-48b3-4d28-8410-95c5f0a88b31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:06:20.993718 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f2b50-48b3-4d28-8410-95c5f0a88b31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:06:21.003246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f2b50-48b3-4d28-8410-95c5f0a88b31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:06:21.004687 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f2b50-48b3-4d28-8410-95c5f0a88b31 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:06:21.014074 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4487/8884] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:06:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:06:25.141099 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082457a2-6151-40bc-9ad5-4d6f1582d29d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:06:25.141603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082457a2-6151-40bc-9ad5-4d6f1582d29d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:06:25.141801 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082457a2-6151-40bc-9ad5-4d6f1582d29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:06:25.173594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-082457a2-6151-40bc-9ad5-4d6f1582d29d None None] MFA Rules not processed for user `09cb536a0a584f5f96bec5fca7afa3b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:06:25.175538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-082457a2-6151-40bc-9ad5-4d6f1582d29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:06:25.251643 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4398/8885] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:06:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:06:25.266512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f2b50-48b3-4d28-8410-95c5f0a88b31 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:06:25.268119 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f07f2b50-48b3-4d28-8410-95c5f0a88b31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:06:25.356432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f2b50-48b3-4d28-8410-95c5f0a88b31 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:06:25.362068 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33f654-8b69-47bf-90dd-803c2c3d0723 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:06:25.362683 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33f654-8b69-47bf-90dd-803c2c3d0723 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:06:25.362958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33f654-8b69-47bf-90dd-803c2c3d0723 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:06:25.363221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33f654-8b69-47bf-90dd-803c2c3d0723 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:06:25.372426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c33f654-8b69-47bf-90dd-803c2c3d0723 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:06:25.374009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c33f654-8b69-47bf-90dd-803c2c3d0723 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:06:25.384312 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4488/8886] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:06:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:06:26.666806 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02b9cc-9eaa-4b8d-882a-254ffa2ebc25 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:06:26.667282 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02b9cc-9eaa-4b8d-882a-254ffa2ebc25 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:06:26.667387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02b9cc-9eaa-4b8d-882a-254ffa2ebc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:06:26.686428 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-4a02b9cc-9eaa-4b8d-882a-254ffa2ebc25 None None] MFA Rules not processed for user `09cb536a0a584f5f96bec5fca7afa3b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:06:26.687647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4a02b9cc-9eaa-4b8d-882a-254ffa2ebc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:06:26.694647 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4399/8887] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:06:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:06:26.734221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b7522-10b9-4d70-940b-6e828035b998 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:06:26.734700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b7522-10b9-4d70-940b-6e828035b998 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:06:26.734913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b7522-10b9-4d70-940b-6e828035b998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:06:26.802623 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-ac5b7522-10b9-4d70-940b-6e828035b998 None None] MFA Rules not processed for user `bcb60ac015204436b81971694393380c`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:06:26.803978 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ac5b7522-10b9-4d70-940b-6e828035b998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:06:26.867545 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4489/8888] 10.222.0.39 () {58 vars in 1063 bytes} [Sun Aug 7 02:06:26 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:06:26.873902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02b9cc-9eaa-4b8d-882a-254ffa2ebc25 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:06:26.883742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02b9cc-9eaa-4b8d-882a-254ffa2ebc25 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:06:26.888139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af319f9-7de9-4fa5-baff-18e93a680fe1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:06:26.888809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af319f9-7de9-4fa5-baff-18e93a680fe1 service glance] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:06:26.889087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af319f9-7de9-4fa5-baff-18e93a680fe1 service glance] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:06:26.889352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af319f9-7de9-4fa5-baff-18e93a680fe1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:06:26.891104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2af319f9-7de9-4fa5-baff-18e93a680fe1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:06:26.908035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af319f9-7de9-4fa5-baff-18e93a680fe1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:06:26.909574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af319f9-7de9-4fa5-baff-18e93a680fe1 service glance] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:06:26.923866 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4400/8889] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:06:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 02:06:27.553627 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b7522-10b9-4d70-940b-6e828035b998 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:06:27.555120 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ac5b7522-10b9-4d70-940b-6e828035b998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:06:27.563042 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=100 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:06:27.567726 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b7522-10b9-4d70-940b-6e828035b998 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:06:27.572102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570dd229-28d2-4cc6-91f7-54f399933bf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:06:27.572709 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570dd229-28d2-4cc6-91f7-54f399933bf4 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:06:27.573134 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570dd229-28d2-4cc6-91f7-54f399933bf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:06:27.573432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570dd229-28d2-4cc6-91f7-54f399933bf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:06:27.576823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-570dd229-28d2-4cc6-91f7-54f399933bf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:06:27.595379 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570dd229-28d2-4cc6-91f7-54f399933bf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:06:27.596871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570dd229-28d2-4cc6-91f7-54f399933bf4 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:06:27.612392 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4490/8890] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:06:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:06:36.915978 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=79,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:06:37.604149 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:07:13.242447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0fdad-6222-4363-b14b-1b69668d7b4d None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:07:13.243005 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0fdad-6222-4363-b14b-1b69668d7b4d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:07:13.243258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0fdad-6222-4363-b14b-1b69668d7b4d None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:07:13.244818 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4401/8891] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 02:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 02:07:13.250344 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe4115-9e3d-4081-9563-aaa176f14407 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:07:13.250833 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe4115-9e3d-4081-9563-aaa176f14407 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:07:13.251058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe4115-9e3d-4081-9563-aaa176f14407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:07:13.270418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a5fe4115-9e3d-4081-9563-aaa176f14407 None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:07:13.271959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a5fe4115-9e3d-4081-9563-aaa176f14407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:07:13.333196 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4491/8892] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 02:07:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 02:07:13.354878 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0fdad-6222-4363-b14b-1b69668d7b4d None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:07:13.356596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c6e0fdad-6222-4363-b14b-1b69668d7b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:07:13.373415 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0fdad-6222-4363-b14b-1b69668d7b4d None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:07:13.378398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f40ba1-b9c7-44db-a330-46069405389c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:07:13.379004 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f40ba1-b9c7-44db-a330-46069405389c service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:07:13.379278 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f40ba1-b9c7-44db-a330-46069405389c service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:07:13.379544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f40ba1-b9c7-44db-a330-46069405389c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:07:13.387840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f40ba1-b9c7-44db-a330-46069405389c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:07:13.389457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f40ba1-b9c7-44db-a330-46069405389c service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:07:13.399014 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4402/8893] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:07:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:07:23.324678 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=29 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:07:23.394958 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:07:26.040410 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9185b-12e6-4141-970d-ffca6a98015e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:07:26.040944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9185b-12e6-4141-970d-ffca6a98015e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:07:26.041053 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9185b-12e6-4141-970d-ffca6a98015e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:07:26.077418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e7c9185b-12e6-4141-970d-ffca6a98015e None None] MFA Rules not processed for user `6c70d5a72d424db68de7c7b8257fe02c`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:07:26.079130 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e7c9185b-12e6-4141-970d-ffca6a98015e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:07:26.088583 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4492/8894] 10.222.0.39 () {58 vars in 1059 bytes} [Sun Aug 7 02:07:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:07:27.273387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01403bd6-ec0a-456b-a1aa-f4e9de56d5b6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:07:27.273933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01403bd6-ec0a-456b-a1aa-f4e9de56d5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:07:27.273933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01403bd6-ec0a-456b-a1aa-f4e9de56d5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:07:27.294561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-01403bd6-ec0a-456b-a1aa-f4e9de56d5b6 None None] MFA Rules not processed for user `6c70d5a72d424db68de7c7b8257fe02c`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:07:27.295783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-01403bd6-ec0a-456b-a1aa-f4e9de56d5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:07:27.305514 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4403/8895] 10.222.0.39 () {58 vars in 1059 bytes} [Sun Aug 7 02:07:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:07:32.516377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55ac8b-f02a-478f-a6d4-3f06695f3621 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:07:32.516856 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55ac8b-f02a-478f-a6d4-3f06695f3621 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:07:32.517057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55ac8b-f02a-478f-a6d4-3f06695f3621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:07:32.536327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5d55ac8b-f02a-478f-a6d4-3f06695f3621 None None] MFA Rules not processed for user `6c70d5a72d424db68de7c7b8257fe02c`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:07:32.537610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5d55ac8b-f02a-478f-a6d4-3f06695f3621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:07:32.547352 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4493/8896] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 02:07:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:07:32.560388 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01403bd6-ec0a-456b-a1aa-f4e9de56d5b6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:07:32.571125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01403bd6-ec0a-456b-a1aa-f4e9de56d5b6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:07:32.575012 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec2691-1776-457a-b0c0-f37bb4c05ec5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:07:32.575608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec2691-1776-457a-b0c0-f37bb4c05ec5 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:07:32.576024 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec2691-1776-457a-b0c0-f37bb4c05ec5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:07:32.576259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec2691-1776-457a-b0c0-f37bb4c05ec5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:07:32.586979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec2691-1776-457a-b0c0-f37bb4c05ec5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:07:32.588893 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec2691-1776-457a-b0c0-f37bb4c05ec5 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:07:32.600319 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4404/8897] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:07:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:07:32.775305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46efc9-1280-4e5a-8376-062a0533bea6 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:07:32.775591 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46efc9-1280-4e5a-8376-062a0533bea6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:07:32.775864 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46efc9-1280-4e5a-8376-062a0533bea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:07:32.794786 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0b46efc9-1280-4e5a-8376-062a0533bea6 None None] MFA Rules not processed for user `6c70d5a72d424db68de7c7b8257fe02c`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:07:32.796012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0b46efc9-1280-4e5a-8376-062a0533bea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:07:32.806000 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4494/8898] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 02:07:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:07:32.817321 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec2691-1776-457a-b0c0-f37bb4c05ec5 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:07:32.826011 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec2691-1776-457a-b0c0-f37bb4c05ec5 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:07:32.829661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e464f5f-bda7-4cb6-bfd0-d13072f06340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:07:32.830250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e464f5f-bda7-4cb6-bfd0-d13072f06340 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:07:32.830540 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e464f5f-bda7-4cb6-bfd0-d13072f06340 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:07:32.830796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e464f5f-bda7-4cb6-bfd0-d13072f06340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:07:32.841171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e464f5f-bda7-4cb6-bfd0-d13072f06340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:07:32.842589 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e464f5f-bda7-4cb6-bfd0-d13072f06340 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:07:32.854060 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4405/8899] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:07:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:07:36.814303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0f2f5-c6a9-4bbd-93da-6ad8eca334d7 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:07:36.814806 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0f2f5-c6a9-4bbd-93da-6ad8eca334d7 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:07:36.814908 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0f2f5-c6a9-4bbd-93da-6ad8eca334d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:07:36.833545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-0dd0f2f5-c6a9-4bbd-93da-6ad8eca334d7 None None] MFA Rules not processed for user `09cb536a0a584f5f96bec5fca7afa3b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:07:36.834742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-0dd0f2f5-c6a9-4bbd-93da-6ad8eca334d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:07:36.841559 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4495/8900] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:07:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:07:40.270147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56c6ba-b422-47f7-a58b-b58e525f31b5 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:07:40.271417 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56c6ba-b422-47f7-a58b-b58e525f31b5 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:07:40.271570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56c6ba-b422-47f7-a58b-b58e525f31b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:07:40.314375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6f56c6ba-b422-47f7-a58b-b58e525f31b5 None None] MFA Rules not processed for user `b219e01934fa477fbaa053cca586f01b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:07:40.315560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6f56c6ba-b422-47f7-a58b-b58e525f31b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:07:40.322056 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4406/8901] 10.222.0.25 () {58 vars in 1015 bytes} [Sun Aug 7 02:07:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 02:07:40.336455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0f2f5-c6a9-4bbd-93da-6ad8eca334d7 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:07:40.349133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0f2f5-c6a9-4bbd-93da-6ad8eca334d7 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:07:40.352826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90582f6b-1d1a-4712-928b-ce075ddc9b03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:07:40.353429 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90582f6b-1d1a-4712-928b-ce075ddc9b03 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:07:40.353708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90582f6b-1d1a-4712-928b-ce075ddc9b03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:07:40.354012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90582f6b-1d1a-4712-928b-ce075ddc9b03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:07:40.361537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90582f6b-1d1a-4712-928b-ce075ddc9b03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:07:40.362981 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90582f6b-1d1a-4712-928b-ce075ddc9b03 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:07:40.371040 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4496/8902] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:07:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:07:49.387905 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56c6ba-b422-47f7-a58b-b58e525f31b5 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:07:49.401536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56c6ba-b422-47f7-a58b-b58e525f31b5 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:07:49.407435 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4934612-88c6-4a19-897e-df5617b03785 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:07:49.408079 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4934612-88c6-4a19-897e-df5617b03785 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:07:49.408363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4934612-88c6-4a19-897e-df5617b03785 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:07:49.408633 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4934612-88c6-4a19-897e-df5617b03785 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:07:49.410387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f4934612-88c6-4a19-897e-df5617b03785 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:07:49.425363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4934612-88c6-4a19-897e-df5617b03785 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:07:49.426954 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4934612-88c6-4a19-897e-df5617b03785 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:07:49.440859 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4407/8903] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:07:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:07:50.367576 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=24 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:07:59.435603 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=30 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:08:33.383476 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b2dd3-c5a9-46ae-8974-93c7f524afd9 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:08:33.384123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b2dd3-c5a9-46ae-8974-93c7f524afd9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:08:33.384123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b2dd3-c5a9-46ae-8974-93c7f524afd9 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:08:33.385461 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4497/8904] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 02:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 02:08:33.390861 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533a707-ac2e-45a8-ba26-849b9b948a2e None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:08:33.391442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533a707-ac2e-45a8-ba26-849b9b948a2e None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:08:33.391682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2533a707-ac2e-45a8-ba26-849b9b948a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:08:33.411996 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2533a707-ac2e-45a8-ba26-849b9b948a2e None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:08:33.413236 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2533a707-ac2e-45a8-ba26-849b9b948a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:08:33.421949 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4408/8905] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 02:08:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:08:33.444785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b2dd3-c5a9-46ae-8974-93c7f524afd9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:08:33.459286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b2dd3-c5a9-46ae-8974-93c7f524afd9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:08:33.464457 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc0a3f-f8d5-4688-9af5-531282562a3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:08:33.465074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc0a3f-f8d5-4688-9af5-531282562a3d service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:08:33.465348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc0a3f-f8d5-4688-9af5-531282562a3d service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:08:33.465646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc0a3f-f8d5-4688-9af5-531282562a3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:08:33.474890 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc0a3f-f8d5-4688-9af5-531282562a3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:08:33.476532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc0a3f-f8d5-4688-9af5-531282562a3d service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:08:33.487571 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4498/8906] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:08:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:08:33.746532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533a707-ac2e-45a8-ba26-849b9b948a2e None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:08:33.757350 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2533a707-ac2e-45a8-ba26-849b9b948a2e None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:08:33.762674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f216093-2f15-4692-a12a-e76e348afd7a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:08:33.763277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f216093-2f15-4692-a12a-e76e348afd7a service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:08:33.763552 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f216093-2f15-4692-a12a-e76e348afd7a service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:08:33.763820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f216093-2f15-4692-a12a-e76e348afd7a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:08:33.765671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4f216093-2f15-4692-a12a-e76e348afd7a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:08:33.776944 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f216093-2f15-4692-a12a-e76e348afd7a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:08:33.778505 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f216093-2f15-4692-a12a-e76e348afd7a service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:08:33.788636 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4409/8907] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:08:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:08:37.477033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481236d-c8e6-41bd-b5ff-c9141eb4e3ae None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:08:37.477638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481236d-c8e6-41bd-b5ff-c9141eb4e3ae None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:08:37.477638 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481236d-c8e6-41bd-b5ff-c9141eb4e3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:08:37.498073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b481236d-c8e6-41bd-b5ff-c9141eb4e3ae None None] MFA Rules not processed for user `b219e01934fa477fbaa053cca586f01b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:08:37.499197 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b481236d-c8e6-41bd-b5ff-c9141eb4e3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:08:37.506697 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4499/8908] 10.222.0.50 () {58 vars in 1015 bytes} [Sun Aug 7 02:08:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:08:37.519520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f216093-2f15-4692-a12a-e76e348afd7a service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:08:37.529967 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f216093-2f15-4692-a12a-e76e348afd7a service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:08:37.533726 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b5ef8-bf9f-45ce-8d03-20e22147dc61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:08:37.534326 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b5ef8-bf9f-45ce-8d03-20e22147dc61 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:08:37.534601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b5ef8-bf9f-45ce-8d03-20e22147dc61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:08:37.534873 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b5ef8-bf9f-45ce-8d03-20e22147dc61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:08:37.542511 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b5ef8-bf9f-45ce-8d03-20e22147dc61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:08:37.543944 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b5ef8-bf9f-45ce-8d03-20e22147dc61 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:08:37.551540 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4410/8909] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:08:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:08:37.941079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd984df8-e6ce-48e9-86eb-d355140a34c4 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:08:37.941273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd984df8-e6ce-48e9-86eb-d355140a34c4 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:08:37.941548 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd984df8-e6ce-48e9-86eb-d355140a34c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:08:37.961427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-dd984df8-e6ce-48e9-86eb-d355140a34c4 None None] MFA Rules not processed for user `6c70d5a72d424db68de7c7b8257fe02c`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:08:37.962716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dd984df8-e6ce-48e9-86eb-d355140a34c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:08:37.973059 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4500/8910] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 02:08:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:08:37.998924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b5ef8-bf9f-45ce-8d03-20e22147dc61 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:08:38.012812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b5ef8-bf9f-45ce-8d03-20e22147dc61 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:08:38.018529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7cde69-dd63-4cc2-89b6-34919aac9ca8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:08:38.019125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cde69-dd63-4cc2-89b6-34919aac9ca8 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:08:38.019402 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cde69-dd63-4cc2-89b6-34919aac9ca8 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:08:38.019674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cde69-dd63-4cc2-89b6-34919aac9ca8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:08:38.028768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7cde69-dd63-4cc2-89b6-34919aac9ca8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:08:38.030344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7cde69-dd63-4cc2-89b6-34919aac9ca8 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:08:38.041645 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4411/8911] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:08:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:08:43.235329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bb22f-8529-4760-a311-faa07bdc4228 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:08:43.236286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bb22f-8529-4760-a311-faa07bdc4228 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:08:43.236757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bb22f-8529-4760-a311-faa07bdc4228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:08:43.260967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1c7bb22f-8529-4760-a311-faa07bdc4228 None None] MFA Rules not processed for user `6c70d5a72d424db68de7c7b8257fe02c`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:08:43.262730 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1c7bb22f-8529-4760-a311-faa07bdc4228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:08:43.272311 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4501/8912] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 02:08:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:08:43.286245 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7cde69-dd63-4cc2-89b6-34919aac9ca8 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:08:43.297514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7cde69-dd63-4cc2-89b6-34919aac9ca8 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:08:43.303557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03fb9b-6d54-4175-b374-24cf51f8f550 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:08:43.304578 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03fb9b-6d54-4175-b374-24cf51f8f550 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:08:43.305080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03fb9b-6d54-4175-b374-24cf51f8f550 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:08:43.305353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03fb9b-6d54-4175-b374-24cf51f8f550 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:08:43.315469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03fb9b-6d54-4175-b374-24cf51f8f550 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:08:43.317903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03fb9b-6d54-4175-b374-24cf51f8f550 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:08:43.330947 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4412/8913] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:08:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:08:48.937322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e882c-c0f9-44b1-8cda-4bb8e3ceca4e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:08:48.937776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e882c-c0f9-44b1-8cda-4bb8e3ceca4e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:08:48.937864 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e882c-c0f9-44b1-8cda-4bb8e3ceca4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:08:48.956383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-461e882c-c0f9-44b1-8cda-4bb8e3ceca4e None None] MFA Rules not processed for user `09cb536a0a584f5f96bec5fca7afa3b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:08:48.957583 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-461e882c-c0f9-44b1-8cda-4bb8e3ceca4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:08:48.964803 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4502/8914] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:08:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:08:49.265905 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03fb9b-6d54-4175-b374-24cf51f8f550 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:08:49.275212 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03fb9b-6d54-4175-b374-24cf51f8f550 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:08:49.278835 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b977432-5382-480e-b109-8f544fdb2d7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:08:49.279425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b977432-5382-480e-b109-8f544fdb2d7c service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:08:49.279721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b977432-5382-480e-b109-8f544fdb2d7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:08:49.280022 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b977432-5382-480e-b109-8f544fdb2d7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:08:49.282284 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3b977432-5382-480e-b109-8f544fdb2d7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:08:49.294316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b977432-5382-480e-b109-8f544fdb2d7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:08:49.295767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b977432-5382-480e-b109-8f544fdb2d7c service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:08:49.306286 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4413/8915] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:08:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:08:49.926722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e882c-c0f9-44b1-8cda-4bb8e3ceca4e None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:08:49.938426 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e882c-c0f9-44b1-8cda-4bb8e3ceca4e None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:08:49.943616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041d170-e1d6-4f90-b038-f1579492671b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:08:49.944437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041d170-e1d6-4f90-b038-f1579492671b service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:08:49.944784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041d170-e1d6-4f90-b038-f1579492671b service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:08:49.945144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041d170-e1d6-4f90-b038-f1579492671b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:08:49.947010 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2041d170-e1d6-4f90-b038-f1579492671b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:08:49.962133 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041d170-e1d6-4f90-b038-f1579492671b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:08:49.964060 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041d170-e1d6-4f90-b038-f1579492671b service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:08:49.981080 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4503/8916] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:08:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:08:59.300253 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=33 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:08:59.971453 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=24 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:09:00.429342 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbbe48-230e-401e-802c-a53b8f18e0ec None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:09:00.429834 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbbe48-230e-401e-802c-a53b8f18e0ec None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:09:00.429929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbbe48-230e-401e-802c-a53b8f18e0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:09:00.449239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-5ecbbe48-230e-401e-802c-a53b8f18e0ec None None] MFA Rules not processed for user `6c70d5a72d424db68de7c7b8257fe02c`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:09:00.450444 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5ecbbe48-230e-401e-802c-a53b8f18e0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:09:00.461374 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4414/8917] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 02:09:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:09:00.475869 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041d170-e1d6-4f90-b038-f1579492671b service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:09:00.488131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041d170-e1d6-4f90-b038-f1579492671b service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:09:00.493936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1eaf4d-7f3f-4ae4-bc45-ae1e43dece03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:09:00.494545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1eaf4d-7f3f-4ae4-bc45-ae1e43dece03 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:09:00.494826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1eaf4d-7f3f-4ae4-bc45-ae1e43dece03 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:09:00.495101 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1eaf4d-7f3f-4ae4-bc45-ae1e43dece03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:09:00.504603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1eaf4d-7f3f-4ae4-bc45-ae1e43dece03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:09:00.506261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1eaf4d-7f3f-4ae4-bc45-ae1e43dece03 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:09:00.516833 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4504/8918] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:09:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:09:10.444285 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:09:10.512314 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:09:31.067016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbbe48-230e-401e-802c-a53b8f18e0ec None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:09:31.076933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbbe48-230e-401e-802c-a53b8f18e0ec None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:09:31.080869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60ca6b-4dd9-49bd-abf9-238fb1e72836 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:09:31.081482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60ca6b-4dd9-49bd-abf9-238fb1e72836 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:09:31.081773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60ca6b-4dd9-49bd-abf9-238fb1e72836 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:09:31.082032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60ca6b-4dd9-49bd-abf9-238fb1e72836 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:09:31.083825 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2e60ca6b-4dd9-49bd-abf9-238fb1e72836 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:09:31.100995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60ca6b-4dd9-49bd-abf9-238fb1e72836 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:09:31.102539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60ca6b-4dd9-49bd-abf9-238fb1e72836 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:09:31.115119 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4415/8919] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:09:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:09:31.224026 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67f1bd-91c2-4011-98f5-2088ac71d6e4 None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:09:31.224554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67f1bd-91c2-4011-98f5-2088ac71d6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:09:31.224554 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67f1bd-91c2-4011-98f5-2088ac71d6e4 None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:09:31.226293 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4505/8920] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 02:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 02:09:31.231488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41c58b-def4-4cdc-bdd1-cb082cb1a2f6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:09:31.231865 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41c58b-def4-4cdc-bdd1-cb082cb1a2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:09:31.232239 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41c58b-def4-4cdc-bdd1-cb082cb1a2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:09:31.265362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9b41c58b-def4-4cdc-bdd1-cb082cb1a2f6 None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:09:31.266891 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9b41c58b-def4-4cdc-bdd1-cb082cb1a2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:09:31.285563 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4416/8921] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 02:09:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:09:31.306483 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034a9d9-7a7e-4fba-b76c-701b75210db2 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:09:31.306763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034a9d9-7a7e-4fba-b76c-701b75210db2 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:09:31.307033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034a9d9-7a7e-4fba-b76c-701b75210db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:09:31.327327 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-f034a9d9-7a7e-4fba-b76c-701b75210db2 None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:09:31.328567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f034a9d9-7a7e-4fba-b76c-701b75210db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:09:31.337585 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4506/8922] 10.222.0.39 () {58 vars in 1058 bytes} [Sun Aug 7 02:09:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:09:31.343631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41c58b-def4-4cdc-bdd1-cb082cb1a2f6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:09:31.354316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41c58b-def4-4cdc-bdd1-cb082cb1a2f6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:09:31.359533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e550b4-6bfb-40c0-b47a-9f5f1c5cf420 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:09:31.360229 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e550b4-6bfb-40c0-b47a-9f5f1c5cf420 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:09:31.360576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e550b4-6bfb-40c0-b47a-9f5f1c5cf420 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:09:31.360915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e550b4-6bfb-40c0-b47a-9f5f1c5cf420 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:09:31.369830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e550b4-6bfb-40c0-b47a-9f5f1c5cf420 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:09:31.371527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e550b4-6bfb-40c0-b47a-9f5f1c5cf420 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:09:31.381447 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4417/8923] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:09:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:09:31.557599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034a9d9-7a7e-4fba-b76c-701b75210db2 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:09:31.567054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034a9d9-7a7e-4fba-b76c-701b75210db2 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:09:31.570605 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d393a58-c154-4b5a-9dc2-c9cb043e4e46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:09:31.571945 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d393a58-c154-4b5a-9dc2-c9cb043e4e46 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:09:31.572206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d393a58-c154-4b5a-9dc2-c9cb043e4e46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:09:31.572473 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d393a58-c154-4b5a-9dc2-c9cb043e4e46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:09:31.574256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1d393a58-c154-4b5a-9dc2-c9cb043e4e46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:09:31.610935 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d393a58-c154-4b5a-9dc2-c9cb043e4e46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:09:31.612438 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d393a58-c154-4b5a-9dc2-c9cb043e4e46 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:09:31.626660 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4507/8924] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:09:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:09:41.377202 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=24 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:09:41.619464 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=17 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:09:59.487072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d14863-87b6-4d1f-a6a0-a8d13f20b771 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:09:59.487595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d14863-87b6-4d1f-a6a0-a8d13f20b771 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:09:59.487595 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d14863-87b6-4d1f-a6a0-a8d13f20b771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:09:59.506763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d9d14863-87b6-4d1f-a6a0-a8d13f20b771 None None] MFA Rules not processed for user `09cb536a0a584f5f96bec5fca7afa3b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:09:59.507997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d9d14863-87b6-4d1f-a6a0-a8d13f20b771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:09:59.515385 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4418/8925] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:09:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:09:59.820991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9a1ad-67b6-40ef-a3e1-93865180d9b7 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:09:59.821505 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9a1ad-67b6-40ef-a3e1-93865180d9b7 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:09:59.821617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9a1ad-67b6-40ef-a3e1-93865180d9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:09:59.845839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-09a9a1ad-67b6-40ef-a3e1-93865180d9b7 None None] MFA Rules not processed for user `b219e01934fa477fbaa053cca586f01b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:09:59.847870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-09a9a1ad-67b6-40ef-a3e1-93865180d9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:09:59.854550 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4508/8926] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 02:09:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:09:59.867490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d14863-87b6-4d1f-a6a0-a8d13f20b771 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:09:59.877095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d14863-87b6-4d1f-a6a0-a8d13f20b771 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:09:59.880646 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a19ad3-15e7-4258-a584-93a20b89512f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:09:59.881266 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a19ad3-15e7-4258-a584-93a20b89512f service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:09:59.881543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a19ad3-15e7-4258-a584-93a20b89512f service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:09:59.881813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a19ad3-15e7-4258-a584-93a20b89512f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:09:59.888696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a19ad3-15e7-4258-a584-93a20b89512f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:09:59.890157 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a19ad3-15e7-4258-a584-93a20b89512f service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:09:59.898085 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4419/8927] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:09:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:10:09.837649 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:10:09.894543 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=9 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:10:24.356311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9a1ad-67b6-40ef-a3e1-93865180d9b7 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:10:24.367992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9a1ad-67b6-40ef-a3e1-93865180d9b7 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:10:24.372889 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ec045-417c-45b3-b1c4-2f4d961af3ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:10:24.373483 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ec045-417c-45b3-b1c4-2f4d961af3ad service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:10:24.373756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ec045-417c-45b3-b1c4-2f4d961af3ad service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:10:24.374022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ec045-417c-45b3-b1c4-2f4d961af3ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:10:24.375710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5e6ec045-417c-45b3-b1c4-2f4d961af3ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:10:24.387148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ec045-417c-45b3-b1c4-2f4d961af3ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:10:24.388742 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ec045-417c-45b3-b1c4-2f4d961af3ad service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:10:24.398722 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4509/8928] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:10:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:10:34.395332 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:10:56.349820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40daee45-3183-4d31-ba3a-2fabe463b941 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:10:56.350424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40daee45-3183-4d31-ba3a-2fabe463b941 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:10:56.350424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40daee45-3183-4d31-ba3a-2fabe463b941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:10:56.370867 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-40daee45-3183-4d31-ba3a-2fabe463b941 None None] MFA Rules not processed for user `b219e01934fa477fbaa053cca586f01b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:10:56.372290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-40daee45-3183-4d31-ba3a-2fabe463b941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:10:56.378903 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4420/8929] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 02:10:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:10:56.400858 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ec045-417c-45b3-b1c4-2f4d961af3ad service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:10:56.410993 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ec045-417c-45b3-b1c4-2f4d961af3ad service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:10:56.415258 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83676b-f6c7-4c10-95a5-19c353f4286c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:10:56.415874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83676b-f6c7-4c10-95a5-19c353f4286c service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:10:56.416178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83676b-f6c7-4c10-95a5-19c353f4286c service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:10:56.416448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83676b-f6c7-4c10-95a5-19c353f4286c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:10:56.424213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83676b-f6c7-4c10-95a5-19c353f4286c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:10:56.425714 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83676b-f6c7-4c10-95a5-19c353f4286c service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:10:56.434718 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4510/8930] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:10:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:10:56.529125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38451385-91cd-4664-a751-cc0667517970 None None] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:10:56.529409 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38451385-91cd-4664-a751-cc0667517970 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:10:56.529687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38451385-91cd-4664-a751-cc0667517970 None None] PATH_INFO: `/` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:10:56.532090 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4421/8931] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 02:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 02:10:56.536586 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120401d8-5d4c-4a0c-8628-0cff68413103 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:10:56.537371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120401d8-5d4c-4a0c-8628-0cff68413103 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:10:56.537371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120401d8-5d4c-4a0c-8628-0cff68413103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:10:56.556620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-120401d8-5d4c-4a0c-8628-0cff68413103 None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:10:56.557801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-120401d8-5d4c-4a0c-8628-0cff68413103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:10:56.566784 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4511/8932] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 02:10:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:10:56.588121 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38451385-91cd-4664-a751-cc0667517970 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:10:56.601751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38451385-91cd-4664-a751-cc0667517970 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:10:56.606664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc423a-3ad1-4e58-b670-0a32198d1036 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:10:56.607249 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc423a-3ad1-4e58-b670-0a32198d1036 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:10:56.607526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc423a-3ad1-4e58-b670-0a32198d1036 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:10:56.607793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc423a-3ad1-4e58-b670-0a32198d1036 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:10:56.616039 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc423a-3ad1-4e58-b670-0a32198d1036 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:10:56.617612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc423a-3ad1-4e58-b670-0a32198d1036 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:10:56.627731 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4422/8933] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:10:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:10:57.198478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120401d8-5d4c-4a0c-8628-0cff68413103 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:10:57.208811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120401d8-5d4c-4a0c-8628-0cff68413103 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:10:57.214465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d7e51-86b9-42c5-8d29-4c11ac889e6a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:10:57.215070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d7e51-86b9-42c5-8d29-4c11ac889e6a service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:10:57.215347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d7e51-86b9-42c5-8d29-4c11ac889e6a service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:10:57.215619 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d7e51-86b9-42c5-8d29-4c11ac889e6a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:10:57.217357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fe8d7e51-86b9-42c5-8d29-4c11ac889e6a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:10:57.229339 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d7e51-86b9-42c5-8d29-4c11ac889e6a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:10:57.230901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d7e51-86b9-42c5-8d29-4c11ac889e6a service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:10:57.240793 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4512/8934] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:10:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:11:06.623686 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=9 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:11:07.236683 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=15 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:11:26.068427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc423a-3ad1-4e58-b670-0a32198d1036 service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:11:26.080943 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc423a-3ad1-4e58-b670-0a32198d1036 service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:11:26.086214 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10eb886-da9a-4b00-b47c-6f007f7fcff8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:11:26.086844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10eb886-da9a-4b00-b47c-6f007f7fcff8 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:11:26.087117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10eb886-da9a-4b00-b47c-6f007f7fcff8 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:11:26.087382 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10eb886-da9a-4b00-b47c-6f007f7fcff8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:11:26.095512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10eb886-da9a-4b00-b47c-6f007f7fcff8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:11:26.097110 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10eb886-da9a-4b00-b47c-6f007f7fcff8 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:11:26.105810 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4423/8935] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:11:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:11:36.101804 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:12:04.182922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d7e51-86b9-42c5-8d29-4c11ac889e6a service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:12:04.192830 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d7e51-86b9-42c5-8d29-4c11ac889e6a service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:12:04.196423 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b8e35-37dd-40bb-9a0c-0a2903654670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:12:04.197015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b8e35-37dd-40bb-9a0c-0a2903654670 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:04.197295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b8e35-37dd-40bb-9a0c-0a2903654670 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:04.197566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b8e35-37dd-40bb-9a0c-0a2903654670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:04.206282 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b8e35-37dd-40bb-9a0c-0a2903654670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:12:04.207701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b8e35-37dd-40bb-9a0c-0a2903654670 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:12:04.217102 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4513/8936] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:12:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:12:07.305410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab7178-da5e-4ce5-969f-03f34a9f82aa None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:07.306104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab7178-da5e-4ce5-969f-03f34a9f82aa None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:07.306390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab7178-da5e-4ce5-969f-03f34a9f82aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:07.331462 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-78ab7178-da5e-4ce5-969f-03f34a9f82aa None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:12:07.334202 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-78ab7178-da5e-4ce5-969f-03f34a9f82aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:12:07.344862 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4424/8937] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 02:12:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:12:07.357857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b8e35-37dd-40bb-9a0c-0a2903654670 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:12:07.374392 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b8e35-37dd-40bb-9a0c-0a2903654670 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:12:07.388753 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f93a6-6b71-4f52-a77c-89b7a9515131 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:12:07.389386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f93a6-6b71-4f52-a77c-89b7a9515131 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:07.389664 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f93a6-6b71-4f52-a77c-89b7a9515131 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:07.389936 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f93a6-6b71-4f52-a77c-89b7a9515131 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:07.390251 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab7178-da5e-4ce5-969f-03f34a9f82aa None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:12:07.401281 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f93a6-6b71-4f52-a77c-89b7a9515131 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:12:07.402910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f93a6-6b71-4f52-a77c-89b7a9515131 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:12:07.408467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab7178-da5e-4ce5-969f-03f34a9f82aa None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:12:07.413830 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4514/8938] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:12:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:12:07.414583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afc775-58e0-4ecf-881c-a3e4d234292d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:12:07.415321 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afc775-58e0-4ecf-881c-a3e4d234292d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:07.415606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afc775-58e0-4ecf-881c-a3e4d234292d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:07.415892 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afc775-58e0-4ecf-881c-a3e4d234292d admin admin] PATH_INFO: `/v3/users/09cb536a0a584f5f96bec5fca7afa3b4` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:07.417795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78afc775-58e0-4ecf-881c-a3e4d234292d admin admin] RBAC: Authorizing `identity:delete_user(user_id=09cb536a0a584f5f96bec5fca7afa3b4)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:12:07.420467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78afc775-58e0-4ecf-881c-a3e4d234292d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:12:07.472588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-78afc775-58e0-4ecf-881c-a3e4d234292d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09cb536a0a584f5f96bec5fca7afa3b4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:12:07.479372 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-78afc775-58e0-4ecf-881c-a3e4d234292d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09cb536a0a584f5f96bec5fca7afa3b4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:12:07.491457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-78afc775-58e0-4ecf-881c-a3e4d234292d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09cb536a0a584f5f96bec5fca7afa3b4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:12:07.492162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-78afc775-58e0-4ecf-881c-a3e4d234292d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09cb536a0a584f5f96bec5fca7afa3b4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:12:07.499271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-78afc775-58e0-4ecf-881c-a3e4d234292d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09cb536a0a584f5f96bec5fca7afa3b4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:12:07.505821 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4425/8939] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 02:12:07 2022] DELETE /identity/v3/users/09cb536a0a584f5f96bec5fca7afa3b4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:12:07.684433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f93a6-6b71-4f52-a77c-89b7a9515131 service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:12:07.700078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f93a6-6b71-4f52-a77c-89b7a9515131 service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:12:07.771464 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd60e58-82ca-49a5-8d65-fd7490a9af7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:12:07.772151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd60e58-82ca-49a5-8d65-fd7490a9af7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:07.772442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd60e58-82ca-49a5-8d65-fd7490a9af7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:07.772717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd60e58-82ca-49a5-8d65-fd7490a9af7d admin admin] PATH_INFO: `/v3/projects/435945eeab2f42d386f48f7374bbd488` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:07.773834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd60e58-82ca-49a5-8d65-fd7490a9af7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=435945eeab2f42d386f48f7374bbd488)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:12:07.775747 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd60e58-82ca-49a5-8d65-fd7490a9af7d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:12:07.821298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-efd60e58-82ca-49a5-8d65-fd7490a9af7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '435945eeab2f42d386f48f7374bbd488', 'request_id': 'req-efd60e58-82ca-49a5-8d65-fd7490a9af7d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:12:07.826653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-efd60e58-82ca-49a5-8d65-fd7490a9af7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '435945eeab2f42d386f48f7374bbd488', 'request_id': 'req-efd60e58-82ca-49a5-8d65-fd7490a9af7d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:12:07.833166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-efd60e58-82ca-49a5-8d65-fd7490a9af7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '435945eeab2f42d386f48f7374bbd488', 'request_id': 'req-efd60e58-82ca-49a5-8d65-fd7490a9af7d'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:12:07.847736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-efd60e58-82ca-49a5-8d65-fd7490a9af7d admin admin] The token cache is being invalidate because project 435945eeab2f42d386f48f7374bbd488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 02:12:07.848063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-efd60e58-82ca-49a5-8d65-fd7490a9af7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:12:07.848770 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-efd60e58-82ca-49a5-8d65-fd7490a9af7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:12:07.850360 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4515/8940] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 02:12:07 2022] DELETE /identity/v3/projects/435945eeab2f42d386f48f7374bbd488 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:12:07.855556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d21b8c-2c78-4901-bcbc-d436982c768a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:07.855843 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d21b8c-2c78-4901-bcbc-d436982c768a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:07.856164 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d21b8c-2c78-4901-bcbc-d436982c768a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:07.876083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b8d21b8c-2c78-4901-bcbc-d436982c768a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:12:07.877279 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b8d21b8c-2c78-4901-bcbc-d436982c768a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:12:07.935978 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4426/8941] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:12:07.944181 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdccbc-e5d9-411d-b083-b3a05a5d77aa None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:07.944465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdccbc-e5d9-411d-b083-b3a05a5d77aa None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:07.944735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdccbc-e5d9-411d-b083-b3a05a5d77aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:07.964535 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-99cdccbc-e5d9-411d-b083-b3a05a5d77aa None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:12:07.965717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-99cdccbc-e5d9-411d-b083-b3a05a5d77aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:12:07.974618 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4516/8942] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:12:07.978948 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d21b8c-2c78-4901-bcbc-d436982c768a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:12:07.988843 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d21b8c-2c78-4901-bcbc-d436982c768a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:12:07.993411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb682d9-ff5b-4233-95d6-c2d4042196de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:12:07.993999 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb682d9-ff5b-4233-95d6-c2d4042196de admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:07.994272 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb682d9-ff5b-4233-95d6-c2d4042196de admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:07.994536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb682d9-ff5b-4233-95d6-c2d4042196de admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:07.995171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb682d9-ff5b-4233-95d6-c2d4042196de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 02:12:07.995472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb682d9-ff5b-4233-95d6-c2d4042196de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:12:07.997096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb682d9-ff5b-4233-95d6-c2d4042196de admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:12:08.008631 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4427/8943] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 02:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 02:12:08.012806 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdccbc-e5d9-411d-b083-b3a05a5d77aa None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:12:08.027171 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdccbc-e5d9-411d-b083-b3a05a5d77aa None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:12:08.032131 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db507a4-7374-4aa0-8301-7e27dc35ebfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:12:08.033370 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db507a4-7374-4aa0-8301-7e27dc35ebfb admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:08.033646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db507a4-7374-4aa0-8301-7e27dc35ebfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:08.033913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db507a4-7374-4aa0-8301-7e27dc35ebfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:08.034533 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db507a4-7374-4aa0-8301-7e27dc35ebfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:12:08.036480 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db507a4-7374-4aa0-8301-7e27dc35ebfb admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:12:08.069810 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4517/8944] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 02:12:08 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 02:12:08.074072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb682d9-ff5b-4233-95d6-c2d4042196de admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:12:08.084541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb682d9-ff5b-4233-95d6-c2d4042196de admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:12:08.132564 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:12:08.143123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060e8e0-c57d-42fd-ae42-94602eb3b448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:12:08.143718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060e8e0-c57d-42fd-ae42-94602eb3b448 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:08.144049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060e8e0-c57d-42fd-ae42-94602eb3b448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:08.144316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c060e8e0-c57d-42fd-ae42-94602eb3b448 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:08.144924 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060e8e0-c57d-42fd-ae42-94602eb3b448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:12:08.146829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c060e8e0-c57d-42fd-ae42-94602eb3b448 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:12:08.170656 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4428/8945] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 02:12:08 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 02:12:08.171875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db507a4-7374-4aa0-8301-7e27dc35ebfb admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:12:08.182624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db507a4-7374-4aa0-8301-7e27dc35ebfb admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:12:08.187267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4067a3d-63de-40a7-b78a-8b9c0025962b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:12:08.187867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4067a3d-63de-40a7-b78a-8b9c0025962b admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:08.188189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4067a3d-63de-40a7-b78a-8b9c0025962b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:08.188461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4067a3d-63de-40a7-b78a-8b9c0025962b admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:08.189136 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4067a3d-63de-40a7-b78a-8b9c0025962b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:12:08.190723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4067a3d-63de-40a7-b78a-8b9c0025962b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:12:08.200461 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4518/8946] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 02:12:08.204445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060e8e0-c57d-42fd-ae42-94602eb3b448 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:12:08.215126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c060e8e0-c57d-42fd-ae42-94602eb3b448 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:12:08.219784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1378e57f-306e-47ca-85d6-dc4e9322e64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:12:08.221054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378e57f-306e-47ca-85d6-dc4e9322e64f admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:08.221332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378e57f-306e-47ca-85d6-dc4e9322e64f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:08.221606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1378e57f-306e-47ca-85d6-dc4e9322e64f admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:08.222252 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378e57f-306e-47ca-85d6-dc4e9322e64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:12:08.223844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1378e57f-306e-47ca-85d6-dc4e9322e64f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:12:08.234647 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4429/8947] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 02:12:08.239151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4067a3d-63de-40a7-b78a-8b9c0025962b admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:12:08.249307 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4067a3d-63de-40a7-b78a-8b9c0025962b admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:12:08.254455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c6d66-66bd-4f97-8b70-f48744e8954f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:12:08.255087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c6d66-66bd-4f97-8b70-f48744e8954f admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:08.255372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c6d66-66bd-4f97-8b70-f48744e8954f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:08.255645 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c6d66-66bd-4f97-8b70-f48744e8954f admin admin] PATH_INFO: `/v3/projects/1694bfebb9414fcd90bfdef30d061be0/users/53d0dd0eddee4fd4b9f23b4a6c79ce07/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:08.270639 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c6d66-66bd-4f97-8b70-f48744e8954f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1694bfebb9414fcd90bfdef30d061be0, user_id=53d0dd0eddee4fd4b9f23b4a6c79ce07, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:12:08.273413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c6d66-66bd-4f97-8b70-f48744e8954f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:12:08.282375 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:12:08.287336 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4519/8948] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 02:12:08 2022] PUT /identity/v3/projects/1694bfebb9414fcd90bfdef30d061be0/users/53d0dd0eddee4fd4b9f23b4a6c79ce07/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:12:08.292852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c35a8-5165-4935-98ec-93ddef9acb29 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:08.293140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c35a8-5165-4935-98ec-93ddef9acb29 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:08.293416 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c35a8-5165-4935-98ec-93ddef9acb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:08.313019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-dd4c35a8-5165-4935-98ec-93ddef9acb29 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:12:08.314711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-dd4c35a8-5165-4935-98ec-93ddef9acb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:12:08.374241 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4430/8949] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:12:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:12:08.384413 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c6d66-66bd-4f97-8b70-f48744e8954f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:12:08.386532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6c3c6d66-66bd-4f97-8b70-f48744e8954f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:12:08.448174 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c6d66-66bd-4f97-8b70-f48744e8954f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:12:08.451863 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb1a14-4fba-4cd8-9be0-062f99377b24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:12:08.452510 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb1a14-4fba-4cd8-9be0-062f99377b24 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:08.452790 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb1a14-4fba-4cd8-9be0-062f99377b24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:08.453063 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb1a14-4fba-4cd8-9be0-062f99377b24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:08.463421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb1a14-4fba-4cd8-9be0-062f99377b24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:12:08.464895 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deb1a14-4fba-4cd8-9be0-062f99377b24 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:12:08.474674 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4520/8950] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:12:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:12:12.495845 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ff307-cf88-4c29-ab64-c22e8abfadda None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:12.496420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ff307-cf88-4c29-ab64-c22e8abfadda None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:12.496420 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ff307-cf88-4c29-ab64-c22e8abfadda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:12.527515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-5e4ff307-cf88-4c29-ab64-c22e8abfadda None None] MFA Rules not processed for user `53d0dd0eddee4fd4b9f23b4a6c79ce07`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:12:12.529044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5e4ff307-cf88-4c29-ab64-c22e8abfadda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:12:12.599500 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4431/8951] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:12:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:12:12.609350 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64132a08-68d2-4308-b602-b3eecb416d01 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:12.609748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64132a08-68d2-4308-b602-b3eecb416d01 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:12.609906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64132a08-68d2-4308-b602-b3eecb416d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:12.631966 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-64132a08-68d2-4308-b602-b3eecb416d01 None None] MFA Rules not processed for user `53d0dd0eddee4fd4b9f23b4a6c79ce07`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:12:12.633551 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-64132a08-68d2-4308-b602-b3eecb416d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:12:12.646148 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4521/8952] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:12:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:12:12.652619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ff307-cf88-4c29-ab64-c22e8abfadda None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:12:12.654310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5e4ff307-cf88-4c29-ab64-c22e8abfadda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:12:12.749871 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:12:12.771177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ff307-cf88-4c29-ab64-c22e8abfadda None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:12:12.776941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574916d1-2f89-445b-bfe4-b73f69665a69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:12:12.777723 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574916d1-2f89-445b-bfe4-b73f69665a69 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:12.778077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574916d1-2f89-445b-bfe4-b73f69665a69 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:12.778425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574916d1-2f89-445b-bfe4-b73f69665a69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:12.788065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574916d1-2f89-445b-bfe4-b73f69665a69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:12:12.790263 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574916d1-2f89-445b-bfe4-b73f69665a69 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:12:12.801406 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4432/8953] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:12:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 02:12:22.624717 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=29 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:12:22.795398 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:12:25.111083 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f01c0b-9a49-43cf-983f-8825ffa7ea3a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:25.111570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f01c0b-9a49-43cf-983f-8825ffa7ea3a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:25.111658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f01c0b-9a49-43cf-983f-8825ffa7ea3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:25.130801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-33f01c0b-9a49-43cf-983f-8825ffa7ea3a None None] MFA Rules not processed for user `53d0dd0eddee4fd4b9f23b4a6c79ce07`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:12:25.132018 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-33f01c0b-9a49-43cf-983f-8825ffa7ea3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:12:25.138875 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4522/8954] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:12:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:12:25.386227 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42566c10-b684-4777-889f-fb50c8dfbbe6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:25.386719 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42566c10-b684-4777-889f-fb50c8dfbbe6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:25.386809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42566c10-b684-4777-889f-fb50c8dfbbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:25.406795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-42566c10-b684-4777-889f-fb50c8dfbbe6 None None] MFA Rules not processed for user `b219e01934fa477fbaa053cca586f01b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:12:25.408139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-42566c10-b684-4777-889f-fb50c8dfbbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:12:25.414730 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4433/8955] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 02:12:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:12:25.428305 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f01c0b-9a49-43cf-983f-8825ffa7ea3a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:12:25.438278 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f01c0b-9a49-43cf-983f-8825ffa7ea3a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:12:25.443247 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be77489-7e97-4929-9e47-cdf6da124741 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:12:25.443857 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be77489-7e97-4929-9e47-cdf6da124741 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:25.444194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be77489-7e97-4929-9e47-cdf6da124741 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:25.444486 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be77489-7e97-4929-9e47-cdf6da124741 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:25.454064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be77489-7e97-4929-9e47-cdf6da124741 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:12:25.455955 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be77489-7e97-4929-9e47-cdf6da124741 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:12:25.466739 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4523/8956] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:12:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:12:32.713738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42566c10-b684-4777-889f-fb50c8dfbbe6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:12:32.722184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42566c10-b684-4777-889f-fb50c8dfbbe6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:12:32.726682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd79d0a-8692-4bdd-b382-eae3ecec5c9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:12:32.727273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd79d0a-8692-4bdd-b382-eae3ecec5c9b service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:32.727547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd79d0a-8692-4bdd-b382-eae3ecec5c9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:32.727813 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd79d0a-8692-4bdd-b382-eae3ecec5c9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:32.729559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-dbd79d0a-8692-4bdd-b382-eae3ecec5c9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:12:32.743571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd79d0a-8692-4bdd-b382-eae3ecec5c9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:12:32.745068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd79d0a-8692-4bdd-b382-eae3ecec5c9b service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:12:32.758833 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4434/8957] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:12:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:12:33.944459 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be77489-7e97-4929-9e47-cdf6da124741 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:12:33.945927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6be77489-7e97-4929-9e47-cdf6da124741 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:12:33.957014 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be77489-7e97-4929-9e47-cdf6da124741 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:12:33.960647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ba2a2-cfe8-40ac-ba8f-c86a3c430a57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:12:33.961242 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ba2a2-cfe8-40ac-ba8f-c86a3c430a57 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:33.961522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ba2a2-cfe8-40ac-ba8f-c86a3c430a57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:33.961794 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ba2a2-cfe8-40ac-ba8f-c86a3c430a57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:33.963515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f14ba2a2-cfe8-40ac-ba8f-c86a3c430a57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:12:33.977660 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ba2a2-cfe8-40ac-ba8f-c86a3c430a57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:12:33.979101 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ba2a2-cfe8-40ac-ba8f-c86a3c430a57 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:12:33.990813 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4524/8958] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:12:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:12:42.751121 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=9 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:12:43.985303 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=15 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:12:47.764296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd79d0a-8692-4bdd-b382-eae3ecec5c9b service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:12:47.790148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd79d0a-8692-4bdd-b382-eae3ecec5c9b service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:12:47.794930 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d65f0d-840d-4cd4-9c7e-8adc99266255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:12:47.795572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d65f0d-840d-4cd4-9c7e-8adc99266255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:47.795851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d65f0d-840d-4cd4-9c7e-8adc99266255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:47.796410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d65f0d-840d-4cd4-9c7e-8adc99266255 admin admin] PATH_INFO: `/v3/users/53d0dd0eddee4fd4b9f23b4a6c79ce07` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:47.797533 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d65f0d-840d-4cd4-9c7e-8adc99266255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53d0dd0eddee4fd4b9f23b4a6c79ce07)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:12:47.799458 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d65f0d-840d-4cd4-9c7e-8adc99266255 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:12:47.854598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-35d65f0d-840d-4cd4-9c7e-8adc99266255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53d0dd0eddee4fd4b9f23b4a6c79ce07'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:12:47.863153 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-35d65f0d-840d-4cd4-9c7e-8adc99266255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53d0dd0eddee4fd4b9f23b4a6c79ce07'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:12:47.875765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-35d65f0d-840d-4cd4-9c7e-8adc99266255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53d0dd0eddee4fd4b9f23b4a6c79ce07'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:12:47.876514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-35d65f0d-840d-4cd4-9c7e-8adc99266255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53d0dd0eddee4fd4b9f23b4a6c79ce07'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:12:47.884603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-35d65f0d-840d-4cd4-9c7e-8adc99266255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53d0dd0eddee4fd4b9f23b4a6c79ce07'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:12:47.890501 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4435/8959] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 02:12:47 2022] DELETE /identity/v3/users/53d0dd0eddee4fd4b9f23b4a6c79ce07 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:12:48.065504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ba2a2-cfe8-40ac-ba8f-c86a3c430a57 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:12:48.078565 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ba2a2-cfe8-40ac-ba8f-c86a3c430a57 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:12:48.136223 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933a1b9-0f71-4668-aeea-fe6b1d7a5d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:12:48.136937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933a1b9-0f71-4668-aeea-fe6b1d7a5d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:48.137221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933a1b9-0f71-4668-aeea-fe6b1d7a5d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:48.137491 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933a1b9-0f71-4668-aeea-fe6b1d7a5d76 admin admin] PATH_INFO: `/v3/projects/1694bfebb9414fcd90bfdef30d061be0` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:48.138621 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933a1b9-0f71-4668-aeea-fe6b1d7a5d76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1694bfebb9414fcd90bfdef30d061be0)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:12:48.140570 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933a1b9-0f71-4668-aeea-fe6b1d7a5d76 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:12:48.191210 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6933a1b9-0f71-4668-aeea-fe6b1d7a5d76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1694bfebb9414fcd90bfdef30d061be0', 'request_id': 'req-6933a1b9-0f71-4668-aeea-fe6b1d7a5d76'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:12:48.200123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6933a1b9-0f71-4668-aeea-fe6b1d7a5d76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1694bfebb9414fcd90bfdef30d061be0', 'request_id': 'req-6933a1b9-0f71-4668-aeea-fe6b1d7a5d76'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:12:48.206485 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6933a1b9-0f71-4668-aeea-fe6b1d7a5d76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1694bfebb9414fcd90bfdef30d061be0', 'request_id': 'req-6933a1b9-0f71-4668-aeea-fe6b1d7a5d76'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:12:48.219055 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6933a1b9-0f71-4668-aeea-fe6b1d7a5d76 admin admin] The token cache is being invalidate because project 1694bfebb9414fcd90bfdef30d061be0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 02:12:48.219474 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6933a1b9-0f71-4668-aeea-fe6b1d7a5d76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:12:48.220125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6933a1b9-0f71-4668-aeea-fe6b1d7a5d76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:12:48.221650 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4525/8960] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 02:12:48 2022] DELETE /identity/v3/projects/1694bfebb9414fcd90bfdef30d061be0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:12:48.227275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456da94-cc5a-41f3-b758-035499caa839 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:48.227561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456da94-cc5a-41f3-b758-035499caa839 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:48.227864 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456da94-cc5a-41f3-b758-035499caa839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:48.247795 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b456da94-cc5a-41f3-b758-035499caa839 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:12:48.249017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b456da94-cc5a-41f3-b758-035499caa839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:12:48.307758 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4436/8961] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:12:48.315937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65788b-d63f-46b7-b015-b3cf903b075a None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:48.316226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65788b-d63f-46b7-b015-b3cf903b075a None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:48.316502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65788b-d63f-46b7-b015-b3cf903b075a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:48.336022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3d65788b-d63f-46b7-b015-b3cf903b075a None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:12:48.337216 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3d65788b-d63f-46b7-b015-b3cf903b075a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:12:48.345556 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4526/8962] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:12:48.350176 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456da94-cc5a-41f3-b758-035499caa839 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:12:48.359829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456da94-cc5a-41f3-b758-035499caa839 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:12:48.364380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8202de-34e7-4a04-9976-6a917aa1201d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:12:48.364964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8202de-34e7-4a04-9976-6a917aa1201d admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:48.365883 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8202de-34e7-4a04-9976-6a917aa1201d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:48.366153 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8202de-34e7-4a04-9976-6a917aa1201d admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:48.366792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8202de-34e7-4a04-9976-6a917aa1201d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 02:12:48.367096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8202de-34e7-4a04-9976-6a917aa1201d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:12:48.368709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8202de-34e7-4a04-9976-6a917aa1201d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:12:48.380307 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4437/8963] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 02:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 02:12:48.384584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65788b-d63f-46b7-b015-b3cf903b075a None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:12:48.393705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65788b-d63f-46b7-b015-b3cf903b075a None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:12:48.398989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0421465-8e9f-401f-b184-8beb23c9af47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:12:48.399587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0421465-8e9f-401f-b184-8beb23c9af47 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:48.399864 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0421465-8e9f-401f-b184-8beb23c9af47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:48.400194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0421465-8e9f-401f-b184-8beb23c9af47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:48.400827 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0421465-8e9f-401f-b184-8beb23c9af47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:12:48.402759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0421465-8e9f-401f-b184-8beb23c9af47 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:12:48.430549 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4527/8964] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 02:12:48 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 02:12:48.434977 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8202de-34e7-4a04-9976-6a917aa1201d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:12:48.445561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8202de-34e7-4a04-9976-6a917aa1201d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:12:48.503812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3a01d-4f92-4cec-8790-a54698aed192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:12:48.504441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3a01d-4f92-4cec-8790-a54698aed192 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:48.504717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3a01d-4f92-4cec-8790-a54698aed192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:48.504986 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3a01d-4f92-4cec-8790-a54698aed192 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:48.505603 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3a01d-4f92-4cec-8790-a54698aed192 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:12:48.507519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3a01d-4f92-4cec-8790-a54698aed192 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:12:48.517326 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:12:48.530614 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4438/8965] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 02:12:48 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 02:12:48.534974 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0421465-8e9f-401f-b184-8beb23c9af47 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:12:48.546093 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0421465-8e9f-401f-b184-8beb23c9af47 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:12:48.551135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed3b88-9420-4155-a1f5-94a8d3168288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:12:48.551734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed3b88-9420-4155-a1f5-94a8d3168288 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:48.552048 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed3b88-9420-4155-a1f5-94a8d3168288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:48.552325 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed3b88-9420-4155-a1f5-94a8d3168288 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:48.552973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed3b88-9420-4155-a1f5-94a8d3168288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:12:48.554653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed3b88-9420-4155-a1f5-94a8d3168288 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:12:48.564690 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4528/8966] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 02:12:48.568756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3a01d-4f92-4cec-8790-a54698aed192 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:12:48.578747 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3a01d-4f92-4cec-8790-a54698aed192 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:12:48.583340 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c70df-b4c4-4cf6-885b-6b91fe0b6050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:12:48.584468 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c70df-b4c4-4cf6-885b-6b91fe0b6050 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:48.584739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c70df-b4c4-4cf6-885b-6b91fe0b6050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:48.585035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c70df-b4c4-4cf6-885b-6b91fe0b6050 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:48.585641 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c70df-b4c4-4cf6-885b-6b91fe0b6050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:12:48.587237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c70df-b4c4-4cf6-885b-6b91fe0b6050 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:12:48.597825 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4439/8967] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 02:12:48.602668 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed3b88-9420-4155-a1f5-94a8d3168288 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:12:48.612701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed3b88-9420-4155-a1f5-94a8d3168288 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:12:48.617360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcfff9e-8666-4960-9c69-77a3dfb99cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:12:48.618002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfff9e-8666-4960-9c69-77a3dfb99cb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:48.618277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfff9e-8666-4960-9c69-77a3dfb99cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:48.618549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfff9e-8666-4960-9c69-77a3dfb99cb5 admin admin] PATH_INFO: `/v3/projects/3edbfd7c4670414297a8819d27d8f460/users/83d7434836b24535942082d965022ec4/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:48.633368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcfff9e-8666-4960-9c69-77a3dfb99cb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3edbfd7c4670414297a8819d27d8f460, user_id=83d7434836b24535942082d965022ec4, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:12:48.636072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcfff9e-8666-4960-9c69-77a3dfb99cb5 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:12:48.650709 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4529/8968] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 02:12:48 2022] PUT /identity/v3/projects/3edbfd7c4670414297a8819d27d8f460/users/83d7434836b24535942082d965022ec4/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:12:48.661891 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3f1a9-ab62-48d4-a4ae-50b058031f98 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:48.662848 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3f1a9-ab62-48d4-a4ae-50b058031f98 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:48.663188 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3f1a9-ab62-48d4-a4ae-50b058031f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:48.692310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-6ba3f1a9-ab62-48d4-a4ae-50b058031f98 None None] MFA Rules not processed for user `83d7434836b24535942082d965022ec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:12:48.693527 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6ba3f1a9-ab62-48d4-a4ae-50b058031f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:12:48.760550 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4440/8969] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:12:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:12:48.770757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcfff9e-8666-4960-9c69-77a3dfb99cb5 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:12:48.773132 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5dcfff9e-8666-4960-9c69-77a3dfb99cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:12:48.803277 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:12:48.830905 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcfff9e-8666-4960-9c69-77a3dfb99cb5 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:12:48.835240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c983ce-fc0b-4ec7-b2ef-7f7c524ee8a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:12:48.835871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c983ce-fc0b-4ec7-b2ef-7f7c524ee8a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:48.836175 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c983ce-fc0b-4ec7-b2ef-7f7c524ee8a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:48.836444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c983ce-fc0b-4ec7-b2ef-7f7c524ee8a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:48.845451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c983ce-fc0b-4ec7-b2ef-7f7c524ee8a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:12:48.846962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c983ce-fc0b-4ec7-b2ef-7f7c524ee8a8 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:12:48.857591 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4530/8970] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:12:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:12:54.612858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbc0ac-e920-491d-b387-7dfabda110f4 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:54.613303 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbc0ac-e920-491d-b387-7dfabda110f4 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:54.613516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fbc0ac-e920-491d-b387-7dfabda110f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:54.639718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-f2fbc0ac-e920-491d-b387-7dfabda110f4 None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:12:54.641782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f2fbc0ac-e920-491d-b387-7dfabda110f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:12:54.746091 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4441/8971] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 02:12:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:12:54.758209 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c983ce-fc0b-4ec7-b2ef-7f7c524ee8a8 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:12:54.759697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d7c983ce-fc0b-4ec7-b2ef-7f7c524ee8a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:12:54.775397 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c983ce-fc0b-4ec7-b2ef-7f7c524ee8a8 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:12:54.780419 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73bb291-26a4-4ace-97a6-5a6cdb23cf92 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:12:54.781043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bb291-26a4-4ace-97a6-5a6cdb23cf92 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:12:54.781323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bb291-26a4-4ace-97a6-5a6cdb23cf92 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:12:54.781599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bb291-26a4-4ace-97a6-5a6cdb23cf92 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:12:54.790898 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73bb291-26a4-4ace-97a6-5a6cdb23cf92 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:12:54.792529 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73bb291-26a4-4ace-97a6-5a6cdb23cf92 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:12:54.803774 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4531/8972] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:12:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:13:01.618567 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbc0ac-e920-491d-b387-7dfabda110f4 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:13:01.681277 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fbc0ac-e920-491d-b387-7dfabda110f4 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:13:01.685910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd76e66-4521-43d9-8ff1-bf5fd3723070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:13:01.686541 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd76e66-4521-43d9-8ff1-bf5fd3723070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:01.686820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd76e66-4521-43d9-8ff1-bf5fd3723070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:01.687092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd76e66-4521-43d9-8ff1-bf5fd3723070 admin admin] PATH_INFO: `/v3/users/83d7434836b24535942082d965022ec4` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:01.688256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd76e66-4521-43d9-8ff1-bf5fd3723070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83d7434836b24535942082d965022ec4)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:13:01.690163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd76e66-4521-43d9-8ff1-bf5fd3723070 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:13:01.695157 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:13:01.740423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3fd76e66-4521-43d9-8ff1-bf5fd3723070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83d7434836b24535942082d965022ec4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:13:01.747819 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3fd76e66-4521-43d9-8ff1-bf5fd3723070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83d7434836b24535942082d965022ec4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:13:01.759856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3fd76e66-4521-43d9-8ff1-bf5fd3723070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83d7434836b24535942082d965022ec4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:13:01.760537 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3fd76e66-4521-43d9-8ff1-bf5fd3723070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83d7434836b24535942082d965022ec4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:13:01.768117 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-3fd76e66-4521-43d9-8ff1-bf5fd3723070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83d7434836b24535942082d965022ec4'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:13:01.774382 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4442/8973] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 02:13:01 2022] DELETE /identity/v3/users/83d7434836b24535942082d965022ec4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:13:01.778923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46618ec8-eb3d-4e60-859c-3bc2a0f2ca84 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:01.779410 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46618ec8-eb3d-4e60-859c-3bc2a0f2ca84 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:01.779502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46618ec8-eb3d-4e60-859c-3bc2a0f2ca84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:01.798957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-46618ec8-eb3d-4e60-859c-3bc2a0f2ca84 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:13:01.800340 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-46618ec8-eb3d-4e60-859c-3bc2a0f2ca84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:13:01.859091 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4532/8974] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:13:01.869427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd76e66-4521-43d9-8ff1-bf5fd3723070 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:13:01.870908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3fd76e66-4521-43d9-8ff1-bf5fd3723070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:13:01.927327 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd76e66-4521-43d9-8ff1-bf5fd3723070 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:13:01.931015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d3505-9dd1-48b8-898f-73a8ee552a3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:13:01.931601 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d3505-9dd1-48b8-898f-73a8ee552a3c service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:01.931872 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d3505-9dd1-48b8-898f-73a8ee552a3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:01.932170 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d3505-9dd1-48b8-898f-73a8ee552a3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:01.941057 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d3505-9dd1-48b8-898f-73a8ee552a3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:13:01.942480 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d3505-9dd1-48b8-898f-73a8ee552a3c service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:13:01.951697 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4443/8975] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:13:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:13:02.124475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46618ec8-eb3d-4e60-859c-3bc2a0f2ca84 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:13:02.126090 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-46618ec8-eb3d-4e60-859c-3bc2a0f2ca84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:13:02.142452 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46618ec8-eb3d-4e60-859c-3bc2a0f2ca84 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:13:02.154589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61334a-f61d-4e69-ad38-8398b959b78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:13:02.155254 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61334a-f61d-4e69-ad38-8398b959b78a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:02.155526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61334a-f61d-4e69-ad38-8398b959b78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:02.155793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61334a-f61d-4e69-ad38-8398b959b78a admin admin] PATH_INFO: `/v3/projects/3edbfd7c4670414297a8819d27d8f460` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:02.156939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61334a-f61d-4e69-ad38-8398b959b78a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3edbfd7c4670414297a8819d27d8f460)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:13:02.158843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61334a-f61d-4e69-ad38-8398b959b78a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:13:02.205294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6a61334a-f61d-4e69-ad38-8398b959b78a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3edbfd7c4670414297a8819d27d8f460', 'request_id': 'req-6a61334a-f61d-4e69-ad38-8398b959b78a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:13:02.211428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6a61334a-f61d-4e69-ad38-8398b959b78a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3edbfd7c4670414297a8819d27d8f460', 'request_id': 'req-6a61334a-f61d-4e69-ad38-8398b959b78a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:13:02.217620 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6a61334a-f61d-4e69-ad38-8398b959b78a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3edbfd7c4670414297a8819d27d8f460', 'request_id': 'req-6a61334a-f61d-4e69-ad38-8398b959b78a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:13:02.230343 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6a61334a-f61d-4e69-ad38-8398b959b78a admin admin] The token cache is being invalidate because project 3edbfd7c4670414297a8819d27d8f460 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 02:13:02.230658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6a61334a-f61d-4e69-ad38-8398b959b78a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:13:02.231283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6a61334a-f61d-4e69-ad38-8398b959b78a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:13:02.232809 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4533/8976] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 02:13:02 2022] DELETE /identity/v3/projects/3edbfd7c4670414297a8819d27d8f460 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:13:02.237939 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bbb4a-c071-4155-add6-d66a63a777ce None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:02.238220 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bbb4a-c071-4155-add6-d66a63a777ce None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:02.238489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bbb4a-c071-4155-add6-d66a63a777ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:02.257789 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-531bbb4a-c071-4155-add6-d66a63a777ce None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:13:02.258963 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-531bbb4a-c071-4155-add6-d66a63a777ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:13:02.316208 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4444/8977] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:13:02.324589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d570e03-3074-4b80-8de3-384020e7935e None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:02.324870 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d570e03-3074-4b80-8de3-384020e7935e None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:02.325147 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d570e03-3074-4b80-8de3-384020e7935e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:02.345194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5d570e03-3074-4b80-8de3-384020e7935e None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:13:02.346427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5d570e03-3074-4b80-8de3-384020e7935e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:13:02.354331 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4534/8978] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:13:02.358592 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bbb4a-c071-4155-add6-d66a63a777ce None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:13:02.368392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bbb4a-c071-4155-add6-d66a63a777ce None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:13:02.373027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133ded3-4dbb-4783-ba4a-759bc479fa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:13:02.373622 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133ded3-4dbb-4783-ba4a-759bc479fa99 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:02.373900 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133ded3-4dbb-4783-ba4a-759bc479fa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:02.374172 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133ded3-4dbb-4783-ba4a-759bc479fa99 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:02.374817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133ded3-4dbb-4783-ba4a-759bc479fa99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 02:13:02.375119 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133ded3-4dbb-4783-ba4a-759bc479fa99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:13:02.376753 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133ded3-4dbb-4783-ba4a-759bc479fa99 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:13:02.389307 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4445/8979] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 02:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 02:13:02.393385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d570e03-3074-4b80-8de3-384020e7935e None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:13:02.403257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d570e03-3074-4b80-8de3-384020e7935e None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:13:02.407861 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6d053-3436-45e9-a24c-55f0a7e21bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:13:02.408484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6d053-3436-45e9-a24c-55f0a7e21bfa admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:02.408765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6d053-3436-45e9-a24c-55f0a7e21bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:02.409039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e6d053-3436-45e9-a24c-55f0a7e21bfa admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:02.409689 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6d053-3436-45e9-a24c-55f0a7e21bfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:13:02.411588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e6d053-3436-45e9-a24c-55f0a7e21bfa admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:13:02.441015 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4535/8980] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 02:13:02 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 02:13:02.443344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133ded3-4dbb-4783-ba4a-759bc479fa99 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:13:02.453671 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133ded3-4dbb-4783-ba4a-759bc479fa99 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:13:02.463151 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:13:02.511631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf44cf7-d578-46be-b9ba-176efa7c69da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:13:02.512261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf44cf7-d578-46be-b9ba-176efa7c69da admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:02.512544 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf44cf7-d578-46be-b9ba-176efa7c69da admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:02.512820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf44cf7-d578-46be-b9ba-176efa7c69da admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:02.513447 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf44cf7-d578-46be-b9ba-176efa7c69da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:13:02.515367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf44cf7-d578-46be-b9ba-176efa7c69da admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:13:02.536070 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4446/8981] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 02:13:02 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 02:13:02.540253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6d053-3436-45e9-a24c-55f0a7e21bfa admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:13:02.551673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e6d053-3436-45e9-a24c-55f0a7e21bfa admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:13:02.556378 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e33c8-2d6a-42e7-9a7a-14ac609a5d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:13:02.556956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e33c8-2d6a-42e7-9a7a-14ac609a5d54 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:02.557232 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e33c8-2d6a-42e7-9a7a-14ac609a5d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:02.557504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e33c8-2d6a-42e7-9a7a-14ac609a5d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:02.558144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e33c8-2d6a-42e7-9a7a-14ac609a5d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:13:02.559728 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e33c8-2d6a-42e7-9a7a-14ac609a5d54 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:13:02.564873 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:13:02.571310 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4536/8982] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 02:13:02.574751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf44cf7-d578-46be-b9ba-176efa7c69da admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:13:02.584630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf44cf7-d578-46be-b9ba-176efa7c69da admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:13:02.589893 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631fb2f-e5dc-46b2-8169-fa0c3095c144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:13:02.590507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631fb2f-e5dc-46b2-8169-fa0c3095c144 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:02.590782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631fb2f-e5dc-46b2-8169-fa0c3095c144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:02.591049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631fb2f-e5dc-46b2-8169-fa0c3095c144 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:02.591695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631fb2f-e5dc-46b2-8169-fa0c3095c144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:13:02.593324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631fb2f-e5dc-46b2-8169-fa0c3095c144 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:13:02.604181 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4447/8983] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 02:13:02.608262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e33c8-2d6a-42e7-9a7a-14ac609a5d54 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:13:02.618556 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e33c8-2d6a-42e7-9a7a-14ac609a5d54 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:13:02.623092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e6480-cfc3-4ac6-9c43-827b92decf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:13:02.623721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e6480-cfc3-4ac6-9c43-827b92decf6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:02.624022 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e6480-cfc3-4ac6-9c43-827b92decf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:02.624293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e6480-cfc3-4ac6-9c43-827b92decf6d admin admin] PATH_INFO: `/v3/projects/5b78ffcb4ae64e04be141bfc6c7ebfac/users/1ac407fdc1d54cfaaeb3de294cb7af92/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:02.639820 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e6480-cfc3-4ac6-9c43-827b92decf6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b78ffcb4ae64e04be141bfc6c7ebfac, user_id=1ac407fdc1d54cfaaeb3de294cb7af92, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:13:02.642488 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e6480-cfc3-4ac6-9c43-827b92decf6d admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:13:02.656565 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4537/8984] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 02:13:02 2022] PUT /identity/v3/projects/5b78ffcb4ae64e04be141bfc6c7ebfac/users/1ac407fdc1d54cfaaeb3de294cb7af92/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:13:02.666993 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25497b58-10a2-4bf8-997c-5946bdc8ad6a None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:02.667477 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25497b58-10a2-4bf8-997c-5946bdc8ad6a None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:02.667583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25497b58-10a2-4bf8-997c-5946bdc8ad6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:02.697691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-25497b58-10a2-4bf8-997c-5946bdc8ad6a None None] MFA Rules not processed for user `1ac407fdc1d54cfaaeb3de294cb7af92`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:13:02.698908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-25497b58-10a2-4bf8-997c-5946bdc8ad6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:13:02.764927 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4448/8985] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:13:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:13:02.775437 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e6480-cfc3-4ac6-9c43-827b92decf6d admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:13:02.777135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5d6e6480-cfc3-4ac6-9c43-827b92decf6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:13:02.833316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e6480-cfc3-4ac6-9c43-827b92decf6d admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:13:02.837023 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18433a6c-7116-4096-b246-97f3b92e39a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:13:02.837617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18433a6c-7116-4096-b246-97f3b92e39a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:02.837891 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18433a6c-7116-4096-b246-97f3b92e39a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:02.838154 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18433a6c-7116-4096-b246-97f3b92e39a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:02.846329 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18433a6c-7116-4096-b246-97f3b92e39a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:13:02.847752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18433a6c-7116-4096-b246-97f3b92e39a6 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:13:02.856468 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4538/8986] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:13:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:13:07.227934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25497b58-10a2-4bf8-997c-5946bdc8ad6a None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:13:07.290093 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25497b58-10a2-4bf8-997c-5946bdc8ad6a None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:13:07.294539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61729c7-78eb-45a7-b363-b6dfef259e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:13:07.295167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61729c7-78eb-45a7-b363-b6dfef259e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:07.295445 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61729c7-78eb-45a7-b363-b6dfef259e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:07.295783 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61729c7-78eb-45a7-b363-b6dfef259e1b admin admin] PATH_INFO: `/v3/users/1ac407fdc1d54cfaaeb3de294cb7af92` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:07.296968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61729c7-78eb-45a7-b363-b6dfef259e1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ac407fdc1d54cfaaeb3de294cb7af92)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:13:07.299151 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61729c7-78eb-45a7-b363-b6dfef259e1b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:13:07.321410 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:13:07.345174 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f61729c7-78eb-45a7-b363-b6dfef259e1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ac407fdc1d54cfaaeb3de294cb7af92'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:13:07.352794 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f61729c7-78eb-45a7-b363-b6dfef259e1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ac407fdc1d54cfaaeb3de294cb7af92'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:13:07.364691 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f61729c7-78eb-45a7-b363-b6dfef259e1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ac407fdc1d54cfaaeb3de294cb7af92'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:13:07.365379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f61729c7-78eb-45a7-b363-b6dfef259e1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ac407fdc1d54cfaaeb3de294cb7af92'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:13:07.372661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-f61729c7-78eb-45a7-b363-b6dfef259e1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ac407fdc1d54cfaaeb3de294cb7af92'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:13:07.378723 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4449/8987] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 02:13:07 2022] DELETE /identity/v3/users/1ac407fdc1d54cfaaeb3de294cb7af92 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:13:07.383126 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407741d-8259-41bd-ad26-da47473a95f5 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:07.383601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407741d-8259-41bd-ad26-da47473a95f5 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:07.383690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407741d-8259-41bd-ad26-da47473a95f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:07.402546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d407741d-8259-41bd-ad26-da47473a95f5 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:13:07.403746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d407741d-8259-41bd-ad26-da47473a95f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:13:07.468556 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4539/8988] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:13:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:13:07.479575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61729c7-78eb-45a7-b363-b6dfef259e1b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:13:07.481092 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f61729c7-78eb-45a7-b363-b6dfef259e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:13:07.543625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61729c7-78eb-45a7-b363-b6dfef259e1b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:13:07.547184 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d6cd3-4505-4b39-88e6-e008cfc2dc47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:13:07.547797 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d6cd3-4505-4b39-88e6-e008cfc2dc47 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:07.548103 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d6cd3-4505-4b39-88e6-e008cfc2dc47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:07.548657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d6cd3-4505-4b39-88e6-e008cfc2dc47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:07.558317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d6cd3-4505-4b39-88e6-e008cfc2dc47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:13:07.559771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d6cd3-4505-4b39-88e6-e008cfc2dc47 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:13:07.570526 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4450/8989] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:13:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:13:07.739809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407741d-8259-41bd-ad26-da47473a95f5 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:13:07.741321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d407741d-8259-41bd-ad26-da47473a95f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:13:07.753969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407741d-8259-41bd-ad26-da47473a95f5 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:13:07.759114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcaba9e-9ba1-4300-a6b9-3df17975708c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:13:07.759755 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaba9e-9ba1-4300-a6b9-3df17975708c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:07.760047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaba9e-9ba1-4300-a6b9-3df17975708c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:07.760748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaba9e-9ba1-4300-a6b9-3df17975708c admin admin] PATH_INFO: `/v3/projects/5b78ffcb4ae64e04be141bfc6c7ebfac` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:07.761425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcaba9e-9ba1-4300-a6b9-3df17975708c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b78ffcb4ae64e04be141bfc6c7ebfac)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:13:07.763324 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcaba9e-9ba1-4300-a6b9-3df17975708c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:13:07.810934 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3dcaba9e-9ba1-4300-a6b9-3df17975708c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b78ffcb4ae64e04be141bfc6c7ebfac', 'request_id': 'req-3dcaba9e-9ba1-4300-a6b9-3df17975708c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:13:07.816279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3dcaba9e-9ba1-4300-a6b9-3df17975708c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b78ffcb4ae64e04be141bfc6c7ebfac', 'request_id': 'req-3dcaba9e-9ba1-4300-a6b9-3df17975708c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:13:07.823777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3dcaba9e-9ba1-4300-a6b9-3df17975708c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b78ffcb4ae64e04be141bfc6c7ebfac', 'request_id': 'req-3dcaba9e-9ba1-4300-a6b9-3df17975708c'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:13:07.834977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3dcaba9e-9ba1-4300-a6b9-3df17975708c admin admin] The token cache is being invalidate because project 5b78ffcb4ae64e04be141bfc6c7ebfac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 02:13:07.835264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3dcaba9e-9ba1-4300-a6b9-3df17975708c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:13:07.836453 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-3dcaba9e-9ba1-4300-a6b9-3df17975708c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:13:07.839505 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4540/8990] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 02:13:07 2022] DELETE /identity/v3/projects/5b78ffcb4ae64e04be141bfc6c7ebfac => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:13:07.844483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaafa96-8d41-4451-9b0b-4cfe5eba963c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:07.844837 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaafa96-8d41-4451-9b0b-4cfe5eba963c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:07.845181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaafa96-8d41-4451-9b0b-4cfe5eba963c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:07.867237 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-bcaafa96-8d41-4451-9b0b-4cfe5eba963c None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:13:07.868483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bcaafa96-8d41-4451-9b0b-4cfe5eba963c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:13:07.932217 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4451/8991] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:13:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:13:07.940007 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f1a4c-6b9b-4840-bd97-d630a564b7ea None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:07.940298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f1a4c-6b9b-4840-bd97-d630a564b7ea None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:07.940576 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f1a4c-6b9b-4840-bd97-d630a564b7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:07.948851 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:13:07.963151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d98f1a4c-6b9b-4840-bd97-d630a564b7ea None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:13:07.964478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d98f1a4c-6b9b-4840-bd97-d630a564b7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:13:07.972655 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4541/8992] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:13:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:13:07.977010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaafa96-8d41-4451-9b0b-4cfe5eba963c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:13:07.987367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaafa96-8d41-4451-9b0b-4cfe5eba963c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:13:07.992501 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385ff59-e638-4321-9d6e-0c0b926d08b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:13:07.993132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385ff59-e638-4321-9d6e-0c0b926d08b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:07.993408 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385ff59-e638-4321-9d6e-0c0b926d08b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:07.993678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385ff59-e638-4321-9d6e-0c0b926d08b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:07.994326 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f385ff59-e638-4321-9d6e-0c0b926d08b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 02:13:07.994629 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f385ff59-e638-4321-9d6e-0c0b926d08b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:13:07.996273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f385ff59-e638-4321-9d6e-0c0b926d08b9 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:13:08.008497 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4452/8993] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 02:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 02:13:08.012899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f1a4c-6b9b-4840-bd97-d630a564b7ea None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:13:08.022440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f1a4c-6b9b-4840-bd97-d630a564b7ea None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:13:08.027161 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e81aa-9064-450e-8e82-d55e8143a517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:13:08.027754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e81aa-9064-450e-8e82-d55e8143a517 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:08.028072 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e81aa-9064-450e-8e82-d55e8143a517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:08.028348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e81aa-9064-450e-8e82-d55e8143a517 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:08.028977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e81aa-9064-450e-8e82-d55e8143a517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:13:08.030872 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e81aa-9064-450e-8e82-d55e8143a517 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:13:08.058295 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4542/8994] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 02:13:08 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 02:13:08.062508 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385ff59-e638-4321-9d6e-0c0b926d08b9 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:13:08.073059 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385ff59-e638-4321-9d6e-0c0b926d08b9 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:13:08.101232 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:13:08.130709 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5d400-3b79-4bae-831c-bebba940acbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:13:08.131302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5d400-3b79-4bae-831c-bebba940acbc admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:08.131588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5d400-3b79-4bae-831c-bebba940acbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:08.131849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5d400-3b79-4bae-831c-bebba940acbc admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:08.133077 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5d400-3b79-4bae-831c-bebba940acbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:13:08.134975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5d400-3b79-4bae-831c-bebba940acbc admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:13:08.154700 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4453/8995] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 02:13:08 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 02:13:08.158849 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e81aa-9064-450e-8e82-d55e8143a517 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:13:08.169312 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e81aa-9064-450e-8e82-d55e8143a517 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:13:08.174262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95de409-63e8-4433-8374-73499a904791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:13:08.174850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95de409-63e8-4433-8374-73499a904791 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:08.175123 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95de409-63e8-4433-8374-73499a904791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:08.175388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95de409-63e8-4433-8374-73499a904791 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:08.176059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95de409-63e8-4433-8374-73499a904791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:13:08.177672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95de409-63e8-4433-8374-73499a904791 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:13:08.188633 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4543/8996] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 02:13:08.194045 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5d400-3b79-4bae-831c-bebba940acbc admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:13:08.209021 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5d400-3b79-4bae-831c-bebba940acbc admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:13:08.213889 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0e6c2-fa64-4f6f-902d-960db6511d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:13:08.214472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0e6c2-fa64-4f6f-902d-960db6511d12 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:08.214753 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0e6c2-fa64-4f6f-902d-960db6511d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:08.215024 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0e6c2-fa64-4f6f-902d-960db6511d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:08.215677 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0e6c2-fa64-4f6f-902d-960db6511d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:13:08.217359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0e6c2-fa64-4f6f-902d-960db6511d12 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:13:08.228584 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4454/8997] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 02:13:08.232957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95de409-63e8-4433-8374-73499a904791 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:13:08.243627 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95de409-63e8-4433-8374-73499a904791 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:13:08.248249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad053a41-cb38-4f4e-a408-4010fe5f4a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:13:08.248893 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad053a41-cb38-4f4e-a408-4010fe5f4a2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:08.249165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad053a41-cb38-4f4e-a408-4010fe5f4a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:08.249432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad053a41-cb38-4f4e-a408-4010fe5f4a2a admin admin] PATH_INFO: `/v3/projects/c3c7f99169cd47ae9f3020313f4796df/users/047c577e2fcd44f88da514da4a3492ec/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:08.263604 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad053a41-cb38-4f4e-a408-4010fe5f4a2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c7f99169cd47ae9f3020313f4796df, user_id=047c577e2fcd44f88da514da4a3492ec, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:13:08.266271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad053a41-cb38-4f4e-a408-4010fe5f4a2a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:13:08.279231 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4544/8998] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 02:13:08 2022] PUT /identity/v3/projects/c3c7f99169cd47ae9f3020313f4796df/users/047c577e2fcd44f88da514da4a3492ec/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 02:13:08.284228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a2412-cad7-44f0-8ae5-851b70595693 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:08.284520 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a2412-cad7-44f0-8ae5-851b70595693 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:08.284798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a2412-cad7-44f0-8ae5-851b70595693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:08.304147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-794a2412-cad7-44f0-8ae5-851b70595693 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:13:08.305927 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-794a2412-cad7-44f0-8ae5-851b70595693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:13:08.364449 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4455/8999] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:13:08.374598 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad053a41-cb38-4f4e-a408-4010fe5f4a2a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:13:08.376376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ad053a41-cb38-4f4e-a408-4010fe5f4a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:13:08.433696 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad053a41-cb38-4f4e-a408-4010fe5f4a2a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:13:08.437501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641c44a-c948-4851-a534-8bd3c0bf1dd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:13:08.438107 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641c44a-c948-4851-a534-8bd3c0bf1dd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:08.438381 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641c44a-c948-4851-a534-8bd3c0bf1dd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:08.438673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641c44a-c948-4851-a534-8bd3c0bf1dd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:08.447608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641c44a-c948-4851-a534-8bd3c0bf1dd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:13:08.449064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641c44a-c948-4851-a534-8bd3c0bf1dd5 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:13:08.458528 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4545/9000] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:13:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:13:12.543244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c00c73-b73d-4e73-a39b-024c258b65a6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:12.543725 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c00c73-b73d-4e73-a39b-024c258b65a6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:12.543817 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c00c73-b73d-4e73-a39b-024c258b65a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:12.577683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-17c00c73-b73d-4e73-a39b-024c258b65a6 None None] MFA Rules not processed for user `047c577e2fcd44f88da514da4a3492ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:13:12.579003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-17c00c73-b73d-4e73-a39b-024c258b65a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:13:12.659823 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4456/9001] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:13:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:13:12.665151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641c44a-c948-4851-a534-8bd3c0bf1dd5 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:13:12.677581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641c44a-c948-4851-a534-8bd3c0bf1dd5 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:13:12.683265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c92a22-c8e9-4402-88a9-716ab5a91f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:13:12.683940 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c92a22-c8e9-4402-88a9-716ab5a91f65 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:12.684209 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c92a22-c8e9-4402-88a9-716ab5a91f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:12.684484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c92a22-c8e9-4402-88a9-716ab5a91f65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:12.685125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c92a22-c8e9-4402-88a9-716ab5a91f65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:13:12.687054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c92a22-c8e9-4402-88a9-716ab5a91f65 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:13:12.717755 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4546/9002] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 02:13:12 2022] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 02:13:12.721877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c00c73-b73d-4e73-a39b-024c258b65a6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:13:12.734231 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c00c73-b73d-4e73-a39b-024c258b65a6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:13:12.779783 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:13:12.801558 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf47d1-9018-4c1b-89c1-b435487c84cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:13:12.802167 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf47d1-9018-4c1b-89c1-b435487c84cb admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:12.802464 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf47d1-9018-4c1b-89c1-b435487c84cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:12.802740 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf47d1-9018-4c1b-89c1-b435487c84cb admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:12.803374 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf47d1-9018-4c1b-89c1-b435487c84cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:13:12.805941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf47d1-9018-4c1b-89c1-b435487c84cb admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:13:12.832371 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4457/9003] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 02:13:12 2022] POST /identity/v3/users => generated 301 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 02:13:12.836634 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c92a22-c8e9-4402-88a9-716ab5a91f65 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:13:12.849231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c92a22-c8e9-4402-88a9-716ab5a91f65 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:13:12.854949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677db51-5cf7-4c6b-a660-44c97d8ae8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:13:12.855721 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677db51-5cf7-4c6b-a660-44c97d8ae8d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:12.856129 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677db51-5cf7-4c6b-a660-44c97d8ae8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:12.856467 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677db51-5cf7-4c6b-a660-44c97d8ae8d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:12.857298 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677db51-5cf7-4c6b-a660-44c97d8ae8d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:13:12.859065 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677db51-5cf7-4c6b-a660-44c97d8ae8d6 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:13:12.875931 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4547/9004] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 02:13:12.879529 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf47d1-9018-4c1b-89c1-b435487c84cb admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:13:12.892664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf47d1-9018-4c1b-89c1-b435487c84cb admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:13:12.898791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df524d-808b-4775-96b1-da309bfa6258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:13:12.900007 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df524d-808b-4775-96b1-da309bfa6258 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:12.900363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df524d-808b-4775-96b1-da309bfa6258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:12.900705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df524d-808b-4775-96b1-da309bfa6258 admin admin] PATH_INFO: `/v3/projects/106b7f255a654614b35b298ad9aba2b5/users/a4a405ec56eb4af0a8012573d271d6d7/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:12.919322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df524d-808b-4775-96b1-da309bfa6258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=106b7f255a654614b35b298ad9aba2b5, user_id=a4a405ec56eb4af0a8012573d271d6d7, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:13:12.922065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df524d-808b-4775-96b1-da309bfa6258 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:13:12.938073 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4458/9005] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 02:13:12 2022] PUT /identity/v3/projects/106b7f255a654614b35b298ad9aba2b5/users/a4a405ec56eb4af0a8012573d271d6d7/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 02:13:12.942223 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677db51-5cf7-4c6b-a660-44c97d8ae8d6 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:13:12.953033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677db51-5cf7-4c6b-a660-44c97d8ae8d6 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:13:13.026967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3304d-4650-434f-a4dc-0ad487828df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:13:13.027442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3304d-4650-434f-a4dc-0ad487828df2 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:13.027710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3304d-4650-434f-a4dc-0ad487828df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:13.028061 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3304d-4650-434f-a4dc-0ad487828df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:13.028710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3304d-4650-434f-a4dc-0ad487828df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:13:13.030434 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3304d-4650-434f-a4dc-0ad487828df2 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:13:13.046036 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4548/9006] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 02:13:13.047182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df524d-808b-4775-96b1-da309bfa6258 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:13:13.058705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df524d-808b-4775-96b1-da309bfa6258 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:13:13.063472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf4c5c-34d7-4f78-9652-5361c3ce8bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:13:13.064158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf4c5c-34d7-4f78-9652-5361c3ce8bb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:13.064438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf4c5c-34d7-4f78-9652-5361c3ce8bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:13.065068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf4c5c-34d7-4f78-9652-5361c3ce8bb3 admin admin] PATH_INFO: `/v3/projects/106b7f255a654614b35b298ad9aba2b5/users/a4a405ec56eb4af0a8012573d271d6d7/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:13.066964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf4c5c-34d7-4f78-9652-5361c3ce8bb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=106b7f255a654614b35b298ad9aba2b5, user_id=a4a405ec56eb4af0a8012573d271d6d7, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:13:13.069651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf4c5c-34d7-4f78-9652-5361c3ce8bb3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:13:13.080307 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4459/9007] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 02:13:13 2022] PUT /identity/v3/projects/106b7f255a654614b35b298ad9aba2b5/users/a4a405ec56eb4af0a8012573d271d6d7/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:13:17.620875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087896c0-20d3-4c87-964d-0ddd0bf180bd None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:17.621701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087896c0-20d3-4c87-964d-0ddd0bf180bd None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:17.621701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087896c0-20d3-4c87-964d-0ddd0bf180bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:17.633573 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:13:17.663349 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-087896c0-20d3-4c87-964d-0ddd0bf180bd None None] MFA Rules not processed for user `a4a405ec56eb4af0a8012573d271d6d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:13:17.664748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-087896c0-20d3-4c87-964d-0ddd0bf180bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:13:17.752118 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4549/9008] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:13:17 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:13:17.766852 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf4c5c-34d7-4f78-9652-5361c3ce8bb3 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:13:17.768555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9baf4c5c-34d7-4f78-9652-5361c3ce8bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:13:17.854936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf4c5c-34d7-4f78-9652-5361c3ce8bb3 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:13:17.860616 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18bd916-a34a-47ec-95c9-122fdcf9db84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:13:17.861253 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bd916-a34a-47ec-95c9-122fdcf9db84 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:17.861531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bd916-a34a-47ec-95c9-122fdcf9db84 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:17.861793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18bd916-a34a-47ec-95c9-122fdcf9db84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:17.921666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18bd916-a34a-47ec-95c9-122fdcf9db84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:13:17.923259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18bd916-a34a-47ec-95c9-122fdcf9db84 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:13:17.933003 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4460/9009] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:13:17 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:13:18.007667 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997568c-7266-4e77-948f-2f29daa1262c None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:18.008475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997568c-7266-4e77-948f-2f29daa1262c None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:18.010018 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997568c-7266-4e77-948f-2f29daa1262c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:18.030052 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-9997568c-7266-4e77-948f-2f29daa1262c None None] MFA Rules not processed for user `047c577e2fcd44f88da514da4a3492ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:13:18.031261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9997568c-7266-4e77-948f-2f29daa1262c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:13:18.038354 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4550/9010] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:13:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:13:27.928582 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=82,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:13:28.023939 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=35 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:13:28.649522 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d9130-0d4b-4fbb-8170-621637f2ea36 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:28.649812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d9130-0d4b-4fbb-8170-621637f2ea36 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:28.650113 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d9130-0d4b-4fbb-8170-621637f2ea36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:28.699200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0f6d9130-0d4b-4fbb-8170-621637f2ea36 None None] MFA Rules not processed for user `9a8be18e03a54bd8821ed5c048bbc793`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:13:28.700423 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0f6d9130-0d4b-4fbb-8170-621637f2ea36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:13:28.760425 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4461/9011] 10.222.0.39 () {58 vars in 1061 bytes} [Sun Aug 7 02:13:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 02:13:28.766284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997568c-7266-4e77-948f-2f29daa1262c None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:13:28.775525 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997568c-7266-4e77-948f-2f29daa1262c None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:13:28.779006 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35059e86-025a-4e39-87d8-e6ae66b6ea77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a8be18e03a54bd8821ed5c048bbc793', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:13:28.779592 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35059e86-025a-4e39-87d8-e6ae66b6ea77 service cinder] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:28.779861 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35059e86-025a-4e39-87d8-e6ae66b6ea77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:28.780156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35059e86-025a-4e39-87d8-e6ae66b6ea77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:28.788756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35059e86-025a-4e39-87d8-e6ae66b6ea77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:13:28.790654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35059e86-025a-4e39-87d8-e6ae66b6ea77 service cinder] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:13:28.799800 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4551/9012] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:13:28 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:13:38.758475 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=38 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:13:38.795661 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:13:52.839177 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d9130-0d4b-4fbb-8170-621637f2ea36 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:13:52.840652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0f6d9130-0d4b-4fbb-8170-621637f2ea36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:13:52.857125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d9130-0d4b-4fbb-8170-621637f2ea36 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:13:52.863362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac6525-ed0c-48d6-ae8f-d561c04f16e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:13:52.864638 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac6525-ed0c-48d6-ae8f-d561c04f16e0 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:52.864923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac6525-ed0c-48d6-ae8f-d561c04f16e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:52.865200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac6525-ed0c-48d6-ae8f-d561c04f16e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:52.867383 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-beac6525-ed0c-48d6-ae8f-d561c04f16e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:13:52.881023 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac6525-ed0c-48d6-ae8f-d561c04f16e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:13:52.882612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac6525-ed0c-48d6-ae8f-d561c04f16e0 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:13:52.894070 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4462/9013] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:13:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:13:54.220244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f69ba-2908-4099-8786-a9ba45861ea7 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:54.220761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f69ba-2908-4099-8786-a9ba45861ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:54.220875 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f69ba-2908-4099-8786-a9ba45861ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:54.239519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-aa7f69ba-2908-4099-8786-a9ba45861ea7 None None] MFA Rules not processed for user `047c577e2fcd44f88da514da4a3492ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:13:54.240659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-aa7f69ba-2908-4099-8786-a9ba45861ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:13:54.253848 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4552/9014] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:13:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:13:54.815331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac6525-ed0c-48d6-ae8f-d561c04f16e0 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:13:54.816854 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-beac6525-ed0c-48d6-ae8f-d561c04f16e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:13:54.885759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac6525-ed0c-48d6-ae8f-d561c04f16e0 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:13:54.890736 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143423c-ab68-4c29-85d9-a496164943e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:13:54.891335 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143423c-ab68-4c29-85d9-a496164943e3 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:54.891610 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143423c-ab68-4c29-85d9-a496164943e3 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:54.891874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143423c-ab68-4c29-85d9-a496164943e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:54.893598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f143423c-ab68-4c29-85d9-a496164943e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:13:54.904480 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143423c-ab68-4c29-85d9-a496164943e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:13:54.906028 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143423c-ab68-4c29-85d9-a496164943e3 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:13:54.915532 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4463/9015] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:13:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:13:56.669920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f69ba-2908-4099-8786-a9ba45861ea7 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:13:56.727470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f69ba-2908-4099-8786-a9ba45861ea7 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:13:56.731807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934089b-cd93-4273-ab4d-b2806414dac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:13:56.732461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934089b-cd93-4273-ab4d-b2806414dac5 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:13:56.732741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934089b-cd93-4273-ab4d-b2806414dac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:13:56.733012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934089b-cd93-4273-ab4d-b2806414dac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:13:56.734793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6934089b-cd93-4273-ab4d-b2806414dac5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:13:56.745009 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934089b-cd93-4273-ab4d-b2806414dac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:13:56.746369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934089b-cd93-4273-ab4d-b2806414dac5 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:13:56.754499 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4553/9016] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:13:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:14:02.706185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143423c-ab68-4c29-85d9-a496164943e3 service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:14:02.720621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143423c-ab68-4c29-85d9-a496164943e3 service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:14:02.726148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e0c6d-e6ff-40b2-812c-8abf503b9ae5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:14:02.726753 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e0c6d-e6ff-40b2-812c-8abf503b9ae5 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:14:02.727038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e0c6d-e6ff-40b2-812c-8abf503b9ae5 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:14:02.727320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e0c6d-e6ff-40b2-812c-8abf503b9ae5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:14:02.729364 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-072e0c6d-e6ff-40b2-812c-8abf503b9ae5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:14:02.753754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e0c6d-e6ff-40b2-812c-8abf503b9ae5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:14:02.755349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e0c6d-e6ff-40b2-812c-8abf503b9ae5 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:14:02.767552 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4464/9017] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:14:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:14:06.751019 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=29 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:14:12.762015 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=48 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:14:29.567217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9428d-1615-4580-af52-6e09b54b17a6 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:14:29.567713 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9428d-1615-4580-af52-6e09b54b17a6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:14:29.567815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9428d-1615-4580-af52-6e09b54b17a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:14:29.586406 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-bfb9428d-1615-4580-af52-6e09b54b17a6 None None] MFA Rules not processed for user `047c577e2fcd44f88da514da4a3492ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:14:29.587603 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-bfb9428d-1615-4580-af52-6e09b54b17a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:14:29.611016 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4554/9018] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:14:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:14:30.170296 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e0c6d-e6ff-40b2-812c-8abf503b9ae5 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:14:30.171816 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-072e0c6d-e6ff-40b2-812c-8abf503b9ae5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:14:30.236611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e0c6d-e6ff-40b2-812c-8abf503b9ae5 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:14:30.241687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c424e-2e8b-4552-8dfa-c3b4a61a2ed3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:14:30.242289 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c424e-2e8b-4552-8dfa-c3b4a61a2ed3 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:14:30.242571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c424e-2e8b-4552-8dfa-c3b4a61a2ed3 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:14:30.242840 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c424e-2e8b-4552-8dfa-c3b4a61a2ed3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:14:30.244620 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5d8c424e-2e8b-4552-8dfa-c3b4a61a2ed3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:14:30.255748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c424e-2e8b-4552-8dfa-c3b4a61a2ed3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:14:30.257338 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c424e-2e8b-4552-8dfa-c3b4a61a2ed3 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:14:30.267529 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4465/9019] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:14:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:14:39.609023 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=11 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:14:40.263989 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=24 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:15:12.416346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9428d-1615-4580-af52-6e09b54b17a6 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:15:12.493528 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9428d-1615-4580-af52-6e09b54b17a6 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:15:12.498012 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64223e59-f51e-4ce7-af71-d620e3c31bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:15:12.498633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64223e59-f51e-4ce7-af71-d620e3c31bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:15:12.498906 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64223e59-f51e-4ce7-af71-d620e3c31bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:15:12.499175 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64223e59-f51e-4ce7-af71-d620e3c31bff admin admin] PATH_INFO: `/v3/users/047c577e2fcd44f88da514da4a3492ec` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:15:12.500811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64223e59-f51e-4ce7-af71-d620e3c31bff admin admin] RBAC: Authorizing `identity:delete_user(user_id=047c577e2fcd44f88da514da4a3492ec)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:15:12.502710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64223e59-f51e-4ce7-af71-d620e3c31bff admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:15:12.547566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-64223e59-f51e-4ce7-af71-d620e3c31bff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '047c577e2fcd44f88da514da4a3492ec'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:15:12.554521 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-64223e59-f51e-4ce7-af71-d620e3c31bff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '047c577e2fcd44f88da514da4a3492ec'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:15:12.566873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-64223e59-f51e-4ce7-af71-d620e3c31bff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '047c577e2fcd44f88da514da4a3492ec'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:15:12.567536 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-64223e59-f51e-4ce7-af71-d620e3c31bff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '047c577e2fcd44f88da514da4a3492ec'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:15:12.574704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-64223e59-f51e-4ce7-af71-d620e3c31bff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '047c577e2fcd44f88da514da4a3492ec'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:15:12.581199 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4555/9020] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 02:15:12 2022] DELETE /identity/v3/users/047c577e2fcd44f88da514da4a3492ec => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:15:12.763965 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c424e-2e8b-4552-8dfa-c3b4a61a2ed3 service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:15:12.775809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c424e-2e8b-4552-8dfa-c3b4a61a2ed3 service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:15:12.840637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318f8d8-99b8-4c46-b1d6-5be26bc49b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:15:12.841274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318f8d8-99b8-4c46-b1d6-5be26bc49b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:15:12.841554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318f8d8-99b8-4c46-b1d6-5be26bc49b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:15:12.841829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318f8d8-99b8-4c46-b1d6-5be26bc49b5a admin admin] PATH_INFO: `/v3/projects/c3c7f99169cd47ae9f3020313f4796df` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:15:12.843013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a318f8d8-99b8-4c46-b1d6-5be26bc49b5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3c7f99169cd47ae9f3020313f4796df)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:15:12.844940 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a318f8d8-99b8-4c46-b1d6-5be26bc49b5a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:15:12.893131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a318f8d8-99b8-4c46-b1d6-5be26bc49b5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3c7f99169cd47ae9f3020313f4796df', 'request_id': 'req-a318f8d8-99b8-4c46-b1d6-5be26bc49b5a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:15:12.898606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a318f8d8-99b8-4c46-b1d6-5be26bc49b5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3c7f99169cd47ae9f3020313f4796df', 'request_id': 'req-a318f8d8-99b8-4c46-b1d6-5be26bc49b5a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:15:12.904867 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a318f8d8-99b8-4c46-b1d6-5be26bc49b5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3c7f99169cd47ae9f3020313f4796df', 'request_id': 'req-a318f8d8-99b8-4c46-b1d6-5be26bc49b5a'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:15:12.931804 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a318f8d8-99b8-4c46-b1d6-5be26bc49b5a admin admin] The token cache is being invalidate because project c3c7f99169cd47ae9f3020313f4796df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 02:15:12.932058 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a318f8d8-99b8-4c46-b1d6-5be26bc49b5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:15:12.932695 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-a318f8d8-99b8-4c46-b1d6-5be26bc49b5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:15:12.934209 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4466/9021] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 02:15:12 2022] DELETE /identity/v3/projects/c3c7f99169cd47ae9f3020313f4796df => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:15:12.939284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64223e59-f51e-4ce7-af71-d620e3c31bff admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:15:12.940732 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-64223e59-f51e-4ce7-af71-d620e3c31bff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:15:12.954441 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64223e59-f51e-4ce7-af71-d620e3c31bff admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:15:13.010657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0afdb7d-e37b-4790-ac51-ff9bc4ac2b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:15:13.011288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afdb7d-e37b-4790-ac51-ff9bc4ac2b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:15:13.011564 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afdb7d-e37b-4790-ac51-ff9bc4ac2b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:15:13.011834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0afdb7d-e37b-4790-ac51-ff9bc4ac2b6b admin admin] PATH_INFO: `/v3/users/a4a405ec56eb4af0a8012573d271d6d7` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:15:13.013056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0afdb7d-e37b-4790-ac51-ff9bc4ac2b6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4a405ec56eb4af0a8012573d271d6d7)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:15:13.014968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0afdb7d-e37b-4790-ac51-ff9bc4ac2b6b admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:15:13.026992 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:15:13.063170 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a0afdb7d-e37b-4790-ac51-ff9bc4ac2b6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4a405ec56eb4af0a8012573d271d6d7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:15:13.070079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a0afdb7d-e37b-4790-ac51-ff9bc4ac2b6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4a405ec56eb4af0a8012573d271d6d7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:15:13.081698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a0afdb7d-e37b-4790-ac51-ff9bc4ac2b6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4a405ec56eb4af0a8012573d271d6d7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:15:13.082367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a0afdb7d-e37b-4790-ac51-ff9bc4ac2b6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4a405ec56eb4af0a8012573d271d6d7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:15:13.089599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-a0afdb7d-e37b-4790-ac51-ff9bc4ac2b6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4a405ec56eb4af0a8012573d271d6d7'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:15:13.096086 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4556/9022] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 02:15:12 2022] DELETE /identity/v3/users/a4a405ec56eb4af0a8012573d271d6d7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:15:13.268358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318f8d8-99b8-4c46-b1d6-5be26bc49b5a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:15:13.270104 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a318f8d8-99b8-4c46-b1d6-5be26bc49b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:15:13.283978 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318f8d8-99b8-4c46-b1d6-5be26bc49b5a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:15:13.365424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04386c3-7b45-4607-9e17-1da6fb78e690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:15:13.366059 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04386c3-7b45-4607-9e17-1da6fb78e690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:15:13.366338 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04386c3-7b45-4607-9e17-1da6fb78e690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:15:13.366611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04386c3-7b45-4607-9e17-1da6fb78e690 admin admin] PATH_INFO: `/v3/projects/106b7f255a654614b35b298ad9aba2b5` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:15:13.367732 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04386c3-7b45-4607-9e17-1da6fb78e690 admin admin] RBAC: Authorizing `identity:delete_project(project_id=106b7f255a654614b35b298ad9aba2b5)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:15:13.369680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04386c3-7b45-4607-9e17-1da6fb78e690 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:15:13.393045 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:15:13.416597 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b04386c3-7b45-4607-9e17-1da6fb78e690 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '106b7f255a654614b35b298ad9aba2b5', 'request_id': 'req-b04386c3-7b45-4607-9e17-1da6fb78e690'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:15:13.422148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b04386c3-7b45-4607-9e17-1da6fb78e690 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '106b7f255a654614b35b298ad9aba2b5', 'request_id': 'req-b04386c3-7b45-4607-9e17-1da6fb78e690'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:15:13.428470 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b04386c3-7b45-4607-9e17-1da6fb78e690 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '106b7f255a654614b35b298ad9aba2b5', 'request_id': 'req-b04386c3-7b45-4607-9e17-1da6fb78e690'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:15:13.441856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b04386c3-7b45-4607-9e17-1da6fb78e690 admin admin] The token cache is being invalidate because project 106b7f255a654614b35b298ad9aba2b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 02:15:13.442082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b04386c3-7b45-4607-9e17-1da6fb78e690 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:15:13.442705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-b04386c3-7b45-4607-9e17-1da6fb78e690 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:15:13.444244 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4467/9023] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 02:15:13 2022] DELETE /identity/v3/projects/106b7f255a654614b35b298ad9aba2b5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:15:13.449252 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecfd3d-c71f-43c9-9c43-d8061b3bcbd6 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:15:13.449776 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecfd3d-c71f-43c9-9c43-d8061b3bcbd6 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:15:13.449874 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecfd3d-c71f-43c9-9c43-d8061b3bcbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:15:13.507001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-93ecfd3d-c71f-43c9-9c43-d8061b3bcbd6 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:15:13.508244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-93ecfd3d-c71f-43c9-9c43-d8061b3bcbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:15:13.567195 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4557/9024] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:15:13.575064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190013b-7b6a-40c7-839f-8ba618b90a54 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:15:13.575346 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190013b-7b6a-40c7-839f-8ba618b90a54 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:15:13.575617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190013b-7b6a-40c7-839f-8ba618b90a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:15:13.594915 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-c190013b-7b6a-40c7-839f-8ba618b90a54 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:15:13.596135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c190013b-7b6a-40c7-839f-8ba618b90a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:15:13.603877 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4468/9025] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:15:13.607963 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ecfd3d-c71f-43c9-9c43-d8061b3bcbd6 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:15:13.618125 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ecfd3d-c71f-43c9-9c43-d8061b3bcbd6 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:15:13.623576 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ec737-44b3-49f6-a619-633f6bf179c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:15:13.624211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ec737-44b3-49f6-a619-633f6bf179c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:15:13.624493 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ec737-44b3-49f6-a619-633f6bf179c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:15:13.624764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ec737-44b3-49f6-a619-633f6bf179c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:15:13.625938 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ec737-44b3-49f6-a619-633f6bf179c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 02:15:13.626239 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ec737-44b3-49f6-a619-633f6bf179c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:15:13.627865 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ec737-44b3-49f6-a619-633f6bf179c2 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:15:13.642489 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4558/9026] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 02:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 07 02:15:13.647425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190013b-7b6a-40c7-839f-8ba618b90a54 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:15:13.657796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190013b-7b6a-40c7-839f-8ba618b90a54 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:15:13.662492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09537f60-6498-46ab-924a-c4c6eda7f7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:15:13.663088 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09537f60-6498-46ab-924a-c4c6eda7f7ae admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:15:13.663362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09537f60-6498-46ab-924a-c4c6eda7f7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:15:13.663630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09537f60-6498-46ab-924a-c4c6eda7f7ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:15:13.664294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09537f60-6498-46ab-924a-c4c6eda7f7ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:15:13.666211 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09537f60-6498-46ab-924a-c4c6eda7f7ae admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:15:13.702987 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4469/9027] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 02:15:13 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 02:15:13.707365 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ec737-44b3-49f6-a619-633f6bf179c2 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:15:13.717361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ec737-44b3-49f6-a619-633f6bf179c2 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:15:13.760722 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:15:13.774085 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26048ff-8699-4256-bda8-9ecd0983e008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:15:13.774717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26048ff-8699-4256-bda8-9ecd0983e008 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:15:13.774999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26048ff-8699-4256-bda8-9ecd0983e008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:15:13.775273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26048ff-8699-4256-bda8-9ecd0983e008 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:15:13.775913 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26048ff-8699-4256-bda8-9ecd0983e008 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:15:13.777903 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26048ff-8699-4256-bda8-9ecd0983e008 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:15:13.799517 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4559/9028] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 02:15:13 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 02:15:13.803171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09537f60-6498-46ab-924a-c4c6eda7f7ae admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:15:13.814443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09537f60-6498-46ab-924a-c4c6eda7f7ae admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:15:13.819114 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ddfa0-6eb1-4ffc-bdd5-24320f51c913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:15:13.819706 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ddfa0-6eb1-4ffc-bdd5-24320f51c913 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:15:13.820016 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ddfa0-6eb1-4ffc-bdd5-24320f51c913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:15:13.820285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ddfa0-6eb1-4ffc-bdd5-24320f51c913 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:15:13.820920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ddfa0-6eb1-4ffc-bdd5-24320f51c913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:15:13.822494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ddfa0-6eb1-4ffc-bdd5-24320f51c913 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:15:13.832232 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4470/9029] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 02:15:13.836202 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26048ff-8699-4256-bda8-9ecd0983e008 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:15:13.846989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26048ff-8699-4256-bda8-9ecd0983e008 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:15:13.851602 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78557b-b97f-420a-b95d-4224b2e75d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:15:13.852236 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78557b-b97f-420a-b95d-4224b2e75d05 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:15:13.852516 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78557b-b97f-420a-b95d-4224b2e75d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:15:13.852787 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78557b-b97f-420a-b95d-4224b2e75d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:15:13.853425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78557b-b97f-420a-b95d-4224b2e75d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:15:13.855044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78557b-b97f-420a-b95d-4224b2e75d05 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:15:13.866378 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4560/9030] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 02:15:13.870545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ddfa0-6eb1-4ffc-bdd5-24320f51c913 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:15:13.880582 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ddfa0-6eb1-4ffc-bdd5-24320f51c913 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:15:13.885083 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8097bee-d386-4cdb-ad83-ff367032f74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:15:13.885712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8097bee-d386-4cdb-ad83-ff367032f74a admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:15:13.885987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8097bee-d386-4cdb-ad83-ff367032f74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:15:13.886256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8097bee-d386-4cdb-ad83-ff367032f74a admin admin] PATH_INFO: `/v3/projects/1416397f45dc4abf94bb539540b5b61f/users/965b3c62c5af4285a6d747d18274f18a/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:15:13.900559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8097bee-d386-4cdb-ad83-ff367032f74a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1416397f45dc4abf94bb539540b5b61f, user_id=965b3c62c5af4285a6d747d18274f18a, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:15:13.903185 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8097bee-d386-4cdb-ad83-ff367032f74a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:15:13.916253 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4471/9031] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 02:15:13 2022] PUT /identity/v3/projects/1416397f45dc4abf94bb539540b5b61f/users/965b3c62c5af4285a6d747d18274f18a/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 02:15:13.921227 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a997a-a0bc-45f9-92d5-02ee06f98435 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:15:13.921515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a997a-a0bc-45f9-92d5-02ee06f98435 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:15:13.921788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a997a-a0bc-45f9-92d5-02ee06f98435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:15:13.942114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-a96a997a-a0bc-45f9-92d5-02ee06f98435 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:15:13.943313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a96a997a-a0bc-45f9-92d5-02ee06f98435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:15:14.002081 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4561/9032] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:15:14.011969 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8097bee-d386-4cdb-ad83-ff367032f74a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:15:14.013668 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e8097bee-d386-4cdb-ad83-ff367032f74a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:15:14.083917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8097bee-d386-4cdb-ad83-ff367032f74a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:15:14.087617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be30e4-7c57-4abf-859e-19430c43fc5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:15:14.088244 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be30e4-7c57-4abf-859e-19430c43fc5f service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:15:14.088524 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be30e4-7c57-4abf-859e-19430c43fc5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:15:14.088796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be30e4-7c57-4abf-859e-19430c43fc5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:15:14.097862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be30e4-7c57-4abf-859e-19430c43fc5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:15:14.099332 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be30e4-7c57-4abf-859e-19430c43fc5f service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:15:14.108951 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4472/9033] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:15:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:15:18.160213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32069e3a-5db2-4799-8090-f8064cd53f95 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:15:18.160739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32069e3a-5db2-4799-8090-f8064cd53f95 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:15:18.160739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32069e3a-5db2-4799-8090-f8064cd53f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:15:18.190924 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-32069e3a-5db2-4799-8090-f8064cd53f95 None None] MFA Rules not processed for user `965b3c62c5af4285a6d747d18274f18a`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:15:18.192175 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-32069e3a-5db2-4799-8090-f8064cd53f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:15:18.259856 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4562/9034] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:15:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:15:18.264400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be30e4-7c57-4abf-859e-19430c43fc5f service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:15:18.274418 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be30e4-7c57-4abf-859e-19430c43fc5f service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:15:18.279168 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6edc34-c283-48b4-8842-a091bfb6e456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:15:18.279769 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6edc34-c283-48b4-8842-a091bfb6e456 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:15:18.280084 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6edc34-c283-48b4-8842-a091bfb6e456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:15:18.280362 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6edc34-c283-48b4-8842-a091bfb6e456 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:15:18.280992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6edc34-c283-48b4-8842-a091bfb6e456 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:15:18.282947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6edc34-c283-48b4-8842-a091bfb6e456 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:15:18.315630 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4473/9035] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 02:15:18 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 02:15:18.316807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32069e3a-5db2-4799-8090-f8064cd53f95 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:15:18.328617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32069e3a-5db2-4799-8090-f8064cd53f95 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:15:18.380936 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:15:18.389251 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cdcbc-f508-49e6-b292-cb654108eeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:15:18.389883 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cdcbc-f508-49e6-b292-cb654108eeab admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:15:18.390312 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cdcbc-f508-49e6-b292-cb654108eeab admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:15:18.390587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cdcbc-f508-49e6-b292-cb654108eeab admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:15:18.391271 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cdcbc-f508-49e6-b292-cb654108eeab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:15:18.393326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cdcbc-f508-49e6-b292-cb654108eeab admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:15:18.415468 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4563/9036] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 02:15:18 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 02:15:18.419539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6edc34-c283-48b4-8842-a091bfb6e456 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:15:18.430744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6edc34-c283-48b4-8842-a091bfb6e456 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:15:18.435659 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa634269-e2f5-4e35-9474-9e50ceac6e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:15:18.436336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa634269-e2f5-4e35-9474-9e50ceac6e5b admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:15:18.436908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa634269-e2f5-4e35-9474-9e50ceac6e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:15:18.437476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa634269-e2f5-4e35-9474-9e50ceac6e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:15:18.438424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa634269-e2f5-4e35-9474-9e50ceac6e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:15:18.441010 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa634269-e2f5-4e35-9474-9e50ceac6e5b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:15:18.442900 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:15:18.455318 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4474/9037] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 02:15:18.459326 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cdcbc-f508-49e6-b292-cb654108eeab admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:15:18.469894 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cdcbc-f508-49e6-b292-cb654108eeab admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:15:18.474512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7794e-f16a-4cb1-b51a-ed49fc35744e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:15:18.475156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7794e-f16a-4cb1-b51a-ed49fc35744e admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:15:18.475440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7794e-f16a-4cb1-b51a-ed49fc35744e admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:15:18.475716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7794e-f16a-4cb1-b51a-ed49fc35744e admin admin] PATH_INFO: `/v3/projects/5cd27caca3634f78b75c586047bd2054/users/4f7c91c17362453a85215f4bb2ac4deb/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:15:18.491284 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7794e-f16a-4cb1-b51a-ed49fc35744e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd27caca3634f78b75c586047bd2054, user_id=4f7c91c17362453a85215f4bb2ac4deb, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:15:18.494000 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7794e-f16a-4cb1-b51a-ed49fc35744e admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:15:18.506503 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4564/9038] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 02:15:18 2022] PUT /identity/v3/projects/5cd27caca3634f78b75c586047bd2054/users/4f7c91c17362453a85215f4bb2ac4deb/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:15:18.510550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa634269-e2f5-4e35-9474-9e50ceac6e5b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:15:18.520543 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa634269-e2f5-4e35-9474-9e50ceac6e5b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:15:18.580040 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d90bb-c82e-4b59-988a-4533b7cbfc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:15:18.580657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d90bb-c82e-4b59-988a-4533b7cbfc45 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:15:18.580979 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d90bb-c82e-4b59-988a-4533b7cbfc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:15:18.581250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d90bb-c82e-4b59-988a-4533b7cbfc45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:15:18.581902 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d90bb-c82e-4b59-988a-4533b7cbfc45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:15:18.583506 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077d90bb-c82e-4b59-988a-4533b7cbfc45 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:15:18.593415 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4475/9039] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 02:15:18.597630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7794e-f16a-4cb1-b51a-ed49fc35744e admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:15:18.607826 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7794e-f16a-4cb1-b51a-ed49fc35744e admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:15:18.612537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc6f02-753e-48e6-ab9c-6255ad2634fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:15:18.613184 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc6f02-753e-48e6-ab9c-6255ad2634fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:15:18.613463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc6f02-753e-48e6-ab9c-6255ad2634fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:15:18.613735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc6f02-753e-48e6-ab9c-6255ad2634fe admin admin] PATH_INFO: `/v3/projects/5cd27caca3634f78b75c586047bd2054/users/4f7c91c17362453a85215f4bb2ac4deb/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:15:18.615692 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc6f02-753e-48e6-ab9c-6255ad2634fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd27caca3634f78b75c586047bd2054, user_id=4f7c91c17362453a85215f4bb2ac4deb, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:15:18.618382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc6f02-753e-48e6-ab9c-6255ad2634fe admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:15:18.629055 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4565/9040] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 02:15:18 2022] PUT /identity/v3/projects/5cd27caca3634f78b75c586047bd2054/users/4f7c91c17362453a85215f4bb2ac4deb/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:15:23.176652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462b234-1bd0-4f2b-a315-9c51ed351378 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:15:23.177500 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462b234-1bd0-4f2b-a315-9c51ed351378 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:15:23.178000 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462b234-1bd0-4f2b-a315-9c51ed351378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:15:23.210525 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-8462b234-1bd0-4f2b-a315-9c51ed351378 None None] MFA Rules not processed for user `4f7c91c17362453a85215f4bb2ac4deb`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:15:23.211948 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8462b234-1bd0-4f2b-a315-9c51ed351378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:15:23.300726 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4476/9041] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:15:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:15:23.330371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc6f02-753e-48e6-ab9c-6255ad2634fe admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:15:23.332191 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-01dc6f02-753e-48e6-ab9c-6255ad2634fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:15:23.403044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc6f02-753e-48e6-ab9c-6255ad2634fe admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:15:23.408506 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750b2b6-c553-469b-bc4e-8f7581ddd929 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:15:23.409207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750b2b6-c553-469b-bc4e-8f7581ddd929 service glance] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:15:23.409576 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750b2b6-c553-469b-bc4e-8f7581ddd929 service glance] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:15:23.409992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750b2b6-c553-469b-bc4e-8f7581ddd929 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:15:23.478932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750b2b6-c553-469b-bc4e-8f7581ddd929 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:15:23.480431 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750b2b6-c553-469b-bc4e-8f7581ddd929 service glance] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:15:23.491161 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4566/9042] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:15:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:15:23.640767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cabf3-7d32-45e5-bb6c-6c70b9353b94 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:15:23.641062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cabf3-7d32-45e5-bb6c-6c70b9353b94 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:15:23.641950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cabf3-7d32-45e5-bb6c-6c70b9353b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:15:23.694357 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-d44cabf3-7d32-45e5-bb6c-6c70b9353b94 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:15:23.695575 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d44cabf3-7d32-45e5-bb6c-6c70b9353b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:15:23.751382 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:15:23.770197 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4477/9043] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 02:15:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:15:23.814850 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72aff83-7dc3-4a1d-b62e-4aca907e6946 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:15:23.815138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72aff83-7dc3-4a1d-b62e-4aca907e6946 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:15:23.815438 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72aff83-7dc3-4a1d-b62e-4aca907e6946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:15:23.865607 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-b72aff83-7dc3-4a1d-b62e-4aca907e6946 None None] MFA Rules not processed for user `fb5a86da594046ed97745371176decf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:15:23.866804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b72aff83-7dc3-4a1d-b62e-4aca907e6946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:15:23.899991 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:15:23.941059 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4567/9044] 10.222.0.39 () {58 vars in 1040 bytes} [Sun Aug 7 02:15:23 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:15:23.947152 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cabf3-7d32-45e5-bb6c-6c70b9353b94 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:15:23.959828 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cabf3-7d32-45e5-bb6c-6c70b9353b94 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:15:23.964933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0042a9-9bd4-4aab-b0e5-f508ae61afa2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:15:23.965535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0042a9-9bd4-4aab-b0e5-f508ae61afa2 service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:15:23.965811 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0042a9-9bd4-4aab-b0e5-f508ae61afa2 service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:15:23.966082 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0042a9-9bd4-4aab-b0e5-f508ae61afa2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:15:23.974628 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0042a9-9bd4-4aab-b0e5-f508ae61afa2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:15:23.976250 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0042a9-9bd4-4aab-b0e5-f508ae61afa2 service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:15:23.985314 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4478/9045] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 02:15:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 02:15:28.399064 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72aff83-7dc3-4a1d-b62e-4aca907e6946 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:15:28.401113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b72aff83-7dc3-4a1d-b62e-4aca907e6946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:15:28.489546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72aff83-7dc3-4a1d-b62e-4aca907e6946 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:15:28.495081 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96074d7-f1eb-4ecd-a601-b7d1c22122e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:15:28.495926 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96074d7-f1eb-4ecd-a601-b7d1c22122e1 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:15:28.496803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96074d7-f1eb-4ecd-a601-b7d1c22122e1 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:15:28.496803 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96074d7-f1eb-4ecd-a601-b7d1c22122e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:15:28.499013 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f96074d7-f1eb-4ecd-a601-b7d1c22122e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:15:28.512113 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96074d7-f1eb-4ecd-a601-b7d1c22122e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:15:28.513864 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96074d7-f1eb-4ecd-a601-b7d1c22122e1 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:15:28.527059 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4568/9046] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:15:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:15:32.663966 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d8c8e-c261-4ab4-819d-e8a96725b319 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:15:32.664521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d8c8e-c261-4ab4-819d-e8a96725b319 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:15:32.664521 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d8c8e-c261-4ab4-819d-e8a96725b319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:15:32.682820 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ab4d8c8e-c261-4ab4-819d-e8a96725b319 None None] MFA Rules not processed for user `965b3c62c5af4285a6d747d18274f18a`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:15:32.684075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ab4d8c8e-c261-4ab4-819d-e8a96725b319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:15:32.691505 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4479/9047] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:15:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:15:32.951399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96074d7-f1eb-4ecd-a601-b7d1c22122e1 service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:15:33.006279 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96074d7-f1eb-4ecd-a601-b7d1c22122e1 service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:15:33.009815 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993c070-ff26-46f2-88f8-d96b9f706cf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:15:33.010409 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993c070-ff26-46f2-88f8-d96b9f706cf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:15:33.010680 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993c070-ff26-46f2-88f8-d96b9f706cf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:15:33.010944 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993c070-ff26-46f2-88f8-d96b9f706cf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:15:33.012674 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6993c070-ff26-46f2-88f8-d96b9f706cf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:15:33.022082 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993c070-ff26-46f2-88f8-d96b9f706cf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:15:33.023503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993c070-ff26-46f2-88f8-d96b9f706cf1 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:15:33.031268 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4569/9048] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:15:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:15:34.566775 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728d4a7-37d9-4d60-9215-efb8bd8a5329 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:15:34.567267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728d4a7-37d9-4d60-9215-efb8bd8a5329 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:15:34.567371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728d4a7-37d9-4d60-9215-efb8bd8a5329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:15:34.586436 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7728d4a7-37d9-4d60-9215-efb8bd8a5329 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:15:34.587660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7728d4a7-37d9-4d60-9215-efb8bd8a5329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:15:34.594808 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4480/9049] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 02:15:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:15:34.608139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993c070-ff26-46f2-88f8-d96b9f706cf1 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:15:34.621002 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993c070-ff26-46f2-88f8-d96b9f706cf1 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:15:34.626609 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c80e6-a429-411f-86e7-e89f5aab3367 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:15:34.627208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c80e6-a429-411f-86e7-e89f5aab3367 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:15:34.627485 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c80e6-a429-411f-86e7-e89f5aab3367 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:15:34.627752 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c80e6-a429-411f-86e7-e89f5aab3367 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:15:34.636901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c80e6-a429-411f-86e7-e89f5aab3367 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:15:34.638475 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c80e6-a429-411f-86e7-e89f5aab3367 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:15:34.647425 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4570/9050] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 02:15:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 07 02:15:44.580873 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=17 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:15:44.644265 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=80 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:16:06.520929 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728d4a7-37d9-4d60-9215-efb8bd8a5329 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:16:06.522333 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7728d4a7-37d9-4d60-9215-efb8bd8a5329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:16:06.533526 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728d4a7-37d9-4d60-9215-efb8bd8a5329 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:16:06.537148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bd07c-dc7a-46dc-b5f3-77c842721354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:16:06.537739 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bd07c-dc7a-46dc-b5f3-77c842721354 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:16:06.538018 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bd07c-dc7a-46dc-b5f3-77c842721354 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:16:06.538291 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bd07c-dc7a-46dc-b5f3-77c842721354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:16:06.547087 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bd07c-dc7a-46dc-b5f3-77c842721354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:16:06.548555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bd07c-dc7a-46dc-b5f3-77c842721354 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:16:06.558430 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4481/9051] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:16:06 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:16:12.440309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c80e6-a429-411f-86e7-e89f5aab3367 service swift] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:16:12.441715 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-313c80e6-a429-411f-86e7-e89f5aab3367 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:16:12.457280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c80e6-a429-411f-86e7-e89f5aab3367 service swift] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:16:12.462192 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24423c4-f999-48f7-bb03-caa47109084f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:16:12.462784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24423c4-f999-48f7-bb03-caa47109084f service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:16:12.463058 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24423c4-f999-48f7-bb03-caa47109084f service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:16:12.463322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24423c4-f999-48f7-bb03-caa47109084f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:16:12.464990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d24423c4-f999-48f7-bb03-caa47109084f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:16:12.476513 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24423c4-f999-48f7-bb03-caa47109084f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:16:12.478071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24423c4-f999-48f7-bb03-caa47109084f service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:16:12.488354 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4571/9052] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:16:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:16:16.554310 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:16:22.483993 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:17:48.108377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bd07c-dc7a-46dc-b5f3-77c842721354 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:17:48.127635 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bd07c-dc7a-46dc-b5f3-77c842721354 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:17:48.131281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928db5c-dd03-4a87-9369-afd984ac3eba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:17:48.131874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928db5c-dd03-4a87-9369-afd984ac3eba service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:17:48.132679 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928db5c-dd03-4a87-9369-afd984ac3eba service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:17:48.132950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928db5c-dd03-4a87-9369-afd984ac3eba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:17:48.134706 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4928db5c-dd03-4a87-9369-afd984ac3eba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:17:48.213146 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928db5c-dd03-4a87-9369-afd984ac3eba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:17:48.214594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928db5c-dd03-4a87-9369-afd984ac3eba service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:17:48.234902 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4482/9053] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:17:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:17:49.511994 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24423c4-f999-48f7-bb03-caa47109084f service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:17:49.521138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24423c4-f999-48f7-bb03-caa47109084f service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:17:49.524784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000247d7-7854-4105-85d2-93c975121966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:17:49.525375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000247d7-7854-4105-85d2-93c975121966 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:17:49.525658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000247d7-7854-4105-85d2-93c975121966 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:17:49.525928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000247d7-7854-4105-85d2-93c975121966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:17:49.527630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-000247d7-7854-4105-85d2-93c975121966 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:17:49.541143 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000247d7-7854-4105-85d2-93c975121966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:17:49.542608 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000247d7-7854-4105-85d2-93c975121966 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:17:49.553612 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4572/9054] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:17:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:17:58.232334 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=42 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:17:59.548962 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:19:03.068717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928db5c-dd03-4a87-9369-afd984ac3eba service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:19:03.070647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4928db5c-dd03-4a87-9369-afd984ac3eba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:19:03.102465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928db5c-dd03-4a87-9369-afd984ac3eba service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:19:03.109516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c5ae7-152a-4eeb-b0d5-08860bc4609f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:19:03.110682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c5ae7-152a-4eeb-b0d5-08860bc4609f service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:19:03.111224 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c5ae7-152a-4eeb-b0d5-08860bc4609f service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:19:03.111378 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c5ae7-152a-4eeb-b0d5-08860bc4609f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:19:03.113197 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7e4c5ae7-152a-4eeb-b0d5-08860bc4609f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:19:03.133871 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c5ae7-152a-4eeb-b0d5-08860bc4609f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:19:03.135611 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c5ae7-152a-4eeb-b0d5-08860bc4609f service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:19:03.148289 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4483/9055] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:19:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:19:03.247840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000247d7-7854-4105-85d2-93c975121966 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:19:03.272367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000247d7-7854-4105-85d2-93c975121966 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:19:03.277164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344bb41-fe64-4c64-a1dd-4c36898e925a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:19:03.278053 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344bb41-fe64-4c64-a1dd-4c36898e925a service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:19:03.278527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344bb41-fe64-4c64-a1dd-4c36898e925a service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:19:03.278889 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344bb41-fe64-4c64-a1dd-4c36898e925a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:19:03.281261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-b344bb41-fe64-4c64-a1dd-4c36898e925a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:19:03.292054 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344bb41-fe64-4c64-a1dd-4c36898e925a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:19:03.294291 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344bb41-fe64-4c64-a1dd-4c36898e925a service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:19:03.306365 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4573/9056] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:19:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 02:19:13.143476 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:19:13.300575 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:19:17.036784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88b256-f100-4bee-9f7e-f207ba287884 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:19:17.037256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88b256-f100-4bee-9f7e-f207ba287884 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:19:17.037354 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88b256-f100-4bee-9f7e-f207ba287884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:19:17.066235 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-9b88b256-f100-4bee-9f7e-f207ba287884 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:19:17.067431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-9b88b256-f100-4bee-9f7e-f207ba287884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:19:17.075602 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4484/9057] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 02:19:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:19:17.115530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344bb41-fe64-4c64-a1dd-4c36898e925a service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:19:17.127871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344bb41-fe64-4c64-a1dd-4c36898e925a service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:19:17.132834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8906c-1010-49de-8dae-59bf4e5e8d3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:19:17.133425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8906c-1010-49de-8dae-59bf4e5e8d3f service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:19:17.133705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8906c-1010-49de-8dae-59bf4e5e8d3f service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:19:17.133982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8906c-1010-49de-8dae-59bf4e5e8d3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:19:17.142642 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8906c-1010-49de-8dae-59bf4e5e8d3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:19:17.144256 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8906c-1010-49de-8dae-59bf4e5e8d3f service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:19:17.152187 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4574/9058] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 02:19:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 02:19:17.627799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ada1c-c390-40e1-8f41-dfa24fa169fe None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:19:17.628148 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ada1c-c390-40e1-8f41-dfa24fa169fe None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:19:17.628427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ada1c-c390-40e1-8f41-dfa24fa169fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:19:17.647210 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-904ada1c-c390-40e1-8f41-dfa24fa169fe None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:19:17.648424 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-904ada1c-c390-40e1-8f41-dfa24fa169fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:19:17.655562 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4485/9059] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 02:19:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:19:17.667579 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8906c-1010-49de-8dae-59bf4e5e8d3f service swift] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:19:17.678217 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8906c-1010-49de-8dae-59bf4e5e8d3f service swift] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:19:17.683318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d838a-f54b-446f-8050-0b4b8b13ee55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:19:17.683999 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d838a-f54b-446f-8050-0b4b8b13ee55 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:19:17.684282 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d838a-f54b-446f-8050-0b4b8b13ee55 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:19:17.684550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d838a-f54b-446f-8050-0b4b8b13ee55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:19:17.693101 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d838a-f54b-446f-8050-0b4b8b13ee55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:19:17.694661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d838a-f54b-446f-8050-0b4b8b13ee55 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:19:17.702919 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4575/9060] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 02:19:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 02:19:25.913471 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead45482-1e66-4957-a6c7-8a0cd14ca753 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:19:25.913941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead45482-1e66-4957-a6c7-8a0cd14ca753 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:19:25.914035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead45482-1e66-4957-a6c7-8a0cd14ca753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:19:25.932849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-ead45482-1e66-4957-a6c7-8a0cd14ca753 None None] MFA Rules not processed for user `965b3c62c5af4285a6d747d18274f18a`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:19:25.934095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ead45482-1e66-4957-a6c7-8a0cd14ca753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:19:25.940899 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4486/9061] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:19:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:19:27.699414 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=12 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:19:31.928768 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a44dc-7a65-4f16-bfe0-f42d23167639 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:19:31.929704 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a44dc-7a65-4f16-bfe0-f42d23167639 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:19:31.929977 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a44dc-7a65-4f16-bfe0-f42d23167639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:19:31.950117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e95a44dc-7a65-4f16-bfe0-f42d23167639 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:19:31.951395 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e95a44dc-7a65-4f16-bfe0-f42d23167639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:19:31.971965 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4576/9062] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 02:19:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:19:31.990661 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead45482-1e66-4957-a6c7-8a0cd14ca753 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:19:32.004474 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead45482-1e66-4957-a6c7-8a0cd14ca753 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:19:32.010247 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f415217-ebb0-447b-8663-3921309a9986 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:19:32.011000 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f415217-ebb0-447b-8663-3921309a9986 service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:19:32.011580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f415217-ebb0-447b-8663-3921309a9986 service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:19:32.011952 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f415217-ebb0-447b-8663-3921309a9986 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:19:32.035414 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f415217-ebb0-447b-8663-3921309a9986 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:19:32.037147 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f415217-ebb0-447b-8663-3921309a9986 service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:19:32.046776 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4487/9063] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 02:19:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 07 02:19:41.966940 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:19:42.042977 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=19 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:19:46.291896 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a44dc-7a65-4f16-bfe0-f42d23167639 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:19:46.306786 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a44dc-7a65-4f16-bfe0-f42d23167639 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:19:46.312904 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea8e47-a616-4487-ac3d-c0b9450fd1e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:19:46.313504 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea8e47-a616-4487-ac3d-c0b9450fd1e7 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:19:46.313808 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea8e47-a616-4487-ac3d-c0b9450fd1e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:19:46.314077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea8e47-a616-4487-ac3d-c0b9450fd1e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:19:46.315763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-24ea8e47-a616-4487-ac3d-c0b9450fd1e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:19:46.342338 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea8e47-a616-4487-ac3d-c0b9450fd1e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:19:46.344135 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea8e47-a616-4487-ac3d-c0b9450fd1e7 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:19:46.355098 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4577/9064] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:19:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:19:56.350353 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=11 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:20:23.113921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f415217-ebb0-447b-8663-3921309a9986 service swift] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:20:23.125903 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f415217-ebb0-447b-8663-3921309a9986 service swift] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:20:23.131229 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739d12c-4488-49d9-bede-06b5f179e9d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:20:23.131843 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739d12c-4488-49d9-bede-06b5f179e9d1 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:20:23.132143 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739d12c-4488-49d9-bede-06b5f179e9d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:20:23.132410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739d12c-4488-49d9-bede-06b5f179e9d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:20:23.140178 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739d12c-4488-49d9-bede-06b5f179e9d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:20:23.141748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739d12c-4488-49d9-bede-06b5f179e9d1 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:20:23.150751 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4488/9065] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:20:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:20:33.146669 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:20:34.448096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea8e47-a616-4487-ac3d-c0b9450fd1e7 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:20:34.470097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea8e47-a616-4487-ac3d-c0b9450fd1e7 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:20:34.475649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77c173-2507-4078-a0f2-3d07c341ed1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:20:34.476487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77c173-2507-4078-a0f2-3d07c341ed1f service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:20:34.476887 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77c173-2507-4078-a0f2-3d07c341ed1f service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:20:34.477247 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77c173-2507-4078-a0f2-3d07c341ed1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:20:34.486455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77c173-2507-4078-a0f2-3d07c341ed1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:20:34.488050 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77c173-2507-4078-a0f2-3d07c341ed1f service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:20:34.497481 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4578/9066] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:20:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:20:44.493504 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=10 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:21:06.433314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739d12c-4488-49d9-bede-06b5f179e9d1 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:21:06.435097 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-4739d12c-4488-49d9-bede-06b5f179e9d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:21:06.451738 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739d12c-4488-49d9-bede-06b5f179e9d1 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:21:06.458555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7377d59-f67e-4758-9acc-cf406ba9d071 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:21:06.459166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7377d59-f67e-4758-9acc-cf406ba9d071 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:21:06.459438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7377d59-f67e-4758-9acc-cf406ba9d071 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:21:06.459706 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7377d59-f67e-4758-9acc-cf406ba9d071 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:21:06.461585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c7377d59-f67e-4758-9acc-cf406ba9d071 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:21:06.476175 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7377d59-f67e-4758-9acc-cf406ba9d071 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:21:06.477941 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7377d59-f67e-4758-9acc-cf406ba9d071 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:21:06.503019 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4489/9067] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:21:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:21:16.484901 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:21:19.441537 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77c173-2507-4078-a0f2-3d07c341ed1f service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:21:19.452219 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77c173-2507-4078-a0f2-3d07c341ed1f service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:21:19.458297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bd5e4-a059-4bec-98fa-0a5be5f77fab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:21:19.459030 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bd5e4-a059-4bec-98fa-0a5be5f77fab service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:21:19.459401 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bd5e4-a059-4bec-98fa-0a5be5f77fab service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:21:19.459772 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bd5e4-a059-4bec-98fa-0a5be5f77fab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:21:19.469172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2bd5e4-a059-4bec-98fa-0a5be5f77fab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:21:19.471032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2bd5e4-a059-4bec-98fa-0a5be5f77fab service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:21:19.481845 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4579/9068] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:21:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:21:20.294608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7b224-0e11-4286-b6e9-81f7cb7740d9 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:21:20.295098 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7b224-0e11-4286-b6e9-81f7cb7740d9 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:21:20.295330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7b224-0e11-4286-b6e9-81f7cb7740d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:21:20.314596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-7ce7b224-0e11-4286-b6e9-81f7cb7740d9 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:21:20.315779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7ce7b224-0e11-4286-b6e9-81f7cb7740d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:21:20.322847 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4490/9069] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 02:21:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:21:20.362992 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bd5e4-a059-4bec-98fa-0a5be5f77fab service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:21:20.374194 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bd5e4-a059-4bec-98fa-0a5be5f77fab service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:21:20.379247 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9ef09-7cde-4503-a3cb-ce3326b57610 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:21:20.379844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9ef09-7cde-4503-a3cb-ce3326b57610 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:21:20.380153 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9ef09-7cde-4503-a3cb-ce3326b57610 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:21:20.380425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9ef09-7cde-4503-a3cb-ce3326b57610 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:21:20.388420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9ef09-7cde-4503-a3cb-ce3326b57610 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:21:20.390001 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9ef09-7cde-4503-a3cb-ce3326b57610 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:21:20.398522 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4580/9070] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 02:21:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 02:21:20.752749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7b224-0e11-4286-b6e9-81f7cb7740d9 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:21:20.762349 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7b224-0e11-4286-b6e9-81f7cb7740d9 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:21:20.765960 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6739ae1-b2a1-4fab-b502-cdd44222ad91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:21:20.766557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6739ae1-b2a1-4fab-b502-cdd44222ad91 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:21:20.767502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6739ae1-b2a1-4fab-b502-cdd44222ad91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:21:20.767773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6739ae1-b2a1-4fab-b502-cdd44222ad91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:21:20.826325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6739ae1-b2a1-4fab-b502-cdd44222ad91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:21:20.827755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6739ae1-b2a1-4fab-b502-cdd44222ad91 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:21:20.847280 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4491/9071] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:21:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:21:23.941388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9ef09-7cde-4503-a3cb-ce3326b57610 service swift] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:21:23.955759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9ef09-7cde-4503-a3cb-ce3326b57610 service swift] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:21:23.969294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc21c0-f86b-465a-9b73-46e2ff321c66 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:21:23.970211 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc21c0-f86b-465a-9b73-46e2ff321c66 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:21:23.970560 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc21c0-f86b-465a-9b73-46e2ff321c66 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:21:23.970843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc21c0-f86b-465a-9b73-46e2ff321c66 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:21:23.972759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-45fc21c0-f86b-465a-9b73-46e2ff321c66 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:21:24.009231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc21c0-f86b-465a-9b73-46e2ff321c66 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:21:24.010922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc21c0-f86b-465a-9b73-46e2ff321c66 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:21:24.024563 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4581/9072] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:21:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:21:27.122958 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6739ae1-b2a1-4fab-b502-cdd44222ad91 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:21:27.142680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6739ae1-b2a1-4fab-b502-cdd44222ad91 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:21:27.153756 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7dd724-d322-4e09-964b-bf75d7b7b864 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:21:27.154410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7dd724-d322-4e09-964b-bf75d7b7b864 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:21:27.154698 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7dd724-d322-4e09-964b-bf75d7b7b864 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:21:27.154917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7dd724-d322-4e09-964b-bf75d7b7b864 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:21:27.156740 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8c7dd724-d322-4e09-964b-bf75d7b7b864 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:21:27.169199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7dd724-d322-4e09-964b-bf75d7b7b864 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:21:27.170782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7dd724-d322-4e09-964b-bf75d7b7b864 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:21:27.182130 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4492/9073] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:21:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:21:27.198144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc21c0-f86b-465a-9b73-46e2ff321c66 service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:21:27.209650 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc21c0-f86b-465a-9b73-46e2ff321c66 service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:21:27.214351 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8f409-c4f2-4de7-b66e-21204dcdc6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:21:27.215034 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8f409-c4f2-4de7-b66e-21204dcdc6b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:21:27.215313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8f409-c4f2-4de7-b66e-21204dcdc6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:21:27.215584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8f409-c4f2-4de7-b66e-21204dcdc6b7 admin admin] PATH_INFO: `/v3/users/965b3c62c5af4285a6d747d18274f18a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:21:27.216761 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8f409-c4f2-4de7-b66e-21204dcdc6b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=965b3c62c5af4285a6d747d18274f18a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:21:27.218686 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8f409-c4f2-4de7-b66e-21204dcdc6b7 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:21:27.264941 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6ba8f409-c4f2-4de7-b66e-21204dcdc6b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '965b3c62c5af4285a6d747d18274f18a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:21:27.272720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6ba8f409-c4f2-4de7-b66e-21204dcdc6b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '965b3c62c5af4285a6d747d18274f18a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:21:27.285710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6ba8f409-c4f2-4de7-b66e-21204dcdc6b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '965b3c62c5af4285a6d747d18274f18a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:21:27.286405 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6ba8f409-c4f2-4de7-b66e-21204dcdc6b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '965b3c62c5af4285a6d747d18274f18a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:21:27.294156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6ba8f409-c4f2-4de7-b66e-21204dcdc6b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '965b3c62c5af4285a6d747d18274f18a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:21:27.300288 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4582/9074] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 02:21:27 2022] DELETE /identity/v3/users/965b3c62c5af4285a6d747d18274f18a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 02:21:27.476446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7dd724-d322-4e09-964b-bf75d7b7b864 service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:21:27.489139 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7dd724-d322-4e09-964b-bf75d7b7b864 service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:21:27.547091 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6782d4-95a4-492d-820e-f7fcc13a687f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:21:27.547720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6782d4-95a4-492d-820e-f7fcc13a687f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:21:27.548071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6782d4-95a4-492d-820e-f7fcc13a687f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:21:27.548347 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6782d4-95a4-492d-820e-f7fcc13a687f admin admin] PATH_INFO: `/v3/projects/1416397f45dc4abf94bb539540b5b61f` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:21:27.549469 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6782d4-95a4-492d-820e-f7fcc13a687f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1416397f45dc4abf94bb539540b5b61f)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:21:27.551404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6782d4-95a4-492d-820e-f7fcc13a687f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:21:27.597710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7c6782d4-95a4-492d-820e-f7fcc13a687f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1416397f45dc4abf94bb539540b5b61f', 'request_id': 'req-7c6782d4-95a4-492d-820e-f7fcc13a687f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:21:27.603200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7c6782d4-95a4-492d-820e-f7fcc13a687f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1416397f45dc4abf94bb539540b5b61f', 'request_id': 'req-7c6782d4-95a4-492d-820e-f7fcc13a687f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:21:27.609490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7c6782d4-95a4-492d-820e-f7fcc13a687f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1416397f45dc4abf94bb539540b5b61f', 'request_id': 'req-7c6782d4-95a4-492d-820e-f7fcc13a687f'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:21:27.613103 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:21:27.623549 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7c6782d4-95a4-492d-820e-f7fcc13a687f admin admin] The token cache is being invalidate because project 1416397f45dc4abf94bb539540b5b61f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 02:21:27.624101 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7c6782d4-95a4-492d-820e-f7fcc13a687f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:21:27.624758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-7c6782d4-95a4-492d-820e-f7fcc13a687f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:21:27.626823 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4493/9075] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 02:21:27 2022] DELETE /identity/v3/projects/1416397f45dc4abf94bb539540b5b61f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:21:27.630848 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8f409-c4f2-4de7-b66e-21204dcdc6b7 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:21:27.632310 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6ba8f409-c4f2-4de7-b66e-21204dcdc6b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:21:27.646640 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8f409-c4f2-4de7-b66e-21204dcdc6b7 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:21:27.701410 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020266e-36a6-40ba-ac21-8b5988a0aa81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:21:27.702038 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020266e-36a6-40ba-ac21-8b5988a0aa81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:21:27.702318 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020266e-36a6-40ba-ac21-8b5988a0aa81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:21:27.702593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020266e-36a6-40ba-ac21-8b5988a0aa81 admin admin] PATH_INFO: `/v3/users/4f7c91c17362453a85215f4bb2ac4deb` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:21:27.703727 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020266e-36a6-40ba-ac21-8b5988a0aa81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f7c91c17362453a85215f4bb2ac4deb)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:21:27.706313 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020266e-36a6-40ba-ac21-8b5988a0aa81 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:21:27.728371 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:21:27.753804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8020266e-36a6-40ba-ac21-8b5988a0aa81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f7c91c17362453a85215f4bb2ac4deb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:21:27.760500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8020266e-36a6-40ba-ac21-8b5988a0aa81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f7c91c17362453a85215f4bb2ac4deb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:21:27.772648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8020266e-36a6-40ba-ac21-8b5988a0aa81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f7c91c17362453a85215f4bb2ac4deb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:21:27.773303 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8020266e-36a6-40ba-ac21-8b5988a0aa81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f7c91c17362453a85215f4bb2ac4deb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:21:27.780622 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-8020266e-36a6-40ba-ac21-8b5988a0aa81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f7c91c17362453a85215f4bb2ac4deb'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:21:27.786492 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4583/9076] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 02:21:27 2022] DELETE /identity/v3/users/4f7c91c17362453a85215f4bb2ac4deb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:21:27.963001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6782d4-95a4-492d-820e-f7fcc13a687f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:21:27.964465 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-7c6782d4-95a4-492d-820e-f7fcc13a687f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:21:27.977222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6782d4-95a4-492d-820e-f7fcc13a687f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:21:28.037572 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931da14f-7dd9-4c5e-b021-ea220548d71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:21:28.038215 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931da14f-7dd9-4c5e-b021-ea220548d71c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:21:28.038495 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931da14f-7dd9-4c5e-b021-ea220548d71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:21:28.038773 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931da14f-7dd9-4c5e-b021-ea220548d71c admin admin] PATH_INFO: `/v3/projects/5cd27caca3634f78b75c586047bd2054` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:21:28.039936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931da14f-7dd9-4c5e-b021-ea220548d71c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cd27caca3634f78b75c586047bd2054)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:21:28.041880 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931da14f-7dd9-4c5e-b021-ea220548d71c admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:21:28.089560 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-931da14f-7dd9-4c5e-b021-ea220548d71c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cd27caca3634f78b75c586047bd2054', 'request_id': 'req-931da14f-7dd9-4c5e-b021-ea220548d71c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:21:28.095331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-931da14f-7dd9-4c5e-b021-ea220548d71c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cd27caca3634f78b75c586047bd2054', 'request_id': 'req-931da14f-7dd9-4c5e-b021-ea220548d71c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:21:28.101851 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-931da14f-7dd9-4c5e-b021-ea220548d71c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cd27caca3634f78b75c586047bd2054', 'request_id': 'req-931da14f-7dd9-4c5e-b021-ea220548d71c'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:21:28.114574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-931da14f-7dd9-4c5e-b021-ea220548d71c admin admin] The token cache is being invalidate because project 5cd27caca3634f78b75c586047bd2054 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 02:21:28.114863 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-931da14f-7dd9-4c5e-b021-ea220548d71c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:21:28.115489 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-931da14f-7dd9-4c5e-b021-ea220548d71c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:21:28.117017 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4494/9077] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 02:21:27 2022] DELETE /identity/v3/projects/5cd27caca3634f78b75c586047bd2054 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:21:28.122104 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed7df8-bce8-4c55-9201-dea159d8e589 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:21:28.122421 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed7df8-bce8-4c55-9201-dea159d8e589 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:21:28.122699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed7df8-bce8-4c55-9201-dea159d8e589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:21:28.142698 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e8ed7df8-bce8-4c55-9201-dea159d8e589 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:21:28.143928 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e8ed7df8-bce8-4c55-9201-dea159d8e589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:21:28.203753 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4584/9078] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:21:28.211602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55f3e3-46dc-4db6-ae2f-4705e9617189 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:21:28.212034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55f3e3-46dc-4db6-ae2f-4705e9617189 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:21:28.212186 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55f3e3-46dc-4db6-ae2f-4705e9617189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:21:28.231621 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3e55f3e3-46dc-4db6-ae2f-4705e9617189 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:21:28.233052 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3e55f3e3-46dc-4db6-ae2f-4705e9617189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:21:28.241670 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4495/9079] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:21:28.245903 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed7df8-bce8-4c55-9201-dea159d8e589 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:21:28.256307 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed7df8-bce8-4c55-9201-dea159d8e589 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:21:28.261004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0b6fa-f61c-4c2e-a114-6a03fd6f8d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:21:28.261601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0b6fa-f61c-4c2e-a114-6a03fd6f8d53 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:21:28.261880 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0b6fa-f61c-4c2e-a114-6a03fd6f8d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:21:28.262151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0b6fa-f61c-4c2e-a114-6a03fd6f8d53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:21:28.262805 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0b6fa-f61c-4c2e-a114-6a03fd6f8d53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 02:21:28.263102 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0b6fa-f61c-4c2e-a114-6a03fd6f8d53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:21:28.264717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0b6fa-f61c-4c2e-a114-6a03fd6f8d53 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:21:28.276024 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4585/9080] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 02:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 02:21:28.280275 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55f3e3-46dc-4db6-ae2f-4705e9617189 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:21:28.289975 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55f3e3-46dc-4db6-ae2f-4705e9617189 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:21:28.294625 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff743b-d4eb-474e-8882-65db828145fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:21:28.295246 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff743b-d4eb-474e-8882-65db828145fe admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:21:28.295523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff743b-d4eb-474e-8882-65db828145fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:21:28.295792 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff743b-d4eb-474e-8882-65db828145fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:21:28.296448 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff743b-d4eb-474e-8882-65db828145fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:21:28.298986 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff743b-d4eb-474e-8882-65db828145fe admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:21:28.328712 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4496/9081] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 02:21:28 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 02:21:28.330103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0b6fa-f61c-4c2e-a114-6a03fd6f8d53 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:21:28.340000 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0b6fa-f61c-4c2e-a114-6a03fd6f8d53 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:21:28.394769 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac1239-8842-4542-a981-a6be2133ec99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:21:28.395368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac1239-8842-4542-a981-a6be2133ec99 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:21:28.395677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac1239-8842-4542-a981-a6be2133ec99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:21:28.395980 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac1239-8842-4542-a981-a6be2133ec99 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:21:28.396632 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac1239-8842-4542-a981-a6be2133ec99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:21:28.398539 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac1239-8842-4542-a981-a6be2133ec99 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:21:28.419447 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4586/9082] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 02:21:28 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 02:21:28.424238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff743b-d4eb-474e-8882-65db828145fe admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:21:28.434426 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff743b-d4eb-474e-8882-65db828145fe admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:21:28.439038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e886353-b809-479d-bc32-37da74041d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:21:28.439622 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e886353-b809-479d-bc32-37da74041d1f admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:21:28.439925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e886353-b809-479d-bc32-37da74041d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:21:28.440200 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e886353-b809-479d-bc32-37da74041d1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:21:28.440844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e886353-b809-479d-bc32-37da74041d1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:21:28.442442 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e886353-b809-479d-bc32-37da74041d1f admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:21:28.452268 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4497/9083] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 02:21:28.456446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac1239-8842-4542-a981-a6be2133ec99 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:21:28.466455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac1239-8842-4542-a981-a6be2133ec99 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:21:28.472115 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99478ef-0c38-402d-91a1-2716b508177a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:21:28.472710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99478ef-0c38-402d-91a1-2716b508177a admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:21:28.472990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99478ef-0c38-402d-91a1-2716b508177a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:21:28.473262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99478ef-0c38-402d-91a1-2716b508177a admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:21:28.473903 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99478ef-0c38-402d-91a1-2716b508177a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:21:28.475488 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99478ef-0c38-402d-91a1-2716b508177a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:21:28.486745 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4587/9084] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 02:21:28.490923 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e886353-b809-479d-bc32-37da74041d1f admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:21:28.500973 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e886353-b809-479d-bc32-37da74041d1f admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:21:28.505538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba236ad-33b5-4f00-aede-b5b5a6d1077d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:21:28.506207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba236ad-33b5-4f00-aede-b5b5a6d1077d admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:21:28.506490 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba236ad-33b5-4f00-aede-b5b5a6d1077d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:21:28.506753 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba236ad-33b5-4f00-aede-b5b5a6d1077d admin admin] PATH_INFO: `/v3/projects/a212f473f58c4fb680bdb8ad63bd56f1/users/a2c21b7e0fa94a9eb7155caaf474b3b2/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:21:28.521281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba236ad-33b5-4f00-aede-b5b5a6d1077d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a212f473f58c4fb680bdb8ad63bd56f1, user_id=a2c21b7e0fa94a9eb7155caaf474b3b2, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:21:28.523953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba236ad-33b5-4f00-aede-b5b5a6d1077d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:21:28.536732 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4498/9085] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 02:21:28 2022] PUT /identity/v3/projects/a212f473f58c4fb680bdb8ad63bd56f1/users/a2c21b7e0fa94a9eb7155caaf474b3b2/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:21:28.547804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87775034-a59f-4d78-95be-ecb4496db169 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:21:28.548661 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87775034-a59f-4d78-95be-ecb4496db169 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:21:28.548938 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87775034-a59f-4d78-95be-ecb4496db169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:21:28.562019 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:21:28.577293 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-87775034-a59f-4d78-95be-ecb4496db169 None None] MFA Rules not processed for user `a2c21b7e0fa94a9eb7155caaf474b3b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:21:28.578566 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-87775034-a59f-4d78-95be-ecb4496db169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:21:28.643294 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4588/9086] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:21:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:21:28.647818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba236ad-33b5-4f00-aede-b5b5a6d1077d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:21:28.673162 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:21:28.712446 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba236ad-33b5-4f00-aede-b5b5a6d1077d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:21:28.721006 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09504b-a40f-48f0-8484-e2fcc2683fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:21:28.722054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09504b-a40f-48f0-8484-e2fcc2683fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:21:28.722557 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09504b-a40f-48f0-8484-e2fcc2683fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:21:28.723035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09504b-a40f-48f0-8484-e2fcc2683fc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:21:28.724255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09504b-a40f-48f0-8484-e2fcc2683fc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:21:28.726429 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09504b-a40f-48f0-8484-e2fcc2683fc4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:21:28.752792 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4499/9087] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 02:21:28 2022] POST /identity/v3/projects => generated 393 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 02:21:28.756751 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87775034-a59f-4d78-95be-ecb4496db169 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:21:28.768005 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87775034-a59f-4d78-95be-ecb4496db169 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:21:28.822534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc2505-16e3-4c94-97a0-ed7cef3b7e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:21:28.823132 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc2505-16e3-4c94-97a0-ed7cef3b7e59 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:21:28.823411 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc2505-16e3-4c94-97a0-ed7cef3b7e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:21:28.823679 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc2505-16e3-4c94-97a0-ed7cef3b7e59 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:21:28.824361 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc2505-16e3-4c94-97a0-ed7cef3b7e59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:21:28.826267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc2505-16e3-4c94-97a0-ed7cef3b7e59 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:21:28.847848 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4589/9088] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 02:21:28 2022] POST /identity/v3/users => generated 303 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 02:21:28.851745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09504b-a40f-48f0-8484-e2fcc2683fc4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:21:28.861925 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09504b-a40f-48f0-8484-e2fcc2683fc4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:21:28.866761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2f7fa-d7a0-44f8-a279-7d6e359b069b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:21:28.867395 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2f7fa-d7a0-44f8-a279-7d6e359b069b admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:21:28.867675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2f7fa-d7a0-44f8-a279-7d6e359b069b admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:21:28.867982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2f7fa-d7a0-44f8-a279-7d6e359b069b admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:21:28.868629 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2f7fa-d7a0-44f8-a279-7d6e359b069b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:21:28.870256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2f7fa-d7a0-44f8-a279-7d6e359b069b admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:21:28.880983 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4500/9089] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 02:21:28.884785 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc2505-16e3-4c94-97a0-ed7cef3b7e59 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:21:28.896274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc2505-16e3-4c94-97a0-ed7cef3b7e59 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:21:28.901264 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bfbc8-b929-4d1b-94de-2d1b56540353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:21:28.901925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bfbc8-b929-4d1b-94de-2d1b56540353 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:21:28.902658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bfbc8-b929-4d1b-94de-2d1b56540353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:21:28.902658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bfbc8-b929-4d1b-94de-2d1b56540353 admin admin] PATH_INFO: `/v3/projects/3ebdba50f24942f1a720220552b05a13/users/e156dd745cda4e978b0e66d990f189bd/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:21:28.918275 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bfbc8-b929-4d1b-94de-2d1b56540353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ebdba50f24942f1a720220552b05a13, user_id=e156dd745cda4e978b0e66d990f189bd, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:21:28.920968 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bfbc8-b929-4d1b-94de-2d1b56540353 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:21:28.933527 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4590/9090] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 02:21:28 2022] PUT /identity/v3/projects/3ebdba50f24942f1a720220552b05a13/users/e156dd745cda4e978b0e66d990f189bd/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 02:21:28.937550 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2f7fa-d7a0-44f8-a279-7d6e359b069b admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:21:28.947693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2f7fa-d7a0-44f8-a279-7d6e359b069b admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:21:29.005634 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a354c9-9252-4cb8-85de-39cba4e49a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:21:29.006232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a354c9-9252-4cb8-85de-39cba4e49a37 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:21:29.006492 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a354c9-9252-4cb8-85de-39cba4e49a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:21:29.006761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a354c9-9252-4cb8-85de-39cba4e49a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:21:29.007401 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a354c9-9252-4cb8-85de-39cba4e49a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:21:29.009034 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a354c9-9252-4cb8-85de-39cba4e49a37 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:21:29.019590 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4501/9091] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 02:21:29.023812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bfbc8-b929-4d1b-94de-2d1b56540353 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:21:29.034229 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bfbc8-b929-4d1b-94de-2d1b56540353 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:21:29.038823 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5d555-a343-4afa-873e-73082f028649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:21:29.039463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5d555-a343-4afa-873e-73082f028649 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:21:29.039740 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5d555-a343-4afa-873e-73082f028649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:21:29.040047 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5d555-a343-4afa-873e-73082f028649 admin admin] PATH_INFO: `/v3/projects/3ebdba50f24942f1a720220552b05a13/users/e156dd745cda4e978b0e66d990f189bd/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:21:29.041967 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5d555-a343-4afa-873e-73082f028649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ebdba50f24942f1a720220552b05a13, user_id=e156dd745cda4e978b0e66d990f189bd, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:21:29.044631 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5d555-a343-4afa-873e-73082f028649 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:21:29.054501 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4591/9092] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 02:21:29 2022] PUT /identity/v3/projects/3ebdba50f24942f1a720220552b05a13/users/e156dd745cda4e978b0e66d990f189bd/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:21:29.064660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3d4ad-c0c4-4441-8f28-f3fc9f97999c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:21:29.064953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3d4ad-c0c4-4441-8f28-f3fc9f97999c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:21:29.065233 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3d4ad-c0c4-4441-8f28-f3fc9f97999c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:21:29.093566 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-f0d3d4ad-c0c4-4441-8f28-f3fc9f97999c None None] MFA Rules not processed for user `e156dd745cda4e978b0e66d990f189bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:21:29.094804 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f0d3d4ad-c0c4-4441-8f28-f3fc9f97999c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:21:29.162744 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4502/9093] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:21:29 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:21:29.176988 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5d555-a343-4afa-873e-73082f028649 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:21:29.178763 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-dfd5d555-a343-4afa-873e-73082f028649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:21:29.228675 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:21:29.253751 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5d555-a343-4afa-873e-73082f028649 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:21:29.259433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0367193-3327-4db8-9006-d039424d9338 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:21:29.259948 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0367193-3327-4db8-9006-d039424d9338 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:21:29.260229 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0367193-3327-4db8-9006-d039424d9338 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:21:29.260500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0367193-3327-4db8-9006-d039424d9338 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:21:29.316025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0367193-3327-4db8-9006-d039424d9338 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:21:29.317647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0367193-3327-4db8-9006-d039424d9338 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:21:29.326506 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4592/9094] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:21:29 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:21:31.997150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3d4ad-c0c4-4441-8f28-f3fc9f97999c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:21:31.998619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-f0d3d4ad-c0c4-4441-8f28-f3fc9f97999c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:21:32.020448 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:21:32.064449 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3d4ad-c0c4-4441-8f28-f3fc9f97999c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:21:32.068131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a32bca-28f4-48f9-89fc-e75bdf265666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:21:32.068735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a32bca-28f4-48f9-89fc-e75bdf265666 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:21:32.069015 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a32bca-28f4-48f9-89fc-e75bdf265666 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:21:32.069289 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a32bca-28f4-48f9-89fc-e75bdf265666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:21:32.078793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a32bca-28f4-48f9-89fc-e75bdf265666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:21:32.080968 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a32bca-28f4-48f9-89fc-e75bdf265666 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:21:32.090997 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4503/9095] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:21:31 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:21:34.735912 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfdaa2-02f1-4ec9-b29b-74dec5089c88 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:21:34.736373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfdaa2-02f1-4ec9-b29b-74dec5089c88 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:21:34.736454 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfdaa2-02f1-4ec9-b29b-74dec5089c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:21:34.761420 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-23dfdaa2-02f1-4ec9-b29b-74dec5089c88 None None] MFA Rules not processed for user `a2c21b7e0fa94a9eb7155caaf474b3b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:21:34.762859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-23dfdaa2-02f1-4ec9-b29b-74dec5089c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:21:34.776687 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4593/9096] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:21:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:21:35.203680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a32bca-28f4-48f9-89fc-e75bdf265666 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:21:35.215685 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a32bca-28f4-48f9-89fc-e75bdf265666 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:21:35.220379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c7792-6039-4fc7-8059-3e6b881ad9db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:21:35.221137 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c7792-6039-4fc7-8059-3e6b881ad9db service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:21:35.221484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c7792-6039-4fc7-8059-3e6b881ad9db service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:21:35.221815 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c7792-6039-4fc7-8059-3e6b881ad9db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:21:35.223662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-e67c7792-6039-4fc7-8059-3e6b881ad9db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:21:35.235971 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c7792-6039-4fc7-8059-3e6b881ad9db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:21:35.237460 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67c7792-6039-4fc7-8059-3e6b881ad9db service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:21:35.249493 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4504/9097] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:21:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:21:35.598015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfdaa2-02f1-4ec9-b29b-74dec5089c88 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:21:35.599399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-23dfdaa2-02f1-4ec9-b29b-74dec5089c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:21:35.685675 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfdaa2-02f1-4ec9-b29b-74dec5089c88 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:21:35.691512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4eac1-7a5c-4f59-86b8-ad88bf13e39f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:21:35.692193 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4eac1-7a5c-4f59-86b8-ad88bf13e39f service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:21:35.692473 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4eac1-7a5c-4f59-86b8-ad88bf13e39f service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:21:35.693635 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4eac1-7a5c-4f59-86b8-ad88bf13e39f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:21:35.694985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2fe4eac1-7a5c-4f59-86b8-ad88bf13e39f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:21:35.709995 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe4eac1-7a5c-4f59-86b8-ad88bf13e39f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:21:35.711544 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe4eac1-7a5c-4f59-86b8-ad88bf13e39f service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:21:35.724192 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4594/9098] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:21:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 02:21:45.244582 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=24 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:21:45.719006 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=69 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:22:36.094814 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a46e26-1cf7-4c7d-bf58-a8c46f6c493d None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:22:36.095306 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a46e26-1cf7-4c7d-bf58-a8c46f6c493d None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:22:36.095406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a46e26-1cf7-4c7d-bf58-a8c46f6c493d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:22:36.117303 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-a2a46e26-1cf7-4c7d-bf58-a8c46f6c493d None None] MFA Rules not processed for user `a2c21b7e0fa94a9eb7155caaf474b3b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:22:36.119898 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a2a46e26-1cf7-4c7d-bf58-a8c46f6c493d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:22:36.127401 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4505/9099] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:22:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 02:22:36.892150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4eac1-7a5c-4f59-86b8-ad88bf13e39f service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:22:36.895348 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2fe4eac1-7a5c-4f59-86b8-ad88bf13e39f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:22:36.910861 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4eac1-7a5c-4f59-86b8-ad88bf13e39f service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:22:36.916891 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ca578-219b-48df-a9b2-2cbe29ae528f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:22:36.917840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ca578-219b-48df-a9b2-2cbe29ae528f service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:22:36.918117 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ca578-219b-48df-a9b2-2cbe29ae528f service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:22:36.918386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ca578-219b-48df-a9b2-2cbe29ae528f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:22:36.920176 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-683ca578-219b-48df-a9b2-2cbe29ae528f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:22:36.944372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ca578-219b-48df-a9b2-2cbe29ae528f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:22:36.946200 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ca578-219b-48df-a9b2-2cbe29ae528f service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:22:36.959270 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4595/9100] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:22:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 02:22:46.110508 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:22:46.953027 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:22:49.766513 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a46e26-1cf7-4c7d-bf58-a8c46f6c493d None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:22:49.768054 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a2a46e26-1cf7-4c7d-bf58-a8c46f6c493d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:22:49.783276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a46e26-1cf7-4c7d-bf58-a8c46f6c493d None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:22:49.787013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d63ef-e82f-4d26-9966-d44a0d56e91c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:22:49.787619 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d63ef-e82f-4d26-9966-d44a0d56e91c service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:22:49.787918 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d63ef-e82f-4d26-9966-d44a0d56e91c service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:22:49.788206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d63ef-e82f-4d26-9966-d44a0d56e91c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:22:49.790012 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-dd1d63ef-e82f-4d26-9966-d44a0d56e91c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:22:49.814360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d63ef-e82f-4d26-9966-d44a0d56e91c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:22:49.816523 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d63ef-e82f-4d26-9966-d44a0d56e91c service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:22:49.829344 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4506/9101] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:22:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:22:59.823865 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:23:17.828575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ca578-219b-48df-a9b2-2cbe29ae528f service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:23:17.839909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ca578-219b-48df-a9b2-2cbe29ae528f service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:23:17.844283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b2f9e-f04a-4fcd-8040-4bb6815ad09c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:23:17.844883 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b2f9e-f04a-4fcd-8040-4bb6815ad09c service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:23:17.845162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b2f9e-f04a-4fcd-8040-4bb6815ad09c service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:23:17.845435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b2f9e-f04a-4fcd-8040-4bb6815ad09c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:23:17.847156 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-fd4b2f9e-f04a-4fcd-8040-4bb6815ad09c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:23:17.862015 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b2f9e-f04a-4fcd-8040-4bb6815ad09c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:23:17.863442 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b2f9e-f04a-4fcd-8040-4bb6815ad09c service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:23:17.875458 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4596/9102] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:23:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:23:27.870981 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:24:03.488664 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d63ef-e82f-4d26-9966-d44a0d56e91c service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:24:03.499782 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d63ef-e82f-4d26-9966-d44a0d56e91c service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:24:03.505651 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf2ba0-3eca-41d0-a3a0-be28a268090d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:24:03.506255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf2ba0-3eca-41d0-a3a0-be28a268090d service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:24:03.506535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf2ba0-3eca-41d0-a3a0-be28a268090d service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:24:03.506829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf2ba0-3eca-41d0-a3a0-be28a268090d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:24:03.509729 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d9cf2ba0-3eca-41d0-a3a0-be28a268090d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:24:03.533982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf2ba0-3eca-41d0-a3a0-be28a268090d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:24:03.535579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf2ba0-3eca-41d0-a3a0-be28a268090d service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:24:03.546310 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4507/9103] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:24:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:24:13.541757 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=10 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:24:13.641581 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83080b7-a054-4d9e-8cc9-53419d7513c8 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:24:13.642116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83080b7-a054-4d9e-8cc9-53419d7513c8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:24:13.642466 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83080b7-a054-4d9e-8cc9-53419d7513c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:24:13.671983 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e83080b7-a054-4d9e-8cc9-53419d7513c8 None None] MFA Rules not processed for user `a2c21b7e0fa94a9eb7155caaf474b3b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:24:13.673428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e83080b7-a054-4d9e-8cc9-53419d7513c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:24:13.681386 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4597/9104] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:24:13 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:24:19.692076 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf2ba0-3eca-41d0-a3a0-be28a268090d service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:24:19.702895 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf2ba0-3eca-41d0-a3a0-be28a268090d service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:24:19.706616 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12ae68-6e62-4520-9e0a-7fa73205a2fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:24:19.707594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12ae68-6e62-4520-9e0a-7fa73205a2fe service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:24:19.707869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12ae68-6e62-4520-9e0a-7fa73205a2fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:24:19.708163 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12ae68-6e62-4520-9e0a-7fa73205a2fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:24:19.709982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8e12ae68-6e62-4520-9e0a-7fa73205a2fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:24:19.722036 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12ae68-6e62-4520-9e0a-7fa73205a2fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:24:19.723536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12ae68-6e62-4520-9e0a-7fa73205a2fe service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:24:19.732441 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4508/9105] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:24:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:24:23.666631 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:24:29.728635 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:24:59.098671 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51db96-fdf0-4262-a36b-8c4a53113559 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:24:59.099218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51db96-fdf0-4262-a36b-8c4a53113559 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:24:59.099218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51db96-fdf0-4262-a36b-8c4a53113559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:24:59.145295 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-db51db96-fdf0-4262-a36b-8c4a53113559 None None] MFA Rules not processed for user `b219e01934fa477fbaa053cca586f01b`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:24:59.147473 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-db51db96-fdf0-4262-a36b-8c4a53113559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:24:59.179645 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4598/9106] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 02:24:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:24:59.191994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12ae68-6e62-4520-9e0a-7fa73205a2fe service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:24:59.212002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12ae68-6e62-4520-9e0a-7fa73205a2fe service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:24:59.215602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde13bd0-4851-4603-9977-35bf85490a71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:24:59.216232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde13bd0-4851-4603-9977-35bf85490a71 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:24:59.216628 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde13bd0-4851-4603-9977-35bf85490a71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:24:59.216907 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde13bd0-4851-4603-9977-35bf85490a71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:24:59.224255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde13bd0-4851-4603-9977-35bf85490a71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:24:59.225762 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde13bd0-4851-4603-9977-35bf85490a71 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:24:59.233766 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4509/9107] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:24:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:24:59.320651 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5dcba0-eb99-4c06-9f07-03e1a689c3fb None None] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:24:59.320937 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5dcba0-eb99-4c06-9f07-03e1a689c3fb None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:24:59.321206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5dcba0-eb99-4c06-9f07-03e1a689c3fb None None] PATH_INFO: `/` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:24:59.322565 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4599/9108] 10.222.0.39 () {54 vars in 921 bytes} [Sun Aug 7 02:24:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 07 02:24:59.327815 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfeb1e4-1489-4e54-b348-602960d794c3 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:24:59.328127 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfeb1e4-1489-4e54-b348-602960d794c3 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:24:59.328399 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfeb1e4-1489-4e54-b348-602960d794c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:24:59.365294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-2dfeb1e4-1489-4e54-b348-602960d794c3 None None] MFA Rules not processed for user `e3a1871b12e54ecdb9d656799385d05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:24:59.366996 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2dfeb1e4-1489-4e54-b348-602960d794c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:24:59.396258 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4510/9109] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 02:24:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 02:24:59.416646 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5dcba0-eb99-4c06-9f07-03e1a689c3fb None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:24:59.430688 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5dcba0-eb99-4c06-9f07-03e1a689c3fb None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:24:59.435522 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087eec0-d7cf-4f96-aabb-491f27781508 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:24:59.436149 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087eec0-d7cf-4f96-aabb-491f27781508 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:24:59.436430 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087eec0-d7cf-4f96-aabb-491f27781508 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:24:59.436705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087eec0-d7cf-4f96-aabb-491f27781508 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:24:59.445716 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087eec0-d7cf-4f96-aabb-491f27781508 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:24:59.447519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087eec0-d7cf-4f96-aabb-491f27781508 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:24:59.460998 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4600/9110] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:24:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:24:59.629457 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1706ea-5e36-4d78-984a-dd222f02d96c None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:24:59.629744 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1706ea-5e36-4d78-984a-dd222f02d96c None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:24:59.630043 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1706ea-5e36-4d78-984a-dd222f02d96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:24:59.667322 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0b1706ea-5e36-4d78-984a-dd222f02d96c None None] MFA Rules not processed for user `6c70d5a72d424db68de7c7b8257fe02c`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:24:59.668652 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0b1706ea-5e36-4d78-984a-dd222f02d96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:24:59.677979 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4511/9111] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 02:24:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:24:59.689097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087eec0-d7cf-4f96-aabb-491f27781508 service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:24:59.698277 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087eec0-d7cf-4f96-aabb-491f27781508 service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:24:59.701838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5180d78-a8ee-436d-88c8-f44ffa41b722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:24:59.702424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5180d78-a8ee-436d-88c8-f44ffa41b722 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:24:59.702693 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5180d78-a8ee-436d-88c8-f44ffa41b722 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:24:59.702956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5180d78-a8ee-436d-88c8-f44ffa41b722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:24:59.713043 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5180d78-a8ee-436d-88c8-f44ffa41b722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:24:59.714450 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5180d78-a8ee-436d-88c8-f44ffa41b722 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:24:59.724839 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4601/9112] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:24:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:25:09.664854 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=38 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:25:09.720318 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=30 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:25:13.226994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1706ea-5e36-4d78-984a-dd222f02d96c None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:25:13.237488 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1706ea-5e36-4d78-984a-dd222f02d96c None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:25:13.241718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344f803-bc81-4574-a004-30041f06cd88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:25:13.242988 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344f803-bc81-4574-a004-30041f06cd88 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:25:13.243267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344f803-bc81-4574-a004-30041f06cd88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:25:13.243536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344f803-bc81-4574-a004-30041f06cd88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:25:13.245324 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c344f803-bc81-4574-a004-30041f06cd88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:25:13.255222 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344f803-bc81-4574-a004-30041f06cd88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:25:13.256690 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344f803-bc81-4574-a004-30041f06cd88 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:25:13.265274 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4512/9113] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:25:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:25:19.942290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5180d78-a8ee-436d-88c8-f44ffa41b722 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:25:19.955922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5180d78-a8ee-436d-88c8-f44ffa41b722 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:25:19.961512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6240b81-eaa0-4998-8d95-ad2f9ec708cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:25:19.962137 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6240b81-eaa0-4998-8d95-ad2f9ec708cc service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:25:19.963240 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6240b81-eaa0-4998-8d95-ad2f9ec708cc service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:25:19.963519 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6240b81-eaa0-4998-8d95-ad2f9ec708cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:25:19.965333 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d6240b81-eaa0-4998-8d95-ad2f9ec708cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:25:19.979958 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6240b81-eaa0-4998-8d95-ad2f9ec708cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:25:19.980157 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6240b81-eaa0-4998-8d95-ad2f9ec708cc service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:25:19.991388 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4602/9114] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:25:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:25:23.261963 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:25:29.987130 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:25:40.443749 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344f803-bc81-4574-a004-30041f06cd88 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:25:40.455459 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344f803-bc81-4574-a004-30041f06cd88 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:25:40.460427 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1dea09-b145-4669-8000-fd847624c193 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:25:40.461038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1dea09-b145-4669-8000-fd847624c193 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:25:40.461314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1dea09-b145-4669-8000-fd847624c193 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:25:40.461583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1dea09-b145-4669-8000-fd847624c193 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:25:40.463536 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0b1dea09-b145-4669-8000-fd847624c193 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:25:40.475378 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1dea09-b145-4669-8000-fd847624c193 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:25:40.476958 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1dea09-b145-4669-8000-fd847624c193 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:25:40.487179 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4513/9115] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:25:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:25:50.483085 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:26:02.831499 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78535fe0-acfe-4549-8cba-a81372e0ffba None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:26:02.832099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78535fe0-acfe-4549-8cba-a81372e0ffba None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:26:02.832099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78535fe0-acfe-4549-8cba-a81372e0ffba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:26:02.852673 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-78535fe0-acfe-4549-8cba-a81372e0ffba None None] MFA Rules not processed for user `a2c21b7e0fa94a9eb7155caaf474b3b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:26:02.854422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-78535fe0-acfe-4549-8cba-a81372e0ffba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:26:02.862035 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4603/9116] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:26:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:26:03.257297 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1dea09-b145-4669-8000-fd847624c193 service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:26:03.271472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1dea09-b145-4669-8000-fd847624c193 service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:26:03.280329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ba204-534f-443f-be7a-bed060f905b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:26:03.281255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ba204-534f-443f-be7a-bed060f905b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:26:03.281538 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ba204-534f-443f-be7a-bed060f905b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:26:03.282129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ba204-534f-443f-be7a-bed060f905b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:26:03.284576 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-710ba204-534f-443f-be7a-bed060f905b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:26:03.319140 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ba204-534f-443f-be7a-bed060f905b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:26:03.320649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ba204-534f-443f-be7a-bed060f905b7 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:26:03.333836 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4514/9117] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:26:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:26:12.846730 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:26:13.327608 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=11 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:26:25.447112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78535fe0-acfe-4549-8cba-a81372e0ffba None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:26:25.459518 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78535fe0-acfe-4549-8cba-a81372e0ffba None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:26:25.464774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd6c39-38d8-4e55-82a6-348ff2607933 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:26:25.465371 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd6c39-38d8-4e55-82a6-348ff2607933 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:26:25.465649 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd6c39-38d8-4e55-82a6-348ff2607933 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:26:25.465922 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd6c39-38d8-4e55-82a6-348ff2607933 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:26:25.467653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d4dd6c39-38d8-4e55-82a6-348ff2607933 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:26:25.478766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd6c39-38d8-4e55-82a6-348ff2607933 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:26:25.480362 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd6c39-38d8-4e55-82a6-348ff2607933 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:26:25.490256 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4604/9118] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:26:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:26:35.485979 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:26:37.627713 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ba204-534f-443f-be7a-bed060f905b7 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:26:37.629183 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-710ba204-534f-443f-be7a-bed060f905b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:26:37.645472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ba204-534f-443f-be7a-bed060f905b7 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:26:37.650933 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4f6fd-0c49-4d24-a652-27c8f4829d12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:26:37.651551 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4f6fd-0c49-4d24-a652-27c8f4829d12 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:26:37.651829 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4f6fd-0c49-4d24-a652-27c8f4829d12 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:26:37.652207 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4f6fd-0c49-4d24-a652-27c8f4829d12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:26:37.659847 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4f6fd-0c49-4d24-a652-27c8f4829d12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:26:37.661444 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4f6fd-0c49-4d24-a652-27c8f4829d12 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:26:37.670147 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4515/9119] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:26:37 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:26:47.666218 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:27:38.715461 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd6c39-38d8-4e55-82a6-348ff2607933 service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:27:38.730357 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd6c39-38d8-4e55-82a6-348ff2607933 service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:27:38.737567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a1985-b28b-4213-bba0-c58178c68d53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:27:38.737567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a1985-b28b-4213-bba0-c58178c68d53 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:27:38.737567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a1985-b28b-4213-bba0-c58178c68d53 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:27:38.737567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a1985-b28b-4213-bba0-c58178c68d53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:27:38.739428 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-707a1985-b28b-4213-bba0-c58178c68d53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:27:38.752471 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a1985-b28b-4213-bba0-c58178c68d53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:27:38.754218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a1985-b28b-4213-bba0-c58178c68d53 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:27:38.766044 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4605/9120] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:27:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:27:45.463380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4f6fd-0c49-4d24-a652-27c8f4829d12 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:27:45.475530 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4f6fd-0c49-4d24-a652-27c8f4829d12 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:27:45.480810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05260d-713a-4cc1-aaa2-842a93156333 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:27:45.481411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05260d-713a-4cc1-aaa2-842a93156333 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:27:45.481696 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05260d-713a-4cc1-aaa2-842a93156333 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:27:45.481970 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05260d-713a-4cc1-aaa2-842a93156333 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:27:45.483950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6e05260d-713a-4cc1-aaa2-842a93156333 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:27:45.503331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05260d-713a-4cc1-aaa2-842a93156333 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:27:45.505339 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05260d-713a-4cc1-aaa2-842a93156333 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:27:45.518417 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4516/9121] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:27:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:27:48.603964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a1985-b28b-4213-bba0-c58178c68d53 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:27:48.623658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a1985-b28b-4213-bba0-c58178c68d53 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:27:48.627359 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b30a0-d8b9-4452-91b5-125e7877a8eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:27:48.627990 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b30a0-d8b9-4452-91b5-125e7877a8eb service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:27:48.628267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b30a0-d8b9-4452-91b5-125e7877a8eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:27:48.628545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b30a0-d8b9-4452-91b5-125e7877a8eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:27:48.638288 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b30a0-d8b9-4452-91b5-125e7877a8eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:27:48.639712 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b30a0-d8b9-4452-91b5-125e7877a8eb service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:27:48.649355 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4606/9122] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:27:48 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:27:51.280963 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e39106-8d9c-4b44-bbb8-1ff8c830c338 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:27:51.281438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e39106-8d9c-4b44-bbb8-1ff8c830c338 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:27:51.281715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e39106-8d9c-4b44-bbb8-1ff8c830c338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:27:51.305776 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-75e39106-8d9c-4b44-bbb8-1ff8c830c338 None None] MFA Rules not processed for user `a2c21b7e0fa94a9eb7155caaf474b3b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:27:51.308248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-75e39106-8d9c-4b44-bbb8-1ff8c830c338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:27:51.318076 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4517/9123] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:27:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:27:51.983582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b30a0-d8b9-4452-91b5-125e7877a8eb service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:27:51.992739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b30a0-d8b9-4452-91b5-125e7877a8eb service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:27:51.996435 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b6eee-879e-4373-92ea-25bbbc54a00f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:27:51.997626 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b6eee-879e-4373-92ea-25bbbc54a00f service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:27:51.997901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b6eee-879e-4373-92ea-25bbbc54a00f service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:27:51.998172 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b6eee-879e-4373-92ea-25bbbc54a00f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:27:52.005867 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b6eee-879e-4373-92ea-25bbbc54a00f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:27:52.007300 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b6eee-879e-4373-92ea-25bbbc54a00f service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:27:52.015683 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4607/9124] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:27:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:27:52.352615 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e39106-8d9c-4b44-bbb8-1ff8c830c338 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:27:52.363710 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e39106-8d9c-4b44-bbb8-1ff8c830c338 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:27:52.367285 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f4439-566f-4609-a727-bb681aa72518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:27:52.367912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f4439-566f-4609-a727-bb681aa72518 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:27:52.368221 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f4439-566f-4609-a727-bb681aa72518 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:27:52.368494 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f4439-566f-4609-a727-bb681aa72518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:27:52.379027 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f4439-566f-4609-a727-bb681aa72518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:27:52.380507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f4439-566f-4609-a727-bb681aa72518 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:27:52.401325 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4518/9125] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:27:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:27:53.361200 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b6eee-879e-4373-92ea-25bbbc54a00f service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:27:53.374416 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b6eee-879e-4373-92ea-25bbbc54a00f service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:27:53.379843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8acb5a-7ccf-46e6-90b9-7d27dd457a78 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:27:53.380568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8acb5a-7ccf-46e6-90b9-7d27dd457a78 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:27:53.380923 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8acb5a-7ccf-46e6-90b9-7d27dd457a78 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:27:53.381273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8acb5a-7ccf-46e6-90b9-7d27dd457a78 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:27:53.391116 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8acb5a-7ccf-46e6-90b9-7d27dd457a78 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:27:53.392847 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8acb5a-7ccf-46e6-90b9-7d27dd457a78 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:27:53.404094 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4608/9126] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:27:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:28:02.398581 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=19 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:28:03.399899 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=28 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:28:43.470001 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f4439-566f-4609-a727-bb681aa72518 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:28:43.480918 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f4439-566f-4609-a727-bb681aa72518 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:28:43.485735 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92dae8-3cdf-41b0-94a8-e9b1df28ceba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:28:43.486539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92dae8-3cdf-41b0-94a8-e9b1df28ceba service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:28:43.486812 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92dae8-3cdf-41b0-94a8-e9b1df28ceba service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:28:43.487076 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e92dae8-3cdf-41b0-94a8-e9b1df28ceba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:28:43.498002 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92dae8-3cdf-41b0-94a8-e9b1df28ceba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:28:43.499482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e92dae8-3cdf-41b0-94a8-e9b1df28ceba service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:28:43.511425 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4519/9127] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:28:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:28:53.506687 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:28:55.222465 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8acb5a-7ccf-46e6-90b9-7d27dd457a78 service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:28:55.232773 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8acb5a-7ccf-46e6-90b9-7d27dd457a78 service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:28:55.238354 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb0a4a-75c7-4172-9b7d-7525b1f7577f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:28:55.239025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb0a4a-75c7-4172-9b7d-7525b1f7577f service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:28:55.239370 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb0a4a-75c7-4172-9b7d-7525b1f7577f service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:28:55.239708 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb0a4a-75c7-4172-9b7d-7525b1f7577f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:28:55.241530 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-40bb0a4a-75c7-4172-9b7d-7525b1f7577f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:28:55.253935 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb0a4a-75c7-4172-9b7d-7525b1f7577f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:28:55.255512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb0a4a-75c7-4172-9b7d-7525b1f7577f service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:28:55.265783 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4609/9128] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:28:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 02:28:55.510072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92dae8-3cdf-41b0-94a8-e9b1df28ceba service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:28:55.599656 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e92dae8-3cdf-41b0-94a8-e9b1df28ceba service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:28:55.606570 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05844e2-bbe7-433f-a716-72540548773a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:28:55.607204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05844e2-bbe7-433f-a716-72540548773a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:28:55.607481 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05844e2-bbe7-433f-a716-72540548773a admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:28:55.607751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05844e2-bbe7-433f-a716-72540548773a admin admin] PATH_INFO: `/v3/users/a2c21b7e0fa94a9eb7155caaf474b3b2` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:28:55.609463 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05844e2-bbe7-433f-a716-72540548773a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2c21b7e0fa94a9eb7155caaf474b3b2)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:28:55.611379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05844e2-bbe7-433f-a716-72540548773a admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:28:55.660335 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c05844e2-bbe7-433f-a716-72540548773a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2c21b7e0fa94a9eb7155caaf474b3b2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:28:55.667294 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c05844e2-bbe7-433f-a716-72540548773a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2c21b7e0fa94a9eb7155caaf474b3b2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:28:55.679205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c05844e2-bbe7-433f-a716-72540548773a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2c21b7e0fa94a9eb7155caaf474b3b2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:28:55.679860 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c05844e2-bbe7-433f-a716-72540548773a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2c21b7e0fa94a9eb7155caaf474b3b2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:28:55.686969 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c05844e2-bbe7-433f-a716-72540548773a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2c21b7e0fa94a9eb7155caaf474b3b2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:28:55.692736 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4520/9129] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 02:28:55 2022] DELETE /identity/v3/users/a2c21b7e0fa94a9eb7155caaf474b3b2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:28:55.697546 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58656e2-92e1-4187-bb80-094cd18255e1 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:28:55.697834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58656e2-92e1-4187-bb80-094cd18255e1 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:28:55.698139 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58656e2-92e1-4187-bb80-094cd18255e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:28:55.738989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-e58656e2-92e1-4187-bb80-094cd18255e1 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:28:55.740231 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e58656e2-92e1-4187-bb80-094cd18255e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:28:55.797467 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4610/9130] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:28:55.807359 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05844e2-bbe7-433f-a716-72540548773a admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:28:55.808772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c05844e2-bbe7-433f-a716-72540548773a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:28:55.867403 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05844e2-bbe7-433f-a716-72540548773a admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:28:55.871047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725fe034-475c-4929-9ad3-cedd1d561363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:28:55.871642 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fe034-475c-4929-9ad3-cedd1d561363 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:28:55.871947 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fe034-475c-4929-9ad3-cedd1d561363 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:28:55.872219 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fe034-475c-4929-9ad3-cedd1d561363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:28:55.881049 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725fe034-475c-4929-9ad3-cedd1d561363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:28:55.882464 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725fe034-475c-4929-9ad3-cedd1d561363 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:28:55.892302 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4521/9131] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:28:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:28:56.064042 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58656e2-92e1-4187-bb80-094cd18255e1 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:28:56.065624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e58656e2-92e1-4187-bb80-094cd18255e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:28:56.078735 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58656e2-92e1-4187-bb80-094cd18255e1 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:28:56.083388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14cbf0-32d8-4c93-809a-8b227191b095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:28:56.084144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14cbf0-32d8-4c93-809a-8b227191b095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:28:56.084432 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14cbf0-32d8-4c93-809a-8b227191b095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:28:56.084709 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14cbf0-32d8-4c93-809a-8b227191b095 admin admin] PATH_INFO: `/v3/projects/a212f473f58c4fb680bdb8ad63bd56f1` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:28:56.085843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e14cbf0-32d8-4c93-809a-8b227191b095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a212f473f58c4fb680bdb8ad63bd56f1)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:28:56.087767 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e14cbf0-32d8-4c93-809a-8b227191b095 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:28:56.134375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7e14cbf0-32d8-4c93-809a-8b227191b095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a212f473f58c4fb680bdb8ad63bd56f1', 'request_id': 'req-7e14cbf0-32d8-4c93-809a-8b227191b095'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:28:56.140274 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7e14cbf0-32d8-4c93-809a-8b227191b095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a212f473f58c4fb680bdb8ad63bd56f1', 'request_id': 'req-7e14cbf0-32d8-4c93-809a-8b227191b095'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:28:56.146383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7e14cbf0-32d8-4c93-809a-8b227191b095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a212f473f58c4fb680bdb8ad63bd56f1', 'request_id': 'req-7e14cbf0-32d8-4c93-809a-8b227191b095'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:28:56.160225 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7e14cbf0-32d8-4c93-809a-8b227191b095 admin admin] The token cache is being invalidate because project a212f473f58c4fb680bdb8ad63bd56f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 02:28:56.160512 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7e14cbf0-32d8-4c93-809a-8b227191b095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:28:56.161163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-7e14cbf0-32d8-4c93-809a-8b227191b095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:28:56.162679 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4611/9132] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 02:28:56 2022] DELETE /identity/v3/projects/a212f473f58c4fb680bdb8ad63bd56f1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:28:56.166800 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725fe034-475c-4929-9ad3-cedd1d561363 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:28:56.176310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725fe034-475c-4929-9ad3-cedd1d561363 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:28:56.184994 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:28:56.233497 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633f9a9-46e9-4910-96e1-d5679ee051bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:28:56.234111 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633f9a9-46e9-4910-96e1-d5679ee051bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:28:56.234386 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633f9a9-46e9-4910-96e1-d5679ee051bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:28:56.234653 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633f9a9-46e9-4910-96e1-d5679ee051bc admin admin] PATH_INFO: `/v3/users/e156dd745cda4e978b0e66d990f189bd` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:28:56.235748 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633f9a9-46e9-4910-96e1-d5679ee051bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e156dd745cda4e978b0e66d990f189bd)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:28:56.237708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633f9a9-46e9-4910-96e1-d5679ee051bc admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:28:56.281994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6633f9a9-46e9-4910-96e1-d5679ee051bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e156dd745cda4e978b0e66d990f189bd'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:28:56.288818 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6633f9a9-46e9-4910-96e1-d5679ee051bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e156dd745cda4e978b0e66d990f189bd'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:28:56.300704 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6633f9a9-46e9-4910-96e1-d5679ee051bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e156dd745cda4e978b0e66d990f189bd'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:28:56.301379 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6633f9a9-46e9-4910-96e1-d5679ee051bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e156dd745cda4e978b0e66d990f189bd'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:28:56.308831 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-6633f9a9-46e9-4910-96e1-d5679ee051bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e156dd745cda4e978b0e66d990f189bd'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:28:56.315194 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4522/9133] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 02:28:56 2022] DELETE /identity/v3/users/e156dd745cda4e978b0e66d990f189bd => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:28:56.586206 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14cbf0-32d8-4c93-809a-8b227191b095 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:28:56.587736 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-7e14cbf0-32d8-4c93-809a-8b227191b095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:28:56.601670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14cbf0-32d8-4c93-809a-8b227191b095 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:28:56.648906 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:28:56.660451 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0550b-ea67-45de-83c6-ab8093a13fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:28:56.661025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0550b-ea67-45de-83c6-ab8093a13fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:28:56.661309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0550b-ea67-45de-83c6-ab8093a13fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:28:56.661590 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0550b-ea67-45de-83c6-ab8093a13fea admin admin] PATH_INFO: `/v3/projects/3ebdba50f24942f1a720220552b05a13` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:28:56.662710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0550b-ea67-45de-83c6-ab8093a13fea admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ebdba50f24942f1a720220552b05a13)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:28:56.664654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0550b-ea67-45de-83c6-ab8093a13fea admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:28:56.710366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-42c0550b-ea67-45de-83c6-ab8093a13fea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ebdba50f24942f1a720220552b05a13', 'request_id': 'req-42c0550b-ea67-45de-83c6-ab8093a13fea'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:28:56.715786 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-42c0550b-ea67-45de-83c6-ab8093a13fea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ebdba50f24942f1a720220552b05a13', 'request_id': 'req-42c0550b-ea67-45de-83c6-ab8093a13fea'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:28:56.722844 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-42c0550b-ea67-45de-83c6-ab8093a13fea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ebdba50f24942f1a720220552b05a13', 'request_id': 'req-42c0550b-ea67-45de-83c6-ab8093a13fea'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:28:56.735408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-42c0550b-ea67-45de-83c6-ab8093a13fea admin admin] The token cache is being invalidate because project 3ebdba50f24942f1a720220552b05a13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80492) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 02:28:56.735693 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-42c0550b-ea67-45de-83c6-ab8093a13fea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:28:56.736347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-42c0550b-ea67-45de-83c6-ab8093a13fea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:28:56.737889 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4612/9134] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 02:28:56 2022] DELETE /identity/v3/projects/3ebdba50f24942f1a720220552b05a13 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:28:56.743191 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb1e8b-984b-4362-aa45-053a1f7d99a6 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:28:56.743666 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb1e8b-984b-4362-aa45-053a1f7d99a6 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:28:56.743778 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb1e8b-984b-4362-aa45-053a1f7d99a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:28:56.792317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-67eb1e8b-984b-4362-aa45-053a1f7d99a6 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:28:56.793519 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-67eb1e8b-984b-4362-aa45-053a1f7d99a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:28:56.852719 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4523/9135] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:28:56.862369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd41f6-5a44-4b78-9555-1a99ce415ba0 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:28:56.862657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd41f6-5a44-4b78-9555-1a99ce415ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:28:56.862959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd41f6-5a44-4b78-9555-1a99ce415ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:28:56.883074 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-3ecd41f6-5a44-4b78-9555-1a99ce415ba0 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:28:56.884345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3ecd41f6-5a44-4b78-9555-1a99ce415ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:28:56.893017 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4613/9136] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:28:56.897150 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb1e8b-984b-4362-aa45-053a1f7d99a6 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:28:56.906893 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb1e8b-984b-4362-aa45-053a1f7d99a6 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:28:56.911555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb5dfe-001a-4940-8aec-8d67ef539f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:28:56.912129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb5dfe-001a-4940-8aec-8d67ef539f7d admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:28:56.912410 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb5dfe-001a-4940-8aec-8d67ef539f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:28:56.912682 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb5dfe-001a-4940-8aec-8d67ef539f7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:28:56.913356 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb5dfe-001a-4940-8aec-8d67ef539f7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80493) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 02:28:56.913657 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb5dfe-001a-4940-8aec-8d67ef539f7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:28:56.915255 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb5dfe-001a-4940-8aec-8d67ef539f7d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:28:56.917603 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:28:56.931331 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4524/9137] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 02:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 02:28:56.932323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd41f6-5a44-4b78-9555-1a99ce415ba0 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:28:56.942106 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd41f6-5a44-4b78-9555-1a99ce415ba0 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:28:56.946782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdf052-6cf3-4882-92fe-eff12ea9050f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:28:56.947375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdf052-6cf3-4882-92fe-eff12ea9050f admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:28:56.947653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdf052-6cf3-4882-92fe-eff12ea9050f admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:28:56.947959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdf052-6cf3-4882-92fe-eff12ea9050f admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:28:56.948582 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cdf052-6cf3-4882-92fe-eff12ea9050f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:28:56.950482 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cdf052-6cf3-4882-92fe-eff12ea9050f admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:28:56.990325 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4614/9138] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 02:28:56 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 02:28:56.991539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb5dfe-001a-4940-8aec-8d67ef539f7d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:28:57.002081 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb5dfe-001a-4940-8aec-8d67ef539f7d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:28:57.057802 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71196f2-7e26-4433-bd1d-4996ed650520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:28:57.058407 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71196f2-7e26-4433-bd1d-4996ed650520 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:28:57.058689 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71196f2-7e26-4433-bd1d-4996ed650520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:28:57.058963 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71196f2-7e26-4433-bd1d-4996ed650520 admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:28:57.059582 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71196f2-7e26-4433-bd1d-4996ed650520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:28:57.062254 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71196f2-7e26-4433-bd1d-4996ed650520 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:28:57.083275 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4525/9139] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 02:28:56 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 02:28:57.087492 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdf052-6cf3-4882-92fe-eff12ea9050f admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:28:57.098144 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdf052-6cf3-4882-92fe-eff12ea9050f admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:28:57.102749 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78d8b0-1fd1-44c5-b9f7-79e4e3abeb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:28:57.103349 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78d8b0-1fd1-44c5-b9f7-79e4e3abeb8a admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:28:57.103629 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78d8b0-1fd1-44c5-b9f7-79e4e3abeb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:28:57.103925 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78d8b0-1fd1-44c5-b9f7-79e4e3abeb8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:28:57.104572 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78d8b0-1fd1-44c5-b9f7-79e4e3abeb8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:28:57.106166 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78d8b0-1fd1-44c5-b9f7-79e4e3abeb8a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:28:57.116544 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4615/9140] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 02:28:57.120317 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71196f2-7e26-4433-bd1d-4996ed650520 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:28:57.130874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71196f2-7e26-4433-bd1d-4996ed650520 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:28:57.135510 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989eb9ae-5d6f-44bb-bbaa-9765fa7dd2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:28:57.136135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989eb9ae-5d6f-44bb-bbaa-9765fa7dd2ce admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:28:57.136414 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989eb9ae-5d6f-44bb-bbaa-9765fa7dd2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:28:57.136687 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989eb9ae-5d6f-44bb-bbaa-9765fa7dd2ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:28:57.137330 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989eb9ae-5d6f-44bb-bbaa-9765fa7dd2ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:28:57.138911 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989eb9ae-5d6f-44bb-bbaa-9765fa7dd2ce admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:28:57.154436 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4526/9141] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 02:28:57.158765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78d8b0-1fd1-44c5-b9f7-79e4e3abeb8a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:28:57.168575 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78d8b0-1fd1-44c5-b9f7-79e4e3abeb8a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:28:57.173701 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d451e-2114-48ac-b813-759f6a55aa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:28:57.174347 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d451e-2114-48ac-b813-759f6a55aa63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:28:57.174624 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d451e-2114-48ac-b813-759f6a55aa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:28:57.174920 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d451e-2114-48ac-b813-759f6a55aa63 admin admin] PATH_INFO: `/v3/projects/3bf88ea13f914730a38cef575bd4982d/users/6377b5c6f4bc4645a62697b66316fb39/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:28:57.190368 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d451e-2114-48ac-b813-759f6a55aa63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf88ea13f914730a38cef575bd4982d, user_id=6377b5c6f4bc4645a62697b66316fb39, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:28:57.193032 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d451e-2114-48ac-b813-759f6a55aa63 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:28:57.205245 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4616/9142] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 02:28:57 2022] PUT /identity/v3/projects/3bf88ea13f914730a38cef575bd4982d/users/6377b5c6f4bc4645a62697b66316fb39/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 02:28:57.210425 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21541ad1-2a1a-4a25-8a30-36adb67c8644 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:28:57.210715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21541ad1-2a1a-4a25-8a30-36adb67c8644 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:28:57.210993 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21541ad1-2a1a-4a25-8a30-36adb67c8644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:28:57.229874 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-21541ad1-2a1a-4a25-8a30-36adb67c8644 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:28:57.231061 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-21541ad1-2a1a-4a25-8a30-36adb67c8644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:28:57.289491 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4527/9143] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:28:57.299588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d451e-2114-48ac-b813-759f6a55aa63 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:28:57.301422 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-826d451e-2114-48ac-b813-759f6a55aa63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:28:57.358580 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d451e-2114-48ac-b813-759f6a55aa63 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:28:57.362221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bbc7e-f7e7-4af7-bf16-ac3f55e3a3bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:28:57.362824 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bbc7e-f7e7-4af7-bf16-ac3f55e3a3bb service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:28:57.363103 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bbc7e-f7e7-4af7-bf16-ac3f55e3a3bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:28:57.363377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bbc7e-f7e7-4af7-bf16-ac3f55e3a3bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:28:57.372265 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63bbc7e-f7e7-4af7-bf16-ac3f55e3a3bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:28:57.374296 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63bbc7e-f7e7-4af7-bf16-ac3f55e3a3bb service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:28:57.383650 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4617/9144] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:28:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:29:01.715431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be444a1-a887-40e2-8ed4-94fd5ca3d61b None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:29:01.715942 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be444a1-a887-40e2-8ed4-94fd5ca3d61b None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:29:01.716293 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be444a1-a887-40e2-8ed4-94fd5ca3d61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:29:01.754908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-0be444a1-a887-40e2-8ed4-94fd5ca3d61b None None] MFA Rules not processed for user `6377b5c6f4bc4645a62697b66316fb39`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:29:01.756391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-0be444a1-a887-40e2-8ed4-94fd5ca3d61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:29:01.830122 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4528/9145] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:29:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:29:01.834734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bbc7e-f7e7-4af7-bf16-ac3f55e3a3bb service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:29:01.845044 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bbc7e-f7e7-4af7-bf16-ac3f55e3a3bb service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:29:01.849745 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d42ca-d30b-40ff-9a65-6fbf81aa6c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:29:01.850355 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d42ca-d30b-40ff-9a65-6fbf81aa6c58 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:29:01.850633 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d42ca-d30b-40ff-9a65-6fbf81aa6c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:29:01.850901 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d42ca-d30b-40ff-9a65-6fbf81aa6c58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:29:01.851523 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d42ca-d30b-40ff-9a65-6fbf81aa6c58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:29:01.853484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d42ca-d30b-40ff-9a65-6fbf81aa6c58 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:29:01.865953 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:29:01.888932 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4618/9146] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 02:29:01 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 02:29:01.890138 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be444a1-a887-40e2-8ed4-94fd5ca3d61b None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:29:01.897068 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:29:01.903314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be444a1-a887-40e2-8ed4-94fd5ca3d61b None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:29:01.962967 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0c9b5-ad82-490f-a810-d81d368e73ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:29:01.963593 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0c9b5-ad82-490f-a810-d81d368e73ff admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:29:01.963876 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0c9b5-ad82-490f-a810-d81d368e73ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:29:01.964180 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0c9b5-ad82-490f-a810-d81d368e73ff admin admin] PATH_INFO: `/v3/users` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:29:01.964830 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0c9b5-ad82-490f-a810-d81d368e73ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:29:01.966759 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0c9b5-ad82-490f-a810-d81d368e73ff admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:29:01.994510 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4529/9147] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 02:29:01 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 02:29:01.999469 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d42ca-d30b-40ff-9a65-6fbf81aa6c58 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:29:02.010033 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d42ca-d30b-40ff-9a65-6fbf81aa6c58 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:29:02.014781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a156b6f-58dd-49fa-93b5-533842e9a0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:29:02.015386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a156b6f-58dd-49fa-93b5-533842e9a0ca admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:29:02.015694 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a156b6f-58dd-49fa-93b5-533842e9a0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:29:02.015985 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a156b6f-58dd-49fa-93b5-533842e9a0ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:29:02.016764 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a156b6f-58dd-49fa-93b5-533842e9a0ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:29:02.018366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a156b6f-58dd-49fa-93b5-533842e9a0ca admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:29:02.028947 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4619/9148] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 02:29:02.033791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0c9b5-ad82-490f-a810-d81d368e73ff admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:29:02.043858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0c9b5-ad82-490f-a810-d81d368e73ff admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:29:02.049122 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a998b29-c58d-4e6d-9fff-2c5ba77f4fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:29:02.049763 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a998b29-c58d-4e6d-9fff-2c5ba77f4fb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:29:02.050041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a998b29-c58d-4e6d-9fff-2c5ba77f4fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:29:02.050309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a998b29-c58d-4e6d-9fff-2c5ba77f4fb3 admin admin] PATH_INFO: `/v3/projects/040cf52b8acf4340ac8e42a11f872fd3/users/1990b5ef10354e61b0dcbb2dc183764a/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:29:02.065290 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a998b29-c58d-4e6d-9fff-2c5ba77f4fb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=040cf52b8acf4340ac8e42a11f872fd3, user_id=1990b5ef10354e61b0dcbb2dc183764a, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:29:02.067948 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a998b29-c58d-4e6d-9fff-2c5ba77f4fb3 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:29:02.080429 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4530/9149] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 02:29:02 2022] PUT /identity/v3/projects/040cf52b8acf4340ac8e42a11f872fd3/users/1990b5ef10354e61b0dcbb2dc183764a/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 02:29:02.084294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a156b6f-58dd-49fa-93b5-533842e9a0ca admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:29:02.095836 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a156b6f-58dd-49fa-93b5-533842e9a0ca admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:29:02.158644 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca849a6-d5ab-4358-acd1-3b864e8c8e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:29:02.159163 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca849a6-d5ab-4358-acd1-3b864e8c8e12 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:29:02.159448 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca849a6-d5ab-4358-acd1-3b864e8c8e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:29:02.159720 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca849a6-d5ab-4358-acd1-3b864e8c8e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:29:02.160393 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca849a6-d5ab-4358-acd1-3b864e8c8e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:29:02.162025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca849a6-d5ab-4358-acd1-3b864e8c8e12 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:29:02.172639 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4620/9150] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 02:29:02.176680 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a998b29-c58d-4e6d-9fff-2c5ba77f4fb3 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:29:02.187123 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a998b29-c58d-4e6d-9fff-2c5ba77f4fb3 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:29:02.191718 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1e2dd-10b9-443e-a621-14d7216c8418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:29:02.192393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1e2dd-10b9-443e-a621-14d7216c8418 admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:29:02.192674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1e2dd-10b9-443e-a621-14d7216c8418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:29:02.192965 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1e2dd-10b9-443e-a621-14d7216c8418 admin admin] PATH_INFO: `/v3/projects/040cf52b8acf4340ac8e42a11f872fd3/users/1990b5ef10354e61b0dcbb2dc183764a/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:29:02.194857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1e2dd-10b9-443e-a621-14d7216c8418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=040cf52b8acf4340ac8e42a11f872fd3, user_id=1990b5ef10354e61b0dcbb2dc183764a, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:29:02.199316 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1e2dd-10b9-443e-a621-14d7216c8418 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:29:02.210509 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4531/9151] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 02:29:02 2022] PUT /identity/v3/projects/040cf52b8acf4340ac8e42a11f872fd3/users/1990b5ef10354e61b0dcbb2dc183764a/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:29:06.315659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a41969-2015-4246-b95d-4bb07bb49cc0 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:29:06.316178 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a41969-2015-4246-b95d-4bb07bb49cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:29:06.316418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a41969-2015-4246-b95d-4bb07bb49cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:29:06.346653 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d2a41969-2015-4246-b95d-4bb07bb49cc0 None None] MFA Rules not processed for user `1990b5ef10354e61b0dcbb2dc183764a`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:29:06.348078 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d2a41969-2015-4246-b95d-4bb07bb49cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:29:06.422297 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4621/9152] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:29:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:29:06.438909 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1e2dd-10b9-443e-a621-14d7216c8418 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:29:06.440784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-58b1e2dd-10b9-443e-a621-14d7216c8418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:29:06.517126 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1e2dd-10b9-443e-a621-14d7216c8418 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:29:06.522626 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e9d26-da64-4a0c-8cd3-45fae9c94226 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:29:06.523238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e9d26-da64-4a0c-8cd3-45fae9c94226 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:29:06.523516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e9d26-da64-4a0c-8cd3-45fae9c94226 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:29:06.523785 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e9d26-da64-4a0c-8cd3-45fae9c94226 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:29:06.577625 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:29:06.581606 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e9d26-da64-4a0c-8cd3-45fae9c94226 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:29:06.583946 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e9d26-da64-4a0c-8cd3-45fae9c94226 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:29:06.595137 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4532/9153] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:29:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:29:07.707617 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2caa3-06f3-40fe-9f19-aebffd4a9e76 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:29:07.708152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2caa3-06f3-40fe-9f19-aebffd4a9e76 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:29:07.708235 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2caa3-06f3-40fe-9f19-aebffd4a9e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:29:07.729358 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-efe2caa3-06f3-40fe-9f19-aebffd4a9e76 None None] MFA Rules not processed for user `6377b5c6f4bc4645a62697b66316fb39`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:29:07.730660 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-efe2caa3-06f3-40fe-9f19-aebffd4a9e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:29:07.738147 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4622/9154] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:29:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:29:08.717779 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e9d26-da64-4a0c-8cd3-45fae9c94226 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:29:08.719588 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-895e9d26-da64-4a0c-8cd3-45fae9c94226 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:29:08.796491 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e9d26-da64-4a0c-8cd3-45fae9c94226 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:29:08.801761 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278edc92-f299-42b2-9bdd-6855619af6ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:29:08.802380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278edc92-f299-42b2-9bdd-6855619af6ea service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:29:08.802654 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278edc92-f299-42b2-9bdd-6855619af6ea service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:29:08.802919 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278edc92-f299-42b2-9bdd-6855619af6ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:29:08.804699 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-278edc92-f299-42b2-9bdd-6855619af6ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:29:08.817161 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278edc92-f299-42b2-9bdd-6855619af6ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:29:08.818743 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278edc92-f299-42b2-9bdd-6855619af6ea service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:29:08.829033 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4533/9155] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:29:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:29:17.723408 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=74,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:29:18.365446 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2caa3-06f3-40fe-9f19-aebffd4a9e76 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:29:18.418625 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2caa3-06f3-40fe-9f19-aebffd4a9e76 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:29:18.422249 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724cd8d-b2fe-4882-8e42-a71e384952a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:29:18.422839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724cd8d-b2fe-4882-8e42-a71e384952a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:29:18.423112 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724cd8d-b2fe-4882-8e42-a71e384952a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:29:18.423377 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724cd8d-b2fe-4882-8e42-a71e384952a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:29:18.432057 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2724cd8d-b2fe-4882-8e42-a71e384952a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:29:18.433509 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2724cd8d-b2fe-4882-8e42-a71e384952a3 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:29:18.442820 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4623/9156] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:29:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:29:18.824777 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=35 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:29:20.102367 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278edc92-f299-42b2-9bdd-6855619af6ea service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:29:20.111784 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278edc92-f299-42b2-9bdd-6855619af6ea service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:29:20.115586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c61cf-80f1-43a0-bc4c-f18cb5336b45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:29:20.116218 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c61cf-80f1-43a0-bc4c-f18cb5336b45 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:29:20.116612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c61cf-80f1-43a0-bc4c-f18cb5336b45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:29:20.116887 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c61cf-80f1-43a0-bc4c-f18cb5336b45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:29:20.118605 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a21c61cf-80f1-43a0-bc4c-f18cb5336b45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:29:20.128849 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c61cf-80f1-43a0-bc4c-f18cb5336b45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:29:20.130267 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c61cf-80f1-43a0-bc4c-f18cb5336b45 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:29:20.138143 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4534/9157] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:29:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:29:28.438622 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=26 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:29:30.134653 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:30:44.407150 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724cd8d-b2fe-4882-8e42-a71e384952a3 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:30:44.408663 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-2724cd8d-b2fe-4882-8e42-a71e384952a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:30:44.432478 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724cd8d-b2fe-4882-8e42-a71e384952a3 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:30:44.437567 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e8dc3-7d54-4237-bd21-a53b3b950060 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:30:44.438159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e8dc3-7d54-4237-bd21-a53b3b950060 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:30:44.438436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e8dc3-7d54-4237-bd21-a53b3b950060 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:30:44.438705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e8dc3-7d54-4237-bd21-a53b3b950060 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:30:44.440418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6d4e8dc3-7d54-4237-bd21-a53b3b950060 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:30:44.452070 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e8dc3-7d54-4237-bd21-a53b3b950060 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:30:44.453717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e8dc3-7d54-4237-bd21-a53b3b950060 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:30:44.463335 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4624/9158] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:30:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:30:54.459194 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=10 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:31:29.627742 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb249613-7efb-4d29-9e84-988ce3775d9f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:31:29.628310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb249613-7efb-4d29-9e84-988ce3775d9f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:31:29.628453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb249613-7efb-4d29-9e84-988ce3775d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:31:29.690149 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-cb249613-7efb-4d29-9e84-988ce3775d9f None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:31:29.691482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cb249613-7efb-4d29-9e84-988ce3775d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:31:29.768593 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4535/9159] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 02:31:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:31:29.814878 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e8dc3-7d54-4237-bd21-a53b3b950060 service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:31:29.816346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6d4e8dc3-7d54-4237-bd21-a53b3b950060 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:31:29.905723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e8dc3-7d54-4237-bd21-a53b3b950060 service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:31:29.910690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8001c49-3a02-4f8b-8b01-f7533d27bf2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:31:29.911290 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8001c49-3a02-4f8b-8b01-f7533d27bf2d service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:31:29.911568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8001c49-3a02-4f8b-8b01-f7533d27bf2d service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:31:29.911841 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8001c49-3a02-4f8b-8b01-f7533d27bf2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:31:29.919812 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8001c49-3a02-4f8b-8b01-f7533d27bf2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:31:29.921417 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8001c49-3a02-4f8b-8b01-f7533d27bf2d service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:31:29.929468 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4625/9160] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 02:31:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 02:31:31.045913 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb249613-7efb-4d29-9e84-988ce3775d9f None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:31:31.047912 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-cb249613-7efb-4d29-9e84-988ce3775d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:31:31.080643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb249613-7efb-4d29-9e84-988ce3775d9f None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:31:31.090706 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74969f8-464d-4600-a9f4-c68c5ad574bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:31:31.092561 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74969f8-464d-4600-a9f4-c68c5ad574bd service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:31:31.093075 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74969f8-464d-4600-a9f4-c68c5ad574bd service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:31:31.093591 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74969f8-464d-4600-a9f4-c68c5ad574bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:31:31.097096 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a74969f8-464d-4600-a9f4-c68c5ad574bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:31:31.119531 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74969f8-464d-4600-a9f4-c68c5ad574bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:31:31.122369 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74969f8-464d-4600-a9f4-c68c5ad574bd service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:31:31.149985 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4536/9161] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:31:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:31:33.560594 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8001c49-3a02-4f8b-8b01-f7533d27bf2d service swift] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:31:33.573829 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8001c49-3a02-4f8b-8b01-f7533d27bf2d service swift] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:31:33.578987 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e3628-a17d-4286-83a4-ddf14c0f4764 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:31:33.579601 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e3628-a17d-4286-83a4-ddf14c0f4764 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:31:33.579914 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e3628-a17d-4286-83a4-ddf14c0f4764 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:31:33.580187 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e3628-a17d-4286-83a4-ddf14c0f4764 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:31:33.582099 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ae8e3628-a17d-4286-83a4-ddf14c0f4764 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:31:33.611616 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e3628-a17d-4286-83a4-ddf14c0f4764 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:31:33.617079 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e3628-a17d-4286-83a4-ddf14c0f4764 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:31:33.627865 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4626/9162] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:31:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:31:41.132931 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=58 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:31:41.798225 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74969f8-464d-4600-a9f4-c68c5ad574bd service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:31:41.807371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74969f8-464d-4600-a9f4-c68c5ad574bd service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:31:41.810901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914b182-a37c-4375-ac59-a17bed7e9078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:31:41.811483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914b182-a37c-4375-ac59-a17bed7e9078 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:31:41.811752 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914b182-a37c-4375-ac59-a17bed7e9078 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:31:41.812070 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914b182-a37c-4375-ac59-a17bed7e9078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:31:41.813767 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6914b182-a37c-4375-ac59-a17bed7e9078 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:31:41.822808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914b182-a37c-4375-ac59-a17bed7e9078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:31:41.824310 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914b182-a37c-4375-ac59-a17bed7e9078 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:31:41.831943 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4537/9163] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:31:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:31:41.942699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008c723-6edb-4045-b9b1-55ab3aad5090 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:31:41.943238 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008c723-6edb-4045-b9b1-55ab3aad5090 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:31:41.943238 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008c723-6edb-4045-b9b1-55ab3aad5090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:31:41.964938 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d008c723-6edb-4045-b9b1-55ab3aad5090 None None] MFA Rules not processed for user `6c70d5a72d424db68de7c7b8257fe02c`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:31:41.966286 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d008c723-6edb-4045-b9b1-55ab3aad5090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:31:41.979854 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4627/9164] 10.222.0.39 () {58 vars in 1018 bytes} [Sun Aug 7 02:31:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:31:41.992035 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914b182-a37c-4375-ac59-a17bed7e9078 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:31:41.993508 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-6914b182-a37c-4375-ac59-a17bed7e9078 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:31:42.074772 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914b182-a37c-4375-ac59-a17bed7e9078 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:31:42.079068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd18b9-ead1-4535-82fb-3504a9af5c4f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb60ac015204436b81971694393380c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:31:42.080319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd18b9-ead1-4535-82fb-3504a9af5c4f service glance] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:31:42.080602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd18b9-ead1-4535-82fb-3504a9af5c4f service glance] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:31:42.080877 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd18b9-ead1-4535-82fb-3504a9af5c4f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:31:42.091586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd18b9-ead1-4535-82fb-3504a9af5c4f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:31:42.093398 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd18b9-ead1-4535-82fb-3504a9af5c4f service glance] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:31:42.105626 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4538/9165] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:31:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:31:42.169652 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008c723-6edb-4045-b9b1-55ab3aad5090 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:31:42.171092 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d008c723-6edb-4045-b9b1-55ab3aad5090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:31:42.182262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008c723-6edb-4045-b9b1-55ab3aad5090 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:31:42.185769 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914057b-e18f-40b3-8459-b20aa466370c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:31:42.186360 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914057b-e18f-40b3-8459-b20aa466370c service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:31:42.186634 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914057b-e18f-40b3-8459-b20aa466370c service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:31:42.186910 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914057b-e18f-40b3-8459-b20aa466370c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:31:42.188550 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9914057b-e18f-40b3-8459-b20aa466370c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:31:42.197600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914057b-e18f-40b3-8459-b20aa466370c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:31:42.199016 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914057b-e18f-40b3-8459-b20aa466370c service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:31:42.207299 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4628/9166] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:31:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:31:42.285259 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd18b9-ead1-4535-82fb-3504a9af5c4f service glance] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:31:42.294768 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd18b9-ead1-4535-82fb-3504a9af5c4f service glance] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:31:42.298503 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6d6ac-c427-427b-90d1-1c0be0ba2c70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:31:42.299095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6d6ac-c427-427b-90d1-1c0be0ba2c70 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:31:42.299371 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6d6ac-c427-427b-90d1-1c0be0ba2c70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:31:42.299641 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6d6ac-c427-427b-90d1-1c0be0ba2c70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:31:42.301387 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-2ab6d6ac-c427-427b-90d1-1c0be0ba2c70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:31:42.314482 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6d6ac-c427-427b-90d1-1c0be0ba2c70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:31:42.315927 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6d6ac-c427-427b-90d1-1c0be0ba2c70 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:31:42.326804 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4539/9167] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:31:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:31:43.184657 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914057b-e18f-40b3-8459-b20aa466370c service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:31:43.193399 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914057b-e18f-40b3-8459-b20aa466370c service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:31:43.197056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371913b-1676-4047-8e48-b2c15164e819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:31:43.197658 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371913b-1676-4047-8e48-b2c15164e819 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:31:43.197954 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371913b-1676-4047-8e48-b2c15164e819 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:31:43.198204 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371913b-1676-4047-8e48-b2c15164e819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:31:43.199932 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5371913b-1676-4047-8e48-b2c15164e819 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:31:43.209734 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371913b-1676-4047-8e48-b2c15164e819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:31:43.211159 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371913b-1676-4047-8e48-b2c15164e819 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:31:43.219991 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4629/9168] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:31:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:31:44.008705 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6d6ac-c427-427b-90d1-1c0be0ba2c70 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:31:44.022264 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6d6ac-c427-427b-90d1-1c0be0ba2c70 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:31:44.028678 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de639d25-e8fd-4d37-95c7-e44b975a3c24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:31:44.029353 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de639d25-e8fd-4d37-95c7-e44b975a3c24 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:31:44.029700 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de639d25-e8fd-4d37-95c7-e44b975a3c24 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:31:44.029972 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de639d25-e8fd-4d37-95c7-e44b975a3c24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:31:44.032158 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-de639d25-e8fd-4d37-95c7-e44b975a3c24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:31:44.045754 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de639d25-e8fd-4d37-95c7-e44b975a3c24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:31:44.047352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de639d25-e8fd-4d37-95c7-e44b975a3c24 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:31:44.058457 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4540/9169] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:31:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:31:44.785402 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cd759-59ce-40e0-a2fa-ef0f0098cbf8 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:31:44.785890 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cd759-59ce-40e0-a2fa-ef0f0098cbf8 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:31:44.786109 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cd759-59ce-40e0-a2fa-ef0f0098cbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:31:44.806161 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1b7cd759-59ce-40e0-a2fa-ef0f0098cbf8 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:31:44.807436 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1b7cd759-59ce-40e0-a2fa-ef0f0098cbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:31:44.815187 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4630/9170] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 02:31:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:31:44.827323 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de639d25-e8fd-4d37-95c7-e44b975a3c24 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:31:44.839059 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de639d25-e8fd-4d37-95c7-e44b975a3c24 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:31:44.844302 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f2196-376a-4ec6-8e58-ef33ba00968e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:31:44.845484 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f2196-376a-4ec6-8e58-ef33ba00968e service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:31:44.845765 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f2196-376a-4ec6-8e58-ef33ba00968e service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:31:44.846042 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f2196-376a-4ec6-8e58-ef33ba00968e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:31:44.854951 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f2196-376a-4ec6-8e58-ef33ba00968e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:31:44.856717 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f2196-376a-4ec6-8e58-ef33ba00968e service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:31:44.865687 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4541/9171] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 02:31:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 07 02:31:54.800587 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=70 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:31:54.862295 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=59 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:31:59.467572 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eaf3e6-a875-47e6-a7d9-5f4a3b805de9 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:31:59.468138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eaf3e6-a875-47e6-a7d9-5f4a3b805de9 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:31:59.468138 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eaf3e6-a875-47e6-a7d9-5f4a3b805de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:31:59.488697 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-d0eaf3e6-a875-47e6-a7d9-5f4a3b805de9 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:31:59.489933 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d0eaf3e6-a875-47e6-a7d9-5f4a3b805de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:31:59.496863 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4631/9172] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 02:31:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:31:59.509656 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f2196-376a-4ec6-8e58-ef33ba00968e service swift] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:31:59.520331 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f2196-376a-4ec6-8e58-ef33ba00968e service swift] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:31:59.525360 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380e7b6-3cb4-4ec7-adf4-7bf52230ae17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:31:59.525948 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380e7b6-3cb4-4ec7-adf4-7bf52230ae17 service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:31:59.526228 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380e7b6-3cb4-4ec7-adf4-7bf52230ae17 service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:31:59.526502 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380e7b6-3cb4-4ec7-adf4-7bf52230ae17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:31:59.534390 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380e7b6-3cb4-4ec7-adf4-7bf52230ae17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:31:59.535997 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380e7b6-3cb4-4ec7-adf4-7bf52230ae17 service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:31:59.543985 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4542/9173] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 02:31:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 02:32:09.482010 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:32:09.540813 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:33:12.840502 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eaf3e6-a875-47e6-a7d9-5f4a3b805de9 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:33:12.850838 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eaf3e6-a875-47e6-a7d9-5f4a3b805de9 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:33:12.854540 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f830d-d93c-44ab-ba13-96c967a8cfdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:33:12.855151 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f830d-d93c-44ab-ba13-96c967a8cfdb service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:33:12.855433 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f830d-d93c-44ab-ba13-96c967a8cfdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:33:12.855705 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f830d-d93c-44ab-ba13-96c967a8cfdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:33:12.857481 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-ab9f830d-d93c-44ab-ba13-96c967a8cfdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:33:12.873349 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f830d-d93c-44ab-ba13-96c967a8cfdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:33:12.874801 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f830d-d93c-44ab-ba13-96c967a8cfdb service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:33:12.886701 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4632/9174] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:33:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:33:17.510669 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2fe30-8b2c-46a4-9278-4dfd32fd3ef1 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:33:17.511205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2fe30-8b2c-46a4-9278-4dfd32fd3ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:33:17.511205 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2fe30-8b2c-46a4-9278-4dfd32fd3ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:33:17.532419 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-88a2fe30-8b2c-46a4-9278-4dfd32fd3ef1 None None] MFA Rules not processed for user `6377b5c6f4bc4645a62697b66316fb39`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:33:17.534233 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-88a2fe30-8b2c-46a4-9278-4dfd32fd3ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:33:17.541106 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4543/9175] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:33:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:33:22.881725 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:33:27.526498 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:33:33.049320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f830d-d93c-44ab-ba13-96c967a8cfdb service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:33:33.057859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f830d-d93c-44ab-ba13-96c967a8cfdb service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:33:33.061414 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4c9a5-883a-4657-b38f-72b93ca1f095 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:33:33.062004 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4c9a5-883a-4657-b38f-72b93ca1f095 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:33:33.062280 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4c9a5-883a-4657-b38f-72b93ca1f095 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:33:33.062549 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4c9a5-883a-4657-b38f-72b93ca1f095 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:33:33.064291 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1cb4c9a5-883a-4657-b38f-72b93ca1f095 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:33:33.073400 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb4c9a5-883a-4657-b38f-72b93ca1f095 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:33:33.074822 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb4c9a5-883a-4657-b38f-72b93ca1f095 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:33:33.083114 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4633/9176] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:33:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:33:38.893033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2fe30-8b2c-46a4-9278-4dfd32fd3ef1 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:33:38.909892 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2fe30-8b2c-46a4-9278-4dfd32fd3ef1 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:33:38.915858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002a257-9849-4222-ab07-31d2aa6d2e78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:33:38.916745 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002a257-9849-4222-ab07-31d2aa6d2e78 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:33:38.917041 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002a257-9849-4222-ab07-31d2aa6d2e78 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:33:38.917299 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002a257-9849-4222-ab07-31d2aa6d2e78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:33:38.919169 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-d002a257-9849-4222-ab07-31d2aa6d2e78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:33:38.940438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002a257-9849-4222-ab07-31d2aa6d2e78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:33:38.942617 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002a257-9849-4222-ab07-31d2aa6d2e78 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:33:38.959337 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4544/9177] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:33:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:33:43.079236 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:33:45.026309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4c9a5-883a-4657-b38f-72b93ca1f095 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:33:45.035640 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4c9a5-883a-4657-b38f-72b93ca1f095 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:33:45.039213 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0736632-0a97-4f5a-b577-b467ef4a88b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:33:45.039802 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0736632-0a97-4f5a-b577-b467ef4a88b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:33:45.040105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0736632-0a97-4f5a-b577-b467ef4a88b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:33:45.040372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0736632-0a97-4f5a-b577-b467ef4a88b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:33:45.042096 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-f0736632-0a97-4f5a-b577-b467ef4a88b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:33:45.054994 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0736632-0a97-4f5a-b577-b467ef4a88b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:33:45.056600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0736632-0a97-4f5a-b577-b467ef4a88b6 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:33:45.067470 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4634/9178] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:33:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:33:48.951182 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:33:55.062536 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=6 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:34:31.146612 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002a257-9849-4222-ab07-31d2aa6d2e78 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:34:31.156256 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002a257-9849-4222-ab07-31d2aa6d2e78 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:34:31.159859 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171d11b-7642-4025-850d-5304b3749867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:34:31.160518 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171d11b-7642-4025-850d-5304b3749867 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:34:31.160799 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171d11b-7642-4025-850d-5304b3749867 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:34:31.161068 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171d11b-7642-4025-850d-5304b3749867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:34:31.169594 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171d11b-7642-4025-850d-5304b3749867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:34:31.170827 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171d11b-7642-4025-850d-5304b3749867 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:34:31.178935 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4545/9179] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:34:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:34:41.175353 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:35:52.404793 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0736632-0a97-4f5a-b577-b467ef4a88b6 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:35:52.445559 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0736632-0a97-4f5a-b577-b467ef4a88b6 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:35:52.450552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4fe18-34c2-4119-ab8c-a840d28d7232 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:35:52.451147 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4fe18-34c2-4119-ab8c-a840d28d7232 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:35:52.451418 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4fe18-34c2-4119-ab8c-a840d28d7232 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:35:52.451681 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4fe18-34c2-4119-ab8c-a840d28d7232 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:35:52.460322 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4fe18-34c2-4119-ab8c-a840d28d7232 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:35:52.461909 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4fe18-34c2-4119-ab8c-a840d28d7232 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:35:52.472494 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4635/9180] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:35:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 02:35:52.953539 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171d11b-7642-4025-850d-5304b3749867 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:35:52.976755 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171d11b-7642-4025-850d-5304b3749867 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:35:52.982565 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c0b83-4635-45ff-80aa-8d331c02b660 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:35:52.983162 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c0b83-4635-45ff-80aa-8d331c02b660 service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:35:52.983808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c0b83-4635-45ff-80aa-8d331c02b660 service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:35:52.983808 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c0b83-4635-45ff-80aa-8d331c02b660 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:35:52.991568 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c0b83-4635-45ff-80aa-8d331c02b660 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:35:52.993171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c0b83-4635-45ff-80aa-8d331c02b660 service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:35:53.002454 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4546/9181] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:35:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:36:02.467807 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=20 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:36:02.997911 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=11 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:36:07.828756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4fe18-34c2-4119-ab8c-a840d28d7232 service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:36:07.839777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4fe18-34c2-4119-ab8c-a840d28d7232 service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:36:07.845017 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f1821-d9be-467f-8cb2-9d8cc34bc551 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:36:07.845588 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f1821-d9be-467f-8cb2-9d8cc34bc551 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:36:07.845899 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f1821-d9be-467f-8cb2-9d8cc34bc551 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:36:07.846200 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f1821-d9be-467f-8cb2-9d8cc34bc551 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:36:07.847964 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-713f1821-d9be-467f-8cb2-9d8cc34bc551 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:36:07.878853 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f1821-d9be-467f-8cb2-9d8cc34bc551 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:36:07.880463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f1821-d9be-467f-8cb2-9d8cc34bc551 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:36:07.890320 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4636/9182] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:36:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:36:17.885898 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=14 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:36:35.429660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c0b83-4635-45ff-80aa-8d331c02b660 service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:36:35.440980 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c0b83-4635-45ff-80aa-8d331c02b660 service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:36:35.445922 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6884344-decc-4ef4-beb0-a8ea7a6d6599 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:36:35.446507 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6884344-decc-4ef4-beb0-a8ea7a6d6599 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:36:35.446780 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6884344-decc-4ef4-beb0-a8ea7a6d6599 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:36:35.447047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6884344-decc-4ef4-beb0-a8ea7a6d6599 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:36:35.455908 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6884344-decc-4ef4-beb0-a8ea7a6d6599 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:36:35.457856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6884344-decc-4ef4-beb0-a8ea7a6d6599 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:36:35.467841 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4547/9183] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:36:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 02:36:45.463729 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:37:38.844717 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f1821-d9be-467f-8cb2-9d8cc34bc551 service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:37:38.859440 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f1821-d9be-467f-8cb2-9d8cc34bc551 service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:37:38.868193 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead7fa7-ba6b-4400-9a3d-b101ccdda37a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:37:38.868811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead7fa7-ba6b-4400-9a3d-b101ccdda37a service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:37:38.869086 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead7fa7-ba6b-4400-9a3d-b101ccdda37a service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:37:38.869356 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead7fa7-ba6b-4400-9a3d-b101ccdda37a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:37:38.878834 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead7fa7-ba6b-4400-9a3d-b101ccdda37a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:37:38.880447 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead7fa7-ba6b-4400-9a3d-b101ccdda37a service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:37:38.901788 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4637/9184] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:37:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:37:38.987660 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6884344-decc-4ef4-beb0-a8ea7a6d6599 service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:37:39.004750 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6884344-decc-4ef4-beb0-a8ea7a6d6599 service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:37:39.010025 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7c9d7-e45e-4afd-aa03-58518ea74179 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:37:39.010857 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7c9d7-e45e-4afd-aa03-58518ea74179 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:37:39.011314 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7c9d7-e45e-4afd-aa03-58518ea74179 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:37:39.011585 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7c9d7-e45e-4afd-aa03-58518ea74179 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:37:39.019758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc7c9d7-e45e-4afd-aa03-58518ea74179 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:37:39.021224 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc7c9d7-e45e-4afd-aa03-58518ea74179 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:37:39.029650 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4548/9185] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:37:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:37:47.191845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead7fa7-ba6b-4400-9a3d-b101ccdda37a service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:37:47.201627 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead7fa7-ba6b-4400-9a3d-b101ccdda37a service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:37:47.205647 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c488a4-184e-4551-9dcf-67e888f02de3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:37:47.206257 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c488a4-184e-4551-9dcf-67e888f02de3 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:37:47.206542 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c488a4-184e-4551-9dcf-67e888f02de3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:37:47.206816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c488a4-184e-4551-9dcf-67e888f02de3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:37:47.267479 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c488a4-184e-4551-9dcf-67e888f02de3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:37:47.268948 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c488a4-184e-4551-9dcf-67e888f02de3 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:37:47.288154 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4638/9186] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:37:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:37:49.025935 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=6 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:37:50.538790 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7c9d7-e45e-4afd-aa03-58518ea74179 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:37:50.552033 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7c9d7-e45e-4afd-aa03-58518ea74179 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:37:50.556921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceeabb3-4d9f-4d18-86f5-9ad69fe5c040 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:37:50.557515 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceeabb3-4d9f-4d18-86f5-9ad69fe5c040 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:37:50.557793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceeabb3-4d9f-4d18-86f5-9ad69fe5c040 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:37:50.558064 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceeabb3-4d9f-4d18-86f5-9ad69fe5c040 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:37:50.559982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bceeabb3-4d9f-4d18-86f5-9ad69fe5c040 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:37:50.572198 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceeabb3-4d9f-4d18-86f5-9ad69fe5c040 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:37:50.573876 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceeabb3-4d9f-4d18-86f5-9ad69fe5c040 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:37:50.584039 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4549/9187] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:37:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:37:53.762367 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c488a4-184e-4551-9dcf-67e888f02de3 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:37:53.778165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c488a4-184e-4551-9dcf-67e888f02de3 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:37:53.784455 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7eb0f3-21f9-4fc5-a497-25c9c38cfbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:37:53.785105 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7eb0f3-21f9-4fc5-a497-25c9c38cfbdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:37:53.785385 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7eb0f3-21f9-4fc5-a497-25c9c38cfbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:37:53.785659 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7eb0f3-21f9-4fc5-a497-25c9c38cfbdb admin admin] PATH_INFO: `/v3/users/6377b5c6f4bc4645a62697b66316fb39` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:37:53.786814 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7eb0f3-21f9-4fc5-a497-25c9c38cfbdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6377b5c6f4bc4645a62697b66316fb39)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:37:53.788813 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7eb0f3-21f9-4fc5-a497-25c9c38cfbdb admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:37:53.835690 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6d7eb0f3-21f9-4fc5-a497-25c9c38cfbdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6377b5c6f4bc4645a62697b66316fb39'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:37:53.842766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6d7eb0f3-21f9-4fc5-a497-25c9c38cfbdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6377b5c6f4bc4645a62697b66316fb39'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:37:53.858408 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6d7eb0f3-21f9-4fc5-a497-25c9c38cfbdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6377b5c6f4bc4645a62697b66316fb39'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:37:53.859237 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6d7eb0f3-21f9-4fc5-a497-25c9c38cfbdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6377b5c6f4bc4645a62697b66316fb39'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:37:53.869940 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-6d7eb0f3-21f9-4fc5-a497-25c9c38cfbdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6377b5c6f4bc4645a62697b66316fb39'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:37:53.876609 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4639/9188] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 02:37:53 2022] DELETE /identity/v3/users/6377b5c6f4bc4645a62697b66316fb39 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:37:54.059345 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceeabb3-4d9f-4d18-86f5-9ad69fe5c040 service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:37:54.071692 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceeabb3-4d9f-4d18-86f5-9ad69fe5c040 service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:37:54.129804 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77007f0c-a186-4b28-9309-32d688f2bb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:37:54.130431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77007f0c-a186-4b28-9309-32d688f2bb79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:37:54.130711 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77007f0c-a186-4b28-9309-32d688f2bb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:37:54.130982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77007f0c-a186-4b28-9309-32d688f2bb79 admin admin] PATH_INFO: `/v3/projects/3bf88ea13f914730a38cef575bd4982d` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:37:54.132238 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77007f0c-a186-4b28-9309-32d688f2bb79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bf88ea13f914730a38cef575bd4982d)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:37:54.134135 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77007f0c-a186-4b28-9309-32d688f2bb79 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:37:54.180411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-77007f0c-a186-4b28-9309-32d688f2bb79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bf88ea13f914730a38cef575bd4982d', 'request_id': 'req-77007f0c-a186-4b28-9309-32d688f2bb79'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:37:54.186401 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-77007f0c-a186-4b28-9309-32d688f2bb79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bf88ea13f914730a38cef575bd4982d', 'request_id': 'req-77007f0c-a186-4b28-9309-32d688f2bb79'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:37:54.192602 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-77007f0c-a186-4b28-9309-32d688f2bb79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bf88ea13f914730a38cef575bd4982d', 'request_id': 'req-77007f0c-a186-4b28-9309-32d688f2bb79'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:37:54.205363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-77007f0c-a186-4b28-9309-32d688f2bb79 admin admin] The token cache is being invalidate because project 3bf88ea13f914730a38cef575bd4982d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 02:37:54.205649 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-77007f0c-a186-4b28-9309-32d688f2bb79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:37:54.206274 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-77007f0c-a186-4b28-9309-32d688f2bb79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:37:54.207773 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4550/9189] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 02:37:54 2022] DELETE /identity/v3/projects/3bf88ea13f914730a38cef575bd4982d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:37:54.211873 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7eb0f3-21f9-4fc5-a497-25c9c38cfbdb admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:37:54.213316 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-6d7eb0f3-21f9-4fc5-a497-25c9c38cfbdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:37:54.226892 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7eb0f3-21f9-4fc5-a497-25c9c38cfbdb admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:37:54.268265 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:37:54.285383 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccaf78-a8ef-48d1-b89d-fe178b04e85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:37:54.286008 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccaf78-a8ef-48d1-b89d-fe178b04e85c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:37:54.286283 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccaf78-a8ef-48d1-b89d-fe178b04e85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:37:54.286555 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccaf78-a8ef-48d1-b89d-fe178b04e85c admin admin] PATH_INFO: `/v3/users/1990b5ef10354e61b0dcbb2dc183764a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:37:54.287669 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccaf78-a8ef-48d1-b89d-fe178b04e85c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1990b5ef10354e61b0dcbb2dc183764a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:37:54.289645 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccaf78-a8ef-48d1-b89d-fe178b04e85c admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:37:54.334366 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fcccaf78-a8ef-48d1-b89d-fe178b04e85c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1990b5ef10354e61b0dcbb2dc183764a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:37:54.342886 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fcccaf78-a8ef-48d1-b89d-fe178b04e85c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1990b5ef10354e61b0dcbb2dc183764a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:37:54.356011 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fcccaf78-a8ef-48d1-b89d-fe178b04e85c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1990b5ef10354e61b0dcbb2dc183764a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:37:54.356807 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fcccaf78-a8ef-48d1-b89d-fe178b04e85c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1990b5ef10354e61b0dcbb2dc183764a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:37:54.364614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-fcccaf78-a8ef-48d1-b89d-fe178b04e85c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1990b5ef10354e61b0dcbb2dc183764a'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:37:54.370386 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4640/9190] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 02:37:54 2022] DELETE /identity/v3/users/1990b5ef10354e61b0dcbb2dc183764a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:37:54.541677 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77007f0c-a186-4b28-9309-32d688f2bb79 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:37:54.543109 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-77007f0c-a186-4b28-9309-32d688f2bb79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:37:54.557675 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77007f0c-a186-4b28-9309-32d688f2bb79 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:37:54.615375 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918dfc3c-92ca-48dd-9249-5db930375735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:37:54.616044 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918dfc3c-92ca-48dd-9249-5db930375735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:37:54.616325 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918dfc3c-92ca-48dd-9249-5db930375735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:37:54.616596 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918dfc3c-92ca-48dd-9249-5db930375735 admin admin] PATH_INFO: `/v3/projects/040cf52b8acf4340ac8e42a11f872fd3` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:37:54.617715 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918dfc3c-92ca-48dd-9249-5db930375735 admin admin] RBAC: Authorizing `identity:delete_project(project_id=040cf52b8acf4340ac8e42a11f872fd3)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:37:54.619662 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918dfc3c-92ca-48dd-9249-5db930375735 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:37:54.640740 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:37:54.667842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-918dfc3c-92ca-48dd-9249-5db930375735 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '040cf52b8acf4340ac8e42a11f872fd3', 'request_id': 'req-918dfc3c-92ca-48dd-9249-5db930375735'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:37:54.673336 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-918dfc3c-92ca-48dd-9249-5db930375735 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '040cf52b8acf4340ac8e42a11f872fd3', 'request_id': 'req-918dfc3c-92ca-48dd-9249-5db930375735'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:37:54.681506 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-918dfc3c-92ca-48dd-9249-5db930375735 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '040cf52b8acf4340ac8e42a11f872fd3', 'request_id': 'req-918dfc3c-92ca-48dd-9249-5db930375735'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:37:54.694554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-918dfc3c-92ca-48dd-9249-5db930375735 admin admin] The token cache is being invalidate because project 040cf52b8acf4340ac8e42a11f872fd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 02:37:54.694841 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-918dfc3c-92ca-48dd-9249-5db930375735 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:37:54.695456 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-918dfc3c-92ca-48dd-9249-5db930375735 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:37:54.696976 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4551/9191] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 02:37:54 2022] DELETE /identity/v3/projects/040cf52b8acf4340ac8e42a11f872fd3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:37:54.702214 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15a5c9-9bb3-4ef6-ad57-1c6e0ebd4f02 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:37:54.702501 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15a5c9-9bb3-4ef6-ad57-1c6e0ebd4f02 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:37:54.702774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15a5c9-9bb3-4ef6-ad57-1c6e0ebd4f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:37:54.723209 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-8f15a5c9-9bb3-4ef6-ad57-1c6e0ebd4f02 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:37:54.724375 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8f15a5c9-9bb3-4ef6-ad57-1c6e0ebd4f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:37:54.782903 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4641/9192] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:37:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:37:54.790892 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c73b9-91e2-4aba-b6a1-3df8e9c4c9f8 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:37:54.791179 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c73b9-91e2-4aba-b6a1-3df8e9c4c9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:37:54.791453 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c73b9-91e2-4aba-b6a1-3df8e9c4c9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:37:54.812363 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-033c73b9-91e2-4aba-b6a1-3df8e9c4c9f8 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:37:54.814165 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-033c73b9-91e2-4aba-b6a1-3df8e9c4c9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:37:54.822021 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4552/9193] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:37:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:37:54.826261 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15a5c9-9bb3-4ef6-ad57-1c6e0ebd4f02 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:37:54.836311 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15a5c9-9bb3-4ef6-ad57-1c6e0ebd4f02 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:37:54.840816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac302541-e405-4db5-a8a0-54c7cae44e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:37:54.841487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac302541-e405-4db5-a8a0-54c7cae44e56 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:37:54.841759 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac302541-e405-4db5-a8a0-54c7cae44e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:37:54.842025 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac302541-e405-4db5-a8a0-54c7cae44e56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:37:54.842665 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac302541-e405-4db5-a8a0-54c7cae44e56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80492) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 07 02:37:54.842962 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac302541-e405-4db5-a8a0-54c7cae44e56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:37:54.844589 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac302541-e405-4db5-a8a0-54c7cae44e56 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:37:54.855917 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4642/9194] 10.222.0.39 () {58 vars in 1153 bytes} [Sun Aug 7 02:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 07 02:37:54.860716 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c73b9-91e2-4aba-b6a1-3df8e9c4c9f8 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:37:54.870179 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c73b9-91e2-4aba-b6a1-3df8e9c4c9f8 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:37:54.874810 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8706c-94ab-450a-9452-dcccaa664153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:37:54.875391 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8706c-94ab-450a-9452-dcccaa664153 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:37:54.876305 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8706c-94ab-450a-9452-dcccaa664153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:37:54.876580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8706c-94ab-450a-9452-dcccaa664153 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:37:54.877196 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8706c-94ab-450a-9452-dcccaa664153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:37:54.879071 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8706c-94ab-450a-9452-dcccaa664153 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:37:54.908730 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4553/9195] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 02:37:54 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 02:37:54.913077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac302541-e405-4db5-a8a0-54c7cae44e56 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:37:54.923610 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac302541-e405-4db5-a8a0-54c7cae44e56 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:37:54.969587 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:37:54.981320 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e32415-6e94-4547-aa9e-155d8ca4a589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:37:54.981840 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e32415-6e94-4547-aa9e-155d8ca4a589 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:37:54.982552 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e32415-6e94-4547-aa9e-155d8ca4a589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:37:54.983073 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e32415-6e94-4547-aa9e-155d8ca4a589 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:37:54.983722 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e32415-6e94-4547-aa9e-155d8ca4a589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:37:54.986208 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e32415-6e94-4547-aa9e-155d8ca4a589 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:37:55.011058 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4643/9196] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 02:37:54 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 02:37:55.015377 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8706c-94ab-450a-9452-dcccaa664153 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:37:55.025703 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8706c-94ab-450a-9452-dcccaa664153 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:37:55.030476 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db912cf9-dc1a-4aa0-b95b-f63d3b6fa193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:37:55.031072 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db912cf9-dc1a-4aa0-b95b-f63d3b6fa193 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:37:55.031351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db912cf9-dc1a-4aa0-b95b-f63d3b6fa193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:37:55.031647 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db912cf9-dc1a-4aa0-b95b-f63d3b6fa193 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:37:55.032400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db912cf9-dc1a-4aa0-b95b-f63d3b6fa193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:37:55.034055 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db912cf9-dc1a-4aa0-b95b-f63d3b6fa193 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:37:55.044521 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4554/9197] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 02:37:55.048869 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e32415-6e94-4547-aa9e-155d8ca4a589 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:37:55.058911 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e32415-6e94-4547-aa9e-155d8ca4a589 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:37:55.064154 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69361525-ee77-48bc-b661-c90db9d4c913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:37:55.064746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69361525-ee77-48bc-b661-c90db9d4c913 admin admin] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:37:55.065031 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69361525-ee77-48bc-b661-c90db9d4c913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:37:55.065306 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69361525-ee77-48bc-b661-c90db9d4c913 admin admin] PATH_INFO: `/v3/roles` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:37:55.065949 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69361525-ee77-48bc-b661-c90db9d4c913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:37:55.067541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69361525-ee77-48bc-b661-c90db9d4c913 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:37:55.078324 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4644/9198] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 02:37:55.082479 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db912cf9-dc1a-4aa0-b95b-f63d3b6fa193 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:37:55.092708 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db912cf9-dc1a-4aa0-b95b-f63d3b6fa193 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:37:55.097344 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c08692-7f15-4afe-977b-d6cbc331054d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:37:55.097991 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c08692-7f15-4afe-977b-d6cbc331054d admin admin] REQUEST_METHOD: `PUT` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:37:55.098271 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c08692-7f15-4afe-977b-d6cbc331054d admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:37:55.098545 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c08692-7f15-4afe-977b-d6cbc331054d admin admin] PATH_INFO: `/v3/projects/a1518999779440e38b3796e5bf91c262/users/1755f644c416482c955baa17a4b21f43/roles/979b0708a1934c50b706215aa79dbb7a` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:37:55.113532 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c08692-7f15-4afe-977b-d6cbc331054d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1518999779440e38b3796e5bf91c262, user_id=1755f644c416482c955baa17a4b21f43, role_id=979b0708a1934c50b706215aa79dbb7a)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:37:55.116261 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c08692-7f15-4afe-977b-d6cbc331054d admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:37:55.129558 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4555/9199] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 02:37:55 2022] PUT /identity/v3/projects/a1518999779440e38b3796e5bf91c262/users/1755f644c416482c955baa17a4b21f43/roles/979b0708a1934c50b706215aa79dbb7a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:37:55.134630 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2fd56-b130-48a1-a6a5-9f72c74590e1 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:37:55.134971 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2fd56-b130-48a1-a6a5-9f72c74590e1 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:37:55.135229 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2fd56-b130-48a1-a6a5-9f72c74590e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:37:55.153848 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-41a2fd56-b130-48a1-a6a5-9f72c74590e1 None None] MFA Rules not processed for user `e6bf2139d86940dda0c8934f84df710d`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:37:55.155036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-41a2fd56-b130-48a1-a6a5-9f72c74590e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:37:55.214622 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4645/9200] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 07 02:37:55.225003 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c08692-7f15-4afe-977b-d6cbc331054d admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:37:55.226720 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-79c08692-7f15-4afe-977b-d6cbc331054d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:37:55.304400 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c08692-7f15-4afe-977b-d6cbc331054d admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:37:55.308047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6dfe4-e21c-4b69-adfe-6fa94404e9e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:37:55.308645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6dfe4-e21c-4b69-adfe-6fa94404e9e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:37:55.308931 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6dfe4-e21c-4b69-adfe-6fa94404e9e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:37:55.309204 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6dfe4-e21c-4b69-adfe-6fa94404e9e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:37:55.318166 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6dfe4-e21c-4b69-adfe-6fa94404e9e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:37:55.319586 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6dfe4-e21c-4b69-adfe-6fa94404e9e9 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:37:55.329018 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4556/9201] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:37:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:37:59.367825 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186eefb-685f-434f-98e4-d8233f13f330 None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:37:59.368996 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186eefb-685f-434f-98e4-d8233f13f330 None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:37:59.369276 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186eefb-685f-434f-98e4-d8233f13f330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:37:59.398324 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-5186eefb-685f-434f-98e4-d8233f13f330 None None] MFA Rules not processed for user `1755f644c416482c955baa17a4b21f43`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:37:59.399517 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-5186eefb-685f-434f-98e4-d8233f13f330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:37:59.470909 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4646/9202] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:37:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:37:59.478844 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6dfe4-e21c-4b69-adfe-6fa94404e9e9 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:37:59.493179 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6dfe4-e21c-4b69-adfe-6fa94404e9e9 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:37:59.499132 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ee7f8-e2a8-4e0f-aff6-06c215cb56f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:37:59.503733 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ee7f8-e2a8-4e0f-aff6-06c215cb56f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:37:59.504555 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ee7f8-e2a8-4e0f-aff6-06c215cb56f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:37:59.505095 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ee7f8-e2a8-4e0f-aff6-06c215cb56f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:37:59.505850 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ee7f8-e2a8-4e0f-aff6-06c215cb56f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:37:59.509351 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ee7f8-e2a8-4e0f-aff6-06c215cb56f8 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:37:59.549774 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4557/9203] 10.222.0.39 () {60 vars in 1153 bytes} [Sun Aug 7 02:37:59 2022] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 07 02:37:59.556388 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186eefb-685f-434f-98e4-d8233f13f330 None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:37:59.569127 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186eefb-685f-434f-98e4-d8233f13f330 None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:37:59.639957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d896c7-dc32-40c8-a32d-ad966220aec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:37:59.640672 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d896c7-dc32-40c8-a32d-ad966220aec8 admin admin] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:37:59.641046 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d896c7-dc32-40c8-a32d-ad966220aec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:37:59.642173 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d896c7-dc32-40c8-a32d-ad966220aec8 admin admin] PATH_INFO: `/v3/users` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:37:59.642741 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d896c7-dc32-40c8-a32d-ad966220aec8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:37:59.645036 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d896c7-dc32-40c8-a32d-ad966220aec8 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:37:59.653642 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:37:59.673278 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4647/9204] 10.222.0.39 () {60 vars in 1144 bytes} [Sun Aug 7 02:37:59 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 07 02:37:59.674499 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ee7f8-e2a8-4e0f-aff6-06c215cb56f8 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:37:59.681428 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:37:59.685670 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ee7f8-e2a8-4e0f-aff6-06c215cb56f8 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:37:59.692950 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099c354-426e-4d27-b42f-c3d2e591a6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:37:59.693936 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099c354-426e-4d27-b42f-c3d2e591a6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:37:59.694448 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099c354-426e-4d27-b42f-c3d2e591a6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:37:59.694934 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099c354-426e-4d27-b42f-c3d2e591a6d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:37:59.695607 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099c354-426e-4d27-b42f-c3d2e591a6d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:37:59.697393 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a099c354-426e-4d27-b42f-c3d2e591a6d4 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:37:59.708955 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4558/9205] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 07 02:37:59.713321 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d896c7-dc32-40c8-a32d-ad966220aec8 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:37:59.723791 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d896c7-dc32-40c8-a32d-ad966220aec8 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:37:59.728584 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafa601-988e-4787-93a2-47c7ebe9545a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:37:59.729309 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafa601-988e-4787-93a2-47c7ebe9545a admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:37:59.729534 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafa601-988e-4787-93a2-47c7ebe9545a admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:37:59.729808 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafa601-988e-4787-93a2-47c7ebe9545a admin admin] PATH_INFO: `/v3/projects/2f29e36eaee84bafa8242d1f8a42b512/users/e5e4d6c7f78748179d6e6c803647b977/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:37:59.745888 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafa601-988e-4787-93a2-47c7ebe9545a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f29e36eaee84bafa8242d1f8a42b512, user_id=e5e4d6c7f78748179d6e6c803647b977, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:37:59.748600 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafa601-988e-4787-93a2-47c7ebe9545a admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:37:59.763398 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4648/9206] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 02:37:59 2022] PUT /identity/v3/projects/2f29e36eaee84bafa8242d1f8a42b512/users/e5e4d6c7f78748179d6e6c803647b977/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 07 02:37:59.768125 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099c354-426e-4d27-b42f-c3d2e591a6d4 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:37:59.778516 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099c354-426e-4d27-b42f-c3d2e591a6d4 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:37:59.838982 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8891043-d7af-421e-becd-20776e7ba2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:37:59.839598 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8891043-d7af-421e-becd-20776e7ba2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:37:59.839920 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8891043-d7af-421e-becd-20776e7ba2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:37:59.840199 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8891043-d7af-421e-becd-20776e7ba2c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:37:59.840868 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8891043-d7af-421e-becd-20776e7ba2c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:37:59.842467 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8891043-d7af-421e-becd-20776e7ba2c0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:37:59.853656 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4559/9207] 10.222.0.39 () {58 vars in 1122 bytes} [Sun Aug 7 02:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 07 02:37:59.858246 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafa601-988e-4787-93a2-47c7ebe9545a admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:37:59.871614 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafa601-988e-4787-93a2-47c7ebe9545a admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:37:59.876520 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0fdf5-d01e-4dc2-a6d0-b840f2937611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:37:59.877241 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0fdf5-d01e-4dc2-a6d0-b840f2937611 admin admin] REQUEST_METHOD: `PUT` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:37:59.877524 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0fdf5-d01e-4dc2-a6d0-b840f2937611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:37:59.877796 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0fdf5-d01e-4dc2-a6d0-b840f2937611 admin admin] PATH_INFO: `/v3/projects/2f29e36eaee84bafa8242d1f8a42b512/users/e5e4d6c7f78748179d6e6c803647b977/roles/695b07606e564668bac7afff4ab6052a` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:37:59.879748 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0fdf5-d01e-4dc2-a6d0-b840f2937611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f29e36eaee84bafa8242d1f8a42b512, user_id=e5e4d6c7f78748179d6e6c803647b977, role_id=695b07606e564668bac7afff4ab6052a)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:37:59.882545 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0fdf5-d01e-4dc2-a6d0-b840f2937611 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:37:59.893546 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4649/9208] 10.222.0.39 () {60 vars in 1483 bytes} [Sun Aug 7 02:37:59 2022] PUT /identity/v3/projects/2f29e36eaee84bafa8242d1f8a42b512/users/e5e4d6c7f78748179d6e6c803647b977/roles/695b07606e564668bac7afff4ab6052a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:38:04.020512 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44641f1a-a6e9-40b9-8297-528bb211b8d4 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:38:04.021038 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44641f1a-a6e9-40b9-8297-528bb211b8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:38:04.021142 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44641f1a-a6e9-40b9-8297-528bb211b8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:38:04.055632 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-44641f1a-a6e9-40b9-8297-528bb211b8d4 None None] MFA Rules not processed for user `e5e4d6c7f78748179d6e6c803647b977`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:38:04.056791 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-44641f1a-a6e9-40b9-8297-528bb211b8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:38:04.131033 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4560/9209] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:38:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:38:04.148345 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0fdf5-d01e-4dc2-a6d0-b840f2937611 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:38:04.151177 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-80b0fdf5-d01e-4dc2-a6d0-b840f2937611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:38:04.247146 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0fdf5-d01e-4dc2-a6d0-b840f2937611 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:38:04.255108 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e0a2c-53d7-409d-9002-02909243811e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:38:04.255843 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e0a2c-53d7-409d-9002-02909243811e service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:38:04.256158 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e0a2c-53d7-409d-9002-02909243811e service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:38:04.256424 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e0a2c-53d7-409d-9002-02909243811e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:38:04.358809 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e0a2c-53d7-409d-9002-02909243811e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:38:04.360766 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e0a2c-53d7-409d-9002-02909243811e service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:38:04.371838 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4650/9210] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:38:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:38:05.387329 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af76e1b-ff8c-4b06-aa2e-40d46ecc28ba None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:38:05.387858 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af76e1b-ff8c-4b06-aa2e-40d46ecc28ba None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:38:05.387995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af76e1b-ff8c-4b06-aa2e-40d46ecc28ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:38:05.406984 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-3af76e1b-ff8c-4b06-aa2e-40d46ecc28ba None None] MFA Rules not processed for user `1755f644c416482c955baa17a4b21f43`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:38:05.408223 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3af76e1b-ff8c-4b06-aa2e-40d46ecc28ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:38:05.415172 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4561/9211] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:38:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:38:05.748233 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e0a2c-53d7-409d-9002-02909243811e service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:38:05.749676 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-085e0a2c-53d7-409d-9002-02909243811e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:38:05.793872 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:38:05.811162 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e0a2c-53d7-409d-9002-02909243811e service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:38:05.814825 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e5a44-90e8-4b51-8cc4-69b4aa808cbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:38:05.815444 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e5a44-90e8-4b51-8cc4-69b4aa808cbd service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:38:05.815723 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e5a44-90e8-4b51-8cc4-69b4aa808cbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:38:05.816027 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e5a44-90e8-4b51-8cc4-69b4aa808cbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:38:05.817754 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a82e5a44-90e8-4b51-8cc4-69b4aa808cbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:38:05.829373 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e5a44-90e8-4b51-8cc4-69b4aa808cbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:38:05.831091 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e5a44-90e8-4b51-8cc4-69b4aa808cbd service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:38:05.840631 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4651/9212] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:38:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:38:06.196441 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af76e1b-ff8c-4b06-aa2e-40d46ecc28ba None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:38:06.198201 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-3af76e1b-ff8c-4b06-aa2e-40d46ecc28ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:38:06.280798 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af76e1b-ff8c-4b06-aa2e-40d46ecc28ba None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:38:06.286206 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ad1b5-8c1d-4e92-9bb6-b9544eb5c609 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:38:06.286974 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ad1b5-8c1d-4e92-9bb6-b9544eb5c609 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:38:06.287318 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ad1b5-8c1d-4e92-9bb6-b9544eb5c609 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:38:06.287683 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ad1b5-8c1d-4e92-9bb6-b9544eb5c609 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:38:06.289535 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-5c6ad1b5-8c1d-4e92-9bb6-b9544eb5c609 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:38:06.302358 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ad1b5-8c1d-4e92-9bb6-b9544eb5c609 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:38:06.303995 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6ad1b5-8c1d-4e92-9bb6-b9544eb5c609 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:38:06.308596 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=100 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:38:06.316401 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4562/9213] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:38:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:38:13.495386 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e5a44-90e8-4b51-8cc4-69b4aa808cbd service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:38:13.504648 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e5a44-90e8-4b51-8cc4-69b4aa808cbd service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:38:13.508297 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706e8ce-28fe-474a-bbbc-99f91fffc096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:38:13.508886 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706e8ce-28fe-474a-bbbc-99f91fffc096 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:38:13.509164 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706e8ce-28fe-474a-bbbc-99f91fffc096 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:38:13.509470 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706e8ce-28fe-474a-bbbc-99f91fffc096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:38:13.511189 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-3706e8ce-28fe-474a-bbbc-99f91fffc096 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:38:13.524267 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706e8ce-28fe-474a-bbbc-99f91fffc096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:38:13.525685 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706e8ce-28fe-474a-bbbc-99f91fffc096 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:38:13.536543 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4652/9214] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:38:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:38:13.981062 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ad1b5-8c1d-4e92-9bb6-b9544eb5c609 service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:38:13.994914 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6ad1b5-8c1d-4e92-9bb6-b9544eb5c609 service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:38:14.000809 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec600c-6400-4702-b661-7c63f28adfbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:38:14.001556 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec600c-6400-4702-b661-7c63f28adfbf service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:38:14.001842 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec600c-6400-4702-b661-7c63f28adfbf service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:38:14.002118 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec600c-6400-4702-b661-7c63f28adfbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:38:14.004217 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c9ec600c-6400-4702-b661-7c63f28adfbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:38:14.017953 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec600c-6400-4702-b661-7c63f28adfbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:38:14.019129 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec600c-6400-4702-b661-7c63f28adfbf service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:38:14.031122 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4563/9215] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:38:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:38:16.184907 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706e8ce-28fe-474a-bbbc-99f91fffc096 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:38:16.194059 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706e8ce-28fe-474a-bbbc-99f91fffc096 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:38:16.197739 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0e59b-7a30-4627-9339-bfe45c3bb7b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:38:16.198331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0e59b-7a30-4627-9339-bfe45c3bb7b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:38:16.198609 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0e59b-7a30-4627-9339-bfe45c3bb7b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:38:16.198881 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0e59b-7a30-4627-9339-bfe45c3bb7b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:38:16.208382 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0e59b-7a30-4627-9339-bfe45c3bb7b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:38:16.209804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0e59b-7a30-4627-9339-bfe45c3bb7b8 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:38:16.219200 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4653/9216] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:38:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:38:24.025834 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=7 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:38:26.215034 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=20 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:40:17.882608 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa8f3c-6d97-4512-944a-b95f0507262f None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:40:17.883131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa8f3c-6d97-4512-944a-b95f0507262f None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:40:17.883131 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa8f3c-6d97-4512-944a-b95f0507262f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:40:17.902584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-b6fa8f3c-6d97-4512-944a-b95f0507262f None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:40:17.903758 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-b6fa8f3c-6d97-4512-944a-b95f0507262f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:40:17.959293 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4564/9217] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 02:40:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:40:18.005148 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0e59b-7a30-4627-9339-bfe45c3bb7b8 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:40:18.006677 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-98a0e59b-7a30-4627-9339-bfe45c3bb7b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:40:18.078097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0e59b-7a30-4627-9339-bfe45c3bb7b8 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:40:18.084035 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acfbbcf-08bb-4f54-b714-b523d4546b5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:40:18.084654 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfbbcf-08bb-4f54-b714-b523d4546b5f service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:40:18.084927 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfbbcf-08bb-4f54-b714-b523d4546b5f service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:40:18.085196 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfbbcf-08bb-4f54-b714-b523d4546b5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:40:18.093948 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acfbbcf-08bb-4f54-b714-b523d4546b5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:40:18.095523 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acfbbcf-08bb-4f54-b714-b523d4546b5f service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:40:18.103613 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4654/9218] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 02:40:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 02:40:27.195352 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16756e3c-dae6-4df4-ac5c-d6bbaabcba99 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:40:27.195771 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16756e3c-dae6-4df4-ac5c-d6bbaabcba99 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:40:27.195921 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16756e3c-dae6-4df4-ac5c-d6bbaabcba99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:40:27.216712 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-16756e3c-dae6-4df4-ac5c-d6bbaabcba99 None None] MFA Rules not processed for user `1755f644c416482c955baa17a4b21f43`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:40:27.217901 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-16756e3c-dae6-4df4-ac5c-d6bbaabcba99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:40:27.225091 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4565/9219] 10.222.0.39 () {58 vars in 958 bytes} [Sun Aug 7 02:40:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:40:27.880527 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acfbbcf-08bb-4f54-b714-b523d4546b5f service swift] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:40:27.889811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acfbbcf-08bb-4f54-b714-b523d4546b5f service swift] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:40:27.893376 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da053eb-2ff7-4e7e-a8a2-1f98ece92045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:40:27.893969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da053eb-2ff7-4e7e-a8a2-1f98ece92045 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:40:27.894244 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da053eb-2ff7-4e7e-a8a2-1f98ece92045 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:40:27.894515 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da053eb-2ff7-4e7e-a8a2-1f98ece92045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:40:27.896262 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-8da053eb-2ff7-4e7e-a8a2-1f98ece92045 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:40:27.909782 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da053eb-2ff7-4e7e-a8a2-1f98ece92045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:40:27.911710 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da053eb-2ff7-4e7e-a8a2-1f98ece92045 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:40:27.922514 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4655/9220] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:40:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:40:29.115580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b8969-4fad-4df4-8e8b-95aee0ce3880 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:40:29.116124 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b8969-4fad-4df4-8e8b-95aee0ce3880 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:40:29.116281 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b8969-4fad-4df4-8e8b-95aee0ce3880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:40:29.135630 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-bc8b8969-4fad-4df4-8e8b-95aee0ce3880 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:40:29.137048 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-bc8b8969-4fad-4df4-8e8b-95aee0ce3880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:40:29.144460 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4566/9221] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 02:40:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:40:29.156991 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da053eb-2ff7-4e7e-a8a2-1f98ece92045 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:40:29.168684 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da053eb-2ff7-4e7e-a8a2-1f98ece92045 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:40:29.173804 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6241c0-f37e-423a-a211-1c995355ec7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:40:29.174508 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6241c0-f37e-423a-a211-1c995355ec7b service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:40:29.174784 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6241c0-f37e-423a-a211-1c995355ec7b service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:40:29.175062 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6241c0-f37e-423a-a211-1c995355ec7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:40:29.184331 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6241c0-f37e-423a-a211-1c995355ec7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:40:29.186077 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6241c0-f37e-423a-a211-1c995355ec7b service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:40:29.194960 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4656/9222] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 02:40:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 02:40:37.016643 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b8969-4fad-4df4-8e8b-95aee0ce3880 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:40:37.025969 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b8969-4fad-4df4-8e8b-95aee0ce3880 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:40:37.029554 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33700fe-ae2b-44be-b9a0-d105c68b8fa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:40:37.030155 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33700fe-ae2b-44be-b9a0-d105c68b8fa6 service neutron] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:40:37.030431 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33700fe-ae2b-44be-b9a0-d105c68b8fa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:40:37.030702 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33700fe-ae2b-44be-b9a0-d105c68b8fa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:40:37.032483 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a33700fe-ae2b-44be-b9a0-d105c68b8fa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:40:37.042165 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33700fe-ae2b-44be-b9a0-d105c68b8fa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:40:37.043580 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33700fe-ae2b-44be-b9a0-d105c68b8fa6 service neutron] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:40:37.052077 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4567/9223] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:40:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:40:37.720427 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6241c0-f37e-423a-a211-1c995355ec7b service swift] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:40:37.733832 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6241c0-f37e-423a-a211-1c995355ec7b service swift] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:40:37.740269 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de79caa-e6d1-4244-81a6-9f3ec1afba35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:40:37.740973 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de79caa-e6d1-4244-81a6-9f3ec1afba35 service nova] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:40:37.741528 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de79caa-e6d1-4244-81a6-9f3ec1afba35 service nova] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:40:37.741975 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de79caa-e6d1-4244-81a6-9f3ec1afba35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:40:37.743728 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-4de79caa-e6d1-4244-81a6-9f3ec1afba35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:40:37.756637 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de79caa-e6d1-4244-81a6-9f3ec1afba35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:40:37.758221 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de79caa-e6d1-4244-81a6-9f3ec1afba35 service nova] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:40:37.769626 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4657/9224] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:40:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:40:47.048007 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=37 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:40:47.764619 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=50 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:40:58.428869 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33700fe-ae2b-44be-b9a0-d105c68b8fa6 service neutron] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:40:58.430270 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-a33700fe-ae2b-44be-b9a0-d105c68b8fa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:40:58.454658 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33700fe-ae2b-44be-b9a0-d105c68b8fa6 service neutron] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:40:58.460438 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c8836-f764-4c7a-b196-8467b9714fc1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:40:58.461032 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c8836-f764-4c7a-b196-8467b9714fc1 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:40:58.461309 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c8836-f764-4c7a-b196-8467b9714fc1 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:40:58.461579 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c8836-f764-4c7a-b196-8467b9714fc1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:40:58.463276 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-ed3c8836-f764-4c7a-b196-8467b9714fc1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:40:58.474444 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c8836-f764-4c7a-b196-8467b9714fc1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:40:58.476058 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c8836-f764-4c7a-b196-8467b9714fc1 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:40:58.486048 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4568/9225] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:40:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:41:08.481662 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=10 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:41:40.516067 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de79caa-e6d1-4244-81a6-9f3ec1afba35 service nova] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:41:40.527942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de79caa-e6d1-4244-81a6-9f3ec1afba35 service nova] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:41:40.532969 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ead4f-05e1-412c-bc20-188c4a9c6d6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:41:40.533568 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ead4f-05e1-412c-bc20-188c4a9c6d6b service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:41:40.533845 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ead4f-05e1-412c-bc20-188c4a9c6d6b service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:41:40.534114 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ead4f-05e1-412c-bc20-188c4a9c6d6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:41:40.535811 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-d13ead4f-05e1-412c-bc20-188c4a9c6d6b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:41:40.559341 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ead4f-05e1-412c-bc20-188c4a9c6d6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:41:40.560939 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ead4f-05e1-412c-bc20-188c4a9c6d6b service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:41:40.571805 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4658/9226] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:41:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:41:50.566529 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=11 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:42:30.013971 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe44f86-1ce5-4689-8b2e-cc083c50c1cf None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:42:30.014514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe44f86-1ce5-4689-8b2e-cc083c50c1cf None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:42:30.014514 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe44f86-1ce5-4689-8b2e-cc083c50c1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:42:30.077019 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-efe44f86-1ce5-4689-8b2e-cc083c50c1cf None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:42:30.078257 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-efe44f86-1ce5-4689-8b2e-cc083c50c1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:42:30.106371 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4569/9227] 10.222.0.39 () {58 vars in 1009 bytes} [Sun Aug 7 02:42:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:42:30.147724 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ead4f-05e1-412c-bc20-188c4a9c6d6b service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:42:30.169989 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ead4f-05e1-412c-bc20-188c4a9c6d6b service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:42:30.176081 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0946bbe-603d-4b1f-8185-3f6bf3598032 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:42:30.176682 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0946bbe-603d-4b1f-8185-3f6bf3598032 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:42:30.176957 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0946bbe-603d-4b1f-8185-3f6bf3598032 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:42:30.177839 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0946bbe-603d-4b1f-8185-3f6bf3598032 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:42:30.187268 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0946bbe-603d-4b1f-8185-3f6bf3598032 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:42:30.188982 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0946bbe-603d-4b1f-8185-3f6bf3598032 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:42:30.197095 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4659/9228] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 02:42:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 02:42:39.211721 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220659b2-65fc-4d23-8e80-6c9d9da9d100 None None] REQUEST_METHOD: `POST` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:42:39.212307 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220659b2-65fc-4d23-8e80-6c9d9da9d100 None None] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:42:39.212307 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220659b2-65fc-4d23-8e80-6c9d9da9d100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:42:39.231258 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.auth.core [None req-220659b2-65fc-4d23-8e80-6c9d9da9d100 None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80493) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:42:39.232472 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-220659b2-65fc-4d23-8e80-6c9d9da9d100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:42:39.239501 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4570/9229] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 02:42:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:42:39.253593 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0946bbe-603d-4b1f-8185-3f6bf3598032 service swift] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:42:39.264942 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0946bbe-603d-4b1f-8185-3f6bf3598032 service swift] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:42:39.270526 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1d89b-c8e3-4a32-9aee-3eddbfc0d7a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:42:39.270700 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1d89b-c8e3-4a32-9aee-3eddbfc0d7a0 service swift] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:42:39.270888 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1d89b-c8e3-4a32-9aee-3eddbfc0d7a0 service swift] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:42:39.271165 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1d89b-c8e3-4a32-9aee-3eddbfc0d7a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:42:39.279532 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec1d89b-c8e3-4a32-9aee-3eddbfc0d7a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:42:39.281167 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec1d89b-c8e3-4a32-9aee-3eddbfc0d7a0 service swift] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:42:39.290054 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4660/9230] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 02:42:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 02:42:40.428793 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220659b2-65fc-4d23-8e80-6c9d9da9d100 None None] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:42:40.448693 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220659b2-65fc-4d23-8e80-6c9d9da9d100 None None] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:42:40.459821 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea45ad-04b0-41e5-a3b8-18d055431a6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c70d5a72d424db68de7c7b8257fe02c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:42:40.461182 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea45ad-04b0-41e5-a3b8-18d055431a6a service nova] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:42:40.461917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea45ad-04b0-41e5-a3b8-18d055431a6a service nova] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:42:40.462429 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea45ad-04b0-41e5-a3b8-18d055431a6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:42:40.464637 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8eea45ad-04b0-41e5-a3b8-18d055431a6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:42:40.496411 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea45ad-04b0-41e5-a3b8-18d055431a6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:42:40.497994 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea45ad-04b0-41e5-a3b8-18d055431a6a service nova] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:42:40.510447 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4571/9231] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:42:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 07 02:42:44.237503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226518f-77d5-400f-8fb4-bbd6779331ac None None] REQUEST_METHOD: `POST` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:42:44.237956 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226518f-77d5-400f-8fb4-bbd6779331ac None None] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:42:44.238071 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226518f-77d5-400f-8fb4-bbd6779331ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:42:44.257599 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.auth.core [None req-1226518f-77d5-400f-8fb4-bbd6779331ac None None] MFA Rules not processed for user `af48a86c031e400982666d661c9f4229`. Rule list: `[]` (Enabled: `True`). {{(pid=80492) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 07 02:42:44.258788 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-1226518f-77d5-400f-8fb4-bbd6779331ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:42:44.265856 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4661/9232] 10.222.0.39 () {58 vars in 967 bytes} [Sun Aug 7 02:42:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 07 02:42:44.277609 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea45ad-04b0-41e5-a3b8-18d055431a6a service nova] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:42:44.289190 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea45ad-04b0-41e5-a3b8-18d055431a6a service nova] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:42:44.294181 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f687a9-4142-4890-a9aa-5cc7125a267a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb5a86da594046ed97745371176decf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:42:44.294774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f687a9-4142-4890-a9aa-5cc7125a267a service swift] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:42:44.295050 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f687a9-4142-4890-a9aa-5cc7125a267a service swift] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:42:44.295328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f687a9-4142-4890-a9aa-5cc7125a267a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:42:44.303774 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f687a9-4142-4890-a9aa-5cc7125a267a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:42:44.305404 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f687a9-4142-4890-a9aa-5cc7125a267a service swift] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:42:44.313478 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4572/9233] 10.222.0.39 () {60 vars in 1384 bytes} [Sun Aug 7 02:42:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 07 02:42:45.602141 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226518f-77d5-400f-8fb4-bbd6779331ac None None] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:42:45.613625 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226518f-77d5-400f-8fb4-bbd6779331ac None None] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:42:45.619294 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc497ef-3898-42a1-9b28-5d94c1da4468 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:42:45.620087 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc497ef-3898-42a1-9b28-5d94c1da4468 service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:42:45.620369 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc497ef-3898-42a1-9b28-5d94c1da4468 service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:42:45.620774 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc497ef-3898-42a1-9b28-5d94c1da4468 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:42:45.623775 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-9fc497ef-3898-42a1-9b28-5d94c1da4468 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:42:45.636323 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc497ef-3898-42a1-9b28-5d94c1da4468 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:42:45.637781 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc497ef-3898-42a1-9b28-5d94c1da4468 service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:42:45.659961 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4662/9234] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:42:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:42:52.259723 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f687a9-4142-4890-a9aa-5cc7125a267a service swift] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:42:52.279406 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f687a9-4142-4890-a9aa-5cc7125a267a service swift] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:42:52.286319 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba8803-8e33-4fa5-b1fc-2f60698bef6e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:42:52.287047 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba8803-8e33-4fa5-b1fc-2f60698bef6e service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:42:52.290645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba8803-8e33-4fa5-b1fc-2f60698bef6e service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:42:52.290645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba8803-8e33-4fa5-b1fc-2f60698bef6e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:42:52.290645 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-67ba8803-8e33-4fa5-b1fc-2f60698bef6e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:42:52.303384 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba8803-8e33-4fa5-b1fc-2f60698bef6e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:42:52.305171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba8803-8e33-4fa5-b1fc-2f60698bef6e service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:42:52.316687 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4573/9235] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:42:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:42:55.025871 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc497ef-3898-42a1-9b28-5d94c1da4468 service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:42:55.030000 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=26 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:42:55.035699 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc497ef-3898-42a1-9b28-5d94c1da4468 service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:42:55.040097 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c395d03-ef46-4fe7-9df6-29c2197edbea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b219e01934fa477fbaa053cca586f01b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:42:55.040695 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c395d03-ef46-4fe7-9df6-29c2197edbea service neutron] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:42:55.040970 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c395d03-ef46-4fe7-9df6-29c2197edbea service neutron] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:42:55.041238 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c395d03-ef46-4fe7-9df6-29c2197edbea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:42:55.112425 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c395d03-ef46-4fe7-9df6-29c2197edbea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:42:55.113859 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c395d03-ef46-4fe7-9df6-29c2197edbea service neutron] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:42:55.124049 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4663/9236] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:42:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:42:55.629796 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba8803-8e33-4fa5-b1fc-2f60698bef6e service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:42:55.642017 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba8803-8e33-4fa5-b1fc-2f60698bef6e service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:42:55.648547 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68902f2b-ea16-402c-9527-43a04020d78e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:42:55.649227 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68902f2b-ea16-402c-9527-43a04020d78e service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:42:55.649583 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68902f2b-ea16-402c-9527-43a04020d78e service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:42:55.650080 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68902f2b-ea16-402c-9527-43a04020d78e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:42:55.652065 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-68902f2b-ea16-402c-9527-43a04020d78e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:42:55.667380 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68902f2b-ea16-402c-9527-43a04020d78e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:42:55.669571 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68902f2b-ea16-402c-9527-43a04020d78e service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:42:55.690985 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4574/9237] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:42:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:42:55.714253 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c395d03-ef46-4fe7-9df6-29c2197edbea service neutron] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:42:55.732500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c395d03-ef46-4fe7-9df6-29c2197edbea service neutron] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:42:55.737152 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb81bbe-abd4-4365-9f8b-c7bfd5e04140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:42:55.737777 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb81bbe-abd4-4365-9f8b-c7bfd5e04140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:42:55.738056 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb81bbe-abd4-4365-9f8b-c7bfd5e04140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:42:55.738336 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb81bbe-abd4-4365-9f8b-c7bfd5e04140 admin admin] PATH_INFO: `/v3/users/1755f644c416482c955baa17a4b21f43` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:42:55.739463 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb81bbe-abd4-4365-9f8b-c7bfd5e04140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1755f644c416482c955baa17a4b21f43)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:42:55.742169 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb81bbe-abd4-4365-9f8b-c7bfd5e04140 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:42:55.786230 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cdb81bbe-abd4-4365-9f8b-c7bfd5e04140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1755f644c416482c955baa17a4b21f43'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:42:55.793039 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cdb81bbe-abd4-4365-9f8b-c7bfd5e04140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1755f644c416482c955baa17a4b21f43'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:42:55.805353 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cdb81bbe-abd4-4365-9f8b-c7bfd5e04140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1755f644c416482c955baa17a4b21f43'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:42:55.805959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cdb81bbe-abd4-4365-9f8b-c7bfd5e04140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1755f644c416482c955baa17a4b21f43'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:42:55.824372 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-cdb81bbe-abd4-4365-9f8b-c7bfd5e04140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1755f644c416482c955baa17a4b21f43'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:42:55.835356 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4664/9238] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 02:42:55 2022] DELETE /identity/v3/users/1755f644c416482c955baa17a4b21f43 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:42:56.017452 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68902f2b-ea16-402c-9527-43a04020d78e service placement] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:42:56.030826 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68902f2b-ea16-402c-9527-43a04020d78e service placement] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:42:56.092957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f537339-7d8f-4ead-8820-7c91334688e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:42:56.093584 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f537339-7d8f-4ead-8820-7c91334688e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:42:56.093862 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f537339-7d8f-4ead-8820-7c91334688e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:42:56.094133 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f537339-7d8f-4ead-8820-7c91334688e2 admin admin] PATH_INFO: `/v3/projects/a1518999779440e38b3796e5bf91c262` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:42:56.095232 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f537339-7d8f-4ead-8820-7c91334688e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1518999779440e38b3796e5bf91c262)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:42:56.097171 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f537339-7d8f-4ead-8820-7c91334688e2 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:42:56.134934 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:42:56.145243 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1f537339-7d8f-4ead-8820-7c91334688e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1518999779440e38b3796e5bf91c262', 'request_id': 'req-1f537339-7d8f-4ead-8820-7c91334688e2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:42:56.157856 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1f537339-7d8f-4ead-8820-7c91334688e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1518999779440e38b3796e5bf91c262', 'request_id': 'req-1f537339-7d8f-4ead-8820-7c91334688e2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:42:56.164910 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1f537339-7d8f-4ead-8820-7c91334688e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1518999779440e38b3796e5bf91c262', 'request_id': 'req-1f537339-7d8f-4ead-8820-7c91334688e2'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:42:56.197674 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1f537339-7d8f-4ead-8820-7c91334688e2 admin admin] The token cache is being invalidate because project a1518999779440e38b3796e5bf91c262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 02:42:56.197957 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1f537339-7d8f-4ead-8820-7c91334688e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:42:56.198574 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-1f537339-7d8f-4ead-8820-7c91334688e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:42:56.200512 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4575/9239] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 02:42:56 2022] DELETE /identity/v3/projects/a1518999779440e38b3796e5bf91c262 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:42:56.205273 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb81bbe-abd4-4365-9f8b-c7bfd5e04140 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:42:56.206756 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-cdb81bbe-abd4-4365-9f8b-c7bfd5e04140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:42:56.219693 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb81bbe-abd4-4365-9f8b-c7bfd5e04140 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:42:56.274587 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3298038-c561-437b-ae6c-08bb8a8ccb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:42:56.275207 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3298038-c561-437b-ae6c-08bb8a8ccb79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:42:56.275487 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3298038-c561-437b-ae6c-08bb8a8ccb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:42:56.275757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3298038-c561-437b-ae6c-08bb8a8ccb79 admin admin] PATH_INFO: `/v3/users/e5e4d6c7f78748179d6e6c803647b977` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:42:56.276915 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3298038-c561-437b-ae6c-08bb8a8ccb79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5e4d6c7f78748179d6e6c803647b977)` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:42:56.278816 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3298038-c561-437b-ae6c-08bb8a8ccb79 admin admin] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:42:56.280264 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:42:56.326765 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e3298038-c561-437b-ae6c-08bb8a8ccb79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5e4d6c7f78748179d6e6c803647b977'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:42:56.333670 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e3298038-c561-437b-ae6c-08bb8a8ccb79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5e4d6c7f78748179d6e6c803647b977'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:42:56.345396 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e3298038-c561-437b-ae6c-08bb8a8ccb79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5e4d6c7f78748179d6e6c803647b977'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:42:56.346034 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e3298038-c561-437b-ae6c-08bb8a8ccb79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5e4d6c7f78748179d6e6c803647b977'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:42:56.354304 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.notifications [None req-e3298038-c561-437b-ae6c-08bb8a8ccb79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5e4d6c7f78748179d6e6c803647b977'} {{(pid=80492) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:42:56.360458 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4665/9240] 10.222.0.39 () {58 vars in 1224 bytes} [Sun Aug 7 02:42:56 2022] DELETE /identity/v3/users/e5e4d6c7f78748179d6e6c803647b977 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:42:56.539694 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f537339-7d8f-4ead-8820-7c91334688e2 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:42:56.541328 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-1f537339-7d8f-4ead-8820-7c91334688e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:42:56.554751 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f537339-7d8f-4ead-8820-7c91334688e2 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:42:56.612917 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea3b26-6120-4d01-9615-16d59c06f4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6bf2139d86940dda0c8934f84df710d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '62e0ba2ccef34e34b7ab3788b1ce6bb8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:42:56.613443 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea3b26-6120-4d01-9615-16d59c06f4c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:42:56.613723 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea3b26-6120-4d01-9615-16d59c06f4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:42:56.613987 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea3b26-6120-4d01-9615-16d59c06f4c0 admin admin] PATH_INFO: `/v3/projects/2f29e36eaee84bafa8242d1f8a42b512` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:42:56.615085 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea3b26-6120-4d01-9615-16d59c06f4c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f29e36eaee84bafa8242d1f8a42b512)` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:42:56.617320 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea3b26-6120-4d01-9615-16d59c06f4c0 admin admin] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:42:56.663389 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c2ea3b26-6120-4d01-9615-16d59c06f4c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f29e36eaee84bafa8242d1f8a42b512', 'request_id': 'req-c2ea3b26-6120-4d01-9615-16d59c06f4c0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:42:56.668992 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c2ea3b26-6120-4d01-9615-16d59c06f4c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f29e36eaee84bafa8242d1f8a42b512', 'request_id': 'req-c2ea3b26-6120-4d01-9615-16d59c06f4c0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:42:56.675292 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c2ea3b26-6120-4d01-9615-16d59c06f4c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f29e36eaee84bafa8242d1f8a42b512', 'request_id': 'req-c2ea3b26-6120-4d01-9615-16d59c06f4c0'} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:42:56.686723 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c2ea3b26-6120-4d01-9615-16d59c06f4c0 admin admin] The token cache is being invalidate because project 2f29e36eaee84bafa8242d1f8a42b512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80493) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 07 02:42:56.687013 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c2ea3b26-6120-4d01-9615-16d59c06f4c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:42:56.687631 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.notifications [None req-c2ea3b26-6120-4d01-9615-16d59c06f4c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80493) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 07 02:42:56.689151 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4576/9241] 10.222.0.39 () {58 vars in 1233 bytes} [Sun Aug 7 02:42:56 2022] DELETE /identity/v3/projects/2f29e36eaee84bafa8242d1f8a42b512 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 07 02:43:06.356992 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=26,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:43:06.683899 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=67,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:46:05.402760 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3298038-c561-437b-ae6c-08bb8a8ccb79 admin admin] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:46:05.404218 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-e3298038-c561-437b-ae6c-08bb8a8ccb79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:46:05.501415 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3298038-c561-437b-ae6c-08bb8a8ccb79 admin admin] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:46:05.559541 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c77fc8-c490-41ae-8ad2-a4841253e66a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:46:05.560203 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c77fc8-c490-41ae-8ad2-a4841253e66a service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:46:05.560484 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c77fc8-c490-41ae-8ad2-a4841253e66a service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:46:05.560757 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c77fc8-c490-41ae-8ad2-a4841253e66a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:46:05.562503 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a4c77fc8-c490-41ae-8ad2-a4841253e66a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:46:05.573500 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c77fc8-c490-41ae-8ad2-a4841253e66a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:46:05.575069 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c77fc8-c490-41ae-8ad2-a4841253e66a service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:46:05.584833 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4666/9242] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:46:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:46:15.580714 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=72 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:46:45.457559 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea3b26-6120-4d01-9615-16d59c06f4c0 admin admin] Authenticating user token {{(pid=80493) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:46:45.458964 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-c2ea3b26-6120-4d01-9615-16d59c06f4c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:46:45.517248 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea3b26-6120-4d01-9615-16d59c06f4c0 admin admin] Validating token access rules against request {{(pid=80493) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:46:45.522392 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743bcc3-70fd-42ae-a2f1-e612dd8b6719 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80493) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:46:45.522990 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743bcc3-70fd-42ae-a2f1-e612dd8b6719 service placement] REQUEST_METHOD: `GET` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:46:45.523273 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743bcc3-70fd-42ae-a2f1-e612dd8b6719 service placement] SCRIPT_NAME: `/identity` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:46:45.523548 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743bcc3-70fd-42ae-a2f1-e612dd8b6719 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80493) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:46:45.525286 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.fernet_utils [None req-8743bcc3-70fd-42ae-a2f1-e612dd8b6719 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80493) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:46:45.536927 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743bcc3-70fd-42ae-a2f1-e612dd8b6719 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:46:45.538496 n-d-master-1 devstack@keystone.service[80493]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743bcc3-70fd-42ae-a2f1-e612dd8b6719 service placement] RBAC: Authorization granted {{(pid=80493) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:46:45.548739 n-d-master-1 devstack@keystone.service[80493]: [pid: 80493|app: 0|req: 4577/9243] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:46:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:46:55.544086 n-d-master-1 devstack@keystone.service[80493]: DEBUG dbcounter [-] [80493] Writing DB stats keystone:SELECT=25 {{(pid=80493) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 07 02:51:07.385733 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c77fc8-c490-41ae-8ad2-a4841253e66a service placement] Authenticating user token {{(pid=80492) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 07 02:51:07.387110 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.fernet_utils [None req-a4c77fc8-c490-41ae-8ad2-a4841253e66a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80492) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 07 02:51:07.427346 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c77fc8-c490-41ae-8ad2-a4841253e66a service placement] Validating token access rules against request {{(pid=80492) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 07 02:51:07.433053 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ef0d8-ba3f-4785-9a0b-cd08eb2e0890 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3a1871b12e54ecdb9d656799385d05b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd2efda8567437e983e3a7867ecd69b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80492) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 07 02:51:07.433682 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ef0d8-ba3f-4785-9a0b-cd08eb2e0890 service placement] REQUEST_METHOD: `GET` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 07 02:51:07.433959 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ef0d8-ba3f-4785-9a0b-cd08eb2e0890 service placement] SCRIPT_NAME: `/identity` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 07 02:51:07.434226 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ef0d8-ba3f-4785-9a0b-cd08eb2e0890 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80492) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 07 02:51:07.442746 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ef0d8-ba3f-4785-9a0b-cd08eb2e0890 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 07 02:51:07.444350 n-d-master-1 devstack@keystone.service[80492]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ef0d8-ba3f-4785-9a0b-cd08eb2e0890 service placement] RBAC: Authorization granted {{(pid=80492) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 07 02:51:07.454586 n-d-master-1 devstack@keystone.service[80492]: [pid: 80492|app: 0|req: 4667/9244] 10.222.0.39 () {60 vars in 1365 bytes} [Sun Aug 7 02:51:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 07 02:51:17.450500 n-d-master-1 devstack@keystone.service[80492]: DEBUG dbcounter [-] [80492] Writing DB stats keystone:SELECT=18 {{(pid=80492) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}